-- Logs begin at Sat 2022-05-28 03:30:56 UTC, end at Sat 2022-05-28 06:23:39 UTC. -- May 28 04:23:18.804744 n-d-843700-1 systemd[1]: Starting Devstack devstack@n-api.service... May 28 04:23:18.813840 n-d-843700-1 devstack@n-api.service[104231]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 28 04:23:18.815843 n-d-843700-1 devstack@n-api.service[104231]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat May 28 04:23:18 2022] *** May 28 04:23:18.815843 n-d-843700-1 devstack@n-api.service[104231]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 28 04:23:18.815843 n-d-843700-1 devstack@n-api.service[104231]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 28 04:23:18.815843 n-d-843700-1 devstack@n-api.service[104231]: nodename: n-d-843700-1 May 28 04:23:18.815843 n-d-843700-1 devstack@n-api.service[104231]: machine: x86_64 May 28 04:23:18.815843 n-d-843700-1 devstack@n-api.service[104231]: clock source: unix May 28 04:23:18.815843 n-d-843700-1 devstack@n-api.service[104231]: pcre jit disabled May 28 04:23:18.815843 n-d-843700-1 devstack@n-api.service[104231]: detected number of CPU cores: 4 May 28 04:23:18.815843 n-d-843700-1 devstack@n-api.service[104231]: current working directory: / May 28 04:23:18.815843 n-d-843700-1 devstack@n-api.service[104231]: detected binary path: /usr/bin/uwsgi-core May 28 04:23:18.816537 n-d-843700-1 devstack@n-api.service[104231]: your processes number limit is 47680 May 28 04:23:18.816537 n-d-843700-1 devstack@n-api.service[104231]: your memory page size is 4096 bytes May 28 04:23:18.816537 n-d-843700-1 devstack@n-api.service[104231]: detected max file descriptor number: 2048 May 28 04:23:18.816537 n-d-843700-1 devstack@n-api.service[104231]: lock engine: pthread robust mutexes May 28 04:23:18.816537 n-d-843700-1 devstack@n-api.service[104231]: thunder lock: enabled May 28 04:23:18.816537 n-d-843700-1 devstack@n-api.service[104231]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 28 04:23:18.816537 n-d-843700-1 devstack@n-api.service[104231]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 28 04:23:18.861135 n-d-843700-1 devstack@n-api.service[104231]: Python main interpreter initialized at 0x55a56b16b9c0 May 28 04:23:18.861135 n-d-843700-1 devstack@n-api.service[104231]: python threads support enabled May 28 04:23:18.861135 n-d-843700-1 devstack@n-api.service[104231]: your server socket listen backlog is limited to 100 connections May 28 04:23:18.861135 n-d-843700-1 devstack@n-api.service[104231]: your mercy for graceful operations on workers is 90 seconds May 28 04:23:18.861464 n-d-843700-1 devstack@n-api.service[104231]: mapped 403077 bytes (393 KB) for 2 cores May 28 04:23:18.861546 n-d-843700-1 devstack@n-api.service[104231]: *** Operational MODE: preforking *** May 28 04:23:18.861789 n-d-843700-1 devstack@n-api.service[104231]: *** uWSGI is running in multiple interpreter mode *** May 28 04:23:18.861789 n-d-843700-1 devstack@n-api.service[104231]: spawned uWSGI master process (pid: 104231) May 28 04:23:18.861962 n-d-843700-1 systemd[1]: Started Devstack devstack@n-api.service. May 28 04:23:18.863046 n-d-843700-1 devstack@n-api.service[104231]: spawned uWSGI worker 1 (pid: 104232, cores: 1) May 28 04:23:18.863046 n-d-843700-1 devstack@n-api.service[104231]: spawned uWSGI worker 2 (pid: 104233, cores: 1) May 28 04:23:18.863046 n-d-843700-1 devstack@n-api.service[104231]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 28 04:23:20.025333 n-d-843700-1 devstack@n-api.service[104233]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 28 04:23:20.035672 n-d-843700-1 devstack@n-api.service[104232]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 28 04:23:20.747349 n-d-843700-1 devstack@n-api.service[104233]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 04:23:20.747349 n-d-843700-1 devstack@n-api.service[104233]: from cryptography.utils import int_from_bytes May 28 04:23:20.747863 n-d-843700-1 devstack@n-api.service[104233]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 04:23:20.747863 n-d-843700-1 devstack@n-api.service[104233]: from cryptography.utils import int_from_bytes May 28 04:23:20.752478 n-d-843700-1 devstack@n-api.service[104232]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 04:23:20.752478 n-d-843700-1 devstack@n-api.service[104232]: from cryptography.utils import int_from_bytes May 28 04:23:20.752825 n-d-843700-1 devstack@n-api.service[104232]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 04:23:20.752825 n-d-843700-1 devstack@n-api.service[104232]: from cryptography.utils import int_from_bytes May 28 04:23:23.328820 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 28 04:23:23.329390 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 28 04:23:23.329589 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 28 04:23:23.329953 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 28 04:23:23.330212 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 28 04:23:23.330598 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.330934 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.336411 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 28 04:23:23.336411 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 28 04:23:23.336919 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.336919 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.337057 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 28 04:23:23.337129 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.337201 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 28 04:23:23.337275 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.337345 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 28 04:23:23.337419 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.337499 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.337564 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.337632 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.337700 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.337772 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.337840 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.337840 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.337978 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.338049 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-843700-1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.338118 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.338187 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.338262 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.338335 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.338405 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.338473 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.338537 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.338613 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.338683 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.338753 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.338822 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.338890 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.338962 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.339062 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.339144 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-843700-1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.339144 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.339276 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.339366 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.339440 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.339515 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.339584 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.339648 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.339715 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.339782 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.339927 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.340000 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.340071 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.340140 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.340208 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.340208 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.340344 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.340423 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.340498 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.340571 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.340643 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.340718 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.340788 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.340788 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.340912 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-843700-1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.341091 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.341672 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.341750 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.341835 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.341835 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.341949 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.342064 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.342187 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.342375 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.342511 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.342743 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.342856 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.343184 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-843700-1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.343289 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.343515 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.343630 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.343826 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.343925 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.344154 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.344326 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.344473 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.344614 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.344781 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.344912 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.345104 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.345259 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.345393 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.345534 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.345708 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.345845 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.346018 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.346181 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.346444 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.346573 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.346758 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.346886 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.347092 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.347236 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.347380 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.347519 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.347651 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.347794 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.347944 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.348083 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.348262 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.348404 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.348588 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.348727 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.348876 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.349010 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.349151 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.349291 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.349429 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.349574 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.349718 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.349862 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.350002 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.350145 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.350276 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.350420 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.350580 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.350713 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.350888 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.350979 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.351221 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.351319 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.351598 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.351688 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.351928 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.352018 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.352244 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.352329 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.352559 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.352643 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.353137 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.353235 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.353447 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.353531 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.353758 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.353865 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.354073 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.354170 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.354383 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.354487 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.354695 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.354786 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.355061 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.355151 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.355364 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.355450 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.355686 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.355794 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.355999 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.356095 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.356323 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.356406 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.356681 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.356770 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.356991 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.357084 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.357334 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.357480 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.357641 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.357726 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.357964 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.358059 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.358289 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.358380 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.358598 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.358695 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.358849 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.358949 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.359177 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.359281 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.359486 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.359570 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.359807 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.359903 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.360114 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.360205 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.360422 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.360507 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.360728 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.360814 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.361031 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.361120 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.361336 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.361424 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.361642 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.361737 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.361950 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.362040 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.362259 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.362349 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.362565 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.362650 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.362871 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.362956 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.363203 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.363304 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.363509 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.363593 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.363818 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.363902 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.364134 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.364258 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.364449 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.364543 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.364758 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.364851 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.365065 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.365251 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.365373 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.365570 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.365716 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.365850 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.366000 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.366144 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.366276 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.366457 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.366600 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.366734 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.366866 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.367039 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.367192 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.367277 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.367500 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.367593 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.367808 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.367902 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.368113 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.368203 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.368421 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.368505 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.368729 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.368820 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.369030 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.369113 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.369336 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.369421 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.369644 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.369739 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.369948 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.370045 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.370253 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.370345 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.370558 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.370643 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.370863 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.370954 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.371189 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.371286 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.371495 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.371591 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.371800 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.371891 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.372104 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.372250 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.372497 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.372595 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.372806 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.372890 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.373116 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.373208 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.373427 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.373512 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.373736 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.373922 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.374043 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.374127 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.374356 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.374451 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.374657 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.374749 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.374980 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.375124 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.375329 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.375426 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.375640 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.375725 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.375950 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.376044 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.376259 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.376351 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.376582 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:23:23.376673 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.376913 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.377005 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.377231 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.377323 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.377560 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.377652 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.377875 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.377973 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.378191 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.378276 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.378505 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.378596 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.378826 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.378911 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.379167 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.379267 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.379486 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.379569 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.379809 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.379893 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.380124 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.380212 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.380443 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.380540 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.380757 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.380861 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.381075 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.381160 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.381406 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.381499 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.381733 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.381818 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.382048 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.382131 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.382392 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.382485 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.382741 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.382836 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.383079 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.383169 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.383403 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.383497 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.383730 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.383814 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.384046 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.384130 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.384425 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.384536 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.384671 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.384755 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.384997 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.385081 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.385332 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.385488 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.385649 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.385741 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.385972 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.386057 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.386288 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.386451 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.386599 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.386683 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.386911 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.387018 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.387250 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.387344 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.387563 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.387655 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.388416 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.388517 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.388804 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.388890 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.389219 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.389349 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.389539 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.389788 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.389882 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.390116 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.390201 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.390440 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.390524 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.390763 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.390862 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.391100 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.391187 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.391411 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.391505 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.391722 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.391815 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.392035 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.392119 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.392343 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.392428 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.392667 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.392759 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.392999 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.393083 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.393310 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.393396 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.393620 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.393705 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.393934 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.394018 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.394247 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.394332 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.394559 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.394655 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.394867 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.394951 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.395200 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.395287 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.395514 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.395601 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.395826 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.395910 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.396135 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.396234 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.396461 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.396545 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.396772 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.396868 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.397077 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.397171 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.397390 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.397474 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.397696 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.397788 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.398003 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.398097 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.398315 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.398399 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.398625 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.398708 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.398936 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.399047 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.399274 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.399361 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.399583 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.399666 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.399905 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.399990 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.400215 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.400299 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.400526 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.400610 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.400846 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.400930 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.401167 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.401258 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.401476 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.401560 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.401791 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.401876 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.402105 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.402189 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.402423 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.402506 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.402730 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.402816 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.403064 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.403164 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.403375 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.404111 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.404249 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.404335 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.404576 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.404713 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.404873 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.404967 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.405179 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.405264 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.405486 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.405579 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.405793 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.405891 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.406100 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.406191 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.406407 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.406501 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.406732 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.406826 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.407067 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.407157 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.407376 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.407459 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.407682 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.407769 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.407988 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.408073 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.408296 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.408380 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.408608 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.408703 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.408920 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.409005 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.409250 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.409333 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.409566 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.409652 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.409878 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.409963 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.410189 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.410285 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.410499 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.410592 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.410810 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.410894 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.411149 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.411251 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.411467 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.411559 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.411784 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.411869 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.412109 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.412201 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.412425 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.412516 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.412749 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.412841 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.413064 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.413157 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.413386 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.413469 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.413705 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.413798 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.414025 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.414149 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.414331 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.414417 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.414650 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.414741 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.414966 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.415088 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.415314 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.415398 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.415631 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.415715 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.415959 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.416051 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.416271 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.416356 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.416587 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.416678 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.416898 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.416983 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.417209 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.417291 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.417521 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.417605 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.417850 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.417951 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.418158 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.418250 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.418470 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.418553 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.418790 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.418885 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.419161 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.419252 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.419481 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.419575 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.419792 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.419875 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.420105 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.420190 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.420412 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.420509 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.420728 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.420812 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.421050 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.421133 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.421377 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.421469 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.421686 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.421777 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.422000 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.422097 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.422316 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.422409 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.422628 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.422719 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.422943 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.423038 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.423281 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.423366 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.423598 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.423683 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.423907 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.423998 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.424219 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.424304 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.424536 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.424628 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.424847 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.424948 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.425159 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.425245 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.425468 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.425552 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.425784 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.425874 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.426093 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.426191 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.426401 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.426492 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.426706 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.426799 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.427030 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.427118 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.427353 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.427436 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.427664 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.427755 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.427975 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.428057 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.428296 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.428380 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.428602 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.428695 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.428909 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.428993 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.429217 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.429307 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.429528 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.429617 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.429834 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.429919 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.430142 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.430233 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.430448 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.430532 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.430781 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.430872 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.431114 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.431195 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.431422 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.431507 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.431739 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.431823 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.432052 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.432134 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.432362 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.432453 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.432668 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.432751 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.432975 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.433059 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.433283 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.433367 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.433615 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.433699 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.433924 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.434015 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.434231 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.434314 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.434542 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.434653 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.434876 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.434967 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.435210 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.435297 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.435524 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.435607 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.435841 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.435977 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.436148 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.436239 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.436459 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.436543 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.436771 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.436872 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.437077 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.437162 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.437389 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.437483 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.437705 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.437797 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.438022 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.438272 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.438357 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.438608 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.438700 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.438927 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.439056 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.439276 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.439368 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.439583 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.439684 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.439900 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.439991 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.440222 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.440307 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.440551 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.440792 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.440899 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.441138 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.441237 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.441462 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.441554 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.441787 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.441879 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.442106 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.442190 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.442421 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.442512 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.442731 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.442824 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.443060 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.443161 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.443372 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.443457 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.443691 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.443788 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.443999 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.444085 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.444307 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.444398 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.444613 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.444704 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.444920 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.445013 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.445237 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.445323 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.445543 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.445638 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.445853 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.445944 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.446157 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.446248 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.446467 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.446561 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.446779 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.446863 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.447120 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.447217 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.447418 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.447516 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.447724 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.447818 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.448033 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.448118 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.448351 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.448445 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.448662 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.448755 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.448991 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.449077 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.449306 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.449392 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.449617 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.449702 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.449922 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.450012 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.450228 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.450835 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.451087 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.451174 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.451397 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.451490 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.451706 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.451799 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.452020 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.452104 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.452334 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.452427 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.452641 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.452726 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.452954 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.453039 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.453264 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.453358 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.453576 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.453660 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.453890 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.453975 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.454195 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.454293 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.454505 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.454589 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.454810 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.454902 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.455142 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.455242 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.455455 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.455539 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.455760 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.455845 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.456068 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.456163 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.456380 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.456466 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.456686 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.456769 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.456991 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.457083 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.457299 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.457389 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.457601 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.457686 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.457920 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.458012 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.458227 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.458312 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.458535 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.458619 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.458839 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.458923 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.459177 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.459263 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.459488 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.459584 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.459794 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.459879 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.460101 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.460193 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.460419 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.460512 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.460727 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.460818 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.461034 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.461120 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.461345 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.461439 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.461652 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.461737 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.461956 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.462049 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.462266 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.462367 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.462590 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.462675 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.462902 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.463004 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.463232 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.463325 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.463546 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.463630 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.463855 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.463939 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.464161 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.464247 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.464465 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.464549 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.464774 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.464858 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.465079 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.465173 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.465383 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.465471 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.465689 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.465809 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.466531 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.466628 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.466841 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.466926 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.467212 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.467312 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.467525 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.467610 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.467833 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.467918 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.468140 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.468233 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.468443 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.468529 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.468750 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.468842 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.469061 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.469155 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.469371 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.469464 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.469701 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.469787 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.470017 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.470111 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.470329 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.470421 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.470639 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.470724 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.470947 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.471053 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.471285 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.471381 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.471594 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.471680 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.471913 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.472000 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.472226 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.472311 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.472541 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.472633 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.472849 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.472936 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.473156 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.473242 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.473479 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.473565 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.473796 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.473882 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.474111 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.474201 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.474432 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.474518 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.474748 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.474841 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.475098 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.475197 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.475408 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.475501 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.475717 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.475802 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.476030 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.476113 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.476342 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.476435 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.476656 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.476740 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.476964 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.477056 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.477277 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.477371 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.477590 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.477676 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.478175 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.478261 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.478488 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.478581 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.478800 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.478885 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.479136 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.479232 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.479450 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.479535 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.479762 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.479854 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.480070 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.480154 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.480383 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.480475 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.480699 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.480783 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.481009 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.481093 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.481320 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.481406 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.481650 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.481738 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.481961 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.482046 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.482266 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.482359 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.482658 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.482742 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.483014 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.483114 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.483327 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.483414 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.483636 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.483720 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.483948 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.484041 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.484257 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.484349 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.484572 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.484656 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.484879 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.484975 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.485185 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.485307 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.485607 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.485692 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.485920 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.486061 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.486228 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.486313 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.486539 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.486623 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.486847 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.486933 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.487189 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.487274 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.487502 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.487586 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.487811 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.487897 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.488126 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.488235 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.488435 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.488551 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.488741 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.488867 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.489065 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.489184 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.489372 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.489494 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.489694 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.489805 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.490114 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.490200 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.490428 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.490521 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.490737 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.490821 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.491153 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.491241 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.491473 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.491570 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.491783 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.491868 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.492100 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.492183 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.492420 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.492511 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.492744 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.492829 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.493051 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.493135 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.493366 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.493459 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.493679 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.493856 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.494010 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.494174 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.494337 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.494492 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.494650 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.494822 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.494968 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.495187 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.495298 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.495522 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.495660 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.495838 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.495923 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.496158 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.496243 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.496475 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.496568 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.496808 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.496944 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.497151 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.497294 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.497477 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.497609 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.497799 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.497932 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.498113 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.498264 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.498442 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.498576 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.498773 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.498886 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.499116 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.499230 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.499448 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.499535 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.499835 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.499920 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.500160 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.500245 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.500469 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.500555 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.500781 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.500867 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.501094 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.501178 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.501406 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.501492 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.501736 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.501876 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.502045 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.502140 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.502370 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.502456 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.502680 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.502773 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.503024 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.503128 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.503341 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.503426 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.503659 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.503751 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.503976 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.504070 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.504281 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.504366 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.504591 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.504675 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.504901 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.504995 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.505220 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.505312 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.505535 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.505649 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.505885 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.505986 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.506231 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.506319 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.506541 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.506626 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.506863 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.507007 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.507231 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.507317 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.507563 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.507650 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.507881 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.507967 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.508191 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.508283 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.508501 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.508593 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.508813 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.508907 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.509143 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.509235 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.509462 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.509547 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.509767 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.509852 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.510072 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.510157 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.510385 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.510484 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.510693 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.510778 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.511039 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.511140 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.511329 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.511467 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.511638 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.511731 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.511943 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.512073 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.512247 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.512342 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.512551 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.512637 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.513440 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.513581 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.513733 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.513828 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.514058 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.514150 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.514374 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.514460 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.514682 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.514768 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.515008 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.515098 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.515322 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.515407 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.515629 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.515715 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.515940 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.516026 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.516306 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.516403 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.516620 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.516720 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.517015 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.517104 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.517334 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.517419 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.517645 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.517731 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.517957 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.518042 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.518300 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.518497 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.518650 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.518825 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.518961 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.519173 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.519331 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.519489 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.519653 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.519799 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.519980 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.520117 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.520315 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.520435 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.520631 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.520748 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.520958 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.521065 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.521280 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.521418 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.521599 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.521685 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.521924 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.522190 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.522287 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.522519 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.522695 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.522837 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.523049 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.523177 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.523374 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.523494 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.523692 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.523809 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.524014 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.524129 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.524334 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.524440 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.524657 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.524742 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.525050 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.525178 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.525363 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.525515 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.525690 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.525837 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.526012 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.526157 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.526339 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.526469 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.526677 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.526782 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.527005 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.527175 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.527332 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.527417 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.527647 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.527733 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.527962 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.528056 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.528318 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.528970 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.529171 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.529258 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.529484 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.529571 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.529800 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.529885 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.530117 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.530202 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.530433 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.530525 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.530745 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.530837 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.531087 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.531190 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.531405 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.531500 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.531720 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.531812 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.532033 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.532127 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.532345 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.532434 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.532659 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.532751 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.532975 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.533061 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.533301 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.533386 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.533621 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.533706 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.533939 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.534026 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.534259 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.534343 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.534575 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.534660 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.534892 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.534978 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.535235 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.535435 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.535556 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.535751 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.535878 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.536085 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.536210 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.536414 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.536545 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.536739 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.536868 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.537055 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.537188 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.537375 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.537506 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.537703 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.537830 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.538011 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.538320 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.538440 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.538634 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.538728 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.538946 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.539061 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.539278 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.539363 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.539601 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.539696 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.539911 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.539996 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.540215 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.540312 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.540539 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.540625 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.540850 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.540943 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.541208 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.541384 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.541527 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.541731 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.541850 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.542048 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.542162 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.542375 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.542492 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.542703 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.542810 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.543044 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.543133 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.543357 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.543464 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.543683 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.543768 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.543994 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.544330 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.544426 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.544648 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.544735 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.544964 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.545050 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.545273 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.545372 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.545581 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.545675 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.545892 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.545977 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.546202 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.546296 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.546509 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.546633 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.546820 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.546905 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.547151 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.547240 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.547481 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.547566 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.547788 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.547884 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.548097 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.548190 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.548403 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.548496 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.548715 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.548800 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.549020 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.549106 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.549326 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.549411 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.549633 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.549719 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.549936 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.550022 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.550248 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.550334 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.550552 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.550646 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.550860 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.550945 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.551191 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.551290 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.551504 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.551601 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.551809 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.551894 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.552119 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.552203 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.552435 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.552528 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.552748 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.552833 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.553066 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.553158 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.553370 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.553464 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.553685 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.553770 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.553996 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.554079 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.554312 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.554398 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.554626 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.554710 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.554940 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.555042 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.555310 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.555403 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.555626 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.555716 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.555944 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.556162 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.556260 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.556502 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.556588 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.556826 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.556910 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.557161 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.557327 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.557486 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.557573 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.557796 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.557888 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.558107 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.558194 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.558419 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.558504 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.558746 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.558979 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.559098 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.559346 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.559432 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.559698 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.559787 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.560014 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.560107 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.560331 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.560416 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.560644 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.560730 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.560959 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.561046 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.561271 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.561430 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.561583 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.561669 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.561895 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.561989 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.562206 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.562292 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.562521 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.562619 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.562832 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.562919 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.563172 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.563261 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.563489 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.563591 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.563807 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.563893 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.564123 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.564216 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.564440 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.564538 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.564755 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.564846 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.565069 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.565154 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.565380 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.565478 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.565690 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.565776 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.566002 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.566096 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.566318 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.566413 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.566651 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.566738 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.566969 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.567095 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.567304 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.567392 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.567653 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.567745 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.567973 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.568058 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.568291 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.568378 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.568610 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.568696 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.568928 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.569020 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.569252 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.569339 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.569581 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.569667 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.569894 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.569989 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.570204 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.570289 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.570517 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.570629 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.570848 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.570943 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.571216 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.571304 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.571550 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.571635 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.571878 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.571980 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.572188 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.572274 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.572497 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.572647 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.572804 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.572890 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.573115 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.573207 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.573437 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.573522 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.573750 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.573837 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.574057 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.574143 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.574369 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.574455 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.574680 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.574773 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.575002 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.575101 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.575837 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.575942 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.576147 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.576233 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.576457 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.576557 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.576765 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.576860 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.577071 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.577163 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.577376 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.577461 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.577680 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.577774 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.577986 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.578072 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.578291 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.578377 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.578596 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.578690 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.578904 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.579041 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.579232 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.579328 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.579537 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.579632 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.579840 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.579927 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.580146 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.580231 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.580450 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.580537 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.580757 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.580841 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.581069 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.581154 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.581379 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.581523 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.581693 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.581780 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.582003 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.582088 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.582319 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.582412 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.582627 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.582764 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.582934 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.583050 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.583270 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.583356 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.583599 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.583684 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.583910 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.584003 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.584242 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.584327 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.584559 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.584644 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.584874 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.584970 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.585184 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.585270 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.585495 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.585582 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.585807 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.585906 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.586120 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.586206 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.586511 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.586618 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.586771 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.586865 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.587090 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.587181 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.587417 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.587503 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.587738 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.587825 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.588059 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.588145 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.588372 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.588457 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.588684 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.588778 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.589000 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.589087 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.589313 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.589407 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.589624 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.589711 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.589940 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.590025 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.590251 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.590345 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.590560 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.590646 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.590878 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.591528 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.591758 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.591854 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.592085 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.592169 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.592411 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.592495 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.592723 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.592850 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.593036 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.593129 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.593357 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.593441 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.593673 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.593767 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.593990 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.594082 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.594313 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.594399 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.594633 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.594719 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.594955 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.595075 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.595293 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.595380 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.595600 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.595695 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.595844 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 28 04:23:23.595931 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.596253 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.596610 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.596931 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.597276 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.597610 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.597932 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.598248 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.598559 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:23:23.598807 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 28 04:23:23.655315 n-d-843700-1 devstack@n-api.service[104233]: INFO dbcounter [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] Registered counter for database nova_api May 28 04:23:23.658453 n-d-843700-1 devstack@n-api.service[104232]: INFO dbcounter [None req-bbb8f63b-41db-42d3-9949-6a50dd77b823 None None] Registered counter for database nova_api May 28 04:23:23.675730 n-d-843700-1 devstack@n-api.service[104233]: DEBUG oslo_db.sqlalchemy.engines [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 04:23:23.679411 n-d-843700-1 devstack@n-api.service[104232]: DEBUG oslo_db.sqlalchemy.engines [None req-bbb8f63b-41db-42d3-9949-6a50dd77b823 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 04:23:23.682314 n-d-843700-1 devstack@n-api.service[104233]: DEBUG dbcounter [-] [104233] Writer thread running {{(pid=104233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 04:23:23.686575 n-d-843700-1 devstack@n-api.service[104232]: DEBUG dbcounter [-] [104232] Writer thread running {{(pid=104232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 04:23:23.739520 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.context [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8c12a9b9-d304-4763-b71f-4058d5ce2ded(cell1) {{(pid=104233) load_cells /opt/stack/nova/nova/context.py:464}} May 28 04:23:23.743368 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.context [None req-bbb8f63b-41db-42d3-9949-6a50dd77b823 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8c12a9b9-d304-4763-b71f-4058d5ce2ded(cell1) {{(pid=104232) load_cells /opt/stack/nova/nova/context.py:464}} May 28 04:23:23.743647 n-d-843700-1 devstack@n-api.service[104233]: DEBUG oslo_concurrency.lockutils [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:23:23.745221 n-d-843700-1 devstack@n-api.service[104233]: DEBUG oslo_concurrency.lockutils [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:23:23.746010 n-d-843700-1 devstack@n-api.service[104233]: DEBUG oslo_concurrency.lockutils [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:23:23.747979 n-d-843700-1 devstack@n-api.service[104232]: DEBUG oslo_concurrency.lockutils [None req-bbb8f63b-41db-42d3-9949-6a50dd77b823 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:23:23.748530 n-d-843700-1 devstack@n-api.service[104233]: DEBUG oslo_concurrency.lockutils [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:23:23.749541 n-d-843700-1 devstack@n-api.service[104232]: DEBUG oslo_concurrency.lockutils [None req-bbb8f63b-41db-42d3-9949-6a50dd77b823 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:23:23.750334 n-d-843700-1 devstack@n-api.service[104232]: DEBUG oslo_concurrency.lockutils [None req-bbb8f63b-41db-42d3-9949-6a50dd77b823 None None] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:23:23.750506 n-d-843700-1 devstack@n-api.service[104233]: INFO dbcounter [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] Registered counter for database nova_cell0 May 28 04:23:23.752350 n-d-843700-1 devstack@n-api.service[104232]: DEBUG oslo_concurrency.lockutils [None req-bbb8f63b-41db-42d3-9949-6a50dd77b823 None None] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:23:23.754330 n-d-843700-1 devstack@n-api.service[104232]: INFO dbcounter [None req-bbb8f63b-41db-42d3-9949-6a50dd77b823 None None] Registered counter for database nova_cell0 May 28 04:23:23.754463 n-d-843700-1 devstack@n-api.service[104233]: INFO dbcounter [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] Registered counter for database nova_cell1 May 28 04:23:23.758284 n-d-843700-1 devstack@n-api.service[104232]: INFO dbcounter [None req-bbb8f63b-41db-42d3-9949-6a50dd77b823 None None] Registered counter for database nova_cell1 May 28 04:23:23.761884 n-d-843700-1 devstack@n-api.service[104233]: DEBUG oslo_db.sqlalchemy.engines [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 04:23:23.763897 n-d-843700-1 devstack@n-api.service[104233]: DEBUG oslo_db.sqlalchemy.engines [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 04:23:23.765905 n-d-843700-1 devstack@n-api.service[104232]: DEBUG oslo_db.sqlalchemy.engines [None req-bbb8f63b-41db-42d3-9949-6a50dd77b823 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 04:23:23.768434 n-d-843700-1 devstack@n-api.service[104233]: DEBUG dbcounter [-] [104233] Writer thread running {{(pid=104233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 04:23:23.768547 n-d-843700-1 devstack@n-api.service[104232]: DEBUG oslo_db.sqlalchemy.engines [None req-bbb8f63b-41db-42d3-9949-6a50dd77b823 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 04:23:23.776104 n-d-843700-1 devstack@n-api.service[104232]: DEBUG dbcounter [-] [104232] Writer thread running {{(pid=104232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 04:23:23.776430 n-d-843700-1 devstack@n-api.service[104232]: DEBUG dbcounter [-] [104232] Writer thread running {{(pid=104232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 04:23:23.909011 n-d-843700-1 devstack@n-api.service[104233]: DEBUG dbcounter [-] [104233] Writer thread running {{(pid=104233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 04:23:23.917728 n-d-843700-1 devstack@n-api.service[104233]: INFO dbcounter [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] Registered counter for database nova_cell0 May 28 04:23:23.922137 n-d-843700-1 devstack@n-api.service[104232]: INFO dbcounter [None req-bbb8f63b-41db-42d3-9949-6a50dd77b823 None None] Registered counter for database nova_cell0 May 28 04:23:23.926493 n-d-843700-1 devstack@n-api.service[104233]: DEBUG oslo_db.sqlalchemy.engines [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 04:23:23.930583 n-d-843700-1 devstack@n-api.service[104232]: DEBUG oslo_db.sqlalchemy.engines [None req-bbb8f63b-41db-42d3-9949-6a50dd77b823 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 04:23:23.930826 n-d-843700-1 devstack@n-api.service[104233]: DEBUG dbcounter [-] [104233] Writer thread running {{(pid=104233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 04:23:23.935488 n-d-843700-1 devstack@n-api.service[104232]: DEBUG dbcounter [-] [104232] Writer thread running {{(pid=104232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 04:23:24.360396 n-d-843700-1 devstack@n-api.service[104233]: WARNING keystonemiddleware.auth_token [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 04:23:24.367562 n-d-843700-1 devstack@n-api.service[104233]: WARNING keystonemiddleware.auth_token [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 04:23:24.473828 n-d-843700-1 devstack@n-api.service[104232]: WARNING keystonemiddleware.auth_token [None req-bbb8f63b-41db-42d3-9949-6a50dd77b823 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 04:23:24.482187 n-d-843700-1 devstack@n-api.service[104232]: WARNING keystonemiddleware.auth_token [None req-bbb8f63b-41db-42d3-9949-6a50dd77b823 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 04:23:24.705185 n-d-843700-1 devstack@n-api.service[104233]: WARNING keystonemiddleware.auth_token [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 04:23:24.711035 n-d-843700-1 devstack@n-api.service[104233]: WARNING keystonemiddleware.auth_token [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 04:23:24.716822 n-d-843700-1 devstack@n-api.service[104233]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a56b16b9c0 pid: 104233 (default app) May 28 04:23:24.718867 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:23:24.720061 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001747 May 28 04:23:24.720474 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Sat May 28 04:23:24 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:23:24.819993 n-d-843700-1 devstack@n-api.service[104232]: WARNING keystonemiddleware.auth_token [None req-bbb8f63b-41db-42d3-9949-6a50dd77b823 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 04:23:24.826722 n-d-843700-1 devstack@n-api.service[104232]: WARNING keystonemiddleware.auth_token [None req-bbb8f63b-41db-42d3-9949-6a50dd77b823 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 04:23:24.831944 n-d-843700-1 devstack@n-api.service[104232]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a56b16b9c0 pid: 104232 (default app) May 28 04:24:44.679427 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:24:44.680429 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 28 04:24:44.681227 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 930 bytes} [Sat May 28 04:24:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:24:44.696998 n-d-843700-1 devstack@n-api.service[104232]: DEBUG dbcounter [-] [104232] Writing DB stats nova_api:SELECT=3 {{(pid=104232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:24:44.698101 n-d-843700-1 devstack@n-api.service[104232]: DEBUG dbcounter [-] [104232] Writing DB stats nova_cell0:SELECT=3 {{(pid=104232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:24:44.698930 n-d-843700-1 devstack@n-api.service[104232]: DEBUG dbcounter [-] [104232] Writing DB stats nova_cell1:SELECT=3 {{(pid=104232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:24:44.699834 n-d-843700-1 devstack@n-api.service[104232]: DEBUG dbcounter [-] [104232] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:24:45.156877 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-8b1d0aee-a784-4d7a-88f2-a19ec615c829 admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:24:45.196603 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-8b1d0aee-a784-4d7a-88f2-a19ec615c829 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.508582 May 28 04:24:45.207385 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1291 bytes} [Sat May 28 04:24:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:24:47.466845 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:24:47.467891 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-7d08ffea-61b2-40f1-93cd-65eca24660a0 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 May 28 04:24:47.468298 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 3/4] 10.222.0.58 () {54 vars in 930 bytes} [Sat May 28 04:24:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:24:47.532281 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-f2bb4185-f676-4cdf-a6ba-71af7f4d85e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "id": "c1", "vcpus": 1, "name": "cirros256"}} {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:24:47.550506 n-d-843700-1 devstack@n-api.service[104232]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:24:47.550506 n-d-843700-1 devstack@n-api.service[104232]: warnings.warn(msg) May 28 04:24:47.638650 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-f2bb4185-f676-4cdf-a6ba-71af7f4d85e6 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.164015 May 28 04:24:47.646253 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 2/5] 10.222.0.58 () {64 vars in 1282 bytes} [Sat May 28 04:24:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:24:47.653142 n-d-843700-1 devstack@n-api.service[104233]: DEBUG dbcounter [-] [104233] Writing DB stats nova_api:SELECT=3 {{(pid=104233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:24:47.654482 n-d-843700-1 devstack@n-api.service[104233]: DEBUG dbcounter [-] [104233] Writing DB stats nova_cell1:SELECT=3 {{(pid=104233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:24:47.655577 n-d-843700-1 devstack@n-api.service[104233]: DEBUG dbcounter [-] [104233] Writing DB stats nova_cell0:SELECT=3 {{(pid=104233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:24:47.656432 n-d-843700-1 devstack@n-api.service[104233]: DEBUG dbcounter [-] [104233] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:24:47.865304 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-d5e574a2-3689-4406-b188-a92e017d425a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:24:47.867892 n-d-843700-1 devstack@n-api.service[104233]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:24:47.867892 n-d-843700-1 devstack@n-api.service[104233]: warnings.warn(msg) May 28 04:24:47.967569 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-d5e574a2-3689-4406-b188-a92e017d425a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.319577 May 28 04:24:47.968384 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 4/6] 10.222.0.58 () {64 vars in 1335 bytes} [Sat May 28 04:24:47 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:24:50.204253 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-f2bb4185-f676-4cdf-a6ba-71af7f4d85e6 admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:24:50.205312 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-f2bb4185-f676-4cdf-a6ba-71af7f4d85e6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001942 May 28 04:24:50.205712 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 3/7] 10.222.0.58 () {54 vars in 930 bytes} [Sat May 28 04:24:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:24:50.342610 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-e2f57c1e-829e-4984-b422-9ab02848455e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "vcpus": 1, "name": "ds512M"}} {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:24:50.360659 n-d-843700-1 devstack@n-api.service[104233]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:24:50.360659 n-d-843700-1 devstack@n-api.service[104233]: warnings.warn(msg) May 28 04:24:50.457634 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-e2f57c1e-829e-4984-b422-9ab02848455e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.245691 May 28 04:24:50.458120 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 5/8] 10.222.0.58 () {64 vars in 1282 bytes} [Sat May 28 04:24:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:24:50.470914 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-2a238995-e706-4159-a7b1-27bcab864aa6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:24:50.472562 n-d-843700-1 devstack@n-api.service[104232]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:24:50.472562 n-d-843700-1 devstack@n-api.service[104232]: warnings.warn(msg) May 28 04:24:50.569097 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-2a238995-e706-4159-a7b1-27bcab864aa6 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101995 May 28 04:24:50.569729 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 4/9] 10.222.0.58 () {64 vars in 1335 bytes} [Sat May 28 04:24:50 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:24:52.848893 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-e2f57c1e-829e-4984-b422-9ab02848455e admin admin] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:24:52.850678 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-e2f57c1e-829e-4984-b422-9ab02848455e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002228 May 28 04:24:52.851685 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 930 bytes} [Sat May 28 04:24:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:24:52.937977 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-0586519b-f5d7-4989-9b14-af7decbabe75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "swap": 0, "vcpus": 1, "id": "d2", "ram": 1024}} {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:24:53.049073 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-0586519b-f5d7-4989-9b14-af7decbabe75 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.190274 May 28 04:24:53.050313 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 5/11] 10.222.0.58 () {64 vars in 1282 bytes} [Sat May 28 04:24:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 04:24:53.062562 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-6ae95941-47c8-4955-ab2c-e93f3b7eb4ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:24:53.147597 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-6ae95941-47c8-4955-ab2c-e93f3b7eb4ef admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088569 May 28 04:24:53.148479 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 7/12] 10.222.0.58 () {64 vars in 1335 bytes} [Sat May 28 04:24:53 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:24:55.717384 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-0586519b-f5d7-4989-9b14-af7decbabe75 admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:24:55.719184 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-0586519b-f5d7-4989-9b14-af7decbabe75 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002764 May 28 04:24:55.736092 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 6/13] 10.222.0.58 () {54 vars in 930 bytes} [Sat May 28 04:24:55 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:24:55.784411 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-0e474495-da06-464a-9b1a-510325fcb7ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "id": "d3", "name": "ds2G", "vcpus": 2}} {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:24:55.875644 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-0e474495-da06-464a-9b1a-510325fcb7ca admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148871 May 28 04:24:55.883951 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 8/14] 10.222.0.58 () {64 vars in 1282 bytes} [Sat May 28 04:24:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 04:24:55.890660 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-18b392ab-aa45-4fbf-b442-22afa5e992b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:24:56.000837 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-18b392ab-aa45-4fbf-b442-22afa5e992b3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114246 May 28 04:24:56.007040 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 7/15] 10.222.0.58 () {64 vars in 1335 bytes} [Sat May 28 04:24:55 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:24:58.325077 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-0e474495-da06-464a-9b1a-510325fcb7ca admin admin] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:24:58.326081 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-0e474495-da06-464a-9b1a-510325fcb7ca admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 28 04:24:58.326475 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 9/16] 10.222.0.58 () {54 vars in 930 bytes} [Sat May 28 04:24:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:24:58.386874 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-2b3e7c25-edde-41f4-a61f-b1897099b1ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:24:58.468278 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-2b3e7c25-edde-41f4-a61f-b1897099b1ef admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135663 May 28 04:24:58.468836 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 8/17] 10.222.0.58 () {64 vars in 1282 bytes} [Sat May 28 04:24:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 04:24:58.480981 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-0e21ba14-e573-43b8-9aaf-8f945db62d9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:24:58.603769 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-0e21ba14-e573-43b8-9aaf-8f945db62d9b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126424 May 28 04:24:58.604364 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 10/18] 10.222.0.58 () {64 vars in 1335 bytes} [Sat May 28 04:24:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:25:00.977848 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-2b3e7c25-edde-41f4-a61f-b1897099b1ef admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:00.979601 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-2b3e7c25-edde-41f4-a61f-b1897099b1ef admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002183 May 28 04:25:00.987700 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 9/19] 10.222.0.58 () {54 vars in 930 bytes} [Sat May 28 04:25:00 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:25:01.068063 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-dc670432-e620-4850-9710-1a56c2110ee0 admin admin] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:01.114013 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-dc670432-e620-4850-9710-1a56c2110ee0 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.126951 May 28 04:25:01.115172 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1291 bytes} [Sat May 28 04:25:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:25:03.426578 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-2b3e7c25-edde-41f4-a61f-b1897099b1ef admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:03.428447 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-2b3e7c25-edde-41f4-a61f-b1897099b1ef admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002293 May 28 04:25:03.431065 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 10/21] 10.222.0.58 () {54 vars in 930 bytes} [Sat May 28 04:25:03 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:25:03.496661 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-8e1558a7-e35e-467f-83bc-499b53455e18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "1", "ram": 512, "disk": 1, "name": "m1.tiny"}} {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:25:03.616962 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-8e1558a7-e35e-467f-83bc-499b53455e18 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.181858 May 28 04:25:03.620524 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 12/22] 10.222.0.58 () {64 vars in 1282 bytes} [Sat May 28 04:25:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 04:25:03.629944 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-afe03e12-2dd7-4cd9-9f1b-fadc1d373112 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:25:03.803700 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-afe03e12-2dd7-4cd9-9f1b-fadc1d373112 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.177395 May 28 04:25:03.804300 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 11/23] 10.222.0.58 () {64 vars in 1332 bytes} [Sat May 28 04:25:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:25:06.080847 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-8e1558a7-e35e-467f-83bc-499b53455e18 admin admin] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:06.081918 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-8e1558a7-e35e-467f-83bc-499b53455e18 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 May 28 04:25:06.082318 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 930 bytes} [Sat May 28 04:25:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:25:06.141301 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-28c62861-0210-4d5e-aebc-e205ae72fc2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "name": "m1.small", "vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "2"}} {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:25:06.229232 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-28c62861-0210-4d5e-aebc-e205ae72fc2b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.140473 May 28 04:25:06.230258 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 12/25] 10.222.0.58 () {64 vars in 1282 bytes} [Sat May 28 04:25:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:25:06.242467 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-825958d5-f822-4d8d-b894-6908b5715d49 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:25:06.357376 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-825958d5-f822-4d8d-b894-6908b5715d49 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118587 May 28 04:25:06.358223 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 14/26] 10.222.0.58 () {64 vars in 1332 bytes} [Sat May 28 04:25:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:25:08.597462 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-28c62861-0210-4d5e-aebc-e205ae72fc2b admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:08.598695 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-28c62861-0210-4d5e-aebc-e205ae72fc2b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 28 04:25:08.599258 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 930 bytes} [Sat May 28 04:25:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:25:08.673324 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-d3a64ed0-e7c4-4afd-8874-c770dae32eef admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0, "id": "3", "name": "m1.medium", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "ram": 4096}} {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:25:08.731897 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-d3a64ed0-e7c4-4afd-8874-c770dae32eef admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.125483 May 28 04:25:08.732458 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 15/28] 10.222.0.58 () {64 vars in 1282 bytes} [Sat May 28 04:25:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 04:25:08.745180 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-3d4ca782-a3da-4afb-bef4-85b846e45725 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:25:08.823027 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-3d4ca782-a3da-4afb-bef4-85b846e45725 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082088 May 28 04:25:08.823915 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 14/29] 10.222.0.58 () {64 vars in 1332 bytes} [Sat May 28 04:25:08 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:25:11.148156 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-d3a64ed0-e7c4-4afd-8874-c770dae32eef admin admin] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:11.149295 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-d3a64ed0-e7c4-4afd-8874-c770dae32eef admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001625 May 28 04:25:11.149851 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 16/30] 10.222.0.58 () {54 vars in 930 bytes} [Sat May 28 04:25:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:25:11.215538 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-20fdb323-ead3-4bbc-a23e-5d336a9103ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "disk": 80, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:25:11.376400 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-20fdb323-ead3-4bbc-a23e-5d336a9103ed admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.219479 May 28 04:25:11.376960 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 15/31] 10.222.0.58 () {64 vars in 1282 bytes} [Sat May 28 04:25:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:25:11.389540 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-2ff466b6-8a58-46f5-85d4-e1411b41e697 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:25:11.459984 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-2ff466b6-8a58-46f5-85d4-e1411b41e697 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074230 May 28 04:25:11.460505 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 17/32] 10.222.0.58 () {64 vars in 1332 bytes} [Sat May 28 04:25:11 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:25:13.667349 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-20fdb323-ead3-4bbc-a23e-5d336a9103ed admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:13.668363 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-20fdb323-ead3-4bbc-a23e-5d336a9103ed admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 28 04:25:13.668855 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 16/33] 10.222.0.58 () {54 vars in 930 bytes} [Sat May 28 04:25:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:25:13.725853 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-8a05568b-2c71-44d3-a5b3-cb0e4f73439b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "id": "5", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "vcpus": 8}} {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:25:13.810717 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-8a05568b-2c71-44d3-a5b3-cb0e4f73439b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.135947 May 28 04:25:13.811376 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 18/34] 10.222.0.58 () {64 vars in 1282 bytes} [Sat May 28 04:25:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:25:13.823081 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-e45f6dec-46c6-4bf0-ae0e-6780ab2bbef3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:25:13.899751 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-e45f6dec-46c6-4bf0-ae0e-6780ab2bbef3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080309 May 28 04:25:13.900953 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 17/35] 10.222.0.58 () {64 vars in 1332 bytes} [Sat May 28 04:25:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:25:41.336093 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-8a05568b-2c71-44d3-a5b3-cb0e4f73439b admin admin] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:41.337652 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-8a05568b-2c71-44d3-a5b3-cb0e4f73439b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001967 May 28 04:25:41.338050 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 930 bytes} [Sat May 28 04:25:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:25:41.348590 n-d-843700-1 devstack@n-api.service[104232]: DEBUG dbcounter [-] [104232] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=104232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:25:41.406520 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-8459ca83-a76c-4000-879a-b118bfaf9a92 admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:41.423404 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-8459ca83-a76c-4000-879a-b118bfaf9a92 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.079292 May 28 04:25:41.423932 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1291 bytes} [Sat May 28 04:25:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:25:42.409250 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-8a05568b-2c71-44d3-a5b3-cb0e4f73439b admin admin] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:42.410240 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-8a05568b-2c71-44d3-a5b3-cb0e4f73439b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 May 28 04:25:42.410632 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1074 bytes} [Sat May 28 04:25:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:25:42.631077 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-38d076a5-509a-436d-a2b8-3e913f9e836c admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:42.637870 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.wsgi [None req-38d076a5-509a-436d-a2b8-3e913f9e836c admin admin] HTTP exception thrown: Flavor 42 could not be found. May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-38d076a5-509a-436d-a2b8-3e913f9e836c admin admin] Request method failure captured: May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: Accept: application/json May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: Accept-Encoding: gzip, deflate May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: Connection: keep-alive May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: Content-Length: 0 May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: Host: 10.222.0.58 May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: Openstack-Api-Version: compute 2.90 May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: Openstack-System-Scope: None May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: User-Agent: python-novaclient May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: X-Auth-Token: gAAAAABikaRGHv5s1H6RDueS98fIfyCHLkUJFwY-vi4gmZ1wVLEyNNzTGyXMygv8faDXCm35d9VUyZHNYFCUMfeHFe5douCCmt2WG5ho__DPdMt1IY8xpWZUXu66acvPFfDL7w05-WH4BHyY35FoMqAUzaVvzqK9SIEoHux76uFaVmugoTbICK8 May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: X-Domain-Id: None May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: X-Domain-Name: None May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: X-Identity-Status: Confirmed May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: X-Is-Admin-Project: True May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: X-Openstack-Nova-Api-Version: 2.90 May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: X-Project-Domain-Id: default May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: X-Project-Domain-Name: Default May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: X-Project-Id: 9818b24a40e84144ba59b9abaa2c28d0 May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: X-Project-Name: admin May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: X-Role: admin,reader,member May 28 04:25:42.641167 n-d-843700-1 devstack@n-api.service[104232]: X-Roles: admin,reader,member May 28 04:25:42.642823 n-d-843700-1 devstack@n-api.service[104232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:25:42.642823 n-d-843700-1 devstack@n-api.service[104232]: X-Tenant: admin May 28 04:25:42.642823 n-d-843700-1 devstack@n-api.service[104232]: X-Tenant-Id: 9818b24a40e84144ba59b9abaa2c28d0 May 28 04:25:42.642823 n-d-843700-1 devstack@n-api.service[104232]: X-Tenant-Name: admin May 28 04:25:42.642823 n-d-843700-1 devstack@n-api.service[104232]: X-User: admin May 28 04:25:42.642823 n-d-843700-1 devstack@n-api.service[104232]: X-User-Domain-Id: default May 28 04:25:42.642823 n-d-843700-1 devstack@n-api.service[104232]: X-User-Domain-Name: Default May 28 04:25:42.642823 n-d-843700-1 devstack@n-api.service[104232]: X-User-Id: 3d0c6f8a072742fb823f1d42420f80df May 28 04:25:42.642823 n-d-843700-1 devstack@n-api.service[104232]: X-User-Name: admin May 28 04:25:42.642823 n-d-843700-1 devstack@n-api.service[104232]: method: > May 28 04:25:42.642823 n-d-843700-1 devstack@n-api.service[104232]: exception: Flavor 42 could not be found. May 28 04:25:42.642823 n-d-843700-1 devstack@n-api.service[104232]: action_args: {'id': '42'} May 28 04:25:42.642823 n-d-843700-1 devstack@n-api.service[104232]: {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:25:42.642823 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:25:42.643789 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 28 04:25:42.643789 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 28 04:25:42.643789 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 04:25:42.643789 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 04:25:42.643789 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:25:42.643789 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:25:42.643789 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 04:25:42.643789 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 04:25:42.643789 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 04:25:42.643789 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:25:42.643789 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 04:25:42.643789 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 04:25:42.643789 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 28 04:25:42.643789 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi May 28 04:25:42.643789 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:25:42.643789 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi May 28 04:25:42.643789 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:25:42.643789 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:25:42.643789 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:25:42.645021 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:25:42.645021 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:25:42.645021 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:25:42.645021 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:25:42.645021 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 28 04:25:42.645021 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:25:42.645021 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 28 04:25:42.645021 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi May 28 04:25:42.645021 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:25:42.645021 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi May 28 04:25:42.645021 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:25:42.645021 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:25:42.645021 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:25:42.645021 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:25:42.645021 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:25:42.645021 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 28 04:25:42.645021 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi May 28 04:25:42.645021 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-38d076a5-509a-436d-a2b8-3e913f9e836c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:25:42.646057 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-38d076a5-509a-436d-a2b8-3e913f9e836c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063033 May 28 04:25:42.646057 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 19/39] 10.222.0.58 () {60 vars in 1190 bytes} [Sat May 28 04:25:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 04:25:42.652305 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-2b4c3662-ca71-43db-88e3-b72094dd2f9e admin admin] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:42.655947 n-d-843700-1 devstack@n-api.service[104233]: DEBUG dbcounter [-] [104233] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:25:42.674315 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-2b4c3662-ca71-43db-88e3-b72094dd2f9e admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025548 May 28 04:25:42.674865 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1210 bytes} [Sat May 28 04:25:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:25:42.691511 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-dbd27324-95cf-4361-b072-47155af28821 admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:42.713518 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-dbd27324-95cf-4361-b072-47155af28821 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025606 May 28 04:25:42.714051 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1210 bytes} [Sat May 28 04:25:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:25:42.723536 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-f46575b0-b2dc-4bbd-b573-dfb8e6d0ed0f admin admin] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:42.729918 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.wsgi [None req-f46575b0-b2dc-4bbd-b573-dfb8e6d0ed0f admin admin] HTTP exception thrown: Flavor 42 could not be found. May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-f46575b0-b2dc-4bbd-b573-dfb8e6d0ed0f admin admin] Request method failure captured: May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: Accept: application/json May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: Accept-Encoding: gzip, deflate May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: Connection: keep-alive May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: Content-Length: 0 May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: Host: 10.222.0.58 May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: Openstack-Api-Version: compute 2.90 May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: Openstack-System-Scope: None May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: User-Agent: python-novaclient May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: X-Auth-Token: gAAAAABikaRGHv5s1H6RDueS98fIfyCHLkUJFwY-vi4gmZ1wVLEyNNzTGyXMygv8faDXCm35d9VUyZHNYFCUMfeHFe5douCCmt2WG5ho__DPdMt1IY8xpWZUXu66acvPFfDL7w05-WH4BHyY35FoMqAUzaVvzqK9SIEoHux76uFaVmugoTbICK8 May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: X-Domain-Id: None May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: X-Domain-Name: None May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: X-Identity-Status: Confirmed May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: X-Is-Admin-Project: True May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: X-Openstack-Nova-Api-Version: 2.90 May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: X-Project-Domain-Id: default May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: X-Project-Domain-Name: Default May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: X-Project-Id: 9818b24a40e84144ba59b9abaa2c28d0 May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: X-Project-Name: admin May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: X-Role: admin,reader,member May 28 04:25:42.733179 n-d-843700-1 devstack@n-api.service[104233]: X-Roles: admin,reader,member May 28 04:25:42.735388 n-d-843700-1 devstack@n-api.service[104233]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:25:42.735388 n-d-843700-1 devstack@n-api.service[104233]: X-Tenant: admin May 28 04:25:42.735388 n-d-843700-1 devstack@n-api.service[104233]: X-Tenant-Id: 9818b24a40e84144ba59b9abaa2c28d0 May 28 04:25:42.735388 n-d-843700-1 devstack@n-api.service[104233]: X-Tenant-Name: admin May 28 04:25:42.735388 n-d-843700-1 devstack@n-api.service[104233]: X-User: admin May 28 04:25:42.735388 n-d-843700-1 devstack@n-api.service[104233]: X-User-Domain-Id: default May 28 04:25:42.735388 n-d-843700-1 devstack@n-api.service[104233]: X-User-Domain-Name: Default May 28 04:25:42.735388 n-d-843700-1 devstack@n-api.service[104233]: X-User-Id: 3d0c6f8a072742fb823f1d42420f80df May 28 04:25:42.735388 n-d-843700-1 devstack@n-api.service[104233]: X-User-Name: admin May 28 04:25:42.735388 n-d-843700-1 devstack@n-api.service[104233]: method: > May 28 04:25:42.735388 n-d-843700-1 devstack@n-api.service[104233]: exception: Flavor 42 could not be found. May 28 04:25:42.735388 n-d-843700-1 devstack@n-api.service[104233]: action_args: {'id': '42'} May 28 04:25:42.735388 n-d-843700-1 devstack@n-api.service[104233]: {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:25:42.735388 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:25:42.736383 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 28 04:25:42.736383 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 28 04:25:42.736383 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 04:25:42.736383 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 04:25:42.736383 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:25:42.736383 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:25:42.736383 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 04:25:42.736383 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 04:25:42.736383 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 04:25:42.736383 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:25:42.736383 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 04:25:42.736383 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 04:25:42.736383 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 28 04:25:42.736383 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi May 28 04:25:42.736383 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:25:42.736383 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi May 28 04:25:42.736383 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:25:42.736383 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:25:42.736383 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:25:42.737621 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:25:42.737621 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:25:42.737621 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:25:42.737621 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:25:42.737621 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 28 04:25:42.737621 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:25:42.737621 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 28 04:25:42.737621 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi May 28 04:25:42.737621 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:25:42.737621 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi May 28 04:25:42.737621 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:25:42.737621 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:25:42.737621 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:25:42.737621 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:25:42.737621 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:25:42.737621 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 28 04:25:42.737621 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi May 28 04:25:42.737621 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-f46575b0-b2dc-4bbd-b573-dfb8e6d0ed0f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:25:42.738833 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-f46575b0-b2dc-4bbd-b573-dfb8e6d0ed0f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014877 May 28 04:25:42.738833 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1190 bytes} [Sat May 28 04:25:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 04:25:43.589348 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-dbd27324-95cf-4361-b072-47155af28821 admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:43.590375 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-dbd27324-95cf-4361-b072-47155af28821 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 28 04:25:43.590767 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 21/43] 10.222.0.58 () {56 vars in 1074 bytes} [Sat May 28 04:25:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:25:43.779357 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-0ef543cb-bafd-4f4f-8cf0-e071195ef719 admin admin] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:43.784674 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.wsgi [None req-0ef543cb-bafd-4f4f-8cf0-e071195ef719 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-0ef543cb-bafd-4f4f-8cf0-e071195ef719 admin admin] Request method failure captured: May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: Accept: application/json May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: Accept-Encoding: gzip, deflate May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: Connection: keep-alive May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: Content-Length: 0 May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: Host: 10.222.0.58 May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: Openstack-Api-Version: compute 2.90 May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: Openstack-System-Scope: None May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: User-Agent: python-novaclient May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: X-Auth-Token: gAAAAABikaRHXNH_MSxWqVmQP8pE0tKLO-lT3gQYrf03ZGtpeROTLClfTuqGIh2Bvia1zqFJsp4yH2LejGjZ05RWdE6Lr0lPDVrwQ-1Zf7o5KnPgr6_eRLP4vxkI2yky81rNhmUH0yKOqnzbcpm2bdsoq4W1wcyvIXRh665WnBkf8_LIoblwfJU May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: X-Domain-Id: None May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: X-Domain-Name: None May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: X-Identity-Status: Confirmed May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: X-Is-Admin-Project: True May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: X-Openstack-Nova-Api-Version: 2.90 May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: X-Project-Domain-Id: default May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: X-Project-Domain-Name: Default May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: X-Project-Id: 9818b24a40e84144ba59b9abaa2c28d0 May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: X-Project-Name: admin May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: X-Role: admin,reader,member May 28 04:25:43.786175 n-d-843700-1 devstack@n-api.service[104233]: X-Roles: admin,reader,member May 28 04:25:43.787711 n-d-843700-1 devstack@n-api.service[104233]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:25:43.787711 n-d-843700-1 devstack@n-api.service[104233]: X-Tenant: admin May 28 04:25:43.787711 n-d-843700-1 devstack@n-api.service[104233]: X-Tenant-Id: 9818b24a40e84144ba59b9abaa2c28d0 May 28 04:25:43.787711 n-d-843700-1 devstack@n-api.service[104233]: X-Tenant-Name: admin May 28 04:25:43.787711 n-d-843700-1 devstack@n-api.service[104233]: X-User: admin May 28 04:25:43.787711 n-d-843700-1 devstack@n-api.service[104233]: X-User-Domain-Id: default May 28 04:25:43.787711 n-d-843700-1 devstack@n-api.service[104233]: X-User-Domain-Name: Default May 28 04:25:43.787711 n-d-843700-1 devstack@n-api.service[104233]: X-User-Id: 3d0c6f8a072742fb823f1d42420f80df May 28 04:25:43.787711 n-d-843700-1 devstack@n-api.service[104233]: X-User-Name: admin May 28 04:25:43.787711 n-d-843700-1 devstack@n-api.service[104233]: method: > May 28 04:25:43.787711 n-d-843700-1 devstack@n-api.service[104233]: exception: Flavor 84 could not be found. May 28 04:25:43.787711 n-d-843700-1 devstack@n-api.service[104233]: action_args: {'id': '84'} May 28 04:25:43.787711 n-d-843700-1 devstack@n-api.service[104233]: {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:25:43.787711 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:25:43.788668 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 28 04:25:43.788668 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 28 04:25:43.788668 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 04:25:43.788668 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 04:25:43.788668 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:25:43.788668 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:25:43.788668 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 04:25:43.788668 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 04:25:43.788668 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 04:25:43.788668 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:25:43.788668 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 04:25:43.788668 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 04:25:43.788668 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 28 04:25:43.788668 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi May 28 04:25:43.788668 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:25:43.788668 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi May 28 04:25:43.788668 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:25:43.788668 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:25:43.788668 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:25:43.790431 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:25:43.790431 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:25:43.790431 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:25:43.790431 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:25:43.790431 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 28 04:25:43.790431 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:25:43.790431 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 28 04:25:43.790431 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi May 28 04:25:43.790431 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:25:43.790431 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi May 28 04:25:43.790431 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:25:43.790431 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:25:43.790431 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:25:43.790431 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:25:43.790431 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:25:43.790431 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 28 04:25:43.790431 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi May 28 04:25:43.790431 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-0ef543cb-bafd-4f4f-8cf0-e071195ef719 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:25:43.791559 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-0ef543cb-bafd-4f4f-8cf0-e071195ef719 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061947 May 28 04:25:43.791559 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1190 bytes} [Sat May 28 04:25:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 04:25:43.797970 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-255bcf78-c1e2-4f63-b0f3-bcdbf069b6aa admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:43.813065 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-255bcf78-c1e2-4f63-b0f3-bcdbf069b6aa admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018572 May 28 04:25:43.813530 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1210 bytes} [Sat May 28 04:25:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:25:43.822866 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-7adc7856-41db-4125-aeb2-affeaba4becd admin admin] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:43.837152 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-7adc7856-41db-4125-aeb2-affeaba4becd admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017844 May 28 04:25:43.837673 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1210 bytes} [Sat May 28 04:25:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:25:43.846907 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-5d59b468-36e9-41ff-b0ce-c1683c2c7142 admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:43.853090 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.wsgi [None req-5d59b468-36e9-41ff-b0ce-c1683c2c7142 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-5d59b468-36e9-41ff-b0ce-c1683c2c7142 admin admin] Request method failure captured: May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: Accept: application/json May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: Accept-Encoding: gzip, deflate May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: Connection: keep-alive May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: Content-Length: 0 May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: Host: 10.222.0.58 May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: Openstack-Api-Version: compute 2.90 May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: Openstack-System-Scope: None May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: User-Agent: python-novaclient May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: X-Auth-Token: gAAAAABikaRHXNH_MSxWqVmQP8pE0tKLO-lT3gQYrf03ZGtpeROTLClfTuqGIh2Bvia1zqFJsp4yH2LejGjZ05RWdE6Lr0lPDVrwQ-1Zf7o5KnPgr6_eRLP4vxkI2yky81rNhmUH0yKOqnzbcpm2bdsoq4W1wcyvIXRh665WnBkf8_LIoblwfJU May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: X-Domain-Id: None May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: X-Domain-Name: None May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: X-Identity-Status: Confirmed May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: X-Is-Admin-Project: True May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: X-Openstack-Nova-Api-Version: 2.90 May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: X-Project-Domain-Id: default May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: X-Project-Domain-Name: Default May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: X-Project-Id: 9818b24a40e84144ba59b9abaa2c28d0 May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: X-Project-Name: admin May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: X-Role: admin,reader,member May 28 04:25:43.854591 n-d-843700-1 devstack@n-api.service[104232]: X-Roles: admin,reader,member May 28 04:25:43.856142 n-d-843700-1 devstack@n-api.service[104232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:25:43.856142 n-d-843700-1 devstack@n-api.service[104232]: X-Tenant: admin May 28 04:25:43.856142 n-d-843700-1 devstack@n-api.service[104232]: X-Tenant-Id: 9818b24a40e84144ba59b9abaa2c28d0 May 28 04:25:43.856142 n-d-843700-1 devstack@n-api.service[104232]: X-Tenant-Name: admin May 28 04:25:43.856142 n-d-843700-1 devstack@n-api.service[104232]: X-User: admin May 28 04:25:43.856142 n-d-843700-1 devstack@n-api.service[104232]: X-User-Domain-Id: default May 28 04:25:43.856142 n-d-843700-1 devstack@n-api.service[104232]: X-User-Domain-Name: Default May 28 04:25:43.856142 n-d-843700-1 devstack@n-api.service[104232]: X-User-Id: 3d0c6f8a072742fb823f1d42420f80df May 28 04:25:43.856142 n-d-843700-1 devstack@n-api.service[104232]: X-User-Name: admin May 28 04:25:43.856142 n-d-843700-1 devstack@n-api.service[104232]: method: > May 28 04:25:43.856142 n-d-843700-1 devstack@n-api.service[104232]: exception: Flavor 84 could not be found. May 28 04:25:43.856142 n-d-843700-1 devstack@n-api.service[104232]: action_args: {'id': '84'} May 28 04:25:43.856142 n-d-843700-1 devstack@n-api.service[104232]: {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:25:43.856142 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:25:43.857092 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 28 04:25:43.857092 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 28 04:25:43.857092 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 04:25:43.857092 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 04:25:43.857092 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:25:43.857092 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:25:43.857092 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 04:25:43.857092 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 04:25:43.857092 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 04:25:43.857092 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:25:43.857092 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 04:25:43.857092 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 04:25:43.857092 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 28 04:25:43.857092 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi May 28 04:25:43.857092 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:25:43.857092 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi May 28 04:25:43.857092 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:25:43.857092 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:25:43.857092 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:25:43.858409 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:25:43.858409 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:25:43.858409 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:25:43.858409 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:25:43.858409 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 28 04:25:43.858409 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:25:43.858409 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 28 04:25:43.858409 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi May 28 04:25:43.858409 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:25:43.858409 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi May 28 04:25:43.858409 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:25:43.858409 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:25:43.858409 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:25:43.858409 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:25:43.858409 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:25:43.858409 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 28 04:25:43.858409 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi May 28 04:25:43.858409 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-5d59b468-36e9-41ff-b0ce-c1683c2c7142 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:25:43.859695 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-5d59b468-36e9-41ff-b0ce-c1683c2c7142 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012638 May 28 04:25:43.859695 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1190 bytes} [Sat May 28 04:25:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 04:25:44.721489 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-7adc7856-41db-4125-aeb2-affeaba4becd admin admin] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:44.722588 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-7adc7856-41db-4125-aeb2-affeaba4becd admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 May 28 04:25:44.722975 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 25/48] 10.222.0.58 () {56 vars in 1074 bytes} [Sat May 28 04:25:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:25:44.910829 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-ea9b81f7-646c-482b-9bf1-d7f541a0d78a admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:44.917134 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.wsgi [None req-ea9b81f7-646c-482b-9bf1-d7f541a0d78a admin admin] HTTP exception thrown: Flavor 451 could not be found. May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-ea9b81f7-646c-482b-9bf1-d7f541a0d78a admin admin] Request method failure captured: May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: Accept: application/json May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: Accept-Encoding: gzip, deflate May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: Connection: keep-alive May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: Content-Length: 0 May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: Host: 10.222.0.58 May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: Openstack-Api-Version: compute 2.90 May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: Openstack-System-Scope: None May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: User-Agent: python-novaclient May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: X-Auth-Token: gAAAAABikaRIhloF4oBHKFrmeSJhmGtVfQmHw44c6c46aaKxEonFGk5rzFxacId0TnmzEhqo3dfrV-TjxkcAti2LVIeKwaSCxhAIB2db7H2xD3QN8KRgHdcwOaQsQi_gYvw7een9VuGGClVHhI3FzmGuI68lbAnVrOLvwa6vWzELV1CHJ8QAZKQ May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: X-Domain-Id: None May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: X-Domain-Name: None May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: X-Identity-Status: Confirmed May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: X-Is-Admin-Project: True May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: X-Openstack-Nova-Api-Version: 2.90 May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: X-Project-Domain-Id: default May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: X-Project-Domain-Name: Default May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: X-Project-Id: 9818b24a40e84144ba59b9abaa2c28d0 May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: X-Project-Name: admin May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: X-Role: admin,reader,member May 28 04:25:44.918638 n-d-843700-1 devstack@n-api.service[104232]: X-Roles: admin,reader,member May 28 04:25:44.920202 n-d-843700-1 devstack@n-api.service[104232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:25:44.920202 n-d-843700-1 devstack@n-api.service[104232]: X-Tenant: admin May 28 04:25:44.920202 n-d-843700-1 devstack@n-api.service[104232]: X-Tenant-Id: 9818b24a40e84144ba59b9abaa2c28d0 May 28 04:25:44.920202 n-d-843700-1 devstack@n-api.service[104232]: X-Tenant-Name: admin May 28 04:25:44.920202 n-d-843700-1 devstack@n-api.service[104232]: X-User: admin May 28 04:25:44.920202 n-d-843700-1 devstack@n-api.service[104232]: X-User-Domain-Id: default May 28 04:25:44.920202 n-d-843700-1 devstack@n-api.service[104232]: X-User-Domain-Name: Default May 28 04:25:44.920202 n-d-843700-1 devstack@n-api.service[104232]: X-User-Id: 3d0c6f8a072742fb823f1d42420f80df May 28 04:25:44.920202 n-d-843700-1 devstack@n-api.service[104232]: X-User-Name: admin May 28 04:25:44.920202 n-d-843700-1 devstack@n-api.service[104232]: method: > May 28 04:25:44.920202 n-d-843700-1 devstack@n-api.service[104232]: exception: Flavor 451 could not be found. May 28 04:25:44.920202 n-d-843700-1 devstack@n-api.service[104232]: action_args: {'id': '451'} May 28 04:25:44.920202 n-d-843700-1 devstack@n-api.service[104232]: {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:25:44.920202 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:25:44.921158 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 28 04:25:44.921158 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 28 04:25:44.921158 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 04:25:44.921158 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 04:25:44.921158 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:25:44.921158 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:25:44.921158 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 04:25:44.921158 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 04:25:44.921158 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 04:25:44.921158 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:25:44.921158 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 04:25:44.921158 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 04:25:44.921158 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 28 04:25:44.921158 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi May 28 04:25:44.921158 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:25:44.921158 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi May 28 04:25:44.921158 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:25:44.921158 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:25:44.921158 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:25:44.922322 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:25:44.922322 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:25:44.922322 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:25:44.922322 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:25:44.922322 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 28 04:25:44.922322 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:25:44.922322 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 28 04:25:44.922322 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi May 28 04:25:44.922322 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:25:44.922322 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi May 28 04:25:44.922322 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:25:44.922322 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:25:44.922322 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:25:44.922322 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:25:44.922322 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:25:44.922322 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 28 04:25:44.922322 n-d-843700-1 devstack@n-api.service[104232]: ERROR nova.api.openstack.wsgi May 28 04:25:44.922322 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-ea9b81f7-646c-482b-9bf1-d7f541a0d78a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:25:44.923422 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-ea9b81f7-646c-482b-9bf1-d7f541a0d78a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061069 May 28 04:25:44.923422 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 24/49] 10.222.0.58 () {60 vars in 1193 bytes} [Sat May 28 04:25:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 04:25:44.929765 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-d3fddbae-bb94-4bef-b940-70ec3db208b0 admin admin] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:44.946014 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-d3fddbae-bb94-4bef-b940-70ec3db208b0 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019335 May 28 04:25:44.946479 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 26/50] 10.222.0.58 () {60 vars in 1210 bytes} [Sat May 28 04:25:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:25:44.955798 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-9d099f5c-7679-470c-8b5f-36b5b1121f98 admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:44.969936 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-9d099f5c-7679-470c-8b5f-36b5b1121f98 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017681 May 28 04:25:44.970469 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1210 bytes} [Sat May 28 04:25:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:25:44.979961 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-ec5aedcf-7068-46ac-b11e-302ec68bfe91 admin admin] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:44.985409 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.wsgi [None req-ec5aedcf-7068-46ac-b11e-302ec68bfe91 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-ec5aedcf-7068-46ac-b11e-302ec68bfe91 admin admin] Request method failure captured: May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: Accept: application/json May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: Accept-Encoding: gzip, deflate May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: Connection: keep-alive May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: Content-Length: 0 May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: Host: 10.222.0.58 May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: Openstack-Api-Version: compute 2.90 May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: Openstack-System-Scope: None May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: User-Agent: python-novaclient May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: X-Auth-Token: gAAAAABikaRIhloF4oBHKFrmeSJhmGtVfQmHw44c6c46aaKxEonFGk5rzFxacId0TnmzEhqo3dfrV-TjxkcAti2LVIeKwaSCxhAIB2db7H2xD3QN8KRgHdcwOaQsQi_gYvw7een9VuGGClVHhI3FzmGuI68lbAnVrOLvwa6vWzELV1CHJ8QAZKQ May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: X-Domain-Id: None May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: X-Domain-Name: None May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: X-Identity-Status: Confirmed May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: X-Is-Admin-Project: True May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: X-Openstack-Nova-Api-Version: 2.90 May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: X-Project-Domain-Id: default May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: X-Project-Domain-Name: Default May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: X-Project-Id: 9818b24a40e84144ba59b9abaa2c28d0 May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: X-Project-Name: admin May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: X-Role: admin,reader,member May 28 04:25:44.986916 n-d-843700-1 devstack@n-api.service[104233]: X-Roles: admin,reader,member May 28 04:25:44.988530 n-d-843700-1 devstack@n-api.service[104233]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9818b24a40e84144ba59b9abaa2c28d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:25:44.988530 n-d-843700-1 devstack@n-api.service[104233]: X-Tenant: admin May 28 04:25:44.988530 n-d-843700-1 devstack@n-api.service[104233]: X-Tenant-Id: 9818b24a40e84144ba59b9abaa2c28d0 May 28 04:25:44.988530 n-d-843700-1 devstack@n-api.service[104233]: X-Tenant-Name: admin May 28 04:25:44.988530 n-d-843700-1 devstack@n-api.service[104233]: X-User: admin May 28 04:25:44.988530 n-d-843700-1 devstack@n-api.service[104233]: X-User-Domain-Id: default May 28 04:25:44.988530 n-d-843700-1 devstack@n-api.service[104233]: X-User-Domain-Name: Default May 28 04:25:44.988530 n-d-843700-1 devstack@n-api.service[104233]: X-User-Id: 3d0c6f8a072742fb823f1d42420f80df May 28 04:25:44.988530 n-d-843700-1 devstack@n-api.service[104233]: X-User-Name: admin May 28 04:25:44.988530 n-d-843700-1 devstack@n-api.service[104233]: method: > May 28 04:25:44.988530 n-d-843700-1 devstack@n-api.service[104233]: exception: Flavor 451 could not be found. May 28 04:25:44.988530 n-d-843700-1 devstack@n-api.service[104233]: action_args: {'id': '451'} May 28 04:25:44.988530 n-d-843700-1 devstack@n-api.service[104233]: {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:25:44.988530 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:25:44.989515 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 28 04:25:44.989515 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 28 04:25:44.989515 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 04:25:44.989515 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 04:25:44.989515 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:25:44.989515 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:25:44.989515 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 04:25:44.989515 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 04:25:44.989515 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 04:25:44.989515 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:25:44.989515 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 04:25:44.989515 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 04:25:44.989515 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 28 04:25:44.989515 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi May 28 04:25:44.989515 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:25:44.989515 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi May 28 04:25:44.989515 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:25:44.989515 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:25:44.989515 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:25:44.990764 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:25:44.990764 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:25:44.990764 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:25:44.990764 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:25:44.990764 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 28 04:25:44.990764 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:25:44.990764 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 28 04:25:44.990764 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi May 28 04:25:44.990764 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:25:44.990764 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi May 28 04:25:44.990764 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:25:44.990764 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:25:44.990764 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:25:44.990764 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:25:44.990764 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:25:44.990764 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 28 04:25:44.990764 n-d-843700-1 devstack@n-api.service[104233]: ERROR nova.api.openstack.wsgi May 28 04:25:44.990764 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-ec5aedcf-7068-46ac-b11e-302ec68bfe91 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:25:44.992006 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-ec5aedcf-7068-46ac-b11e-302ec68bfe91 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011983 May 28 04:25:44.992214 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1193 bytes} [Sat May 28 04:25:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 04:25:45.846942 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-9d099f5c-7679-470c-8b5f-36b5b1121f98 admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:45.847980 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-9d099f5c-7679-470c-8b5f-36b5b1121f98 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 28 04:25:45.848414 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1074 bytes} [Sat May 28 04:25:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:25:46.037621 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-2c66bc93-7ac0-4004-803b-6b245532858a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:25:46.106674 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-2c66bc93-7ac0-4004-803b-6b245532858a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.119928 May 28 04:25:46.107245 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 28/54] 10.222.0.58 () {64 vars in 1235 bytes} [Sat May 28 04:25:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:25:46.982542 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-9d099f5c-7679-470c-8b5f-36b5b1121f98 admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:46.983567 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-9d099f5c-7679-470c-8b5f-36b5b1121f98 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 28 04:25:46.983952 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1074 bytes} [Sat May 28 04:25:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:25:47.170287 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-a57aa7b3-285f-42cb-8000-bb6ca5a6e465 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:25:47.249500 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-a57aa7b3-285f-42cb-8000-bb6ca5a6e465 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.129773 May 28 04:25:47.249982 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1235 bytes} [Sat May 28 04:25:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:25:48.116039 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-9d099f5c-7679-470c-8b5f-36b5b1121f98 admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:48.117049 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-9d099f5c-7679-470c-8b5f-36b5b1121f98 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 28 04:25:48.118034 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1074 bytes} [Sat May 28 04:25:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:25:48.306745 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-ab20079f-9a5e-4c86-929c-a1e4a189729d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:25:48.386687 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-ab20079f-9a5e-4c86-929c-a1e4a189729d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.131088 May 28 04:25:48.387191 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 30/58] 10.222.0.58 () {64 vars in 1235 bytes} [Sat May 28 04:25:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:25:49.248748 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-9d099f5c-7679-470c-8b5f-36b5b1121f98 admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:49.249758 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-9d099f5c-7679-470c-8b5f-36b5b1121f98 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 28 04:25:49.250159 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 29/59] 10.222.0.58 () {56 vars in 1074 bytes} [Sat May 28 04:25:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:25:49.438226 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-112e7832-451d-4712-b3ce-2a46704b5625 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:25:49.517733 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-112e7832-451d-4712-b3ce-2a46704b5625 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.131104 May 28 04:25:49.518209 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1235 bytes} [Sat May 28 04:25:49 2022] POST /compute/v2.1/flavors => generated 409 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:25:50.380253 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-9d099f5c-7679-470c-8b5f-36b5b1121f98 admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:50.381257 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-9d099f5c-7679-470c-8b5f-36b5b1121f98 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 May 28 04:25:50.381656 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 30/61] 10.222.0.58 () {56 vars in 1074 bytes} [Sat May 28 04:25:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:25:50.566406 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-6900b322-ca00-41bc-b053-ee7d254162f9 admin admin] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:25:50.585869 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-6900b322-ca00-41bc-b053-ee7d254162f9 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070091 May 28 04:25:50.586436 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1202 bytes} [Sat May 28 04:25:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:26:53.105024 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-9d099f5c-7679-470c-8b5f-36b5b1121f98 admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:26:53.106030 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-9d099f5c-7679-470c-8b5f-36b5b1121f98 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 May 28 04:26:53.106421 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 930 bytes} [Sat May 28 04:26:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:26:53.113951 n-d-843700-1 devstack@n-api.service[104233]: DEBUG dbcounter [-] [104233] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:26:53.165690 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-38cd5c41-8e9c-48eb-bb6b-a83584c2ceb3 admin admin] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:26:53.185298 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-38cd5c41-8e9c-48eb-bb6b-a83584c2ceb3 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072794 May 28 04:26:53.185839 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1291 bytes} [Sat May 28 04:26:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:26:53.208139 n-d-843700-1 devstack@n-api.service[104232]: DEBUG dbcounter [-] [104232] Writing DB stats nova_api:SELECT=14 {{(pid=104232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:26:53.212038 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-16b9e78c-59ba-4d2f-b77f-6d305c3c8a0d admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:26:53.219632 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-16b9e78c-59ba-4d2f-b77f-6d305c3c8a0d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013187 May 28 04:26:53.220169 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 32/65] 10.222.0.58 () {60 vars in 1282 bytes} [Sat May 28 04:26:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:26:53.232916 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-ae52cfa2-10eb-448d-bcd5-1ab6b58db072 admin admin] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:26:53.241366 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-ae52cfa2-10eb-448d-bcd5-1ab6b58db072 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012807 May 28 04:26:53.241874 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1285 bytes} [Sat May 28 04:26:53 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:26:53.253025 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-fdb6ae07-9695-4c4a-b974-1b0d19c799b4 admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:26:53.261555 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-fdb6ae07-9695-4c4a-b974-1b0d19c799b4 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012125 May 28 04:26:53.262063 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 33/67] 10.222.0.58 () {60 vars in 1285 bytes} [Sat May 28 04:26:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:26:53.274334 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-cca295fb-efc4-44f5-bd09-8cfe56c1f900 admin admin] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:26:53.282201 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-cca295fb-efc4-44f5-bd09-8cfe56c1f900 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011358 May 28 04:26:53.282722 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 35/68] 10.222.0.58 () {60 vars in 1282 bytes} [Sat May 28 04:26:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:32:43.881537 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-fdb6ae07-9695-4c4a-b974-1b0d19c799b4 admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:32:43.882544 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-fdb6ae07-9695-4c4a-b974-1b0d19c799b4 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002075 May 28 04:32:43.882930 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 34/69] 10.222.0.58 () {56 vars in 1074 bytes} [Sat May 28 04:32:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:32:44.037582 n-d-843700-1 devstack@n-api.service[104233]: DEBUG dbcounter [-] [104233] Writing DB stats nova_api:SELECT=6 {{(pid=104233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:32:44.150866 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-ad61013a-f433-4219-9141-cc3afd48a915 admin admin] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:32:44.152053 n-d-843700-1 devstack@n-api.service[104233]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:32:44.152053 n-d-843700-1 devstack@n-api.service[104233]: warnings.warn(msg) May 28 04:32:44.153245 n-d-843700-1 devstack@n-api.service[104233]: DEBUG oslo_concurrency.lockutils [None req-ad61013a-f433-4219-9141-cc3afd48a915 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:32:44.153715 n-d-843700-1 devstack@n-api.service[104233]: DEBUG oslo_concurrency.lockutils [None req-ad61013a-f433-4219-9141-cc3afd48a915 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:32:44.154493 n-d-843700-1 devstack@n-api.service[104233]: DEBUG oslo_concurrency.lockutils [None req-ad61013a-f433-4219-9141-cc3afd48a915 admin admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:32:44.154927 n-d-843700-1 devstack@n-api.service[104233]: DEBUG oslo_concurrency.lockutils [None req-ad61013a-f433-4219-9141-cc3afd48a915 admin admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:32:44.195903 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-ad61013a-f433-4219-9141-cc3afd48a915 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.160151 May 28 04:32:44.196477 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 36/70] 10.222.0.58 () {60 vars in 1193 bytes} [Sat May 28 04:32:44 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:32:45.064643 n-d-843700-1 devstack@n-api.service[104232]: DEBUG nova.api.openstack.wsgi [None req-fdb6ae07-9695-4c4a-b974-1b0d19c799b4 admin admin] Calling method '>' {{(pid=104232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:32:45.065653 n-d-843700-1 devstack@n-api.service[104232]: INFO nova.api.openstack.requestlog [None req-fdb6ae07-9695-4c4a-b974-1b0d19c799b4 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 28 04:32:45.066050 n-d-843700-1 devstack@n-api.service[104232]: [pid: 104232|app: 0|req: 35/71] 10.222.0.58 () {56 vars in 1074 bytes} [Sat May 28 04:32:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:32:45.262956 n-d-843700-1 devstack@n-api.service[104233]: DEBUG nova.api.openstack.wsgi [None req-3bfa107f-7cad-43c1-8abe-de9f20fea122 admin admin] Calling method '>' {{(pid=104233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:32:45.264193 n-d-843700-1 devstack@n-api.service[104233]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:32:45.264193 n-d-843700-1 devstack@n-api.service[104233]: warnings.warn(msg) May 28 04:32:45.265394 n-d-843700-1 devstack@n-api.service[104233]: DEBUG oslo_concurrency.lockutils [None req-3bfa107f-7cad-43c1-8abe-de9f20fea122 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:32:45.265834 n-d-843700-1 devstack@n-api.service[104233]: DEBUG oslo_concurrency.lockutils [None req-3bfa107f-7cad-43c1-8abe-de9f20fea122 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:32:45.266651 n-d-843700-1 devstack@n-api.service[104233]: DEBUG oslo_concurrency.lockutils [None req-3bfa107f-7cad-43c1-8abe-de9f20fea122 admin admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:32:45.267107 n-d-843700-1 devstack@n-api.service[104233]: DEBUG oslo_concurrency.lockutils [None req-3bfa107f-7cad-43c1-8abe-de9f20fea122 admin admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:32:45.289704 n-d-843700-1 devstack@n-api.service[104233]: INFO nova.api.openstack.requestlog [None req-3bfa107f-7cad-43c1-8abe-de9f20fea122 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.077632 May 28 04:32:45.290186 n-d-843700-1 devstack@n-api.service[104233]: [pid: 104233|app: 0|req: 37/72] 10.222.0.58 () {60 vars in 1193 bytes} [Sat May 28 04:32:45 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:33:34.218148 n-d-843700-1 systemd[1]: Stopping Devstack devstack@n-api.service... May 28 04:33:34.218710 n-d-843700-1 devstack@n-api.service[104231]: Sat May 28 04:33:34 2022 - graceful shutdown triggered... May 28 04:33:34.219265 n-d-843700-1 devstack@n-api.service[104232]: Gracefully killing worker 1 (pid: 104232)... May 28 04:33:34.219764 n-d-843700-1 devstack@n-api.service[104233]: Gracefully killing worker 2 (pid: 104233)... May 28 04:33:35.219095 n-d-843700-1 devstack@n-api.service[104231]: worker 1 buried after 1 seconds May 28 04:33:35.219531 n-d-843700-1 devstack@n-api.service[104231]: worker 2 buried after 1 seconds May 28 04:33:35.219531 n-d-843700-1 devstack@n-api.service[104231]: goodbye to uWSGI. May 28 04:33:35.220656 n-d-843700-1 systemd[1]: devstack@n-api.service: Succeeded. May 28 04:33:35.221231 n-d-843700-1 systemd[1]: Stopped Devstack devstack@n-api.service. May 28 04:33:35.224022 n-d-843700-1 systemd[1]: Starting Devstack devstack@n-api.service... May 28 04:33:35.242204 n-d-843700-1 devstack@n-api.service[126033]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 28 04:33:35.264193 n-d-843700-1 devstack@n-api.service[126033]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat May 28 04:33:35 2022] *** May 28 04:33:35.264193 n-d-843700-1 devstack@n-api.service[126033]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 28 04:33:35.264193 n-d-843700-1 devstack@n-api.service[126033]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 28 04:33:35.264193 n-d-843700-1 devstack@n-api.service[126033]: nodename: n-d-843700-1 May 28 04:33:35.264193 n-d-843700-1 devstack@n-api.service[126033]: machine: x86_64 May 28 04:33:35.264193 n-d-843700-1 devstack@n-api.service[126033]: clock source: unix May 28 04:33:35.264193 n-d-843700-1 devstack@n-api.service[126033]: pcre jit disabled May 28 04:33:35.264193 n-d-843700-1 devstack@n-api.service[126033]: detected number of CPU cores: 4 May 28 04:33:35.264193 n-d-843700-1 devstack@n-api.service[126033]: current working directory: / May 28 04:33:35.264193 n-d-843700-1 devstack@n-api.service[126033]: detected binary path: /usr/bin/uwsgi-core May 28 04:33:35.264193 n-d-843700-1 devstack@n-api.service[126033]: your processes number limit is 47680 May 28 04:33:35.264193 n-d-843700-1 devstack@n-api.service[126033]: your memory page size is 4096 bytes May 28 04:33:35.264193 n-d-843700-1 devstack@n-api.service[126033]: detected max file descriptor number: 2048 May 28 04:33:35.264193 n-d-843700-1 devstack@n-api.service[126033]: lock engine: pthread robust mutexes May 28 04:33:35.265325 n-d-843700-1 devstack@n-api.service[126033]: thunder lock: enabled May 28 04:33:35.265325 n-d-843700-1 devstack@n-api.service[126033]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 28 04:33:35.265325 n-d-843700-1 devstack@n-api.service[126033]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 28 04:33:35.310342 n-d-843700-1 devstack@n-api.service[126033]: Python main interpreter initialized at 0x55aff043c9c0 May 28 04:33:35.310342 n-d-843700-1 devstack@n-api.service[126033]: python threads support enabled May 28 04:33:35.310342 n-d-843700-1 devstack@n-api.service[126033]: your server socket listen backlog is limited to 100 connections May 28 04:33:35.310342 n-d-843700-1 devstack@n-api.service[126033]: your mercy for graceful operations on workers is 90 seconds May 28 04:33:35.310757 n-d-843700-1 devstack@n-api.service[126033]: mapped 403077 bytes (393 KB) for 2 cores May 28 04:33:35.310757 n-d-843700-1 devstack@n-api.service[126033]: *** Operational MODE: preforking *** May 28 04:33:35.311092 n-d-843700-1 devstack@n-api.service[126033]: *** uWSGI is running in multiple interpreter mode *** May 28 04:33:35.311092 n-d-843700-1 devstack@n-api.service[126033]: spawned uWSGI master process (pid: 126033) May 28 04:33:35.311301 n-d-843700-1 systemd[1]: Started Devstack devstack@n-api.service. May 28 04:33:35.312040 n-d-843700-1 devstack@n-api.service[126033]: spawned uWSGI worker 1 (pid: 126043, cores: 1) May 28 04:33:35.319300 n-d-843700-1 devstack@n-api.service[126033]: spawned uWSGI worker 2 (pid: 126044, cores: 1) May 28 04:33:35.319300 n-d-843700-1 devstack@n-api.service[126033]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 28 04:33:36.504674 n-d-843700-1 devstack@n-api.service[126043]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 28 04:33:36.505255 n-d-843700-1 devstack@n-api.service[126044]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 28 04:33:37.297850 n-d-843700-1 devstack@n-api.service[126044]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 04:33:37.297850 n-d-843700-1 devstack@n-api.service[126044]: from cryptography.utils import int_from_bytes May 28 04:33:37.298215 n-d-843700-1 devstack@n-api.service[126044]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 04:33:37.298215 n-d-843700-1 devstack@n-api.service[126044]: from cryptography.utils import int_from_bytes May 28 04:33:37.304008 n-d-843700-1 devstack@n-api.service[126043]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 04:33:37.304008 n-d-843700-1 devstack@n-api.service[126043]: from cryptography.utils import int_from_bytes May 28 04:33:37.304348 n-d-843700-1 devstack@n-api.service[126043]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 04:33:37.304348 n-d-843700-1 devstack@n-api.service[126043]: from cryptography.utils import int_from_bytes May 28 04:33:39.759407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 28 04:33:39.760025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 28 04:33:39.760025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 28 04:33:39.760470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 28 04:33:39.760611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 28 04:33:39.761109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 28 04:33:39.761237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 28 04:33:39.761832 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.761966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 28 04:33:39.762171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.762287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 28 04:33:39.762502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.762604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 28 04:33:39.762837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.762952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.763204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.763324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.763527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.763648 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.763869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.763981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.764186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.764313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.764517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.764634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.764772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.764915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.765143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.765476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.765731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.765859 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.766051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.766175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-843700-1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.766381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-843700-1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.766490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.766703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.766826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.767023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.767133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.767338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.767439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.767661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.767768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.767971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.768081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.768297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.768412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.768604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.768801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.769104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.769742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.769838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.770199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.770457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.770598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.770786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.770915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.771193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.771931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.772090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.772384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.772722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.772851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.773028 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.773190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.773522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.773656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-843700-1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.773849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.773987 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.774245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.774451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.774582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.775005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.775240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.775361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.775659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.775871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.775965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.776228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-843700-1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.776363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.776543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.776661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.776916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.777244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.777388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.777567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.777894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.778131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.778228 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.778500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.778813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.779088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.779203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.779483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.779802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.779937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.780051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.780355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.780508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.780685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.781014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.781152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.781343 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.781602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.781741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.781855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.781978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.782296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.782601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.782728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.782948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.783451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.783576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.783656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.783741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.783870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.783985 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.784226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.784553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.784828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.784918 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.785001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.785158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.785279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.785523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.785679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.785834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.785997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.786149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.786325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.786475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.786650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.786800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.786978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.787727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.787926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.788054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.788182 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.788384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.788506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.788794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.788895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.789052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.789157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.789369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.789471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.789723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.789891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.790035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.790139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.790328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.790435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.790665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.790936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.791084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.791285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.791389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.791594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.791688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.791915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.792020 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.792234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.792339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.792558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.792696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.792866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.792961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.793122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.793224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.793431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.793574 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.793745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.793854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.794069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.794164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.794380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.794495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.794692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.794795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.795020 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.795118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.795331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.795424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.795645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.795782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.795960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.796066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.796272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.796375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.796580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.796688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.796888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.796990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.797198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.797300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.797506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.797607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.797758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.797850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.798064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.798154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.798375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.798467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.798699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.798793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.799035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.799141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.799331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.799433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.799638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.799745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.799959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.800072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.800246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.800369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.800555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.800680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.800858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.800965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.801166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.801273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.801470 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.801575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.801775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.801875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.802083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.802174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.802388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.802493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.802737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.802887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.803070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.803186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.803376 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.803477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.803687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.803787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.803992 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.804085 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.804300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.804470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.804616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.804788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.804940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.805089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.805238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.805380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.805526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.805759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.806003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.806169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.806318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.806479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.806621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.806781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.806936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.807103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.807247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.807396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.807396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.807685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.807829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.807982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.808131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.808278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.808436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.808590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.808740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.808843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.809003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.809155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.809313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.809463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.809599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.809685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.809757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.809828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.811047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.811244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.811401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.811562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.811722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.811883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.812030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.812175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.812319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.812476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.812632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.812785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.812930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.813074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.813224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.813368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.813540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.813694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.814053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.814208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.814381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 04:33:39.814686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.814845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.814953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.815099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.815255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.815413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.815558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.815711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.815955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.816133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.816361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.816521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.816675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.816866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.816971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.817087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.817185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.817305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.817428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.817518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.817611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.817704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.817704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.817867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.817964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.818055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.818148 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.818241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.818339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.818432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.818523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.818607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.818707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.818800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.818891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.818975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.819148 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.819290 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.819388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.819473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.819686 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.819780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.820015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.820121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.820340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.820488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.820650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.820798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.820965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.821067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.821282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.821383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.821597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.821689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.821933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.822038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.822250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.822340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.822562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.822662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.822877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.822979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.823213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.823304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.823538 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.823643 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.823853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.824022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.824174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.824319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.824488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.824622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.824801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.824978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.825138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.825289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.825435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.825586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.825745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.825895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.826058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.826199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.826351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.826511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.826673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.826842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.827061 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.827158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.827259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.827357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.827565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.827660 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.827877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.827972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.828192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.828295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.828501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.828599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.828815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.828910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.829120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.829227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.829426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.829520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.829738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.829841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.830042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.830146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.830362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.830455 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.830689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.830797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.831014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.831112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.831328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.831424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.831645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.831747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.831958 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.832055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.832271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.832365 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.832585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.832678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.832889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.832991 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.833204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.833307 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.833518 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.833627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.833826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.834441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.835123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.835225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.835313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.835417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.835512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.835599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.835683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.835775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.835867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.835966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.836171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.836285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.836487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.836648 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.836810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.836973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.837134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.837282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.837434 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.837575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.837988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.838142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.838298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.838451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.838594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.838742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.838901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.839135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.839289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.839398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.839536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.839638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.839811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.839915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.840132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.840225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.840444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.840536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.840755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.840860 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.841058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.841161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.841364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.841465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.841666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.841766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.841973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.842074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.842277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.842380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.842604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.842719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.842893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.843003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.843222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.843327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.843528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.843621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.843831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.843923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.844138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.844274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.844462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.844566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.844775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.844880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.845076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.845182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.845380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.845471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.845682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.845781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.846023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.846125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.846330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.846444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.846657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.846750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.846974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.847137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.847317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.847408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.847625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.847727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.847940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.848039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.848256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.848355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.848569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.848662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.848880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.848973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.849196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.849296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.849505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.850190 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.850360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.850453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.850670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.850775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.851007 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.851145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.851322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.851489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.851656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.851815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.851967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.852129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.852273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.852424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.852574 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.852715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.852857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.853011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.853161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.853304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.853452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.853597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.853771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.853925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.854072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.854249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.854432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.854541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.854700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.854942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.855137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.855296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.855403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.855491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.855633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.855735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.855944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.856036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.856262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.856367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.856571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.856687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.856883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.856978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.857190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.857332 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.857498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.857597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.857807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.857898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.858124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.858228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.858424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.858523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.858739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.858839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.859073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.859263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.859410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.859563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.859715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.859876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.860019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.860176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.860330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.860481 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.860632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.860774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.860941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.861110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.861275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.861420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.861560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.861719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.861944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.862089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.862233 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.862382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.862531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.862679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.862836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.863004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.863163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.863309 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.863454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.863562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.863661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.863757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.863963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.864065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.864265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.864358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.864571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.864676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.864880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.864989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.865749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.865871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.866019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.866114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.866340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.866433 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.866659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.866796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.866962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.867093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.867403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.867521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.867614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.867711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.867908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.868009 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.868213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.868308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.868519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.868626 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.868824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.868917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.869134 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.869234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.869449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.869551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.869760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.869860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.870076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.870177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.870392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.870493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.870701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.870793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.871029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.871137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.871335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.871432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.871645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.871746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.871966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.872229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.872336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.872569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.872670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.872875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.872968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.873184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.873279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.873491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.873592 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.873799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.873894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.874120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.874214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.874429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.874530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.874737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.874832 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.875065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.875214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.875364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.875458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.875668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.875763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.875984 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.876080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.876342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.876554 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.876648 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.876883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.877022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.877200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.877294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.877520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.877635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.877839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.877941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.878146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.878238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.878453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.878548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.878764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.878858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.879107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.879224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.879416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.879541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.879732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.879842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.880037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.880129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.880342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.880437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.880656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.880778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.881498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.881603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.881809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.881922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.882119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.882226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.882438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.882538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.882744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.882839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.883070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.883182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.883378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.883480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.883684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.883779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.883999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.884095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.884305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.884398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.884616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.884717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.884921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.885018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.885245 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.885351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.885554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.885660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.885855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.885948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.886162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.886275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.886465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.886575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.886777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.886871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.887112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.887212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.887430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.887593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.887745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.887841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.888052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.888156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.888366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.888469 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.888669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.888769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.888984 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.889085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.889292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.889386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.889596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.889702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.889901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.889995 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.890211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.890306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.890521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.890622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.890825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.890919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.891162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.891269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.891471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.891739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.891876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.892065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.892232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.892376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.892470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.892679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.892810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.892992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.893085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.893293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.893386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.893599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.893699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.893906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.894000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.894211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.894304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.894513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.894624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.894816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.894962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.895182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.895328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.895462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.895552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.895741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.895887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.896052 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.896181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.896369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.896502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.896698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.896793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.897001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.897102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.897305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.897416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.897613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.897748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.897921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.898013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.898225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.898327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.898537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.898637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.898845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.898937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.899176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.899351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.899486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.899587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.899794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.899895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.900095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.900199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.900400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.900494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.900710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.900810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.901021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.901124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.901331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.901436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.901633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.901732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.901945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.902039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.902249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.902352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.902733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.902863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.903022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.903169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.903267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.903362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.903456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.903555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.903756 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.903850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.904058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.904153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.904362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.904467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.904666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.904759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.904988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.905081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.905299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.905453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.905609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.905745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.905910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.906011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.906272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.906391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.906553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.906656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.906859 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.906954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.907197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.907336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.907521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.907625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.907835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.907939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.908154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.908257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.908459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.908552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.908767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.908859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.909076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.909170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.909385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.909492 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.909693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.909795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.910000 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.910094 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.910313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.910418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.910617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.910711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.910920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.911048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.911266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.911360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.911579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.911687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.911888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.911992 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.912231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.912334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.912577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.912696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.912889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.912992 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.913195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.913295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.913506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.913610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.913813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.913913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.914119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.914220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.914425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.914519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.914734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.914835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.915060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.915206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.915372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.915508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.915682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.915786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.915993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.916099 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.916378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.916496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.916594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.916681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.916905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.917001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.917217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.917319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.917524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.917632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.917850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.917984 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.918160 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.918296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.918464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.918613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.918774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.918931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.919117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.919279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.919433 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.919590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.919737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.919897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.920166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.920263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.920479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.920574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.920790 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.920902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.921094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.921198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.921405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.921499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.921714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.921817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.922025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.922162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.922338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.922438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.922645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.922747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.923087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.923201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.923400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.923500 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.923712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.923806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.924027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.924129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.924332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.924427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.924637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.924732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.924947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.925041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.925272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.925380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.925578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.925679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.925884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.925989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.926188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.926298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.926512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.926619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.926814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.926917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.927172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.927308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.927591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.928198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.928417 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.928512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.928727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.928836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.929071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.929172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.929394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.929503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.929725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.929820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.930063 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.930155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.930388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.930493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.930713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.930815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.931053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.931197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.931364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.931485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.931683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.931798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.932010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.932113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.932327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.932482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.932630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.932774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.932986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.933131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.933295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.933440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.933582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.933746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.933890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.934031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.934184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.934327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.934475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.934618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.934769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.934943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.935116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.935316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.935476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.935632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.935774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.935932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.936082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.936255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.936404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.936572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.936785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.936951 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.937103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.937246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.937395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.937552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.937714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.937870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.938015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.938163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.938321 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.938463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.938608 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.938765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.938910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.939075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.939181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.939270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.939428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.939542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.939743 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.939839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.940078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.940171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.940411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.940515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.940733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.940842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.941063 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.941155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.941386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.941488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.941703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.941795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.942008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.942150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.942333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.942436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.942635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.942745 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.942940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.943082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.943305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.943898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.944146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.944248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.944460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.944660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.944761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.944855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.945063 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.945166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.945370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.945475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.945678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.945807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.945985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.946080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.946310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.946450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.946618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.946756 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.946942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.947066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.947283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.947388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.947594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.947726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.947905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.948008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.948216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.948310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.948531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.948666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.948835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.948943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.949141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.949244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.949444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.949547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.949759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.949866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.950063 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.950163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.950367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.950462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.950671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.950853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.951016 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.951115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.951321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.951427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.951644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.951774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.951957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.952059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.952263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.952388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.952567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.952680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.952879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.952973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.953195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.953514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.953607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.953835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.953929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.954156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.954249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.954512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.954690 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.954837 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.955044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.955197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.955369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.955510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.955686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.955834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.956004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.956148 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.956323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.956464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.956641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.956778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.956956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.957096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.957272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.957382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.957585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.957681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.957900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.958006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.958231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.958345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.958559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.958669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.958902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.959064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.959291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.959400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.959676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.959824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.959997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.960153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.960317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.960470 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.960645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.960782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.961007 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.961104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.961325 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.961420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.961639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.961732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.961960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.962054 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.962280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.962425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.962590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.962983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.963206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.963327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.963529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.963624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.963846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.963938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.964165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.964268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.964483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.964577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.964799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.964893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.965111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.965218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.965425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.965519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.965750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.965843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.966080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.966192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.966397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.966498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.966702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.966796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.967038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.967193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.967356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.967466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.967669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.967881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.967977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.968204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.968308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.968544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.968706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.968877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.968974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.969187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.969289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.969498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.969601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.969818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.969921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.970133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.970228 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.970444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.970544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.970762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.970858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.971102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.971199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.971419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.971523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.971729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.971822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.972042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.972135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.972358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.972563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.972684 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.972887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.972996 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.973220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.973322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.973549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.973805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.973909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.974164 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.974266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.974488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.974606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.974840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.974937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.975173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.975283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.975483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.975579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.975795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.975907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.976106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.976213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.976412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.976515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.976740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.976871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.977037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.977172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.977342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.977438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.977652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.977753 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.977961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.978069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.978275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.978493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.978597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.978844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.978938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.979186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.979318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.979511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.979633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.979842 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.979965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.980152 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.980251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.980459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.980560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.980773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.980868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.981081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.981175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.981388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.981488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.981699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.981808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.982009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.982111 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.982316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.982410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.982620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.982726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.982930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.983091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.983265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.983381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.983573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.983680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.983885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.983980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.984191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.984283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.984503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.984616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.984811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.984903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.985116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.985217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.985420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.985514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.985730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.985823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.986038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.986189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.986340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.986441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.986639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.986737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.986944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.987058 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.987281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.987377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.987584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.987678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.987896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.987991 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.988204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.988509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.988620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.988870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.988984 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.989119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.989228 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.989474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.989568 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.989803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.989898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.990112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.990722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.990922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.991118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.991264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.991367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.991575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.991670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.991900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.992001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.992210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.992303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.992525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.992783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.992878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.993147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.993263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.993458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.993567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.993773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.993991 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.994086 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.994323 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.994431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.994645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.994741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.994979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.995122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.995319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.995428 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.995628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.995729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.995933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.996035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.996238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.996342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.996562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.996715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.996876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.996979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.997188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.997295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.997502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.997600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.997812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.997913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.998122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.998260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.998432 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.998527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.998741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.998843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.999078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.999198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.999390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.999487 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.999703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:39.999818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.000010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.000112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.000324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.000418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.000635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.000741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.000948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.001044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.001287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.001390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.001606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.001715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.001922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.002016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.002239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.002334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.002555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.002658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.002864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.002959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.003199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.003307 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.003510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.003607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.003819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.003915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.004135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.004230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.004467 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.004571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.004780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.004882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.005087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.005193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.005399 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.005495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.005716 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.006389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.006593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.006728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.006911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.007076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.007279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.007392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.007558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.007700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.007875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.008025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.008185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.008339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.008496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.008662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.008807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.008976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.009172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.009304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.009458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.009642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.009738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.009967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.010061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.010295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.010402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.010602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.010697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.010908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.011042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.011235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.011412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.011547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.011641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.011858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.011953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.012166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.012261 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.012471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.012566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.012777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.012873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.013085 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.013182 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.013389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.183674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.186475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.186475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.187001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.201638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.202304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.202646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.202909 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.203038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.203537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.203618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.203851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.203943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.204026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.204118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.204303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.204512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.204936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.205092 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.205092 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.205233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.205535 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.205776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.205949 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.206150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.206314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.206604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.206741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.206921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.207051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.208044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.208617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.208820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.209007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.209355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.209590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.209975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.210122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.210688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.210964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.211243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.211373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.211839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.212245 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.212450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.213061 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.213360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.213619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.213954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.214226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.214376 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.214625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.214744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.214883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.215100 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.215334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.215470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.216418 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.216651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.216847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.217039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.217287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.217617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.217860 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.217942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.218116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.218460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.218617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.218872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.219059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.219222 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.219353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.219481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.219626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.219742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.219927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.220372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.220739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.220841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.221137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.221331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.221693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.221912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.222664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.222796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.222921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.222921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.223202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.223368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.223561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.223727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.223873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.224001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.224206 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.224206 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 28 04:33:40.224978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.224978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.224978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.224978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.224978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.224978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.224978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.224978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.226640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.226640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.226640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.226640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.226640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.226640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 04:33:40.226640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 28 04:33:40.227533 n-d-843700-1 devstack@n-api.service[126043]: INFO dbcounter [None req-3939f8f3-7892-4413-b84d-c72327deec3a None None] Registered counter for database nova_api May 28 04:33:40.227727 n-d-843700-1 devstack@n-api.service[126044]: INFO dbcounter [None req-8fbc7dc5-242b-44e2-859b-798c8acd8d48 None None] Registered counter for database nova_api May 28 04:33:40.227912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_db.sqlalchemy.engines [None req-3939f8f3-7892-4413-b84d-c72327deec3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126043) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 04:33:40.228043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_db.sqlalchemy.engines [None req-8fbc7dc5-242b-44e2-859b-798c8acd8d48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 04:33:40.228181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writer thread running {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 04:33:40.228308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writer thread running {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 04:33:40.228483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.context [None req-3939f8f3-7892-4413-b84d-c72327deec3a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8c12a9b9-d304-4763-b71f-4058d5ce2ded(cell1) {{(pid=126043) load_cells /opt/stack/nova/nova/context.py:464}} May 28 04:33:40.228483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3939f8f3-7892-4413-b84d-c72327deec3a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:33:40.228483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3939f8f3-7892-4413-b84d-c72327deec3a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:33:40.228483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3939f8f3-7892-4413-b84d-c72327deec3a None None] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:33:40.228483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3939f8f3-7892-4413-b84d-c72327deec3a None None] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:33:40.229131 n-d-843700-1 devstack@n-api.service[126043]: INFO dbcounter [None req-3939f8f3-7892-4413-b84d-c72327deec3a None None] Registered counter for database nova_cell0 May 28 04:33:40.229420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.context [None req-8fbc7dc5-242b-44e2-859b-798c8acd8d48 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8c12a9b9-d304-4763-b71f-4058d5ce2ded(cell1) {{(pid=126044) load_cells /opt/stack/nova/nova/context.py:464}} May 28 04:33:40.229579 n-d-843700-1 devstack@n-api.service[126043]: INFO dbcounter [None req-3939f8f3-7892-4413-b84d-c72327deec3a None None] Registered counter for database nova_cell1 May 28 04:33:40.229709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8fbc7dc5-242b-44e2-859b-798c8acd8d48 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:33:40.229709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8fbc7dc5-242b-44e2-859b-798c8acd8d48 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:33:40.229709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8fbc7dc5-242b-44e2-859b-798c8acd8d48 None None] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:33:40.229709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8fbc7dc5-242b-44e2-859b-798c8acd8d48 None None] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:33:40.230191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_db.sqlalchemy.engines [None req-3939f8f3-7892-4413-b84d-c72327deec3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126043) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 04:33:40.230343 n-d-843700-1 devstack@n-api.service[126044]: INFO dbcounter [None req-8fbc7dc5-242b-44e2-859b-798c8acd8d48 None None] Registered counter for database nova_cell0 May 28 04:33:40.230471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_db.sqlalchemy.engines [None req-3939f8f3-7892-4413-b84d-c72327deec3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126043) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 04:33:40.230612 n-d-843700-1 devstack@n-api.service[126044]: INFO dbcounter [None req-8fbc7dc5-242b-44e2-859b-798c8acd8d48 None None] Registered counter for database nova_cell1 May 28 04:33:40.230733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writer thread running {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 04:33:40.230733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writer thread running {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 04:33:40.230977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_db.sqlalchemy.engines [None req-8fbc7dc5-242b-44e2-859b-798c8acd8d48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 04:33:40.230977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_db.sqlalchemy.engines [None req-8fbc7dc5-242b-44e2-859b-798c8acd8d48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 04:33:40.230977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writer thread running {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 04:33:40.371120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writer thread running {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 04:33:40.372994 n-d-843700-1 devstack@n-api.service[126043]: INFO dbcounter [None req-3939f8f3-7892-4413-b84d-c72327deec3a None None] Registered counter for database nova_cell0 May 28 04:33:40.381141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_db.sqlalchemy.engines [None req-3939f8f3-7892-4413-b84d-c72327deec3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126043) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 04:33:40.382724 n-d-843700-1 devstack@n-api.service[126044]: INFO dbcounter [None req-8fbc7dc5-242b-44e2-859b-798c8acd8d48 None None] Registered counter for database nova_cell0 May 28 04:33:40.386067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writer thread running {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 04:33:40.391392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_db.sqlalchemy.engines [None req-8fbc7dc5-242b-44e2-859b-798c8acd8d48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 04:33:40.396343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writer thread running {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 04:33:40.712319 n-d-843700-1 devstack@n-api.service[126043]: WARNING keystonemiddleware.auth_token [None req-3939f8f3-7892-4413-b84d-c72327deec3a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 04:33:40.717532 n-d-843700-1 devstack@n-api.service[126044]: WARNING keystonemiddleware.auth_token [None req-8fbc7dc5-242b-44e2-859b-798c8acd8d48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 04:33:40.719993 n-d-843700-1 devstack@n-api.service[126043]: WARNING keystonemiddleware.auth_token [None req-3939f8f3-7892-4413-b84d-c72327deec3a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 04:33:40.725502 n-d-843700-1 devstack@n-api.service[126044]: WARNING keystonemiddleware.auth_token [None req-8fbc7dc5-242b-44e2-859b-798c8acd8d48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 04:33:41.068932 n-d-843700-1 devstack@n-api.service[126043]: WARNING keystonemiddleware.auth_token [None req-3939f8f3-7892-4413-b84d-c72327deec3a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 04:33:41.071016 n-d-843700-1 devstack@n-api.service[126044]: WARNING keystonemiddleware.auth_token [None req-8fbc7dc5-242b-44e2-859b-798c8acd8d48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 04:33:41.075001 n-d-843700-1 devstack@n-api.service[126043]: WARNING keystonemiddleware.auth_token [None req-3939f8f3-7892-4413-b84d-c72327deec3a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 04:33:41.077004 n-d-843700-1 devstack@n-api.service[126044]: WARNING keystonemiddleware.auth_token [None req-8fbc7dc5-242b-44e2-859b-798c8acd8d48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 04:33:41.080321 n-d-843700-1 devstack@n-api.service[126043]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aff043c9c0 pid: 126043 (default app) May 28 04:33:41.082261 n-d-843700-1 devstack@n-api.service[126044]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aff043c9c0 pid: 126044 (default app) May 28 04:34:27.756539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:34:27.757436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:34:27.758484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:34:27.759282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:34:29.173571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:34:29.174434 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:34:29.175536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:34:29.181361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:34:29.306978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-306a2a1e-21b3-4795-a9e8-9359438d20ae tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] Calling method '.version_select at 0x7f7704396c10>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:29.309352 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:29.309352 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:29.315427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-306a2a1e-21b3-4795-a9e8-9359438d20ae tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8c12a9b9-d304-4763-b71f-4058d5ce2ded(cell1) {{(pid=126043) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 28 04:34:29.316522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-306a2a1e-21b3-4795-a9e8-9359438d20ae tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:29.317155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-306a2a1e-21b3-4795-a9e8-9359438d20ae tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:29.355551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-306a2a1e-21b3-4795-a9e8-9359438d20ae tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:29.355959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-306a2a1e-21b3-4795-a9e8-9359438d20ae tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:29.373739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-306a2a1e-21b3-4795-a9e8-9359438d20ae tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:29.374278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-306a2a1e-21b3-4795-a9e8-9359438d20ae tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:29.384682 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-306a2a1e-21b3-4795-a9e8-9359438d20ae tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.637769 May 28 04:34:29.385716 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1207 bytes} [Sat May 28 04:34:27 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:34:29.405259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f8b77fcb-0a90-461f-9aeb-89644eaa8f3f tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-707012023"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:29.427114 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:29.427114 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:29.428514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.aggregate [None req-f8b77fcb-0a90-461f-9aeb-89644eaa8f3f tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] Generated uuid af1b7690-1122-438e-9b28-5c2b7d7d4b96 for aggregate {{(pid=126043) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 04:34:29.627169 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f8b77fcb-0a90-461f-9aeb-89644eaa8f3f tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.224901 May 28 04:34:29.628058 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2/2] 10.222.0.58 () {62 vars in 1204 bytes} [Sat May 28 04:34:29 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:34:30.176720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b842f826-3541-4bc4-b79c-6dccc7347af0 tempest-AZAdminNegativeTestJSON-1557257852 tempest-AZAdminNegativeTestJSON-1557257852-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:30.177799 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:30.177799 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:30.178805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b842f826-3541-4bc4-b79c-6dccc7347af0 tempest-AZAdminNegativeTestJSON-1557257852 tempest-AZAdminNegativeTestJSON-1557257852-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '569f29f72ebb406eaf4ae2829ddca802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea38448db014d98917fde336a4fda4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b842f826-3541-4bc4-b79c-6dccc7347af0 tempest-AZAdminNegativeTestJSON-1557257852 tempest-AZAdminNegativeTestJSON-1557257852-project] Request method failure captured: May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZSPf2TfkfRtnVnu02rIazb-K3Zc6tgJj0uzl22FYWSJY-FDR86Pex_nXUlMWMrtr-kShN1TUqYZ3BqJV0Ucs8avIJwNWXbGGXOktTi5MYPuzlUzrw3_mybVnuPs2cRUa7bjhxOMk50TL8vxA954VvSOoMRPvwYIPMz-rEQ8pzsu0o May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 0ea38448db014d98917fde336a4fda4f May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1557257852 May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:34:30.182643 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:34:30.186735 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0ea38448db014d98917fde336a4fda4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0ea38448db014d98917fde336a4fda4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0ea38448db014d98917fde336a4fda4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0ea38448db014d98917fde336a4fda4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:34:30.186735 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AZAdminNegativeTestJSON-1557257852 May 28 04:34:30.186735 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 0ea38448db014d98917fde336a4fda4f May 28 04:34:30.186735 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1557257852 May 28 04:34:30.186735 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AZAdminNegativeTestJSON-1557257852-project May 28 04:34:30.186735 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:34:30.186735 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:34:30.186735 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 569f29f72ebb406eaf4ae2829ddca802 May 28 04:34:30.186735 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AZAdminNegativeTestJSON-1557257852-project May 28 04:34:30.186735 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:34:30.186735 n-d-843700-1 devstack@n-api.service[126043]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 28 04:34:30.186735 n-d-843700-1 devstack@n-api.service[126043]: action_args: {} May 28 04:34:30.187366 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:34:30.187366 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:30.187366 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:30.187366 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:30.187366 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:34:30.187366 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:34:30.187366 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:34:30.187366 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:34:30.187366 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail May 28 04:34:30.187366 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) May 28 04:34:30.187366 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:34:30.187366 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:34:30.187366 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:34:30.187366 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:34:30.187366 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:34:30.187366 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:34:30.187366 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:34:30.187366 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:34:30.187366 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:34:30.188262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:34:30.188262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:34:30.188262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:34:30.188262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:34:30.188262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:34:30.188262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 28 04:34:30.188262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:30.188262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:30.188262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:30.188262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:30.188262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:30.188262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:30.188262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:34:30.188262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:34:30.188262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 28 04:34:30.188262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:30.188262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b842f826-3541-4bc4-b79c-6dccc7347af0 tempest-AZAdminNegativeTestJSON-1557257852 tempest-AZAdminNegativeTestJSON-1557257852-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:34:30.189106 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b842f826-3541-4bc4-b79c-6dccc7347af0 tempest-AZAdminNegativeTestJSON-1557257852 tempest-AZAdminNegativeTestJSON-1557257852-project] 10.222.0.58 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.545460 May 28 04:34:30.190234 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3/3] 10.222.0.58 () {58 vars in 1184 bytes} [Sat May 28 04:34:29 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 552 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:34:30.196133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bdc83f9d-fc40-4cdc-8455-93b8a519f4bf tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-213304368"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:30.275668 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:30.275668 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:30.413734 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bdc83f9d-fc40-4cdc-8455-93b8a519f4bf tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.221621 May 28 04:34:30.414376 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4/4] 10.222.0.58 () {62 vars in 1209 bytes} [Sat May 28 04:34:30 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:34:30.711115 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d08aca26-71fe-47b2-9e47-98c68b26ffa4 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '.version_select at 0x7f7704397c10>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:30.712009 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:30.712009 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:30.717713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d08aca26-71fe-47b2-9e47-98c68b26ffa4 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8c12a9b9-d304-4763-b71f-4058d5ce2ded(cell1) {{(pid=126044) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 28 04:34:30.718655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d08aca26-71fe-47b2-9e47-98c68b26ffa4 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:30.719137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d08aca26-71fe-47b2-9e47-98c68b26ffa4 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:30.747780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d08aca26-71fe-47b2-9e47-98c68b26ffa4 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:30.748463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d08aca26-71fe-47b2-9e47-98c68b26ffa4 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:30.761236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fff863e7-b210-4842-a313-a8625627692d tempest-AZAdminV2TestJSON-874491724 tempest-AZAdminV2TestJSON-874491724-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:30.763609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fff863e7-b210-4842-a313-a8625627692d tempest-AZAdminV2TestJSON-874491724 tempest-AZAdminV2TestJSON-874491724-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:30.768775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fff863e7-b210-4842-a313-a8625627692d tempest-AZAdminV2TestJSON-874491724 tempest-AZAdminV2TestJSON-874491724-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:30.768775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fff863e7-b210-4842-a313-a8625627692d tempest-AZAdminV2TestJSON-874491724 tempest-AZAdminV2TestJSON-874491724-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:30.768775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fff863e7-b210-4842-a313-a8625627692d tempest-AZAdminV2TestJSON-874491724 tempest-AZAdminV2TestJSON-874491724-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:30.782258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d08aca26-71fe-47b2-9e47-98c68b26ffa4 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:30.784615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d08aca26-71fe-47b2-9e47-98c68b26ffa4 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:30.798539 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d08aca26-71fe-47b2-9e47-98c68b26ffa4 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.630321 May 28 04:34:30.802844 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1/5] 10.222.0.58 () {58 vars in 1166 bytes} [Sat May 28 04:34:29 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:30.812599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0dafe779-7650-45b9-a03c-4fe336d83827 tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:30.813725 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:30.813725 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:30.847192 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0dafe779-7650-45b9-a03c-4fe336d83827 tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.042953 May 28 04:34:30.851295 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fff863e7-b210-4842-a313-a8625627692d tempest-AZAdminV2TestJSON-874491724 tempest-AZAdminV2TestJSON-874491724-project-admin] 10.222.0.58 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.435853 May 28 04:34:30.852511 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2/6] 10.222.0.58 () {60 vars in 1189 bytes} [Sat May 28 04:34:30 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:34:30.860735 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 5/7] 10.222.0.58 () {58 vars in 1163 bytes} [Sat May 28 04:34:30 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:34:30.866540 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-05f1553c-6687-4918-ab65-1e0c3e120367 tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843700-1"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:30.868428 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:30.868428 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:30.877251 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-05f1553c-6687-4918-ab65-1e0c3e120367 tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:30.878063 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-05f1553c-6687-4918-ab65-1e0c3e120367 tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:31.190496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-80a2f0d3-8717-4897-91d4-36d57cb2de3f tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:31.193274 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:31.193274 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:31.196314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80a2f0d3-8717-4897-91d4-36d57cb2de3f tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:31.197012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80a2f0d3-8717-4897-91d4-36d57cb2de3f tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:31.198319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80a2f0d3-8717-4897-91d4-36d57cb2de3f tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:31.199426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80a2f0d3-8717-4897-91d4-36d57cb2de3f tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:31.247996 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-80a2f0d3-8717-4897-91d4-36d57cb2de3f tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.391999 May 28 04:34:31.271927 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3/8] 10.222.0.58 () {58 vars in 1175 bytes} [Sat May 28 04:34:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:31.293285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d2c42612-6451-4b13-92f1-9aa708dfe6ff tempest-AZAdminV2TestJSON-874491724 tempest-AZAdminV2TestJSON-874491724-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:31.294908 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:31.294908 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:31.314074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d2c42612-6451-4b13-92f1-9aa708dfe6ff tempest-AZAdminV2TestJSON-874491724 tempest-AZAdminV2TestJSON-874491724-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:31.314412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d2c42612-6451-4b13-92f1-9aa708dfe6ff tempest-AZAdminV2TestJSON-874491724 tempest-AZAdminV2TestJSON-874491724-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:31.315355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d2c42612-6451-4b13-92f1-9aa708dfe6ff tempest-AZAdminV2TestJSON-874491724 tempest-AZAdminV2TestJSON-874491724-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:31.318036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d2c42612-6451-4b13-92f1-9aa708dfe6ff tempest-AZAdminV2TestJSON-874491724 tempest-AZAdminV2TestJSON-874491724-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:31.376163 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d2c42612-6451-4b13-92f1-9aa708dfe6ff tempest-AZAdminV2TestJSON-874491724 tempest-AZAdminV2TestJSON-874491724-project-admin] 10.222.0.58 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.090091 May 28 04:34:31.387347 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4/9] 10.222.0.58 () {58 vars in 1184 bytes} [Sat May 28 04:34:31 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:31.918008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-93dc380a-ff90-4614-aafe-47c49e655c92 tempest-HypervisorAdminV228Test-384793662 tempest-HypervisorAdminV228Test-384793662-project-admin] Calling method '.version_select at 0x7f77041b3d30>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:31.918924 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:31.918924 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:31.922144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93dc380a-ff90-4614-aafe-47c49e655c92 tempest-HypervisorAdminV228Test-384793662 tempest-HypervisorAdminV228Test-384793662-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:31.922775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93dc380a-ff90-4614-aafe-47c49e655c92 tempest-HypervisorAdminV228Test-384793662 tempest-HypervisorAdminV228Test-384793662-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:31.980395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93dc380a-ff90-4614-aafe-47c49e655c92 tempest-HypervisorAdminV228Test-384793662 tempest-HypervisorAdminV228Test-384793662-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:31.985894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93dc380a-ff90-4614-aafe-47c49e655c92 tempest-HypervisorAdminV228Test-384793662 tempest-HypervisorAdminV228Test-384793662-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:32.012515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93dc380a-ff90-4614-aafe-47c49e655c92 tempest-HypervisorAdminV228Test-384793662 tempest-HypervisorAdminV228Test-384793662-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:32.013946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93dc380a-ff90-4614-aafe-47c49e655c92 tempest-HypervisorAdminV228Test-384793662 tempest-HypervisorAdminV228Test-384793662-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:32.030733 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-93dc380a-ff90-4614-aafe-47c49e655c92 tempest-HypervisorAdminV228Test-384793662 tempest-HypervisorAdminV228Test-384793662-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.641621 May 28 04:34:32.036205 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 5/10] 10.222.0.58 () {60 vars in 1186 bytes} [Sat May 28 04:34:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:34:32.047025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d61076ff-f8a6-4d75-b916-30a052ec5f98 tempest-HypervisorAdminV228Test-384793662 tempest-HypervisorAdminV228Test-384793662-project-admin] Calling method '.version_select at 0x7f77041b3e50>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:32.049330 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:32.049330 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:32.054540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d61076ff-f8a6-4d75-b916-30a052ec5f98 tempest-HypervisorAdminV228Test-384793662 tempest-HypervisorAdminV228Test-384793662-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:32.057663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d61076ff-f8a6-4d75-b916-30a052ec5f98 tempest-HypervisorAdminV228Test-384793662 tempest-HypervisorAdminV228Test-384793662-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:32.099354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d61076ff-f8a6-4d75-b916-30a052ec5f98 tempest-HypervisorAdminV228Test-384793662 tempest-HypervisorAdminV228Test-384793662-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:32.102781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d61076ff-f8a6-4d75-b916-30a052ec5f98 tempest-HypervisorAdminV228Test-384793662 tempest-HypervisorAdminV228Test-384793662-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:32.127037 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d61076ff-f8a6-4d75-b916-30a052ec5f98 tempest-HypervisorAdminV228Test-384793662 tempest-HypervisorAdminV228Test-384793662-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 717 microversion: 2.28 time: 0.074588 May 28 04:34:32.128056 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 6/11] 10.222.0.58 () {60 vars in 1192 bytes} [Sat May 28 04:34:32 2022] GET /compute/v2.1/os-hypervisors/1 => generated 717 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 04:34:32.372325 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-05f1553c-6687-4918-ab65-1e0c3e120367 tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 1.509914 May 28 04:34:32.373603 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 6/12] 10.222.0.58 () {62 vars in 1231 bytes} [Sat May 28 04:34:30 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:34:32.383856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-13858bc7-354e-4c34-bd7b-cb849c91a7cc tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843700-1"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:32.385557 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:32.385557 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:32.414096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13858bc7-354e-4c34-bd7b-cb849c91a7cc tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:32.414546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13858bc7-354e-4c34-bd7b-cb849c91a7cc tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:33.871244 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-13858bc7-354e-4c34-bd7b-cb849c91a7cc tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 1.491239 May 28 04:34:33.877511 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 7/13] 10.222.0.58 () {62 vars in 1231 bytes} [Sat May 28 04:34:32 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 04:34:33.884012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7952ce7a-cff5-46d5-bbea-1695fad1f76f tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:33.884879 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:33.884879 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:34.020459 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7952ce7a-cff5-46d5-bbea-1695fad1f76f tempest-AggregatesAdminTestV241-2091568704 tempest-AggregatesAdminTestV241-2091568704-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.141282 May 28 04:34:34.021513 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 7/14] 10.222.0.58 () {60 vars in 1192 bytes} [Sat May 28 04:34:33 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:34.043997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1e5a64cd-77fe-442d-ad15-a8a8e45d9ecd tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-982744449"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:34.101692 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:34.101692 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:34.107519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.aggregate [None req-1e5a64cd-77fe-442d-ad15-a8a8e45d9ecd tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Generated uuid 66b7ee5e-263c-425c-a94f-79d20f6a0ab2 for aggregate {{(pid=126044) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 04:34:34.268490 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1e5a64cd-77fe-442d-ad15-a8a8e45d9ecd tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.228715 May 28 04:34:34.270178 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 8/15] 10.222.0.58 () {60 vars in 1163 bytes} [Sat May 28 04:34:34 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:34.280517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e5512f84-5936-480c-accb-ebb878ffebba tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843700-1"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:34.282011 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:34.282011 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:34.291842 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e5512f84-5936-480c-accb-ebb878ffebba tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:34.292563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e5512f84-5936-480c-accb-ebb878ffebba tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:34.594856 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e5512f84-5936-480c-accb-ebb878ffebba tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.318004 May 28 04:34:34.595556 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 8/16] 10.222.0.58 () {60 vars in 1190 bytes} [Sat May 28 04:34:34 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:34.605801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a46719cf-c41c-4d7d-8421-6f0fd4459c86 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843700-1"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:34.607058 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:34.607058 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:34.616062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a46719cf-c41c-4d7d-8421-6f0fd4459c86 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:34.616616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a46719cf-c41c-4d7d-8421-6f0fd4459c86 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:34.677240 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-a46719cf-c41c-4d7d-8421-6f0fd4459c86 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h1-843700-1. May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a46719cf-c41c-4d7d-8421-6f0fd4459c86 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Request method failure captured: May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 39 May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZW7SGXjy79gqJh_aG85x9CXE8mDCgbB0sdzOUVfNQzxuSX2ZbmKSp8SnvzaWVrg3K6Fu2c9pSoMA2-0EcTzQRrIiLSKTUQfEDDzcZLxi1dbyKDysQ6wI6N_5-UCAFpAlViEBvznAgcTJqCjq2dkQlHXylegTwDUr_5Dh4t37EyKgs May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 122df235d06c48a59cb66d0372212429 May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:34:34.693712 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:34:34.695087 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_122df235d06c48a59cb66d0372212429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/122df235d06c48a59cb66d0372212429"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/122df235d06c48a59cb66d0372212429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/122df235d06c48a59cb66d0372212429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:34:34.695087 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:34.695087 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 122df235d06c48a59cb66d0372212429 May 28 04:34:34.695087 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:34.695087 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin May 28 04:34:34.695087 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:34:34.695087 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:34:34.695087 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 2af8200da6e844e4870969cb21c062f1 May 28 04:34:34.695087 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin May 28 04:34:34.695087 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:34:34.695087 n-d-843700-1 devstack@n-api.service[126044]: {"add_host": {"host": "n-h1-843700-1"}} May 28 04:34:34.695087 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:34:34.695087 n-d-843700-1 devstack@n-api.service[126044]: exception: Aggregate 2 already has host n-h1-843700-1. May 28 04:34:34.695906 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-843700-1'}}} May 28 04:34:34.695906 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:34:34.695906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:34.695906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 28 04:34:34.695906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 28 04:34:34.695906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 28 04:34:34.695906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 28 04:34:34.695906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 28 04:34:34.695906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = self._query(query) May 28 04:34:34.695906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 28 04:34:34.695906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi conn.query(q) May 28 04:34:34.695906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 28 04:34:34.695906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 04:34:34.695906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 28 04:34:34.695906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result.read() May 28 04:34:34.695906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 28 04:34:34.695906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 28 04:34:34.695906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 28 04:34:34.695906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 28 04:34:34.697029 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 04:34:34.697029 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 28 04:34:34.697029 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 04:34:34.697029 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 28 04:34:34.697029 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-843700-1-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") May 28 04:34:34.697029 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:34.697029 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 28 04:34:34.697029 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:34.697029 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:34.697029 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db May 28 04:34:34.697029 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) May 28 04:34:34.697029 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 28 04:34:34.697029 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi session.flush() May 28 04:34:34.697029 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 28 04:34:34.697029 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._flush(objects) May 28 04:34:34.697029 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 28 04:34:34.697029 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 28 04:34:34.697029 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 28 04:34:34.697029 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi compat.raise_( May 28 04:34:34.698061 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 28 04:34:34.698061 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception May 28 04:34:34.698061 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 28 04:34:34.698061 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi flush_context.execute() May 28 04:34:34.698061 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 28 04:34:34.698061 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi rec.execute(self) May 28 04:34:34.698061 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 28 04:34:34.698061 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 28 04:34:34.698061 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 28 04:34:34.698061 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 28 04:34:34.698061 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 28 04:34:34.698061 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 28 04:34:34.698061 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 28 04:34:34.698061 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 28 04:34:34.698061 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 28 04:34:34.698061 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 28 04:34:34.698061 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 28 04:34:34.698061 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 28 04:34:34.699425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 28 04:34:34.699425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 28 04:34:34.699425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 28 04:34:34.699425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 28 04:34:34.699425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 28 04:34:34.699425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception May 28 04:34:34.699425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 28 04:34:34.699425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 28 04:34:34.699425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 28 04:34:34.699425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 28 04:34:34.699425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 28 04:34:34.699425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = self._query(query) May 28 04:34:34.699425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 28 04:34:34.699425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi conn.query(q) May 28 04:34:34.699425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 28 04:34:34.699425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 04:34:34.699425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 28 04:34:34.699425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result.read() May 28 04:34:34.701803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 28 04:34:34.701803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 28 04:34:34.701803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 28 04:34:34.701803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 28 04:34:34.701803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 04:34:34.701803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 28 04:34:34.701803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 04:34:34.701803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 28 04:34:34.701803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-843700-1-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") May 28 04:34:34.701803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] May 28 04:34:34.701803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 28, 4, 34, 34, 632807), 'updated_at': None, 'host': 'n-h1-843700-1', 'aggregate_id': 2}] May 28 04:34:34.701803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 28 04:34:34.701803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:34.701803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:34.701803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:34.701803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:34.701803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host May 28 04:34:34.703043 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) May 28 04:34:34.703043 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 04:34:34.703043 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 04:34:34.703043 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:34:34.703043 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:34:34.703043 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:34:34.703043 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:34:34.703043 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 04:34:34.703043 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 04:34:34.703043 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate May 28 04:34:34.703043 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) May 28 04:34:34.703043 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 28 04:34:34.703043 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 28 04:34:34.703043 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host May 28 04:34:34.703043 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) May 28 04:34:34.703043 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db May 28 04:34:34.703043 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, May 28 04:34:34.703043 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h1-843700-1. May 28 04:34:34.703043 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:34.703043 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h1-843700-1. May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:34:34.707271 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:34:34.708477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h1-843700-1. May 28 04:34:34.708477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:34.708477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a46719cf-c41c-4d7d-8421-6f0fd4459c86 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Returning 409 to user: Aggregate 2 already has host n-h1-843700-1. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:34:34.708477 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a46719cf-c41c-4d7d-8421-6f0fd4459c86 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.098777 May 28 04:34:34.708477 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 9/17] 10.222.0.58 () {60 vars in 1190 bytes} [Sat May 28 04:34:34 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) May 28 04:34:34.710744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ddd01e43-73d5-458c-b84e-41e9c43ee286 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843700-1"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:34.712304 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:34.712304 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:34.721137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ddd01e43-73d5-458c-b84e-41e9c43ee286 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:34.721639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ddd01e43-73d5-458c-b84e-41e9c43ee286 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:35.027696 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ddd01e43-73d5-458c-b84e-41e9c43ee286 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.320039 May 28 04:34:35.028636 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 9/18] 10.222.0.58 () {60 vars in 1190 bytes} [Sat May 28 04:34:34 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:34:35.040862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-323980b3-af3d-43be-8805-1ac02dee740e tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:35.042891 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:35.042891 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:35.147235 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-323980b3-af3d-43be-8805-1ac02dee740e tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.112503 May 28 04:34:35.147904 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 10/19] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:34:35 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 28 04:34:35.158271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3f31d381-f32f-40e3-9f3a-edf4894c6985 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2027514735"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:35.159581 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:35.159581 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:35.161148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.aggregate [None req-3f31d381-f32f-40e3-9f3a-edf4894c6985 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Generated uuid 4bd59963-7af2-45cc-8a6c-9527ec0b52f1 for aggregate {{(pid=126043) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 04:34:35.293520 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3f31d381-f32f-40e3-9f3a-edf4894c6985 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.139015 May 28 04:34:35.295726 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1163 bytes} [Sat May 28 04:34:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:35.301024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0eea8471-d414-4ae1-b309-14dd1eafe536 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1237266410", "name": "tempest-test_aggregate-68217441"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:35.318290 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:35.318290 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:35.319701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.aggregate [None req-0eea8471-d414-4ae1-b309-14dd1eafe536 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Generated uuid 410581da-1086-4466-b868-8426b919ee4b for aggregate {{(pid=126043) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 04:34:35.484984 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0eea8471-d414-4ae1-b309-14dd1eafe536 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.187931 May 28 04:34:35.491885 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 12/21] 10.222.0.58 () {60 vars in 1164 bytes} [Sat May 28 04:34:35 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:35.496729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-71a1a541-6877-4675-ad50-87ff7fc4d508 tempest-FloatingIPsNegativeTestJSON-1701741416 tempest-FloatingIPsNegativeTestJSON-1701741416-project] Calling method '.version_select at 0x7f7703932d30>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:35.958780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-83de5d5b-ef93-4ee0-81de-a8bf6ce9eb5f tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843700-1"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:35.961979 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:35.961979 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:35.963335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-83de5d5b-ef93-4ee0-81de-a8bf6ce9eb5f tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '63e7a4e0e5dc4ac186f8654146973571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68fb00cc8a54d54a55a84297bc35393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-83de5d5b-ef93-4ee0-81de-a8bf6ce9eb5f tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Request method failure captured: May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 39 May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZT7HTo95ojojKHZC-NNltVExy7yQojtH5pTrZQxzW32T2kBAnWam4RPzMJqNePVsWUFtEwZ-W5zJQNWqxtrDI5Q96dSBmXI18VQH2e82LZNofHv-bIX9Kz7RkW-VPBnOzqnHt_mJ-_pkl368dkfxdFCceggYFN7RWeB8hhnJ5D_44 May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: b68fb00cc8a54d54a55a84297bc35393 May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1345048806 May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:34:35.967052 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:34:35.968352 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:34:35.968352 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1345048806 May 28 04:34:35.968352 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: b68fb00cc8a54d54a55a84297bc35393 May 28 04:34:35.968352 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1345048806 May 28 04:34:35.968352 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AggregatesAdminNegativeTestJSON-1345048806-project May 28 04:34:35.968352 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:34:35.968352 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:34:35.968352 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 63e7a4e0e5dc4ac186f8654146973571 May 28 04:34:35.968352 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1345048806-project May 28 04:34:35.968352 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:34:35.968352 n-d-843700-1 devstack@n-api.service[126043]: {"add_host": {"host": "n-h1-843700-1"}} May 28 04:34:35.968352 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:34:35.968352 n-d-843700-1 devstack@n-api.service[126043]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 28 04:34:35.969167 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-843700-1'}}} May 28 04:34:35.969167 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:34:35.969167 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:35.969167 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:35.969167 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:35.969167 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:34:35.969167 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:34:35.969167 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:34:35.969167 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:34:35.969167 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:34:35.969167 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:34:35.969167 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host May 28 04:34:35.969167 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) May 28 04:34:35.969167 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:34:35.969167 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:34:35.969167 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:34:35.969167 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:34:35.969167 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:34:35.969167 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:34:35.970210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:34:35.970210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:34:35.970210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:34:35.970210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:34:35.970210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:34:35.970210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:34:35.970210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:34:35.970210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:34:35.970210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 28 04:34:35.970210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:35.970210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:35.970210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:35.970210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:35.970210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:35.970210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:35.970210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:34:35.970210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:34:35.970210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 28 04:34:35.970210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:35.973213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-83de5d5b-ef93-4ee0-81de-a8bf6ce9eb5f tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:34:35.975097 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-83de5d5b-ef93-4ee0-81de-a8bf6ce9eb5f tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] 10.222.0.58 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.481585 May 28 04:34:35.980495 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 13/22] 10.222.0.58 () {60 vars in 1190 bytes} [Sat May 28 04:34:35 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 487 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:34:35.990638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bf9b57e8-062c-4a50-8661-c242135d49da tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:35.991719 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:35.991719 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:36.004526 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bf9b57e8-062c-4a50-8661-c242135d49da tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 515 microversion: 2.1 time: 0.022832 May 28 04:34:36.005119 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 14/23] 10.222.0.58 () {58 vars in 1142 bytes} [Sat May 28 04:34:35 2022] GET /compute/v2.1/os-aggregates => generated 515 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:36.014287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7210b4f4-9bb1-4fab-82c4-161bb8568dba tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:36.015059 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:36.015059 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:36.148375 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7210b4f4-9bb1-4fab-82c4-161bb8568dba tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.142220 May 28 04:34:36.154497 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 15/24] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:34:36 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 04:34:36.159107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-76e21bcb-b024-4ed8-8ad4-f1aa6d7e7709 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843700-1"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:36.168574 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:36.168574 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:36.186374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76e21bcb-b024-4ed8-8ad4-f1aa6d7e7709 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:36.189218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76e21bcb-b024-4ed8-8ad4-f1aa6d7e7709 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:36.549261 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-76e21bcb-b024-4ed8-8ad4-f1aa6d7e7709 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 313 microversion: 2.1 time: 0.395483 May 28 04:34:36.555214 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 16/25] 10.222.0.58 () {60 vars in 1190 bytes} [Sat May 28 04:34:36 2022] POST /compute/v2.1/os-aggregates/4/action => generated 313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:36.558778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-726be722-80cc-41ef-90a2-d85ef71068bd tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-882341168"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:36.563641 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:36.563641 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:36.564762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.aggregate [None req-726be722-80cc-41ef-90a2-d85ef71068bd tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Generated uuid 6473ee85-2f5e-499c-b0c2-e20c7bd41476 for aggregate {{(pid=126043) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 04:34:36.687507 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-726be722-80cc-41ef-90a2-d85ef71068bd tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.135428 May 28 04:34:36.688760 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 17/26] 10.222.0.58 () {60 vars in 1163 bytes} [Sat May 28 04:34:36 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:36.699253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8d271b8a-9f34-4874-b57c-29cee40ca088 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-870315625"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:36.700961 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:36.700961 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:36.723701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d271b8a-9f34-4874-b57c-29cee40ca088 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:36.725508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d271b8a-9f34-4874-b57c-29cee40ca088 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:36.734288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d271b8a-9f34-4874-b57c-29cee40ca088 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:36.735087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d271b8a-9f34-4874-b57c-29cee40ca088 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:36.748080 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-8d271b8a-9f34-4874-b57c-29cee40ca088 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-870315625 could not be found. May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8d271b8a-9f34-4874-b57c-29cee40ca088 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Request method failure captured: May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 57 May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZW7SGXjy79gqJh_aG85x9CXE8mDCgbB0sdzOUVfNQzxuSX2ZbmKSp8SnvzaWVrg3K6Fu2c9pSoMA2-0EcTzQRrIiLSKTUQfEDDzcZLxi1dbyKDysQ6wI6N_5-UCAFpAlViEBvznAgcTJqCjq2dkQlHXylegTwDUr_5Dh4t37EyKgs May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 122df235d06c48a59cb66d0372212429 May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: X-Role: admin,reader,member May 28 04:34:36.754594 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: admin,reader,member May 28 04:34:36.764687 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_122df235d06c48a59cb66d0372212429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/122df235d06c48a59cb66d0372212429"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/122df235d06c48a59cb66d0372212429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/122df235d06c48a59cb66d0372212429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:34:36.764687 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:36.764687 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 122df235d06c48a59cb66d0372212429 May 28 04:34:36.764687 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:36.764687 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin May 28 04:34:36.764687 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:34:36.764687 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:34:36.764687 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 2af8200da6e844e4870969cb21c062f1 May 28 04:34:36.764687 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin May 28 04:34:36.764687 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:34:36.764687 n-d-843700-1 devstack@n-api.service[126043]: {"add_host": {"host": "tempest-nonexist_host-870315625"}} May 28 04:34:36.764687 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:34:36.764687 n-d-843700-1 devstack@n-api.service[126043]: exception: Compute host tempest-nonexist_host-870315625 could not be found. May 28 04:34:36.765481 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-870315625'}}} May 28 04:34:36.765481 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:34:36.765481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:36.765481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host May 28 04:34:36.765481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 28 04:34:36.765481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:34:36.765481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:34:36.765481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 28 04:34:36.765481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 28 04:34:36.765481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:34:36.765481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:34:36.765481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 28 04:34:36.765481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 28 04:34:36.765481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-870315625' is not mapped to any cell May 28 04:34:36.765481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.765481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:36.765481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.765481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:36.765481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host May 28 04:34:36.766636 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) May 28 04:34:36.766636 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 28 04:34:36.766636 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 28 04:34:36.766636 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 28 04:34:36.766636 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.766636 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:36.766636 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.766636 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:36.766636 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host May 28 04:34:36.766636 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) May 28 04:34:36.766636 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 04:34:36.766636 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 04:34:36.766636 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:34:36.766636 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:34:36.766636 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:34:36.766636 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:34:36.766636 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 04:34:36.766636 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 04:34:36.766636 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate May 28 04:34:36.766636 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-870315625 could not be found. May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-870315625 could not be found. May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:36.768233 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.769997 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:36.769997 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:36.769997 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:36.769997 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:34:36.769997 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:34:36.769997 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-870315625 could not be found. May 28 04:34:36.769997 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.769997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8d271b8a-9f34-4874-b57c-29cee40ca088 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-870315625 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:34:36.769997 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8d271b8a-9f34-4874-b57c-29cee40ca088 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 110 microversion: 2.1 time: 0.061205 May 28 04:34:36.769997 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 18/27] 10.222.0.58 () {60 vars in 1190 bytes} [Sat May 28 04:34:36 2022] POST /compute/v2.1/os-aggregates/5/action => generated 110 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:34:36.770594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-17b222fa-ba28-4a88-8582-cce4f994aefa tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:36.770680 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:36.770680 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:36.870360 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-17b222fa-ba28-4a88-8582-cce4f994aefa tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.096669 May 28 04:34:36.871143 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 19/28] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:34:36 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 04:34:36.881037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8ba39348-b8a9-4c5f-8d88-c37cb4ade19a tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8ba39348-b8a9-4c5f-8d88-c37cb4ade19a tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Request method failure captured: May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 283 May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZW7SGXjy79gqJh_aG85x9CXE8mDCgbB0sdzOUVfNQzxuSX2ZbmKSp8SnvzaWVrg3K6Fu2c9pSoMA2-0EcTzQRrIiLSKTUQfEDDzcZLxi1dbyKDysQ6wI6N_5-UCAFpAlViEBvznAgcTJqCjq2dkQlHXylegTwDUr_5Dh4t37EyKgs May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 122df235d06c48a59cb66d0372212429 May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: X-Role: admin,reader,member May 28 04:34:36.891418 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: admin,reader,member May 28 04:34:36.892812 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_122df235d06c48a59cb66d0372212429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/122df235d06c48a59cb66d0372212429"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/122df235d06c48a59cb66d0372212429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/122df235d06c48a59cb66d0372212429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:34:36.892812 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:36.892812 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 122df235d06c48a59cb66d0372212429 May 28 04:34:36.892812 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:36.892812 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin May 28 04:34:36.892812 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:34:36.892812 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:34:36.892812 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 2af8200da6e844e4870969cb21c062f1 May 28 04:34:36.892812 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin May 28 04:34:36.892812 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:34:36.892812 n-d-843700-1 devstack@n-api.service[126043]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 28 04:34:36.893479 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:34:36.893479 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 04:34:36.893479 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 28 04:34:36.893479 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:34:36.893479 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:36.893479 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:34:36.893479 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:34:36.893479 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:34:36.893479 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:34:36.893479 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 04:34:36.893479 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.894316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: May 28 04:34:36.894316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 28 04:34:36.894316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.894316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['aggregate']: May 28 04:34:36.894316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 28 04:34:36.894316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.894316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:36.894316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.894316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:36.894316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:36.894316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:36.894316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:34:36.894316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:34:36.894316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:34:36.894316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:34:36.894316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:34:36.894316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:34:36.894316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:34:36.894316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:34:36.895461 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:34:36.895461 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:34:36.895461 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:34:36.895461 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:34:36.895461 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 04:34:36.895461 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.895461 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:36.895461 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.895461 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:36.895461 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:36.895461 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:36.895461 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:34:36.895461 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:34:36.896219 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 04:34:36.896219 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.896219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8ba39348-b8a9-4c5f-8d88-c37cb4ade19a tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:34:36.896219 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8ba39348-b8a9-4c5f-8d88-c37cb4ade19a tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.016703 May 28 04:34:36.896499 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 20/29] 10.222.0.58 () {60 vars in 1164 bytes} [Sat May 28 04:34:36 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:34:36.904365 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a2c66e3a-64ab-4fb8-bb61-2dd0af2012bd tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a2c66e3a-64ab-4fb8-bb61-2dd0af2012bd tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Request method failure captured: May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 27 May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZW7SGXjy79gqJh_aG85x9CXE8mDCgbB0sdzOUVfNQzxuSX2ZbmKSp8SnvzaWVrg3K6Fu2c9pSoMA2-0EcTzQRrIiLSKTUQfEDDzcZLxi1dbyKDysQ6wI6N_5-UCAFpAlViEBvznAgcTJqCjq2dkQlHXylegTwDUr_5Dh4t37EyKgs May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 122df235d06c48a59cb66d0372212429 May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: X-Role: admin,reader,member May 28 04:34:36.907034 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: admin,reader,member May 28 04:34:36.908271 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_122df235d06c48a59cb66d0372212429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/122df235d06c48a59cb66d0372212429"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/122df235d06c48a59cb66d0372212429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/122df235d06c48a59cb66d0372212429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:34:36.908271 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:36.908271 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 122df235d06c48a59cb66d0372212429 May 28 04:34:36.908271 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:36.908271 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin May 28 04:34:36.908271 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:34:36.908271 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:34:36.908271 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 2af8200da6e844e4870969cb21c062f1 May 28 04:34:36.908271 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin May 28 04:34:36.908271 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:34:36.908271 n-d-843700-1 devstack@n-api.service[126043]: {"aggregate": {"name": ""}} May 28 04:34:36.908271 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:34:36.908271 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute name. Value: . '' is too short May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'aggregate': {'name': ''}}} May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['aggregate']: May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi '' May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:34:36.909055 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:34:36.910342 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:34:36.910342 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:34:36.910342 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:34:36.910342 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:34:36.910342 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:34:36.910342 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:34:36.910342 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:34:36.910342 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:34:36.910342 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:34:36.910342 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 28 04:34:36.910342 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.910342 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:36.910342 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.910342 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:36.910342 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:36.910342 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:36.910342 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:34:36.910342 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:34:36.910342 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 28 04:34:36.910342 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.911442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a2c66e3a-64ab-4fb8-bb61-2dd0af2012bd tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:34:36.911442 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a2c66e3a-64ab-4fb8-bb61-2dd0af2012bd tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.008131 May 28 04:34:36.911442 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 21/30] 10.222.0.58 () {60 vars in 1163 bytes} [Sat May 28 04:34:36 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:34:36.919659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-92bdebe7-1002-4200-8fc3-395d7aaa1eca tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1652139419"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:36.921212 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:36.921212 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:36.922280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-92bdebe7-1002-4200-8fc3-395d7aaa1eca tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '63e7a4e0e5dc4ac186f8654146973571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68fb00cc8a54d54a55a84297bc35393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-92bdebe7-1002-4200-8fc3-395d7aaa1eca tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Request method failure captured: May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 60 May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZT7HTo95ojojKHZC-NNltVExy7yQojtH5pTrZQxzW32T2kBAnWam4RPzMJqNePVsWUFtEwZ-W5zJQNWqxtrDI5Q96dSBmXI18VQH2e82LZNofHv-bIX9Kz7RkW-VPBnOzqnHt_mJ-_pkl368dkfxdFCceggYFN7RWeB8hhnJ5D_44 May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: b68fb00cc8a54d54a55a84297bc35393 May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1345048806 May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:34:36.924322 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:34:36.926114 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:34:36.926114 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1345048806 May 28 04:34:36.926114 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: b68fb00cc8a54d54a55a84297bc35393 May 28 04:34:36.926114 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1345048806 May 28 04:34:36.926114 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AggregatesAdminNegativeTestJSON-1345048806-project May 28 04:34:36.926114 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:34:36.926114 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:34:36.926114 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 63e7a4e0e5dc4ac186f8654146973571 May 28 04:34:36.926114 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1345048806-project May 28 04:34:36.926114 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:34:36.926114 n-d-843700-1 devstack@n-api.service[126043]: {"aggregate": {"name": "tempest-test_aggregate-1652139419"}} May 28 04:34:36.926114 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:34:36.926114 n-d-843700-1 devstack@n-api.service[126043]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 28 04:34:36.926888 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1652139419'}}} May 28 04:34:36.926888 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:34:36.926888 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:36.926888 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:36.926888 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:36.926888 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:34:36.926888 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:34:36.926888 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:34:36.926888 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:34:36.926888 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:34:36.926888 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:34:36.926888 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:34:36.926888 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:34:36.926888 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create May 28 04:34:36.926888 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) May 28 04:34:36.926888 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:34:36.926888 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:34:36.926888 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:34:36.926888 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:34:36.928030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:34:36.928030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:34:36.928030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:34:36.928030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:34:36.928030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:34:36.928030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:34:36.928030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:34:36.928030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:34:36.928030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:34:36.928030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:34:36.928030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 28 04:34:36.928030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.928030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:36.928030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.928030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:36.928030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:36.928030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:36.928030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:34:36.928030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:34:36.928030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 28 04:34:36.929148 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:36.929389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-92bdebe7-1002-4200-8fc3-395d7aaa1eca tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:34:36.930915 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-92bdebe7-1002-4200-8fc3-395d7aaa1eca tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.016117 May 28 04:34:36.931940 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 22/31] 10.222.0.58 () {60 vars in 1163 bytes} [Sat May 28 04:34:36 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 28 04:34:36.944964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-754574f7-5c39-459c-a349-8bbaae5b29ad tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1673707958"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:36.947261 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.aggregate [None req-754574f7-5c39-459c-a349-8bbaae5b29ad tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Generated uuid eeaf4c31-ba8f-437a-aea9-3bcecaae877b for aggregate {{(pid=126043) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 04:34:36.958165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=9,nova_api:UPDATE=1,nova_api:DELETE=9 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:34:37.029879 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-754574f7-5c39-459c-a349-8bbaae5b29ad tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.091933 May 28 04:34:37.036766 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 23/32] 10.222.0.58 () {60 vars in 1163 bytes} [Sat May 28 04:34:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:34:37.042239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e459454a-538a-402f-85f1-4dedac0edcd2 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1673707958"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:37.043755 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:37.043755 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:37.044686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.aggregate [None req-e459454a-538a-402f-85f1-4dedac0edcd2 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Generated uuid dce1c580-96eb-4573-8990-9566972233d4 for aggregate {{(pid=126043) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 04:34:37.057321 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-e459454a-538a-402f-85f1-4dedac0edcd2 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1673707958 already exists. May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e459454a-538a-402f-85f1-4dedac0edcd2 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Request method failure captured: May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 60 May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZW7SGXjy79gqJh_aG85x9CXE8mDCgbB0sdzOUVfNQzxuSX2ZbmKSp8SnvzaWVrg3K6Fu2c9pSoMA2-0EcTzQRrIiLSKTUQfEDDzcZLxi1dbyKDysQ6wI6N_5-UCAFpAlViEBvznAgcTJqCjq2dkQlHXylegTwDUr_5Dh4t37EyKgs May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 122df235d06c48a59cb66d0372212429 May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: X-Role: admin,reader,member May 28 04:34:37.059854 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: admin,reader,member May 28 04:34:37.061085 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_122df235d06c48a59cb66d0372212429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/122df235d06c48a59cb66d0372212429"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/122df235d06c48a59cb66d0372212429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/122df235d06c48a59cb66d0372212429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:34:37.061085 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:37.061085 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 122df235d06c48a59cb66d0372212429 May 28 04:34:37.061085 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:37.061085 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin May 28 04:34:37.061085 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:34:37.061085 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:34:37.061085 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 2af8200da6e844e4870969cb21c062f1 May 28 04:34:37.061085 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin May 28 04:34:37.061085 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:34:37.061085 n-d-843700-1 devstack@n-api.service[126043]: {"aggregate": {"name": "tempest-test_aggregate-1673707958"}} May 28 04:34:37.061085 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:34:37.061085 n-d-843700-1 devstack@n-api.service[126043]: exception: Aggregate tempest-test_aggregate-1673707958 already exists. May 28 04:34:37.061840 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1673707958'}}} May 28 04:34:37.061840 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:34:37.061840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:37.061840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create May 28 04:34:37.061840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) May 28 04:34:37.061840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 04:34:37.061840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 04:34:37.061840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:34:37.061840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:34:37.061840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:34:37.061840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:34:37.061840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 04:34:37.061840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 04:34:37.061840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate May 28 04:34:37.061840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi aggregate.create() May 28 04:34:37.061840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 28 04:34:37.061840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 28 04:34:37.061840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create May 28 04:34:37.061840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, May 28 04:34:37.062892 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:34:37.062892 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:34:37.062892 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db May 28 04:34:37.062892 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) May 28 04:34:37.062892 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1673707958 already exists. May 28 04:34:37.062892 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:37.062892 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:37.062892 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:37.062892 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:37.062892 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:37.062892 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:37.062892 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:34:37.062892 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:34:37.062892 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:34:37.062892 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:34:37.062892 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:34:37.062892 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:34:37.062892 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:34:37.062892 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:34:37.062892 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create May 28 04:34:37.063946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) May 28 04:34:37.063946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1673707958 already exists. May 28 04:34:37.063946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:37.063946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:37.063946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:37.063946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:37.063946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:37.063946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:37.063946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:34:37.063946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:34:37.063946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1673707958 already exists. May 28 04:34:37.063946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:34:37.065616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e459454a-538a-402f-85f1-4dedac0edcd2 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1673707958 already exists. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:34:37.067271 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e459454a-538a-402f-85f1-4dedac0edcd2 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.029315 May 28 04:34:37.068176 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 24/33] 10.222.0.58 () {60 vars in 1163 bytes} [Sat May 28 04:34:37 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 31 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 04:34:37.156754 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-71a1a541-6877-4675-ad50-87ff7fc4d508 tempest-FloatingIPsNegativeTestJSON-1701741416 tempest-FloatingIPsNegativeTestJSON-1701741416-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 2.247497 May 28 04:34:37.157428 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 10/34] 10.222.0.58 () {58 vars in 1148 bytes} [Sat May 28 04:34:34 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 2249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 04:34:37.163355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6c9817d8-996c-4154-a2da-48a928b294be tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:37.164387 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:37.164387 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:37.278637 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6c9817d8-996c-4154-a2da-48a928b294be tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.119682 May 28 04:34:37.279816 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 11/35] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:34:37 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 04:34:37.287451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ebda855f-8349-4c83-bf25-8a0f2168027d tempest-FloatingIPsNegativeTestJSON-1701741416 tempest-FloatingIPsNegativeTestJSON-1701741416-project] Action: 'create', calling method: .version_select at 0x7f77028fd790>, body: {"pool": "non_exist_pool"} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:37.330054 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-ebda855f-8349-4c83-bf25-8a0f2168027d tempest-FloatingIPsNegativeTestJSON-1701741416 tempest-FloatingIPsNegativeTestJSON-1701741416-project] HTTP exception thrown: Floating IP pool not found. May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ebda855f-8349-4c83-bf25-8a0f2168027d tempest-FloatingIPsNegativeTestJSON-1701741416 tempest-FloatingIPsNegativeTestJSON-1701741416-project] Request method failure captured: May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 26 May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZa0HK9eUjMoVFSEcJi48Hq-di8X9e6jD7ffX9RmuUiag8HKGB4-kHiSFsR4KZSSgO82tVClhkjuiFm3hRLr7W1I7-W9kS1vT8tKHYdkVVfIFyQPQ6s3ex1qh2nKxyP38qpaihwqiCTbCHglPZKp7SrPyAVnJouMuHMmDWXpAEweGo May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 44c241b8b1ae4f33940cccd1c03a84d6 May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1701741416 May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:34:37.333831 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:34:37.334944 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_44c241b8b1ae4f33940cccd1c03a84d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/44c241b8b1ae4f33940cccd1c03a84d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/44c241b8b1ae4f33940cccd1c03a84d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/44c241b8b1ae4f33940cccd1c03a84d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:34:37.334944 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1701741416 May 28 04:34:37.334944 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 44c241b8b1ae4f33940cccd1c03a84d6 May 28 04:34:37.334944 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1701741416 May 28 04:34:37.334944 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-FloatingIPsNegativeTestJSON-1701741416-project May 28 04:34:37.334944 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:34:37.334944 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:34:37.334944 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 85bd50a338e74c64b9cc1a961266cac0 May 28 04:34:37.334944 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1701741416-project May 28 04:34:37.334944 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:34:37.334944 n-d-843700-1 devstack@n-api.service[126044]: {"pool": "non_exist_pool"} May 28 04:34:37.334944 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:34:37.334944 n-d-843700-1 devstack@n-api.service[126044]: exception: Floating IP pool not found. May 28 04:34:37.334944 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'body': {'pool': 'non_exist_pool'}} May 28 04:34:37.334944 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:34:37.343000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:37.343000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create May 28 04:34:37.343000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) May 28 04:34:37.343000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2958, in allocate_floating_ip May 28 04:34:37.343000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) May 28 04:34:37.343000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2948, in _get_floating_ip_pool_id_by_name_or_id May 28 04:34:37.343000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() May 28 04:34:37.343000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. May 28 04:34:37.343000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:37.343000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:37.343000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:37.343000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:37.343000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:37.343000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:37.343000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:34:37.343000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:34:37.343000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:34:37.343000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:34:37.343000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:34:37.343000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:34:37.344001 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create May 28 04:34:37.344001 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:34:37.344001 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. May 28 04:34:37.344001 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:37.344001 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:37.344001 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:37.344001 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:37.344001 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:37.344001 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:37.344001 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:34:37.344001 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:34:37.344001 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. May 28 04:34:37.344001 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:37.344001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ebda855f-8349-4c83-bf25-8a0f2168027d tempest-FloatingIPsNegativeTestJSON-1701741416 tempest-FloatingIPsNegativeTestJSON-1701741416-project] Returning 404 to user: Floating IP pool not found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:34:37.344001 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ebda855f-8349-4c83-bf25-8a0f2168027d tempest-FloatingIPsNegativeTestJSON-1701741416 tempest-FloatingIPsNegativeTestJSON-1701741416-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.056103 May 28 04:34:37.344712 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 12/36] 10.222.0.58 () {60 vars in 1169 bytes} [Sat May 28 04:34:37 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:34:37.344712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-754e0a3f-fb8e-412a-8cdb-6bacc3de6e77 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1323727410"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:37.349369 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:37.349369 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:37.350375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.aggregate [None req-754e0a3f-fb8e-412a-8cdb-6bacc3de6e77 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Generated uuid 3e1425d9-0477-490b-a8fd-66ce835b1650 for aggregate {{(pid=126044) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 04:34:37.441838 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-754e0a3f-fb8e-412a-8cdb-6bacc3de6e77 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.103003 May 28 04:34:37.442460 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 13/37] 10.222.0.58 () {60 vars in 1163 bytes} [Sat May 28 04:34:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:37.447288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f35ecd2d-270d-4247-8169-f0a80a307169 tempest-FloatingIPsNegativeTestJSON-1701741416 tempest-FloatingIPsNegativeTestJSON-1701741416-project] Calling method '.version_select at 0x7f770259d280>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:37.553256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG neutronclient.v2_0.client [None req-f35ecd2d-270d-4247-8169-f0a80a307169 tempest-FloatingIPsNegativeTestJSON-1701741416 tempest-FloatingIPsNegativeTestJSON-1701741416-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e0651e97-be5b-4014-8bf7-23d7489c5391 could not be found", "detail": ""}} {{(pid=126044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:34:37.554129 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-f35ecd2d-270d-4247-8169-f0a80a307169 tempest-FloatingIPsNegativeTestJSON-1701741416 tempest-FloatingIPsNegativeTestJSON-1701741416-project] HTTP exception thrown: Floating IP not found for ID e0651e97-be5b-4014-8bf7-23d7489c5391 May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f35ecd2d-270d-4247-8169-f0a80a307169 tempest-FloatingIPsNegativeTestJSON-1701741416 tempest-FloatingIPsNegativeTestJSON-1701741416-project] Request method failure captured: May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/os-floating-ips/e0651e97-be5b-4014-8bf7-23d7489c5391 HTTP/1.1 May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZa0HK9eUjMoVFSEcJi48Hq-di8X9e6jD7ffX9RmuUiag8HKGB4-kHiSFsR4KZSSgO82tVClhkjuiFm3hRLr7W1I7-W9kS1vT8tKHYdkVVfIFyQPQ6s3ex1qh2nKxyP38qpaihwqiCTbCHglPZKp7SrPyAVnJouMuHMmDWXpAEweGo May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 44c241b8b1ae4f33940cccd1c03a84d6 May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1701741416 May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:34:37.557961 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:34:37.559289 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_44c241b8b1ae4f33940cccd1c03a84d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/44c241b8b1ae4f33940cccd1c03a84d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/44c241b8b1ae4f33940cccd1c03a84d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/44c241b8b1ae4f33940cccd1c03a84d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:34:37.559289 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1701741416 May 28 04:34:37.559289 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 44c241b8b1ae4f33940cccd1c03a84d6 May 28 04:34:37.559289 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1701741416 May 28 04:34:37.559289 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-FloatingIPsNegativeTestJSON-1701741416-project May 28 04:34:37.559289 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:34:37.559289 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:34:37.559289 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 85bd50a338e74c64b9cc1a961266cac0 May 28 04:34:37.559289 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1701741416-project May 28 04:34:37.559289 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:34:37.559289 n-d-843700-1 devstack@n-api.service[126044]: exception: Floating IP not found for ID e0651e97-be5b-4014-8bf7-23d7489c5391 May 28 04:34:37.559289 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'e0651e97-be5b-4014-8bf7-23d7489c5391'} May 28 04:34:37.559289 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:34:37.560157 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:37.560157 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip May 28 04:34:37.560157 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 28 04:34:37.560157 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:34:37.560157 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:34:37.560157 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 28 04:34:37.560157 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 28 04:34:37.560157 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:34:37.560157 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:34:37.560157 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 04:34:37.560157 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 04:34:37.560157 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:34:37.560157 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:34:37.560157 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:34:37.560157 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:34:37.560157 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:34:37.560157 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:34:37.560157 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:34:37.560157 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:34:37.561190 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:34:37.561190 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:34:37.561190 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:34:37.561190 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:34:37.561190 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:34:37.561190 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:34:37.561190 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e0651e97-be5b-4014-8bf7-23d7489c5391 could not be found May 28 04:34:37.561190 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce4fb18f-7cd7-4d7f-b837-5b145b9caa80'] May 28 04:34:37.561190 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:37.561190 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:37.561190 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:37.561190 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:37.561190 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete May 28 04:34:37.561190 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 28 04:34:37.561190 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip May 28 04:34:37.561190 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 28 04:34:37.561190 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e0651e97-be5b-4014-8bf7-23d7489c5391. May 28 04:34:37.561190 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:37.561190 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:37.561190 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:37.562306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:37.562306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:37.562306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:37.562306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:34:37.562306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:34:37.562306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:34:37.562306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:34:37.562306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:34:37.562306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:34:37.562306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete May 28 04:34:37.562306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 04:34:37.562306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e0651e97-be5b-4014-8bf7-23d7489c5391 May 28 04:34:37.562306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:37.562306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:37.562306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:37.562306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:37.562306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:37.562306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:37.562306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:34:37.562306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:34:37.564631 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e0651e97-be5b-4014-8bf7-23d7489c5391 May 28 04:34:37.564631 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:37.564631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f35ecd2d-270d-4247-8169-f0a80a307169 tempest-FloatingIPsNegativeTestJSON-1701741416 tempest-FloatingIPsNegativeTestJSON-1701741416-project] Returning 404 to user: Floating IP not found for ID e0651e97-be5b-4014-8bf7-23d7489c5391 {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:34:37.564631 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f35ecd2d-270d-4247-8169-f0a80a307169 tempest-FloatingIPsNegativeTestJSON-1701741416 tempest-FloatingIPsNegativeTestJSON-1701741416-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/e0651e97-be5b-4014-8bf7-23d7489c5391" status: 404 len: 111 microversion: 2.1 time: 0.116036 May 28 04:34:37.564631 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 14/38] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 04:34:37 2022] DELETE /compute/v2.1/os-floating-ips/e0651e97-be5b-4014-8bf7-23d7489c5391 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:34:37.577088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7c60ea17-d3cb-4a06-9a80-f5f3caf4628c tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:37.578274 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:37.578274 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:37.579595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7c60ea17-d3cb-4a06-9a80-f5f3caf4628c tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '63e7a4e0e5dc4ac186f8654146973571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68fb00cc8a54d54a55a84297bc35393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7c60ea17-d3cb-4a06-9a80-f5f3caf4628c tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Request method failure captured: May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZT7HTo95ojojKHZC-NNltVExy7yQojtH5pTrZQxzW32T2kBAnWam4RPzMJqNePVsWUFtEwZ-W5zJQNWqxtrDI5Q96dSBmXI18VQH2e82LZNofHv-bIX9Kz7RkW-VPBnOzqnHt_mJ-_pkl368dkfxdFCceggYFN7RWeB8hhnJ5D_44 May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: b68fb00cc8a54d54a55a84297bc35393 May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1345048806 May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:34:37.590690 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:34:37.591831 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:34:37.591831 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1345048806 May 28 04:34:37.591831 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: b68fb00cc8a54d54a55a84297bc35393 May 28 04:34:37.591831 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1345048806 May 28 04:34:37.591831 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AggregatesAdminNegativeTestJSON-1345048806-project May 28 04:34:37.591831 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:34:37.591831 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:34:37.591831 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 63e7a4e0e5dc4ac186f8654146973571 May 28 04:34:37.591831 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1345048806-project May 28 04:34:37.591831 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:34:37.591831 n-d-843700-1 devstack@n-api.service[126044]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 28 04:34:37.591831 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '7'} May 28 04:34:37.592449 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:34:37.592449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:37.592449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:37.592449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:37.592449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:34:37.592449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:34:37.592449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:34:37.592449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:34:37.592449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete May 28 04:34:37.592449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) May 28 04:34:37.592449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:34:37.592449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:34:37.592449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:34:37.592449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:34:37.592449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:34:37.592449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:34:37.592449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:34:37.592449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:34:37.592449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:34:37.593403 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:34:37.593403 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:34:37.593403 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:34:37.593403 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:34:37.593403 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:34:37.593403 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 28 04:34:37.593403 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:37.593403 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:37.593403 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:37.593403 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:37.593403 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:37.593403 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:37.593403 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:34:37.593403 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:34:37.593403 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 28 04:34:37.593403 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:37.596470 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7c60ea17-d3cb-4a06-9a80-f5f3caf4628c tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:34:37.598139 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7c60ea17-d3cb-4a06-9a80-f5f3caf4628c tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.036673 May 28 04:34:37.602260 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 15/39] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:34:37 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:34:37.623831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5d9e70a4-2893-45f1-8359-45f781041c93 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:37.747986 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5d9e70a4-2893-45f1-8359-45f781041c93 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.135730 May 28 04:34:37.751880 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 16/40] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:34:37 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 04:34:38.016959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-094f712d-8754-4ce5-9920-b6c9c02af46c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-530357452", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "availability_zone": "tempest-test_az-1237266410"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:38.067455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-094f712d-8754-4ce5-9920-b6c9c02af46c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:38.070276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-094f712d-8754-4ce5-9920-b6c9c02af46c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:38.071475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-094f712d-8754-4ce5-9920-b6c9c02af46c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:38.072128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-094f712d-8754-4ce5-9920-b6c9c02af46c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:38.377931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d523ab26-d465-4036-ba1b-ce5fcac7f169 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1477338373", "id": 666926309, "os-flavor-access:is_public": "True"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:38.380384 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:38.380384 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:38.513295 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d523ab26-d465-4036-ba1b-ce5fcac7f169 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.762913 May 28 04:34:38.514615 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 17/41] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:34:37 2022] POST /compute/v2.1/flavors => generated 427 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:38.524119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-15d0d574-a675-47d1-9b53-16e45f383ede tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:38.527410 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:38.527410 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:38.541047 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-15d0d574-a675-47d1-9b53-16e45f383ede tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] HTTP exception thrown: Aggregate -1 could not be found. May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-15d0d574-a675-47d1-9b53-16e45f383ede tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Request method failure captured: May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZW7SGXjy79gqJh_aG85x9CXE8mDCgbB0sdzOUVfNQzxuSX2ZbmKSp8SnvzaWVrg3K6Fu2c9pSoMA2-0EcTzQRrIiLSKTUQfEDDzcZLxi1dbyKDysQ6wI6N_5-UCAFpAlViEBvznAgcTJqCjq2dkQlHXylegTwDUr_5Dh4t37EyKgs May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 122df235d06c48a59cb66d0372212429 May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:34:38.543874 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:34:38.545682 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_122df235d06c48a59cb66d0372212429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/122df235d06c48a59cb66d0372212429"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/122df235d06c48a59cb66d0372212429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/122df235d06c48a59cb66d0372212429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:34:38.545682 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:38.545682 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 122df235d06c48a59cb66d0372212429 May 28 04:34:38.545682 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:38.545682 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin May 28 04:34:38.545682 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:34:38.545682 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:34:38.545682 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 2af8200da6e844e4870969cb21c062f1 May 28 04:34:38.545682 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin May 28 04:34:38.545682 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:34:38.545682 n-d-843700-1 devstack@n-api.service[126044]: exception: Aggregate -1 could not be found. May 28 04:34:38.545682 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '-1'} May 28 04:34:38.546381 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:34:38.546381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:38.546381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 28 04:34:38.546381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 28 04:34:38.546381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 04:34:38.546381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 04:34:38.546381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:34:38.546381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:34:38.546381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:34:38.546381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:34:38.546381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 04:34:38.546381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 04:34:38.546381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 28 04:34:38.546381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 28 04:34:38.546381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:34:38.546381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:34:38.546381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 28 04:34:38.546381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 28 04:34:38.546381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:38.547308 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:38.548318 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:38.548318 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:38.548318 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:34:38.548318 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:34:38.548318 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. May 28 04:34:38.548318 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:38.551711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-15d0d574-a675-47d1-9b53-16e45f383ede tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:34:38.552811 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-15d0d574-a675-47d1-9b53-16e45f383ede tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.035591 May 28 04:34:38.553546 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 18/42] 10.222.0.58 () {58 vars in 1154 bytes} [Sat May 28 04:34:38 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:34:38.559220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0073505f-1753-4e89-8714-b7a455a052a9 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:38.560332 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:38.560332 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:38.676324 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0073505f-1753-4e89-8714-b7a455a052a9 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/666926309" status: 202 len: 0 microversion: 2.1 time: 0.120462 May 28 04:34:38.681435 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 19/43] 10.222.0.58 () {58 vars in 1157 bytes} [Sat May 28 04:34:38 2022] DELETE /compute/v2.1/flavors/666926309 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:34:38.690074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d861adbc-4ec9-4591-9db6-a5cdc1df7a37 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-6080098"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:38.697927 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:38.697927 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:38.700424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.aggregate [None req-d861adbc-4ec9-4591-9db6-a5cdc1df7a37 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Generated uuid 4c404dbf-fe14-412f-b2ba-beae3e75dfb0 for aggregate {{(pid=126044) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 04:34:38.811870 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d861adbc-4ec9-4591-9db6-a5cdc1df7a37 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 195 microversion: 2.1 time: 0.128040 May 28 04:34:38.812935 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 20/44] 10.222.0.58 () {60 vars in 1163 bytes} [Sat May 28 04:34:38 2022] POST /compute/v2.1/os-aggregates => generated 195 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:38.824956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1e048ea1-50e2-4e9d-b854-c475b00fade7 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:38.878739 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1e048ea1-50e2-4e9d-b854-c475b00fade7 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063802 May 28 04:34:38.879468 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 21/45] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:34:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:38.885517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-083cb659-c5e3-46ad-a487-f90c216dc1aa tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:38.886539 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:38.886539 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:38.887430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-083cb659-c5e3-46ad-a487-f90c216dc1aa tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '63e7a4e0e5dc4ac186f8654146973571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68fb00cc8a54d54a55a84297bc35393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-083cb659-c5e3-46ad-a487-f90c216dc1aa tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Request method failure captured: May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZT7HTo95ojojKHZC-NNltVExy7yQojtH5pTrZQxzW32T2kBAnWam4RPzMJqNePVsWUFtEwZ-W5zJQNWqxtrDI5Q96dSBmXI18VQH2e82LZNofHv-bIX9Kz7RkW-VPBnOzqnHt_mJ-_pkl368dkfxdFCceggYFN7RWeB8hhnJ5D_44 May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: b68fb00cc8a54d54a55a84297bc35393 May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1345048806 May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:34:38.891228 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:34:38.892592 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:34:38.892592 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1345048806 May 28 04:34:38.892592 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: b68fb00cc8a54d54a55a84297bc35393 May 28 04:34:38.892592 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1345048806 May 28 04:34:38.892592 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AggregatesAdminNegativeTestJSON-1345048806-project May 28 04:34:38.892592 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:34:38.892592 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:34:38.892592 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 63e7a4e0e5dc4ac186f8654146973571 May 28 04:34:38.892592 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1345048806-project May 28 04:34:38.892592 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:34:38.892592 n-d-843700-1 devstack@n-api.service[126044]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 28 04:34:38.892592 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '8'} May 28 04:34:38.893351 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:34:38.893351 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:38.893351 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:38.893351 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:38.893351 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:34:38.893351 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:34:38.893351 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:34:38.893351 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:34:38.893351 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show May 28 04:34:38.893351 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) May 28 04:34:38.893351 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:34:38.893351 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:34:38.893351 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:34:38.893351 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:34:38.893351 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:34:38.893351 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:34:38.893351 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:34:38.893351 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:34:38.893351 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:34:38.894417 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:34:38.894417 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:34:38.894417 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:34:38.894417 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:34:38.894417 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:34:38.894417 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 28 04:34:38.894417 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:38.894417 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:38.894417 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:38.894417 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:38.894417 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:38.894417 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:38.894417 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:34:38.894417 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:34:38.894417 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 28 04:34:38.894417 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:38.898851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-083cb659-c5e3-46ad-a487-f90c216dc1aa tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:34:38.899912 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-083cb659-c5e3-46ad-a487-f90c216dc1aa tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] 10.222.0.58 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.018821 May 28 04:34:38.901200 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 22/46] 10.222.0.58 () {58 vars in 1148 bytes} [Sat May 28 04:34:38 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:34:38.906077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-912f4ee9-a5be-475c-a650-9d7d3a35af5b tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-697194411", "id": 1854483393, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:38.909175 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:38.909175 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:38.991617 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-912f4ee9-a5be-475c-a650-9d7d3a35af5b tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.089127 May 28 04:34:38.995026 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:34:38 2022] POST /compute/v2.1/flavors => generated 416 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:39.011321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c9f16d3a-728c-46b8-b50e-57f7107cfb74 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:39.020313 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:39.020313 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:39.137865 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c9f16d3a-728c-46b8-b50e-57f7107cfb74 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.136730 May 28 04:34:39.153726 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 24/48] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:34:38 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 04:34:39.163778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-29dabb20-6440-4381-99ba-6345281e7004 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:39.192671 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-29dabb20-6440-4381-99ba-6345281e7004 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.037223 May 28 04:34:39.193555 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 25/49] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:34:39 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:39.199301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9faa71c6-b91c-4dc3-a8b0-f01e755bf20f tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:39.199301 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:39.199301 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:39.205688 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-9faa71c6-b91c-4dc3-a8b0-f01e755bf20f tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] HTTP exception thrown: Aggregate -1 could not be found. May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9faa71c6-b91c-4dc3-a8b0-f01e755bf20f tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Request method failure captured: May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZW7SGXjy79gqJh_aG85x9CXE8mDCgbB0sdzOUVfNQzxuSX2ZbmKSp8SnvzaWVrg3K6Fu2c9pSoMA2-0EcTzQRrIiLSKTUQfEDDzcZLxi1dbyKDysQ6wI6N_5-UCAFpAlViEBvznAgcTJqCjq2dkQlHXylegTwDUr_5Dh4t37EyKgs May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 122df235d06c48a59cb66d0372212429 May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:34:39.208261 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:34:39.209553 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_122df235d06c48a59cb66d0372212429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/122df235d06c48a59cb66d0372212429"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/122df235d06c48a59cb66d0372212429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/122df235d06c48a59cb66d0372212429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:34:39.209553 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:39.209553 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 122df235d06c48a59cb66d0372212429 May 28 04:34:39.209553 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:34:39.209553 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin May 28 04:34:39.209553 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:34:39.209553 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:34:39.209553 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 2af8200da6e844e4870969cb21c062f1 May 28 04:34:39.209553 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin May 28 04:34:39.209553 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:34:39.209553 n-d-843700-1 devstack@n-api.service[126044]: exception: Aggregate -1 could not be found. May 28 04:34:39.209553 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '-1'} May 28 04:34:39.210284 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:34:39.210284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:39.210284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 28 04:34:39.210284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 28 04:34:39.210284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 28 04:34:39.210284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 28 04:34:39.210284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:34:39.210284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:34:39.210284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 28 04:34:39.210284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 28 04:34:39.210284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:34:39.210284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:34:39.210284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 28 04:34:39.210284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 28 04:34:39.210284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. May 28 04:34:39.210284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:39.210284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:39.210284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:39.210284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:39.210284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:39.212067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:39.212067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:34:39.212067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:34:39.212067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:34:39.212067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:34:39.212067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 28 04:34:39.212067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:34:39.212067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. May 28 04:34:39.212067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:39.212067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:39.212067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:39.212067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:39.212067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:39.212067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:39.212067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:34:39.212067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:34:39.212067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. May 28 04:34:39.212067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:39.214149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9faa71c6-b91c-4dc3-a8b0-f01e755bf20f tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:34:39.215173 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9faa71c6-b91c-4dc3-a8b0-f01e755bf20f tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.020638 May 28 04:34:39.219930 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 26/50] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:34:39 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:34:39.224168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8b42da0e-e062-4e9d-ac28-640b80a62ac6 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:39.224924 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:39.224924 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:39.301622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-094f712d-8754-4ce5-9920-b6c9c02af46c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] validate_networks() for None {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:34:39.333627 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8b42da0e-e062-4e9d-ac28-640b80a62ac6 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1854483393" status: 202 len: 0 microversion: 2.1 time: 0.116029 May 28 04:34:39.334664 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 27/51] 10.222.0.58 () {58 vars in 1160 bytes} [Sat May 28 04:34:39 2022] DELETE /compute/v2.1/flavors/1854483393 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:34:39.341089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6d8ae812-a79d-4541-9793-78f6c2df1ad1 tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:39.341911 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:39.341911 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:39.342815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6d8ae812-a79d-4541-9793-78f6c2df1ad1 tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '63e7a4e0e5dc4ac186f8654146973571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68fb00cc8a54d54a55a84297bc35393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6d8ae812-a79d-4541-9793-78f6c2df1ad1 tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Request method failure captured: May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZT7HTo95ojojKHZC-NNltVExy7yQojtH5pTrZQxzW32T2kBAnWam4RPzMJqNePVsWUFtEwZ-W5zJQNWqxtrDI5Q96dSBmXI18VQH2e82LZNofHv-bIX9Kz7RkW-VPBnOzqnHt_mJ-_pkl368dkfxdFCceggYFN7RWeB8hhnJ5D_44 May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: b68fb00cc8a54d54a55a84297bc35393 May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1345048806 May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:34:39.344669 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:34:39.345963 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:34:39.345963 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1345048806 May 28 04:34:39.345963 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: b68fb00cc8a54d54a55a84297bc35393 May 28 04:34:39.345963 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1345048806 May 28 04:34:39.345963 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AggregatesAdminNegativeTestJSON-1345048806-project May 28 04:34:39.345963 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:34:39.345963 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:34:39.345963 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 63e7a4e0e5dc4ac186f8654146973571 May 28 04:34:39.345963 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1345048806-project May 28 04:34:39.345963 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:34:39.345963 n-d-843700-1 devstack@n-api.service[126044]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 28 04:34:39.345963 n-d-843700-1 devstack@n-api.service[126044]: action_args: {} May 28 04:34:39.346579 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:34:39.346579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:39.346579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:39.346579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:39.346579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:34:39.346579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:34:39.346579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:34:39.346579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:34:39.346579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index May 28 04:34:39.346579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) May 28 04:34:39.346579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:34:39.346579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:34:39.346579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:34:39.346579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:34:39.346579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:34:39.346579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:34:39.346579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:34:39.346579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:34:39.346579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:34:39.348471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:34:39.348471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:34:39.348471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:34:39.348471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:34:39.348471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:34:39.348471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 28 04:34:39.348471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:39.348471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:39.348471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:39.348471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:39.348471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:39.348471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:39.348471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:34:39.348471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:34:39.348471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 28 04:34:39.348471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:39.348471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6d8ae812-a79d-4541-9793-78f6c2df1ad1 tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:34:39.349293 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6d8ae812-a79d-4541-9793-78f6c2df1ad1 tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.010441 May 28 04:34:39.349293 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 28/52] 10.222.0.58 () {58 vars in 1142 bytes} [Sat May 28 04:34:39 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:34:39.353132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-00a14ee8-7d43-45fb-8b0e-05fc83e36d8e tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:39.393089 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-00a14ee8-7d43-45fb-8b0e-05fc83e36d8e tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044447 May 28 04:34:39.394011 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 29/53] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:34:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:39.417987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c1bc9cc3-1b1a-4a33-acac-33a83393abc0 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2061295123", "id": 1401955506, "os-flavor-access:is_public": "True"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:39.420943 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:39.420943 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:39.430972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=13,nova_api:INSERT=7 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:34:39.576017 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c1bc9cc3-1b1a-4a33-acac-33a83393abc0 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.167019 May 28 04:34:39.580881 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 30/54] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:34:39 2022] POST /compute/v2.1/flavors => generated 429 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:39.592007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-34a9a0fc-1bc7-4443-be8c-29809aa16353 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:39.674897 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-34a9a0fc-1bc7-4443-be8c-29809aa16353 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1401955506" status: 202 len: 0 microversion: 2.1 time: 0.086555 May 28 04:34:39.676141 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 31/55] 10.222.0.58 () {58 vars in 1160 bytes} [Sat May 28 04:34:39 2022] DELETE /compute/v2.1/flavors/1401955506 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:34:39.684270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3465e5e3-9136-4ed7-804c-bc352ca49318 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:39.724531 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3465e5e3-9136-4ed7-804c-bc352ca49318 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044034 May 28 04:34:39.730939 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 32/56] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:34:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:39.748228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cbb48483-885f-43a1-911f-75af10721231 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-775229387", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:39.811193 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cbb48483-885f-43a1-911f-75af10721231 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.066707 May 28 04:34:39.812438 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 33/57] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:34:39 2022] POST /compute/v2.1/flavors => generated 506 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:39.827512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f5dd06df-7635-47c2-ad5b-0aa18de2edc7 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:39.935635 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f5dd06df-7635-47c2-ad5b-0aa18de2edc7 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/ad94ce02-f124-40ef-ab76-781a04dd1cde" status: 202 len: 0 microversion: 2.1 time: 0.116241 May 28 04:34:39.936307 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 34/58] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:34:39 2022] DELETE /compute/v2.1/flavors/ad94ce02-f124-40ef-ab76-781a04dd1cde => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:34:39.945351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-855c08dc-1e84-4b6b-b56f-988602df8a18 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:39.966574 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-855c08dc-1e84-4b6b-b56f-988602df8a18 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025501 May 28 04:34:39.967783 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 35/59] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:34:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:34:39.986514 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-13678bac-3419-46dd-9152-2885bdc118bb tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1242320415", "id": "7dc838d8-1c36-4019-8018-e32d7678341d", "os-flavor-access:is_public": "True"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:40.054585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-094f712d-8754-4ce5-9920-b6c9c02af46c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:34:40.055340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-094f712d-8754-4ce5-9920-b6c9c02af46c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:34:40.055936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-094f712d-8754-4ce5-9920-b6c9c02af46c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:34:40.056512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-094f712d-8754-4ce5-9920-b6c9c02af46c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:34:40.057098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-094f712d-8754-4ce5-9920-b6c9c02af46c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:34:40.071598 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-13678bac-3419-46dd-9152-2885bdc118bb tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.091102 May 28 04:34:40.072211 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 36/60] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:34:39 2022] POST /compute/v2.1/flavors => generated 507 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:34:40.092964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1f669358-eea4-4ae6-b645-8ea828c4c79e tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:40.106196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-094f712d-8754-4ce5-9920-b6c9c02af46c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:40.106955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-094f712d-8754-4ce5-9920-b6c9c02af46c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:40.108363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-094f712d-8754-4ce5-9920-b6c9c02af46c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:40.108994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-094f712d-8754-4ce5-9920-b6c9c02af46c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:40.156280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-094f712d-8754-4ce5-9920-b6c9c02af46c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Getting quotas for project 89ba54e5cecc4c1d93d39b53b41fbc4d. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:34:40.166595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-094f712d-8754-4ce5-9920-b6c9c02af46c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Getting quotas for user 38dd516851bb4185a3b4c2d5560c4b2b and project 89ba54e5cecc4c1d93d39b53b41fbc4d. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:34:40.193024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-094f712d-8754-4ce5-9920-b6c9c02af46c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:34:40.204287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-094f712d-8754-4ce5-9920-b6c9c02af46c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:34:40.241852 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1f669358-eea4-4ae6-b645-8ea828c4c79e tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/7dc838d8-1c36-4019-8018-e32d7678341d" status: 202 len: 0 microversion: 2.1 time: 0.161477 May 28 04:34:40.243957 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 37/61] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:34:40 2022] DELETE /compute/v2.1/flavors/7dc838d8-1c36-4019-8018-e32d7678341d => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:34:40.254625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c343822b-2910-4dec-8958-faff75cd3c06 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:40.306147 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c343822b-2910-4dec-8958-faff75cd3c06 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059098 May 28 04:34:40.306757 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 38/62] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:34:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:40.322284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d8b8b2ff-f87a-4b29-ac6e-b2bc7c8e4bce tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1719349996", "id": 1209212682, "os-flavor-access:is_public": "True"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:40.356269 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-094f712d-8754-4ce5-9920-b6c9c02af46c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.271533 May 28 04:34:40.359372 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 25/63] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:34:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:34:40.372156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7fe1c49d-4df6-4a5c-9b24-25782214b75b tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:40.372800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7fe1c49d-4df6-4a5c-9b24-25782214b75b tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:40.469707 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d8b8b2ff-f87a-4b29-ac6e-b2bc7c8e4bce tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.151256 May 28 04:34:40.471046 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 39/64] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:34:40 2022] POST /compute/v2.1/flavors => generated 414 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:34:40.484521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b5a86994-10c3-451c-9559-3f318c451dc0 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:40.515448 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b5a86994-10c3-451c-9559-3f318c451dc0 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/1209212682" status: 200 len: 414 microversion: 2.1 time: 0.034633 May 28 04:34:40.516700 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 40/65] 10.222.0.58 () {58 vars in 1157 bytes} [Sat May 28 04:34:40 2022] GET /compute/v2.1/flavors/1209212682 => generated 414 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:34:40.541697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7fe1c49d-4df6-4a5c-9b24-25782214b75b tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:40.556867 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7fe1c49d-4df6-4a5c-9b24-25782214b75b tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1242 microversion: 2.1 time: 0.192461 May 28 04:34:40.557982 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 26/66] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:40 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1242 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:34:40.936286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-36a2c159-cad4-4d32-9239-af510b52ef9c tempest-FlavorsAdminTestJSON-1748379900 tempest-FlavorsAdminTestJSON-1748379900-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:40.990477 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-36a2c159-cad4-4d32-9239-af510b52ef9c tempest-FlavorsAdminTestJSON-1748379900 tempest-FlavorsAdminTestJSON-1748379900-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.466264 May 28 04:34:40.995214 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 41/67] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:34:40 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:41.006620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8e5aa605-6b5a-430f-bc17-0cdf47f39b7e tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:41.008602 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:41.008602 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:41.133417 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8e5aa605-6b5a-430f-bc17-0cdf47f39b7e tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1209212682" status: 202 len: 0 microversion: 2.1 time: 0.131469 May 28 04:34:41.134252 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 27/68] 10.222.0.58 () {58 vars in 1160 bytes} [Sat May 28 04:34:41 2022] DELETE /compute/v2.1/flavors/1209212682 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:34:41.143487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9da13d8d-2e64-46e7-846c-6e28113b65a4 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:41.190576 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9da13d8d-2e64-46e7-846c-6e28113b65a4 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047469 May 28 04:34:41.190576 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 42/69] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:34:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:34:41.206106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-83e0f171-9cb9-47a5-9dcf-e0a6b3dbc16d tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1174949926", "id": 2097524709, "os-flavor-access:is_public": "False"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:41.208643 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:41.208643 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:41.342243 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-83e0f171-9cb9-47a5-9dcf-e0a6b3dbc16d tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.139360 May 28 04:34:41.342866 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 28/70] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:34:41 2022] POST /compute/v2.1/flavors => generated 430 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:41.354002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c2f80129-93c1-44d7-bbac-6a8e3beb91fe tempest-FlavorsAdminTestJSON-1748379900 tempest-FlavorsAdminTestJSON-1748379900-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "2097524709"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:41.362023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:34:41.382803 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-c2f80129-93c1-44d7-bbac-6a8e3beb91fe tempest-FlavorsAdminTestJSON-1748379900 tempest-FlavorsAdminTestJSON-1748379900-project] HTTP exception thrown: Flavor 2097524709 could not be found. May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c2f80129-93c1-44d7-bbac-6a8e3beb91fe tempest-FlavorsAdminTestJSON-1748379900 tempest-FlavorsAdminTestJSON-1748379900-project] Request method failure captured: May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 107 May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZZGUrZN_-aLQLot2zLQ2oRvxYdq4ESIeMIUfBZ18oMgoLsrMFC5r4suPFAfkNYM72ksUGhlJcwFDiqtqt0gHKS1HCukjcn_uWT6tYVfFUcHnmNCj7Ot_dhhbp41kPVH07G8lsWgoZCnqwT5_N9jWYJ0mJ76sXIPC2Ok8tUSqgX42M May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: e3b7a9e92f3a4afe81ecaaee77b10db4 May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-FlavorsAdminTestJSON-1748379900 May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:34:41.386096 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:34:41.387434 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e3b7a9e92f3a4afe81ecaaee77b10db4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e3b7a9e92f3a4afe81ecaaee77b10db4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e3b7a9e92f3a4afe81ecaaee77b10db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e3b7a9e92f3a4afe81ecaaee77b10db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:34:41.387434 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-FlavorsAdminTestJSON-1748379900 May 28 04:34:41.387434 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: e3b7a9e92f3a4afe81ecaaee77b10db4 May 28 04:34:41.387434 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1748379900 May 28 04:34:41.387434 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-FlavorsAdminTestJSON-1748379900-project May 28 04:34:41.387434 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:34:41.387434 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:34:41.387434 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: a3de7a7a1a5e4d7b99afad31aeadc05c May 28 04:34:41.387434 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-FlavorsAdminTestJSON-1748379900-project May 28 04:34:41.387434 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:34:41.387434 n-d-843700-1 devstack@n-api.service[126044]: {"server": {"name": "test", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "2097524709"}} May 28 04:34:41.387434 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:34:41.387434 n-d-843700-1 devstack@n-api.service[126044]: exception: Flavor 2097524709 could not be found. May 28 04:34:41.388075 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '2097524709'}}} May 28 04:34:41.388075 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:34:41.388075 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:41.388075 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create May 28 04:34:41.388075 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( May 28 04:34:41.388075 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 04:34:41.388075 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 04:34:41.388075 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:34:41.388075 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:34:41.388075 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 04:34:41.388075 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 04:34:41.388075 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 04:34:41.388075 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:34:41.388075 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 04:34:41.388075 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 04:34:41.388075 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2097524709 could not be found. May 28 04:34:41.388075 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:41.388075 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:41.388075 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:41.388075 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2097524709 could not be found. May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:34:41.389164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:34:41.390837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:34:41.390837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:34:41.390837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:34:41.390837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2097524709 could not be found. May 28 04:34:41.390837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:34:41.390837 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c2f80129-93c1-44d7-bbac-6a8e3beb91fe tempest-FlavorsAdminTestJSON-1748379900 tempest-FlavorsAdminTestJSON-1748379900-project] Returning 400 to user: Flavor 2097524709 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:34:41.390837 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c2f80129-93c1-44d7-bbac-6a8e3beb91fe tempest-FlavorsAdminTestJSON-1748379900 tempest-FlavorsAdminTestJSON-1748379900-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.038100 May 28 04:34:41.390837 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 43/71] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:34:41 2022] POST /compute/v2.1/servers => generated 81 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 04:34:41.397449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6e4d06e5-1197-426a-a88a-bd3688462e97 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:41.493230 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6e4d06e5-1197-426a-a88a-bd3688462e97 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/2097524709" status: 202 len: 0 microversion: 2.1 time: 0.098559 May 28 04:34:41.494064 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 29/72] 10.222.0.58 () {58 vars in 1160 bytes} [Sat May 28 04:34:41 2022] DELETE /compute/v2.1/flavors/2097524709 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:34:41.502785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-64a6f446-7ed4-4461-b1de-84b1b11cc791 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:41.537013 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-64a6f446-7ed4-4461-b1de-84b1b11cc791 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038360 May 28 04:34:41.538036 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 44/73] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:34:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:41.555138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-63a782bd-2af3-4dde-9362-a3da172ddf9e tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-979274615", "id": 1813780714, "os-flavor-access:is_public": "False"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:41.574641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-446a4931-02c3-4ee1-9882-0b23b1988a2f tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:41.576155 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-446a4931-02c3-4ee1-9882-0b23b1988a2f tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:41.646231 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-63a782bd-2af3-4dde-9362-a3da172ddf9e tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.094671 May 28 04:34:41.652657 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 30/74] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:34:41 2022] POST /compute/v2.1/flavors => generated 414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:41.670248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-446a4931-02c3-4ee1-9882-0b23b1988a2f tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:41.684563 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-446a4931-02c3-4ee1-9882-0b23b1988a2f tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1242 microversion: 2.1 time: 0.114116 May 28 04:34:41.694255 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 45/75] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:41 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1242 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:34:41.694255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a26583ad-035a-43c1-bf7a-ffa5a71ae7f5 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1873561862", "id": 839429816, "os-flavor-access:is_public": "True"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:41.694255 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:41.694255 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:41.816728 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a26583ad-035a-43c1-bf7a-ffa5a71ae7f5 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.130464 May 28 04:34:41.817534 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 46/76] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:34:41 2022] POST /compute/v2.1/flavors => generated 411 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:41.828202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4906d7c4-c76f-4867-b9f6-e6d56fd5af09 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:41.846082 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4906d7c4-c76f-4867-b9f6-e6d56fd5af09 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.021942 May 28 04:34:41.846713 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 47/77] 10.222.0.58 () {58 vars in 1168 bytes} [Sat May 28 04:34:41 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:34:41.861017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8fc493af-2791-49c1-9f84-8e65c5a5e452 tempest-FlavorsAccessTestJSON-1249787431 tempest-FlavorsAccessTestJSON-1249787431-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-268178752", "id": 1154821876, "os-flavor-access:is_public": "False"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:41.873066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-654ec654-3b5a-4cb3-a841-ac17fa3d6a80 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:41.888578 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-654ec654-3b5a-4cb3-a841-ac17fa3d6a80 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.034050 May 28 04:34:41.889311 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 48/78] 10.222.0.58 () {58 vars in 1176 bytes} [Sat May 28 04:34:41 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:34:41.912061 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c46e7aa1-b8f7-4b5e-87c2-01b4660285cb tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:41.924531 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c46e7aa1-b8f7-4b5e-87c2-01b4660285cb tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.019430 May 28 04:34:41.926172 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 49/79] 10.222.0.58 () {58 vars in 1170 bytes} [Sat May 28 04:34:41 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:41.938891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-84bde059-94f5-401d-832a-f9bdd71a310c tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:41.955511 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8fc493af-2791-49c1-9f84-8e65c5a5e452 tempest-FlavorsAccessTestJSON-1249787431 tempest-FlavorsAccessTestJSON-1249787431-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.301276 May 28 04:34:41.957772 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 31/80] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:34:41 2022] POST /compute/v2.1/flavors => generated 430 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:41.958569 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-84bde059-94f5-401d-832a-f9bdd71a310c tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.025226 May 28 04:34:41.959460 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 50/81] 10.222.0.58 () {58 vars in 1168 bytes} [Sat May 28 04:34:41 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:41.975554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-790b6ed0-e851-45c3-8e79-51a05973ee6e tempest-FlavorsAccessTestJSON-1249787431 tempest-FlavorsAccessTestJSON-1249787431-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2a8bd89bf91b403cba653e3d4ad8bc49"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:41.976925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1877bf01-8bca-4f2a-ba83-723511980091 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:41.980804 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:41.980804 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:42.018176 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1877bf01-8bca-4f2a-ba83-723511980091 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.050424 May 28 04:34:42.018966 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 51/82] 10.222.0.58 () {58 vars in 1168 bytes} [Sat May 28 04:34:41 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:42.033916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-beb64450-ea44-4559-bcf3-c542c0be21ca tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:42.082943 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-beb64450-ea44-4559-bcf3-c542c0be21ca tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.052534 May 28 04:34:42.084108 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 52/83] 10.222.0.58 () {58 vars in 1174 bytes} [Sat May 28 04:34:42 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:34:42.105252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-002a8933-fdfd-4494-80bb-36aa0bbf0c36 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:42.146389 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-002a8933-fdfd-4494-80bb-36aa0bbf0c36 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.044585 May 28 04:34:42.149867 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 53/84] 10.222.0.58 () {58 vars in 1172 bytes} [Sat May 28 04:34:42 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:42.166935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-62a9d975-b06b-49aa-95fd-eb4f97d047e5 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:42.201508 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-62a9d975-b06b-49aa-95fd-eb4f97d047e5 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.038909 May 28 04:34:42.202297 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 54/85] 10.222.0.58 () {58 vars in 1168 bytes} [Sat May 28 04:34:42 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:42.219143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-82991875-9968-4bd3-b784-ba057ebbc2a6 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:42.220311 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:42.220311 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:42.320208 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-82991875-9968-4bd3-b784-ba057ebbc2a6 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/839429816" status: 202 len: 0 microversion: 2.1 time: 0.105628 May 28 04:34:42.321417 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 55/86] 10.222.0.58 () {58 vars in 1157 bytes} [Sat May 28 04:34:42 2022] DELETE /compute/v2.1/flavors/839429816 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:34:42.329826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-12164a8f-27c5-4576-86d2-f96d63e0d74a tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:42.356586 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-12164a8f-27c5-4576-86d2-f96d63e0d74a tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030586 May 28 04:34:42.357065 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 56/87] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:34:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:42.377007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b71ce7a3-85d3-4e42-aeeb-e5705d76f8cc tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:42.509675 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b71ce7a3-85d3-4e42-aeeb-e5705d76f8cc tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1813780714" status: 202 len: 0 microversion: 2.1 time: 0.137381 May 28 04:34:42.513843 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 57/88] 10.222.0.58 () {58 vars in 1160 bytes} [Sat May 28 04:34:42 2022] DELETE /compute/v2.1/flavors/1813780714 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:34:42.523172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b444d8f8-0c8c-41f1-ac08-1364b195cbef tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:42.542330 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b444d8f8-0c8c-41f1-ac08-1364b195cbef tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026442 May 28 04:34:42.544418 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 58/89] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:34:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:42.562857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d2acb7c1-49c7-413b-9360-2c88373b05ec tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-30065823", "id": 1591655614, "os-flavor-access:is_public": "False"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:42.635925 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-790b6ed0-e851-45c3-8e79-51a05973ee6e tempest-FlavorsAccessTestJSON-1249787431 tempest-FlavorsAccessTestJSON-1249787431-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1154821876/action" status: 200 len: 97 microversion: 2.1 time: 0.669378 May 28 04:34:42.636817 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 32/90] 10.222.0.58 () {60 vars in 1199 bytes} [Sat May 28 04:34:41 2022] POST /compute/v2.1/flavors/1154821876/action => generated 97 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:34:42.679210 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d2acb7c1-49c7-413b-9360-2c88373b05ec tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.117648 May 28 04:34:42.682919 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 59/91] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:34:42 2022] POST /compute/v2.1/flavors => generated 413 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:34:42.689380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e0f6a8b5-e505-47d4-860d-f0885edbaf2a tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:42.732413 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e0f6a8b5-e505-47d4-860d-f0885edbaf2a tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037934 May 28 04:34:42.732413 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 60/92] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:34:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:42.732413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3cb958c0-e53e-4456-9ee2-4d6066e08b98 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:42.732413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3cb958c0-e53e-4456-9ee2-4d6066e08b98 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:42.732413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=15,nova_api:INSERT=5 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:34:42.850495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3cb958c0-e53e-4456-9ee2-4d6066e08b98 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:42.857870 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3cb958c0-e53e-4456-9ee2-4d6066e08b98 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1242 microversion: 2.1 time: 0.133726 May 28 04:34:42.858793 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 61/93] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:42 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1242 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:42.864510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7a574e9e-acdd-4109-bcb3-1ca247d16a74 tempest-FlavorsAdminTestJSON-1748379900 tempest-FlavorsAdminTestJSON-1748379900-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:42.888247 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7a574e9e-acdd-4109-bcb3-1ca247d16a74 tempest-FlavorsAdminTestJSON-1748379900 tempest-FlavorsAdminTestJSON-1748379900-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028245 May 28 04:34:42.898070 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 62/94] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:34:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:42.986736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5a7cff34-80d2-48a3-b630-fcb56625d8d3 tempest-FlavorsAccessTestJSON-1181722130 tempest-FlavorsAccessTestJSON-1181722130-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:43.047692 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5a7cff34-80d2-48a3-b630-fcb56625d8d3 tempest-FlavorsAccessTestJSON-1181722130 tempest-FlavorsAccessTestJSON-1181722130-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5411 microversion: 2.1 time: 0.398081 May 28 04:34:43.047692 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 33/95] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:34:42 2022] GET /compute/v2.1/flavors/detail => generated 5411 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:43.052992 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bf6f5a65-de06-4554-bee6-3ba6f3a2a32b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-735202501", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:43.060307 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e9d21ae5-47cd-4df7-8ab3-fe64942d7fdb tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:43.189864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-bf6f5a65-de06-4554-bee6-3ba6f3a2a32b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:34:43.224945 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e9d21ae5-47cd-4df7-8ab3-fe64942d7fdb tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1591655614" status: 202 len: 0 microversion: 2.1 time: 0.175887 May 28 04:34:43.226376 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 34/96] 10.222.0.58 () {58 vars in 1160 bytes} [Sat May 28 04:34:43 2022] DELETE /compute/v2.1/flavors/1591655614 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:34:43.235760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6d68c387-42a5-44b7-967e-5773f44b65dd tempest-FlavorsAccessTestJSON-1249787431 tempest-FlavorsAccessTestJSON-1249787431-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2a8bd89bf91b403cba653e3d4ad8bc49"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:43.240745 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:43.240745 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:43.604001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-bf6f5a65-de06-4554-bee6-3ba6f3a2a32b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:34:43.604657 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-bf6f5a65-de06-4554-bee6-3ba6f3a2a32b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:34:43.604920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-bf6f5a65-de06-4554-bee6-3ba6f3a2a32b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:34:43.606936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-bf6f5a65-de06-4554-bee6-3ba6f3a2a32b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:34:43.607403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-bf6f5a65-de06-4554-bee6-3ba6f3a2a32b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:34:43.635271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf6f5a65-de06-4554-bee6-3ba6f3a2a32b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:43.635942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf6f5a65-de06-4554-bee6-3ba6f3a2a32b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:43.638059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf6f5a65-de06-4554-bee6-3ba6f3a2a32b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:43.641545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf6f5a65-de06-4554-bee6-3ba6f3a2a32b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:43.734745 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-bf6f5a65-de06-4554-bee6-3ba6f3a2a32b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Getting quotas for project 506fcf1e564049258c90cf33d274fc5f. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:34:43.750011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-bf6f5a65-de06-4554-bee6-3ba6f3a2a32b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Getting quotas for user 6d208bde90d54f7487f39c505b884285 and project 506fcf1e564049258c90cf33d274fc5f. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:34:43.757866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bf6f5a65-de06-4554-bee6-3ba6f3a2a32b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:34:43.760556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bf6f5a65-de06-4554-bee6-3ba6f3a2a32b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:34:43.889647 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bf6f5a65-de06-4554-bee6-3ba6f3a2a32b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.999118 May 28 04:34:43.899243 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6d68c387-42a5-44b7-967e-5773f44b65dd tempest-FlavorsAccessTestJSON-1249787431 tempest-FlavorsAccessTestJSON-1249787431-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1154821876/action" status: 200 len: 21 microversion: 2.1 time: 0.670503 May 28 04:34:43.899859 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 35/97] 10.222.0.58 () {60 vars in 1199 bytes} [Sat May 28 04:34:43 2022] POST /compute/v2.1/flavors/1154821876/action => generated 21 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:34:43.900305 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 63/98] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:34:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:34:43.910140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-196011d4-7ffb-413a-9ce2-80234bd4c89f tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:43.962420 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-196011d4-7ffb-413a-9ce2-80234bd4c89f tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060637 May 28 04:34:43.963558 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 64/99] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:34:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:43.969684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b2b29a84-7e6a-4a07-8b47-b1f2ea7f8595 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:43.970387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b2b29a84-7e6a-4a07-8b47-b1f2ea7f8595 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:43.980886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b2b29a84-7e6a-4a07-8b47-b1f2ea7f8595 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:43.981356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b2b29a84-7e6a-4a07-8b47-b1f2ea7f8595 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:43.983189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b2b29a84-7e6a-4a07-8b47-b1f2ea7f8595 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:43.983630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b2b29a84-7e6a-4a07-8b47-b1f2ea7f8595 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:44.201319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cbe5a46d-69e7-4a2d-b657-4039b1feef35 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-834413597", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:44.263547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-cbe5a46d-69e7-4a2d-b657-4039b1feef35 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] validate_networks() for None {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:34:44.479573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b2b29a84-7e6a-4a07-8b47-b1f2ea7f8595 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:44.499249 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b2b29a84-7e6a-4a07-8b47-b1f2ea7f8595 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1290 microversion: 2.1 time: 0.534217 May 28 04:34:44.510978 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 65/100] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:43 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1290 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:44.510978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5d6ef93d-3646-4df1-9c9c-bc33d31c43b3 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:44.510978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5d6ef93d-3646-4df1-9c9c-bc33d31c43b3 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:44.646107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5d6ef93d-3646-4df1-9c9c-bc33d31c43b3 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:44.671585 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5d6ef93d-3646-4df1-9c9c-bc33d31c43b3 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1212 microversion: 2.1 time: 0.169854 May 28 04:34:44.673995 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 66/101] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:44 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1212 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:44.684231 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-96548196-4ecc-41f2-af42-fbff0962a597 tempest-FlavorsAccessTestJSON-1181722130 tempest-FlavorsAccessTestJSON-1181722130-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:44.746925 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-96548196-4ecc-41f2-af42-fbff0962a597 tempest-FlavorsAccessTestJSON-1181722130 tempest-FlavorsAccessTestJSON-1181722130-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071516 May 28 04:34:44.747893 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 67/102] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:34:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:44.754441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-088ce8bc-8dd3-400e-b492-ba8d2073d816 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1690079348", "id": 1317826683, "os-flavor-access:is_public": "True"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:44.756358 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:44.756358 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:44.786303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-cbe5a46d-69e7-4a2d-b657-4039b1feef35 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:34:44.786725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-cbe5a46d-69e7-4a2d-b657-4039b1feef35 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:34:44.787493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-cbe5a46d-69e7-4a2d-b657-4039b1feef35 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:34:44.788098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-cbe5a46d-69e7-4a2d-b657-4039b1feef35 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:34:44.788664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-cbe5a46d-69e7-4a2d-b657-4039b1feef35 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:34:44.799921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cbe5a46d-69e7-4a2d-b657-4039b1feef35 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:44.799921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cbe5a46d-69e7-4a2d-b657-4039b1feef35 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:44.801707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cbe5a46d-69e7-4a2d-b657-4039b1feef35 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:44.802323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cbe5a46d-69e7-4a2d-b657-4039b1feef35 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:44.824806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-cbe5a46d-69e7-4a2d-b657-4039b1feef35 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Getting quotas for project 55a346c9751c4215909999fdbc3ea1be. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:34:44.829882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-cbe5a46d-69e7-4a2d-b657-4039b1feef35 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Getting quotas for user 24f5c69cf0c848b7b8c6672c5be5dcfa and project 55a346c9751c4215909999fdbc3ea1be. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:34:44.845957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cbe5a46d-69e7-4a2d-b657-4039b1feef35 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:34:44.849303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cbe5a46d-69e7-4a2d-b657-4039b1feef35 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:34:44.856859 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-088ce8bc-8dd3-400e-b492-ba8d2073d816 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.106581 May 28 04:34:44.857545 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 68/103] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:34:44 2022] POST /compute/v2.1/flavors => generated 414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:44.886450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2a20c296-3980-4bf8-90f5-c94211911159 tempest-FlavorsAccessTestJSON-1249787431 tempest-FlavorsAccessTestJSON-1249787431-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:44.887245 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:44.887245 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:45.028152 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cbe5a46d-69e7-4a2d-b657-4039b1feef35 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.122427 May 28 04:34:45.034351 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 36/104] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:34:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:34:45.038762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a61f837d-246a-4ef9-b754-2e89ba5594e2 tempest-FlavorsAdminTestJSON-1748379900 tempest-FlavorsAdminTestJSON-1748379900-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:45.061080 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a61f837d-246a-4ef9-b754-2e89ba5594e2 tempest-FlavorsAdminTestJSON-1748379900 tempest-FlavorsAdminTestJSON-1748379900-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.030305 May 28 04:34:45.066959 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 37/105] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:34:45 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:45.071120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-02e9b698-0e08-48ee-aa70-f41d1dbf1d6b tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:45.071900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-02e9b698-0e08-48ee-aa70-f41d1dbf1d6b tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:45.074908 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2a20c296-3980-4bf8-90f5-c94211911159 tempest-FlavorsAccessTestJSON-1249787431 tempest-FlavorsAccessTestJSON-1249787431-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1154821876" status: 202 len: 0 microversion: 2.1 time: 0.216309 May 28 04:34:45.079084 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 69/106] 10.222.0.58 () {58 vars in 1160 bytes} [Sat May 28 04:34:44 2022] DELETE /compute/v2.1/flavors/1154821876 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:34:45.087028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8fc50ad3-bf4d-4ef9-a319-c40de7cf9263 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:45.161413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-02e9b698-0e08-48ee-aa70-f41d1dbf1d6b tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:45.169937 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-02e9b698-0e08-48ee-aa70-f41d1dbf1d6b tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1219 microversion: 2.1 time: 0.106834 May 28 04:34:45.179291 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 38/107] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:45 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:45.179291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f6fa70be-fca4-474b-af82-cf6c063366dd tempest-FlavorsAccessTestJSON-1249787431 tempest-FlavorsAccessTestJSON-1249787431-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:45.224842 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8fc50ad3-bf4d-4ef9-a319-c40de7cf9263 tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1317826683" status: 202 len: 0 microversion: 2.1 time: 0.143088 May 28 04:34:45.226168 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 70/108] 10.222.0.58 () {58 vars in 1160 bytes} [Sat May 28 04:34:45 2022] DELETE /compute/v2.1/flavors/1317826683 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:34:45.237308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-92f05fa9-70df-47ef-8de6-8ef9a16425ad tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:45.270225 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f6fa70be-fca4-474b-af82-cf6c063366dd tempest-FlavorsAccessTestJSON-1249787431 tempest-FlavorsAccessTestJSON-1249787431-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.097850 May 28 04:34:45.282793 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 39/109] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:34:45 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:45.282885 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-92f05fa9-70df-47ef-8de6-8ef9a16425ad tempest-FlavorsAdminTestJSON-966019039 tempest-FlavorsAdminTestJSON-966019039-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043154 May 28 04:34:45.282885 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 71/110] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:34:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:45.296302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bf9fd359-9d26-4c3c-ba90-873eaa9abe5a tempest-FlavorsAccessTestJSON-1249787431 tempest-FlavorsAccessTestJSON-1249787431-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1771574468", "id": 2011110723, "os-flavor-access:is_public": "False"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:45.300660 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:45.300660 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:45.413821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=11,nova_api:DELETE=10 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:34:45.416672 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bf9fd359-9d26-4c3c-ba90-873eaa9abe5a tempest-FlavorsAccessTestJSON-1249787431 tempest-FlavorsAccessTestJSON-1249787431-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.124123 May 28 04:34:45.417692 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 40/111] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:34:45 2022] POST /compute/v2.1/flavors => generated 431 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:45.428637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-737f36bf-93b4-438c-b64b-d9893d644d56 tempest-FlavorsAccessTestJSON-1249787431 tempest-FlavorsAccessTestJSON-1249787431-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:45.429992 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:45.429992 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:45.447237 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-737f36bf-93b4-438c-b64b-d9893d644d56 tempest-FlavorsAccessTestJSON-1249787431 tempest-FlavorsAccessTestJSON-1249787431-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/2011110723/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.022201 May 28 04:34:45.448089 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 72/112] 10.222.0.58 () {58 vars in 1208 bytes} [Sat May 28 04:34:45 2022] GET /compute/v2.1/flavors/2011110723/os-flavor-access => generated 21 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:34:45.459188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e28f18ea-d760-4ea0-9031-73b1f9b041bd tempest-FlavorsAccessTestJSON-1249787431 tempest-FlavorsAccessTestJSON-1249787431-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:45.460055 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:45.460055 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:45.517728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fdb5fee7-d854-45c0-953f-c67595bdfecf tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:45.518473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fdb5fee7-d854-45c0-953f-c67595bdfecf tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:45.529253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fdb5fee7-d854-45c0-953f-c67595bdfecf tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:45.532104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fdb5fee7-d854-45c0-953f-c67595bdfecf tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:45.533013 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fdb5fee7-d854-45c0-953f-c67595bdfecf tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:45.533723 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fdb5fee7-d854-45c0-953f-c67595bdfecf tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:45.557260 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e28f18ea-d760-4ea0-9031-73b1f9b041bd tempest-FlavorsAccessTestJSON-1249787431 tempest-FlavorsAccessTestJSON-1249787431-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/2011110723" status: 202 len: 0 microversion: 2.1 time: 0.103544 May 28 04:34:45.558144 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 41/113] 10.222.0.58 () {58 vars in 1160 bytes} [Sat May 28 04:34:45 2022] DELETE /compute/v2.1/flavors/2011110723 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:34:45.567820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f88190f0-0f99-4da3-86dc-73eba6d989ae tempest-FlavorsAccessTestJSON-1249787431 tempest-FlavorsAccessTestJSON-1249787431-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:45.617871 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f88190f0-0f99-4da3-86dc-73eba6d989ae tempest-FlavorsAccessTestJSON-1249787431 tempest-FlavorsAccessTestJSON-1249787431-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055075 May 28 04:34:45.620569 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 42/114] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:34:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:34:45.690830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9fc6a43b-adcf-4364-a39e-eb700c2efa3d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:45.692799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9fc6a43b-adcf-4364-a39e-eb700c2efa3d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:45.721890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fdb5fee7-d854-45c0-953f-c67595bdfecf tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:45.736325 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fdb5fee7-d854-45c0-953f-c67595bdfecf tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1296 microversion: 2.1 time: 0.222219 May 28 04:34:45.737093 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 73/115] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:45 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1296 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:34:45.776909 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9fc6a43b-adcf-4364-a39e-eb700c2efa3d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:45.789467 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9fc6a43b-adcf-4364-a39e-eb700c2efa3d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1212 microversion: 2.1 time: 0.102337 May 28 04:34:45.790675 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 43/116] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:45 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1212 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:34:46.194525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-baf14573-0ff4-42e0-9169-2725d0870326 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:46.195511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-baf14573-0ff4-42e0-9169-2725d0870326 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:46.345468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-baf14573-0ff4-42e0-9169-2725d0870326 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:46.382965 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-baf14573-0ff4-42e0-9169-2725d0870326 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1219 microversion: 2.1 time: 0.199999 May 28 04:34:46.395580 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 74/117] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:46 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1219 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:46.754478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-608e573d-1d86-42db-8fe5-e65d61ff1eab tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:46.755789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-608e573d-1d86-42db-8fe5-e65d61ff1eab tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:46.764079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-608e573d-1d86-42db-8fe5-e65d61ff1eab tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:46.764769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-608e573d-1d86-42db-8fe5-e65d61ff1eab tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:46.766374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-608e573d-1d86-42db-8fe5-e65d61ff1eab tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:46.767076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-608e573d-1d86-42db-8fe5-e65d61ff1eab tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:46.806848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0f80c12c-c9ca-4135-af39-9bba4d6bb757 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:46.808224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0f80c12c-c9ca-4135-af39-9bba4d6bb757 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:46.821087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f80c12c-c9ca-4135-af39-9bba4d6bb757 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:46.821856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f80c12c-c9ca-4135-af39-9bba4d6bb757 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:46.823628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f80c12c-c9ca-4135-af39-9bba4d6bb757 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:46.824293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f80c12c-c9ca-4135-af39-9bba4d6bb757 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:46.928135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0f80c12c-c9ca-4135-af39-9bba4d6bb757 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:46.939853 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0f80c12c-c9ca-4135-af39-9bba4d6bb757 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1264 microversion: 2.1 time: 0.136538 May 28 04:34:46.941910 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 75/118] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:46 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:34:47.353873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-608e573d-1d86-42db-8fe5-e65d61ff1eab tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:47.353873 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-608e573d-1d86-42db-8fe5-e65d61ff1eab tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1338 microversion: 2.1 time: 0.521161 May 28 04:34:47.353873 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 44/119] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:46 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1338 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:47.424978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-56e54eb6-c6cd-4c87-8ec5-5eaa0c771498 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:47.424978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-56e54eb6-c6cd-4c87-8ec5-5eaa0c771498 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:47.424978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56e54eb6-c6cd-4c87-8ec5-5eaa0c771498 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:47.424978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56e54eb6-c6cd-4c87-8ec5-5eaa0c771498 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:47.425848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56e54eb6-c6cd-4c87-8ec5-5eaa0c771498 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:47.425848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56e54eb6-c6cd-4c87-8ec5-5eaa0c771498 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:47.559534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-56e54eb6-c6cd-4c87-8ec5-5eaa0c771498 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:47.574584 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-56e54eb6-c6cd-4c87-8ec5-5eaa0c771498 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1223 microversion: 2.1 time: 0.166095 May 28 04:34:47.576625 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 76/120] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:47 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1223 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:47.958355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dc7b9199-21ec-4a55-90db-72cada35d697 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:47.959938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dc7b9199-21ec-4a55-90db-72cada35d697 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:47.978965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc7b9199-21ec-4a55-90db-72cada35d697 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:47.980655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc7b9199-21ec-4a55-90db-72cada35d697 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:47.983350 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc7b9199-21ec-4a55-90db-72cada35d697 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:47.985973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc7b9199-21ec-4a55-90db-72cada35d697 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:48.248293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dc7b9199-21ec-4a55-90db-72cada35d697 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:48.276854 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dc7b9199-21ec-4a55-90db-72cada35d697 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1272 microversion: 2.1 time: 0.322689 May 28 04:34:48.293958 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 77/121] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:47 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1272 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:34:48.371281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b8046a59-78e4-4003-879a-d963efda7a3b tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:48.372887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b8046a59-78e4-4003-879a-d963efda7a3b tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:48.417710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8046a59-78e4-4003-879a-d963efda7a3b tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:48.418557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8046a59-78e4-4003-879a-d963efda7a3b tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:48.425568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8046a59-78e4-4003-879a-d963efda7a3b tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:48.428121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8046a59-78e4-4003-879a-d963efda7a3b tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:48.455177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-25fbf46a-48de-4091-a53a-58634d1b6ebf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1314434124", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "68123182-7714-4432-8648-5b70eb3b9ead"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:48.611786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-25fbf46a-48de-4091-a53a-58634d1b6ebf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] validate_networks() for [('68123182-7714-4432-8648-5b70eb3b9ead', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:34:49.837953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b8046a59-78e4-4003-879a-d963efda7a3b tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:49.853063 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b8046a59-78e4-4003-879a-d963efda7a3b tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1338 microversion: 2.1 time: 1.488574 May 28 04:34:49.859885 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 78/122] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:48 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1338 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:34:49.876040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-abbbc2b0-85eb-4e32-9fa6-c1f6a042cbbc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:49.879968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-abbbc2b0-85eb-4e32-9fa6-c1f6a042cbbc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:49.893636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abbbc2b0-85eb-4e32-9fa6-c1f6a042cbbc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:49.895554 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abbbc2b0-85eb-4e32-9fa6-c1f6a042cbbc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:49.898490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abbbc2b0-85eb-4e32-9fa6-c1f6a042cbbc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:49.898490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abbbc2b0-85eb-4e32-9fa6-c1f6a042cbbc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:50.027783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-abbbc2b0-85eb-4e32-9fa6-c1f6a042cbbc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:50.041050 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-abbbc2b0-85eb-4e32-9fa6-c1f6a042cbbc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1277 microversion: 2.1 time: 0.169319 May 28 04:34:50.061729 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 79/123] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:49 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:50.067060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-45c98098-36e3-4abe-b43b-87285070b268 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:50.072196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-45c98098-36e3-4abe-b43b-87285070b268 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:50.100413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45c98098-36e3-4abe-b43b-87285070b268 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:50.109878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45c98098-36e3-4abe-b43b-87285070b268 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:50.113044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45c98098-36e3-4abe-b43b-87285070b268 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:50.113044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45c98098-36e3-4abe-b43b-87285070b268 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:50.636669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-45c98098-36e3-4abe-b43b-87285070b268 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:50.646031 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-45c98098-36e3-4abe-b43b-87285070b268 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1270 microversion: 2.1 time: 0.582844 May 28 04:34:50.650953 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 80/124] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:50 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1270 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:50.877575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-75f9bdc0-07ff-4fc5-8c3b-6724e24afd49 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:50.878813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-75f9bdc0-07ff-4fc5-8c3b-6724e24afd49 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:50.890762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75f9bdc0-07ff-4fc5-8c3b-6724e24afd49 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:50.891327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75f9bdc0-07ff-4fc5-8c3b-6724e24afd49 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:50.892719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75f9bdc0-07ff-4fc5-8c3b-6724e24afd49 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:50.892719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75f9bdc0-07ff-4fc5-8c3b-6724e24afd49 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:52.143604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-75f9bdc0-07ff-4fc5-8c3b-6724e24afd49 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:52.152560 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-75f9bdc0-07ff-4fc5-8c3b-6724e24afd49 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1338 microversion: 2.1 time: 1.279419 May 28 04:34:52.153164 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 81/125] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:50 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1338 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:52.181587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e7283381-5971-438a-a8cf-7c6c088cccf0 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:52.194305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e7283381-5971-438a-a8cf-7c6c088cccf0 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:52.222237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e7283381-5971-438a-a8cf-7c6c088cccf0 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:52.230074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e7283381-5971-438a-a8cf-7c6c088cccf0 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:52.231286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e7283381-5971-438a-a8cf-7c6c088cccf0 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:52.234266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e7283381-5971-438a-a8cf-7c6c088cccf0 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:52.461554 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e7283381-5971-438a-a8cf-7c6c088cccf0 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:52.477183 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e7283381-5971-438a-a8cf-7c6c088cccf0 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1277 microversion: 2.1 time: 0.297210 May 28 04:34:52.478760 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 82/126] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:52 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1277 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:52.490921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-25fbf46a-48de-4091-a53a-58634d1b6ebf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:34:52.490921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-25fbf46a-48de-4091-a53a-58634d1b6ebf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:34:52.490921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-25fbf46a-48de-4091-a53a-58634d1b6ebf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:34:52.490921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-25fbf46a-48de-4091-a53a-58634d1b6ebf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:34:52.491741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-25fbf46a-48de-4091-a53a-58634d1b6ebf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:34:52.504103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25fbf46a-48de-4091-a53a-58634d1b6ebf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:52.504798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25fbf46a-48de-4091-a53a-58634d1b6ebf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:52.505727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25fbf46a-48de-4091-a53a-58634d1b6ebf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:52.506443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25fbf46a-48de-4091-a53a-58634d1b6ebf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:52.514354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-693f11f9-d9d4-4284-8eab-81ae8b15b4e1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:52.518027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-693f11f9-d9d4-4284-8eab-81ae8b15b4e1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:52.549501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-693f11f9-d9d4-4284-8eab-81ae8b15b4e1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:52.551838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-693f11f9-d9d4-4284-8eab-81ae8b15b4e1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:52.557230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-693f11f9-d9d4-4284-8eab-81ae8b15b4e1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:52.558479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-693f11f9-d9d4-4284-8eab-81ae8b15b4e1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:52.569333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-25fbf46a-48de-4091-a53a-58634d1b6ebf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Getting quotas for project d908671a46484d2082cc88a1d2c93f98. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:34:52.579658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-25fbf46a-48de-4091-a53a-58634d1b6ebf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Getting quotas for user da8fff3851eb4ecc927400c09117f5ee and project d908671a46484d2082cc88a1d2c93f98. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:34:52.607851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-25fbf46a-48de-4091-a53a-58634d1b6ebf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:34:52.614468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-25fbf46a-48de-4091-a53a-58634d1b6ebf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:34:52.787401 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-25fbf46a-48de-4091-a53a-58634d1b6ebf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.964825 May 28 04:34:52.788798 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 45/127] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:34:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 4968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:34:53.082564 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-693f11f9-d9d4-4284-8eab-81ae8b15b4e1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:53.104658 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-693f11f9-d9d4-4284-8eab-81ae8b15b4e1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1312 microversion: 2.1 time: 0.601248 May 28 04:34:53.104658 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 83/128] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:52 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1312 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:53.122333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0408726e-f31e-4de7-bfe3-7ede7c40972a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:53.123033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0408726e-f31e-4de7-bfe3-7ede7c40972a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:53.302883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0408726e-f31e-4de7-bfe3-7ede7c40972a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:53.318945 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0408726e-f31e-4de7-bfe3-7ede7c40972a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1211 microversion: 2.1 time: 0.219526 May 28 04:34:53.319300 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 84/129] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:53 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1211 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:53.337391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-58788b6f-7cc4-4e02-84a6-afadf5ff07df tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:53.338456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-58788b6f-7cc4-4e02-84a6-afadf5ff07df tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:53.349083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58788b6f-7cc4-4e02-84a6-afadf5ff07df tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:53.352304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58788b6f-7cc4-4e02-84a6-afadf5ff07df tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:53.352304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58788b6f-7cc4-4e02-84a6-afadf5ff07df tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:53.352304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58788b6f-7cc4-4e02-84a6-afadf5ff07df tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:53.407187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-33a9b674-27ca-4b22-910e-c90ea6cd0ea8 req-08b00d0d-e90b-41e4-b3a2-7d8244bcb693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c431c1-9eaa-4508-94b0-05614a36f135", "tag": "2bdce7c2-a103-419f-abec-055ab2ac98b2"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:53.489078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-33a9b674-27ca-4b22-910e-c90ea6cd0ea8 req-08b00d0d-e90b-41e4-b3a2-7d8244bcb693 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:53.491477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-33a9b674-27ca-4b22-910e-c90ea6cd0ea8 req-08b00d0d-e90b-41e4-b3a2-7d8244bcb693 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:53.586192 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-33a9b674-27ca-4b22-910e-c90ea6cd0ea8 req-08b00d0d-e90b-41e4-b3a2-7d8244bcb693 service nova] Creating event network-changed:2bdce7c2-a103-419f-abec-055ab2ac98b2 for instance 38c431c1-9eaa-4508-94b0-05614a36f135 on n-h1-843700-1 May 28 04:34:53.588135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-33a9b674-27ca-4b22-910e-c90ea6cd0ea8 req-08b00d0d-e90b-41e4-b3a2-7d8244bcb693 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 04:34:53.592658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b35836e-e940-40c1-bd66-91c5e608ff82 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:53.595521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b35836e-e940-40c1-bd66-91c5e608ff82 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:53.596679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b35836e-e940-40c1-bd66-91c5e608ff82 None None] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:53.598533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b35836e-e940-40c1-bd66-91c5e608ff82 None None] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:53.624659 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.compute.rpcapi [None req-2b35836e-e940-40c1-bd66-91c5e608ff82 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 28 04:34:53.627655 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b35836e-e940-40c1-bd66-91c5e608ff82 None None] Releasing lock "compute-rpcapi-router" {{(pid=126043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 04:34:53.670632 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2b35836e-e940-40c1-bd66-91c5e608ff82 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.879648 May 28 04:34:53.671632 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 46/130] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:53.677383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-10eb78a0-1766-4b3b-ade6-e526bf312f4d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:53.679619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-10eb78a0-1766-4b3b-ade6-e526bf312f4d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:53.694715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:34:54.091848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-58788b6f-7cc4-4e02-84a6-afadf5ff07df tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:54.099325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:34:54.107136 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-58788b6f-7cc4-4e02-84a6-afadf5ff07df tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1338 microversion: 2.1 time: 0.771880 May 28 04:34:54.120305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10eb78a0-1766-4b3b-ade6-e526bf312f4d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:54.120305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10eb78a0-1766-4b3b-ade6-e526bf312f4d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:54.120305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10eb78a0-1766-4b3b-ade6-e526bf312f4d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:54.120305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10eb78a0-1766-4b3b-ade6-e526bf312f4d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:54.132547 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 85/131] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:53 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1338 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:54.138263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4411c7e4-c5c9-4844-9a26-0878985dabe3 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:54.139844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4411c7e4-c5c9-4844-9a26-0878985dabe3 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:54.148203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4411c7e4-c5c9-4844-9a26-0878985dabe3 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:54.148967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4411c7e4-c5c9-4844-9a26-0878985dabe3 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:54.153734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4411c7e4-c5c9-4844-9a26-0878985dabe3 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:54.154389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4411c7e4-c5c9-4844-9a26-0878985dabe3 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:54.644842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4411c7e4-c5c9-4844-9a26-0878985dabe3 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:54.654435 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4411c7e4-c5c9-4844-9a26-0878985dabe3 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1312 microversion: 2.1 time: 0.520520 May 28 04:34:54.663023 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 86/132] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:54 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1312 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:54.677347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b25c0e6e-9510-4a9e-903e-dbf5b7c150ad tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:54.678598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b25c0e6e-9510-4a9e-903e-dbf5b7c150ad tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:54.687425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b25c0e6e-9510-4a9e-903e-dbf5b7c150ad tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:54.689781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b25c0e6e-9510-4a9e-903e-dbf5b7c150ad tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:54.693134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b25c0e6e-9510-4a9e-903e-dbf5b7c150ad tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:54.693912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b25c0e6e-9510-4a9e-903e-dbf5b7c150ad tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:54.834879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b25c0e6e-9510-4a9e-903e-dbf5b7c150ad tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:54.843992 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b25c0e6e-9510-4a9e-903e-dbf5b7c150ad tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1237 microversion: 2.1 time: 0.179417 May 28 04:34:54.850142 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 87/133] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:54 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1237 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:54.874503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-10eb78a0-1766-4b3b-ade6-e526bf312f4d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:54.885993 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-10eb78a0-1766-4b3b-ade6-e526bf312f4d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1319 microversion: 2.1 time: 1.212712 May 28 04:34:54.888723 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 47/134] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:53 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1319 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:55.128299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e57da64b-9bb9-4c21-9e11-19f516013c77 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:55.129329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e57da64b-9bb9-4c21-9e11-19f516013c77 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:55.136336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e57da64b-9bb9-4c21-9e11-19f516013c77 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:55.137122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e57da64b-9bb9-4c21-9e11-19f516013c77 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:55.138129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e57da64b-9bb9-4c21-9e11-19f516013c77 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:55.138787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e57da64b-9bb9-4c21-9e11-19f516013c77 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:55.682962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b6c4843b-653a-48fc-bb88-0b2956ab9c00 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:55.683965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b6c4843b-653a-48fc-bb88-0b2956ab9c00 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:55.697974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6c4843b-653a-48fc-bb88-0b2956ab9c00 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:55.699958 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6c4843b-653a-48fc-bb88-0b2956ab9c00 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:55.702414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6c4843b-653a-48fc-bb88-0b2956ab9c00 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:55.705181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6c4843b-653a-48fc-bb88-0b2956ab9c00 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:55.834360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e57da64b-9bb9-4c21-9e11-19f516013c77 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:55.848712 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e57da64b-9bb9-4c21-9e11-19f516013c77 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1338 microversion: 2.1 time: 0.726835 May 28 04:34:55.851353 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 88/135] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:55 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1338 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:34:55.867333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6f72b3be-ed07-4e65-b4ec-16788272f83f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:55.868381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6f72b3be-ed07-4e65-b4ec-16788272f83f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:55.882199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f72b3be-ed07-4e65-b4ec-16788272f83f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:55.887497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f72b3be-ed07-4e65-b4ec-16788272f83f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:55.888718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f72b3be-ed07-4e65-b4ec-16788272f83f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:55.893652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f72b3be-ed07-4e65-b4ec-16788272f83f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:56.135305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6f72b3be-ed07-4e65-b4ec-16788272f83f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:56.150222 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6f72b3be-ed07-4e65-b4ec-16788272f83f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1285 microversion: 2.1 time: 0.288851 May 28 04:34:56.160641 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 89/136] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:55 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1285 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:56.171370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0f4c9e9d-3ae6-4eb7-926c-b6658628193d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:56.172018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0f4c9e9d-3ae6-4eb7-926c-b6658628193d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:56.202138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f4c9e9d-3ae6-4eb7-926c-b6658628193d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:56.203162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f4c9e9d-3ae6-4eb7-926c-b6658628193d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:56.204015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f4c9e9d-3ae6-4eb7-926c-b6658628193d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:56.204467 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f4c9e9d-3ae6-4eb7-926c-b6658628193d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:56.303316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b6c4843b-653a-48fc-bb88-0b2956ab9c00 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:56.325710 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b6c4843b-653a-48fc-bb88-0b2956ab9c00 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1312 microversion: 2.1 time: 0.648818 May 28 04:34:56.340474 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 48/137] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:55 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1312 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:56.610144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0f4c9e9d-3ae6-4eb7-926c-b6658628193d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:56.639324 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0f4c9e9d-3ae6-4eb7-926c-b6658628193d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1319 microversion: 2.1 time: 0.457067 May 28 04:34:56.642364 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 90/138] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:56 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1319 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:56.653667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-c4c62f21-90e3-4f1d-964c-0ca598168dd1 req-1ff883fc-a9c5-4ba8-b0ef-e0d1dc0ba529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2af79f0-ae7c-40fd-8034-3a957e218bbd", "tag": "e0a73643-7263-4551-8d5a-5ef51b6fe3b3"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:56.683339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c4c62f21-90e3-4f1d-964c-0ca598168dd1 req-1ff883fc-a9c5-4ba8-b0ef-e0d1dc0ba529 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:56.686242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c4c62f21-90e3-4f1d-964c-0ca598168dd1 req-1ff883fc-a9c5-4ba8-b0ef-e0d1dc0ba529 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:56.750693 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-c4c62f21-90e3-4f1d-964c-0ca598168dd1 req-1ff883fc-a9c5-4ba8-b0ef-e0d1dc0ba529 service nova] Creating event network-changed:e0a73643-7263-4551-8d5a-5ef51b6fe3b3 for instance c2af79f0-ae7c-40fd-8034-3a957e218bbd on n-h2-843700-1 May 28 04:34:56.755400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c4c62f21-90e3-4f1d-964c-0ca598168dd1 req-1ff883fc-a9c5-4ba8-b0ef-e0d1dc0ba529 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 04:34:56.761172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d92af3d1-cfba-47fa-9a49-89768b0c0762 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:56.762913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d92af3d1-cfba-47fa-9a49-89768b0c0762 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:56.765522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d92af3d1-cfba-47fa-9a49-89768b0c0762 None None] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:56.766571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d92af3d1-cfba-47fa-9a49-89768b0c0762 None None] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:56.794245 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.compute.rpcapi [None req-d92af3d1-cfba-47fa-9a49-89768b0c0762 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 28 04:34:56.802387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d92af3d1-cfba-47fa-9a49-89768b0c0762 None None] Releasing lock "compute-rpcapi-router" {{(pid=126044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 04:34:56.871501 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d92af3d1-cfba-47fa-9a49-89768b0c0762 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225806 May 28 04:34:56.873400 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 91/139] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:56.881408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-33baa2e5-5fb9-4f28-9a90-def2dc68c16d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:56.890004 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-33baa2e5-5fb9-4f28-9a90-def2dc68c16d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:56.911699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-33baa2e5-5fb9-4f28-9a90-def2dc68c16d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:56.917157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-33baa2e5-5fb9-4f28-9a90-def2dc68c16d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:56.920616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-33baa2e5-5fb9-4f28-9a90-def2dc68c16d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:56.924772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-33baa2e5-5fb9-4f28-9a90-def2dc68c16d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:57.018525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f53c7155-6308-4610-b8da-0b6e79759bce tempest-FlavorMetadataValidation-1553158920 tempest-FlavorMetadataValidation-1553158920-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1645146381", "id": 715696723, "os-flavor-access:is_public": "True"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:57.020252 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:57.020252 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:57.148680 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f53c7155-6308-4610-b8da-0b6e79759bce tempest-FlavorMetadataValidation-1553158920 tempest-FlavorMetadataValidation-1553158920-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.806671 May 28 04:34:57.149826 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 49/140] 10.222.0.58 () {62 vars in 1187 bytes} [Sat May 28 04:34:56 2022] POST /compute/v2.1/flavors => generated 468 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:34:57.167130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b46a967b-6520-4a30-ad2b-76cc4fcdae67 tempest-FlavorMetadataValidation-1553158920 tempest-FlavorMetadataValidation-1553158920-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:57.171757 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:57.171757 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:57.660141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-33baa2e5-5fb9-4f28-9a90-def2dc68c16d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:57.668003 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b46a967b-6520-4a30-ad2b-76cc4fcdae67 tempest-FlavorMetadataValidation-1553158920 tempest-FlavorMetadataValidation-1553158920-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/715696723/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.510658 May 28 04:34:57.669822 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 50/141] 10.222.0.58 () {62 vars in 1261 bytes} [Sat May 28 04:34:57 2022] POST /compute/v2.1/flavors/715696723/os-extra_specs => generated 62 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:57.680757 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-33baa2e5-5fb9-4f28-9a90-def2dc68c16d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1338 microversion: 2.1 time: 0.805718 May 28 04:34:57.681368 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 92/142] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:56 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1338 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:57.699527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-06c86ce3-a091-4a1a-959e-240d7ace5731 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:57.700271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-06c86ce3-a091-4a1a-959e-240d7ace5731 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:57.718622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-87936dbc-c945-4c15-ba90-e0d86574be94 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:57.721028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-87936dbc-c945-4c15-ba90-e0d86574be94 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:57.726929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:34:57.728649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06c86ce3-a091-4a1a-959e-240d7ace5731 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:57.735754 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06c86ce3-a091-4a1a-959e-240d7ace5731 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:57.738266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06c86ce3-a091-4a1a-959e-240d7ace5731 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:57.742623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87936dbc-c945-4c15-ba90-e0d86574be94 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:57.743840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06c86ce3-a091-4a1a-959e-240d7ace5731 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:57.744141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87936dbc-c945-4c15-ba90-e0d86574be94 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:57.749414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87936dbc-c945-4c15-ba90-e0d86574be94 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:57.750294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87936dbc-c945-4c15-ba90-e0d86574be94 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:58.098773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-06c86ce3-a091-4a1a-959e-240d7ace5731 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:58.101883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=61 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:34:58.117552 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-06c86ce3-a091-4a1a-959e-240d7ace5731 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1291 microversion: 2.1 time: 0.444482 May 28 04:34:58.129528 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 51/143] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:57 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1291 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:58.243854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-87936dbc-c945-4c15-ba90-e0d86574be94 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:58.253931 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-87936dbc-c945-4c15-ba90-e0d86574be94 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1312 microversion: 2.1 time: 0.567056 May 28 04:34:58.259627 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 93/144] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:57 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1312 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:58.266460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f091fd59-903c-4f7a-80bc-383c4966609f tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:58.273348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f091fd59-903c-4f7a-80bc-383c4966609f tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:58.291798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f091fd59-903c-4f7a-80bc-383c4966609f tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:58.293828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f091fd59-903c-4f7a-80bc-383c4966609f tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:58.293828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f091fd59-903c-4f7a-80bc-383c4966609f tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:58.294376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f091fd59-903c-4f7a-80bc-383c4966609f tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:58.377349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-efff2a9b-b4be-4737-9862-25607573d2c5 req-aa28d376-281d-44e4-a3de-d5c44f690d59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a0535f1-775e-459f-86e6-1ae27b94fbb9", "tag": "38854251-1bce-468f-8935-acb2745b2259"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:58.399974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-efff2a9b-b4be-4737-9862-25607573d2c5 req-aa28d376-281d-44e4-a3de-d5c44f690d59 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:58.403107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-efff2a9b-b4be-4737-9862-25607573d2c5 req-aa28d376-281d-44e4-a3de-d5c44f690d59 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:58.420074 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-efff2a9b-b4be-4737-9862-25607573d2c5 req-aa28d376-281d-44e4-a3de-d5c44f690d59 service nova] Creating event network-changed:38854251-1bce-468f-8935-acb2745b2259 for instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 on n-h2-843700-1 May 28 04:34:58.427615 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-efff2a9b-b4be-4737-9862-25607573d2c5 req-aa28d376-281d-44e4-a3de-d5c44f690d59 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.296345 May 28 04:34:58.428801 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 52/145] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:58.435838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-63b6d01f-3179-4c54-a02a-6c7c8f4d3327 tempest-FlavorMetadataValidation-1553158920 tempest-FlavorMetadataValidation-1553158920-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:58.437161 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:58.437161 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:58.544967 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-63b6d01f-3179-4c54-a02a-6c7c8f4d3327 tempest-FlavorMetadataValidation-1553158920 tempest-FlavorMetadataValidation-1553158920-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/715696723" status: 202 len: 0 microversion: 2.86 time: 0.114199 May 28 04:34:58.545980 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 53/146] 10.222.0.58 () {60 vars in 1198 bytes} [Sat May 28 04:34:58 2022] DELETE /compute/v2.1/flavors/715696723 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 04:34:58.604493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f091fd59-903c-4f7a-80bc-383c4966609f tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:58.616868 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f091fd59-903c-4f7a-80bc-383c4966609f tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1319 microversion: 2.1 time: 0.355514 May 28 04:34:58.629163 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 94/147] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:58 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:58.644841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-001e75cb-7f37-4b9f-a0c2-80c778d5e73c tempest-FlavorMetadataValidation-1553158920 tempest-FlavorMetadataValidation-1553158920-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:58.717629 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-001e75cb-7f37-4b9f-a0c2-80c778d5e73c tempest-FlavorMetadataValidation-1553158920 tempest-FlavorMetadataValidation-1553158920-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.095973 May 28 04:34:58.719948 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 95/148] 10.222.0.58 () {60 vars in 1186 bytes} [Sat May 28 04:34:58 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:34:58.731948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e922148c-fd40-413f-a4e5-251973b64875 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:58.749569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e922148c-fd40-413f-a4e5-251973b64875 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:58.772961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e922148c-fd40-413f-a4e5-251973b64875 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:58.774092 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e922148c-fd40-413f-a4e5-251973b64875 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:58.775893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e922148c-fd40-413f-a4e5-251973b64875 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:58.779872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e922148c-fd40-413f-a4e5-251973b64875 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:58.852251 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-64e7ed72-7f73-4376-affd-28ab52dd4f74 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-499544199", "id": 621605737, "os-flavor-access:is_public": "False"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:58.892103 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:58.892103 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:59.063976 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-64e7ed72-7f73-4376-affd-28ab52dd4f74 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.511400 May 28 04:34:59.083726 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 54/149] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:34:58 2022] POST /compute/v2.1/flavors => generated 435 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:34:59.100761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bc30f884-15c3-4de8-be31-a3b17a902bcc tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ebe678a1d4c843d1839881054a0f035b"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:59.102337 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:59.102337 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:34:59.238619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e922148c-fd40-413f-a4e5-251973b64875 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:59.248516 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e922148c-fd40-413f-a4e5-251973b64875 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1338 microversion: 2.1 time: 0.525162 May 28 04:34:59.249868 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 96/150] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:58 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1338 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:59.265317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-76f55f27-acb2-43a8-a6d5-c6fb6b774f43 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:59.266229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-76f55f27-acb2-43a8-a6d5-c6fb6b774f43 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:59.285818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76f55f27-acb2-43a8-a6d5-c6fb6b774f43 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:59.286545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76f55f27-acb2-43a8-a6d5-c6fb6b774f43 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:59.287537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76f55f27-acb2-43a8-a6d5-c6fb6b774f43 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:59.288301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76f55f27-acb2-43a8-a6d5-c6fb6b774f43 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:59.405497 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bc30f884-15c3-4de8-be31-a3b17a902bcc tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/621605737/action" status: 200 len: 96 microversion: 2.1 time: 0.314628 May 28 04:34:59.409124 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 55/151] 10.222.0.58 () {60 vars in 1196 bytes} [Sat May 28 04:34:59 2022] POST /compute/v2.1/flavors/621605737/action => generated 96 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:34:59.425296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-45b529cf-1aaf-41f5-afee-fe77a204586b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:59.426064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-45b529cf-1aaf-41f5-afee-fe77a204586b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:59.450023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45b529cf-1aaf-41f5-afee-fe77a204586b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:59.454625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45b529cf-1aaf-41f5-afee-fe77a204586b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:59.457036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45b529cf-1aaf-41f5-afee-fe77a204586b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:59.458033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45b529cf-1aaf-41f5-afee-fe77a204586b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:59.624199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-76f55f27-acb2-43a8-a6d5-c6fb6b774f43 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:59.637898 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-76f55f27-acb2-43a8-a6d5-c6fb6b774f43 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1333 microversion: 2.1 time: 0.385883 May 28 04:34:59.640768 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 97/152] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:59 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1333 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:59.650006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-11d9016e-141e-4c8c-9c92-9aa67f2f7257 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ebe678a1d4c843d1839881054a0f035b"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:34:59.656707 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:34:59.656707 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:34:59.790841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-45b529cf-1aaf-41f5-afee-fe77a204586b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:34:59.801512 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-45b529cf-1aaf-41f5-afee-fe77a204586b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1312 microversion: 2.1 time: 0.389487 May 28 04:34:59.811179 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 56/153] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:59 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1312 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:34:59.821823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7e7299f9-e72b-469e-b7c6-f8217e36d718 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:34:59.822872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7e7299f9-e72b-469e-b7c6-f8217e36d718 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:34:59.835304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e7299f9-e72b-469e-b7c6-f8217e36d718 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:59.837507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e7299f9-e72b-469e-b7c6-f8217e36d718 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:34:59.837507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e7299f9-e72b-469e-b7c6-f8217e36d718 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:34:59.838721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e7299f9-e72b-469e-b7c6-f8217e36d718 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:00.086851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7e7299f9-e72b-469e-b7c6-f8217e36d718 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:00.096020 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7e7299f9-e72b-469e-b7c6-f8217e36d718 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1319 microversion: 2.1 time: 0.292310 May 28 04:35:00.097607 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 57/154] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:34:59 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:00.119732 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-11d9016e-141e-4c8c-9c92-9aa67f2f7257 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] HTTP exception thrown: Flavor access already exists for flavor 29 and project ebe678a1d4c843d1839881054a0f035b combination. May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-11d9016e-141e-4c8c-9c92-9aa67f2f7257 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Request method failure captured: May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/flavors/621605737/action HTTP/1.1 May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 67 May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZwYE_tYsyCNkbJbJYDRLxfJLGPBUBoioGdv-bIglGrnZRmIXC9UvlNcNC5KiXPcEVZ7jqysgHm4SMEAqV2JPn4GBsw41ug6cF5XKyTSrXptm6bKFvNvH6XalxYWapkUMt-pNs3jDh94o82SJTFzURsq8XkpKesOELVMH3gHlVpksI May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 467066a662334b0184fe9a74439f58f7 May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-874646757 May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:35:00.123373 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:35:00.126153 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_467066a662334b0184fe9a74439f58f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/467066a662334b0184fe9a74439f58f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/467066a662334b0184fe9a74439f58f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/467066a662334b0184fe9a74439f58f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:00.126153 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-874646757 May 28 04:35:00.126153 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 467066a662334b0184fe9a74439f58f7 May 28 04:35:00.126153 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-874646757 May 28 04:35:00.126153 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin May 28 04:35:00.126153 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:00.126153 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:00.126153 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 6e068caa5ca942d4ae28512268e5c060 May 28 04:35:00.126153 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin May 28 04:35:00.126153 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:35:00.126153 n-d-843700-1 devstack@n-api.service[126044]: {"addTenantAccess": {"tenant": "ebe678a1d4c843d1839881054a0f035b"}} May 28 04:35:00.126153 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:35:00.126829 n-d-843700-1 devstack@n-api.service[126044]: exception: Flavor access already exists for flavor 29 and project ebe678a1d4c843d1839881054a0f035b combination. May 28 04:35:00.126829 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '621605737', 'body': {'addTenantAccess': {'tenant': 'ebe678a1d4c843d1839881054a0f035b'}}} May 28 04:35:00.126829 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:00.126829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:00.126829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 28 04:35:00.126829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 28 04:35:00.126829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 28 04:35:00.126829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 28 04:35:00.126829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 28 04:35:00.126829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = self._query(query) May 28 04:35:00.126829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 28 04:35:00.126829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi conn.query(q) May 28 04:35:00.126829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 28 04:35:00.126829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 04:35:00.126829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 28 04:35:00.126829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result.read() May 28 04:35:00.126829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 28 04:35:00.126829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 28 04:35:00.128054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 28 04:35:00.128054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 28 04:35:00.128054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 04:35:00.128054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 28 04:35:00.128054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 04:35:00.128054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 28 04:35:00.128054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '29-ebe678a1d4c843d1839881054a0f035b' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") May 28 04:35:00.128054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:00.128054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 28 04:35:00.128054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:00.128054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:00.128054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project May 28 04:35:00.128054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi project.save(context.session) May 28 04:35:00.128054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 28 04:35:00.128054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi session.flush() May 28 04:35:00.128054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 28 04:35:00.128054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._flush(objects) May 28 04:35:00.128054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 28 04:35:00.128054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 28 04:35:00.131028 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 28 04:35:00.131028 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi compat.raise_( May 28 04:35:00.131028 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 28 04:35:00.131028 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception May 28 04:35:00.131028 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 28 04:35:00.131028 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi flush_context.execute() May 28 04:35:00.131028 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 28 04:35:00.131028 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi rec.execute(self) May 28 04:35:00.131028 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 28 04:35:00.131028 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 28 04:35:00.131028 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 28 04:35:00.131028 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 28 04:35:00.131028 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 28 04:35:00.131028 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 28 04:35:00.131028 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 28 04:35:00.131028 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 28 04:35:00.131028 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 28 04:35:00.131028 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 28 04:35:00.133938 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 28 04:35:00.133938 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 28 04:35:00.133938 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 28 04:35:00.133938 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 28 04:35:00.133938 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 28 04:35:00.133938 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 28 04:35:00.133938 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 28 04:35:00.133938 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception May 28 04:35:00.133938 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 28 04:35:00.133938 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 28 04:35:00.133938 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 28 04:35:00.133938 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 28 04:35:00.133938 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 28 04:35:00.133938 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = self._query(query) May 28 04:35:00.133938 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 28 04:35:00.133938 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi conn.query(q) May 28 04:35:00.133938 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 28 04:35:00.133938 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 04:35:00.136826 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 28 04:35:00.136826 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result.read() May 28 04:35:00.136826 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 28 04:35:00.136826 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 28 04:35:00.136826 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 28 04:35:00.136826 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 28 04:35:00.136826 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 04:35:00.136826 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 28 04:35:00.136826 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 04:35:00.136826 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 28 04:35:00.136826 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '29-ebe678a1d4c843d1839881054a0f035b' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") May 28 04:35:00.136826 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] May 28 04:35:00.136826 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 28, 4, 35, 0, 76568), 'updated_at': None, 'flavor_id': 29, 'project_id': 'ebe678a1d4c843d1839881054a0f035b'}] May 28 04:35:00.136826 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 28 04:35:00.136826 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:00.136826 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:00.136826 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:00.140177 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:00.140177 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access May 28 04:35:00.140177 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) May 28 04:35:00.140177 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 28 04:35:00.140177 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 28 04:35:00.140177 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access May 28 04:35:00.140177 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._add_access(project_id) May 28 04:35:00.140177 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access May 28 04:35:00.140177 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) May 28 04:35:00.140177 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project May 28 04:35:00.140177 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) May 28 04:35:00.140177 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:35:00.140177 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:35:00.140177 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project May 28 04:35:00.140177 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, May 28 04:35:00.140177 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 29 and project ebe678a1d4c843d1839881054a0f035b combination. May 28 04:35:00.140177 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:00.140177 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:00.140177 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:00.144819 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:00.144819 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:00.144819 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:00.144819 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:00.144819 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:00.144819 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:00.144819 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:00.144819 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:35:00.144819 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:35:00.144819 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access May 28 04:35:00.144819 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) May 28 04:35:00.144819 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 29 and project ebe678a1d4c843d1839881054a0f035b combination. May 28 04:35:00.144819 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:00.144819 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:00.144819 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:00.144819 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:00.144819 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:00.144819 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:00.144819 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:00.144819 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:00.148055 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 29 and project ebe678a1d4c843d1839881054a0f035b combination. May 28 04:35:00.148055 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:00.148055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-11d9016e-141e-4c8c-9c92-9aa67f2f7257 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Returning 409 to user: Flavor access already exists for flavor 29 and project ebe678a1d4c843d1839881054a0f035b combination. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:00.148055 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-11d9016e-141e-4c8c-9c92-9aa67f2f7257 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/621605737/action" status: 409 len: 152 microversion: 2.1 time: 0.481862 May 28 04:35:00.148055 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 98/155] 10.222.0.58 () {60 vars in 1196 bytes} [Sat May 28 04:34:59 2022] POST /compute/v2.1/flavors/621605737/action => generated 152 bytes in 484 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 04:35:00.148780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-71a75cb5-c791-4f24-95d4-5bc35325e63e tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ebe678a1d4c843d1839881054a0f035b"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:00.148780 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:00.148780 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:00.270283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b2585783-2b85-437f-885c-20a5879fcb6b tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:00.272122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b2585783-2b85-437f-885c-20a5879fcb6b tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:00.287315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b2585783-2b85-437f-885c-20a5879fcb6b tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:00.288166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b2585783-2b85-437f-885c-20a5879fcb6b tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:00.289130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b2585783-2b85-437f-885c-20a5879fcb6b tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:00.290363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b2585783-2b85-437f-885c-20a5879fcb6b tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:00.328600 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-71a75cb5-c791-4f24-95d4-5bc35325e63e tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/621605737/action" status: 200 len: 21 microversion: 2.1 time: 0.198194 May 28 04:35:00.335147 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 58/156] 10.222.0.58 () {60 vars in 1196 bytes} [Sat May 28 04:35:00 2022] POST /compute/v2.1/flavors/621605737/action => generated 21 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:35:00.354486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c7babbb2-1ab6-4942-97ff-84a707250063 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:00.357996 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:00.357996 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:00.505741 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c7babbb2-1ab6-4942-97ff-84a707250063 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/621605737" status: 202 len: 0 microversion: 2.1 time: 0.169495 May 28 04:35:00.506342 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 59/157] 10.222.0.58 () {58 vars in 1157 bytes} [Sat May 28 04:35:00 2022] DELETE /compute/v2.1/flavors/621605737 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:35:00.525378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0d9c3eb6-bdff-4228-b5b3-88bfeefcfc84 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:00.617791 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0d9c3eb6-bdff-4228-b5b3-88bfeefcfc84 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.099669 May 28 04:35:00.619806 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 60/158] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:35:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:00.640017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-dc1fa577-0ce0-4df1-9a6c-dc7f2d082600 req-bc31fcb5-046b-4fd5-ab0f-db26eb3988c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158412f0-30ee-458c-9da2-83be853d2ea4", "tag": "3234e2dc-f459-4590-9dd3-6cfbc11536ed"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:00.651118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b2585783-2b85-437f-885c-20a5879fcb6b tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:00.663433 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b2585783-2b85-437f-885c-20a5879fcb6b tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1338 microversion: 2.1 time: 0.399301 May 28 04:35:00.666857 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 99/159] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:00 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1338 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:00.672604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d34a9763-4a82-4050-8a95-650add9d1a46 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1075887884", "id": 1950856320, "os-flavor-access:is_public": "True"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:00.674710 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:00.674710 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:00.685939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-dc1fa577-0ce0-4df1-9a6c-dc7f2d082600 req-bc31fcb5-046b-4fd5-ab0f-db26eb3988c9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:00.686389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-dc1fa577-0ce0-4df1-9a6c-dc7f2d082600 req-bc31fcb5-046b-4fd5-ab0f-db26eb3988c9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:00.700676 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-dc1fa577-0ce0-4df1-9a6c-dc7f2d082600 req-bc31fcb5-046b-4fd5-ab0f-db26eb3988c9 service nova] Creating event network-changed:3234e2dc-f459-4590-9dd3-6cfbc11536ed for instance 158412f0-30ee-458c-9da2-83be853d2ea4 on n-h1-843700-1 May 28 04:35:00.717814 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-dc1fa577-0ce0-4df1-9a6c-dc7f2d082600 req-bc31fcb5-046b-4fd5-ab0f-db26eb3988c9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092794 May 28 04:35:00.721551 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 61/160] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:00.728284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-743526b6-c35d-47de-a55f-a02df670abed tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:00.729140 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-743526b6-c35d-47de-a55f-a02df670abed tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:00.738233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-743526b6-c35d-47de-a55f-a02df670abed tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:00.738707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-743526b6-c35d-47de-a55f-a02df670abed tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:00.739524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-743526b6-c35d-47de-a55f-a02df670abed tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:00.740132 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-743526b6-c35d-47de-a55f-a02df670abed tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:00.790435 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d34a9763-4a82-4050-8a95-650add9d1a46 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.122101 May 28 04:35:00.791594 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 100/161] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:35:00 2022] POST /compute/v2.1/flavors => generated 438 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:00.805575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8d8b6917-10b7-43de-827a-4910ac38d855 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:00.808363 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:00.808363 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:00.824792 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-8d8b6917-10b7-43de-827a-4910ac38d855 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] HTTP exception thrown: Access list not available for public flavors. May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8d8b6917-10b7-43de-827a-4910ac38d855 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Request method failure captured: May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/flavors/1950856320/os-flavor-access HTTP/1.1 May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZwYE_tYsyCNkbJbJYDRLxfJLGPBUBoioGdv-bIglGrnZRmIXC9UvlNcNC5KiXPcEVZ7jqysgHm4SMEAqV2JPn4GBsw41ug6cF5XKyTSrXptm6bKFvNvH6XalxYWapkUMt-pNs3jDh94o82SJTFzURsq8XkpKesOELVMH3gHlVpksI May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 467066a662334b0184fe9a74439f58f7 May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-874646757 May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:35:00.830677 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:35:00.832773 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_467066a662334b0184fe9a74439f58f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/467066a662334b0184fe9a74439f58f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/467066a662334b0184fe9a74439f58f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/467066a662334b0184fe9a74439f58f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:00.832773 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-874646757 May 28 04:35:00.832773 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 467066a662334b0184fe9a74439f58f7 May 28 04:35:00.832773 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-874646757 May 28 04:35:00.832773 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin May 28 04:35:00.832773 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:00.832773 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:00.832773 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 6e068caa5ca942d4ae28512268e5c060 May 28 04:35:00.832773 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin May 28 04:35:00.832773 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:35:00.832773 n-d-843700-1 devstack@n-api.service[126044]: exception: Access list not available for public flavors. May 28 04:35:00.832773 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'flavor_id': '1950856320'} May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. May 28 04:35:00.833445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:00.838244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8d8b6917-10b7-43de-827a-4910ac38d855 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:00.841789 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8d8b6917-10b7-43de-827a-4910ac38d855 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/1950856320/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.041626 May 28 04:35:00.844436 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 101/162] 10.222.0.58 () {58 vars in 1208 bytes} [Sat May 28 04:35:00 2022] GET /compute/v2.1/flavors/1950856320/os-flavor-access => generated 91 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:35:00.859901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0e32f8aa-5606-45a3-99c2-d9f78f5a58ca tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:00.865855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0e32f8aa-5606-45a3-99c2-d9f78f5a58ca tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:00.882644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0e32f8aa-5606-45a3-99c2-d9f78f5a58ca tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:00.885136 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0e32f8aa-5606-45a3-99c2-d9f78f5a58ca tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:00.886471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0e32f8aa-5606-45a3-99c2-d9f78f5a58ca tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:00.889387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0e32f8aa-5606-45a3-99c2-d9f78f5a58ca tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:01.199128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-743526b6-c35d-47de-a55f-a02df670abed tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:01.243310 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-743526b6-c35d-47de-a55f-a02df670abed tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1333 microversion: 2.1 time: 0.516539 May 28 04:35:01.249797 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 62/163] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:00 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1333 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:01.288229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d69c9a3f-e5ee-4886-98a4-acb6df909b07 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:01.290493 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:01.290493 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:01.312179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=10,nova_api:INSERT=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:01.349118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0e32f8aa-5606-45a3-99c2-d9f78f5a58ca tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:01.360495 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0e32f8aa-5606-45a3-99c2-d9f78f5a58ca tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1312 microversion: 2.1 time: 0.514289 May 28 04:35:01.364836 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 102/164] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:00 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1312 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:01.372247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-becd7bb7-9bdc-45c3-a2a1-52f338b4ac51 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:01.372926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-becd7bb7-9bdc-45c3-a2a1-52f338b4ac51 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:01.386852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-becd7bb7-9bdc-45c3-a2a1-52f338b4ac51 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:01.387341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-becd7bb7-9bdc-45c3-a2a1-52f338b4ac51 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:01.388339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-becd7bb7-9bdc-45c3-a2a1-52f338b4ac51 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:01.388777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-becd7bb7-9bdc-45c3-a2a1-52f338b4ac51 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:01.424755 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d69c9a3f-e5ee-4886-98a4-acb6df909b07 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1950856320" status: 202 len: 0 microversion: 2.1 time: 0.164722 May 28 04:35:01.427033 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 63/165] 10.222.0.58 () {58 vars in 1160 bytes} [Sat May 28 04:35:01 2022] DELETE /compute/v2.1/flavors/1950856320 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:35:01.440327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a2fb236c-5d4d-48f0-b07a-047551b26bd4 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:01.531713 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a2fb236c-5d4d-48f0-b07a-047551b26bd4 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.099984 May 28 04:35:01.532326 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 64/166] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:35:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:01.554551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e25f61e4-c6ed-40bf-b462-a3fb0289c495 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-156778287", "id": 1045584870, "os-flavor-access:is_public": "False"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:01.556109 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:01.556109 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:01.647621 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e25f61e4-c6ed-40bf-b462-a3fb0289c495 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.086165 May 28 04:35:01.648328 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 65/167] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:35:01 2022] POST /compute/v2.1/flavors => generated 438 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:35:01.836897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-becd7bb7-9bdc-45c3-a2a1-52f338b4ac51 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:01.845925 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-becd7bb7-9bdc-45c3-a2a1-52f338b4ac51 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1319 microversion: 2.1 time: 0.479663 May 28 04:35:01.849959 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 103/168] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:01 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1319 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:01.860027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b92c6710-a280-438c-b23c-313deec81d3d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:01.861007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b92c6710-a280-438c-b23c-313deec81d3d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:01.873728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b92c6710-a280-438c-b23c-313deec81d3d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:01.875422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b92c6710-a280-438c-b23c-313deec81d3d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:01.875637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b92c6710-a280-438c-b23c-313deec81d3d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:01.876600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b92c6710-a280-438c-b23c-313deec81d3d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:02.196422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b92c6710-a280-438c-b23c-313deec81d3d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:02.208225 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b92c6710-a280-438c-b23c-313deec81d3d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1338 microversion: 2.1 time: 0.356903 May 28 04:35:02.210069 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 104/169] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:01 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1338 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:02.261791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3583652e-b5fe-499f-ba93-71f0a7a0ec12 tempest-FlavorsAccessNegativeTestJSON-1419816510 tempest-FlavorsAccessNegativeTestJSON-1419816510-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ebe678a1d4c843d1839881054a0f035b"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:02.266708 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:02.266708 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:02.266708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3583652e-b5fe-499f-ba93-71f0a7a0ec12 tempest-FlavorsAccessNegativeTestJSON-1419816510 tempest-FlavorsAccessNegativeTestJSON-1419816510-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '8cae61246f924f44a82ec6d81aa82f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe678a1d4c843d1839881054a0f035b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3583652e-b5fe-499f-ba93-71f0a7a0ec12 tempest-FlavorsAccessNegativeTestJSON-1419816510 tempest-FlavorsAccessNegativeTestJSON-1419816510-project] Request method failure captured: May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/flavors/1045584870/action HTTP/1.1 May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 67 May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZuBTKA_wQcVQGXjn9qjFWwvhGFB8sugBwpX7f3pyvfjej_RVuVQ8Lp3GTELT8i8AFcoVL4L-liZhYKGsxlIHia2U_-AlJHzl3DsvVVioxIHGOBsMRLz1b_EY4k9agXQJtAv1nOXe2FCzDe3O5CSleqnNaSBvmxy74M06AoxLLNEgU May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: ebe678a1d4c843d1839881054a0f035b May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1419816510 May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:35:02.268357 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:35:02.270348 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ebe678a1d4c843d1839881054a0f035b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ebe678a1d4c843d1839881054a0f035b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ebe678a1d4c843d1839881054a0f035b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ebe678a1d4c843d1839881054a0f035b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:02.270348 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1419816510 May 28 04:35:02.270348 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: ebe678a1d4c843d1839881054a0f035b May 28 04:35:02.270348 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1419816510 May 28 04:35:02.270348 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-FlavorsAccessNegativeTestJSON-1419816510-project May 28 04:35:02.270348 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:02.270348 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:02.270348 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 8cae61246f924f44a82ec6d81aa82f5b May 28 04:35:02.270348 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1419816510-project May 28 04:35:02.270348 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:35:02.270348 n-d-843700-1 devstack@n-api.service[126043]: {"addTenantAccess": {"tenant": "ebe678a1d4c843d1839881054a0f035b"}} May 28 04:35:02.270348 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:35:02.271197 n-d-843700-1 devstack@n-api.service[126043]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 28 04:35:02.271197 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '1045584870', 'body': {'addTenantAccess': {'tenant': 'ebe678a1d4c843d1839881054a0f035b'}}} May 28 04:35:02.271197 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:02.271197 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:02.271197 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:02.271197 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:02.271197 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:02.271197 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:02.271197 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:02.271197 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:02.271197 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:35:02.271197 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:35:02.271197 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access May 28 04:35:02.271197 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) May 28 04:35:02.271197 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:02.271197 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:02.271197 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:02.271197 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:02.271197 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:02.272435 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:02.272435 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:02.272435 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:02.272435 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:02.272435 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:02.272435 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:02.272435 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:02.272435 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:02.272435 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:02.272435 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 28 04:35:02.272435 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:02.272435 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:02.272435 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:02.272435 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:02.272435 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:02.272435 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:02.272435 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:02.272435 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:02.272435 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 28 04:35:02.272435 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:02.273601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1e71b32c-2c57-446d-9f60-335b577b2e4f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:02.273601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1e71b32c-2c57-446d-9f60-335b577b2e4f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:02.274775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3583652e-b5fe-499f-ba93-71f0a7a0ec12 tempest-FlavorsAccessNegativeTestJSON-1419816510 tempest-FlavorsAccessNegativeTestJSON-1419816510-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:02.275806 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3583652e-b5fe-499f-ba93-71f0a7a0ec12 tempest-FlavorsAccessNegativeTestJSON-1419816510 tempest-FlavorsAccessNegativeTestJSON-1419816510-project] 10.222.0.58 "POST /compute/v2.1/flavors/1045584870/action" status: 403 len: 130 microversion: 2.1 time: 0.614764 May 28 04:35:02.280604 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 66/170] 10.222.0.58 () {60 vars in 1199 bytes} [Sat May 28 04:35:01 2022] POST /compute/v2.1/flavors/1045584870/action => generated 130 bytes in 620 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:02.296023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-07de6fd5-2660-4e85-9ab4-0e1979ed773d tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:02.296211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e71b32c-2c57-446d-9f60-335b577b2e4f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:02.296211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e71b32c-2c57-446d-9f60-335b577b2e4f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:02.296211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e71b32c-2c57-446d-9f60-335b577b2e4f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:02.296765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e71b32c-2c57-446d-9f60-335b577b2e4f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:02.387093 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-07de6fd5-2660-4e85-9ab4-0e1979ed773d tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1045584870" status: 202 len: 0 microversion: 2.1 time: 0.105107 May 28 04:35:02.391447 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 67/171] 10.222.0.58 () {58 vars in 1160 bytes} [Sat May 28 04:35:02 2022] DELETE /compute/v2.1/flavors/1045584870 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:35:02.398146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d4e49e16-b986-40bf-b8e0-124eca12f835 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:02.403746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d4e49e16-b986-40bf-b8e0-124eca12f835 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:02.416062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d4e49e16-b986-40bf-b8e0-124eca12f835 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:02.417212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d4e49e16-b986-40bf-b8e0-124eca12f835 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:02.417329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d4e49e16-b986-40bf-b8e0-124eca12f835 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:02.417739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d4e49e16-b986-40bf-b8e0-124eca12f835 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:02.546026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1e71b32c-2c57-446d-9f60-335b577b2e4f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:02.555416 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1e71b32c-2c57-446d-9f60-335b577b2e4f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1333 microversion: 2.1 time: 0.289850 May 28 04:35:02.566304 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 105/172] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:02 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1333 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:02.575891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3fa5f97f-b16e-4ed0-9035-6409cafcec68 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:02.601522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=24 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:02.613918 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3fa5f97f-b16e-4ed0-9035-6409cafcec68 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046237 May 28 04:35:02.649505 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 106/173] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:35:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:02.662386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f7659b9c-591e-41af-a9c0-9576f8dde3a8 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1479322047", "id": 1104322656, "os-flavor-access:is_public": "False"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:02.664277 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:02.664277 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:02.749837 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f7659b9c-591e-41af-a9c0-9576f8dde3a8 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.092876 May 28 04:35:02.754829 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 107/174] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:35:02 2022] POST /compute/v2.1/flavors => generated 439 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:02.783491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7e56df00-0d66-4d18-b09a-295484bb1083 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ebe678a1d4c843d1839881054a0f035b"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:02.783491 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:02.783491 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:02.797832 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d4e49e16-b986-40bf-b8e0-124eca12f835 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:02.807910 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d4e49e16-b986-40bf-b8e0-124eca12f835 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1312 microversion: 2.1 time: 0.415136 May 28 04:35:02.809059 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 68/175] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:02 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1312 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:02.897273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dc6e99a0-968c-4153-abb6-4474b499068c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:02.897586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dc6e99a0-968c-4153-abb6-4474b499068c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:03.007555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc6e99a0-968c-4153-abb6-4474b499068c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:03.007555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc6e99a0-968c-4153-abb6-4474b499068c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:03.007555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc6e99a0-968c-4153-abb6-4474b499068c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:03.007555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc6e99a0-968c-4153-abb6-4474b499068c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:03.130541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dc6e99a0-968c-4153-abb6-4474b499068c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:03.130541 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dc6e99a0-968c-4153-abb6-4474b499068c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1319 microversion: 2.1 time: 0.228412 May 28 04:35:03.130541 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 69/176] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:02 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:03.234725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-539cf155-73d1-4f3c-9ed5-8cb7e1c29d43 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:03.235458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-539cf155-73d1-4f3c-9ed5-8cb7e1c29d43 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:03.243235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-539cf155-73d1-4f3c-9ed5-8cb7e1c29d43 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:03.243766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-539cf155-73d1-4f3c-9ed5-8cb7e1c29d43 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:03.244812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-539cf155-73d1-4f3c-9ed5-8cb7e1c29d43 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:03.245268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-539cf155-73d1-4f3c-9ed5-8cb7e1c29d43 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:03.317013 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=16 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:03.438965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-539cf155-73d1-4f3c-9ed5-8cb7e1c29d43 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:03.457040 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-539cf155-73d1-4f3c-9ed5-8cb7e1c29d43 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1338 microversion: 2.1 time: 0.216222 May 28 04:35:03.457040 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 70/177] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:03 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1338 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:03.514438 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7e56df00-0d66-4d18-b09a-295484bb1083 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1104322656/action" status: 200 len: 97 microversion: 2.1 time: 0.753392 May 28 04:35:03.515250 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 108/178] 10.222.0.58 () {60 vars in 1199 bytes} [Sat May 28 04:35:02 2022] POST /compute/v2.1/flavors/1104322656/action => generated 97 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 04:35:03.530291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-168569be-ee59-46cc-a9e4-50c8fe9da5b6 tempest-FlavorsAccessNegativeTestJSON-1419816510 tempest-FlavorsAccessNegativeTestJSON-1419816510-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ebe678a1d4c843d1839881054a0f035b"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:03.531711 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:03.531711 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:03.533082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-168569be-ee59-46cc-a9e4-50c8fe9da5b6 tempest-FlavorsAccessNegativeTestJSON-1419816510 tempest-FlavorsAccessNegativeTestJSON-1419816510-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '8cae61246f924f44a82ec6d81aa82f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe678a1d4c843d1839881054a0f035b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-168569be-ee59-46cc-a9e4-50c8fe9da5b6 tempest-FlavorsAccessNegativeTestJSON-1419816510 tempest-FlavorsAccessNegativeTestJSON-1419816510-project] Request method failure captured: May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/flavors/1104322656/action HTTP/1.1 May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 70 May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZuBTKA_wQcVQGXjn9qjFWwvhGFB8sugBwpX7f3pyvfjej_RVuVQ8Lp3GTELT8i8AFcoVL4L-liZhYKGsxlIHia2U_-AlJHzl3DsvVVioxIHGOBsMRLz1b_EY4k9agXQJtAv1nOXe2FCzDe3O5CSleqnNaSBvmxy74M06AoxLLNEgU May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: ebe678a1d4c843d1839881054a0f035b May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1419816510 May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:35:03.535227 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:35:03.536476 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ebe678a1d4c843d1839881054a0f035b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ebe678a1d4c843d1839881054a0f035b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ebe678a1d4c843d1839881054a0f035b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ebe678a1d4c843d1839881054a0f035b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:03.536476 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1419816510 May 28 04:35:03.536476 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: ebe678a1d4c843d1839881054a0f035b May 28 04:35:03.536476 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1419816510 May 28 04:35:03.536476 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-FlavorsAccessNegativeTestJSON-1419816510-project May 28 04:35:03.536476 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:03.536476 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:03.536476 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 8cae61246f924f44a82ec6d81aa82f5b May 28 04:35:03.536476 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1419816510-project May 28 04:35:03.536476 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:35:03.536476 n-d-843700-1 devstack@n-api.service[126043]: {"removeTenantAccess": {"tenant": "ebe678a1d4c843d1839881054a0f035b"}} May 28 04:35:03.536476 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:35:03.537294 n-d-843700-1 devstack@n-api.service[126043]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 28 04:35:03.537294 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '1104322656', 'body': {'removeTenantAccess': {'tenant': 'ebe678a1d4c843d1839881054a0f035b'}}} May 28 04:35:03.537294 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:03.537294 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:03.537294 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:03.537294 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:03.537294 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:03.537294 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:03.537294 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:03.537294 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:03.537294 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:35:03.537294 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:35:03.537294 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access May 28 04:35:03.537294 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi context.can( May 28 04:35:03.537294 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:03.537294 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:03.537294 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:03.537294 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:03.537294 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:03.537294 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:03.538381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:03.538381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:03.538381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:03.538381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:03.538381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:03.538381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:03.538381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:03.538381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:03.538381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 28 04:35:03.538381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:03.538381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:03.538381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:03.538381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:03.538381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:03.538381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:03.538381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:03.538381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:03.538381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 28 04:35:03.538381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:03.539472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-168569be-ee59-46cc-a9e4-50c8fe9da5b6 tempest-FlavorsAccessNegativeTestJSON-1419816510 tempest-FlavorsAccessNegativeTestJSON-1419816510-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:03.539472 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-168569be-ee59-46cc-a9e4-50c8fe9da5b6 tempest-FlavorsAccessNegativeTestJSON-1419816510 tempest-FlavorsAccessNegativeTestJSON-1419816510-project] 10.222.0.58 "POST /compute/v2.1/flavors/1104322656/action" status: 403 len: 133 microversion: 2.1 time: 0.014113 May 28 04:35:03.539472 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 71/179] 10.222.0.58 () {60 vars in 1199 bytes} [Sat May 28 04:35:03 2022] POST /compute/v2.1/flavors/1104322656/action => generated 133 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:03.546563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-60ef0c2b-6145-48a5-bec6-0b2b675f9966 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ebe678a1d4c843d1839881054a0f035b"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:03.547861 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:03.547861 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:03.584406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c61e42bd-c2a5-43b0-baf5-87ebce3cc96c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:03.584406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c61e42bd-c2a5-43b0-baf5-87ebce3cc96c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:03.597603 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c61e42bd-c2a5-43b0-baf5-87ebce3cc96c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:03.598601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c61e42bd-c2a5-43b0-baf5-87ebce3cc96c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:03.600010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c61e42bd-c2a5-43b0-baf5-87ebce3cc96c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:03.600723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c61e42bd-c2a5-43b0-baf5-87ebce3cc96c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:03.626255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=14 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:03.775025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c61e42bd-c2a5-43b0-baf5-87ebce3cc96c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:03.783814 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c61e42bd-c2a5-43b0-baf5-87ebce3cc96c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1333 microversion: 2.1 time: 0.215124 May 28 04:35:03.784957 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 72/180] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:03 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1333 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:03.825683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1cdb47ae-f21f-4039-8801-01b6a0dbb3a8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:03.826527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1cdb47ae-f21f-4039-8801-01b6a0dbb3a8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:03.833626 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cdb47ae-f21f-4039-8801-01b6a0dbb3a8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:03.834082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cdb47ae-f21f-4039-8801-01b6a0dbb3a8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:03.834852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cdb47ae-f21f-4039-8801-01b6a0dbb3a8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:03.835327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cdb47ae-f21f-4039-8801-01b6a0dbb3a8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:03.963036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1cdb47ae-f21f-4039-8801-01b6a0dbb3a8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:03.974276 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1cdb47ae-f21f-4039-8801-01b6a0dbb3a8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1312 microversion: 2.1 time: 0.152782 May 28 04:35:03.975045 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 73/181] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:03 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:04.159575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3599b898-8052-4431-aa88-ba3a7c1708e9 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:04.159575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3599b898-8052-4431-aa88-ba3a7c1708e9 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:04.159575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3599b898-8052-4431-aa88-ba3a7c1708e9 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:04.159575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3599b898-8052-4431-aa88-ba3a7c1708e9 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:04.159976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3599b898-8052-4431-aa88-ba3a7c1708e9 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:04.159976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3599b898-8052-4431-aa88-ba3a7c1708e9 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:04.277902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3599b898-8052-4431-aa88-ba3a7c1708e9 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:04.285427 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3599b898-8052-4431-aa88-ba3a7c1708e9 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1319 microversion: 2.1 time: 0.155984 May 28 04:35:04.286005 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 74/182] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:04 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:04.460793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-90fc75bc-2202-414d-9a69-973613e40078 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:04.461711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-90fc75bc-2202-414d-9a69-973613e40078 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:04.467748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-90fc75bc-2202-414d-9a69-973613e40078 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:04.468199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-90fc75bc-2202-414d-9a69-973613e40078 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:04.468961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-90fc75bc-2202-414d-9a69-973613e40078 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:04.469398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-90fc75bc-2202-414d-9a69-973613e40078 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:04.559342 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-60ef0c2b-6145-48a5-bec6-0b2b675f9966 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1104322656/action" status: 200 len: 21 microversion: 2.1 time: 1.016388 May 28 04:35:04.560421 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 109/183] 10.222.0.58 () {60 vars in 1199 bytes} [Sat May 28 04:35:03 2022] POST /compute/v2.1/flavors/1104322656/action => generated 21 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:35:04.571243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-48e84ea7-2a1e-473a-9299-56b1fc8c4991 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:04.572736 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:04.572736 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:04.611350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-90fc75bc-2202-414d-9a69-973613e40078 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:04.620148 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-90fc75bc-2202-414d-9a69-973613e40078 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1338 microversion: 2.1 time: 0.164105 May 28 04:35:04.620793 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 75/184] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:04 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1338 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:04.701918 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-48e84ea7-2a1e-473a-9299-56b1fc8c4991 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1104322656" status: 202 len: 0 microversion: 2.1 time: 0.136168 May 28 04:35:04.704572 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 110/185] 10.222.0.58 () {58 vars in 1160 bytes} [Sat May 28 04:35:04 2022] DELETE /compute/v2.1/flavors/1104322656 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:35:04.711853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c943537c-6c9c-4466-9a40-e3ac57629825 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:04.730531 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c943537c-6c9c-4466-9a40-e3ac57629825 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023090 May 28 04:35:04.740035 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 76/186] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:35:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:04.754932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ebce1331-abff-4f1a-b957-5e9e7586334f tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1464837962", "id": 1787712360, "os-flavor-access:is_public": "False"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:04.802931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-101861b7-b80e-4301-8729-006d1f4c1a9d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:04.803300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-101861b7-b80e-4301-8729-006d1f4c1a9d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:04.809564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-101861b7-b80e-4301-8729-006d1f4c1a9d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:04.809996 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-101861b7-b80e-4301-8729-006d1f4c1a9d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:04.810765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-101861b7-b80e-4301-8729-006d1f4c1a9d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:04.811240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-101861b7-b80e-4301-8729-006d1f4c1a9d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:04.852592 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ebce1331-abff-4f1a-b957-5e9e7586334f tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.101931 May 28 04:35:04.853357 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 111/187] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:35:04 2022] POST /compute/v2.1/flavors => generated 439 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:35:04.864280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a353a7f3-81e9-4176-ad13-afa1f535161e tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c0f2eab3e58e44d593c92a04153ac862"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:04.953614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-101861b7-b80e-4301-8729-006d1f4c1a9d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:04.961830 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-101861b7-b80e-4301-8729-006d1f4c1a9d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1333 microversion: 2.1 time: 0.163727 May 28 04:35:04.971242 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 77/188] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:04 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1333 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:04.992860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-13aaef53-d23c-4a5e-8c35-8c9ea089214c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:04.993439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-13aaef53-d23c-4a5e-8c35-8c9ea089214c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:04.999837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13aaef53-d23c-4a5e-8c35-8c9ea089214c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:05.000298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13aaef53-d23c-4a5e-8c35-8c9ea089214c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:05.001072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13aaef53-d23c-4a5e-8c35-8c9ea089214c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:05.001513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13aaef53-d23c-4a5e-8c35-8c9ea089214c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:05.078033 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-a353a7f3-81e9-4176-ad13-afa1f535161e tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] HTTP exception thrown: Flavor access not found for 33 / c0f2eab3e58e44d593c92a04153ac862 combination. May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a353a7f3-81e9-4176-ad13-afa1f535161e tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Request method failure captured: May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/flavors/1787712360/action HTTP/1.1 May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 70 May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZwYE_tYsyCNkbJbJYDRLxfJLGPBUBoioGdv-bIglGrnZRmIXC9UvlNcNC5KiXPcEVZ7jqysgHm4SMEAqV2JPn4GBsw41ug6cF5XKyTSrXptm6bKFvNvH6XalxYWapkUMt-pNs3jDh94o82SJTFzURsq8XkpKesOELVMH3gHlVpksI May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 467066a662334b0184fe9a74439f58f7 May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-874646757 May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:35:05.080192 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:35:05.081650 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_467066a662334b0184fe9a74439f58f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/467066a662334b0184fe9a74439f58f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/467066a662334b0184fe9a74439f58f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/467066a662334b0184fe9a74439f58f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:05.081650 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-874646757 May 28 04:35:05.081650 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 467066a662334b0184fe9a74439f58f7 May 28 04:35:05.081650 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-874646757 May 28 04:35:05.081650 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin May 28 04:35:05.081650 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:05.081650 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:05.081650 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 6e068caa5ca942d4ae28512268e5c060 May 28 04:35:05.081650 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin May 28 04:35:05.081650 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:35:05.081650 n-d-843700-1 devstack@n-api.service[126044]: {"removeTenantAccess": {"tenant": "c0f2eab3e58e44d593c92a04153ac862"}} May 28 04:35:05.081650 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:35:05.082687 n-d-843700-1 devstack@n-api.service[126044]: exception: Flavor access not found for 33 / c0f2eab3e58e44d593c92a04153ac862 combination. May 28 04:35:05.082687 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '1787712360', 'body': {'removeTenantAccess': {'tenant': 'c0f2eab3e58e44d593c92a04153ac862'}}} May 28 04:35:05.082687 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:05.082687 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:05.082687 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access May 28 04:35:05.082687 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) May 28 04:35:05.082687 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 28 04:35:05.082687 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 28 04:35:05.082687 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access May 28 04:35:05.082687 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) May 28 04:35:05.082687 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access May 28 04:35:05.082687 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) May 28 04:35:05.082687 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project May 28 04:35:05.082687 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) May 28 04:35:05.082687 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:35:05.082687 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:35:05.082687 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project May 28 04:35:05.082687 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, May 28 04:35:05.084652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 33 / c0f2eab3e58e44d593c92a04153ac862 combination. May 28 04:35:05.084652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:05.084652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:05.084652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:05.084652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:05.084652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:05.084652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:05.084652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:05.084652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:05.084652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:05.084652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:05.084652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:35:05.084652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:35:05.084652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access May 28 04:35:05.084652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:35:05.084652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 33 / c0f2eab3e58e44d593c92a04153ac862 combination. May 28 04:35:05.084652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:05.084652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:05.084652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:05.084652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:05.086702 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:05.086702 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:05.086702 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:05.086702 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:05.086702 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 33 / c0f2eab3e58e44d593c92a04153ac862 combination. May 28 04:35:05.086702 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:05.087889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a353a7f3-81e9-4176-ad13-afa1f535161e tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Returning 404 to user: Flavor access not found for 33 / c0f2eab3e58e44d593c92a04153ac862 combination. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:05.088756 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a353a7f3-81e9-4176-ad13-afa1f535161e tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1787712360/action" status: 404 len: 124 microversion: 2.1 time: 0.228787 May 28 04:35:05.090034 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 112/189] 10.222.0.58 () {60 vars in 1199 bytes} [Sat May 28 04:35:04 2022] POST /compute/v2.1/flavors/1787712360/action => generated 124 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:05.102617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7ce65a10-6de2-4086-a0b6-62edc0de0ebf tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:05.148729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-13aaef53-d23c-4a5e-8c35-8c9ea089214c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:05.156749 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-13aaef53-d23c-4a5e-8c35-8c9ea089214c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1312 microversion: 2.1 time: 0.167787 May 28 04:35:05.157362 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 78/190] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:04 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1312 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:05.163525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4c82eae4-451f-4ea2-b1db-9d586200cc51 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f77025a0e50>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:05.206197 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4c82eae4-451f-4ea2-b1db-9d586200cc51 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/e168bc02-ea2d-43ac-9a4e-d7168112a8da" status: 200 len: 661 microversion: 2.1 time: 0.047141 May 28 04:35:05.206786 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 79/191] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:05 2022] GET /compute/v2.1/images/e168bc02-ea2d-43ac-9a4e-d7168112a8da => generated 661 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:05.215469 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7ce65a10-6de2-4086-a0b6-62edc0de0ebf tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1787712360" status: 202 len: 0 microversion: 2.1 time: 0.116868 May 28 04:35:05.216218 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 113/192] 10.222.0.58 () {58 vars in 1160 bytes} [Sat May 28 04:35:05 2022] DELETE /compute/v2.1/flavors/1787712360 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:35:05.218561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9500f818-ef70-4084-a606-81bc7512e45e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f77026baaf0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:05.228064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6bf1c6b0-d188-4771-b4ff-4f38e0763113 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:05.248721 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6bf1c6b0-d188-4771-b4ff-4f38e0763113 tempest-FlavorsAccessNegativeTestJSON-874646757 tempest-FlavorsAccessNegativeTestJSON-874646757-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024215 May 28 04:35:05.249315 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 114/193] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:35:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:05.259268 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9500f818-ef70-4084-a606-81bc7512e45e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/e168bc02-ea2d-43ac-9a4e-d7168112a8da" status: 200 len: 661 microversion: 2.1 time: 0.044349 May 28 04:35:05.259984 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 80/194] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:05 2022] GET /compute/v2.1/images/e168bc02-ea2d-43ac-9a4e-d7168112a8da => generated 661 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:35:05.301855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-62e2b0e1-0a7b-431d-9ed5-5b9624ac93dc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:05.302514 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-62e2b0e1-0a7b-431d-9ed5-5b9624ac93dc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:05.309133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-62e2b0e1-0a7b-431d-9ed5-5b9624ac93dc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:05.309761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-62e2b0e1-0a7b-431d-9ed5-5b9624ac93dc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:05.310725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-62e2b0e1-0a7b-431d-9ed5-5b9624ac93dc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:05.311324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-62e2b0e1-0a7b-431d-9ed5-5b9624ac93dc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:05.455108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-62e2b0e1-0a7b-431d-9ed5-5b9624ac93dc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:05.459209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:05.463853 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-62e2b0e1-0a7b-431d-9ed5-5b9624ac93dc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1319 microversion: 2.1 time: 0.166145 May 28 04:35:05.464438 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 115/195] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:05 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:05.637499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0b8e2b74-f64a-4d26-bd27-77baddca4e33 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:05.638263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0b8e2b74-f64a-4d26-bd27-77baddca4e33 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:05.646333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b8e2b74-f64a-4d26-bd27-77baddca4e33 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:05.646910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b8e2b74-f64a-4d26-bd27-77baddca4e33 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:05.647585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b8e2b74-f64a-4d26-bd27-77baddca4e33 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:05.648197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b8e2b74-f64a-4d26-bd27-77baddca4e33 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:05.785479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0b8e2b74-f64a-4d26-bd27-77baddca4e33 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:05.793681 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0b8e2b74-f64a-4d26-bd27-77baddca4e33 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1338 microversion: 2.1 time: 0.160522 May 28 04:35:05.794705 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 81/196] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:05 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1338 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:05.977800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-744abf70-63ad-4b04-b158-ab41c01b2e63 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:05.978410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-744abf70-63ad-4b04-b158-ab41c01b2e63 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:05.984808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-744abf70-63ad-4b04-b158-ab41c01b2e63 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:05.985251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-744abf70-63ad-4b04-b158-ab41c01b2e63 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:05.986008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-744abf70-63ad-4b04-b158-ab41c01b2e63 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:05.986446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-744abf70-63ad-4b04-b158-ab41c01b2e63 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:06.151699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-744abf70-63ad-4b04-b158-ab41c01b2e63 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:06.159554 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-744abf70-63ad-4b04-b158-ab41c01b2e63 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1333 microversion: 2.1 time: 0.185635 May 28 04:35:06.160358 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 116/197] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:05 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1333 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:06.178603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e537a5f6-39f4-491b-bab8-f5b9a6ef15e7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:06.179285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e537a5f6-39f4-491b-bab8-f5b9a6ef15e7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:06.185758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e537a5f6-39f4-491b-bab8-f5b9a6ef15e7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:06.186216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e537a5f6-39f4-491b-bab8-f5b9a6ef15e7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:06.187106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e537a5f6-39f4-491b-bab8-f5b9a6ef15e7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:06.187550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e537a5f6-39f4-491b-bab8-f5b9a6ef15e7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:06.260791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6ab75056-3857-48a0-a56f-bbcd067b0d9a tempest-FlavorsV255TestJSON-1925029777 tempest-FlavorsV255TestJSON-1925029777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1399940617", "id": 966932428, "os-flavor-access:is_public": "True"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:06.262355 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:06.262355 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:06.318888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e537a5f6-39f4-491b-bab8-f5b9a6ef15e7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:06.326708 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e537a5f6-39f4-491b-bab8-f5b9a6ef15e7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1312 microversion: 2.1 time: 0.152662 May 28 04:35:06.327387 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 117/198] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:06 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:06.364183 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6ab75056-3857-48a0-a56f-bbcd067b0d9a tempest-FlavorsV255TestJSON-1925029777 tempest-FlavorsV255TestJSON-1925029777-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.223690 May 28 04:35:06.364940 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 82/199] 10.222.0.58 () {62 vars in 1187 bytes} [Sat May 28 04:35:06 2022] POST /compute/v2.1/flavors => generated 446 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 04:35:06.487986 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a18ed7b5-3fb9-4fbe-a694-9e73e7f37ad1 tempest-FlavorsV255TestJSON-986321175 tempest-FlavorsV255TestJSON-986321175-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:06.490265 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a88e7893-1480-4b40-b88b-950e622dd048 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:06.490967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a88e7893-1480-4b40-b88b-950e622dd048 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:06.497418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a88e7893-1480-4b40-b88b-950e622dd048 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:06.498303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a88e7893-1480-4b40-b88b-950e622dd048 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:06.499101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a88e7893-1480-4b40-b88b-950e622dd048 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:06.499860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a88e7893-1480-4b40-b88b-950e622dd048 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:06.502374 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a18ed7b5-3fb9-4fbe-a694-9e73e7f37ad1 tempest-FlavorsV255TestJSON-986321175 tempest-FlavorsV255TestJSON-986321175-project] 10.222.0.58 "GET /compute/v2.1/flavors/966932428" status: 200 len: 446 microversion: 2.55 time: 0.130106 May 28 04:35:06.509414 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 118/200] 10.222.0.58 () {60 vars in 1195 bytes} [Sat May 28 04:35:06 2022] GET /compute/v2.1/flavors/966932428 => generated 446 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:35:06.514205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6bca06d0-bed5-4066-afc2-76f886d507ac tempest-FlavorsV255TestJSON-1925029777 tempest-FlavorsV255TestJSON-1925029777-project-admin] Action: 'update', calling method: .version_select at 0x7f770487a790>, body: {"flavor": {"description": "new"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:06.524482 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:06.524482 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:06.652044 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6bca06d0-bed5-4066-afc2-76f886d507ac tempest-FlavorsV255TestJSON-1925029777 tempest-FlavorsV255TestJSON-1925029777-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/966932428" status: 200 len: 447 microversion: 2.55 time: 0.135630 May 28 04:35:06.652044 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 119/201] 10.222.0.58 () {62 vars in 1215 bytes} [Sat May 28 04:35:06 2022] PUT /compute/v2.1/flavors/966932428 => generated 447 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:35:06.661121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-10d01733-969e-47a8-b134-023bd10e447c tempest-FlavorsV255TestJSON-986321175 tempest-FlavorsV255TestJSON-986321175-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:06.671506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a88e7893-1480-4b40-b88b-950e622dd048 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:06.684675 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a88e7893-1480-4b40-b88b-950e622dd048 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1319 microversion: 2.1 time: 0.206721 May 28 04:35:06.685883 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 83/202] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:06 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:06.694840 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-10d01733-969e-47a8-b134-023bd10e447c tempest-FlavorsV255TestJSON-986321175 tempest-FlavorsV255TestJSON-986321175-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.038295 May 28 04:35:06.695723 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 120/203] 10.222.0.58 () {60 vars in 1186 bytes} [Sat May 28 04:35:06 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:35:06.712260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7a202e88-135f-4f68-b5a1-d30e4b97d563 tempest-FlavorsV255TestJSON-986321175 tempest-FlavorsV255TestJSON-986321175-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:06.731596 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7a202e88-135f-4f68-b5a1-d30e4b97d563 tempest-FlavorsV255TestJSON-986321175 tempest-FlavorsV255TestJSON-986321175-project] 10.222.0.58 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.023295 May 28 04:35:06.732672 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 84/204] 10.222.0.58 () {60 vars in 1165 bytes} [Sat May 28 04:35:06 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:35:06.746263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-005ee1d4-e5ed-4694-a967-4279172df642 tempest-FlavorsV255TestJSON-1925029777 tempest-FlavorsV255TestJSON-1925029777-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:06.748733 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:06.748733 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:06.787474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:06.809844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b2f1880a-64af-4528-8a85-b2f03776c794 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:06.810460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b2f1880a-64af-4528-8a85-b2f03776c794 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:06.817678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b2f1880a-64af-4528-8a85-b2f03776c794 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:06.818327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b2f1880a-64af-4528-8a85-b2f03776c794 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:06.819232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b2f1880a-64af-4528-8a85-b2f03776c794 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:06.819630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b2f1880a-64af-4528-8a85-b2f03776c794 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:06.838586 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-005ee1d4-e5ed-4694-a967-4279172df642 tempest-FlavorsV255TestJSON-1925029777 tempest-FlavorsV255TestJSON-1925029777-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/966932428" status: 202 len: 0 microversion: 2.55 time: 0.096179 May 28 04:35:06.839697 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 121/205] 10.222.0.58 () {60 vars in 1198 bytes} [Sat May 28 04:35:06 2022] DELETE /compute/v2.1/flavors/966932428 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 04:35:06.847699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e5bb120b-102c-46fb-b1c6-436ea195955c tempest-FlavorsV255TestJSON-1925029777 tempest-FlavorsV255TestJSON-1925029777-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:06.872528 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e5bb120b-102c-46fb-b1c6-436ea195955c tempest-FlavorsV255TestJSON-1925029777 tempest-FlavorsV255TestJSON-1925029777-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.028717 May 28 04:35:06.873240 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 122/206] 10.222.0.58 () {60 vars in 1186 bytes} [Sat May 28 04:35:06 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:35:06.960497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b2f1880a-64af-4528-8a85-b2f03776c794 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:06.968756 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b2f1880a-64af-4528-8a85-b2f03776c794 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1338 microversion: 2.1 time: 0.162962 May 28 04:35:06.975086 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 85/207] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:06 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1338 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:07.176573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aad5e0a4-14af-4efb-a711-77f9decf29f0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:07.177831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aad5e0a4-14af-4efb-a711-77f9decf29f0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:07.186182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-011d8b1b-e860-4e23-804f-78a7d0bc8909 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f770269cee0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:07.187741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aad5e0a4-14af-4efb-a711-77f9decf29f0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:07.188201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aad5e0a4-14af-4efb-a711-77f9decf29f0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:07.190409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aad5e0a4-14af-4efb-a711-77f9decf29f0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:07.190409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aad5e0a4-14af-4efb-a711-77f9decf29f0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:07.233981 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-011d8b1b-e860-4e23-804f-78a7d0bc8909 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/afc50315-453b-4c9d-b4d7-df40cdc3a48a" status: 200 len: 662 microversion: 2.1 time: 0.053007 May 28 04:35:07.234565 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 86/208] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:07 2022] GET /compute/v2.1/images/afc50315-453b-4c9d-b4d7-df40cdc3a48a => generated 662 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:35:07.246345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8fee7076-6581-4605-a0bc-e6d989002dc2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f77025ba940>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:07.289387 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8fee7076-6581-4605-a0bc-e6d989002dc2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/afc50315-453b-4c9d-b4d7-df40cdc3a48a" status: 200 len: 662 microversion: 2.1 time: 0.046715 May 28 04:35:07.290268 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 87/209] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:07 2022] GET /compute/v2.1/images/afc50315-453b-4c9d-b4d7-df40cdc3a48a => generated 662 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:35:07.336806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aad5e0a4-14af-4efb-a711-77f9decf29f0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:07.344245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-07b49aa0-3808-4044-abf4-c1396f8857f9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:07.345207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-07b49aa0-3808-4044-abf4-c1396f8857f9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:07.347505 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aad5e0a4-14af-4efb-a711-77f9decf29f0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1333 microversion: 2.1 time: 0.174676 May 28 04:35:07.348176 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 123/210] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:07 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1333 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:07.367861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07b49aa0-3808-4044-abf4-c1396f8857f9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:07.368421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07b49aa0-3808-4044-abf4-c1396f8857f9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:07.369269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07b49aa0-3808-4044-abf4-c1396f8857f9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:07.369720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07b49aa0-3808-4044-abf4-c1396f8857f9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:07.579272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-07b49aa0-3808-4044-abf4-c1396f8857f9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:07.583572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:07.590269 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-07b49aa0-3808-4044-abf4-c1396f8857f9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1312 microversion: 2.1 time: 0.250162 May 28 04:35:07.591347 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 88/211] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:07 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1312 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:07.705561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-930b77d2-4a19-4890-87e3-7158dfaa0d40 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:07.708117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-930b77d2-4a19-4890-87e3-7158dfaa0d40 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:07.713746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5,nova_api:DELETE=11,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:07.729522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-930b77d2-4a19-4890-87e3-7158dfaa0d40 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:07.729522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-930b77d2-4a19-4890-87e3-7158dfaa0d40 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:07.731197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-930b77d2-4a19-4890-87e3-7158dfaa0d40 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:07.732057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-930b77d2-4a19-4890-87e3-7158dfaa0d40 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:07.986527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8d031f69-787e-4b9c-9ccb-fd8836c280d4 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:07.987447 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8d031f69-787e-4b9c-9ccb-fd8836c280d4 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:07.996122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d031f69-787e-4b9c-9ccb-fd8836c280d4 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:07.996941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d031f69-787e-4b9c-9ccb-fd8836c280d4 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:07.998539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d031f69-787e-4b9c-9ccb-fd8836c280d4 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:07.999748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d031f69-787e-4b9c-9ccb-fd8836c280d4 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:08.157953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-930b77d2-4a19-4890-87e3-7158dfaa0d40 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:08.169429 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-930b77d2-4a19-4890-87e3-7158dfaa0d40 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1319 microversion: 2.1 time: 0.470399 May 28 04:35:08.172911 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 124/212] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:07 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:08.197908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8d031f69-787e-4b9c-9ccb-fd8836c280d4 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:08.207511 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8d031f69-787e-4b9c-9ccb-fd8836c280d4 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1338 microversion: 2.1 time: 0.225130 May 28 04:35:08.208137 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 89/213] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:07 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1338 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:08.366540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4d6f03ea-43c6-439b-82f0-ab52aa2d8d3b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:08.367428 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4d6f03ea-43c6-439b-82f0-ab52aa2d8d3b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:08.373852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d6f03ea-43c6-439b-82f0-ab52aa2d8d3b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:08.374298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d6f03ea-43c6-439b-82f0-ab52aa2d8d3b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:08.375214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d6f03ea-43c6-439b-82f0-ab52aa2d8d3b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:08.375559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d6f03ea-43c6-439b-82f0-ab52aa2d8d3b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:08.525057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4d6f03ea-43c6-439b-82f0-ab52aa2d8d3b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:08.532520 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4d6f03ea-43c6-439b-82f0-ab52aa2d8d3b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1333 microversion: 2.1 time: 0.170676 May 28 04:35:08.533712 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 125/214] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:08 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1333 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:08.608062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4179746d-83c0-442d-8bfe-bf2ef5e01016 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:08.608676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4179746d-83c0-442d-8bfe-bf2ef5e01016 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:08.615956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4179746d-83c0-442d-8bfe-bf2ef5e01016 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:08.616609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4179746d-83c0-442d-8bfe-bf2ef5e01016 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:08.617366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4179746d-83c0-442d-8bfe-bf2ef5e01016 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:08.617946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4179746d-83c0-442d-8bfe-bf2ef5e01016 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:08.793339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4179746d-83c0-442d-8bfe-bf2ef5e01016 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:08.801978 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4179746d-83c0-442d-8bfe-bf2ef5e01016 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1312 microversion: 2.1 time: 0.197175 May 28 04:35:08.802566 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 90/215] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:08 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1312 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:09.060854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-d15bb87f-ecd2-4b62-8b66-dbe08cc20231 req-3929ac27-9857-4e36-99d9-70c9101c01a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a0535f1-775e-459f-86e6-1ae27b94fbb9", "name": "network-vif-plugged", "status": "completed", "tag": "38854251-1bce-468f-8935-acb2745b2259"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:09.069258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d15bb87f-ecd2-4b62-8b66-dbe08cc20231 req-3929ac27-9857-4e36-99d9-70c9101c01a3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:09.069706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d15bb87f-ecd2-4b62-8b66-dbe08cc20231 req-3929ac27-9857-4e36-99d9-70c9101c01a3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:09.080874 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-d15bb87f-ecd2-4b62-8b66-dbe08cc20231 req-3929ac27-9857-4e36-99d9-70c9101c01a3 service nova] Creating event network-vif-plugged:38854251-1bce-468f-8935-acb2745b2259 for instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 on n-h2-843700-1 May 28 04:35:09.086738 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-d15bb87f-ecd2-4b62-8b66-dbe08cc20231 req-3929ac27-9857-4e36-99d9-70c9101c01a3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083202 May 28 04:35:09.087879 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 126/216] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:09.187582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aa24d9ec-6f50-4c86-9bdd-112eaa62b8c7 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:09.188193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-aa24d9ec-6f50-4c86-9bdd-112eaa62b8c7 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:09.196068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa24d9ec-6f50-4c86-9bdd-112eaa62b8c7 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:09.196688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa24d9ec-6f50-4c86-9bdd-112eaa62b8c7 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:09.200441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa24d9ec-6f50-4c86-9bdd-112eaa62b8c7 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:09.201082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa24d9ec-6f50-4c86-9bdd-112eaa62b8c7 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:09.227016 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7552af34-b157-4a83-8dd2-97b1e3e4eb64 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:09.228095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7552af34-b157-4a83-8dd2-97b1e3e4eb64 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:09.244120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7552af34-b157-4a83-8dd2-97b1e3e4eb64 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:09.245026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7552af34-b157-4a83-8dd2-97b1e3e4eb64 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:09.247530 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7552af34-b157-4a83-8dd2-97b1e3e4eb64 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:09.248166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7552af34-b157-4a83-8dd2-97b1e3e4eb64 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:09.501036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-aa24d9ec-6f50-4c86-9bdd-112eaa62b8c7 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:09.512336 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aa24d9ec-6f50-4c86-9bdd-112eaa62b8c7 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1319 microversion: 2.1 time: 0.329382 May 28 04:35:09.529742 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 91/217] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:09 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:09.534710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3a999202-6606-4333-9e88-bd0c3edf20f4 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7702530d30>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:09.586813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7552af34-b157-4a83-8dd2-97b1e3e4eb64 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:09.589240 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3a999202-6606-4333-9e88-bd0c3edf20f4 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/37c6ddc0-05ee-46ff-9574-c115fa3a9989" status: 200 len: 662 microversion: 2.1 time: 0.058170 May 28 04:35:09.590369 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 92/218] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:09 2022] GET /compute/v2.1/images/37c6ddc0-05ee-46ff-9574-c115fa3a9989 => generated 662 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:09.595271 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7552af34-b157-4a83-8dd2-97b1e3e4eb64 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1338 microversion: 2.1 time: 0.374048 May 28 04:35:09.599584 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 127/219] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:09 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1338 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:09.602146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0aff2b56-2f09-42ae-884b-d2825140ade0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:09.603474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0aff2b56-2f09-42ae-884b-d2825140ade0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:09.607360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-448c3661-3361-4748-9d84-962d8864dca1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f770229d670>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:09.625881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0aff2b56-2f09-42ae-884b-d2825140ade0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:09.625881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0aff2b56-2f09-42ae-884b-d2825140ade0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:09.625881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0aff2b56-2f09-42ae-884b-d2825140ade0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:09.625881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0aff2b56-2f09-42ae-884b-d2825140ade0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:09.674552 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-448c3661-3361-4748-9d84-962d8864dca1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/37c6ddc0-05ee-46ff-9574-c115fa3a9989" status: 200 len: 662 microversion: 2.1 time: 0.072902 May 28 04:35:09.675184 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 128/220] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:09 2022] GET /compute/v2.1/images/37c6ddc0-05ee-46ff-9574-c115fa3a9989 => generated 662 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:09.819442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2ee80b0b-5b6a-4ff4-a073-deb60ac068de tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:09.820088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2ee80b0b-5b6a-4ff4-a073-deb60ac068de tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:09.823065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0aff2b56-2f09-42ae-884b-d2825140ade0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:09.826548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2ee80b0b-5b6a-4ff4-a073-deb60ac068de tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:09.827028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2ee80b0b-5b6a-4ff4-a073-deb60ac068de tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:09.833199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2ee80b0b-5b6a-4ff4-a073-deb60ac068de tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:09.833669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2ee80b0b-5b6a-4ff4-a073-deb60ac068de tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:09.841342 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0aff2b56-2f09-42ae-884b-d2825140ade0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1333 microversion: 2.1 time: 0.248194 May 28 04:35:09.842327 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 93/221] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:09 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1333 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:09.954397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5971d390-afcc-40f8-b0dd-fd742b2fe337 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2020788148", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:10.014355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-5971d390-afcc-40f8-b0dd-fd742b2fe337 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] validate_networks() for None {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:35:10.074420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2ee80b0b-5b6a-4ff4-a073-deb60ac068de tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:10.090851 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2ee80b0b-5b6a-4ff4-a073-deb60ac068de tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1312 microversion: 2.1 time: 0.274781 May 28 04:35:10.091829 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 129/222] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:09 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1312 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:10.256627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-5971d390-afcc-40f8-b0dd-fd742b2fe337 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:35:10.257135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-5971d390-afcc-40f8-b0dd-fd742b2fe337 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:35:10.257521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-5971d390-afcc-40f8-b0dd-fd742b2fe337 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:35:10.257934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-5971d390-afcc-40f8-b0dd-fd742b2fe337 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:35:10.258348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-5971d390-afcc-40f8-b0dd-fd742b2fe337 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:35:10.267379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5971d390-afcc-40f8-b0dd-fd742b2fe337 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:10.267829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5971d390-afcc-40f8-b0dd-fd742b2fe337 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:10.268630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5971d390-afcc-40f8-b0dd-fd742b2fe337 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:10.269072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5971d390-afcc-40f8-b0dd-fd742b2fe337 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:10.297997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-5971d390-afcc-40f8-b0dd-fd742b2fe337 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Getting quotas for project 30dc7de2bf82417f8d26ad8ce4a50b17. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:35:10.305879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-5971d390-afcc-40f8-b0dd-fd742b2fe337 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Getting quotas for user 31ab597e5a574f01910a9e0fe680fdb1 and project 30dc7de2bf82417f8d26ad8ce4a50b17. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:35:10.318199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5971d390-afcc-40f8-b0dd-fd742b2fe337 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:35:10.320928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5971d390-afcc-40f8-b0dd-fd742b2fe337 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: a27b8082-4f44-4263-a6a2-86291ea3950b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:35:10.531086 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5971d390-afcc-40f8-b0dd-fd742b2fe337 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583624 May 28 04:35:10.531086 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 94/223] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:35:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:35:10.537299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-53d3fd75-96f6-4679-857f-b9ec74f83da0 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:10.537996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-53d3fd75-96f6-4679-857f-b9ec74f83da0 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:10.545186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53d3fd75-96f6-4679-857f-b9ec74f83da0 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:10.545654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53d3fd75-96f6-4679-857f-b9ec74f83da0 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:10.546422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53d3fd75-96f6-4679-857f-b9ec74f83da0 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:10.547909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53d3fd75-96f6-4679-857f-b9ec74f83da0 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:10.612618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-69852e9c-931a-49fe-aee8-61f27c3e841e tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:10.620392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-69852e9c-931a-49fe-aee8-61f27c3e841e tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:10.628705 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-69852e9c-931a-49fe-aee8-61f27c3e841e tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:10.629205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-69852e9c-931a-49fe-aee8-61f27c3e841e tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:10.630367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-69852e9c-931a-49fe-aee8-61f27c3e841e tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:10.631039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-69852e9c-931a-49fe-aee8-61f27c3e841e tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:10.766521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-53d3fd75-96f6-4679-857f-b9ec74f83da0 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:10.780808 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-53d3fd75-96f6-4679-857f-b9ec74f83da0 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1319 microversion: 2.1 time: 0.244725 May 28 04:35:10.780808 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 130/224] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:10 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:10.788636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-69f894b6-8a48-4183-a7bf-02dffde9cede tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2067627540", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:10.856794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-69f894b6-8a48-4183-a7bf-02dffde9cede tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:35:10.862689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-69852e9c-931a-49fe-aee8-61f27c3e841e tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:10.870849 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-69852e9c-931a-49fe-aee8-61f27c3e841e tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1338 microversion: 2.1 time: 0.261928 May 28 04:35:10.872005 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 95/225] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:10 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1338 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:10.876945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-778b1dd3-12d2-49b6-8371-f667622bffbd tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:10.877631 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-778b1dd3-12d2-49b6-8371-f667622bffbd tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:10.886827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-778b1dd3-12d2-49b6-8371-f667622bffbd tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:10.887472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-778b1dd3-12d2-49b6-8371-f667622bffbd tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:10.888362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-778b1dd3-12d2-49b6-8371-f667622bffbd tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:10.889008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-778b1dd3-12d2-49b6-8371-f667622bffbd tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:11.162129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-778b1dd3-12d2-49b6-8371-f667622bffbd tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:11.171773 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-778b1dd3-12d2-49b6-8371-f667622bffbd tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1333 microversion: 2.1 time: 0.298636 May 28 04:35:11.173070 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 96/226] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:10 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1333 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:11.177603 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1938b4c6-75be-42da-b0b7-7f85c55e761f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:11.178205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1938b4c6-75be-42da-b0b7-7f85c55e761f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:11.196454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1938b4c6-75be-42da-b0b7-7f85c55e761f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:11.197392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1938b4c6-75be-42da-b0b7-7f85c55e761f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:11.197670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1938b4c6-75be-42da-b0b7-7f85c55e761f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:11.198103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1938b4c6-75be-42da-b0b7-7f85c55e761f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:11.208935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-69f894b6-8a48-4183-a7bf-02dffde9cede tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:35:11.209590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-69f894b6-8a48-4183-a7bf-02dffde9cede tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:35:11.210215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-69f894b6-8a48-4183-a7bf-02dffde9cede tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:35:11.210773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-69f894b6-8a48-4183-a7bf-02dffde9cede tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:35:11.211784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-69f894b6-8a48-4183-a7bf-02dffde9cede tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:35:11.224995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-69f894b6-8a48-4183-a7bf-02dffde9cede tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:11.225774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-69f894b6-8a48-4183-a7bf-02dffde9cede tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:11.227396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-69f894b6-8a48-4183-a7bf-02dffde9cede tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:11.228048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-69f894b6-8a48-4183-a7bf-02dffde9cede tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:11.251225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-69f894b6-8a48-4183-a7bf-02dffde9cede tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Getting quotas for project 30dc7de2bf82417f8d26ad8ce4a50b17. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:35:11.256298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-69f894b6-8a48-4183-a7bf-02dffde9cede tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Getting quotas for user 31ab597e5a574f01910a9e0fe680fdb1 and project 30dc7de2bf82417f8d26ad8ce4a50b17. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:35:11.269403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-69f894b6-8a48-4183-a7bf-02dffde9cede tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:35:11.272058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-69f894b6-8a48-4183-a7bf-02dffde9cede tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:35:11.368876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1938b4c6-75be-42da-b0b7-7f85c55e761f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:11.376562 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1938b4c6-75be-42da-b0b7-7f85c55e761f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1312 microversion: 2.1 time: 0.202530 May 28 04:35:11.379660 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 97/227] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:11 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1312 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:11.382502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-29d0bbbf-1539-4d76-b84f-ceee8e648528 req-3bb4ec08-771e-4a7b-8f68-5350688bc941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2af79f0-ae7c-40fd-8034-3a957e218bbd", "name": "network-vif-plugged", "status": "completed", "tag": "e0a73643-7263-4551-8d5a-5ef51b6fe3b3"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:11.390381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-29d0bbbf-1539-4d76-b84f-ceee8e648528 req-3bb4ec08-771e-4a7b-8f68-5350688bc941 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:11.390827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-29d0bbbf-1539-4d76-b84f-ceee8e648528 req-3bb4ec08-771e-4a7b-8f68-5350688bc941 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:11.401890 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-29d0bbbf-1539-4d76-b84f-ceee8e648528 req-3bb4ec08-771e-4a7b-8f68-5350688bc941 service nova] Creating event network-vif-plugged:e0a73643-7263-4551-8d5a-5ef51b6fe3b3 for instance c2af79f0-ae7c-40fd-8034-3a957e218bbd on n-h2-843700-1 May 28 04:35:11.406936 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-29d0bbbf-1539-4d76-b84f-ceee8e648528 req-3bb4ec08-771e-4a7b-8f68-5350688bc941 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028697 May 28 04:35:11.408084 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 98/228] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:11.411067 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-69f894b6-8a48-4183-a7bf-02dffde9cede tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631891 May 28 04:35:11.411720 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 131/229] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:35:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:35:11.431454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-631309f7-e110-4c2e-b324-166337dee84d tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:11.432155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-631309f7-e110-4c2e-b324-166337dee84d tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:11.527172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-631309f7-e110-4c2e-b324-166337dee84d tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:11.534294 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-631309f7-e110-4c2e-b324-166337dee84d tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 1218 microversion: 2.1 time: 0.113970 May 28 04:35:11.537607 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 99/230] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:11 2022] GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:11.773881 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c4f3ef41-49ed-4c0a-97a3-1a852d87b312 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Calling method '.version_select at 0x7f770261f9d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:11.775350 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:11.775350 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:11.776520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4f3ef41-49ed-4c0a-97a3-1a852d87b312 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:11.776974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4f3ef41-49ed-4c0a-97a3-1a852d87b312 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:11.796649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4f3ef41-49ed-4c0a-97a3-1a852d87b312 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:11.796804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-69f3845b-a68a-49da-a648-96804eb36191 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:11.800229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4f3ef41-49ed-4c0a-97a3-1a852d87b312 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:11.800367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-69f3845b-a68a-49da-a648-96804eb36191 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:11.804374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-69f3845b-a68a-49da-a648-96804eb36191 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:11.804826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-69f3845b-a68a-49da-a648-96804eb36191 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:11.805819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-69f3845b-a68a-49da-a648-96804eb36191 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:11.806433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-69f3845b-a68a-49da-a648-96804eb36191 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:11.814772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4f3ef41-49ed-4c0a-97a3-1a852d87b312 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:11.815321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4f3ef41-49ed-4c0a-97a3-1a852d87b312 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:11.824081 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c4f3ef41-49ed-4c0a-97a3-1a852d87b312 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.316707 May 28 04:35:11.825890 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 132/231] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:35:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:11.837355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cf515f21-8d2f-4847-bc66-d0dcd380fb14 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Calling method '.version_select at 0x7f770229d310>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:11.839395 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:11.839395 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:11.841352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf515f21-8d2f-4847-bc66-d0dcd380fb14 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:11.842086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf515f21-8d2f-4847-bc66-d0dcd380fb14 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:11.862121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf515f21-8d2f-4847-bc66-d0dcd380fb14 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:11.862808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf515f21-8d2f-4847-bc66-d0dcd380fb14 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:11.901338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf515f21-8d2f-4847-bc66-d0dcd380fb14 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:11.901635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf515f21-8d2f-4847-bc66-d0dcd380fb14 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:11.908365 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cf515f21-8d2f-4847-bc66-d0dcd380fb14 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/n-h1-843700-1/servers" status: 200 len: 275 microversion: 2.1 time: 0.076639 May 28 04:35:11.915018 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 133/232] 10.222.0.58 () {58 vars in 1211 bytes} [Sat May 28 04:35:11 2022] GET /compute/v2.1/os-hypervisors/n-h1-843700-1/servers => generated 275 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:11.915761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b0c6e6e4-e419-4abb-88b0-f39ba6e6e33c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:11.916375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b0c6e6e4-e419-4abb-88b0-f39ba6e6e33c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:11.924462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0c6e6e4-e419-4abb-88b0-f39ba6e6e33c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:11.924913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0c6e6e4-e419-4abb-88b0-f39ba6e6e33c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:11.925771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0c6e6e4-e419-4abb-88b0-f39ba6e6e33c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:11.926247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0c6e6e4-e419-4abb-88b0-f39ba6e6e33c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:11.967394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-69f3845b-a68a-49da-a648-96804eb36191 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:11.976945 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-69f3845b-a68a-49da-a648-96804eb36191 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1319 microversion: 2.1 time: 0.184641 May 28 04:35:11.986819 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 100/233] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:11 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:11.993132 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0cf2ce92-941a-4e59-81dd-88f58dc21771 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Calling method '.version_select at 0x7f770256d670>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:11.994489 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:11.994489 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:11.996060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0cf2ce92-941a-4e59-81dd-88f58dc21771 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:11.996609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0cf2ce92-941a-4e59-81dd-88f58dc21771 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:12.058301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0cf2ce92-941a-4e59-81dd-88f58dc21771 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:12.058827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0cf2ce92-941a-4e59-81dd-88f58dc21771 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:12.087860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0cf2ce92-941a-4e59-81dd-88f58dc21771 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:12.089300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0cf2ce92-941a-4e59-81dd-88f58dc21771 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:12.102924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b0c6e6e4-e419-4abb-88b0-f39ba6e6e33c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:12.104046 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0cf2ce92-941a-4e59-81dd-88f58dc21771 tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.120760 May 28 04:35:12.104700 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 101/234] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:35:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:12.114356 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b0c6e6e4-e419-4abb-88b0-f39ba6e6e33c tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1338 microversion: 2.1 time: 0.200991 May 28 04:35:12.118299 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 134/235] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:11 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1338 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:12.128056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-43acc1e1-a930-4f9e-a86e-5efc20c86d8f tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Calling method '.version_select at 0x7f770256da60>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:12.129848 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:12.129848 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:12.131094 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43acc1e1-a930-4f9e-a86e-5efc20c86d8f tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:12.131767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43acc1e1-a930-4f9e-a86e-5efc20c86d8f tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:12.154620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43acc1e1-a930-4f9e-a86e-5efc20c86d8f tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:12.154620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43acc1e1-a930-4f9e-a86e-5efc20c86d8f tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:12.159941 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-43acc1e1-a930-4f9e-a86e-5efc20c86d8f tempest-HypervisorAdminUnderV252Test-1963191499 tempest-HypervisorAdminUnderV252Test-1963191499-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/n-h1-843700-1/search" status: 200 len: 104 microversion: 2.1 time: 0.046631 May 28 04:35:12.160649 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 102/236] 10.222.0.58 () {58 vars in 1208 bytes} [Sat May 28 04:35:12 2022] GET /compute/v2.1/os-hypervisors/n-h1-843700-1/search => generated 104 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:35:12.189877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e3bd713a-c862-4cef-8da9-487676fe302b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:12.190516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e3bd713a-c862-4cef-8da9-487676fe302b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:12.197434 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3bd713a-c862-4cef-8da9-487676fe302b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:12.197886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3bd713a-c862-4cef-8da9-487676fe302b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:12.198656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3bd713a-c862-4cef-8da9-487676fe302b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:12.199131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3bd713a-c862-4cef-8da9-487676fe302b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:12.377735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e3bd713a-c862-4cef-8da9-487676fe302b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:12.397842 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e3bd713a-c862-4cef-8da9-487676fe302b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1333 microversion: 2.1 time: 0.201544 May 28 04:35:12.397842 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 135/237] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:12 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1333 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:12.397842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-21c11ba2-fd95-499e-9e03-b43c081c4d38 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:12.397842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-21c11ba2-fd95-499e-9e03-b43c081c4d38 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:12.401585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21c11ba2-fd95-499e-9e03-b43c081c4d38 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:12.402040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21c11ba2-fd95-499e-9e03-b43c081c4d38 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:12.402807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21c11ba2-fd95-499e-9e03-b43c081c4d38 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:12.403274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21c11ba2-fd95-499e-9e03-b43c081c4d38 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:12.459755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e09dabf2-19f5-4adc-9e7f-bda4be6cccf7 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Calling method '.version_select at 0x7f770255b820>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:12.460977 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:12.460977 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:12.463584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e09dabf2-19f5-4adc-9e7f-bda4be6cccf7 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:12.464043 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e09dabf2-19f5-4adc-9e7f-bda4be6cccf7 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:12.464864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e09dabf2-19f5-4adc-9e7f-bda4be6cccf7 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:12.465290 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e09dabf2-19f5-4adc-9e7f-bda4be6cccf7 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:12.486677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:DELETE=6,nova_api:SELECT=89,nova_api:INSERT=5 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:12.495403 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e09dabf2-19f5-4adc-9e7f-bda4be6cccf7 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.182074 May 28 04:35:12.495993 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 103/238] 10.222.0.58 () {58 vars in 1127 bytes} [Sat May 28 04:35:12 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:12.507026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a799b22c-1701-4018-94f2-137189efab30 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Calling method '.version_select at 0x7f7702530550>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:12.508261 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:12.508261 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:12.509421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a799b22c-1701-4018-94f2-137189efab30 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:12.509874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a799b22c-1701-4018-94f2-137189efab30 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:12.514951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a799b22c-1701-4018-94f2-137189efab30 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:12.514951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a799b22c-1701-4018-94f2-137189efab30 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:12.539278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-21c11ba2-fd95-499e-9e03-b43c081c4d38 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:12.548251 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a799b22c-1701-4018-94f2-137189efab30 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.044061 May 28 04:35:12.548251 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 104/239] 10.222.0.58 () {58 vars in 1138 bytes} [Sat May 28 04:35:12 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:35:12.548489 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-21c11ba2-fd95-499e-9e03-b43c081c4d38 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1312 microversion: 2.1 time: 0.158180 May 28 04:35:12.552165 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 136/240] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:12 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:12.562237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1bbf5004-d394-401f-a140-1091cf487d73 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Calling method '.version_select at 0x7f7702233f70>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:12.562791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a09cd644-05fa-4853-8e5b-71e13294fb3f tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:12.563512 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:12.563512 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:12.563701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a09cd644-05fa-4853-8e5b-71e13294fb3f tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:12.565095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1bbf5004-d394-401f-a140-1091cf487d73 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:12.565901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1bbf5004-d394-401f-a140-1091cf487d73 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:12.567488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1bbf5004-d394-401f-a140-1091cf487d73 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:12.572179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1bbf5004-d394-401f-a140-1091cf487d73 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:12.600363 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1bbf5004-d394-401f-a140-1091cf487d73 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.041786 May 28 04:35:12.602249 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 137/241] 10.222.0.58 () {58 vars in 1144 bytes} [Sat May 28 04:35:12 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:35:12.646246 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a09cd644-05fa-4853-8e5b-71e13294fb3f tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:12.654066 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a09cd644-05fa-4853-8e5b-71e13294fb3f tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 1218 microversion: 2.1 time: 0.095534 May 28 04:35:12.654773 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 105/242] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:12 2022] GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:12.994278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e5d174ea-9fa1-4835-b86d-513ec6eee3fc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:12.995086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e5d174ea-9fa1-4835-b86d-513ec6eee3fc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:13.001072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5d174ea-9fa1-4835-b86d-513ec6eee3fc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:13.001522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5d174ea-9fa1-4835-b86d-513ec6eee3fc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:13.002290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5d174ea-9fa1-4835-b86d-513ec6eee3fc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:13.002924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5d174ea-9fa1-4835-b86d-513ec6eee3fc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:13.135967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e5d174ea-9fa1-4835-b86d-513ec6eee3fc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:13.144158 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e5d174ea-9fa1-4835-b86d-513ec6eee3fc tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1468 microversion: 2.1 time: 0.153777 May 28 04:35:13.144420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-264bca74-834e-4315-94fa-279364ee36b8 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:13.145011 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 138/243] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:12 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1468 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:13.145190 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-264bca74-834e-4315-94fa-279364ee36b8 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:13.152701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-264bca74-834e-4315-94fa-279364ee36b8 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:13.153364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-264bca74-834e-4315-94fa-279364ee36b8 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:13.154130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-264bca74-834e-4315-94fa-279364ee36b8 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:13.154557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-264bca74-834e-4315-94fa-279364ee36b8 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:13.332333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-264bca74-834e-4315-94fa-279364ee36b8 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:13.342968 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-264bca74-834e-4315-94fa-279364ee36b8 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1338 microversion: 2.1 time: 0.212844 May 28 04:35:13.343712 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 106/244] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:13 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1338 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:13.372823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a0a2af33-ed71-43b4-b3cb-1e21c5b2b52d tempest-DeleteServersAdminTestJSON-445448485 tempest-DeleteServersAdminTestJSON-445448485-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:13.373662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a0a2af33-ed71-43b4-b3cb-1e21c5b2b52d tempest-DeleteServersAdminTestJSON-445448485 tempest-DeleteServersAdminTestJSON-445448485-project-admin] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:13.380635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0a2af33-ed71-43b4-b3cb-1e21c5b2b52d tempest-DeleteServersAdminTestJSON-445448485 tempest-DeleteServersAdminTestJSON-445448485-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:13.381298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0a2af33-ed71-43b4-b3cb-1e21c5b2b52d tempest-DeleteServersAdminTestJSON-445448485 tempest-DeleteServersAdminTestJSON-445448485-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:13.382102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0a2af33-ed71-43b4-b3cb-1e21c5b2b52d tempest-DeleteServersAdminTestJSON-445448485 tempest-DeleteServersAdminTestJSON-445448485-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:13.382544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0a2af33-ed71-43b4-b3cb-1e21c5b2b52d tempest-DeleteServersAdminTestJSON-445448485 tempest-DeleteServersAdminTestJSON-445448485-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:13.405209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-faeed294-c5db-439e-9fb3-40ac954860e2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:13.406153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-faeed294-c5db-439e-9fb3-40ac954860e2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:13.416603 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-faeed294-c5db-439e-9fb3-40ac954860e2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:13.417159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-faeed294-c5db-439e-9fb3-40ac954860e2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:13.418278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-faeed294-c5db-439e-9fb3-40ac954860e2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:13.419434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-faeed294-c5db-439e-9fb3-40ac954860e2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:13.453721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a0a2af33-ed71-43b4-b3cb-1e21c5b2b52d tempest-DeleteServersAdminTestJSON-445448485 tempest-DeleteServersAdminTestJSON-445448485-project-admin] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:35:13.499628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:13.586459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-faeed294-c5db-439e-9fb3-40ac954860e2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:13.595286 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-faeed294-c5db-439e-9fb3-40ac954860e2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1333 microversion: 2.1 time: 0.194396 May 28 04:35:13.595805 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 107/245] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:13 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1333 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:13.601134 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-c9632591-b325-4f15-aa86-5742a2569461 req-2ef093c2-b7c4-4d69-8ecb-19c264d23fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c431c1-9eaa-4508-94b0-05614a36f135", "name": "network-vif-plugged", "status": "completed", "tag": "2bdce7c2-a103-419f-abec-055ab2ac98b2"}, {"server_uuid": "158412f0-30ee-458c-9da2-83be853d2ea4", "name": "network-vif-plugged", "status": "completed", "tag": "3234e2dc-f459-4590-9dd3-6cfbc11536ed"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:13.610164 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c9632591-b325-4f15-aa86-5742a2569461 req-2ef093c2-b7c4-4d69-8ecb-19c264d23fdc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:13.610816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c9632591-b325-4f15-aa86-5742a2569461 req-2ef093c2-b7c4-4d69-8ecb-19c264d23fdc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:13.625633 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-c9632591-b325-4f15-aa86-5742a2569461 req-2ef093c2-b7c4-4d69-8ecb-19c264d23fdc service nova] Creating event network-vif-plugged:2bdce7c2-a103-419f-abec-055ab2ac98b2 for instance 38c431c1-9eaa-4508-94b0-05614a36f135 on n-h1-843700-1 May 28 04:35:13.631781 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-c9632591-b325-4f15-aa86-5742a2569461 req-2ef093c2-b7c4-4d69-8ecb-19c264d23fdc service nova] Creating event network-vif-plugged:3234e2dc-f459-4590-9dd3-6cfbc11536ed for instance 158412f0-30ee-458c-9da2-83be853d2ea4 on n-h1-843700-1 May 28 04:35:13.634916 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-c9632591-b325-4f15-aa86-5742a2569461 req-2ef093c2-b7c4-4d69-8ecb-19c264d23fdc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037662 May 28 04:35:13.635563 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 108/246] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:13.640692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3e3726d0-8347-43af-bc37-df9c85ceb537 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:13.641392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3e3726d0-8347-43af-bc37-df9c85ceb537 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:13.648229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e3726d0-8347-43af-bc37-df9c85ceb537 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:13.648993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e3726d0-8347-43af-bc37-df9c85ceb537 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:13.649974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e3726d0-8347-43af-bc37-df9c85ceb537 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:13.650596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e3726d0-8347-43af-bc37-df9c85ceb537 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:13.783307 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3e3726d0-8347-43af-bc37-df9c85ceb537 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:13.791718 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3e3726d0-8347-43af-bc37-df9c85ceb537 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1462 microversion: 2.1 time: 0.154916 May 28 04:35:13.792612 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 109/247] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:13 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1462 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:13.797662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f3647b95-5c93-40c2-a34e-9b6d43348810 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:13.798468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f3647b95-5c93-40c2-a34e-9b6d43348810 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:13.804553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3647b95-5c93-40c2-a34e-9b6d43348810 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:13.805033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3647b95-5c93-40c2-a34e-9b6d43348810 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:13.805805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3647b95-5c93-40c2-a34e-9b6d43348810 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:13.806457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3647b95-5c93-40c2-a34e-9b6d43348810 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:13.876703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f3647b95-5c93-40c2-a34e-9b6d43348810 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:13.885610 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f3647b95-5c93-40c2-a34e-9b6d43348810 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 1214 microversion: 2.1 time: 0.091927 May 28 04:35:13.886200 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 110/248] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:13 2022] GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:13.942532 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a0a2af33-ed71-43b4-b3cb-1e21c5b2b52d tempest-DeleteServersAdminTestJSON-445448485 tempest-DeleteServersAdminTestJSON-445448485-project-admin] 10.222.0.58 "DELETE /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 204 len: 0 microversion: 2.1 time: 0.784208 May 28 04:35:13.944044 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 139/249] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:35:13 2022] DELETE /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 04:35:13.955613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b0481d45-9fb4-42bf-8c6e-20df54f5db3c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:13.956327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b0481d45-9fb4-42bf-8c6e-20df54f5db3c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:13.966103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0481d45-9fb4-42bf-8c6e-20df54f5db3c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:13.966624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0481d45-9fb4-42bf-8c6e-20df54f5db3c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:13.967557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0481d45-9fb4-42bf-8c6e-20df54f5db3c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:13.968836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0481d45-9fb4-42bf-8c6e-20df54f5db3c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:14.080819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5023e51f-02fe-4cc0-a8ad-5438229a0295 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:14.081695 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5023e51f-02fe-4cc0-a8ad-5438229a0295 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:14.090678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5023e51f-02fe-4cc0-a8ad-5438229a0295 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:14.091174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5023e51f-02fe-4cc0-a8ad-5438229a0295 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:14.091961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5023e51f-02fe-4cc0-a8ad-5438229a0295 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:14.092405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5023e51f-02fe-4cc0-a8ad-5438229a0295 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:14.130695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b0481d45-9fb4-42bf-8c6e-20df54f5db3c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:14.139114 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b0481d45-9fb4-42bf-8c6e-20df54f5db3c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1474 microversion: 2.1 time: 0.188726 May 28 04:35:14.139997 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 140/250] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:13 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1474 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:14.360789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7d0b6693-d981-4070-82df-bff1eb764426 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:14.361320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7d0b6693-d981-4070-82df-bff1eb764426 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:14.367965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d0b6693-d981-4070-82df-bff1eb764426 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:14.368413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d0b6693-d981-4070-82df-bff1eb764426 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:14.369171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d0b6693-d981-4070-82df-bff1eb764426 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:14.369599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d0b6693-d981-4070-82df-bff1eb764426 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:14.483212 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5023e51f-02fe-4cc0-a8ad-5438229a0295 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1613 microversion: 2.1 time: 0.595937 May 28 04:35:14.483809 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 111/251] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:13 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1613 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:14.500026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fa435507-7174-43ac-8143-7560d3280e6c tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:14.500321 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fa435507-7174-43ac-8143-7560d3280e6c tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:14.507300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa435507-7174-43ac-8143-7560d3280e6c tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:14.507926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa435507-7174-43ac-8143-7560d3280e6c tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:14.508816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa435507-7174-43ac-8143-7560d3280e6c tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:14.509243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa435507-7174-43ac-8143-7560d3280e6c tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:14.546380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:14.555113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7d0b6693-d981-4070-82df-bff1eb764426 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:14.562601 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7d0b6693-d981-4070-82df-bff1eb764426 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1338 microversion: 2.1 time: 0.205802 May 28 04:35:14.563218 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 141/252] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:14 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1338 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:14.599325 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fa435507-7174-43ac-8143-7560d3280e6c tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dd2f32c3deaa43c38bd7f296c35b09ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b724702716164d928271e58ac2b375ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:14.599932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fa435507-7174-43ac-8143-7560d3280e6c tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] flavor_id is None. Assuming migration. {{(pid=126043) resize /opt/stack/nova/nova/compute/api.py:4142}} May 28 04:35:14.600373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fa435507-7174-43ac-8143-7560d3280e6c tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126043) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 04:35:14.615717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7e9366f3-69db-479a-a80c-8dc95d6b144b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:14.616641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7e9366f3-69db-479a-a80c-8dc95d6b144b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:14.623710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e9366f3-69db-479a-a80c-8dc95d6b144b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:14.624791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e9366f3-69db-479a-a80c-8dc95d6b144b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:14.625940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e9366f3-69db-479a-a80c-8dc95d6b144b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:14.626676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e9366f3-69db-479a-a80c-8dc95d6b144b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:14.772244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7e9366f3-69db-479a-a80c-8dc95d6b144b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:14.779875 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7e9366f3-69db-479a-a80c-8dc95d6b144b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1333 microversion: 2.1 time: 0.170650 May 28 04:35:14.780495 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 142/253] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:14 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1333 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:14.903863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6c165a9e-69ef-4d32-afc9-8c0203042792 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:14.905915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6c165a9e-69ef-4d32-afc9-8c0203042792 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:14.912864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c165a9e-69ef-4d32-afc9-8c0203042792 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:14.912864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c165a9e-69ef-4d32-afc9-8c0203042792 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:14.913495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c165a9e-69ef-4d32-afc9-8c0203042792 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:14.913930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c165a9e-69ef-4d32-afc9-8c0203042792 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:14.978935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6c165a9e-69ef-4d32-afc9-8c0203042792 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:14.986813 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6c165a9e-69ef-4d32-afc9-8c0203042792 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 1270 microversion: 2.1 time: 0.087797 May 28 04:35:14.987415 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 143/254] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:14 2022] GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:15.158178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-15ef81cc-c291-4577-9a9c-39498108016d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:15.159189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-15ef81cc-c291-4577-9a9c-39498108016d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:15.165067 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fa435507-7174-43ac-8143-7560d3280e6c tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd/action" status: 202 len: 0 microversion: 2.1 time: 0.654916 May 28 04:35:15.165868 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 112/255] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:35:14 2022] POST /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd/action => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:35:15.177628 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-57e5814c-b5d2-44a6-985b-68f340beffde tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:15.177783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-15ef81cc-c291-4577-9a9c-39498108016d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:15.177783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-15ef81cc-c291-4577-9a9c-39498108016d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:15.179174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-15ef81cc-c291-4577-9a9c-39498108016d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:15.181812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-15ef81cc-c291-4577-9a9c-39498108016d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:15.188898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-57e5814c-b5d2-44a6-985b-68f340beffde tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:15.195938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-57e5814c-b5d2-44a6-985b-68f340beffde tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:15.196520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-57e5814c-b5d2-44a6-985b-68f340beffde tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:15.197394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-57e5814c-b5d2-44a6-985b-68f340beffde tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:15.198151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-57e5814c-b5d2-44a6-985b-68f340beffde tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:15.427097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-15ef81cc-c291-4577-9a9c-39498108016d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:15.435851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-57e5814c-b5d2-44a6-985b-68f340beffde tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:15.443961 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-15ef81cc-c291-4577-9a9c-39498108016d tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1474 microversion: 2.1 time: 0.290946 May 28 04:35:15.447270 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-57e5814c-b5d2-44a6-985b-68f340beffde tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1471 microversion: 2.1 time: 0.276757 May 28 04:35:15.449460 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 144/256] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:15 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1474 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:15.449656 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 113/257] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:15 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1471 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:15.580116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2b06c6ff-da1e-410a-91a7-1d46341cbe97 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:15.580948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2b06c6ff-da1e-410a-91a7-1d46341cbe97 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:15.588406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b06c6ff-da1e-410a-91a7-1d46341cbe97 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:15.589121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b06c6ff-da1e-410a-91a7-1d46341cbe97 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:15.590293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b06c6ff-da1e-410a-91a7-1d46341cbe97 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:15.591147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b06c6ff-da1e-410a-91a7-1d46341cbe97 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:15.796811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dd080c27-743e-47ff-8604-9b9b030e4a04 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:15.798333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dd080c27-743e-47ff-8604-9b9b030e4a04 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:15.806095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd080c27-743e-47ff-8604-9b9b030e4a04 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:15.807317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd080c27-743e-47ff-8604-9b9b030e4a04 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:15.808641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd080c27-743e-47ff-8604-9b9b030e4a04 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:15.809282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd080c27-743e-47ff-8604-9b9b030e4a04 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:15.874551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2b06c6ff-da1e-410a-91a7-1d46341cbe97 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:15.890687 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2b06c6ff-da1e-410a-91a7-1d46341cbe97 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1338 microversion: 2.1 time: 0.312954 May 28 04:35:15.896807 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 145/258] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:15 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1338 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:16.020633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-70efe664-a3b5-4a99-88dd-4ff98b3b2ef9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:16.022796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-70efe664-a3b5-4a99-88dd-4ff98b3b2ef9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:16.049958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70efe664-a3b5-4a99-88dd-4ff98b3b2ef9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:16.051517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70efe664-a3b5-4a99-88dd-4ff98b3b2ef9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:16.069930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70efe664-a3b5-4a99-88dd-4ff98b3b2ef9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:16.070577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70efe664-a3b5-4a99-88dd-4ff98b3b2ef9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:16.193608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-70efe664-a3b5-4a99-88dd-4ff98b3b2ef9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:16.208022 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-70efe664-a3b5-4a99-88dd-4ff98b3b2ef9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 1278 microversion: 2.1 time: 0.203471 May 28 04:35:16.208807 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 146/259] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:15 2022] GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 1278 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:16.331546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dd080c27-743e-47ff-8604-9b9b030e4a04 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:16.343674 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dd080c27-743e-47ff-8604-9b9b030e4a04 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1333 microversion: 2.1 time: 0.550549 May 28 04:35:16.353462 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 114/260] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:15 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1333 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:16.465107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d98ee120-1cff-4914-93e4-26cf7a03015c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:16.466141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d98ee120-1cff-4914-93e4-26cf7a03015c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:16.468248 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3e42b743-a628-4f25-9541-60a04b979938 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:16.469019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3e42b743-a628-4f25-9541-60a04b979938 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:16.479192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e42b743-a628-4f25-9541-60a04b979938 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:16.480200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d98ee120-1cff-4914-93e4-26cf7a03015c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:16.480354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e42b743-a628-4f25-9541-60a04b979938 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:16.480678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d98ee120-1cff-4914-93e4-26cf7a03015c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:16.481959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e42b743-a628-4f25-9541-60a04b979938 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:16.482807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d98ee120-1cff-4914-93e4-26cf7a03015c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:16.483980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e42b743-a628-4f25-9541-60a04b979938 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:16.485099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d98ee120-1cff-4914-93e4-26cf7a03015c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:16.822564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3e42b743-a628-4f25-9541-60a04b979938 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:16.834093 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3e42b743-a628-4f25-9541-60a04b979938 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1471 microversion: 2.1 time: 0.367788 May 28 04:35:16.834715 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 115/261] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:16 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1471 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:16.840821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d98ee120-1cff-4914-93e4-26cf7a03015c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:16.850323 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d98ee120-1cff-4914-93e4-26cf7a03015c tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1474 microversion: 2.1 time: 0.392942 May 28 04:35:16.852047 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 147/262] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:16 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1474 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:16.910391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-abcc8681-3ac7-487d-a039-3d1840ad7936 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:16.911350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-abcc8681-3ac7-487d-a039-3d1840ad7936 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:16.919591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abcc8681-3ac7-487d-a039-3d1840ad7936 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:16.920491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abcc8681-3ac7-487d-a039-3d1840ad7936 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:16.922070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abcc8681-3ac7-487d-a039-3d1840ad7936 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:16.922769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abcc8681-3ac7-487d-a039-3d1840ad7936 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:17.220347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2c9da421-7e7b-4730-a588-358ed9a7b336 tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Calling method '.version_select at 0x7f7702409670>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:17.221921 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:17.221921 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:17.223779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c9da421-7e7b-4730-a588-358ed9a7b336 tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:17.224421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c9da421-7e7b-4730-a588-358ed9a7b336 tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:17.236703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-abcc8681-3ac7-487d-a039-3d1840ad7936 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:17.244435 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-abcc8681-3ac7-487d-a039-3d1840ad7936 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1488 microversion: 2.1 time: 0.341331 May 28 04:35:17.261089 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 116/263] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:16 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1488 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:17.263095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c9da421-7e7b-4730-a588-358ed9a7b336 tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:17.263560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c9da421-7e7b-4730-a588-358ed9a7b336 tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:17.276408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-916e6463-77c9-4b69-a8bf-01f8c617df49 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:17.277775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-916e6463-77c9-4b69-a8bf-01f8c617df49 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:17.289342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-916e6463-77c9-4b69-a8bf-01f8c617df49 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:17.292108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-916e6463-77c9-4b69-a8bf-01f8c617df49 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:17.292108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-916e6463-77c9-4b69-a8bf-01f8c617df49 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:17.292108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-916e6463-77c9-4b69-a8bf-01f8c617df49 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:17.297101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c9da421-7e7b-4730-a588-358ed9a7b336 tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:17.297775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c9da421-7e7b-4730-a588-358ed9a7b336 tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:17.311374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c9da421-7e7b-4730-a588-358ed9a7b336 tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:17.312498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c9da421-7e7b-4730-a588-358ed9a7b336 tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:17.343822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c9da421-7e7b-4730-a588-358ed9a7b336 tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:17.349591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c9da421-7e7b-4730-a588-358ed9a7b336 tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:17.368997 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2c9da421-7e7b-4730-a588-358ed9a7b336 tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2073 microversion: 2.53 time: 0.325638 May 28 04:35:17.370158 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 148/264] 10.222.0.58 () {60 vars in 1242 bytes} [Sat May 28 04:35:17 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2073 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:35:17.375069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-b4a9c511-ab2c-4595-9675-2edb4ff89bc1 req-c671eec0-8e48-4484-8ee3-8d80803096a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a0535f1-775e-459f-86e6-1ae27b94fbb9", "name": "network-vif-deleted", "tag": "38854251-1bce-468f-8935-acb2745b2259"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:17.385303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-916e6463-77c9-4b69-a8bf-01f8c617df49 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:17.391957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b4a9c511-ab2c-4595-9675-2edb4ff89bc1 req-c671eec0-8e48-4484-8ee3-8d80803096a4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:17.392648 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b4a9c511-ab2c-4595-9675-2edb4ff89bc1 req-c671eec0-8e48-4484-8ee3-8d80803096a4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:17.396921 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-916e6463-77c9-4b69-a8bf-01f8c617df49 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 1276 microversion: 2.1 time: 0.131749 May 28 04:35:17.397768 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 117/265] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:17 2022] GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 1276 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:17.403407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8028bb81-a910-4de8-96b7-0ed80d6bb465 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:17.404326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8028bb81-a910-4de8-96b7-0ed80d6bb465 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:17.413283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8028bb81-a910-4de8-96b7-0ed80d6bb465 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:17.414093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8028bb81-a910-4de8-96b7-0ed80d6bb465 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:17.415419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8028bb81-a910-4de8-96b7-0ed80d6bb465 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:17.416204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8028bb81-a910-4de8-96b7-0ed80d6bb465 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:17.424143 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-b4a9c511-ab2c-4595-9675-2edb4ff89bc1 req-c671eec0-8e48-4484-8ee3-8d80803096a4 service nova] Creating event network-vif-deleted:38854251-1bce-468f-8935-acb2745b2259 for instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 on n-h2-843700-1 May 28 04:35:17.437282 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-b4a9c511-ab2c-4595-9675-2edb4ff89bc1 req-c671eec0-8e48-4484-8ee3-8d80803096a4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065678 May 28 04:35:17.438730 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 149/266] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:17.463417 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6c27504c-7e2a-4713-917e-01c344dadaf8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:17.464628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6c27504c-7e2a-4713-917e-01c344dadaf8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:17.475792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c27504c-7e2a-4713-917e-01c344dadaf8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:17.476858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c27504c-7e2a-4713-917e-01c344dadaf8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:17.478080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c27504c-7e2a-4713-917e-01c344dadaf8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:17.478795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c27504c-7e2a-4713-917e-01c344dadaf8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:17.775601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6c27504c-7e2a-4713-917e-01c344dadaf8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:17.785800 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6c27504c-7e2a-4713-917e-01c344dadaf8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1517 microversion: 2.1 time: 0.327354 May 28 04:35:17.786576 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 150/267] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:17 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1517 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:17.802239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5d12aec6-d70e-4e3b-947a-2d0f0b3a4f0c tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Calling method '.version_select at 0x7f77021aa280>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:17.803877 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:17.803877 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:17.804966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d12aec6-d70e-4e3b-947a-2d0f0b3a4f0c tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:17.805420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d12aec6-d70e-4e3b-947a-2d0f0b3a4f0c tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:17.821485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d12aec6-d70e-4e3b-947a-2d0f0b3a4f0c tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:17.821935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d12aec6-d70e-4e3b-947a-2d0f0b3a4f0c tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:17.851970 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d12aec6-d70e-4e3b-947a-2d0f0b3a4f0c tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:17.852425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d12aec6-d70e-4e3b-947a-2d0f0b3a4f0c tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:17.866590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d12aec6-d70e-4e3b-947a-2d0f0b3a4f0c tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:17.867197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d12aec6-d70e-4e3b-947a-2d0f0b3a4f0c tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:17.904948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d12aec6-d70e-4e3b-947a-2d0f0b3a4f0c tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:17.905409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d12aec6-d70e-4e3b-947a-2d0f0b3a4f0c tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:17.918060 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5d12aec6-d70e-4e3b-947a-2d0f0b3a4f0c tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 765 microversion: 2.53 time: 0.129061 May 28 04:35:17.918675 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 151/268] 10.222.0.58 () {60 vars in 1221 bytes} [Sat May 28 04:35:17 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 765 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:35:18.065893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ec000631-e6cd-4006-8cc8-cf73e13d06bc tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:18.067310 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ec000631-e6cd-4006-8cc8-cf73e13d06bc tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:18.073983 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec000631-e6cd-4006-8cc8-cf73e13d06bc tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:18.074528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec000631-e6cd-4006-8cc8-cf73e13d06bc tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:18.075438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec000631-e6cd-4006-8cc8-cf73e13d06bc tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:18.076110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec000631-e6cd-4006-8cc8-cf73e13d06bc tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:18.299768 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8028bb81-a910-4de8-96b7-0ed80d6bb465 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1639 microversion: 2.1 time: 0.896483 May 28 04:35:18.299768 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 118/269] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:17 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1639 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:18.313143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-573afba9-5f8f-4fc2-b2e6-a62585d5db29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:18.313792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-573afba9-5f8f-4fc2-b2e6-a62585d5db29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:18.320978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-573afba9-5f8f-4fc2-b2e6-a62585d5db29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:18.321666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-573afba9-5f8f-4fc2-b2e6-a62585d5db29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:18.323112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-573afba9-5f8f-4fc2-b2e6-a62585d5db29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:18.323319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-573afba9-5f8f-4fc2-b2e6-a62585d5db29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:18.340055 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ec000631-e6cd-4006-8cc8-cf73e13d06bc tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1668 microversion: 2.1 time: 0.420296 May 28 04:35:18.340891 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 152/270] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:17 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1668 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:18.356352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a4846a9d-1cd6-4c9c-8da9-c098108e2368 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:18.356352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a4846a9d-1cd6-4c9c-8da9-c098108e2368 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:18.356352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4846a9d-1cd6-4c9c-8da9-c098108e2368 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:18.356352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4846a9d-1cd6-4c9c-8da9-c098108e2368 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:18.356965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4846a9d-1cd6-4c9c-8da9-c098108e2368 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:18.356965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4846a9d-1cd6-4c9c-8da9-c098108e2368 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:18.359894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:18.390118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4846a9d-1cd6-4c9c-8da9-c098108e2368 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:18.390583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4846a9d-1cd6-4c9c-8da9-c098108e2368 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:18.391089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-a4846a9d-1cd6-4c9c-8da9-c098108e2368 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lazy-loading 'fault' on Instance uuid 9a0535f1-775e-459f-86e6-1ae27b94fbb9 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:35:18.452435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a4846a9d-1cd6-4c9c-8da9-c098108e2368 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:18.460646 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a4846a9d-1cd6-4c9c-8da9-c098108e2368 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 200 len: 1309 microversion: 2.1 time: 0.118547 May 28 04:35:18.461465 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 153/271] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:18 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 1309 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:18.477435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e83332fd-3e80-4d74-81e2-629cfd89b793 tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Calling method '.version_select at 0x7f7702394790>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:18.478882 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:18.478882 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:18.480549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e83332fd-3e80-4d74-81e2-629cfd89b793 tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:18.481153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e83332fd-3e80-4d74-81e2-629cfd89b793 tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:18.500799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e83332fd-3e80-4d74-81e2-629cfd89b793 tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:18.501505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e83332fd-3e80-4d74-81e2-629cfd89b793 tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:18.512212 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e83332fd-3e80-4d74-81e2-629cfd89b793 tempest-HypervisorAdminV253TestBase-1572957751 tempest-HypervisorAdminV253TestBase-1572957751-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/353a89e7-50ac-41d0-9be7-7390aebde3df" status: 200 len: 792 microversion: 2.53 time: 0.038414 May 28 04:35:18.513850 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 154/272] 10.222.0.58 () {60 vars in 1297 bytes} [Sat May 28 04:35:18 2022] GET /compute/v2.1/os-hypervisors/353a89e7-50ac-41d0-9be7-7390aebde3df => generated 792 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:35:18.520350 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-11008d0f-3452-4f02-a601-3374b6aa8dda tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:18.521120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-11008d0f-3452-4f02-a601-3374b6aa8dda tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:18.525688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:18.530169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11008d0f-3452-4f02-a601-3374b6aa8dda tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:18.530601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11008d0f-3452-4f02-a601-3374b6aa8dda tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:18.531610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11008d0f-3452-4f02-a601-3374b6aa8dda tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:18.532200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11008d0f-3452-4f02-a601-3374b6aa8dda tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:18.574187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-11008d0f-3452-4f02-a601-3374b6aa8dda tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:35:18.779868 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-573afba9-5f8f-4fc2-b2e6-a62585d5db29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:18.788378 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-573afba9-5f8f-4fc2-b2e6-a62585d5db29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1471 microversion: 2.1 time: 0.480115 May 28 04:35:18.788888 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 119/273] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:18 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1471 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:18.793785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5394f855-eccb-4933-b505-55450887cf96 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:18.794496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5394f855-eccb-4933-b505-55450887cf96 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:18.801175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5394f855-eccb-4933-b505-55450887cf96 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:18.801577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5394f855-eccb-4933-b505-55450887cf96 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:18.802348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5394f855-eccb-4933-b505-55450887cf96 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:18.802789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5394f855-eccb-4933-b505-55450887cf96 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:19.075840 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-11008d0f-3452-4f02-a601-3374b6aa8dda tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "DELETE /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 204 len: 0 microversion: 2.1 time: 0.560317 May 28 04:35:19.080328 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 155/274] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:35:18 2022] DELETE /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:35:19.094321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-554ea0a3-c31b-415f-a328-03266319b4b2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:19.095087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-554ea0a3-c31b-415f-a328-03266319b4b2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:19.097036 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5394f855-eccb-4933-b505-55450887cf96 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1668 microversion: 2.1 time: 0.306645 May 28 04:35:19.108180 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 120/275] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:18 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1668 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:19.108180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4033f3a3-5d5e-46ef-82b5-092169de4943 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:19.108180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4033f3a3-5d5e-46ef-82b5-092169de4943 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:19.116240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4033f3a3-5d5e-46ef-82b5-092169de4943 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:19.117015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4033f3a3-5d5e-46ef-82b5-092169de4943 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:19.120406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4033f3a3-5d5e-46ef-82b5-092169de4943 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:19.123971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4033f3a3-5d5e-46ef-82b5-092169de4943 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:19.124109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-554ea0a3-c31b-415f-a328-03266319b4b2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:19.124540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-554ea0a3-c31b-415f-a328-03266319b4b2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:19.125336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-554ea0a3-c31b-415f-a328-03266319b4b2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:19.125783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-554ea0a3-c31b-415f-a328-03266319b4b2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:19.390346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4033f3a3-5d5e-46ef-82b5-092169de4943 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:19.399550 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4033f3a3-5d5e-46ef-82b5-092169de4943 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1494 microversion: 2.1 time: 0.299344 May 28 04:35:19.400157 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 121/276] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:19 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1494 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:19.406046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7f685001-f502-4c86-a42a-06c5e15f75f0 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:19.407766 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:19.407766 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:19.409254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f685001-f502-4c86-a42a-06c5e15f75f0 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:19.409859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f685001-f502-4c86-a42a-06c5e15f75f0 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:19.416677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f685001-f502-4c86-a42a-06c5e15f75f0 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:19.417791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f685001-f502-4c86-a42a-06c5e15f75f0 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:19.418530 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-554ea0a3-c31b-415f-a328-03266319b4b2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:19.432844 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-554ea0a3-c31b-415f-a328-03266319b4b2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 1318 microversion: 2.1 time: 0.347243 May 28 04:35:19.433765 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 156/277] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:19 2022] GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:19.467386 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7f685001-f502-4c86-a42a-06c5e15f75f0 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.066028 May 28 04:35:19.468194 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 122/278] 10.222.0.58 () {58 vars in 1175 bytes} [Sat May 28 04:35:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:19.481275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ce863178-2ade-4169-ab14-c63e99745390 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:19.481275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ce863178-2ade-4169-ab14-c63e99745390 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:19.482223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-91b541e3-d3f0-433e-9214-6e77a5d63e31 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-843700-1", "block_migration": true, "disk_over_commit": false}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:19.484084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-91b541e3-d3f0-433e-9214-6e77a5d63e31 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:19.491867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91b541e3-d3f0-433e-9214-6e77a5d63e31 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:19.492641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91b541e3-d3f0-433e-9214-6e77a5d63e31 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:19.494271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91b541e3-d3f0-433e-9214-6e77a5d63e31 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:19.495131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce863178-2ade-4169-ab14-c63e99745390 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:19.495350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91b541e3-d3f0-433e-9214-6e77a5d63e31 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:19.495908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce863178-2ade-4169-ab14-c63e99745390 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:19.497498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce863178-2ade-4169-ab14-c63e99745390 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:19.502784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce863178-2ade-4169-ab14-c63e99745390 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:19.527952 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-ce863178-2ade-4169-ab14-c63e99745390 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] HTTP exception thrown: Instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 could not be found. May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ce863178-2ade-4169-ab14-c63e99745390 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Request method failure captured: May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 HTTP/1.1 May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZhWSbx3Tl2pcEX8f5j_ONvAo7azWZppHUy25lW4SoaAY8g2QbiHiPd6S0iJRIGxuNtn8ommR4Mje3UYPQopWJcK0nblHhl1L_I1M9fd6AAHN21sO9FgujDvqsFbRzla21UkGIZbwbMmD4DkZahfX967XEFAgiMMGSsQ9VEyMJCphw May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 55a346c9751c4215909999fdbc3ea1be May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1678635388 May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:35:19.535644 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:35:19.537103 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:19.537103 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-DeleteServersAdminTestJSON-1678635388 May 28 04:35:19.537103 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 55a346c9751c4215909999fdbc3ea1be May 28 04:35:19.537103 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1678635388 May 28 04:35:19.537103 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-DeleteServersAdminTestJSON-1678635388-project May 28 04:35:19.537103 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:19.537103 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:19.537103 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24f5c69cf0c848b7b8c6672c5be5dcfa May 28 04:35:19.537103 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-DeleteServersAdminTestJSON-1678635388-project May 28 04:35:19.537103 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:35:19.537103 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 could not be found. May 28 04:35:19.537103 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '9a0535f1-775e-459f-86e6-1ae27b94fbb9'} May 28 04:35:19.537947 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:19.537947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:19.537947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:35:19.537947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:35:19.537947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:35:19.537947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:35:19.537947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:35:19.537947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:35:19.537947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:35:19.537947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:35:19.537947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 could not be found. May 28 04:35:19.537947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:19.537947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:19.537947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:19.537947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:19.537947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:19.537947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:19.537947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:19.537947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:19.537947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:19.539844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:19.539844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:35:19.539844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:35:19.539844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:35:19.539844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:35:19.539844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:35:19.539844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:35:19.539844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 could not be found. May 28 04:35:19.539844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:19.539844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:19.539844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:19.539844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:19.539844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:19.539844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:19.539844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:19.539844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:19.539844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 could not be found. May 28 04:35:19.539844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:19.542502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ce863178-2ade-4169-ab14-c63e99745390 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Returning 404 to user: Instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:19.543798 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ce863178-2ade-4169-ab14-c63e99745390 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 404 len: 111 microversion: 2.1 time: 0.068341 May 28 04:35:19.557602 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 157/279] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:19 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:19.572419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-36e1f640-16bd-41cd-85d4-b628b2441ae0 req-91fc99df-ef28-4c5a-9424-006a65738ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a27b8082-4f44-4263-a6a2-86291ea3950b", "tag": "06f37629-13a1-489c-9d41-01ab1fa9a306"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:19.587035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-91b541e3-d3f0-433e-9214-6e77a5d63e31 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lazy-loading 'flavor' on Instance uuid 158412f0-30ee-458c-9da2-83be853d2ea4 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:35:19.593125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-36e1f640-16bd-41cd-85d4-b628b2441ae0 req-91fc99df-ef28-4c5a-9424-006a65738ce5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:19.593594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-36e1f640-16bd-41cd-85d4-b628b2441ae0 req-91fc99df-ef28-4c5a-9424-006a65738ce5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:19.610715 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-36e1f640-16bd-41cd-85d4-b628b2441ae0 req-91fc99df-ef28-4c5a-9424-006a65738ce5 service nova] Creating event network-changed:06f37629-13a1-489c-9d41-01ab1fa9a306 for instance a27b8082-4f44-4263-a6a2-86291ea3950b on n-h2-843700-1 May 28 04:35:19.620878 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-36e1f640-16bd-41cd-85d4-b628b2441ae0 req-91fc99df-ef28-4c5a-9424-006a65738ce5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058601 May 28 04:35:19.621737 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 158/280] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:19.628903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-c45d5614-c1ce-4f53-bfc1-75f6d48c8556 req-8a6430f3-384c-4562-b332-f1b5d839b14a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e0d40b8-3a01-421f-84fe-b94732c1f667", "tag": "9c5d3b07-270f-42b6-a87f-60d7da0c6be0"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:19.641992 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c45d5614-c1ce-4f53-bfc1-75f6d48c8556 req-8a6430f3-384c-4562-b332-f1b5d839b14a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:19.642823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c45d5614-c1ce-4f53-bfc1-75f6d48c8556 req-8a6430f3-384c-4562-b332-f1b5d839b14a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:19.656733 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-c45d5614-c1ce-4f53-bfc1-75f6d48c8556 req-8a6430f3-384c-4562-b332-f1b5d839b14a service nova] Creating event network-changed:9c5d3b07-270f-42b6-a87f-60d7da0c6be0 for instance 9e0d40b8-3a01-421f-84fe-b94732c1f667 on n-h2-843700-1 May 28 04:35:19.661327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-91b541e3-d3f0-433e-9214-6e77a5d63e31 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Going to try to live migrate instance to n-h2-843700-1 {{(pid=126043) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 28 04:35:19.666879 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-c45d5614-c1ce-4f53-bfc1-75f6d48c8556 req-8a6430f3-384c-4562-b332-f1b5d839b14a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042971 May 28 04:35:19.668440 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 159/281] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:19.726931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5cc76a50-a372-4f11-965a-2ebf0500198e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1460233390", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:19.784148 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-5cc76a50-a372-4f11-965a-2ebf0500198e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:35:19.983547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-5cc76a50-a372-4f11-965a-2ebf0500198e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:35:19.983976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-5cc76a50-a372-4f11-965a-2ebf0500198e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:35:19.984451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-5cc76a50-a372-4f11-965a-2ebf0500198e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:35:19.984860 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-5cc76a50-a372-4f11-965a-2ebf0500198e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:35:19.985272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-5cc76a50-a372-4f11-965a-2ebf0500198e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:35:19.994607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5cc76a50-a372-4f11-965a-2ebf0500198e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:19.995254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5cc76a50-a372-4f11-965a-2ebf0500198e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:19.996069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5cc76a50-a372-4f11-965a-2ebf0500198e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:19.996509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5cc76a50-a372-4f11-965a-2ebf0500198e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:20.013718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-5cc76a50-a372-4f11-965a-2ebf0500198e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Getting quotas for project 55a346c9751c4215909999fdbc3ea1be. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:35:20.017700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-5cc76a50-a372-4f11-965a-2ebf0500198e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Getting quotas for user 24f5c69cf0c848b7b8c6672c5be5dcfa and project 55a346c9751c4215909999fdbc3ea1be. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:35:20.028806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5cc76a50-a372-4f11-965a-2ebf0500198e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:35:20.031222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5cc76a50-a372-4f11-965a-2ebf0500198e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:35:20.172923 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5cc76a50-a372-4f11-965a-2ebf0500198e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.450743 May 28 04:35:20.173774 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 160/282] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:35:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:35:20.178765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d7670cd0-7209-4ccd-b81c-04484432f1f4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:20.179494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d7670cd0-7209-4ccd-b81c-04484432f1f4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:20.186055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7670cd0-7209-4ccd-b81c-04484432f1f4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:20.186506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7670cd0-7209-4ccd-b81c-04484432f1f4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:20.187310 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7670cd0-7209-4ccd-b81c-04484432f1f4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:20.187781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7670cd0-7209-4ccd-b81c-04484432f1f4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:20.354605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d7670cd0-7209-4ccd-b81c-04484432f1f4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:20.363442 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d7670cd0-7209-4ccd-b81c-04484432f1f4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1471 microversion: 2.1 time: 0.188753 May 28 04:35:20.364026 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 161/283] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:20 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:20.368608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-76ad7209-41a0-478e-b204-758b7adf97d3 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:20.369245 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-76ad7209-41a0-478e-b204-758b7adf97d3 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:20.423300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-76ad7209-41a0-478e-b204-758b7adf97d3 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:20.433375 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-76ad7209-41a0-478e-b204-758b7adf97d3 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 200 len: 1220 microversion: 2.1 time: 0.067081 May 28 04:35:20.433960 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 162/284] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:20 2022] GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 1220 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:20.439188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d58b43a7-9400-4e8c-9d37-cb2c803b9c4e tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:20.439810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d58b43a7-9400-4e8c-9d37-cb2c803b9c4e tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:20.447771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d58b43a7-9400-4e8c-9d37-cb2c803b9c4e tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:20.448258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d58b43a7-9400-4e8c-9d37-cb2c803b9c4e tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:20.449028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d58b43a7-9400-4e8c-9d37-cb2c803b9c4e tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:20.449465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d58b43a7-9400-4e8c-9d37-cb2c803b9c4e tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:20.673149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d58b43a7-9400-4e8c-9d37-cb2c803b9c4e tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:20.691980 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d58b43a7-9400-4e8c-9d37-cb2c803b9c4e tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1494 microversion: 2.1 time: 0.256116 May 28 04:35:20.693309 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 163/285] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:20 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1494 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:20.698810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8317f411-0871-4035-9333-a10fa1255adb tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:20.699701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8317f411-0871-4035-9333-a10fa1255adb tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:20.708628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8317f411-0871-4035-9333-a10fa1255adb tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:20.709355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8317f411-0871-4035-9333-a10fa1255adb tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:20.710481 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8317f411-0871-4035-9333-a10fa1255adb tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:20.711617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8317f411-0871-4035-9333-a10fa1255adb tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:20.925591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8317f411-0871-4035-9333-a10fa1255adb tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:20.940729 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8317f411-0871-4035-9333-a10fa1255adb tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 1318 microversion: 2.1 time: 0.246088 May 28 04:35:20.941857 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 164/286] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:20 2022] GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:21.380264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c188f220-c1b4-4906-8a38-ca157cb2121b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:21.380806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c188f220-c1b4-4906-8a38-ca157cb2121b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:21.387473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c188f220-c1b4-4906-8a38-ca157cb2121b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:21.388041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c188f220-c1b4-4906-8a38-ca157cb2121b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:21.388904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c188f220-c1b4-4906-8a38-ca157cb2121b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:21.389421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c188f220-c1b4-4906-8a38-ca157cb2121b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:21.577444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c188f220-c1b4-4906-8a38-ca157cb2121b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:21.587410 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c188f220-c1b4-4906-8a38-ca157cb2121b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1471 microversion: 2.1 time: 0.211064 May 28 04:35:21.587999 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 165/287] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:21 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1471 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:21.593013 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f08de3e3-286a-49a1-a3db-61016a7b2aee tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:21.593737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f08de3e3-286a-49a1-a3db-61016a7b2aee tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:21.600976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f08de3e3-286a-49a1-a3db-61016a7b2aee tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:21.602602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f08de3e3-286a-49a1-a3db-61016a7b2aee tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:21.602602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f08de3e3-286a-49a1-a3db-61016a7b2aee tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:21.602802 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f08de3e3-286a-49a1-a3db-61016a7b2aee tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:21.667690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f08de3e3-286a-49a1-a3db-61016a7b2aee tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:21.677625 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f08de3e3-286a-49a1-a3db-61016a7b2aee tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 200 len: 1246 microversion: 2.1 time: 0.088449 May 28 04:35:21.678588 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 166/288] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:21 2022] GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:21.713833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bc2656da-d4bf-4cf5-9826-24ca336347c6 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:21.714463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bc2656da-d4bf-4cf5-9826-24ca336347c6 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:21.727885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bc2656da-d4bf-4cf5-9826-24ca336347c6 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:21.727885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bc2656da-d4bf-4cf5-9826-24ca336347c6 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:21.727885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bc2656da-d4bf-4cf5-9826-24ca336347c6 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:21.727885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bc2656da-d4bf-4cf5-9826-24ca336347c6 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:21.801081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bc2656da-d4bf-4cf5-9826-24ca336347c6 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:21.809583 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bc2656da-d4bf-4cf5-9826-24ca336347c6 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1452 microversion: 2.1 time: 0.103414 May 28 04:35:21.810171 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 167/289] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:21 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:21.815148 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-817ac3a1-6fea-48a3-a9f1-3f3d48698c20 req-c8ccf91a-3d66-4978-9820-1de9c7fd2804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c431c1-9eaa-4508-94b0-05614a36f135", "name": "network-vif-deleted", "tag": "2bdce7c2-a103-419f-abec-055ab2ac98b2"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:21.824015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-817ac3a1-6fea-48a3-a9f1-3f3d48698c20 req-c8ccf91a-3d66-4978-9820-1de9c7fd2804 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:21.824458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-817ac3a1-6fea-48a3-a9f1-3f3d48698c20 req-c8ccf91a-3d66-4978-9820-1de9c7fd2804 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:21.836807 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-817ac3a1-6fea-48a3-a9f1-3f3d48698c20 req-c8ccf91a-3d66-4978-9820-1de9c7fd2804 service nova] Creating event network-vif-deleted:2bdce7c2-a103-419f-abec-055ab2ac98b2 for instance 38c431c1-9eaa-4508-94b0-05614a36f135 on n-h1-843700-1 May 28 04:35:21.842187 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-817ac3a1-6fea-48a3-a9f1-3f3d48698c20 req-c8ccf91a-3d66-4978-9820-1de9c7fd2804 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030473 May 28 04:35:21.843013 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 168/290] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:21.958903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-283398a3-6889-43e8-ac78-f97657f08d7e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:21.959746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-283398a3-6889-43e8-ac78-f97657f08d7e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:21.969319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-283398a3-6889-43e8-ac78-f97657f08d7e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:21.970046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-283398a3-6889-43e8-ac78-f97657f08d7e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:21.971068 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-283398a3-6889-43e8-ac78-f97657f08d7e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:21.971586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-283398a3-6889-43e8-ac78-f97657f08d7e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:22.151155 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-283398a3-6889-43e8-ac78-f97657f08d7e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:22.155091 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-283398a3-6889-43e8-ac78-f97657f08d7e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 1318 microversion: 2.1 time: 0.200860 May 28 04:35:22.155954 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 169/291] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:21 2022] GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:22.612887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f8817795-2da6-43c8-93ea-8c4893d4c199 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:22.614037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f8817795-2da6-43c8-93ea-8c4893d4c199 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:22.622685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8817795-2da6-43c8-93ea-8c4893d4c199 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:22.623624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8817795-2da6-43c8-93ea-8c4893d4c199 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:22.624575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8817795-2da6-43c8-93ea-8c4893d4c199 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:22.625169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8817795-2da6-43c8-93ea-8c4893d4c199 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:22.653813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=10 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:22.826042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f8817795-2da6-43c8-93ea-8c4893d4c199 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:22.833905 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f8817795-2da6-43c8-93ea-8c4893d4c199 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1471 microversion: 2.1 time: 0.233317 May 28 04:35:22.834499 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 170/292] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:22 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1471 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:22.840430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3a92e44d-adf6-4897-8323-ee72e986e29b tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:22.841233 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3a92e44d-adf6-4897-8323-ee72e986e29b tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:22.848348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a92e44d-adf6-4897-8323-ee72e986e29b tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:22.848826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a92e44d-adf6-4897-8323-ee72e986e29b tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:22.849603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a92e44d-adf6-4897-8323-ee72e986e29b tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:22.850087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a92e44d-adf6-4897-8323-ee72e986e29b tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:22.956257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3a92e44d-adf6-4897-8323-ee72e986e29b tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:22.966748 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3a92e44d-adf6-4897-8323-ee72e986e29b tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 200 len: 1302 microversion: 2.1 time: 0.130899 May 28 04:35:22.967653 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 171/293] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:22 2022] GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 1302 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:22.974957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1fc4c315-81cf-440e-b2ba-84bd41fdbb1d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:22.975613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1fc4c315-81cf-440e-b2ba-84bd41fdbb1d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:22.981888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fc4c315-81cf-440e-b2ba-84bd41fdbb1d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:22.982496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fc4c315-81cf-440e-b2ba-84bd41fdbb1d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:22.983317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fc4c315-81cf-440e-b2ba-84bd41fdbb1d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:22.983794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fc4c315-81cf-440e-b2ba-84bd41fdbb1d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:23.015347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:23.028592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fc4c315-81cf-440e-b2ba-84bd41fdbb1d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:23.029076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fc4c315-81cf-440e-b2ba-84bd41fdbb1d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:23.029539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-1fc4c315-81cf-440e-b2ba-84bd41fdbb1d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lazy-loading 'fault' on Instance uuid 38c431c1-9eaa-4508-94b0-05614a36f135 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:35:23.087500 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1fc4c315-81cf-440e-b2ba-84bd41fdbb1d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dd516851bb4185a3b4c2d5560c4b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba54e5cecc4c1d93d39b53b41fbc4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:23.098669 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1fc4c315-81cf-440e-b2ba-84bd41fdbb1d tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 200 len: 1328 microversion: 2.1 time: 0.129815 May 28 04:35:23.099805 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 172/294] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:22 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 1328 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:23.173955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-52033ef9-af8e-4758-8d13-d6bbb2c90fa7 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:23.175061 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-52033ef9-af8e-4758-8d13-d6bbb2c90fa7 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:23.184164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52033ef9-af8e-4758-8d13-d6bbb2c90fa7 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:23.184638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52033ef9-af8e-4758-8d13-d6bbb2c90fa7 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:23.185520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52033ef9-af8e-4758-8d13-d6bbb2c90fa7 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:23.186037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52033ef9-af8e-4758-8d13-d6bbb2c90fa7 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:23.369502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-52033ef9-af8e-4758-8d13-d6bbb2c90fa7 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:23.377318 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-52033ef9-af8e-4758-8d13-d6bbb2c90fa7 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 1318 microversion: 2.1 time: 0.209297 May 28 04:35:23.378147 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 173/295] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:23 2022] GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:23.851910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0274c0c2-2afe-4f1d-93e6-e84e3a12b426 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:23.852610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0274c0c2-2afe-4f1d-93e6-e84e3a12b426 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:23.873217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0274c0c2-2afe-4f1d-93e6-e84e3a12b426 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:23.874727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0274c0c2-2afe-4f1d-93e6-e84e3a12b426 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:23.874727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0274c0c2-2afe-4f1d-93e6-e84e3a12b426 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:23.881624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0274c0c2-2afe-4f1d-93e6-e84e3a12b426 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:24.034205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0274c0c2-2afe-4f1d-93e6-e84e3a12b426 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:24.041741 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0274c0c2-2afe-4f1d-93e6-e84e3a12b426 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1476 microversion: 2.1 time: 0.194123 May 28 04:35:24.042395 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 174/296] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:23 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1476 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:24.058942 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-91b541e3-d3f0-433e-9214-6e77a5d63e31 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4/action" status: 202 len: 0 microversion: 2.1 time: 4.581770 May 28 04:35:24.060214 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 123/297] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:35:19 2022] POST /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4/action => generated 0 bytes in 4585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:35:24.065706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-786f9ec1-2275-4cf4-aef5-22d029896126 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:24.067096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-786f9ec1-2275-4cf4-aef5-22d029896126 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:24.074167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-786f9ec1-2275-4cf4-aef5-22d029896126 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:24.081338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-786f9ec1-2275-4cf4-aef5-22d029896126 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:24.081338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-786f9ec1-2275-4cf4-aef5-22d029896126 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:24.081338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-786f9ec1-2275-4cf4-aef5-22d029896126 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:24.213311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ed5acb43-5bc3-47f0-a5d0-bbd7e2a7d86d tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Calling method '.version_select at 0x7f77020c9310>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:24.214286 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:24.214286 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:24.215824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed5acb43-5bc3-47f0-a5d0-bbd7e2a7d86d tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:24.216236 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed5acb43-5bc3-47f0-a5d0-bbd7e2a7d86d tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:24.226563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-786f9ec1-2275-4cf4-aef5-22d029896126 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:24.232600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed5acb43-5bc3-47f0-a5d0-bbd7e2a7d86d tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:24.233120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed5acb43-5bc3-47f0-a5d0-bbd7e2a7d86d tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:24.241732 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-786f9ec1-2275-4cf4-aef5-22d029896126 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 200 len: 1342 microversion: 2.1 time: 0.180289 May 28 04:35:24.242329 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 124/298] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:24 2022] GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 1342 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:24.244901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed5acb43-5bc3-47f0-a5d0-bbd7e2a7d86d tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:24.245382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed5acb43-5bc3-47f0-a5d0-bbd7e2a7d86d tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:24.251542 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ed5acb43-5bc3-47f0-a5d0-bbd7e2a7d86d tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.208025 May 28 04:35:24.252120 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 175/299] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:35:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:24.253335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cd8456d0-4bea-416f-928d-f8171d502473 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:24.255795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cd8456d0-4bea-416f-928d-f8171d502473 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:24.257301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3df62179-9c1e-45a9-991d-60af86b31576 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:24.258002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3df62179-9c1e-45a9-991d-60af86b31576 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:24.262721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd8456d0-4bea-416f-928d-f8171d502473 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:24.263280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd8456d0-4bea-416f-928d-f8171d502473 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:24.263793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3df62179-9c1e-45a9-991d-60af86b31576 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:24.264086 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd8456d0-4bea-416f-928d-f8171d502473 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:24.264270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3df62179-9c1e-45a9-991d-60af86b31576 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:24.265040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3df62179-9c1e-45a9-991d-60af86b31576 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:24.265165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd8456d0-4bea-416f-928d-f8171d502473 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:24.265478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3df62179-9c1e-45a9-991d-60af86b31576 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:24.278774 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-3df62179-9c1e-45a9-991d-60af86b31576 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] HTTP exception thrown: Instance 38c431c1-9eaa-4508-94b0-05614a36f135 could not be found. May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3df62179-9c1e-45a9-991d-60af86b31576 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Request method failure captured: May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 HTTP/1.1 May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZSV6m9Yucf153-fIumuU6MUHneujQ83RHGLwVKIsiQTb_uQboUNJGgKcBKYitW38V9JQ4b35tq-T7bKBgXaX0VwhYOHU-luWBQZpphzWFoMfeZA5B5e-nxJb_s2JbRudB5vuxkoDDdK5mz5LsRwm-PrEK25mYt44DdOc1bE5XFjTM May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 89ba54e5cecc4c1d93d39b53b41fbc4d May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AggregatesAdminTestJSON-1180716365 May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:35:24.280837 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:35:24.282309 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_89ba54e5cecc4c1d93d39b53b41fbc4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/89ba54e5cecc4c1d93d39b53b41fbc4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/89ba54e5cecc4c1d93d39b53b41fbc4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/89ba54e5cecc4c1d93d39b53b41fbc4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:24.282309 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AggregatesAdminTestJSON-1180716365 May 28 04:35:24.282309 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 89ba54e5cecc4c1d93d39b53b41fbc4d May 28 04:35:24.282309 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1180716365 May 28 04:35:24.282309 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AggregatesAdminTestJSON-1180716365-project May 28 04:35:24.282309 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:24.282309 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:24.282309 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 38dd516851bb4185a3b4c2d5560c4b2b May 28 04:35:24.282309 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AggregatesAdminTestJSON-1180716365-project May 28 04:35:24.282309 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:35:24.282309 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 38c431c1-9eaa-4508-94b0-05614a36f135 could not be found. May 28 04:35:24.282309 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '38c431c1-9eaa-4508-94b0-05614a36f135'} May 28 04:35:24.283101 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:24.283101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:24.283101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:35:24.283101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:35:24.283101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:35:24.283101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:35:24.283101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:35:24.283101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:35:24.283101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:35:24.283101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:35:24.283101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c431c1-9eaa-4508-94b0-05614a36f135 could not be found. May 28 04:35:24.283101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:24.283101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:24.283101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:24.283101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:24.283101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:24.283101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:24.283101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:24.283101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:24.283101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:24.284171 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:24.284171 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:35:24.284171 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:35:24.284171 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:35:24.284171 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:35:24.284171 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:35:24.284171 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:35:24.284171 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c431c1-9eaa-4508-94b0-05614a36f135 could not be found. May 28 04:35:24.284171 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:24.284171 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:24.284171 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:24.284171 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:24.284171 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:24.284171 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:24.284171 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:24.284171 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:24.284171 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c431c1-9eaa-4508-94b0-05614a36f135 could not be found. May 28 04:35:24.284171 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:24.285141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3df62179-9c1e-45a9-991d-60af86b31576 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Returning 404 to user: Instance 38c431c1-9eaa-4508-94b0-05614a36f135 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:24.285141 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3df62179-9c1e-45a9-991d-60af86b31576 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 404 len: 111 microversion: 2.1 time: 0.028845 May 28 04:35:24.285141 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 176/300] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:24 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:24.423850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e159c486-d230-4457-a623-4eab6fbccc6f tempest-HypervisorAdminNegativeUnderV252Test-360603025 tempest-HypervisorAdminNegativeUnderV252Test-360603025-project] Calling method '.version_select at 0x7f77020775e0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:24.425441 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:24.425441 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:24.428268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e159c486-d230-4457-a623-4eab6fbccc6f tempest-HypervisorAdminNegativeUnderV252Test-360603025 tempest-HypervisorAdminNegativeUnderV252Test-360603025-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '21cf02eebd5444dc9472bc0a530361bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c66d1431d44e28a708dbefcda70ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e159c486-d230-4457-a623-4eab6fbccc6f tempest-HypervisorAdminNegativeUnderV252Test-360603025 tempest-HypervisorAdminNegativeUnderV252Test-360603025-project] Request method failure captured: May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-hypervisors/n-h1-843700-1/search HTTP/1.1 May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaaKUD248U96foxg_mUWrTb-wJIBlscNeZ4xzXROBLcU2XW1rnvqIcYGCOJCKqR1n-dWI2t4Pbu-XVXg_uJZF70QXUjxeaOTbdeyWD4uxGrkrYx6RxHKsVaMmJpL0mzXgTAMjl0mMYhABQ2sXT9RasJQCAanq7IvmOmmOedlnDXQKnc May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: a84c66d1431d44e28a708dbefcda70ce May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-360603025 May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:35:24.431852 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:35:24.433325 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a84c66d1431d44e28a708dbefcda70ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a84c66d1431d44e28a708dbefcda70ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a84c66d1431d44e28a708dbefcda70ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a84c66d1431d44e28a708dbefcda70ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:24.433325 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-360603025 May 28 04:35:24.433325 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: a84c66d1431d44e28a708dbefcda70ce May 28 04:35:24.433325 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-360603025 May 28 04:35:24.433325 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-360603025-project May 28 04:35:24.433325 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:24.433325 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:24.433325 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 21cf02eebd5444dc9472bc0a530361bd May 28 04:35:24.433325 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-360603025-project May 28 04:35:24.433325 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:35:24.433325 n-d-843700-1 devstack@n-api.service[126044]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 28 04:35:24.433325 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'n-h1-843700-1'} May 28 04:35:24.434123 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:24.434123 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:24.434123 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:24.434123 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:24.434123 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:24.434123 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:24.434123 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:24.434123 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:24.434123 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:24.434123 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:24.434123 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search May 28 04:35:24.434123 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) May 28 04:35:24.434123 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:24.434123 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:24.434123 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:24.434123 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:24.434123 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:24.434123 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:24.434123 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:24.435690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:24.435690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:24.435690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:24.435690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:24.435690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:24.435690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:24.435690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:24.435690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 28 04:35:24.435690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:24.435690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:24.435690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:24.435690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:24.435690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:24.435690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:24.435690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:24.435690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:24.435690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 28 04:35:24.435690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:24.438338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e159c486-d230-4457-a623-4eab6fbccc6f tempest-HypervisorAdminNegativeUnderV252Test-360603025 tempest-HypervisorAdminNegativeUnderV252Test-360603025-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:24.439319 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e159c486-d230-4457-a623-4eab6fbccc6f tempest-HypervisorAdminNegativeUnderV252Test-360603025 tempest-HypervisorAdminNegativeUnderV252Test-360603025-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/n-h1-843700-1/search" status: 403 len: 117 microversion: 2.1 time: 0.155571 May 28 04:35:24.439682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cd8456d0-4bea-416f-928d-f8171d502473 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:24.440801 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 177/301] 10.222.0.58 () {58 vars in 1208 bytes} [Sat May 28 04:35:24 2022] GET /compute/v2.1/os-hypervisors/n-h1-843700-1/search => generated 117 bytes in 157 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:24.444079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:24.453311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c134330c-a9ed-4c03-bedb-bb87c40d58ed tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843700-1"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:24.454634 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:24.454634 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:24.457387 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cd8456d0-4bea-416f-928d-f8171d502473 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1527 microversion: 2.1 time: 0.208150 May 28 04:35:24.458239 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 125/302] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:24 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1527 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:24.468915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c134330c-a9ed-4c03-bedb-bb87c40d58ed tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:24.469397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c134330c-a9ed-4c03-bedb-bb87c40d58ed tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:24.472060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-36d89c2e-3451-4dd1-b087-c46f77efd742 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:24.473418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-36d89c2e-3451-4dd1-b087-c46f77efd742 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:24.480747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-36d89c2e-3451-4dd1-b087-c46f77efd742 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:24.481372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-36d89c2e-3451-4dd1-b087-c46f77efd742 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:24.489263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-36d89c2e-3451-4dd1-b087-c46f77efd742 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:24.489263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-36d89c2e-3451-4dd1-b087-c46f77efd742 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:24.722361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-36d89c2e-3451-4dd1-b087-c46f77efd742 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:24.735851 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-36d89c2e-3451-4dd1-b087-c46f77efd742 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 1318 microversion: 2.1 time: 0.276283 May 28 04:35:24.739367 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 126/303] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:24 2022] GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:24.750241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eb103771-2927-4558-ad97-49f5cc0a8b10 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Calling method '.version_select at 0x7f770256da60>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:24.753497 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:24.753497 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:24.758932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb103771-2927-4558-ad97-49f5cc0a8b10 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:24.758932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb103771-2927-4558-ad97-49f5cc0a8b10 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:24.765784 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-eb103771-2927-4558-ad97-49f5cc0a8b10 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eb103771-2927-4558-ad97-49f5cc0a8b10 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Request method failure captured: May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaaL7jW8HwICZ1TctHsjcLCDxcTPOn8R4QS90BC0e1Rnfs3SGYfKUSc1zoCKCvOfXzhPxanMoWyHbPI3JiVEzSCFyDibGPi_ax2_YHs1JICfPWzd64gFEGpO8XN1NLpoVO_GVUkiVhljojqQ6m_uv88Zi2yTEAQUfAzlvEdU-YoTUSg May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 5624a34ab8dc49ed90f2f77d6e841e7a May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-389936534 May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: X-Role: admin,reader,member May 28 04:35:24.768241 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: admin,reader,member May 28 04:35:24.769709 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5624a34ab8dc49ed90f2f77d6e841e7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5624a34ab8dc49ed90f2f77d6e841e7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5624a34ab8dc49ed90f2f77d6e841e7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5624a34ab8dc49ed90f2f77d6e841e7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:24.769709 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-389936534 May 28 04:35:24.769709 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 5624a34ab8dc49ed90f2f77d6e841e7a May 28 04:35:24.769709 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-389936534 May 28 04:35:24.769709 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin May 28 04:35:24.769709 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:24.769709 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:24.769709 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 890f9c60f5c54fc2996822f60b7be614 May 28 04:35:24.769709 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin May 28 04:35:24.769709 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:35:24.769709 n-d-843700-1 devstack@n-api.service[126043]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 28 04:35:24.769709 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'nonexistent_hypervisor_name'} May 28 04:35:24.770576 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:24.770576 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:24.770576 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:24.770576 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:24.770576 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:24.770576 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:24.770576 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:24.770576 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:24.770576 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:24.770576 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:24.770576 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search May 28 04:35:24.770576 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) May 28 04:35:24.770576 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern May 28 04:35:24.770576 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 04:35:24.770576 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 28 04:35:24.770576 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:24.770576 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:24.770576 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:24.770576 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:24.770576 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:24.771901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:24.771901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:24.771901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:24.771901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 28 04:35:24.771901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:24.771901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eb103771-2927-4558-ad97-49f5cc0a8b10 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:24.772739 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eb103771-2927-4558-ad97-49f5cc0a8b10 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.030321 May 28 04:35:24.773750 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 127/304] 10.222.0.58 () {58 vars in 1250 bytes} [Sat May 28 04:35:24 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:24.778899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-f2483117-d886-4caa-9945-dee44468b3e8 req-755cb5a6-b80b-4a79-b441-80f83da63d81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bac9c02e-1bd0-420e-8a7f-1d530dceae26", "tag": "8488de26-4471-44b2-87b5-50fdf5dfd1de"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:24.792738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f2483117-d886-4caa-9945-dee44468b3e8 req-755cb5a6-b80b-4a79-b441-80f83da63d81 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:24.798620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f2483117-d886-4caa-9945-dee44468b3e8 req-755cb5a6-b80b-4a79-b441-80f83da63d81 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:24.819354 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-f2483117-d886-4caa-9945-dee44468b3e8 req-755cb5a6-b80b-4a79-b441-80f83da63d81 service nova] Creating event network-changed:8488de26-4471-44b2-87b5-50fdf5dfd1de for instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 on n-h1-843700-1 May 28 04:35:24.826270 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-f2483117-d886-4caa-9945-dee44468b3e8 req-755cb5a6-b80b-4a79-b441-80f83da63d81 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051108 May 28 04:35:24.828138 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 128/305] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:24.832867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a3cd569a-4646-40bd-87f7-ffbc71d8c909 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Calling method '.version_select at 0x7f770219c550>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:24.833927 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:24.833927 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:24.835179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3cd569a-4646-40bd-87f7-ffbc71d8c909 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:24.835644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3cd569a-4646-40bd-87f7-ffbc71d8c909 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:24.852734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3cd569a-4646-40bd-87f7-ffbc71d8c909 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:24.859925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3cd569a-4646-40bd-87f7-ffbc71d8c909 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:24.873272 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c134330c-a9ed-4c03-bedb-bb87c40d58ed tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 298 microversion: 2.1 time: 0.423862 May 28 04:35:24.881498 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 178/306] 10.222.0.58 () {60 vars in 1190 bytes} [Sat May 28 04:35:24 2022] POST /compute/v2.1/os-aggregates/4/action => generated 298 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:24.885315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3cd569a-4646-40bd-87f7-ffbc71d8c909 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:24.885816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3cd569a-4646-40bd-87f7-ffbc71d8c909 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:24.890568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-48f440c5-e77b-4025-be55-d6fde5edcef6 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:24.891328 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:24.891328 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:24.901787 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a3cd569a-4646-40bd-87f7-ffbc71d8c909 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.072729 May 28 04:35:24.902481 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 129/307] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:35:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:24.914082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-93b7e6f2-1f0c-458a-97b2-2c14536933f2 tempest-HypervisorAdminNegativeUnderV252Test-360603025 tempest-HypervisorAdminNegativeUnderV252Test-360603025-project] Calling method '.version_select at 0x7f77021a3ca0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:24.918468 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:24.918468 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:24.918468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-93b7e6f2-1f0c-458a-97b2-2c14536933f2 tempest-HypervisorAdminNegativeUnderV252Test-360603025 tempest-HypervisorAdminNegativeUnderV252Test-360603025-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '21cf02eebd5444dc9472bc0a530361bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c66d1431d44e28a708dbefcda70ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-93b7e6f2-1f0c-458a-97b2-2c14536933f2 tempest-HypervisorAdminNegativeUnderV252Test-360603025 tempest-HypervisorAdminNegativeUnderV252Test-360603025-project] Request method failure captured: May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaaKUD248U96foxg_mUWrTb-wJIBlscNeZ4xzXROBLcU2XW1rnvqIcYGCOJCKqR1n-dWI2t4Pbu-XVXg_uJZF70QXUjxeaOTbdeyWD4uxGrkrYx6RxHKsVaMmJpL0mzXgTAMjl0mMYhABQ2sXT9RasJQCAanq7IvmOmmOedlnDXQKnc May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: a84c66d1431d44e28a708dbefcda70ce May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-360603025 May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:35:24.919371 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:35:24.920719 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a84c66d1431d44e28a708dbefcda70ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a84c66d1431d44e28a708dbefcda70ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a84c66d1431d44e28a708dbefcda70ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a84c66d1431d44e28a708dbefcda70ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:24.920719 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-360603025 May 28 04:35:24.920719 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: a84c66d1431d44e28a708dbefcda70ce May 28 04:35:24.920719 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-360603025 May 28 04:35:24.920719 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-360603025-project May 28 04:35:24.920719 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:24.920719 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:24.920719 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 21cf02eebd5444dc9472bc0a530361bd May 28 04:35:24.920719 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-360603025-project May 28 04:35:24.920719 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:35:24.920719 n-d-843700-1 devstack@n-api.service[126043]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 28 04:35:24.920719 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '1'} May 28 04:35:24.920719 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:24.921411 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:24.921411 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:24.921411 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:24.921411 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:24.921411 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:24.921411 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:24.921411 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:24.921411 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:24.921411 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:24.921411 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers May 28 04:35:24.921411 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) May 28 04:35:24.921411 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:24.921411 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:24.921411 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:24.921411 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:24.921411 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:24.921411 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:24.921411 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:24.921411 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:24.927630 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:24.927630 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:24.927630 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:24.927630 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:24.927630 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:24.927630 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:24.927630 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 28 04:35:24.927630 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:24.927630 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:24.927630 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:24.927630 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:24.927630 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:24.927630 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:24.927630 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:24.927630 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:24.927630 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 28 04:35:24.927630 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:24.928536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-93b7e6f2-1f0c-458a-97b2-2c14536933f2 tempest-HypervisorAdminNegativeUnderV252Test-360603025 tempest-HypervisorAdminNegativeUnderV252Test-360603025-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:24.928536 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-93b7e6f2-1f0c-458a-97b2-2c14536933f2 tempest-HypervisorAdminNegativeUnderV252Test-360603025 tempest-HypervisorAdminNegativeUnderV252Test-360603025-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.013120 May 28 04:35:24.928536 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 130/308] 10.222.0.58 () {58 vars in 1175 bytes} [Sat May 28 04:35:24 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:24.937116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-272432d2-27b2-4bbb-a77c-e8ba2addbbd5 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Calling method '.version_select at 0x7f77023f2ca0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:24.939198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-272432d2-27b2-4bbb-a77c-e8ba2addbbd5 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:24.939604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-272432d2-27b2-4bbb-a77c-e8ba2addbbd5 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:24.946930 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-272432d2-27b2-4bbb-a77c-e8ba2addbbd5 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] HTTP exception thrown: No hypervisor matching '6f6bbd52-2450-4533-984d-22f713e8dbe6' could be found. May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-272432d2-27b2-4bbb-a77c-e8ba2addbbd5 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Request method failure captured: May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/os-hypervisors/6f6bbd52-2450-4533-984d-22f713e8dbe6/servers HTTP/1.1 May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaaL7jW8HwICZ1TctHsjcLCDxcTPOn8R4QS90BC0e1Rnfs3SGYfKUSc1zoCKCvOfXzhPxanMoWyHbPI3JiVEzSCFyDibGPi_ax2_YHs1JICfPWzd64gFEGpO8XN1NLpoVO_GVUkiVhljojqQ6m_uv88Zi2yTEAQUfAzlvEdU-YoTUSg May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 5624a34ab8dc49ed90f2f77d6e841e7a May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-389936534 May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: X-Role: admin,reader,member May 28 04:35:24.948333 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: admin,reader,member May 28 04:35:24.949688 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5624a34ab8dc49ed90f2f77d6e841e7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5624a34ab8dc49ed90f2f77d6e841e7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5624a34ab8dc49ed90f2f77d6e841e7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5624a34ab8dc49ed90f2f77d6e841e7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:24.949688 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-389936534 May 28 04:35:24.949688 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 5624a34ab8dc49ed90f2f77d6e841e7a May 28 04:35:24.949688 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-389936534 May 28 04:35:24.949688 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin May 28 04:35:24.949688 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:24.949688 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:24.949688 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 890f9c60f5c54fc2996822f60b7be614 May 28 04:35:24.949688 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin May 28 04:35:24.949688 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:35:24.949688 n-d-843700-1 devstack@n-api.service[126043]: exception: No hypervisor matching '6f6bbd52-2450-4533-984d-22f713e8dbe6' could be found. May 28 04:35:24.949688 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '6f6bbd52-2450-4533-984d-22f713e8dbe6'} May 28 04:35:24.954712 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:24.954712 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:24.954712 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:24.954712 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:24.954712 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:24.954712 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:24.954712 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:24.954712 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:24.954712 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:24.954712 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:24.954712 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers May 28 04:35:24.954712 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) May 28 04:35:24.954712 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern May 28 04:35:24.954712 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 04:35:24.954712 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '6f6bbd52-2450-4533-984d-22f713e8dbe6' could be found. May 28 04:35:24.954712 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:24.954712 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:24.954712 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:24.954712 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:24.956552 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:24.956552 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:24.956552 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:24.956552 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:24.956552 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '6f6bbd52-2450-4533-984d-22f713e8dbe6' could be found. May 28 04:35:24.956552 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:24.956552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-272432d2-27b2-4bbb-a77c-e8ba2addbbd5 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] Returning 404 to user: No hypervisor matching '6f6bbd52-2450-4533-984d-22f713e8dbe6' could be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:24.956552 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-272432d2-27b2-4bbb-a77c-e8ba2addbbd5 tempest-HypervisorAdminNegativeUnderV252Test-389936534 tempest-HypervisorAdminNegativeUnderV252Test-389936534-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/6f6bbd52-2450-4533-984d-22f713e8dbe6/servers" status: 404 len: 123 microversion: 2.1 time: 0.020314 May 28 04:35:24.956552 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 131/309] 10.222.0.58 () {58 vars in 1280 bytes} [Sat May 28 04:35:24 2022] GET /compute/v2.1/os-hypervisors/6f6bbd52-2450-4533-984d-22f713e8dbe6/servers => generated 123 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:24.998054 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-48f440c5-e77b-4025-be55-d6fde5edcef6 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.113925 May 28 04:35:25.003036 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 179/310] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:35:24 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 04:35:25.009782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6d424ce3-0d74-4702-8e8c-1eaaa69f3043 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1362030891"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:25.011558 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:25.011558 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:25.012714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.aggregate [None req-6d424ce3-0d74-4702-8e8c-1eaaa69f3043 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Generated uuid 0172453a-c47a-4c2a-9f56-4fb3f4dab207 for aggregate {{(pid=126043) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 04:35:25.043866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-8a8bef75-f803-4127-9d87-13e06d0cf82b req-7244e25b-bcfd-46cf-841f-3937525f5807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0d40b8-3a01-421f-84fe-b94732c1f667", "name": "network-vif-plugged", "status": "completed", "tag": "9c5d3b07-270f-42b6-a87f-60d7da0c6be0"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:25.056813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8a8bef75-f803-4127-9d87-13e06d0cf82b req-7244e25b-bcfd-46cf-841f-3937525f5807 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:25.058388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8a8bef75-f803-4127-9d87-13e06d0cf82b req-7244e25b-bcfd-46cf-841f-3937525f5807 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:25.079579 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-8a8bef75-f803-4127-9d87-13e06d0cf82b req-7244e25b-bcfd-46cf-841f-3937525f5807 service nova] Creating event network-vif-plugged:9c5d3b07-270f-42b6-a87f-60d7da0c6be0 for instance 9e0d40b8-3a01-421f-84fe-b94732c1f667 on n-h2-843700-1 May 28 04:35:25.085302 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-8a8bef75-f803-4127-9d87-13e06d0cf82b req-7244e25b-bcfd-46cf-841f-3937525f5807 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045009 May 28 04:35:25.086502 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 180/311] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:25.092522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bc1d6c8c-34b3-4771-9437-14fb0dead146 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:25.094352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bc1d6c8c-34b3-4771-9437-14fb0dead146 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:25.116468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bc1d6c8c-34b3-4771-9437-14fb0dead146 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:25.118725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bc1d6c8c-34b3-4771-9437-14fb0dead146 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:25.118725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bc1d6c8c-34b3-4771-9437-14fb0dead146 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:25.118725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bc1d6c8c-34b3-4771-9437-14fb0dead146 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:25.135754 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6d424ce3-0d74-4702-8e8c-1eaaa69f3043 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.129755 May 28 04:35:25.137365 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 132/312] 10.222.0.58 () {60 vars in 1163 bytes} [Sat May 28 04:35:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:25.147509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-120c1abd-5acd-4c51-8e2b-8399d2d233d4 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843700-1"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:25.151155 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:25.151155 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:25.170677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-120c1abd-5acd-4c51-8e2b-8399d2d233d4 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:25.174382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-120c1abd-5acd-4c51-8e2b-8399d2d233d4 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:25.337476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bc1d6c8c-34b3-4771-9437-14fb0dead146 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:25.345419 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bc1d6c8c-34b3-4771-9437-14fb0dead146 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1476 microversion: 2.1 time: 0.257515 May 28 04:35:25.350455 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 181/313] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:25 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1476 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:25.363147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c3ddedf6-a902-480d-9b2f-51de403c5230 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:25.364513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c3ddedf6-a902-480d-9b2f-51de403c5230 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:25.376713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3ddedf6-a902-480d-9b2f-51de403c5230 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:25.383672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3ddedf6-a902-480d-9b2f-51de403c5230 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:25.385088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3ddedf6-a902-480d-9b2f-51de403c5230 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:25.385749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3ddedf6-a902-480d-9b2f-51de403c5230 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:25.428776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:25.512270 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-120c1abd-5acd-4c51-8e2b-8399d2d233d4 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.368852 May 28 04:35:25.520293 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 133/314] 10.222.0.58 () {60 vars in 1190 bytes} [Sat May 28 04:35:25 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:35:25.525876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f16fe268-2dee-4709-a48f-f426a68db5e7 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:25.527404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f16fe268-2dee-4709-a48f-f426a68db5e7 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:25.539874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f16fe268-2dee-4709-a48f-f426a68db5e7 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:25.539874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f16fe268-2dee-4709-a48f-f426a68db5e7 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:25.539874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f16fe268-2dee-4709-a48f-f426a68db5e7 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:25.539874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f16fe268-2dee-4709-a48f-f426a68db5e7 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:25.571377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c3ddedf6-a902-480d-9b2f-51de403c5230 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:25.579114 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c3ddedf6-a902-480d-9b2f-51de403c5230 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 200 len: 1320 microversion: 2.1 time: 0.227416 May 28 04:35:25.579784 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 182/315] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:25 2022] GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 1320 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:25.595068 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-caf1a1e2-a647-4eb6-a3bf-00a2fd4dbf63 tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843700-1"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:25.596082 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:25.596082 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:25.596928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-caf1a1e2-a647-4eb6-a3bf-00a2fd4dbf63 tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '63e7a4e0e5dc4ac186f8654146973571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68fb00cc8a54d54a55a84297bc35393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-caf1a1e2-a647-4eb6-a3bf-00a2fd4dbf63 tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Request method failure captured: May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 42 May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZT7HTo95ojojKHZC-NNltVExy7yQojtH5pTrZQxzW32T2kBAnWam4RPzMJqNePVsWUFtEwZ-W5zJQNWqxtrDI5Q96dSBmXI18VQH2e82LZNofHv-bIX9Kz7RkW-VPBnOzqnHt_mJ-_pkl368dkfxdFCceggYFN7RWeB8hhnJ5D_44 May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: b68fb00cc8a54d54a55a84297bc35393 May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1345048806 May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:35:25.599318 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:35:25.600596 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b68fb00cc8a54d54a55a84297bc35393"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:25.600596 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1345048806 May 28 04:35:25.600596 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: b68fb00cc8a54d54a55a84297bc35393 May 28 04:35:25.600596 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1345048806 May 28 04:35:25.600596 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AggregatesAdminNegativeTestJSON-1345048806-project May 28 04:35:25.600596 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:25.600596 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:25.600596 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 63e7a4e0e5dc4ac186f8654146973571 May 28 04:35:25.600596 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1345048806-project May 28 04:35:25.600596 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:35:25.600596 n-d-843700-1 devstack@n-api.service[126044]: {"remove_host": {"host": "n-h1-843700-1"}} May 28 04:35:25.600596 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:35:25.600596 n-d-843700-1 devstack@n-api.service[126044]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 28 04:35:25.601312 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '9', 'body': {'remove_host': {'host': 'n-h1-843700-1'}}} May 28 04:35:25.601312 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:25.601312 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:25.601312 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:25.601312 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:25.601312 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:25.601312 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:25.601312 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:25.601312 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:25.601312 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:35:25.601312 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:35:25.601312 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host May 28 04:35:25.601312 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) May 28 04:35:25.601312 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:25.601312 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:25.601312 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:25.601312 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:25.601312 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:25.601312 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:25.602305 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:25.602305 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:25.602305 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:25.602305 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:25.602305 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:25.602305 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:25.602305 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:25.602305 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:25.602305 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 28 04:35:25.602305 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:25.602305 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:25.602305 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:25.602305 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:25.602305 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:25.602305 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:25.602305 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:25.602305 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:25.602305 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 28 04:35:25.602305 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:25.603441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-caf1a1e2-a647-4eb6-a3bf-00a2fd4dbf63 tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:25.603441 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-caf1a1e2-a647-4eb6-a3bf-00a2fd4dbf63 tempest-AggregatesAdminNegativeTestJSON-1345048806 tempest-AggregatesAdminNegativeTestJSON-1345048806-project] 10.222.0.58 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 121 microversion: 2.1 time: 0.010466 May 28 04:35:25.603441 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 183/316] 10.222.0.58 () {60 vars in 1190 bytes} [Sat May 28 04:35:25 2022] POST /compute/v2.1/os-aggregates/9/action => generated 121 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:25.609349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-01c6f1ba-b5d7-427a-9056-1e03964fb99e tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843700-1"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:25.619663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01c6f1ba-b5d7-427a-9056-1e03964fb99e tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:25.620281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01c6f1ba-b5d7-427a-9056-1e03964fb99e tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:25.702233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f16fe268-2dee-4709-a48f-f426a68db5e7 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:25.710577 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f16fe268-2dee-4709-a48f-f426a68db5e7 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1505 microversion: 2.1 time: 0.189020 May 28 04:35:25.712125 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 134/317] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:25 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1505 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:25.754361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c6cb6904-3cca-468d-99ce-ed73ceeec9b2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:25.754957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c6cb6904-3cca-468d-99ce-ed73ceeec9b2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:25.762351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6cb6904-3cca-468d-99ce-ed73ceeec9b2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:25.762351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6cb6904-3cca-468d-99ce-ed73ceeec9b2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:25.762835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6cb6904-3cca-468d-99ce-ed73ceeec9b2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:25.763475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6cb6904-3cca-468d-99ce-ed73ceeec9b2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:25.878422 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-01c6f1ba-b5d7-427a-9056-1e03964fb99e tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.272575 May 28 04:35:25.879700 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 184/318] 10.222.0.58 () {60 vars in 1190 bytes} [Sat May 28 04:35:25 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:35:25.889406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8e9245f1-95c4-42ac-abae-937067ab3369 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:25.890165 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:25.890165 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:25.898158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c6cb6904-3cca-468d-99ce-ed73ceeec9b2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:25.905753 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c6cb6904-3cca-468d-99ce-ed73ceeec9b2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 1318 microversion: 2.1 time: 0.155245 May 28 04:35:25.906569 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 135/319] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:25 2022] GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:25.981607 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8e9245f1-95c4-42ac-abae-937067ab3369 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.095721 May 28 04:35:25.982484 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 185/320] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:35:25 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 28 04:35:25.993402 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5bbdb10b-a236-4254-82ca-499e86869361 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Calling method '.version_select at 0x7f770229d8b0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:25.994405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a1eaf6cc-692b-4fda-951d-05a654d02146 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-209504053"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:25.994719 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:25.994719 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:25.995781 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:25.995781 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:25.995936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5bbdb10b-a236-4254-82ca-499e86869361 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:25.996378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5bbdb10b-a236-4254-82ca-499e86869361 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:25.996723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.aggregate [None req-a1eaf6cc-692b-4fda-951d-05a654d02146 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Generated uuid a5f8dc82-58a1-4de4-a7db-32bebffb6180 for aggregate {{(pid=126043) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 04:35:25.997545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5bbdb10b-a236-4254-82ca-499e86869361 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:25.998082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5bbdb10b-a236-4254-82ca-499e86869361 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:26.024629 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5bbdb10b-a236-4254-82ca-499e86869361 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.034678 May 28 04:35:26.025183 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 186/321] 10.222.0.58 () {58 vars in 1127 bytes} [Sat May 28 04:35:25 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:35:26.034483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3ea34450-a2d3-411b-82d0-aa08f0f7a929 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Calling method '.version_select at 0x7f770246e9d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:26.035762 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:26.035762 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:26.036902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ea34450-a2d3-411b-82d0-aa08f0f7a929 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:26.040235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ea34450-a2d3-411b-82d0-aa08f0f7a929 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:26.040235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ea34450-a2d3-411b-82d0-aa08f0f7a929 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:26.040235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ea34450-a2d3-411b-82d0-aa08f0f7a929 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:26.061892 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3ea34450-a2d3-411b-82d0-aa08f0f7a929 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.031194 May 28 04:35:26.062490 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 187/322] 10.222.0.58 () {58 vars in 1154 bytes} [Sat May 28 04:35:26 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:35:26.072942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e8964847-ca06-42d3-8159-3ce80d8b7333 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Calling method '.version_select at 0x7f7702394790>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:26.074075 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:26.074075 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:26.075220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e8964847-ca06-42d3-8159-3ce80d8b7333 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:26.075733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e8964847-ca06-42d3-8159-3ce80d8b7333 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:26.076519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e8964847-ca06-42d3-8159-3ce80d8b7333 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:26.076987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e8964847-ca06-42d3-8159-3ce80d8b7333 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:26.093229 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a1eaf6cc-692b-4fda-951d-05a654d02146 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.104881 May 28 04:35:26.095175 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 136/323] 10.222.0.58 () {60 vars in 1163 bytes} [Sat May 28 04:35:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:26.101908 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e8964847-ca06-42d3-8159-3ce80d8b7333 tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.032306 May 28 04:35:26.106871 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 188/324] 10.222.0.58 () {58 vars in 1127 bytes} [Sat May 28 04:35:26 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:35:26.107022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d6976c43-a289-40be-b53c-e4cacda4b561 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:26.108159 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:26.108159 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:26.115637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c3ea4ae2-3680-4ee1-b32b-1bf13d0ea71e tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Calling method '.version_select at 0x7f7702077550>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:26.115637 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:26.115637 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:26.117732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6976c43-a289-40be-b53c-e4cacda4b561 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:26.118414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6976c43-a289-40be-b53c-e4cacda4b561 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:26.119157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3ea4ae2-3680-4ee1-b32b-1bf13d0ea71e tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:26.119608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3ea4ae2-3680-4ee1-b32b-1bf13d0ea71e tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:26.126947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6976c43-a289-40be-b53c-e4cacda4b561 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:26.127581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6976c43-a289-40be-b53c-e4cacda4b561 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:26.141666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3ea4ae2-3680-4ee1-b32b-1bf13d0ea71e tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:26.142332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3ea4ae2-3680-4ee1-b32b-1bf13d0ea71e tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:26.142742 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.compute.aggregates [None req-d6976c43-a289-40be-b53c-e4cacda4b561 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Failed to remove host nonexist_host from aggregate 10. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. May 28 04:35:26.143309 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-d6976c43-a289-40be-b53c-e4cacda4b561 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 10 May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d6976c43-a289-40be-b53c-e4cacda4b561 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Request method failure captured: May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 42 May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZW7SGXjy79gqJh_aG85x9CXE8mDCgbB0sdzOUVfNQzxuSX2ZbmKSp8SnvzaWVrg3K6Fu2c9pSoMA2-0EcTzQRrIiLSKTUQfEDDzcZLxi1dbyKDysQ6wI6N_5-UCAFpAlViEBvznAgcTJqCjq2dkQlHXylegTwDUr_5Dh4t37EyKgs May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 122df235d06c48a59cb66d0372212429 May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: X-Role: admin,reader,member May 28 04:35:26.146447 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: admin,reader,member May 28 04:35:26.147626 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_122df235d06c48a59cb66d0372212429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/122df235d06c48a59cb66d0372212429"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/122df235d06c48a59cb66d0372212429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/122df235d06c48a59cb66d0372212429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:26.147626 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:35:26.147626 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 122df235d06c48a59cb66d0372212429 May 28 04:35:26.147626 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-576461617 May 28 04:35:26.147626 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin May 28 04:35:26.147626 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:26.147626 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:26.147626 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 2af8200da6e844e4870969cb21c062f1 May 28 04:35:26.147626 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin May 28 04:35:26.147626 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:35:26.147626 n-d-843700-1 devstack@n-api.service[126043]: {"remove_host": {"host": "nonexist_host"}} May 28 04:35:26.147626 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:35:26.147626 n-d-843700-1 devstack@n-api.service[126043]: exception: Cannot remove host nonexist_host in aggregate 10 May 28 04:35:26.148365 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '10', 'body': {'remove_host': {'host': 'nonexist_host'}}} May 28 04:35:26.148365 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:26.148365 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:26.148365 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host May 28 04:35:26.148365 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 28 04:35:26.148365 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:35:26.148365 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:35:26.148365 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 28 04:35:26.148365 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 28 04:35:26.148365 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:35:26.148365 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:35:26.148365 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 28 04:35:26.148365 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 28 04:35:26.148365 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell May 28 04:35:26.148365 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:26.148365 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:26.148365 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:26.148365 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:26.148365 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host May 28 04:35:26.148365 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) May 28 04:35:26.149437 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 28 04:35:26.149437 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 28 04:35:26.149437 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 28 04:35:26.149437 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:26.149437 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:26.149437 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:26.149437 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:26.149437 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host May 28 04:35:26.149437 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) May 28 04:35:26.149437 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 04:35:26.149437 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 04:35:26.149437 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:26.149437 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:26.149437 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:26.149437 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:26.149437 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 04:35:26.149437 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 04:35:26.149437 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate May 28 04:35:26.149437 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) May 28 04:35:26.149437 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 10 May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:26.150614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:26.154284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:26.154284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:26.154284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:26.154284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:26.154284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 10 May 28 04:35:26.154284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:26.154284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d6976c43-a289-40be-b53c-e4cacda4b561 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 10 {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:26.154284 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d6976c43-a289-40be-b53c-e4cacda4b561 tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/10/action" status: 404 len: 94 microversion: 2.1 time: 0.045171 May 28 04:35:26.154284 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 137/325] 10.222.0.58 () {60 vars in 1193 bytes} [Sat May 28 04:35:26 2022] POST /compute/v2.1/os-aggregates/10/action => generated 94 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 28 04:35:26.165139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fc557913-bbae-4cb2-9378-d8c930b027fd tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:26.165914 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:26.165914 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:26.177255 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c3ea4ae2-3680-4ee1-b32b-1bf13d0ea71e tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-h1-843700-1" status: 200 len: 598 microversion: 2.1 time: 0.068787 May 28 04:35:26.178247 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 189/326] 10.222.0.58 () {58 vars in 1169 bytes} [Sat May 28 04:35:26 2022] GET /compute/v2.1/os-hosts/n-h1-843700-1 => generated 598 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:35:26.183280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-88acf493-c443-46ce-9af6-2ffd8b965491 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2109676315"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:26.184730 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:26.184730 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:26.185605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.aggregate [None req-88acf493-c443-46ce-9af6-2ffd8b965491 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Generated uuid b06345fd-9b01-4eac-81c0-4edcb2c5bcfb for aggregate {{(pid=126044) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 04:35:26.270574 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fc557913-bbae-4cb2-9378-d8c930b027fd tempest-AggregatesAdminNegativeTestJSON-576461617 tempest-AggregatesAdminNegativeTestJSON-576461617-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.116882 May 28 04:35:26.271494 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 138/327] 10.222.0.58 () {58 vars in 1154 bytes} [Sat May 28 04:35:26 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 04:35:26.282673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f4ee9908-a620-4056-b613-e83c0a74639e tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Calling method '.version_select at 0x7f77041d8c10>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:26.286335 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:26.286335 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:26.290438 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-88acf493-c443-46ce-9af6-2ffd8b965491 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.109733 May 28 04:35:26.296527 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 190/328] 10.222.0.58 () {60 vars in 1163 bytes} [Sat May 28 04:35:26 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:26.302516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4ee9908-a620-4056-b613-e83c0a74639e tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:26.302980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4ee9908-a620-4056-b613-e83c0a74639e tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:26.306242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1e606100-f964-40cb-8c7d-f5eeaaea7c31 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843700-1"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:26.309089 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:26.309089 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:26.320400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4ee9908-a620-4056-b613-e83c0a74639e tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:26.320751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e606100-f964-40cb-8c7d-f5eeaaea7c31 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:26.321018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4ee9908-a620-4056-b613-e83c0a74639e tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:26.321755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e606100-f964-40cb-8c7d-f5eeaaea7c31 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:26.358859 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f4ee9908-a620-4056-b613-e83c0a74639e tempest-HostsAdminTestJSON-1172925249 tempest-HostsAdminTestJSON-1172925249-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-h2-843700-1" status: 200 len: 598 microversion: 2.1 time: 0.086296 May 28 04:35:26.360022 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 139/329] 10.222.0.58 () {58 vars in 1169 bytes} [Sat May 28 04:35:26 2022] GET /compute/v2.1/os-hosts/n-h2-843700-1 => generated 598 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:26.367119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-120afc7d-0e28-4d86-b494-a79024584ac4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:26.367813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-120afc7d-0e28-4d86-b494-a79024584ac4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:26.372022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:26.375687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-120afc7d-0e28-4d86-b494-a79024584ac4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:26.376141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-120afc7d-0e28-4d86-b494-a79024584ac4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:26.376920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-120afc7d-0e28-4d86-b494-a79024584ac4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:26.377357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-120afc7d-0e28-4d86-b494-a79024584ac4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:26.702773 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1e606100-f964-40cb-8c7d-f5eeaaea7c31 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.400376 May 28 04:35:26.704474 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 191/330] 10.222.0.58 () {60 vars in 1193 bytes} [Sat May 28 04:35:26 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:26.713748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c9c7e3e4-2171-4fca-9489-86ccbcdeefdf tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:26.714701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c9c7e3e4-2171-4fca-9489-86ccbcdeefdf tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:26.722880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9c7e3e4-2171-4fca-9489-86ccbcdeefdf tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:26.737830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9c7e3e4-2171-4fca-9489-86ccbcdeefdf tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:26.740974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9c7e3e4-2171-4fca-9489-86ccbcdeefdf tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:26.742523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9c7e3e4-2171-4fca-9489-86ccbcdeefdf tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:26.838057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-120afc7d-0e28-4d86-b494-a79024584ac4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:26.849644 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-120afc7d-0e28-4d86-b494-a79024584ac4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1476 microversion: 2.1 time: 0.487541 May 28 04:35:26.851312 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 140/331] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:26 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1476 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:26.858715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9c31eafb-36fb-4a6d-8d0e-9cedc77b3f48 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:26.860510 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:26.860510 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:26.873336 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9c31eafb-36fb-4a6d-8d0e-9cedc77b3f48 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/11" status: 200 len: 243 microversion: 2.1 time: 0.020624 May 28 04:35:26.874606 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 141/332] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:35:26 2022] GET /compute/v2.1/os-aggregates/11 => generated 243 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:26.882189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a0f8ac6e-f72d-4186-b00c-a2b5ebadf172 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:26.883714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a0f8ac6e-f72d-4186-b00c-a2b5ebadf172 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:26.900805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a0f8ac6e-f72d-4186-b00c-a2b5ebadf172 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:26.901304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a0f8ac6e-f72d-4186-b00c-a2b5ebadf172 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:26.902172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a0f8ac6e-f72d-4186-b00c-a2b5ebadf172 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:26.903066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a0f8ac6e-f72d-4186-b00c-a2b5ebadf172 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:27.049204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c9c7e3e4-2171-4fca-9489-86ccbcdeefdf tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:27.055983 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c9c7e3e4-2171-4fca-9489-86ccbcdeefdf tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 200 len: 1320 microversion: 2.1 time: 0.348858 May 28 04:35:27.056966 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 192/333] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:26 2022] GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 1320 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:27.072648 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-30dd2c59-89dd-4985-87ad-301af3708baf tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843700-1"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:27.075165 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:27.075165 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:27.088310 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30dd2c59-89dd-4985-87ad-301af3708baf tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:27.089138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30dd2c59-89dd-4985-87ad-301af3708baf tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:27.231938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a0f8ac6e-f72d-4186-b00c-a2b5ebadf172 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:27.240319 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a0f8ac6e-f72d-4186-b00c-a2b5ebadf172 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1505 microversion: 2.1 time: 0.363176 May 28 04:35:27.243281 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 142/334] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:26 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1505 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:27.247438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5ccc2190-084e-4485-8ff9-3213efcc53de tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:27.248079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5ccc2190-084e-4485-8ff9-3213efcc53de tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:27.255781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ccc2190-084e-4485-8ff9-3213efcc53de tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:27.256362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ccc2190-084e-4485-8ff9-3213efcc53de tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:27.257350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ccc2190-084e-4485-8ff9-3213efcc53de tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:27.257862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ccc2190-084e-4485-8ff9-3213efcc53de tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:27.427213 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-30dd2c59-89dd-4985-87ad-301af3708baf tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.361722 May 28 04:35:27.428780 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 193/335] 10.222.0.58 () {60 vars in 1193 bytes} [Sat May 28 04:35:27 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:27.433821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-00a66cac-e41e-4de4-89c1-52b8e624a88b req-383d2905-fe91-49ea-9767-78d636138004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158412f0-30ee-458c-9da2-83be853d2ea4", "name": "network-vif-unplugged", "status": "completed", "tag": "3234e2dc-f459-4590-9dd3-6cfbc11536ed"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:27.442700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-00a66cac-e41e-4de4-89c1-52b8e624a88b req-383d2905-fe91-49ea-9767-78d636138004 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:27.443174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-00a66cac-e41e-4de4-89c1-52b8e624a88b req-383d2905-fe91-49ea-9767-78d636138004 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:27.454911 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-00a66cac-e41e-4de4-89c1-52b8e624a88b req-383d2905-fe91-49ea-9767-78d636138004 service nova] Creating event network-vif-unplugged:3234e2dc-f459-4590-9dd3-6cfbc11536ed for instance 158412f0-30ee-458c-9da2-83be853d2ea4 on n-h1-843700-1 May 28 04:35:27.461211 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-00a66cac-e41e-4de4-89c1-52b8e624a88b req-383d2905-fe91-49ea-9767-78d636138004 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031049 May 28 04:35:27.461842 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 194/336] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:27.462302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5ccc2190-084e-4485-8ff9-3213efcc53de tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:27.466968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-b523e3e9-c1c5-455b-89e6-3ff8b3f4511b req-1b3eb41d-af4e-43b6-92af-e26260b4123c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a27b8082-4f44-4263-a6a2-86291ea3950b", "name": "network-vif-plugged", "status": "completed", "tag": "06f37629-13a1-489c-9d41-01ab1fa9a306"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:27.474792 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5ccc2190-084e-4485-8ff9-3213efcc53de tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 1466 microversion: 2.1 time: 0.232460 May 28 04:35:27.475427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b523e3e9-c1c5-455b-89e6-3ff8b3f4511b req-1b3eb41d-af4e-43b6-92af-e26260b4123c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:27.475873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b523e3e9-c1c5-455b-89e6-3ff8b3f4511b req-1b3eb41d-af4e-43b6-92af-e26260b4123c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:27.476272 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 143/337] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:27 2022] GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 1466 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:27.482570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c4256319-450b-4bd7-a876-4fdbce45967c tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:27.484864 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:27.484864 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:27.487347 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-b523e3e9-c1c5-455b-89e6-3ff8b3f4511b req-1b3eb41d-af4e-43b6-92af-e26260b4123c service nova] Creating event network-vif-plugged:06f37629-13a1-489c-9d41-01ab1fa9a306 for instance a27b8082-4f44-4263-a6a2-86291ea3950b on n-h2-843700-1 May 28 04:35:27.492654 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-b523e3e9-c1c5-455b-89e6-3ff8b3f4511b req-1b3eb41d-af4e-43b6-92af-e26260b4123c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029474 May 28 04:35:27.493316 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 195/338] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:27.498714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bef89b4e-976a-4811-9a12-252ad4a0699f tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:27.499474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bef89b4e-976a-4811-9a12-252ad4a0699f tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: a27b8082-4f44-4263-a6a2-86291ea3950b] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:27.508214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bef89b4e-976a-4811-9a12-252ad4a0699f tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:27.508623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bef89b4e-976a-4811-9a12-252ad4a0699f tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:27.509276 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bef89b4e-976a-4811-9a12-252ad4a0699f tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:27.509710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bef89b4e-976a-4811-9a12-252ad4a0699f tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:27.631055 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c4256319-450b-4bd7-a876-4fdbce45967c tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.153492 May 28 04:35:27.634879 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 144/339] 10.222.0.58 () {58 vars in 1154 bytes} [Sat May 28 04:35:27 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 04:35:27.643453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c0afae58-6493-4531-93ec-21ae74d97f52 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-218496924"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:27.648808 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:27.648808 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:27.650042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.aggregate [None req-c0afae58-6493-4531-93ec-21ae74d97f52 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Generated uuid bf604ea2-6d27-406a-ac53-ce908f1c928c for aggregate {{(pid=126043) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 04:35:27.728985 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bef89b4e-976a-4811-9a12-252ad4a0699f tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:27.736714 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bef89b4e-976a-4811-9a12-252ad4a0699f tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b" status: 200 len: 1318 microversion: 2.1 time: 0.242062 May 28 04:35:27.737418 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 196/340] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:27 2022] GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:27.763284 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c0afae58-6493-4531-93ec-21ae74d97f52 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.124752 May 28 04:35:27.764005 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 145/341] 10.222.0.58 () {60 vars in 1163 bytes} [Sat May 28 04:35:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:35:27.773964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-17385d6c-0525-49e9-b086-4bb47726eb34 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843700-1"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:27.775375 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:27.775375 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:27.784658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-17385d6c-0525-49e9-b086-4bb47726eb34 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:27.789369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-17385d6c-0525-49e9-b086-4bb47726eb34 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:27.867073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8f32398b-7683-4ccc-99b7-31d27e709d5c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:27.867724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8f32398b-7683-4ccc-99b7-31d27e709d5c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:27.876023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f32398b-7683-4ccc-99b7-31d27e709d5c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:27.880908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f32398b-7683-4ccc-99b7-31d27e709d5c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:27.880908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f32398b-7683-4ccc-99b7-31d27e709d5c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:27.880908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f32398b-7683-4ccc-99b7-31d27e709d5c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:28.090612 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-17385d6c-0525-49e9-b086-4bb47726eb34 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 242 microversion: 2.1 time: 0.318699 May 28 04:35:28.098822 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 197/342] 10.222.0.58 () {60 vars in 1193 bytes} [Sat May 28 04:35:27 2022] POST /compute/v2.1/os-aggregates/12/action => generated 242 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:28.099166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8f32398b-7683-4ccc-99b7-31d27e709d5c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:28.114340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-84c4029e-2eee-4931-b85d-87c51b9808f4 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:28.118253 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8f32398b-7683-4ccc-99b7-31d27e709d5c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1476 microversion: 2.1 time: 0.255841 May 28 04:35:28.126917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-84c4029e-2eee-4931-b85d-87c51b9808f4 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:28.136069 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 146/343] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:27 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1476 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:28.142497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3157fac6-81e8-4ea7-be4a-20da7c59f54f tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:28.144048 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:28.144048 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:28.147841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84c4029e-2eee-4931-b85d-87c51b9808f4 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:28.149786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84c4029e-2eee-4931-b85d-87c51b9808f4 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:28.152812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84c4029e-2eee-4931-b85d-87c51b9808f4 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:28.153439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84c4029e-2eee-4931-b85d-87c51b9808f4 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:28.153854 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3157fac6-81e8-4ea7-be4a-20da7c59f54f tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.015893 May 28 04:35:28.154498 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 147/344] 10.222.0.58 () {58 vars in 1142 bytes} [Sat May 28 04:35:28 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:28.166248 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-de2dd566-600f-47fb-8209-394404a452e2 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843700-1"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:28.168133 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:28.168133 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:28.181322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de2dd566-600f-47fb-8209-394404a452e2 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:28.181322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de2dd566-600f-47fb-8209-394404a452e2 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:28.340502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-84c4029e-2eee-4931-b85d-87c51b9808f4 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:28.349412 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-84c4029e-2eee-4931-b85d-87c51b9808f4 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 200 len: 1320 microversion: 2.1 time: 0.245742 May 28 04:35:28.356424 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 198/345] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:28 2022] GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 1320 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:28.356424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-35179a20-4324-4e6d-88ef-5019d52d30c8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:28.356424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-35179a20-4324-4e6d-88ef-5019d52d30c8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:28.360765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35179a20-4324-4e6d-88ef-5019d52d30c8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:28.361251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35179a20-4324-4e6d-88ef-5019d52d30c8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:28.362052 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35179a20-4324-4e6d-88ef-5019d52d30c8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:28.362492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35179a20-4324-4e6d-88ef-5019d52d30c8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:28.493243 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-de2dd566-600f-47fb-8209-394404a452e2 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 227 microversion: 2.1 time: 0.330693 May 28 04:35:28.493990 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 148/346] 10.222.0.58 () {60 vars in 1193 bytes} [Sat May 28 04:35:28 2022] POST /compute/v2.1/os-aggregates/12/action => generated 227 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:28.504373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-93304df2-f4cf-455f-ad29-799f04fecd64 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:28.505363 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:28.505363 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:28.545490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-35179a20-4324-4e6d-88ef-5019d52d30c8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:28.553026 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-35179a20-4324-4e6d-88ef-5019d52d30c8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1505 microversion: 2.1 time: 0.202100 May 28 04:35:28.553703 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 199/347] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:28 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1505 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:28.611482 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-93304df2-f4cf-455f-ad29-799f04fecd64 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.110888 May 28 04:35:28.612080 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 149/348] 10.222.0.58 () {58 vars in 1154 bytes} [Sat May 28 04:35:28 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 28 04:35:28.622084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2d5b380b-6a45-4c2b-974a-180f7ff79661 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1354109718"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:28.623535 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:28.623535 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:28.624404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.aggregate [None req-2d5b380b-6a45-4c2b-974a-180f7ff79661 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Generated uuid febd78cb-b908-49ca-bef8-7234981d72f3 for aggregate {{(pid=126044) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 04:35:28.753907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9fadd857-637e-48f5-83e5-4aad6ef10c31 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:28.754598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9fadd857-637e-48f5-83e5-4aad6ef10c31 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: a27b8082-4f44-4263-a6a2-86291ea3950b] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:28.760665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fadd857-637e-48f5-83e5-4aad6ef10c31 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:28.761193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fadd857-637e-48f5-83e5-4aad6ef10c31 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:28.762030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fadd857-637e-48f5-83e5-4aad6ef10c31 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:28.762625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fadd857-637e-48f5-83e5-4aad6ef10c31 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:28.764059 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2d5b380b-6a45-4c2b-974a-180f7ff79661 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.144952 May 28 04:35:28.770783 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 200/349] 10.222.0.58 () {60 vars in 1163 bytes} [Sat May 28 04:35:28 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:28.775889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6da0a0fc-97e9-491d-96af-8863340ed9dc tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843700-1"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:28.777162 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:28.777162 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:28.788010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6da0a0fc-97e9-491d-96af-8863340ed9dc tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:28.788472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6da0a0fc-97e9-491d-96af-8863340ed9dc tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:28.791883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:28.899228 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9fadd857-637e-48f5-83e5-4aad6ef10c31 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:28.907511 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9fadd857-637e-48f5-83e5-4aad6ef10c31 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b" status: 200 len: 1318 microversion: 2.1 time: 0.157471 May 28 04:35:28.908313 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 150/350] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:28 2022] GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:29.085572 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6da0a0fc-97e9-491d-96af-8863340ed9dc tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.313676 May 28 04:35:29.086446 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 201/351] 10.222.0.58 () {60 vars in 1193 bytes} [Sat May 28 04:35:28 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:29.096332 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2de87dbb-51d7-450a-95d8-d39532d181ef tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843700-1"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:29.097636 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:29.097636 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:29.106167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2de87dbb-51d7-450a-95d8-d39532d181ef tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:29.106620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2de87dbb-51d7-450a-95d8-d39532d181ef tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:29.143551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8d3bffc6-82e6-4cfd-b6d2-9507c784aa61 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:29.144778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8d3bffc6-82e6-4cfd-b6d2-9507c784aa61 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:29.150926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d3bffc6-82e6-4cfd-b6d2-9507c784aa61 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:29.151426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d3bffc6-82e6-4cfd-b6d2-9507c784aa61 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:29.152204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d3bffc6-82e6-4cfd-b6d2-9507c784aa61 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:29.152648 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d3bffc6-82e6-4cfd-b6d2-9507c784aa61 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:29.296474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8d3bffc6-82e6-4cfd-b6d2-9507c784aa61 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:29.304811 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8d3bffc6-82e6-4cfd-b6d2-9507c784aa61 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1476 microversion: 2.1 time: 0.165236 May 28 04:35:29.305385 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 202/352] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:29 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1476 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:29.367557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c86f4c0c-c44e-49dc-9562-8e2abfed8210 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:29.368181 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c86f4c0c-c44e-49dc-9562-8e2abfed8210 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:29.369014 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2de87dbb-51d7-450a-95d8-d39532d181ef tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.276307 May 28 04:35:29.369914 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 151/353] 10.222.0.58 () {60 vars in 1193 bytes} [Sat May 28 04:35:29 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:29.376454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c86f4c0c-c44e-49dc-9562-8e2abfed8210 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:29.377094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c86f4c0c-c44e-49dc-9562-8e2abfed8210 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:29.378047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c86f4c0c-c44e-49dc-9562-8e2abfed8210 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:29.378493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c86f4c0c-c44e-49dc-9562-8e2abfed8210 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:29.393327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6b03368d-8169-4758-a296-1cc7c890ac3e tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:29.394144 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:29.394144 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:29.512099 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6b03368d-8169-4758-a296-1cc7c890ac3e tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.122417 May 28 04:35:29.517624 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 152/354] 10.222.0.58 () {58 vars in 1154 bytes} [Sat May 28 04:35:29 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 04:35:29.522622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b916cedb-2a09-4287-bea3-491621971b3d req-4149ed88-8b02-4a75-9a21-23be09effa90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158412f0-30ee-458c-9da2-83be853d2ea4", "tag": "3234e2dc-f459-4590-9dd3-6cfbc11536ed"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:29.532846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b916cedb-2a09-4287-bea3-491621971b3d req-4149ed88-8b02-4a75-9a21-23be09effa90 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:29.533294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b916cedb-2a09-4287-bea3-491621971b3d req-4149ed88-8b02-4a75-9a21-23be09effa90 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:29.545314 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b916cedb-2a09-4287-bea3-491621971b3d req-4149ed88-8b02-4a75-9a21-23be09effa90 service nova] Creating event network-changed:3234e2dc-f459-4590-9dd3-6cfbc11536ed for instance 158412f0-30ee-458c-9da2-83be853d2ea4 on n-h1-843700-1 May 28 04:35:29.550736 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b916cedb-2a09-4287-bea3-491621971b3d req-4149ed88-8b02-4a75-9a21-23be09effa90 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032045 May 28 04:35:29.552263 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 153/355] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:29.559083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ccd1623a-d5e3-4b90-936e-59d1ce504ede tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-323767235"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:29.561185 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:29.561185 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:29.562861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.aggregate [None req-ccd1623a-d5e3-4b90-936e-59d1ce504ede tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Generated uuid c2202b5b-c436-4d59-9573-70d1a30c5459 for aggregate {{(pid=126043) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 04:35:29.617834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c86f4c0c-c44e-49dc-9562-8e2abfed8210 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:29.627819 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c86f4c0c-c44e-49dc-9562-8e2abfed8210 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 200 len: 1320 microversion: 2.1 time: 0.265523 May 28 04:35:29.631519 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 203/356] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:29 2022] GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 1320 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:29.640774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-da5d4fdc-0f0f-44a4-a3b7-632595a5fb3e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:29.642898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-da5d4fdc-0f0f-44a4-a3b7-632595a5fb3e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:29.660732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da5d4fdc-0f0f-44a4-a3b7-632595a5fb3e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:29.660732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da5d4fdc-0f0f-44a4-a3b7-632595a5fb3e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:29.660732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da5d4fdc-0f0f-44a4-a3b7-632595a5fb3e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:29.660732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da5d4fdc-0f0f-44a4-a3b7-632595a5fb3e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:29.689818 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ccd1623a-d5e3-4b90-936e-59d1ce504ede tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.136175 May 28 04:35:29.691939 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 154/357] 10.222.0.58 () {60 vars in 1163 bytes} [Sat May 28 04:35:29 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:29.705221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f2fa0615-db59-4b3f-996d-f327b0a629cc tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:29.707614 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:29.707614 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:29.812425 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f2fa0615-db59-4b3f-996d-f327b0a629cc tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.112707 May 28 04:35:29.813628 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 155/358] 10.222.0.58 () {58 vars in 1154 bytes} [Sat May 28 04:35:29 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 04:35:29.825415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ac9153df-e304-42d8-a991-e0f83137841b tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:29.826655 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:29.826655 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:29.836812 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-ac9153df-e304-42d8-a991-e0f83137841b tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] HTTP exception thrown: Aggregate 14 could not be found. May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ac9153df-e304-42d8-a991-e0f83137841b tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Request method failure captured: May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZVf6fPn8NBKww9WB3DPkSrOv0wApLrgyxjEuhMsNhD7sjvjTLg7tzTLhc6hT1xGSr7AUiZtLEAQOU9jCkKtr5y9SZ6geNAc1m-V688t0whnxUniBaJWZBjKErkH_qJUncTaOQwESL1VDX8WcJxmyXa6faf-u6XT2j9-jfTXjwkw0c May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: fe53df2314a8400493a6443f0a788624 May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AggregatesAdminTestJSON-1479230522 May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: X-Role: admin,reader,member May 28 04:35:29.839726 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: admin,reader,member May 28 04:35:29.841188 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fe53df2314a8400493a6443f0a788624"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fe53df2314a8400493a6443f0a788624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe53df2314a8400493a6443f0a788624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe53df2314a8400493a6443f0a788624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:29.841188 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AggregatesAdminTestJSON-1479230522 May 28 04:35:29.841188 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: fe53df2314a8400493a6443f0a788624 May 28 04:35:29.841188 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1479230522 May 28 04:35:29.841188 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AggregatesAdminTestJSON-1479230522-project-admin May 28 04:35:29.841188 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:29.841188 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:29.841188 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 96319cfd94f44e6b9d9bf12fc57ef6d5 May 28 04:35:29.841188 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AggregatesAdminTestJSON-1479230522-project-admin May 28 04:35:29.841188 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:35:29.841188 n-d-843700-1 devstack@n-api.service[126043]: exception: Aggregate 14 could not be found. May 28 04:35:29.841188 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '14'} May 28 04:35:29.841188 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:29.842070 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:29.842070 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 28 04:35:29.842070 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 28 04:35:29.842070 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 28 04:35:29.842070 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 28 04:35:29.842070 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:35:29.842070 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:35:29.842070 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 28 04:35:29.842070 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 28 04:35:29.842070 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:35:29.842070 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:35:29.842070 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 28 04:35:29.842070 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 28 04:35:29.842070 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. May 28 04:35:29.842070 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:29.842070 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:29.842070 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:29.842070 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:29.842070 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:29.843317 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:29.843317 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:29.843317 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:29.843317 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:29.843317 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:29.843317 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 28 04:35:29.843317 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:35:29.843317 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. May 28 04:35:29.843317 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:29.843317 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:29.843317 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:29.843317 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:29.843317 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:29.843317 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:29.843317 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:29.843317 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:29.843317 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. May 28 04:35:29.843317 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:29.847212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ac9153df-e304-42d8-a991-e0f83137841b tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:29.848509 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ac9153df-e304-42d8-a991-e0f83137841b tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.030139 May 28 04:35:29.849254 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 156/359] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:35:29 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:35:29.858698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5c4cbdfb-2947-40fc-b5fe-46a9519dd047 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:29.860028 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:29.860028 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:29.878377 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-5c4cbdfb-2947-40fc-b5fe-46a9519dd047 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] HTTP exception thrown: Aggregate 14 could not be found. May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5c4cbdfb-2947-40fc-b5fe-46a9519dd047 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Request method failure captured: May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZVf6fPn8NBKww9WB3DPkSrOv0wApLrgyxjEuhMsNhD7sjvjTLg7tzTLhc6hT1xGSr7AUiZtLEAQOU9jCkKtr5y9SZ6geNAc1m-V688t0whnxUniBaJWZBjKErkH_qJUncTaOQwESL1VDX8WcJxmyXa6faf-u6XT2j9-jfTXjwkw0c May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: fe53df2314a8400493a6443f0a788624 May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AggregatesAdminTestJSON-1479230522 May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: X-Role: admin,reader,member May 28 04:35:29.880537 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: admin,reader,member May 28 04:35:29.881939 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fe53df2314a8400493a6443f0a788624"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fe53df2314a8400493a6443f0a788624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe53df2314a8400493a6443f0a788624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe53df2314a8400493a6443f0a788624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:29.881939 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AggregatesAdminTestJSON-1479230522 May 28 04:35:29.881939 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: fe53df2314a8400493a6443f0a788624 May 28 04:35:29.881939 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1479230522 May 28 04:35:29.881939 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AggregatesAdminTestJSON-1479230522-project-admin May 28 04:35:29.881939 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:29.881939 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:29.881939 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 96319cfd94f44e6b9d9bf12fc57ef6d5 May 28 04:35:29.881939 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AggregatesAdminTestJSON-1479230522-project-admin May 28 04:35:29.881939 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:35:29.881939 n-d-843700-1 devstack@n-api.service[126043]: exception: Aggregate 14 could not be found. May 28 04:35:29.881939 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '14'} May 28 04:35:29.881939 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:29.882850 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:29.882850 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 28 04:35:29.882850 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 28 04:35:29.882850 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 04:35:29.882850 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 04:35:29.882850 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:29.882850 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:29.882850 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:29.882850 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:29.882850 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 04:35:29.882850 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 04:35:29.882850 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 28 04:35:29.882850 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 28 04:35:29.882850 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:35:29.882850 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:35:29.882850 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 28 04:35:29.882850 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 28 04:35:29.882850 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:35:29.882850 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:29.885099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:29.886972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:29.886972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:29.886972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:29.886972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. May 28 04:35:29.886972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:29.886972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5c4cbdfb-2947-40fc-b5fe-46a9519dd047 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:29.886972 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5c4cbdfb-2947-40fc-b5fe-46a9519dd047 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.031290 May 28 04:35:29.886972 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 157/360] 10.222.0.58 () {58 vars in 1154 bytes} [Sat May 28 04:35:29 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 28 04:35:29.898346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-099f67e7-af59-481e-af03-ae9cf72dd3f8 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-995700738", "name": "tempest-test_aggregate-3483731"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:29.913179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-da5d4fdc-0f0f-44a4-a3b7-632595a5fb3e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:29.939038 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-da5d4fdc-0f0f-44a4-a3b7-632595a5fb3e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1505 microversion: 2.1 time: 0.305660 May 28 04:35:29.942370 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 204/361] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:29 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:29.949111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a7087868-1d0b-4455-898b-aaefae60e820 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:29.949734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a7087868-1d0b-4455-898b-aaefae60e820 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: a27b8082-4f44-4263-a6a2-86291ea3950b] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:29.953705 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:29.953705 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:29.954777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.aggregate [None req-099f67e7-af59-481e-af03-ae9cf72dd3f8 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Generated uuid dea1cd5e-5e19-4a49-b818-f77c0708e726 for aggregate {{(pid=126043) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 04:35:29.976967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7087868-1d0b-4455-898b-aaefae60e820 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:29.982581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7087868-1d0b-4455-898b-aaefae60e820 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:29.982581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7087868-1d0b-4455-898b-aaefae60e820 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:29.982581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7087868-1d0b-4455-898b-aaefae60e820 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:30.124768 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-099f67e7-af59-481e-af03-ae9cf72dd3f8 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 219 microversion: 2.1 time: 0.230780 May 28 04:35:30.125522 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 158/362] 10.222.0.58 () {60 vars in 1164 bytes} [Sat May 28 04:35:29 2022] POST /compute/v2.1/os-aggregates => generated 219 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:30.139391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-24723466-9ada-4bb1-9e98-5e021304fcb8 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:30.141021 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:30.141021 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:30.217544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a7087868-1d0b-4455-898b-aaefae60e820 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:30.227371 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a7087868-1d0b-4455-898b-aaefae60e820 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b" status: 200 len: 1468 microversion: 2.1 time: 0.283350 May 28 04:35:30.228408 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 205/363] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:29 2022] GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b => generated 1468 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:30.253464 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-24723466-9ada-4bb1-9e98-5e021304fcb8 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.121017 May 28 04:35:30.256560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0c748745-f408-437a-8efb-1eb19a60d9e9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1106771391"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:30.256930 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 159/364] 10.222.0.58 () {58 vars in 1154 bytes} [Sat May 28 04:35:30 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 28 04:35:30.258448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0c748745-f408-437a-8efb-1eb19a60d9e9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: a27b8082-4f44-4263-a6a2-86291ea3950b] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:30.265749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=4,nova_api:INSERT=5 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:30.268744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c748745-f408-437a-8efb-1eb19a60d9e9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:30.269518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c748745-f408-437a-8efb-1eb19a60d9e9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:30.270192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c748745-f408-437a-8efb-1eb19a60d9e9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:30.270627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c748745-f408-437a-8efb-1eb19a60d9e9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:30.271539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2bfddbdc-a202-4b9f-b644-57e201841544 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:30.273935 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:30.273935 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:30.288649 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-2bfddbdc-a202-4b9f-b644-57e201841544 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] HTTP exception thrown: Aggregate 15 could not be found. May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2bfddbdc-a202-4b9f-b644-57e201841544 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Request method failure captured: May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/os-aggregates/15 HTTP/1.1 May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZVf6fPn8NBKww9WB3DPkSrOv0wApLrgyxjEuhMsNhD7sjvjTLg7tzTLhc6hT1xGSr7AUiZtLEAQOU9jCkKtr5y9SZ6geNAc1m-V688t0whnxUniBaJWZBjKErkH_qJUncTaOQwESL1VDX8WcJxmyXa6faf-u6XT2j9-jfTXjwkw0c May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: fe53df2314a8400493a6443f0a788624 May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AggregatesAdminTestJSON-1479230522 May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: X-Role: admin,reader,member May 28 04:35:30.290854 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: admin,reader,member May 28 04:35:30.292068 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fe53df2314a8400493a6443f0a788624"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fe53df2314a8400493a6443f0a788624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe53df2314a8400493a6443f0a788624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe53df2314a8400493a6443f0a788624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:30.292068 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AggregatesAdminTestJSON-1479230522 May 28 04:35:30.292068 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: fe53df2314a8400493a6443f0a788624 May 28 04:35:30.292068 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1479230522 May 28 04:35:30.292068 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AggregatesAdminTestJSON-1479230522-project-admin May 28 04:35:30.292068 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:30.292068 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:30.292068 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 96319cfd94f44e6b9d9bf12fc57ef6d5 May 28 04:35:30.292068 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AggregatesAdminTestJSON-1479230522-project-admin May 28 04:35:30.292068 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:35:30.292068 n-d-843700-1 devstack@n-api.service[126043]: exception: Aggregate 15 could not be found. May 28 04:35:30.292068 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '15'} May 28 04:35:30.292068 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:30.292792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:30.292792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 28 04:35:30.292792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 28 04:35:30.292792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 28 04:35:30.292792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 28 04:35:30.292792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:35:30.292792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:35:30.292792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 28 04:35:30.292792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 28 04:35:30.292792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:35:30.292792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:35:30.292792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 28 04:35:30.292792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 28 04:35:30.292792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. May 28 04:35:30.292792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:30.292792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:30.292792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:30.292792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:30.292792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:30.293793 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:30.293793 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:30.293793 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:30.293793 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:30.293793 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:30.293793 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 28 04:35:30.293793 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:35:30.293793 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. May 28 04:35:30.293793 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:30.293793 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:30.293793 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:30.293793 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:30.293793 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:30.293793 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:30.293793 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:30.293793 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:30.293793 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. May 28 04:35:30.293793 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:30.299299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2bfddbdc-a202-4b9f-b644-57e201841544 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:30.301473 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2bfddbdc-a202-4b9f-b644-57e201841544 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.039478 May 28 04:35:30.302671 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 160/365] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:35:30 2022] GET /compute/v2.1/os-aggregates/15 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:35:30.313839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6d46cf86-7384-46a3-8a83-2690f279710d tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:30.319102 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:30.319102 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:30.334702 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-6d46cf86-7384-46a3-8a83-2690f279710d tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] HTTP exception thrown: Aggregate 15 could not be found. May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6d46cf86-7384-46a3-8a83-2690f279710d tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Request method failure captured: May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZVf6fPn8NBKww9WB3DPkSrOv0wApLrgyxjEuhMsNhD7sjvjTLg7tzTLhc6hT1xGSr7AUiZtLEAQOU9jCkKtr5y9SZ6geNAc1m-V688t0whnxUniBaJWZBjKErkH_qJUncTaOQwESL1VDX8WcJxmyXa6faf-u6XT2j9-jfTXjwkw0c May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: fe53df2314a8400493a6443f0a788624 May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AggregatesAdminTestJSON-1479230522 May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: X-Role: admin,reader,member May 28 04:35:30.336974 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: admin,reader,member May 28 04:35:30.338233 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fe53df2314a8400493a6443f0a788624"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fe53df2314a8400493a6443f0a788624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe53df2314a8400493a6443f0a788624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe53df2314a8400493a6443f0a788624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:30.338233 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AggregatesAdminTestJSON-1479230522 May 28 04:35:30.338233 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: fe53df2314a8400493a6443f0a788624 May 28 04:35:30.338233 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1479230522 May 28 04:35:30.338233 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AggregatesAdminTestJSON-1479230522-project-admin May 28 04:35:30.338233 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:30.338233 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:30.338233 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 96319cfd94f44e6b9d9bf12fc57ef6d5 May 28 04:35:30.338233 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AggregatesAdminTestJSON-1479230522-project-admin May 28 04:35:30.338233 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:35:30.338233 n-d-843700-1 devstack@n-api.service[126043]: exception: Aggregate 15 could not be found. May 28 04:35:30.338233 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '15'} May 28 04:35:30.338233 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:30.338924 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:30.338924 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 28 04:35:30.338924 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 28 04:35:30.338924 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 04:35:30.338924 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 04:35:30.338924 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:30.338924 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:30.338924 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:30.338924 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:30.338924 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 04:35:30.338924 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 04:35:30.338924 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 28 04:35:30.338924 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 28 04:35:30.338924 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:35:30.338924 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:35:30.338924 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 28 04:35:30.338924 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 28 04:35:30.338924 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:35:30.338924 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:30.340103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:30.341415 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:30.341415 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:30.341415 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:30.341415 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. May 28 04:35:30.341415 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:30.341415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6d46cf86-7384-46a3-8a83-2690f279710d tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:30.342517 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6d46cf86-7384-46a3-8a83-2690f279710d tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.035679 May 28 04:35:30.346334 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 161/366] 10.222.0.58 () {58 vars in 1154 bytes} [Sat May 28 04:35:30 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 28 04:35:30.366552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1f4cdb48-513e-4f3b-92d3-fd23628bad1b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:30.367406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1f4cdb48-513e-4f3b-92d3-fd23628bad1b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:30.384512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1f4cdb48-513e-4f3b-92d3-fd23628bad1b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:30.384967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1f4cdb48-513e-4f3b-92d3-fd23628bad1b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:30.385740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1f4cdb48-513e-4f3b-92d3-fd23628bad1b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:30.386194 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1f4cdb48-513e-4f3b-92d3-fd23628bad1b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:30.487023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=14 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:30.543394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1f4cdb48-513e-4f3b-92d3-fd23628bad1b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:30.553938 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1f4cdb48-513e-4f3b-92d3-fd23628bad1b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1476 microversion: 2.1 time: 0.198565 May 28 04:35:30.554837 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 162/367] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:30 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1476 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:30.560775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f3c3bf83-2a25-49b5-a0ea-fc513805a647 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1019696393"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:30.562645 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:30.562645 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:30.563597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.aggregate [None req-f3c3bf83-2a25-49b5-a0ea-fc513805a647 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Generated uuid 9120e7ff-734c-4db5-b067-de2b75728ab4 for aggregate {{(pid=126043) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 04:35:30.673344 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f3c3bf83-2a25-49b5-a0ea-fc513805a647 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.117100 May 28 04:35:30.680223 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 163/368] 10.222.0.58 () {60 vars in 1163 bytes} [Sat May 28 04:35:30 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:30.685463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-11bd4a59-aed8-4f87-875d-a167709b52e9 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:30.686185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-11bd4a59-aed8-4f87-875d-a167709b52e9 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:30.694087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11bd4a59-aed8-4f87-875d-a167709b52e9 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:30.695571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11bd4a59-aed8-4f87-875d-a167709b52e9 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:30.700921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11bd4a59-aed8-4f87-875d-a167709b52e9 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:30.700921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11bd4a59-aed8-4f87-875d-a167709b52e9 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:30.842736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-11bd4a59-aed8-4f87-875d-a167709b52e9 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:30.851619 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-11bd4a59-aed8-4f87-875d-a167709b52e9 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 200 len: 1320 microversion: 2.1 time: 0.170016 May 28 04:35:30.861161 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 164/369] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:30 2022] GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 1320 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:30.861161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5c891542-acc4-4b9e-987e-a66743c6db45 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:30.861161 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:30.861161 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:30.862238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=12,nova_api:INSERT=5 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:30.866561 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5c891542-acc4-4b9e-987e-a66743c6db45 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.011604 May 28 04:35:30.867109 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 165/370] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:35:30 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:30.880327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4c18699a-ccce-4e2e-abc7-f369b4cdc6ba tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:30.882886 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:30.882886 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:30.886800 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0c748745-f408-437a-8efb-1eb19a60d9e9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "POST /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b/action" status: 202 len: 0 microversion: 2.1 time: 0.645442 May 28 04:35:30.887567 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 206/371] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:35:30 2022] POST /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 04:35:30.898352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b993d100-e8bb-4f1b-86f9-9ff6f4541eb3 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7702077a60>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:30.945397 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b993d100-e8bb-4f1b-86f9-9ff6f4541eb3 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.051975 May 28 04:35:30.945984 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 207/372] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:30 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:30.957539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5c4bc3a4-c82b-4af6-95b9-4cb0bdefaf43 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:30.961545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5c4bc3a4-c82b-4af6-95b9-4cb0bdefaf43 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:30.965801 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4c18699a-ccce-4e2e-abc7-f369b4cdc6ba tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.089162 May 28 04:35:30.973463 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 166/373] 10.222.0.58 () {60 vars in 1193 bytes} [Sat May 28 04:35:30 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:35:30.979260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5ecf00d5-4f51-4b58-a5d6-b653b9324781 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:30.980078 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:30.980078 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:30.980271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c4bc3a4-c82b-4af6-95b9-4cb0bdefaf43 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:30.980836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c4bc3a4-c82b-4af6-95b9-4cb0bdefaf43 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:30.981651 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c4bc3a4-c82b-4af6-95b9-4cb0bdefaf43 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:30.983996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c4bc3a4-c82b-4af6-95b9-4cb0bdefaf43 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:30.989404 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5ecf00d5-4f51-4b58-a5d6-b653b9324781 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.014627 May 28 04:35:30.989974 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 167/374] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:35:30 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:31.000861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c835a17e-362b-44f1-bd93-2bba20713577 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:31.001826 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:31.001826 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:31.071067 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c835a17e-362b-44f1-bd93-2bba20713577 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.073966 May 28 04:35:31.075179 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 168/375] 10.222.0.58 () {58 vars in 1154 bytes} [Sat May 28 04:35:30 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 28 04:35:31.087470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6c4f8a72-8ff8-47ad-bb79-99fc252dae94 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-382828253", "availability_zone": "tempest-test_az-1813427243"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:31.091480 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:31.091480 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:31.096984 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.aggregate [None req-6c4f8a72-8ff8-47ad-bb79-99fc252dae94 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Generated uuid ba9bc5c6-7762-47cd-9319-f1867fed77ef for aggregate {{(pid=126043) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 04:35:31.155792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5c4bc3a4-c82b-4af6-95b9-4cb0bdefaf43 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:31.163859 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5c4bc3a4-c82b-4af6-95b9-4cb0bdefaf43 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1505 microversion: 2.1 time: 0.211182 May 28 04:35:31.174059 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 208/376] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:30 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1505 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:31.195847 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6c4f8a72-8ff8-47ad-bb79-99fc252dae94 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.118511 May 28 04:35:31.196693 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 169/377] 10.222.0.58 () {60 vars in 1164 bytes} [Sat May 28 04:35:31 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:35:31.206487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-03c21a06-e507-4133-ada8-ecce8dffab09 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-382828253_new", "availability_zone": "tempest-test_az-1813427243_new"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:31.306000 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:31.306000 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:31.436940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03c21a06-e507-4133-ada8-ecce8dffab09 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:31.437577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03c21a06-e507-4133-ada8-ecce8dffab09 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:31.530016 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-03c21a06-e507-4133-ada8-ecce8dffab09 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 336 microversion: 2.1 time: 0.327441 May 28 04:35:31.530731 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 209/378] 10.222.0.58 () {60 vars in 1172 bytes} [Sat May 28 04:35:31 2022] PUT /compute/v2.1/os-aggregates/17 => generated 336 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:31.540988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fe4dc950-0ddd-4319-8683-d1c862e365f0 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:31.542081 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:31.542081 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:31.551345 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fe4dc950-0ddd-4319-8683-d1c862e365f0 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.013493 May 28 04:35:31.552328 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 170/379] 10.222.0.58 () {58 vars in 1142 bytes} [Sat May 28 04:35:31 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:31.562165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-05473631-f6a4-4ec5-8a97-bf35f016aeaa tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:31.562981 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:31.562981 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:31.571796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7405e639-02a9-4242-a6fd-3cdf7de1cca1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:31.572535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7405e639-02a9-4242-a6fd-3cdf7de1cca1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:31.578741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7405e639-02a9-4242-a6fd-3cdf7de1cca1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:31.579309 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7405e639-02a9-4242-a6fd-3cdf7de1cca1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:31.580223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7405e639-02a9-4242-a6fd-3cdf7de1cca1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:31.580866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7405e639-02a9-4242-a6fd-3cdf7de1cca1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:31.644241 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-05473631-f6a4-4ec5-8a97-bf35f016aeaa tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.085752 May 28 04:35:31.662047 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 210/380] 10.222.0.58 () {58 vars in 1154 bytes} [Sat May 28 04:35:31 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 04:35:31.667519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-67e4a20a-6a3e-477a-9e7d-0e02a7b159e1 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-875891097"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:31.668884 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:31.668884 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:31.670081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.aggregate [None req-67e4a20a-6a3e-477a-9e7d-0e02a7b159e1 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Generated uuid 79551291-00bc-4158-b88b-58ee80fef3a7 for aggregate {{(pid=126044) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 04:35:31.758762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7405e639-02a9-4242-a6fd-3cdf7de1cca1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:31.761228 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:31.767736 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7405e639-02a9-4242-a6fd-3cdf7de1cca1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1476 microversion: 2.1 time: 0.199999 May 28 04:35:31.768313 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 171/381] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:31 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1476 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:31.790319 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-67e4a20a-6a3e-477a-9e7d-0e02a7b159e1 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.127012 May 28 04:35:31.793175 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 211/382] 10.222.0.58 () {60 vars in 1163 bytes} [Sat May 28 04:35:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:31.803331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aac82b4c-feab-48a8-892c-a1a1d8834f12 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:31.804388 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:31.804388 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:31.812141 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aac82b4c-feab-48a8-892c-a1a1d8834f12 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.013085 May 28 04:35:31.813276 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 172/383] 10.222.0.58 () {58 vars in 1142 bytes} [Sat May 28 04:35:31 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:31.828456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-51758317-0c1a-4d0f-96f5-685cb9f96f78 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:31.829568 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:31.829568 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:31.835848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-85211a60-124b-418d-935d-a9b7bd441a80 req-f3663956-e063-4f6c-9123-ddea7ba943db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bac9c02e-1bd0-420e-8a7f-1d530dceae26", "name": "network-vif-plugged", "status": "completed", "tag": "8488de26-4471-44b2-87b5-50fdf5dfd1de"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:31.849622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-85211a60-124b-418d-935d-a9b7bd441a80 req-f3663956-e063-4f6c-9123-ddea7ba943db service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:31.850222 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-85211a60-124b-418d-935d-a9b7bd441a80 req-f3663956-e063-4f6c-9123-ddea7ba943db service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:31.862789 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-85211a60-124b-418d-935d-a9b7bd441a80 req-f3663956-e063-4f6c-9123-ddea7ba943db service nova] Creating event network-vif-plugged:8488de26-4471-44b2-87b5-50fdf5dfd1de for instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 on n-h1-843700-1 May 28 04:35:31.867031 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-85211a60-124b-418d-935d-a9b7bd441a80 req-f3663956-e063-4f6c-9123-ddea7ba943db service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036991 May 28 04:35:31.867624 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 173/384] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:35:31.873080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3336eb1b-6f3f-4b1e-b2f3-a62114282b62 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:31.873775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3336eb1b-6f3f-4b1e-b2f3-a62114282b62 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:31.880594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3336eb1b-6f3f-4b1e-b2f3-a62114282b62 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:31.881295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3336eb1b-6f3f-4b1e-b2f3-a62114282b62 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:31.882068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3336eb1b-6f3f-4b1e-b2f3-a62114282b62 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:31.882654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3336eb1b-6f3f-4b1e-b2f3-a62114282b62 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:31.955361 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-51758317-0c1a-4d0f-96f5-685cb9f96f78 tempest-AggregatesAdminTestJSON-1479230522 tempest-AggregatesAdminTestJSON-1479230522-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.130562 May 28 04:35:31.957850 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 212/385] 10.222.0.58 () {58 vars in 1154 bytes} [Sat May 28 04:35:31 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 04:35:31.966341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5007eb8a-930d-4b0c-9468-d2f205b84c6a tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7702217280>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:32.020569 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5007eb8a-930d-4b0c-9468-d2f205b84c6a tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.061517 May 28 04:35:32.021697 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 213/386] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:31 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:32.030374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bb2fe14c-9355-49cb-90ae-51fb59b91869 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:32.030374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bb2fe14c-9355-49cb-90ae-51fb59b91869 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:32.035635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb2fe14c-9355-49cb-90ae-51fb59b91869 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:32.036920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb2fe14c-9355-49cb-90ae-51fb59b91869 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:32.037767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb2fe14c-9355-49cb-90ae-51fb59b91869 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:32.038268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb2fe14c-9355-49cb-90ae-51fb59b91869 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:32.053129 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-bb2fe14c-9355-49cb-90ae-51fb59b91869 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] HTTP exception thrown: Instance 38c431c1-9eaa-4508-94b0-05614a36f135 could not be found. May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bb2fe14c-9355-49cb-90ae-51fb59b91869 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Request method failure captured: May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 HTTP/1.1 May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZSV6m9Yucf153-fIumuU6MUHneujQ83RHGLwVKIsiQTb_uQboUNJGgKcBKYitW38V9JQ4b35tq-T7bKBgXaX0VwhYOHU-luWBQZpphzWFoMfeZA5B5e-nxJb_s2JbRudB5vuxkoDDdK5mz5LsRwm-PrEK25mYt44DdOc1bE5XFjTM May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 89ba54e5cecc4c1d93d39b53b41fbc4d May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AggregatesAdminTestJSON-1180716365 May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:35:32.054839 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:35:32.059997 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_89ba54e5cecc4c1d93d39b53b41fbc4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/89ba54e5cecc4c1d93d39b53b41fbc4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/89ba54e5cecc4c1d93d39b53b41fbc4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/89ba54e5cecc4c1d93d39b53b41fbc4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:32.059997 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AggregatesAdminTestJSON-1180716365 May 28 04:35:32.059997 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 89ba54e5cecc4c1d93d39b53b41fbc4d May 28 04:35:32.059997 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1180716365 May 28 04:35:32.059997 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AggregatesAdminTestJSON-1180716365-project May 28 04:35:32.059997 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:32.059997 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:32.059997 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 38dd516851bb4185a3b4c2d5560c4b2b May 28 04:35:32.059997 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AggregatesAdminTestJSON-1180716365-project May 28 04:35:32.059997 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:35:32.059997 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 38c431c1-9eaa-4508-94b0-05614a36f135 could not be found. May 28 04:35:32.059997 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '38c431c1-9eaa-4508-94b0-05614a36f135'} May 28 04:35:32.060699 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:32.060699 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:32.060699 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:35:32.060699 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:35:32.060699 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:35:32.060699 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:35:32.060699 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:35:32.060699 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:35:32.060699 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:35:32.060699 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:35:32.060699 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c431c1-9eaa-4508-94b0-05614a36f135 could not be found. May 28 04:35:32.060699 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:32.060699 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:32.060699 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:32.060699 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:32.060699 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:32.060699 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:32.060699 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:32.060699 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:32.060699 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:32.061742 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:32.061742 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:35:32.061742 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:35:32.061742 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:35:32.061742 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:35:32.061742 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:35:32.061742 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:35:32.061742 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:35:32.061742 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:35:32.061742 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c431c1-9eaa-4508-94b0-05614a36f135 could not be found. May 28 04:35:32.061742 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:32.061742 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:32.061742 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:32.061742 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:32.061742 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:32.061742 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:32.061742 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:32.061742 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:32.061742 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c431c1-9eaa-4508-94b0-05614a36f135 could not be found. May 28 04:35:32.061742 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:32.062750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bb2fe14c-9355-49cb-90ae-51fb59b91869 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Returning 404 to user: Instance 38c431c1-9eaa-4508-94b0-05614a36f135 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:32.062750 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bb2fe14c-9355-49cb-90ae-51fb59b91869 tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "DELETE /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 404 len: 111 microversion: 2.1 time: 0.033481 May 28 04:35:32.062750 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 214/387] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:35:32 2022] DELETE /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:32.069538 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d86a546e-8244-41c9-81a6-eebb31745aae tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:32.070596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d86a546e-8244-41c9-81a6-eebb31745aae tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] [instance: 38c431c1-9eaa-4508-94b0-05614a36f135] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:32.074577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3336eb1b-6f3f-4b1e-b2f3-a62114282b62 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:32.077485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d86a546e-8244-41c9-81a6-eebb31745aae tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:32.079065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d86a546e-8244-41c9-81a6-eebb31745aae tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:32.080182 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d86a546e-8244-41c9-81a6-eebb31745aae tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:32.081071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d86a546e-8244-41c9-81a6-eebb31745aae tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:32.083680 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3336eb1b-6f3f-4b1e-b2f3-a62114282b62 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 200 len: 1320 microversion: 2.1 time: 0.214342 May 28 04:35:32.084272 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 174/388] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:31 2022] GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 1320 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:32.096854 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-d86a546e-8244-41c9-81a6-eebb31745aae tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] HTTP exception thrown: Instance 38c431c1-9eaa-4508-94b0-05614a36f135 could not be found. May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d86a546e-8244-41c9-81a6-eebb31745aae tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Request method failure captured: May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 HTTP/1.1 May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZSV6m9Yucf153-fIumuU6MUHneujQ83RHGLwVKIsiQTb_uQboUNJGgKcBKYitW38V9JQ4b35tq-T7bKBgXaX0VwhYOHU-luWBQZpphzWFoMfeZA5B5e-nxJb_s2JbRudB5vuxkoDDdK5mz5LsRwm-PrEK25mYt44DdOc1bE5XFjTM May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 89ba54e5cecc4c1d93d39b53b41fbc4d May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AggregatesAdminTestJSON-1180716365 May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:35:32.098427 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:35:32.099864 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_89ba54e5cecc4c1d93d39b53b41fbc4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/89ba54e5cecc4c1d93d39b53b41fbc4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/89ba54e5cecc4c1d93d39b53b41fbc4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/89ba54e5cecc4c1d93d39b53b41fbc4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:32.099864 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AggregatesAdminTestJSON-1180716365 May 28 04:35:32.099864 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 89ba54e5cecc4c1d93d39b53b41fbc4d May 28 04:35:32.099864 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1180716365 May 28 04:35:32.099864 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AggregatesAdminTestJSON-1180716365-project May 28 04:35:32.099864 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:32.099864 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:32.099864 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 38dd516851bb4185a3b4c2d5560c4b2b May 28 04:35:32.099864 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AggregatesAdminTestJSON-1180716365-project May 28 04:35:32.099864 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:35:32.099864 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 38c431c1-9eaa-4508-94b0-05614a36f135 could not be found. May 28 04:35:32.099864 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '38c431c1-9eaa-4508-94b0-05614a36f135'} May 28 04:35:32.100524 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:32.100524 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:32.100524 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:35:32.100524 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:35:32.100524 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:35:32.100524 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:35:32.100524 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:35:32.100524 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:35:32.100524 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:35:32.100524 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:35:32.100524 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c431c1-9eaa-4508-94b0-05614a36f135 could not be found. May 28 04:35:32.100524 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:32.100524 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:32.100524 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:32.100524 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:32.100524 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:32.100524 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:32.100524 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:32.100524 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:32.100524 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:32.101565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:32.101565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:35:32.101565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:35:32.101565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:35:32.101565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:35:32.101565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:35:32.101565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:35:32.101565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c431c1-9eaa-4508-94b0-05614a36f135 could not be found. May 28 04:35:32.101565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:32.101565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:32.101565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:32.101565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:32.101565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:32.101565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:32.101565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:32.101565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:32.101565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c431c1-9eaa-4508-94b0-05614a36f135 could not be found. May 28 04:35:32.101565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:32.102476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d86a546e-8244-41c9-81a6-eebb31745aae tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] Returning 404 to user: Instance 38c431c1-9eaa-4508-94b0-05614a36f135 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:32.102476 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d86a546e-8244-41c9-81a6-eebb31745aae tempest-AggregatesAdminTestJSON-1180716365 tempest-AggregatesAdminTestJSON-1180716365-project] 10.222.0.58 "GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135" status: 404 len: 111 microversion: 2.1 time: 0.035040 May 28 04:35:32.102476 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 215/389] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:32 2022] GET /compute/v2.1/servers/38c431c1-9eaa-4508-94b0-05614a36f135 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:32.181269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b0c00cbc-0aab-46fe-a51f-e412a0f3ccb3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:32.182259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b0c00cbc-0aab-46fe-a51f-e412a0f3ccb3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:32.188658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0c00cbc-0aab-46fe-a51f-e412a0f3ccb3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:32.189122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0c00cbc-0aab-46fe-a51f-e412a0f3ccb3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:32.189913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0c00cbc-0aab-46fe-a51f-e412a0f3ccb3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:32.190353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0c00cbc-0aab-46fe-a51f-e412a0f3ccb3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:32.339415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b0c00cbc-0aab-46fe-a51f-e412a0f3ccb3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:32.346112 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b0c00cbc-0aab-46fe-a51f-e412a0f3ccb3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1505 microversion: 2.1 time: 0.168957 May 28 04:35:32.346673 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 175/390] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:32 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:32.785866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eb3e1fd2-9014-4678-aee9-389c775a1dd4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:32.786485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-eb3e1fd2-9014-4678-aee9-389c775a1dd4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:32.792581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb3e1fd2-9014-4678-aee9-389c775a1dd4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:32.793039 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb3e1fd2-9014-4678-aee9-389c775a1dd4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:32.793807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb3e1fd2-9014-4678-aee9-389c775a1dd4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:32.794247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb3e1fd2-9014-4678-aee9-389c775a1dd4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:32.949957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-eb3e1fd2-9014-4678-aee9-389c775a1dd4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:32.960143 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-eb3e1fd2-9014-4678-aee9-389c775a1dd4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1476 microversion: 2.1 time: 0.178134 May 28 04:35:32.960731 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 216/391] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:32 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1476 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:33.034019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-90aef2b2-a364-4aba-9d40-ee6fcc0ceccd tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f770219c940>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:33.090335 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-90aef2b2-a364-4aba-9d40-ee6fcc0ceccd tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.060402 May 28 04:35:33.099820 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 176/392] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:33 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:33.104405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8b3a010a-25c8-44a8-ae1c-5c9fa6d5186a tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:33.105007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8b3a010a-25c8-44a8-ae1c-5c9fa6d5186a tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:33.114374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b3a010a-25c8-44a8-ae1c-5c9fa6d5186a tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:33.115065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b3a010a-25c8-44a8-ae1c-5c9fa6d5186a tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:33.116147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b3a010a-25c8-44a8-ae1c-5c9fa6d5186a tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:33.116907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b3a010a-25c8-44a8-ae1c-5c9fa6d5186a tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:33.311412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8b3a010a-25c8-44a8-ae1c-5c9fa6d5186a tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:33.327767 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8b3a010a-25c8-44a8-ae1c-5c9fa6d5186a tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 200 len: 1320 microversion: 2.1 time: 0.219766 May 28 04:35:33.327767 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 217/393] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:33 2022] GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:33.365153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e579af87-1be1-4d22-b150-7638781367ab tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:33.366013 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e579af87-1be1-4d22-b150-7638781367ab tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:33.372301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e579af87-1be1-4d22-b150-7638781367ab tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:33.372933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e579af87-1be1-4d22-b150-7638781367ab tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:33.373810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e579af87-1be1-4d22-b150-7638781367ab tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:33.374350 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e579af87-1be1-4d22-b150-7638781367ab tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:33.510517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cf29951e-a627-4916-9798-2f33147089a5 tempest-QuotaClassesAdmin257Test-765738431 tempest-QuotaClassesAdmin257Test-765738431-project-admin] Calling method '.version_select at 0x7f770213a4c0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:33.511609 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:33.511609 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:33.527882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e579af87-1be1-4d22-b150-7638781367ab tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:33.531341 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cf29951e-a627-4916-9798-2f33147089a5 tempest-QuotaClassesAdmin257Test-765738431 tempest-QuotaClassesAdmin257Test-765738431-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.259401 May 28 04:35:33.532182 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 177/394] 10.222.0.58 () {60 vars in 1225 bytes} [Sat May 28 04:35:33 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:35:33.541070 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e579af87-1be1-4d22-b150-7638781367ab tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1505 microversion: 2.1 time: 0.181199 May 28 04:35:33.541673 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 218/395] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:33 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:33.546281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c33d32d1-bf86-4666-85bb-cf3239158127 tempest-QuotaClassesAdmin257Test-765738431 tempest-QuotaClassesAdmin257Test-765738431-project-admin] Action: 'update', calling method: .version_select at 0x7f770246e9d0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:33.547835 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:33.547835 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:33.796940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8d295ad7-8b72-4b8e-9e4e-50127a453679 tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] Calling method '.version_select at 0x7f7702419040>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:33.797726 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:33.797726 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:33.798970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8d295ad7-8b72-4b8e-9e4e-50127a453679 tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'c4c41e3f02f0488388f26a07747d3271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d35181bed49849d9faf66da0ee3cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8d295ad7-8b72-4b8e-9e4e-50127a453679 tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] Request method failure captured: May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaaTiPFotpPiTIaV6nAz_-SqWNHLdRN0oo-U8hTHSxWFH74eaQFJ3twYn7QJQ5rPGeUxtEXogN-TjS8vbxPuBRgUEntEcNPp8qIn43dOrREKFPYGMyPLSshzo7rFos4zARdmPb7Q-Y9XqqeyPDLeEi0qFY45WYX2rGmhDxpk4q-h7hg May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: ed9d35181bed49849d9faf66da0ee3cf May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-346484782 May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:35:33.800689 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:35:33.802098 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ed9d35181bed49849d9faf66da0ee3cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ed9d35181bed49849d9faf66da0ee3cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed9d35181bed49849d9faf66da0ee3cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed9d35181bed49849d9faf66da0ee3cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:33.802098 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-346484782 May 28 04:35:33.802098 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: ed9d35181bed49849d9faf66da0ee3cf May 28 04:35:33.802098 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-346484782 May 28 04:35:33.802098 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-HypervisorAdminNegativeTestJSON-346484782-project May 28 04:35:33.802098 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:33.802098 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:33.802098 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c4c41e3f02f0488388f26a07747d3271 May 28 04:35:33.802098 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-346484782-project May 28 04:35:33.802098 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:35:33.802098 n-d-843700-1 devstack@n-api.service[126043]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 28 04:35:33.802098 n-d-843700-1 devstack@n-api.service[126043]: action_args: {} May 28 04:35:33.802098 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:33.803033 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:33.803033 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:33.803033 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:33.803033 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:33.803033 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:33.803033 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:33.803033 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:33.803033 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:33.803033 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:33.803033 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail May 28 04:35:33.803033 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._detail(req) May 28 04:35:33.803033 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail May 28 04:35:33.803033 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) May 28 04:35:33.803033 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:33.803033 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:33.803033 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:33.803033 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:33.803033 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:33.803033 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:33.804203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:33.804203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:33.804203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:33.804203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:33.804203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:33.804203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:33.804203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:33.804203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:33.804203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 28 04:35:33.804203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:33.804203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:33.804203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:33.804203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:33.804203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:33.804203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:33.804203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:33.804203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:33.804203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 28 04:35:33.804203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:33.805347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8d295ad7-8b72-4b8e-9e4e-50127a453679 tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:33.805347 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8d295ad7-8b72-4b8e-9e4e-50127a453679 tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.268772 May 28 04:35:33.810476 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 178/396] 10.222.0.58 () {58 vars in 1166 bytes} [Sat May 28 04:35:33 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 278 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:33.920391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8817f7ac-6bd3-4d5e-a6fe-5d0e8f5aa585 tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-674915855", "ram": 512, "vcpus": 1, "disk": 10, "id": 736220231, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:33.922043 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:33.922043 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:34.021291 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8817f7ac-6bd3-4d5e-a6fe-5d0e8f5aa585 tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.209659 May 28 04:35:34.022170 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 179/397] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:35:33 2022] POST /compute/v2.1/flavors => generated 412 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:34.027607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-93f916b0-2447-423b-a165-f55ee5b60672 tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] Calling method '.version_select at 0x7f7702168040>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:34.032915 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:34.032915 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:34.032915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-93f916b0-2447-423b-a165-f55ee5b60672 tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'c4c41e3f02f0488388f26a07747d3271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d35181bed49849d9faf66da0ee3cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:34.032915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-93f916b0-2447-423b-a165-f55ee5b60672 tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] Request method failure captured: May 28 04:35:34.032915 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 May 28 04:35:34.032915 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:34.032915 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:34.032915 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:34.032915 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:35:34.032915 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:34.032915 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:34.032915 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:34.032915 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:34.032915 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaaTiPFotpPiTIaV6nAz_-SqWNHLdRN0oo-U8hTHSxWFH74eaQFJ3twYn7QJQ5rPGeUxtEXogN-TjS8vbxPuBRgUEntEcNPp8qIn43dOrREKFPYGMyPLSshzo7rFos4zARdmPb7Q-Y9XqqeyPDLeEi0qFY45WYX2rGmhDxpk4q-h7hg May 28 04:35:34.032915 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:34.032915 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:34.032915 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:34.032915 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:34.032915 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:34.032915 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:34.034764 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: ed9d35181bed49849d9faf66da0ee3cf May 28 04:35:34.034764 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-346484782 May 28 04:35:34.034764 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:35:34.034764 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:35:34.034764 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ed9d35181bed49849d9faf66da0ee3cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ed9d35181bed49849d9faf66da0ee3cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed9d35181bed49849d9faf66da0ee3cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed9d35181bed49849d9faf66da0ee3cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:34.034764 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-346484782 May 28 04:35:34.034764 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: ed9d35181bed49849d9faf66da0ee3cf May 28 04:35:34.034764 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-346484782 May 28 04:35:34.034764 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-HypervisorAdminNegativeTestJSON-346484782-project May 28 04:35:34.034764 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:34.034764 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:34.034764 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c4c41e3f02f0488388f26a07747d3271 May 28 04:35:34.034764 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-346484782-project May 28 04:35:34.034764 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:35:34.036184 n-d-843700-1 devstack@n-api.service[126043]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 28 04:35:34.036184 n-d-843700-1 devstack@n-api.service[126043]: action_args: {} May 28 04:35:34.036184 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:34.036184 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:34.036184 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:34.036184 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:34.036184 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:34.036184 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:34.036184 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:34.036184 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:34.036184 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:34.036184 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:34.036184 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index May 28 04:35:34.036184 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._index(req) May 28 04:35:34.036184 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index May 28 04:35:34.036184 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) May 28 04:35:34.036184 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:34.036184 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:34.036184 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:34.036184 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:34.037481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:34.037481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:34.037481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:34.037481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:34.037481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:34.037481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:34.037481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:34.037481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:34.037481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:34.037481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:34.037481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 28 04:35:34.037481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:34.037481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:34.037481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:34.037481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:34.037481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:34.037481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:34.037481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:34.037481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:34.037481 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 28 04:35:34.039083 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:34.039083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-93f916b0-2447-423b-a165-f55ee5b60672 tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:34.039822 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-93f916b0-2447-423b-a165-f55ee5b60672 tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.009501 May 28 04:35:34.040400 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 180/398] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:35:34 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:34.045115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-169976aa-dfdc-4cb2-a580-19bdee13a512 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:34.045741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-169976aa-dfdc-4cb2-a580-19bdee13a512 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:34.052069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-169976aa-dfdc-4cb2-a580-19bdee13a512 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:34.052604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-169976aa-dfdc-4cb2-a580-19bdee13a512 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:34.053397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-169976aa-dfdc-4cb2-a580-19bdee13a512 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:34.053840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-169976aa-dfdc-4cb2-a580-19bdee13a512 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:34.202023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-169976aa-dfdc-4cb2-a580-19bdee13a512 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:34.212120 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-169976aa-dfdc-4cb2-a580-19bdee13a512 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1476 microversion: 2.1 time: 0.170525 May 28 04:35:34.213022 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 181/399] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:34 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1476 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:34.214731 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c33d32d1-bf86-4666-85bb-cf3239158127 tempest-QuotaClassesAdmin257Test-765738431 tempest-QuotaClassesAdmin257Test-765738431-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.671839 May 28 04:35:34.215622 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 219/400] 10.222.0.58 () {62 vars in 1246 bytes} [Sat May 28 04:35:33 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:35:34.224973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b68bbb54-36fa-4a8d-9fdf-32ac09f76797 tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] Calling method '.version_select at 0x7f770200a940>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:34.225821 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:34.225821 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:34.229274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b68bbb54-36fa-4a8d-9fdf-32ac09f76797 tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'c4c41e3f02f0488388f26a07747d3271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d35181bed49849d9faf66da0ee3cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b68bbb54-36fa-4a8d-9fdf-32ac09f76797 tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] Request method failure captured: May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaaTiPFotpPiTIaV6nAz_-SqWNHLdRN0oo-U8hTHSxWFH74eaQFJ3twYn7QJQ5rPGeUxtEXogN-TjS8vbxPuBRgUEntEcNPp8qIn43dOrREKFPYGMyPLSshzo7rFos4zARdmPb7Q-Y9XqqeyPDLeEi0qFY45WYX2rGmhDxpk4q-h7hg May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: ed9d35181bed49849d9faf66da0ee3cf May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-346484782 May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:35:34.231098 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:35:34.234684 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ed9d35181bed49849d9faf66da0ee3cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ed9d35181bed49849d9faf66da0ee3cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed9d35181bed49849d9faf66da0ee3cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed9d35181bed49849d9faf66da0ee3cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:34.234684 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-346484782 May 28 04:35:34.234684 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: ed9d35181bed49849d9faf66da0ee3cf May 28 04:35:34.234684 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-346484782 May 28 04:35:34.234684 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-HypervisorAdminNegativeTestJSON-346484782-project May 28 04:35:34.234684 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:34.234684 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:34.234684 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: c4c41e3f02f0488388f26a07747d3271 May 28 04:35:34.234684 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-346484782-project May 28 04:35:34.234684 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:35:34.234684 n-d-843700-1 devstack@n-api.service[126044]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 28 04:35:34.234684 n-d-843700-1 devstack@n-api.service[126044]: action_args: {} May 28 04:35:34.234684 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:34.235552 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:34.235552 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:34.235552 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:34.235552 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:34.235552 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:34.235552 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:34.235552 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:34.235552 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:34.235552 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:34.235552 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics May 28 04:35:34.235552 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) May 28 04:35:34.235552 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:34.235552 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:34.235552 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:34.235552 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:34.235552 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:34.235552 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:34.235552 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:34.235552 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:34.236531 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:34.236531 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:34.236531 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:34.236531 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:34.236531 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:34.236531 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:34.236531 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 28 04:35:34.236531 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:34.236531 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:34.236531 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:34.236531 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:34.236531 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:34.236531 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:34.236531 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:34.236531 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:34.236531 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 28 04:35:34.236531 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:34.238116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-daa35b43-84d9-4cf3-8157-9f7ca8bf4b96 tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:34.238116 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:34.238116 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:34.238437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b68bbb54-36fa-4a8d-9fdf-32ac09f76797 tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:34.238437 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b68bbb54-36fa-4a8d-9fdf-32ac09f76797 tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.018654 May 28 04:35:34.238437 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 220/401] 10.222.0.58 () {58 vars in 1178 bytes} [Sat May 28 04:35:34 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:34.245002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-de414071-9566-478d-90ba-49b53124624e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701fb7670>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:34.308373 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-de414071-9566-478d-90ba-49b53124624e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.071090 May 28 04:35:34.310040 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 221/402] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:34 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:34.313613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-91d839fd-5250-44cf-9806-94e92995ba98 tempest-QuotaClassesAdmin257Test-765738431 tempest-QuotaClassesAdmin257Test-765738431-project-admin] Calling method '.version_select at 0x7f770200a790>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:34.314434 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:34.314434 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:34.325110 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-91d839fd-5250-44cf-9806-94e92995ba98 tempest-QuotaClassesAdmin257Test-765738431 tempest-QuotaClassesAdmin257Test-765738431-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.015078 May 28 04:35:34.325817 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 222/403] 10.222.0.58 () {60 vars in 1225 bytes} [Sat May 28 04:35:34 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:35:34.337818 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-daa35b43-84d9-4cf3-8157-9f7ca8bf4b96 tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/736220231/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.111304 May 28 04:35:34.338543 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 182/404] 10.222.0.58 () {60 vars in 1220 bytes} [Sat May 28 04:35:34 2022] POST /compute/v2.1/flavors/736220231/os-extra_specs => generated 66 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:35:34.343772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3db6e365-13d0-473c-ad72-c33350bc4158 tempest-QuotaClassesAdmin257Test-765738431 tempest-QuotaClassesAdmin257Test-765738431-project-admin] Action: 'update', calling method: .version_select at 0x7f7702317e50>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:34.345256 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:34.345256 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:34.521622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9fe35fb4-9489-41c9-ae6d-66d8b843877c tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] Calling method '.version_select at 0x7f7702140ca0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:34.522575 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:34.522575 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:34.523796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fe35fb4-9489-41c9-ae6d-66d8b843877c tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:34.524238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fe35fb4-9489-41c9-ae6d-66d8b843877c tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:34.540953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fe35fb4-9489-41c9-ae6d-66d8b843877c tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:34.541590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fe35fb4-9489-41c9-ae6d-66d8b843877c tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:34.554324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fe35fb4-9489-41c9-ae6d-66d8b843877c tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:34.555231 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fe35fb4-9489-41c9-ae6d-66d8b843877c tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:34.568096 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9fe35fb4-9489-41c9-ae6d-66d8b843877c tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.241046 May 28 04:35:34.568754 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 223/405] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:35:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:34.574029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c952a8ef-0428-4cc5-ab79-5c812d090170 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:34.574835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c952a8ef-0428-4cc5-ab79-5c812d090170 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:34.581204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c952a8ef-0428-4cc5-ab79-5c812d090170 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:34.581683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c952a8ef-0428-4cc5-ab79-5c812d090170 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:34.582454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c952a8ef-0428-4cc5-ab79-5c812d090170 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:34.582889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c952a8ef-0428-4cc5-ab79-5c812d090170 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:34.729465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c952a8ef-0428-4cc5-ab79-5c812d090170 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:34.741992 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c952a8ef-0428-4cc5-ab79-5c812d090170 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 200 len: 1469 microversion: 2.1 time: 0.172081 May 28 04:35:34.742790 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 224/406] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:34 2022] GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:35.077658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eff2aee8-ccf9-4b4d-b2fb-24af8e8c8d8f tempest-FlavorsExtraSpecsTestJSON-576280446 tempest-FlavorsExtraSpecsTestJSON-576280446-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:35.077658 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-eff2aee8-ccf9-4b4d-b2fb-24af8e8c8d8f tempest-FlavorsExtraSpecsTestJSON-576280446 tempest-FlavorsExtraSpecsTestJSON-576280446-project] 10.222.0.58 "GET /compute/v2.1/flavors/736220231/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.310307 May 28 04:35:35.077658 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 225/407] 10.222.0.58 () {58 vars in 1199 bytes} [Sat May 28 04:35:34 2022] GET /compute/v2.1/flavors/736220231/os-extra_specs => generated 66 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:35:35.078648 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-328eb8fd-81d5-4182-963f-15a9f3a689e4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:35.079296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-328eb8fd-81d5-4182-963f-15a9f3a689e4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:35.086830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-328eb8fd-81d5-4182-963f-15a9f3a689e4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:35.087534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-328eb8fd-81d5-4182-963f-15a9f3a689e4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:35.088477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-328eb8fd-81d5-4182-963f-15a9f3a689e4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:35.089057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-328eb8fd-81d5-4182-963f-15a9f3a689e4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:35.155197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=9,nova_api:DELETE=4,nova_api:INSERT=8 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:35.300468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-328eb8fd-81d5-4182-963f-15a9f3a689e4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:35.308682 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-328eb8fd-81d5-4182-963f-15a9f3a689e4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1505 microversion: 2.1 time: 0.238268 May 28 04:35:35.309411 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 226/408] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:35 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1505 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:35.315915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5b9cbf4d-00a2-4af4-8cfc-25ec7e70b5fa tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] Calling method '.version_select at 0x7f770200a790>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:35.316908 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:35.316908 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:35.318364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5b9cbf4d-00a2-4af4-8cfc-25ec7e70b5fa tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'c4c41e3f02f0488388f26a07747d3271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d35181bed49849d9faf66da0ee3cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5b9cbf4d-00a2-4af4-8cfc-25ec7e70b5fa tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] Request method failure captured: May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaaTiPFotpPiTIaV6nAz_-SqWNHLdRN0oo-U8hTHSxWFH74eaQFJ3twYn7QJQ5rPGeUxtEXogN-TjS8vbxPuBRgUEntEcNPp8qIn43dOrREKFPYGMyPLSshzo7rFos4zARdmPb7Q-Y9XqqeyPDLeEi0qFY45WYX2rGmhDxpk4q-h7hg May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: ed9d35181bed49849d9faf66da0ee3cf May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-346484782 May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:35:35.320229 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:35:35.321438 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ed9d35181bed49849d9faf66da0ee3cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ed9d35181bed49849d9faf66da0ee3cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed9d35181bed49849d9faf66da0ee3cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed9d35181bed49849d9faf66da0ee3cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:35.321438 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-346484782 May 28 04:35:35.321438 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: ed9d35181bed49849d9faf66da0ee3cf May 28 04:35:35.321438 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-346484782 May 28 04:35:35.321438 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-HypervisorAdminNegativeTestJSON-346484782-project May 28 04:35:35.321438 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:35.321438 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:35.321438 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: c4c41e3f02f0488388f26a07747d3271 May 28 04:35:35.321438 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-346484782-project May 28 04:35:35.321438 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:35:35.321438 n-d-843700-1 devstack@n-api.service[126044]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 28 04:35:35.321438 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '1'} May 28 04:35:35.321438 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:35.322176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:35.322176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:35.322176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:35.322176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:35.322176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:35.322176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:35.322176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:35.322176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:35.322176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:35.322176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime May 28 04:35:35.322176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) May 28 04:35:35.322176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:35.322176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:35.322176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:35.322176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:35.322176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:35.322176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:35.322176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:35.322176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:35.323245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:35.323245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:35.323245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:35.323245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:35.323245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:35.323245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:35.323245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 28 04:35:35.323245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:35.323245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:35.323245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:35.323245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:35.323245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:35.323245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:35.323245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:35.323245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:35.323245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 28 04:35:35.323245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:35.324174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5b9cbf4d-00a2-4af4-8cfc-25ec7e70b5fa tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:35.324174 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5b9cbf4d-00a2-4af4-8cfc-25ec7e70b5fa tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.011448 May 28 04:35:35.326603 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 227/409] 10.222.0.58 () {58 vars in 1172 bytes} [Sat May 28 04:35:35 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:35.332245 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a3c2a70b-2139-4c70-980c-6692419a997c tempest-DeleteServersAdminTestJSON-445448485 tempest-DeleteServersAdminTestJSON-445448485-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:35.334232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a3c2a70b-2139-4c70-980c-6692419a997c tempest-DeleteServersAdminTestJSON-445448485 tempest-DeleteServersAdminTestJSON-445448485-project-admin] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:35.342541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3c2a70b-2139-4c70-980c-6692419a997c tempest-DeleteServersAdminTestJSON-445448485 tempest-DeleteServersAdminTestJSON-445448485-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:35.343309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3c2a70b-2139-4c70-980c-6692419a997c tempest-DeleteServersAdminTestJSON-445448485 tempest-DeleteServersAdminTestJSON-445448485-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:35.344352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3c2a70b-2139-4c70-980c-6692419a997c tempest-DeleteServersAdminTestJSON-445448485 tempest-DeleteServersAdminTestJSON-445448485-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:35.345023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3c2a70b-2139-4c70-980c-6692419a997c tempest-DeleteServersAdminTestJSON-445448485 tempest-DeleteServersAdminTestJSON-445448485-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:35.388498 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3db6e365-13d0-473c-ad72-c33350bc4158 tempest-QuotaClassesAdmin257Test-765738431 tempest-QuotaClassesAdmin257Test-765738431-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 1.048811 May 28 04:35:35.392385 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 183/410] 10.222.0.58 () {62 vars in 1246 bytes} [Sat May 28 04:35:34 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:35:35.400869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-00bf0366-74b0-4f39-94d0-e80ac8f0c661 tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:35.433373 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-00bf0366-74b0-4f39-94d0-e80ac8f0c661 tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/736220231/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.039826 May 28 04:35:35.434236 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 184/411] 10.222.0.58 () {60 vars in 1220 bytes} [Sat May 28 04:35:35 2022] POST /compute/v2.1/flavors/736220231/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:35:35.441169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-333789b8-bd92-4eb2-9adb-dd565b1b342a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:35.444629 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-333789b8-bd92-4eb2-9adb-dd565b1b342a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:35.454558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-333789b8-bd92-4eb2-9adb-dd565b1b342a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:35.455465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-333789b8-bd92-4eb2-9adb-dd565b1b342a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:35.456800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-333789b8-bd92-4eb2-9adb-dd565b1b342a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:35.457454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-333789b8-bd92-4eb2-9adb-dd565b1b342a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:35.535936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:35.649794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-333789b8-bd92-4eb2-9adb-dd565b1b342a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:35.658970 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-333789b8-bd92-4eb2-9adb-dd565b1b342a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1476 microversion: 2.1 time: 0.223277 May 28 04:35:35.671634 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 185/412] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:35 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1476 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:35.676685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2f48201d-6ba0-46d7-8d90-d8cb59b44083 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f77021cf8b0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:35.726751 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2f48201d-6ba0-46d7-8d90-d8cb59b44083 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.053983 May 28 04:35:35.732814 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 186/413] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:35 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:35.732814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-52443133-868d-482b-86a2-928430bb97a8 tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] Calling method '.version_select at 0x7f7702184820>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:35.732814 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:35.732814 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:35.740891 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-52443133-868d-482b-86a2-928430bb97a8 tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] HTTP exception thrown: Hypervisor with ID 'efb8ef96-c127-4fc4-8342-0b5226f1cb09' could not be found. May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-52443133-868d-482b-86a2-928430bb97a8 tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] Request method failure captured: May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/os-hypervisors/efb8ef96-c127-4fc4-8342-0b5226f1cb09/uptime HTTP/1.1 May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaaVN7CFTXWqu6Sl8izHynRTRuWvGqEJGtACVek5gQO5Yj6Aps_t6FqLSVw6Bxq8g89PNUQ6yWJ18gktOI5V3tr8JPJHZw_8_S_3lBVuSxIrrLssDH_TB0lIGH0CCiV4iCpO7hkZxnU25llTAR-wUZXTcxZArA9kToWoSohUw2j9zYY May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 79b60d89522444398bd8497251506554 May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-765853906 May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: X-Role: admin,reader,member May 28 04:35:35.743432 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: admin,reader,member May 28 04:35:35.744929 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79b60d89522444398bd8497251506554"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79b60d89522444398bd8497251506554"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79b60d89522444398bd8497251506554"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79b60d89522444398bd8497251506554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:35.744929 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-765853906 May 28 04:35:35.744929 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 79b60d89522444398bd8497251506554 May 28 04:35:35.744929 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-765853906 May 28 04:35:35.744929 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin May 28 04:35:35.744929 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:35.744929 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:35.744929 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 44ff9de9703b4c7abf6c80d077bcafbe May 28 04:35:35.744929 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin May 28 04:35:35.744929 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:35:35.744929 n-d-843700-1 devstack@n-api.service[126043]: exception: Hypervisor with ID 'efb8ef96-c127-4fc4-8342-0b5226f1cb09' could not be found. May 28 04:35:35.744929 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'efb8ef96-c127-4fc4-8342-0b5226f1cb09'} May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi value = int(str(value)) May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'efb8ef96-c127-4fc4-8342-0b5226f1cb09' May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise ValueError(msg) May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer May 28 04:35:35.745782 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'efb8ef96-c127-4fc4-8342-0b5226f1cb09' could not be found. May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:35.747585 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:35.749012 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:35.749012 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:35.749012 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:35.749012 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:35.749012 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:35.749012 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'efb8ef96-c127-4fc4-8342-0b5226f1cb09' could not be found. May 28 04:35:35.749012 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:35.749012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-52443133-868d-482b-86a2-928430bb97a8 tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] Returning 404 to user: Hypervisor with ID 'efb8ef96-c127-4fc4-8342-0b5226f1cb09' could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:35.749012 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-52443133-868d-482b-86a2-928430bb97a8 tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/efb8ef96-c127-4fc4-8342-0b5226f1cb09/uptime" status: 404 len: 123 microversion: 2.1 time: 0.016668 May 28 04:35:35.749012 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 187/414] 10.222.0.58 () {58 vars in 1277 bytes} [Sat May 28 04:35:35 2022] GET /compute/v2.1/os-hypervisors/efb8ef96-c127-4fc4-8342-0b5226f1cb09/uptime => generated 123 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:35.752295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bb16ef2d-467c-4fa0-8386-3969ca2e49a1 tempest-FlavorsExtraSpecsTestJSON-576280446 tempest-FlavorsExtraSpecsTestJSON-576280446-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:35.764162 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bb16ef2d-467c-4fa0-8386-3969ca2e49a1 tempest-FlavorsExtraSpecsTestJSON-576280446 tempest-FlavorsExtraSpecsTestJSON-576280446-project] 10.222.0.58 "GET /compute/v2.1/flavors/736220231/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.017132 May 28 04:35:35.771774 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 188/415] 10.222.0.58 () {58 vars in 1241 bytes} [Sat May 28 04:35:35 2022] GET /compute/v2.1/flavors/736220231/os-extra_specs/hw:numa_nodes => generated 22 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:35:35.776894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aa82ced6-12cd-40ff-b120-d7404074f5cf tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] Calling method '.version_select at 0x7f7702695310>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:35.777869 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:35.777869 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:35.779321 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa82ced6-12cd-40ff-b120-d7404074f5cf tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:35.779948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa82ced6-12cd-40ff-b120-d7404074f5cf tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:35.794725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa82ced6-12cd-40ff-b120-d7404074f5cf tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:35.795448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa82ced6-12cd-40ff-b120-d7404074f5cf tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:35.806138 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a3c2a70b-2139-4c70-980c-6692419a997c tempest-DeleteServersAdminTestJSON-445448485 tempest-DeleteServersAdminTestJSON-445448485-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26/action" status: 202 len: 0 microversion: 2.1 time: 0.478342 May 28 04:35:35.807350 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 228/416] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:35:35 2022] POST /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:35:35.808398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa82ced6-12cd-40ff-b120-d7404074f5cf tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:35.809025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa82ced6-12cd-40ff-b120-d7404074f5cf tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:35.812618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c9b8e493-2d5c-4492-a07f-f89e9e660bf4 tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:35.814910 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:35.814910 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:35.816584 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aa82ced6-12cd-40ff-b120-d7404074f5cf tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.042839 May 28 04:35:35.817238 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 189/417] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:35:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:35.822322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-810e1416-a917-4cce-a1c1-29e279606a27 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:35.823752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-810e1416-a917-4cce-a1c1-29e279606a27 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:35.839146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-810e1416-a917-4cce-a1c1-29e279606a27 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:35.839146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-810e1416-a917-4cce-a1c1-29e279606a27 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:35.839146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-810e1416-a917-4cce-a1c1-29e279606a27 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:35.839146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-810e1416-a917-4cce-a1c1-29e279606a27 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:35.868493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6,nova_api:DELETE=2,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=7 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:35.872900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-810e1416-a917-4cce-a1c1-29e279606a27 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:35.873537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-810e1416-a917-4cce-a1c1-29e279606a27 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:35.874166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-810e1416-a917-4cce-a1c1-29e279606a27 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lazy-loading 'fault' on Instance uuid bac9c02e-1bd0-420e-8a7f-1d530dceae26 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:35:35.878199 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c9b8e493-2d5c-4492-a07f-f89e9e660bf4 tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/736220231/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.069547 May 28 04:35:35.879425 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 229/418] 10.222.0.58 () {60 vars in 1220 bytes} [Sat May 28 04:35:35 2022] POST /compute/v2.1/flavors/736220231/os-extra_specs => generated 66 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:35:35.884160 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a5be1d2e-7f15-4db4-940a-da10c582e7b8 tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] Calling method '.version_select at 0x7f7701f761f0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:35.885176 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:35.885176 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:35.886605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a5be1d2e-7f15-4db4-940a-da10c582e7b8 tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'c4c41e3f02f0488388f26a07747d3271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d35181bed49849d9faf66da0ee3cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a5be1d2e-7f15-4db4-940a-da10c582e7b8 tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] Request method failure captured: May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaaTiPFotpPiTIaV6nAz_-SqWNHLdRN0oo-U8hTHSxWFH74eaQFJ3twYn7QJQ5rPGeUxtEXogN-TjS8vbxPuBRgUEntEcNPp8qIn43dOrREKFPYGMyPLSshzo7rFos4zARdmPb7Q-Y9XqqeyPDLeEi0qFY45WYX2rGmhDxpk4q-h7hg May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: ed9d35181bed49849d9faf66da0ee3cf May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-346484782 May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:35:35.888731 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:35:35.890239 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ed9d35181bed49849d9faf66da0ee3cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ed9d35181bed49849d9faf66da0ee3cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed9d35181bed49849d9faf66da0ee3cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed9d35181bed49849d9faf66da0ee3cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:35.890239 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-346484782 May 28 04:35:35.890239 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: ed9d35181bed49849d9faf66da0ee3cf May 28 04:35:35.890239 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-346484782 May 28 04:35:35.890239 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-HypervisorAdminNegativeTestJSON-346484782-project May 28 04:35:35.890239 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:35.890239 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:35.890239 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: c4c41e3f02f0488388f26a07747d3271 May 28 04:35:35.890239 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-346484782-project May 28 04:35:35.890239 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:35:35.890239 n-d-843700-1 devstack@n-api.service[126044]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 28 04:35:35.890239 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '1'} May 28 04:35:35.890239 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:35.891172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:35.891172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:35.891172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:35.891172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:35.891172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:35.891172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:35.891172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:35.891172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:35.891172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:35.891172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show May 28 04:35:35.891172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 28 04:35:35.891172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show May 28 04:35:35.891172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) May 28 04:35:35.891172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:35.891172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:35.891172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:35.891172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:35.891172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:35.891172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:35.892407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:35.892407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:35.892407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:35.892407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:35.892407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:35.892407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:35.892407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:35.892407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:35.892407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 28 04:35:35.892407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:35.892407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:35.892407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:35.892407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:35.892407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:35.892407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:35.892407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:35.892407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:35.892407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 28 04:35:35.892407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:35.896393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a5be1d2e-7f15-4db4-940a-da10c582e7b8 tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:35.897428 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a5be1d2e-7f15-4db4-940a-da10c582e7b8 tempest-HypervisorAdminNegativeTestJSON-346484782 tempest-HypervisorAdminNegativeTestJSON-346484782-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.017108 May 28 04:35:35.898684 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 230/419] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:35:35 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:35.946476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-47d98409-5725-4d33-a71d-6811a67ef330 tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:35.963488 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-47d98409-5725-4d33-a71d-6811a67ef330 tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/736220231/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.063539 May 28 04:35:35.967454 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 231/420] 10.222.0.58 () {58 vars in 1199 bytes} [Sat May 28 04:35:35 2022] GET /compute/v2.1/flavors/736220231/os-extra_specs => generated 66 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:35:35.971070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d75f0fa5-9242-4cfb-b07e-7f946e157ea9 tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] Calling method '.version_select at 0x7f7701fbd700>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:35.973177 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-d75f0fa5-9242-4cfb-b07e-7f946e157ea9 tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] HTTP exception thrown: Hypervisor with ID '8bb91710-e978-4ecc-88df-2a67886c2355' could not be found. May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d75f0fa5-9242-4cfb-b07e-7f946e157ea9 tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] Request method failure captured: May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-hypervisors/8bb91710-e978-4ecc-88df-2a67886c2355 HTTP/1.1 May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaaVN7CFTXWqu6Sl8izHynRTRuWvGqEJGtACVek5gQO5Yj6Aps_t6FqLSVw6Bxq8g89PNUQ6yWJ18gktOI5V3tr8JPJHZw_8_S_3lBVuSxIrrLssDH_TB0lIGH0CCiV4iCpO7hkZxnU25llTAR-wUZXTcxZArA9kToWoSohUw2j9zYY May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 79b60d89522444398bd8497251506554 May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-765853906 May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:35:35.978395 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:35:35.979627 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79b60d89522444398bd8497251506554"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79b60d89522444398bd8497251506554"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79b60d89522444398bd8497251506554"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79b60d89522444398bd8497251506554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:35.979627 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-765853906 May 28 04:35:35.979627 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 79b60d89522444398bd8497251506554 May 28 04:35:35.979627 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-765853906 May 28 04:35:35.979627 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin May 28 04:35:35.979627 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:35.979627 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:35.979627 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 44ff9de9703b4c7abf6c80d077bcafbe May 28 04:35:35.979627 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin May 28 04:35:35.979627 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:35:35.979627 n-d-843700-1 devstack@n-api.service[126044]: exception: Hypervisor with ID '8bb91710-e978-4ecc-88df-2a67886c2355' could not be found. May 28 04:35:35.979627 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '8bb91710-e978-4ecc-88df-2a67886c2355'} May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi value = int(str(value)) May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '8bb91710-e978-4ecc-88df-2a67886c2355' May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise ValueError(msg) May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer May 28 04:35:35.980295 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) May 28 04:35:35.981423 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer May 28 04:35:35.981423 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:35.981423 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:35.981423 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:35.981423 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:35.981423 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:35.981423 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:35.981423 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:35.981423 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:35.981423 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:35.981423 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:35.981423 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:35.981423 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:35.981423 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show May 28 04:35:35.981423 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 28 04:35:35.981423 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show May 28 04:35:35.981423 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) May 28 04:35:35.981423 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id May 28 04:35:35.981423 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 04:35:35.981423 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '8bb91710-e978-4ecc-88df-2a67886c2355' could not be found. May 28 04:35:35.982441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:35.982441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:35.982441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:35.982441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:35.982441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:35.982441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:35.982441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:35.982441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:35.982441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '8bb91710-e978-4ecc-88df-2a67886c2355' could not be found. May 28 04:35:35.982441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:35.986391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d75f0fa5-9242-4cfb-b07e-7f946e157ea9 tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] Returning 404 to user: Hypervisor with ID '8bb91710-e978-4ecc-88df-2a67886c2355' could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:35.988626 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d75f0fa5-9242-4cfb-b07e-7f946e157ea9 tempest-HypervisorAdminNegativeTestJSON-765853906 tempest-HypervisorAdminNegativeTestJSON-765853906-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/8bb91710-e978-4ecc-88df-2a67886c2355" status: 404 len: 123 microversion: 2.1 time: 0.022043 May 28 04:35:35.991627 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 232/421] 10.222.0.58 () {58 vars in 1256 bytes} [Sat May 28 04:35:35 2022] GET /compute/v2.1/os-hypervisors/8bb91710-e978-4ecc-88df-2a67886c2355 => generated 123 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:35.998147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-faa891f6-3e88-44e1-9f5f-23e67a50aa38 tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:36.004980 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:36.004980 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:36.083053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=12 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:36.093805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-810e1416-a917-4cce-a1c1-29e279606a27 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:36.098514 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-810e1416-a917-4cce-a1c1-29e279606a27 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 200 len: 1452 microversion: 2.1 time: 0.279992 May 28 04:35:36.114494 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 190/422] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:35 2022] GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 1452 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:36.120547 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-faa891f6-3e88-44e1-9f5f-23e67a50aa38 tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/736220231/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.126066 May 28 04:35:36.121351 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 233/423] 10.222.0.58 () {60 vars in 1261 bytes} [Sat May 28 04:35:35 2022] PUT /compute/v2.1/flavors/736220231/os-extra_specs/hw:numa_nodes => generated 22 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:35:36.121898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0f4c4376-8b52-467a-888d-45515b601404 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:36.122620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0f4c4376-8b52-467a-888d-45515b601404 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:36.128982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=10 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:36.129946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d18438ab-33a6-4d7d-bf00-6418a23c010b tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:36.131053 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f4c4376-8b52-467a-888d-45515b601404 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:36.131982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f4c4376-8b52-467a-888d-45515b601404 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:36.132963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f4c4376-8b52-467a-888d-45515b601404 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:36.133605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f4c4376-8b52-467a-888d-45515b601404 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:36.153443 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d18438ab-33a6-4d7d-bf00-6418a23c010b tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/736220231/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.027354 May 28 04:35:36.154047 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 234/424] 10.222.0.58 () {58 vars in 1199 bytes} [Sat May 28 04:35:36 2022] GET /compute/v2.1/flavors/736220231/os-extra_specs => generated 66 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 04:35:36.163555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4e6cbe14-d723-4ee7-9d85-da5a7ec3c4d7 tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:36.168442 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:36.168442 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:36.170460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0f4c4376-8b52-467a-888d-45515b601404 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:35:36.276966 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4e6cbe14-d723-4ee7-9d85-da5a7ec3c4d7 tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/736220231/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.117625 May 28 04:35:36.284003 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 235/425] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 04:35:36 2022] DELETE /compute/v2.1/flavors/736220231/os-extra_specs/hw:numa_nodes => generated 0 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 28 04:35:36.290026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a53c60cc-bfab-452e-88a1-5f0b549eea68 tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:36.400538 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a53c60cc-bfab-452e-88a1-5f0b549eea68 tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/736220231/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.110181 May 28 04:35:36.400538 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 236/426] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 04:35:36 2022] DELETE /compute/v2.1/flavors/736220231/os-extra_specs/hw:cpu_policy => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 04:35:36.413342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-18b006b3-4d2c-432a-97bd-b0993bfac3d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:36.415763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-18b006b3-4d2c-432a-97bd-b0993bfac3d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:36.435036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-18b006b3-4d2c-432a-97bd-b0993bfac3d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:36.436742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-18b006b3-4d2c-432a-97bd-b0993bfac3d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:36.438681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-18b006b3-4d2c-432a-97bd-b0993bfac3d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:36.439249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-18b006b3-4d2c-432a-97bd-b0993bfac3d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:36.626932 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0f4c4376-8b52-467a-888d-45515b601404 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 204 len: 0 microversion: 2.1 time: 0.506609 May 28 04:35:36.627886 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 191/427] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:35:36 2022] DELETE /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:35:36.636360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-43477e6a-0964-4849-9083-90353bc5047f tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:36.662559 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-43477e6a-0964-4849-9083-90353bc5047f tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/736220231/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.032621 May 28 04:35:36.663203 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 192/428] 10.222.0.58 () {58 vars in 1199 bytes} [Sat May 28 04:35:36 2022] GET /compute/v2.1/flavors/736220231/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:35:36.687590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e43a0810-08ad-4539-9052-51c903cb7f64 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:36.692616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e43a0810-08ad-4539-9052-51c903cb7f64 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:36.720734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e43a0810-08ad-4539-9052-51c903cb7f64 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:36.722677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e43a0810-08ad-4539-9052-51c903cb7f64 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:36.723689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e43a0810-08ad-4539-9052-51c903cb7f64 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:36.727233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e43a0810-08ad-4539-9052-51c903cb7f64 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:36.769870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-18b006b3-4d2c-432a-97bd-b0993bfac3d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:36.785304 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-18b006b3-4d2c-432a-97bd-b0993bfac3d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1505 microversion: 2.1 time: 0.381772 May 28 04:35:36.801526 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 237/429] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:36 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1505 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:36.807306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4d19ce03-d9de-43bf-9d69-8a2c492d37d4 tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:36.808498 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:36.808498 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:36.841259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e43a0810-08ad-4539-9052-51c903cb7f64 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:36.843827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e43a0810-08ad-4539-9052-51c903cb7f64 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:36.848655 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-e43a0810-08ad-4539-9052-51c903cb7f64 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lazy-loading 'fault' on Instance uuid bac9c02e-1bd0-420e-8a7f-1d530dceae26 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:35:36.920665 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4d19ce03-d9de-43bf-9d69-8a2c492d37d4 tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/736220231" status: 202 len: 0 microversion: 2.1 time: 0.112258 May 28 04:35:36.925844 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 238/430] 10.222.0.58 () {58 vars in 1157 bytes} [Sat May 28 04:35:36 2022] DELETE /compute/v2.1/flavors/736220231 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:35:36.962808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eb4e4931-b83a-4582-b50b-b09eb35bc584 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:36.967141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-eb4e4931-b83a-4582-b50b-b09eb35bc584 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:36.996956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb4e4931-b83a-4582-b50b-b09eb35bc584 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:36.997952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb4e4931-b83a-4582-b50b-b09eb35bc584 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:37.016508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb4e4931-b83a-4582-b50b-b09eb35bc584 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:37.017013 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb4e4931-b83a-4582-b50b-b09eb35bc584 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:37.243584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e43a0810-08ad-4539-9052-51c903cb7f64 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:37.259776 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e43a0810-08ad-4539-9052-51c903cb7f64 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 200 len: 1458 microversion: 2.1 time: 0.584358 May 28 04:35:37.262594 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 193/431] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:36 2022] GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 1458 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:37.274863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f7ab08dd-92e7-4f18-bb76-3ac2fc4b344a tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f77023f2d30>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:37.346921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-eb4e4931-b83a-4582-b50b-b09eb35bc584 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:37.354241 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f7ab08dd-92e7-4f18-bb76-3ac2fc4b344a tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.089671 May 28 04:35:37.358622 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 194/432] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:37 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:37.358855 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-eb4e4931-b83a-4582-b50b-b09eb35bc584 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1476 microversion: 2.1 time: 0.425964 May 28 04:35:37.358855 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 239/433] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:36 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1476 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:37.361278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b5a222e3-3195-47d0-9371-eeb1c3e822a3 req-3ee54613-88f6-44f7-bc4f-a03c1aae5fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a27b8082-4f44-4263-a6a2-86291ea3950b", "name": "network-vif-plugged", "status": "completed", "tag": "06f37629-13a1-489c-9d41-01ab1fa9a306"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:37.369109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-20ef90e9-e77a-431a-8a27-3cebf4fefe82 tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:37.374439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b5a222e3-3195-47d0-9371-eeb1c3e822a3 req-3ee54613-88f6-44f7-bc4f-a03c1aae5fe0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:37.375306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b5a222e3-3195-47d0-9371-eeb1c3e822a3 req-3ee54613-88f6-44f7-bc4f-a03c1aae5fe0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:37.405177 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-20ef90e9-e77a-431a-8a27-3cebf4fefe82 tempest-FlavorsExtraSpecsTestJSON-1638877779 tempest-FlavorsExtraSpecsTestJSON-1638877779-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045056 May 28 04:35:37.405896 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 240/434] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:35:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:37.411697 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b5a222e3-3195-47d0-9371-eeb1c3e822a3 req-3ee54613-88f6-44f7-bc4f-a03c1aae5fe0 service nova] Creating event network-vif-plugged:06f37629-13a1-489c-9d41-01ab1fa9a306 for instance a27b8082-4f44-4263-a6a2-86291ea3950b on n-h2-843700-1 May 28 04:35:37.436075 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b5a222e3-3195-47d0-9371-eeb1c3e822a3 req-3ee54613-88f6-44f7-bc4f-a03c1aae5fe0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076936 May 28 04:35:37.444095 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 195/435] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:37.808154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef72f7ed-8fc2-4508-9412-054e490e2d94 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:37.809216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ef72f7ed-8fc2-4508-9412-054e490e2d94 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:37.817372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef72f7ed-8fc2-4508-9412-054e490e2d94 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:37.818163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef72f7ed-8fc2-4508-9412-054e490e2d94 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:37.819212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef72f7ed-8fc2-4508-9412-054e490e2d94 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:37.819852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef72f7ed-8fc2-4508-9412-054e490e2d94 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:38.092476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef72f7ed-8fc2-4508-9412-054e490e2d94 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:38.101293 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ef72f7ed-8fc2-4508-9412-054e490e2d94 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1505 microversion: 2.1 time: 0.298204 May 28 04:35:38.102360 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 241/436] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:37 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:38.279352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d5476d0b-f2af-47a5-baa2-f26965c4bfdb tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:38.280066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d5476d0b-f2af-47a5-baa2-f26965c4bfdb tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:38.299736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5476d0b-f2af-47a5-baa2-f26965c4bfdb tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:38.299736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5476d0b-f2af-47a5-baa2-f26965c4bfdb tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:38.299736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5476d0b-f2af-47a5-baa2-f26965c4bfdb tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:38.299736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5476d0b-f2af-47a5-baa2-f26965c4bfdb tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:38.368572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7716d5ef-44d5-45b6-8145-a214660acca3 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f429d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:38.375401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5476d0b-f2af-47a5-baa2-f26965c4bfdb tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:38.383646 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5476d0b-f2af-47a5-baa2-f26965c4bfdb tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:38.390826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-d5476d0b-f2af-47a5-baa2-f26965c4bfdb tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lazy-loading 'fault' on Instance uuid bac9c02e-1bd0-420e-8a7f-1d530dceae26 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:35:38.449099 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7716d5ef-44d5-45b6-8145-a214660acca3 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.084403 May 28 04:35:38.449999 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 242/437] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:38 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:38.459488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8a633a89-e511-4507-b5ba-f1de0dbfd41f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:38.460109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8a633a89-e511-4507-b5ba-f1de0dbfd41f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:38.480341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a633a89-e511-4507-b5ba-f1de0dbfd41f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:38.480813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a633a89-e511-4507-b5ba-f1de0dbfd41f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:38.481609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a633a89-e511-4507-b5ba-f1de0dbfd41f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:38.482621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a633a89-e511-4507-b5ba-f1de0dbfd41f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:38.579592 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d5476d0b-f2af-47a5-baa2-f26965c4bfdb tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:38.590837 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d5476d0b-f2af-47a5-baa2-f26965c4bfdb tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 200 len: 1458 microversion: 2.1 time: 0.315744 May 28 04:35:38.603409 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 196/438] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:38 2022] GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 1458 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:38.768584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8a633a89-e511-4507-b5ba-f1de0dbfd41f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:38.779436 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8a633a89-e511-4507-b5ba-f1de0dbfd41f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1476 microversion: 2.1 time: 0.328316 May 28 04:35:38.781199 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 243/439] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:38 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1476 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:39.119885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c3c53060-0917-4a3b-9c7f-c90ee29ba9d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:39.122064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c3c53060-0917-4a3b-9c7f-c90ee29ba9d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:39.144752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3c53060-0917-4a3b-9c7f-c90ee29ba9d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:39.145791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3c53060-0917-4a3b-9c7f-c90ee29ba9d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:39.173286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3c53060-0917-4a3b-9c7f-c90ee29ba9d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:39.173286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3c53060-0917-4a3b-9c7f-c90ee29ba9d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:39.495711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c3c53060-0917-4a3b-9c7f-c90ee29ba9d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:39.495711 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c3c53060-0917-4a3b-9c7f-c90ee29ba9d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1505 microversion: 2.1 time: 0.339753 May 28 04:35:39.495711 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 197/440] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:39 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:39.496348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4862e8d3-f183-407e-bdd2-da600c9a3a9b tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f504c0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:39.521153 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4862e8d3-f183-407e-bdd2-da600c9a3a9b tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.062714 May 28 04:35:39.521664 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 244/441] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:39 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:39.610357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-85f996b5-1f3d-4384-b416-4de747539fe8 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:39.611071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-85f996b5-1f3d-4384-b416-4de747539fe8 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:39.619583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85f996b5-1f3d-4384-b416-4de747539fe8 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:39.620356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85f996b5-1f3d-4384-b416-4de747539fe8 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:39.621653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85f996b5-1f3d-4384-b416-4de747539fe8 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:39.622351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85f996b5-1f3d-4384-b416-4de747539fe8 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:39.657118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85f996b5-1f3d-4384-b416-4de747539fe8 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:39.657675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85f996b5-1f3d-4384-b416-4de747539fe8 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:39.658278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-85f996b5-1f3d-4384-b416-4de747539fe8 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lazy-loading 'fault' on Instance uuid bac9c02e-1bd0-420e-8a7f-1d530dceae26 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:35:39.758521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-85f996b5-1f3d-4384-b416-4de747539fe8 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:39.776450 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-85f996b5-1f3d-4384-b416-4de747539fe8 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 200 len: 1416 microversion: 2.1 time: 0.169972 May 28 04:35:39.777282 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 198/442] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:39 2022] GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 1416 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:39.801855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f9f65500-4a00-4de6-8919-faeb5cb60b40 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:39.802945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f9f65500-4a00-4de6-8919-faeb5cb60b40 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:39.819416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9f65500-4a00-4de6-8919-faeb5cb60b40 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:39.820177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9f65500-4a00-4de6-8919-faeb5cb60b40 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:39.822171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9f65500-4a00-4de6-8919-faeb5cb60b40 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:39.822888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9f65500-4a00-4de6-8919-faeb5cb60b40 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:39.933221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-49dceebd-d98b-48ec-b5db-acc5eccd4ddb req-698c62c8-d301-4f00-82f1-a6358f9ddf84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bac9c02e-1bd0-420e-8a7f-1d530dceae26", "name": "network-vif-deleted", "tag": "8488de26-4471-44b2-87b5-50fdf5dfd1de"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:39.959102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-49dceebd-d98b-48ec-b5db-acc5eccd4ddb req-698c62c8-d301-4f00-82f1-a6358f9ddf84 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:39.959843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-49dceebd-d98b-48ec-b5db-acc5eccd4ddb req-698c62c8-d301-4f00-82f1-a6358f9ddf84 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:40.003104 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-49dceebd-d98b-48ec-b5db-acc5eccd4ddb req-698c62c8-d301-4f00-82f1-a6358f9ddf84 service nova] Creating event network-vif-deleted:8488de26-4471-44b2-87b5-50fdf5dfd1de for instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 on n-h1-843700-1 May 28 04:35:40.039871 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-49dceebd-d98b-48ec-b5db-acc5eccd4ddb req-698c62c8-d301-4f00-82f1-a6358f9ddf84 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108512 May 28 04:35:40.041299 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 199/443] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:35:40.223688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f9f65500-4a00-4de6-8919-faeb5cb60b40 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:40.232457 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f9f65500-4a00-4de6-8919-faeb5cb60b40 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1476 microversion: 2.1 time: 0.435456 May 28 04:35:40.233653 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 245/444] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:39 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1476 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:40.506061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d0144625-5263-451c-b8a0-48458d0bc33a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:40.519355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d0144625-5263-451c-b8a0-48458d0bc33a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:40.529993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0144625-5263-451c-b8a0-48458d0bc33a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:40.530682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0144625-5263-451c-b8a0-48458d0bc33a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:40.531666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0144625-5263-451c-b8a0-48458d0bc33a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:40.532244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0144625-5263-451c-b8a0-48458d0bc33a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:40.533846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0819b70e-5e49-4d46-abe6-45ce2fcf1375 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f50a60>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:40.592030 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0819b70e-5e49-4d46-abe6-45ce2fcf1375 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.060864 May 28 04:35:40.596361 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 246/445] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:40 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:40.803508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f6efc1da-920c-4ea0-baef-682828acb5d6 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:40.805857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f6efc1da-920c-4ea0-baef-682828acb5d6 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:40.845721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6efc1da-920c-4ea0-baef-682828acb5d6 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:40.847943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6efc1da-920c-4ea0-baef-682828acb5d6 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:40.852891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6efc1da-920c-4ea0-baef-682828acb5d6 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:40.855706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6efc1da-920c-4ea0-baef-682828acb5d6 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:40.874752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d0144625-5263-451c-b8a0-48458d0bc33a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:40.886746 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d0144625-5263-451c-b8a0-48458d0bc33a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1495 microversion: 2.1 time: 0.388637 May 28 04:35:40.889849 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 200/446] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:40 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1495 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:40.910053 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2d629cd8-65c7-4727-80a2-602dbd84ef13 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '.version_select at 0x7f770219c820>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:40.926515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d629cd8-65c7-4727-80a2-602dbd84ef13 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:40.928143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d629cd8-65c7-4727-80a2-602dbd84ef13 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:40.967124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6efc1da-920c-4ea0-baef-682828acb5d6 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:40.968081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6efc1da-920c-4ea0-baef-682828acb5d6 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:40.968702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-f6efc1da-920c-4ea0-baef-682828acb5d6 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lazy-loading 'fault' on Instance uuid bac9c02e-1bd0-420e-8a7f-1d530dceae26 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:35:41.029158 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2d629cd8-65c7-4727-80a2-602dbd84ef13 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 791 microversion: 2.1 time: 0.122925 May 28 04:35:41.031905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f6efc1da-920c-4ea0-baef-682828acb5d6 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f5c69cf0c848b7b8c6672c5be5dcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a346c9751c4215909999fdbc3ea1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:41.039855 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 201/447] 10.222.0.58 () {58 vars in 1142 bytes} [Sat May 28 04:35:40 2022] GET /compute/v2.1/os-migrations => generated 791 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:35:41.046478 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f6efc1da-920c-4ea0-baef-682828acb5d6 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 200 len: 1310 microversion: 2.1 time: 0.255540 May 28 04:35:41.048426 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 247/448] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:40 2022] GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 1310 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:41.065680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f59a87b4-a000-4fb9-995e-f8096ba734eb tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:41.068622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f59a87b4-a000-4fb9-995e-f8096ba734eb tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:41.083761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f59a87b4-a000-4fb9-995e-f8096ba734eb tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:41.084445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f59a87b4-a000-4fb9-995e-f8096ba734eb tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:41.085397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f59a87b4-a000-4fb9-995e-f8096ba734eb tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:41.086241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f59a87b4-a000-4fb9-995e-f8096ba734eb tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:41.091522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:41.252388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3546ab5d-690d-4639-9895-39de6ffe6620 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:41.255677 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3546ab5d-690d-4639-9895-39de6ffe6620 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:41.273946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3546ab5d-690d-4639-9895-39de6ffe6620 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:41.277652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3546ab5d-690d-4639-9895-39de6ffe6620 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:41.283368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3546ab5d-690d-4639-9895-39de6ffe6620 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:41.284851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3546ab5d-690d-4639-9895-39de6ffe6620 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:41.337459 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f59a87b4-a000-4fb9-995e-f8096ba734eb tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1646 microversion: 2.1 time: 0.293490 May 28 04:35:41.348896 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 202/449] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:41 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1646 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:41.585730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3546ab5d-690d-4639-9895-39de6ffe6620 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:41.613734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fefe80cb-fcdc-4046-b2c6-265f82172764 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f77021849d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:41.628984 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3546ab5d-690d-4639-9895-39de6ffe6620 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1476 microversion: 2.1 time: 0.380025 May 28 04:35:41.634596 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 248/450] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:41 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1476 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:41.728275 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fefe80cb-fcdc-4046-b2c6-265f82172764 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.122846 May 28 04:35:41.732568 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 203/451] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:41 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:42.016250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-56d00275-2b9f-43b7-90c5-84013f327dff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1960719945", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "68123182-7714-4432-8648-5b70eb3b9ead"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:42.065004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-516d3dd9-9c6e-4ac2-b691-01a5f77a9801 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:42.066403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-516d3dd9-9c6e-4ac2-b691-01a5f77a9801 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:42.077002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-516d3dd9-9c6e-4ac2-b691-01a5f77a9801 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:42.079963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-516d3dd9-9c6e-4ac2-b691-01a5f77a9801 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:42.082839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-516d3dd9-9c6e-4ac2-b691-01a5f77a9801 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:42.088092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-516d3dd9-9c6e-4ac2-b691-01a5f77a9801 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:42.115012 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-516d3dd9-9c6e-4ac2-b691-01a5f77a9801 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] HTTP exception thrown: Instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 could not be found. May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-516d3dd9-9c6e-4ac2-b691-01a5f77a9801 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Request method failure captured: May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 HTTP/1.1 May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZhWSbx3Tl2pcEX8f5j_ONvAo7azWZppHUy25lW4SoaAY8g2QbiHiPd6S0iJRIGxuNtn8ommR4Mje3UYPQopWJcK0nblHhl1L_I1M9fd6AAHN21sO9FgujDvqsFbRzla21UkGIZbwbMmD4DkZahfX967XEFAgiMMGSsQ9VEyMJCphw May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 55a346c9751c4215909999fdbc3ea1be May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1678635388 May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:35:42.123823 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:35:42.125195 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:42.125195 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersAdminTestJSON-1678635388 May 28 04:35:42.125195 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 55a346c9751c4215909999fdbc3ea1be May 28 04:35:42.125195 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1678635388 May 28 04:35:42.125195 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersAdminTestJSON-1678635388-project May 28 04:35:42.125195 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:42.125195 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:42.125195 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24f5c69cf0c848b7b8c6672c5be5dcfa May 28 04:35:42.125195 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersAdminTestJSON-1678635388-project May 28 04:35:42.125195 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:35:42.125195 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 could not be found. May 28 04:35:42.125195 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'bac9c02e-1bd0-420e-8a7f-1d530dceae26'} May 28 04:35:42.125836 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:42.125836 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:42.125836 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:35:42.125836 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:35:42.125836 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:35:42.125836 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:35:42.125836 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:35:42.125836 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:35:42.125836 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:35:42.125836 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:35:42.125836 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 could not be found. May 28 04:35:42.125836 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.125836 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:42.125836 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.125836 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:42.125836 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:42.125836 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:42.125836 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:42.125836 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:42.125836 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:42.126925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:42.126925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:35:42.126925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:35:42.126925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:35:42.126925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:35:42.126925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:35:42.126925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:35:42.126925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 could not be found. May 28 04:35:42.126925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.126925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:42.126925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.126925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:42.126925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:42.126925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:42.126925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:42.126925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:42.126925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 could not be found. May 28 04:35:42.126925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.132875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-516d3dd9-9c6e-4ac2-b691-01a5f77a9801 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Returning 404 to user: Instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:42.134636 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-516d3dd9-9c6e-4ac2-b691-01a5f77a9801 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 404 len: 111 microversion: 2.1 time: 0.073869 May 28 04:35:42.146317 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 204/452] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:42 2022] GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:35:42.165778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-586af61f-4b89-4504-8d1e-eff599bbbb1e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:42.165778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-586af61f-4b89-4504-8d1e-eff599bbbb1e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:42.177421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-56d00275-2b9f-43b7-90c5-84013f327dff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] validate_networks() for [('68123182-7714-4432-8648-5b70eb3b9ead', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:35:42.186670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-586af61f-4b89-4504-8d1e-eff599bbbb1e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:42.187435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-586af61f-4b89-4504-8d1e-eff599bbbb1e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:42.194979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-586af61f-4b89-4504-8d1e-eff599bbbb1e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:42.194979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-586af61f-4b89-4504-8d1e-eff599bbbb1e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:42.229430 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-586af61f-4b89-4504-8d1e-eff599bbbb1e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] HTTP exception thrown: Instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 could not be found. May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-586af61f-4b89-4504-8d1e-eff599bbbb1e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Request method failure captured: May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 HTTP/1.1 May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZhWSbx3Tl2pcEX8f5j_ONvAo7azWZppHUy25lW4SoaAY8g2QbiHiPd6S0iJRIGxuNtn8ommR4Mje3UYPQopWJcK0nblHhl1L_I1M9fd6AAHN21sO9FgujDvqsFbRzla21UkGIZbwbMmD4DkZahfX967XEFAgiMMGSsQ9VEyMJCphw May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 55a346c9751c4215909999fdbc3ea1be May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1678635388 May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:35:42.231243 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:35:42.232653 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:42.232653 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersAdminTestJSON-1678635388 May 28 04:35:42.232653 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 55a346c9751c4215909999fdbc3ea1be May 28 04:35:42.232653 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1678635388 May 28 04:35:42.232653 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersAdminTestJSON-1678635388-project May 28 04:35:42.232653 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:42.232653 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:42.232653 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24f5c69cf0c848b7b8c6672c5be5dcfa May 28 04:35:42.232653 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersAdminTestJSON-1678635388-project May 28 04:35:42.232653 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:35:42.232653 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 could not be found. May 28 04:35:42.232653 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'bac9c02e-1bd0-420e-8a7f-1d530dceae26'} May 28 04:35:42.233486 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:42.233486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:42.233486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:35:42.233486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:35:42.233486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:35:42.233486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:35:42.233486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:35:42.233486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:35:42.233486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:35:42.233486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:35:42.233486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 could not be found. May 28 04:35:42.233486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.233486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:42.233486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.233486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:42.233486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:42.233486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:42.233486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:42.233486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:42.233486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:42.234811 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:42.234811 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:35:42.234811 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:35:42.234811 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:35:42.234811 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:35:42.234811 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:35:42.234811 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:35:42.234811 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:35:42.234811 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:35:42.234811 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 could not be found. May 28 04:35:42.234811 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.234811 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:42.234811 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.234811 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:42.234811 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:42.234811 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:42.234811 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:42.234811 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:42.234811 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 could not be found. May 28 04:35:42.234811 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.237443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-586af61f-4b89-4504-8d1e-eff599bbbb1e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Returning 404 to user: Instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:42.238360 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-586af61f-4b89-4504-8d1e-eff599bbbb1e tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 404 len: 111 microversion: 2.1 time: 0.090967 May 28 04:35:42.238923 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 205/453] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:35:42 2022] DELETE /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:42.253533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7619b583-9037-450f-bd8c-6c2546f1c934 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:42.254387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7619b583-9037-450f-bd8c-6c2546f1c934 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: bac9c02e-1bd0-420e-8a7f-1d530dceae26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:42.277619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7619b583-9037-450f-bd8c-6c2546f1c934 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:42.283473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7619b583-9037-450f-bd8c-6c2546f1c934 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:42.285070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7619b583-9037-450f-bd8c-6c2546f1c934 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:42.290541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7619b583-9037-450f-bd8c-6c2546f1c934 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:42.336018 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-7619b583-9037-450f-bd8c-6c2546f1c934 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] HTTP exception thrown: Instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 could not be found. May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7619b583-9037-450f-bd8c-6c2546f1c934 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Request method failure captured: May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 HTTP/1.1 May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZhWSbx3Tl2pcEX8f5j_ONvAo7azWZppHUy25lW4SoaAY8g2QbiHiPd6S0iJRIGxuNtn8ommR4Mje3UYPQopWJcK0nblHhl1L_I1M9fd6AAHN21sO9FgujDvqsFbRzla21UkGIZbwbMmD4DkZahfX967XEFAgiMMGSsQ9VEyMJCphw May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 55a346c9751c4215909999fdbc3ea1be May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1678635388 May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:35:42.341613 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:35:42.344704 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:42.344704 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersAdminTestJSON-1678635388 May 28 04:35:42.344704 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 55a346c9751c4215909999fdbc3ea1be May 28 04:35:42.344704 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1678635388 May 28 04:35:42.344704 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersAdminTestJSON-1678635388-project May 28 04:35:42.344704 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:42.344704 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:42.344704 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24f5c69cf0c848b7b8c6672c5be5dcfa May 28 04:35:42.344704 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersAdminTestJSON-1678635388-project May 28 04:35:42.344704 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:35:42.344704 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 could not be found. May 28 04:35:42.344704 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'bac9c02e-1bd0-420e-8a7f-1d530dceae26'} May 28 04:35:42.345494 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:42.345494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:42.345494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:35:42.345494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:35:42.345494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:35:42.345494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:35:42.345494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:35:42.345494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:35:42.345494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:35:42.345494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:35:42.345494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 could not be found. May 28 04:35:42.345494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.345494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:42.345494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.345494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:42.345494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:42.345494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:42.345494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:42.345494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:42.345494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:42.346709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:42.346709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:35:42.346709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:35:42.346709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:35:42.346709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:35:42.346709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:35:42.346709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:35:42.346709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 could not be found. May 28 04:35:42.346709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.346709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:42.346709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.346709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:42.346709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:42.346709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:42.346709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:42.346709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:42.346709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 could not be found. May 28 04:35:42.346709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.348017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7619b583-9037-450f-bd8c-6c2546f1c934 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Returning 404 to user: Instance bac9c02e-1bd0-420e-8a7f-1d530dceae26 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:42.348795 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7619b583-9037-450f-bd8c-6c2546f1c934 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26" status: 404 len: 111 microversion: 2.1 time: 0.097642 May 28 04:35:42.352238 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 206/454] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:42 2022] GET /compute/v2.1/servers/bac9c02e-1bd0-420e-8a7f-1d530dceae26 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:42.367661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4aadca2d-7b8d-46b5-9f37-c6afcc9e5e66 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:42.378890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4aadca2d-7b8d-46b5-9f37-c6afcc9e5e66 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:42.386980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4aadca2d-7b8d-46b5-9f37-c6afcc9e5e66 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:42.387456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4aadca2d-7b8d-46b5-9f37-c6afcc9e5e66 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:42.405448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4aadca2d-7b8d-46b5-9f37-c6afcc9e5e66 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:42.406136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4aadca2d-7b8d-46b5-9f37-c6afcc9e5e66 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:42.455471 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-4aadca2d-7b8d-46b5-9f37-c6afcc9e5e66 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] HTTP exception thrown: Instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 could not be found. May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4aadca2d-7b8d-46b5-9f37-c6afcc9e5e66 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Request method failure captured: May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 HTTP/1.1 May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZhWSbx3Tl2pcEX8f5j_ONvAo7azWZppHUy25lW4SoaAY8g2QbiHiPd6S0iJRIGxuNtn8ommR4Mje3UYPQopWJcK0nblHhl1L_I1M9fd6AAHN21sO9FgujDvqsFbRzla21UkGIZbwbMmD4DkZahfX967XEFAgiMMGSsQ9VEyMJCphw May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 55a346c9751c4215909999fdbc3ea1be May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1678635388 May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:35:42.457373 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:35:42.458779 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:42.458779 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersAdminTestJSON-1678635388 May 28 04:35:42.458779 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 55a346c9751c4215909999fdbc3ea1be May 28 04:35:42.458779 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1678635388 May 28 04:35:42.458779 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersAdminTestJSON-1678635388-project May 28 04:35:42.458779 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:42.458779 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:42.458779 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24f5c69cf0c848b7b8c6672c5be5dcfa May 28 04:35:42.458779 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersAdminTestJSON-1678635388-project May 28 04:35:42.458779 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:35:42.458779 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 could not be found. May 28 04:35:42.458779 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '9a0535f1-775e-459f-86e6-1ae27b94fbb9'} May 28 04:35:42.459694 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:42.459694 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:42.459694 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:35:42.459694 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:35:42.459694 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:35:42.459694 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:35:42.459694 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:35:42.459694 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:35:42.459694 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:35:42.459694 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:35:42.459694 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 could not be found. May 28 04:35:42.459694 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.459694 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:42.459694 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.459694 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:42.459694 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:42.459694 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:42.459694 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:42.459694 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:42.459694 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:42.461257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:42.461257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:35:42.461257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:35:42.461257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:35:42.461257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:35:42.461257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:35:42.461257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:35:42.461257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:35:42.461257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:35:42.461257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 could not be found. May 28 04:35:42.461257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.461257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:42.461257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.461257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:42.461257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:42.461257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:42.461257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:42.461257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:42.461257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 could not be found. May 28 04:35:42.461257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.472891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4aadca2d-7b8d-46b5-9f37-c6afcc9e5e66 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Returning 404 to user: Instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:42.473893 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4aadca2d-7b8d-46b5-9f37-c6afcc9e5e66 tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 404 len: 111 microversion: 2.1 time: 0.120393 May 28 04:35:42.477502 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 207/455] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:35:42 2022] DELETE /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:42.486769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-45b2112f-f6b1-4cea-b349-80d6eae60c8a tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:42.493609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-45b2112f-f6b1-4cea-b349-80d6eae60c8a tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] [instance: 9a0535f1-775e-459f-86e6-1ae27b94fbb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:42.511932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45b2112f-f6b1-4cea-b349-80d6eae60c8a tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:42.512696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45b2112f-f6b1-4cea-b349-80d6eae60c8a tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:42.513733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45b2112f-f6b1-4cea-b349-80d6eae60c8a tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:42.514410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45b2112f-f6b1-4cea-b349-80d6eae60c8a tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:42.539843 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-45b2112f-f6b1-4cea-b349-80d6eae60c8a tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] HTTP exception thrown: Instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 could not be found. May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-45b2112f-f6b1-4cea-b349-80d6eae60c8a tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Request method failure captured: May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 HTTP/1.1 May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZhWSbx3Tl2pcEX8f5j_ONvAo7azWZppHUy25lW4SoaAY8g2QbiHiPd6S0iJRIGxuNtn8ommR4Mje3UYPQopWJcK0nblHhl1L_I1M9fd6AAHN21sO9FgujDvqsFbRzla21UkGIZbwbMmD4DkZahfX967XEFAgiMMGSsQ9VEyMJCphw May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 55a346c9751c4215909999fdbc3ea1be May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1678635388 May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:35:42.541801 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:35:42.542979 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55a346c9751c4215909999fdbc3ea1be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:42.542979 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersAdminTestJSON-1678635388 May 28 04:35:42.542979 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 55a346c9751c4215909999fdbc3ea1be May 28 04:35:42.542979 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1678635388 May 28 04:35:42.542979 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersAdminTestJSON-1678635388-project May 28 04:35:42.542979 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:42.542979 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:42.542979 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24f5c69cf0c848b7b8c6672c5be5dcfa May 28 04:35:42.542979 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersAdminTestJSON-1678635388-project May 28 04:35:42.542979 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:35:42.542979 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 could not be found. May 28 04:35:42.542979 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '9a0535f1-775e-459f-86e6-1ae27b94fbb9'} May 28 04:35:42.543690 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:42.543690 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:42.543690 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:35:42.543690 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:35:42.543690 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:35:42.543690 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:35:42.543690 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:35:42.543690 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:35:42.543690 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:35:42.543690 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:35:42.543690 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 could not be found. May 28 04:35:42.543690 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.543690 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:42.543690 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.543690 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:42.543690 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:42.543690 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:42.543690 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:42.543690 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:42.543690 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:42.544722 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:42.544722 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:35:42.544722 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:35:42.544722 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:35:42.544722 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:35:42.544722 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:35:42.544722 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:35:42.544722 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 could not be found. May 28 04:35:42.544722 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.544722 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:42.544722 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.544722 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:42.544722 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:42.544722 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:42.544722 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:42.544722 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:42.544722 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 could not be found. May 28 04:35:42.544722 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:42.547041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-45b2112f-f6b1-4cea-b349-80d6eae60c8a tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] Returning 404 to user: Instance 9a0535f1-775e-459f-86e6-1ae27b94fbb9 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:42.548153 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-45b2112f-f6b1-4cea-b349-80d6eae60c8a tempest-DeleteServersAdminTestJSON-1678635388 tempest-DeleteServersAdminTestJSON-1678635388-project] 10.222.0.58 "GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9" status: 404 len: 111 microversion: 2.1 time: 0.069487 May 28 04:35:42.552927 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 208/456] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:42 2022] GET /compute/v2.1/servers/9a0535f1-775e-459f-86e6-1ae27b94fbb9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:42.649548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-364acd28-18a2-411f-b722-0ae4664d136c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:42.651062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-364acd28-18a2-411f-b722-0ae4664d136c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:42.662507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-364acd28-18a2-411f-b722-0ae4664d136c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:42.663579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-364acd28-18a2-411f-b722-0ae4664d136c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:42.668145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-364acd28-18a2-411f-b722-0ae4664d136c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:42.668145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-364acd28-18a2-411f-b722-0ae4664d136c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:43.070922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-364acd28-18a2-411f-b722-0ae4664d136c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:43.082256 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-364acd28-18a2-411f-b722-0ae4664d136c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1476 microversion: 2.1 time: 0.437510 May 28 04:35:43.085027 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 209/457] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:42 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1476 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:43.090590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9beb29ac-8d95-429a-bafc-9fc306c1c3f8 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f77021a3940>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:43.188340 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9beb29ac-8d95-429a-bafc-9fc306c1c3f8 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.102019 May 28 04:35:43.189455 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 210/458] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:43 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:43.714972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-56d00275-2b9f-43b7-90c5-84013f327dff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:35:43.715483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-56d00275-2b9f-43b7-90c5-84013f327dff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:35:43.716045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-56d00275-2b9f-43b7-90c5-84013f327dff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:35:43.716524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-56d00275-2b9f-43b7-90c5-84013f327dff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:35:43.717012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-56d00275-2b9f-43b7-90c5-84013f327dff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:35:43.731681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56d00275-2b9f-43b7-90c5-84013f327dff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:43.732216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56d00275-2b9f-43b7-90c5-84013f327dff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:43.734302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56d00275-2b9f-43b7-90c5-84013f327dff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:43.734302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56d00275-2b9f-43b7-90c5-84013f327dff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:43.761708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-56d00275-2b9f-43b7-90c5-84013f327dff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Getting quotas for project d908671a46484d2082cc88a1d2c93f98. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:35:43.777568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-56d00275-2b9f-43b7-90c5-84013f327dff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Getting quotas for user da8fff3851eb4ecc927400c09117f5ee and project d908671a46484d2082cc88a1d2c93f98. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:35:43.831300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-56d00275-2b9f-43b7-90c5-84013f327dff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:35:43.841730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-56d00275-2b9f-43b7-90c5-84013f327dff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:35:44.030362 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-56d00275-2b9f-43b7-90c5-84013f327dff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.013581 May 28 04:35:44.033091 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 249/459] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:35:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:35:44.050200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-00d24396-c255-4425-8b41-ed87c898daab tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:44.051594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-00d24396-c255-4425-8b41-ed87c898daab tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:44.102961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-53ce624a-8488-466a-9c1d-ae4db53c009f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:44.103726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-53ce624a-8488-466a-9c1d-ae4db53c009f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:44.107614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=81,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=1,nova_api:DELETE=5,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:44.126855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53ce624a-8488-466a-9c1d-ae4db53c009f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:44.140195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53ce624a-8488-466a-9c1d-ae4db53c009f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:44.141066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53ce624a-8488-466a-9c1d-ae4db53c009f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:44.141518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53ce624a-8488-466a-9c1d-ae4db53c009f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:44.182254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-00d24396-c255-4425-8b41-ed87c898daab tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:44.190104 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-00d24396-c255-4425-8b41-ed87c898daab tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1211 microversion: 2.1 time: 0.145400 May 28 04:35:44.196216 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 211/460] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:44 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1211 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:44.214526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bc53c8e0-4730-4e0a-8cb2-f78723cfe4d4 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f770200ca60>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:44.348814 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bc53c8e0-4730-4e0a-8cb2-f78723cfe4d4 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.148748 May 28 04:35:44.354639 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 212/461] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:44 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:44.490738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-53ce624a-8488-466a-9c1d-ae4db53c009f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:44.508466 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-53ce624a-8488-466a-9c1d-ae4db53c009f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1476 microversion: 2.1 time: 0.408466 May 28 04:35:44.509958 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 250/462] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:44 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1476 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:45.213421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a90c6771-98ca-4175-8ec5-a59635dca3c9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:45.217977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a90c6771-98ca-4175-8ec5-a59635dca3c9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:45.363142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cc4b8e31-d00e-40dc-ac38-50528cc337d1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f50790>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:45.432448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a90c6771-98ca-4175-8ec5-a59635dca3c9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:45.443667 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a90c6771-98ca-4175-8ec5-a59635dca3c9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1211 microversion: 2.1 time: 0.238165 May 28 04:35:45.444217 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 213/463] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:45 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1211 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:45.481361 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cc4b8e31-d00e-40dc-ac38-50528cc337d1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.123491 May 28 04:35:45.488535 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 251/464] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:45 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:45.525969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-49e45be0-351b-4c9f-b29b-e2253f9696d0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:45.526974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-49e45be0-351b-4c9f-b29b-e2253f9696d0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:45.535998 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49e45be0-351b-4c9f-b29b-e2253f9696d0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:45.536496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49e45be0-351b-4c9f-b29b-e2253f9696d0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:45.537289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49e45be0-351b-4c9f-b29b-e2253f9696d0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:45.537752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49e45be0-351b-4c9f-b29b-e2253f9696d0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:45.720973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-49e45be0-351b-4c9f-b29b-e2253f9696d0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:45.729918 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-49e45be0-351b-4c9f-b29b-e2253f9696d0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1476 microversion: 2.1 time: 0.207832 May 28 04:35:45.730505 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 214/465] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:45 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1476 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:46.462361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-71925b84-0396-4b60-abe1-d4864f8a042f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:46.463690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-71925b84-0396-4b60-abe1-d4864f8a042f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:46.495329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ff3752dc-b55a-43cf-868d-b9de536b2329 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7702048af0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:46.502065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71925b84-0396-4b60-abe1-d4864f8a042f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:46.505670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71925b84-0396-4b60-abe1-d4864f8a042f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:46.515827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71925b84-0396-4b60-abe1-d4864f8a042f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:46.515827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71925b84-0396-4b60-abe1-d4864f8a042f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:46.587400 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ff3752dc-b55a-43cf-868d-b9de536b2329 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.096122 May 28 04:35:46.588298 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 215/466] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:46 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:46.751613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-af15baef-5ca3-47a3-b598-c8c5781b5344 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:46.751613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-af15baef-5ca3-47a3-b598-c8c5781b5344 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:46.759831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af15baef-5ca3-47a3-b598-c8c5781b5344 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:46.764576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af15baef-5ca3-47a3-b598-c8c5781b5344 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:46.765877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af15baef-5ca3-47a3-b598-c8c5781b5344 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:46.768057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af15baef-5ca3-47a3-b598-c8c5781b5344 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:46.800079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-71925b84-0396-4b60-abe1-d4864f8a042f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:46.810120 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-71925b84-0396-4b60-abe1-d4864f8a042f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1207 microversion: 2.1 time: 0.352576 May 28 04:35:46.815297 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 252/467] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:46 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1207 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:47.079440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-cccde0da-0524-40d8-835a-3c045ff14f13 req-c3882a43-514b-4025-a369-2e7f43841893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2af79f0-ae7c-40fd-8034-3a957e218bbd", "name": "network-vif-unplugged", "status": "completed", "tag": "e0a73643-7263-4551-8d5a-5ef51b6fe3b3"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:47.098114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-cccde0da-0524-40d8-835a-3c045ff14f13 req-c3882a43-514b-4025-a369-2e7f43841893 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:47.101629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-cccde0da-0524-40d8-835a-3c045ff14f13 req-c3882a43-514b-4025-a369-2e7f43841893 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:47.118058 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-cccde0da-0524-40d8-835a-3c045ff14f13 req-c3882a43-514b-4025-a369-2e7f43841893 service nova] Creating event network-vif-unplugged:e0a73643-7263-4551-8d5a-5ef51b6fe3b3 for instance c2af79f0-ae7c-40fd-8034-3a957e218bbd on n-h1-843700-1 May 28 04:35:47.132633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-cccde0da-0524-40d8-835a-3c045ff14f13 req-c3882a43-514b-4025-a369-2e7f43841893 service nova] Instance c2af79f0-ae7c-40fd-8034-3a957e218bbd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:35:47.153326 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-cccde0da-0524-40d8-835a-3c045ff14f13 req-c3882a43-514b-4025-a369-2e7f43841893 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079148 May 28 04:35:47.154751 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 253/468] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:47.603391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5f8ccc0e-ac72-49a9-a35d-26587ea6e246 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f429d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:47.611424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-af15baef-5ca3-47a3-b598-c8c5781b5344 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:47.623753 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-af15baef-5ca3-47a3-b598-c8c5781b5344 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1475 microversion: 2.1 time: 0.879937 May 28 04:35:47.638748 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 216/469] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:46 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1475 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:47.698542 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5f8ccc0e-ac72-49a9-a35d-26587ea6e246 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.099984 May 28 04:35:47.699644 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 254/470] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:47 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:47.832415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-13428095-efab-4524-9b85-8406f2f9c81d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:47.833834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-13428095-efab-4524-9b85-8406f2f9c81d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:47.858910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13428095-efab-4524-9b85-8406f2f9c81d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:47.860103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13428095-efab-4524-9b85-8406f2f9c81d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:47.863972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13428095-efab-4524-9b85-8406f2f9c81d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:47.865591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13428095-efab-4524-9b85-8406f2f9c81d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:48.471250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-728b6ee3-a8a9-4dc3-adda-3af8a2323b89 tempest-InstanceUsageAuditLogNegativeTestJSON-817318125 tempest-InstanceUsageAuditLogNegativeTestJSON-817318125-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:48.472945 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:48.472945 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:48.477410 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-728b6ee3-a8a9-4dc3-adda-3af8a2323b89 tempest-InstanceUsageAuditLogNegativeTestJSON-817318125 tempest-InstanceUsageAuditLogNegativeTestJSON-817318125-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-728b6ee3-a8a9-4dc3-adda-3af8a2323b89 tempest-InstanceUsageAuditLogNegativeTestJSON-817318125 tempest-InstanceUsageAuditLogNegativeTestJSON-817318125-project-admin] Request method failure captured: May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaakP9Ab0hS2M07IDeL99RX6c69YhBAxS-2U9JEhuZ9nCRkCXVJZSRqODF_GkTKGeMk_ncoCU25h9g0tW2NLtNq2i2OysbeMEB57IeWpPyzsT2PM_Ykhmhw0jbfzEKKwhi4UQAYvLqDgCH0bvmn4IYR1r3WTp7mK27wMKHnSuIsFTMk May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 43685289f8044f5b8e1709f9c68c7218 May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-817318125 May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:35:48.492461 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:35:48.494171 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_43685289f8044f5b8e1709f9c68c7218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/43685289f8044f5b8e1709f9c68c7218"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/43685289f8044f5b8e1709f9c68c7218"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/43685289f8044f5b8e1709f9c68c7218"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:48.494171 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-817318125 May 28 04:35:48.494171 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 43685289f8044f5b8e1709f9c68c7218 May 28 04:35:48.494171 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-817318125 May 28 04:35:48.494171 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-817318125-project-admin May 28 04:35:48.494171 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:48.494171 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:48.494171 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: aa084c085ff447b084b151faec7e9ba4 May 28 04:35:48.494171 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-817318125-project-admin May 28 04:35:48.494171 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:35:48.494171 n-d-843700-1 devstack@n-api.service[126044]: exception: Invalid timestamp for date invalid_time May 28 04:35:48.494171 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'invalid_time'} May 28 04:35:48.494881 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:48.494881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:48.494881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show May 28 04:35:48.494881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), May 28 04:35:48.494881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime May 28 04:35:48.494881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) May 28 04:35:48.494881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime May 28 04:35:48.494881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % May 28 04:35:48.494881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' May 28 04:35:48.494881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:48.494881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:48.494881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:48.494881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:48.494881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:48.494881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:48.494881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:48.494881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:48.494881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:48.494881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:48.494881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show May 28 04:35:48.496489 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) May 28 04:35:48.496489 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time May 28 04:35:48.496489 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:48.496489 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:48.496489 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:48.496489 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:48.496489 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:48.496489 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:48.496489 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:48.496489 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:48.496489 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time May 28 04:35:48.496489 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:48.496489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-728b6ee3-a8a9-4dc3-adda-3af8a2323b89 tempest-InstanceUsageAuditLogNegativeTestJSON-817318125 tempest-InstanceUsageAuditLogNegativeTestJSON-817318125-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:48.496489 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-728b6ee3-a8a9-4dc3-adda-3af8a2323b89 tempest-InstanceUsageAuditLogNegativeTestJSON-817318125 tempest-InstanceUsageAuditLogNegativeTestJSON-817318125-project-admin] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.246224 May 28 04:35:48.504765 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 255/471] 10.222.0.58 () {58 vars in 1223 bytes} [Sat May 28 04:35:48 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 258 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) May 28 04:35:48.720258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-13428095-efab-4524-9b85-8406f2f9c81d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:48.731940 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-13428095-efab-4524-9b85-8406f2f9c81d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1271 microversion: 2.1 time: 0.904124 May 28 04:35:48.740120 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 217/472] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:47 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1271 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:48.757071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8cf176d9-3950-41b0-b558-91335dfd0d01 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:48.769378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8cf176d9-3950-41b0-b558-91335dfd0d01 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:48.790411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cf176d9-3950-41b0-b558-91335dfd0d01 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:48.790787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cf176d9-3950-41b0-b558-91335dfd0d01 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:48.795102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cf176d9-3950-41b0-b558-91335dfd0d01 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:48.795780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cf176d9-3950-41b0-b558-91335dfd0d01 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:49.213182 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9188270e-7fac-4ad4-9a2d-63e424ffd217 tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289 tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:49.213959 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:49.213959 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:49.215259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9188270e-7fac-4ad4-9a2d-63e424ffd217 tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289 tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '4ba27bf030c246a68b1f7db2b8afdff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28f675e32a40959ee307b6b8449f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9188270e-7fac-4ad4-9a2d-63e424ffd217 tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289 tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289-project] Request method failure captured: May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaagSO0AY0ISSFXv0kDSC-muerHNgh_2nlxsGTWnh9QJShWVcY7bfgF9CtGhcOTM2YP3-kYK6RKKdFTrs5Q6Y3R6-aCjAqN3vJorPmPji6IpZA6Lj6PQ9ul49QD_9yyD1bNKUhfzlSgL9rSBKJxy6M1wyPuRJv0fTQ-qlzYkUigYzK4 May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 5a28f675e32a40959ee307b6b8449f2a May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289 May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:35:49.216825 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:35:49.218096 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5a28f675e32a40959ee307b6b8449f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5a28f675e32a40959ee307b6b8449f2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5a28f675e32a40959ee307b6b8449f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5a28f675e32a40959ee307b6b8449f2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:49.218096 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289 May 28 04:35:49.218096 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 5a28f675e32a40959ee307b6b8449f2a May 28 04:35:49.218096 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289 May 28 04:35:49.218096 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289-project May 28 04:35:49.218096 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:49.218096 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:49.218096 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 4ba27bf030c246a68b1f7db2b8afdff7 May 28 04:35:49.218096 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289-project May 28 04:35:49.218096 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:35:49.218096 n-d-843700-1 devstack@n-api.service[126044]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 28 04:35:49.218704 n-d-843700-1 devstack@n-api.service[126044]: action_args: {} May 28 04:35:49.218704 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:49.218704 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:49.218704 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:49.218704 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:49.218704 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:49.218704 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:49.218704 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:49.218704 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:49.218704 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index May 28 04:35:49.218704 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) May 28 04:35:49.218704 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:49.218704 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:49.218704 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:49.218704 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:49.218704 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:49.218704 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:49.218704 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:49.218704 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:49.218704 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:49.219899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:49.219899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:49.219899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:49.219899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:49.219899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:49.219899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 28 04:35:49.219899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:49.219899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:49.219899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:49.219899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:49.219899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:49.219899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:49.219899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:49.219899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:49.219899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 28 04:35:49.219899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:49.219899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9188270e-7fac-4ad4-9a2d-63e424ffd217 tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289 tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:49.220817 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9188270e-7fac-4ad4-9a2d-63e424ffd217 tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289 tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289-project] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.707777 May 28 04:35:49.220817 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 256/473] 10.222.0.58 () {58 vars in 1184 bytes} [Sat May 28 04:35:48 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 710 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:49.233426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e350b3a7-0cee-4186-9ed9-a278c08b7e83 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f01550>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:49.301584 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e350b3a7-0cee-4186-9ed9-a278c08b7e83 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.078165 May 28 04:35:49.302167 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 257/474] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:49 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:49.309208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8cf176d9-3950-41b0-b558-91335dfd0d01 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:49.317493 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8cf176d9-3950-41b0-b558-91335dfd0d01 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1475 microversion: 2.1 time: 0.576004 May 28 04:35:49.327724 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 218/475] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:48 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1475 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:49.332657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ef66207b-2e0d-4bdd-8c38-427cf94b36d0 tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289 tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:49.358137 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:49.358137 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:49.360748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ef66207b-2e0d-4bdd-8c38-427cf94b36d0 tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289 tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '4ba27bf030c246a68b1f7db2b8afdff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28f675e32a40959ee307b6b8449f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ef66207b-2e0d-4bdd-8c38-427cf94b36d0 tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289 tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289-project] Request method failure captured: May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-05-28%2004:35:49 HTTP/1.1 May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaagSO0AY0ISSFXv0kDSC-muerHNgh_2nlxsGTWnh9QJShWVcY7bfgF9CtGhcOTM2YP3-kYK6RKKdFTrs5Q6Y3R6-aCjAqN3vJorPmPji6IpZA6Lj6PQ9ul49QD_9yyD1bNKUhfzlSgL9rSBKJxy6M1wyPuRJv0fTQ-qlzYkUigYzK4 May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 5a28f675e32a40959ee307b6b8449f2a May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289 May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:35:49.369557 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:35:49.373502 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5a28f675e32a40959ee307b6b8449f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5a28f675e32a40959ee307b6b8449f2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5a28f675e32a40959ee307b6b8449f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5a28f675e32a40959ee307b6b8449f2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:49.373502 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289 May 28 04:35:49.373502 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 5a28f675e32a40959ee307b6b8449f2a May 28 04:35:49.373502 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289 May 28 04:35:49.373502 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289-project May 28 04:35:49.373502 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:49.373502 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:49.373502 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 4ba27bf030c246a68b1f7db2b8afdff7 May 28 04:35:49.373502 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289-project May 28 04:35:49.373502 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:35:49.373502 n-d-843700-1 devstack@n-api.service[126043]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 28 04:35:49.374151 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '2022-05-28 04:35:49'} May 28 04:35:49.374151 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:49.374151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:49.374151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:49.374151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:49.374151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:49.374151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:49.374151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:49.374151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:49.374151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show May 28 04:35:49.374151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) May 28 04:35:49.374151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:49.374151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:49.374151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:49.374151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:49.374151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:49.374151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:49.374151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:49.374151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:49.374151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:49.375475 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:49.375475 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:49.375475 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:49.375475 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:49.375475 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:49.375475 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 28 04:35:49.375475 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:49.375475 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:49.375475 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:49.375475 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:49.375475 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:49.375475 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:49.375475 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:49.375475 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:49.375475 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 28 04:35:49.375475 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:49.380595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ef66207b-2e0d-4bdd-8c38-427cf94b36d0 tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289 tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:49.384353 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ef66207b-2e0d-4bdd-8c38-427cf94b36d0 tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289 tempest-InstanceUsageAuditLogNegativeTestJSON-1696085289-project] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log/2022-05-28 04:35:49" status: 403 len: 128 microversion: 2.1 time: 0.055569 May 28 04:35:49.390097 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 219/476] 10.222.0.58 () {58 vars in 1250 bytes} [Sat May 28 04:35:49 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-05-28%2004%3A35%3A49 => generated 128 bytes in 61 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:49.410213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-30edd26c-f0f7-48b6-9491-ef384bb18328 tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] Action: 'update', calling method: .version_select at 0x7f7701fbd280>, body: {"quota_set": {"ram": "5120"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:49.643659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-a1a99a8e-1b48-48e0-b0f3-6d9a7837b6f0 req-2b0901dd-089e-4670-a4e8-31bae0882073 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2af79f0-ae7c-40fd-8034-3a957e218bbd", "tag": "e0a73643-7263-4551-8d5a-5ef51b6fe3b3"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:49.675624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a1a99a8e-1b48-48e0-b0f3-6d9a7837b6f0 req-2b0901dd-089e-4670-a4e8-31bae0882073 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:49.687820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a1a99a8e-1b48-48e0-b0f3-6d9a7837b6f0 req-2b0901dd-089e-4670-a4e8-31bae0882073 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:49.745264 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-a1a99a8e-1b48-48e0-b0f3-6d9a7837b6f0 req-2b0901dd-089e-4670-a4e8-31bae0882073 service nova] Creating event network-changed:e0a73643-7263-4551-8d5a-5ef51b6fe3b3 for instance c2af79f0-ae7c-40fd-8034-3a957e218bbd on n-h1-843700-1 May 28 04:35:49.767651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-a1a99a8e-1b48-48e0-b0f3-6d9a7837b6f0 req-2b0901dd-089e-4670-a4e8-31bae0882073 service nova] Instance c2af79f0-ae7c-40fd-8034-3a957e218bbd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:35:49.815082 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-a1a99a8e-1b48-48e0-b0f3-6d9a7837b6f0 req-2b0901dd-089e-4670-a4e8-31bae0882073 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171059 May 28 04:35:49.820645 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 220/477] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:35:49.837388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b93d9a4d-0e91-44bc-a711-99d757ae9c1d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:49.848162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b93d9a4d-0e91-44bc-a711-99d757ae9c1d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:49.880999 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b93d9a4d-0e91-44bc-a711-99d757ae9c1d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:49.884859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b93d9a4d-0e91-44bc-a711-99d757ae9c1d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:49.885713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b93d9a4d-0e91-44bc-a711-99d757ae9c1d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:49.886165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b93d9a4d-0e91-44bc-a711-99d757ae9c1d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:50.476802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b93d9a4d-0e91-44bc-a711-99d757ae9c1d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:50.483933 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b93d9a4d-0e91-44bc-a711-99d757ae9c1d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1311 microversion: 2.1 time: 0.661619 May 28 04:35:50.484526 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 221/478] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:49 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1311 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:50.499426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2d65701f-69fe-414b-bb7a-27ae7a0ee104 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7702018ca0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:50.517499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30edd26c-f0f7-48b6-9491-ef384bb18328 tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:50.518079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30edd26c-f0f7-48b6-9491-ef384bb18328 tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:50.519304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30edd26c-f0f7-48b6-9491-ef384bb18328 tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:50.519748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30edd26c-f0f7-48b6-9491-ef384bb18328 tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:50.564791 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2d65701f-69fe-414b-bb7a-27ae7a0ee104 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.075918 May 28 04:35:50.568103 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 222/479] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:50 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:50.573604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c1761159-2955-46d1-97cd-197e355d665d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:50.574525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c1761159-2955-46d1-97cd-197e355d665d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:50.588657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1761159-2955-46d1-97cd-197e355d665d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:50.589392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1761159-2955-46d1-97cd-197e355d665d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:50.590400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1761159-2955-46d1-97cd-197e355d665d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:50.591018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1761159-2955-46d1-97cd-197e355d665d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:50.820766 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-30edd26c-f0f7-48b6-9491-ef384bb18328 tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/d1ab5e30a0a645a990db348c236a7303" status: 200 len: 240 microversion: 2.36 time: 1.517491 May 28 04:35:50.826298 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 258/480] 10.222.0.58 () {62 vars in 1302 bytes} [Sat May 28 04:35:49 2022] PUT /compute/v2.1/os-quota-sets/d1ab5e30a0a645a990db348c236a7303 => generated 240 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:35:50.840337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-71e6de02-00be-4fa1-a858-804242567e9a tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] Calling method '.version_select at 0x7f7701f50dc0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:51.240278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c1761159-2955-46d1-97cd-197e355d665d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:51.252023 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c1761159-2955-46d1-97cd-197e355d665d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1475 microversion: 2.1 time: 0.682144 May 28 04:35:51.272716 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 223/481] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:50 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1475 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:51.560257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b294888e-6452-4005-a2fc-d6195d158aed tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Calling method '.version_select at 0x7f77021a00d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:51.561590 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:51.561590 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:51.562734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b294888e-6452-4005-a2fc-d6195d158aed tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:51.563216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b294888e-6452-4005-a2fc-d6195d158aed tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:51.564021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b294888e-6452-4005-a2fc-d6195d158aed tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:51.564450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b294888e-6452-4005-a2fc-d6195d158aed tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:51.661123 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b294888e-6452-4005-a2fc-d6195d158aed tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.294336 May 28 04:35:51.664523 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 224/482] 10.222.0.58 () {58 vars in 1127 bytes} [Sat May 28 04:35:51 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:51.672933 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-71ca7425-3144-4529-8d33-1b512348bc79 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:51.683429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-71ca7425-3144-4529-8d33-1b512348bc79 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:51.702778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71ca7425-3144-4529-8d33-1b512348bc79 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:51.703284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71ca7425-3144-4529-8d33-1b512348bc79 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:51.704101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71ca7425-3144-4529-8d33-1b512348bc79 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:51.704557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71ca7425-3144-4529-8d33-1b512348bc79 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:51.746074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71e6de02-00be-4fa1-a858-804242567e9a tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:51.749978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71e6de02-00be-4fa1-a858-804242567e9a tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:51.751149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71e6de02-00be-4fa1-a858-804242567e9a tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:51.755626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71e6de02-00be-4fa1-a858-804242567e9a tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:51.813236 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-71e6de02-00be-4fa1-a858-804242567e9a tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/d1ab5e30a0a645a990db348c236a7303/detail" status: 200 len: 672 microversion: 2.36 time: 0.980546 May 28 04:35:51.814707 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 259/483] 10.222.0.58 () {60 vars in 1303 bytes} [Sat May 28 04:35:50 2022] GET /compute/v2.1/os-quota-sets/d1ab5e30a0a645a990db348c236a7303/detail => generated 672 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:35:51.819555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3f707f9c-3ded-4fe3-a88e-56582d3e9b93 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f01940>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:51.922194 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3f707f9c-3ded-4fe3-a88e-56582d3e9b93 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.104249 May 28 04:35:51.922194 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 260/484] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:51 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:52.649565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d25618f7-cae3-4123-963f-7bd577175ac2 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Calling method '.version_select at 0x7f7701f50f70>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:52.650634 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:52.650634 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:52.651776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d25618f7-cae3-4123-963f-7bd577175ac2 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '47c6a4198f0349daa952af38078c9c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f6214f46514322baa64ad23ce99ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d25618f7-cae3-4123-963f-7bd577175ac2 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Request method failure captured: May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-hosts HTTP/1.1 May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaak5ujip2ytshep3FFE59P0St_SoXbpDUSJqbYykMwFQKMwTVHKwL14_VtkQUyBJdKsBASBMlBy49e22MKmFYF9ubVZpXmRftQ013NwRmwZx7sQMx-yPZiGqnPlSGsPGldO0DKbfUn2Ba_Hcra9zyKW4EosMVfw5ek6W_cKwYypcQI May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 88f6214f46514322baa64ad23ce99ff1 May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-839131068 May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:35:52.653769 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:35:52.657699 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:52.657699 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-839131068 May 28 04:35:52.657699 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 88f6214f46514322baa64ad23ce99ff1 May 28 04:35:52.657699 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-839131068 May 28 04:35:52.657699 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-HostsAdminNegativeTestJSON-839131068-project May 28 04:35:52.657699 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:52.657699 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:52.657699 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 47c6a4198f0349daa952af38078c9c65 May 28 04:35:52.657699 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-839131068-project May 28 04:35:52.657699 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:35:52.657699 n-d-843700-1 devstack@n-api.service[126044]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 28 04:35:52.657699 n-d-843700-1 devstack@n-api.service[126044]: action_args: {} May 28 04:35:52.657699 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:52.658967 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:52.658967 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:52.658967 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:52.658967 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:52.658967 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:52.658967 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:52.658967 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:52.658967 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:35:52.658967 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:35:52.658967 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:52.658967 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:52.658967 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index May 28 04:35:52.658967 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', May 28 04:35:52.658967 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:52.658967 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:52.658967 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:52.658967 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:52.658967 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:52.658967 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:52.660777 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:52.660777 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:52.660777 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:52.660777 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:52.660777 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:52.660777 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:52.660777 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:52.660777 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:52.660777 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 28 04:35:52.660777 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:52.660777 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:52.660777 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:52.660777 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:52.660777 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:52.660777 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:52.660777 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:52.660777 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:52.660777 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 28 04:35:52.660777 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:52.661849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d25618f7-cae3-4123-963f-7bd577175ac2 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:52.661849 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d25618f7-cae3-4123-963f-7bd577175ac2 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.732877 May 28 04:35:52.661849 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 261/485] 10.222.0.58 () {58 vars in 1127 bytes} [Sat May 28 04:35:51 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 734 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:52.662347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-45cd2875-1439-4a96-a720-f6e2ca26bfc9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:52.663334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-45cd2875-1439-4a96-a720-f6e2ca26bfc9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:52.690885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45cd2875-1439-4a96-a720-f6e2ca26bfc9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:52.692735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45cd2875-1439-4a96-a720-f6e2ca26bfc9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:52.693798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45cd2875-1439-4a96-a720-f6e2ca26bfc9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:52.696361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45cd2875-1439-4a96-a720-f6e2ca26bfc9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:52.989368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-71ca7425-3144-4529-8d33-1b512348bc79 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:53.007223 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-71ca7425-3144-4529-8d33-1b512348bc79 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1311 microversion: 2.1 time: 1.331454 May 28 04:35:53.007223 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 225/486] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:51 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1311 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:53.008313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-35e7be9f-ff28-4b20-8c3d-a625139338c3 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Calling method '.version_select at 0x7f7701fad5e0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:53.021177 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:53.021177 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:53.022471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-35e7be9f-ff28-4b20-8c3d-a625139338c3 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '47c6a4198f0349daa952af38078c9c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f6214f46514322baa64ad23ce99ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-35e7be9f-ff28-4b20-8c3d-a625139338c3 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Request method failure captured: May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/os-hosts/n-d-843700-1/reboot HTTP/1.1 May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaak5ujip2ytshep3FFE59P0St_SoXbpDUSJqbYykMwFQKMwTVHKwL14_VtkQUyBJdKsBASBMlBy49e22MKmFYF9ubVZpXmRftQ013NwRmwZx7sQMx-yPZiGqnPlSGsPGldO0DKbfUn2Ba_Hcra9zyKW4EosMVfw5ek6W_cKwYypcQI May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 88f6214f46514322baa64ad23ce99ff1 May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-839131068 May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:35:53.024521 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:35:53.025987 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:53.025987 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-HostsAdminNegativeTestJSON-839131068 May 28 04:35:53.025987 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 88f6214f46514322baa64ad23ce99ff1 May 28 04:35:53.025987 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-839131068 May 28 04:35:53.025987 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-HostsAdminNegativeTestJSON-839131068-project May 28 04:35:53.025987 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:53.025987 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:53.025987 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 47c6a4198f0349daa952af38078c9c65 May 28 04:35:53.025987 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-HostsAdminNegativeTestJSON-839131068-project May 28 04:35:53.025987 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:35:53.025987 n-d-843700-1 devstack@n-api.service[126043]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 28 04:35:53.025987 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'n-d-843700-1'} May 28 04:35:53.025987 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:53.026839 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.026839 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:53.026839 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:53.026839 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:53.026839 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:53.026839 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:53.026839 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:53.026839 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:53.026839 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:53.026839 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot May 28 04:35:53.026839 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', May 28 04:35:53.026839 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:53.026839 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:53.026839 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:53.026839 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:53.026839 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:53.026839 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:53.026839 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:53.026839 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:53.028354 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:53.028354 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:53.028354 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:53.028354 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:53.028354 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:53.028354 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:53.028354 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 28 04:35:53.028354 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:53.028354 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:53.028354 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:53.028354 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.028354 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:53.028354 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:53.028354 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:53.028354 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:53.028354 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 28 04:35:53.028354 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:53.034471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-35e7be9f-ff28-4b20-8c3d-a625139338c3 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:53.035376 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-35e7be9f-ff28-4b20-8c3d-a625139338c3 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-843700-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.030924 May 28 04:35:53.047738 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 226/487] 10.222.0.58 () {58 vars in 1187 bytes} [Sat May 28 04:35:52 2022] GET /compute/v2.1/os-hosts/n-d-843700-1/reboot => generated 111 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:53.052503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8bb149fa-6499-4619-b16b-d989da7c87dd tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] Action: 'update', calling method: .version_select at 0x7f7701fb34c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:53.468715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-45cd2875-1439-4a96-a720-f6e2ca26bfc9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:53.485106 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-45cd2875-1439-4a96-a720-f6e2ca26bfc9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1475 microversion: 2.1 time: 0.825959 May 28 04:35:53.490008 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 262/488] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:52 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1475 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:53.511424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8bb149fa-6499-4619-b16b-d989da7c87dd tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:53.512054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8bb149fa-6499-4619-b16b-d989da7c87dd tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:53.513195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8bb149fa-6499-4619-b16b-d989da7c87dd tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:53.513324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-77364cb4-4a14-4a28-88ef-a99d58e3441e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f11ca0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:53.513906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8bb149fa-6499-4619-b16b-d989da7c87dd tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:53.570912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:53.626979 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-77364cb4-4a14-4a28-88ef-a99d58e3441e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.134909 May 28 04:35:53.631102 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 263/489] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:53 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:53.647928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6e5f3ba3-22c3-470d-ad5e-15e00d1d3213 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Calling method '.version_select at 0x7f7701f11e50>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:53.653685 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:53.653685 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:53.695419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8bb149fa-6499-4619-b16b-d989da7c87dd tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:53.695878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8bb149fa-6499-4619-b16b-d989da7c87dd tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:53.696688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8bb149fa-6499-4619-b16b-d989da7c87dd tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:53.697131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8bb149fa-6499-4619-b16b-d989da7c87dd tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:53.701702 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-6e5f3ba3-22c3-470d-ad5e-15e00d1d3213 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6e5f3ba3-22c3-470d-ad5e-15e00d1d3213 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Request method failure captured: May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaaniBLJN8J2YtVgwu0hoO5-bvHPdIi2Px2_QOtA7mtF9_b0qEJK5f3WwFcUesrVERbfnX8JPM-hLTnnxmCYO6r5bIbGJzSEvCl-w6Xs-TwUeDlL7i-K6jDzKwKPKc5ykNAF02WgZEqCkT9DrMGPz0tGyHhjpsgiZrGNk1b9zhlCXFo May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 8e63b7d277ff46ecad2ad2f72c78f872 May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:35:53.708526 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:35:53.712668 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:53.712668 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:53.712668 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 8e63b7d277ff46ecad2ad2f72c78f872 May 28 04:35:53.712668 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:53.712668 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-HostsAdminNegativeTestJSON-1811967195-project-admin May 28 04:35:53.712668 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:53.712668 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:53.712668 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: bd6aef6b346243f7b4ecd4f95ed41b1c May 28 04:35:53.712668 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1811967195-project-admin May 28 04:35:53.712668 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:35:53.712668 n-d-843700-1 devstack@n-api.service[126044]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:53.712668 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'nonexistent_hostname'} May 28 04:35:53.712668 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:53.713632 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.713632 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 28 04:35:53.713632 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 28 04:35:53.713632 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 04:35:53.713632 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 04:35:53.713632 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:53.713632 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:53.713632 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:53.713632 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:53.713632 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 04:35:53.713632 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 04:35:53.713632 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 28 04:35:53.713632 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 28 04:35:53.713632 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:35:53.713632 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:35:53.713632 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 28 04:35:53.713632 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 28 04:35:53.713632 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:35:53.713632 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:35:53.714760 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 28 04:35:53.714760 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 28 04:35:53.714760 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:53.714760 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.714760 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:53.714760 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.714760 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.714760 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:53.714760 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:53.714760 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:53.714760 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:53.714760 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:53.714760 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:53.714760 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:53.714760 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:53.714760 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot May 28 04:35:53.714760 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") May 28 04:35:53.714760 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 28 04:35:53.714760 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:35:53.715957 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:53.715957 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.715957 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:53.715957 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.715957 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.715957 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:53.715957 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:53.715957 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:53.715957 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:53.715957 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:53.715957 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.718872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6e5f3ba3-22c3-470d-ad5e-15e00d1d3213 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:53.723148 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6e5f3ba3-22c3-470d-ad5e-15e00d1d3213 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.090245 May 28 04:35:53.731665 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 264/490] 10.222.0.58 () {58 vars in 1211 bytes} [Sat May 28 04:35:53 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:35:53.743475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dd0c49fe-8736-4609-804b-b2cd9ee59c30 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Calling method '.version_select at 0x7f7701f01940>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:53.744577 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:53.744577 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:53.746355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dd0c49fe-8736-4609-804b-b2cd9ee59c30 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '47c6a4198f0349daa952af38078c9c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f6214f46514322baa64ad23ce99ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dd0c49fe-8736-4609-804b-b2cd9ee59c30 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Request method failure captured: May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-hosts/n-d-843700-1 HTTP/1.1 May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaak5ujip2ytshep3FFE59P0St_SoXbpDUSJqbYykMwFQKMwTVHKwL14_VtkQUyBJdKsBASBMlBy49e22MKmFYF9ubVZpXmRftQ013NwRmwZx7sQMx-yPZiGqnPlSGsPGldO0DKbfUn2Ba_Hcra9zyKW4EosMVfw5ek6W_cKwYypcQI May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 88f6214f46514322baa64ad23ce99ff1 May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-839131068 May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:35:53.751869 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:35:53.753418 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:53.753418 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-839131068 May 28 04:35:53.753418 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 88f6214f46514322baa64ad23ce99ff1 May 28 04:35:53.753418 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-839131068 May 28 04:35:53.753418 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-HostsAdminNegativeTestJSON-839131068-project May 28 04:35:53.753418 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:53.753418 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:53.753418 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 47c6a4198f0349daa952af38078c9c65 May 28 04:35:53.753418 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-839131068-project May 28 04:35:53.753418 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:35:53.753418 n-d-843700-1 devstack@n-api.service[126044]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 28 04:35:53.753418 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'n-d-843700-1'} May 28 04:35:53.753418 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:53.754276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.754276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:53.754276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:53.754276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:53.754276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:53.754276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:53.754276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:53.754276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:53.754276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:53.754276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show May 28 04:35:53.754276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', May 28 04:35:53.754276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:53.754276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:53.754276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:53.754276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:53.754276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:53.754276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:53.754276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:53.754276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:53.755533 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:53.755533 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:53.755533 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:53.755533 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:53.755533 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:53.755533 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:53.755533 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 28 04:35:53.755533 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.755533 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:53.755533 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.755533 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.755533 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:53.755533 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:53.755533 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:53.755533 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:53.755533 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 28 04:35:53.755533 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.759823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dd0c49fe-8736-4609-804b-b2cd9ee59c30 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:53.761080 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dd0c49fe-8736-4609-804b-b2cd9ee59c30 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-843700-1" status: 403 len: 109 microversion: 2.1 time: 0.021960 May 28 04:35:53.762142 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 265/491] 10.222.0.58 () {58 vars in 1166 bytes} [Sat May 28 04:35:53 2022] GET /compute/v2.1/os-hosts/n-d-843700-1 => generated 109 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:53.775560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-386d9fd8-2c07-4333-9e2c-92cbc4fe206b tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Calling method '.version_select at 0x7f7701f11550>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:53.798498 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-386d9fd8-2c07-4333-9e2c-92cbc4fe206b tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-386d9fd8-2c07-4333-9e2c-92cbc4fe206b tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Request method failure captured: May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaaniBLJN8J2YtVgwu0hoO5-bvHPdIi2Px2_QOtA7mtF9_b0qEJK5f3WwFcUesrVERbfnX8JPM-hLTnnxmCYO6r5bIbGJzSEvCl-w6Xs-TwUeDlL7i-K6jDzKwKPKc5ykNAF02WgZEqCkT9DrMGPz0tGyHhjpsgiZrGNk1b9zhlCXFo May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 8e63b7d277ff46ecad2ad2f72c78f872 May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:35:53.802788 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:35:53.804351 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:53.804351 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:53.804351 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 8e63b7d277ff46ecad2ad2f72c78f872 May 28 04:35:53.804351 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:53.804351 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-HostsAdminNegativeTestJSON-1811967195-project-admin May 28 04:35:53.804351 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:53.804351 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:53.804351 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: bd6aef6b346243f7b4ecd4f95ed41b1c May 28 04:35:53.804351 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1811967195-project-admin May 28 04:35:53.804351 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:35:53.804351 n-d-843700-1 devstack@n-api.service[126044]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:53.804351 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'nonexistent_hostname'} May 28 04:35:53.804351 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:53.805213 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.805213 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show May 28 04:35:53.805213 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 28 04:35:53.805213 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:35:53.805213 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:35:53.805213 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 28 04:35:53.805213 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 28 04:35:53.805213 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:35:53.805213 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:35:53.805213 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 28 04:35:53.805213 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 28 04:35:53.805213 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:53.805213 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.805213 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:53.805213 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.805213 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.805213 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:53.805213 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:53.805213 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:53.806445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:53.806445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:53.806445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:53.806445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:53.806445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:53.806445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show May 28 04:35:53.806445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:35:53.806445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:53.806445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.806445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:53.806445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.806445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.806445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:53.806445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:53.806445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:53.806445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:53.806445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:53.806445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.816617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-386d9fd8-2c07-4333-9e2c-92cbc4fe206b tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:53.816617 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-386d9fd8-2c07-4333-9e2c-92cbc4fe206b tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.044181 May 28 04:35:53.821780 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 266/492] 10.222.0.58 () {58 vars in 1190 bytes} [Sat May 28 04:35:53 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:35:53.844234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4ecfdc54-86bc-48c1-8be7-77ea6754c5c9 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Calling method '.version_select at 0x7f7701f110d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:53.845454 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:53.845454 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:53.857741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4ecfdc54-86bc-48c1-8be7-77ea6754c5c9 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '47c6a4198f0349daa952af38078c9c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f6214f46514322baa64ad23ce99ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4ecfdc54-86bc-48c1-8be7-77ea6754c5c9 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Request method failure captured: May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-hosts/n-d-843700-1/shutdown HTTP/1.1 May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaak5ujip2ytshep3FFE59P0St_SoXbpDUSJqbYykMwFQKMwTVHKwL14_VtkQUyBJdKsBASBMlBy49e22MKmFYF9ubVZpXmRftQ013NwRmwZx7sQMx-yPZiGqnPlSGsPGldO0DKbfUn2Ba_Hcra9zyKW4EosMVfw5ek6W_cKwYypcQI May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 88f6214f46514322baa64ad23ce99ff1 May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-839131068 May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:35:53.868237 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:35:53.869517 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:53.869517 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-839131068 May 28 04:35:53.869517 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 88f6214f46514322baa64ad23ce99ff1 May 28 04:35:53.869517 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-839131068 May 28 04:35:53.869517 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-HostsAdminNegativeTestJSON-839131068-project May 28 04:35:53.869517 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:53.869517 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:53.869517 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 47c6a4198f0349daa952af38078c9c65 May 28 04:35:53.869517 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-839131068-project May 28 04:35:53.869517 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:35:53.869517 n-d-843700-1 devstack@n-api.service[126044]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 28 04:35:53.869517 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'n-d-843700-1'} May 28 04:35:53.869517 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:53.870327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.870327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:53.870327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:53.870327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:53.870327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:53.870327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:53.870327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:53.870327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:53.870327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:53.870327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown May 28 04:35:53.870327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', May 28 04:35:53.870327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:53.870327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:53.870327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:53.870327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:53.870327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:53.870327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:53.870327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:53.870327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:53.871353 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:53.871353 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:53.871353 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:53.871353 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:53.871353 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:53.871353 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:53.871353 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 28 04:35:53.871353 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.871353 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:53.871353 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.871353 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.871353 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:53.871353 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:53.871353 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:53.871353 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:53.871353 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 28 04:35:53.871353 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.873045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4ecfdc54-86bc-48c1-8be7-77ea6754c5c9 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:53.873045 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4ecfdc54-86bc-48c1-8be7-77ea6754c5c9 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-843700-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.047345 May 28 04:35:53.879383 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 267/493] 10.222.0.58 () {58 vars in 1193 bytes} [Sat May 28 04:35:53 2022] GET /compute/v2.1/os-hosts/n-d-843700-1/shutdown => generated 113 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:53.886118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0031f121-4a28-471e-93f1-6d3de925a561 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Calling method '.version_select at 0x7f7701f50f70>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:53.897238 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-0031f121-4a28-471e-93f1-6d3de925a561 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0031f121-4a28-471e-93f1-6d3de925a561 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Request method failure captured: May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaaniBLJN8J2YtVgwu0hoO5-bvHPdIi2Px2_QOtA7mtF9_b0qEJK5f3WwFcUesrVERbfnX8JPM-hLTnnxmCYO6r5bIbGJzSEvCl-w6Xs-TwUeDlL7i-K6jDzKwKPKc5ykNAF02WgZEqCkT9DrMGPz0tGyHhjpsgiZrGNk1b9zhlCXFo May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 8e63b7d277ff46ecad2ad2f72c78f872 May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:35:53.899555 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:35:53.900792 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:53.900792 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:53.900792 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 8e63b7d277ff46ecad2ad2f72c78f872 May 28 04:35:53.900792 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:53.900792 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-HostsAdminNegativeTestJSON-1811967195-project-admin May 28 04:35:53.900792 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:53.900792 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:53.900792 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: bd6aef6b346243f7b4ecd4f95ed41b1c May 28 04:35:53.900792 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1811967195-project-admin May 28 04:35:53.900792 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:35:53.900792 n-d-843700-1 devstack@n-api.service[126044]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:53.900792 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'nonexistent_hostname'} May 28 04:35:53.900792 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:53.901508 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.901508 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 28 04:35:53.901508 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 28 04:35:53.901508 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 04:35:53.901508 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 04:35:53.901508 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:53.901508 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:53.901508 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:53.901508 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:53.901508 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 04:35:53.901508 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 04:35:53.901508 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 28 04:35:53.901508 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 28 04:35:53.901508 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:35:53.901508 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:35:53.901508 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 28 04:35:53.901508 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 28 04:35:53.901508 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:35:53.901508 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:35:53.902567 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 28 04:35:53.902567 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 28 04:35:53.902567 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:53.902567 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.902567 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:53.902567 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.902567 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.902567 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:53.902567 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:53.902567 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:53.902567 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:53.902567 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:53.902567 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:53.902567 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:53.902567 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:53.902567 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown May 28 04:35:53.902567 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") May 28 04:35:53.902567 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 28 04:35:53.902567 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:35:53.903665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:53.903665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.903665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:53.903665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.903665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.903665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:53.903665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:53.903665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:53.903665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:53.903665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:53.903665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.908808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0031f121-4a28-471e-93f1-6d3de925a561 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:53.911386 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0031f121-4a28-471e-93f1-6d3de925a561 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.030178 May 28 04:35:53.916712 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 268/494] 10.222.0.58 () {58 vars in 1217 bytes} [Sat May 28 04:35:53 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:35:53.923342 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8bb149fa-6499-4619-b16b-d989da7c87dd tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/d1ab5e30a0a645a990db348c236a7303?user_id=24ac94ae2c2744429ee0f8f2328ee81e" status: 200 len: 240 microversion: 2.36 time: 0.871734 May 28 04:35:53.926793 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 227/495] 10.222.0.58 () {62 vars in 1383 bytes} [Sat May 28 04:35:53 2022] PUT /compute/v2.1/os-quota-sets/d1ab5e30a0a645a990db348c236a7303?user_id=24ac94ae2c2744429ee0f8f2328ee81e => generated 240 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:35:53.927165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-03091dd3-ca71-42b3-ad78-09a3121eab27 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Calling method '.version_select at 0x7f7701f11f70>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:53.927165 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:53.927165 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:53.927165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-03091dd3-ca71-42b3-ad78-09a3121eab27 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '47c6a4198f0349daa952af38078c9c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f6214f46514322baa64ad23ce99ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-03091dd3-ca71-42b3-ad78-09a3121eab27 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Request method failure captured: May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-hosts/n-d-843700-1/startup HTTP/1.1 May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaak5ujip2ytshep3FFE59P0St_SoXbpDUSJqbYykMwFQKMwTVHKwL14_VtkQUyBJdKsBASBMlBy49e22MKmFYF9ubVZpXmRftQ013NwRmwZx7sQMx-yPZiGqnPlSGsPGldO0DKbfUn2Ba_Hcra9zyKW4EosMVfw5ek6W_cKwYypcQI May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 88f6214f46514322baa64ad23ce99ff1 May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-839131068 May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:35:53.929479 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:35:53.930947 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:53.930947 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-839131068 May 28 04:35:53.930947 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 88f6214f46514322baa64ad23ce99ff1 May 28 04:35:53.930947 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-839131068 May 28 04:35:53.930947 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-HostsAdminNegativeTestJSON-839131068-project May 28 04:35:53.930947 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:53.930947 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:53.930947 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 47c6a4198f0349daa952af38078c9c65 May 28 04:35:53.930947 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-839131068-project May 28 04:35:53.930947 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:35:53.930947 n-d-843700-1 devstack@n-api.service[126044]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 28 04:35:53.930947 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'n-d-843700-1'} May 28 04:35:53.930947 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:53.931690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.931690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:53.931690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:53.931690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:53.931690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:53.931690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:53.931690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:53.931690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:53.931690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:53.931690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup May 28 04:35:53.931690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', May 28 04:35:53.931690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:53.931690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:53.931690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:53.931690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:53.931690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:53.931690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:53.931690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:53.931690 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:53.932705 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:53.932705 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:53.932705 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:53.932705 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:53.932705 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:53.932705 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:53.932705 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 28 04:35:53.932705 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.932705 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:53.932705 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.932705 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.932705 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:53.932705 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:53.932705 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:53.932705 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:53.932705 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 28 04:35:53.932705 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.935253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-03091dd3-ca71-42b3-ad78-09a3121eab27 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:53.937112 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-03091dd3-ca71-42b3-ad78-09a3121eab27 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-843700-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.017547 May 28 04:35:53.942671 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 269/496] 10.222.0.58 () {58 vars in 1190 bytes} [Sat May 28 04:35:53 2022] GET /compute/v2.1/os-hosts/n-d-843700-1/startup => generated 110 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:53.945289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4803a6bb-d3d3-45db-b246-0ad6932f467f tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] Calling method '.version_select at 0x7f7701fb33a0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:53.948114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cbee291a-5bcf-4077-b007-b118b1b0ba1e tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Calling method '.version_select at 0x7f7701f018b0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:53.960226 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-cbee291a-5bcf-4077-b007-b118b1b0ba1e tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cbee291a-5bcf-4077-b007-b118b1b0ba1e tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Request method failure captured: May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaaniBLJN8J2YtVgwu0hoO5-bvHPdIi2Px2_QOtA7mtF9_b0qEJK5f3WwFcUesrVERbfnX8JPM-hLTnnxmCYO6r5bIbGJzSEvCl-w6Xs-TwUeDlL7i-K6jDzKwKPKc5ykNAF02WgZEqCkT9DrMGPz0tGyHhjpsgiZrGNk1b9zhlCXFo May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 8e63b7d277ff46ecad2ad2f72c78f872 May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:35:53.969939 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:35:53.971157 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:53.971157 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:53.971157 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 8e63b7d277ff46ecad2ad2f72c78f872 May 28 04:35:53.971157 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:53.971157 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-HostsAdminNegativeTestJSON-1811967195-project-admin May 28 04:35:53.971157 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:53.971157 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:53.971157 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: bd6aef6b346243f7b4ecd4f95ed41b1c May 28 04:35:53.971157 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1811967195-project-admin May 28 04:35:53.971157 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:35:53.971157 n-d-843700-1 devstack@n-api.service[126044]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:53.971157 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'nonexistent_hostname'} May 28 04:35:53.971157 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:53.972556 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.972556 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 28 04:35:53.972556 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 28 04:35:53.972556 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 04:35:53.972556 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 04:35:53.972556 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:53.972556 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:53.972556 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:53.972556 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:53.972556 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 04:35:53.972556 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 04:35:53.972556 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 28 04:35:53.972556 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 28 04:35:53.972556 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:35:53.972556 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:35:53.972556 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 28 04:35:53.972556 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 28 04:35:53.972556 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:35:53.972556 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:35:53.973638 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 28 04:35:53.973638 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 28 04:35:53.973638 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:53.973638 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.973638 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:53.973638 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.973638 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.973638 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:53.973638 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:53.973638 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:53.973638 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:53.973638 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:53.973638 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:53.973638 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:53.973638 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:53.973638 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup May 28 04:35:53.973638 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") May 28 04:35:53.973638 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 28 04:35:53.973638 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:35:53.974674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:53.974674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.974674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:53.974674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.974674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.974674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:53.974674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:53.974674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:53.974674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:53.974674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:53.974674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.974674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cbee291a-5bcf-4077-b007-b118b1b0ba1e tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:53.974674 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cbee291a-5bcf-4077-b007-b118b1b0ba1e tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.020492 May 28 04:35:53.976431 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 270/497] 10.222.0.58 () {58 vars in 1214 bytes} [Sat May 28 04:35:53 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:35:53.981494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-11d99173-ab17-40a0-8291-dd1ccd738085 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Action: 'update', calling method: .version_select at 0x7f7701f113a0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-11d99173-ab17-40a0-8291-dd1ccd738085 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Request method failure captured: May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: request: PUT /compute/v2.1/os-hosts/n-d-843700-1 HTTP/1.1 May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 51 May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaaniBLJN8J2YtVgwu0hoO5-bvHPdIi2Px2_QOtA7mtF9_b0qEJK5f3WwFcUesrVERbfnX8JPM-hLTnnxmCYO6r5bIbGJzSEvCl-w6Xs-TwUeDlL7i-K6jDzKwKPKc5ykNAF02WgZEqCkT9DrMGPz0tGyHhjpsgiZrGNk1b9zhlCXFo May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 8e63b7d277ff46ecad2ad2f72c78f872 May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:35:53.985006 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:35:53.986323 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:53.986323 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:53.986323 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 8e63b7d277ff46ecad2ad2f72c78f872 May 28 04:35:53.986323 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:53.986323 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-HostsAdminNegativeTestJSON-1811967195-project-admin May 28 04:35:53.986323 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:53.986323 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:53.986323 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: bd6aef6b346243f7b4ecd4f95ed41b1c May 28 04:35:53.986323 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1811967195-project-admin May 28 04:35:53.986323 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:35:53.986323 n-d-843700-1 devstack@n-api.service[126044]: {"status": "enable", "maintenance_mode": "invalid"} May 28 04:35:53.986323 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:35:53.986323 n-d-843700-1 devstack@n-api.service[126044]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'n-d-843700-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise error May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'disable', May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'Enable', May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'Disable', May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'ENABLE', May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi On instance: May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'invalid' May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.987079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:53.988796 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:53.988796 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:53.988796 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:53.988796 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:53.988796 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:53.988796 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:53.988796 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:53.988796 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:35:53.988796 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:35:53.988796 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:35:53.988796 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:35:53.988796 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:35:53.988796 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:35:53.988796 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 28 04:35:53.988796 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.988796 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:53.988796 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.988796 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:53.988796 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:53.989820 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:53.989820 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:35:53.989820 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:35:53.989820 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 28 04:35:53.989820 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:53.992019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-11d99173-ab17-40a0-8291-dd1ccd738085 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:53.993080 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-11d99173-ab17-40a0-8291-dd1ccd738085 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-843700-1" status: 400 len: 199 microversion: 2.1 time: 0.015467 May 28 04:35:53.998319 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 271/498] 10.222.0.58 () {60 vars in 1186 bytes} [Sat May 28 04:35:53 2022] PUT /compute/v2.1/os-hosts/n-d-843700-1 => generated 199 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:35:54.007187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8c1e1a6b-cc6c-484b-87a3-9bd6c90abf09 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Action: 'update', calling method: .version_select at 0x7f7701f509d0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8c1e1a6b-cc6c-484b-87a3-9bd6c90abf09 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Request method failure captured: May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: request: PUT /compute/v2.1/os-hosts/n-d-843700-1 HTTP/1.1 May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 51 May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaaniBLJN8J2YtVgwu0hoO5-bvHPdIi2Px2_QOtA7mtF9_b0qEJK5f3WwFcUesrVERbfnX8JPM-hLTnnxmCYO6r5bIbGJzSEvCl-w6Xs-TwUeDlL7i-K6jDzKwKPKc5ykNAF02WgZEqCkT9DrMGPz0tGyHhjpsgiZrGNk1b9zhlCXFo May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 8e63b7d277ff46ecad2ad2f72c78f872 May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:35:54.010505 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:35:54.011748 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:54.011748 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:54.011748 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 8e63b7d277ff46ecad2ad2f72c78f872 May 28 04:35:54.011748 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:54.011748 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-HostsAdminNegativeTestJSON-1811967195-project-admin May 28 04:35:54.011748 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:54.011748 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:54.011748 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: bd6aef6b346243f7b4ecd4f95ed41b1c May 28 04:35:54.011748 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1811967195-project-admin May 28 04:35:54.011748 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:35:54.011748 n-d-843700-1 devstack@n-api.service[126044]: {"status": "invalid", "maintenance_mode": "enable"} May 28 04:35:54.011748 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:35:54.011748 n-d-843700-1 devstack@n-api.service[126044]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'n-d-843700-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise error May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'disable', May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'Enable', May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'Disable', May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'ENABLE', May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi On instance: May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'invalid' May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:54.012456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:54.013744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:54.013744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:54.013744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:54.013744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:54.013744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:54.013744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:54.013744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:54.013744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:35:54.013744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:35:54.013744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:35:54.013744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:35:54.013744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:35:54.013744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:35:54.013744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 28 04:35:54.013744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.013744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:54.013744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.013744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:54.013744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:54.015681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:54.015681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:35:54.015681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:35:54.015681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 28 04:35:54.015681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.015681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8c1e1a6b-cc6c-484b-87a3-9bd6c90abf09 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:54.015681 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8c1e1a6b-cc6c-484b-87a3-9bd6c90abf09 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-843700-1" status: 400 len: 189 microversion: 2.1 time: 0.013913 May 28 04:35:54.021885 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 272/499] 10.222.0.58 () {60 vars in 1186 bytes} [Sat May 28 04:35:53 2022] PUT /compute/v2.1/os-hosts/n-d-843700-1 => generated 189 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:35:54.028067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-775dbf2a-0235-46e7-b6d6-0229c66b312e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:54.028705 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-775dbf2a-0235-46e7-b6d6-0229c66b312e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:54.041848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-775dbf2a-0235-46e7-b6d6-0229c66b312e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:54.041848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-775dbf2a-0235-46e7-b6d6-0229c66b312e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:54.041848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-775dbf2a-0235-46e7-b6d6-0229c66b312e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:54.041848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-775dbf2a-0235-46e7-b6d6-0229c66b312e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:54.263038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-775dbf2a-0235-46e7-b6d6-0229c66b312e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:54.277345 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-775dbf2a-0235-46e7-b6d6-0229c66b312e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1311 microversion: 2.1 time: 0.253525 May 28 04:35:54.298455 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 273/500] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:54 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1311 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:54.298455 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9bcd4416-9dfe-4b0d-9e9f-02f358908be0 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Action: 'update', calling method: .version_select at 0x7f7701f50b80>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:54.298455 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:54.298455 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:54.310457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9bcd4416-9dfe-4b0d-9e9f-02f358908be0 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '47c6a4198f0349daa952af38078c9c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f6214f46514322baa64ad23ce99ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9bcd4416-9dfe-4b0d-9e9f-02f358908be0 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Request method failure captured: May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: request: PUT /compute/v2.1/os-hosts/n-d-843700-1 HTTP/1.1 May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 50 May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaak5ujip2ytshep3FFE59P0St_SoXbpDUSJqbYykMwFQKMwTVHKwL14_VtkQUyBJdKsBASBMlBy49e22MKmFYF9ubVZpXmRftQ013NwRmwZx7sQMx-yPZiGqnPlSGsPGldO0DKbfUn2Ba_Hcra9zyKW4EosMVfw5ek6W_cKwYypcQI May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 88f6214f46514322baa64ad23ce99ff1 May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-839131068 May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:35:54.312934 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:35:54.314114 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88f6214f46514322baa64ad23ce99ff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:54.314114 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-839131068 May 28 04:35:54.314114 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 88f6214f46514322baa64ad23ce99ff1 May 28 04:35:54.314114 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-839131068 May 28 04:35:54.314114 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-HostsAdminNegativeTestJSON-839131068-project May 28 04:35:54.314114 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:54.314114 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:54.314114 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 47c6a4198f0349daa952af38078c9c65 May 28 04:35:54.314114 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-839131068-project May 28 04:35:54.314114 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:35:54.314114 n-d-843700-1 devstack@n-api.service[126044]: {"status": "enable", "maintenance_mode": "enable"} May 28 04:35:54.314114 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:35:54.314114 n-d-843700-1 devstack@n-api.service[126044]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 28 04:35:54.314114 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'n-d-843700-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} May 28 04:35:54.314860 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:54.314860 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:54.314860 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:54.314860 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:54.314860 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:54.314860 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:54.314860 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:54.314860 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:54.314860 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:54.314860 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:54.314860 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:35:54.314860 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:35:54.314860 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update May 28 04:35:54.314860 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', May 28 04:35:54.314860 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:54.314860 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:54.314860 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:54.314860 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:54.314860 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:54.314860 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:54.316488 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:54.316488 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:54.316488 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:54.316488 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:54.316488 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:54.316488 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:54.316488 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:54.316488 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:54.316488 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 28 04:35:54.316488 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.316488 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:54.316488 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.316488 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:54.316488 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:54.316488 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:54.316488 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:54.316488 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:54.316488 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 28 04:35:54.316488 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.319175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9bcd4416-9dfe-4b0d-9e9f-02f358908be0 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:54.320055 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9bcd4416-9dfe-4b0d-9e9f-02f358908be0 tempest-HostsAdminNegativeTestJSON-839131068 tempest-HostsAdminNegativeTestJSON-839131068-project] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-843700-1" status: 403 len: 111 microversion: 2.1 time: 0.030586 May 28 04:35:54.324909 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 274/501] 10.222.0.58 () {60 vars in 1186 bytes} [Sat May 28 04:35:54 2022] PUT /compute/v2.1/os-hosts/n-d-843700-1 => generated 111 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:54.340459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef499340-1fc1-420d-bfd0-086730d4c01f tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Action: 'update', calling method: .version_select at 0x7f7701f49e50>, body: {"status": null, "maintenance_mode": null} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef499340-1fc1-420d-bfd0-086730d4c01f tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Request method failure captured: May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: request: PUT /compute/v2.1/os-hosts/n-d-843700-1 HTTP/1.1 May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 42 May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaaniBLJN8J2YtVgwu0hoO5-bvHPdIi2Px2_QOtA7mtF9_b0qEJK5f3WwFcUesrVERbfnX8JPM-hLTnnxmCYO6r5bIbGJzSEvCl-w6Xs-TwUeDlL7i-K6jDzKwKPKc5ykNAF02WgZEqCkT9DrMGPz0tGyHhjpsgiZrGNk1b9zhlCXFo May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 8e63b7d277ff46ecad2ad2f72c78f872 May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:35:54.361091 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:35:54.362362 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:54.362362 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:54.362362 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 8e63b7d277ff46ecad2ad2f72c78f872 May 28 04:35:54.362362 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:54.362362 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-HostsAdminNegativeTestJSON-1811967195-project-admin May 28 04:35:54.362362 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:54.362362 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:54.362362 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: bd6aef6b346243f7b4ecd4f95ed41b1c May 28 04:35:54.362362 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1811967195-project-admin May 28 04:35:54.362362 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:35:54.362362 n-d-843700-1 devstack@n-api.service[126044]: {"status": null, "maintenance_mode": null} May 28 04:35:54.362362 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:35:54.362362 n-d-843700-1 devstack@n-api.service[126044]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 28 04:35:54.362362 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'n-d-843700-1', 'body': {'status': None, 'maintenance_mode': None}} May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise error May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'disable', May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'Enable', May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'Disable', May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'ENABLE', May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi On instance: May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi None May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:54.363206 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:54.369862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:54.369862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:54.369862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:54.369862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:54.369862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:54.369862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:54.369862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:35:54.369862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:35:54.369862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:35:54.369862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:35:54.369862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:35:54.369862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:35:54.369862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 28 04:35:54.369862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.369862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:54.369862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.369862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:54.369862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:54.369862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:54.371786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:35:54.371786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:35:54.371786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 28 04:35:54.371786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.371786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef499340-1fc1-420d-bfd0-086730d4c01f tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:54.371786 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ef499340-1fc1-420d-bfd0-086730d4c01f tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-843700-1" status: 400 len: 127 microversion: 2.1 time: 0.028012 May 28 04:35:54.371786 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 275/502] 10.222.0.58 () {60 vars in 1186 bytes} [Sat May 28 04:35:54 2022] PUT /compute/v2.1/os-hosts/n-d-843700-1 => generated 127 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:35:54.380720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8cb0d360-9faa-4a34-af2f-a3103d0cc175 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Action: 'update', calling method: .version_select at 0x7f7701f49e50>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:54.382617 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.hosts [None req-8cb0d360-9faa-4a34-af2f-a3103d0cc175 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Enabling host nonexistent_hostname. May 28 04:35:54.394724 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-8cb0d360-9faa-4a34-af2f-a3103d0cc175 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8cb0d360-9faa-4a34-af2f-a3103d0cc175 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Request method failure captured: May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 50 May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaaniBLJN8J2YtVgwu0hoO5-bvHPdIi2Px2_QOtA7mtF9_b0qEJK5f3WwFcUesrVERbfnX8JPM-hLTnnxmCYO6r5bIbGJzSEvCl-w6Xs-TwUeDlL7i-K6jDzKwKPKc5ykNAF02WgZEqCkT9DrMGPz0tGyHhjpsgiZrGNk1b9zhlCXFo May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 8e63b7d277ff46ecad2ad2f72c78f872 May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:35:54.396532 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:35:54.397743 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e63b7d277ff46ecad2ad2f72c78f872"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:54.397743 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:54.397743 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 8e63b7d277ff46ecad2ad2f72c78f872 May 28 04:35:54.397743 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1811967195 May 28 04:35:54.397743 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-HostsAdminNegativeTestJSON-1811967195-project-admin May 28 04:35:54.397743 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:54.397743 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:54.397743 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: bd6aef6b346243f7b4ecd4f95ed41b1c May 28 04:35:54.397743 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1811967195-project-admin May 28 04:35:54.397743 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:35:54.397743 n-d-843700-1 devstack@n-api.service[126044]: {"status": "enable", "maintenance_mode": "enable"} May 28 04:35:54.397743 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:35:54.397743 n-d-843700-1 devstack@n-api.service[126044]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:54.397743 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} May 28 04:35:54.398520 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:54.398520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:54.398520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status May 28 04:35:54.398520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) May 28 04:35:54.398520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 04:35:54.398520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 04:35:54.398520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:54.398520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:54.398520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:54.398520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:54.398520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 04:35:54.398520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 04:35:54.398520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 28 04:35:54.398520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 28 04:35:54.398520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:35:54.398520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:35:54.398520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 28 04:35:54.398520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 28 04:35:54.404099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:35:54.404099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:35:54.404099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 28 04:35:54.404099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 28 04:35:54.404099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:54.404099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.404099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:54.404099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.404099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:54.404099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:54.404099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:54.404099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:54.404099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:54.404099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:35:54.404099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:35:54.404099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:54.404099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:54.404099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:35:54.404099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:35:54.404099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update May 28 04:35:54.405153 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) May 28 04:35:54.405153 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status May 28 04:35:54.405153 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:35:54.405153 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:54.405153 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.405153 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:54.405153 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.405153 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:54.405153 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:54.405153 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:54.405153 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:54.405153 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:54.405153 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 28 04:35:54.405153 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:54.405153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8cb0d360-9faa-4a34-af2f-a3103d0cc175 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:54.406060 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8cb0d360-9faa-4a34-af2f-a3103d0cc175 tempest-HostsAdminNegativeTestJSON-1811967195 tempest-HostsAdminNegativeTestJSON-1811967195-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.027539 May 28 04:35:54.406060 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 276/503] 10.222.0.58 () {60 vars in 1210 bytes} [Sat May 28 04:35:54 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:35:54.507370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2c984bd3-ec26-412b-959f-43877d336485 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:54.508047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2c984bd3-ec26-412b-959f-43877d336485 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:54.514538 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c984bd3-ec26-412b-959f-43877d336485 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:54.515012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c984bd3-ec26-412b-959f-43877d336485 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:54.515802 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c984bd3-ec26-412b-959f-43877d336485 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:54.516236 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c984bd3-ec26-412b-959f-43877d336485 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:54.675119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2c984bd3-ec26-412b-959f-43877d336485 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:54.708099 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2c984bd3-ec26-412b-959f-43877d336485 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1473 microversion: 2.1 time: 0.194699 May 28 04:35:54.708099 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 277/504] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:54 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1473 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:54.723415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e136922f-e6a7-4c35-acbe-e1f50ebe7488 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f115e0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:54.791356 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e136922f-e6a7-4c35-acbe-e1f50ebe7488 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.074973 May 28 04:35:54.792044 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 278/505] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:54 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:54.826347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-4ddcc5d6-894b-4632-a0bd-84f187f324ba req-28683d72-8c8d-4496-955d-3c17a2238b4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b500d99-8f98-409e-a0df-e2cea22343ca", "tag": "89183d0a-5af7-462b-845f-59b3484b2c3b"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:54.850887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-4ddcc5d6-894b-4632-a0bd-84f187f324ba req-28683d72-8c8d-4496-955d-3c17a2238b4f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:54.851896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-4ddcc5d6-894b-4632-a0bd-84f187f324ba req-28683d72-8c8d-4496-955d-3c17a2238b4f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:54.880426 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-4ddcc5d6-894b-4632-a0bd-84f187f324ba req-28683d72-8c8d-4496-955d-3c17a2238b4f service nova] Creating event network-changed:89183d0a-5af7-462b-845f-59b3484b2c3b for instance 7b500d99-8f98-409e-a0df-e2cea22343ca on n-h1-843700-1 May 28 04:35:54.889384 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-4ddcc5d6-894b-4632-a0bd-84f187f324ba req-28683d72-8c8d-4496-955d-3c17a2238b4f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073576 May 28 04:35:54.890668 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 279/506] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:55.341268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-75a06446-065f-4b17-a9e9-aef45d7728c3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:55.347911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-75a06446-065f-4b17-a9e9-aef45d7728c3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:55.388973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75a06446-065f-4b17-a9e9-aef45d7728c3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:55.390792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75a06446-065f-4b17-a9e9-aef45d7728c3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:55.392070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75a06446-065f-4b17-a9e9-aef45d7728c3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:55.398926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75a06446-065f-4b17-a9e9-aef45d7728c3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:55.447091 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4803a6bb-d3d3-45db-b246-0ad6932f467f tempest-QuotasAdminTestV236-355537400 tempest-QuotasAdminTestV236-355537400-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/d1ab5e30a0a645a990db348c236a7303?user_id=24ac94ae2c2744429ee0f8f2328ee81e" status: 200 len: 282 microversion: 2.36 time: 1.512876 May 28 04:35:55.451913 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 228/507] 10.222.0.58 () {60 vars in 1363 bytes} [Sat May 28 04:35:53 2022] GET /compute/v2.1/os-quota-sets/d1ab5e30a0a645a990db348c236a7303?user_id=24ac94ae2c2744429ee0f8f2328ee81e => generated 282 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:35:55.722368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a3e616e4-3a95-4d11-bd53-5bf61c16f17b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:55.723396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a3e616e4-3a95-4d11-bd53-5bf61c16f17b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:55.733824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3e616e4-3a95-4d11-bd53-5bf61c16f17b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:55.734297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3e616e4-3a95-4d11-bd53-5bf61c16f17b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:55.746272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3e616e4-3a95-4d11-bd53-5bf61c16f17b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:55.746893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3e616e4-3a95-4d11-bd53-5bf61c16f17b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:55.767722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-75a06446-065f-4b17-a9e9-aef45d7728c3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:55.780175 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-75a06446-065f-4b17-a9e9-aef45d7728c3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1311 microversion: 2.1 time: 0.469558 May 28 04:35:55.781078 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 280/508] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:55 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1311 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:55.804570 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-59f00a03-2dd3-4129-ab8c-b508c9f3069f tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f49af0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:55.906919 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-59f00a03-2dd3-4129-ab8c-b508c9f3069f tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1453 microversion: 2.1 time: 0.106165 May 28 04:35:55.907728 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 281/509] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:55 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1453 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:56.070432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a3e616e4-3a95-4d11-bd53-5bf61c16f17b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:56.084512 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a3e616e4-3a95-4d11-bd53-5bf61c16f17b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1470 microversion: 2.1 time: 0.365380 May 28 04:35:56.085540 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 229/510] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:55 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1470 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:56.104029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5cee5854-2d05-4256-9068-c64d7a6fd9d6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:56.104569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5cee5854-2d05-4256-9068-c64d7a6fd9d6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:56.120897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5cee5854-2d05-4256-9068-c64d7a6fd9d6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:56.121357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5cee5854-2d05-4256-9068-c64d7a6fd9d6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:56.122148 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5cee5854-2d05-4256-9068-c64d7a6fd9d6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:56.133254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5cee5854-2d05-4256-9068-c64d7a6fd9d6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:56.199766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:56.396697 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5cee5854-2d05-4256-9068-c64d7a6fd9d6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "POST /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd/action" status: 204 len: 0 microversion: 2.1 time: 0.296302 May 28 04:35:56.398423 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 282/511] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:35:56 2022] POST /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd/action => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:35:56.406543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ece59dc7-3f9a-4796-a9bd-302cb7c8a3fb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:56.407208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ece59dc7-3f9a-4796-a9bd-302cb7c8a3fb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:56.417929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ece59dc7-3f9a-4796-a9bd-302cb7c8a3fb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:56.418644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ece59dc7-3f9a-4796-a9bd-302cb7c8a3fb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:56.419794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ece59dc7-3f9a-4796-a9bd-302cb7c8a3fb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:56.421104 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ece59dc7-3f9a-4796-a9bd-302cb7c8a3fb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:56.679356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ece59dc7-3f9a-4796-a9bd-302cb7c8a3fb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:56.690290 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ece59dc7-3f9a-4796-a9bd-302cb7c8a3fb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1470 microversion: 2.1 time: 0.287546 May 28 04:35:56.693423 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 230/512] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:56 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1470 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:56.798953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-73654795-e2bd-4fae-8624-768f35d48a42 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:56.800942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-73654795-e2bd-4fae-8624-768f35d48a42 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:56.822277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73654795-e2bd-4fae-8624-768f35d48a42 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:56.823101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73654795-e2bd-4fae-8624-768f35d48a42 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:56.824079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73654795-e2bd-4fae-8624-768f35d48a42 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:56.829114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73654795-e2bd-4fae-8624-768f35d48a42 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:56.919993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fe07fbb7-e540-4757-8da3-930aa32edcf2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f6b4c0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:56.978294 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fe07fbb7-e540-4757-8da3-930aa32edcf2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1462 microversion: 2.1 time: 0.061943 May 28 04:35:56.984859 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 231/513] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:56 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1462 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:57.000144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0d94b9d8-f9b4-4a61-879a-e01d8ba2e1e6 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701fadd30>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:57.018034 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-73654795-e2bd-4fae-8624-768f35d48a42 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:57.028319 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-73654795-e2bd-4fae-8624-768f35d48a42 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1311 microversion: 2.1 time: 0.234109 May 28 04:35:57.029416 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 283/514] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:56 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1311 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:57.065878 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0d94b9d8-f9b4-4a61-879a-e01d8ba2e1e6 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 200 len: 1462 microversion: 2.1 time: 0.069356 May 28 04:35:57.066708 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 232/515] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:56 2022] GET /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 1462 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:57.083856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3108acf0-cfac-4777-ad6f-edc920646382 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:57.084489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3108acf0-cfac-4777-ad6f-edc920646382 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: a27b8082-4f44-4263-a6a2-86291ea3950b] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:57.093893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3108acf0-cfac-4777-ad6f-edc920646382 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:57.094348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3108acf0-cfac-4777-ad6f-edc920646382 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:57.095164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3108acf0-cfac-4777-ad6f-edc920646382 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:57.095593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3108acf0-cfac-4777-ad6f-edc920646382 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:57.305898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3108acf0-cfac-4777-ad6f-edc920646382 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:57.316594 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3108acf0-cfac-4777-ad6f-edc920646382 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b" status: 200 len: 1468 microversion: 2.1 time: 0.239337 May 28 04:35:57.329440 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 284/516] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:57 2022] GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b => generated 1468 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:35:57.336573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-27c9db45-7bcf-4ad6-ae7f-09c60b817573 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1858782188"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:57.338369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-27c9db45-7bcf-4ad6-ae7f-09c60b817573 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:57.346151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27c9db45-7bcf-4ad6-ae7f-09c60b817573 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:57.346915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27c9db45-7bcf-4ad6-ae7f-09c60b817573 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:57.347947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27c9db45-7bcf-4ad6-ae7f-09c60b817573 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:57.348595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27c9db45-7bcf-4ad6-ae7f-09c60b817573 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:57.744882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-97cef98a-db8a-4985-921c-983cbf7845aa tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-390453780", "ram": 512, "vcpus": 1, "disk": 10, "id": 624147418, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:57.747244 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:57.747244 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:57.874527 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-97cef98a-db8a-4985-921c-983cbf7845aa tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.731879 May 28 04:35:57.881552 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 233/517] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:35:57 2022] POST /compute/v2.1/flavors => generated 412 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:57.901613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2ea842d9-3f85-4817-a898-f0c3146b208a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:57.903663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2ea842d9-3f85-4817-a898-f0c3146b208a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:57.918788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2ea842d9-3f85-4817-a898-f0c3146b208a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:57.924169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2ea842d9-3f85-4817-a898-f0c3146b208a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:57.926578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2ea842d9-3f85-4817-a898-f0c3146b208a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:57.927204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2ea842d9-3f85-4817-a898-f0c3146b208a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:58.083749 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-27c9db45-7bcf-4ad6-ae7f-09c60b817573 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "POST /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667/action" status: 202 len: 0 microversion: 2.1 time: 0.751117 May 28 04:35:58.086544 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 285/518] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:35:57 2022] POST /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667/action => generated 0 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 04:35:58.281442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2ea842d9-3f85-4817-a898-f0c3146b208a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:58.291251 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2ea842d9-3f85-4817-a898-f0c3146b208a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1470 microversion: 2.1 time: 0.414507 May 28 04:35:58.304910 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 234/519] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:57 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1470 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:58.319499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-21e8d1de-e1a1-4711-a582-b348d2badcc8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:58.323155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-21e8d1de-e1a1-4711-a582-b348d2badcc8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:58.337297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21e8d1de-e1a1-4711-a582-b348d2badcc8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:58.339803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21e8d1de-e1a1-4711-a582-b348d2badcc8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:58.340638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21e8d1de-e1a1-4711-a582-b348d2badcc8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:58.341083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21e8d1de-e1a1-4711-a582-b348d2badcc8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:58.471687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c49e1cf3-aaaf-459f-bf98-7be901bf9840 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:58.496652 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-c49e1cf3-aaaf-459f-bf98-7be901bf9840 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project] HTTP exception thrown: Flavor 624147418 has no extra specs with key hw:cpu_thread_policy. May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c49e1cf3-aaaf-459f-bf98-7be901bf9840 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project] Request method failure captured: May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/flavors/624147418/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaao8_UVpedRo0Z3KY0R5MYwWmz-eT2dYJAuIDHk2VEWjOn36T2BjOV91dLaJRQQK2ecoK1WcfJiMVKBe4LhXoGKCm8WbPdsXp0rf5FMp1Q4UfyykSTfs4BbhaI9itbwlg2qunXweKZRk0PmYB14h8DZ1qD3lDT-qIWVSGzniVrblDw May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 70355dcaf04445cf81666ef43e25803d May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:35:58.498430 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:35:58.499823 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_70355dcaf04445cf81666ef43e25803d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/70355dcaf04445cf81666ef43e25803d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/70355dcaf04445cf81666ef43e25803d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/70355dcaf04445cf81666ef43e25803d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:58.499823 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 May 28 04:35:58.499823 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 70355dcaf04445cf81666ef43e25803d May 28 04:35:58.499823 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 May 28 04:35:58.499823 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project May 28 04:35:58.499823 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:58.499823 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:58.499823 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: b89734346dee4e9bad269d6e2094844f May 28 04:35:58.499823 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project May 28 04:35:58.499823 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:35:58.499823 n-d-843700-1 devstack@n-api.service[126044]: exception: Flavor 624147418 has no extra specs with key hw:cpu_thread_policy. May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'flavor_id': '624147418', 'id': 'hw:cpu_thread_policy'} May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 624147418 has no extra specs with key hw:cpu_thread_policy. May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:58.500444 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:58.501669 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:58.501669 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:58.501669 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:58.501669 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:58.501669 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:58.501669 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 624147418 has no extra specs with key hw:cpu_thread_policy. May 28 04:35:58.501669 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:58.501669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c49e1cf3-aaaf-459f-bf98-7be901bf9840 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project] Returning 404 to user: Flavor 624147418 has no extra specs with key hw:cpu_thread_policy. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:58.505880 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c49e1cf3-aaaf-459f-bf98-7be901bf9840 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project] 10.222.0.58 "GET /compute/v2.1/flavors/624147418/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.417854 May 28 04:35:58.506476 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 286/520] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 04:35:58 2022] GET /compute/v2.1/flavors/624147418/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:58.515807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-29451093-0647-46fe-8f2f-db0981b5a79e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f01b80>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:58.574552 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-29451093-0647-46fe-8f2f-db0981b5a79e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.066910 May 28 04:35:58.580486 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 287/521] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:58 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:58.585875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-18452682-b48b-4117-87b7-3b772b069668 req-5821cebc-5e80-47a8-9931-05d269b1d0f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2af79f0-ae7c-40fd-8034-3a957e218bbd", "name": "network-vif-plugged", "status": "completed", "tag": "e0a73643-7263-4551-8d5a-5ef51b6fe3b3"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:58.601347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-18452682-b48b-4117-87b7-3b772b069668 req-5821cebc-5e80-47a8-9931-05d269b1d0f5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:58.601347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-18452682-b48b-4117-87b7-3b772b069668 req-5821cebc-5e80-47a8-9931-05d269b1d0f5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:58.610676 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-18452682-b48b-4117-87b7-3b772b069668 req-5821cebc-5e80-47a8-9931-05d269b1d0f5 service nova] Creating event network-vif-plugged:e0a73643-7263-4551-8d5a-5ef51b6fe3b3 for instance c2af79f0-ae7c-40fd-8034-3a957e218bbd on n-h1-843700-1 May 28 04:35:58.617652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-18452682-b48b-4117-87b7-3b772b069668 req-5821cebc-5e80-47a8-9931-05d269b1d0f5 service nova] Instance c2af79f0-ae7c-40fd-8034-3a957e218bbd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:35:58.630232 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-18452682-b48b-4117-87b7-3b772b069668 req-5821cebc-5e80-47a8-9931-05d269b1d0f5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048337 May 28 04:35:58.631056 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 288/522] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:35:58.648078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0d88ed05-66f4-45ec-b8cd-02cea7596e68 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:58.652566 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:58.652566 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:58.655300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0d88ed05-66f4-45ec-b8cd-02cea7596e68 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'b89734346dee4e9bad269d6e2094844f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70355dcaf04445cf81666ef43e25803d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0d88ed05-66f4-45ec-b8cd-02cea7596e68 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project] Request method failure captured: May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/flavors/624147418/os-extra_specs HTTP/1.1 May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 66 May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaao8_UVpedRo0Z3KY0R5MYwWmz-eT2dYJAuIDHk2VEWjOn36T2BjOV91dLaJRQQK2ecoK1WcfJiMVKBe4LhXoGKCm8WbPdsXp0rf5FMp1Q4UfyykSTfs4BbhaI9itbwlg2qunXweKZRk0PmYB14h8DZ1qD3lDT-qIWVSGzniVrblDw May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 70355dcaf04445cf81666ef43e25803d May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:35:58.655964 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:35:58.657360 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_70355dcaf04445cf81666ef43e25803d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/70355dcaf04445cf81666ef43e25803d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/70355dcaf04445cf81666ef43e25803d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/70355dcaf04445cf81666ef43e25803d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:58.657360 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 May 28 04:35:58.657360 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 70355dcaf04445cf81666ef43e25803d May 28 04:35:58.657360 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 May 28 04:35:58.657360 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project May 28 04:35:58.657360 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:58.657360 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:58.657360 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: b89734346dee4e9bad269d6e2094844f May 28 04:35:58.657360 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project May 28 04:35:58.657360 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:35:58.657360 n-d-843700-1 devstack@n-api.service[126044]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} May 28 04:35:58.657360 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:35:58.658164 n-d-843700-1 devstack@n-api.service[126044]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 28 04:35:58.658164 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'flavor_id': '624147418', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} May 28 04:35:58.658164 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:58.658164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:58.658164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:58.658164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:58.658164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:58.658164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:58.658164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:58.658164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:58.658164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:35:58.658164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:35:58.658164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create May 28 04:35:58.658164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) May 28 04:35:58.658164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:58.658164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:58.658164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:58.658164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:58.658164 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:58.659992 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:58.659992 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:58.659992 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:58.659992 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:58.659992 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:58.659992 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:58.659992 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:58.659992 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:58.659992 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:58.659992 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 28 04:35:58.659992 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:58.659992 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:58.659992 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:58.659992 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:58.659992 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:58.659992 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:58.659992 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:58.659992 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:58.659992 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 28 04:35:58.659992 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:58.662094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0d88ed05-66f4-45ec-b8cd-02cea7596e68 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:58.663258 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0d88ed05-66f4-45ec-b8cd-02cea7596e68 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project] 10.222.0.58 "POST /compute/v2.1/flavors/624147418/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.030688 May 28 04:35:58.667966 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 289/523] 10.222.0.58 () {60 vars in 1220 bytes} [Sat May 28 04:35:58 2022] POST /compute/v2.1/flavors/624147418/os-extra_specs => generated 124 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:58.672623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8859c617-9c63-42ce-91eb-823eb5c9b50c tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:58.716169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-21e8d1de-e1a1-4711-a582-b348d2badcc8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:58.723923 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-21e8d1de-e1a1-4711-a582-b348d2badcc8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1311 microversion: 2.1 time: 0.414274 May 28 04:35:58.733539 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 235/524] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:58 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1311 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:58.799533 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8859c617-9c63-42ce-91eb-823eb5c9b50c tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/624147418/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.130419 May 28 04:35:58.800694 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 290/525] 10.222.0.58 () {60 vars in 1220 bytes} [Sat May 28 04:35:58 2022] POST /compute/v2.1/flavors/624147418/os-extra_specs => generated 66 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:35:58.811721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-122c9734-cf25-4e78-a8c2-2c0552ea8d8c tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:58.812469 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:58.812469 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:58.813290 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-122c9734-cf25-4e78-a8c2-2c0552ea8d8c tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'b89734346dee4e9bad269d6e2094844f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70355dcaf04445cf81666ef43e25803d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-122c9734-cf25-4e78-a8c2-2c0552ea8d8c tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project] Request method failure captured: May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/flavors/624147418/os-extra_specs/hw:numa_nodes HTTP/1.1 May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaao8_UVpedRo0Z3KY0R5MYwWmz-eT2dYJAuIDHk2VEWjOn36T2BjOV91dLaJRQQK2ecoK1WcfJiMVKBe4LhXoGKCm8WbPdsXp0rf5FMp1Q4UfyykSTfs4BbhaI9itbwlg2qunXweKZRk0PmYB14h8DZ1qD3lDT-qIWVSGzniVrblDw May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 70355dcaf04445cf81666ef43e25803d May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:35:58.815055 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:35:58.817112 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_70355dcaf04445cf81666ef43e25803d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/70355dcaf04445cf81666ef43e25803d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/70355dcaf04445cf81666ef43e25803d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/70355dcaf04445cf81666ef43e25803d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:58.817112 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 May 28 04:35:58.817112 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 70355dcaf04445cf81666ef43e25803d May 28 04:35:58.817112 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 May 28 04:35:58.817112 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project May 28 04:35:58.817112 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:58.817112 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:58.817112 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: b89734346dee4e9bad269d6e2094844f May 28 04:35:58.817112 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project May 28 04:35:58.817112 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:35:58.817112 n-d-843700-1 devstack@n-api.service[126043]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 28 04:35:58.817709 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'flavor_id': '624147418', 'id': 'hw:numa_nodes'} May 28 04:35:58.817709 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:58.817709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:58.817709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:58.817709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:58.817709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:58.817709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:58.817709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:58.817709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:58.817709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete May 28 04:35:58.817709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) May 28 04:35:58.817709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:58.817709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:58.817709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:58.817709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:58.817709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:58.817709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:58.817709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:58.817709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:58.817709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:58.819093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:58.819093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:58.819093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:58.819093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:58.819093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:58.819093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 28 04:35:58.819093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:58.819093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:58.819093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:58.819093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:58.819093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:58.819093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:58.819093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:58.819093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:58.819093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 28 04:35:58.819093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:58.819093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-122c9734-cf25-4e78-a8c2-2c0552ea8d8c tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:58.820270 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-122c9734-cf25-4e78-a8c2-2c0552ea8d8c tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project] 10.222.0.58 "DELETE /compute/v2.1/flavors/624147418/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.009511 May 28 04:35:58.820270 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 236/526] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 04:35:58 2022] DELETE /compute/v2.1/flavors/624147418/os-extra_specs/hw:numa_nodes => generated 124 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:58.828012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef1f7bc9-1b05-416c-9f1f-b048dbe13a7c tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:58.851301 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ef1f7bc9-1b05-416c-9f1f-b048dbe13a7c tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/624147418/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.028063 May 28 04:35:58.856562 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 291/527] 10.222.0.58 () {60 vars in 1220 bytes} [Sat May 28 04:35:58 2022] POST /compute/v2.1/flavors/624147418/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 04:35:58.864103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dde46a9c-deda-4097-be4a-b5fa38f8188e tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:58.866556 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:58.866556 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:58.867505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dde46a9c-deda-4097-be4a-b5fa38f8188e tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'b89734346dee4e9bad269d6e2094844f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70355dcaf04445cf81666ef43e25803d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dde46a9c-deda-4097-be4a-b5fa38f8188e tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project] Request method failure captured: May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: request: PUT /compute/v2.1/flavors/624147418/os-extra_specs/hw:numa_nodes HTTP/1.1 May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 22 May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaao8_UVpedRo0Z3KY0R5MYwWmz-eT2dYJAuIDHk2VEWjOn36T2BjOV91dLaJRQQK2ecoK1WcfJiMVKBe4LhXoGKCm8WbPdsXp0rf5FMp1Q4UfyykSTfs4BbhaI9itbwlg2qunXweKZRk0PmYB14h8DZ1qD3lDT-qIWVSGzniVrblDw May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 70355dcaf04445cf81666ef43e25803d May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:35:58.870418 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:35:58.871675 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_70355dcaf04445cf81666ef43e25803d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/70355dcaf04445cf81666ef43e25803d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/70355dcaf04445cf81666ef43e25803d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/70355dcaf04445cf81666ef43e25803d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:58.871675 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 May 28 04:35:58.871675 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 70355dcaf04445cf81666ef43e25803d May 28 04:35:58.871675 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 May 28 04:35:58.871675 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project May 28 04:35:58.871675 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:58.871675 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:58.871675 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: b89734346dee4e9bad269d6e2094844f May 28 04:35:58.871675 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project May 28 04:35:58.871675 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:35:58.871675 n-d-843700-1 devstack@n-api.service[126043]: {"hw:numa_nodes": "1"} May 28 04:35:58.871675 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:35:58.871675 n-d-843700-1 devstack@n-api.service[126043]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 28 04:35:58.872387 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'flavor_id': '624147418', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} May 28 04:35:58.872387 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:58.872387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:58.872387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:58.872387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:58.872387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:58.872387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:58.872387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:58.872387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:58.872387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:35:58.872387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:35:58.872387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update May 28 04:35:58.872387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) May 28 04:35:58.872387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:35:58.872387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:35:58.872387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:35:58.872387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:35:58.872387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:35:58.872387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:35:58.873371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:35:58.873371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:35:58.873371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:35:58.873371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:35:58.873371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:35:58.873371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:35:58.873371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:35:58.873371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:35:58.873371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 28 04:35:58.873371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:58.873371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:58.873371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:58.873371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:58.873371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:58.873371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:58.873371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:35:58.873371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:35:58.873371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 28 04:35:58.873371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:58.874409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dde46a9c-deda-4097-be4a-b5fa38f8188e tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:58.874409 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dde46a9c-deda-4097-be4a-b5fa38f8188e tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354 tempest-FlavorsExtraSpecsNegativeTestJSON-1549627354-project] 10.222.0.58 "PUT /compute/v2.1/flavors/624147418/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.014530 May 28 04:35:58.874409 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 237/528] 10.222.0.58 () {60 vars in 1261 bytes} [Sat May 28 04:35:58 2022] PUT /compute/v2.1/flavors/624147418/os-extra_specs/hw:numa_nodes => generated 124 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:58.887311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c0e290af-73e4-4bb8-8f80-5ab60b88a40a tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:58.888808 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:58.888808 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:35:58.897865 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-c0e290af-73e4-4bb8-8f80-5ab60b88a40a tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] HTTP exception thrown: Flavor 624147418 has no extra specs with key hw:cpu_thread_policy. May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c0e290af-73e4-4bb8-8f80-5ab60b88a40a tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] Request method failure captured: May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/flavors/624147418/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaas_dkHzISdFpK5ZcGQbfhHVInuNhPh17x4V-APQXLjAe908mv3Zkr1uibXm7_PEEeq0AOLB8PuRM0bTycI2X0qD07byT-5kSsfs7gd4yWKM6TWaf6vKE0LO8O515Ysj9Kozkcy40tr_97FOorswODHPgT4wuiE1eNNMu8FGEBrEo4 May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2916d0b0a7dc4aa1b8e7886286d6fbc1 May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:35:58.900230 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:35:58.901542 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2916d0b0a7dc4aa1b8e7886286d6fbc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2916d0b0a7dc4aa1b8e7886286d6fbc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2916d0b0a7dc4aa1b8e7886286d6fbc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2916d0b0a7dc4aa1b8e7886286d6fbc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:58.901542 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 May 28 04:35:58.901542 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2916d0b0a7dc4aa1b8e7886286d6fbc1 May 28 04:35:58.901542 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 May 28 04:35:58.901542 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin May 28 04:35:58.901542 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:58.901542 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:58.901542 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 0dfbe06e4490436a869cd35581c67c09 May 28 04:35:58.901542 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin May 28 04:35:58.901542 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:35:58.901542 n-d-843700-1 devstack@n-api.service[126044]: exception: Flavor 624147418 has no extra specs with key hw:cpu_thread_policy. May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'flavor_id': '624147418', 'id': 'hw:cpu_thread_policy'} May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 624147418 has no extra specs with key hw:cpu_thread_policy. May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:58.902161 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:58.903357 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:58.903357 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:58.903357 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:58.903357 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:58.903357 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:58.903357 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 624147418 has no extra specs with key hw:cpu_thread_policy. May 28 04:35:58.903357 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:58.904445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c0e290af-73e4-4bb8-8f80-5ab60b88a40a tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] Returning 404 to user: Flavor 624147418 has no extra specs with key hw:cpu_thread_policy. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:58.905359 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c0e290af-73e4-4bb8-8f80-5ab60b88a40a tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/624147418/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.022884 May 28 04:35:58.907128 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 292/529] 10.222.0.58 () {58 vars in 1265 bytes} [Sat May 28 04:35:58 2022] DELETE /compute/v2.1/flavors/624147418/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:35:58.916920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ef7b3d94-3d82-4e23-9881-6bd53a4bd090 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:58.920954 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-ef7b3d94-3d82-4e23-9881-6bd53a4bd090 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] HTTP exception thrown: Request body and URI mismatch May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ef7b3d94-3d82-4e23-9881-6bd53a4bd090 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] Request method failure captured: May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: request: PUT /compute/v2.1/flavors/624147418/os-extra_specs/hw:numa_nodes HTTP/1.1 May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 27 May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaas_dkHzISdFpK5ZcGQbfhHVInuNhPh17x4V-APQXLjAe908mv3Zkr1uibXm7_PEEeq0AOLB8PuRM0bTycI2X0qD07byT-5kSsfs7gd4yWKM6TWaf6vKE0LO8O515Ysj9Kozkcy40tr_97FOorswODHPgT4wuiE1eNNMu8FGEBrEo4 May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2916d0b0a7dc4aa1b8e7886286d6fbc1 May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: X-Role: admin,reader,member May 28 04:35:58.922545 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: admin,reader,member May 28 04:35:58.923827 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2916d0b0a7dc4aa1b8e7886286d6fbc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2916d0b0a7dc4aa1b8e7886286d6fbc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2916d0b0a7dc4aa1b8e7886286d6fbc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2916d0b0a7dc4aa1b8e7886286d6fbc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:58.923827 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 May 28 04:35:58.923827 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2916d0b0a7dc4aa1b8e7886286d6fbc1 May 28 04:35:58.923827 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 May 28 04:35:58.923827 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin May 28 04:35:58.923827 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:35:58.923827 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:35:58.923827 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 0dfbe06e4490436a869cd35581c67c09 May 28 04:35:58.923827 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin May 28 04:35:58.923827 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:35:58.923827 n-d-843700-1 devstack@n-api.service[126043]: {"hw:cpu_policy": "shared"} May 28 04:35:58.923827 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:35:58.923827 n-d-843700-1 devstack@n-api.service[126043]: exception: Request body and URI mismatch May 28 04:35:58.925257 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'flavor_id': '624147418', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} May 28 04:35:58.925257 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:58.925257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:58.925257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:58.925257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:58.925257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:58.925257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:58.925257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:58.925257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:58.925257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:35:58.925257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:35:58.925257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update May 28 04:35:58.925257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) May 28 04:35:58.925257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch May 28 04:35:58.925257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:58.925257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:58.925257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:58.925257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:58.925257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:58.925257 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:58.926386 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:35:58.926386 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:35:58.926386 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch May 28 04:35:58.926386 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:35:58.929363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ef7b3d94-3d82-4e23-9881-6bd53a4bd090 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:58.931270 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ef7b3d94-3d82-4e23-9881-6bd53a4bd090 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/624147418/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.019351 May 28 04:35:58.933120 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 238/530] 10.222.0.58 () {60 vars in 1261 bytes} [Sat May 28 04:35:58 2022] PUT /compute/v2.1/flavors/624147418/os-extra_specs/hw:numa_nodes => generated 73 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 04:35:58.943835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-653b6ea0-d9b1-458d-81ef-fb25a12f6adc tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-653b6ea0-d9b1-458d-81ef-fb25a12f6adc tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] Request method failure captured: May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: request: PUT /compute/v2.1/flavors/624147418/os-extra_specs/hw:numa_nodes HTTP/1.1 May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 49 May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaas_dkHzISdFpK5ZcGQbfhHVInuNhPh17x4V-APQXLjAe908mv3Zkr1uibXm7_PEEeq0AOLB8PuRM0bTycI2X0qD07byT-5kSsfs7gd4yWKM6TWaf6vKE0LO8O515Ysj9Kozkcy40tr_97FOorswODHPgT4wuiE1eNNMu8FGEBrEo4 May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2916d0b0a7dc4aa1b8e7886286d6fbc1 May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:35:58.950471 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:35:58.952014 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2916d0b0a7dc4aa1b8e7886286d6fbc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2916d0b0a7dc4aa1b8e7886286d6fbc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2916d0b0a7dc4aa1b8e7886286d6fbc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2916d0b0a7dc4aa1b8e7886286d6fbc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:35:58.952014 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 May 28 04:35:58.952014 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2916d0b0a7dc4aa1b8e7886286d6fbc1 May 28 04:35:58.952014 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 May 28 04:35:58.952014 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin May 28 04:35:58.952014 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:35:58.952014 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:35:58.952014 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 0dfbe06e4490436a869cd35581c67c09 May 28 04:35:58.952014 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin May 28 04:35:58.952014 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:35:58.952014 n-d-843700-1 devstack@n-api.service[126044]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} May 28 04:35:58.952014 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'flavor_id': '624147418', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise error May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'minProperties': 1, May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'type': ['string', May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'number']}}, May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi On instance: May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} May 28 04:35:58.952660 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:58.953840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:58.953840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:58.953840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:58.953840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:58.953840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:58.953840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:35:58.953840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:35:58.953840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:35:58.953840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:35:58.953840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:35:58.953840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:35:58.953840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:35:58.953840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:35:58.953840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:35:58.953840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:35:58.953840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 28 04:35:58.953840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:58.953840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:35:58.953840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:58.953840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:35:58.954862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:35:58.954862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:35:58.954862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:35:58.954862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:35:58.954862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 28 04:35:58.954862 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:35:58.954862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-653b6ea0-d9b1-458d-81ef-fb25a12f6adc tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:35:58.954862 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-653b6ea0-d9b1-458d-81ef-fb25a12f6adc tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/624147418/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.008761 May 28 04:35:58.954862 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 293/531] 10.222.0.58 () {60 vars in 1261 bytes} [Sat May 28 04:35:58 2022] PUT /compute/v2.1/flavors/624147418/os-extra_specs/hw:numa_nodes => generated 117 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:35:58.958793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-85be571e-5d6d-4401-8e36-66e2da12d89d tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:58.959587 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:35:58.959587 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:35:59.052011 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-85be571e-5d6d-4401-8e36-66e2da12d89d tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/624147418" status: 202 len: 0 microversion: 2.1 time: 0.097767 May 28 04:35:59.053163 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 239/532] 10.222.0.58 () {58 vars in 1157 bytes} [Sat May 28 04:35:58 2022] DELETE /compute/v2.1/flavors/624147418 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:35:59.061366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6b513045-c430-40b5-8576-878ff7efbad8 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:59.087401 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6b513045-c430-40b5-8576-878ff7efbad8 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373 tempest-FlavorsExtraSpecsNegativeTestJSON-812484373-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029859 May 28 04:35:59.089058 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 294/533] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:35:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:59.308657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2d9d82fa-36f7-4494-8636-7dfd40f90207 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:59.309271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2d9d82fa-36f7-4494-8636-7dfd40f90207 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:59.324656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d9d82fa-36f7-4494-8636-7dfd40f90207 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:59.325111 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d9d82fa-36f7-4494-8636-7dfd40f90207 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:59.325922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d9d82fa-36f7-4494-8636-7dfd40f90207 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:59.326361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d9d82fa-36f7-4494-8636-7dfd40f90207 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:59.330652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:35:59.529476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2d9d82fa-36f7-4494-8636-7dfd40f90207 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:35:59.537604 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2d9d82fa-36f7-4494-8636-7dfd40f90207 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1470 microversion: 2.1 time: 0.232823 May 28 04:35:59.538471 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 240/534] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:59 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1470 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:59.587990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0121cca3-9456-4a38-871c-1fa70426967e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7702217310>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:59.644066 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0121cca3-9456-4a38-871c-1fa70426967e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.060425 May 28 04:35:59.648948 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 295/535] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:35:59 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:35:59.741110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-db974ad6-fe1a-4637-b5a7-cd9eec36507c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:35:59.749338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-db974ad6-fe1a-4637-b5a7-cd9eec36507c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:35:59.750892 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db974ad6-fe1a-4637-b5a7-cd9eec36507c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:59.752271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db974ad6-fe1a-4637-b5a7-cd9eec36507c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:35:59.753879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db974ad6-fe1a-4637-b5a7-cd9eec36507c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:35:59.754969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db974ad6-fe1a-4637-b5a7-cd9eec36507c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:00.021257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-db974ad6-fe1a-4637-b5a7-cd9eec36507c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:00.043951 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-db974ad6-fe1a-4637-b5a7-cd9eec36507c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1311 microversion: 2.1 time: 0.306611 May 28 04:36:00.046286 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 241/536] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:35:59 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1311 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:00.559878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d3992075-823d-49de-9ecd-59158aa60406 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:00.570010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d3992075-823d-49de-9ecd-59158aa60406 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:00.588943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3992075-823d-49de-9ecd-59158aa60406 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:00.589461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3992075-823d-49de-9ecd-59158aa60406 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:00.595228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3992075-823d-49de-9ecd-59158aa60406 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:00.600482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3992075-823d-49de-9ecd-59158aa60406 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:00.659430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7876bf81-2b07-489e-87e0-e4b84ebd549c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f75d30>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:00.721611 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7876bf81-2b07-489e-87e0-e4b84ebd549c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.065932 May 28 04:36:00.722194 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 242/537] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:00 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:00.976746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d3992075-823d-49de-9ecd-59158aa60406 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:00.992470 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d3992075-823d-49de-9ecd-59158aa60406 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1462 microversion: 2.1 time: 0.440939 May 28 04:36:00.993833 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 296/538] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:00 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1462 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:01.009740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6898e01f-4723-4a47-9cc5-6d088a627ca5 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:01.010698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6898e01f-4723-4a47-9cc5-6d088a627ca5 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:01.021350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6898e01f-4723-4a47-9cc5-6d088a627ca5 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:01.022515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6898e01f-4723-4a47-9cc5-6d088a627ca5 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:01.023861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6898e01f-4723-4a47-9cc5-6d088a627ca5 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:01.025718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6898e01f-4723-4a47-9cc5-6d088a627ca5 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:01.064884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0f5ef33d-6675-43c1-93d7-81f172b5fb77 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:01.077190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0f5ef33d-6675-43c1-93d7-81f172b5fb77 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:01.091751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f5ef33d-6675-43c1-93d7-81f172b5fb77 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:01.094332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f5ef33d-6675-43c1-93d7-81f172b5fb77 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:01.099908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f5ef33d-6675-43c1-93d7-81f172b5fb77 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:01.103224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f5ef33d-6675-43c1-93d7-81f172b5fb77 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:01.467299 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6898e01f-4723-4a47-9cc5-6d088a627ca5 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1613 microversion: 2.1 time: 0.457049 May 28 04:36:01.467941 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 243/539] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:01 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1613 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:01.473992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-2f311052-bd57-423f-879b-5d6429b053c2 req-6d927e36-622b-45a1-be45-91c4fdaeea07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a27b8082-4f44-4263-a6a2-86291ea3950b", "name": "network-vif-unplugged", "status": "completed", "tag": "06f37629-13a1-489c-9d41-01ab1fa9a306"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:01.494597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2f311052-bd57-423f-879b-5d6429b053c2 req-6d927e36-622b-45a1-be45-91c4fdaeea07 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:01.495974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2f311052-bd57-423f-879b-5d6429b053c2 req-6d927e36-622b-45a1-be45-91c4fdaeea07 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:01.509470 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-2f311052-bd57-423f-879b-5d6429b053c2 req-6d927e36-622b-45a1-be45-91c4fdaeea07 service nova] Creating event network-vif-unplugged:06f37629-13a1-489c-9d41-01ab1fa9a306 for instance a27b8082-4f44-4263-a6a2-86291ea3950b on n-h2-843700-1 May 28 04:36:01.516400 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-2f311052-bd57-423f-879b-5d6429b053c2 req-6d927e36-622b-45a1-be45-91c4fdaeea07 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046460 May 28 04:36:01.517710 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 244/540] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:01.525452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d4bd2753-ee7c-4283-8d4d-c2292bfd0759 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Calling method '.version_select at 0x7f7701f75160>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:01.531208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d4bd2753-ee7c-4283-8d4d-c2292bfd0759 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:01.531677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d4bd2753-ee7c-4283-8d4d-c2292bfd0759 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:01.539427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0f5ef33d-6675-43c1-93d7-81f172b5fb77 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:01.552044 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0f5ef33d-6675-43c1-93d7-81f172b5fb77 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1311 microversion: 2.1 time: 0.493557 May 28 04:36:01.555172 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 297/541] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:01 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1311 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:01.573395 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d4bd2753-ee7c-4283-8d4d-c2292bfd0759 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.054293 May 28 04:36:01.574127 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 245/542] 10.222.0.58 () {58 vars in 1142 bytes} [Sat May 28 04:36:01 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:01.737745 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-08378d01-dc34-470d-b282-c410b8b11f6e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f01ee0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:01.760565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=41,nova_cell0:UPDATE=7 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:01.785513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1c1ea4f5-d77f-4e70-a692-777351410945 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1419191839", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:01.786368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:01.824118 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-08378d01-dc34-470d-b282-c410b8b11f6e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.091863 May 28 04:36:01.827076 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 298/543] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:01 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:01.881448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-1c1ea4f5-d77f-4e70-a692-777351410945 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] validate_networks() for None {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:36:02.325254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-1c1ea4f5-d77f-4e70-a692-777351410945 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:36:02.325847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-1c1ea4f5-d77f-4e70-a692-777351410945 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:36:02.326439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-1c1ea4f5-d77f-4e70-a692-777351410945 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:36:02.326945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-1c1ea4f5-d77f-4e70-a692-777351410945 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:36:02.327676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-1c1ea4f5-d77f-4e70-a692-777351410945 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:36:02.347549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1c1ea4f5-d77f-4e70-a692-777351410945 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:02.353688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1c1ea4f5-d77f-4e70-a692-777351410945 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:02.355610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1c1ea4f5-d77f-4e70-a692-777351410945 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:02.356881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1c1ea4f5-d77f-4e70-a692-777351410945 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:02.399420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-1c1ea4f5-d77f-4e70-a692-777351410945 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Getting quotas for project 506fcf1e564049258c90cf33d274fc5f. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:36:02.411558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-1c1ea4f5-d77f-4e70-a692-777351410945 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Getting quotas for user 6d208bde90d54f7487f39c505b884285 and project 506fcf1e564049258c90cf33d274fc5f. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:36:02.445825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1c1ea4f5-d77f-4e70-a692-777351410945 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:36:02.453597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1c1ea4f5-d77f-4e70-a692-777351410945 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:36:02.572363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-94e64196-a0b7-436c-9c2b-b467a17005ba tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:02.572985 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-94e64196-a0b7-436c-9c2b-b467a17005ba tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:02.588571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-94e64196-a0b7-436c-9c2b-b467a17005ba tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:02.594641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-94e64196-a0b7-436c-9c2b-b467a17005ba tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:02.595779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-94e64196-a0b7-436c-9c2b-b467a17005ba tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:02.596246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-94e64196-a0b7-436c-9c2b-b467a17005ba tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:02.603847 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1c1ea4f5-d77f-4e70-a692-777351410945 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.822517 May 28 04:36:02.607267 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 246/544] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:36:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:36:02.621155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-be0d4c75-8bd6-4bca-823a-7093e8160e77 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:02.621838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-be0d4c75-8bd6-4bca-823a-7093e8160e77 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:02.772281 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-be0d4c75-8bd6-4bca-823a-7093e8160e77 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:02.783143 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-be0d4c75-8bd6-4bca-823a-7093e8160e77 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1213 microversion: 2.1 time: 0.168505 May 28 04:36:02.794794 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 247/545] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:02 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1213 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:02.839910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-777cbbd3-98bc-4291-947c-87ec0545303f tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f754c0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:02.915483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-94e64196-a0b7-436c-9c2b-b467a17005ba tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:02.935796 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-94e64196-a0b7-436c-9c2b-b467a17005ba tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1311 microversion: 2.1 time: 0.363674 May 28 04:36:02.936601 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-777cbbd3-98bc-4291-947c-87ec0545303f tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.102536 May 28 04:36:02.936720 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 299/546] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:02 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1311 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:02.944254 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 248/547] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:02 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:03.666232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-a7debc80-8774-4634-a904-ac06361473cf req-08ffc7f7-6e42-41f1-8fce-49eb55ed33de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b500d99-8f98-409e-a0df-e2cea22343ca", "name": "network-vif-plugged", "status": "completed", "tag": "89183d0a-5af7-462b-845f-59b3484b2c3b"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:03.678092 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a7debc80-8774-4634-a904-ac06361473cf req-08ffc7f7-6e42-41f1-8fce-49eb55ed33de service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:03.685430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a7debc80-8774-4634-a904-ac06361473cf req-08ffc7f7-6e42-41f1-8fce-49eb55ed33de service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:03.707707 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-a7debc80-8774-4634-a904-ac06361473cf req-08ffc7f7-6e42-41f1-8fce-49eb55ed33de service nova] Creating event network-vif-plugged:89183d0a-5af7-462b-845f-59b3484b2c3b for instance 7b500d99-8f98-409e-a0df-e2cea22343ca on n-h1-843700-1 May 28 04:36:03.727883 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-a7debc80-8774-4634-a904-ac06361473cf req-08ffc7f7-6e42-41f1-8fce-49eb55ed33de service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065604 May 28 04:36:03.730252 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 300/548] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:03.804109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bca88006-ceb4-46df-b51e-fd9a5ea5eae4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:03.805460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bca88006-ceb4-46df-b51e-fd9a5ea5eae4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:03.892601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bca88006-ceb4-46df-b51e-fd9a5ea5eae4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:03.897004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=33 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:03.908889 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bca88006-ceb4-46df-b51e-fd9a5ea5eae4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1213 microversion: 2.1 time: 0.111078 May 28 04:36:03.910465 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 249/549] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:03 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1213 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:03.951298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-86e0912b-5e6e-40a2-a965-6c89af1edbac tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f11430>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:03.953823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3e064aa2-860d-4880-b043-48556c9082ab tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:03.954610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3e064aa2-860d-4880-b043-48556c9082ab tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:03.968246 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e064aa2-860d-4880-b043-48556c9082ab tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:03.969256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e064aa2-860d-4880-b043-48556c9082ab tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:03.974549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e064aa2-860d-4880-b043-48556c9082ab tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:03.975251 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e064aa2-860d-4880-b043-48556c9082ab tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:04.010561 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-86e0912b-5e6e-40a2-a965-6c89af1edbac tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.064265 May 28 04:36:04.019427 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 301/550] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:03 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:04.927962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-413dc526-5355-4ee9-8146-178519dc0978 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:04.929113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-413dc526-5355-4ee9-8146-178519dc0978 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:04.933049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:04.943507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-413dc526-5355-4ee9-8146-178519dc0978 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:04.947765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-413dc526-5355-4ee9-8146-178519dc0978 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:04.948982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-413dc526-5355-4ee9-8146-178519dc0978 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:04.949656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-413dc526-5355-4ee9-8146-178519dc0978 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:05.399608 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3e064aa2-860d-4880-b043-48556c9082ab tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:05.411012 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3e064aa2-860d-4880-b043-48556c9082ab tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1311 microversion: 2.1 time: 1.462085 May 28 04:36:05.419767 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 250/551] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:03 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1311 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:05.425445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-82a954ff-84d0-406c-ac92-6e9e02b7d6fe tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f75dc0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:05.489780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-413dc526-5355-4ee9-8146-178519dc0978 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:05.505686 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-82a954ff-84d0-406c-ac92-6e9e02b7d6fe tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.084590 May 28 04:36:05.505989 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-413dc526-5355-4ee9-8146-178519dc0978 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1209 microversion: 2.1 time: 0.581560 May 28 04:36:05.506491 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 251/552] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:05 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:05.511729 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 302/553] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:04 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1209 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:05.831756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-792abd37-4546-4621-94eb-a26dc16228c3 req-c1bb9d75-98df-45de-a6fa-2591eac67048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0d40b8-3a01-421f-84fe-b94732c1f667", "name": "network-vif-plugged", "status": "completed", "tag": "9c5d3b07-270f-42b6-a87f-60d7da0c6be0"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:05.853248 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-792abd37-4546-4621-94eb-a26dc16228c3 req-c1bb9d75-98df-45de-a6fa-2591eac67048 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:05.855750 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-792abd37-4546-4621-94eb-a26dc16228c3 req-c1bb9d75-98df-45de-a6fa-2591eac67048 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:05.885811 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-792abd37-4546-4621-94eb-a26dc16228c3 req-c1bb9d75-98df-45de-a6fa-2591eac67048 service nova] Creating event network-vif-plugged:9c5d3b07-270f-42b6-a87f-60d7da0c6be0 for instance 9e0d40b8-3a01-421f-84fe-b94732c1f667 on n-h2-843700-1 May 28 04:36:05.903244 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-792abd37-4546-4621-94eb-a26dc16228c3 req-c1bb9d75-98df-45de-a6fa-2591eac67048 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073820 May 28 04:36:05.907690 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 252/554] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:36:06.442909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c9fedc17-b1b4-40c2-b462-e941a8625d9a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:06.443570 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c9fedc17-b1b4-40c2-b462-e941a8625d9a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:06.468150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9fedc17-b1b4-40c2-b462-e941a8625d9a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:06.468620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9fedc17-b1b4-40c2-b462-e941a8625d9a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:06.480692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9fedc17-b1b4-40c2-b462-e941a8625d9a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:06.481229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9fedc17-b1b4-40c2-b462-e941a8625d9a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:06.527923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4017692f-34ee-4ef9-a74e-4f42a8a463cc tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f758b0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:06.647368 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4017692f-34ee-4ef9-a74e-4f42a8a463cc tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.125070 May 28 04:36:06.648041 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 253/555] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:06 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:06.663088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0b2a746c-2086-4a7f-aa66-4940502149fb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:06.663845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0b2a746c-2086-4a7f-aa66-4940502149fb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:06.680936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b2a746c-2086-4a7f-aa66-4940502149fb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:06.681425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b2a746c-2086-4a7f-aa66-4940502149fb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:06.682302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b2a746c-2086-4a7f-aa66-4940502149fb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:06.682698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b2a746c-2086-4a7f-aa66-4940502149fb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:06.893242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0b2a746c-2086-4a7f-aa66-4940502149fb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:06.907581 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0b2a746c-2086-4a7f-aa66-4940502149fb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1271 microversion: 2.1 time: 0.251837 May 28 04:36:06.909230 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 254/556] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:06 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1271 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:06.910225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0b2a746c-2086-4a7f-aa66-4940502149fb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:06.912605 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0b2a746c-2086-4a7f-aa66-4940502149fb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001104 May 28 04:36:06.912971 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 255/557] 10.222.0.58 () {56 vars in 885 bytes} [Sat May 28 04:36:06 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 28 04:36:06.952437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c9fedc17-b1b4-40c2-b462-e941a8625d9a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:06.962155 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c9fedc17-b1b4-40c2-b462-e941a8625d9a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1494 microversion: 2.1 time: 0.525464 May 28 04:36:06.981069 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 303/558] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:06 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1494 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:06.991779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dad636dc-c686-43a1-bb6e-e9e7e39f0cca tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:06.993509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dad636dc-c686-43a1-bb6e-e9e7e39f0cca tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:07.011547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dad636dc-c686-43a1-bb6e-e9e7e39f0cca tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:07.013685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dad636dc-c686-43a1-bb6e-e9e7e39f0cca tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:07.018954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dad636dc-c686-43a1-bb6e-e9e7e39f0cca tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:07.019718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dad636dc-c686-43a1-bb6e-e9e7e39f0cca tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:07.358172 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dad636dc-c686-43a1-bb6e-e9e7e39f0cca tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1645 microversion: 2.1 time: 0.375022 May 28 04:36:07.361459 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 256/559] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:06 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1645 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:07.379863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-26337f38-4416-41ca-b2c5-7cfdc1e9188f tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:07.381106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-26337f38-4416-41ca-b2c5-7cfdc1e9188f tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:07.392457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26337f38-4416-41ca-b2c5-7cfdc1e9188f tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:07.394942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26337f38-4416-41ca-b2c5-7cfdc1e9188f tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:07.395967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26337f38-4416-41ca-b2c5-7cfdc1e9188f tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:07.398834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26337f38-4416-41ca-b2c5-7cfdc1e9188f tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:07.621726 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-26337f38-4416-41ca-b2c5-7cfdc1e9188f tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1645 microversion: 2.1 time: 0.236786 May 28 04:36:07.624550 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 304/560] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:07 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1645 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:07.640113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-34b3f732-c7a6-4f0c-97ca-feea16b0a27c tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:07.644027 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:36:07.644027 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:36:07.648349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34b3f732-c7a6-4f0c-97ca-feea16b0a27c tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:07.648349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34b3f732-c7a6-4f0c-97ca-feea16b0a27c tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:07.648349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34b3f732-c7a6-4f0c-97ca-feea16b0a27c tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:07.651261 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34b3f732-c7a6-4f0c-97ca-feea16b0a27c tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:07.662368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a7c3e3ec-166e-41e1-93b8-fb21595164be tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701ec9d30>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:07.756440 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-34b3f732-c7a6-4f0c-97ca-feea16b0a27c tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.118017 May 28 04:36:07.766647 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a7c3e3ec-166e-41e1-93b8-fb21595164be tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.109922 May 28 04:36:07.767952 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 305/561] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:07 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:07.770482 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 257/562] 10.222.0.58 () {58 vars in 1175 bytes} [Sat May 28 04:36:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:07.774330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-964c5d74-e99a-4270-b431-905aaecf50cc tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:07.775381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-964c5d74-e99a-4270-b431-905aaecf50cc tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:07.782268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-964c5d74-e99a-4270-b431-905aaecf50cc tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:07.782975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-964c5d74-e99a-4270-b431-905aaecf50cc tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:07.784668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-964c5d74-e99a-4270-b431-905aaecf50cc tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:07.785463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-964c5d74-e99a-4270-b431-905aaecf50cc tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:07.927891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cfa7c301-25bf-4b3b-a54e-3d866327cda0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:07.939226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cfa7c301-25bf-4b3b-a54e-3d866327cda0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:07.957197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfa7c301-25bf-4b3b-a54e-3d866327cda0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:07.957956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfa7c301-25bf-4b3b-a54e-3d866327cda0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:07.960158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfa7c301-25bf-4b3b-a54e-3d866327cda0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:07.962485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfa7c301-25bf-4b3b-a54e-3d866327cda0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:08.032270 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-964c5d74-e99a-4270-b431-905aaecf50cc tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca/action" status: 202 len: 0 microversion: 2.1 time: 0.261881 May 28 04:36:08.033641 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 306/563] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:36:07 2022] POST /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:36:08.066186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0bccfd64-649b-4e87-beb5-c7c80357adff tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:08.067732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0bccfd64-649b-4e87-beb5-c7c80357adff tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:08.098426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0bccfd64-649b-4e87-beb5-c7c80357adff tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:08.098426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0bccfd64-649b-4e87-beb5-c7c80357adff tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:08.115900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0bccfd64-649b-4e87-beb5-c7c80357adff tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:08.116668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0bccfd64-649b-4e87-beb5-c7c80357adff tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:08.280939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cfa7c301-25bf-4b3b-a54e-3d866327cda0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:08.296339 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cfa7c301-25bf-4b3b-a54e-3d866327cda0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1271 microversion: 2.1 time: 0.369286 May 28 04:36:08.298897 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 258/564] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:07 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1271 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:08.780860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-374b1c14-be3f-4208-8ca7-57614bf0a463 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f7a9d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:08.857581 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-374b1c14-be3f-4208-8ca7-57614bf0a463 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.080861 May 28 04:36:08.859888 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 259/565] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:08 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:09.178719 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0bccfd64-649b-4e87-beb5-c7c80357adff tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1650 microversion: 2.1 time: 1.131780 May 28 04:36:09.192258 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 307/566] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:08 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1650 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:09.313770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-140c3963-8938-46a0-82db-7289c8b6de3a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:09.314688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-140c3963-8938-46a0-82db-7289c8b6de3a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:09.323981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-140c3963-8938-46a0-82db-7289c8b6de3a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:09.326548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-140c3963-8938-46a0-82db-7289c8b6de3a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:09.331514 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-140c3963-8938-46a0-82db-7289c8b6de3a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:09.332868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-140c3963-8938-46a0-82db-7289c8b6de3a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:09.764805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c5660d54-38dc-4f99-90c9-d35bef4bd3e1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:09.782201 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c5660d54-38dc-4f99-90c9-d35bef4bd3e1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.529247 May 28 04:36:09.814363 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 260/567] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:36:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:09.927773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-df12b16e-492c-4758-be82-9e1a97d4b88c tempest-ServersWithSpecificFlavorTestJSON-201764576 tempest-ServersWithSpecificFlavorTestJSON-201764576-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1266953393", "id": 1960087950, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:09.929665 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:36:09.929665 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:36:09.933864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:10.007227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-140c3963-8938-46a0-82db-7289c8b6de3a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:10.015489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:10.024869 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-140c3963-8938-46a0-82db-7289c8b6de3a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1313 microversion: 2.1 time: 0.715505 May 28 04:36:10.027582 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 308/568] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:09 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1313 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:10.038923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d714f31c-d555-4468-94e8-f8ab9626f170 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f01c10>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:10.067997 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-df12b16e-492c-4758-be82-9e1a97d4b88c tempest-ServersWithSpecificFlavorTestJSON-201764576 tempest-ServersWithSpecificFlavorTestJSON-201764576-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.246373 May 28 04:36:10.068782 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 261/569] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:36:09 2022] POST /compute/v2.1/flavors => generated 425 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:10.102514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-19ca89b9-44dc-4eaa-b036-5b79e6300890 tempest-ServersWithSpecificFlavorTestJSON-201764576 tempest-ServersWithSpecificFlavorTestJSON-201764576-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:10.134823 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-19ca89b9-44dc-4eaa-b036-5b79e6300890 tempest-ServersWithSpecificFlavorTestJSON-201764576 tempest-ServersWithSpecificFlavorTestJSON-201764576-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.058585 May 28 04:36:10.135856 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 262/570] 10.222.0.58 () {58 vars in 1181 bytes} [Sat May 28 04:36:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:36:10.145744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9af44b0b-f8e3-4721-a9e2-27e7e959645e tempest-ServersWithSpecificFlavorTestJSON-201764576 tempest-ServersWithSpecificFlavorTestJSON-201764576-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-736543433", "id": 790028090, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:10.197742 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d714f31c-d555-4468-94e8-f8ab9626f170 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.166183 May 28 04:36:10.198612 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 309/571] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:10 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:10.227628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-89fd4293-7af0-41de-8f34-c467ab598986 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:10.230601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-89fd4293-7af0-41de-8f34-c467ab598986 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:10.245247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89fd4293-7af0-41de-8f34-c467ab598986 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:10.245404 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9af44b0b-f8e3-4721-a9e2-27e7e959645e tempest-ServersWithSpecificFlavorTestJSON-201764576 tempest-ServersWithSpecificFlavorTestJSON-201764576-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.092452 May 28 04:36:10.245760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89fd4293-7af0-41de-8f34-c467ab598986 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:10.246674 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 263/572] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:36:10 2022] POST /compute/v2.1/flavors => generated 421 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:10.255740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89fd4293-7af0-41de-8f34-c467ab598986 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:10.256218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89fd4293-7af0-41de-8f34-c467ab598986 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:10.267534 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dedc6365-667c-4074-a93f-31c9ed8c6abc tempest-ServersWithSpecificFlavorTestJSON-201764576 tempest-ServersWithSpecificFlavorTestJSON-201764576-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:10.304574 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dedc6365-667c-4074-a93f-31c9ed8c6abc tempest-ServersWithSpecificFlavorTestJSON-201764576 tempest-ServersWithSpecificFlavorTestJSON-201764576-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.050163 May 28 04:36:10.306738 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 264/573] 10.222.0.58 () {58 vars in 1181 bytes} [Sat May 28 04:36:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:36:10.324870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-335de01c-9ad4-44b4-8ed7-62441903c23f tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Action: 'create', calling method: .version_select at 0x7f7701f7a280>, body: {"keypair": {"name": "tempest-keypair-255921009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa460fHVTuIDLwJi3q9h7uCM3jQzGrm7eL6uCPLIe1SrNxTervz0T+qJJM1yvTtPy04mZtBMrki4/n0CDexEy6PupmcCzQNWyCym97WEOY8GUUylisxSNx5q/DraScLUA=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:10.403498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-335de01c-9ad4-44b4-8ed7-62441903c23f tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Getting quotas for project 7b5e68532952468cbd37fad9b381d355. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:36:10.414046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-335de01c-9ad4-44b4-8ed7-62441903c23f tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Getting quotas for user c567ca604e0743bf874889ba69bbeb49 and project 7b5e68532952468cbd37fad9b381d355. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:36:10.573153 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-335de01c-9ad4-44b4-8ed7-62441903c23f tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.247123 May 28 04:36:10.578843 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 265/574] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:36:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:10.579024 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-89fd4293-7af0-41de-8f34-c467ab598986 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1630 microversion: 2.1 time: 0.362466 May 28 04:36:10.598139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c2a19b16-aa5a-4a73-b1a6-0da2de513e10 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-843700-1", "block_migration": true, "disk_over_commit": false}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:10.603270 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 310/575] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:10 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1630 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:10.603405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c2a19b16-aa5a-4a73-b1a6-0da2de513e10 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:10.608618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c2a19b16-aa5a-4a73-b1a6-0da2de513e10 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:10.609916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c2a19b16-aa5a-4a73-b1a6-0da2de513e10 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:10.611121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c2a19b16-aa5a-4a73-b1a6-0da2de513e10 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:10.611895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c2a19b16-aa5a-4a73-b1a6-0da2de513e10 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:10.755185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-c2a19b16-aa5a-4a73-b1a6-0da2de513e10 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lazy-loading 'flavor' on Instance uuid 7b500d99-8f98-409e-a0df-e2cea22343ca {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:36:10.827435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c2a19b16-aa5a-4a73-b1a6-0da2de513e10 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Going to try to live migrate instance to n-h2-843700-1 {{(pid=126043) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 28 04:36:11.046971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8b643896-95cf-44e9-a814-7c8df7c1c40b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:11.048177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8b643896-95cf-44e9-a814-7c8df7c1c40b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:11.056517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b643896-95cf-44e9-a814-7c8df7c1c40b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:11.056968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b643896-95cf-44e9-a814-7c8df7c1c40b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:11.057743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b643896-95cf-44e9-a814-7c8df7c1c40b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:11.058178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b643896-95cf-44e9-a814-7c8df7c1c40b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:11.317135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8b643896-95cf-44e9-a814-7c8df7c1c40b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:11.328807 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8b643896-95cf-44e9-a814-7c8df7c1c40b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1313 microversion: 2.1 time: 0.288545 May 28 04:36:11.329708 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 311/576] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:11 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:11.336363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fb3580b4-ddfe-4ffa-b3e7-b433aa2a9da6 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701ec99d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:11.399276 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fb3580b4-ddfe-4ffa-b3e7-b433aa2a9da6 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.067913 May 28 04:36:11.406241 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 312/577] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:11 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:11.532964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-89f6e918-5b1a-4ae6-9f11-e5ba162359d0 req-ed8436a3-c1a8-476c-83ab-8479e8f42b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87cc4d83-fd02-4a96-a640-3cad08bba4f4", "tag": "47bf89ee-9954-4b95-8607-a086661df3bd"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:11.556269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-89f6e918-5b1a-4ae6-9f11-e5ba162359d0 req-ed8436a3-c1a8-476c-83ab-8479e8f42b0f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:11.557145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-89f6e918-5b1a-4ae6-9f11-e5ba162359d0 req-ed8436a3-c1a8-476c-83ab-8479e8f42b0f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:11.572505 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-89f6e918-5b1a-4ae6-9f11-e5ba162359d0 req-ed8436a3-c1a8-476c-83ab-8479e8f42b0f service nova] Creating event network-changed:47bf89ee-9954-4b95-8607-a086661df3bd for instance 87cc4d83-fd02-4a96-a640-3cad08bba4f4 on n-h1-843700-1 May 28 04:36:11.583456 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-89f6e918-5b1a-4ae6-9f11-e5ba162359d0 req-ed8436a3-c1a8-476c-83ab-8479e8f42b0f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059498 May 28 04:36:11.584121 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 313/578] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:36:12.352401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8739d133-d60f-49bf-bd26-6c0b04942921 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:12.352989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8739d133-d60f-49bf-bd26-6c0b04942921 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:12.362789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8739d133-d60f-49bf-bd26-6c0b04942921 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:12.363865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8739d133-d60f-49bf-bd26-6c0b04942921 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:12.364972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8739d133-d60f-49bf-bd26-6c0b04942921 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:12.365676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8739d133-d60f-49bf-bd26-6c0b04942921 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:12.837296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8739d133-d60f-49bf-bd26-6c0b04942921 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:12.847388 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8739d133-d60f-49bf-bd26-6c0b04942921 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1313 microversion: 2.1 time: 0.504713 May 28 04:36:12.848593 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 314/579] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:12 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:12.855829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b8b99df0-a9ca-42de-b62e-e77526d7f4f2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e7b790>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:12.953845 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b8b99df0-a9ca-42de-b62e-e77526d7f4f2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.103380 May 28 04:36:12.956074 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 315/580] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:12 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:13.879501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7b827fad-80ee-438b-9d87-4f91e3de27ba tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:13.883092 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7b827fad-80ee-438b-9d87-4f91e3de27ba tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:13.923684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b827fad-80ee-438b-9d87-4f91e3de27ba tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:13.925960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b827fad-80ee-438b-9d87-4f91e3de27ba tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:13.929792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b827fad-80ee-438b-9d87-4f91e3de27ba tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:13.944525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b827fad-80ee-438b-9d87-4f91e3de27ba tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:14.904608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7b827fad-80ee-438b-9d87-4f91e3de27ba tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:14.914630 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7b827fad-80ee-438b-9d87-4f91e3de27ba tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1313 microversion: 2.1 time: 1.052844 May 28 04:36:14.918722 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 316/581] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:13 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1313 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:14.938447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e6044db3-5e0d-4210-8b9b-a235a37b83f1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e7baf0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:15.089102 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e6044db3-5e0d-4210-8b9b-a235a37b83f1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.169239 May 28 04:36:15.090612 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 317/582] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:14 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:15.670289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-223de324-2c77-4a4c-90d1-4faa42d4b568 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-542395966", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "244ceb49-a9c1-42ce-900e-8ae28e09e3a9"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:15.810670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-223de324-2c77-4a4c-90d1-4faa42d4b568 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] validate_networks() for [('244ceb49-a9c1-42ce-900e-8ae28e09e3a9', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:36:16.587396 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c2a19b16-aa5a-4a73-b1a6-0da2de513e10 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca/action" status: 202 len: 0 microversion: 2.1 time: 5.995188 May 28 04:36:16.593466 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 266/583] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:36:10 2022] POST /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca/action => generated 0 bytes in 6002 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:36:16.599539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0c8554e1-ac6c-4771-9ebd-bc75aa144534 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:16.600521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0c8554e1-ac6c-4771-9ebd-bc75aa144534 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:16.613474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c8554e1-ac6c-4771-9ebd-bc75aa144534 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:16.618690 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c8554e1-ac6c-4771-9ebd-bc75aa144534 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:16.620638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c8554e1-ac6c-4771-9ebd-bc75aa144534 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:16.621376 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c8554e1-ac6c-4771-9ebd-bc75aa144534 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:17.123754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-223de324-2c77-4a4c-90d1-4faa42d4b568 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:36:17.123754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-223de324-2c77-4a4c-90d1-4faa42d4b568 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:36:17.123754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-223de324-2c77-4a4c-90d1-4faa42d4b568 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:36:17.123754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-223de324-2c77-4a4c-90d1-4faa42d4b568 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:36:17.123754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-223de324-2c77-4a4c-90d1-4faa42d4b568 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:36:17.142200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-223de324-2c77-4a4c-90d1-4faa42d4b568 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:17.142962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-223de324-2c77-4a4c-90d1-4faa42d4b568 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:17.144114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-223de324-2c77-4a4c-90d1-4faa42d4b568 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:17.144720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-223de324-2c77-4a4c-90d1-4faa42d4b568 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:17.164527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-223de324-2c77-4a4c-90d1-4faa42d4b568 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Getting quotas for project 99f14746bfbc460eb4a21e7eb567de46. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:36:17.168471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0c8554e1-ac6c-4771-9ebd-bc75aa144534 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:17.170556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-223de324-2c77-4a4c-90d1-4faa42d4b568 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Getting quotas for user ed90faaaee584c3a8d1385b8d873d12d and project 99f14746bfbc460eb4a21e7eb567de46. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:36:17.178039 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0c8554e1-ac6c-4771-9ebd-bc75aa144534 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1313 microversion: 2.1 time: 0.582886 May 28 04:36:17.178886 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 267/584] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:16 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1313 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:17.184528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-20cb47e4-b1ae-462b-97ad-e94d27c4016b tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f759d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:17.184829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-223de324-2c77-4a4c-90d1-4faa42d4b568 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:36:17.187134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-223de324-2c77-4a4c-90d1-4faa42d4b568 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:36:17.241265 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-20cb47e4-b1ae-462b-97ad-e94d27c4016b tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.060975 May 28 04:36:17.242424 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 268/585] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:17 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:17.247385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-825da99a-995f-4504-9b94-68c757c64311 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:17.248185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-825da99a-995f-4504-9b94-68c757c64311 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:17.261175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-825da99a-995f-4504-9b94-68c757c64311 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:17.261629 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-825da99a-995f-4504-9b94-68c757c64311 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:17.263638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-825da99a-995f-4504-9b94-68c757c64311 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:17.263638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-825da99a-995f-4504-9b94-68c757c64311 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:17.337469 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-223de324-2c77-4a4c-90d1-4faa42d4b568 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.243189 May 28 04:36:17.347346 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 318/586] 10.222.0.58 () {62 vars in 1187 bytes} [Sat May 28 04:36:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2256 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 04:36:17.360204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2a7a0409-2993-4ff1-9138-33ed5c8144ca tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:17.361826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2a7a0409-2993-4ff1-9138-33ed5c8144ca tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:17.685802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=11 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:17.712150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2a7a0409-2993-4ff1-9138-33ed5c8144ca tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:17.721276 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2a7a0409-2993-4ff1-9138-33ed5c8144ca tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:17.728923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2a7a0409-2993-4ff1-9138-33ed5c8144ca tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:17.739240 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2a7a0409-2993-4ff1-9138-33ed5c8144ca tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1261 microversion: 2.25 time: 0.389610 May 28 04:36:17.755720 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 319/587] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:17 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1261 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:17.767167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-825da99a-995f-4504-9b94-68c757c64311 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:17.780867 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-825da99a-995f-4504-9b94-68c757c64311 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1504 microversion: 2.1 time: 0.535992 May 28 04:36:17.781770 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 269/588] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:17 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1504 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:18.194870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2ab0d21a-ddd6-4800-970f-58627bda8996 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:18.195592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2ab0d21a-ddd6-4800-970f-58627bda8996 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:18.202825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2ab0d21a-ddd6-4800-970f-58627bda8996 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:18.203560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2ab0d21a-ddd6-4800-970f-58627bda8996 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:18.204923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2ab0d21a-ddd6-4800-970f-58627bda8996 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:18.205577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2ab0d21a-ddd6-4800-970f-58627bda8996 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:18.256917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-36c0ca08-a0e6-479b-ab34-92500eadd9a8 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f26280>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:18.362274 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-36c0ca08-a0e6-479b-ab34-92500eadd9a8 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.110476 May 28 04:36:18.364268 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 270/589] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:18 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:18.601934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2ab0d21a-ddd6-4800-970f-58627bda8996 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:18.613272 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2ab0d21a-ddd6-4800-970f-58627bda8996 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1313 microversion: 2.1 time: 0.422036 May 28 04:36:18.617069 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 320/590] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:18 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:18.774791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-749ae2b4-d072-4dce-80dc-495593dfdec5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:18.774791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-749ae2b4-d072-4dce-80dc-495593dfdec5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:18.798357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-efdf403e-a5a1-46a8-8f09-cf77157e1452 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:18.803316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-efdf403e-a5a1-46a8-8f09-cf77157e1452 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:18.819836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efdf403e-a5a1-46a8-8f09-cf77157e1452 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:18.822232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efdf403e-a5a1-46a8-8f09-cf77157e1452 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:18.825238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efdf403e-a5a1-46a8-8f09-cf77157e1452 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:18.825987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efdf403e-a5a1-46a8-8f09-cf77157e1452 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.105265 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-749ae2b4-d072-4dce-80dc-495593dfdec5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:19.123451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-749ae2b4-d072-4dce-80dc-495593dfdec5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:19.127842 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-749ae2b4-d072-4dce-80dc-495593dfdec5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:19.129041 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-749ae2b4-d072-4dce-80dc-495593dfdec5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1261 microversion: 2.25 time: 0.360708 May 28 04:36:19.129663 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 271/591] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:18 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1261 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:36:19.305641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-efdf403e-a5a1-46a8-8f09-cf77157e1452 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:19.317205 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-efdf403e-a5a1-46a8-8f09-cf77157e1452 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1504 microversion: 2.1 time: 0.520465 May 28 04:36:19.317205 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 321/592] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:18 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1504 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:19.379460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-be6c8242-2fd5-4fb6-a1c7-734995b563d1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f119d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:19.457340 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-be6c8242-2fd5-4fb6-a1c7-734995b563d1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.083958 May 28 04:36:19.458597 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 322/593] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:19 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:19.466919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2710ebe5-8de8-4479-9fb2-eaffa40899c3 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Calling method '.version_select at 0x7f7701f6bf70>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:19.467856 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:36:19.467856 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:36:19.469179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2710ebe5-8de8-4479-9fb2-eaffa40899c3 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.469689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2710ebe5-8de8-4479-9fb2-eaffa40899c3 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.471977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-a341064a-b82a-4a0f-a6bf-8a42724cd7b0 req-2f9fe36e-07eb-4ed8-a489-d3d4ba7d5071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b500d99-8f98-409e-a0df-e2cea22343ca", "name": "network-vif-unplugged", "status": "completed", "tag": "89183d0a-5af7-462b-845f-59b3484b2c3b"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:19.480495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a341064a-b82a-4a0f-a6bf-8a42724cd7b0 req-2f9fe36e-07eb-4ed8-a489-d3d4ba7d5071 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.481108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a341064a-b82a-4a0f-a6bf-8a42724cd7b0 req-2f9fe36e-07eb-4ed8-a489-d3d4ba7d5071 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.493613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2710ebe5-8de8-4479-9fb2-eaffa40899c3 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.494328 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-a341064a-b82a-4a0f-a6bf-8a42724cd7b0 req-2f9fe36e-07eb-4ed8-a489-d3d4ba7d5071 service nova] Creating event network-vif-unplugged:89183d0a-5af7-462b-845f-59b3484b2c3b for instance 7b500d99-8f98-409e-a0df-e2cea22343ca on n-h1-843700-1 May 28 04:36:19.494458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2710ebe5-8de8-4479-9fb2-eaffa40899c3 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.500827 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-a341064a-b82a-4a0f-a6bf-8a42724cd7b0 req-2f9fe36e-07eb-4ed8-a489-d3d4ba7d5071 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040042 May 28 04:36:19.507254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2710ebe5-8de8-4479-9fb2-eaffa40899c3 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.507713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2710ebe5-8de8-4479-9fb2-eaffa40899c3 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.508008 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 323/594] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:19.517412 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2710ebe5-8de8-4479-9fb2-eaffa40899c3 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.378168 May 28 04:36:19.517412 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 272/595] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:36:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:19.526173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bf62f14c-7a64-4ef3-8d9e-38798293b92b tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Calling method '.version_select at 0x7f7701f429d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:19.527080 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:36:19.527080 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:36:19.528227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf62f14c-7a64-4ef3-8d9e-38798293b92b tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.528676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf62f14c-7a64-4ef3-8d9e-38798293b92b tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.543209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf62f14c-7a64-4ef3-8d9e-38798293b92b tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.543661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf62f14c-7a64-4ef3-8d9e-38798293b92b tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.553693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf62f14c-7a64-4ef3-8d9e-38798293b92b tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.554138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf62f14c-7a64-4ef3-8d9e-38798293b92b tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.560068 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bf62f14c-7a64-4ef3-8d9e-38798293b92b tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.038002 May 28 04:36:19.564795 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 324/596] 10.222.0.58 () {58 vars in 1166 bytes} [Sat May 28 04:36:19 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:19.573448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9a7967e4-e6de-4d43-8d4d-c5780685803c tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Calling method '.version_select at 0x7f7701f6b310>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:19.574242 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:36:19.574242 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:36:19.575416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9a7967e4-e6de-4d43-8d4d-c5780685803c tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.575861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9a7967e4-e6de-4d43-8d4d-c5780685803c tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.590020 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9a7967e4-e6de-4d43-8d4d-c5780685803c tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.590470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9a7967e4-e6de-4d43-8d4d-c5780685803c tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.600959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9a7967e4-e6de-4d43-8d4d-c5780685803c tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.601408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9a7967e4-e6de-4d43-8d4d-c5780685803c tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.607171 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9a7967e4-e6de-4d43-8d4d-c5780685803c tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.037247 May 28 04:36:19.607738 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 273/597] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:36:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:19.617020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9ee67dea-3cc6-4a94-b1b8-8ecc2b18f1b4 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Calling method '.version_select at 0x7f7701f11550>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:19.617806 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:36:19.617806 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:36:19.619081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ee67dea-3cc6-4a94-b1b8-8ecc2b18f1b4 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.619558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ee67dea-3cc6-4a94-b1b8-8ecc2b18f1b4 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.632294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ee67dea-3cc6-4a94-b1b8-8ecc2b18f1b4 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.632674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ee67dea-3cc6-4a94-b1b8-8ecc2b18f1b4 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.633539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f9fca2e9-7080-4e01-be7c-45333e3e3c73 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:19.634210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f9fca2e9-7080-4e01-be7c-45333e3e3c73 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:19.639397 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9ee67dea-3cc6-4a94-b1b8-8ecc2b18f1b4 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.026042 May 28 04:36:19.639981 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 325/598] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:36:19 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:19.640415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9fca2e9-7080-4e01-be7c-45333e3e3c73 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.640876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9fca2e9-7080-4e01-be7c-45333e3e3c73 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.643839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9fca2e9-7080-4e01-be7c-45333e3e3c73 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.644294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9fca2e9-7080-4e01-be7c-45333e3e3c73 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.653310 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eec032db-9505-4d73-a3a0-aba43f5915de tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Calling method '.version_select at 0x7f7701f50940>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:19.654121 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:36:19.654121 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:36:19.655255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eec032db-9505-4d73-a3a0-aba43f5915de tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.655759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eec032db-9505-4d73-a3a0-aba43f5915de tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.673714 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-eec032db-9505-4d73-a3a0-aba43f5915de tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.023893 May 28 04:36:19.674349 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 326/599] 10.222.0.58 () {58 vars in 1178 bytes} [Sat May 28 04:36:19 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:19.685733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-81aa5b44-3362-497e-b0c0-5f7eb2c33e72 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Calling method '.version_select at 0x7f7701f114c0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:19.686670 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:36:19.686670 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:36:19.688472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-81aa5b44-3362-497e-b0c0-5f7eb2c33e72 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.689002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-81aa5b44-3362-497e-b0c0-5f7eb2c33e72 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.704288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-81aa5b44-3362-497e-b0c0-5f7eb2c33e72 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.704834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-81aa5b44-3362-497e-b0c0-5f7eb2c33e72 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.716264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-81aa5b44-3362-497e-b0c0-5f7eb2c33e72 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.716793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-81aa5b44-3362-497e-b0c0-5f7eb2c33e72 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.723311 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-81aa5b44-3362-497e-b0c0-5f7eb2c33e72 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.041482 May 28 04:36:19.724290 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 327/600] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:36:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:36:19.733691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f948affd-a1a0-4cc8-9bf7-a73ee6a3d1b8 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Calling method '.version_select at 0x7f7701f11af0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:19.734621 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:36:19.734621 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:36:19.736263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f948affd-a1a0-4cc8-9bf7-a73ee6a3d1b8 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.736880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f948affd-a1a0-4cc8-9bf7-a73ee6a3d1b8 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.780979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f948affd-a1a0-4cc8-9bf7-a73ee6a3d1b8 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.781716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f948affd-a1a0-4cc8-9bf7-a73ee6a3d1b8 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.800931 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f948affd-a1a0-4cc8-9bf7-a73ee6a3d1b8 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.071318 May 28 04:36:19.802252 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 328/601] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:36:19 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:19.814397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f22cc725-4863-412f-8d72-1fce2f5a0608 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Calling method '.version_select at 0x7f77022175e0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:19.816590 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:36:19.816590 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:36:19.824044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f22cc725-4863-412f-8d72-1fce2f5a0608 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.824726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f22cc725-4863-412f-8d72-1fce2f5a0608 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.860195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f22cc725-4863-412f-8d72-1fce2f5a0608 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.861274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f22cc725-4863-412f-8d72-1fce2f5a0608 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.881288 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f22cc725-4863-412f-8d72-1fce2f5a0608 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.070433 May 28 04:36:19.884269 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 329/602] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:36:19 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:19.896510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6a49242f-1b6e-448b-b3a9-16f8fbdc3ee4 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Calling method '.version_select at 0x7f7701f11280>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:19.903945 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:36:19.903945 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:36:19.903945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a49242f-1b6e-448b-b3a9-16f8fbdc3ee4 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.903945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a49242f-1b6e-448b-b3a9-16f8fbdc3ee4 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.930066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f9fca2e9-7080-4e01-be7c-45333e3e3c73 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:19.939267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a49242f-1b6e-448b-b3a9-16f8fbdc3ee4 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.940873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a49242f-1b6e-448b-b3a9-16f8fbdc3ee4 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:19.942983 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f9fca2e9-7080-4e01-be7c-45333e3e3c73 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1313 microversion: 2.1 time: 0.309664 May 28 04:36:19.945552 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 274/603] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:19 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:19.977718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a49242f-1b6e-448b-b3a9-16f8fbdc3ee4 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:19.978531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a49242f-1b6e-448b-b3a9-16f8fbdc3ee4 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:20.031584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-363faba9-eb65-493f-822c-1b5f117486b6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-396540293", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "790028090", "adminPass": "***", "networks": [{"uuid": "f493df89-4f63-4577-b13a-401006b19043"}], "security_groups": [{"name": "tempest-securitygroup--724082104"}], "key_name": "tempest-keypair-255921009", "user_data": "}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:20.065569 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6a49242f-1b6e-448b-b3a9-16f8fbdc3ee4 tempest-HypervisorAdminTestJSON-2109988091 tempest-HypervisorAdminTestJSON-2109988091-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.174242 May 28 04:36:20.072369 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 330/604] 10.222.0.58 () {58 vars in 1172 bytes} [Sat May 28 04:36:19 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:20.176179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-28d999bb-6d64-4053-99bc-44f2144d061b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:20.183868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-28d999bb-6d64-4053-99bc-44f2144d061b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:20.188356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-28d999bb-6d64-4053-99bc-44f2144d061b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:20.188895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-28d999bb-6d64-4053-99bc-44f2144d061b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:20.189941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-28d999bb-6d64-4053-99bc-44f2144d061b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:20.190737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-28d999bb-6d64-4053-99bc-44f2144d061b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:20.224586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-363faba9-eb65-493f-822c-1b5f117486b6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] validate_networks() for [('f493df89-4f63-4577-b13a-401006b19043', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:36:20.451806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-28d999bb-6d64-4053-99bc-44f2144d061b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:20.464659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-28d999bb-6d64-4053-99bc-44f2144d061b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:20.466609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-28d999bb-6d64-4053-99bc-44f2144d061b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:20.469740 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-28d999bb-6d64-4053-99bc-44f2144d061b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1257 microversion: 2.25 time: 0.302701 May 28 04:36:20.474662 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 331/605] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:20 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1257 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:36:20.481945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0207524f-1dd8-4504-a801-f5ff58415b92 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:20.484252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0207524f-1dd8-4504-a801-f5ff58415b92 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:20.504048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0207524f-1dd8-4504-a801-f5ff58415b92 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:20.506566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0207524f-1dd8-4504-a801-f5ff58415b92 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:20.507414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0207524f-1dd8-4504-a801-f5ff58415b92 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:20.508578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0207524f-1dd8-4504-a801-f5ff58415b92 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:20.797899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0207524f-1dd8-4504-a801-f5ff58415b92 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:20.809304 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0207524f-1dd8-4504-a801-f5ff58415b92 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1504 microversion: 2.1 time: 0.331264 May 28 04:36:20.810107 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 332/606] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:20 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1504 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:20.823512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-148d8289-7785-4d26-b791-9aca63df77f3 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e96af0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:20.925923 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-148d8289-7785-4d26-b791-9aca63df77f3 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.114956 May 28 04:36:20.926870 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 333/607] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:20 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:20.963283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5dc09011-150f-42b1-b476-dba42d2760c6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:20.964046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5dc09011-150f-42b1-b476-dba42d2760c6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:20.973365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5dc09011-150f-42b1-b476-dba42d2760c6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:20.973810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5dc09011-150f-42b1-b476-dba42d2760c6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:20.981619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5dc09011-150f-42b1-b476-dba42d2760c6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:20.982320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5dc09011-150f-42b1-b476-dba42d2760c6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:21.006849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-363faba9-eb65-493f-822c-1b5f117486b6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:36:21.011870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-363faba9-eb65-493f-822c-1b5f117486b6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:36:21.011870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-363faba9-eb65-493f-822c-1b5f117486b6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:36:21.011870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-363faba9-eb65-493f-822c-1b5f117486b6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:36:21.011870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-363faba9-eb65-493f-822c-1b5f117486b6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:36:21.020708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-363faba9-eb65-493f-822c-1b5f117486b6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:21.021401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-363faba9-eb65-493f-822c-1b5f117486b6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:21.022373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-363faba9-eb65-493f-822c-1b5f117486b6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:21.022970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-363faba9-eb65-493f-822c-1b5f117486b6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:21.033614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:21.047019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-363faba9-eb65-493f-822c-1b5f117486b6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Getting quotas for project 7b5e68532952468cbd37fad9b381d355. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:36:21.053437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-363faba9-eb65-493f-822c-1b5f117486b6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Getting quotas for user c567ca604e0743bf874889ba69bbeb49 and project 7b5e68532952468cbd37fad9b381d355. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:36:21.080755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-363faba9-eb65-493f-822c-1b5f117486b6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:36:21.097950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-363faba9-eb65-493f-822c-1b5f117486b6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:36:21.303460 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-363faba9-eb65-493f-822c-1b5f117486b6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.279628 May 28 04:36:21.313151 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 275/608] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:36:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 04:36:21.326599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-92affe76-4146-424c-9bcf-6efd74fe1833 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:21.327539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-92affe76-4146-424c-9bcf-6efd74fe1833 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:21.329075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5dc09011-150f-42b1-b476-dba42d2760c6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:21.338668 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5dc09011-150f-42b1-b476-dba42d2760c6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1313 microversion: 2.1 time: 0.380064 May 28 04:36:21.349281 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 334/609] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:20 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:21.468038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-92affe76-4146-424c-9bcf-6efd74fe1833 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:21.481881 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-92affe76-4146-424c-9bcf-6efd74fe1833 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8" status: 200 len: 1261 microversion: 2.1 time: 0.160533 May 28 04:36:21.495534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5dd672c9-d6c5-4414-9991-c76332ef9230 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:21.495534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5dd672c9-d6c5-4414-9991-c76332ef9230 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:21.499669 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 276/610] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:21 2022] GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 => generated 1261 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:21.505133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5dd672c9-d6c5-4414-9991-c76332ef9230 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:21.508277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5dd672c9-d6c5-4414-9991-c76332ef9230 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:21.515189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5dd672c9-d6c5-4414-9991-c76332ef9230 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:21.519937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5dd672c9-d6c5-4414-9991-c76332ef9230 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:21.551084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-0eacd1a2-61c6-4f68-b22e-6d6b9e73d294 req-f244de2a-951c-4546-adce-a4da0026f174 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b500d99-8f98-409e-a0df-e2cea22343ca", "tag": "89183d0a-5af7-462b-845f-59b3484b2c3b"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:21.564304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0eacd1a2-61c6-4f68-b22e-6d6b9e73d294 req-f244de2a-951c-4546-adce-a4da0026f174 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:21.565580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0eacd1a2-61c6-4f68-b22e-6d6b9e73d294 req-f244de2a-951c-4546-adce-a4da0026f174 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:21.600201 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-0eacd1a2-61c6-4f68-b22e-6d6b9e73d294 req-f244de2a-951c-4546-adce-a4da0026f174 service nova] Creating event network-changed:89183d0a-5af7-462b-845f-59b3484b2c3b for instance 7b500d99-8f98-409e-a0df-e2cea22343ca on n-h1-843700-1 May 28 04:36:21.606103 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-0eacd1a2-61c6-4f68-b22e-6d6b9e73d294 req-f244de2a-951c-4546-adce-a4da0026f174 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058942 May 28 04:36:21.606714 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 277/611] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:36:21.645088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5dd672c9-d6c5-4414-9991-c76332ef9230 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:21.661121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5dd672c9-d6c5-4414-9991-c76332ef9230 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:21.663106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5dd672c9-d6c5-4414-9991-c76332ef9230 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:21.665434 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5dd672c9-d6c5-4414-9991-c76332ef9230 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1331 microversion: 2.25 time: 0.179662 May 28 04:36:21.667036 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 335/612] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:21 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1331 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:36:21.827152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-123ad6a3-8647-4c6d-bd5b-a3e6ada3faf2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:21.828034 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-123ad6a3-8647-4c6d-bd5b-a3e6ada3faf2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:21.836495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-123ad6a3-8647-4c6d-bd5b-a3e6ada3faf2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:21.838573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-123ad6a3-8647-4c6d-bd5b-a3e6ada3faf2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:21.839845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-123ad6a3-8647-4c6d-bd5b-a3e6ada3faf2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:21.840609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-123ad6a3-8647-4c6d-bd5b-a3e6ada3faf2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:21.847447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:22.099422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bc8fd243-b317-490a-9a8e-b201accfdd48 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1612440800", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:22.175132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-123ad6a3-8647-4c6d-bd5b-a3e6ada3faf2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:22.184022 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-123ad6a3-8647-4c6d-bd5b-a3e6ada3faf2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1504 microversion: 2.1 time: 0.362021 May 28 04:36:22.195542 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 336/613] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:21 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1504 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:22.200297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-bc8fd243-b317-490a-9a8e-b201accfdd48 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] validate_networks() for None {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:36:22.212451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-442dc893-402a-4367-a5e6-08e45348cf36 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e96f70>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:22.302827 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-442dc893-402a-4367-a5e6-08e45348cf36 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.114557 May 28 04:36:22.306971 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 337/614] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:22 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:22.356065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bacd1712-68a1-4949-a004-642012a83f29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:22.356679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bacd1712-68a1-4949-a004-642012a83f29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:22.372018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bacd1712-68a1-4949-a004-642012a83f29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:22.372503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bacd1712-68a1-4949-a004-642012a83f29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:22.373318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bacd1712-68a1-4949-a004-642012a83f29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:22.373759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bacd1712-68a1-4949-a004-642012a83f29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:22.739235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bacd1712-68a1-4949-a004-642012a83f29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:22.748184 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bacd1712-68a1-4949-a004-642012a83f29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1313 microversion: 2.1 time: 0.396289 May 28 04:36:22.748706 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 338/615] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:22 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:22.757627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-be681f4f-5fbd-42bd-8cea-73e25ee04307 req-dc3f79bc-6162-4763-887d-5b84e5f73a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87cc4d83-fd02-4a96-a640-3cad08bba4f4", "name": "network-vif-plugged", "status": "completed", "tag": "47bf89ee-9954-4b95-8607-a086661df3bd"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:22.782876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-bc8fd243-b317-490a-9a8e-b201accfdd48 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:36:22.783510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-bc8fd243-b317-490a-9a8e-b201accfdd48 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:36:22.784276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-bc8fd243-b317-490a-9a8e-b201accfdd48 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:36:22.785960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-bc8fd243-b317-490a-9a8e-b201accfdd48 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:36:22.787293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-bc8fd243-b317-490a-9a8e-b201accfdd48 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:36:22.797751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-be681f4f-5fbd-42bd-8cea-73e25ee04307 req-dc3f79bc-6162-4763-887d-5b84e5f73a9b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:22.800188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-be681f4f-5fbd-42bd-8cea-73e25ee04307 req-dc3f79bc-6162-4763-887d-5b84e5f73a9b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:22.807404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc8fd243-b317-490a-9a8e-b201accfdd48 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:22.808876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc8fd243-b317-490a-9a8e-b201accfdd48 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:22.810253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc8fd243-b317-490a-9a8e-b201accfdd48 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:22.811072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc8fd243-b317-490a-9a8e-b201accfdd48 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:22.814175 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-be681f4f-5fbd-42bd-8cea-73e25ee04307 req-dc3f79bc-6162-4763-887d-5b84e5f73a9b service nova] Creating event network-vif-plugged:47bf89ee-9954-4b95-8607-a086661df3bd for instance 87cc4d83-fd02-4a96-a640-3cad08bba4f4 on n-h1-843700-1 May 28 04:36:22.819917 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-be681f4f-5fbd-42bd-8cea-73e25ee04307 req-dc3f79bc-6162-4763-887d-5b84e5f73a9b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067569 May 28 04:36:22.821041 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 339/616] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:22.828490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-225a625b-388a-4410-afe9-486e98e47f2c tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:22.829422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-225a625b-388a-4410-afe9-486e98e47f2c tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:22.837545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-225a625b-388a-4410-afe9-486e98e47f2c tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:22.838473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-225a625b-388a-4410-afe9-486e98e47f2c tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:22.839489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-225a625b-388a-4410-afe9-486e98e47f2c tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:22.840164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-225a625b-388a-4410-afe9-486e98e47f2c tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:22.886364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-bc8fd243-b317-490a-9a8e-b201accfdd48 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Getting quotas for project 2225e50831e54c9093339163d35e690d. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:36:22.905179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-bc8fd243-b317-490a-9a8e-b201accfdd48 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Getting quotas for user dc3db75ca2004d7db34b1717680c3146 and project 2225e50831e54c9093339163d35e690d. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:36:22.948780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bc8fd243-b317-490a-9a8e-b201accfdd48 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:36:22.957039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bc8fd243-b317-490a-9a8e-b201accfdd48 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] [instance: f495e0b2-28af-4f3d-9b5f-753ab641593a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:36:22.989827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-225a625b-388a-4410-afe9-486e98e47f2c tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:23.009185 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-225a625b-388a-4410-afe9-486e98e47f2c tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8" status: 200 len: 1265 microversion: 2.1 time: 0.182937 May 28 04:36:23.009847 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 340/617] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:22 2022] GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:23.032263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4c2b2f46-7239-4c55-85ec-46a2a0dc47c6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:23.035075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4c2b2f46-7239-4c55-85ec-46a2a0dc47c6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:23.056766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c2b2f46-7239-4c55-85ec-46a2a0dc47c6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:23.056879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c2b2f46-7239-4c55-85ec-46a2a0dc47c6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:23.061444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c2b2f46-7239-4c55-85ec-46a2a0dc47c6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:23.061444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c2b2f46-7239-4c55-85ec-46a2a0dc47c6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:23.216752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4c2b2f46-7239-4c55-85ec-46a2a0dc47c6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:23.237150 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bc8fd243-b317-490a-9a8e-b201accfdd48 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.540655 May 28 04:36:23.238137 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 278/618] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:36:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:36:23.260321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4c2b2f46-7239-4c55-85ec-46a2a0dc47c6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:23.268269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4c2b2f46-7239-4c55-85ec-46a2a0dc47c6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:23.272911 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4c2b2f46-7239-4c55-85ec-46a2a0dc47c6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1319 microversion: 2.25 time: 0.259537 May 28 04:36:23.274874 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 341/619] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:23 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:23.280852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c54f2844-6fdd-4cd6-9ec7-cd06891f8795 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:23.281555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c54f2844-6fdd-4cd6-9ec7-cd06891f8795 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:23.292477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c54f2844-6fdd-4cd6-9ec7-cd06891f8795 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:23.293018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c54f2844-6fdd-4cd6-9ec7-cd06891f8795 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:23.293947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c54f2844-6fdd-4cd6-9ec7-cd06891f8795 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:23.294421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c54f2844-6fdd-4cd6-9ec7-cd06891f8795 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:23.535740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c54f2844-6fdd-4cd6-9ec7-cd06891f8795 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:23.545410 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c54f2844-6fdd-4cd6-9ec7-cd06891f8795 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1504 microversion: 2.1 time: 0.269136 May 28 04:36:23.546245 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 342/620] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:23 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1504 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:23.552880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6ba239cf-74b4-4e1e-8f3d-526bc71b3270 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:23.553785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6ba239cf-74b4-4e1e-8f3d-526bc71b3270 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] [instance: f495e0b2-28af-4f3d-9b5f-753ab641593a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:23.611016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ddafd1ce-00f0-468d-8a70-ad54cde828df tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-342071022", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:23.688949 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6ba239cf-74b4-4e1e-8f3d-526bc71b3270 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3db75ca2004d7db34b1717680c3146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2225e50831e54c9093339163d35e690d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:23.701026 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6ba239cf-74b4-4e1e-8f3d-526bc71b3270 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] 10.222.0.58 "GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a" status: 200 len: 1223 microversion: 2.1 time: 0.151991 May 28 04:36:23.705838 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 343/621] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:23 2022] GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a => generated 1223 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:23.719795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8473ff1d-e858-44d0-b618-771fe01c06a6 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e7b310>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:23.746498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-ddafd1ce-00f0-468d-8a70-ad54cde828df tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] validate_networks() for None {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:36:23.837185 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8473ff1d-e858-44d0-b618-771fe01c06a6 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.132583 May 28 04:36:23.842858 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 344/622] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:23 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:23.848680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0c00742f-03c7-432f-9a42-195d293ab35c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:23.849518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0c00742f-03c7-432f-9a42-195d293ab35c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:23.856464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c00742f-03c7-432f-9a42-195d293ab35c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:23.857543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c00742f-03c7-432f-9a42-195d293ab35c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:23.858854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c00742f-03c7-432f-9a42-195d293ab35c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:23.860040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c00742f-03c7-432f-9a42-195d293ab35c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:24.080319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-ddafd1ce-00f0-468d-8a70-ad54cde828df tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:36:24.083559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-ddafd1ce-00f0-468d-8a70-ad54cde828df tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:36:24.084322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-ddafd1ce-00f0-468d-8a70-ad54cde828df tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:36:24.084938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-ddafd1ce-00f0-468d-8a70-ad54cde828df tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:36:24.085907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-ddafd1ce-00f0-468d-8a70-ad54cde828df tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:36:24.100328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ddafd1ce-00f0-468d-8a70-ad54cde828df tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:24.105297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ddafd1ce-00f0-468d-8a70-ad54cde828df tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:24.106494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ddafd1ce-00f0-468d-8a70-ad54cde828df tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:24.107400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ddafd1ce-00f0-468d-8a70-ad54cde828df tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:24.129937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0c00742f-03c7-432f-9a42-195d293ab35c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:24.137690 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-ddafd1ce-00f0-468d-8a70-ad54cde828df tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Getting quotas for project 2f8aa260b3e94154b0a0485659f7f7e3. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:36:24.139206 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0c00742f-03c7-432f-9a42-195d293ab35c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1313 microversion: 2.1 time: 0.294886 May 28 04:36:24.144071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-ddafd1ce-00f0-468d-8a70-ad54cde828df tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Getting quotas for user a666a6908cd44a898f0b3dfdb8e1dd3a and project 2f8aa260b3e94154b0a0485659f7f7e3. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:36:24.152897 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 345/623] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:23 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:24.162580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e0486558-8277-4cd9-a2ff-2eaaa21e6d4f tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:24.171598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e0486558-8277-4cd9-a2ff-2eaaa21e6d4f tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:24.185601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ddafd1ce-00f0-468d-8a70-ad54cde828df tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:36:24.189921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ddafd1ce-00f0-468d-8a70-ad54cde828df tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:36:24.193463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0486558-8277-4cd9-a2ff-2eaaa21e6d4f tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:24.193928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0486558-8277-4cd9-a2ff-2eaaa21e6d4f tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:24.203345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0486558-8277-4cd9-a2ff-2eaaa21e6d4f tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:24.204100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0486558-8277-4cd9-a2ff-2eaaa21e6d4f tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:24.238562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:24.280251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e0486558-8277-4cd9-a2ff-2eaaa21e6d4f tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:24.292624 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e0486558-8277-4cd9-a2ff-2eaaa21e6d4f tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8" status: 200 len: 1313 microversion: 2.1 time: 0.135679 May 28 04:36:24.292748 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 346/624] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:24 2022] GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 => generated 1313 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:24.298390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-81fc8214-1c21-4a15-969f-6dc85c10fec4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:24.300460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-81fc8214-1c21-4a15-969f-6dc85c10fec4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:24.308478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-81fc8214-1c21-4a15-969f-6dc85c10fec4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:24.308478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-81fc8214-1c21-4a15-969f-6dc85c10fec4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:24.308478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-81fc8214-1c21-4a15-969f-6dc85c10fec4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:24.309161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-81fc8214-1c21-4a15-969f-6dc85c10fec4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:24.367366 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ddafd1ce-00f0-468d-8a70-ad54cde828df tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.128080 May 28 04:36:24.376821 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 279/625] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:36:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:36:24.382470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-23d67298-5e76-4586-b3fe-33bca5e0b34e tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:24.389904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-23d67298-5e76-4586-b3fe-33bca5e0b34e tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:24.540352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-81fc8214-1c21-4a15-969f-6dc85c10fec4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:24.542048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-23d67298-5e76-4586-b3fe-33bca5e0b34e tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:24.558163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-81fc8214-1c21-4a15-969f-6dc85c10fec4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:24.559936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-81fc8214-1c21-4a15-969f-6dc85c10fec4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:24.561332 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-81fc8214-1c21-4a15-969f-6dc85c10fec4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1361 microversion: 2.25 time: 0.267509 May 28 04:36:24.572089 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 347/626] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:24 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:24.573657 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-23d67298-5e76-4586-b3fe-33bca5e0b34e tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1218 microversion: 2.1 time: 0.194897 May 28 04:36:24.578364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1ce63c52-aac7-454c-a75e-436b6cf0ef7f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:24.579328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1ce63c52-aac7-454c-a75e-436b6cf0ef7f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:24.586589 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 280/627] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:24 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1218 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:24.619204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ce63c52-aac7-454c-a75e-436b6cf0ef7f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:24.619204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ce63c52-aac7-454c-a75e-436b6cf0ef7f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:24.619204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ce63c52-aac7-454c-a75e-436b6cf0ef7f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:24.619204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ce63c52-aac7-454c-a75e-436b6cf0ef7f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:24.722975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ed56ba4b-0b89-466b-a0e7-39b5228b034a tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:24.723480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ed56ba4b-0b89-466b-a0e7-39b5228b034a tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] [instance: f495e0b2-28af-4f3d-9b5f-753ab641593a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:24.877711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ed56ba4b-0b89-466b-a0e7-39b5228b034a tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3db75ca2004d7db34b1717680c3146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2225e50831e54c9093339163d35e690d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:24.886085 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ed56ba4b-0b89-466b-a0e7-39b5228b034a tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] 10.222.0.58 "GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a" status: 200 len: 1223 microversion: 2.1 time: 0.170187 May 28 04:36:24.888586 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 281/628] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:24 2022] GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a => generated 1223 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:24.900005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-81588008-227e-41ec-94d3-af76d1122ab4 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f40670>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:25.046248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1ce63c52-aac7-454c-a75e-436b6cf0ef7f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:25.053683 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-81588008-227e-41ec-94d3-af76d1122ab4 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.162077 May 28 04:36:25.054280 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 282/629] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:24 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:25.058490 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1ce63c52-aac7-454c-a75e-436b6cf0ef7f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1504 microversion: 2.1 time: 0.484988 May 28 04:36:25.060019 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 348/630] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:24 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1504 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:25.157922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e7e76fc6-58a3-4a2b-8c33-5e18ce1ba723 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:25.159545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e7e76fc6-58a3-4a2b-8c33-5e18ce1ba723 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:25.170385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e7e76fc6-58a3-4a2b-8c33-5e18ce1ba723 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:25.170850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e7e76fc6-58a3-4a2b-8c33-5e18ce1ba723 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:25.171836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e7e76fc6-58a3-4a2b-8c33-5e18ce1ba723 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:25.176394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e7e76fc6-58a3-4a2b-8c33-5e18ce1ba723 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:25.316879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2062752a-5cf8-48f1-8cef-7b75991d03f3 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:25.317777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2062752a-5cf8-48f1-8cef-7b75991d03f3 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:25.332731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2062752a-5cf8-48f1-8cef-7b75991d03f3 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:25.336404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2062752a-5cf8-48f1-8cef-7b75991d03f3 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:25.337540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2062752a-5cf8-48f1-8cef-7b75991d03f3 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:25.338144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2062752a-5cf8-48f1-8cef-7b75991d03f3 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:25.500296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e7e76fc6-58a3-4a2b-8c33-5e18ce1ba723 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:25.509386 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e7e76fc6-58a3-4a2b-8c33-5e18ce1ba723 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1461 microversion: 2.1 time: 0.355882 May 28 04:36:25.521504 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 283/631] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:25 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1461 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:25.521600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2062752a-5cf8-48f1-8cef-7b75991d03f3 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:25.540092 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2062752a-5cf8-48f1-8cef-7b75991d03f3 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8" status: 200 len: 1331 microversion: 2.1 time: 0.227608 May 28 04:36:25.542792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8e062b54-e927-412d-a47e-365dd08c811e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:25.544172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8e062b54-e927-412d-a47e-365dd08c811e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:25.547389 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 349/632] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:25 2022] GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 => generated 1331 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:25.560950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e062b54-e927-412d-a47e-365dd08c811e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:25.561367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e062b54-e927-412d-a47e-365dd08c811e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:25.562524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e062b54-e927-412d-a47e-365dd08c811e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:25.562645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e062b54-e927-412d-a47e-365dd08c811e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:25.591484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5543dd13-c832-402a-a08e-777a6dc48d2e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:25.592352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5543dd13-c832-402a-a08e-777a6dc48d2e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:25.595702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:25.602548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5543dd13-c832-402a-a08e-777a6dc48d2e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:25.608681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5543dd13-c832-402a-a08e-777a6dc48d2e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:25.613452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5543dd13-c832-402a-a08e-777a6dc48d2e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:25.615649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5543dd13-c832-402a-a08e-777a6dc48d2e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:25.790363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8e062b54-e927-412d-a47e-365dd08c811e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:25.798270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8e062b54-e927-412d-a47e-365dd08c811e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Old instance type m1.heat2, new instance type m1.heat {{(pid=126043) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 04:36:25.819683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-8e062b54-e927-412d-a47e-365dd08c811e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:36:25.820469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-8e062b54-e927-412d-a47e-365dd08c811e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:36:25.825224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-8e062b54-e927-412d-a47e-365dd08c811e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:36:25.825648 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-8e062b54-e927-412d-a47e-365dd08c811e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:36:25.826326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-8e062b54-e927-412d-a47e-365dd08c811e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:36:25.849123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5543dd13-c832-402a-a08e-777a6dc48d2e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:25.866257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5543dd13-c832-402a-a08e-777a6dc48d2e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:25.868519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5543dd13-c832-402a-a08e-777a6dc48d2e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:25.876193 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5543dd13-c832-402a-a08e-777a6dc48d2e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1361 microversion: 2.25 time: 0.295863 May 28 04:36:25.877490 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 350/633] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:25 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1361 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:25.895459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-605f756b-77ac-4d89-802b-2124bb728abe tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:25.896354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-605f756b-77ac-4d89-802b-2124bb728abe tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:25.990189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-605f756b-77ac-4d89-802b-2124bb728abe tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:26.008364 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-605f756b-77ac-4d89-802b-2124bb728abe tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1218 microversion: 2.1 time: 0.128944 May 28 04:36:26.009447 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 351/634] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:25 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1218 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:26.015134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c592a557-04b5-42c1-b2ba-a709a6edea95 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:26.015814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c592a557-04b5-42c1-b2ba-a709a6edea95 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] [instance: f495e0b2-28af-4f3d-9b5f-753ab641593a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:26.024212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c592a557-04b5-42c1-b2ba-a709a6edea95 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:26.024637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c592a557-04b5-42c1-b2ba-a709a6edea95 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:26.025442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c592a557-04b5-42c1-b2ba-a709a6edea95 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:26.025884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c592a557-04b5-42c1-b2ba-a709a6edea95 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:26.188794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c592a557-04b5-42c1-b2ba-a709a6edea95 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3db75ca2004d7db34b1717680c3146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2225e50831e54c9093339163d35e690d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:26.200079 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c592a557-04b5-42c1-b2ba-a709a6edea95 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] 10.222.0.58 "GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a" status: 200 len: 1275 microversion: 2.1 time: 0.188376 May 28 04:36:26.240254 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 352/635] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:26 2022] GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a => generated 1275 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:26.240254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-38d2c124-01a5-42ae-a478-6bb4eb4e4575 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e454c0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:26.265321 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-38d2c124-01a5-42ae-a478-6bb4eb4e4575 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.058520 May 28 04:36:26.266514 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 353/636] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:26 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:26.271865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e9fa6d34-1e59-44da-809a-4bfc20ae660c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:26.272854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e9fa6d34-1e59-44da-809a-4bfc20ae660c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:26.280652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9fa6d34-1e59-44da-809a-4bfc20ae660c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:26.281211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9fa6d34-1e59-44da-809a-4bfc20ae660c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:26.284382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9fa6d34-1e59-44da-809a-4bfc20ae660c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:26.285152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9fa6d34-1e59-44da-809a-4bfc20ae660c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:26.430056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e9fa6d34-1e59-44da-809a-4bfc20ae660c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:26.437738 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e9fa6d34-1e59-44da-809a-4bfc20ae660c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1504 microversion: 2.1 time: 0.170092 May 28 04:36:26.438320 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 354/637] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:26 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:26.443487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-742c5eff-60ac-47a5-91d9-217820be354e req-c52b3d3c-bcd0-4317-8bd6-8818859a5c6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f64917b4-0e1c-4354-b5e5-e2925b14a602", "tag": "de60a199-e862-4d4b-a623-cea20acebfcd"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:26.451412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-742c5eff-60ac-47a5-91d9-217820be354e req-c52b3d3c-bcd0-4317-8bd6-8818859a5c6b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:26.451858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-742c5eff-60ac-47a5-91d9-217820be354e req-c52b3d3c-bcd0-4317-8bd6-8818859a5c6b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:26.463389 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-742c5eff-60ac-47a5-91d9-217820be354e req-c52b3d3c-bcd0-4317-8bd6-8818859a5c6b service nova] Creating event network-changed:de60a199-e862-4d4b-a623-cea20acebfcd for instance f64917b4-0e1c-4354-b5e5-e2925b14a602 on n-h2-843700-1 May 28 04:36:26.468422 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-742c5eff-60ac-47a5-91d9-217820be354e req-c52b3d3c-bcd0-4317-8bd6-8818859a5c6b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028929 May 28 04:36:26.469565 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 355/638] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:26.563676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ccb2c424-3a55-49cc-b557-be865c8bf5d2 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:26.564378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ccb2c424-3a55-49cc-b557-be865c8bf5d2 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:26.571171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ccb2c424-3a55-49cc-b557-be865c8bf5d2 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:26.571623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ccb2c424-3a55-49cc-b557-be865c8bf5d2 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:26.572380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ccb2c424-3a55-49cc-b557-be865c8bf5d2 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:26.572817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ccb2c424-3a55-49cc-b557-be865c8bf5d2 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:26.634732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ccb2c424-3a55-49cc-b557-be865c8bf5d2 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:26.642395 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ccb2c424-3a55-49cc-b557-be865c8bf5d2 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8" status: 200 len: 1319 microversion: 2.1 time: 0.082900 May 28 04:36:26.643035 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 356/639] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:26 2022] GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 => generated 1319 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:26.762944 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8e062b54-e927-412d-a47e-365dd08c811e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "POST /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4/action" status: 202 len: 0 microversion: 2.1 time: 1.227294 May 28 04:36:26.774727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c09ef63b-4c51-4b14-baf4-7b4fa489815d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:26.775371 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 284/640] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:36:25 2022] POST /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4/action => generated 0 bytes in 1240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:36:26.776014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c09ef63b-4c51-4b14-baf4-7b4fa489815d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:26.783075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c09ef63b-4c51-4b14-baf4-7b4fa489815d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:26.784090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c09ef63b-4c51-4b14-baf4-7b4fa489815d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:26.784946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c09ef63b-4c51-4b14-baf4-7b4fa489815d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:26.785502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c09ef63b-4c51-4b14-baf4-7b4fa489815d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:26.898326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dea65f51-1a1f-4830-b254-c9263e15e5e0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:26.899344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dea65f51-1a1f-4830-b254-c9263e15e5e0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:26.909083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dea65f51-1a1f-4830-b254-c9263e15e5e0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:26.910286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dea65f51-1a1f-4830-b254-c9263e15e5e0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:26.914389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dea65f51-1a1f-4830-b254-c9263e15e5e0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:26.914389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dea65f51-1a1f-4830-b254-c9263e15e5e0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:27.160112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:27.190522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c09ef63b-4c51-4b14-baf4-7b4fa489815d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:27.203394 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c09ef63b-4c51-4b14-baf4-7b4fa489815d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1470 microversion: 2.1 time: 0.432854 May 28 04:36:27.204971 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 357/641] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:26 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1470 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:27.211552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ddfdb427-aedc-4eea-a0b1-c8e75d48de3c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:27.216831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ddfdb427-aedc-4eea-a0b1-c8e75d48de3c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:27.230391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddfdb427-aedc-4eea-a0b1-c8e75d48de3c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:27.231648 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddfdb427-aedc-4eea-a0b1-c8e75d48de3c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:27.234061 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddfdb427-aedc-4eea-a0b1-c8e75d48de3c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:27.235916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddfdb427-aedc-4eea-a0b1-c8e75d48de3c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:27.390099 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dea65f51-1a1f-4830-b254-c9263e15e5e0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:27.410005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dea65f51-1a1f-4830-b254-c9263e15e5e0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:27.414336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dea65f51-1a1f-4830-b254-c9263e15e5e0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:27.415560 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dea65f51-1a1f-4830-b254-c9263e15e5e0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1361 microversion: 2.25 time: 0.524592 May 28 04:36:27.421807 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 285/642] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:26 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1361 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:36:27.439322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-22b7904d-01a7-4542-9caa-a9e5847d09d0 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:27.446278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-22b7904d-01a7-4542-9caa-a9e5847d09d0 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] [instance: f495e0b2-28af-4f3d-9b5f-753ab641593a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:27.461223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22b7904d-01a7-4542-9caa-a9e5847d09d0 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:27.467273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22b7904d-01a7-4542-9caa-a9e5847d09d0 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:27.469317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22b7904d-01a7-4542-9caa-a9e5847d09d0 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:27.471415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22b7904d-01a7-4542-9caa-a9e5847d09d0 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:27.486051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ddfdb427-aedc-4eea-a0b1-c8e75d48de3c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:27.499227 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ddfdb427-aedc-4eea-a0b1-c8e75d48de3c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1214 microversion: 2.1 time: 0.290891 May 28 04:36:27.511616 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 358/643] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:27 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1214 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:27.523864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1618ffac-183e-476c-9929-9649ac106409 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e45e50>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:27.619668 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1618ffac-183e-476c-9929-9649ac106409 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1453 microversion: 2.1 time: 0.105345 May 28 04:36:27.620586 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 359/644] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:27 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1453 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:27.628760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b69f9b73-a24c-4963-92fa-e2f3fd43c5b3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:27.635916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b69f9b73-a24c-4963-92fa-e2f3fd43c5b3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:27.660487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b69f9b73-a24c-4963-92fa-e2f3fd43c5b3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:27.661347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b69f9b73-a24c-4963-92fa-e2f3fd43c5b3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:27.663060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b69f9b73-a24c-4963-92fa-e2f3fd43c5b3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:27.664836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b69f9b73-a24c-4963-92fa-e2f3fd43c5b3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:27.677488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-22b7904d-01a7-4542-9caa-a9e5847d09d0 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3db75ca2004d7db34b1717680c3146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2225e50831e54c9093339163d35e690d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:27.678483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:27.693378 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-22b7904d-01a7-4542-9caa-a9e5847d09d0 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] 10.222.0.58 "GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a" status: 200 len: 1293 microversion: 2.1 time: 0.264943 May 28 04:36:27.708538 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 286/645] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:27 2022] GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a => generated 1293 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:27.723686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aa90ec1a-9275-4a3f-85f0-881d80383ee6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:27.725779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-aa90ec1a-9275-4a3f-85f0-881d80383ee6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:27.749413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa90ec1a-9275-4a3f-85f0-881d80383ee6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:27.751028 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa90ec1a-9275-4a3f-85f0-881d80383ee6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:27.752046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa90ec1a-9275-4a3f-85f0-881d80383ee6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:27.752928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa90ec1a-9275-4a3f-85f0-881d80383ee6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:27.872961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-aa90ec1a-9275-4a3f-85f0-881d80383ee6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:27.886157 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aa90ec1a-9275-4a3f-85f0-881d80383ee6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8" status: 200 len: 1319 microversion: 2.1 time: 0.176375 May 28 04:36:27.886752 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 287/646] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:27 2022] GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:28.020466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b69f9b73-a24c-4963-92fa-e2f3fd43c5b3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:28.028034 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b69f9b73-a24c-4963-92fa-e2f3fd43c5b3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1504 microversion: 2.1 time: 0.406289 May 28 04:36:28.040184 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 360/647] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:27 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1504 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:28.227551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d43a24d5-c552-478d-ac57-463bc1bc9e69 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:28.228203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d43a24d5-c552-478d-ac57-463bc1bc9e69 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:28.235018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d43a24d5-c552-478d-ac57-463bc1bc9e69 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:28.236311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d43a24d5-c552-478d-ac57-463bc1bc9e69 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:28.237802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d43a24d5-c552-478d-ac57-463bc1bc9e69 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:28.238448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d43a24d5-c552-478d-ac57-463bc1bc9e69 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:28.438130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fe9bb4bd-3ed6-4258-a034-c4559e900e98 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:28.438767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fe9bb4bd-3ed6-4258-a034-c4559e900e98 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:28.451150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe9bb4bd-3ed6-4258-a034-c4559e900e98 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:28.451632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe9bb4bd-3ed6-4258-a034-c4559e900e98 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:28.452395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe9bb4bd-3ed6-4258-a034-c4559e900e98 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:28.452834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe9bb4bd-3ed6-4258-a034-c4559e900e98 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:29.089179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fe9bb4bd-3ed6-4258-a034-c4559e900e98 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:29.102145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fe9bb4bd-3ed6-4258-a034-c4559e900e98 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:29.102145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fe9bb4bd-3ed6-4258-a034-c4559e900e98 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:29.107545 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fe9bb4bd-3ed6-4258-a034-c4559e900e98 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1361 microversion: 2.25 time: 0.673180 May 28 04:36:29.109848 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 361/648] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:28 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1361 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:29.155641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1fd2b4a1-7fe4-4e8c-8ee1-10871e79dd75 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:29.156848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1fd2b4a1-7fe4-4e8c-8ee1-10871e79dd75 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:29.181101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fd2b4a1-7fe4-4e8c-8ee1-10871e79dd75 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:29.186734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fd2b4a1-7fe4-4e8c-8ee1-10871e79dd75 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:29.186734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fd2b4a1-7fe4-4e8c-8ee1-10871e79dd75 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:29.186734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fd2b4a1-7fe4-4e8c-8ee1-10871e79dd75 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:29.372308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1fd2b4a1-7fe4-4e8c-8ee1-10871e79dd75 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:29.385639 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1fd2b4a1-7fe4-4e8c-8ee1-10871e79dd75 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1278 microversion: 2.1 time: 0.248003 May 28 04:36:29.386464 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 362/649] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:29 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1278 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:29.391849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3217ba16-55f6-477d-9468-5fb97da03ad3 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f01160>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:29.448420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d43a24d5-c552-478d-ac57-463bc1bc9e69 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:29.456468 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d43a24d5-c552-478d-ac57-463bc1bc9e69 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1470 microversion: 2.1 time: 1.232867 May 28 04:36:29.461719 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3217ba16-55f6-477d-9468-5fb97da03ad3 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1462 microversion: 2.1 time: 0.073789 May 28 04:36:29.463842 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 288/650] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:28 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1470 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:29.467113 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 363/651] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:29 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1462 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:29.470210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6f6eadc2-3bb8-4305-8dd6-28d9481496ee tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:29.473618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6f6eadc2-3bb8-4305-8dd6-28d9481496ee tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] [instance: f495e0b2-28af-4f3d-9b5f-753ab641593a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:29.480978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3fcee1cd-fa7c-41bc-94ad-160dfbee06eb tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:29.481753 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3fcee1cd-fa7c-41bc-94ad-160dfbee06eb tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:29.489789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f6eadc2-3bb8-4305-8dd6-28d9481496ee tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:29.490620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f6eadc2-3bb8-4305-8dd6-28d9481496ee tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:29.492789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3fcee1cd-fa7c-41bc-94ad-160dfbee06eb tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:29.493353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3fcee1cd-fa7c-41bc-94ad-160dfbee06eb tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:29.493949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f6eadc2-3bb8-4305-8dd6-28d9481496ee tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:29.494330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3fcee1cd-fa7c-41bc-94ad-160dfbee06eb tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:29.495017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3fcee1cd-fa7c-41bc-94ad-160dfbee06eb tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:29.495553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f6eadc2-3bb8-4305-8dd6-28d9481496ee tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:29.640733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6f6eadc2-3bb8-4305-8dd6-28d9481496ee tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3db75ca2004d7db34b1717680c3146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2225e50831e54c9093339163d35e690d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:29.649760 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6f6eadc2-3bb8-4305-8dd6-28d9481496ee tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] 10.222.0.58 "GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a" status: 200 len: 1281 microversion: 2.1 time: 0.184592 May 28 04:36:29.659859 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 289/652] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:29 2022] GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a => generated 1281 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:29.659859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a82a594f-8491-4336-8b1b-a353222c702f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:29.659859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a82a594f-8491-4336-8b1b-a353222c702f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:29.662630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a82a594f-8491-4336-8b1b-a353222c702f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:29.663119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a82a594f-8491-4336-8b1b-a353222c702f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:29.664266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a82a594f-8491-4336-8b1b-a353222c702f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:29.664759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a82a594f-8491-4336-8b1b-a353222c702f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:29.873359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3fcee1cd-fa7c-41bc-94ad-160dfbee06eb tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:29.883624 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3fcee1cd-fa7c-41bc-94ad-160dfbee06eb tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8" status: 200 len: 1386 microversion: 2.1 time: 0.415196 May 28 04:36:29.893318 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 364/653] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:29 2022] GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 => generated 1386 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:30.040541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a82a594f-8491-4336-8b1b-a353222c702f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:30.042594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-198c99d1-b873-4cc6-956a-5c44dd650a39 tempest-InstanceUsageAuditLogTestJSON-1031392890 tempest-InstanceUsageAuditLogTestJSON-1031392890-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:30.043776 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:36:30.043776 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:36:30.057297 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a82a594f-8491-4336-8b1b-a353222c702f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1504 microversion: 2.1 time: 0.405886 May 28 04:36:30.057887 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 290/654] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:29 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1504 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:30.063645 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-198c99d1-b873-4cc6-956a-5c44dd650a39 tempest-InstanceUsageAuditLogTestJSON-1031392890 tempest-InstanceUsageAuditLogTestJSON-1031392890-project-admin] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log/2022-05-28 04:36:29" status: 200 len: 318 microversion: 2.1 time: 0.177640 May 28 04:36:30.064340 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 365/655] 10.222.0.58 () {58 vars in 1250 bytes} [Sat May 28 04:36:29 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-05-28%2004%3A36%3A29 => generated 318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:30.070327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2612f48c-c77c-4835-9e10-12b6c92e35c3 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e30160>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:30.084084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-c6874ea3-c7ad-4b99-8131-83f6f1282e2d req-9a2a93d1-eb6f-4917-8323-92a1f14591fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c86c50-5759-4619-9f17-a61d7452a6e8", "tag": "ccd10a3b-275c-471d-bbc8-932e66f9e657"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:30.096881 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c6874ea3-c7ad-4b99-8131-83f6f1282e2d req-9a2a93d1-eb6f-4917-8323-92a1f14591fe service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:30.097410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c6874ea3-c7ad-4b99-8131-83f6f1282e2d req-9a2a93d1-eb6f-4917-8323-92a1f14591fe service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:30.130400 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2612f48c-c77c-4835-9e10-12b6c92e35c3 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 200 len: 1462 microversion: 2.1 time: 0.071319 May 28 04:36:30.134561 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-c6874ea3-c7ad-4b99-8131-83f6f1282e2d req-9a2a93d1-eb6f-4917-8323-92a1f14591fe service nova] Creating event network-changed:ccd10a3b-275c-471d-bbc8-932e66f9e657 for instance 88c86c50-5759-4619-9f17-a61d7452a6e8 on n-h1-843700-1 May 28 04:36:30.137670 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 291/656] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:30 2022] GET /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 1462 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:30.144180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b23af58b-ae23-4572-b603-f4a6e76645ea tempest-InstanceUsageAuditLogTestJSON-1031392890 tempest-InstanceUsageAuditLogTestJSON-1031392890-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:30.148279 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:36:30.148279 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:36:30.161150 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-c6874ea3-c7ad-4b99-8131-83f6f1282e2d req-9a2a93d1-eb6f-4917-8323-92a1f14591fe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095583 May 28 04:36:30.164129 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 366/657] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:30.174104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9efe431a-81dd-4718-8fc3-69f4bb1619de tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:30.181296 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b23af58b-ae23-4572-b603-f4a6e76645ea tempest-InstanceUsageAuditLogTestJSON-1031392890 tempest-InstanceUsageAuditLogTestJSON-1031392890-project-admin] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.041980 May 28 04:36:30.189139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9efe431a-81dd-4718-8fc3-69f4bb1619de tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:30.190021 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 292/658] 10.222.0.58 () {58 vars in 1184 bytes} [Sat May 28 04:36:30 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:30.196543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b7df63aa-c8a2-442c-a72a-3e8cde11a248 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:30.197491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b7df63aa-c8a2-442c-a72a-3e8cde11a248 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:30.201496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9efe431a-81dd-4718-8fc3-69f4bb1619de tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:30.205782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9efe431a-81dd-4718-8fc3-69f4bb1619de tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:30.205782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9efe431a-81dd-4718-8fc3-69f4bb1619de tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:30.205782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9efe431a-81dd-4718-8fc3-69f4bb1619de tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:30.206515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7df63aa-c8a2-442c-a72a-3e8cde11a248 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:30.207267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7df63aa-c8a2-442c-a72a-3e8cde11a248 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:30.208187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7df63aa-c8a2-442c-a72a-3e8cde11a248 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:30.209871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7df63aa-c8a2-442c-a72a-3e8cde11a248 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:30.612961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b7df63aa-c8a2-442c-a72a-3e8cde11a248 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:30.615673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9efe431a-81dd-4718-8fc3-69f4bb1619de tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:30.623887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9efe431a-81dd-4718-8fc3-69f4bb1619de tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:30.625411 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9efe431a-81dd-4718-8fc3-69f4bb1619de tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:30.626279 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b7df63aa-c8a2-442c-a72a-3e8cde11a248 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 1466 microversion: 2.1 time: 0.435054 May 28 04:36:30.626526 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9efe431a-81dd-4718-8fc3-69f4bb1619de tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1361 microversion: 2.25 time: 0.459232 May 28 04:36:30.627160 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 367/659] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:30 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1361 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:30.627713 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 293/660] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:30 2022] GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 1466 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:30.632615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d1437a0e-569f-4189-adb2-e63cc4525973 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:30.633160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ecbacd6e-f435-42ed-bc47-d17f6e18b081 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:30.633289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d1437a0e-569f-4189-adb2-e63cc4525973 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:30.634389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ecbacd6e-f435-42ed-bc47-d17f6e18b081 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:30.642807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d1437a0e-569f-4189-adb2-e63cc4525973 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:30.643281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d1437a0e-569f-4189-adb2-e63cc4525973 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:30.644227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d1437a0e-569f-4189-adb2-e63cc4525973 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:30.644459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecbacd6e-f435-42ed-bc47-d17f6e18b081 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:30.644849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d1437a0e-569f-4189-adb2-e63cc4525973 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:30.645390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecbacd6e-f435-42ed-bc47-d17f6e18b081 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:30.646275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecbacd6e-f435-42ed-bc47-d17f6e18b081 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:30.647081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecbacd6e-f435-42ed-bc47-d17f6e18b081 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:30.788246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d1437a0e-569f-4189-adb2-e63cc4525973 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:30.820512 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d1437a0e-569f-4189-adb2-e63cc4525973 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1276 microversion: 2.1 time: 0.190404 May 28 04:36:30.821602 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 368/661] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:30 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1276 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:30.828167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d90107a9-ecc6-4239-8b7c-ad31798b9f36 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-720007623"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:30.829522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d90107a9-ecc6-4239-8b7c-ad31798b9f36 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: a27b8082-4f44-4263-a6a2-86291ea3950b] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:30.841390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d90107a9-ecc6-4239-8b7c-ad31798b9f36 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:30.843033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d90107a9-ecc6-4239-8b7c-ad31798b9f36 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:30.848583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d90107a9-ecc6-4239-8b7c-ad31798b9f36 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:30.848583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d90107a9-ecc6-4239-8b7c-ad31798b9f36 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:30.951120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ecbacd6e-f435-42ed-bc47-d17f6e18b081 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:30.959444 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ecbacd6e-f435-42ed-bc47-d17f6e18b081 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1470 microversion: 2.1 time: 0.330201 May 28 04:36:30.966662 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 294/662] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:30 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1470 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:30.977366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-de93c9cd-921d-44dc-ab7e-6239b88a94ca tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:30.980222 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-de93c9cd-921d-44dc-ab7e-6239b88a94ca tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] [instance: f495e0b2-28af-4f3d-9b5f-753ab641593a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:31.012897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de93c9cd-921d-44dc-ab7e-6239b88a94ca tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:31.013355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de93c9cd-921d-44dc-ab7e-6239b88a94ca tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:31.014144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de93c9cd-921d-44dc-ab7e-6239b88a94ca tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:31.014576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de93c9cd-921d-44dc-ab7e-6239b88a94ca tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:31.518851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-de93c9cd-921d-44dc-ab7e-6239b88a94ca tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3db75ca2004d7db34b1717680c3146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2225e50831e54c9093339163d35e690d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:31.527611 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-de93c9cd-921d-44dc-ab7e-6239b88a94ca tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] 10.222.0.58 "GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a" status: 200 len: 1323 microversion: 2.1 time: 0.559495 May 28 04:36:31.528223 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 295/663] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:30 2022] GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a => generated 1323 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:31.533377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-76195a9b-1a05-4325-b662-b332e96fb8d1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:31.534189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-76195a9b-1a05-4325-b662-b332e96fb8d1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:31.541639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76195a9b-1a05-4325-b662-b332e96fb8d1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:31.542368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76195a9b-1a05-4325-b662-b332e96fb8d1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:31.543937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76195a9b-1a05-4325-b662-b332e96fb8d1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:31.544382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76195a9b-1a05-4325-b662-b332e96fb8d1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:31.598577 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d90107a9-ecc6-4239-8b7c-ad31798b9f36 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "POST /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b/action" status: 202 len: 0 microversion: 2.1 time: 0.775245 May 28 04:36:31.599608 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 369/664] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:36:30 2022] POST /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b/action => generated 0 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 04:36:31.618847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4b37320d-a50e-4bc5-9538-a6046f5b8f19 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:31.623188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4b37320d-a50e-4bc5-9538-a6046f5b8f19 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:31.640990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4b37320d-a50e-4bc5-9538-a6046f5b8f19 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:31.641450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4b37320d-a50e-4bc5-9538-a6046f5b8f19 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:31.642238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4b37320d-a50e-4bc5-9538-a6046f5b8f19 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:31.642726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4b37320d-a50e-4bc5-9538-a6046f5b8f19 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:31.889214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-76195a9b-1a05-4325-b662-b332e96fb8d1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:31.907567 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-76195a9b-1a05-4325-b662-b332e96fb8d1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8" status: 200 len: 1386 microversion: 2.1 time: 0.377852 May 28 04:36:31.918982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4b37320d-a50e-4bc5-9538-a6046f5b8f19 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:31.922070 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 296/665] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:31 2022] GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 => generated 1386 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:31.925999 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4b37320d-a50e-4bc5-9538-a6046f5b8f19 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1479 microversion: 2.1 time: 0.321126 May 28 04:36:31.927138 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 370/666] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:31 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1479 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:31.929405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6b1cdbb4-7327-48bd-adc6-778e79c3ea99 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e44f70>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:31.938274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4516c10e-9937-4a9d-9675-7e9102834e7c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:31.947975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4516c10e-9937-4a9d-9675-7e9102834e7c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:31.957730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4516c10e-9937-4a9d-9675-7e9102834e7c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:31.958352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4516c10e-9937-4a9d-9675-7e9102834e7c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:31.959129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4516c10e-9937-4a9d-9675-7e9102834e7c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:31.959578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4516c10e-9937-4a9d-9675-7e9102834e7c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:31.988122 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6b1cdbb4-7327-48bd-adc6-778e79c3ea99 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23" status: 200 len: 1452 microversion: 2.1 time: 0.064047 May 28 04:36:31.989279 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 297/667] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:31 2022] GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23 => generated 1452 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:31.995957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-928b8fb1-5ab2-4410-aed6-82cd525872c3 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:31.999524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-928b8fb1-5ab2-4410-aed6-82cd525872c3 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:32.004525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-928b8fb1-5ab2-4410-aed6-82cd525872c3 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:32.005344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-928b8fb1-5ab2-4410-aed6-82cd525872c3 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:32.006338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-928b8fb1-5ab2-4410-aed6-82cd525872c3 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:32.007010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-928b8fb1-5ab2-4410-aed6-82cd525872c3 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:32.347004 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4516c10e-9937-4a9d-9675-7e9102834e7c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:32.360291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-928b8fb1-5ab2-4410-aed6-82cd525872c3 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:32.377042 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-928b8fb1-5ab2-4410-aed6-82cd525872c3 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1318 microversion: 2.1 time: 0.384963 May 28 04:36:32.378172 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 298/668] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:31 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:32.378435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4516c10e-9937-4a9d-9675-7e9102834e7c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:32.380808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4516c10e-9937-4a9d-9675-7e9102834e7c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:32.386956 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4516c10e-9937-4a9d-9675-7e9102834e7c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1361 microversion: 2.25 time: 0.457801 May 28 04:36:32.388800 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 371/669] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:31 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1361 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:32.393939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2982170f-c699-4ff4-b84e-dd28cfe768f2 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '.version_select at 0x7f7701e44160>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:32.405609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6f7dc82e-d946-4788-aab1-a586556b1a04 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:32.406526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2982170f-c699-4ff4-b84e-dd28cfe768f2 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:32.407804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2982170f-c699-4ff4-b84e-dd28cfe768f2 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:32.410829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6f7dc82e-d946-4788-aab1-a586556b1a04 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:32.430485 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2982170f-c699-4ff4-b84e-dd28cfe768f2 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1572 microversion: 2.1 time: 0.047828 May 28 04:36:32.431866 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 299/670] 10.222.0.58 () {58 vars in 1142 bytes} [Sat May 28 04:36:32 2022] GET /compute/v2.1/os-migrations => generated 1572 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:32.435599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f7dc82e-d946-4788-aab1-a586556b1a04 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:32.443085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f7dc82e-d946-4788-aab1-a586556b1a04 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:32.446113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f7dc82e-d946-4788-aab1-a586556b1a04 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:32.446875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f7dc82e-d946-4788-aab1-a586556b1a04 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:32.448457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e9828b75-b4f4-49ee-84eb-8caac3155e3c tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:32.451164 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e9828b75-b4f4-49ee-84eb-8caac3155e3c tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:32.465427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9828b75-b4f4-49ee-84eb-8caac3155e3c tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:32.466600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9828b75-b4f4-49ee-84eb-8caac3155e3c tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:32.469551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9828b75-b4f4-49ee-84eb-8caac3155e3c tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:32.469551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9828b75-b4f4-49ee-84eb-8caac3155e3c tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:33.016155 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6f7dc82e-d946-4788-aab1-a586556b1a04 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:33.031810 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6f7dc82e-d946-4788-aab1-a586556b1a04 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1470 microversion: 2.1 time: 0.641182 May 28 04:36:33.032008 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 372/671] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:32 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1470 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:33.045047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-84311d08-efff-4c7b-aeb3-657035b6838d tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:33.046506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-84311d08-efff-4c7b-aeb3-657035b6838d tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] [instance: f495e0b2-28af-4f3d-9b5f-753ab641593a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:33.081566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84311d08-efff-4c7b-aeb3-657035b6838d tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:33.082032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84311d08-efff-4c7b-aeb3-657035b6838d tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:33.082849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84311d08-efff-4c7b-aeb3-657035b6838d tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:33.089929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84311d08-efff-4c7b-aeb3-657035b6838d tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:33.279029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:33.288005 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e9828b75-b4f4-49ee-84eb-8caac3155e3c tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1630 microversion: 2.1 time: 0.844432 May 28 04:36:33.289853 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 300/672] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:32 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1630 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:33.305240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-567bbb07-8d21-4897-94fa-3082466e8804 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:33.307356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-567bbb07-8d21-4897-94fa-3082466e8804 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:33.345246 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-567bbb07-8d21-4897-94fa-3082466e8804 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:33.347211 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-567bbb07-8d21-4897-94fa-3082466e8804 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:33.353214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-567bbb07-8d21-4897-94fa-3082466e8804 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:33.353214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-567bbb07-8d21-4897-94fa-3082466e8804 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:33.757489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-567bbb07-8d21-4897-94fa-3082466e8804 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:33.767961 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-567bbb07-8d21-4897-94fa-3082466e8804 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8" status: 200 len: 1386 microversion: 2.1 time: 0.475300 May 28 04:36:33.768909 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 301/673] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:33 2022] GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 => generated 1386 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:33.777419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-da36792a-3fcf-4ff5-a9d5-476d9b2a28d1 req-ca7490b2-91c5-43a9-a539-1e5edd855d95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f495e0b2-28af-4f3d-9b5f-753ab641593a", "tag": "d926dd56-bda0-43cd-aca5-9afdabc87550"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:33.782980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-84311d08-efff-4c7b-aeb3-657035b6838d tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3db75ca2004d7db34b1717680c3146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2225e50831e54c9093339163d35e690d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:33.787033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-da36792a-3fcf-4ff5-a9d5-476d9b2a28d1 req-ca7490b2-91c5-43a9-a539-1e5edd855d95 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:33.787470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-da36792a-3fcf-4ff5-a9d5-476d9b2a28d1 req-ca7490b2-91c5-43a9-a539-1e5edd855d95 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:33.793553 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-84311d08-efff-4c7b-aeb3-657035b6838d tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] 10.222.0.58 "GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a" status: 200 len: 1323 microversion: 2.1 time: 0.760517 May 28 04:36:33.807874 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 373/674] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:33 2022] GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a => generated 1323 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:33.812273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1999ea4b-1a83-4112-a2ae-493e240d008b tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f018b0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:33.879258 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1999ea4b-1a83-4112-a2ae-493e240d008b tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23" status: 200 len: 1452 microversion: 2.1 time: 0.081331 May 28 04:36:33.880607 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 374/675] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:33 2022] GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23 => generated 1452 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:33.888864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-6335d4cd-e140-4488-a039-1ecf74abe8f1 req-bad2d671-ce73-4447-ba64-0e1deef1858f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89406e18-7fa9-41e4-9fe8-34ce8a7255cf", "tag": "a8602bdf-b159-4e10-9f57-681347e49a0b"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:33.899842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-6335d4cd-e140-4488-a039-1ecf74abe8f1 req-bad2d671-ce73-4447-ba64-0e1deef1858f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:33.900651 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-6335d4cd-e140-4488-a039-1ecf74abe8f1 req-bad2d671-ce73-4447-ba64-0e1deef1858f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:33.921516 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-6335d4cd-e140-4488-a039-1ecf74abe8f1 req-bad2d671-ce73-4447-ba64-0e1deef1858f service nova] Creating event network-changed:a8602bdf-b159-4e10-9f57-681347e49a0b for instance 89406e18-7fa9-41e4-9fe8-34ce8a7255cf on n-h2-843700-1 May 28 04:36:33.929359 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-6335d4cd-e140-4488-a039-1ecf74abe8f1 req-bad2d671-ce73-4447-ba64-0e1deef1858f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047212 May 28 04:36:33.930649 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 375/676] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:33.936971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-f1f52a9b-7778-44f8-bb96-8b7342b093cd req-05f7193f-64dc-4e67-8832-3c7a541eeeda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64917b4-0e1c-4354-b5e5-e2925b14a602", "name": "network-vif-plugged", "status": "completed", "tag": "de60a199-e862-4d4b-a623-cea20acebfcd"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:33.948299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f1f52a9b-7778-44f8-bb96-8b7342b093cd req-05f7193f-64dc-4e67-8832-3c7a541eeeda service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:33.949065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f1f52a9b-7778-44f8-bb96-8b7342b093cd req-05f7193f-64dc-4e67-8832-3c7a541eeeda service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:33.977041 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-f1f52a9b-7778-44f8-bb96-8b7342b093cd req-05f7193f-64dc-4e67-8832-3c7a541eeeda service nova] Creating event network-vif-plugged:de60a199-e862-4d4b-a623-cea20acebfcd for instance f64917b4-0e1c-4354-b5e5-e2925b14a602 on n-h2-843700-1 May 28 04:36:33.986910 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-da36792a-3fcf-4ff5-a9d5-476d9b2a28d1 req-ca7490b2-91c5-43a9-a539-1e5edd855d95 service nova] Creating event network-changed:d926dd56-bda0-43cd-aca5-9afdabc87550 for instance f495e0b2-28af-4f3d-9b5f-753ab641593a on n-h1-843700-1 May 28 04:36:33.988854 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-f1f52a9b-7778-44f8-bb96-8b7342b093cd req-05f7193f-64dc-4e67-8832-3c7a541eeeda service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056581 May 28 04:36:33.994038 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-da36792a-3fcf-4ff5-a9d5-476d9b2a28d1 req-ca7490b2-91c5-43a9-a539-1e5edd855d95 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221587 May 28 04:36:33.994168 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 376/677] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:33.994251 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 302/678] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:33.998498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0acbd2c0-8aff-4d3f-bb9f-a0e6bfb48213 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:33.999448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0acbd2c0-8aff-4d3f-bb9f-a0e6bfb48213 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:34.007278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0acbd2c0-8aff-4d3f-bb9f-a0e6bfb48213 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:34.007915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0acbd2c0-8aff-4d3f-bb9f-a0e6bfb48213 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:34.008912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0acbd2c0-8aff-4d3f-bb9f-a0e6bfb48213 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:34.009503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0acbd2c0-8aff-4d3f-bb9f-a0e6bfb48213 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:34.010114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6791b3ca-f300-42f7-a5a9-e69ff7610fa5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:34.013598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6791b3ca-f300-42f7-a5a9-e69ff7610fa5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:34.037359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6791b3ca-f300-42f7-a5a9-e69ff7610fa5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:34.038106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6791b3ca-f300-42f7-a5a9-e69ff7610fa5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:34.038663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6791b3ca-f300-42f7-a5a9-e69ff7610fa5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:34.039233 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6791b3ca-f300-42f7-a5a9-e69ff7610fa5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:34.122884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:34.353210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6791b3ca-f300-42f7-a5a9-e69ff7610fa5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:34.362424 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6791b3ca-f300-42f7-a5a9-e69ff7610fa5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1318 microversion: 2.1 time: 0.367874 May 28 04:36:34.363301 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 377/679] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:33 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:34.368050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8024354a-3bb6-4bbe-bab9-64eeec4016cf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1953202944", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "68123182-7714-4432-8648-5b70eb3b9ead"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:34.371384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0acbd2c0-8aff-4d3f-bb9f-a0e6bfb48213 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:34.380168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0acbd2c0-8aff-4d3f-bb9f-a0e6bfb48213 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:34.381662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0acbd2c0-8aff-4d3f-bb9f-a0e6bfb48213 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:34.382769 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0acbd2c0-8aff-4d3f-bb9f-a0e6bfb48213 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1361 microversion: 2.25 time: 0.388901 May 28 04:36:34.383355 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 303/680] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:33 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1361 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:34.388581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a4d934df-3216-46b0-8b23-2ce90f28622f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:34.388581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a4d934df-3216-46b0-8b23-2ce90f28622f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:34.394304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4d934df-3216-46b0-8b23-2ce90f28622f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:34.394754 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4d934df-3216-46b0-8b23-2ce90f28622f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:34.395709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4d934df-3216-46b0-8b23-2ce90f28622f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:34.396142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4d934df-3216-46b0-8b23-2ce90f28622f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:34.426404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-8024354a-3bb6-4bbe-bab9-64eeec4016cf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] validate_networks() for [('68123182-7714-4432-8648-5b70eb3b9ead', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:36:34.628993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a4d934df-3216-46b0-8b23-2ce90f28622f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:34.636547 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a4d934df-3216-46b0-8b23-2ce90f28622f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1475 microversion: 2.1 time: 0.252246 May 28 04:36:34.637306 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 304/681] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:34 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1475 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:34.786380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6f3c3b2a-a967-4aac-99a7-766f7136f4d2 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:34.787226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6f3c3b2a-a967-4aac-99a7-766f7136f4d2 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:34.793560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f3c3b2a-a967-4aac-99a7-766f7136f4d2 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:34.794097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f3c3b2a-a967-4aac-99a7-766f7136f4d2 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:34.794968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f3c3b2a-a967-4aac-99a7-766f7136f4d2 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:34.795503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f3c3b2a-a967-4aac-99a7-766f7136f4d2 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:34.933103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-8024354a-3bb6-4bbe-bab9-64eeec4016cf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:36:34.933955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-8024354a-3bb6-4bbe-bab9-64eeec4016cf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:36:34.934785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-8024354a-3bb6-4bbe-bab9-64eeec4016cf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:36:34.935324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-8024354a-3bb6-4bbe-bab9-64eeec4016cf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:36:34.936355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-8024354a-3bb6-4bbe-bab9-64eeec4016cf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:36:34.949371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8024354a-3bb6-4bbe-bab9-64eeec4016cf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:34.950070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8024354a-3bb6-4bbe-bab9-64eeec4016cf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:34.951404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8024354a-3bb6-4bbe-bab9-64eeec4016cf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:34.952193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8024354a-3bb6-4bbe-bab9-64eeec4016cf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:34.979374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-8024354a-3bb6-4bbe-bab9-64eeec4016cf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Getting quotas for project d908671a46484d2082cc88a1d2c93f98. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:36:34.986002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-8024354a-3bb6-4bbe-bab9-64eeec4016cf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Getting quotas for user da8fff3851eb4ecc927400c09117f5ee and project d908671a46484d2082cc88a1d2c93f98. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:36:34.998432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6f3c3b2a-a967-4aac-99a7-766f7136f4d2 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:35.000740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8024354a-3bb6-4bbe-bab9-64eeec4016cf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:36:35.004309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8024354a-3bb6-4bbe-bab9-64eeec4016cf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:36:35.008830 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6f3c3b2a-a967-4aac-99a7-766f7136f4d2 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8" status: 200 len: 1386 microversion: 2.1 time: 0.227304 May 28 04:36:35.019334 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 305/682] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:34 2022] GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 => generated 1386 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:35.024194 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-605b81c2-5c9c-45e8-9578-75f643bf9d3f tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:35.024881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-605b81c2-5c9c-45e8-9578-75f643bf9d3f tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] [instance: f495e0b2-28af-4f3d-9b5f-753ab641593a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:35.040362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-605b81c2-5c9c-45e8-9578-75f643bf9d3f tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:35.041801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-605b81c2-5c9c-45e8-9578-75f643bf9d3f tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:35.042803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-605b81c2-5c9c-45e8-9578-75f643bf9d3f tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:35.043495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-605b81c2-5c9c-45e8-9578-75f643bf9d3f tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:35.116513 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8024354a-3bb6-4bbe-bab9-64eeec4016cf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.752163 May 28 04:36:35.118188 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 378/683] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:36:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:36:35.123576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8d7d22af-19b8-4bc9-9f6c-ba16f0604d59 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701dfcaf0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:35.193842 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8d7d22af-19b8-4bc9-9f6c-ba16f0604d59 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23" status: 200 len: 1452 microversion: 2.1 time: 0.073848 May 28 04:36:35.194871 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 379/684] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:35 2022] GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23 => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:35.201194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8b75863f-aedb-4b0b-a168-ceef690c6388 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:35.202442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8b75863f-aedb-4b0b-a168-ceef690c6388 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:35.266594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8b75863f-aedb-4b0b-a168-ceef690c6388 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:35.276434 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8b75863f-aedb-4b0b-a168-ceef690c6388 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1211 microversion: 2.1 time: 0.080402 May 28 04:36:35.277281 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 380/685] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:35 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:35.331651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-605b81c2-5c9c-45e8-9578-75f643bf9d3f tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3db75ca2004d7db34b1717680c3146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2225e50831e54c9093339163d35e690d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:35.341688 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-605b81c2-5c9c-45e8-9578-75f643bf9d3f tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] 10.222.0.58 "GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a" status: 200 len: 1323 microversion: 2.1 time: 0.321102 May 28 04:36:35.346704 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 306/686] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:35 2022] GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a => generated 1323 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:35.379873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a1b0e49e-27fa-495b-b48a-1f203b50db7a tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:35.380699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a1b0e49e-27fa-495b-b48a-1f203b50db7a tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:35.389256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1b0e49e-27fa-495b-b48a-1f203b50db7a tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:35.391895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1b0e49e-27fa-495b-b48a-1f203b50db7a tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:35.393528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1b0e49e-27fa-495b-b48a-1f203b50db7a tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:35.394288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1b0e49e-27fa-495b-b48a-1f203b50db7a tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:35.405853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-076807a9-2a1f-4ba6-81a6-2c1ef5b7da3e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:35.408109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-076807a9-2a1f-4ba6-81a6-2c1ef5b7da3e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:35.423438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-076807a9-2a1f-4ba6-81a6-2c1ef5b7da3e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:35.424674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-076807a9-2a1f-4ba6-81a6-2c1ef5b7da3e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:35.427680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-076807a9-2a1f-4ba6-81a6-2c1ef5b7da3e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:35.429520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-076807a9-2a1f-4ba6-81a6-2c1ef5b7da3e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:35.709888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a1b0e49e-27fa-495b-b48a-1f203b50db7a tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:35.735237 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a1b0e49e-27fa-495b-b48a-1f203b50db7a tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1318 microversion: 2.1 time: 0.359667 May 28 04:36:35.747966 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 381/687] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:35 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:35.748651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-076807a9-2a1f-4ba6-81a6-2c1ef5b7da3e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:35.753611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-076807a9-2a1f-4ba6-81a6-2c1ef5b7da3e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:35.755282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-076807a9-2a1f-4ba6-81a6-2c1ef5b7da3e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:35.757363 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-076807a9-2a1f-4ba6-81a6-2c1ef5b7da3e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1361 microversion: 2.25 time: 0.356367 May 28 04:36:35.758782 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 307/688] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:35 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1361 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:35.759571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0332f482-9cc2-4b2d-b956-3f18612b5b6a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:35.760207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0332f482-9cc2-4b2d-b956-3f18612b5b6a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:35.766362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0332f482-9cc2-4b2d-b956-3f18612b5b6a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:35.766818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0332f482-9cc2-4b2d-b956-3f18612b5b6a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:35.767808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0332f482-9cc2-4b2d-b956-3f18612b5b6a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:35.768437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0332f482-9cc2-4b2d-b956-3f18612b5b6a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:35.992943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0332f482-9cc2-4b2d-b956-3f18612b5b6a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:36.006767 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0332f482-9cc2-4b2d-b956-3f18612b5b6a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1475 microversion: 2.1 time: 0.262694 May 28 04:36:36.007429 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 382/689] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:35 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1475 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:36.025809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9d3915e8-c1ff-4611-a581-056ecbd712e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:36.026589 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9d3915e8-c1ff-4611-a581-056ecbd712e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:36.031672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-045d2764-52dd-4dde-9dcb-e1778b3f8e6f req-cf0362d8-390f-48ff-b021-164c5690cb36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0d40b8-3a01-421f-84fe-b94732c1f667", "name": "network-vif-unplugged", "status": "completed", "tag": "9c5d3b07-270f-42b6-a87f-60d7da0c6be0"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:36.035615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d3915e8-c1ff-4611-a581-056ecbd712e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:36.037401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d3915e8-c1ff-4611-a581-056ecbd712e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:36.039873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d3915e8-c1ff-4611-a581-056ecbd712e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:36.041113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d3915e8-c1ff-4611-a581-056ecbd712e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:36.042934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-045d2764-52dd-4dde-9dcb-e1778b3f8e6f req-cf0362d8-390f-48ff-b021-164c5690cb36 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:36.043573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-045d2764-52dd-4dde-9dcb-e1778b3f8e6f req-cf0362d8-390f-48ff-b021-164c5690cb36 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:36.048868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:36.059558 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-045d2764-52dd-4dde-9dcb-e1778b3f8e6f req-cf0362d8-390f-48ff-b021-164c5690cb36 service nova] Creating event network-vif-unplugged:9c5d3b07-270f-42b6-a87f-60d7da0c6be0 for instance 9e0d40b8-3a01-421f-84fe-b94732c1f667 on n-h2-843700-1 May 28 04:36:36.067870 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-045d2764-52dd-4dde-9dcb-e1778b3f8e6f req-cf0362d8-390f-48ff-b021-164c5690cb36 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037733 May 28 04:36:36.067870 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 383/690] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:36.217223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bc1b4e19-7884-429b-9b55-4f570c9f2719 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e11160>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:36.299462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9d3915e8-c1ff-4611-a581-056ecbd712e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:36.308629 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9d3915e8-c1ff-4611-a581-056ecbd712e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8" status: 200 len: 1386 microversion: 2.1 time: 0.286749 May 28 04:36:36.309400 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 308/691] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:36 2022] GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 => generated 1386 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:36.315491 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bc1b4e19-7884-429b-9b55-4f570c9f2719 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23" status: 200 len: 1452 microversion: 2.1 time: 0.110219 May 28 04:36:36.321033 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 384/692] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:36 2022] GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23 => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:36.324990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-15f64b76-8631-44a9-8481-8da64ad02f6d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:36.325728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-15f64b76-8631-44a9-8481-8da64ad02f6d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:36.333198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15f64b76-8631-44a9-8481-8da64ad02f6d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:36.335927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15f64b76-8631-44a9-8481-8da64ad02f6d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:36.335927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15f64b76-8631-44a9-8481-8da64ad02f6d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:36.335927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15f64b76-8631-44a9-8481-8da64ad02f6d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:36.361682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-05383960-eb85-4e05-b763-7167a80e5e8a tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:36.362426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-05383960-eb85-4e05-b763-7167a80e5e8a tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] [instance: f495e0b2-28af-4f3d-9b5f-753ab641593a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:36.368784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05383960-eb85-4e05-b763-7167a80e5e8a tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:36.369232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05383960-eb85-4e05-b763-7167a80e5e8a tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:36.369993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05383960-eb85-4e05-b763-7167a80e5e8a tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:36.370425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05383960-eb85-4e05-b763-7167a80e5e8a tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:36.400870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-15f64b76-8631-44a9-8481-8da64ad02f6d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:36.409076 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-15f64b76-8631-44a9-8481-8da64ad02f6d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1215 microversion: 2.1 time: 0.089103 May 28 04:36:36.418875 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 309/693] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:36 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1215 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:36.507744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-05383960-eb85-4e05-b763-7167a80e5e8a tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3db75ca2004d7db34b1717680c3146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2225e50831e54c9093339163d35e690d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:36.515190 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-05383960-eb85-4e05-b763-7167a80e5e8a tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] 10.222.0.58 "GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a" status: 200 len: 1323 microversion: 2.1 time: 0.157376 May 28 04:36:36.515766 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 385/694] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:36 2022] GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a => generated 1323 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:36.759585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b21b9dc4-620c-438c-9575-27b7fb54092c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:36.760747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b21b9dc4-620c-438c-9575-27b7fb54092c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:36.770200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b21b9dc4-620c-438c-9575-27b7fb54092c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:36.770833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b21b9dc4-620c-438c-9575-27b7fb54092c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:36.771656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b21b9dc4-620c-438c-9575-27b7fb54092c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:36.772264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b21b9dc4-620c-438c-9575-27b7fb54092c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:36.852700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0b4c1952-698c-4cb4-8854-8ae9a077e239 tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] Action: 'create', calling method: .version_select at 0x7f7701e57e50>, body: {"keypair": {"name": "tempest-keypair-1389697690", "type": "ssh", "user_id": "5f9a1e933d42460eba9730aa85152e24", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1xwPtiOK6VKmqnRrpvAk4WFp+3ou8NwRZ794+BHEQiRmwoca+bL6XcIqY8Fi7cFhkEOdcIXEOC3IPDDVpXSBb5ZgiRIRzkqTTO4IAiUkUfpgKG35UhkjgshduORtLSpQ=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:36.866296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=36 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:36.869635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0b4c1952-698c-4cb4-8854-8ae9a077e239 tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] Getting quotas for project d058aaf47e3e494d86b0c52b481148ad. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:36:36.877698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0b4c1952-698c-4cb4-8854-8ae9a077e239 tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] Getting quotas for user 07d93772208f4e63817fffac8f9a29d8 and project d058aaf47e3e494d86b0c52b481148ad. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:36:36.934819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b21b9dc4-620c-438c-9575-27b7fb54092c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:36.943157 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b21b9dc4-620c-438c-9575-27b7fb54092c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1318 microversion: 2.1 time: 0.189348 May 28 04:36:36.943740 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 386/695] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:36 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:36.955905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b4f9dae9-f454-4e3e-987d-8e4d1afa6d59 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:36.956607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b4f9dae9-f454-4e3e-987d-8e4d1afa6d59 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:36.964486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4f9dae9-f454-4e3e-987d-8e4d1afa6d59 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:36.964940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4f9dae9-f454-4e3e-987d-8e4d1afa6d59 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:36.965907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4f9dae9-f454-4e3e-987d-8e4d1afa6d59 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:36.966529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4f9dae9-f454-4e3e-987d-8e4d1afa6d59 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:36.973136 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0b4c1952-698c-4cb4-8854-8ae9a077e239 tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.280645 May 28 04:36:36.973760 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 310/696] 10.222.0.58 () {62 vars in 1199 bytes} [Sat May 28 04:36:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 282 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 28 04:36:36.987142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b539f5f7-1d0b-4866-bb0f-aa9b7d4f73a1 tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] Action: 'create', calling method: .version_select at 0x7f7701e57700>, body: {"keypair": {"name": "tempest-keypair-1934734621", "type": "ssh", "user_id": "5f9a1e933d42460eba9730aa85152e24", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLp+oJULmf2wEfwnEb+GXDQ3KxNQlbzM4oVwYffhziFi3KkAncx2bl4e+ZbyN2ctfQxERkCjcrsSIv2nsqCcSD0J+/TRteTZ0iAl0Bg3F60/ekXqVsX4ZTCJw9NqryPTiw=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:37.003265 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-b539f5f7-1d0b-4866-bb0f-aa9b7d4f73a1 tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] Getting quotas for project d058aaf47e3e494d86b0c52b481148ad. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:36:37.008949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-b539f5f7-1d0b-4866-bb0f-aa9b7d4f73a1 tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] Getting quotas for user 07d93772208f4e63817fffac8f9a29d8 and project d058aaf47e3e494d86b0c52b481148ad. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:36:37.087705 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b539f5f7-1d0b-4866-bb0f-aa9b7d4f73a1 tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.105117 May 28 04:36:37.088730 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 311/697] 10.222.0.58 () {62 vars in 1199 bytes} [Sat May 28 04:36:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 28 04:36:37.094058 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-36072752-08d5-4572-bb45-bd4bb14dca83 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:37.095250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-36072752-08d5-4572-bb45-bd4bb14dca83 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:37.102921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-36072752-08d5-4572-bb45-bd4bb14dca83 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:37.103410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-36072752-08d5-4572-bb45-bd4bb14dca83 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:37.104331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-36072752-08d5-4572-bb45-bd4bb14dca83 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:37.104779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-36072752-08d5-4572-bb45-bd4bb14dca83 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:37.154169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b4f9dae9-f454-4e3e-987d-8e4d1afa6d59 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:37.174264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b4f9dae9-f454-4e3e-987d-8e4d1afa6d59 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:37.177060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b4f9dae9-f454-4e3e-987d-8e4d1afa6d59 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:37.178437 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b4f9dae9-f454-4e3e-987d-8e4d1afa6d59 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1557 microversion: 2.25 time: 0.228922 May 28 04:36:37.179666 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 387/698] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:36 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1557 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:37.187775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-be30c0c6-181f-40bb-ade4-6d761162ca92 tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] Calling method '.version_select at 0x7f7701f114c0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:37.206791 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-be30c0c6-181f-40bb-ade4-6d761162ca92 tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-1389697690?user_id=5f9a1e933d42460eba9730aa85152e24" status: 200 len: 512 microversion: 2.10 time: 0.025984 May 28 04:36:37.207406 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 388/699] 10.222.0.58 () {60 vars in 1339 bytes} [Sat May 28 04:36:37 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1389697690?user_id=5f9a1e933d42460eba9730aa85152e24 => generated 512 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:36:37.289920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-36072752-08d5-4572-bb45-bd4bb14dca83 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:37.298561 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-36072752-08d5-4572-bb45-bd4bb14dca83 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1475 microversion: 2.1 time: 0.208611 May 28 04:36:37.299665 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 312/700] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:37 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1475 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:37.304424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-afdcb799-3fb7-4939-8166-764a1c88e1d0 tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] Action: 'create', calling method: .version_select at 0x7f7702419a60>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-2000075674", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvVq8uLiQT8AOqRTpECzNn9xpcPcCSTYAn6Npgad0S+ZojdMOKNeT9jAmWs+jiNX1Q5w0tPt4ITCieZi3efmyIY9nRhxceEV32SV07ekrqh9UJYBO4uuN19TEk2OQTyFw=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:37.320888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-afdcb799-3fb7-4939-8166-764a1c88e1d0 tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] Getting quotas for project d058aaf47e3e494d86b0c52b481148ad. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:36:37.327229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-afdcb799-3fb7-4939-8166-764a1c88e1d0 tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] Getting quotas for user 07d93772208f4e63817fffac8f9a29d8 and project d058aaf47e3e494d86b0c52b481148ad. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:36:37.384704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cb18f50a-4639-4e04-9822-c56f403b9496 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:37.387295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cb18f50a-4639-4e04-9822-c56f403b9496 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:37.396919 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb18f50a-4639-4e04-9822-c56f403b9496 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:37.398332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb18f50a-4639-4e04-9822-c56f403b9496 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:37.399168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb18f50a-4639-4e04-9822-c56f403b9496 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:37.399631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb18f50a-4639-4e04-9822-c56f403b9496 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:37.439466 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-afdcb799-3fb7-4939-8166-764a1c88e1d0 tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.135134 May 28 04:36:37.440190 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 313/701] 10.222.0.58 () {62 vars in 1199 bytes} [Sat May 28 04:36:37 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 140 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 28 04:36:37.450931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6a3a102f-f20d-416a-ad95-ea650ab13a11 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:37.454355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6a3a102f-f20d-416a-ad95-ea650ab13a11 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:37.459315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a3a102f-f20d-416a-ad95-ea650ab13a11 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:37.459981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a3a102f-f20d-416a-ad95-ea650ab13a11 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:37.461296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a3a102f-f20d-416a-ad95-ea650ab13a11 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:37.462524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a3a102f-f20d-416a-ad95-ea650ab13a11 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:37.769398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-cb18f50a-4639-4e04-9822-c56f403b9496 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lazy-loading 'services' on Instance uuid f64917b4-0e1c-4354-b5e5-e2925b14a602 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:36:37.828951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6a3a102f-f20d-416a-ad95-ea650ab13a11 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:37.840379 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6a3a102f-f20d-416a-ad95-ea650ab13a11 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8" status: 200 len: 1386 microversion: 2.1 time: 0.393461 May 28 04:36:37.842034 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 314/702] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:37 2022] GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 => generated 1386 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:37.844532 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cb18f50a-4639-4e04-9822-c56f403b9496 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 2049 microversion: 2.25 time: 0.633096 May 28 04:36:37.857328 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 389/703] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:37 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 2049 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:37.857328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c97806f6-1f64-4552-8fdb-f45a0a17da74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:37.857328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c97806f6-1f64-4552-8fdb-f45a0a17da74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:37.865106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-964c3ff0-e706-4f44-8842-24f8cf812138 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f770255bd30>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:37.872922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c97806f6-1f64-4552-8fdb-f45a0a17da74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:37.873389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c97806f6-1f64-4552-8fdb-f45a0a17da74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:37.877503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c97806f6-1f64-4552-8fdb-f45a0a17da74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:37.879645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c97806f6-1f64-4552-8fdb-f45a0a17da74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:37.944693 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-964c3ff0-e706-4f44-8842-24f8cf812138 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23" status: 200 len: 1452 microversion: 2.1 time: 0.101339 May 28 04:36:37.945556 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 315/704] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:37 2022] GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23 => generated 1452 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:37.953963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e8837513-ba3d-4d9c-a4fa-cd99724d986f tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] Calling method '.version_select at 0x7f7701fd4dc0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:37.957147 n-d-843700-1 devstack@n-api.service[126043]: WARNING oslo_db.sqlalchemy.utils [None req-e8837513-ba3d-4d9c-a4fa-cd99724d986f tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. May 28 04:36:37.969476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:37.974110 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e8837513-ba3d-4d9c-a4fa-cd99724d986f tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] 10.222.0.58 "GET /compute/v2.1/os-keypairs?user_id=5f9a1e933d42460eba9730aa85152e24" status: 200 len: 726 microversion: 2.10 time: 0.027019 May 28 04:36:37.975339 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 316/705] 10.222.0.58 () {60 vars in 1258 bytes} [Sat May 28 04:36:37 2022] GET /compute/v2.1/os-keypairs?user_id=5f9a1e933d42460eba9730aa85152e24 => generated 726 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:36:37.980558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5d553cce-9767-442a-9e66-aab9f202edd6 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:37.981380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5d553cce-9767-442a-9e66-aab9f202edd6 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] [instance: f495e0b2-28af-4f3d-9b5f-753ab641593a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:37.988985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d553cce-9767-442a-9e66-aab9f202edd6 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:37.989670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d553cce-9767-442a-9e66-aab9f202edd6 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:37.990652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d553cce-9767-442a-9e66-aab9f202edd6 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:37.991289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d553cce-9767-442a-9e66-aab9f202edd6 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:38.022175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c97806f6-1f64-4552-8fdb-f45a0a17da74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:38.031275 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c97806f6-1f64-4552-8fdb-f45a0a17da74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1281 microversion: 2.1 time: 0.184049 May 28 04:36:38.046477 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 390/706] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:37 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1281 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:38.058511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-92a8203c-241b-47bf-bdef-9ec0b56fbcff tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:38.059508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-92a8203c-241b-47bf-bdef-9ec0b56fbcff tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:38.069744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-92a8203c-241b-47bf-bdef-9ec0b56fbcff tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:38.070205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-92a8203c-241b-47bf-bdef-9ec0b56fbcff tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:38.071776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-92a8203c-241b-47bf-bdef-9ec0b56fbcff tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:38.072282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-92a8203c-241b-47bf-bdef-9ec0b56fbcff tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:38.311224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5d553cce-9767-442a-9e66-aab9f202edd6 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3db75ca2004d7db34b1717680c3146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2225e50831e54c9093339163d35e690d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:38.320768 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5d553cce-9767-442a-9e66-aab9f202edd6 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] 10.222.0.58 "GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a" status: 200 len: 1323 microversion: 2.1 time: 0.344162 May 28 04:36:38.321876 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 317/707] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:37 2022] GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a => generated 1323 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:38.329541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-92a8203c-241b-47bf-bdef-9ec0b56fbcff tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lazy-loading 'services' on Instance uuid f64917b4-0e1c-4354-b5e5-e2925b14a602 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:36:38.334430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1fe9b5e8-a625-4c07-abe8-1878aac28588 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:38.336878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1fe9b5e8-a625-4c07-abe8-1878aac28588 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:38.343608 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1fe9b5e8-a625-4c07-abe8-1878aac28588 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:38.344272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1fe9b5e8-a625-4c07-abe8-1878aac28588 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:38.345287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1fe9b5e8-a625-4c07-abe8-1878aac28588 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:38.346007 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1fe9b5e8-a625-4c07-abe8-1878aac28588 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:38.368400 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-92a8203c-241b-47bf-bdef-9ec0b56fbcff tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 2049 microversion: 2.25 time: 0.320578 May 28 04:36:38.369843 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 391/708] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:38 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 2049 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:38.387403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-47338268-4208-4815-a600-3ce17edba778 tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] Calling method '.version_select at 0x7f7701f11b80>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:38.496808 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-47338268-4208-4815-a600-3ce17edba778 tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2000075674" status: 204 len: 0 microversion: 2.10 time: 0.125621 May 28 04:36:38.502782 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 392/709] 10.222.0.58 () {60 vars in 1324 bytes} [Sat May 28 04:36:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2000075674 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:36:38.512517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-178615be-dc99-4970-907d-60e8749e1003 req-d2b3222e-1657-42bb-af37-f69e8c727ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c86c50-5759-4619-9f17-a61d7452a6e8", "name": "network-vif-plugged", "status": "completed", "tag": "ccd10a3b-275c-471d-bbc8-932e66f9e657"}, {"server_uuid": "a27b8082-4f44-4263-a6a2-86291ea3950b", "name": "network-vif-plugged", "status": "completed", "tag": "06f37629-13a1-489c-9d41-01ab1fa9a306"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:38.528482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-178615be-dc99-4970-907d-60e8749e1003 req-d2b3222e-1657-42bb-af37-f69e8c727ad3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:38.529444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-178615be-dc99-4970-907d-60e8749e1003 req-d2b3222e-1657-42bb-af37-f69e8c727ad3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:38.549791 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-178615be-dc99-4970-907d-60e8749e1003 req-d2b3222e-1657-42bb-af37-f69e8c727ad3 service nova] Creating event network-vif-plugged:ccd10a3b-275c-471d-bbc8-932e66f9e657 for instance 88c86c50-5759-4619-9f17-a61d7452a6e8 on n-h1-843700-1 May 28 04:36:38.550641 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-178615be-dc99-4970-907d-60e8749e1003 req-d2b3222e-1657-42bb-af37-f69e8c727ad3 service nova] Creating event network-vif-plugged:06f37629-13a1-489c-9d41-01ab1fa9a306 for instance a27b8082-4f44-4263-a6a2-86291ea3950b on n-h2-843700-1 May 28 04:36:38.568272 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-178615be-dc99-4970-907d-60e8749e1003 req-d2b3222e-1657-42bb-af37-f69e8c727ad3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061102 May 28 04:36:38.578509 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 393/710] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:38.579200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cff2ce4d-33f7-432b-b5a8-54b3394f1181 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:38.580024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cff2ce4d-33f7-432b-b5a8-54b3394f1181 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:38.591187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cff2ce4d-33f7-432b-b5a8-54b3394f1181 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:38.592058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cff2ce4d-33f7-432b-b5a8-54b3394f1181 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:38.593106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cff2ce4d-33f7-432b-b5a8-54b3394f1181 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:38.593782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cff2ce4d-33f7-432b-b5a8-54b3394f1181 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:38.594917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1fe9b5e8-a625-4c07-abe8-1878aac28588 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:38.610285 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1fe9b5e8-a625-4c07-abe8-1878aac28588 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1318 microversion: 2.1 time: 0.287148 May 28 04:36:38.610944 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 318/711] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:38 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:38.616177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ebac0deb-3036-46dc-959a-ce73e9bdc55a tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:38.618703 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:36:38.618703 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:36:38.623156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebac0deb-3036-46dc-959a-ce73e9bdc55a tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:38.623948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebac0deb-3036-46dc-959a-ce73e9bdc55a tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:38.625045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebac0deb-3036-46dc-959a-ce73e9bdc55a tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:38.625887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebac0deb-3036-46dc-959a-ce73e9bdc55a tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:38.657279 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ebac0deb-3036-46dc-959a-ce73e9bdc55a tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.044650 May 28 04:36:38.658645 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 319/712] 10.222.0.58 () {60 vars in 1216 bytes} [Sat May 28 04:36:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:36:38.670041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8c7ab7d8-89d7-41da-917d-b1e89c086c72 tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] Calling method '.version_select at 0x7f7701fb3790>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:38.796633 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8c7ab7d8-89d7-41da-917d-b1e89c086c72 tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1934734621?user_id=5f9a1e933d42460eba9730aa85152e24" status: 204 len: 0 microversion: 2.10 time: 0.135297 May 28 04:36:38.796633 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 320/713] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 04:36:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1934734621?user_id=5f9a1e933d42460eba9730aa85152e24 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:36:38.807646 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2be809c0-d30d-43c8-aceb-daaaf8301f05 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843700-1", "block_migration": "auto"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:38.810021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2be809c0-d30d-43c8-aceb-daaaf8301f05 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:38.818790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2be809c0-d30d-43c8-aceb-daaaf8301f05 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:38.819642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2be809c0-d30d-43c8-aceb-daaaf8301f05 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:38.821895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2be809c0-d30d-43c8-aceb-daaaf8301f05 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:38.822522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2be809c0-d30d-43c8-aceb-daaaf8301f05 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:38.866870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-2be809c0-d30d-43c8-aceb-daaaf8301f05 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lazy-loading 'flavor' on Instance uuid f64917b4-0e1c-4354-b5e5-e2925b14a602 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:36:38.889008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2be809c0-d30d-43c8-aceb-daaaf8301f05 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Going to try to live migrate instance to n-h1-843700-1 {{(pid=126043) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 28 04:36:38.889229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cff2ce4d-33f7-432b-b5a8-54b3394f1181 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:38.899479 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cff2ce4d-33f7-432b-b5a8-54b3394f1181 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1475 microversion: 2.1 time: 0.324883 May 28 04:36:38.900125 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 394/714] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:38 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1475 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:38.919103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aae3cac2-1ba6-4148-ae3f-50a4ccd27579 tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] Calling method '.version_select at 0x7f7701f11550>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:39.012377 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aae3cac2-1ba6-4148-ae3f-50a4ccd27579 tempest-KeyPairsV210TestJSON-455101291 tempest-KeyPairsV210TestJSON-455101291-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1389697690?user_id=5f9a1e933d42460eba9730aa85152e24" status: 204 len: 0 microversion: 2.10 time: 0.110280 May 28 04:36:39.012377 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 395/715] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 04:36:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1389697690?user_id=5f9a1e933d42460eba9730aa85152e24 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:36:39.017910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-21ae11f4-08e4-4708-8037-239802f33603 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:39.018927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-21ae11f4-08e4-4708-8037-239802f33603 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:39.021636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:39.028419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21ae11f4-08e4-4708-8037-239802f33603 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:39.028810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21ae11f4-08e4-4708-8037-239802f33603 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:39.029798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21ae11f4-08e4-4708-8037-239802f33603 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:39.030049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21ae11f4-08e4-4708-8037-239802f33603 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:39.354230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-21ae11f4-08e4-4708-8037-239802f33603 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:39.367806 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-21ae11f4-08e4-4708-8037-239802f33603 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8" status: 200 len: 1386 microversion: 2.1 time: 0.353897 May 28 04:36:39.368425 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 396/716] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:39 2022] GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 => generated 1386 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:39.374927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-20e18cc5-08e8-48cc-b90b-02859213c64f tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e11280>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:39.435923 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-20e18cc5-08e8-48cc-b90b-02859213c64f tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23" status: 200 len: 1452 microversion: 2.1 time: 0.065562 May 28 04:36:39.437594 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 397/717] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:39 2022] GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23 => generated 1452 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:39.443817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4e878ca7-f37e-4728-8495-140b26a4c339 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:39.444612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4e878ca7-f37e-4728-8495-140b26a4c339 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:39.451550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e878ca7-f37e-4728-8495-140b26a4c339 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:39.452233 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e878ca7-f37e-4728-8495-140b26a4c339 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:39.453172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e878ca7-f37e-4728-8495-140b26a4c339 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:39.453888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e878ca7-f37e-4728-8495-140b26a4c339 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:39.707423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4e878ca7-f37e-4728-8495-140b26a4c339 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:39.732392 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4e878ca7-f37e-4728-8495-140b26a4c339 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1311 microversion: 2.1 time: 0.293360 May 28 04:36:39.733254 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 398/718] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:39 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1311 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:39.743547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-410d9ae2-e30d-4442-83ed-8dd5755ea758 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:39.743547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-410d9ae2-e30d-4442-83ed-8dd5755ea758 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] [instance: f495e0b2-28af-4f3d-9b5f-753ab641593a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:39.750454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-410d9ae2-e30d-4442-83ed-8dd5755ea758 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:39.750910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-410d9ae2-e30d-4442-83ed-8dd5755ea758 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:39.756062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-410d9ae2-e30d-4442-83ed-8dd5755ea758 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:39.756525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-410d9ae2-e30d-4442-83ed-8dd5755ea758 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:40.188415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-410d9ae2-e30d-4442-83ed-8dd5755ea758 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3db75ca2004d7db34b1717680c3146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2225e50831e54c9093339163d35e690d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:40.197053 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-410d9ae2-e30d-4442-83ed-8dd5755ea758 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] 10.222.0.58 "GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a" status: 200 len: 1323 microversion: 2.1 time: 0.462290 May 28 04:36:40.200096 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 399/719] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:39 2022] GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a => generated 1323 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:40.216974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d3604e4b-2ade-4e90-b1fe-e36baa49d295 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:40.218528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d3604e4b-2ade-4e90-b1fe-e36baa49d295 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:40.237764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3604e4b-2ade-4e90-b1fe-e36baa49d295 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:40.238316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3604e4b-2ade-4e90-b1fe-e36baa49d295 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:40.241469 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3604e4b-2ade-4e90-b1fe-e36baa49d295 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:40.242137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3604e4b-2ade-4e90-b1fe-e36baa49d295 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:40.820693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d3604e4b-2ade-4e90-b1fe-e36baa49d295 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:40.839047 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d3604e4b-2ade-4e90-b1fe-e36baa49d295 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1318 microversion: 2.1 time: 0.624806 May 28 04:36:40.839822 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 400/720] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:40 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1318 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:40.849123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2376b9a2-b47c-4afd-bc3d-670cc3992142 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:40.851163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2376b9a2-b47c-4afd-bc3d-670cc3992142 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:40.880649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2376b9a2-b47c-4afd-bc3d-670cc3992142 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:40.891415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2376b9a2-b47c-4afd-bc3d-670cc3992142 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:40.891415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2376b9a2-b47c-4afd-bc3d-670cc3992142 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:40.891415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2376b9a2-b47c-4afd-bc3d-670cc3992142 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:41.162770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2376b9a2-b47c-4afd-bc3d-670cc3992142 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:41.162770 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2376b9a2-b47c-4afd-bc3d-670cc3992142 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1475 microversion: 2.1 time: 0.298060 May 28 04:36:41.162770 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 401/721] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:40 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1475 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:41.162770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4f662348-94e2-410e-9faa-965c9a9e581b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:41.165830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4f662348-94e2-410e-9faa-965c9a9e581b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:41.165830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f662348-94e2-410e-9faa-965c9a9e581b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:41.165830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f662348-94e2-410e-9faa-965c9a9e581b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:41.165830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f662348-94e2-410e-9faa-965c9a9e581b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:41.166180 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f662348-94e2-410e-9faa-965c9a9e581b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:41.419517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4f662348-94e2-410e-9faa-965c9a9e581b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:41.427621 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4f662348-94e2-410e-9faa-965c9a9e581b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8" status: 200 len: 1585 microversion: 2.1 time: 0.286815 May 28 04:36:41.428198 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 402/722] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:41 2022] GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 => generated 1585 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:41.433190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ede1eec5-2d0d-4362-a2b1-e1c75ccb5a3d tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f113a0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:41.477970 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ede1eec5-2d0d-4362-a2b1-e1c75ccb5a3d tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23" status: 200 len: 1452 microversion: 2.1 time: 0.048767 May 28 04:36:41.478546 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 403/723] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:41 2022] GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23 => generated 1452 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:41.483070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-b06aecc5-9abc-4eca-b68b-e7f89394793f req-0c850031-ee7b-4151-9a31-3e4270b414d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89406e18-7fa9-41e4-9fe8-34ce8a7255cf", "name": "network-vif-plugged", "status": "completed", "tag": "a8602bdf-b159-4e10-9f57-681347e49a0b"}, {"server_uuid": "f495e0b2-28af-4f3d-9b5f-753ab641593a", "name": "network-vif-plugged", "status": "completed", "tag": "d926dd56-bda0-43cd-aca5-9afdabc87550"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:41.491900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b06aecc5-9abc-4eca-b68b-e7f89394793f req-0c850031-ee7b-4151-9a31-3e4270b414d6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:41.492344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b06aecc5-9abc-4eca-b68b-e7f89394793f req-0c850031-ee7b-4151-9a31-3e4270b414d6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:41.504732 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-b06aecc5-9abc-4eca-b68b-e7f89394793f req-0c850031-ee7b-4151-9a31-3e4270b414d6 service nova] Creating event network-vif-plugged:a8602bdf-b159-4e10-9f57-681347e49a0b for instance 89406e18-7fa9-41e4-9fe8-34ce8a7255cf on n-h2-843700-1 May 28 04:36:41.505244 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-b06aecc5-9abc-4eca-b68b-e7f89394793f req-0c850031-ee7b-4151-9a31-3e4270b414d6 service nova] Creating event network-vif-plugged:d926dd56-bda0-43cd-aca5-9afdabc87550 for instance f495e0b2-28af-4f3d-9b5f-753ab641593a on n-h1-843700-1 May 28 04:36:41.520153 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-b06aecc5-9abc-4eca-b68b-e7f89394793f req-0c850031-ee7b-4151-9a31-3e4270b414d6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040399 May 28 04:36:41.521175 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 404/724] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:41.526464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6c8acbe1-bf58-471c-863d-dd5d276fad74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:41.527195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6c8acbe1-bf58-471c-863d-dd5d276fad74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:41.534160 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c8acbe1-bf58-471c-863d-dd5d276fad74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:41.534611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c8acbe1-bf58-471c-863d-dd5d276fad74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:41.535414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c8acbe1-bf58-471c-863d-dd5d276fad74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:41.535845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c8acbe1-bf58-471c-863d-dd5d276fad74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:41.731462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6c8acbe1-bf58-471c-863d-dd5d276fad74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:41.740854 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6c8acbe1-bf58-471c-863d-dd5d276fad74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1311 microversion: 2.1 time: 0.218245 May 28 04:36:41.741612 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 405/725] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:41 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1311 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:41.747289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-017c427c-318f-4333-86cd-7cb7c7e7ced8 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:41.747486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-017c427c-318f-4333-86cd-7cb7c7e7ced8 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] [instance: f495e0b2-28af-4f3d-9b5f-753ab641593a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:41.781641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-017c427c-318f-4333-86cd-7cb7c7e7ced8 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:41.783905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-017c427c-318f-4333-86cd-7cb7c7e7ced8 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:41.784783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-017c427c-318f-4333-86cd-7cb7c7e7ced8 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:41.785227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-017c427c-318f-4333-86cd-7cb7c7e7ced8 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:41.992703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-017c427c-318f-4333-86cd-7cb7c7e7ced8 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3db75ca2004d7db34b1717680c3146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2225e50831e54c9093339163d35e690d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:42.008995 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-017c427c-318f-4333-86cd-7cb7c7e7ced8 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] 10.222.0.58 "GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a" status: 200 len: 1323 microversion: 2.1 time: 0.265345 May 28 04:36:42.010213 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 406/726] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:41 2022] GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a => generated 1323 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:42.025777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dd6a2fb3-ed7a-44bc-a8aa-24d752705456 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:42.026315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dd6a2fb3-ed7a-44bc-a8aa-24d752705456 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:42.033385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd6a2fb3-ed7a-44bc-a8aa-24d752705456 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:42.035611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd6a2fb3-ed7a-44bc-a8aa-24d752705456 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:42.035611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd6a2fb3-ed7a-44bc-a8aa-24d752705456 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:42.035611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd6a2fb3-ed7a-44bc-a8aa-24d752705456 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:42.061971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:42.144061 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dd6a2fb3-ed7a-44bc-a8aa-24d752705456 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132168 May 28 04:36:42.144669 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 407/727] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 04:36:42 2022] GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:42.149626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cd2eded1-e01d-467a-b4cb-1cd32bdbad5b tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:42.150326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cd2eded1-e01d-467a-b4cb-1cd32bdbad5b tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:42.156858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cd2eded1-e01d-467a-b4cb-1cd32bdbad5b tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:42.157332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cd2eded1-e01d-467a-b4cb-1cd32bdbad5b tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:42.158894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cd2eded1-e01d-467a-b4cb-1cd32bdbad5b tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:42.159371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cd2eded1-e01d-467a-b4cb-1cd32bdbad5b tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:42.341012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cd2eded1-e01d-467a-b4cb-1cd32bdbad5b tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:42.361572 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cd2eded1-e01d-467a-b4cb-1cd32bdbad5b tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1318 microversion: 2.1 time: 0.215197 May 28 04:36:42.362181 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 408/728] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:42 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:42.374471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-2b5f8d80-3226-4f6d-9597-9d8a8f29e630 req-2f7ea49b-b82d-49a3-8669-19f1666006ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f64b8b-70f7-43c3-85df-66f0e9104617", "tag": "e2fe83fa-067b-4eba-9577-f8b896d605be"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:42.383706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2b5f8d80-3226-4f6d-9597-9d8a8f29e630 req-2f7ea49b-b82d-49a3-8669-19f1666006ec service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:42.384151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2b5f8d80-3226-4f6d-9597-9d8a8f29e630 req-2f7ea49b-b82d-49a3-8669-19f1666006ec service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:42.397001 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-2b5f8d80-3226-4f6d-9597-9d8a8f29e630 req-2f7ea49b-b82d-49a3-8669-19f1666006ec service nova] Creating event network-changed:e2fe83fa-067b-4eba-9577-f8b896d605be for instance 67f64b8b-70f7-43c3-85df-66f0e9104617 on n-h2-843700-1 May 28 04:36:42.401286 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-2b5f8d80-3226-4f6d-9597-9d8a8f29e630 req-2f7ea49b-b82d-49a3-8669-19f1666006ec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037522 May 28 04:36:42.401984 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 409/729] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:42.408220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-21019cb6-0f4c-4af8-ab5c-fb75592e8884 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:42.412085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-21019cb6-0f4c-4af8-ab5c-fb75592e8884 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:42.415811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21019cb6-0f4c-4af8-ab5c-fb75592e8884 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:42.416509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21019cb6-0f4c-4af8-ab5c-fb75592e8884 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:42.417519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21019cb6-0f4c-4af8-ab5c-fb75592e8884 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:42.418192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21019cb6-0f4c-4af8-ab5c-fb75592e8884 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:42.800827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-21019cb6-0f4c-4af8-ab5c-fb75592e8884 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:42.827326 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-21019cb6-0f4c-4af8-ab5c-fb75592e8884 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1475 microversion: 2.1 time: 0.407830 May 28 04:36:42.834958 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 410/730] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:42 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1475 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:42.840097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c5368b67-6a77-425d-b552-ab4ade349a9f tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e110d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:42.922540 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c5368b67-6a77-425d-b552-ab4ade349a9f tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23" status: 200 len: 1452 microversion: 2.1 time: 0.086315 May 28 04:36:42.928871 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 411/731] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:42 2022] GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23 => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:42.934016 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fa1f4e9b-bd8d-49a0-b695-8aafabb1aab1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:42.934476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fa1f4e9b-bd8d-49a0-b695-8aafabb1aab1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:42.943514 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa1f4e9b-bd8d-49a0-b695-8aafabb1aab1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:42.943971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa1f4e9b-bd8d-49a0-b695-8aafabb1aab1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:42.944946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa1f4e9b-bd8d-49a0-b695-8aafabb1aab1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:42.946737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa1f4e9b-bd8d-49a0-b695-8aafabb1aab1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:43.241087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fa1f4e9b-bd8d-49a0-b695-8aafabb1aab1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:43.248830 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fa1f4e9b-bd8d-49a0-b695-8aafabb1aab1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1311 microversion: 2.1 time: 0.320174 May 28 04:36:43.258309 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 412/732] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:42 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1311 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:43.258309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9dd0f5af-faf2-437f-a6ae-9eeae9277cf1 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:43.258309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9dd0f5af-faf2-437f-a6ae-9eeae9277cf1 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] [instance: f495e0b2-28af-4f3d-9b5f-753ab641593a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:43.266649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9dd0f5af-faf2-437f-a6ae-9eeae9277cf1 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:43.267159 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9dd0f5af-faf2-437f-a6ae-9eeae9277cf1 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:43.272114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9dd0f5af-faf2-437f-a6ae-9eeae9277cf1 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:43.272114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9dd0f5af-faf2-437f-a6ae-9eeae9277cf1 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:43.473930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9dd0f5af-faf2-437f-a6ae-9eeae9277cf1 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3db75ca2004d7db34b1717680c3146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2225e50831e54c9093339163d35e690d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:43.486102 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9dd0f5af-faf2-437f-a6ae-9eeae9277cf1 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] 10.222.0.58 "GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a" status: 200 len: 1472 microversion: 2.1 time: 0.235119 May 28 04:36:43.498205 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 413/733] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:43 2022] GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a => generated 1472 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:43.498205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c9511cd2-6f1e-4e18-ac7f-d4dacd4bd826 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:43.498205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c9511cd2-6f1e-4e18-ac7f-d4dacd4bd826 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:43.504401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9511cd2-6f1e-4e18-ac7f-d4dacd4bd826 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:43.505456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9511cd2-6f1e-4e18-ac7f-d4dacd4bd826 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:43.505656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9511cd2-6f1e-4e18-ac7f-d4dacd4bd826 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:43.506073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9511cd2-6f1e-4e18-ac7f-d4dacd4bd826 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:43.713968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c9511cd2-6f1e-4e18-ac7f-d4dacd4bd826 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:43.723103 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c9511cd2-6f1e-4e18-ac7f-d4dacd4bd826 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1468 microversion: 2.1 time: 0.234257 May 28 04:36:43.724360 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 414/734] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:43 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1468 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:43.729399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6d2e804e-4b09-4f2a-92a2-1571916c0aae tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:43.734279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6d2e804e-4b09-4f2a-92a2-1571916c0aae tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] [instance: f495e0b2-28af-4f3d-9b5f-753ab641593a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:43.736473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d2e804e-4b09-4f2a-92a2-1571916c0aae tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:43.737027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d2e804e-4b09-4f2a-92a2-1571916c0aae tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:43.737953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d2e804e-4b09-4f2a-92a2-1571916c0aae tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:43.738403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d2e804e-4b09-4f2a-92a2-1571916c0aae tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:43.764929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6d2e804e-4b09-4f2a-92a2-1571916c0aae tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'dc3db75ca2004d7db34b1717680c3146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2225e50831e54c9093339163d35e690d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6d2e804e-4b09-4f2a-92a2-1571916c0aae tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Request method failure captured: May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a/diagnostics HTTP/1.1 May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikabD_SCWyfz6pr-baXgfmJJyFGIYlODgztqSiZFemKLKyMdzq1eDLsFaZ6_CwrfYytxMC3RWkLQLEH5rYwljx7Nu41X0ouSu9OEvfVCgwi9IZbKqt_8eZcFin9xtGwa78cnrHRMd4NI2XROB1bsRy8gPUMA6clO2T3veu6X-0EnMEUM May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2225e50831e54c9093339163d35e690d May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1663778846 May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:36:43.766852 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:36:43.769054 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2225e50831e54c9093339163d35e690d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2225e50831e54c9093339163d35e690d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2225e50831e54c9093339163d35e690d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2225e50831e54c9093339163d35e690d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:36:43.769054 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1663778846 May 28 04:36:43.769054 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2225e50831e54c9093339163d35e690d May 28 04:36:43.769054 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1663778846 May 28 04:36:43.769054 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerDiagnosticsNegativeTest-1663778846-project May 28 04:36:43.769054 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:36:43.769054 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:36:43.769054 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: dc3db75ca2004d7db34b1717680c3146 May 28 04:36:43.769054 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1663778846-project May 28 04:36:43.769054 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:36:43.769054 n-d-843700-1 devstack@n-api.service[126044]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 28 04:36:43.769875 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'server_id': 'f495e0b2-28af-4f3d-9b5f-753ab641593a'} May 28 04:36:43.769875 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:36:43.769875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:36:43.769875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:36:43.769875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:36:43.769875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:36:43.769875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:36:43.769875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:36:43.769875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:36:43.769875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index May 28 04:36:43.769875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, May 28 04:36:43.769875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:36:43.769875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:36:43.769875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:36:43.769875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:36:43.769875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:36:43.769875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:36:43.769875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:36:43.769875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:36:43.769875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:36:43.771425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:36:43.771425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:36:43.771425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:36:43.771425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:36:43.771425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:36:43.771425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 28 04:36:43.771425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:36:43.771425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:36:43.771425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:36:43.771425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:36:43.771425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:36:43.771425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:36:43.771425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:36:43.771425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:36:43.771425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 28 04:36:43.771425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:36:43.771425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6d2e804e-4b09-4f2a-92a2-1571916c0aae tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:36:43.772609 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6d2e804e-4b09-4f2a-92a2-1571916c0aae tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] 10.222.0.58 "GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.043641 May 28 04:36:43.777426 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 415/735] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:36:43 2022] GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a/diagnostics => generated 117 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:36:43.915674 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2be809c0-d30d-43c8-aceb-daaaf8301f05 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602/action" status: 202 len: 0 microversion: 2.25 time: 5.113874 May 28 04:36:43.916329 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 321/736] 10.222.0.58 () {62 vars in 1318 bytes} [Sat May 28 04:36:38 2022] POST /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602/action => generated 0 bytes in 5120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 04:36:43.924292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a2c05234-bc89-4654-84b8-c9663a2f5620 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:43.925189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a2c05234-bc89-4654-84b8-c9663a2f5620 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] [instance: f495e0b2-28af-4f3d-9b5f-753ab641593a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:43.938375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2c05234-bc89-4654-84b8-c9663a2f5620 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:43.940352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2c05234-bc89-4654-84b8-c9663a2f5620 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:43.941782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2c05234-bc89-4654-84b8-c9663a2f5620 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:43.942632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2c05234-bc89-4654-84b8-c9663a2f5620 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:43.993560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a2c05234-bc89-4654-84b8-c9663a2f5620 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] [instance: f495e0b2-28af-4f3d-9b5f-753ab641593a] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:36:43.999984 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:44.080991 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-865ca303-c332-4630-b8dd-31637af8acc9 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-605468879", "block_migration": true, "disk_over_commit": false}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:44.082183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-865ca303-c332-4630-b8dd-31637af8acc9 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:44.089993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-865ca303-c332-4630-b8dd-31637af8acc9 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:44.090452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-865ca303-c332-4630-b8dd-31637af8acc9 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:44.093219 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-865ca303-c332-4630-b8dd-31637af8acc9 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:44.094907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-865ca303-c332-4630-b8dd-31637af8acc9 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:44.188613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-865ca303-c332-4630-b8dd-31637af8acc9 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lazy-loading 'flavor' on Instance uuid 89406e18-7fa9-41e4-9fe8-34ce8a7255cf {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:36:44.246112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-865ca303-c332-4630-b8dd-31637af8acc9 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Going to try to live migrate instance to tempest-host-605468879 {{(pid=126044) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 28 04:36:44.264860 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-865ca303-c332-4630-b8dd-31637af8acc9 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] HTTP exception thrown: Compute host tempest-host-605468879 could not be found. May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-865ca303-c332-4630-b8dd-31637af8acc9 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Request method failure captured: May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf/action HTTP/1.1 May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 106 May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikabGn2eJi8eVU4oiKtkB17WbT25ZUGygfeJlzOqF8YXJKrzl5CdNcAieGnrI6EWa9VaDq0_MFK2aTSSPTGD3shu-Q5c-DjIGXZVDq9WKAN5LGoVefGTQPGCpbEpCHZLVFda2NcqgvW8qcH6becVrbACdN01w0CD9ISOqPuIeJpFX2ZM May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 199a98d0c5dc4062a9a578c8d8735625 May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-LiveMigrationNegativeTest-1513136966 May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:36:44.277572 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:36:44.279261 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_199a98d0c5dc4062a9a578c8d8735625"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/199a98d0c5dc4062a9a578c8d8735625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/199a98d0c5dc4062a9a578c8d8735625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/199a98d0c5dc4062a9a578c8d8735625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:36:44.279261 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-LiveMigrationNegativeTest-1513136966 May 28 04:36:44.279261 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 199a98d0c5dc4062a9a578c8d8735625 May 28 04:36:44.279261 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1513136966 May 28 04:36:44.279261 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-LiveMigrationNegativeTest-1513136966-project-admin May 28 04:36:44.279261 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:36:44.279261 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:36:44.279261 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: da0db45fd9624d36b2f88fb41cfbcccf May 28 04:36:44.279261 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-LiveMigrationNegativeTest-1513136966-project-admin May 28 04:36:44.279261 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:36:44.279261 n-d-843700-1 devstack@n-api.service[126044]: {"os-migrateLive": {"host": "tempest-host-605468879", "block_migration": true, "disk_over_commit": false}} May 28 04:36:44.279261 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:36:44.280287 n-d-843700-1 devstack@n-api.service[126044]: exception: Compute host tempest-host-605468879 could not be found. May 28 04:36:44.280287 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '89406e18-7fa9-41e4-9fe8-34ce8a7255cf', 'body': {'os-migrateLive': {'host': 'tempest-host-605468879', 'block_migration': True, 'disk_over_commit': False}}} May 28 04:36:44.280287 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:36:44.280287 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:36:44.280287 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live May 28 04:36:44.280287 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, May 28 04:36:44.280287 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 28 04:36:44.280287 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:36:44.280287 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 28 04:36:44.280287 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 04:36:44.280287 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 28 04:36:44.280287 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 04:36:44.280287 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 28 04:36:44.280287 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 04:36:44.280287 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 28 04:36:44.280287 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 04:36:44.280287 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 28 04:36:44.280287 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 04:36:44.280287 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 04:36:44.281673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:36:44.281673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 28 04:36:44.281673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 04:36:44.281673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate May 28 04:36:44.281673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) May 28 04:36:44.281673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:36:44.281673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:36:44.281673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host May 28 04:36:44.281673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, May 28 04:36:44.281673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper May 28 04:36:44.281673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:36:44.281673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host May 28 04:36:44.281673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) May 28 04:36:44.281673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper May 28 04:36:44.281673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) May 28 04:36:44.281673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host May 28 04:36:44.281673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) May 28 04:36:44.281673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-605468879 could not be found. May 28 04:36:44.281673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:36:44.283221 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:36:44.283221 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:36:44.283221 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:36:44.283221 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:36:44.283221 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:36:44.283221 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:36:44.283221 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:36:44.283221 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:36:44.283221 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:36:44.283221 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:36:44.283221 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:36:44.283221 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:36:44.283221 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:36:44.283221 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:36:44.283221 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:36:44.283221 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 28 04:36:44.283221 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live May 28 04:36:44.283221 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 28 04:36:44.283221 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-605468879 could not be found. May 28 04:36:44.283221 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:36:44.285263 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:36:44.285263 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:36:44.285263 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:36:44.285263 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:36:44.285263 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:36:44.285263 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:36:44.285263 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:36:44.285263 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-605468879 could not be found. May 28 04:36:44.285263 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:36:44.285263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-865ca303-c332-4630-b8dd-31637af8acc9 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Returning 400 to user: Compute host tempest-host-605468879 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:36:44.285263 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-865ca303-c332-4630-b8dd-31637af8acc9 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf/action" status: 400 len: 99 microversion: 2.1 time: 0.503426 May 28 04:36:44.288478 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 416/737] 10.222.0.58 () {60 vars in 1278 bytes} [Sat May 28 04:36:43 2022] POST /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf/action => generated 99 bytes in 510 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 04:36:44.294049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f1cc080f-3fb5-4dcc-8bb9-f0a33a470a02 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:44.294778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f1cc080f-3fb5-4dcc-8bb9-f0a33a470a02 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:44.377533 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a2c05234-bc89-4654-84b8-c9663a2f5620 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a" status: 204 len: 0 microversion: 2.1 time: 0.457209 May 28 04:36:44.381363 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 322/738] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:36:43 2022] DELETE /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:36:44.386617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4e3561d7-cbb1-4972-a8b4-cd69c445c459 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:44.386956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4e3561d7-cbb1-4972-a8b4-cd69c445c459 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:44.411615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e3561d7-cbb1-4972-a8b4-cd69c445c459 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:44.412076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e3561d7-cbb1-4972-a8b4-cd69c445c459 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:44.412876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e3561d7-cbb1-4972-a8b4-cd69c445c459 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:44.419737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e3561d7-cbb1-4972-a8b4-cd69c445c459 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:44.488098 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f1cc080f-3fb5-4dcc-8bb9-f0a33a470a02 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:44.488622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f1cc080f-3fb5-4dcc-8bb9-f0a33a470a02 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:44.489475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f1cc080f-3fb5-4dcc-8bb9-f0a33a470a02 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:44.489994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f1cc080f-3fb5-4dcc-8bb9-f0a33a470a02 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:44.826356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4e3561d7-cbb1-4972-a8b4-cd69c445c459 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:44.836967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4e3561d7-cbb1-4972-a8b4-cd69c445c459 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:44.838711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4e3561d7-cbb1-4972-a8b4-cd69c445c459 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:44.840218 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4e3561d7-cbb1-4972-a8b4-cd69c445c459 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1567 microversion: 2.25 time: 0.460426 May 28 04:36:44.841180 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 323/739] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:44 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1567 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:44.846470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1511fed8-7dc4-499e-81f6-ded722be1886 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e7ec10>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:44.884826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f1cc080f-3fb5-4dcc-8bb9-f0a33a470a02 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:44.904034 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f1cc080f-3fb5-4dcc-8bb9-f0a33a470a02 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1475 microversion: 2.1 time: 0.605424 May 28 04:36:44.904034 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 417/740] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:44 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1475 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:44.908672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b02b59c4-0d47-4b4b-aa36-04b14d51ff39 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:44.911209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b02b59c4-0d47-4b4b-aa36-04b14d51ff39 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:44.915880 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1511fed8-7dc4-499e-81f6-ded722be1886 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23" status: 200 len: 1452 microversion: 2.1 time: 0.073568 May 28 04:36:44.917233 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 324/741] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:44 2022] GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23 => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:44.931163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4e8ed9cf-2f87-42d3-a448-50fce30f611d tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:44.933881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4e8ed9cf-2f87-42d3-a448-50fce30f611d tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:44.936818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b02b59c4-0d47-4b4b-aa36-04b14d51ff39 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:44.937975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b02b59c4-0d47-4b4b-aa36-04b14d51ff39 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:44.938774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b02b59c4-0d47-4b4b-aa36-04b14d51ff39 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:44.941158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b02b59c4-0d47-4b4b-aa36-04b14d51ff39 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:44.946382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e8ed9cf-2f87-42d3-a448-50fce30f611d tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:44.949541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e8ed9cf-2f87-42d3-a448-50fce30f611d tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:44.952282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e8ed9cf-2f87-42d3-a448-50fce30f611d tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:44.952941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e8ed9cf-2f87-42d3-a448-50fce30f611d tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:44.974086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:45.276072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=24 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:45.331447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b02b59c4-0d47-4b4b-aa36-04b14d51ff39 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:45.339402 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b02b59c4-0d47-4b4b-aa36-04b14d51ff39 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1311 microversion: 2.1 time: 0.440092 May 28 04:36:45.354625 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 418/742] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:44 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1311 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:45.363285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ec8b20f2-636f-43a3-845c-b696a125ceff tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:45.368129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ec8b20f2-636f-43a3-845c-b696a125ceff tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:45.388456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec8b20f2-636f-43a3-845c-b696a125ceff tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:45.388456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec8b20f2-636f-43a3-845c-b696a125ceff tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:45.388985 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec8b20f2-636f-43a3-845c-b696a125ceff tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:45.389431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec8b20f2-636f-43a3-845c-b696a125ceff tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:45.402719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4e8ed9cf-2f87-42d3-a448-50fce30f611d tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:45.430518 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4e8ed9cf-2f87-42d3-a448-50fce30f611d tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1468 microversion: 2.1 time: 0.510931 May 28 04:36:45.432304 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 325/743] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:44 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1468 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:45.441353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-2d04cfda-0453-4332-8a2d-5eddeeb2d955 req-94b9c6ea-f2d7-473c-a7ed-860d5f8b7ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c86c50-5759-4619-9f17-a61d7452a6e8", "tag": "ccd10a3b-275c-471d-bbc8-932e66f9e657"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:45.511192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2d04cfda-0453-4332-8a2d-5eddeeb2d955 req-94b9c6ea-f2d7-473c-a7ed-860d5f8b7ee8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:45.514094 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2d04cfda-0453-4332-8a2d-5eddeeb2d955 req-94b9c6ea-f2d7-473c-a7ed-860d5f8b7ee8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:45.539062 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-2d04cfda-0453-4332-8a2d-5eddeeb2d955 req-94b9c6ea-f2d7-473c-a7ed-860d5f8b7ee8 service nova] Creating event network-changed:ccd10a3b-275c-471d-bbc8-932e66f9e657 for instance 88c86c50-5759-4619-9f17-a61d7452a6e8 on n-h1-843700-1 May 28 04:36:45.553208 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-2d04cfda-0453-4332-8a2d-5eddeeb2d955 req-94b9c6ea-f2d7-473c-a7ed-860d5f8b7ee8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119156 May 28 04:36:45.554279 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 326/744] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:45.563580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-87c9c05b-01b5-4498-a564-5dfdd67a740a tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:45.564617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-87c9c05b-01b5-4498-a564-5dfdd67a740a tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] [instance: f495e0b2-28af-4f3d-9b5f-753ab641593a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:45.578890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87c9c05b-01b5-4498-a564-5dfdd67a740a tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:45.579649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87c9c05b-01b5-4498-a564-5dfdd67a740a tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:45.580987 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87c9c05b-01b5-4498-a564-5dfdd67a740a tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:45.582339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87c9c05b-01b5-4498-a564-5dfdd67a740a tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:45.751449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ec8b20f2-636f-43a3-845c-b696a125ceff tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:45.766667 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ec8b20f2-636f-43a3-845c-b696a125ceff tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8" status: 200 len: 1585 microversion: 2.1 time: 0.411269 May 28 04:36:45.768684 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 419/745] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:45 2022] GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 => generated 1585 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:45.778604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b497d311-d2a8-4ef8-ae67-9d472c5b4dce tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1156159926", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:45.872802 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-b497d311-d2a8-4ef8-ae67-9d472c5b4dce tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:36:46.055155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-87c9c05b-01b5-4498-a564-5dfdd67a740a tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3db75ca2004d7db34b1717680c3146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2225e50831e54c9093339163d35e690d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:46.065655 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-87c9c05b-01b5-4498-a564-5dfdd67a740a tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] 10.222.0.58 "GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a" status: 200 len: 1478 microversion: 2.1 time: 0.507665 May 28 04:36:46.066613 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 327/746] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:45 2022] GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a => generated 1478 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:46.091410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b8f9633e-5bfd-4dbe-95be-d89e0ff5e7de tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:46.092066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b8f9633e-5bfd-4dbe-95be-d89e0ff5e7de tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:46.110006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8f9633e-5bfd-4dbe-95be-d89e0ff5e7de tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:46.110463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8f9633e-5bfd-4dbe-95be-d89e0ff5e7de tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:46.112408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8f9633e-5bfd-4dbe-95be-d89e0ff5e7de tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:46.113106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8f9633e-5bfd-4dbe-95be-d89e0ff5e7de tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:46.472873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b8f9633e-5bfd-4dbe-95be-d89e0ff5e7de tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:46.483368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b8f9633e-5bfd-4dbe-95be-d89e0ff5e7de tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:46.484887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b8f9633e-5bfd-4dbe-95be-d89e0ff5e7de tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:46.486683 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b8f9633e-5bfd-4dbe-95be-d89e0ff5e7de tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1567 microversion: 2.25 time: 0.407216 May 28 04:36:46.487759 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 328/747] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:46 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1567 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:46.493378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-562eea90-acad-40ec-889f-4e870d6f5641 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:46.493989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-562eea90-acad-40ec-889f-4e870d6f5641 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:46.500548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-562eea90-acad-40ec-889f-4e870d6f5641 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:46.501335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-562eea90-acad-40ec-889f-4e870d6f5641 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:46.502751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-562eea90-acad-40ec-889f-4e870d6f5641 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:46.507179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-562eea90-acad-40ec-889f-4e870d6f5641 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:46.541960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-b497d311-d2a8-4ef8-ae67-9d472c5b4dce tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:36:46.542582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-b497d311-d2a8-4ef8-ae67-9d472c5b4dce tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:36:46.543248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-b497d311-d2a8-4ef8-ae67-9d472c5b4dce tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:36:46.543767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-b497d311-d2a8-4ef8-ae67-9d472c5b4dce tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:36:46.544286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-b497d311-d2a8-4ef8-ae67-9d472c5b4dce tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:36:46.562072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b497d311-d2a8-4ef8-ae67-9d472c5b4dce tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:46.565316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b497d311-d2a8-4ef8-ae67-9d472c5b4dce tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:46.567481 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b497d311-d2a8-4ef8-ae67-9d472c5b4dce tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:46.571290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b497d311-d2a8-4ef8-ae67-9d472c5b4dce tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:46.614251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-b497d311-d2a8-4ef8-ae67-9d472c5b4dce tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Getting quotas for project 2f8aa260b3e94154b0a0485659f7f7e3. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:36:46.619615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-b497d311-d2a8-4ef8-ae67-9d472c5b4dce tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Getting quotas for user a666a6908cd44a898f0b3dfdb8e1dd3a and project 2f8aa260b3e94154b0a0485659f7f7e3. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:36:46.637715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b497d311-d2a8-4ef8-ae67-9d472c5b4dce tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:36:46.640507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b497d311-d2a8-4ef8-ae67-9d472c5b4dce tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:36:47.005179 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b497d311-d2a8-4ef8-ae67-9d472c5b4dce tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.235170 May 28 04:36:47.005888 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 420/748] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:36:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:36:47.011050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f8c02a90-ad08-4e49-9359-017f3816298e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e45a60>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:47.096931 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f8c02a90-ad08-4e49-9359-017f3816298e tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23" status: 200 len: 1452 microversion: 2.1 time: 0.088190 May 28 04:36:47.097702 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 421/749] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:47 2022] GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23 => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:47.109573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f5c10993-7a89-4236-9dc2-474b5cdd1bf4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:47.115860 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f5c10993-7a89-4236-9dc2-474b5cdd1bf4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:47.134075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5c10993-7a89-4236-9dc2-474b5cdd1bf4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:47.136340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5c10993-7a89-4236-9dc2-474b5cdd1bf4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:47.139590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5c10993-7a89-4236-9dc2-474b5cdd1bf4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:47.140930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5c10993-7a89-4236-9dc2-474b5cdd1bf4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:47.266126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-562eea90-acad-40ec-889f-4e870d6f5641 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:47.277926 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-562eea90-acad-40ec-889f-4e870d6f5641 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1475 microversion: 2.1 time: 0.788877 May 28 04:36:47.284478 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 329/750] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:46 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1475 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:47.687747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2fbb945f-3c0a-44f4-97cf-a10c8d97f04d tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] Action: 'update', calling method: .version_select at 0x7f7702168d30>, body: {"quota_set": {"ram": "5120"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:47.700278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=11 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:47.716729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f5c10993-7a89-4236-9dc2-474b5cdd1bf4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:47.729967 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f5c10993-7a89-4236-9dc2-474b5cdd1bf4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1311 microversion: 2.1 time: 0.628380 May 28 04:36:47.730778 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 422/751] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:47 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1311 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:47.736608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-53974d45-678f-41bd-9da1-f72a85904aca tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:47.740650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-53974d45-678f-41bd-9da1-f72a85904aca tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:47.790249 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2fbb945f-3c0a-44f4-97cf-a10c8d97f04d tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:47.790630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2fbb945f-3c0a-44f4-97cf-a10c8d97f04d tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:47.791812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2fbb945f-3c0a-44f4-97cf-a10c8d97f04d tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:47.792304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2fbb945f-3c0a-44f4-97cf-a10c8d97f04d tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:47.861497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-53974d45-678f-41bd-9da1-f72a85904aca tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:47.870775 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-53974d45-678f-41bd-9da1-f72a85904aca tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1219 microversion: 2.1 time: 0.138339 May 28 04:36:47.871403 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 423/752] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:47 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1219 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:47.887354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1b92c3e2-24ae-4f31-8612-067387e99d57 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:47.888005 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1b92c3e2-24ae-4f31-8612-067387e99d57 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] [instance: f495e0b2-28af-4f3d-9b5f-753ab641593a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:47.894205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b92c3e2-24ae-4f31-8612-067387e99d57 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:47.894874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b92c3e2-24ae-4f31-8612-067387e99d57 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:47.895832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b92c3e2-24ae-4f31-8612-067387e99d57 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:47.896262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b92c3e2-24ae-4f31-8612-067387e99d57 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:47.977008 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2fbb945f-3c0a-44f4-97cf-a10c8d97f04d tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/27695590e1694acca8de29db4ac8f86f" status: 200 len: 148 microversion: 2.57 time: 0.690296 May 28 04:36:47.987110 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 330/753] 10.222.0.58 () {62 vars in 1302 bytes} [Sat May 28 04:36:47 2022] PUT /compute/v2.1/os-quota-sets/27695590e1694acca8de29db4ac8f86f => generated 148 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:36:47.994603 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cbbaa35f-db9a-4b81-97d9-3d357fc4fe06 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:47.996724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1b92c3e2-24ae-4f31-8612-067387e99d57 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3db75ca2004d7db34b1717680c3146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2225e50831e54c9093339163d35e690d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:47.997088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cbbaa35f-db9a-4b81-97d9-3d357fc4fe06 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:48.004442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cbbaa35f-db9a-4b81-97d9-3d357fc4fe06 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:48.015578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cbbaa35f-db9a-4b81-97d9-3d357fc4fe06 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:48.015752 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1b92c3e2-24ae-4f31-8612-067387e99d57 tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] 10.222.0.58 "GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a" status: 200 len: 1436 microversion: 2.1 time: 0.122937 May 28 04:36:48.015862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cbbaa35f-db9a-4b81-97d9-3d357fc4fe06 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:48.015970 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 424/754] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:47 2022] GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a => generated 1436 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:48.016073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cbbaa35f-db9a-4b81-97d9-3d357fc4fe06 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:48.016162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-b8028898-e7cd-4c12-a8fe-949d8a660200 req-347c4fa4-4d81-47c9-82cb-c9a35cd29eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f495e0b2-28af-4f3d-9b5f-753ab641593a", "name": "network-vif-deleted", "tag": "d926dd56-bda0-43cd-aca5-9afdabc87550"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:48.020059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b8028898-e7cd-4c12-a8fe-949d8a660200 req-347c4fa4-4d81-47c9-82cb-c9a35cd29eae service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:48.020510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b8028898-e7cd-4c12-a8fe-949d8a660200 req-347c4fa4-4d81-47c9-82cb-c9a35cd29eae service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:48.035999 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-b8028898-e7cd-4c12-a8fe-949d8a660200 req-347c4fa4-4d81-47c9-82cb-c9a35cd29eae service nova] Creating event network-vif-deleted:d926dd56-bda0-43cd-aca5-9afdabc87550 for instance f495e0b2-28af-4f3d-9b5f-753ab641593a on n-h1-843700-1 May 28 04:36:48.042131 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-b8028898-e7cd-4c12-a8fe-949d8a660200 req-347c4fa4-4d81-47c9-82cb-c9a35cd29eae service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034960 May 28 04:36:48.043180 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 425/755] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:48.049140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cb6e5aed-4000-4990-a458-a78e373fc4c1 tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] Calling method '.version_select at 0x7f7701e11820>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:48.188603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb6e5aed-4000-4990-a458-a78e373fc4c1 tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:48.190776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb6e5aed-4000-4990-a458-a78e373fc4c1 tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:48.193213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb6e5aed-4000-4990-a458-a78e373fc4c1 tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:48.196397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb6e5aed-4000-4990-a458-a78e373fc4c1 tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:48.249408 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cb6e5aed-4000-4990-a458-a78e373fc4c1 tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/27695590e1694acca8de29db4ac8f86f/detail" status: 200 len: 463 microversion: 2.57 time: 0.204881 May 28 04:36:48.255626 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 426/756] 10.222.0.58 () {60 vars in 1303 bytes} [Sat May 28 04:36:48 2022] GET /compute/v2.1/os-quota-sets/27695590e1694acca8de29db4ac8f86f/detail => generated 463 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:36:48.255626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-02f2aaa5-6e53-4754-90f4-660646e7a513 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e45280>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:48.346590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cbbaa35f-db9a-4b81-97d9-3d357fc4fe06 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:48.361128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cbbaa35f-db9a-4b81-97d9-3d357fc4fe06 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:48.361494 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-02f2aaa5-6e53-4754-90f4-660646e7a513 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23" status: 200 len: 1452 microversion: 2.1 time: 0.109821 May 28 04:36:48.365973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cbbaa35f-db9a-4b81-97d9-3d357fc4fe06 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:48.368324 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cbbaa35f-db9a-4b81-97d9-3d357fc4fe06 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1567 microversion: 2.25 time: 0.379033 May 28 04:36:48.374816 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 427/757] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:48 2022] GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23 => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:48.380777 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 331/758] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:47 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1567 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:48.394896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0e27e092-19e6-4b3d-9641-ab45eba63837 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:48.395760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0e27e092-19e6-4b3d-9641-ab45eba63837 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:48.428323 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0e27e092-19e6-4b3d-9641-ab45eba63837 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:48.428909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0e27e092-19e6-4b3d-9641-ab45eba63837 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:48.429741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0e27e092-19e6-4b3d-9641-ab45eba63837 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:48.430177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0e27e092-19e6-4b3d-9641-ab45eba63837 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:48.649205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d55dbcb3-d551-4d7a-ad74-3d3a16437854 tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] Action: 'update', calling method: .version_select at 0x7f77022f29d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:48.763944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d55dbcb3-d551-4d7a-ad74-3d3a16437854 tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:48.763944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d55dbcb3-d551-4d7a-ad74-3d3a16437854 tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:48.763944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d55dbcb3-d551-4d7a-ad74-3d3a16437854 tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:48.763944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d55dbcb3-d551-4d7a-ad74-3d3a16437854 tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:48.799791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0e27e092-19e6-4b3d-9641-ab45eba63837 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:48.808463 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0e27e092-19e6-4b3d-9641-ab45eba63837 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1475 microversion: 2.1 time: 0.432526 May 28 04:36:48.810186 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 428/759] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:48 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1475 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:48.819256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c04e762b-7c9c-4f9d-a130-aeff06293b27 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:48.820761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c04e762b-7c9c-4f9d-a130-aeff06293b27 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:48.827635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c04e762b-7c9c-4f9d-a130-aeff06293b27 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:48.828296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c04e762b-7c9c-4f9d-a130-aeff06293b27 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:48.829223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c04e762b-7c9c-4f9d-a130-aeff06293b27 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:48.830842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c04e762b-7c9c-4f9d-a130-aeff06293b27 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:48.845770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d55dbcb3-d551-4d7a-ad74-3d3a16437854 tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:48.846479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d55dbcb3-d551-4d7a-ad74-3d3a16437854 tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:48.856917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d55dbcb3-d551-4d7a-ad74-3d3a16437854 tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:48.858353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d55dbcb3-d551-4d7a-ad74-3d3a16437854 tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:49.010829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c04e762b-7c9c-4f9d-a130-aeff06293b27 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:49.021196 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c04e762b-7c9c-4f9d-a130-aeff06293b27 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1311 microversion: 2.1 time: 0.209751 May 28 04:36:49.030265 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 429/760] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:48 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1311 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:49.030265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-29693b22-9a86-4da6-8069-c1d3863b765e tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:49.030265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-29693b22-9a86-4da6-8069-c1d3863b765e tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:49.037280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-29693b22-9a86-4da6-8069-c1d3863b765e tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:49.040862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-29693b22-9a86-4da6-8069-c1d3863b765e tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:49.040862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-29693b22-9a86-4da6-8069-c1d3863b765e tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:49.040862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-29693b22-9a86-4da6-8069-c1d3863b765e tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:49.102316 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d55dbcb3-d551-4d7a-ad74-3d3a16437854 tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/27695590e1694acca8de29db4ac8f86f?user_id=8c4fd5165f44461ba6465a71fa1ad9d0" status: 200 len: 148 microversion: 2.57 time: 0.461831 May 28 04:36:49.104160 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 332/761] 10.222.0.58 () {62 vars in 1383 bytes} [Sat May 28 04:36:48 2022] PUT /compute/v2.1/os-quota-sets/27695590e1694acca8de29db4ac8f86f?user_id=8c4fd5165f44461ba6465a71fa1ad9d0 => generated 148 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:36:49.117841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4987d51d-8831-45e3-b655-fb442a8bb6cd tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:49.123046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4987d51d-8831-45e3-b655-fb442a8bb6cd tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] [instance: f495e0b2-28af-4f3d-9b5f-753ab641593a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:49.129488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4987d51d-8831-45e3-b655-fb442a8bb6cd tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:49.129954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4987d51d-8831-45e3-b655-fb442a8bb6cd tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:49.130746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4987d51d-8831-45e3-b655-fb442a8bb6cd tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:49.131408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4987d51d-8831-45e3-b655-fb442a8bb6cd tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:49.144990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-29693b22-9a86-4da6-8069-c1d3863b765e tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:49.149699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:49.154554 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-29693b22-9a86-4da6-8069-c1d3863b765e tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1223 microversion: 2.1 time: 0.131065 May 28 04:36:49.154881 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-4987d51d-8831-45e3-b655-fb442a8bb6cd tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] HTTP exception thrown: Instance f495e0b2-28af-4f3d-9b5f-753ab641593a could not be found. May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4987d51d-8831-45e3-b655-fb442a8bb6cd tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Request method failure captured: May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a HTTP/1.1 May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikabD_SCWyfz6pr-baXgfmJJyFGIYlODgztqSiZFemKLKyMdzq1eDLsFaZ6_CwrfYytxMC3RWkLQLEH5rYwljx7Nu41X0ouSu9OEvfVCgwi9IZbKqt_8eZcFin9xtGwa78cnrHRMd4NI2XROB1bsRy8gPUMA6clO2T3veu6X-0EnMEUM May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2225e50831e54c9093339163d35e690d May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1663778846 May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:36:49.158906 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:36:49.160287 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2225e50831e54c9093339163d35e690d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2225e50831e54c9093339163d35e690d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2225e50831e54c9093339163d35e690d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2225e50831e54c9093339163d35e690d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:36:49.160287 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1663778846 May 28 04:36:49.160287 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2225e50831e54c9093339163d35e690d May 28 04:36:49.160287 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1663778846 May 28 04:36:49.160287 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerDiagnosticsNegativeTest-1663778846-project May 28 04:36:49.160287 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:36:49.160287 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:36:49.160287 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: dc3db75ca2004d7db34b1717680c3146 May 28 04:36:49.160287 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1663778846-project May 28 04:36:49.160287 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:36:49.160287 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance f495e0b2-28af-4f3d-9b5f-753ab641593a could not be found. May 28 04:36:49.160287 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'f495e0b2-28af-4f3d-9b5f-753ab641593a'} May 28 04:36:49.161022 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:36:49.161022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:36:49.161022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:36:49.161022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:36:49.161022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:36:49.161022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:36:49.161022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:36:49.161022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:36:49.161022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:36:49.161022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:36:49.161022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f495e0b2-28af-4f3d-9b5f-753ab641593a could not be found. May 28 04:36:49.161022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:36:49.161022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:36:49.161022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:36:49.161022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:36:49.161022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:36:49.161022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:36:49.161022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:36:49.161022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:36:49.161022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:36:49.162223 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:36:49.162223 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:36:49.162223 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:36:49.162223 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:36:49.162223 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:36:49.162223 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:36:49.162223 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:36:49.162223 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f495e0b2-28af-4f3d-9b5f-753ab641593a could not be found. May 28 04:36:49.162223 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:36:49.162223 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:36:49.162223 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:36:49.162223 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:36:49.162223 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:36:49.162223 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:36:49.162223 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:36:49.162223 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:36:49.162223 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f495e0b2-28af-4f3d-9b5f-753ab641593a could not be found. May 28 04:36:49.162223 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:36:49.164622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4987d51d-8831-45e3-b655-fb442a8bb6cd tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] Returning 404 to user: Instance f495e0b2-28af-4f3d-9b5f-753ab641593a could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:36:49.164622 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4987d51d-8831-45e3-b655-fb442a8bb6cd tempest-ServerDiagnosticsNegativeTest-1663778846 tempest-ServerDiagnosticsNegativeTest-1663778846-project] 10.222.0.58 "GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a" status: 404 len: 111 microversion: 2.1 time: 0.053707 May 28 04:36:49.164622 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 333/762] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:49 2022] GET /compute/v2.1/servers/f495e0b2-28af-4f3d-9b5f-753ab641593a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:36:49.164946 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 430/763] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:49 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1223 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:49.166585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-073b6178-3967-421b-9076-d3be30fccd9e tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] Calling method '.version_select at 0x7f770219c430>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:49.274909 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-073b6178-3967-421b-9076-d3be30fccd9e tempest-QuotasAdminTestV257-1672140753 tempest-QuotasAdminTestV257-1672140753-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/27695590e1694acca8de29db4ac8f86f?user_id=8c4fd5165f44461ba6465a71fa1ad9d0" status: 200 len: 190 microversion: 2.57 time: 0.112709 May 28 04:36:49.279772 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 334/764] 10.222.0.58 () {60 vars in 1363 bytes} [Sat May 28 04:36:49 2022] GET /compute/v2.1/os-quota-sets/27695590e1694acca8de29db4ac8f86f?user_id=8c4fd5165f44461ba6465a71fa1ad9d0 => generated 190 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:36:49.384552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-64782466-e93d-4f48-8a50-13e21a964db1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701ec9af0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:49.386314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e8a25736-75b7-411d-9508-d28f94138605 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:49.387029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e8a25736-75b7-411d-9508-d28f94138605 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:49.410630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e8a25736-75b7-411d-9508-d28f94138605 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:49.411336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e8a25736-75b7-411d-9508-d28f94138605 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:49.414056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e8a25736-75b7-411d-9508-d28f94138605 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:49.415942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e8a25736-75b7-411d-9508-d28f94138605 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:49.456043 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-64782466-e93d-4f48-8a50-13e21a964db1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23" status: 200 len: 1452 microversion: 2.1 time: 0.078034 May 28 04:36:49.464301 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 431/765] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:49 2022] GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23 => generated 1452 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:49.668813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e8a25736-75b7-411d-9508-d28f94138605 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:49.679042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e8a25736-75b7-411d-9508-d28f94138605 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:49.681037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e8a25736-75b7-411d-9508-d28f94138605 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:49.682540 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e8a25736-75b7-411d-9508-d28f94138605 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1567 microversion: 2.25 time: 0.300653 May 28 04:36:49.687454 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 335/766] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:49 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1567 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:49.826511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-800e593d-60fd-4815-8738-c753a1cf560b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:49.827790 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-800e593d-60fd-4815-8738-c753a1cf560b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:49.842841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-800e593d-60fd-4815-8738-c753a1cf560b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:49.844402 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-800e593d-60fd-4815-8738-c753a1cf560b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:49.850895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-800e593d-60fd-4815-8738-c753a1cf560b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:49.850895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-800e593d-60fd-4815-8738-c753a1cf560b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:50.040091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d036ab69-a297-4784-a341-0961ebad6ce1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:50.041103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d036ab69-a297-4784-a341-0961ebad6ce1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:50.053513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d036ab69-a297-4784-a341-0961ebad6ce1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:50.054005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d036ab69-a297-4784-a341-0961ebad6ce1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:50.057244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d036ab69-a297-4784-a341-0961ebad6ce1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:50.057920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d036ab69-a297-4784-a341-0961ebad6ce1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:50.240450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-800e593d-60fd-4815-8738-c753a1cf560b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:50.255540 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-800e593d-60fd-4815-8738-c753a1cf560b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1475 microversion: 2.1 time: 0.432966 May 28 04:36:50.256522 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 432/767] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:49 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1475 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:50.270502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-abc6f335-676e-4336-9b5e-8e06b0d1f7d6 req-0b54bebc-c0e3-4405-9d57-fa68af053fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64917b4-0e1c-4354-b5e5-e2925b14a602", "name": "network-vif-unplugged", "status": "completed", "tag": "de60a199-e862-4d4b-a623-cea20acebfcd"}, {"name": "network-changed", "server_uuid": "f64917b4-0e1c-4354-b5e5-e2925b14a602", "tag": "de60a199-e862-4d4b-a623-cea20acebfcd"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:50.304239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-abc6f335-676e-4336-9b5e-8e06b0d1f7d6 req-0b54bebc-c0e3-4405-9d57-fa68af053fd0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:50.311127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-abc6f335-676e-4336-9b5e-8e06b0d1f7d6 req-0b54bebc-c0e3-4405-9d57-fa68af053fd0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:50.361306 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-abc6f335-676e-4336-9b5e-8e06b0d1f7d6 req-0b54bebc-c0e3-4405-9d57-fa68af053fd0 service nova] Creating event network-vif-unplugged:de60a199-e862-4d4b-a623-cea20acebfcd for instance f64917b4-0e1c-4354-b5e5-e2925b14a602 on n-h2-843700-1 May 28 04:36:50.364399 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-abc6f335-676e-4336-9b5e-8e06b0d1f7d6 req-0b54bebc-c0e3-4405-9d57-fa68af053fd0 service nova] Creating event network-changed:de60a199-e862-4d4b-a623-cea20acebfcd for instance f64917b4-0e1c-4354-b5e5-e2925b14a602 on n-h2-843700-1 May 28 04:36:50.384392 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-abc6f335-676e-4336-9b5e-8e06b0d1f7d6 req-0b54bebc-c0e3-4405-9d57-fa68af053fd0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.125970 May 28 04:36:50.390770 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 433/768] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:50.401942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-05dd798f-aa5e-4813-a8a8-0c3ec6164cbe req-ac8a2ec1-0a5b-4829-ad38-0ba59434b52a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f64b8b-70f7-43c3-85df-66f0e9104617", "name": "network-vif-plugged", "status": "completed", "tag": "e2fe83fa-067b-4eba-9577-f8b896d605be"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:50.414081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d036ab69-a297-4784-a341-0961ebad6ce1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:50.431596 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d036ab69-a297-4784-a341-0961ebad6ce1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1311 microversion: 2.1 time: 0.394985 May 28 04:36:50.435611 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 336/769] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:50 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1311 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:50.437987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-05dd798f-aa5e-4813-a8a8-0c3ec6164cbe req-ac8a2ec1-0a5b-4829-ad38-0ba59434b52a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:50.438453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-05dd798f-aa5e-4813-a8a8-0c3ec6164cbe req-ac8a2ec1-0a5b-4829-ad38-0ba59434b52a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:50.460917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-de727dbe-1097-4b9e-b415-1b8fe8084bc0 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:50.466264 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-05dd798f-aa5e-4813-a8a8-0c3ec6164cbe req-ac8a2ec1-0a5b-4829-ad38-0ba59434b52a service nova] Creating event network-vif-plugged:e2fe83fa-067b-4eba-9577-f8b896d605be for instance 67f64b8b-70f7-43c3-85df-66f0e9104617 on n-h2-843700-1 May 28 04:36:50.472806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-de727dbe-1097-4b9e-b415-1b8fe8084bc0 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:50.475288 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-05dd798f-aa5e-4813-a8a8-0c3ec6164cbe req-ac8a2ec1-0a5b-4829-ad38-0ba59434b52a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080101 May 28 04:36:50.476889 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 434/770] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:50.483829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1515008c-c376-4bf6-90a2-4b7b66bc3da7 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f77022c6940>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:50.497807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de727dbe-1097-4b9e-b415-1b8fe8084bc0 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:50.503672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de727dbe-1097-4b9e-b415-1b8fe8084bc0 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:50.510050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de727dbe-1097-4b9e-b415-1b8fe8084bc0 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:50.513207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de727dbe-1097-4b9e-b415-1b8fe8084bc0 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:50.551068 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1515008c-c376-4bf6-90a2-4b7b66bc3da7 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23" status: 200 len: 1452 microversion: 2.1 time: 0.072317 May 28 04:36:50.552640 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 435/771] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:50 2022] GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23 => generated 1452 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:50.705431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5c68f4c7-c306-4c6e-8719-b39ebfb535b2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:50.714103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5c68f4c7-c306-4c6e-8719-b39ebfb535b2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:50.726074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c68f4c7-c306-4c6e-8719-b39ebfb535b2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:50.726545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c68f4c7-c306-4c6e-8719-b39ebfb535b2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:50.726683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-de727dbe-1097-4b9e-b415-1b8fe8084bc0 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:50.730191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c68f4c7-c306-4c6e-8719-b39ebfb535b2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:50.731031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c68f4c7-c306-4c6e-8719-b39ebfb535b2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:50.742546 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-de727dbe-1097-4b9e-b415-1b8fe8084bc0 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1279 microversion: 2.1 time: 0.305837 May 28 04:36:50.743341 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 337/772] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:50 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1279 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:51.209063 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5c68f4c7-c306-4c6e-8719-b39ebfb535b2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:51.220961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5c68f4c7-c306-4c6e-8719-b39ebfb535b2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:51.223248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5c68f4c7-c306-4c6e-8719-b39ebfb535b2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:51.224533 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5c68f4c7-c306-4c6e-8719-b39ebfb535b2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1567 microversion: 2.25 time: 0.523741 May 28 04:36:51.225299 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 436/773] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:50 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1567 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:51.275448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3c15236c-c9c0-4e7d-b2e6-cd78f43b819d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:51.276393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3c15236c-c9c0-4e7d-b2e6-cd78f43b819d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:51.297029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c15236c-c9c0-4e7d-b2e6-cd78f43b819d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:51.302789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c15236c-c9c0-4e7d-b2e6-cd78f43b819d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:51.310015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c15236c-c9c0-4e7d-b2e6-cd78f43b819d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:51.312856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c15236c-c9c0-4e7d-b2e6-cd78f43b819d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:51.451658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6e8001b4-4f44-40db-b5dc-c172f2df3a63 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:51.451987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6e8001b4-4f44-40db-b5dc-c172f2df3a63 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:51.465400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e8001b4-4f44-40db-b5dc-c172f2df3a63 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:51.467382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e8001b4-4f44-40db-b5dc-c172f2df3a63 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:51.469648 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e8001b4-4f44-40db-b5dc-c172f2df3a63 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:51.471062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e8001b4-4f44-40db-b5dc-c172f2df3a63 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:51.776742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6e8001b4-4f44-40db-b5dc-c172f2df3a63 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:51.785537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3c15236c-c9c0-4e7d-b2e6-cd78f43b819d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:51.793619 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6e8001b4-4f44-40db-b5dc-c172f2df3a63 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1311 microversion: 2.1 time: 0.344218 May 28 04:36:51.794760 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 437/774] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:51 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1311 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:51.797208 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3c15236c-c9c0-4e7d-b2e6-cd78f43b819d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1475 microversion: 2.1 time: 0.526632 May 28 04:36:51.798261 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 338/775] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:51 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1475 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:51.808678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d2097d7f-eac1-448f-b558-bb27f14f59de tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:51.809573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d2097d7f-eac1-448f-b558-bb27f14f59de tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:51.812163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7508d46f-6dee-4308-80fe-1d36cbf4aa7c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f49700>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:51.817425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d2097d7f-eac1-448f-b558-bb27f14f59de tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:51.818074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d2097d7f-eac1-448f-b558-bb27f14f59de tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:51.820139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d2097d7f-eac1-448f-b558-bb27f14f59de tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:51.821111 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d2097d7f-eac1-448f-b558-bb27f14f59de tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:51.902588 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7508d46f-6dee-4308-80fe-1d36cbf4aa7c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23" status: 200 len: 1452 microversion: 2.1 time: 0.105564 May 28 04:36:51.903717 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 438/776] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:51 2022] GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23 => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:51.920074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d2097d7f-eac1-448f-b558-bb27f14f59de tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:51.931753 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d2097d7f-eac1-448f-b558-bb27f14f59de tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1277 microversion: 2.1 time: 0.132298 May 28 04:36:51.976760 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 339/777] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:51 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:52.247427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2bd58386-7645-4dd2-82f4-1a2acc65bf45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:52.250272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2bd58386-7645-4dd2-82f4-1a2acc65bf45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:52.258411 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bd58386-7645-4dd2-82f4-1a2acc65bf45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:52.259616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bd58386-7645-4dd2-82f4-1a2acc65bf45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:52.260596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bd58386-7645-4dd2-82f4-1a2acc65bf45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:52.261271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bd58386-7645-4dd2-82f4-1a2acc65bf45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:52.545379 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2bd58386-7645-4dd2-82f4-1a2acc65bf45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:52.555775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2bd58386-7645-4dd2-82f4-1a2acc65bf45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:52.557747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2bd58386-7645-4dd2-82f4-1a2acc65bf45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:52.559648 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2bd58386-7645-4dd2-82f4-1a2acc65bf45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1567 microversion: 2.25 time: 0.321730 May 28 04:36:52.571295 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 439/778] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:52 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1567 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:52.815152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2c257b60-dfd8-4c02-8ee7-433901c1090d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:52.816546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fb5e0eb1-f53e-44b9-9a18-2b95a31e68bb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:52.817136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fb5e0eb1-f53e-44b9-9a18-2b95a31e68bb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:52.817557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2c257b60-dfd8-4c02-8ee7-433901c1090d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:52.843871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c257b60-dfd8-4c02-8ee7-433901c1090d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:52.848423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c257b60-dfd8-4c02-8ee7-433901c1090d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:52.848890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fb5e0eb1-f53e-44b9-9a18-2b95a31e68bb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:52.849728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fb5e0eb1-f53e-44b9-9a18-2b95a31e68bb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:52.852293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c257b60-dfd8-4c02-8ee7-433901c1090d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:52.853309 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fb5e0eb1-f53e-44b9-9a18-2b95a31e68bb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:52.854027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c257b60-dfd8-4c02-8ee7-433901c1090d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:52.854630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fb5e0eb1-f53e-44b9-9a18-2b95a31e68bb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:53.154393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fb5e0eb1-f53e-44b9-9a18-2b95a31e68bb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:53.164681 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fb5e0eb1-f53e-44b9-9a18-2b95a31e68bb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1495 microversion: 2.1 time: 0.358854 May 28 04:36:53.165921 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 340/779] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:52 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1495 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:53.169615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2c257b60-dfd8-4c02-8ee7-433901c1090d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:53.171500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-911af47c-f784-4560-bd4b-5fac4c81b4f5 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f77022f2d30>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:53.180987 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2c257b60-dfd8-4c02-8ee7-433901c1090d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1475 microversion: 2.1 time: 0.369323 May 28 04:36:53.190295 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 440/780] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:52 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1475 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:53.195611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6f24d63d-d2e2-422a-9da6-bc1178809e27 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:53.196402 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6f24d63d-d2e2-422a-9da6-bc1178809e27 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:53.203472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f24d63d-d2e2-422a-9da6-bc1178809e27 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:53.204109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f24d63d-d2e2-422a-9da6-bc1178809e27 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:53.205683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f24d63d-d2e2-422a-9da6-bc1178809e27 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:53.206128 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f24d63d-d2e2-422a-9da6-bc1178809e27 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:53.223028 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-911af47c-f784-4560-bd4b-5fac4c81b4f5 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23" status: 200 len: 1452 microversion: 2.1 time: 0.055837 May 28 04:36:53.223611 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 341/781] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:53 2022] GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23 => generated 1452 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:53.233038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6e3e4322-3c29-4c34-a444-b067be4bcdb4 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:53.233937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6e3e4322-3c29-4c34-a444-b067be4bcdb4 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:53.256459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6e3e4322-3c29-4c34-a444-b067be4bcdb4 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:53.257123 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6e3e4322-3c29-4c34-a444-b067be4bcdb4 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:53.258072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6e3e4322-3c29-4c34-a444-b067be4bcdb4 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:53.258683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6e3e4322-3c29-4c34-a444-b067be4bcdb4 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:53.521804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6f24d63d-d2e2-422a-9da6-bc1178809e27 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:53.530509 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6f24d63d-d2e2-422a-9da6-bc1178809e27 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1319 microversion: 2.1 time: 0.338870 May 28 04:36:53.535783 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 441/782] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:53 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:53.580632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-731ead3b-ff2e-4fe3-a0da-e06e81320e30 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:53.581307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-731ead3b-ff2e-4fe3-a0da-e06e81320e30 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:53.591206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-731ead3b-ff2e-4fe3-a0da-e06e81320e30 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:53.591618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-731ead3b-ff2e-4fe3-a0da-e06e81320e30 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:53.592503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-731ead3b-ff2e-4fe3-a0da-e06e81320e30 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:53.592938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-731ead3b-ff2e-4fe3-a0da-e06e81320e30 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:53.606849 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6e3e4322-3c29-4c34-a444-b067be4bcdb4 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1646 microversion: 2.1 time: 0.381157 May 28 04:36:53.621558 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 342/783] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:53 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1646 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:53.647403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1e6a7ef0-722c-45a6-9fe9-33ede566b01e tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:53.650523 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:36:53.650523 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:36:53.656069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e6a7ef0-722c-45a6-9fe9-33ede566b01e tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:53.657497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e6a7ef0-722c-45a6-9fe9-33ede566b01e tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:53.663574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e6a7ef0-722c-45a6-9fe9-33ede566b01e tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:53.665506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e6a7ef0-722c-45a6-9fe9-33ede566b01e tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:53.700808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:53.745151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:53.786833 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1e6a7ef0-722c-45a6-9fe9-33ede566b01e tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.151432 May 28 04:36:53.791948 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 343/784] 10.222.0.58 () {58 vars in 1175 bytes} [Sat May 28 04:36:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:54.000174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-731ead3b-ff2e-4fe3-a0da-e06e81320e30 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:54.016517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-731ead3b-ff2e-4fe3-a0da-e06e81320e30 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:54.021965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-731ead3b-ff2e-4fe3-a0da-e06e81320e30 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:54.024456 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-731ead3b-ff2e-4fe3-a0da-e06e81320e30 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1567 microversion: 2.25 time: 0.447867 May 28 04:36:54.048691 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 442/785] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:53 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1567 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:54.200170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1a6106ca-7dcb-4a73-b3bd-ac31aa24e1b3 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:54.200951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1a6106ca-7dcb-4a73-b3bd-ac31aa24e1b3 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:54.211837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a6106ca-7dcb-4a73-b3bd-ac31aa24e1b3 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:54.213353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a6106ca-7dcb-4a73-b3bd-ac31aa24e1b3 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:54.214345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a6106ca-7dcb-4a73-b3bd-ac31aa24e1b3 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:54.214960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a6106ca-7dcb-4a73-b3bd-ac31aa24e1b3 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:54.237516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5e7578c8-23f1-4a47-a7c0-a9b4ebe2574d tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701dfc5e0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:54.305029 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5e7578c8-23f1-4a47-a7c0-a9b4ebe2574d tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23" status: 200 len: 1452 microversion: 2.1 time: 0.072412 May 28 04:36:54.305547 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 443/786] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:54 2022] GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23 => generated 1452 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:54.373443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1a6106ca-7dcb-4a73-b3bd-ac31aa24e1b3 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:54.383120 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1a6106ca-7dcb-4a73-b3bd-ac31aa24e1b3 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1475 microversion: 2.1 time: 0.189351 May 28 04:36:54.383810 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 344/787] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:54 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1475 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:54.552696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f7a8b7f4-f1f6-44fb-b442-44058a631970 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:54.558749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f7a8b7f4-f1f6-44fb-b442-44058a631970 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:54.572019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7a8b7f4-f1f6-44fb-b442-44058a631970 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:54.572468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7a8b7f4-f1f6-44fb-b442-44058a631970 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:54.573246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7a8b7f4-f1f6-44fb-b442-44058a631970 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:54.573681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7a8b7f4-f1f6-44fb-b442-44058a631970 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:54.703228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f7a8b7f4-f1f6-44fb-b442-44058a631970 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:54.711575 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f7a8b7f4-f1f6-44fb-b442-44058a631970 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1319 microversion: 2.1 time: 0.163395 May 28 04:36:54.712428 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 444/788] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:54 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:54.790637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-8442fd38-d45c-475c-ad54-69a22564c696 req-fff1a83c-dd15-484a-bd77-7d5ffa1f0e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55", "tag": "582316da-a3d2-440b-8d46-061a2a605695"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:54.820951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8442fd38-d45c-475c-ad54-69a22564c696 req-fff1a83c-dd15-484a-bd77-7d5ffa1f0e02 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:54.822338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8442fd38-d45c-475c-ad54-69a22564c696 req-fff1a83c-dd15-484a-bd77-7d5ffa1f0e02 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:54.863945 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-8442fd38-d45c-475c-ad54-69a22564c696 req-fff1a83c-dd15-484a-bd77-7d5ffa1f0e02 service nova] Creating event network-changed:582316da-a3d2-440b-8d46-061a2a605695 for instance 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 on n-h1-843700-1 May 28 04:36:54.879423 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-8442fd38-d45c-475c-ad54-69a22564c696 req-fff1a83c-dd15-484a-bd77-7d5ffa1f0e02 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099256 May 28 04:36:54.884970 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 345/789] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:55.071961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-380c1fa6-8c9d-4592-b870-a6e0565b4af8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:55.071961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-380c1fa6-8c9d-4592-b870-a6e0565b4af8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:55.071961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:55.080916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-380c1fa6-8c9d-4592-b870-a6e0565b4af8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:55.081327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-380c1fa6-8c9d-4592-b870-a6e0565b4af8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:55.082113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-380c1fa6-8c9d-4592-b870-a6e0565b4af8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:55.082555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-380c1fa6-8c9d-4592-b870-a6e0565b4af8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:55.321767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cb5ee37e-a554-4552-b9f1-4cc54bd43167 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f77021fb310>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:55.342976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-380c1fa6-8c9d-4592-b870-a6e0565b4af8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:55.353252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-380c1fa6-8c9d-4592-b870-a6e0565b4af8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:55.355203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-380c1fa6-8c9d-4592-b870-a6e0565b4af8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:55.356648 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-380c1fa6-8c9d-4592-b870-a6e0565b4af8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1567 microversion: 2.25 time: 0.295528 May 28 04:36:55.357404 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 445/790] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:55 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1567 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:55.401734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8553616c-e6c4-4e39-8e14-9ca88b8a2439 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:55.402395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8553616c-e6c4-4e39-8e14-9ca88b8a2439 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:55.408542 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cb5ee37e-a554-4552-b9f1-4cc54bd43167 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23" status: 200 len: 1452 microversion: 2.1 time: 0.092213 May 28 04:36:55.409192 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 346/791] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:55 2022] GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23 => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:55.423591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8553616c-e6c4-4e39-8e14-9ca88b8a2439 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:55.424211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8553616c-e6c4-4e39-8e14-9ca88b8a2439 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:55.425185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8553616c-e6c4-4e39-8e14-9ca88b8a2439 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:55.425703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8553616c-e6c4-4e39-8e14-9ca88b8a2439 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:55.729242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8553616c-e6c4-4e39-8e14-9ca88b8a2439 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:55.729873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7c6ec82c-5f32-4655-954c-c14fa3c91aaa tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:55.730274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7c6ec82c-5f32-4655-954c-c14fa3c91aaa tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:55.741675 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8553616c-e6c4-4e39-8e14-9ca88b8a2439 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1475 microversion: 2.1 time: 0.343935 May 28 04:36:55.742588 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 446/792] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:55 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1475 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:55.754331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c6ec82c-5f32-4655-954c-c14fa3c91aaa tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:55.755056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c6ec82c-5f32-4655-954c-c14fa3c91aaa tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:55.757439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c6ec82c-5f32-4655-954c-c14fa3c91aaa tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:55.758232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c6ec82c-5f32-4655-954c-c14fa3c91aaa tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:55.968116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7c6ec82c-5f32-4655-954c-c14fa3c91aaa tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:55.976152 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7c6ec82c-5f32-4655-954c-c14fa3c91aaa tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1319 microversion: 2.1 time: 0.251246 May 28 04:36:55.976726 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 347/793] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:55 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:56.377416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bfc95075-96e9-4d48-a8df-3ecc0ee7d606 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:56.378320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bfc95075-96e9-4d48-a8df-3ecc0ee7d606 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:56.386253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfc95075-96e9-4d48-a8df-3ecc0ee7d606 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:56.387277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfc95075-96e9-4d48-a8df-3ecc0ee7d606 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:56.388539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfc95075-96e9-4d48-a8df-3ecc0ee7d606 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:56.389193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfc95075-96e9-4d48-a8df-3ecc0ee7d606 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:56.422599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8cbcc977-7f06-4380-b053-c6829fdeb8a9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e57d30>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:56.492117 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8cbcc977-7f06-4380-b053-c6829fdeb8a9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23" status: 200 len: 1461 microversion: 2.1 time: 0.074733 May 28 04:36:56.500158 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 348/794] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:56 2022] GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23 => generated 1461 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:56.509740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ece6c51f-2afc-42b1-abf9-0919f7c53773 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f77022f2b80>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:56.601468 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ece6c51f-2afc-42b1-abf9-0919f7c53773 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23" status: 200 len: 1461 microversion: 2.1 time: 0.099916 May 28 04:36:56.605891 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 349/795] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:36:56 2022] GET /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23 => generated 1461 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:56.614952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d99c86dc-a165-40c8-9b83-02df6c89eedf tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:56.617733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d99c86dc-a165-40c8-9b83-02df6c89eedf tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: a27b8082-4f44-4263-a6a2-86291ea3950b] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:56.633536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d99c86dc-a165-40c8-9b83-02df6c89eedf tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:56.636040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d99c86dc-a165-40c8-9b83-02df6c89eedf tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:56.637657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d99c86dc-a165-40c8-9b83-02df6c89eedf tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:56.639195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d99c86dc-a165-40c8-9b83-02df6c89eedf tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:56.646765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bfc95075-96e9-4d48-a8df-3ecc0ee7d606 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:56.662820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bfc95075-96e9-4d48-a8df-3ecc0ee7d606 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:56.664688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bfc95075-96e9-4d48-a8df-3ecc0ee7d606 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:56.665834 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bfc95075-96e9-4d48-a8df-3ecc0ee7d606 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1567 microversion: 2.25 time: 0.294117 May 28 04:36:56.671224 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 447/796] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:56 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1567 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:56.763076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-643145a2-678f-4197-9925-00e543b52423 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:56.764499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-643145a2-678f-4197-9925-00e543b52423 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:56.774401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-643145a2-678f-4197-9925-00e543b52423 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:56.775182 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-643145a2-678f-4197-9925-00e543b52423 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:56.776180 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-643145a2-678f-4197-9925-00e543b52423 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:56.776942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-643145a2-678f-4197-9925-00e543b52423 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:57.052940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d99c86dc-a165-40c8-9b83-02df6c89eedf tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:57.067595 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d99c86dc-a165-40c8-9b83-02df6c89eedf tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b" status: 200 len: 1481 microversion: 2.1 time: 0.456206 May 28 04:36:57.070016 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 350/797] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:56 2022] GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b => generated 1481 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:57.085229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3c16c379-c881-40da-9f20-403cbb5b92f2 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:57.087138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3c16c379-c881-40da-9f20-403cbb5b92f2 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:57.096895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c16c379-c881-40da-9f20-403cbb5b92f2 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:57.099128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c16c379-c881-40da-9f20-403cbb5b92f2 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:57.099128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c16c379-c881-40da-9f20-403cbb5b92f2 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:57.099128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c16c379-c881-40da-9f20-403cbb5b92f2 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:57.157950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-643145a2-678f-4197-9925-00e543b52423 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:57.166449 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-643145a2-678f-4197-9925-00e543b52423 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1474 microversion: 2.1 time: 0.410127 May 28 04:36:57.167242 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 448/798] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:56 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1474 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:57.351224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3c16c379-c881-40da-9f20-403cbb5b92f2 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:57.359114 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3c16c379-c881-40da-9f20-403cbb5b92f2 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1319 microversion: 2.1 time: 0.283383 May 28 04:36:57.359682 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 351/799] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:57 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:57.368914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-98d59a5e-6c59-4a04-a291-455b6301548d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1016457546", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:57.438293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-98d59a5e-6c59-4a04-a291-455b6301548d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:36:57.528962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-1133a0c6-dd53-49cb-96df-a27a79637c53 req-7f0123b7-452a-4296-9b9b-b2fed2b10573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87cc4d83-fd02-4a96-a640-3cad08bba4f4", "name": "network-vif-unplugged", "status": "completed", "tag": "47bf89ee-9954-4b95-8607-a086661df3bd"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:57.538068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1133a0c6-dd53-49cb-96df-a27a79637c53 req-7f0123b7-452a-4296-9b9b-b2fed2b10573 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:57.538775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1133a0c6-dd53-49cb-96df-a27a79637c53 req-7f0123b7-452a-4296-9b9b-b2fed2b10573 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:57.552809 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-1133a0c6-dd53-49cb-96df-a27a79637c53 req-7f0123b7-452a-4296-9b9b-b2fed2b10573 service nova] Creating event network-vif-unplugged:47bf89ee-9954-4b95-8607-a086661df3bd for instance 87cc4d83-fd02-4a96-a640-3cad08bba4f4 on n-h2-843700-1 May 28 04:36:57.560526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-1133a0c6-dd53-49cb-96df-a27a79637c53 req-7f0123b7-452a-4296-9b9b-b2fed2b10573 service nova] Instance 87cc4d83-fd02-4a96-a640-3cad08bba4f4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:36:57.573881 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-1133a0c6-dd53-49cb-96df-a27a79637c53 req-7f0123b7-452a-4296-9b9b-b2fed2b10573 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048599 May 28 04:36:57.574961 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 352/800] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:36:57.698117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4f6a46ca-c5fd-4e57-9c78-756aea87ffd5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:57.699095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4f6a46ca-c5fd-4e57-9c78-756aea87ffd5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:57.707090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4f6a46ca-c5fd-4e57-9c78-756aea87ffd5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:57.707557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4f6a46ca-c5fd-4e57-9c78-756aea87ffd5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:57.708339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4f6a46ca-c5fd-4e57-9c78-756aea87ffd5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:57.708780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4f6a46ca-c5fd-4e57-9c78-756aea87ffd5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:57.769658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-98d59a5e-6c59-4a04-a291-455b6301548d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:36:57.788319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-98d59a5e-6c59-4a04-a291-455b6301548d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:36:57.788319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-98d59a5e-6c59-4a04-a291-455b6301548d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:36:57.788319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-98d59a5e-6c59-4a04-a291-455b6301548d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:36:57.788319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-98d59a5e-6c59-4a04-a291-455b6301548d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:36:57.794099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-98d59a5e-6c59-4a04-a291-455b6301548d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:57.794566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-98d59a5e-6c59-4a04-a291-455b6301548d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:57.795404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-98d59a5e-6c59-4a04-a291-455b6301548d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:57.795841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-98d59a5e-6c59-4a04-a291-455b6301548d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:57.841779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-98d59a5e-6c59-4a04-a291-455b6301548d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Getting quotas for project 7c84426a50904071bfa68e7529a40945. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:36:57.865017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-98d59a5e-6c59-4a04-a291-455b6301548d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Getting quotas for user e75ff372428143249395a635a1766f9f and project 7c84426a50904071bfa68e7529a40945. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:36:57.883729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-98d59a5e-6c59-4a04-a291-455b6301548d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:36:57.886309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-98d59a5e-6c59-4a04-a291-455b6301548d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:36:58.064461 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-98d59a5e-6c59-4a04-a291-455b6301548d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.895396 May 28 04:36:58.065291 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 449/801] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:36:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:36:58.075489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-08bca592-962c-42c3-ad68-2e239cb93541 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:58.076341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-08bca592-962c-42c3-ad68-2e239cb93541 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:58.112029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4f6a46ca-c5fd-4e57-9c78-756aea87ffd5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:58.150449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4f6a46ca-c5fd-4e57-9c78-756aea87ffd5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:58.174250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4f6a46ca-c5fd-4e57-9c78-756aea87ffd5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:58.178027 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4f6a46ca-c5fd-4e57-9c78-756aea87ffd5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1567 microversion: 2.25 time: 0.492246 May 28 04:36:58.184664 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 353/802] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:57 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1567 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:36:58.197326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b9fc7ffd-92a5-4309-a46d-97440091a09c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:58.202026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b9fc7ffd-92a5-4309-a46d-97440091a09c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: a27b8082-4f44-4263-a6a2-86291ea3950b] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:58.217032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9fc7ffd-92a5-4309-a46d-97440091a09c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:58.219760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9fc7ffd-92a5-4309-a46d-97440091a09c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:58.223848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9fc7ffd-92a5-4309-a46d-97440091a09c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:58.223848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9fc7ffd-92a5-4309-a46d-97440091a09c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:58.231397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-08bca592-962c-42c3-ad68-2e239cb93541 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:58.240129 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-08bca592-962c-42c3-ad68-2e239cb93541 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d" status: 200 len: 1222 microversion: 2.1 time: 0.168767 May 28 04:36:58.244060 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 450/803] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:58 2022] GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d => generated 1222 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:58.445071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-54c73fd9-50fc-4e0a-b123-df72e790d941 tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Calling method '.version_select at 0x7f7701e96dc0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:58.523372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b9fc7ffd-92a5-4309-a46d-97440091a09c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:58.535221 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b9fc7ffd-92a5-4309-a46d-97440091a09c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b" status: 200 len: 1468 microversion: 2.1 time: 0.345665 May 28 04:36:58.535838 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 354/804] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:58 2022] GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b => generated 1468 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:58.541265 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7c6e7b83-285e-403f-8248-be5768518a75 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:58.541878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7c6e7b83-285e-403f-8248-be5768518a75 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:58.561132 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c6e7b83-285e-403f-8248-be5768518a75 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:58.566972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c6e7b83-285e-403f-8248-be5768518a75 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:58.567800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c6e7b83-285e-403f-8248-be5768518a75 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:58.568240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c6e7b83-285e-403f-8248-be5768518a75 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:58.597452 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-54c73fd9-50fc-4e0a-b123-df72e790d941 tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00" status: 200 len: 371 microversion: 2.1 time: 0.351901 May 28 04:36:58.614452 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 451/805] 10.222.0.58 () {58 vars in 1241 bytes} [Sat May 28 04:36:58 2022] GET /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00 => generated 371 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:58.622579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-db944089-0c96-43ef-a4f9-2a43cb14cf6c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:58.627762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-db944089-0c96-43ef-a4f9-2a43cb14cf6c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:58.643754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db944089-0c96-43ef-a4f9-2a43cb14cf6c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:58.644501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db944089-0c96-43ef-a4f9-2a43cb14cf6c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:58.645607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db944089-0c96-43ef-a4f9-2a43cb14cf6c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:58.646197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db944089-0c96-43ef-a4f9-2a43cb14cf6c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:58.793541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7c6e7b83-285e-403f-8248-be5768518a75 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:58.819570 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7c6e7b83-285e-403f-8248-be5768518a75 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1474 microversion: 2.1 time: 0.280966 May 28 04:36:58.832459 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 355/806] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:58 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1474 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:58.838541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d32851d9-18cb-4d35-81f2-e5ea8001cdf2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f77022f28b0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:58.870589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-db944089-0c96-43ef-a4f9-2a43cb14cf6c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:58.880745 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-db944089-0c96-43ef-a4f9-2a43cb14cf6c tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1319 microversion: 2.1 time: 0.265033 May 28 04:36:58.890779 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 452/807] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:58 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:58.896122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-893279dd-ff9e-47e3-953d-c549e780cb5c tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Action: 'update', calling method: .version_select at 0x7f7701e4e9d0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:58.975793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-893279dd-ff9e-47e3-953d-c549e780cb5c tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:58.976267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-893279dd-ff9e-47e3-953d-c549e780cb5c tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:58.977147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-893279dd-ff9e-47e3-953d-c549e780cb5c tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:58.977598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-893279dd-ff9e-47e3-953d-c549e780cb5c tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:58.997540 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d32851d9-18cb-4d35-81f2-e5ea8001cdf2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images?changes-since=2022-05-28T04%3A35%3A07Z" status: 200 len: 2376 microversion: 2.1 time: 0.171245 May 28 04:36:58.999076 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 356/808] 10.222.0.58 () {58 vars in 1198 bytes} [Sat May 28 04:36:58 2022] GET /compute/v2.1/images?changes-since=2022-05-28T04%3A35%3A07Z => generated 2376 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:59.012810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d83a40ea-a16c-4c5a-bcb9-63f8ba5db8b9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f77021cf430>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:59.127499 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d83a40ea-a16c-4c5a-bcb9-63f8ba5db8b9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-278689042" status: 200 len: 484 microversion: 2.1 time: 0.118366 May 28 04:36:59.128842 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 357/809] 10.222.0.58 () {58 vars in 1228 bytes} [Sat May 28 04:36:59 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-278689042 => generated 484 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:59.140007 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-557961d1-01e3-4ff8-945b-e85e37a6b69d tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701fb3e50>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:59.146501 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-893279dd-ff9e-47e3-953d-c549e780cb5c tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00" status: 200 len: 328 microversion: 2.1 time: 0.254362 May 28 04:36:59.148008 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 453/810] 10.222.0.58 () {60 vars in 1261 bytes} [Sat May 28 04:36:58 2022] PUT /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00 => generated 328 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:59.199684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-296af3c6-aa5b-4d95-91ce-cc2c1c570684 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:59.200582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-296af3c6-aa5b-4d95-91ce-cc2c1c570684 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:59.213070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-296af3c6-aa5b-4d95-91ce-cc2c1c570684 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:59.213694 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-296af3c6-aa5b-4d95-91ce-cc2c1c570684 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:59.214338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-296af3c6-aa5b-4d95-91ce-cc2c1c570684 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:59.214783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-296af3c6-aa5b-4d95-91ce-cc2c1c570684 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:59.257631 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-557961d1-01e3-4ff8-945b-e85e37a6b69d tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images?server=a27b8082-4f44-4263-a6a2-86291ea3950b" status: 200 len: 957 microversion: 2.1 time: 0.121748 May 28 04:36:59.258832 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 358/811] 10.222.0.58 () {58 vars in 1208 bytes} [Sat May 28 04:36:59 2022] GET /compute/v2.1/images?server=a27b8082-4f44-4263-a6a2-86291ea3950b => generated 957 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:36:59.260725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=24 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:36:59.265376 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b1ac113f-1ae2-417e-831c-25cfff8ac790 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:59.266241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b1ac113f-1ae2-417e-831c-25cfff8ac790 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:59.352581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b1ac113f-1ae2-417e-831c-25cfff8ac790 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:59.364992 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b1ac113f-1ae2-417e-831c-25cfff8ac790 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d" status: 200 len: 1222 microversion: 2.1 time: 0.104774 May 28 04:36:59.375675 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 359/812] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:59 2022] GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d => generated 1222 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:59.383487 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dd438b84-8e56-4fa6-9ec2-fd61534b62ad tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f77021fba60>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:59.398239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-296af3c6-aa5b-4d95-91ce-cc2c1c570684 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:59.412678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-296af3c6-aa5b-4d95-91ce-cc2c1c570684 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:59.414706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-296af3c6-aa5b-4d95-91ce-cc2c1c570684 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:36:59.416628 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-296af3c6-aa5b-4d95-91ce-cc2c1c570684 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1567 microversion: 2.25 time: 0.220730 May 28 04:36:59.417846 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 454/813] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:36:59 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:36:59.443792 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dd438b84-8e56-4fa6-9ec2-fd61534b62ad tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2F9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 485 microversion: 2.1 time: 0.065405 May 28 04:36:59.446424 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 360/814] 10.222.0.58 () {58 vars in 1316 bytes} [Sat May 28 04:36:59 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2F9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 485 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:59.455878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cc8917d3-3392-4260-b7ec-68b44712e8a2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f77021a0d30>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:59.486351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dc291140-e883-45c5-8c3a-e07dd52b527b tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-735652502", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:59.535417 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cc8917d3-3392-4260-b7ec-68b44712e8a2 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2F9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 485 microversion: 2.1 time: 0.083421 May 28 04:36:59.536047 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 361/815] 10.222.0.58 () {58 vars in 1302 bytes} [Sat May 28 04:36:59 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2F9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 485 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:36:59.548541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-99f0307e-a241-480b-b32b-c858891d2238 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701fd4e50>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:59.549194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-dc291140-e883-45c5-8c3a-e07dd52b527b tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:36:59.668537 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-99f0307e-a241-480b-b32b-c858891d2238 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.124786 May 28 04:36:59.670231 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 362/816] 10.222.0.58 () {58 vars in 1148 bytes} [Sat May 28 04:36:59 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:36:59.681382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-9e89faae-405c-4607-b3fa-6a2e7af19726 req-683604dd-7487-4537-8209-0ff2a74572cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87cc4d83-fd02-4a96-a640-3cad08bba4f4", "tag": "47bf89ee-9954-4b95-8607-a086661df3bd"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:59.701581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9e89faae-405c-4607-b3fa-6a2e7af19726 req-683604dd-7487-4537-8209-0ff2a74572cc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:59.702087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9e89faae-405c-4607-b3fa-6a2e7af19726 req-683604dd-7487-4537-8209-0ff2a74572cc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:59.720802 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-9e89faae-405c-4607-b3fa-6a2e7af19726 req-683604dd-7487-4537-8209-0ff2a74572cc service nova] Creating event network-changed:47bf89ee-9954-4b95-8607-a086661df3bd for instance 87cc4d83-fd02-4a96-a640-3cad08bba4f4 on n-h2-843700-1 May 28 04:36:59.727256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-9e89faae-405c-4607-b3fa-6a2e7af19726 req-683604dd-7487-4537-8209-0ff2a74572cc service nova] Instance 87cc4d83-fd02-4a96-a640-3cad08bba4f4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:36:59.739230 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-9e89faae-405c-4607-b3fa-6a2e7af19726 req-683604dd-7487-4537-8209-0ff2a74572cc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068627 May 28 04:36:59.739841 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 363/817] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:36:59.745774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4343a013-b942-4594-a84a-3c248b8e9e51 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7702695310>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:59.774599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-dc291140-e883-45c5-8c3a-e07dd52b527b tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:36:59.775257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-dc291140-e883-45c5-8c3a-e07dd52b527b tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:36:59.776550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-dc291140-e883-45c5-8c3a-e07dd52b527b tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:36:59.777003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-dc291140-e883-45c5-8c3a-e07dd52b527b tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:36:59.777421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-dc291140-e883-45c5-8c3a-e07dd52b527b tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:36:59.787047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc291140-e883-45c5-8c3a-e07dd52b527b tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:59.787713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc291140-e883-45c5-8c3a-e07dd52b527b tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:59.791845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc291140-e883-45c5-8c3a-e07dd52b527b tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:59.791845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc291140-e883-45c5-8c3a-e07dd52b527b tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:59.815194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-dc291140-e883-45c5-8c3a-e07dd52b527b tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Getting quotas for project d536d66baf3941bc84a237c99edb7a00. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:36:59.821274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-dc291140-e883-45c5-8c3a-e07dd52b527b tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Getting quotas for user 1726d6e2f76f40dfa2a9e91fe1344534 and project d536d66baf3941bc84a237c99edb7a00. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:36:59.833987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.utils [None req-dc291140-e883-45c5-8c3a-e07dd52b527b tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] cores quota exceeded for d536d66baf3941bc84a237c99edb7a00, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126044) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 28 04:36:59.835107 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-dc291140-e883-45c5-8c3a-e07dd52b527b tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dc291140-e883-45c5-8c3a-e07dd52b527b tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Request method failure captured: May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 144 May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikabojRjguT_56X1WajLGnVsC77WJubhyHyX9osQ3Dq2b32zeOMrz0kKuh2oM8XOA0N-l8gpOu46I7bp0Jt8LdfHUQahVQ6wlNTUvazGvKES6W1TZpXMBHQY8odNgK1vqntGChdd0VzhEClSaMi9n71kHGcbipFJPxr27jwMQ4TqWfwE May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d536d66baf3941bc84a237c99edb7a00 May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-QuotasAdminNegativeTest-1200191221 May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:36:59.840409 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:36:59.841830 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d536d66baf3941bc84a237c99edb7a00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d536d66baf3941bc84a237c99edb7a00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d536d66baf3941bc84a237c99edb7a00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d536d66baf3941bc84a237c99edb7a00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:36:59.841830 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-QuotasAdminNegativeTest-1200191221 May 28 04:36:59.841830 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d536d66baf3941bc84a237c99edb7a00 May 28 04:36:59.841830 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1200191221 May 28 04:36:59.841830 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-QuotasAdminNegativeTest-1200191221-project May 28 04:36:59.841830 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:36:59.841830 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:36:59.841830 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 1726d6e2f76f40dfa2a9e91fe1344534 May 28 04:36:59.841830 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-QuotasAdminNegativeTest-1200191221-project May 28 04:36:59.841830 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:36:59.841830 n-d-843700-1 devstack@n-api.service[126044]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-735652502", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} May 28 04:36:59.841830 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:36:59.842843 n-d-843700-1 devstack@n-api.service[126044]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 28 04:36:59.842843 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-735652502', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452'}}} May 28 04:36:59.842843 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:36:59.842843 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:36:59.842843 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 28 04:36:59.842843 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 28 04:36:59.842843 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:36:59.842843 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:36:59.842843 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 28 04:36:59.842843 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc May 28 04:36:59.842843 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 28 04:36:59.842843 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 28 04:36:59.842843 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:36:59.842843 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:36:59.842843 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 28 04:36:59.842843 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 28 04:36:59.842843 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 28 04:36:59.842843 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._create_instance( May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:36:59.844174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:36:59.846495 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:36:59.854366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:36:59.854366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:36:59.854366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:36:59.854366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:36:59.854366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 28 04:36:59.854366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:36:59.854366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dc291140-e883-45c5-8c3a-e07dd52b527b tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:36:59.854366 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dc291140-e883-45c5-8c3a-e07dd52b527b tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.430198 May 28 04:36:59.855287 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 455/818] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:36:59 2022] POST /compute/v2.1/servers => generated 111 bytes in 437 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:36:59.861698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-419776a7-31a6-44b5-a190-a3085f1070dc tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:36:59.862597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-419776a7-31a6-44b5-a190-a3085f1070dc tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:36:59.869623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-419776a7-31a6-44b5-a190-a3085f1070dc tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:59.870298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-419776a7-31a6-44b5-a190-a3085f1070dc tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:59.871849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-419776a7-31a6-44b5-a190-a3085f1070dc tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:36:59.873075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-419776a7-31a6-44b5-a190-a3085f1070dc tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:36:59.884871 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4343a013-b942-4594-a84a-3c248b8e9e51 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.143632 May 28 04:36:59.885538 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 364/819] 10.222.0.58 () {58 vars in 1148 bytes} [Sat May 28 04:36:59 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:36:59.890515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f8d53384-c727-4164-a87e-afdc5bfe508f tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Action: 'update', calling method: .version_select at 0x7f77022f2dc0>, body: {"quota_set": {"cores": 20}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:36:59.998189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8d53384-c727-4164-a87e-afdc5bfe508f tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:00.002385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8d53384-c727-4164-a87e-afdc5bfe508f tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:00.007055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8d53384-c727-4164-a87e-afdc5bfe508f tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:00.007910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8d53384-c727-4164-a87e-afdc5bfe508f tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:00.113222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-419776a7-31a6-44b5-a190-a3085f1070dc tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:00.119863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:00.125389 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-419776a7-31a6-44b5-a190-a3085f1070dc tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1472 microversion: 2.1 time: 0.268522 May 28 04:37:00.137860 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 456/820] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:36:59 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1472 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:00.145552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2e0e26c2-3d44-443b-b8bd-1d6e50e1fd0a tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701de5d30>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:00.240156 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2e0e26c2-3d44-443b-b8bd-1d6e50e1fd0a tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.101162 May 28 04:37:00.240744 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 457/821] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:37:00 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:00.245374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b1a938f8-d8f4-4f00-b04f-69a5351d9fff tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:00.245999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b1a938f8-d8f4-4f00-b04f-69a5351d9fff tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:00.251483 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f8d53384-c727-4164-a87e-afdc5bfe508f tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00" status: 200 len: 329 microversion: 2.1 time: 0.364770 May 28 04:37:00.259350 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 365/822] 10.222.0.58 () {60 vars in 1261 bytes} [Sat May 28 04:36:59 2022] PUT /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00 => generated 329 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:00.259593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1a938f8-d8f4-4f00-b04f-69a5351d9fff tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:00.259593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1a938f8-d8f4-4f00-b04f-69a5351d9fff tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:00.259593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1a938f8-d8f4-4f00-b04f-69a5351d9fff tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:00.259593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1a938f8-d8f4-4f00-b04f-69a5351d9fff tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:00.259874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2a39c539-67cc-40d9-bdc8-32de61775394 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5452aff9-3213-4393-945d-6b7505959125", "device": "/dev/xvdb"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:00.262207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2a39c539-67cc-40d9-bdc8-32de61775394 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:00.272311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a39c539-67cc-40d9-bdc8-32de61775394 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:00.272777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a39c539-67cc-40d9-bdc8-32de61775394 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:00.273552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a39c539-67cc-40d9-bdc8-32de61775394 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:00.274401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a39c539-67cc-40d9-bdc8-32de61775394 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:00.448160 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b1a938f8-d8f4-4f00-b04f-69a5351d9fff tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:00.458129 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b1a938f8-d8f4-4f00-b04f-69a5351d9fff tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1319 microversion: 2.1 time: 0.216375 May 28 04:37:00.459038 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 458/823] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:00 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:00.464600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-911aabf4-d2c2-4209-9dfc-9fd81294e64c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f77022ea700>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:00.569650 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-911aabf4-d2c2-4209-9dfc-9fd81294e64c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/detail?changes-since=2022-05-28T04%3A35%3A03Z" status: 200 len: 6328 microversion: 2.1 time: 0.109364 May 28 04:37:00.570247 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 459/824] 10.222.0.58 () {58 vars in 1219 bytes} [Sat May 28 04:37:00 2022] GET /compute/v2.1/images/detail?changes-since=2022-05-28T04%3A35%3A03Z => generated 6328 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:00.574858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0b5565b0-31b6-4652-8ad4-1da0117aa889 tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Calling method '.version_select at 0x7f7701e4e1f0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:00.639878 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0b5565b0-31b6-4652-8ad4-1da0117aa889 tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00" status: 200 len: 371 microversion: 2.1 time: 0.068473 May 28 04:37:00.640469 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 460/825] 10.222.0.58 () {58 vars in 1241 bytes} [Sat May 28 04:37:00 2022] GET /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00 => generated 371 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:00.645577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-03047408-3736-4060-83b9-5aa8f31f0b1f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:00.646254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-03047408-3736-4060-83b9-5aa8f31f0b1f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:00.652313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03047408-3736-4060-83b9-5aa8f31f0b1f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:00.658337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03047408-3736-4060-83b9-5aa8f31f0b1f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:00.658337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03047408-3736-4060-83b9-5aa8f31f0b1f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:00.658337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03047408-3736-4060-83b9-5aa8f31f0b1f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:00.715308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-03047408-3736-4060-83b9-5aa8f31f0b1f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:00.722828 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-03047408-3736-4060-83b9-5aa8f31f0b1f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d" status: 200 len: 1274 microversion: 2.1 time: 0.081402 May 28 04:37:00.723430 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 461/826] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:00 2022] GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d => generated 1274 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:00.728349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2c6084fa-4d5a-411d-919e-7412dfc708ba tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:00.728966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2c6084fa-4d5a-411d-919e-7412dfc708ba tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:00.734788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c6084fa-4d5a-411d-919e-7412dfc708ba tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:00.735770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c6084fa-4d5a-411d-919e-7412dfc708ba tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:00.736550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c6084fa-4d5a-411d-919e-7412dfc708ba tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:00.737000 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c6084fa-4d5a-411d-919e-7412dfc708ba tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:00.864364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2c6084fa-4d5a-411d-919e-7412dfc708ba tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:00.872537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2c6084fa-4d5a-411d-919e-7412dfc708ba tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:00.874055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2c6084fa-4d5a-411d-919e-7412dfc708ba tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:00.875269 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2c6084fa-4d5a-411d-919e-7412dfc708ba tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1557 microversion: 2.25 time: 0.150884 May 28 04:37:00.875857 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 462/827] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:00 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:00.880975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dd98ec3e-e71c-4afc-bb11-2cf20996eb1a tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f770203c4c0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:00.953708 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dd98ec3e-e71c-4afc-bb11-2cf20996eb1a tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-278689042" status: 200 len: 664 microversion: 2.1 time: 0.076215 May 28 04:37:00.954291 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 463/828] 10.222.0.58 () {58 vars in 1249 bytes} [Sat May 28 04:37:00 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-278689042 => generated 664 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:00.958880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-02b35166-622e-47f7-a74e-d72d30bc16fa tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Action: 'update', calling method: .version_select at 0x7f770200adc0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:01.020926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02b35166-622e-47f7-a74e-d72d30bc16fa tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:01.021384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02b35166-622e-47f7-a74e-d72d30bc16fa tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:01.022193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02b35166-622e-47f7-a74e-d72d30bc16fa tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:01.022634 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02b35166-622e-47f7-a74e-d72d30bc16fa tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:01.128174 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-02b35166-622e-47f7-a74e-d72d30bc16fa tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00" status: 200 len: 328 microversion: 2.1 time: 0.172753 May 28 04:37:01.129053 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 464/829] 10.222.0.58 () {60 vars in 1261 bytes} [Sat May 28 04:37:00 2022] PUT /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00 => generated 328 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:01.134001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d9a58e8c-10f9-404c-bc53-7034bc36a379 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '.version_select at 0x7f770212a1f0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:01.137069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9a58e8c-10f9-404c-bc53-7034bc36a379 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:01.139486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9a58e8c-10f9-404c-bc53-7034bc36a379 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:01.156864 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d9a58e8c-10f9-404c-bc53-7034bc36a379 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 2370 microversion: 2.25 time: 0.026462 May 28 04:37:01.165603 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 465/830] 10.222.0.58 () {60 vars in 1183 bytes} [Sat May 28 04:37:01 2022] GET /compute/v2.1/os-migrations => generated 2370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:01.165603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ed7450ad-3725-43de-98e7-c2b5bcd3d25a tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f770212ad30>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:01.216443 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ed7450ad-3725-43de-98e7-c2b5bcd3d25a tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2F9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 1465 microversion: 2.1 time: 0.056986 May 28 04:37:01.219365 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 466/831] 10.222.0.58 () {58 vars in 1337 bytes} [Sat May 28 04:37:01 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2F9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 1465 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:01.228414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5d0f906b-13ca-448a-b3fc-5a8f839e60f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:01.229188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5d0f906b-13ca-448a-b3fc-5a8f839e60f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:01.236937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d0f906b-13ca-448a-b3fc-5a8f839e60f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:01.237395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d0f906b-13ca-448a-b3fc-5a8f839e60f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:01.238296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d0f906b-13ca-448a-b3fc-5a8f839e60f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:01.238740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d0f906b-13ca-448a-b3fc-5a8f839e60f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:01.647787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5d0f906b-13ca-448a-b3fc-5a8f839e60f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:01.655861 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5d0f906b-13ca-448a-b3fc-5a8f839e60f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1472 microversion: 2.1 time: 0.434765 May 28 04:37:01.656446 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 467/832] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:01 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1472 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:01.661649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-940350f3-c316-411e-9956-5684f6da3d4f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:01.662263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-940350f3-c316-411e-9956-5684f6da3d4f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:01.668827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-940350f3-c316-411e-9956-5684f6da3d4f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:01.669782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-940350f3-c316-411e-9956-5684f6da3d4f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:01.670566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-940350f3-c316-411e-9956-5684f6da3d4f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:01.671213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-940350f3-c316-411e-9956-5684f6da3d4f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:01.869805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-940350f3-c316-411e-9956-5684f6da3d4f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lazy-loading 'services' on Instance uuid f64917b4-0e1c-4354-b5e5-e2925b14a602 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:37:01.884722 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-940350f3-c316-411e-9956-5684f6da3d4f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 2049 microversion: 2.25 time: 0.227237 May 28 04:37:01.889118 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 468/833] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:01 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 2049 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:01.905103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0b592d74-fe64-4fe6-beb4-01bbb19dc121 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-343608801", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:01.991723 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-0b592d74-fe64-4fe6-beb4-01bbb19dc121 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:37:02.220726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-0b592d74-fe64-4fe6-beb4-01bbb19dc121 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:37:02.221154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-0b592d74-fe64-4fe6-beb4-01bbb19dc121 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:37:02.221629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-0b592d74-fe64-4fe6-beb4-01bbb19dc121 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:37:02.222043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-0b592d74-fe64-4fe6-beb4-01bbb19dc121 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:37:02.222466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-0b592d74-fe64-4fe6-beb4-01bbb19dc121 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:37:02.231307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b592d74-fe64-4fe6-beb4-01bbb19dc121 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:02.231696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b592d74-fe64-4fe6-beb4-01bbb19dc121 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:02.232500 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b592d74-fe64-4fe6-beb4-01bbb19dc121 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:02.232938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b592d74-fe64-4fe6-beb4-01bbb19dc121 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:02.255573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-0b592d74-fe64-4fe6-beb4-01bbb19dc121 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Getting quotas for project d536d66baf3941bc84a237c99edb7a00. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:37:02.260572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-0b592d74-fe64-4fe6-beb4-01bbb19dc121 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Getting quotas for user 1726d6e2f76f40dfa2a9e91fe1344534 and project d536d66baf3941bc84a237c99edb7a00. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:37:02.262909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:02.273464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.utils [None req-0b592d74-fe64-4fe6-beb4-01bbb19dc121 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] instances quota exceeded for d536d66baf3941bc84a237c99edb7a00, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126044) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 28 04:37:02.274007 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-0b592d74-fe64-4fe6-beb4-01bbb19dc121 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0b592d74-fe64-4fe6-beb4-01bbb19dc121 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Request method failure captured: May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 144 May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikabojRjguT_56X1WajLGnVsC77WJubhyHyX9osQ3Dq2b32zeOMrz0kKuh2oM8XOA0N-l8gpOu46I7bp0Jt8LdfHUQahVQ6wlNTUvazGvKES6W1TZpXMBHQY8odNgK1vqntGChdd0VzhEClSaMi9n71kHGcbipFJPxr27jwMQ4TqWfwE May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d536d66baf3941bc84a237c99edb7a00 May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-QuotasAdminNegativeTest-1200191221 May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:37:02.276091 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:37:02.277373 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d536d66baf3941bc84a237c99edb7a00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d536d66baf3941bc84a237c99edb7a00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d536d66baf3941bc84a237c99edb7a00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d536d66baf3941bc84a237c99edb7a00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:02.277373 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-QuotasAdminNegativeTest-1200191221 May 28 04:37:02.277373 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d536d66baf3941bc84a237c99edb7a00 May 28 04:37:02.277373 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1200191221 May 28 04:37:02.277373 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-QuotasAdminNegativeTest-1200191221-project May 28 04:37:02.277373 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:37:02.277373 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:37:02.277373 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 1726d6e2f76f40dfa2a9e91fe1344534 May 28 04:37:02.277373 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-QuotasAdminNegativeTest-1200191221-project May 28 04:37:02.277373 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:37:02.277373 n-d-843700-1 devstack@n-api.service[126044]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-343608801", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} May 28 04:37:02.277373 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:37:02.278052 n-d-843700-1 devstack@n-api.service[126044]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 28 04:37:02.278052 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-343608801', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452'}}} May 28 04:37:02.278052 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:02.278052 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:02.278052 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 28 04:37:02.278052 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 28 04:37:02.278052 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:37:02.278052 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:37:02.278052 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 28 04:37:02.278052 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc May 28 04:37:02.278052 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 28 04:37:02.278052 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 28 04:37:02.278052 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:37:02.278052 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:37:02.278052 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 28 04:37:02.278052 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 28 04:37:02.278052 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 28 04:37:02.278052 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._create_instance( May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:02.281105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:02.284460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:02.287033 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:02.287033 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:02.287033 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:02.287033 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:02.287033 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 28 04:37:02.287033 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:02.287033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0b592d74-fe64-4fe6-beb4-01bbb19dc121 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:02.287033 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0b592d74-fe64-4fe6-beb4-01bbb19dc121 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.387359 May 28 04:37:02.287033 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 469/834] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:37:01 2022] POST /compute/v2.1/servers => generated 119 bytes in 388 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:37:02.287033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-04001343-59d3-4d53-99b5-d09435d6a1f8 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e4e5e0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:02.339424 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-04001343-59d3-4d53-99b5-d09435d6a1f8 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2F9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 1465 microversion: 2.1 time: 0.060251 May 28 04:37:02.340008 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 470/835] 10.222.0.58 () {58 vars in 1323 bytes} [Sat May 28 04:37:02 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2F9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 1465 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:02.344955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7fb84895-6aa0-4af6-8f6c-7adab9aa8ae2 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:02.345869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7fb84895-6aa0-4af6-8f6c-7adab9aa8ae2 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:02.352391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fb84895-6aa0-4af6-8f6c-7adab9aa8ae2 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:02.352901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fb84895-6aa0-4af6-8f6c-7adab9aa8ae2 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:02.353620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fb84895-6aa0-4af6-8f6c-7adab9aa8ae2 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:02.354062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fb84895-6aa0-4af6-8f6c-7adab9aa8ae2 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:02.390367 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2a39c539-67cc-40d9-bdc8-32de61775394 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "POST /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.136707 May 28 04:37:02.392141 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 366/836] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 04:37:00 2022] POST /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617/os-volume_attachments => generated 194 bytes in 2139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:02.405718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-ea5587b3-bd11-48f4-9599-1f9e84a80818 req-71876479-9dd6-40a0-811d-fe9506d75641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a27b8082-4f44-4263-a6a2-86291ea3950b", "name": "network-vif-unplugged", "status": "completed", "tag": "06f37629-13a1-489c-9d41-01ab1fa9a306"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:02.423704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ea5587b3-bd11-48f4-9599-1f9e84a80818 req-71876479-9dd6-40a0-811d-fe9506d75641 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:02.424925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ea5587b3-bd11-48f4-9599-1f9e84a80818 req-71876479-9dd6-40a0-811d-fe9506d75641 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:02.456211 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-ea5587b3-bd11-48f4-9599-1f9e84a80818 req-71876479-9dd6-40a0-811d-fe9506d75641 service nova] Creating event network-vif-unplugged:06f37629-13a1-489c-9d41-01ab1fa9a306 for instance a27b8082-4f44-4263-a6a2-86291ea3950b on n-h2-843700-1 May 28 04:37:02.465631 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-ea5587b3-bd11-48f4-9599-1f9e84a80818 req-71876479-9dd6-40a0-811d-fe9506d75641 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071690 May 28 04:37:02.466879 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 367/837] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:02.473735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-766f5dfc-c21a-4e6d-8461-58d3d748e1d0 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:02.475753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-766f5dfc-c21a-4e6d-8461-58d3d748e1d0 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:02.492835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-766f5dfc-c21a-4e6d-8461-58d3d748e1d0 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:02.492835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-766f5dfc-c21a-4e6d-8461-58d3d748e1d0 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:02.492835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-766f5dfc-c21a-4e6d-8461-58d3d748e1d0 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:02.492835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-766f5dfc-c21a-4e6d-8461-58d3d748e1d0 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:02.595853 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7fb84895-6aa0-4af6-8f6c-7adab9aa8ae2 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:02.605301 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7fb84895-6aa0-4af6-8f6c-7adab9aa8ae2 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1319 microversion: 2.1 time: 0.264206 May 28 04:37:02.606486 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 471/838] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:02 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:02.612375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d582bbe4-cacb-4f1d-904a-4885cf83092a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-292814674", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "244ceb49-a9c1-42ce-900e-8ae28e09e3a9"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:02.671573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-d582bbe4-cacb-4f1d-904a-4885cf83092a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] validate_networks() for [('244ceb49-a9c1-42ce-900e-8ae28e09e3a9', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:37:02.752693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-766f5dfc-c21a-4e6d-8461-58d3d748e1d0 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:02.760819 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-766f5dfc-c21a-4e6d-8461-58d3d748e1d0 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d" status: 200 len: 1322 microversion: 2.1 time: 0.292025 May 28 04:37:02.761418 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 368/839] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:02 2022] GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:02.776015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1e06cd7e-b0cf-4c46-9535-8dfdb240a0c2 tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Action: 'update', calling method: .version_select at 0x7f7701dfb820>, body: {"quota_set": {"instances": 10}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:02.884020 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e06cd7e-b0cf-4c46-9535-8dfdb240a0c2 tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:02.885029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e06cd7e-b0cf-4c46-9535-8dfdb240a0c2 tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:02.886226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e06cd7e-b0cf-4c46-9535-8dfdb240a0c2 tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:02.887434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e06cd7e-b0cf-4c46-9535-8dfdb240a0c2 tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:03.070349 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1e06cd7e-b0cf-4c46-9535-8dfdb240a0c2 tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00" status: 200 len: 329 microversion: 2.1 time: 0.307601 May 28 04:37:03.072547 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 369/840] 10.222.0.58 () {60 vars in 1261 bytes} [Sat May 28 04:37:02 2022] PUT /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00 => generated 329 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:03.080452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c4e0c7bb-347f-4246-909e-7d6c1e1a306a tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e0f310>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:03.194094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d582bbe4-cacb-4f1d-904a-4885cf83092a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:37:03.194560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d582bbe4-cacb-4f1d-904a-4885cf83092a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:37:03.195218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d582bbe4-cacb-4f1d-904a-4885cf83092a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:37:03.195601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d582bbe4-cacb-4f1d-904a-4885cf83092a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:37:03.200527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d582bbe4-cacb-4f1d-904a-4885cf83092a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:37:03.207888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d582bbe4-cacb-4f1d-904a-4885cf83092a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:03.208465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d582bbe4-cacb-4f1d-904a-4885cf83092a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:03.209566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d582bbe4-cacb-4f1d-904a-4885cf83092a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:03.211089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d582bbe4-cacb-4f1d-904a-4885cf83092a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:03.217120 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c4e0c7bb-347f-4246-909e-7d6c1e1a306a tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7103 microversion: 2.1 time: 0.142889 May 28 04:37:03.217960 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 370/841] 10.222.0.58 () {58 vars in 1169 bytes} [Sat May 28 04:37:03 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7103 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:03.223903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6b445721-75fd-4e68-a8c2-adb8d85151d7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:03.224768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6b445721-75fd-4e68-a8c2-adb8d85151d7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:03.231567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b445721-75fd-4e68-a8c2-adb8d85151d7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:03.232277 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b445721-75fd-4e68-a8c2-adb8d85151d7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:03.233253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b445721-75fd-4e68-a8c2-adb8d85151d7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:03.233895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b445721-75fd-4e68-a8c2-adb8d85151d7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:03.237171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-d582bbe4-cacb-4f1d-904a-4885cf83092a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Getting quotas for project 99f14746bfbc460eb4a21e7eb567de46. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:37:03.243421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-d582bbe4-cacb-4f1d-904a-4885cf83092a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Getting quotas for user ed90faaaee584c3a8d1385b8d873d12d and project 99f14746bfbc460eb4a21e7eb567de46. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:37:03.257148 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d582bbe4-cacb-4f1d-904a-4885cf83092a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:37:03.259740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d582bbe4-cacb-4f1d-904a-4885cf83092a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:37:03.379511 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d582bbe4-cacb-4f1d-904a-4885cf83092a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.771499 May 28 04:37:03.384914 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 472/842] 10.222.0.58 () {62 vars in 1187 bytes} [Sat May 28 04:37:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 04:37:03.385074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-83243265-e384-4c14-b25e-3ab922053dae tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Calling method '.version_select at 0x7f7701dfca60>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:03.400817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6b445721-75fd-4e68-a8c2-adb8d85151d7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:03.425572 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6b445721-75fd-4e68-a8c2-adb8d85151d7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1469 microversion: 2.1 time: 0.204745 May 28 04:37:03.426554 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 371/843] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:03 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1469 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:03.432817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-917a8e61-ba89-4b6c-8b03-3865f534f184 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e009d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:03.491350 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-83243265-e384-4c14-b25e-3ab922053dae tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00" status: 200 len: 371 microversion: 2.1 time: 0.109673 May 28 04:37:03.492389 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 473/844] 10.222.0.58 () {58 vars in 1241 bytes} [Sat May 28 04:37:03 2022] GET /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00 => generated 371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:03.503345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-db6002cc-a90b-4d77-a3cf-0ded337813c2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:03.506204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-db6002cc-a90b-4d77-a3cf-0ded337813c2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:03.595282 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-917a8e61-ba89-4b6c-8b03-3865f534f184 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.166608 May 28 04:37:03.606780 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 372/845] 10.222.0.58 () {58 vars in 1169 bytes} [Sat May 28 04:37:03 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:03.616391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4e81d875-3d00-4a8a-82fc-755fc11e7476 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:03.616391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4e81d875-3d00-4a8a-82fc-755fc11e7476 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:03.620815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-db6002cc-a90b-4d77-a3cf-0ded337813c2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:03.635950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-db6002cc-a90b-4d77-a3cf-0ded337813c2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:03.636944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e81d875-3d00-4a8a-82fc-755fc11e7476 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:03.637422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e81d875-3d00-4a8a-82fc-755fc11e7476 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:03.638223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e81d875-3d00-4a8a-82fc-755fc11e7476 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:03.638666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e81d875-3d00-4a8a-82fc-755fc11e7476 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:03.640600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-db6002cc-a90b-4d77-a3cf-0ded337813c2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:03.647524 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-db6002cc-a90b-4d77-a3cf-0ded337813c2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1261 microversion: 2.25 time: 0.152907 May 28 04:37:03.652864 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 474/846] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:03 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:03.666710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9c352c20-978b-4402-9992-4955989dfbcf tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Action: 'update', calling method: .version_select at 0x7f7701e96550>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:03.795984 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9c352c20-978b-4402-9992-4955989dfbcf tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:03.796921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9c352c20-978b-4402-9992-4955989dfbcf tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:03.798805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9c352c20-978b-4402-9992-4955989dfbcf tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:03.799458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9c352c20-978b-4402-9992-4955989dfbcf tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:03.939218 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9c352c20-978b-4402-9992-4955989dfbcf tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00" status: 200 len: 325 microversion: 2.1 time: 0.284266 May 28 04:37:03.951637 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 475/847] 10.222.0.58 () {60 vars in 1261 bytes} [Sat May 28 04:37:03 2022] PUT /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00 => generated 325 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:03.965540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-333c2ec1-eccd-4c16-9217-82eafcdd3e13 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f01790>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:03.980610 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4e81d875-3d00-4a8a-82fc-755fc11e7476 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "POST /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4/action" status: 204 len: 0 microversion: 2.1 time: 0.372428 May 28 04:37:03.981423 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 373/848] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:37:03 2022] POST /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4/action => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:37:03.994079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9861b6d1-0d84-4cd4-9f5d-c3dcf0a7dd9f tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:03.994577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9861b6d1-0d84-4cd4-9f5d-c3dcf0a7dd9f tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:04.011520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9861b6d1-0d84-4cd4-9f5d-c3dcf0a7dd9f tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:04.011980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9861b6d1-0d84-4cd4-9f5d-c3dcf0a7dd9f tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:04.012859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9861b6d1-0d84-4cd4-9f5d-c3dcf0a7dd9f tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:04.013264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9861b6d1-0d84-4cd4-9f5d-c3dcf0a7dd9f tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:04.018802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:04.057313 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-333c2ec1-eccd-4c16-9217-82eafcdd3e13 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/012b12af-263c-4753-8fad-4a4022b439aa" status: 200 len: 784 microversion: 2.1 time: 0.103649 May 28 04:37:04.059570 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 476/849] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:37:03 2022] GET /compute/v2.1/images/012b12af-263c-4753-8fad-4a4022b439aa => generated 784 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:04.066364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-60709e68-4f16-48d2-8ddd-e27444d7071b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:04.067871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-60709e68-4f16-48d2-8ddd-e27444d7071b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:04.082168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60709e68-4f16-48d2-8ddd-e27444d7071b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:04.082637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60709e68-4f16-48d2-8ddd-e27444d7071b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:04.083444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60709e68-4f16-48d2-8ddd-e27444d7071b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:04.083889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60709e68-4f16-48d2-8ddd-e27444d7071b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:04.339941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9861b6d1-0d84-4cd4-9f5d-c3dcf0a7dd9f tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:04.350533 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9861b6d1-0d84-4cd4-9f5d-c3dcf0a7dd9f tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1319 microversion: 2.1 time: 0.366298 May 28 04:37:04.351247 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 374/850] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:03 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:04.382300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3d8244de-0107-4fbb-a12e-01817d0fe4c7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:04.386172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3d8244de-0107-4fbb-a12e-01817d0fe4c7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:04.414650 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3d8244de-0107-4fbb-a12e-01817d0fe4c7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:04.416694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3d8244de-0107-4fbb-a12e-01817d0fe4c7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:04.426543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3d8244de-0107-4fbb-a12e-01817d0fe4c7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:04.426543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3d8244de-0107-4fbb-a12e-01817d0fe4c7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:04.445910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-60709e68-4f16-48d2-8ddd-e27444d7071b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:04.456620 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-60709e68-4f16-48d2-8ddd-e27444d7071b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d" status: 200 len: 1322 microversion: 2.1 time: 0.395660 May 28 04:37:04.457219 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 477/851] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:04 2022] GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:04.465822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-302fc1ad-071e-4049-9401-c0323791182f tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-823583900", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:04.562834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-302fc1ad-071e-4049-9401-c0323791182f tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:37:04.858749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3d8244de-0107-4fbb-a12e-01817d0fe4c7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:04.873518 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3d8244de-0107-4fbb-a12e-01817d0fe4c7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1469 microversion: 2.1 time: 0.521093 May 28 04:37:04.874508 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 375/852] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:04 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1469 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:04.892857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2871e8a3-f36a-401e-886d-143ea67b43fe tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e004c0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:04.972028 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2871e8a3-f36a-401e-886d-143ea67b43fe tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.083940 May 28 04:37:04.972964 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 376/853] 10.222.0.58 () {58 vars in 1157 bytes} [Sat May 28 04:37:04 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:04.987358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-81a16794-8e10-49eb-b8fe-3a16c52b3d20 req-08286d65-8c04-403d-bfc5-a6c6ef1a8ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f59d61-d661-41f7-9475-5a35ec9e3f2d", "tag": "a218fa08-86a8-47f1-a150-98d4861266c8"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:05.017910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-81a16794-8e10-49eb-b8fe-3a16c52b3d20 req-08286d65-8c04-403d-bfc5-a6c6ef1a8ef0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:05.019500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-81a16794-8e10-49eb-b8fe-3a16c52b3d20 req-08286d65-8c04-403d-bfc5-a6c6ef1a8ef0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:05.036816 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-81a16794-8e10-49eb-b8fe-3a16c52b3d20 req-08286d65-8c04-403d-bfc5-a6c6ef1a8ef0 service nova] Creating event network-changed:a218fa08-86a8-47f1-a150-98d4861266c8 for instance e3f59d61-d661-41f7-9475-5a35ec9e3f2d on n-h1-843700-1 May 28 04:37:05.043803 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-81a16794-8e10-49eb-b8fe-3a16c52b3d20 req-08286d65-8c04-403d-bfc5-a6c6ef1a8ef0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060987 May 28 04:37:05.044892 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 377/854] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:05.046307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-302fc1ad-071e-4049-9401-c0323791182f tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:37:05.046733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-302fc1ad-071e-4049-9401-c0323791182f tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:37:05.047232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-302fc1ad-071e-4049-9401-c0323791182f tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:37:05.047673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-302fc1ad-071e-4049-9401-c0323791182f tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:37:05.048095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-302fc1ad-071e-4049-9401-c0323791182f tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:37:05.051151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-63c76fdf-1865-47de-a115-18c903487324 req-9b848cc7-5463-46a5-9740-ba59baeb1c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55", "name": "network-vif-plugged", "status": "completed", "tag": "582316da-a3d2-440b-8d46-061a2a605695"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:05.060518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-302fc1ad-071e-4049-9401-c0323791182f tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:05.060979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-302fc1ad-071e-4049-9401-c0323791182f tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:05.065757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-302fc1ad-071e-4049-9401-c0323791182f tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:05.065757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-302fc1ad-071e-4049-9401-c0323791182f tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:05.065974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-63c76fdf-1865-47de-a115-18c903487324 req-9b848cc7-5463-46a5-9740-ba59baeb1c3d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:05.065974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-63c76fdf-1865-47de-a115-18c903487324 req-9b848cc7-5463-46a5-9740-ba59baeb1c3d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:05.078434 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-63c76fdf-1865-47de-a115-18c903487324 req-9b848cc7-5463-46a5-9740-ba59baeb1c3d service nova] Creating event network-vif-plugged:582316da-a3d2-440b-8d46-061a2a605695 for instance 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 on n-h1-843700-1 May 28 04:37:05.087426 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-63c76fdf-1865-47de-a115-18c903487324 req-9b848cc7-5463-46a5-9740-ba59baeb1c3d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040278 May 28 04:37:05.088771 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 378/855] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:05.097044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-99f96e90-f012-4e80-896a-b290308bc563 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:05.098017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-99f96e90-f012-4e80-896a-b290308bc563 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:05.106547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-99f96e90-f012-4e80-896a-b290308bc563 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:05.107261 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-99f96e90-f012-4e80-896a-b290308bc563 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:05.108242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-99f96e90-f012-4e80-896a-b290308bc563 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:05.108898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-99f96e90-f012-4e80-896a-b290308bc563 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:05.121111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-302fc1ad-071e-4049-9401-c0323791182f tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Getting quotas for project d536d66baf3941bc84a237c99edb7a00. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:37:05.140991 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-302fc1ad-071e-4049-9401-c0323791182f tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Getting quotas for user 1726d6e2f76f40dfa2a9e91fe1344534 and project d536d66baf3941bc84a237c99edb7a00. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:37:05.164616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.utils [None req-302fc1ad-071e-4049-9401-c0323791182f tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] ram quota exceeded for d536d66baf3941bc84a237c99edb7a00, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126044) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 28 04:37:05.169815 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-302fc1ad-071e-4049-9401-c0323791182f tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-302fc1ad-071e-4049-9401-c0323791182f tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Request method failure captured: May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 144 May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikabojRjguT_56X1WajLGnVsC77WJubhyHyX9osQ3Dq2b32zeOMrz0kKuh2oM8XOA0N-l8gpOu46I7bp0Jt8LdfHUQahVQ6wlNTUvazGvKES6W1TZpXMBHQY8odNgK1vqntGChdd0VzhEClSaMi9n71kHGcbipFJPxr27jwMQ4TqWfwE May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d536d66baf3941bc84a237c99edb7a00 May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-QuotasAdminNegativeTest-1200191221 May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:37:05.175460 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:37:05.176982 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d536d66baf3941bc84a237c99edb7a00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d536d66baf3941bc84a237c99edb7a00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d536d66baf3941bc84a237c99edb7a00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d536d66baf3941bc84a237c99edb7a00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:05.176982 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-QuotasAdminNegativeTest-1200191221 May 28 04:37:05.176982 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d536d66baf3941bc84a237c99edb7a00 May 28 04:37:05.176982 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1200191221 May 28 04:37:05.176982 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-QuotasAdminNegativeTest-1200191221-project May 28 04:37:05.176982 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:37:05.176982 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:37:05.176982 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 1726d6e2f76f40dfa2a9e91fe1344534 May 28 04:37:05.176982 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-QuotasAdminNegativeTest-1200191221-project May 28 04:37:05.176982 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:37:05.176982 n-d-843700-1 devstack@n-api.service[126044]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-823583900", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} May 28 04:37:05.176982 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:37:05.177688 n-d-843700-1 devstack@n-api.service[126044]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 28 04:37:05.177688 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-823583900', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452'}}} May 28 04:37:05.177688 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:05.177688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:05.177688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 28 04:37:05.177688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 28 04:37:05.177688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:37:05.177688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:37:05.177688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 28 04:37:05.177688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc May 28 04:37:05.177688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 28 04:37:05.177688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 28 04:37:05.177688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:37:05.177688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:37:05.177688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 28 04:37:05.177688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 28 04:37:05.177688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 28 04:37:05.177688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._create_instance( May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:05.182861 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:05.187877 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:05.189560 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:05.189560 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:05.189560 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:05.189560 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:05.189560 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 28 04:37:05.189560 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:05.189560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-302fc1ad-071e-4049-9401-c0323791182f tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:05.189560 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-302fc1ad-071e-4049-9401-c0323791182f tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.720051 May 28 04:37:05.189560 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 478/856] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:37:04 2022] POST /compute/v2.1/servers => generated 110 bytes in 722 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:37:05.189560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f9e0fa15-2a3b-441c-b609-25604bd12cb0 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e4ea60>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:05.238884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-99f96e90-f012-4e80-896a-b290308bc563 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:05.247830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-99f96e90-f012-4e80-896a-b290308bc563 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:05.249339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-99f96e90-f012-4e80-896a-b290308bc563 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:05.250531 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-99f96e90-f012-4e80-896a-b290308bc563 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1257 microversion: 2.25 time: 0.161004 May 28 04:37:05.261819 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 379/857] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:05 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1257 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:05.261819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c53d932d-05e8-48c6-93ac-c35f6debb2bd tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Action: 'update', calling method: .version_select at 0x7f7701da3a60>, body: {"quota_set": {"ram": 51200}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:05.336650 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c53d932d-05e8-48c6-93ac-c35f6debb2bd tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:05.337370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c53d932d-05e8-48c6-93ac-c35f6debb2bd tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:05.338563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c53d932d-05e8-48c6-93ac-c35f6debb2bd tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:05.339884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c53d932d-05e8-48c6-93ac-c35f6debb2bd tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:05.353709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=16 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:05.569552 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c53d932d-05e8-48c6-93ac-c35f6debb2bd tempest-QuotasAdminNegativeTest-1429695846 tempest-QuotasAdminNegativeTest-1429695846-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00" status: 200 len: 329 microversion: 2.1 time: 0.316445 May 28 04:37:05.576465 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 380/858] 10.222.0.58 () {60 vars in 1261 bytes} [Sat May 28 04:37:05 2022] PUT /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00 => generated 329 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:05.581376 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-13217de5-192a-4a20-bbe2-bdb6e415b5d6 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:05.581972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-13217de5-192a-4a20-bbe2-bdb6e415b5d6 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:05.588191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13217de5-192a-4a20-bbe2-bdb6e415b5d6 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:05.588668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13217de5-192a-4a20-bbe2-bdb6e415b5d6 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:05.589486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13217de5-192a-4a20-bbe2-bdb6e415b5d6 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:05.589913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13217de5-192a-4a20-bbe2-bdb6e415b5d6 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:05.744749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-13217de5-192a-4a20-bbe2-bdb6e415b5d6 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:05.757162 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-13217de5-192a-4a20-bbe2-bdb6e415b5d6 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1319 microversion: 2.1 time: 0.179442 May 28 04:37:05.757754 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 381/859] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:05 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:05.763652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f07b62e5-461a-43d9-bd37-2ad1d03386be tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:05.764852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f07b62e5-461a-43d9-bd37-2ad1d03386be tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:05.771241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f07b62e5-461a-43d9-bd37-2ad1d03386be tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:05.771704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f07b62e5-461a-43d9-bd37-2ad1d03386be tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:05.772470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f07b62e5-461a-43d9-bd37-2ad1d03386be tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:05.773135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f07b62e5-461a-43d9-bd37-2ad1d03386be tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:05.978946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f07b62e5-461a-43d9-bd37-2ad1d03386be tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:05.996002 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f07b62e5-461a-43d9-bd37-2ad1d03386be tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d" status: 200 len: 1322 microversion: 2.1 time: 0.236991 May 28 04:37:05.996779 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 382/860] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:05 2022] GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:06.018681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-14bcddf0-8ce1-460d-8efd-9e094e538505 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Action: 'update', calling method: .version_select at 0x7f7701df1e50>, body: {"quota_set": {"ram": 0}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:06.021490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-14bcddf0-8ce1-460d-8efd-9e094e538505 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '1726d6e2f76f40dfa2a9e91fe1344534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536d66baf3941bc84a237c99edb7a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-14bcddf0-8ce1-460d-8efd-9e094e538505 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Request method failure captured: May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: request: PUT /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00 HTTP/1.1 May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 25 May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikabojRjguT_56X1WajLGnVsC77WJubhyHyX9osQ3Dq2b32zeOMrz0kKuh2oM8XOA0N-l8gpOu46I7bp0Jt8LdfHUQahVQ6wlNTUvazGvKES6W1TZpXMBHQY8odNgK1vqntGChdd0VzhEClSaMi9n71kHGcbipFJPxr27jwMQ4TqWfwE May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d536d66baf3941bc84a237c99edb7a00 May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-QuotasAdminNegativeTest-1200191221 May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:37:06.024019 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:37:06.025574 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d536d66baf3941bc84a237c99edb7a00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d536d66baf3941bc84a237c99edb7a00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d536d66baf3941bc84a237c99edb7a00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d536d66baf3941bc84a237c99edb7a00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:06.025574 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-QuotasAdminNegativeTest-1200191221 May 28 04:37:06.025574 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d536d66baf3941bc84a237c99edb7a00 May 28 04:37:06.025574 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1200191221 May 28 04:37:06.025574 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-QuotasAdminNegativeTest-1200191221-project May 28 04:37:06.025574 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:37:06.025574 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:37:06.025574 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 1726d6e2f76f40dfa2a9e91fe1344534 May 28 04:37:06.025574 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-QuotasAdminNegativeTest-1200191221-project May 28 04:37:06.025574 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:37:06.025574 n-d-843700-1 devstack@n-api.service[126043]: {"quota_set": {"ram": 0}} May 28 04:37:06.025574 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:37:06.025574 n-d-843700-1 devstack@n-api.service[126043]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 28 04:37:06.025574 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'd536d66baf3941bc84a237c99edb7a00', 'body': {'quota_set': {'ram': 0}}} May 28 04:37:06.026568 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:06.026568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:06.026568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:06.026568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:06.026568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:06.026568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:06.026568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:37:06.026568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:37:06.026568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:06.026568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:06.026568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:37:06.026568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:06.026568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update May 28 04:37:06.026568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) May 28 04:37:06.026568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:37:06.026568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:06.026568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:37:06.026568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:06.026568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update May 28 04:37:06.029164 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) May 28 04:37:06.029164 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:37:06.029164 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:37:06.029164 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:37:06.029164 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:37:06.029164 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:37:06.029164 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:37:06.029164 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:37:06.029164 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:37:06.029164 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:37:06.029164 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:37:06.029164 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:37:06.029164 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:37:06.029164 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:37:06.029164 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:37:06.029164 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 28 04:37:06.029164 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:06.029164 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:06.029164 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:06.029164 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:06.030611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:06.030611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:06.030611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:37:06.030611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:37:06.030611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 28 04:37:06.030611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:06.031363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-14bcddf0-8ce1-460d-8efd-9e094e538505 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:06.032931 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-14bcddf0-8ce1-460d-8efd-9e094e538505 tempest-QuotasAdminNegativeTest-1200191221 tempest-QuotasAdminNegativeTest-1200191221-project] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00" status: 403 len: 116 microversion: 2.1 time: 0.034233 May 28 04:37:06.033738 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 383/861] 10.222.0.58 () {60 vars in 1261 bytes} [Sat May 28 04:37:05 2022] PUT /compute/v2.1/os-quota-sets/d536d66baf3941bc84a237c99edb7a00 => generated 116 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:37:06.045793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3cc00b3d-5c3c-4867-bf23-ef997e06b5f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:06.046433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3cc00b3d-5c3c-4867-bf23-ef997e06b5f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:06.054925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3cc00b3d-5c3c-4867-bf23-ef997e06b5f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:06.062463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3cc00b3d-5c3c-4867-bf23-ef997e06b5f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:06.062463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3cc00b3d-5c3c-4867-bf23-ef997e06b5f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:06.062463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3cc00b3d-5c3c-4867-bf23-ef997e06b5f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:06.267661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3cc00b3d-5c3c-4867-bf23-ef997e06b5f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:06.275228 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3cc00b3d-5c3c-4867-bf23-ef997e06b5f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1469 microversion: 2.1 time: 0.240520 May 28 04:37:06.275788 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 384/862] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:06 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1469 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:06.280698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5e6b7a04-d8ab-4d15-a8aa-e7f502edbf76 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:06.281305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5e6b7a04-d8ab-4d15-a8aa-e7f502edbf76 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:06.283665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:06.290073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e6b7a04-d8ab-4d15-a8aa-e7f502edbf76 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:06.293145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e6b7a04-d8ab-4d15-a8aa-e7f502edbf76 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:06.293145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e6b7a04-d8ab-4d15-a8aa-e7f502edbf76 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:06.293145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e6b7a04-d8ab-4d15-a8aa-e7f502edbf76 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:06.360241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5e6b7a04-d8ab-4d15-a8aa-e7f502edbf76 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:06.385194 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5e6b7a04-d8ab-4d15-a8aa-e7f502edbf76 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:06.389608 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5e6b7a04-d8ab-4d15-a8aa-e7f502edbf76 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:06.394048 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5e6b7a04-d8ab-4d15-a8aa-e7f502edbf76 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1319 microversion: 2.25 time: 0.116699 May 28 04:37:06.395323 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 385/863] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:06 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1319 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:06.733875 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f9e0fa15-2a3b-441c-b609-25604bd12cb0 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "DELETE /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23" status: 204 len: 0 microversion: 2.1 time: 1.552871 May 28 04:37:06.734618 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 479/864] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:05 2022] DELETE /compute/v2.1/images/0477e3ec-3a21-405f-b625-dfb65fc7bd23 => generated 0 bytes in 1555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:37:06.743980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-45a84514-a43a-42cc-94b9-4bb03c97b359 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701f26040>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:06.775113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-703f292f-bbc1-4343-9256-a5a1cafea2bb tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:06.776592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-703f292f-bbc1-4343-9256-a5a1cafea2bb tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:06.786049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-703f292f-bbc1-4343-9256-a5a1cafea2bb tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:06.786575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-703f292f-bbc1-4343-9256-a5a1cafea2bb tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:06.787521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-703f292f-bbc1-4343-9256-a5a1cafea2bb tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:06.788327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-703f292f-bbc1-4343-9256-a5a1cafea2bb tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:07.004461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-703f292f-bbc1-4343-9256-a5a1cafea2bb tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:07.012890 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-703f292f-bbc1-4343-9256-a5a1cafea2bb tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1319 microversion: 2.1 time: 0.242605 May 28 04:37:07.013687 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 480/865] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:06 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:37:07.018392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bd9fbf27-07e1-4ba9-9ac9-97e7b6d366b1 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:07.019681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bd9fbf27-07e1-4ba9-9ac9-97e7b6d366b1 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:07.030370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd9fbf27-07e1-4ba9-9ac9-97e7b6d366b1 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:07.030370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd9fbf27-07e1-4ba9-9ac9-97e7b6d366b1 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:07.030370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd9fbf27-07e1-4ba9-9ac9-97e7b6d366b1 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:07.030370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd9fbf27-07e1-4ba9-9ac9-97e7b6d366b1 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:07.229896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bd9fbf27-07e1-4ba9-9ac9-97e7b6d366b1 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:07.242803 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bd9fbf27-07e1-4ba9-9ac9-97e7b6d366b1 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d" status: 200 len: 1322 microversion: 2.1 time: 0.227867 May 28 04:37:07.243594 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 481/866] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:07 2022] GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:07.250271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-ff06a025-44d4-4978-9247-86780dc566d5 req-6509eb90-51d8-48cf-9657-87067ae68b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87cc4d83-fd02-4a96-a640-3cad08bba4f4", "name": "network-vif-plugged", "status": "completed", "tag": "47bf89ee-9954-4b95-8607-a086661df3bd"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:07.260549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ff06a025-44d4-4978-9247-86780dc566d5 req-6509eb90-51d8-48cf-9657-87067ae68b64 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:07.261315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ff06a025-44d4-4978-9247-86780dc566d5 req-6509eb90-51d8-48cf-9657-87067ae68b64 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:07.275841 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-ff06a025-44d4-4978-9247-86780dc566d5 req-6509eb90-51d8-48cf-9657-87067ae68b64 service nova] Creating event network-vif-plugged:47bf89ee-9954-4b95-8607-a086661df3bd for instance 87cc4d83-fd02-4a96-a640-3cad08bba4f4 on n-h2-843700-1 May 28 04:37:07.286229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-ff06a025-44d4-4978-9247-86780dc566d5 req-6509eb90-51d8-48cf-9657-87067ae68b64 service nova] Instance 87cc4d83-fd02-4a96-a640-3cad08bba4f4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:37:07.297486 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-ff06a025-44d4-4978-9247-86780dc566d5 req-6509eb90-51d8-48cf-9657-87067ae68b64 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052578 May 28 04:37:07.298890 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 482/867] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:07.303828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3858356a-4c0a-4950-a680-661889927f58 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:07.304565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3858356a-4c0a-4950-a680-661889927f58 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:07.311109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3858356a-4c0a-4950-a680-661889927f58 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:07.311563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3858356a-4c0a-4950-a680-661889927f58 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:07.312335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3858356a-4c0a-4950-a680-661889927f58 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:07.312772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3858356a-4c0a-4950-a680-661889927f58 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:07.507726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3858356a-4c0a-4950-a680-661889927f58 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:07.517557 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3858356a-4c0a-4950-a680-661889927f58 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1469 microversion: 2.1 time: 0.217682 May 28 04:37:07.522691 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 483/868] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:07 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1469 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:07.527693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8b507f10-1426-4b2e-bad2-91d6ffba13b5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:07.533616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8b507f10-1426-4b2e-bad2-91d6ffba13b5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:07.545087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b507f10-1426-4b2e-bad2-91d6ffba13b5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:07.551211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b507f10-1426-4b2e-bad2-91d6ffba13b5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:07.551211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b507f10-1426-4b2e-bad2-91d6ffba13b5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:07.551211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b507f10-1426-4b2e-bad2-91d6ffba13b5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:07.757830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8b507f10-1426-4b2e-bad2-91d6ffba13b5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:07.772102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8b507f10-1426-4b2e-bad2-91d6ffba13b5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:07.775582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8b507f10-1426-4b2e-bad2-91d6ffba13b5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:07.776917 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8b507f10-1426-4b2e-bad2-91d6ffba13b5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1361 microversion: 2.25 time: 0.252994 May 28 04:37:07.779814 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 484/869] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:07 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1361 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:08.033077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0157a8de-4055-49b7-86c8-d9a24f02b1c5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:08.033705 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0157a8de-4055-49b7-86c8-d9a24f02b1c5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:08.041793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0157a8de-4055-49b7-86c8-d9a24f02b1c5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:08.042873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0157a8de-4055-49b7-86c8-d9a24f02b1c5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:08.043937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0157a8de-4055-49b7-86c8-d9a24f02b1c5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:08.044678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0157a8de-4055-49b7-86c8-d9a24f02b1c5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:08.236510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0157a8de-4055-49b7-86c8-d9a24f02b1c5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:08.248705 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0157a8de-4055-49b7-86c8-d9a24f02b1c5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1469 microversion: 2.1 time: 0.221336 May 28 04:37:08.260390 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 485/870] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:08 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1469 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:08.274840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-90f23345-48bc-459f-824f-b85544e29d55 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:08.275490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-90f23345-48bc-459f-824f-b85544e29d55 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:08.304652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90f23345-48bc-459f-824f-b85544e29d55 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:08.307457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90f23345-48bc-459f-824f-b85544e29d55 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:08.311100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90f23345-48bc-459f-824f-b85544e29d55 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:08.313237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90f23345-48bc-459f-824f-b85544e29d55 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:08.482098 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-90f23345-48bc-459f-824f-b85544e29d55 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:08.490274 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-90f23345-48bc-459f-824f-b85544e29d55 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d" status: 200 len: 1322 microversion: 2.1 time: 0.232078 May 28 04:37:08.490976 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 486/871] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:08 2022] GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:08.496314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-74963727-da10-4f78-a258-a0728867a141 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:08.497108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-74963727-da10-4f78-a258-a0728867a141 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:08.508284 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-45a84514-a43a-42cc-94b9-4bb03c97b359 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "DELETE /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd" status: 204 len: 0 microversion: 2.1 time: 1.768774 May 28 04:37:08.508936 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 386/872] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:06 2022] DELETE /compute/v2.1/images/a34bc3fc-714d-471f-b181-ba01fbdf58fd => generated 0 bytes in 1770 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:37:08.512492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74963727-da10-4f78-a258-a0728867a141 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:08.513128 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74963727-da10-4f78-a258-a0728867a141 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:08.514075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74963727-da10-4f78-a258-a0728867a141 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:08.514777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74963727-da10-4f78-a258-a0728867a141 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:08.519168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6723f44c-9988-4b4e-9a35-c907b22a87b5 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701dce310>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:08.554147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:08.571230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-74963727-da10-4f78-a258-a0728867a141 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lazy-loading 'flavor' on Instance uuid 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:37:08.889690 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-74963727-da10-4f78-a258-a0728867a141 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55/action" status: 202 len: 0 microversion: 2.1 time: 0.397262 May 28 04:37:08.892061 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 487/873] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:37:08 2022] POST /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:37:08.907389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6002c373-ed19-4e2c-8e3f-187c6357b2cb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:08.908097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6002c373-ed19-4e2c-8e3f-187c6357b2cb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:08.925139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6002c373-ed19-4e2c-8e3f-187c6357b2cb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:08.925596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6002c373-ed19-4e2c-8e3f-187c6357b2cb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:08.929256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6002c373-ed19-4e2c-8e3f-187c6357b2cb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:08.929856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6002c373-ed19-4e2c-8e3f-187c6357b2cb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:09.180090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6002c373-ed19-4e2c-8e3f-187c6357b2cb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:09.188091 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6002c373-ed19-4e2c-8e3f-187c6357b2cb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1461 microversion: 2.1 time: 0.294656 May 28 04:37:09.189309 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 488/874] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:08 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1461 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:09.193911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-0043fb03-35a7-4a08-9cee-c898898fc0df req-93eada72-0983-4216-9b7c-0e4711092f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18cb68a1-94a5-4af2-a376-46e7493e7454", "tag": "453ca3f5-cda2-4f33-aa1e-444133d83763"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:09.205029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-0043fb03-35a7-4a08-9cee-c898898fc0df req-93eada72-0983-4216-9b7c-0e4711092f35 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:09.205700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-0043fb03-35a7-4a08-9cee-c898898fc0df req-93eada72-0983-4216-9b7c-0e4711092f35 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:09.218882 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-0043fb03-35a7-4a08-9cee-c898898fc0df req-93eada72-0983-4216-9b7c-0e4711092f35 service nova] Creating event network-changed:453ca3f5-cda2-4f33-aa1e-444133d83763 for instance 18cb68a1-94a5-4af2-a376-46e7493e7454 on n-h2-843700-1 May 28 04:37:09.224274 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-0043fb03-35a7-4a08-9cee-c898898fc0df req-93eada72-0983-4216-9b7c-0e4711092f35 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033695 May 28 04:37:09.225049 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 489/875] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:09.230933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5094aae9-4623-4f9e-ad9c-0a8010de4333 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:09.238231 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5094aae9-4623-4f9e-ad9c-0a8010de4333 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:09.239326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5094aae9-4623-4f9e-ad9c-0a8010de4333 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:09.239780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5094aae9-4623-4f9e-ad9c-0a8010de4333 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:09.240565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5094aae9-4623-4f9e-ad9c-0a8010de4333 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:09.240993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5094aae9-4623-4f9e-ad9c-0a8010de4333 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:09.382505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5094aae9-4623-4f9e-ad9c-0a8010de4333 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:09.392069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5094aae9-4623-4f9e-ad9c-0a8010de4333 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:09.393631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5094aae9-4623-4f9e-ad9c-0a8010de4333 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:09.394816 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5094aae9-4623-4f9e-ad9c-0a8010de4333 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1361 microversion: 2.25 time: 0.168570 May 28 04:37:09.395609 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 490/876] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:09 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:09.400055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a55c79fb-8824-4218-8016-b92447491adf tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:09.408304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a55c79fb-8824-4218-8016-b92447491adf tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:09.414874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a55c79fb-8824-4218-8016-b92447491adf tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:09.415407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a55c79fb-8824-4218-8016-b92447491adf tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:09.416194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a55c79fb-8824-4218-8016-b92447491adf tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:09.416619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a55c79fb-8824-4218-8016-b92447491adf tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:09.585930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a55c79fb-8824-4218-8016-b92447491adf tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:09.594065 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a55c79fb-8824-4218-8016-b92447491adf tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1477 microversion: 2.1 time: 0.197675 May 28 04:37:09.595229 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 491/877] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:09 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1477 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:09.600192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7ce03d62-3a58-4f03-ae9e-96ca2427dd1e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:09.600817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7ce03d62-3a58-4f03-ae9e-96ca2427dd1e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:09.607118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ce03d62-3a58-4f03-ae9e-96ca2427dd1e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:09.607666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ce03d62-3a58-4f03-ae9e-96ca2427dd1e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:09.608445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ce03d62-3a58-4f03-ae9e-96ca2427dd1e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:09.608894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ce03d62-3a58-4f03-ae9e-96ca2427dd1e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:09.759157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7ce03d62-3a58-4f03-ae9e-96ca2427dd1e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:09.770161 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7ce03d62-3a58-4f03-ae9e-96ca2427dd1e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1461 microversion: 2.1 time: 0.173397 May 28 04:37:09.770777 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 492/878] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:09 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1461 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:09.783721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a78e30ac-423f-410e-aa85-939076a8567f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:09.784375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a78e30ac-423f-410e-aa85-939076a8567f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:09.794708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a78e30ac-423f-410e-aa85-939076a8567f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:09.798515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a78e30ac-423f-410e-aa85-939076a8567f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:09.798515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a78e30ac-423f-410e-aa85-939076a8567f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:09.798515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a78e30ac-423f-410e-aa85-939076a8567f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:09.958815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a78e30ac-423f-410e-aa85-939076a8567f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:09.967334 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a78e30ac-423f-410e-aa85-939076a8567f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d" status: 200 len: 1322 microversion: 2.1 time: 0.188521 May 28 04:37:09.968087 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 493/879] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:09 2022] GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:09.973528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7eb9acd3-73d8-4ff5-a0bd-642becde4d82 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Calling method '.version_select at 0x7f7701e113a0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:09.976525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7eb9acd3-73d8-4ff5-a0bd-642becde4d82 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:09.977200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7eb9acd3-73d8-4ff5-a0bd-642becde4d82 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:09.983029 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6723f44c-9988-4b4e-9a35-c907b22a87b5 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "DELETE /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb" status: 204 len: 0 microversion: 2.1 time: 1.468026 May 28 04:37:09.983616 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 387/880] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:08 2022] DELETE /compute/v2.1/images/7b2bf608-65a2-4c92-8da6-36b73bdb05bb => generated 0 bytes in 1469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 04:37:09.992115 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7eb9acd3-73d8-4ff5-a0bd-642becde4d82 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1954 microversion: 2.1 time: 0.022821 May 28 04:37:09.993468 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 494/881] 10.222.0.58 () {58 vars in 1142 bytes} [Sat May 28 04:37:09 2022] GET /compute/v2.1/os-migrations => generated 1954 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:09.996895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b59afae5-4b01-4e04-afcb-08df432e9523 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:09.997695 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b59afae5-4b01-4e04-afcb-08df432e9523 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:10.005481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b59afae5-4b01-4e04-afcb-08df432e9523 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:10.006521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b59afae5-4b01-4e04-afcb-08df432e9523 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:10.007782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b59afae5-4b01-4e04-afcb-08df432e9523 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:10.008711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b59afae5-4b01-4e04-afcb-08df432e9523 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:10.013906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ea4833ba-2243-4d33-aabf-0f89877c5a89 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:10.021867 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ea4833ba-2243-4d33-aabf-0f89877c5a89 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011647 May 28 04:37:10.028228 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 495/882] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:37:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:10.035673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4b1f9c45-691a-4fea-a0a9-d5911dc10008 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-219327125", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:10.040230 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:37:10.040230 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:37:10.048667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b59afae5-4b01-4e04-afcb-08df432e9523 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:37:10.137404 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4b1f9c45-691a-4fea-a0a9-d5911dc10008 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.108042 May 28 04:37:10.138151 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 496/883] 10.222.0.58 () {60 vars in 1145 bytes} [Sat May 28 04:37:10 2022] POST /compute/v2.1/flavors => generated 498 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:10.150257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-22852d0c-a6d0-4bcc-a911-a7624a428a7b tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:10.160051 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-22852d0c-a6d0-4bcc-a911-a7624a428a7b tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013587 May 28 04:37:10.163043 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 497/884] 10.222.0.58 () {58 vars in 1181 bytes} [Sat May 28 04:37:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:37:10.294213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a55a772a-17f1-4e40-94b8-fcd3c17657df tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2032418506", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "f4fa1d39-7abe-438c-9c7b-1c96bd104438"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:10.396309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-a55a772a-17f1-4e40-94b8-fcd3c17657df tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:37:10.420065 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b59afae5-4b01-4e04-afcb-08df432e9523 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 204 len: 0 microversion: 2.1 time: 0.427553 May 28 04:37:10.421299 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 388/885] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:37:09 2022] DELETE /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:37:10.437283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fdba9730-ec7a-4971-b169-5b4eb27ac80e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:10.439670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fdba9730-ec7a-4971-b169-5b4eb27ac80e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:10.460447 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdba9730-ec7a-4971-b169-5b4eb27ac80e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:10.461798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdba9730-ec7a-4971-b169-5b4eb27ac80e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:10.464885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdba9730-ec7a-4971-b169-5b4eb27ac80e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:10.465571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdba9730-ec7a-4971-b169-5b4eb27ac80e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:10.754115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fdba9730-ec7a-4971-b169-5b4eb27ac80e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:10.769849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a55a772a-17f1-4e40-94b8-fcd3c17657df tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:37:10.770154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a55a772a-17f1-4e40-94b8-fcd3c17657df tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:37:10.770898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a55a772a-17f1-4e40-94b8-fcd3c17657df tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:37:10.771363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a55a772a-17f1-4e40-94b8-fcd3c17657df tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:37:10.774824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fdba9730-ec7a-4971-b169-5b4eb27ac80e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:10.775701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a55a772a-17f1-4e40-94b8-fcd3c17657df tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:37:10.791578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fdba9730-ec7a-4971-b169-5b4eb27ac80e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:10.803226 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fdba9730-ec7a-4971-b169-5b4eb27ac80e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1361 microversion: 2.25 time: 0.369974 May 28 04:37:10.803226 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 389/886] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:10 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1361 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:10.803226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6b929026-7ff3-471c-b76e-e53aa1713b88 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:10.803226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6b929026-7ff3-471c-b76e-e53aa1713b88 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:10.804530 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a55a772a-17f1-4e40-94b8-fcd3c17657df tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:10.804995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a55a772a-17f1-4e40-94b8-fcd3c17657df tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:10.805807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a55a772a-17f1-4e40-94b8-fcd3c17657df tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:10.806249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a55a772a-17f1-4e40-94b8-fcd3c17657df tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:10.817590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b929026-7ff3-471c-b76e-e53aa1713b88 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:10.818050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b929026-7ff3-471c-b76e-e53aa1713b88 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:10.818828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b929026-7ff3-471c-b76e-e53aa1713b88 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:10.819327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b929026-7ff3-471c-b76e-e53aa1713b88 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:10.835775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-a55a772a-17f1-4e40-94b8-fcd3c17657df tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Getting quotas for project 506fcf1e564049258c90cf33d274fc5f. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:37:10.838182 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:10.842027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-a55a772a-17f1-4e40-94b8-fcd3c17657df tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Getting quotas for user 6d208bde90d54f7487f39c505b884285 and project 506fcf1e564049258c90cf33d274fc5f. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:37:10.878261 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a55a772a-17f1-4e40-94b8-fcd3c17657df tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:37:10.881344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a55a772a-17f1-4e40-94b8-fcd3c17657df tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:37:10.975958 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6b929026-7ff3-471c-b76e-e53aa1713b88 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:10.985282 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6b929026-7ff3-471c-b76e-e53aa1713b88 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 1472 microversion: 2.1 time: 0.190683 May 28 04:37:10.997689 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 390/887] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:10 2022] GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 1472 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:11.003302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bd1e17d0-4cae-4d0a-aee8-349ff45b7ff5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:11.004154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bd1e17d0-4cae-4d0a-aee8-349ff45b7ff5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:11.010724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd1e17d0-4cae-4d0a-aee8-349ff45b7ff5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:11.011401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd1e17d0-4cae-4d0a-aee8-349ff45b7ff5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:11.012380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd1e17d0-4cae-4d0a-aee8-349ff45b7ff5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:11.012974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd1e17d0-4cae-4d0a-aee8-349ff45b7ff5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:11.068721 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a55a772a-17f1-4e40-94b8-fcd3c17657df tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.778446 May 28 04:37:11.075714 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 498/888] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:37:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:37:11.091301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d2457d65-a3c4-470e-8844-66c754742510 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:11.094056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d2457d65-a3c4-470e-8844-66c754742510 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:11.111450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d2457d65-a3c4-470e-8844-66c754742510 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:11.113933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d2457d65-a3c4-470e-8844-66c754742510 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:11.117278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d2457d65-a3c4-470e-8844-66c754742510 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:11.117997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d2457d65-a3c4-470e-8844-66c754742510 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:11.433226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bd1e17d0-4cae-4d0a-aee8-349ff45b7ff5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:11.441603 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bd1e17d0-4cae-4d0a-aee8-349ff45b7ff5 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1460 microversion: 2.1 time: 0.442657 May 28 04:37:11.458599 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 391/889] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:10 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1460 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:11.458599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d71dd53c-9206-471d-85a2-98ef68e64ea7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:11.458599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d71dd53c-9206-471d-85a2-98ef68e64ea7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:11.518133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d2457d65-a3c4-470e-8844-66c754742510 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:11.525889 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d2457d65-a3c4-470e-8844-66c754742510 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d" status: 200 len: 1322 microversion: 2.1 time: 0.448575 May 28 04:37:11.526668 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 499/890] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:11 2022] GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d => generated 1322 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:11.539198 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f8f2da22-b148-4d99-8fac-8e6d73680d82 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:11.539816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f8f2da22-b148-4d99-8fac-8e6d73680d82 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:11.546137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8f2da22-b148-4d99-8fac-8e6d73680d82 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:11.546545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8f2da22-b148-4d99-8fac-8e6d73680d82 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:11.554439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8f2da22-b148-4d99-8fac-8e6d73680d82 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:11.554439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8f2da22-b148-4d99-8fac-8e6d73680d82 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:11.569533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d71dd53c-9206-471d-85a2-98ef68e64ea7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:11.579505 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d71dd53c-9206-471d-85a2-98ef68e64ea7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1279 microversion: 2.1 time: 0.128857 May 28 04:37:11.590164 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 392/891] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:11 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1279 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:11.811089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-887441e7-0323-454c-be6a-62d770a42302 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:11.811570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-887441e7-0323-454c-be6a-62d770a42302 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:11.818853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-887441e7-0323-454c-be6a-62d770a42302 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:11.819246 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-887441e7-0323-454c-be6a-62d770a42302 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:11.824472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-887441e7-0323-454c-be6a-62d770a42302 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:11.824472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-887441e7-0323-454c-be6a-62d770a42302 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.021817 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f8f2da22-b148-4d99-8fac-8e6d73680d82 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1611 microversion: 2.1 time: 0.493881 May 28 04:37:12.023116 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 500/892] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:11 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1611 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:12.028382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9dbad08c-ba5b-4847-a1de-75b983d11db6 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:12.029135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9dbad08c-ba5b-4847-a1de-75b983d11db6 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:12.037388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9dbad08c-ba5b-4847-a1de-75b983d11db6 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.037991 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9dbad08c-ba5b-4847-a1de-75b983d11db6 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.038895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9dbad08c-ba5b-4847-a1de-75b983d11db6 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.039412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9dbad08c-ba5b-4847-a1de-75b983d11db6 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.047587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-887441e7-0323-454c-be6a-62d770a42302 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:12.056313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-887441e7-0323-454c-be6a-62d770a42302 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:12.058779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-887441e7-0323-454c-be6a-62d770a42302 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:12.060853 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-887441e7-0323-454c-be6a-62d770a42302 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1361 microversion: 2.25 time: 0.253530 May 28 04:37:12.072815 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 393/893] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:11 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1361 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:12.210153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9dbad08c-ba5b-4847-a1de-75b983d11db6 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:12.234524 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9dbad08c-ba5b-4847-a1de-75b983d11db6 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 1472 microversion: 2.1 time: 0.208982 May 28 04:37:12.236657 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 501/894] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:12 2022] GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 1472 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:12.256331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c41b9565-31d1-4c63-bd00-151e16e73a79 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:12.261176 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:37:12.261176 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:37:12.264994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c41b9565-31d1-4c63-bd00-151e16e73a79 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.272141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c41b9565-31d1-4c63-bd00-151e16e73a79 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.273152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c41b9565-31d1-4c63-bd00-151e16e73a79 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.276157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c41b9565-31d1-4c63-bd00-151e16e73a79 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.326856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a7cde89d-9c42-427b-876f-35559142792d tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:12.328413 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:37:12.328413 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:37:12.331368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a7cde89d-9c42-427b-876f-35559142792d tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.331957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a7cde89d-9c42-427b-876f-35559142792d tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.334498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a7cde89d-9c42-427b-876f-35559142792d tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.335457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a7cde89d-9c42-427b-876f-35559142792d tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.360534 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c41b9565-31d1-4c63-bd00-151e16e73a79 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.120048 May 28 04:37:12.363188 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 502/895] 10.222.0.58 () {58 vars in 1175 bytes} [Sat May 28 04:37:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:12.376328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-80d41129-cebf-4249-a9e7-c54e40da6be5 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-843700-1", "block_migration": true, "disk_over_commit": false}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:12.379394 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-80d41129-cebf-4249-a9e7-c54e40da6be5 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:12.391884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80d41129-cebf-4249-a9e7-c54e40da6be5 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.392537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80d41129-cebf-4249-a9e7-c54e40da6be5 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.398172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80d41129-cebf-4249-a9e7-c54e40da6be5 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.398649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80d41129-cebf-4249-a9e7-c54e40da6be5 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.409783 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a7cde89d-9c42-427b-876f-35559142792d tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.335073 May 28 04:37:12.418638 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 394/896] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:37:12 2022] GET /compute/v2.1/os-services => generated 944 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:12.425822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-6ca4537a-c141-4627-8645-352c0ca18871 req-a0f47802-f49a-4000-a037-f2060e2bb6ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f59d61-d661-41f7-9475-5a35ec9e3f2d", "name": "network-vif-plugged", "status": "completed", "tag": "a218fa08-86a8-47f1-a150-98d4861266c8"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:12.436092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-6ca4537a-c141-4627-8645-352c0ca18871 req-a0f47802-f49a-4000-a037-f2060e2bb6ce service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.436544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-6ca4537a-c141-4627-8645-352c0ca18871 req-a0f47802-f49a-4000-a037-f2060e2bb6ce service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.450886 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-6ca4537a-c141-4627-8645-352c0ca18871 req-a0f47802-f49a-4000-a037-f2060e2bb6ce service nova] Creating event network-vif-plugged:a218fa08-86a8-47f1-a150-98d4861266c8 for instance e3f59d61-d661-41f7-9475-5a35ec9e3f2d on n-h1-843700-1 May 28 04:37:12.457509 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-6ca4537a-c141-4627-8645-352c0ca18871 req-a0f47802-f49a-4000-a037-f2060e2bb6ce service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035536 May 28 04:37:12.458300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-80d41129-cebf-4249-a9e7-c54e40da6be5 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Lazy-loading 'flavor' on Instance uuid 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:37:12.463154 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 395/897] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:12.476197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3bee4d88-3a46-4cc3-93fe-cceeb1135060 tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:12.477849 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:37:12.477849 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:37:12.482035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3bee4d88-3a46-4cc3-93fe-cceeb1135060 tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.483122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3bee4d88-3a46-4cc3-93fe-cceeb1135060 tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.486598 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-80d41129-cebf-4249-a9e7-c54e40da6be5 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 while it is in vm_state suspended May 28 04:37:12.487874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3bee4d88-3a46-4cc3-93fe-cceeb1135060 tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.488751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3bee4d88-3a46-4cc3-93fe-cceeb1135060 tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-80d41129-cebf-4249-a9e7-c54e40da6be5 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Request method failure captured: May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55/action HTTP/1.1 May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 97 May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikabGn2eJi8eVU4oiKtkB17WbT25ZUGygfeJlzOqF8YXJKrzl5CdNcAieGnrI6EWa9VaDq0_MFK2aTSSPTGD3shu-Q5c-DjIGXZVDq9WKAN5LGoVefGTQPGCpbEpCHZLVFda2NcqgvW8qcH6becVrbACdN01w0CD9ISOqPuIeJpFX2ZM May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 199a98d0c5dc4062a9a578c8d8735625 May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-LiveMigrationNegativeTest-1513136966 May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:37:12.495035 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:37:12.496658 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_199a98d0c5dc4062a9a578c8d8735625"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/199a98d0c5dc4062a9a578c8d8735625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/199a98d0c5dc4062a9a578c8d8735625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/199a98d0c5dc4062a9a578c8d8735625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:12.496658 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-LiveMigrationNegativeTest-1513136966 May 28 04:37:12.496658 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 199a98d0c5dc4062a9a578c8d8735625 May 28 04:37:12.496658 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1513136966 May 28 04:37:12.496658 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-LiveMigrationNegativeTest-1513136966-project-admin May 28 04:37:12.496658 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:37:12.496658 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:37:12.496658 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: da0db45fd9624d36b2f88fb41cfbcccf May 28 04:37:12.496658 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-LiveMigrationNegativeTest-1513136966-project-admin May 28 04:37:12.496658 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:37:12.496658 n-d-843700-1 devstack@n-api.service[126044]: {"os-migrateLive": {"host": "n-h2-843700-1", "block_migration": true, "disk_over_commit": false}} May 28 04:37:12.496658 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:37:12.497565 n-d-843700-1 devstack@n-api.service[126044]: exception: Cannot 'os-migrateLive' instance 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 while it is in vm_state suspended May 28 04:37:12.497565 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55', 'body': {'os-migrateLive': {'host': 'n-h2-843700-1', 'block_migration': True, 'disk_over_commit': False}}} May 28 04:37:12.497565 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:12.497565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:12.497565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live May 28 04:37:12.497565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, May 28 04:37:12.497565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 28 04:37:12.497565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:37:12.497565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 28 04:37:12.497565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 04:37:12.497565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 28 04:37:12.497565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 04:37:12.497565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 28 04:37:12.497565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 04:37:12.497565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 28 04:37:12.497565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 04:37:12.497565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 28 04:37:12.497565 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 04:37:12.498838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 04:37:12.498838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:37:12.498838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 04:37:12.498838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 04:37:12.498838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 in vm_state suspended. Cannot live_migrate while the instance is in this state. May 28 04:37:12.498838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:12.498838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:12.498838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:12.498838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:12.498838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:12.498838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:12.498838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:12.498838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:12.498838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:12.498838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:12.498838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:37:12.498838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:12.498838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:37:12.498838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:12.498838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:37:12.500276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:12.500276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 28 04:37:12.500276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live May 28 04:37:12.500276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 04:37:12.500276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 04:37:12.500276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 04:37:12.500276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 while it is in vm_state suspended May 28 04:37:12.500276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:12.500276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:12.500276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:12.500276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:12.500276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:12.500276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:12.500276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:12.500276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:12.500276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 while it is in vm_state suspended May 28 04:37:12.500276 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:12.504999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-80d41129-cebf-4249-a9e7-c54e40da6be5 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 while it is in vm_state suspended {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:12.510586 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-80d41129-cebf-4249-a9e7-c54e40da6be5 tempest-LiveMigrationNegativeTest-1513136966 tempest-LiveMigrationNegativeTest-1513136966-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55/action" status: 409 len: 155 microversion: 2.1 time: 0.138559 May 28 04:37:12.511414 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 503/898] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:37:12 2022] POST /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55/action => generated 155 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 28 04:37:12.522413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c1eec956-7223-490d-8b5b-62c0c2bf009f tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:12.523472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c1eec956-7223-490d-8b5b-62c0c2bf009f tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:12.529887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1eec956-7223-490d-8b5b-62c0c2bf009f tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.530345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1eec956-7223-490d-8b5b-62c0c2bf009f tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.531479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1eec956-7223-490d-8b5b-62c0c2bf009f tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.531957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1eec956-7223-490d-8b5b-62c0c2bf009f tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.566534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c1eec956-7223-490d-8b5b-62c0c2bf009f tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:37:12.571586 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3bee4d88-3a46-4cc3-93fe-cceeb1135060 tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=n-d-843700-1" status: 200 len: 578 microversion: 2.1 time: 0.109241 May 28 04:37:12.576896 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 396/899] 10.222.0.58 () {58 vars in 1171 bytes} [Sat May 28 04:37:12 2022] GET /compute/v2.1/os-services?host=n-d-843700-1 => generated 578 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:12.583006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f4dbda88-d842-4858-9fad-bfbef8d4e88b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:12.585019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f4dbda88-d842-4858-9fad-bfbef8d4e88b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:12.593982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4dbda88-d842-4858-9fad-bfbef8d4e88b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.595019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4dbda88-d842-4858-9fad-bfbef8d4e88b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.596553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4dbda88-d842-4858-9fad-bfbef8d4e88b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.598005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4dbda88-d842-4858-9fad-bfbef8d4e88b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.886241 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c1eec956-7223-490d-8b5b-62c0c2bf009f tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 204 len: 0 microversion: 2.1 time: 0.367498 May 28 04:37:12.890613 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 504/900] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:37:12 2022] DELETE /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 04:37:12.898501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ed7817f1-34c7-48bf-95c2-7bea6d01cca2 tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:12.899193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f4dbda88-d842-4858-9fad-bfbef8d4e88b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:12.904995 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:37:12.904995 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:37:12.906803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed7817f1-34c7-48bf-95c2-7bea6d01cca2 tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.907586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed7817f1-34c7-48bf-95c2-7bea6d01cca2 tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.910562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed7817f1-34c7-48bf-95c2-7bea6d01cca2 tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.910933 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f4dbda88-d842-4858-9fad-bfbef8d4e88b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d" status: 200 len: 1322 microversion: 2.1 time: 0.332392 May 28 04:37:12.911417 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed7817f1-34c7-48bf-95c2-7bea6d01cca2 tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.913588 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 397/901] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:12 2022] GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:12.926805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-798c522a-5631-4970-947e-2c8e558db365 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:12.927456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-798c522a-5631-4970-947e-2c8e558db365 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:12.942167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-798c522a-5631-4970-947e-2c8e558db365 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.944193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-798c522a-5631-4970-947e-2c8e558db365 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.945007 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-798c522a-5631-4970-947e-2c8e558db365 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.945888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-798c522a-5631-4970-947e-2c8e558db365 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.946016 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ed7817f1-34c7-48bf-95c2-7bea6d01cca2 tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.053546 May 28 04:37:12.946803 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 505/902] 10.222.0.58 () {58 vars in 1175 bytes} [Sat May 28 04:37:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:12.950583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:12.952161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-78a79091-eace-4914-91a9-7f5217a3fe47 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:12.953210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-78a79091-eace-4914-91a9-7f5217a3fe47 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:12.960300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78a79091-eace-4914-91a9-7f5217a3fe47 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.961017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78a79091-eace-4914-91a9-7f5217a3fe47 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:12.961969 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78a79091-eace-4914-91a9-7f5217a3fe47 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:12.962578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78a79091-eace-4914-91a9-7f5217a3fe47 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:13.091523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-798c522a-5631-4970-947e-2c8e558db365 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:13.103168 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-798c522a-5631-4970-947e-2c8e558db365 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1275 microversion: 2.1 time: 0.188235 May 28 04:37:13.112575 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 398/903] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:12 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1275 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:13.123430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f9060b09-de42-49c4-9e11-d81b34de7690 tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:13.125047 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:37:13.125047 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:37:13.126472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9060b09-de42-49c4-9e11-d81b34de7690 tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:13.127136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9060b09-de42-49c4-9e11-d81b34de7690 tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:13.128281 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9060b09-de42-49c4-9e11-d81b34de7690 tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:13.128868 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9060b09-de42-49c4-9e11-d81b34de7690 tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:13.155000 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f9060b09-de42-49c4-9e11-d81b34de7690 tempest-ServicesAdminTestJSON-1390399895 tempest-ServicesAdminTestJSON-1390399895-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.040919 May 28 04:37:13.155608 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 399/904] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:37:13 2022] GET /compute/v2.1/os-services => generated 944 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:13.159218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-78a79091-eace-4914-91a9-7f5217a3fe47 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:13.161203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-77051a44-cb3d-4de3-804b-1b688f48ccef tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:13.161963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-77051a44-cb3d-4de3-804b-1b688f48ccef tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:13.171725 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-78a79091-eace-4914-91a9-7f5217a3fe47 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1466 microversion: 2.1 time: 0.223382 May 28 04:37:13.173730 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 506/905] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:12 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1466 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:13.180871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77051a44-cb3d-4de3-804b-1b688f48ccef tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:13.181585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77051a44-cb3d-4de3-804b-1b688f48ccef tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:13.182766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77051a44-cb3d-4de3-804b-1b688f48ccef tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:13.183435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77051a44-cb3d-4de3-804b-1b688f48ccef tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:13.255110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-97be29b6-e36a-42ae-8c13-93954523b0e1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:13.255110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-97be29b6-e36a-42ae-8c13-93954523b0e1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:13.277989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-97be29b6-e36a-42ae-8c13-93954523b0e1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:13.278451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-97be29b6-e36a-42ae-8c13-93954523b0e1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:13.285007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-97be29b6-e36a-42ae-8c13-93954523b0e1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:13.285007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-97be29b6-e36a-42ae-8c13-93954523b0e1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:13.292178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:13.388146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-97be29b6-e36a-42ae-8c13-93954523b0e1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:13.396114 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-97be29b6-e36a-42ae-8c13-93954523b0e1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 1430 microversion: 2.1 time: 0.146854 May 28 04:37:13.406213 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 507/906] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:13 2022] GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 1430 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:13.411359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-2a8e3eff-111c-4b33-9065-1f669dfe9393 req-9b527141-8dca-4670-8dd2-c67e53c5e974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0d40b8-3a01-421f-84fe-b94732c1f667", "name": "network-vif-deleted", "tag": "9c5d3b07-270f-42b6-a87f-60d7da0c6be0"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:13.419718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2a8e3eff-111c-4b33-9065-1f669dfe9393 req-9b527141-8dca-4670-8dd2-c67e53c5e974 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:13.420250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2a8e3eff-111c-4b33-9065-1f669dfe9393 req-9b527141-8dca-4670-8dd2-c67e53c5e974 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:13.432891 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-2a8e3eff-111c-4b33-9065-1f669dfe9393 req-9b527141-8dca-4670-8dd2-c67e53c5e974 service nova] Creating event network-vif-deleted:9c5d3b07-270f-42b6-a87f-60d7da0c6be0 for instance 9e0d40b8-3a01-421f-84fe-b94732c1f667 on n-h2-843700-1 May 28 04:37:13.438513 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-2a8e3eff-111c-4b33-9065-1f669dfe9393 req-9b527141-8dca-4670-8dd2-c67e53c5e974 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031165 May 28 04:37:13.439584 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 508/907] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:13.473507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-77051a44-cb3d-4de3-804b-1b688f48ccef tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:13.482204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-77051a44-cb3d-4de3-804b-1b688f48ccef tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:13.483756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-77051a44-cb3d-4de3-804b-1b688f48ccef tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:13.485045 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-77051a44-cb3d-4de3-804b-1b688f48ccef tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1361 microversion: 2.25 time: 0.328176 May 28 04:37:13.485846 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 400/908] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:13 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1361 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:13.930302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-74d189d1-a665-4155-a6b9-72c927de5835 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:13.931253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-74d189d1-a665-4155-a6b9-72c927de5835 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:13.938595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74d189d1-a665-4155-a6b9-72c927de5835 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:13.939754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74d189d1-a665-4155-a6b9-72c927de5835 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:13.940755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74d189d1-a665-4155-a6b9-72c927de5835 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:13.941550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74d189d1-a665-4155-a6b9-72c927de5835 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:14.129764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5a241b44-5e9f-4b6c-bfc9-5f7b1ca9bc0c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:14.130326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5a241b44-5e9f-4b6c-bfc9-5f7b1ca9bc0c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:14.144217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a241b44-5e9f-4b6c-bfc9-5f7b1ca9bc0c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:14.152193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a241b44-5e9f-4b6c-bfc9-5f7b1ca9bc0c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:14.152193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a241b44-5e9f-4b6c-bfc9-5f7b1ca9bc0c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:14.152193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a241b44-5e9f-4b6c-bfc9-5f7b1ca9bc0c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:14.322620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5a241b44-5e9f-4b6c-bfc9-5f7b1ca9bc0c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:14.337747 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5a241b44-5e9f-4b6c-bfc9-5f7b1ca9bc0c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1339 microversion: 2.1 time: 0.212604 May 28 04:37:14.347422 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 401/909] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:14 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1339 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:14.348891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-74d189d1-a665-4155-a6b9-72c927de5835 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:14.351417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4e8827db-ee6f-4ecd-bd88-a359c0e4455a tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:14.352045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4e8827db-ee6f-4ecd-bd88-a359c0e4455a tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:14.359157 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-74d189d1-a665-4155-a6b9-72c927de5835 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d" status: 200 len: 1322 microversion: 2.1 time: 0.433378 May 28 04:37:14.369165 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 509/910] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:13 2022] GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d => generated 1322 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:14.370133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e8827db-ee6f-4ecd-bd88-a359c0e4455a tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:14.370595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e8827db-ee6f-4ecd-bd88-a359c0e4455a tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:14.379177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e8827db-ee6f-4ecd-bd88-a359c0e4455a tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:14.379658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e8827db-ee6f-4ecd-bd88-a359c0e4455a tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:14.420201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ca586013-5ea8-4bc4-9fec-991901c7f466 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:14.421799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ca586013-5ea8-4bc4-9fec-991901c7f466 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:14.448393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca586013-5ea8-4bc4-9fec-991901c7f466 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:14.452558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca586013-5ea8-4bc4-9fec-991901c7f466 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:14.453536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca586013-5ea8-4bc4-9fec-991901c7f466 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:14.454133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca586013-5ea8-4bc4-9fec-991901c7f466 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:14.540581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca586013-5ea8-4bc4-9fec-991901c7f466 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:14.545761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca586013-5ea8-4bc4-9fec-991901c7f466 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:14.545761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-ca586013-5ea8-4bc4-9fec-991901c7f466 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lazy-loading 'fault' on Instance uuid 9e0d40b8-3a01-421f-84fe-b94732c1f667 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:37:14.613877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ca586013-5ea8-4bc4-9fec-991901c7f466 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:14.636207 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ca586013-5ea8-4bc4-9fec-991901c7f466 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 200 len: 1308 microversion: 2.1 time: 0.226329 May 28 04:37:14.637255 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 510/911] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:14 2022] GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 1308 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:14.644698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-765b3a64-9b5c-4c98-b2e9-835de72fa8bd tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:14.645317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-765b3a64-9b5c-4c98-b2e9-835de72fa8bd tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:14.670114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-765b3a64-9b5c-4c98-b2e9-835de72fa8bd tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:14.671645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-765b3a64-9b5c-4c98-b2e9-835de72fa8bd tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:14.674236 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-765b3a64-9b5c-4c98-b2e9-835de72fa8bd tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:14.675556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-765b3a64-9b5c-4c98-b2e9-835de72fa8bd tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:14.683593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4e8827db-ee6f-4ecd-bd88-a359c0e4455a tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:14.692338 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4e8827db-ee6f-4ecd-bd88-a359c0e4455a tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1466 microversion: 2.1 time: 0.352437 May 28 04:37:14.693231 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 402/912] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:14 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1466 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:15.113762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-765b3a64-9b5c-4c98-b2e9-835de72fa8bd tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:15.183573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-765b3a64-9b5c-4c98-b2e9-835de72fa8bd tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:15.185302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-765b3a64-9b5c-4c98-b2e9-835de72fa8bd tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:15.192513 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-765b3a64-9b5c-4c98-b2e9-835de72fa8bd tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1361 microversion: 2.25 time: 0.548201 May 28 04:37:15.193299 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 511/913] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:14 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1361 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:15.355748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6c96e23b-cc6d-460b-ba93-de30eadc1f29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:15.357111 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6c96e23b-cc6d-460b-ba93-de30eadc1f29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:15.367457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c96e23b-cc6d-460b-ba93-de30eadc1f29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:15.368127 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c96e23b-cc6d-460b-ba93-de30eadc1f29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:15.369320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c96e23b-cc6d-460b-ba93-de30eadc1f29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:15.369879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c96e23b-cc6d-460b-ba93-de30eadc1f29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:15.387776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4d9f77c2-947e-4b02-a1c8-9bdd9a8769b9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:15.388629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4d9f77c2-947e-4b02-a1c8-9bdd9a8769b9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:15.397704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d9f77c2-947e-4b02-a1c8-9bdd9a8769b9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:15.398167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d9f77c2-947e-4b02-a1c8-9bdd9a8769b9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:15.399347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d9f77c2-947e-4b02-a1c8-9bdd9a8769b9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:15.399814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d9f77c2-947e-4b02-a1c8-9bdd9a8769b9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:15.532474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6c96e23b-cc6d-460b-ba93-de30eadc1f29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:15.543594 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6c96e23b-cc6d-460b-ba93-de30eadc1f29 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1337 microversion: 2.1 time: 0.191717 May 28 04:37:15.544971 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 403/914] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:15 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1337 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:15.654596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-abc07e14-45e6-4835-a453-28397572cd16 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:15.655406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-abc07e14-45e6-4835-a453-28397572cd16 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: 9e0d40b8-3a01-421f-84fe-b94732c1f667] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:15.664366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abc07e14-45e6-4835-a453-28397572cd16 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:15.665285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abc07e14-45e6-4835-a453-28397572cd16 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:15.666386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abc07e14-45e6-4835-a453-28397572cd16 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:15.667129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abc07e14-45e6-4835-a453-28397572cd16 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:15.711887 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-abc07e14-45e6-4835-a453-28397572cd16 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] HTTP exception thrown: Instance 9e0d40b8-3a01-421f-84fe-b94732c1f667 could not be found. May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-abc07e14-45e6-4835-a453-28397572cd16 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Request method failure captured: May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 HTTP/1.1 May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZqtrNlfZV1rPhv3RbGNEiIdFbXIGuIxk8ho6qxYKo4ElpwtfAr_TSDJvVVYSqOmVVrRuOVcio_9u4WoGPS-CYY6Do_YE3pgqfZanDIDWtTVRFcWupnSFLY8NYJ6l-kpqlk9dKPtci1RmYXekefAZR-LDLIDYXQR9rlk2ETtlX-7rY May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 30dc7de2bf82417f8d26ad8ce4a50b17 May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ListImageFiltersTestJSON-750586826 May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:37:15.720408 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:37:15.721892 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_30dc7de2bf82417f8d26ad8ce4a50b17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/30dc7de2bf82417f8d26ad8ce4a50b17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/30dc7de2bf82417f8d26ad8ce4a50b17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/30dc7de2bf82417f8d26ad8ce4a50b17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:15.721892 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ListImageFiltersTestJSON-750586826 May 28 04:37:15.721892 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 30dc7de2bf82417f8d26ad8ce4a50b17 May 28 04:37:15.721892 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-750586826 May 28 04:37:15.721892 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ListImageFiltersTestJSON-750586826-project May 28 04:37:15.721892 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:37:15.721892 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:37:15.721892 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 31ab597e5a574f01910a9e0fe680fdb1 May 28 04:37:15.721892 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ListImageFiltersTestJSON-750586826-project May 28 04:37:15.721892 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:37:15.721892 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 9e0d40b8-3a01-421f-84fe-b94732c1f667 could not be found. May 28 04:37:15.721892 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '9e0d40b8-3a01-421f-84fe-b94732c1f667'} May 28 04:37:15.722752 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:15.722752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:15.722752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:37:15.722752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:37:15.722752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:37:15.722752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:37:15.722752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:37:15.722752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:37:15.722752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:37:15.722752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:37:15.722752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e0d40b8-3a01-421f-84fe-b94732c1f667 could not be found. May 28 04:37:15.722752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:15.722752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:15.722752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:15.722752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:15.722752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:15.722752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:15.722752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:15.722752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:15.722752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:15.724163 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:15.724163 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:37:15.724163 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:37:15.724163 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:37:15.724163 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:37:15.724163 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:37:15.724163 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:37:15.724163 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e0d40b8-3a01-421f-84fe-b94732c1f667 could not be found. May 28 04:37:15.724163 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:15.724163 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:15.724163 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:15.724163 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:15.724163 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:15.724163 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:15.724163 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:15.724163 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:15.724163 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e0d40b8-3a01-421f-84fe-b94732c1f667 could not be found. May 28 04:37:15.724163 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:15.727912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-abc07e14-45e6-4835-a453-28397572cd16 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Returning 404 to user: Instance 9e0d40b8-3a01-421f-84fe-b94732c1f667 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:15.729277 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-abc07e14-45e6-4835-a453-28397572cd16 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667" status: 404 len: 111 microversion: 2.1 time: 0.080112 May 28 04:37:15.730466 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 404/915] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:15 2022] GET /compute/v2.1/servers/9e0d40b8-3a01-421f-84fe-b94732c1f667 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:37:15.736561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5ef8ca15-ddc3-4ddf-8c08-6bbdd1f1d126 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:15.738797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5ef8ca15-ddc3-4ddf-8c08-6bbdd1f1d126 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:15.748605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ef8ca15-ddc3-4ddf-8c08-6bbdd1f1d126 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:15.749464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ef8ca15-ddc3-4ddf-8c08-6bbdd1f1d126 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:15.751226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ef8ca15-ddc3-4ddf-8c08-6bbdd1f1d126 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:15.751915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ef8ca15-ddc3-4ddf-8c08-6bbdd1f1d126 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:15.968689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4d9f77c2-947e-4b02-a1c8-9bdd9a8769b9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:15.981478 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4d9f77c2-947e-4b02-a1c8-9bdd9a8769b9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d" status: 200 len: 1472 microversion: 2.1 time: 0.597204 May 28 04:37:15.981478 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 512/916] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:15 2022] GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d => generated 1472 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:15.992148 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0975b083-0fec-4f49-b19e-e87ff0ca752c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:15.993544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0975b083-0fec-4f49-b19e-e87ff0ca752c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: a27b8082-4f44-4263-a6a2-86291ea3950b] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:16.002975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0975b083-0fec-4f49-b19e-e87ff0ca752c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:16.010095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0975b083-0fec-4f49-b19e-e87ff0ca752c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:16.010095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0975b083-0fec-4f49-b19e-e87ff0ca752c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:16.010095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0975b083-0fec-4f49-b19e-e87ff0ca752c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:16.046703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0975b083-0fec-4f49-b19e-e87ff0ca752c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: a27b8082-4f44-4263-a6a2-86291ea3950b] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:37:16.090900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5ef8ca15-ddc3-4ddf-8c08-6bbdd1f1d126 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:16.100997 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5ef8ca15-ddc3-4ddf-8c08-6bbdd1f1d126 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 200 len: 1466 microversion: 2.1 time: 0.369064 May 28 04:37:16.102262 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 405/917] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:15 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 1466 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:16.108219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-6329bb5f-540e-414e-9868-c6039cbf4205 req-500411b6-44ca-431b-8a8e-f56d7137a0cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55", "name": "network-vif-deleted", "tag": "582316da-a3d2-440b-8d46-061a2a605695"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:16.125612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-6329bb5f-540e-414e-9868-c6039cbf4205 req-500411b6-44ca-431b-8a8e-f56d7137a0cd service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:16.126327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-6329bb5f-540e-414e-9868-c6039cbf4205 req-500411b6-44ca-431b-8a8e-f56d7137a0cd service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:16.140308 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-6329bb5f-540e-414e-9868-c6039cbf4205 req-500411b6-44ca-431b-8a8e-f56d7137a0cd service nova] Creating event network-vif-deleted:582316da-a3d2-440b-8d46-061a2a605695 for instance 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 on n-h1-843700-1 May 28 04:37:16.146837 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-6329bb5f-540e-414e-9868-c6039cbf4205 req-500411b6-44ca-431b-8a8e-f56d7137a0cd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042977 May 28 04:37:16.148972 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 406/918] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:16.469890 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0975b083-0fec-4f49-b19e-e87ff0ca752c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b" status: 204 len: 0 microversion: 2.1 time: 0.484975 May 28 04:37:16.471058 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 513/919] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:37:15 2022] DELETE /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:37:16.478758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-41142c2e-678c-4f74-8652-b543ce99a84d req-5913bf66-4188-40d0-9708-b46b3ff163f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18cb68a1-94a5-4af2-a376-46e7493e7454", "name": "network-vif-plugged", "status": "completed", "tag": "453ca3f5-cda2-4f33-aa1e-444133d83763"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:16.499978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-41142c2e-678c-4f74-8652-b543ce99a84d req-5913bf66-4188-40d0-9708-b46b3ff163f4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:16.501202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-41142c2e-678c-4f74-8652-b543ce99a84d req-5913bf66-4188-40d0-9708-b46b3ff163f4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:16.515764 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-41142c2e-678c-4f74-8652-b543ce99a84d req-5913bf66-4188-40d0-9708-b46b3ff163f4 service nova] Creating event network-vif-plugged:453ca3f5-cda2-4f33-aa1e-444133d83763 for instance 18cb68a1-94a5-4af2-a376-46e7493e7454 on n-h2-843700-1 May 28 04:37:16.523314 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-41142c2e-678c-4f74-8652-b543ce99a84d req-5913bf66-4188-40d0-9708-b46b3ff163f4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050730 May 28 04:37:16.524480 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 514/920] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:16.544648 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef835470-cc19-434c-86c2-b42aaa835cd0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:16.545543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ef835470-cc19-434c-86c2-b42aaa835cd0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:16.553396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef835470-cc19-434c-86c2-b42aaa835cd0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:16.553849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef835470-cc19-434c-86c2-b42aaa835cd0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:16.554945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef835470-cc19-434c-86c2-b42aaa835cd0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:16.555421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef835470-cc19-434c-86c2-b42aaa835cd0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:16.562218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-de91e766-01ca-469a-a95f-55aa00fb102f tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:16.563524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-de91e766-01ca-469a-a95f-55aa00fb102f tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] [instance: 52ca61e7-8cfb-4da2-8dfb-77f2c95773d3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:16.570672 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-de91e766-01ca-469a-a95f-55aa00fb102f tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] HTTP exception thrown: Instance 52ca61e7-8cfb-4da2-8dfb-77f2c95773d3 could not be found. May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-de91e766-01ca-469a-a95f-55aa00fb102f tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Request method failure captured: May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/52ca61e7-8cfb-4da2-8dfb-77f2c95773d3/action HTTP/1.1 May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 15 May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaboAgA9X4VLatPPE8-um4LS4rPsLBxPvgVqw6Ult1_6-UHFBha8zaVfSabNgVQsjOl6oIlAtPUK2Xwo9pJFe6K0eiEhzMYAGMMf_BnbHwBNtaf_oeXVeFVvbQWv9nImw_Ubq0oqlm_uv-1mGlmmfEoCR1d8lLuJCU1-bmoWBSh27pU May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 98950ce18cdd4e72895844e107cbcd65 May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-713114128 May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: X-Role: admin,reader,member May 28 04:37:16.580555 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: admin,reader,member May 28 04:37:16.582192 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_98950ce18cdd4e72895844e107cbcd65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/98950ce18cdd4e72895844e107cbcd65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98950ce18cdd4e72895844e107cbcd65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98950ce18cdd4e72895844e107cbcd65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:16.582192 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersAdminNegativeTestJSON-713114128 May 28 04:37:16.582192 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 98950ce18cdd4e72895844e107cbcd65 May 28 04:37:16.582192 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-713114128 May 28 04:37:16.582192 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersAdminNegativeTestJSON-713114128-project-admin May 28 04:37:16.582192 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:37:16.582192 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:37:16.582192 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 3036a479d4e5486b81705e91fd26372e May 28 04:37:16.582192 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersAdminNegativeTestJSON-713114128-project-admin May 28 04:37:16.582192 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:37:16.582192 n-d-843700-1 devstack@n-api.service[126043]: {"migrate": {}} May 28 04:37:16.582192 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:37:16.582192 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 52ca61e7-8cfb-4da2-8dfb-77f2c95773d3 could not be found. May 28 04:37:16.583238 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '52ca61e7-8cfb-4da2-8dfb-77f2c95773d3', 'body': {'migrate': {}}} May 28 04:37:16.583238 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:16.583238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:16.583238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:37:16.583238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:37:16.583238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:37:16.583238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:37:16.583238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:37:16.583238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:37:16.583238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52ca61e7-8cfb-4da2-8dfb-77f2c95773d3 could not be found. May 28 04:37:16.583238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:16.583238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:16.583238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:16.583238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:16.583238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:16.583238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:16.583238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:16.583238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:16.583238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:16.583238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:16.584897 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:37:16.584897 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:16.584897 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate May 28 04:37:16.584897 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, May 28 04:37:16.584897 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:37:16.584897 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:37:16.584897 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52ca61e7-8cfb-4da2-8dfb-77f2c95773d3 could not be found. May 28 04:37:16.584897 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:16.584897 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:16.584897 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:16.584897 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:16.584897 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:16.584897 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:16.584897 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:16.584897 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:16.584897 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52ca61e7-8cfb-4da2-8dfb-77f2c95773d3 could not be found. May 28 04:37:16.584897 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:16.587905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-de91e766-01ca-469a-a95f-55aa00fb102f tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Returning 404 to user: Instance 52ca61e7-8cfb-4da2-8dfb-77f2c95773d3 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:16.590492 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-de91e766-01ca-469a-a95f-55aa00fb102f tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/52ca61e7-8cfb-4da2-8dfb-77f2c95773d3/action" status: 404 len: 111 microversion: 2.1 time: 0.440429 May 28 04:37:16.605217 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 407/921] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:37:16 2022] POST /compute/v2.1/servers/52ca61e7-8cfb-4da2-8dfb-77f2c95773d3/action => generated 111 bytes in 455 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:37:16.611568 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-69153e59-e0c9-4729-8102-dee8aac689fa tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:16.612280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-69153e59-e0c9-4729-8102-dee8aac689fa tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: a27b8082-4f44-4263-a6a2-86291ea3950b] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:16.620919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-69153e59-e0c9-4729-8102-dee8aac689fa tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:16.621784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-69153e59-e0c9-4729-8102-dee8aac689fa tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:16.622780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-69153e59-e0c9-4729-8102-dee8aac689fa tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:16.623439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-69153e59-e0c9-4729-8102-dee8aac689fa tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:17.014628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef835470-cc19-434c-86c2-b42aaa835cd0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:17.026518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef835470-cc19-434c-86c2-b42aaa835cd0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:17.028890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef835470-cc19-434c-86c2-b42aaa835cd0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:17.030538 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ef835470-cc19-434c-86c2-b42aaa835cd0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1361 microversion: 2.25 time: 0.504769 May 28 04:37:17.031414 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 515/922] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:16 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1361 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:17.036320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d53206f1-3139-4552-be56-26618fc8d9b6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:17.037708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d53206f1-3139-4552-be56-26618fc8d9b6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:17.046947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d53206f1-3139-4552-be56-26618fc8d9b6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:17.049457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d53206f1-3139-4552-be56-26618fc8d9b6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:17.049457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d53206f1-3139-4552-be56-26618fc8d9b6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:17.049678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-69153e59-e0c9-4729-8102-dee8aac689fa tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:17.049797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d53206f1-3139-4552-be56-26618fc8d9b6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:17.058858 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-69153e59-e0c9-4729-8102-dee8aac689fa tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b" status: 200 len: 1474 microversion: 2.1 time: 0.452455 May 28 04:37:17.059483 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 408/923] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:16 2022] GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b => generated 1474 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:17.066623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7ffb3bcf-3b56-496c-92b1-a81a3d44422a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-817672497", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:17.125217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-7ffb3bcf-3b56-496c-92b1-a81a3d44422a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] validate_networks() for None {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:37:17.392024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d53206f1-3139-4552-be56-26618fc8d9b6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:17.409172 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d53206f1-3139-4552-be56-26618fc8d9b6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1379 microversion: 2.1 time: 0.367194 May 28 04:37:17.409172 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 516/924] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:17 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1379 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:17.409172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ab6ded3c-3929-4c10-b881-a18fb26df9ab tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:17.409172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ab6ded3c-3929-4c10-b881-a18fb26df9ab tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:17.412241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab6ded3c-3929-4c10-b881-a18fb26df9ab tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:17.412702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab6ded3c-3929-4c10-b881-a18fb26df9ab tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:17.413487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab6ded3c-3929-4c10-b881-a18fb26df9ab tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:17.413930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab6ded3c-3929-4c10-b881-a18fb26df9ab tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-ab6ded3c-3929-4c10-b881-a18fb26df9ab tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] HTTP exception thrown: Instance 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 could not be found. May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ab6ded3c-3929-4c10-b881-a18fb26df9ab tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Request method failure captured: May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 HTTP/1.1 May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikabFz1eSNxhRYX4PDavZOV8mxjNhFwifNV3eGr6DDvU-oL7BakvLGAKAYx2oq33q09xJruFzjeHy-lySADNwXtdWjI0GKEDBW3yLDCQA5815PDe-vp1qXcZxC1RscPut3Qt6p6z1UNOVvh7hjiQtr-ENXqMdGAHGNgMeM-_f7kP4YiQ May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2f8aa260b3e94154b0a0485659f7f7e3 May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-LiveMigrationNegativeTest-96244022 May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:37:17.434388 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:37:17.436322 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2f8aa260b3e94154b0a0485659f7f7e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2f8aa260b3e94154b0a0485659f7f7e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f8aa260b3e94154b0a0485659f7f7e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f8aa260b3e94154b0a0485659f7f7e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:17.436322 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-LiveMigrationNegativeTest-96244022 May 28 04:37:17.436322 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2f8aa260b3e94154b0a0485659f7f7e3 May 28 04:37:17.436322 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-96244022 May 28 04:37:17.436322 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-LiveMigrationNegativeTest-96244022-project May 28 04:37:17.436322 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:37:17.436322 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:37:17.436322 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: a666a6908cd44a898f0b3dfdb8e1dd3a May 28 04:37:17.436322 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-LiveMigrationNegativeTest-96244022-project May 28 04:37:17.436322 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:37:17.436322 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 could not be found. May 28 04:37:17.436322 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55'} May 28 04:37:17.437425 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:17.437425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:17.437425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:37:17.437425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:37:17.437425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:37:17.437425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:37:17.437425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:37:17.437425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:37:17.437425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:37:17.437425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:37:17.437425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 could not be found. May 28 04:37:17.437425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:17.437425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:17.437425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:17.437425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:17.437425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:17.437425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:17.437425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:17.437425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:17.437425 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:17.440606 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:17.440606 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:37:17.440606 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:37:17.440606 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:37:17.440606 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:37:17.440606 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:37:17.440606 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:37:17.440606 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 could not be found. May 28 04:37:17.440606 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:17.440606 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:17.440606 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:17.440606 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:17.440606 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:17.440606 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:17.440606 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:17.440606 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:17.440606 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 could not be found. May 28 04:37:17.440606 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:17.442517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ab6ded3c-3929-4c10-b881-a18fb26df9ab tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Returning 404 to user: Instance 2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:17.442517 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ab6ded3c-3929-4c10-b881-a18fb26df9ab tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55" status: 404 len: 111 microversion: 2.1 time: 0.032205 May 28 04:37:17.442517 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 517/925] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:17 2022] GET /compute/v2.1/servers/2c2d84b8-1f3b-4ac3-a065-ce1f1089ba55 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:37:17.444635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4f8bc94c-b0db-4cbf-8e67-5c2751f230a3 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:17.445136 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4f8bc94c-b0db-4cbf-8e67-5c2751f230a3 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:17.452353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f8bc94c-b0db-4cbf-8e67-5c2751f230a3 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:17.452796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f8bc94c-b0db-4cbf-8e67-5c2751f230a3 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:17.453605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f8bc94c-b0db-4cbf-8e67-5c2751f230a3 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:17.454062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f8bc94c-b0db-4cbf-8e67-5c2751f230a3 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:17.489190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4f8bc94c-b0db-4cbf-8e67-5c2751f230a3 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:37:17.511654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7ffb3bcf-3b56-496c-92b1-a81a3d44422a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:37:17.512092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7ffb3bcf-3b56-496c-92b1-a81a3d44422a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:37:17.512602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7ffb3bcf-3b56-496c-92b1-a81a3d44422a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:37:17.513023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7ffb3bcf-3b56-496c-92b1-a81a3d44422a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:37:17.513449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7ffb3bcf-3b56-496c-92b1-a81a3d44422a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:37:17.530711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7ffb3bcf-3b56-496c-92b1-a81a3d44422a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:17.531200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7ffb3bcf-3b56-496c-92b1-a81a3d44422a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:17.532055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7ffb3bcf-3b56-496c-92b1-a81a3d44422a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:17.532496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7ffb3bcf-3b56-496c-92b1-a81a3d44422a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:17.571512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-7ffb3bcf-3b56-496c-92b1-a81a3d44422a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Getting quotas for project 7c84426a50904071bfa68e7529a40945. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:37:17.577244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-7ffb3bcf-3b56-496c-92b1-a81a3d44422a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Getting quotas for user e75ff372428143249395a635a1766f9f and project 7c84426a50904071bfa68e7529a40945. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:37:17.591500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7ffb3bcf-3b56-496c-92b1-a81a3d44422a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:37:17.594064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7ffb3bcf-3b56-496c-92b1-a81a3d44422a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:37:17.815311 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7ffb3bcf-3b56-496c-92b1-a81a3d44422a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.752630 May 28 04:37:17.815892 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 409/926] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:37:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:37:17.827661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-35410cf3-79b9-4209-93f2-1fb4edc1216c tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:17.828399 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-35410cf3-79b9-4209-93f2-1fb4edc1216c tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:17.845698 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4f8bc94c-b0db-4cbf-8e67-5c2751f230a3 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "DELETE /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 204 len: 0 microversion: 2.1 time: 0.404906 May 28 04:37:17.846277 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 518/927] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:37:17 2022] DELETE /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:37:17.856659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f3b7e88c-45bc-476b-b944-f4135ab055af tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:17.857562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f3b7e88c-45bc-476b-b944-f4135ab055af tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:17.864599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f3b7e88c-45bc-476b-b944-f4135ab055af tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:17.865179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f3b7e88c-45bc-476b-b944-f4135ab055af tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:17.866058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f3b7e88c-45bc-476b-b944-f4135ab055af tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:17.868449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f3b7e88c-45bc-476b-b944-f4135ab055af tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:17.995891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-35410cf3-79b9-4209-93f2-1fb4edc1216c tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:18.014294 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-35410cf3-79b9-4209-93f2-1fb4edc1216c tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 200 len: 1221 microversion: 2.1 time: 0.191917 May 28 04:37:18.024313 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 410/928] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:17 2022] GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 1221 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:37:18.034335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-175a9a57-7664-4df5-bef4-11eb244d217a req-9360c493-68e7-4db7-a4d3-9b379525f558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17bf9454-cf2b-4049-b817-556e4c74b350", "tag": "9a1c5bed-5c2a-4af6-98f9-e6c6cf8a4d4c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:18.070759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-175a9a57-7664-4df5-bef4-11eb244d217a req-9360c493-68e7-4db7-a4d3-9b379525f558 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:18.070759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-175a9a57-7664-4df5-bef4-11eb244d217a req-9360c493-68e7-4db7-a4d3-9b379525f558 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:18.097548 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-175a9a57-7664-4df5-bef4-11eb244d217a req-9360c493-68e7-4db7-a4d3-9b379525f558 service nova] Creating event network-changed:9a1c5bed-5c2a-4af6-98f9-e6c6cf8a4d4c for instance 17bf9454-cf2b-4049-b817-556e4c74b350 on n-h2-843700-1 May 28 04:37:18.104269 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-175a9a57-7664-4df5-bef4-11eb244d217a req-9360c493-68e7-4db7-a4d3-9b379525f558 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087722 May 28 04:37:18.107847 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 411/929] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:18.113483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f3b7e88c-45bc-476b-b944-f4135ab055af tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:18.124526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5b403521-99ce-446c-858c-672c30c30634 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:18.127781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5b403521-99ce-446c-858c-672c30c30634 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:18.129584 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f3b7e88c-45bc-476b-b944-f4135ab055af tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1474 microversion: 2.1 time: 0.278519 May 28 04:37:18.130533 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 519/930] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:17 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1474 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:37:18.136947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-24c687b7-244d-4100-ac5c-5074e10d097d tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:18.137138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5b403521-99ce-446c-858c-672c30c30634 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:18.137461 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5b403521-99ce-446c-858c-672c30c30634 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:18.138319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5b403521-99ce-446c-858c-672c30c30634 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:18.138494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-24c687b7-244d-4100-ac5c-5074e10d097d tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: a27b8082-4f44-4263-a6a2-86291ea3950b] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:18.138760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5b403521-99ce-446c-858c-672c30c30634 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:18.149391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24c687b7-244d-4100-ac5c-5074e10d097d tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:18.151211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24c687b7-244d-4100-ac5c-5074e10d097d tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:18.151211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24c687b7-244d-4100-ac5c-5074e10d097d tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:18.151211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24c687b7-244d-4100-ac5c-5074e10d097d tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:18.383205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5b403521-99ce-446c-858c-672c30c30634 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:18.396005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5b403521-99ce-446c-858c-672c30c30634 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:18.398976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-24c687b7-244d-4100-ac5c-5074e10d097d tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:18.399256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5b403521-99ce-446c-858c-672c30c30634 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:18.400681 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5b403521-99ce-446c-858c-672c30c30634 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1361 microversion: 2.25 time: 0.288867 May 28 04:37:18.401438 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 412/931] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:18 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1361 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:18.407390 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-24c687b7-244d-4100-ac5c-5074e10d097d tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b" status: 200 len: 1474 microversion: 2.1 time: 0.275458 May 28 04:37:18.409551 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 520/932] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:18 2022] GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b => generated 1474 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:18.421800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9169f2eb-e3ea-4213-862d-c599b356a236 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:18.422460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9169f2eb-e3ea-4213-862d-c599b356a236 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:18.429939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9169f2eb-e3ea-4213-862d-c599b356a236 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:18.430401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9169f2eb-e3ea-4213-862d-c599b356a236 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:18.431812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9169f2eb-e3ea-4213-862d-c599b356a236 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:18.432255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9169f2eb-e3ea-4213-862d-c599b356a236 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:18.586348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9169f2eb-e3ea-4213-862d-c599b356a236 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:18.594315 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9169f2eb-e3ea-4213-862d-c599b356a236 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1379 microversion: 2.1 time: 0.181271 May 28 04:37:18.594910 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 413/933] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:18 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1379 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:19.032118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9c3dc25c-80d4-475e-9af3-a500f0b8b6fd tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:19.032735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9c3dc25c-80d4-475e-9af3-a500f0b8b6fd tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:19.039440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9c3dc25c-80d4-475e-9af3-a500f0b8b6fd tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.039895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9c3dc25c-80d4-475e-9af3-a500f0b8b6fd tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.040665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9c3dc25c-80d4-475e-9af3-a500f0b8b6fd tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.041106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9c3dc25c-80d4-475e-9af3-a500f0b8b6fd tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.111257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9c3dc25c-80d4-475e-9af3-a500f0b8b6fd tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:19.120454 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9c3dc25c-80d4-475e-9af3-a500f0b8b6fd tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 200 len: 1225 microversion: 2.1 time: 0.091622 May 28 04:37:19.121786 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 521/934] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:19 2022] GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:19.147195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b6a66557-b9c1-4728-8ef0-c25abb279d43 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:19.148220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b6a66557-b9c1-4728-8ef0-c25abb279d43 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:19.154299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6a66557-b9c1-4728-8ef0-c25abb279d43 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.154766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6a66557-b9c1-4728-8ef0-c25abb279d43 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.155576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6a66557-b9c1-4728-8ef0-c25abb279d43 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.157073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6a66557-b9c1-4728-8ef0-c25abb279d43 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.290399 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b6a66557-b9c1-4728-8ef0-c25abb279d43 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:19.298697 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b6a66557-b9c1-4728-8ef0-c25abb279d43 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1474 microversion: 2.1 time: 0.156285 May 28 04:37:19.299428 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 414/935] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:19 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1474 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:19.420990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-08c98be8-1752-44aa-b2d3-399ca8e47f79 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:19.421355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-08c98be8-1752-44aa-b2d3-399ca8e47f79 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:19.426392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-72cc0f55-6a87-4275-af07-aa7b8167fa44 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:19.427047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-72cc0f55-6a87-4275-af07-aa7b8167fa44 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: a27b8082-4f44-4263-a6a2-86291ea3950b] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:19.428704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08c98be8-1752-44aa-b2d3-399ca8e47f79 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.429520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08c98be8-1752-44aa-b2d3-399ca8e47f79 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.430309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08c98be8-1752-44aa-b2d3-399ca8e47f79 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.430754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08c98be8-1752-44aa-b2d3-399ca8e47f79 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.434748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-72cc0f55-6a87-4275-af07-aa7b8167fa44 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.436779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-72cc0f55-6a87-4275-af07-aa7b8167fa44 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.436926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:19.437033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-72cc0f55-6a87-4275-af07-aa7b8167fa44 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.437033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-72cc0f55-6a87-4275-af07-aa7b8167fa44 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.633111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-08c98be8-1752-44aa-b2d3-399ca8e47f79 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:19.636564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-72cc0f55-6a87-4275-af07-aa7b8167fa44 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:19.642122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-08c98be8-1752-44aa-b2d3-399ca8e47f79 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:19.643259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-08c98be8-1752-44aa-b2d3-399ca8e47f79 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:19.644140 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-72cc0f55-6a87-4275-af07-aa7b8167fa44 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b" status: 200 len: 1474 microversion: 2.1 time: 0.222528 May 28 04:37:19.644366 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-08c98be8-1752-44aa-b2d3-399ca8e47f79 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1361 microversion: 2.25 time: 0.228055 May 28 04:37:19.644719 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 415/936] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:19 2022] GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b => generated 1474 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:37:19.646587 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 522/937] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:19 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:19.650744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d3ba401b-44c7-4182-b577-8172cee08ccf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:19.655381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d3ba401b-44c7-4182-b577-8172cee08ccf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:19.662130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3ba401b-44c7-4182-b577-8172cee08ccf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.662580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3ba401b-44c7-4182-b577-8172cee08ccf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.663382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3ba401b-44c7-4182-b577-8172cee08ccf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.663817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3ba401b-44c7-4182-b577-8172cee08ccf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.778054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-865f78cb-435c-4fec-85c8-9ed19b8aca2a tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Action: 'update', calling method: .version_select at 0x7f7701d85af0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:19.779532 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:37:19.779532 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:37:19.780835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-865f78cb-435c-4fec-85c8-9ed19b8aca2a tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.781289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-865f78cb-435c-4fec-85c8-9ed19b8aca2a tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.789327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-865f78cb-435c-4fec-85c8-9ed19b8aca2a tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.789786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-865f78cb-435c-4fec-85c8-9ed19b8aca2a tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.794381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d3ba401b-44c7-4182-b577-8172cee08ccf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:19.796382 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-865f78cb-435c-4fec-85c8-9ed19b8aca2a tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] HTTP exception thrown: Service 0084c323-d047-4cf3-a7e3-627d72c4e246 could not be found. May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-865f78cb-435c-4fec-85c8-9ed19b8aca2a tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Request method failure captured: May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: request: PUT /compute/v2.1/os-services/0084c323-d047-4cf3-a7e3-627d72c4e246 HTTP/1.1 May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 56 May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikab_OZGgjHEDxvx3YBp1bTestEPWKR4xX4rOLSCnq1U04YQ99scOfMiRHcc5jnRTv-0BJKulnf3pAEv2gwv42koiVfDTb4p68O6USVnPq0W_k6_mNzMRwkVhpP2_4DRMmxkUnXuSD8IbRHM57hCmGgZC-oX6_PodKG3ve1uz0Lr_08A May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: X-Openstack-Nova-Api-Version: 2.53 May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: fbe640258d8c4e9781b9f84e51a73cc3 May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1995177830 May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: X-Role: admin,reader,member May 28 04:37:19.799275 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: admin,reader,member May 28 04:37:19.800619 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fbe640258d8c4e9781b9f84e51a73cc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fbe640258d8c4e9781b9f84e51a73cc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fbe640258d8c4e9781b9f84e51a73cc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fbe640258d8c4e9781b9f84e51a73cc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:19.800619 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1995177830 May 28 04:37:19.800619 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: fbe640258d8c4e9781b9f84e51a73cc3 May 28 04:37:19.800619 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1995177830 May 28 04:37:19.800619 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin May 28 04:37:19.800619 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:37:19.800619 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:37:19.800619 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 62465fa0925a4ec4866da49bacd61081 May 28 04:37:19.800619 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin May 28 04:37:19.800619 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:37:19.800619 n-d-843700-1 devstack@n-api.service[126043]: {"status": "disabled", "disabled_reason": "maintenance"} May 28 04:37:19.800619 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:37:19.800619 n-d-843700-1 devstack@n-api.service[126043]: exception: Service 0084c323-d047-4cf3-a7e3-627d72c4e246 could not be found. May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '0084c323-d047-4cf3-a7e3-627d72c4e246', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 0084c323-d047-4cf3-a7e3-627d72c4e246 could not be found. May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:19.801446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:19.802683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:19.802683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:19.802683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:19.802683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:19.802683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:37:19.802683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:37:19.802683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:19.802683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:19.802683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:37:19.802683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:19.802683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 28 04:37:19.802683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:37:19.802683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 0084c323-d047-4cf3-a7e3-627d72c4e246 could not be found. May 28 04:37:19.802683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:19.802683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:19.802683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:19.802683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:19.802683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:19.802683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:19.802683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:19.803941 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:19.803941 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 0084c323-d047-4cf3-a7e3-627d72c4e246 could not be found. May 28 04:37:19.803941 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:19.803941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-865f78cb-435c-4fec-85c8-9ed19b8aca2a tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Returning 404 to user: Service 0084c323-d047-4cf3-a7e3-627d72c4e246 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:19.803941 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-865f78cb-435c-4fec-85c8-9ed19b8aca2a tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-services/0084c323-d047-4cf3-a7e3-627d72c4e246" status: 404 len: 110 microversion: 2.53 time: 0.155153 May 28 04:37:19.803941 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 416/938] 10.222.0.58 () {62 vars in 1308 bytes} [Sat May 28 04:37:19 2022] PUT /compute/v2.1/os-services/0084c323-d047-4cf3-a7e3-627d72c4e246 => generated 110 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 04:37:19.805025 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d3ba401b-44c7-4182-b577-8172cee08ccf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1379 microversion: 2.1 time: 0.158115 May 28 04:37:19.808459 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 523/939] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:19 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1379 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:19.822574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-80f63757-a1bc-4d5c-b399-1a4e1217b44c tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Action: 'update', calling method: .version_select at 0x7f7701d85ee0>, body: {"status": "disabled"} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:19.824935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80f63757-a1bc-4d5c-b399-1a4e1217b44c tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.825387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80f63757-a1bc-4d5c-b399-1a4e1217b44c tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.831779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80f63757-a1bc-4d5c-b399-1a4e1217b44c tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.832236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80f63757-a1bc-4d5c-b399-1a4e1217b44c tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.837464 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-80f63757-a1bc-4d5c-b399-1a4e1217b44c tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] HTTP exception thrown: Service 0084c323-d047-4cf3-a7e3-627d72c4e246 could not be found. May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-80f63757-a1bc-4d5c-b399-1a4e1217b44c tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Request method failure captured: May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: request: PUT /compute/v2.1/os-services/0084c323-d047-4cf3-a7e3-627d72c4e246 HTTP/1.1 May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 22 May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikab_OZGgjHEDxvx3YBp1bTestEPWKR4xX4rOLSCnq1U04YQ99scOfMiRHcc5jnRTv-0BJKulnf3pAEv2gwv42koiVfDTb4p68O6USVnPq0W_k6_mNzMRwkVhpP2_4DRMmxkUnXuSD8IbRHM57hCmGgZC-oX6_PodKG3ve1uz0Lr_08A May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: X-Openstack-Nova-Api-Version: 2.53 May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: fbe640258d8c4e9781b9f84e51a73cc3 May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1995177830 May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: X-Role: admin,reader,member May 28 04:37:19.839130 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: admin,reader,member May 28 04:37:19.840936 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fbe640258d8c4e9781b9f84e51a73cc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fbe640258d8c4e9781b9f84e51a73cc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fbe640258d8c4e9781b9f84e51a73cc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fbe640258d8c4e9781b9f84e51a73cc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:19.840936 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1995177830 May 28 04:37:19.840936 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: fbe640258d8c4e9781b9f84e51a73cc3 May 28 04:37:19.840936 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1995177830 May 28 04:37:19.840936 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin May 28 04:37:19.840936 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:37:19.840936 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:37:19.840936 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 62465fa0925a4ec4866da49bacd61081 May 28 04:37:19.840936 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin May 28 04:37:19.840936 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:37:19.840936 n-d-843700-1 devstack@n-api.service[126043]: {"status": "disabled"} May 28 04:37:19.840936 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:37:19.840936 n-d-843700-1 devstack@n-api.service[126043]: exception: Service 0084c323-d047-4cf3-a7e3-627d72c4e246 could not be found. May 28 04:37:19.840936 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '0084c323-d047-4cf3-a7e3-627d72c4e246', 'body': {'status': 'disabled'}} May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 0084c323-d047-4cf3-a7e3-627d72c4e246 could not be found. May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:19.841800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:19.843028 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:19.843028 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:19.843028 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:19.843028 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:37:19.843028 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:37:19.843028 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:19.843028 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:19.843028 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:37:19.843028 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:19.843028 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 28 04:37:19.843028 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:37:19.843028 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 0084c323-d047-4cf3-a7e3-627d72c4e246 could not be found. May 28 04:37:19.843028 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:19.843028 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:19.843028 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:19.843028 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:19.843028 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:19.843028 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:19.843028 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:19.843028 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:19.844202 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 0084c323-d047-4cf3-a7e3-627d72c4e246 could not be found. May 28 04:37:19.844202 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:19.844202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-80f63757-a1bc-4d5c-b399-1a4e1217b44c tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Returning 404 to user: Service 0084c323-d047-4cf3-a7e3-627d72c4e246 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:19.844202 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-80f63757-a1bc-4d5c-b399-1a4e1217b44c tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-services/0084c323-d047-4cf3-a7e3-627d72c4e246" status: 404 len: 110 microversion: 2.53 time: 0.022650 May 28 04:37:19.845428 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 417/940] 10.222.0.58 () {62 vars in 1308 bytes} [Sat May 28 04:37:19 2022] PUT /compute/v2.1/os-services/0084c323-d047-4cf3-a7e3-627d72c4e246 => generated 110 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 04:37:19.850688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2215d72f-84dd-4f58-9cf5-0f7c404670c5 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Action: 'update', calling method: .version_select at 0x7f7701e96550>, body: {"status": "enabled"} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:19.852146 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:37:19.852146 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:37:19.853393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2215d72f-84dd-4f58-9cf5-0f7c404670c5 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.853857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2215d72f-84dd-4f58-9cf5-0f7c404670c5 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.861042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=27 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:19.862448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2215d72f-84dd-4f58-9cf5-0f7c404670c5 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.862902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2215d72f-84dd-4f58-9cf5-0f7c404670c5 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.870657 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-2215d72f-84dd-4f58-9cf5-0f7c404670c5 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] HTTP exception thrown: Service 0084c323-d047-4cf3-a7e3-627d72c4e246 could not be found. May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2215d72f-84dd-4f58-9cf5-0f7c404670c5 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Request method failure captured: May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: request: PUT /compute/v2.1/os-services/0084c323-d047-4cf3-a7e3-627d72c4e246 HTTP/1.1 May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 21 May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikab_OZGgjHEDxvx3YBp1bTestEPWKR4xX4rOLSCnq1U04YQ99scOfMiRHcc5jnRTv-0BJKulnf3pAEv2gwv42koiVfDTb4p68O6USVnPq0W_k6_mNzMRwkVhpP2_4DRMmxkUnXuSD8IbRHM57hCmGgZC-oX6_PodKG3ve1uz0Lr_08A May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: X-Openstack-Nova-Api-Version: 2.53 May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: fbe640258d8c4e9781b9f84e51a73cc3 May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1995177830 May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:37:19.872810 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:37:19.874373 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fbe640258d8c4e9781b9f84e51a73cc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fbe640258d8c4e9781b9f84e51a73cc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fbe640258d8c4e9781b9f84e51a73cc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fbe640258d8c4e9781b9f84e51a73cc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:19.874373 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1995177830 May 28 04:37:19.874373 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: fbe640258d8c4e9781b9f84e51a73cc3 May 28 04:37:19.874373 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1995177830 May 28 04:37:19.874373 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin May 28 04:37:19.874373 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:37:19.874373 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:37:19.874373 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 62465fa0925a4ec4866da49bacd61081 May 28 04:37:19.874373 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin May 28 04:37:19.874373 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:37:19.874373 n-d-843700-1 devstack@n-api.service[126044]: {"status": "enabled"} May 28 04:37:19.874373 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:37:19.874373 n-d-843700-1 devstack@n-api.service[126044]: exception: Service 0084c323-d047-4cf3-a7e3-627d72c4e246 could not be found. May 28 04:37:19.874373 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '0084c323-d047-4cf3-a7e3-627d72c4e246', 'body': {'status': 'enabled'}} May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 0084c323-d047-4cf3-a7e3-627d72c4e246 could not be found. May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:19.875871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:19.877108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:19.877108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:19.877108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:19.877108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:37:19.877108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:37:19.877108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:19.877108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:19.877108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:37:19.877108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:19.877108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 28 04:37:19.877108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:37:19.877108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 0084c323-d047-4cf3-a7e3-627d72c4e246 could not be found. May 28 04:37:19.877108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:19.877108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:19.877108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:19.877108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:19.877108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:19.877108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:19.877108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:19.877108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:19.878263 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 0084c323-d047-4cf3-a7e3-627d72c4e246 could not be found. May 28 04:37:19.878263 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:19.878263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2215d72f-84dd-4f58-9cf5-0f7c404670c5 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Returning 404 to user: Service 0084c323-d047-4cf3-a7e3-627d72c4e246 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:19.878263 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2215d72f-84dd-4f58-9cf5-0f7c404670c5 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-services/0084c323-d047-4cf3-a7e3-627d72c4e246" status: 404 len: 110 microversion: 2.53 time: 0.027519 May 28 04:37:19.878263 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 524/941] 10.222.0.58 () {62 vars in 1308 bytes} [Sat May 28 04:37:19 2022] PUT /compute/v2.1/os-services/0084c323-d047-4cf3-a7e3-627d72c4e246 => generated 110 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 04:37:19.884521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-efc705e3-9e87-4918-b8a5-e038761a81aa tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:19.885700 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:37:19.885700 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:37:19.886908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-efc705e3-9e87-4918-b8a5-e038761a81aa tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.887490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-efc705e3-9e87-4918-b8a5-e038761a81aa tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.888308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-efc705e3-9e87-4918-b8a5-e038761a81aa tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.888749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-efc705e3-9e87-4918-b8a5-e038761a81aa tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.913014 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-efc705e3-9e87-4918-b8a5-e038761a81aa tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.032224 May 28 04:37:19.913603 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 418/942] 10.222.0.58 () {60 vars in 1177 bytes} [Sat May 28 04:37:19 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:19.925590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-51c9f11f-1845-44af-bd32-972bbc2e1316 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:19.926819 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:37:19.926819 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:37:19.928051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51c9f11f-1845-44af-bd32-972bbc2e1316 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.928510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51c9f11f-1845-44af-bd32-972bbc2e1316 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.929314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51c9f11f-1845-44af-bd32-972bbc2e1316 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.929754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51c9f11f-1845-44af-bd32-972bbc2e1316 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.954651 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-51c9f11f-1845-44af-bd32-972bbc2e1316 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.032037 May 28 04:37:19.955310 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 525/943] 10.222.0.58 () {60 vars in 1210 bytes} [Sat May 28 04:37:19 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:19.968265 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8ab4923a-6c83-437a-8447-6e3d3f5433e2 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:19.969552 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:37:19.969552 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:37:19.970742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ab4923a-6c83-437a-8447-6e3d3f5433e2 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.971271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ab4923a-6c83-437a-8447-6e3d3f5433e2 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.972020 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ab4923a-6c83-437a-8447-6e3d3f5433e2 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:19.972477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ab4923a-6c83-437a-8447-6e3d3f5433e2 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:19.995675 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8ab4923a-6c83-437a-8447-6e3d3f5433e2 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.031176 May 28 04:37:19.996279 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 419/944] 10.222.0.58 () {60 vars in 1177 bytes} [Sat May 28 04:37:19 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:20.007543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-edfbc6ba-c13d-4249-a43b-3bc4cbf3c685 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:20.009135 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:37:20.009135 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:37:20.010480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-edfbc6ba-c13d-4249-a43b-3bc4cbf3c685 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:20.011163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-edfbc6ba-c13d-4249-a43b-3bc4cbf3c685 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:20.011981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-edfbc6ba-c13d-4249-a43b-3bc4cbf3c685 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:20.012479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-edfbc6ba-c13d-4249-a43b-3bc4cbf3c685 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:20.054196 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-edfbc6ba-c13d-4249-a43b-3bc4cbf3c685 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=n-d-843700-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.050380 May 28 04:37:20.054959 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 526/945] 10.222.0.58 () {60 vars in 1234 bytes} [Sat May 28 04:37:20 2022] GET /compute/v2.1/os-services?host=n-d-843700-1&binary=xxx => generated 16 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:20.066209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-91eeaf76-ab17-4234-a4ca-afd66405e5ed tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:20.067515 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:37:20.067515 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:37:20.069122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91eeaf76-ab17-4234-a4ca-afd66405e5ed tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:20.070428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91eeaf76-ab17-4234-a4ca-afd66405e5ed tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:20.071299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91eeaf76-ab17-4234-a4ca-afd66405e5ed tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:20.071748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91eeaf76-ab17-4234-a4ca-afd66405e5ed tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:20.099834 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-91eeaf76-ab17-4234-a4ca-afd66405e5ed tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.038049 May 28 04:37:20.100446 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 420/946] 10.222.0.58 () {60 vars in 1177 bytes} [Sat May 28 04:37:20 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:20.112230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-24fd4917-2551-4c8e-a7bb-f36b248db3e7 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:20.114651 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:37:20.114651 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:37:20.116142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24fd4917-2551-4c8e-a7bb-f36b248db3e7 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:20.116681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24fd4917-2551-4c8e-a7bb-f36b248db3e7 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:20.117606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24fd4917-2551-4c8e-a7bb-f36b248db3e7 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:20.118123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24fd4917-2551-4c8e-a7bb-f36b248db3e7 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:20.142721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ada756f9-7e84-4131-9a16-c176fde291e9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:20.143632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ada756f9-7e84-4131-9a16-c176fde291e9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:20.145841 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-24fd4917-2551-4c8e-a7bb-f36b248db3e7 tempest-ServicesAdminNegativeV253TestJSON-1995177830 tempest-ServicesAdminNegativeV253TestJSON-1995177830-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.038060 May 28 04:37:20.152176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:20.152176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ada756f9-7e84-4131-9a16-c176fde291e9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:20.152176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ada756f9-7e84-4131-9a16-c176fde291e9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:20.152988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ada756f9-7e84-4131-9a16-c176fde291e9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:20.153667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ada756f9-7e84-4131-9a16-c176fde291e9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:20.154160 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 527/947] 10.222.0.58 () {60 vars in 1238 bytes} [Sat May 28 04:37:20 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:20.276852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ada756f9-7e84-4131-9a16-c176fde291e9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:20.290327 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ada756f9-7e84-4131-9a16-c176fde291e9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 200 len: 1291 microversion: 2.1 time: 0.152046 May 28 04:37:20.291733 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 421/948] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:20 2022] GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 1291 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:37:20.318315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e46f94ee-97c7-4e67-8752-eadb68567b77 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:20.319342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e46f94ee-97c7-4e67-8752-eadb68567b77 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:20.326714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e46f94ee-97c7-4e67-8752-eadb68567b77 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:20.327575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e46f94ee-97c7-4e67-8752-eadb68567b77 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:20.328739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e46f94ee-97c7-4e67-8752-eadb68567b77 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:20.329480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e46f94ee-97c7-4e67-8752-eadb68567b77 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:20.336338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-61d42259-e81c-4243-a380-420b1a90ebf1 tempest-ServicesAdminNegativeV253TestJSON-1469047373 tempest-ServicesAdminNegativeV253TestJSON-1469047373-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:20.338502 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:37:20.338502 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:37:20.345832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-61d42259-e81c-4243-a380-420b1a90ebf1 tempest-ServicesAdminNegativeV253TestJSON-1469047373 tempest-ServicesAdminNegativeV253TestJSON-1469047373-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b9b022be5a104e9bbf8feec84c25c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd6ff4be41d4c3e9807ded826342ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-61d42259-e81c-4243-a380-420b1a90ebf1 tempest-ServicesAdminNegativeV253TestJSON-1469047373 tempest-ServicesAdminNegativeV253TestJSON-1469047373-project] Request method failure captured: May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-services HTTP/1.1 May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikab-izKvD8VJsXxz_Frxprygd45vxWvXs1TnuUYiu7KBzblz8i5n6Z9HyDg9sgUwvKIGb-gBIlDHO9T_cIMnn7K4HjWW_ubiVD0oJlFh-jtG5qbdTqNNALDBSjLWsug8AU7QSzeMRTsJM5nf2wTYjOTg5Bn4P1Lzo07qNtww_hhCEIM May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: X-Openstack-Nova-Api-Version: 2.53 May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 7fd6ff4be41d4c3e9807ded826342ef6 May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1469047373 May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:37:20.350735 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:37:20.352347 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7fd6ff4be41d4c3e9807ded826342ef6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7fd6ff4be41d4c3e9807ded826342ef6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7fd6ff4be41d4c3e9807ded826342ef6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7fd6ff4be41d4c3e9807ded826342ef6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:20.352347 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1469047373 May 28 04:37:20.352347 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 7fd6ff4be41d4c3e9807ded826342ef6 May 28 04:37:20.352347 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1469047373 May 28 04:37:20.352347 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1469047373-project May 28 04:37:20.352347 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:37:20.352347 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:37:20.352347 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: b9b022be5a104e9bbf8feec84c25c14b May 28 04:37:20.352347 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1469047373-project May 28 04:37:20.352347 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:37:20.352347 n-d-843700-1 devstack@n-api.service[126044]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. May 28 04:37:20.352347 n-d-843700-1 devstack@n-api.service[126044]: action_args: {} May 28 04:37:20.353303 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:20.353303 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:20.353303 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:20.353303 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:20.353303 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:20.353303 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:20.353303 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:37:20.353303 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:20.353303 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:37:20.353303 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:20.353303 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:20.353303 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:20.353303 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index May 28 04:37:20.353303 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) May 28 04:37:20.353303 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:37:20.353303 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:37:20.353303 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:37:20.353303 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:37:20.353303 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:37:20.354698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:37:20.354698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:37:20.354698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:37:20.354698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:37:20.354698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:37:20.354698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:37:20.354698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:37:20.354698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:37:20.354698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:37:20.354698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. May 28 04:37:20.354698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:20.354698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:20.354698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:20.354698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:20.354698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:20.354698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:20.354698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:37:20.354698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:37:20.354698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. May 28 04:37:20.354698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:20.359032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-61d42259-e81c-4243-a380-420b1a90ebf1 tempest-ServicesAdminNegativeV253TestJSON-1469047373 tempest-ServicesAdminNegativeV253TestJSON-1469047373-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:20.360836 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-61d42259-e81c-4243-a380-420b1a90ebf1 tempest-ServicesAdminNegativeV253TestJSON-1469047373 tempest-ServicesAdminNegativeV253TestJSON-1469047373-project] 10.222.0.58 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.185669 May 28 04:37:20.368668 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 528/949] 10.222.0.58 () {60 vars in 1177 bytes} [Sat May 28 04:37:20 2022] GET /compute/v2.1/os-services => generated 112 bytes in 214 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) May 28 04:37:20.515838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e46f94ee-97c7-4e67-8752-eadb68567b77 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:20.523829 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e46f94ee-97c7-4e67-8752-eadb68567b77 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1474 microversion: 2.1 time: 0.211623 May 28 04:37:20.524438 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 422/950] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:20 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1474 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:20.661884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-857a3703-174f-41bc-8c74-4cc5e07c5a9c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:20.662651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6df30043-3cbd-4ccc-9c2b-63246cf505da tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:20.663348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6df30043-3cbd-4ccc-9c2b-63246cf505da tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:20.663662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-857a3703-174f-41bc-8c74-4cc5e07c5a9c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: a27b8082-4f44-4263-a6a2-86291ea3950b] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:20.670625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6df30043-3cbd-4ccc-9c2b-63246cf505da tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:20.671113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6df30043-3cbd-4ccc-9c2b-63246cf505da tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:20.672019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6df30043-3cbd-4ccc-9c2b-63246cf505da tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:20.673068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6df30043-3cbd-4ccc-9c2b-63246cf505da tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:20.675042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-857a3703-174f-41bc-8c74-4cc5e07c5a9c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:20.675792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-857a3703-174f-41bc-8c74-4cc5e07c5a9c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:20.677156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-857a3703-174f-41bc-8c74-4cc5e07c5a9c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:20.677869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-857a3703-174f-41bc-8c74-4cc5e07c5a9c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:20.699254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:20.851683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=80 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:20.869403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-857a3703-174f-41bc-8c74-4cc5e07c5a9c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:20.880090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6df30043-3cbd-4ccc-9c2b-63246cf505da tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:20.882725 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-857a3703-174f-41bc-8c74-4cc5e07c5a9c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b" status: 200 len: 1474 microversion: 2.1 time: 0.221088 May 28 04:37:20.882725 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 529/951] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:20 2022] GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b => generated 1474 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:20.890027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4d3b9425-2c54-4a28-875b-a2686a67c65b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:20.891177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4d3b9425-2c54-4a28-875b-a2686a67c65b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:20.901994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d3b9425-2c54-4a28-875b-a2686a67c65b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:20.902604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d3b9425-2c54-4a28-875b-a2686a67c65b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:20.903492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d3b9425-2c54-4a28-875b-a2686a67c65b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:20.903941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d3b9425-2c54-4a28-875b-a2686a67c65b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:20.909463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6df30043-3cbd-4ccc-9c2b-63246cf505da tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:20.917664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6df30043-3cbd-4ccc-9c2b-63246cf505da tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:20.919230 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6df30043-3cbd-4ccc-9c2b-63246cf505da tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1361 microversion: 2.25 time: 0.260921 May 28 04:37:20.921217 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 423/952] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:20 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1361 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:21.062750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4d3b9425-2c54-4a28-875b-a2686a67c65b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:21.070416 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4d3b9425-2c54-4a28-875b-a2686a67c65b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1379 microversion: 2.1 time: 0.187298 May 28 04:37:21.080846 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 530/953] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:20 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1379 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:21.308389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9ba48366-2866-499e-b063-490e576a987f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:21.308929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9ba48366-2866-499e-b063-490e576a987f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:21.316830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ba48366-2866-499e-b063-490e576a987f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:21.317326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ba48366-2866-499e-b063-490e576a987f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:21.318103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ba48366-2866-499e-b063-490e576a987f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:21.318544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ba48366-2866-499e-b063-490e576a987f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:21.381561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9ba48366-2866-499e-b063-490e576a987f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:21.389269 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9ba48366-2866-499e-b063-490e576a987f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 200 len: 1279 microversion: 2.1 time: 0.085169 May 28 04:37:21.389850 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 424/954] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:21 2022] GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 1279 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:21.426405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-c0b9b989-7f4a-4f98-999e-bc58df299c32 req-638c7d61-9101-44e3-a01f-51dc920a10f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a27b8082-4f44-4263-a6a2-86291ea3950b", "name": "network-vif-deleted", "tag": "06f37629-13a1-489c-9d41-01ab1fa9a306"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:21.431121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:21.435611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c0b9b989-7f4a-4f98-999e-bc58df299c32 req-638c7d61-9101-44e3-a01f-51dc920a10f5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:21.436056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c0b9b989-7f4a-4f98-999e-bc58df299c32 req-638c7d61-9101-44e3-a01f-51dc920a10f5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:21.448275 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-c0b9b989-7f4a-4f98-999e-bc58df299c32 req-638c7d61-9101-44e3-a01f-51dc920a10f5 service nova] Creating event network-vif-deleted:06f37629-13a1-489c-9d41-01ab1fa9a306 for instance a27b8082-4f44-4263-a6a2-86291ea3950b on n-h2-843700-1 May 28 04:37:21.453201 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-c0b9b989-7f4a-4f98-999e-bc58df299c32 req-638c7d61-9101-44e3-a01f-51dc920a10f5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030566 May 28 04:37:21.454580 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 531/955] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:21.541131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dbad03fa-9529-4375-a958-cc3a49792086 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:21.541830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dbad03fa-9529-4375-a958-cc3a49792086 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:21.548490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dbad03fa-9529-4375-a958-cc3a49792086 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:21.549016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dbad03fa-9529-4375-a958-cc3a49792086 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:21.549852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dbad03fa-9529-4375-a958-cc3a49792086 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:21.550491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dbad03fa-9529-4375-a958-cc3a49792086 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:21.709889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dbad03fa-9529-4375-a958-cc3a49792086 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:21.724055 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dbad03fa-9529-4375-a958-cc3a49792086 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1474 microversion: 2.1 time: 0.186811 May 28 04:37:21.734232 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 425/956] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:21 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1474 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:21.907030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8c341657-12ea-4afb-9728-cdf8d0da411b tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:21.907840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8c341657-12ea-4afb-9728-cdf8d0da411b tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: a27b8082-4f44-4263-a6a2-86291ea3950b] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:21.910240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b5b3b4d0-fa9d-4acd-b590-a84c99c320be tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:21.910855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b5b3b4d0-fa9d-4acd-b590-a84c99c320be tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:21.918563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c341657-12ea-4afb-9728-cdf8d0da411b tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:21.919427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c341657-12ea-4afb-9728-cdf8d0da411b tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:21.921027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c341657-12ea-4afb-9728-cdf8d0da411b tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:21.921700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c341657-12ea-4afb-9728-cdf8d0da411b tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:21.923097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b5b3b4d0-fa9d-4acd-b590-a84c99c320be tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:21.925212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b5b3b4d0-fa9d-4acd-b590-a84c99c320be tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:21.927097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b5b3b4d0-fa9d-4acd-b590-a84c99c320be tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:21.927734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b5b3b4d0-fa9d-4acd-b590-a84c99c320be tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:22.007168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b5b3b4d0-fa9d-4acd-b590-a84c99c320be tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:37:22.018429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8c341657-12ea-4afb-9728-cdf8d0da411b tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:22.026788 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8c341657-12ea-4afb-9728-cdf8d0da411b tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b" status: 200 len: 1432 microversion: 2.1 time: 0.130714 May 28 04:37:22.036266 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 426/957] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:21 2022] GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b => generated 1432 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:22.036266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8dc116e8-e393-4c16-b55c-f091c3f2c83e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:22.036266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8dc116e8-e393-4c16-b55c-f091c3f2c83e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:22.044884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8dc116e8-e393-4c16-b55c-f091c3f2c83e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:22.044884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8dc116e8-e393-4c16-b55c-f091c3f2c83e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:22.045508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8dc116e8-e393-4c16-b55c-f091c3f2c83e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:22.045946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8dc116e8-e393-4c16-b55c-f091c3f2c83e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:22.265846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8dc116e8-e393-4c16-b55c-f091c3f2c83e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:22.278877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8dc116e8-e393-4c16-b55c-f091c3f2c83e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:22.280745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8dc116e8-e393-4c16-b55c-f091c3f2c83e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:22.282659 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8dc116e8-e393-4c16-b55c-f091c3f2c83e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1361 microversion: 2.25 time: 0.249916 May 28 04:37:22.283754 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 427/958] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:22 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:22.296975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e9820062-f394-459b-a457-bcea0f226d10 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:22.300896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e9820062-f394-459b-a457-bcea0f226d10 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:22.308880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9820062-f394-459b-a457-bcea0f226d10 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:22.309350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9820062-f394-459b-a457-bcea0f226d10 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:22.310150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9820062-f394-459b-a457-bcea0f226d10 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:22.310593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9820062-f394-459b-a457-bcea0f226d10 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:22.321386 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b5b3b4d0-fa9d-4acd-b590-a84c99c320be tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "DELETE /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8" status: 204 len: 0 microversion: 2.1 time: 0.425792 May 28 04:37:22.322097 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 532/959] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:37:21 2022] DELETE /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 04:37:22.408534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fa4056da-9da2-4842-9afa-310af8a6ea6f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:22.409419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fa4056da-9da2-4842-9afa-310af8a6ea6f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:22.420804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa4056da-9da2-4842-9afa-310af8a6ea6f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:22.421410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa4056da-9da2-4842-9afa-310af8a6ea6f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:22.423660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa4056da-9da2-4842-9afa-310af8a6ea6f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:22.424217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa4056da-9da2-4842-9afa-310af8a6ea6f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:22.499556 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e9820062-f394-459b-a457-bcea0f226d10 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:22.512584 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e9820062-f394-459b-a457-bcea0f226d10 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1379 microversion: 2.1 time: 0.224591 May 28 04:37:22.513725 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 428/960] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:22 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1379 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:22.528135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5096feb8-11a4-46d2-a11f-7657fdc87b83 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2111723137", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "1960087950", "adminPass": "***", "networks": [{"uuid": "f493df89-4f63-4577-b13a-401006b19043"}], "security_groups": [{"name": "tempest-securitygroup--724082104"}], "key_name": "tempest-keypair-255921009", "user_data": "}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:22.672204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fa4056da-9da2-4842-9afa-310af8a6ea6f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:22.681081 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fa4056da-9da2-4842-9afa-310af8a6ea6f tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 200 len: 1321 microversion: 2.1 time: 0.277593 May 28 04:37:22.681914 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 533/961] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:22 2022] GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:22.704922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-5096feb8-11a4-46d2-a11f-7657fdc87b83 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] validate_networks() for [('f493df89-4f63-4577-b13a-401006b19043', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:37:22.740940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fa1d76f3-ea5b-430c-aa31-152b9d4f8524 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:22.741644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fa1d76f3-ea5b-430c-aa31-152b9d4f8524 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:22.747520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa1d76f3-ea5b-430c-aa31-152b9d4f8524 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:22.750370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa1d76f3-ea5b-430c-aa31-152b9d4f8524 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:22.750370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa1d76f3-ea5b-430c-aa31-152b9d4f8524 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:22.750370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa1d76f3-ea5b-430c-aa31-152b9d4f8524 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:22.819283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fa1d76f3-ea5b-430c-aa31-152b9d4f8524 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:22.827027 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fa1d76f3-ea5b-430c-aa31-152b9d4f8524 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1303 microversion: 2.1 time: 0.089948 May 28 04:37:22.827634 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 534/962] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:22 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1303 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:37:23.044596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-285348f6-6e18-48d2-a4e7-b9ffcb5492c1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:23.045901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-285348f6-6e18-48d2-a4e7-b9ffcb5492c1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: a27b8082-4f44-4263-a6a2-86291ea3950b] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:23.055632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-285348f6-6e18-48d2-a4e7-b9ffcb5492c1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:23.056105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-285348f6-6e18-48d2-a4e7-b9ffcb5492c1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:23.056958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-285348f6-6e18-48d2-a4e7-b9ffcb5492c1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:23.059086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-285348f6-6e18-48d2-a4e7-b9ffcb5492c1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:23.116572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-285348f6-6e18-48d2-a4e7-b9ffcb5492c1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:23.117251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-285348f6-6e18-48d2-a4e7-b9ffcb5492c1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:23.121052 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-285348f6-6e18-48d2-a4e7-b9ffcb5492c1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lazy-loading 'fault' on Instance uuid a27b8082-4f44-4263-a6a2-86291ea3950b {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:37:23.177557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-285348f6-6e18-48d2-a4e7-b9ffcb5492c1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:23.186699 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-285348f6-6e18-48d2-a4e7-b9ffcb5492c1 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b" status: 200 len: 1308 microversion: 2.1 time: 0.146510 May 28 04:37:23.187616 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 535/963] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:23 2022] GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b => generated 1308 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:37:23.206617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-5096feb8-11a4-46d2-a11f-7657fdc87b83 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:37:23.207127 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-5096feb8-11a4-46d2-a11f-7657fdc87b83 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:37:23.207669 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-5096feb8-11a4-46d2-a11f-7657fdc87b83 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:37:23.208032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-5096feb8-11a4-46d2-a11f-7657fdc87b83 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:37:23.208641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-5096feb8-11a4-46d2-a11f-7657fdc87b83 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:37:23.220155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5096feb8-11a4-46d2-a11f-7657fdc87b83 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:23.220605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5096feb8-11a4-46d2-a11f-7657fdc87b83 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:23.227108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5096feb8-11a4-46d2-a11f-7657fdc87b83 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:23.227108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5096feb8-11a4-46d2-a11f-7657fdc87b83 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:23.240421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-5096feb8-11a4-46d2-a11f-7657fdc87b83 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Getting quotas for project 7b5e68532952468cbd37fad9b381d355. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:37:23.245559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-5096feb8-11a4-46d2-a11f-7657fdc87b83 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Getting quotas for user c567ca604e0743bf874889ba69bbeb49 and project 7b5e68532952468cbd37fad9b381d355. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:37:23.261385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5096feb8-11a4-46d2-a11f-7657fdc87b83 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:37:23.268879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5096feb8-11a4-46d2-a11f-7657fdc87b83 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:37:23.304064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-58e783b7-c060-441f-93e4-a4d5be643263 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:23.304956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-58e783b7-c060-441f-93e4-a4d5be643263 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:23.313480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58e783b7-c060-441f-93e4-a4d5be643263 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:23.314331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58e783b7-c060-441f-93e4-a4d5be643263 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:23.315266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58e783b7-c060-441f-93e4-a4d5be643263 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:23.316307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58e783b7-c060-441f-93e4-a4d5be643263 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:23.435402 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5096feb8-11a4-46d2-a11f-7657fdc87b83 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.920192 May 28 04:37:23.436373 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 429/964] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:37:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:37:23.446834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3c71d5e3-3c71-44df-b7b4-a811ee4b104b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:23.447607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3c71d5e3-3c71-44df-b7b4-a811ee4b104b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:23.520223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3c71d5e3-3c71-44df-b7b4-a811ee4b104b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:23.521494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-58e783b7-c060-441f-93e4-a4d5be643263 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:23.530152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-58e783b7-c060-441f-93e4-a4d5be643263 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:23.532547 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3c71d5e3-3c71-44df-b7b4-a811ee4b104b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3" status: 200 len: 1264 microversion: 2.1 time: 0.089542 May 28 04:37:23.533391 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 430/965] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:23 2022] GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 => generated 1264 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:37:23.534701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-58e783b7-c060-441f-93e4-a4d5be643263 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:23.538403 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-58e783b7-c060-441f-93e4-a4d5be643263 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1557 microversion: 2.25 time: 0.240116 May 28 04:37:23.539232 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 536/966] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:23 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1557 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:23.552768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-db1aef2e-4278-46eb-8490-ed1385b551ba req-3a19cbc5-61c2-400c-8cfb-889b9949c76f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89406e18-7fa9-41e4-9fe8-34ce8a7255cf", "name": "network-vif-deleted", "tag": "a8602bdf-b159-4e10-9f57-681347e49a0b"}, {"name": "network-changed", "server_uuid": "a1679ae8-ff3a-4444-bd5b-9498c7078083", "tag": "462fb92a-28d1-45af-8dba-233b2299a5a8"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:23.566347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ca99c912-1283-479b-961f-6ad4044e05f6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:23.566347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ca99c912-1283-479b-961f-6ad4044e05f6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:23.578577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca99c912-1283-479b-961f-6ad4044e05f6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:23.583653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca99c912-1283-479b-961f-6ad4044e05f6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:23.584728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca99c912-1283-479b-961f-6ad4044e05f6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:23.587192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca99c912-1283-479b-961f-6ad4044e05f6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:23.591199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-db1aef2e-4278-46eb-8490-ed1385b551ba req-3a19cbc5-61c2-400c-8cfb-889b9949c76f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:23.591993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-db1aef2e-4278-46eb-8490-ed1385b551ba req-3a19cbc5-61c2-400c-8cfb-889b9949c76f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:23.605818 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-db1aef2e-4278-46eb-8490-ed1385b551ba req-3a19cbc5-61c2-400c-8cfb-889b9949c76f service nova] Creating event network-vif-deleted:a8602bdf-b159-4e10-9f57-681347e49a0b for instance 89406e18-7fa9-41e4-9fe8-34ce8a7255cf on n-h2-843700-1 May 28 04:37:23.606398 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-db1aef2e-4278-46eb-8490-ed1385b551ba req-3a19cbc5-61c2-400c-8cfb-889b9949c76f service nova] Creating event network-changed:462fb92a-28d1-45af-8dba-233b2299a5a8 for instance a1679ae8-ff3a-4444-bd5b-9498c7078083 on n-h1-843700-1 May 28 04:37:23.616417 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-db1aef2e-4278-46eb-8490-ed1385b551ba req-3a19cbc5-61c2-400c-8cfb-889b9949c76f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.071127 May 28 04:37:23.617615 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 431/967] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:23.623510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c5d66f16-28ac-4e6f-870d-d01ffc5a717f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:23.624293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c5d66f16-28ac-4e6f-870d-d01ffc5a717f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:23.643359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5d66f16-28ac-4e6f-870d-d01ffc5a717f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:23.643817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5d66f16-28ac-4e6f-870d-d01ffc5a717f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:23.644598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5d66f16-28ac-4e6f-870d-d01ffc5a717f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:23.645036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5d66f16-28ac-4e6f-870d-d01ffc5a717f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:23.800357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ca99c912-1283-479b-961f-6ad4044e05f6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:23.800357 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ca99c912-1283-479b-961f-6ad4044e05f6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1379 microversion: 2.1 time: 0.248431 May 28 04:37:23.800929 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 537/968] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:23 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1379 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:23.812030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aceacf9e-4a74-4578-a6e5-159b8382597b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:23.812030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aceacf9e-4a74-4578-a6e5-159b8382597b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:23.815877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aceacf9e-4a74-4578-a6e5-159b8382597b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:23.817492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aceacf9e-4a74-4578-a6e5-159b8382597b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:23.820026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aceacf9e-4a74-4578-a6e5-159b8382597b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:23.820522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aceacf9e-4a74-4578-a6e5-159b8382597b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:23.868844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-c5d66f16-28ac-4e6f-870d-d01ffc5a717f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lazy-loading 'services' on Instance uuid 18cb68a1-94a5-4af2-a376-46e7493e7454 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:37:23.928546 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c5d66f16-28ac-4e6f-870d-d01ffc5a717f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 2049 microversion: 2.25 time: 0.309444 May 28 04:37:23.928933 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 432/969] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:23 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 2049 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:23.933814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d3f892a6-7008-4789-a12c-71743004dcbb tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:23.934475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d3f892a6-7008-4789-a12c-71743004dcbb tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:23.941174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3f892a6-7008-4789-a12c-71743004dcbb tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:23.941759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3f892a6-7008-4789-a12c-71743004dcbb tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:23.942814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3f892a6-7008-4789-a12c-71743004dcbb tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:23.943476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3f892a6-7008-4789-a12c-71743004dcbb tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:24.062029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d3f892a6-7008-4789-a12c-71743004dcbb tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:24.074851 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d3f892a6-7008-4789-a12c-71743004dcbb tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1303 microversion: 2.1 time: 0.144437 May 28 04:37:24.076957 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 433/970] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:23 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1303 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:24.084312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bcfd5e01-7277-4dbf-bb0f-60d640fd575c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:24.087239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bcfd5e01-7277-4dbf-bb0f-60d640fd575c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:24.094094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aceacf9e-4a74-4578-a6e5-159b8382597b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:24.097894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bcfd5e01-7277-4dbf-bb0f-60d640fd575c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:24.099603 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bcfd5e01-7277-4dbf-bb0f-60d640fd575c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:24.100812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bcfd5e01-7277-4dbf-bb0f-60d640fd575c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:24.102809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bcfd5e01-7277-4dbf-bb0f-60d640fd575c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:24.104487 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aceacf9e-4a74-4578-a6e5-159b8382597b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 200 len: 1321 microversion: 2.1 time: 0.302837 May 28 04:37:24.105739 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 538/971] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:23 2022] GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:24.206110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-41fa9950-469e-41fa-8f56-f406a4980543 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:24.206733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-41fa9950-469e-41fa-8f56-f406a4980543 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: a27b8082-4f44-4263-a6a2-86291ea3950b] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:24.223015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41fa9950-469e-41fa-8f56-f406a4980543 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:24.223889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41fa9950-469e-41fa-8f56-f406a4980543 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:24.224685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41fa9950-469e-41fa-8f56-f406a4980543 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:24.225147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41fa9950-469e-41fa-8f56-f406a4980543 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:24.272102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41fa9950-469e-41fa-8f56-f406a4980543 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:24.272564 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41fa9950-469e-41fa-8f56-f406a4980543 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:24.273025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-41fa9950-469e-41fa-8f56-f406a4980543 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lazy-loading 'fault' on Instance uuid a27b8082-4f44-4263-a6a2-86291ea3950b {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:37:24.329436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-41fa9950-469e-41fa-8f56-f406a4980543 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab597e5a574f01910a9e0fe680fdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc7de2bf82417f8d26ad8ce4a50b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:24.338626 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-41fa9950-469e-41fa-8f56-f406a4980543 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b" status: 200 len: 1308 microversion: 2.1 time: 0.137010 May 28 04:37:24.339251 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 539/972] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:24 2022] GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b => generated 1308 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:37:24.358187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-bcfd5e01-7277-4dbf-bb0f-60d640fd575c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lazy-loading 'services' on Instance uuid 18cb68a1-94a5-4af2-a376-46e7493e7454 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:37:24.387982 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bcfd5e01-7277-4dbf-bb0f-60d640fd575c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 2049 microversion: 2.25 time: 0.309605 May 28 04:37:24.388623 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 434/973] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:24 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 2049 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:24.412946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-75da0d15-bff8-4ea2-8d54-60aeef49b14c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:24.415115 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:37:24.415115 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:37:24.416259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5cd2595b-9102-4fac-949c-55ecfe108b50 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:24.417112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5cd2595b-9102-4fac-949c-55ecfe108b50 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:24.417237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75da0d15-bff8-4ea2-8d54-60aeef49b14c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:24.418039 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75da0d15-bff8-4ea2-8d54-60aeef49b14c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:24.418927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75da0d15-bff8-4ea2-8d54-60aeef49b14c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:24.420637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75da0d15-bff8-4ea2-8d54-60aeef49b14c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:24.426929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5cd2595b-9102-4fac-949c-55ecfe108b50 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:24.427656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5cd2595b-9102-4fac-949c-55ecfe108b50 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:24.428623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5cd2595b-9102-4fac-949c-55ecfe108b50 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:24.429412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5cd2595b-9102-4fac-949c-55ecfe108b50 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:24.455977 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-75da0d15-bff8-4ea2-8d54-60aeef49b14c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.046980 May 28 04:37:24.457921 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 540/974] 10.222.0.58 () {60 vars in 1216 bytes} [Sat May 28 04:37:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:37:24.476156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4816faa4-bdfd-44db-bf1a-22b4b1d3d751 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:24.477307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4816faa4-bdfd-44db-bf1a-22b4b1d3d751 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:24.491540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4816faa4-bdfd-44db-bf1a-22b4b1d3d751 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:24.492012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4816faa4-bdfd-44db-bf1a-22b4b1d3d751 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:24.494946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4816faa4-bdfd-44db-bf1a-22b4b1d3d751 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:24.495451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4816faa4-bdfd-44db-bf1a-22b4b1d3d751 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:24.520238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:24.591430 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5cd2595b-9102-4fac-949c-55ecfe108b50 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1692 microversion: 2.1 time: 0.179069 May 28 04:37:24.592338 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 435/975] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:24 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1692 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:24.600384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-af2713a3-3ba2-49d4-a36e-97da5d9cab45 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:24.601393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-af2713a3-3ba2-49d4-a36e-97da5d9cab45 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:24.658065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-af2713a3-3ba2-49d4-a36e-97da5d9cab45 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:24.665093 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-af2713a3-3ba2-49d4-a36e-97da5d9cab45 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3" status: 200 len: 1264 microversion: 2.1 time: 0.071544 May 28 04:37:24.665713 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 436/976] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:24 2022] GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 => generated 1264 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:24.670263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-804c312c-9b54-4844-8092-bd1798524e31 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843700-1", "block_migration": true, "disk_over_commit": false}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:24.671469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-804c312c-9b54-4844-8092-bd1798524e31 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:24.679261 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-804c312c-9b54-4844-8092-bd1798524e31 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:24.679730 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-804c312c-9b54-4844-8092-bd1798524e31 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:24.680520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-804c312c-9b54-4844-8092-bd1798524e31 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:24.680966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-804c312c-9b54-4844-8092-bd1798524e31 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:24.706951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-804c312c-9b54-4844-8092-bd1798524e31 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lazy-loading 'flavor' on Instance uuid 67f64b8b-70f7-43c3-85df-66f0e9104617 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:37:24.720062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-804c312c-9b54-4844-8092-bd1798524e31 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Going to try to live migrate instance to n-h1-843700-1 {{(pid=126043) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 28 04:37:24.805265 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4816faa4-bdfd-44db-bf1a-22b4b1d3d751 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454/action" status: 202 len: 0 microversion: 2.25 time: 0.332896 May 28 04:37:24.807632 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 541/977] 10.222.0.58 () {62 vars in 1318 bytes} [Sat May 28 04:37:24 2022] POST /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 04:37:24.814807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-de0da2b9-dbc7-4548-8daa-9015863dab17 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:24.815684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-de0da2b9-dbc7-4548-8daa-9015863dab17 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:24.829888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de0da2b9-dbc7-4548-8daa-9015863dab17 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:24.843498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de0da2b9-dbc7-4548-8daa-9015863dab17 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:24.845024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de0da2b9-dbc7-4548-8daa-9015863dab17 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:24.845548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de0da2b9-dbc7-4548-8daa-9015863dab17 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:24.994962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-de0da2b9-dbc7-4548-8daa-9015863dab17 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lazy-loading 'services' on Instance uuid 18cb68a1-94a5-4af2-a376-46e7493e7454 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:37:25.009027 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-de0da2b9-dbc7-4548-8daa-9015863dab17 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 2054 microversion: 2.25 time: 0.198435 May 28 04:37:25.009938 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 542/978] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:24 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 2054 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:25.014558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3c941648-defd-4d48-87f2-af2225aac281 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:25.015201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3c941648-defd-4d48-87f2-af2225aac281 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:25.021406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c941648-defd-4d48-87f2-af2225aac281 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:25.024697 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c941648-defd-4d48-87f2-af2225aac281 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:25.024697 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c941648-defd-4d48-87f2-af2225aac281 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:25.024697 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c941648-defd-4d48-87f2-af2225aac281 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:25.159917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3c941648-defd-4d48-87f2-af2225aac281 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:25.167557 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3c941648-defd-4d48-87f2-af2225aac281 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1379 microversion: 2.1 time: 0.156571 May 28 04:37:25.168392 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 543/979] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:25 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1379 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:25.183155 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1a573240-1dc3-49c5-89d1-614ccd836027 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:25.184338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1a573240-1dc3-49c5-89d1-614ccd836027 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:25.201524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a573240-1dc3-49c5-89d1-614ccd836027 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:25.201994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a573240-1dc3-49c5-89d1-614ccd836027 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:25.202789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a573240-1dc3-49c5-89d1-614ccd836027 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:25.203289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a573240-1dc3-49c5-89d1-614ccd836027 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:25.241076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a573240-1dc3-49c5-89d1-614ccd836027 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:25.241792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a573240-1dc3-49c5-89d1-614ccd836027 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:25.242249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-1a573240-1dc3-49c5-89d1-614ccd836027 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lazy-loading 'fault' on Instance uuid 89406e18-7fa9-41e4-9fe8-34ce8a7255cf {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:37:25.288440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1a573240-1dc3-49c5-89d1-614ccd836027 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a666a6908cd44a898f0b3dfdb8e1dd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8aa260b3e94154b0a0485659f7f7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:25.296242 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1a573240-1dc3-49c5-89d1-614ccd836027 tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 200 len: 1308 microversion: 2.1 time: 0.126846 May 28 04:37:25.307269 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 544/980] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:25 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 1308 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:25.312874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4deaeb19-9edf-44ca-8c73-d7ce4a0ef7de tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:25.313666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4deaeb19-9edf-44ca-8c73-d7ce4a0ef7de tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:25.320718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4deaeb19-9edf-44ca-8c73-d7ce4a0ef7de tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:25.321373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4deaeb19-9edf-44ca-8c73-d7ce4a0ef7de tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:25.322317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4deaeb19-9edf-44ca-8c73-d7ce4a0ef7de tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:25.323137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4deaeb19-9edf-44ca-8c73-d7ce4a0ef7de tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:25.801613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4deaeb19-9edf-44ca-8c73-d7ce4a0ef7de tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:25.813617 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4deaeb19-9edf-44ca-8c73-d7ce4a0ef7de tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 200 len: 1321 microversion: 2.1 time: 0.504328 May 28 04:37:25.818787 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 545/981] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:25 2022] GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 1321 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:25.819218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6da9420a-588f-4e80-882f-3d4ba88f510c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:25.820039 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6da9420a-588f-4e80-882f-3d4ba88f510c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] [instance: a27b8082-4f44-4263-a6a2-86291ea3950b] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:25.826413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6da9420a-588f-4e80-882f-3d4ba88f510c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:25.827009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6da9420a-588f-4e80-882f-3d4ba88f510c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:25.827937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6da9420a-588f-4e80-882f-3d4ba88f510c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:25.829039 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6da9420a-588f-4e80-882f-3d4ba88f510c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:25.843823 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-6da9420a-588f-4e80-882f-3d4ba88f510c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] HTTP exception thrown: Instance a27b8082-4f44-4263-a6a2-86291ea3950b could not be found. May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6da9420a-588f-4e80-882f-3d4ba88f510c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Request method failure captured: May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b HTTP/1.1 May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZqtrNlfZV1rPhv3RbGNEiIdFbXIGuIxk8ho6qxYKo4ElpwtfAr_TSDJvVVYSqOmVVrRuOVcio_9u4WoGPS-CYY6Do_YE3pgqfZanDIDWtTVRFcWupnSFLY8NYJ6l-kpqlk9dKPtci1RmYXekefAZR-LDLIDYXQR9rlk2ETtlX-7rY May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 30dc7de2bf82417f8d26ad8ce4a50b17 May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ListImageFiltersTestJSON-750586826 May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:37:25.845890 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:37:25.849519 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_30dc7de2bf82417f8d26ad8ce4a50b17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/30dc7de2bf82417f8d26ad8ce4a50b17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/30dc7de2bf82417f8d26ad8ce4a50b17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/30dc7de2bf82417f8d26ad8ce4a50b17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:25.849519 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ListImageFiltersTestJSON-750586826 May 28 04:37:25.849519 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 30dc7de2bf82417f8d26ad8ce4a50b17 May 28 04:37:25.849519 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-750586826 May 28 04:37:25.849519 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ListImageFiltersTestJSON-750586826-project May 28 04:37:25.849519 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:37:25.849519 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:37:25.849519 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 31ab597e5a574f01910a9e0fe680fdb1 May 28 04:37:25.849519 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ListImageFiltersTestJSON-750586826-project May 28 04:37:25.849519 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:37:25.849519 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance a27b8082-4f44-4263-a6a2-86291ea3950b could not be found. May 28 04:37:25.849519 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'a27b8082-4f44-4263-a6a2-86291ea3950b'} May 28 04:37:25.850383 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:25.850383 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:25.850383 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:37:25.850383 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:37:25.850383 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:37:25.850383 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:37:25.850383 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:37:25.850383 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:37:25.850383 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:37:25.850383 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:37:25.850383 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a27b8082-4f44-4263-a6a2-86291ea3950b could not be found. May 28 04:37:25.850383 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:25.850383 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:25.850383 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:25.850383 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:25.850383 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:25.850383 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:25.850383 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:25.850383 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:25.850383 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:25.851786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:25.851786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:37:25.851786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:37:25.851786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:37:25.851786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:37:25.851786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:37:25.851786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:37:25.851786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a27b8082-4f44-4263-a6a2-86291ea3950b could not be found. May 28 04:37:25.851786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:25.851786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:25.851786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:25.851786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:25.851786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:25.851786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:25.851786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:25.851786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:25.851786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a27b8082-4f44-4263-a6a2-86291ea3950b could not be found. May 28 04:37:25.851786 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:25.853022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6da9420a-588f-4e80-882f-3d4ba88f510c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Returning 404 to user: Instance a27b8082-4f44-4263-a6a2-86291ea3950b could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:25.853022 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6da9420a-588f-4e80-882f-3d4ba88f510c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b" status: 404 len: 111 microversion: 2.1 time: 0.032338 May 28 04:37:25.853022 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 546/982] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:25 2022] GET /compute/v2.1/servers/a27b8082-4f44-4263-a6a2-86291ea3950b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:37:25.858265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-d59e1363-b492-46af-ae42-238e73118bb7 req-88147f6e-c67b-41f0-9a46-d6932a35c864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c86c50-5759-4619-9f17-a61d7452a6e8", "name": "network-vif-deleted", "tag": "ccd10a3b-275c-471d-bbc8-932e66f9e657"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:25.866790 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d59e1363-b492-46af-ae42-238e73118bb7 req-88147f6e-c67b-41f0-9a46-d6932a35c864 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:25.867270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d59e1363-b492-46af-ae42-238e73118bb7 req-88147f6e-c67b-41f0-9a46-d6932a35c864 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:25.879719 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-d59e1363-b492-46af-ae42-238e73118bb7 req-88147f6e-c67b-41f0-9a46-d6932a35c864 service nova] Creating event network-vif-deleted:ccd10a3b-275c-471d-bbc8-932e66f9e657 for instance 88c86c50-5759-4619-9f17-a61d7452a6e8 on n-h1-843700-1 May 28 04:37:25.884822 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-d59e1363-b492-46af-ae42-238e73118bb7 req-88147f6e-c67b-41f0-9a46-d6932a35c864 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030285 May 28 04:37:25.885447 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 547/983] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:25.894239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c103b46d-90c4-4694-aaec-10ed370ef8e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:25.894920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c103b46d-90c4-4694-aaec-10ed370ef8e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:25.901231 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c103b46d-90c4-4694-aaec-10ed370ef8e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:25.901688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c103b46d-90c4-4694-aaec-10ed370ef8e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:25.902520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c103b46d-90c4-4694-aaec-10ed370ef8e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:25.902966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c103b46d-90c4-4694-aaec-10ed370ef8e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:25.997601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c103b46d-90c4-4694-aaec-10ed370ef8e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:26.009526 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c103b46d-90c4-4694-aaec-10ed370ef8e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3" status: 200 len: 1260 microversion: 2.1 time: 0.117779 May 28 04:37:26.019915 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 548/984] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:25 2022] GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 => generated 1260 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:26.025918 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-34ad069d-6465-4f98-9f04-acc5d1b4747a tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7704397c10>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:26.992020 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-34ad069d-6465-4f98-9f04-acc5d1b4747a tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "DELETE /compute/v2.1/images/37c6ddc0-05ee-46ff-9574-c115fa3a9989" status: 204 len: 0 microversion: 2.1 time: 0.970681 May 28 04:37:26.993266 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 549/985] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:26 2022] DELETE /compute/v2.1/images/37c6ddc0-05ee-46ff-9574-c115fa3a9989 => generated 0 bytes in 973 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:37:26.999801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b9b67612-6afd-4995-8a8c-eb7df037341e tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:27.000456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b9b67612-6afd-4995-8a8c-eb7df037341e tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:27.006779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b9b67612-6afd-4995-8a8c-eb7df037341e tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:27.007448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b9b67612-6afd-4995-8a8c-eb7df037341e tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:27.008223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b9b67612-6afd-4995-8a8c-eb7df037341e tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:27.008660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b9b67612-6afd-4995-8a8c-eb7df037341e tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:27.229475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-b9b67612-6afd-4995-8a8c-eb7df037341e tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lazy-loading 'services' on Instance uuid 18cb68a1-94a5-4af2-a376-46e7493e7454 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:37:27.264718 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b9b67612-6afd-4995-8a8c-eb7df037341e tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 2034 microversion: 2.25 time: 0.270180 May 28 04:37:27.266627 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 550/986] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:26 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 2034 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:27.272337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fffe2d06-50ce-4ebf-b901-5edf5913c36c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:27.273227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fffe2d06-50ce-4ebf-b901-5edf5913c36c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:27.289212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fffe2d06-50ce-4ebf-b901-5edf5913c36c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:27.289673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fffe2d06-50ce-4ebf-b901-5edf5913c36c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:27.290458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fffe2d06-50ce-4ebf-b901-5edf5913c36c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:27.290898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fffe2d06-50ce-4ebf-b901-5edf5913c36c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:27.518414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fffe2d06-50ce-4ebf-b901-5edf5913c36c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:27.527235 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fffe2d06-50ce-4ebf-b901-5edf5913c36c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1379 microversion: 2.1 time: 0.258577 May 28 04:37:27.527991 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 551/987] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:27 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1379 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:27.533587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-09b0868e-e85a-4341-b0fc-7fcaf53d64bd tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:27.534389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-09b0868e-e85a-4341-b0fc-7fcaf53d64bd tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] [instance: 89406e18-7fa9-41e4-9fe8-34ce8a7255cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:27.540547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09b0868e-e85a-4341-b0fc-7fcaf53d64bd tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:27.540996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09b0868e-e85a-4341-b0fc-7fcaf53d64bd tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:27.541760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09b0868e-e85a-4341-b0fc-7fcaf53d64bd tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:27.542203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09b0868e-e85a-4341-b0fc-7fcaf53d64bd tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:27.556236 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-09b0868e-e85a-4341-b0fc-7fcaf53d64bd tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] HTTP exception thrown: Instance 89406e18-7fa9-41e4-9fe8-34ce8a7255cf could not be found. May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-09b0868e-e85a-4341-b0fc-7fcaf53d64bd tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Request method failure captured: May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf HTTP/1.1 May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikabFz1eSNxhRYX4PDavZOV8mxjNhFwifNV3eGr6DDvU-oL7BakvLGAKAYx2oq33q09xJruFzjeHy-lySADNwXtdWjI0GKEDBW3yLDCQA5815PDe-vp1qXcZxC1RscPut3Qt6p6z1UNOVvh7hjiQtr-ENXqMdGAHGNgMeM-_f7kP4YiQ May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2f8aa260b3e94154b0a0485659f7f7e3 May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-LiveMigrationNegativeTest-96244022 May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:37:27.557926 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:37:27.559453 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2f8aa260b3e94154b0a0485659f7f7e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2f8aa260b3e94154b0a0485659f7f7e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f8aa260b3e94154b0a0485659f7f7e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f8aa260b3e94154b0a0485659f7f7e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:27.559453 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-LiveMigrationNegativeTest-96244022 May 28 04:37:27.559453 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2f8aa260b3e94154b0a0485659f7f7e3 May 28 04:37:27.559453 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-96244022 May 28 04:37:27.559453 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-LiveMigrationNegativeTest-96244022-project May 28 04:37:27.559453 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:37:27.559453 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:37:27.559453 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: a666a6908cd44a898f0b3dfdb8e1dd3a May 28 04:37:27.559453 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-LiveMigrationNegativeTest-96244022-project May 28 04:37:27.559453 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:37:27.559453 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 89406e18-7fa9-41e4-9fe8-34ce8a7255cf could not be found. May 28 04:37:27.559453 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '89406e18-7fa9-41e4-9fe8-34ce8a7255cf'} May 28 04:37:27.560612 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:27.560612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:27.560612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:37:27.560612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:37:27.560612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:37:27.560612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:37:27.560612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:37:27.560612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:37:27.560612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:37:27.560612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:37:27.560612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89406e18-7fa9-41e4-9fe8-34ce8a7255cf could not be found. May 28 04:37:27.560612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:27.560612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:27.560612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:27.560612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:27.560612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:27.560612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:27.560612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:27.560612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:27.560612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:27.562519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:27.562519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:37:27.562519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:37:27.562519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:37:27.562519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:37:27.562519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:37:27.562519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:37:27.562519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89406e18-7fa9-41e4-9fe8-34ce8a7255cf could not be found. May 28 04:37:27.562519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:27.562519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:27.562519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:27.562519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:27.562519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:27.562519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:27.562519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:27.562519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:27.562519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89406e18-7fa9-41e4-9fe8-34ce8a7255cf could not be found. May 28 04:37:27.562519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:27.570156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-09b0868e-e85a-4341-b0fc-7fcaf53d64bd tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] Returning 404 to user: Instance 89406e18-7fa9-41e4-9fe8-34ce8a7255cf could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:27.570156 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-09b0868e-e85a-4341-b0fc-7fcaf53d64bd tempest-LiveMigrationNegativeTest-96244022 tempest-LiveMigrationNegativeTest-96244022-project] 10.222.0.58 "GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf" status: 404 len: 111 microversion: 2.1 time: 0.029650 May 28 04:37:27.570156 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 552/988] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:27 2022] GET /compute/v2.1/servers/89406e18-7fa9-41e4-9fe8-34ce8a7255cf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:37:27.570156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2f31d42a-465e-42a3-84ed-6695d44bdff5 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:27.570156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2f31d42a-465e-42a3-84ed-6695d44bdff5 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:27.571624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f31d42a-465e-42a3-84ed-6695d44bdff5 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:27.572078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f31d42a-465e-42a3-84ed-6695d44bdff5 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:27.572843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f31d42a-465e-42a3-84ed-6695d44bdff5 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:27.573279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f31d42a-465e-42a3-84ed-6695d44bdff5 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:27.751134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2f31d42a-465e-42a3-84ed-6695d44bdff5 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:27.758622 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2f31d42a-465e-42a3-84ed-6695d44bdff5 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 200 len: 1321 microversion: 2.1 time: 0.197776 May 28 04:37:27.759222 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 553/989] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:27 2022] GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:27.763586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e589b8fa-c9dd-4b94-94b6-e14c7cc1cf3c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701e965e0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:27.819403 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-804c312c-9b54-4844-8092-bd1798524e31 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617/action" status: 202 len: 0 microversion: 2.1 time: 3.152436 May 28 04:37:27.820760 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 437/990] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:37:24 2022] POST /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617/action => generated 0 bytes in 3154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:37:27.827176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-14d7c882-1bae-45bb-baaa-50a394d4c21e tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:27.827926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-14d7c882-1bae-45bb-baaa-50a394d4c21e tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:27.834768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-14d7c882-1bae-45bb-baaa-50a394d4c21e tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:27.835353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-14d7c882-1bae-45bb-baaa-50a394d4c21e tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:27.836135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-14d7c882-1bae-45bb-baaa-50a394d4c21e tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:27.836578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-14d7c882-1bae-45bb-baaa-50a394d4c21e tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:27.909232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-14d7c882-1bae-45bb-baaa-50a394d4c21e tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:27.919060 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-14d7c882-1bae-45bb-baaa-50a394d4c21e tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3" status: 200 len: 1324 microversion: 2.1 time: 0.096975 May 28 04:37:27.920138 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 438/991] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:27 2022] GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 => generated 1324 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:27.925204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-432abf00-e817-4b6b-9317-bbf1ba264f99 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843700-1", "block_migration": "auto"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:27.926308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-432abf00-e817-4b6b-9317-bbf1ba264f99 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:27.932493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-432abf00-e817-4b6b-9317-bbf1ba264f99 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:27.932859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-432abf00-e817-4b6b-9317-bbf1ba264f99 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:27.933631 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-432abf00-e817-4b6b-9317-bbf1ba264f99 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:27.934075 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-432abf00-e817-4b6b-9317-bbf1ba264f99 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:27.963166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-432abf00-e817-4b6b-9317-bbf1ba264f99 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lazy-loading 'flavor' on Instance uuid 18cb68a1-94a5-4af2-a376-46e7493e7454 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:37:27.977207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-432abf00-e817-4b6b-9317-bbf1ba264f99 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Going to try to live migrate instance to n-h1-843700-1 {{(pid=126043) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 28 04:37:28.141317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:28.478876 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e589b8fa-c9dd-4b94-94b6-e14c7cc1cf3c tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "DELETE /compute/v2.1/images/afc50315-453b-4c9d-b4d7-df40cdc3a48a" status: 204 len: 0 microversion: 2.1 time: 0.718592 May 28 04:37:28.479584 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 554/992] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:27 2022] DELETE /compute/v2.1/images/afc50315-453b-4c9d-b4d7-df40cdc3a48a => generated 0 bytes in 720 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:37:28.733262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6240e4df-bf96-4319-97c2-7270c7266389 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Action: 'create', calling method: .version_select at 0x7f770229de50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2069620213", "description": "tempest-description-179629155"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:29.220350 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6240e4df-bf96-4319-97c2-7270c7266389 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.739252 May 28 04:37:29.220966 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 555/993] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:37:28 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:29.230831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-818dcca5-d8da-4a87-85c6-188aace7b749 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:29.231575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-818dcca5-d8da-4a87-85c6-188aace7b749 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:29.238557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-818dcca5-d8da-4a87-85c6-188aace7b749 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:29.243215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-818dcca5-d8da-4a87-85c6-188aace7b749 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:29.243215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-818dcca5-d8da-4a87-85c6-188aace7b749 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:29.243215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-818dcca5-d8da-4a87-85c6-188aace7b749 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:29.403695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-818dcca5-d8da-4a87-85c6-188aace7b749 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:29.411879 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-818dcca5-d8da-4a87-85c6-188aace7b749 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.189219 May 28 04:37:29.413277 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 556/994] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:29 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:29.417562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-641eacba-ea7e-475f-8e44-a1b16be67fd9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] Calling method '.version_select at 0x7f7701bf68b0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:30.284797 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-641eacba-ea7e-475f-8e44-a1b16be67fd9 tempest-ListImageFiltersTestJSON-750586826 tempest-ListImageFiltersTestJSON-750586826-project] 10.222.0.58 "DELETE /compute/v2.1/images/e168bc02-ea2d-43ac-9a4e-d7168112a8da" status: 204 len: 0 microversion: 2.1 time: 0.870689 May 28 04:37:30.288630 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 557/995] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:29 2022] DELETE /compute/v2.1/images/e168bc02-ea2d-43ac-9a4e-d7168112a8da => generated 0 bytes in 872 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:37:30.291519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8c35247c-af32-492c-8394-509d7171fc53 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:30.337662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8c35247c-af32-492c-8394-509d7171fc53 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:30.379619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8c35247c-af32-492c-8394-509d7171fc53 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:30.393199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8c35247c-af32-492c-8394-509d7171fc53 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:30.399907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8c35247c-af32-492c-8394-509d7171fc53 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:30.400888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8c35247c-af32-492c-8394-509d7171fc53 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:30.682546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8c35247c-af32-492c-8394-509d7171fc53 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:30.691169 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8c35247c-af32-492c-8394-509d7171fc53 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1379 microversion: 2.1 time: 0.404153 May 28 04:37:30.691688 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 558/996] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:30 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1379 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:30.696619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef9edf59-2703-4b98-ad67-d6c07f31e0c9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:30.697438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ef9edf59-2703-4b98-ad67-d6c07f31e0c9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:30.726685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef9edf59-2703-4b98-ad67-d6c07f31e0c9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:30.727400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef9edf59-2703-4b98-ad67-d6c07f31e0c9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:30.728384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef9edf59-2703-4b98-ad67-d6c07f31e0c9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:30.729048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef9edf59-2703-4b98-ad67-d6c07f31e0c9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:30.893587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef9edf59-2703-4b98-ad67-d6c07f31e0c9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:30.902567 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ef9edf59-2703-4b98-ad67-d6c07f31e0c9 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 200 len: 1321 microversion: 2.1 time: 0.209502 May 28 04:37:30.903234 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 559/997] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:30 2022] GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:30.909371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b83a3827-9589-45c2-b5e7-a2ec16b82958 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:30.911375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b83a3827-9589-45c2-b5e7-a2ec16b82958 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:30.919423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b83a3827-9589-45c2-b5e7-a2ec16b82958 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:30.919889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b83a3827-9589-45c2-b5e7-a2ec16b82958 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:30.920691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b83a3827-9589-45c2-b5e7-a2ec16b82958 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:30.921141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b83a3827-9589-45c2-b5e7-a2ec16b82958 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:31.115947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b83a3827-9589-45c2-b5e7-a2ec16b82958 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:31.132966 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b83a3827-9589-45c2-b5e7-a2ec16b82958 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3" status: 200 len: 1389 microversion: 2.1 time: 0.228075 May 28 04:37:31.138590 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 560/998] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:30 2022] GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 => generated 1389 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:31.145004 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-62cebaeb-b3d3-43a9-a1aa-f566c5e7aae3 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Action: 'create', calling method: .version_select at 0x7f7701be2af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-915209342", "description": "tempest-description-347758667"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:31.371859 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-432abf00-e817-4b6b-9317-bbf1ba264f99 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454/action" status: 202 len: 0 microversion: 2.25 time: 3.450595 May 28 04:37:31.375622 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 439/999] 10.222.0.58 () {62 vars in 1318 bytes} [Sat May 28 04:37:27 2022] POST /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454/action => generated 0 bytes in 3452 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 04:37:31.378055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-9ca88f87-5e05-4bab-b650-8bc90390cbff req-4f37f90d-2819-4123-b184-8f152ede1c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17bf9454-cf2b-4049-b817-556e4c74b350", "name": "network-vif-plugged", "status": "completed", "tag": "9a1c5bed-5c2a-4af6-98f9-e6c6cf8a4d4c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:31.395848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9ca88f87-5e05-4bab-b650-8bc90390cbff req-4f37f90d-2819-4123-b184-8f152ede1c9e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:31.396685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9ca88f87-5e05-4bab-b650-8bc90390cbff req-4f37f90d-2819-4123-b184-8f152ede1c9e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:31.410703 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-9ca88f87-5e05-4bab-b650-8bc90390cbff req-4f37f90d-2819-4123-b184-8f152ede1c9e service nova] Creating event network-vif-plugged:9a1c5bed-5c2a-4af6-98f9-e6c6cf8a4d4c for instance 17bf9454-cf2b-4049-b817-556e4c74b350 on n-h2-843700-1 May 28 04:37:31.416540 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-9ca88f87-5e05-4bab-b650-8bc90390cbff req-4f37f90d-2819-4123-b184-8f152ede1c9e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042397 May 28 04:37:31.417727 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 440/1000] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:31.435950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-750e7f06-28f3-4346-b028-6197a8a8b7ba req-f1f7dca5-ce8c-4dc5-8ee9-f417768e950e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cf16b71-8fa1-4433-9af1-869667b8f7e3", "tag": "4096714a-e49b-4b7e-b0ac-30da053e7819"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:31.449163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-750e7f06-28f3-4346-b028-6197a8a8b7ba req-f1f7dca5-ce8c-4dc5-8ee9-f417768e950e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:31.449781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-750e7f06-28f3-4346-b028-6197a8a8b7ba req-f1f7dca5-ce8c-4dc5-8ee9-f417768e950e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:31.465462 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-750e7f06-28f3-4346-b028-6197a8a8b7ba req-f1f7dca5-ce8c-4dc5-8ee9-f417768e950e service nova] Creating event network-changed:4096714a-e49b-4b7e-b0ac-30da053e7819 for instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 on n-h1-843700-1 May 28 04:37:31.474657 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-750e7f06-28f3-4346-b028-6197a8a8b7ba req-f1f7dca5-ce8c-4dc5-8ee9-f417768e950e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053036 May 28 04:37:31.477648 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 441/1001] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:31.483628 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6c158bb1-b208-44be-8b75-1d3ff1df2fb5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:31.485171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6c158bb1-b208-44be-8b75-1d3ff1df2fb5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:31.507647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c158bb1-b208-44be-8b75-1d3ff1df2fb5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:31.510947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c158bb1-b208-44be-8b75-1d3ff1df2fb5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:31.516785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c158bb1-b208-44be-8b75-1d3ff1df2fb5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:31.516785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c158bb1-b208-44be-8b75-1d3ff1df2fb5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:31.604538 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-62cebaeb-b3d3-43a9-a1aa-f566c5e7aae3 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.464790 May 28 04:37:31.605819 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 561/1002] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:37:31 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:31.625758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f9ed844a-856a-41fc-a974-14039c028bc4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:31.625758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f9ed844a-856a-41fc-a974-14039c028bc4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:31.631198 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9ed844a-856a-41fc-a974-14039c028bc4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:31.631942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9ed844a-856a-41fc-a974-14039c028bc4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:31.632991 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9ed844a-856a-41fc-a974-14039c028bc4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:31.633745 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9ed844a-856a-41fc-a974-14039c028bc4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:31.823121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6c158bb1-b208-44be-8b75-1d3ff1df2fb5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:31.823982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f9ed844a-856a-41fc-a974-14039c028bc4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:31.832872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f9ed844a-856a-41fc-a974-14039c028bc4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:31.833491 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6c158bb1-b208-44be-8b75-1d3ff1df2fb5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.354546 May 28 04:37:31.834267 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 442/1003] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:31 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:31.834722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f9ed844a-856a-41fc-a974-14039c028bc4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:31.836252 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f9ed844a-856a-41fc-a974-14039c028bc4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.217421 May 28 04:37:31.837002 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 562/1004] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:31 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:31.838742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ae87b3f1-ff26-497b-8821-74c4ab305428 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:31.839378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ae87b3f1-ff26-497b-8821-74c4ab305428 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:31.842974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a8bc91ae-4bb5-4db6-a049-80b3e66eb3f8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-286953734", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "86536437-8d35-4af2-b7d8-a39846bdeaf6"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:31.858973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae87b3f1-ff26-497b-8821-74c4ab305428 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:31.858973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae87b3f1-ff26-497b-8821-74c4ab305428 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:31.858973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae87b3f1-ff26-497b-8821-74c4ab305428 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:31.858973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae87b3f1-ff26-497b-8821-74c4ab305428 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:31.920511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-a8bc91ae-4bb5-4db6-a049-80b3e66eb3f8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] validate_networks() for [('86536437-8d35-4af2-b7d8-a39846bdeaf6', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:37:32.128790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ae87b3f1-ff26-497b-8821-74c4ab305428 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:32.143784 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ae87b3f1-ff26-497b-8821-74c4ab305428 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1379 microversion: 2.1 time: 0.308393 May 28 04:37:32.146487 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 443/1005] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:31 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1379 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:32.154333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-11ced119-bd08-41c5-a13c-2743fc46d94a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:32.159500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-11ced119-bd08-41c5-a13c-2743fc46d94a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:32.172861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11ced119-bd08-41c5-a13c-2743fc46d94a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:32.173517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11ced119-bd08-41c5-a13c-2743fc46d94a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:32.179292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11ced119-bd08-41c5-a13c-2743fc46d94a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:32.179909 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11ced119-bd08-41c5-a13c-2743fc46d94a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:32.446904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-11ced119-bd08-41c5-a13c-2743fc46d94a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:32.455004 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-11ced119-bd08-41c5-a13c-2743fc46d94a tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 200 len: 1321 microversion: 2.1 time: 0.306416 May 28 04:37:32.455819 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 444/1006] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:32 2022] GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:32.461285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3681e04c-95d5-4cbc-a506-a7f379e0b369 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:32.462159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3681e04c-95d5-4cbc-a506-a7f379e0b369 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:32.468711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3681e04c-95d5-4cbc-a506-a7f379e0b369 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:32.469485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3681e04c-95d5-4cbc-a506-a7f379e0b369 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:32.470547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3681e04c-95d5-4cbc-a506-a7f379e0b369 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:32.471213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3681e04c-95d5-4cbc-a506-a7f379e0b369 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:32.513730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a8bc91ae-4bb5-4db6-a049-80b3e66eb3f8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:37:32.513845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a8bc91ae-4bb5-4db6-a049-80b3e66eb3f8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:37:32.514312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a8bc91ae-4bb5-4db6-a049-80b3e66eb3f8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:37:32.514905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a8bc91ae-4bb5-4db6-a049-80b3e66eb3f8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:37:32.515515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a8bc91ae-4bb5-4db6-a049-80b3e66eb3f8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:37:32.526553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a8bc91ae-4bb5-4db6-a049-80b3e66eb3f8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:32.527284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a8bc91ae-4bb5-4db6-a049-80b3e66eb3f8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:32.528453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a8bc91ae-4bb5-4db6-a049-80b3e66eb3f8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:32.528925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a8bc91ae-4bb5-4db6-a049-80b3e66eb3f8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:32.538184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:32.552478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-a8bc91ae-4bb5-4db6-a049-80b3e66eb3f8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Getting quotas for project 9b443a65fedd4511b931cd5130b7e618. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:37:32.558648 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-a8bc91ae-4bb5-4db6-a049-80b3e66eb3f8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Getting quotas for user 54a0d2f3e0184d14ae4050562e236581 and project 9b443a65fedd4511b931cd5130b7e618. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:37:32.572933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a8bc91ae-4bb5-4db6-a049-80b3e66eb3f8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:37:32.577217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a8bc91ae-4bb5-4db6-a049-80b3e66eb3f8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:37:32.663190 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3681e04c-95d5-4cbc-a506-a7f379e0b369 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:32.672643 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3681e04c-95d5-4cbc-a506-a7f379e0b369 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3" status: 200 len: 1389 microversion: 2.1 time: 0.214977 May 28 04:37:32.673263 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 445/1007] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:32 2022] GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 => generated 1389 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:32.851142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d0025946-a679-461b-bd3c-ea3fe614b15e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:32.851772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d0025946-a679-461b-bd3c-ea3fe614b15e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:32.858135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0025946-a679-461b-bd3c-ea3fe614b15e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:32.858594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0025946-a679-461b-bd3c-ea3fe614b15e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:32.860395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0025946-a679-461b-bd3c-ea3fe614b15e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:32.861070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0025946-a679-461b-bd3c-ea3fe614b15e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:32.882117 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a8bc91ae-4bb5-4db6-a049-80b3e66eb3f8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.043212 May 28 04:37:32.883161 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 563/1008] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:37:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:37:32.904646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-13b9d1b2-398e-4f91-9233-94c6b23a7c26 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:32.905280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-13b9d1b2-398e-4f91-9233-94c6b23a7c26 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:32.919133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13b9d1b2-398e-4f91-9233-94c6b23a7c26 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:32.919460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13b9d1b2-398e-4f91-9233-94c6b23a7c26 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:32.920241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13b9d1b2-398e-4f91-9233-94c6b23a7c26 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:32.920680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13b9d1b2-398e-4f91-9233-94c6b23a7c26 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:33.231169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=21 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:33.305413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d0025946-a679-461b-bd3c-ea3fe614b15e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:33.317154 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d0025946-a679-461b-bd3c-ea3fe614b15e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.467614 May 28 04:37:33.319129 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 446/1009] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:32 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:37:33.336711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d551d554-67ff-4f1d-82b5-b0d7521a08a2 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:33.337344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d551d554-67ff-4f1d-82b5-b0d7521a08a2 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:33.378674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-13b9d1b2-398e-4f91-9233-94c6b23a7c26 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:33.395251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-13b9d1b2-398e-4f91-9233-94c6b23a7c26 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:33.397585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-13b9d1b2-398e-4f91-9233-94c6b23a7c26 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:33.399625 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-13b9d1b2-398e-4f91-9233-94c6b23a7c26 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.514802 May 28 04:37:33.402490 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 564/1010] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:32 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:33.405035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ad6743d6-ad65-42dd-ae14-d4468025c81a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:33.407218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ad6743d6-ad65-42dd-ae14-d4468025c81a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:33.424646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad6743d6-ad65-42dd-ae14-d4468025c81a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:33.430726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad6743d6-ad65-42dd-ae14-d4468025c81a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:33.431833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad6743d6-ad65-42dd-ae14-d4468025c81a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:33.432481 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad6743d6-ad65-42dd-ae14-d4468025c81a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:33.461621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d551d554-67ff-4f1d-82b5-b0d7521a08a2 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:33.467951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=47 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:33.475334 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d551d554-67ff-4f1d-82b5-b0d7521a08a2 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d" status: 200 len: 1215 microversion: 2.1 time: 0.155043 May 28 04:37:33.476375 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 447/1011] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:33 2022] GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:33.604557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ad6743d6-ad65-42dd-ae14-d4468025c81a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:33.615416 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ad6743d6-ad65-42dd-ae14-d4468025c81a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1528 microversion: 2.1 time: 0.214103 May 28 04:37:33.616256 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 565/1012] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:33 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1528 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:33.621978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-07f8fccb-ba8d-4f79-b5a7-d548dfccde89 req-2232f2f2-be69-4c29-80fa-a36ef03fac12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1679ae8-ff3a-4444-bd5b-9498c7078083", "name": "network-vif-plugged", "status": "completed", "tag": "462fb92a-28d1-45af-8dba-233b2299a5a8"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:33.632443 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-07f8fccb-ba8d-4f79-b5a7-d548dfccde89 req-2232f2f2-be69-4c29-80fa-a36ef03fac12 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:33.633246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-07f8fccb-ba8d-4f79-b5a7-d548dfccde89 req-2232f2f2-be69-4c29-80fa-a36ef03fac12 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:33.648604 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-07f8fccb-ba8d-4f79-b5a7-d548dfccde89 req-2232f2f2-be69-4c29-80fa-a36ef03fac12 service nova] Creating event network-vif-plugged:462fb92a-28d1-45af-8dba-233b2299a5a8 for instance a1679ae8-ff3a-4444-bd5b-9498c7078083 on n-h1-843700-1 May 28 04:37:33.654507 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-07f8fccb-ba8d-4f79-b5a7-d548dfccde89 req-2232f2f2-be69-4c29-80fa-a36ef03fac12 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036656 May 28 04:37:33.655502 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 566/1013] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:33.666341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b9f53939-2460-486d-9646-1dec431305b3 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:33.667528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b9f53939-2460-486d-9646-1dec431305b3 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:33.678259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b9f53939-2460-486d-9646-1dec431305b3 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:33.678942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b9f53939-2460-486d-9646-1dec431305b3 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:33.679931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b9f53939-2460-486d-9646-1dec431305b3 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:33.680529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b9f53939-2460-486d-9646-1dec431305b3 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:33.785505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-27deee8a-cedf-45a5-bacf-f0e9b8fce473 tempest-ListImagesTestJSON-1730211211 tempest-ListImagesTestJSON-1730211211-project] Calling method '.version_select at 0x7f7701d93790>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:33.862930 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-27deee8a-cedf-45a5-bacf-f0e9b8fce473 tempest-ListImagesTestJSON-1730211211 tempest-ListImagesTestJSON-1730211211-project] 10.222.0.58 "GET /compute/v2.1/images/012b12af-263c-4753-8fad-4a4022b439aa" status: 200 len: 784 microversion: 2.1 time: 0.385323 May 28 04:37:33.869548 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 448/1014] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:37:33 2022] GET /compute/v2.1/images/012b12af-263c-4753-8fad-4a4022b439aa => generated 784 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:33.875171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-116a018a-9b31-420c-b06a-d7dacf6ca904 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:33.875848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-116a018a-9b31-420c-b06a-d7dacf6ca904 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:33.896140 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-116a018a-9b31-420c-b06a-d7dacf6ca904 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:33.897197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-116a018a-9b31-420c-b06a-d7dacf6ca904 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:33.897358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-116a018a-9b31-420c-b06a-d7dacf6ca904 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:33.903049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-116a018a-9b31-420c-b06a-d7dacf6ca904 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:33.976983 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b9f53939-2460-486d-9646-1dec431305b3 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:33.985012 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b9f53939-2460-486d-9646-1dec431305b3 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 200 len: 1321 microversion: 2.1 time: 0.324000 May 28 04:37:33.985615 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 567/1015] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:33 2022] GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:33.990720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5c8e2982-a015-4747-a67a-c2a2f304dfc1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:33.991359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5c8e2982-a015-4747-a67a-c2a2f304dfc1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:33.997525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c8e2982-a015-4747-a67a-c2a2f304dfc1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:33.998340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c8e2982-a015-4747-a67a-c2a2f304dfc1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:34.000249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c8e2982-a015-4747-a67a-c2a2f304dfc1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:34.000853 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c8e2982-a015-4747-a67a-c2a2f304dfc1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:34.123980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-116a018a-9b31-420c-b06a-d7dacf6ca904 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:34.138415 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-116a018a-9b31-420c-b06a-d7dacf6ca904 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1528 microversion: 2.1 time: 0.273401 May 28 04:37:34.144317 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 449/1016] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:33 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1528 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:34.145342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b7245924-a7e9-4ba3-8ee4-a2a328153f79 tempest-ListImagesTestJSON-1730211211 tempest-ListImagesTestJSON-1730211211-project] Calling method '.version_select at 0x7f7701d933a0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:34.173749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5c8e2982-a015-4747-a67a-c2a2f304dfc1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:34.183292 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5c8e2982-a015-4747-a67a-c2a2f304dfc1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3" status: 200 len: 1389 microversion: 2.1 time: 0.196403 May 28 04:37:34.183888 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 568/1017] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:33 2022] GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 => generated 1389 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:34.239099 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b7245924-a7e9-4ba3-8ee4-a2a328153f79 tempest-ListImagesTestJSON-1730211211 tempest-ListImagesTestJSON-1730211211-project] 10.222.0.58 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.098154 May 28 04:37:34.241905 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 450/1018] 10.222.0.58 () {58 vars in 1121 bytes} [Sat May 28 04:37:34 2022] GET /compute/v2.1/images => generated 445 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:34.246801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-141bfba4-c76a-4682-b01f-d762fe968039 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:34.247925 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:37:34.247925 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:37:34.256454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-80325911-06b5-4334-a7ad-ee969aaa31ad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-155768587", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:34.306394 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-80325911-06b5-4334-a7ad-ee969aaa31ad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:37:34.336093 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-141bfba4-c76a-4682-b01f-d762fe968039 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/f4fa1d39-7abe-438c-9c7b-1c96bd104438" status: 202 len: 0 microversion: 2.1 time: 0.092884 May 28 04:37:34.336691 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 451/1019] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:37:34 2022] DELETE /compute/v2.1/flavors/f4fa1d39-7abe-438c-9c7b-1c96bd104438 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:37:34.341318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-27f7a7c1-2e9c-4d57-b0bf-08773f90f146 tempest-ListImagesTestJSON-1730211211 tempest-ListImagesTestJSON-1730211211-project] Calling method '.version_select at 0x7f7701ce0ca0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:34.394357 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-27f7a7c1-2e9c-4d57-b0bf-08773f90f146 tempest-ListImagesTestJSON-1730211211 tempest-ListImagesTestJSON-1730211211-project] 10.222.0.58 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.056598 May 28 04:37:34.395050 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 452/1020] 10.222.0.58 () {58 vars in 1142 bytes} [Sat May 28 04:37:34 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:34.401182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ccad97bf-fdf4-4bab-80a8-913a89a1434d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:34.402023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ccad97bf-fdf4-4bab-80a8-913a89a1434d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:34.409831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ccad97bf-fdf4-4bab-80a8-913a89a1434d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:34.410388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ccad97bf-fdf4-4bab-80a8-913a89a1434d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:34.411312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ccad97bf-fdf4-4bab-80a8-913a89a1434d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:34.412003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ccad97bf-fdf4-4bab-80a8-913a89a1434d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:34.614469 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-80325911-06b5-4334-a7ad-ee969aaa31ad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:37:34.615067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-80325911-06b5-4334-a7ad-ee969aaa31ad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:37:34.615793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-80325911-06b5-4334-a7ad-ee969aaa31ad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:37:34.616279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-80325911-06b5-4334-a7ad-ee969aaa31ad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:37:34.616774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-80325911-06b5-4334-a7ad-ee969aaa31ad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:37:34.617110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ccad97bf-fdf4-4bab-80a8-913a89a1434d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:34.626438 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ccad97bf-fdf4-4bab-80a8-913a89a1434d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.230210 May 28 04:37:34.627200 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 453/1021] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:34 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:34.636847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80325911-06b5-4334-a7ad-ee969aaa31ad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:34.636847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80325911-06b5-4334-a7ad-ee969aaa31ad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:34.636847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80325911-06b5-4334-a7ad-ee969aaa31ad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:34.636847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80325911-06b5-4334-a7ad-ee969aaa31ad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:34.637236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a5eb3124-54a5-467d-ab1b-4240b5e13dab tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:34.650122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-80325911-06b5-4334-a7ad-ee969aaa31ad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for project e7a5b721a538475cbac9c95c61647753. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:37:34.652623 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a5eb3124-54a5-467d-ab1b-4240b5e13dab tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.024084 May 28 04:37:34.652765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:34.653669 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 454/1022] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:37:34 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:34.658606 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9e49b84b-7224-4eb6-87c5-0dfbca65db04 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:34.662709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9e49b84b-7224-4eb6-87c5-0dfbca65db04 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:34.665976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e49b84b-7224-4eb6-87c5-0dfbca65db04 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:34.666860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e49b84b-7224-4eb6-87c5-0dfbca65db04 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:34.667859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e49b84b-7224-4eb6-87c5-0dfbca65db04 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:34.668496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e49b84b-7224-4eb6-87c5-0dfbca65db04 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:34.676377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-80325911-06b5-4334-a7ad-ee969aaa31ad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for user d398d45627fc4d33bc9a736ddf8f9215 and project e7a5b721a538475cbac9c95c61647753. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:37:34.693571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-80325911-06b5-4334-a7ad-ee969aaa31ad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:37:34.696169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-80325911-06b5-4334-a7ad-ee969aaa31ad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:37:34.817706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9e49b84b-7224-4eb6-87c5-0dfbca65db04 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:34.837599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9e49b84b-7224-4eb6-87c5-0dfbca65db04 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:34.837599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9e49b84b-7224-4eb6-87c5-0dfbca65db04 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:34.837796 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-80325911-06b5-4334-a7ad-ee969aaa31ad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645438 May 28 04:37:34.837897 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9e49b84b-7224-4eb6-87c5-0dfbca65db04 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.176164 May 28 04:37:34.837985 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 569/1023] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:37:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:37:34.837985 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-95ed4f60-7911-4ede-abd0-bea2aa3d511d tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:34.838120 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 455/1024] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:34 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:34.838192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-95ed4f60-7911-4ede-abd0-bea2aa3d511d tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:34.845061 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-95ed4f60-7911-4ede-abd0-bea2aa3d511d tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:34.845517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-95ed4f60-7911-4ede-abd0-bea2aa3d511d tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:34.846453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-95ed4f60-7911-4ede-abd0-bea2aa3d511d tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:34.846893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-95ed4f60-7911-4ede-abd0-bea2aa3d511d tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:34.848453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-10f59649-ded6-406a-8b4c-0fa8a2cb1c9d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:34.849721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-10f59649-ded6-406a-8b4c-0fa8a2cb1c9d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:34.857216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10f59649-ded6-406a-8b4c-0fa8a2cb1c9d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:34.913248 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10f59649-ded6-406a-8b4c-0fa8a2cb1c9d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.055s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:34.918133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10f59649-ded6-406a-8b4c-0fa8a2cb1c9d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:34.919036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10f59649-ded6-406a-8b4c-0fa8a2cb1c9d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:34.931785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-95ed4f60-7911-4ede-abd0-bea2aa3d511d tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:34.942087 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-95ed4f60-7911-4ede-abd0-bea2aa3d511d tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d" status: 200 len: 1211 microversion: 2.1 time: 0.109138 May 28 04:37:34.942663 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 570/1025] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:34 2022] GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d => generated 1211 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:34.948569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-24333dd1-bc79-4092-b8c1-7498d6b3bd4f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:34.949367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-24333dd1-bc79-4092-b8c1-7498d6b3bd4f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:34.978709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-10f59649-ded6-406a-8b4c-0fa8a2cb1c9d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:34.988096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-10f59649-ded6-406a-8b4c-0fa8a2cb1c9d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Old instance type tempest-test_resize_flavor_-219327125, new instance type m1.heat {{(pid=126043) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 04:37:35.001422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-10f59649-ded6-406a-8b4c-0fa8a2cb1c9d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:37:35.002091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-10f59649-ded6-406a-8b4c-0fa8a2cb1c9d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:37:35.002781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-10f59649-ded6-406a-8b4c-0fa8a2cb1c9d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:37:35.005333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-10f59649-ded6-406a-8b4c-0fa8a2cb1c9d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:37:35.008545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-10f59649-ded6-406a-8b4c-0fa8a2cb1c9d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:37:35.026175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:35.056769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-24333dd1-bc79-4092-b8c1-7498d6b3bd4f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:35.068619 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-24333dd1-bc79-4092-b8c1-7498d6b3bd4f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287" status: 200 len: 1216 microversion: 2.1 time: 0.124725 May 28 04:37:35.070003 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 571/1026] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:34 2022] GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287 => generated 1216 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:35.077095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-77fc2cc6-2d30-4488-9807-84a35421b807 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:35.077867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-77fc2cc6-2d30-4488-9807-84a35421b807 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:35.086569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77fc2cc6-2d30-4488-9807-84a35421b807 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:35.091944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77fc2cc6-2d30-4488-9807-84a35421b807 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:35.091944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77fc2cc6-2d30-4488-9807-84a35421b807 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:35.091944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77fc2cc6-2d30-4488-9807-84a35421b807 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:35.268497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-77fc2cc6-2d30-4488-9807-84a35421b807 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:35.272706 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-10f59649-ded6-406a-8b4c-0fa8a2cb1c9d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "POST /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350/action" status: 202 len: 0 microversion: 2.1 time: 0.431897 May 28 04:37:35.279532 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 456/1027] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:37:34 2022] POST /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:37:35.286831 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-77fc2cc6-2d30-4488-9807-84a35421b807 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 200 len: 1321 microversion: 2.1 time: 0.215302 May 28 04:37:35.288136 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 572/1028] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:35 2022] GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:35.292773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0f7113d6-bb37-4a38-b511-19efb69c6c96 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:35.292773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0f7113d6-bb37-4a38-b511-19efb69c6c96 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:35.295020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a74d96f7-5ba2-4c73-b5ba-70762d549e81 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:35.296039 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a74d96f7-5ba2-4c73-b5ba-70762d549e81 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:35.303829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a74d96f7-5ba2-4c73-b5ba-70762d549e81 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:35.304389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f7113d6-bb37-4a38-b511-19efb69c6c96 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:35.304839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f7113d6-bb37-4a38-b511-19efb69c6c96 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:35.305158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a74d96f7-5ba2-4c73-b5ba-70762d549e81 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:35.306018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f7113d6-bb37-4a38-b511-19efb69c6c96 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:35.306327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a74d96f7-5ba2-4c73-b5ba-70762d549e81 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:35.306945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f7113d6-bb37-4a38-b511-19efb69c6c96 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:35.307545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a74d96f7-5ba2-4c73-b5ba-70762d549e81 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:35.634002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0f7113d6-bb37-4a38-b511-19efb69c6c96 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:35.644941 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0f7113d6-bb37-4a38-b511-19efb69c6c96 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3" status: 200 len: 1389 microversion: 2.1 time: 0.364039 May 28 04:37:35.645533 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 457/1029] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:35 2022] GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 => generated 1389 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:35.650476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a74d96f7-5ba2-4c73-b5ba-70762d549e81 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:35.657629 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8c39fcda-88e6-4c73-b07c-a74914824f92 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:35.658257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8c39fcda-88e6-4c73-b07c-a74914824f92 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:35.661228 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a74d96f7-5ba2-4c73-b5ba-70762d549e81 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1537 microversion: 2.1 time: 0.371694 May 28 04:37:35.661904 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 573/1030] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:35 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1537 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:35.664639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c39fcda-88e6-4c73-b07c-a74914824f92 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:35.665280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c39fcda-88e6-4c73-b07c-a74914824f92 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:35.666378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c39fcda-88e6-4c73-b07c-a74914824f92 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:35.666820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c39fcda-88e6-4c73-b07c-a74914824f92 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:35.850436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-48af0a89-7e7f-45bc-b768-30f96c8bb7c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:35.854129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-48af0a89-7e7f-45bc-b768-30f96c8bb7c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:35.864577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48af0a89-7e7f-45bc-b768-30f96c8bb7c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:35.865041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48af0a89-7e7f-45bc-b768-30f96c8bb7c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:35.865830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48af0a89-7e7f-45bc-b768-30f96c8bb7c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:35.866271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48af0a89-7e7f-45bc-b768-30f96c8bb7c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:35.868116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8c39fcda-88e6-4c73-b07c-a74914824f92 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:35.877867 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8c39fcda-88e6-4c73-b07c-a74914824f92 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.225578 May 28 04:37:35.887700 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 458/1031] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:35 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:35.968899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0c10ed7a-0fdc-4508-9239-363abc1fbb17 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:35.968899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0c10ed7a-0fdc-4508-9239-363abc1fbb17 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:35.986260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c10ed7a-0fdc-4508-9239-363abc1fbb17 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:35.986723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c10ed7a-0fdc-4508-9239-363abc1fbb17 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:35.988467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c10ed7a-0fdc-4508-9239-363abc1fbb17 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:35.991388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c10ed7a-0fdc-4508-9239-363abc1fbb17 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:36.054511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-48af0a89-7e7f-45bc-b768-30f96c8bb7c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:36.065298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-48af0a89-7e7f-45bc-b768-30f96c8bb7c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:36.069276 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-48af0a89-7e7f-45bc-b768-30f96c8bb7c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:36.091413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0c10ed7a-0fdc-4508-9239-363abc1fbb17 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:36.105236 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0c10ed7a-0fdc-4508-9239-363abc1fbb17 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d" status: 200 len: 1275 microversion: 2.1 time: 0.146113 May 28 04:37:36.106367 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 459/1032] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:35 2022] GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d => generated 1275 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:37:36.110790 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-48af0a89-7e7f-45bc-b768-30f96c8bb7c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.261371 May 28 04:37:36.121336 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 574/1033] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:35 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:37:36.124727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bc4762c9-1d4e-4745-af15-f0c6922e5923 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:36.128565 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bc4762c9-1d4e-4745-af15-f0c6922e5923 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:36.223507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bc4762c9-1d4e-4745-af15-f0c6922e5923 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:36.241131 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bc4762c9-1d4e-4745-af15-f0c6922e5923 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287" status: 200 len: 1216 microversion: 2.1 time: 0.133510 May 28 04:37:36.242634 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 460/1034] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:36 2022] GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287 => generated 1216 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:36.308598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-00c0287a-77ff-4a88-ba07-93f5b509fac3 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:36.309440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-00c0287a-77ff-4a88-ba07-93f5b509fac3 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:36.326525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00c0287a-77ff-4a88-ba07-93f5b509fac3 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:36.328757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00c0287a-77ff-4a88-ba07-93f5b509fac3 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:36.330887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00c0287a-77ff-4a88-ba07-93f5b509fac3 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:36.332531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00c0287a-77ff-4a88-ba07-93f5b509fac3 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:36.527720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-00c0287a-77ff-4a88-ba07-93f5b509fac3 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:36.539084 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-00c0287a-77ff-4a88-ba07-93f5b509fac3 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 200 len: 1471 microversion: 2.1 time: 0.234350 May 28 04:37:36.552370 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 575/1035] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:36 2022] GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 1471 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:36.557277 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-909f018d-6c9f-4fb1-bfe9-74d7a5c564eb tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:36.557813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-909f018d-6c9f-4fb1-bfe9-74d7a5c564eb tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:36.566838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-909f018d-6c9f-4fb1-bfe9-74d7a5c564eb tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:36.567710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-909f018d-6c9f-4fb1-bfe9-74d7a5c564eb tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:36.568664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-909f018d-6c9f-4fb1-bfe9-74d7a5c564eb tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:36.569262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-909f018d-6c9f-4fb1-bfe9-74d7a5c564eb tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:36.596163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-909f018d-6c9f-4fb1-bfe9-74d7a5c564eb tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Lazy-loading 'flavor' on Instance uuid a1679ae8-ff3a-4444-bd5b-9498c7078083 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:37:36.661945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3d59dbc3-edfe-4d6c-9ed5-31eceef85316 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:36.662627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3d59dbc3-edfe-4d6c-9ed5-31eceef85316 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:36.696650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d59dbc3-edfe-4d6c-9ed5-31eceef85316 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:36.696650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d59dbc3-edfe-4d6c-9ed5-31eceef85316 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:36.702618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d59dbc3-edfe-4d6c-9ed5-31eceef85316 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:36.703981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d59dbc3-edfe-4d6c-9ed5-31eceef85316 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:36.789390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:36.893712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3d59dbc3-edfe-4d6c-9ed5-31eceef85316 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:36.902037 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3d59dbc3-edfe-4d6c-9ed5-31eceef85316 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3" status: 200 len: 1389 microversion: 2.1 time: 0.243957 May 28 04:37:36.908052 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 576/1036] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:36 2022] GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 => generated 1389 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:37:36.922165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-15731c71-e681-4158-a4f1-93004853c993 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:36.922165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-15731c71-e681-4158-a4f1-93004853c993 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:36.936823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-15731c71-e681-4158-a4f1-93004853c993 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:36.937193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-15731c71-e681-4158-a4f1-93004853c993 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:36.938660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-15731c71-e681-4158-a4f1-93004853c993 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:36.951084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-15731c71-e681-4158-a4f1-93004853c993 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:37.061018 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-909f018d-6c9f-4fb1-bfe9-74d7a5c564eb tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083/action" status: 202 len: 0 microversion: 2.1 time: 0.507003 May 28 04:37:37.061670 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 461/1037] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:37:36 2022] POST /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:37:37.071341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f6949be1-67ae-4223-bd84-605b8b5514c9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:37.077852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f6949be1-67ae-4223-bd84-605b8b5514c9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:37.088748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6949be1-67ae-4223-bd84-605b8b5514c9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:37.089410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6949be1-67ae-4223-bd84-605b8b5514c9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:37.090348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6949be1-67ae-4223-bd84-605b8b5514c9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:37.098936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6949be1-67ae-4223-bd84-605b8b5514c9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:37.202533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-15731c71-e681-4158-a4f1-93004853c993 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:37.216498 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-15731c71-e681-4158-a4f1-93004853c993 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1537 microversion: 2.1 time: 0.307094 May 28 04:37:37.217110 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 577/1038] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:36 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1537 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:37.244701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a67a241a-9ffc-44d0-afb7-bfacc3298923 tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:37.245608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a67a241a-9ffc-44d0-afb7-bfacc3298923 tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:37.252152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a67a241a-9ffc-44d0-afb7-bfacc3298923 tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:37.252813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a67a241a-9ffc-44d0-afb7-bfacc3298923 tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:37.254022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a67a241a-9ffc-44d0-afb7-bfacc3298923 tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:37.254685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a67a241a-9ffc-44d0-afb7-bfacc3298923 tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:37.452287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f6949be1-67ae-4223-bd84-605b8b5514c9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:37.461215 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f6949be1-67ae-4223-bd84-605b8b5514c9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.397569 May 28 04:37:37.462463 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 462/1039] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:37 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:37.475886 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2c7f70f4-68f0-4f5c-a9dc-66e14498c6fa tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:37.476600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2c7f70f4-68f0-4f5c-a9dc-66e14498c6fa tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:37.483287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c7f70f4-68f0-4f5c-a9dc-66e14498c6fa tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:37.484057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c7f70f4-68f0-4f5c-a9dc-66e14498c6fa tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:37.485099 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c7f70f4-68f0-4f5c-a9dc-66e14498c6fa tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:37.485823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c7f70f4-68f0-4f5c-a9dc-66e14498c6fa tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:37.676582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2c7f70f4-68f0-4f5c-a9dc-66e14498c6fa tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:37.687710 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2c7f70f4-68f0-4f5c-a9dc-66e14498c6fa tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d" status: 200 len: 1315 microversion: 2.1 time: 0.223018 May 28 04:37:37.698396 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 463/1040] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:37 2022] GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:37.708561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0f379ae7-938f-4770-a8fe-9f78bdb0a53c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:37.709827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0f379ae7-938f-4770-a8fe-9f78bdb0a53c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:37.716696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f379ae7-938f-4770-a8fe-9f78bdb0a53c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:37.717448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f379ae7-938f-4770-a8fe-9f78bdb0a53c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:37.718352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f379ae7-938f-4770-a8fe-9f78bdb0a53c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:37.719426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f379ae7-938f-4770-a8fe-9f78bdb0a53c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:37.784770 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a67a241a-9ffc-44d0-afb7-bfacc3298923 tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 200 len: 1630 microversion: 2.1 time: 0.555552 May 28 04:37:37.785374 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 578/1041] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:37 2022] GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 1630 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:37.809871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-76861881-dbb5-4ab5-be11-2b9e2163db8e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:37.810530 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-76861881-dbb5-4ab5-be11-2b9e2163db8e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:37.819284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76861881-dbb5-4ab5-be11-2b9e2163db8e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:37.819945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76861881-dbb5-4ab5-be11-2b9e2163db8e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:37.821171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76861881-dbb5-4ab5-be11-2b9e2163db8e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:37.822181 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76861881-dbb5-4ab5-be11-2b9e2163db8e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:37.980195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0f379ae7-938f-4770-a8fe-9f78bdb0a53c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:37.993766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0f379ae7-938f-4770-a8fe-9f78bdb0a53c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:37.995372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-76861881-dbb5-4ab5-be11-2b9e2163db8e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:37.996073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0f379ae7-938f-4770-a8fe-9f78bdb0a53c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:37.997552 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0f379ae7-938f-4770-a8fe-9f78bdb0a53c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.297667 May 28 04:37:38.010037 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 464/1042] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:37 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:38.024335 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-76861881-dbb5-4ab5-be11-2b9e2163db8e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287" status: 200 len: 1268 microversion: 2.1 time: 0.225418 May 28 04:37:38.025566 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 579/1043] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:37 2022] GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287 => generated 1268 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:38.031899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bc170ff4-5c8b-468b-93df-f9174c44b355 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:38.034887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bc170ff4-5c8b-468b-93df-f9174c44b355 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:38.044202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc170ff4-5c8b-468b-93df-f9174c44b355 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:38.044990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc170ff4-5c8b-468b-93df-f9174c44b355 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:38.045990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc170ff4-5c8b-468b-93df-f9174c44b355 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:38.046671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc170ff4-5c8b-468b-93df-f9174c44b355 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:38.245595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bc170ff4-5c8b-468b-93df-f9174c44b355 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:38.245731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bd975640-cada-45c4-ae40-361fd5b2890e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:38.251423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bd975640-cada-45c4-ae40-361fd5b2890e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:38.257595 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bc170ff4-5c8b-468b-93df-f9174c44b355 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3" status: 200 len: 1389 microversion: 2.1 time: 0.234338 May 28 04:37:38.258485 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 465/1044] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:38 2022] GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 => generated 1389 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:38.273676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd975640-cada-45c4-ae40-361fd5b2890e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:38.274165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd975640-cada-45c4-ae40-361fd5b2890e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:38.280493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd975640-cada-45c4-ae40-361fd5b2890e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:38.280493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd975640-cada-45c4-ae40-361fd5b2890e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:38.481542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bf3a8790-435c-4e95-82c0-9d5da6e75880 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:38.483642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bf3a8790-435c-4e95-82c0-9d5da6e75880 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:38.504269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf3a8790-435c-4e95-82c0-9d5da6e75880 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:38.511054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf3a8790-435c-4e95-82c0-9d5da6e75880 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:38.511054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf3a8790-435c-4e95-82c0-9d5da6e75880 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:38.511054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf3a8790-435c-4e95-82c0-9d5da6e75880 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:38.516081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bd975640-cada-45c4-ae40-361fd5b2890e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:38.526710 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bd975640-cada-45c4-ae40-361fd5b2890e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1537 microversion: 2.1 time: 0.296003 May 28 04:37:38.527430 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 580/1045] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:38 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1537 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:38.713795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3594ea76-f279-4086-ba28-484b99b2ad39 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:38.713795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3594ea76-f279-4086-ba28-484b99b2ad39 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:38.722062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3594ea76-f279-4086-ba28-484b99b2ad39 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:38.723776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3594ea76-f279-4086-ba28-484b99b2ad39 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:38.725384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3594ea76-f279-4086-ba28-484b99b2ad39 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:38.726380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3594ea76-f279-4086-ba28-484b99b2ad39 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:38.748944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bf3a8790-435c-4e95-82c0-9d5da6e75880 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:38.758013 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bf3a8790-435c-4e95-82c0-9d5da6e75880 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.282116 May 28 04:37:38.766019 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 466/1046] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:38 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:38.779218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-1d5ba2d1-144a-4eea-95bd-b27e0d6850f3 req-553155b8-3e70-4b05-80a0-47b79e4f498d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cf16b71-8fa1-4433-9af1-869667b8f7e3", "name": "network-vif-plugged", "status": "completed", "tag": "4096714a-e49b-4b7e-b0ac-30da053e7819"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:38.794906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1d5ba2d1-144a-4eea-95bd-b27e0d6850f3 req-553155b8-3e70-4b05-80a0-47b79e4f498d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:38.795723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1d5ba2d1-144a-4eea-95bd-b27e0d6850f3 req-553155b8-3e70-4b05-80a0-47b79e4f498d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:38.821357 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-1d5ba2d1-144a-4eea-95bd-b27e0d6850f3 req-553155b8-3e70-4b05-80a0-47b79e4f498d service nova] Creating event network-vif-plugged:4096714a-e49b-4b7e-b0ac-30da053e7819 for instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 on n-h1-843700-1 May 28 04:37:38.828030 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-1d5ba2d1-144a-4eea-95bd-b27e0d6850f3 req-553155b8-3e70-4b05-80a0-47b79e4f498d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060467 May 28 04:37:38.828841 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 467/1047] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:38.836744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c7b1b806-a63e-438f-88e8-02492f3773bd tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:38.837965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c7b1b806-a63e-438f-88e8-02492f3773bd tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:38.846091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7b1b806-a63e-438f-88e8-02492f3773bd tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:38.847629 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7b1b806-a63e-438f-88e8-02492f3773bd tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:38.848210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7b1b806-a63e-438f-88e8-02492f3773bd tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:38.848817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7b1b806-a63e-438f-88e8-02492f3773bd tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:38.950545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3594ea76-f279-4086-ba28-484b99b2ad39 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:38.960811 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3594ea76-f279-4086-ba28-484b99b2ad39 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d" status: 200 len: 1315 microversion: 2.1 time: 0.258098 May 28 04:37:38.961956 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 581/1048] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:38 2022] GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:39.017078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bd5d22e0-83a9-49c4-bbf1-a15b6153efd9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:39.017855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bd5d22e0-83a9-49c4-bbf1-a15b6153efd9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:39.024289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd5d22e0-83a9-49c4-bbf1-a15b6153efd9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:39.025086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd5d22e0-83a9-49c4-bbf1-a15b6153efd9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:39.026383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd5d22e0-83a9-49c4-bbf1-a15b6153efd9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:39.027122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd5d22e0-83a9-49c4-bbf1-a15b6153efd9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:39.235955 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c7b1b806-a63e-438f-88e8-02492f3773bd tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 200 len: 1613 microversion: 2.1 time: 0.405634 May 28 04:37:39.238703 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 468/1049] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:38 2022] GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 1613 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:39.254305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-266fcf3d-3f04-471c-89e8-44ffbfb7d917 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:39.256167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-266fcf3d-3f04-471c-89e8-44ffbfb7d917 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:39.264729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-266fcf3d-3f04-471c-89e8-44ffbfb7d917 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:39.266372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-266fcf3d-3f04-471c-89e8-44ffbfb7d917 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:39.268157 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-266fcf3d-3f04-471c-89e8-44ffbfb7d917 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:39.268865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-266fcf3d-3f04-471c-89e8-44ffbfb7d917 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:39.333459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bd5d22e0-83a9-49c4-bbf1-a15b6153efd9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:39.337184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:39.342530 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bd5d22e0-83a9-49c4-bbf1-a15b6153efd9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:39.344223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bd5d22e0-83a9-49c4-bbf1-a15b6153efd9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:39.345496 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bd5d22e0-83a9-49c4-bbf1-a15b6153efd9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.332910 May 28 04:37:39.345981 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 582/1050] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:39 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:37:39.362871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-0341a8f0-67e2-4b02-bbfa-1bfdb1afa2c7 req-1c9de2ba-e056-4ced-9aa8-ee05595b5de4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6f58077-195c-4172-bacf-33dfd66cbe4d", "tag": "1582e229-4bed-4dd2-b97c-c1575e0fac14"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:39.376821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-0341a8f0-67e2-4b02-bbfa-1bfdb1afa2c7 req-1c9de2ba-e056-4ced-9aa8-ee05595b5de4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:39.377784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-0341a8f0-67e2-4b02-bbfa-1bfdb1afa2c7 req-1c9de2ba-e056-4ced-9aa8-ee05595b5de4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:39.392142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-266fcf3d-3f04-471c-89e8-44ffbfb7d917 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:39.396056 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-0341a8f0-67e2-4b02-bbfa-1bfdb1afa2c7 req-1c9de2ba-e056-4ced-9aa8-ee05595b5de4 service nova] Creating event network-changed:1582e229-4bed-4dd2-b97c-c1575e0fac14 for instance b6f58077-195c-4172-bacf-33dfd66cbe4d on n-h2-843700-1 May 28 04:37:39.409057 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-0341a8f0-67e2-4b02-bbfa-1bfdb1afa2c7 req-1c9de2ba-e056-4ced-9aa8-ee05595b5de4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061815 May 28 04:37:39.409879 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 583/1051] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:39.413594 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-266fcf3d-3f04-471c-89e8-44ffbfb7d917 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287" status: 200 len: 1274 microversion: 2.1 time: 0.173006 May 28 04:37:39.415181 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 469/1052] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:39 2022] GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287 => generated 1274 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:39.416683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-846e5e13-cbb5-4464-8fb3-e5e5f5c7c0bc tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:39.417563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-846e5e13-cbb5-4464-8fb3-e5e5f5c7c0bc tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:39.419851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-01174312-0d2d-4adf-91e2-3cc2a56f99e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:39.420791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-01174312-0d2d-4adf-91e2-3cc2a56f99e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:39.425922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-846e5e13-cbb5-4464-8fb3-e5e5f5c7c0bc tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:39.426784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-846e5e13-cbb5-4464-8fb3-e5e5f5c7c0bc tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:39.428046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-01174312-0d2d-4adf-91e2-3cc2a56f99e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:39.428253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-846e5e13-cbb5-4464-8fb3-e5e5f5c7c0bc tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:39.428644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-01174312-0d2d-4adf-91e2-3cc2a56f99e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:39.429492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-846e5e13-cbb5-4464-8fb3-e5e5f5c7c0bc tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:39.429653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-01174312-0d2d-4adf-91e2-3cc2a56f99e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:39.430306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-01174312-0d2d-4adf-91e2-3cc2a56f99e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:39.523531 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-846e5e13-cbb5-4464-8fb3-e5e5f5c7c0bc tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] HTTP exception thrown: Cannot 'migrate' instance a1679ae8-ff3a-4444-bd5b-9498c7078083 while it is in vm_state suspended May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-846e5e13-cbb5-4464-8fb3-e5e5f5c7c0bc tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Request method failure captured: May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083/action HTTP/1.1 May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 15 May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaboAgA9X4VLatPPE8-um4LS4rPsLBxPvgVqw6Ult1_6-UHFBha8zaVfSabNgVQsjOl6oIlAtPUK2Xwo9pJFe6K0eiEhzMYAGMMf_BnbHwBNtaf_oeXVeFVvbQWv9nImw_Ubq0oqlm_uv-1mGlmmfEoCR1d8lLuJCU1-bmoWBSh27pU May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 98950ce18cdd4e72895844e107cbcd65 May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-713114128 May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:37:39.526258 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:37:39.527888 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_98950ce18cdd4e72895844e107cbcd65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/98950ce18cdd4e72895844e107cbcd65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98950ce18cdd4e72895844e107cbcd65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98950ce18cdd4e72895844e107cbcd65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:39.527888 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersAdminNegativeTestJSON-713114128 May 28 04:37:39.527888 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 98950ce18cdd4e72895844e107cbcd65 May 28 04:37:39.527888 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-713114128 May 28 04:37:39.527888 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersAdminNegativeTestJSON-713114128-project-admin May 28 04:37:39.527888 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:37:39.527888 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:37:39.527888 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 3036a479d4e5486b81705e91fd26372e May 28 04:37:39.527888 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersAdminNegativeTestJSON-713114128-project-admin May 28 04:37:39.527888 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:37:39.527888 n-d-843700-1 devstack@n-api.service[126044]: {"migrate": {}} May 28 04:37:39.527888 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:37:39.527888 n-d-843700-1 devstack@n-api.service[126044]: exception: Cannot 'migrate' instance a1679ae8-ff3a-4444-bd5b-9498c7078083 while it is in vm_state suspended May 28 04:37:39.528883 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'a1679ae8-ff3a-4444-bd5b-9498c7078083', 'body': {'migrate': {}}} May 28 04:37:39.528883 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:39.528883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:39.528883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate May 28 04:37:39.528883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, May 28 04:37:39.528883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 28 04:37:39.528883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:37:39.528883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 28 04:37:39.528883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 04:37:39.528883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 28 04:37:39.528883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 04:37:39.528883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 28 04:37:39.528883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 04:37:39.528883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 04:37:39.528883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:37:39.528883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 04:37:39.528883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 04:37:39.528883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a1679ae8-ff3a-4444-bd5b-9498c7078083 in vm_state suspended. Cannot resize while the instance is in this state. May 28 04:37:39.528883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:39.530313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:39.530313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:39.530313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:39.530313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:39.530313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:39.530313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:39.530313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:39.530313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:39.530313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:39.530313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:37:39.530313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:39.530313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate May 28 04:37:39.530313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 04:37:39.530313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 04:37:39.530313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 04:37:39.530313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance a1679ae8-ff3a-4444-bd5b-9498c7078083 while it is in vm_state suspended May 28 04:37:39.530313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:39.530313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:39.530313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:39.530313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:39.531858 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:39.531858 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:39.531858 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:39.531858 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:39.531858 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance a1679ae8-ff3a-4444-bd5b-9498c7078083 while it is in vm_state suspended May 28 04:37:39.531858 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:39.531858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-846e5e13-cbb5-4464-8fb3-e5e5f5c7c0bc tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Returning 409 to user: Cannot 'migrate' instance a1679ae8-ff3a-4444-bd5b-9498c7078083 while it is in vm_state suspended {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:39.533088 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-846e5e13-cbb5-4464-8fb3-e5e5f5c7c0bc tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083/action" status: 409 len: 148 microversion: 2.1 time: 0.121744 May 28 04:37:39.536229 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 584/1053] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:37:39 2022] POST /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083/action => generated 148 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 04:37:39.550146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-01babd66-85ae-424b-b66a-393731f0f75b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:39.550926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-01babd66-85ae-424b-b66a-393731f0f75b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:39.557881 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01babd66-85ae-424b-b66a-393731f0f75b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:39.558458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01babd66-85ae-424b-b66a-393731f0f75b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:39.559456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01babd66-85ae-424b-b66a-393731f0f75b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:39.559990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01babd66-85ae-424b-b66a-393731f0f75b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:39.712530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-01174312-0d2d-4adf-91e2-3cc2a56f99e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:39.730632 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-01174312-0d2d-4adf-91e2-3cc2a56f99e9 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3" status: 200 len: 1389 microversion: 2.1 time: 0.313325 May 28 04:37:39.738178 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 470/1054] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:39 2022] GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 => generated 1389 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:39.745676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1a4b1531-8fa2-4c9e-bbef-697ef07388d9 tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1a4b1531-8fa2-4c9e-bbef-697ef07388d9 tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Request method failure captured: May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d/action HTTP/1.1 May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 39 May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaboAgA9X4VLatPPE8-um4LS4rPsLBxPvgVqw6Ult1_6-UHFBha8zaVfSabNgVQsjOl6oIlAtPUK2Xwo9pJFe6K0eiEhzMYAGMMf_BnbHwBNtaf_oeXVeFVvbQWv9nImw_Ubq0oqlm_uv-1mGlmmfEoCR1d8lLuJCU1-bmoWBSh27pU May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 98950ce18cdd4e72895844e107cbcd65 May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-713114128 May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: X-Role: admin,reader,member May 28 04:37:39.752902 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: admin,reader,member May 28 04:37:39.756740 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_98950ce18cdd4e72895844e107cbcd65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/98950ce18cdd4e72895844e107cbcd65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98950ce18cdd4e72895844e107cbcd65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98950ce18cdd4e72895844e107cbcd65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:39.756740 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersAdminNegativeTestJSON-713114128 May 28 04:37:39.756740 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 98950ce18cdd4e72895844e107cbcd65 May 28 04:37:39.756740 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-713114128 May 28 04:37:39.756740 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersAdminNegativeTestJSON-713114128-project-admin May 28 04:37:39.756740 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:37:39.756740 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:37:39.756740 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 3036a479d4e5486b81705e91fd26372e May 28 04:37:39.756740 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersAdminNegativeTestJSON-713114128-project-admin May 28 04:37:39.756740 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:37:39.756740 n-d-843700-1 devstack@n-api.service[126043]: {"os-resetState": {"state": "invalid"}} May 28 04:37:39.756740 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'e3f59d61-d661-41f7-9475-5a35ec9e3f2d', 'body': {'os-resetState': {'state': 'invalid'}}} May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'invalid' May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:39.757571 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:39.759312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:39.759312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:39.759312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:39.759312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:37:39.759312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:37:39.759312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:37:39.759312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:37:39.759312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:37:39.759312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:37:39.759312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 28 04:37:39.759312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:39.759312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:39.759312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:39.759312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:39.759312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:39.759312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:39.759312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:37:39.759312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:37:39.759312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 28 04:37:39.760732 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:39.760732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1a4b1531-8fa2-4c9e-bbef-697ef07388d9 tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:39.760732 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1a4b1531-8fa2-4c9e-bbef-697ef07388d9 tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d/action" status: 400 len: 144 microversion: 2.1 time: 0.010649 May 28 04:37:39.761832 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 471/1055] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:37:39 2022] POST /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d/action => generated 144 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:37:39.768212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-089da71b-402a-46da-8a26-25522762c3c6 tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-089da71b-402a-46da-8a26-25522762c3c6 tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Request method failure captured: May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d/action HTTP/1.1 May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 31 May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaboAgA9X4VLatPPE8-um4LS4rPsLBxPvgVqw6Ult1_6-UHFBha8zaVfSabNgVQsjOl6oIlAtPUK2Xwo9pJFe6K0eiEhzMYAGMMf_BnbHwBNtaf_oeXVeFVvbQWv9nImw_Ubq0oqlm_uv-1mGlmmfEoCR1d8lLuJCU1-bmoWBSh27pU May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 98950ce18cdd4e72895844e107cbcd65 May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-713114128 May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: X-Role: admin,reader,member May 28 04:37:39.771229 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: admin,reader,member May 28 04:37:39.772826 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_98950ce18cdd4e72895844e107cbcd65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/98950ce18cdd4e72895844e107cbcd65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98950ce18cdd4e72895844e107cbcd65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98950ce18cdd4e72895844e107cbcd65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:39.772826 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersAdminNegativeTestJSON-713114128 May 28 04:37:39.772826 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 98950ce18cdd4e72895844e107cbcd65 May 28 04:37:39.772826 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-713114128 May 28 04:37:39.772826 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersAdminNegativeTestJSON-713114128-project-admin May 28 04:37:39.772826 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:37:39.772826 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:37:39.772826 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 3036a479d4e5486b81705e91fd26372e May 28 04:37:39.772826 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersAdminNegativeTestJSON-713114128-project-admin May 28 04:37:39.772826 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:37:39.772826 n-d-843700-1 devstack@n-api.service[126043]: {"os-resetState": {"state": 1}} May 28 04:37:39.772826 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:37:39.772826 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'e3f59d61-d661-41f7-9475-5a35ec9e3f2d', 'body': {'os-resetState': {'state': 1}}} May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 1 May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:39.773772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:39.777933 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:39.777933 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:39.777933 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:37:39.777933 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:37:39.777933 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:37:39.777933 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:37:39.777933 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:37:39.777933 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:37:39.777933 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 28 04:37:39.777933 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:39.777933 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:39.777933 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:39.777933 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:39.777933 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:39.777933 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:39.777933 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:37:39.777933 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:37:39.777933 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 28 04:37:39.777933 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:39.780624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-089da71b-402a-46da-8a26-25522762c3c6 tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:39.780624 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-089da71b-402a-46da-8a26-25522762c3c6 tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d/action" status: 400 len: 120 microversion: 2.1 time: 0.012239 May 28 04:37:39.781053 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 472/1056] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:37:39 2022] POST /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d/action => generated 120 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:37:39.787903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8b5b69f9-e5ca-49ad-a698-ffce71391960 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:39.788559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8b5b69f9-e5ca-49ad-a698-ffce71391960 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:39.797675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b5b69f9-e5ca-49ad-a698-ffce71391960 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:39.799136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b5b69f9-e5ca-49ad-a698-ffce71391960 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:39.799488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b5b69f9-e5ca-49ad-a698-ffce71391960 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:39.800105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b5b69f9-e5ca-49ad-a698-ffce71391960 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:39.907018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-01babd66-85ae-424b-b66a-393731f0f75b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:39.921405 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-01babd66-85ae-424b-b66a-393731f0f75b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1537 microversion: 2.1 time: 0.376279 May 28 04:37:39.932465 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 585/1057] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:39 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1537 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:39.939175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-579929eb-83d6-44ed-9559-b269152373ed tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:39.940602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-579929eb-83d6-44ed-9559-b269152373ed tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Failed to fetch instance by id 999 {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2926}} May 28 04:37:39.941298 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-579929eb-83d6-44ed-9559-b269152373ed tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] HTTP exception thrown: Instance 999 could not be found. May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-579929eb-83d6-44ed-9559-b269152373ed tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Request method failure captured: May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 37 May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaboAgA9X4VLatPPE8-um4LS4rPsLBxPvgVqw6Ult1_6-UHFBha8zaVfSabNgVQsjOl6oIlAtPUK2Xwo9pJFe6K0eiEhzMYAGMMf_BnbHwBNtaf_oeXVeFVvbQWv9nImw_Ubq0oqlm_uv-1mGlmmfEoCR1d8lLuJCU1-bmoWBSh27pU May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 98950ce18cdd4e72895844e107cbcd65 May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-713114128 May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:37:39.943943 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:37:39.945448 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_98950ce18cdd4e72895844e107cbcd65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/98950ce18cdd4e72895844e107cbcd65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98950ce18cdd4e72895844e107cbcd65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98950ce18cdd4e72895844e107cbcd65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:39.945448 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersAdminNegativeTestJSON-713114128 May 28 04:37:39.945448 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 98950ce18cdd4e72895844e107cbcd65 May 28 04:37:39.945448 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-713114128 May 28 04:37:39.945448 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersAdminNegativeTestJSON-713114128-project-admin May 28 04:37:39.945448 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:37:39.945448 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:37:39.945448 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 3036a479d4e5486b81705e91fd26372e May 28 04:37:39.945448 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersAdminNegativeTestJSON-713114128-project-admin May 28 04:37:39.945448 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:37:39.945448 n-d-843700-1 devstack@n-api.service[126044]: {"os-resetState": {"state": "error"}} May 28 04:37:39.945448 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:37:39.945448 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 999 could not be found. May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:39.946274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state May 28 04:37:39.947816 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 28 04:37:39.947816 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:37:39.947816 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:37:39.947816 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. May 28 04:37:39.947816 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:39.947816 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:39.947816 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:39.947816 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:39.947816 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:39.947816 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:39.947816 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:39.947816 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:39.947816 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. May 28 04:37:39.947816 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:39.950828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-579929eb-83d6-44ed-9559-b269152373ed tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:39.952917 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-579929eb-83d6-44ed-9559-b269152373ed tempest-ServersAdminNegativeTestJSON-713114128 tempest-ServersAdminNegativeTestJSON-713114128-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.018390 May 28 04:37:39.954102 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 586/1058] 10.222.0.58 () {60 vars in 1178 bytes} [Sat May 28 04:37:39 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:37:39.965776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-90b1ec8d-e426-41ab-9da8-d385e935c793 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:39.966108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-90b1ec8d-e426-41ab-9da8-d385e935c793 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:39.976423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90b1ec8d-e426-41ab-9da8-d385e935c793 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:39.976892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90b1ec8d-e426-41ab-9da8-d385e935c793 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:39.977692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90b1ec8d-e426-41ab-9da8-d385e935c793 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:39.978202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90b1ec8d-e426-41ab-9da8-d385e935c793 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:40.012186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-90b1ec8d-e426-41ab-9da8-d385e935c793 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:37:40.019314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8b5b69f9-e5ca-49ad-a698-ffce71391960 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:40.029656 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8b5b69f9-e5ca-49ad-a698-ffce71391960 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.245526 May 28 04:37:40.030259 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 473/1059] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:39 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:40.042523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9c5c95c4-16c0-494c-990f-1cd488a731e9 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:40.043226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9c5c95c4-16c0-494c-990f-1cd488a731e9 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:40.056576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9c5c95c4-16c0-494c-990f-1cd488a731e9 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:40.057042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9c5c95c4-16c0-494c-990f-1cd488a731e9 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:40.067548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9c5c95c4-16c0-494c-990f-1cd488a731e9 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:40.068389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9c5c95c4-16c0-494c-990f-1cd488a731e9 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:40.280252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9c5c95c4-16c0-494c-990f-1cd488a731e9 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:40.294395 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9c5c95c4-16c0-494c-990f-1cd488a731e9 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d" status: 200 len: 1315 microversion: 2.1 time: 0.262787 May 28 04:37:40.295397 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 474/1060] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:40 2022] GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:40.342754 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-90b1ec8d-e426-41ab-9da8-d385e935c793 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 204 len: 0 microversion: 2.1 time: 0.381536 May 28 04:37:40.353348 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 587/1061] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:37:39 2022] DELETE /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:37:40.365354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-426a8ce0-a0a8-4ec8-b83d-ffce3fad8ffd tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:40.369777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-426a8ce0-a0a8-4ec8-b83d-ffce3fad8ffd tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:40.369906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1d036a7e-06bf-4197-a86e-750e206ebb9f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:40.369906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1d036a7e-06bf-4197-a86e-750e206ebb9f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:40.376665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d036a7e-06bf-4197-a86e-750e206ebb9f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:40.377425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d036a7e-06bf-4197-a86e-750e206ebb9f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:40.378377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d036a7e-06bf-4197-a86e-750e206ebb9f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:40.379043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d036a7e-06bf-4197-a86e-750e206ebb9f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:40.393286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-426a8ce0-a0a8-4ec8-b83d-ffce3fad8ffd tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:40.393911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-426a8ce0-a0a8-4ec8-b83d-ffce3fad8ffd tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:40.395212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-426a8ce0-a0a8-4ec8-b83d-ffce3fad8ffd tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:40.396101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-426a8ce0-a0a8-4ec8-b83d-ffce3fad8ffd tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:40.630469 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1d036a7e-06bf-4197-a86e-750e206ebb9f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:40.639305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1d036a7e-06bf-4197-a86e-750e206ebb9f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:40.640776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1d036a7e-06bf-4197-a86e-750e206ebb9f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:40.641944 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1d036a7e-06bf-4197-a86e-750e206ebb9f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.277721 May 28 04:37:40.647728 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 588/1062] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:40 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:40.654497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-09e733a0-80cd-4c2c-a7b4-69ee267b015f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:40.656264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-09e733a0-80cd-4c2c-a7b4-69ee267b015f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:40.669826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09e733a0-80cd-4c2c-a7b4-69ee267b015f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:40.670510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09e733a0-80cd-4c2c-a7b4-69ee267b015f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:40.671490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09e733a0-80cd-4c2c-a7b4-69ee267b015f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:40.672607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09e733a0-80cd-4c2c-a7b4-69ee267b015f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:40.688945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-426a8ce0-a0a8-4ec8-b83d-ffce3fad8ffd tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:40.697657 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-426a8ce0-a0a8-4ec8-b83d-ffce3fad8ffd tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 200 len: 1468 microversion: 2.1 time: 0.340003 May 28 04:37:40.698421 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 475/1063] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:40 2022] GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 1468 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:37:40.748888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5cc37b81-2c18-4632-b52d-ae086fd93933 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:40.749648 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5cc37b81-2c18-4632-b52d-ae086fd93933 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:40.761994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5cc37b81-2c18-4632-b52d-ae086fd93933 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:40.762550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5cc37b81-2c18-4632-b52d-ae086fd93933 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:40.766183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5cc37b81-2c18-4632-b52d-ae086fd93933 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:40.766715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5cc37b81-2c18-4632-b52d-ae086fd93933 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:40.954756 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-09e733a0-80cd-4c2c-a7b4-69ee267b015f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:40.965628 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-09e733a0-80cd-4c2c-a7b4-69ee267b015f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287" status: 200 len: 1316 microversion: 2.1 time: 0.314741 May 28 04:37:40.968218 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 589/1064] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:40 2022] GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287 => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:40.990627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b1f630e2-7ae5-4acd-832a-a3f855171779 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:40.992656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b1f630e2-7ae5-4acd-832a-a3f855171779 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:41.009783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1f630e2-7ae5-4acd-832a-a3f855171779 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:41.010248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1f630e2-7ae5-4acd-832a-a3f855171779 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:41.011096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1f630e2-7ae5-4acd-832a-a3f855171779 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:41.011544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1f630e2-7ae5-4acd-832a-a3f855171779 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:41.054521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5cc37b81-2c18-4632-b52d-ae086fd93933 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:41.073293 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5cc37b81-2c18-4632-b52d-ae086fd93933 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3" status: 200 len: 1589 microversion: 2.1 time: 0.329067 May 28 04:37:41.075029 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 476/1065] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:40 2022] GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 => generated 1589 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:41.158782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b1f630e2-7ae5-4acd-832a-a3f855171779 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:41.168047 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b1f630e2-7ae5-4acd-832a-a3f855171779 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1537 microversion: 2.1 time: 0.187786 May 28 04:37:41.179079 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 590/1066] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:40 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1537 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:41.184691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-317a280b-42ee-4c4a-82f5-5e947659a2f5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:41.185391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-317a280b-42ee-4c4a-82f5-5e947659a2f5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:41.191715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-317a280b-42ee-4c4a-82f5-5e947659a2f5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:41.192268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-317a280b-42ee-4c4a-82f5-5e947659a2f5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:41.193390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-317a280b-42ee-4c4a-82f5-5e947659a2f5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:41.193902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-317a280b-42ee-4c4a-82f5-5e947659a2f5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:41.242031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-05ff52b3-f65b-4a8d-9b12-87f09b4bbde7 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Action: 'create', calling method: .version_select at 0x7f7701d93940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1737441719", "description": "tempest-description-129384388"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:41.357458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-317a280b-42ee-4c4a-82f5-5e947659a2f5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:41.365888 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-317a280b-42ee-4c4a-82f5-5e947659a2f5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.185675 May 28 04:37:41.366481 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 591/1067] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:41 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:41.371280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d90fa892-3e9c-449f-9da4-80095bcbadae tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:41.371779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d90fa892-3e9c-449f-9da4-80095bcbadae tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:41.378135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d90fa892-3e9c-449f-9da4-80095bcbadae tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:41.378641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d90fa892-3e9c-449f-9da4-80095bcbadae tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:41.379436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d90fa892-3e9c-449f-9da4-80095bcbadae tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:41.379906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d90fa892-3e9c-449f-9da4-80095bcbadae tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:41.697133 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d90fa892-3e9c-449f-9da4-80095bcbadae tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.329572 May 28 04:37:41.697979 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 592/1068] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 04:37:41 2022] GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3/os-interface => generated 285 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:41.709048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b6796810-7330-4f16-b573-725d7a8f9154 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:41.709973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b6796810-7330-4f16-b573-725d7a8f9154 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:41.717176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b6796810-7330-4f16-b573-725d7a8f9154 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:41.717679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b6796810-7330-4f16-b573-725d7a8f9154 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:41.718502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b6796810-7330-4f16-b573-725d7a8f9154 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:41.718938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b6796810-7330-4f16-b573-725d7a8f9154 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:41.885721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b6796810-7330-4f16-b573-725d7a8f9154 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:41.898332 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b6796810-7330-4f16-b573-725d7a8f9154 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d" status: 200 len: 1315 microversion: 2.1 time: 0.193119 May 28 04:37:41.899300 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 593/1069] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:41 2022] GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:41.917542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a43772eb-a6ec-4df1-9cf4-b651c020d751 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:41.917542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a43772eb-a6ec-4df1-9cf4-b651c020d751 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:41.924093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a43772eb-a6ec-4df1-9cf4-b651c020d751 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:41.925041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a43772eb-a6ec-4df1-9cf4-b651c020d751 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:41.926282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a43772eb-a6ec-4df1-9cf4-b651c020d751 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:41.926920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a43772eb-a6ec-4df1-9cf4-b651c020d751 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:41.987430 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-05ff52b3-f65b-4a8d-9b12-87f09b4bbde7 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.903620 May 28 04:37:41.987430 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 477/1070] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:37:41 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:41.992915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-15ff5c62-22be-41d6-832f-bc5083c64e09 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:41.999589 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-15ff5c62-22be-41d6-832f-bc5083c64e09 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:42.009460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15ff5c62-22be-41d6-832f-bc5083c64e09 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:42.011445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15ff5c62-22be-41d6-832f-bc5083c64e09 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:42.014918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15ff5c62-22be-41d6-832f-bc5083c64e09 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:42.014918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15ff5c62-22be-41d6-832f-bc5083c64e09 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:42.188071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a43772eb-a6ec-4df1-9cf4-b651c020d751 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:42.196259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a43772eb-a6ec-4df1-9cf4-b651c020d751 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:42.198029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a43772eb-a6ec-4df1-9cf4-b651c020d751 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:42.199607 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a43772eb-a6ec-4df1-9cf4-b651c020d751 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.289162 May 28 04:37:42.200729 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 594/1071] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:41 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:42.205485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7d836bbf-068f-472a-8a6b-e9b6fa0eeaf2 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:42.206327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7d836bbf-068f-472a-8a6b-e9b6fa0eeaf2 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:42.215789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d836bbf-068f-472a-8a6b-e9b6fa0eeaf2 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:42.216528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d836bbf-068f-472a-8a6b-e9b6fa0eeaf2 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:42.217569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d836bbf-068f-472a-8a6b-e9b6fa0eeaf2 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:42.218207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d836bbf-068f-472a-8a6b-e9b6fa0eeaf2 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:42.231299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-15ff5c62-22be-41d6-832f-bc5083c64e09 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:42.248261 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-15ff5c62-22be-41d6-832f-bc5083c64e09 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 200 len: 1468 microversion: 2.1 time: 0.266747 May 28 04:37:42.250690 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 478/1072] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:41 2022] GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 1468 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:42.256240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-05f084fe-3bb6-41ba-867a-5b64e45d8097 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Action: 'create', calling method: .version_select at 0x7f7701ce2280>, body: {"security_group_rule": {"parent_group_id": "42f03a8f-077b-45a1-a920-8ef39df1b4d1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:42.431857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7d836bbf-068f-472a-8a6b-e9b6fa0eeaf2 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:42.442539 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7d836bbf-068f-472a-8a6b-e9b6fa0eeaf2 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287" status: 200 len: 1316 microversion: 2.1 time: 0.240509 May 28 04:37:42.452030 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 595/1073] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:42 2022] GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287 => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:42.452030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e92d2fef-5f8f-46e7-841a-3c595805243b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:42.452030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e92d2fef-5f8f-46e7-841a-3c595805243b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:42.459880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e92d2fef-5f8f-46e7-841a-3c595805243b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:42.460398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e92d2fef-5f8f-46e7-841a-3c595805243b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:42.461248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e92d2fef-5f8f-46e7-841a-3c595805243b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:42.461758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e92d2fef-5f8f-46e7-841a-3c595805243b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:42.645804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e92d2fef-5f8f-46e7-841a-3c595805243b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:42.653482 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e92d2fef-5f8f-46e7-841a-3c595805243b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.209244 May 28 04:37:42.654070 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 596/1074] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:42 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:42.659163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-07f2d3cb-91c9-4571-a284-94582268ecf4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:42.659778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-07f2d3cb-91c9-4571-a284-94582268ecf4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:42.665900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07f2d3cb-91c9-4571-a284-94582268ecf4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:42.666351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07f2d3cb-91c9-4571-a284-94582268ecf4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:42.667146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07f2d3cb-91c9-4571-a284-94582268ecf4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:42.667589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07f2d3cb-91c9-4571-a284-94582268ecf4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:42.825003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-07f2d3cb-91c9-4571-a284-94582268ecf4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:42.831416 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-05f084fe-3bb6-41ba-867a-5b64e45d8097 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.579278 May 28 04:37:42.832157 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 479/1075] 10.222.0.58 () {60 vars in 1194 bytes} [Sat May 28 04:37:42 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:42.836908 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-07f2d3cb-91c9-4571-a284-94582268ecf4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.181811 May 28 04:37:42.849321 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 597/1076] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:42 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:42.852085 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b5b01908-69fc-4692-b10f-e1e54b31bb65 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Action: 'create', calling method: .version_select at 0x7f7701dce430>, body: {"security_group_rule": {"parent_group_id": "42f03a8f-077b-45a1-a920-8ef39df1b4d1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:42.900912 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-b5b01908-69fc-4692-b10f-e1e54b31bb65 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] HTTP exception thrown: This rule already exists in group 42f03a8f-077b-45a1-a920-8ef39df1b4d1 May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b5b01908-69fc-4692-b10f-e1e54b31bb65 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Request method failure captured: May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 138 May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikacUXH63Sz3J0mbWutTzcOgKBHkhCGDq3UbxJ9r8UqVdFQWEwjlAtTgh3gvVa5DBt5ONekgSiAkXFU9n6ZNMmHCeXxpWhQ6UECBFrFQ3kXuDMpzKy9seCujn51AFyjB6J0OxQrELnF4OClMpRgghjtYq1AHo08ZB9kN4vmMjqjx6yH8 May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d12d0d0de82449df98e14e99d89c819e May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:37:42.903296 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:37:42.904665 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:42.904665 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:42.904665 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d12d0d0de82449df98e14e99d89c819e May 28 04:37:42.904665 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:42.904665 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-82288089-project May 28 04:37:42.904665 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:37:42.904665 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:37:42.904665 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 82308388e0a94e12991aa082d4681060 May 28 04:37:42.904665 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089-project May 28 04:37:42.904665 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:37:42.904665 n-d-843700-1 devstack@n-api.service[126043]: {"security_group_rule": {"parent_group_id": "42f03a8f-077b-45a1-a920-8ef39df1b4d1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 28 04:37:42.904665 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:37:42.905440 n-d-843700-1 devstack@n-api.service[126043]: exception: This rule already exists in group 42f03a8f-077b-45a1-a920-8ef39df1b4d1 May 28 04:37:42.905440 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'security_group_rule': {'parent_group_id': '42f03a8f-077b-45a1-a920-8ef39df1b4d1', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 28 04:37:42.905440 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:42.905440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:42.905440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create May 28 04:37:42.905440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( May 28 04:37:42.905440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule May 28 04:37:42.905440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) May 28 04:37:42.905440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 42f03a8f-077b-45a1-a920-8ef39df1b4d1 May 28 04:37:42.905440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:42.905440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:42.905440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:42.905440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:42.905440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:42.905440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:42.905440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:42.905440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:42.905440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:37:42.905440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:37:42.905440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:42.908728 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:42.908728 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create May 28 04:37:42.908728 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 28 04:37:42.908728 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 42f03a8f-077b-45a1-a920-8ef39df1b4d1 May 28 04:37:42.908728 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:42.908728 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:42.908728 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:42.908728 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:42.908728 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:42.908728 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:42.908728 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:42.908728 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:42.908728 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 42f03a8f-077b-45a1-a920-8ef39df1b4d1 May 28 04:37:42.908728 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:42.908728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b5b01908-69fc-4692-b10f-e1e54b31bb65 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Returning 400 to user: This rule already exists in group 42f03a8f-077b-45a1-a920-8ef39df1b4d1 {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:42.914319 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b5b01908-69fc-4692-b10f-e1e54b31bb65 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.066021 May 28 04:37:42.914319 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 480/1077] 10.222.0.58 () {60 vars in 1194 bytes} [Sat May 28 04:37:42 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:37:42.915855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-286e1dc6-8eb3-47ca-8912-34607c2d2f9e tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Calling method '.version_select at 0x7f7701bc6f70>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:42.916990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1b2d436e-856b-46dd-b708-129122d609b8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:42.917616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1b2d436e-856b-46dd-b708-129122d609b8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:42.934339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b2d436e-856b-46dd-b708-129122d609b8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:42.947735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b2d436e-856b-46dd-b708-129122d609b8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:42.948588 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b2d436e-856b-46dd-b708-129122d609b8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:42.949222 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b2d436e-856b-46dd-b708-129122d609b8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:43.159805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1b2d436e-856b-46dd-b708-129122d609b8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:43.169638 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1b2d436e-856b-46dd-b708-129122d609b8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d" status: 200 len: 1315 microversion: 2.1 time: 0.257865 May 28 04:37:43.173743 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 481/1078] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:42 2022] GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:43.218033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-97a884cf-dea1-4da6-9dc1-d997908826e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:43.219547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-97a884cf-dea1-4da6-9dc1-d997908826e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:43.226410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97a884cf-dea1-4da6-9dc1-d997908826e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:43.226861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97a884cf-dea1-4da6-9dc1-d997908826e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:43.227870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97a884cf-dea1-4da6-9dc1-d997908826e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:43.228305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97a884cf-dea1-4da6-9dc1-d997908826e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:43.242483 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-286e1dc6-8eb3-47ca-8912-34607c2d2f9e tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-group-rules/facaa692-21dc-483e-b8bb-470475d5baae" status: 202 len: 0 microversion: 2.1 time: 0.330923 May 28 04:37:43.243103 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 598/1079] 10.222.0.58 () {58 vars in 1286 bytes} [Sat May 28 04:37:42 2022] DELETE /compute/v2.1/os-security-group-rules/facaa692-21dc-483e-b8bb-470475d5baae => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:37:43.252311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b9a48ada-4b6b-4678-a93a-437b2c2c723f tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Action: 'create', calling method: .version_select at 0x7f7701ba20d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-72457287", "description": "tempest-description-323821580"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:43.407457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-97a884cf-dea1-4da6-9dc1-d997908826e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:43.417003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-97a884cf-dea1-4da6-9dc1-d997908826e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:43.418167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-97a884cf-dea1-4da6-9dc1-d997908826e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:43.419325 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-97a884cf-dea1-4da6-9dc1-d997908826e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.205436 May 28 04:37:43.431141 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 482/1080] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:43 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:37:43.436576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b9de5dd1-75c0-408f-b462-d8a6dd195bf0 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:43.437191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b9de5dd1-75c0-408f-b462-d8a6dd195bf0 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:43.443597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9de5dd1-75c0-408f-b462-d8a6dd195bf0 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:43.444039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9de5dd1-75c0-408f-b462-d8a6dd195bf0 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:43.445018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9de5dd1-75c0-408f-b462-d8a6dd195bf0 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:43.445454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9de5dd1-75c0-408f-b462-d8a6dd195bf0 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:43.449876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:43.614554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b9de5dd1-75c0-408f-b462-d8a6dd195bf0 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:43.632358 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b9a48ada-4b6b-4678-a93a-437b2c2c723f tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.383928 May 28 04:37:43.637858 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 599/1081] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:37:43 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:37:43.638599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-93b05453-2523-4b88-a20e-a37541f84133 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:43.639384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-93b05453-2523-4b88-a20e-a37541f84133 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:43.642636 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b9de5dd1-75c0-408f-b462-d8a6dd195bf0 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 200 len: 1468 microversion: 2.1 time: 0.210313 May 28 04:37:43.647642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93b05453-2523-4b88-a20e-a37541f84133 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:43.660956 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 483/1082] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:43 2022] GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 1468 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:43.660956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bc9b20ad-f865-46a6-9542-466c96cf5981 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Action: 'create', calling method: .version_select at 0x7f7701cb5e50>, body: {"security_group_rule": {"parent_group_id": "dfc97d24-8f92-4295-8950-f7187f033e49", "ip_protocol": "tcp", "from_port": 1440281764, "to_port": 22}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:43.661228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93b05453-2523-4b88-a20e-a37541f84133 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:43.661228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93b05453-2523-4b88-a20e-a37541f84133 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:43.661228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93b05453-2523-4b88-a20e-a37541f84133 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:43.728841 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-bc9b20ad-f865-46a6-9542-466c96cf5981 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] HTTP exception thrown: Invalid port range 1440281764:22. Former value cannot be greater than the later May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bc9b20ad-f865-46a6-9542-466c96cf5981 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Request method failure captured: May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 146 May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikacUXH63Sz3J0mbWutTzcOgKBHkhCGDq3UbxJ9r8UqVdFQWEwjlAtTgh3gvVa5DBt5ONekgSiAkXFU9n6ZNMmHCeXxpWhQ6UECBFrFQ3kXuDMpzKy9seCujn51AFyjB6J0OxQrELnF4OClMpRgghjtYq1AHo08ZB9kN4vmMjqjx6yH8 May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d12d0d0de82449df98e14e99d89c819e May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:37:43.731153 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:37:43.732724 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:43.732724 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:43.732724 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d12d0d0de82449df98e14e99d89c819e May 28 04:37:43.732724 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:43.732724 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-82288089-project May 28 04:37:43.732724 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:37:43.732724 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:37:43.732724 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 82308388e0a94e12991aa082d4681060 May 28 04:37:43.732724 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089-project May 28 04:37:43.732724 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:37:43.732724 n-d-843700-1 devstack@n-api.service[126043]: {"security_group_rule": {"parent_group_id": "dfc97d24-8f92-4295-8950-f7187f033e49", "ip_protocol": "tcp", "from_port": 1440281764, "to_port": 22}} May 28 04:37:43.732724 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:37:43.733506 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid port range 1440281764:22. Former value cannot be greater than the later May 28 04:37:43.733506 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'dfc97d24-8f92-4295-8950-f7187f033e49', 'ip_protocol': 'tcp', 'from_port': 1440281764, 'to_port': 22}}} May 28 04:37:43.733506 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:43.733506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:43.733506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 28 04:37:43.733506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 28 04:37:43.733506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 28 04:37:43.733506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 28 04:37:43.733506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 28 04:37:43.733506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 28 04:37:43.733506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule May 28 04:37:43.733506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 28 04:37:43.733506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1440281764:22. Former value cannot be greater than the later May 28 04:37:43.733506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:43.733506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:43.733506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:43.733506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:43.733506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:43.733506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:43.734946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:43.734946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:43.734946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:37:43.734946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:37:43.734946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:43.734946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:43.734946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 28 04:37:43.734946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 28 04:37:43.734946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1440281764:22. Former value cannot be greater than the later May 28 04:37:43.734946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:43.734946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:43.734946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:43.734946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:43.734946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:43.734946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:43.734946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:43.734946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:43.734946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1440281764:22. Former value cannot be greater than the later May 28 04:37:43.734946 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:43.737308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bc9b20ad-f865-46a6-9542-466c96cf5981 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Returning 400 to user: Invalid port range 1440281764:22. Former value cannot be greater than the later {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:43.738330 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bc9b20ad-f865-46a6-9542-466c96cf5981 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.089307 May 28 04:37:43.739143 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 484/1083] 10.222.0.58 () {60 vars in 1194 bytes} [Sat May 28 04:37:43 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:37:43.748865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d965b79b-8a04-400a-9c94-bb9b50fa9290 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:43.752178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d965b79b-8a04-400a-9c94-bb9b50fa9290 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:43.767834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d965b79b-8a04-400a-9c94-bb9b50fa9290 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:43.768515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d965b79b-8a04-400a-9c94-bb9b50fa9290 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:43.769614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d965b79b-8a04-400a-9c94-bb9b50fa9290 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:43.770276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d965b79b-8a04-400a-9c94-bb9b50fa9290 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:43.926669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-93b05453-2523-4b88-a20e-a37541f84133 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:43.941316 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-93b05453-2523-4b88-a20e-a37541f84133 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287" status: 200 len: 1316 microversion: 2.1 time: 0.306766 May 28 04:37:43.945072 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 600/1084] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:43 2022] GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287 => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:43.963110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5af3b63f-835b-4b99-8d1a-cdd5c02efed2 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Action: 'create', calling method: .version_select at 0x7f7701ba2af0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-466380762", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:43.968989 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-5af3b63f-835b-4b99-8d1a-cdd5c02efed2 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] HTTP exception thrown: Security group id should be uuid May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5af3b63f-835b-4b99-8d1a-cdd5c02efed2 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Request method failure captured: May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 130 May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikacUXH63Sz3J0mbWutTzcOgKBHkhCGDq3UbxJ9r8UqVdFQWEwjlAtTgh3gvVa5DBt5ONekgSiAkXFU9n6ZNMmHCeXxpWhQ6UECBFrFQ3kXuDMpzKy9seCujn51AFyjB6J0OxQrELnF4OClMpRgghjtYq1AHo08ZB9kN4vmMjqjx6yH8 May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d12d0d0de82449df98e14e99d89c819e May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:37:43.976937 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:37:43.978413 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:43.978413 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:43.978413 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d12d0d0de82449df98e14e99d89c819e May 28 04:37:43.978413 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:43.978413 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-82288089-project May 28 04:37:43.978413 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:37:43.978413 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:37:43.978413 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 82308388e0a94e12991aa082d4681060 May 28 04:37:43.978413 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089-project May 28 04:37:43.978413 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:37:43.978413 n-d-843700-1 devstack@n-api.service[126044]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-466380762", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 28 04:37:43.978413 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:37:43.978413 n-d-843700-1 devstack@n-api.service[126044]: exception: Security group id should be uuid May 28 04:37:43.979256 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-466380762', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 28 04:37:43.979256 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:43.979256 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:43.979256 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create May 28 04:37:43.979256 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( May 28 04:37:43.979256 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id May 28 04:37:43.979256 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) May 28 04:37:43.979256 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid May 28 04:37:43.979256 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:43.979256 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:43.979256 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:43.979256 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:43.979256 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:43.979256 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:43.979256 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:43.979256 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:43.979256 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:37:43.979256 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:37:43.979256 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:43.979256 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:43.980436 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 28 04:37:43.980436 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 28 04:37:43.980436 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid May 28 04:37:43.980436 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:43.980436 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:43.980436 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:43.980436 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:43.980436 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:43.980436 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:43.980436 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:43.980436 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:43.980436 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid May 28 04:37:43.980436 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:43.989407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5af3b63f-835b-4b99-8d1a-cdd5c02efed2 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Returning 400 to user: Security group id should be uuid {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:43.990507 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5af3b63f-835b-4b99-8d1a-cdd5c02efed2 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.044106 May 28 04:37:43.995572 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 601/1085] 10.222.0.58 () {60 vars in 1194 bytes} [Sat May 28 04:37:43 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 04:37:43.999540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0c03767b-fce7-4e95-b64a-712874b61615 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:44.000677 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0c03767b-fce7-4e95-b64a-712874b61615 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:44.007752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c03767b-fce7-4e95-b64a-712874b61615 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:44.008288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c03767b-fce7-4e95-b64a-712874b61615 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:44.009076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c03767b-fce7-4e95-b64a-712874b61615 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:44.010144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c03767b-fce7-4e95-b64a-712874b61615 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:44.119648 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d965b79b-8a04-400a-9c94-bb9b50fa9290 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:44.131816 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d965b79b-8a04-400a-9c94-bb9b50fa9290 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.386623 May 28 04:37:44.135907 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 485/1086] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:43 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:44.142550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-dede2f7b-1d69-46e5-bd82-cbe7376dcf81 req-caa8d60e-ec6f-4944-88d5-42af5975c68d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1679ae8-ff3a-4444-bd5b-9498c7078083", "name": "network-vif-deleted", "tag": "462fb92a-28d1-45af-8dba-233b2299a5a8"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:44.160555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-dede2f7b-1d69-46e5-bd82-cbe7376dcf81 req-caa8d60e-ec6f-4944-88d5-42af5975c68d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:44.161139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-dede2f7b-1d69-46e5-bd82-cbe7376dcf81 req-caa8d60e-ec6f-4944-88d5-42af5975c68d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:44.183705 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-dede2f7b-1d69-46e5-bd82-cbe7376dcf81 req-caa8d60e-ec6f-4944-88d5-42af5975c68d service nova] Creating event network-vif-deleted:462fb92a-28d1-45af-8dba-233b2299a5a8 for instance a1679ae8-ff3a-4444-bd5b-9498c7078083 on n-h1-843700-1 May 28 04:37:44.189738 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-dede2f7b-1d69-46e5-bd82-cbe7376dcf81 req-caa8d60e-ec6f-4944-88d5-42af5975c68d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055695 May 28 04:37:44.191029 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 486/1087] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:44.196684 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f8e2e2e5-ad7e-49f3-ae31-17d97a6565a8 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Action: 'create', calling method: .version_select at 0x7f7701cb5ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1942823968", "description": "tempest-description-934632883"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:44.242304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0c03767b-fce7-4e95-b64a-712874b61615 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:44.252938 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0c03767b-fce7-4e95-b64a-712874b61615 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.259990 May 28 04:37:44.253554 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 602/1088] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:43 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:44.261158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5c204cd3-818f-42ed-b139-d3c4681abea4 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:44.264835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5c204cd3-818f-42ed-b139-d3c4681abea4 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:44.269968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c204cd3-818f-42ed-b139-d3c4681abea4 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:44.271228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c204cd3-818f-42ed-b139-d3c4681abea4 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:44.272018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c204cd3-818f-42ed-b139-d3c4681abea4 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:44.272463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c204cd3-818f-42ed-b139-d3c4681abea4 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:44.277766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:44.474093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5c204cd3-818f-42ed-b139-d3c4681abea4 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:44.484734 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5c204cd3-818f-42ed-b139-d3c4681abea4 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d" status: 200 len: 1315 microversion: 2.1 time: 0.229086 May 28 04:37:44.486975 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 603/1089] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:44 2022] GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:44.492838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bca785bd-1251-4f62-9d10-75429611ddd6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:44.493711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bca785bd-1251-4f62-9d10-75429611ddd6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:44.500628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bca785bd-1251-4f62-9d10-75429611ddd6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:44.501367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bca785bd-1251-4f62-9d10-75429611ddd6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:44.502145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bca785bd-1251-4f62-9d10-75429611ddd6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:44.502748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bca785bd-1251-4f62-9d10-75429611ddd6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:44.642707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=13 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:44.684104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bca785bd-1251-4f62-9d10-75429611ddd6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:44.693277 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bca785bd-1251-4f62-9d10-75429611ddd6 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3" status: 200 len: 1589 microversion: 2.1 time: 0.206091 May 28 04:37:44.694406 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 604/1090] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:44 2022] GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 => generated 1589 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:44.705841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-93df5baf-3986-4a3c-a8e6-2c179c4756f9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:44.707494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-93df5baf-3986-4a3c-a8e6-2c179c4756f9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:44.715213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93df5baf-3986-4a3c-a8e6-2c179c4756f9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:44.716213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93df5baf-3986-4a3c-a8e6-2c179c4756f9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:44.717525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93df5baf-3986-4a3c-a8e6-2c179c4756f9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:44.718151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93df5baf-3986-4a3c-a8e6-2c179c4756f9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:44.734651 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f8e2e2e5-ad7e-49f3-ae31-17d97a6565a8 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.539589 May 28 04:37:44.734651 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 487/1091] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:37:44 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:44.739638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-71019308-3617-4aa2-a946-2bc339ef5268 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:44.741069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-71019308-3617-4aa2-a946-2bc339ef5268 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:44.748622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71019308-3617-4aa2-a946-2bc339ef5268 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:44.749389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71019308-3617-4aa2-a946-2bc339ef5268 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:44.758409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71019308-3617-4aa2-a946-2bc339ef5268 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:44.763289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71019308-3617-4aa2-a946-2bc339ef5268 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:44.801171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71019308-3617-4aa2-a946-2bc339ef5268 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:44.802009 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71019308-3617-4aa2-a946-2bc339ef5268 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:44.803301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-71019308-3617-4aa2-a946-2bc339ef5268 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lazy-loading 'fault' on Instance uuid a1679ae8-ff3a-4444-bd5b-9498c7078083 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:37:44.873441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-71019308-3617-4aa2-a946-2bc339ef5268 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:44.896797 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-71019308-3617-4aa2-a946-2bc339ef5268 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 200 len: 1311 microversion: 2.1 time: 0.161816 May 28 04:37:44.898112 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 488/1092] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:44 2022] GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 1311 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:44.903477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a4822818-495d-4215-89d1-0d4518fa509c tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Action: 'create', calling method: .version_select at 0x7f7701ce09d0>, body: {"security_group_rule": {"parent_group_id": "dc0edc84-5095-41a7-a106-0bf458835111", "ip_protocol": "tempest-999-47862037", "from_port": 22, "to_port": 22}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:44.948784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-93df5baf-3986-4a3c-a8e6-2c179c4756f9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:44.964620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-93df5baf-3986-4a3c-a8e6-2c179c4756f9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:44.970289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-93df5baf-3986-4a3c-a8e6-2c179c4756f9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:44.972405 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-93df5baf-3986-4a3c-a8e6-2c179c4756f9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.276824 May 28 04:37:44.973645 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 605/1093] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:44 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:44.991893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-895103bc-a17e-4d29-95c3-90ac36556e5a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:44.998284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-895103bc-a17e-4d29-95c3-90ac36556e5a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:45.000928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-895103bc-a17e-4d29-95c3-90ac36556e5a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:45.001645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-895103bc-a17e-4d29-95c3-90ac36556e5a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:45.002622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-895103bc-a17e-4d29-95c3-90ac36556e5a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:45.003089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-895103bc-a17e-4d29-95c3-90ac36556e5a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:45.011496 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-a4822818-495d-4215-89d1-0d4518fa509c tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] HTTP exception thrown: Invalid IP protocol tempest-999-47862037. May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a4822818-495d-4215-89d1-0d4518fa509c tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Request method failure captured: May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 155 May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikacUXH63Sz3J0mbWutTzcOgKBHkhCGDq3UbxJ9r8UqVdFQWEwjlAtTgh3gvVa5DBt5ONekgSiAkXFU9n6ZNMmHCeXxpWhQ6UECBFrFQ3kXuDMpzKy9seCujn51AFyjB6J0OxQrELnF4OClMpRgghjtYq1AHo08ZB9kN4vmMjqjx6yH8 May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d12d0d0de82449df98e14e99d89c819e May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:37:45.014408 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:37:45.016750 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:45.016750 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:45.016750 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d12d0d0de82449df98e14e99d89c819e May 28 04:37:45.016750 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:45.016750 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-82288089-project May 28 04:37:45.016750 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:37:45.016750 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:37:45.016750 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 82308388e0a94e12991aa082d4681060 May 28 04:37:45.016750 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089-project May 28 04:37:45.016750 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:37:45.016750 n-d-843700-1 devstack@n-api.service[126043]: {"security_group_rule": {"parent_group_id": "dc0edc84-5095-41a7-a106-0bf458835111", "ip_protocol": "tempest-999-47862037", "from_port": 22, "to_port": 22}} May 28 04:37:45.016750 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:37:45.016750 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid IP protocol tempest-999-47862037. May 28 04:37:45.018045 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'dc0edc84-5095-41a7-a106-0bf458835111', 'ip_protocol': 'tempest-999-47862037', 'from_port': 22, 'to_port': 22}}} May 28 04:37:45.018045 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:45.018045 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:45.018045 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 28 04:37:45.018045 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 28 04:37:45.018045 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 28 04:37:45.018045 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 28 04:37:45.018045 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 28 04:37:45.018045 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 28 04:37:45.018045 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule May 28 04:37:45.018045 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) May 28 04:37:45.018045 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-47862037. May 28 04:37:45.018045 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:45.018045 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:45.018045 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:45.018045 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:45.018045 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:45.018045 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:45.018045 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:45.019600 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:45.019600 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:37:45.019600 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:37:45.019600 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:45.019600 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:45.019600 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 28 04:37:45.019600 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 28 04:37:45.019600 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-47862037. May 28 04:37:45.019600 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:45.019600 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:45.019600 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:45.019600 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:45.019600 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:45.019600 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:45.019600 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:45.019600 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:45.019600 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-47862037. May 28 04:37:45.019600 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:45.026283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a4822818-495d-4215-89d1-0d4518fa509c tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Returning 400 to user: Invalid IP protocol tempest-999-47862037. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:45.026283 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a4822818-495d-4215-89d1-0d4518fa509c tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 85 microversion: 2.1 time: 0.116778 May 28 04:37:45.026283 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 489/1094] 10.222.0.58 () {60 vars in 1194 bytes} [Sat May 28 04:37:44 2022] POST /compute/v2.1/os-security-group-rules => generated 85 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 04:37:45.028096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e0250e63-d526-4bf4-81a1-d732363eebe5 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Action: 'create', calling method: .version_select at 0x7f7701d0f1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-448126354", "description": "tempest-description-1129606481"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:45.065602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=14 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:45.176165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-895103bc-a17e-4d29-95c3-90ac36556e5a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:45.183995 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-895103bc-a17e-4d29-95c3-90ac36556e5a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287" status: 200 len: 1316 microversion: 2.1 time: 0.196910 May 28 04:37:45.184601 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 606/1095] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:44 2022] GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287 => generated 1316 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:45.189320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-47140a47-fb5f-460a-99a9-3b6a18ee2528 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:45.189926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-47140a47-fb5f-460a-99a9-3b6a18ee2528 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:45.198055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47140a47-fb5f-460a-99a9-3b6a18ee2528 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:45.198512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47140a47-fb5f-460a-99a9-3b6a18ee2528 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:45.199550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47140a47-fb5f-460a-99a9-3b6a18ee2528 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:45.199931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47140a47-fb5f-460a-99a9-3b6a18ee2528 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:45.351247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-47140a47-fb5f-460a-99a9-3b6a18ee2528 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:45.358676 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-47140a47-fb5f-460a-99a9-3b6a18ee2528 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.172895 May 28 04:37:45.359313 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 607/1096] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:45 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:45.364608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ed724f53-2fa5-408f-bdfd-9771650ea9ee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:45.365479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ed724f53-2fa5-408f-bdfd-9771650ea9ee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:45.372466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed724f53-2fa5-408f-bdfd-9771650ea9ee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:45.373012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed724f53-2fa5-408f-bdfd-9771650ea9ee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:45.373867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed724f53-2fa5-408f-bdfd-9771650ea9ee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:45.374366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed724f53-2fa5-408f-bdfd-9771650ea9ee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:45.456360 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e0250e63-d526-4bf4-81a1-d732363eebe5 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.431920 May 28 04:37:45.457561 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 490/1097] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:37:45 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:45.468990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d36ec864-aa7b-4668-8bdc-b8c961c8dad6 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Action: 'create', calling method: .version_select at 0x7f7701ce2c10>, body: {"security_group_rule": {"parent_group_id": "a41c895e-ff95-44dd-98ee-1d84b1b0906e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:45.556202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ed724f53-2fa5-408f-bdfd-9771650ea9ee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:45.557557 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-d36ec864-aa7b-4668-8bdc-b8c961c8dad6 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d36ec864-aa7b-4668-8bdc-b8c961c8dad6 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Request method failure captured: May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 138 May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikacUXH63Sz3J0mbWutTzcOgKBHkhCGDq3UbxJ9r8UqVdFQWEwjlAtTgh3gvVa5DBt5ONekgSiAkXFU9n6ZNMmHCeXxpWhQ6UECBFrFQ3kXuDMpzKy9seCujn51AFyjB6J0OxQrELnF4OClMpRgghjtYq1AHo08ZB9kN4vmMjqjx6yH8 May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d12d0d0de82449df98e14e99d89c819e May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:37:45.559409 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:37:45.560752 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:45.560752 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:45.560752 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d12d0d0de82449df98e14e99d89c819e May 28 04:37:45.560752 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:45.560752 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-82288089-project May 28 04:37:45.560752 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:37:45.560752 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:37:45.560752 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 82308388e0a94e12991aa082d4681060 May 28 04:37:45.560752 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089-project May 28 04:37:45.560752 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:37:45.560752 n-d-843700-1 devstack@n-api.service[126043]: {"security_group_rule": {"parent_group_id": "a41c895e-ff95-44dd-98ee-1d84b1b0906e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} May 28 04:37:45.560752 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:37:45.561460 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid port range 22:21. Former value cannot be greater than the later May 28 04:37:45.561460 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a41c895e-ff95-44dd-98ee-1d84b1b0906e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} May 28 04:37:45.561460 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:45.561460 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:45.561460 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 28 04:37:45.561460 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 28 04:37:45.561460 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 28 04:37:45.561460 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 28 04:37:45.561460 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 28 04:37:45.561460 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 28 04:37:45.561460 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule May 28 04:37:45.561460 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 28 04:37:45.561460 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later May 28 04:37:45.561460 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:45.561460 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:45.561460 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:45.561460 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:45.561460 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:45.561460 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:45.564054 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:45.564054 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:45.564054 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:37:45.564054 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:37:45.564054 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:45.564054 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:45.564054 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 28 04:37:45.564054 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 28 04:37:45.564054 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later May 28 04:37:45.564054 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:45.564054 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:45.564054 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:45.564054 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:45.564054 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:45.564054 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:45.564054 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:45.564054 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:45.564054 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later May 28 04:37:45.564054 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:45.566966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d36ec864-aa7b-4668-8bdc-b8c961c8dad6 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:45.566966 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d36ec864-aa7b-4668-8bdc-b8c961c8dad6 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.095871 May 28 04:37:45.566966 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 491/1098] 10.222.0.58 () {60 vars in 1194 bytes} [Sat May 28 04:37:45 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 04:37:45.567614 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ed724f53-2fa5-408f-bdfd-9771650ea9ee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.207270 May 28 04:37:45.568212 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 608/1099] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:45 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:45.568430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-16fa2699-cb65-437a-9280-2faaf6abc10b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:45.572887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-88e427d8-777e-4fe8-8c16-5e2568d33994 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Action: 'create', calling method: .version_select at 0x7f7701b30ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-489460859", "description": "tempest-description-228312663"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:45.573429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-16fa2699-cb65-437a-9280-2faaf6abc10b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:45.585442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16fa2699-cb65-437a-9280-2faaf6abc10b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:45.585442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16fa2699-cb65-437a-9280-2faaf6abc10b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:45.585442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16fa2699-cb65-437a-9280-2faaf6abc10b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:45.585964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16fa2699-cb65-437a-9280-2faaf6abc10b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:45.746131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-16fa2699-cb65-437a-9280-2faaf6abc10b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:45.755711 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-16fa2699-cb65-437a-9280-2faaf6abc10b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d" status: 200 len: 1315 microversion: 2.1 time: 0.193356 May 28 04:37:45.767067 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 492/1100] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:45 2022] GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:45.914670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ac4052ad-b754-4f6d-824b-cc8837d9ea3b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:45.917404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ac4052ad-b754-4f6d-824b-cc8837d9ea3b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: a1679ae8-ff3a-4444-bd5b-9498c7078083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:45.922019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ac4052ad-b754-4f6d-824b-cc8837d9ea3b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:45.922476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ac4052ad-b754-4f6d-824b-cc8837d9ea3b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:45.923424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ac4052ad-b754-4f6d-824b-cc8837d9ea3b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:45.923867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ac4052ad-b754-4f6d-824b-cc8837d9ea3b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:45.937794 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-ac4052ad-b754-4f6d-824b-cc8837d9ea3b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] HTTP exception thrown: Instance a1679ae8-ff3a-4444-bd5b-9498c7078083 could not be found. May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ac4052ad-b754-4f6d-824b-cc8837d9ea3b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Request method failure captured: May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 HTTP/1.1 May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikabnXo-AJt712KG8MGyeyWVBWyntMYo1B421v_yrpzMaSgx-0QqwUQo8l5FD0s1vi9u7AjEsfVk056N60WHOU5MzT2jiWCvL_i4VRStj-k16sqjV2E8L9RabqkhtVBqUlMYYIqfPUU_b19Eq7aRyUSLXHSTYnGjA1K6kvhmDt-VryhI May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 7c84426a50904071bfa68e7529a40945 May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-793629218 May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:37:45.939349 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:37:45.945022 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7c84426a50904071bfa68e7529a40945"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7c84426a50904071bfa68e7529a40945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7c84426a50904071bfa68e7529a40945"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7c84426a50904071bfa68e7529a40945"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:45.945022 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersAdminNegativeTestJSON-793629218 May 28 04:37:45.945022 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 7c84426a50904071bfa68e7529a40945 May 28 04:37:45.945022 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-793629218 May 28 04:37:45.945022 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersAdminNegativeTestJSON-793629218-project May 28 04:37:45.945022 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:37:45.945022 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:37:45.945022 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: e75ff372428143249395a635a1766f9f May 28 04:37:45.945022 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersAdminNegativeTestJSON-793629218-project May 28 04:37:45.945022 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:37:45.945022 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance a1679ae8-ff3a-4444-bd5b-9498c7078083 could not be found. May 28 04:37:45.945022 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'a1679ae8-ff3a-4444-bd5b-9498c7078083'} May 28 04:37:45.945784 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:45.945784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:45.945784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:37:45.945784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:37:45.945784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:37:45.945784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:37:45.945784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:37:45.945784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:37:45.945784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:37:45.945784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:37:45.945784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1679ae8-ff3a-4444-bd5b-9498c7078083 could not be found. May 28 04:37:45.945784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:45.945784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:45.945784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:45.945784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:45.945784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:45.945784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:45.945784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:45.945784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:45.945784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:45.946953 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:45.946953 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:37:45.946953 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:37:45.946953 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:37:45.946953 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:37:45.946953 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:37:45.946953 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:37:45.946953 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1679ae8-ff3a-4444-bd5b-9498c7078083 could not be found. May 28 04:37:45.946953 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:45.946953 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:45.946953 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:45.946953 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:45.946953 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:45.946953 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:45.946953 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:45.946953 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:45.946953 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1679ae8-ff3a-4444-bd5b-9498c7078083 could not be found. May 28 04:37:45.946953 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:45.948032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ac4052ad-b754-4f6d-824b-cc8837d9ea3b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Returning 404 to user: Instance a1679ae8-ff3a-4444-bd5b-9498c7078083 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:45.948032 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ac4052ad-b754-4f6d-824b-cc8837d9ea3b tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083" status: 404 len: 111 microversion: 2.1 time: 0.030105 May 28 04:37:45.948032 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 493/1101] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:45 2022] GET /compute/v2.1/servers/a1679ae8-ff3a-4444-bd5b-9498c7078083 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:37:45.949162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-16974316-73c5-4b57-be01-c266b0332625 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:45.949668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-16974316-73c5-4b57-be01-c266b0332625 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:45.955757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16974316-73c5-4b57-be01-c266b0332625 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:45.956215 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16974316-73c5-4b57-be01-c266b0332625 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:45.956983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16974316-73c5-4b57-be01-c266b0332625 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:45.957428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16974316-73c5-4b57-be01-c266b0332625 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:45.968724 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-88e427d8-777e-4fe8-8c16-5e2568d33994 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.399436 May 28 04:37:45.978221 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 609/1102] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:37:45 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:45.982737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-28bf0e3d-cc2b-4512-aef8-caa735435e5a tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Action: 'create', calling method: .version_select at 0x7f7701b84af0>, body: {"security_group_rule": {"parent_group_id": "adba470c-2595-4b4a-a14f-0a49e96dd318", "ip_protocol": "tcp", "from_port": 22, "to_port": 1453789381}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:45.983155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-16974316-73c5-4b57-be01-c266b0332625 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:37:46.034551 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-28bf0e3d-cc2b-4512-aef8-caa735435e5a tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] HTTP exception thrown: Invalid port range 22:1453789381. Valid TCP ports should be between 1-65535 May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-28bf0e3d-cc2b-4512-aef8-caa735435e5a tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Request method failure captured: May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 146 May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikacUXH63Sz3J0mbWutTzcOgKBHkhCGDq3UbxJ9r8UqVdFQWEwjlAtTgh3gvVa5DBt5ONekgSiAkXFU9n6ZNMmHCeXxpWhQ6UECBFrFQ3kXuDMpzKy9seCujn51AFyjB6J0OxQrELnF4OClMpRgghjtYq1AHo08ZB9kN4vmMjqjx6yH8 May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d12d0d0de82449df98e14e99d89c819e May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:37:46.036741 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:37:46.038139 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:46.038139 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:46.038139 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d12d0d0de82449df98e14e99d89c819e May 28 04:37:46.038139 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:46.038139 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-82288089-project May 28 04:37:46.038139 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:37:46.038139 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:37:46.038139 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 82308388e0a94e12991aa082d4681060 May 28 04:37:46.038139 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089-project May 28 04:37:46.038139 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:37:46.038139 n-d-843700-1 devstack@n-api.service[126044]: {"security_group_rule": {"parent_group_id": "adba470c-2595-4b4a-a14f-0a49e96dd318", "ip_protocol": "tcp", "from_port": 22, "to_port": 1453789381}} May 28 04:37:46.038139 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:37:46.039181 n-d-843700-1 devstack@n-api.service[126044]: exception: Invalid port range 22:1453789381. Valid TCP ports should be between 1-65535 May 28 04:37:46.039181 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'adba470c-2595-4b4a-a14f-0a49e96dd318', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1453789381}}} May 28 04:37:46.039181 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:46.039181 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:46.039181 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 28 04:37:46.039181 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 28 04:37:46.039181 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 28 04:37:46.039181 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 28 04:37:46.039181 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 28 04:37:46.039181 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 28 04:37:46.039181 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule May 28 04:37:46.039181 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 28 04:37:46.039181 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1453789381. Valid TCP ports should be between 1-65535 May 28 04:37:46.039181 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:46.039181 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:46.039181 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:46.039181 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:46.039181 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:46.039181 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:46.040306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:46.040306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:46.040306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:37:46.040306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:37:46.040306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:46.040306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:46.040306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 28 04:37:46.040306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 28 04:37:46.040306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1453789381. Valid TCP ports should be between 1-65535 May 28 04:37:46.040306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:46.040306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:46.040306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:46.040306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:46.040306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:46.040306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:46.040306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:46.040306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:46.040306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1453789381. Valid TCP ports should be between 1-65535 May 28 04:37:46.040306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:46.042326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-28bf0e3d-cc2b-4512-aef8-caa735435e5a tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Returning 400 to user: Invalid port range 22:1453789381. Valid TCP ports should be between 1-65535 {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:46.043145 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-28bf0e3d-cc2b-4512-aef8-caa735435e5a tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.064108 May 28 04:37:46.048798 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 610/1103] 10.222.0.58 () {60 vars in 1194 bytes} [Sat May 28 04:37:45 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 04:37:46.049179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dad2269a-505b-4735-a715-b938f7abd4ef tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:46.049803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dad2269a-505b-4735-a715-b938f7abd4ef tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:46.057151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dad2269a-505b-4735-a715-b938f7abd4ef tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:46.057611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dad2269a-505b-4735-a715-b938f7abd4ef tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:46.058448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dad2269a-505b-4735-a715-b938f7abd4ef tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:46.058948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dad2269a-505b-4735-a715-b938f7abd4ef tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:46.200072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dad2269a-505b-4735-a715-b938f7abd4ef tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:46.208916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dad2269a-505b-4735-a715-b938f7abd4ef tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:46.210727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dad2269a-505b-4735-a715-b938f7abd4ef tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:46.211959 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dad2269a-505b-4735-a715-b938f7abd4ef tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.167321 May 28 04:37:46.212518 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 611/1104] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:46 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:46.218830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ceef9b22-92eb-4a19-8365-4d05631d49ed tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Action: 'create', calling method: .version_select at 0x7f7701dbb8b0>, body: {"security_group_rule": {"parent_group_id": "13a32ed4-4134-47e2-8fc3-0319257fe201", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:46.240560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:46.242621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG neutronclient.v2_0.client [None req-ceef9b22-92eb-4a19-8365-4d05631d49ed tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 13a32ed4-4134-47e2-8fc3-0319257fe201 does not exist", "detail": ""}} {{(pid=126044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:37:46.243154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.security_group_api [None req-ceef9b22-92eb-4a19-8365-4d05631d49ed tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Neutron security group 13a32ed4-4134-47e2-8fc3-0319257fe201 not found {{(pid=126044) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 04:37:46.243592 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-16974316-73c5-4b57-be01-c266b0332625 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d" status: 204 len: 0 microversion: 2.1 time: 0.297861 May 28 04:37:46.243701 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-ceef9b22-92eb-4a19-8365-4d05631d49ed tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] HTTP exception thrown: Security group 13a32ed4-4134-47e2-8fc3-0319257fe201 does not exist May 28 04:37:46.243701 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-1efb9f36-94de-470e-a9d0-7877925272a1'] May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ceef9b22-92eb-4a19-8365-4d05631d49ed tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Request method failure captured: May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 138 May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikacUXH63Sz3J0mbWutTzcOgKBHkhCGDq3UbxJ9r8UqVdFQWEwjlAtTgh3gvVa5DBt5ONekgSiAkXFU9n6ZNMmHCeXxpWhQ6UECBFrFQ3kXuDMpzKy9seCujn51AFyjB6J0OxQrELnF4OClMpRgghjtYq1AHo08ZB9kN4vmMjqjx6yH8 May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d12d0d0de82449df98e14e99d89c819e May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:37:46.245729 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:37:46.247141 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:46.247141 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:46.247141 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d12d0d0de82449df98e14e99d89c819e May 28 04:37:46.247141 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:46.247141 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-82288089-project May 28 04:37:46.247141 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:37:46.247141 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:37:46.247141 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 82308388e0a94e12991aa082d4681060 May 28 04:37:46.247141 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089-project May 28 04:37:46.247141 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:37:46.247141 n-d-843700-1 devstack@n-api.service[126044]: {"security_group_rule": {"parent_group_id": "13a32ed4-4134-47e2-8fc3-0319257fe201", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 28 04:37:46.247141 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:37:46.247141 n-d-843700-1 devstack@n-api.service[126044]: exception: Security group 13a32ed4-4134-47e2-8fc3-0319257fe201 does not exist May 28 04:37:46.247906 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-1efb9f36-94de-470e-a9d0-7877925272a1'] May 28 04:37:46.247906 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'body': {'security_group_rule': {'parent_group_id': '13a32ed4-4134-47e2-8fc3-0319257fe201', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 28 04:37:46.247906 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:46.247906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:46.247906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 04:37:46.247906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 04:37:46.247906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:46.247906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:46.247906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 04:37:46.247906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 04:37:46.247906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:46.247906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:46.247906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 04:37:46.247906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 04:37:46.247906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:46.247906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:46.247906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:37:46.247906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:37:46.248980 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:46.248980 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:46.248980 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:37:46.248980 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:37:46.248980 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:46.248980 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:46.248980 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:37:46.248980 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:37:46.248980 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:37:46.248980 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:37:46.248980 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 13a32ed4-4134-47e2-8fc3-0319257fe201 does not exist May 28 04:37:46.248980 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1efb9f36-94de-470e-a9d0-7877925272a1'] May 28 04:37:46.248980 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:46.248980 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:46.248980 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:46.248980 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:46.248980 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create May 28 04:37:46.248980 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( May 28 04:37:46.248980 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 04:37:46.252600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 04:37:46.252600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 13a32ed4-4134-47e2-8fc3-0319257fe201 does not exist May 28 04:37:46.252600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1efb9f36-94de-470e-a9d0-7877925272a1'] May 28 04:37:46.252600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:46.252600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:46.252600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:46.252600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:46.252600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:46.252600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:46.252600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:46.252600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:46.252600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:37:46.252600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:37:46.252600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:46.252600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:46.252600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create May 28 04:37:46.252600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 04:37:46.252600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 13a32ed4-4134-47e2-8fc3-0319257fe201 does not exist May 28 04:37:46.252600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1efb9f36-94de-470e-a9d0-7877925272a1'] May 28 04:37:46.252600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:46.255544 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:46.255544 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:46.255544 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:46.255544 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:46.255544 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:46.255544 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:46.255544 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:46.255544 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 13a32ed4-4134-47e2-8fc3-0319257fe201 does not exist May 28 04:37:46.255544 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1efb9f36-94de-470e-a9d0-7877925272a1'] May 28 04:37:46.255544 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:46.255544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ceef9b22-92eb-4a19-8365-4d05631d49ed tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Returning 404 to user: Security group 13a32ed4-4134-47e2-8fc3-0319257fe201 does not exist May 28 04:37:46.255544 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-1efb9f36-94de-470e-a9d0-7877925272a1'] {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:46.255544 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ceef9b22-92eb-4a19-8365-4d05631d49ed tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.033710 May 28 04:37:46.257376 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 494/1105] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:37:45 2022] DELETE /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:37:46.257540 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 612/1106] 10.222.0.58 () {60 vars in 1194 bytes} [Sat May 28 04:37:46 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:37:46.257728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-080a2153-7874-483e-9f7f-5e12bf739b2f req-be174314-175d-41c7-97fb-906d59ecbe95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6f58077-195c-4172-bacf-33dfd66cbe4d", "name": "network-vif-plugged", "status": "completed", "tag": "1582e229-4bed-4dd2-b97c-c1575e0fac14"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:46.257907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d7b3fe02-1115-4d9b-88fb-0ad2d815e315 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:46.257907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d7b3fe02-1115-4d9b-88fb-0ad2d815e315 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:46.264151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-080a2153-7874-483e-9f7f-5e12bf739b2f req-be174314-175d-41c7-97fb-906d59ecbe95 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:46.264540 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-080a2153-7874-483e-9f7f-5e12bf739b2f req-be174314-175d-41c7-97fb-906d59ecbe95 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:46.264692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7b3fe02-1115-4d9b-88fb-0ad2d815e315 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:46.265212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7b3fe02-1115-4d9b-88fb-0ad2d815e315 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:46.265983 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7b3fe02-1115-4d9b-88fb-0ad2d815e315 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:46.266420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7b3fe02-1115-4d9b-88fb-0ad2d815e315 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:46.277853 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-080a2153-7874-483e-9f7f-5e12bf739b2f req-be174314-175d-41c7-97fb-906d59ecbe95 service nova] Creating event network-vif-plugged:1582e229-4bed-4dd2-b97c-c1575e0fac14 for instance b6f58077-195c-4172-bacf-33dfd66cbe4d on n-h2-843700-1 May 28 04:37:46.283264 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-080a2153-7874-483e-9f7f-5e12bf739b2f req-be174314-175d-41c7-97fb-906d59ecbe95 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034336 May 28 04:37:46.283878 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 495/1107] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:46.288863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b6850566-aab2-4d6e-99c2-03ddb8519ac2 req-6662dfd0-3b86-465f-b6a9-f3a4cf9550c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cf16b71-8fa1-4433-9af1-869667b8f7e3", "tag": "4096714a-e49b-4b7e-b0ac-30da053e7819"}, {"name": "network-changed", "server_uuid": "7015ae59-a219-4897-97c4-ba6ead622287", "tag": "808893f1-2f18-4655-af40-220ed920c0ea"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:46.298998 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b6850566-aab2-4d6e-99c2-03ddb8519ac2 req-6662dfd0-3b86-465f-b6a9-f3a4cf9550c6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:46.299464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b6850566-aab2-4d6e-99c2-03ddb8519ac2 req-6662dfd0-3b86-465f-b6a9-f3a4cf9550c6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:46.312265 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b6850566-aab2-4d6e-99c2-03ddb8519ac2 req-6662dfd0-3b86-465f-b6a9-f3a4cf9550c6 service nova] Creating event network-changed:4096714a-e49b-4b7e-b0ac-30da053e7819 for instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 on n-h1-843700-1 May 28 04:37:46.312775 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b6850566-aab2-4d6e-99c2-03ddb8519ac2 req-6662dfd0-3b86-465f-b6a9-f3a4cf9550c6 service nova] Creating event network-changed:808893f1-2f18-4655-af40-220ed920c0ea for instance 7015ae59-a219-4897-97c4-ba6ead622287 on n-h2-843700-1 May 28 04:37:46.321065 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b6850566-aab2-4d6e-99c2-03ddb8519ac2 req-6662dfd0-3b86-465f-b6a9-f3a4cf9550c6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035892 May 28 04:37:46.321671 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 496/1108] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:46.329635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9b93c3ad-d633-4a56-847e-7d440ed7102e tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:46.330601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9b93c3ad-d633-4a56-847e-7d440ed7102e tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:46.338112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b93c3ad-d633-4a56-847e-7d440ed7102e tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:46.338709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b93c3ad-d633-4a56-847e-7d440ed7102e tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:46.339525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b93c3ad-d633-4a56-847e-7d440ed7102e tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:46.339975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b93c3ad-d633-4a56-847e-7d440ed7102e tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:46.437857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d7b3fe02-1115-4d9b-88fb-0ad2d815e315 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:46.450256 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d7b3fe02-1115-4d9b-88fb-0ad2d815e315 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287" status: 200 len: 1316 microversion: 2.1 time: 0.200725 May 28 04:37:46.450854 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 613/1109] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:46 2022] GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287 => generated 1316 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:46.458122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a3815d8d-8c18-4efa-9945-b52e969bbc45 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Calling method '.version_select at 0x7f7701ba21f0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:46.484350 n-d-843700-1 devstack@n-api.service[126044]: DEBUG neutronclient.v2_0.client [None req-a3815d8d-8c18-4efa-9945-b52e969bbc45 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule ca51b3d7-48b8-486a-8d0d-9a767ffc9e67 does not exist", "detail": ""}} {{(pid=126044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:37:46.485030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.security_group_api [None req-a3815d8d-8c18-4efa-9945-b52e969bbc45 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Neutron security group rule ca51b3d7-48b8-486a-8d0d-9a767ffc9e67 not found {{(pid=126044) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} May 28 04:37:46.485687 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-a3815d8d-8c18-4efa-9945-b52e969bbc45 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] HTTP exception thrown: Security group rule ca51b3d7-48b8-486a-8d0d-9a767ffc9e67 does not exist May 28 04:37:46.485687 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-113a93aa-b902-496b-83b1-b36442c884bd'] May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a3815d8d-8c18-4efa-9945-b52e969bbc45 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Request method failure captured: May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/os-security-group-rules/ca51b3d7-48b8-486a-8d0d-9a767ffc9e67 HTTP/1.1 May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikacUXH63Sz3J0mbWutTzcOgKBHkhCGDq3UbxJ9r8UqVdFQWEwjlAtTgh3gvVa5DBt5ONekgSiAkXFU9n6ZNMmHCeXxpWhQ6UECBFrFQ3kXuDMpzKy9seCujn51AFyjB6J0OxQrELnF4OClMpRgghjtYq1AHo08ZB9kN4vmMjqjx6yH8 May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d12d0d0de82449df98e14e99d89c819e May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:37:46.487738 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:37:46.489350 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d12d0d0de82449df98e14e99d89c819e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:46.489350 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:46.489350 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d12d0d0de82449df98e14e99d89c819e May 28 04:37:46.489350 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089 May 28 04:37:46.489350 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-82288089-project May 28 04:37:46.489350 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:37:46.489350 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:37:46.489350 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 82308388e0a94e12991aa082d4681060 May 28 04:37:46.489350 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-82288089-project May 28 04:37:46.489350 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:37:46.489350 n-d-843700-1 devstack@n-api.service[126044]: exception: Security group rule ca51b3d7-48b8-486a-8d0d-9a767ffc9e67 does not exist May 28 04:37:46.489350 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-113a93aa-b902-496b-83b1-b36442c884bd'] May 28 04:37:46.490156 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'ca51b3d7-48b8-486a-8d0d-9a767ffc9e67'} May 28 04:37:46.490156 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:46.490156 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:46.490156 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule May 28 04:37:46.490156 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( May 28 04:37:46.490156 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:46.490156 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:46.490156 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule May 28 04:37:46.490156 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), May 28 04:37:46.490156 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:46.490156 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:46.490156 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 04:37:46.490156 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 04:37:46.490156 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:46.490156 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:46.490156 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:37:46.490156 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:37:46.490156 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:46.490156 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:46.492566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:37:46.492566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:37:46.492566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:46.492566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:46.492566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:37:46.492566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:37:46.492566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:37:46.492566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:37:46.492566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule ca51b3d7-48b8-486a-8d0d-9a767ffc9e67 does not exist May 28 04:37:46.492566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-113a93aa-b902-496b-83b1-b36442c884bd'] May 28 04:37:46.492566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:46.492566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:46.492566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:46.492566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:46.492566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete May 28 04:37:46.492566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) May 28 04:37:46.492566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule May 28 04:37:46.492566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 04:37:46.493951 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule ca51b3d7-48b8-486a-8d0d-9a767ffc9e67 does not exist May 28 04:37:46.493951 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-113a93aa-b902-496b-83b1-b36442c884bd'] May 28 04:37:46.493951 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:46.493951 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:46.493951 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:46.493951 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:46.493951 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:46.493951 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:46.493951 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:46.493951 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:46.493951 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:37:46.493951 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:37:46.493951 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:46.493951 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:46.493951 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete May 28 04:37:46.493951 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 04:37:46.493951 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule ca51b3d7-48b8-486a-8d0d-9a767ffc9e67 does not exist May 28 04:37:46.493951 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-113a93aa-b902-496b-83b1-b36442c884bd'] May 28 04:37:46.493951 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:46.493951 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:46.495482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:46.495482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:46.495482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:46.495482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:46.495482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:46.495482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:46.495482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule ca51b3d7-48b8-486a-8d0d-9a767ffc9e67 does not exist May 28 04:37:46.495482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-113a93aa-b902-496b-83b1-b36442c884bd'] May 28 04:37:46.495482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:46.495482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a3815d8d-8c18-4efa-9945-b52e969bbc45 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Returning 404 to user: Security group rule ca51b3d7-48b8-486a-8d0d-9a767ffc9e67 does not exist May 28 04:37:46.495482 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-113a93aa-b902-496b-83b1-b36442c884bd'] {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:46.495482 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a3815d8d-8c18-4efa-9945-b52e969bbc45 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-group-rules/ca51b3d7-48b8-486a-8d0d-9a767ffc9e67" status: 404 len: 199 microversion: 2.1 time: 0.037246 May 28 04:37:46.495482 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 614/1110] 10.222.0.58 () {58 vars in 1286 bytes} [Sat May 28 04:37:46 2022] DELETE /compute/v2.1/os-security-group-rules/ca51b3d7-48b8-486a-8d0d-9a767ffc9e67 => generated 199 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:37:46.496558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-458b405e-f049-4c72-83f2-1dcb6dffa118 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:46.497022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-458b405e-f049-4c72-83f2-1dcb6dffa118 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:46.505595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-458b405e-f049-4c72-83f2-1dcb6dffa118 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:46.506291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-458b405e-f049-4c72-83f2-1dcb6dffa118 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:46.510601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-458b405e-f049-4c72-83f2-1dcb6dffa118 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:46.510601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-458b405e-f049-4c72-83f2-1dcb6dffa118 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:46.514149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9b93c3ad-d633-4a56-847e-7d440ed7102e tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:46.524910 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9b93c3ad-d633-4a56-847e-7d440ed7102e tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d" status: 200 len: 1478 microversion: 2.1 time: 0.201377 May 28 04:37:46.525861 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 497/1111] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:46 2022] GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d => generated 1478 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:46.539110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-121fb118-8399-4608-bccd-1d1ca1eaa16e tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Calling method '.version_select at 0x7f7701d93af0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:46.695991 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-458b405e-f049-4c72-83f2-1dcb6dffa118 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:46.706627 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-458b405e-f049-4c72-83f2-1dcb6dffa118 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.215817 May 28 04:37:46.709927 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 615/1112] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:46 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:46.713004 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2b76d2d0-0011-42fa-a38b-2322d2f39fc5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:46.713655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2b76d2d0-0011-42fa-a38b-2322d2f39fc5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:46.720403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b76d2d0-0011-42fa-a38b-2322d2f39fc5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:46.721254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b76d2d0-0011-42fa-a38b-2322d2f39fc5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:46.722787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b76d2d0-0011-42fa-a38b-2322d2f39fc5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:46.723429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b76d2d0-0011-42fa-a38b-2322d2f39fc5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:46.871326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2b76d2d0-0011-42fa-a38b-2322d2f39fc5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:46.880053 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2b76d2d0-0011-42fa-a38b-2322d2f39fc5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.171207 May 28 04:37:46.880632 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 616/1113] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:46 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:46.885063 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-01f3276a-de56-417c-b595-315ba8d69aa5 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:46.885775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-01f3276a-de56-417c-b595-315ba8d69aa5 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:46.892410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01f3276a-de56-417c-b595-315ba8d69aa5 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:46.892872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01f3276a-de56-417c-b595-315ba8d69aa5 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:46.893646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01f3276a-de56-417c-b595-315ba8d69aa5 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:46.894089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01f3276a-de56-417c-b595-315ba8d69aa5 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:46.894812 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-121fb118-8399-4608-bccd-1d1ca1eaa16e tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/adba470c-2595-4b4a-a14f-0a49e96dd318" status: 202 len: 0 microversion: 2.1 time: 0.367729 May 28 04:37:46.895429 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 498/1114] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:37:46 2022] DELETE /compute/v2.1/os-security-groups/adba470c-2595-4b4a-a14f-0a49e96dd318 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:37:46.905225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-052ee790-cef4-4dfe-8864-563e1ad447c4 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Calling method '.version_select at 0x7f7701ce2dc0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:47.075406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-01f3276a-de56-417c-b595-315ba8d69aa5 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:47.082526 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-01f3276a-de56-417c-b595-315ba8d69aa5 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d" status: 200 len: 1315 microversion: 2.1 time: 0.200881 May 28 04:37:47.092250 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 617/1115] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:46 2022] GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:47.230424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d3c181bc-6d71-4fb2-8c96-954e7c16e8fa tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:47.231079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d3c181bc-6d71-4fb2-8c96-954e7c16e8fa tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:47.231844 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-052ee790-cef4-4dfe-8864-563e1ad447c4 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/a41c895e-ff95-44dd-98ee-1d84b1b0906e" status: 202 len: 0 microversion: 2.1 time: 0.331818 May 28 04:37:47.232510 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 499/1116] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:37:46 2022] DELETE /compute/v2.1/os-security-groups/a41c895e-ff95-44dd-98ee-1d84b1b0906e => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:37:47.252301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3c181bc-6d71-4fb2-8c96-954e7c16e8fa tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:47.252301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3c181bc-6d71-4fb2-8c96-954e7c16e8fa tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:47.252865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7292d9dd-23bc-4270-a6f0-624ff696a140 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Calling method '.version_select at 0x7f7701ce2160>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:47.252974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3c181bc-6d71-4fb2-8c96-954e7c16e8fa tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:47.252974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3c181bc-6d71-4fb2-8c96-954e7c16e8fa tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:47.424901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d3c181bc-6d71-4fb2-8c96-954e7c16e8fa tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:47.434118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d3c181bc-6d71-4fb2-8c96-954e7c16e8fa tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:47.435757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d3c181bc-6d71-4fb2-8c96-954e7c16e8fa tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:47.436942 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d3c181bc-6d71-4fb2-8c96-954e7c16e8fa tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.210732 May 28 04:37:47.438635 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 618/1117] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:47 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:37:47.470650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c445630d-c5d9-4331-9d2f-9b78ba8f14cd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:47.471300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c445630d-c5d9-4331-9d2f-9b78ba8f14cd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:47.474247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:47.479212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c445630d-c5d9-4331-9d2f-9b78ba8f14cd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:47.479674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c445630d-c5d9-4331-9d2f-9b78ba8f14cd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:47.480459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c445630d-c5d9-4331-9d2f-9b78ba8f14cd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:47.480943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c445630d-c5d9-4331-9d2f-9b78ba8f14cd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:47.615293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c445630d-c5d9-4331-9d2f-9b78ba8f14cd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:47.622996 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c445630d-c5d9-4331-9d2f-9b78ba8f14cd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287" status: 200 len: 1316 microversion: 2.1 time: 0.156463 May 28 04:37:47.623584 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 619/1118] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:47 2022] GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:47.632420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b1282575-b659-45c4-84b7-4a843c3f9f09 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:47.632420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b1282575-b659-45c4-84b7-4a843c3f9f09 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:47.635819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1282575-b659-45c4-84b7-4a843c3f9f09 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:47.636273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1282575-b659-45c4-84b7-4a843c3f9f09 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:47.637045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1282575-b659-45c4-84b7-4a843c3f9f09 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:47.637544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1282575-b659-45c4-84b7-4a843c3f9f09 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:47.639932 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7292d9dd-23bc-4270-a6f0-624ff696a140 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/dc0edc84-5095-41a7-a106-0bf458835111" status: 202 len: 0 microversion: 2.1 time: 0.402541 May 28 04:37:47.644607 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 500/1119] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:37:47 2022] DELETE /compute/v2.1/os-security-groups/dc0edc84-5095-41a7-a106-0bf458835111 => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:37:47.650187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7871a196-eea1-4c0a-8a08-e4418f7fa071 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Calling method '.version_select at 0x7f7701d85af0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:47.854460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b1282575-b659-45c4-84b7-4a843c3f9f09 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:47.863282 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b1282575-b659-45c4-84b7-4a843c3f9f09 tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d" status: 200 len: 1478 microversion: 2.1 time: 0.238642 May 28 04:37:47.872738 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 620/1120] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:47 2022] GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d => generated 1478 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:47.872738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-55230383-edcd-449a-89d1-c30a6c436c3b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:47.872738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-55230383-edcd-449a-89d1-c30a6c436c3b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:47.875347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55230383-edcd-449a-89d1-c30a6c436c3b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:47.875806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55230383-edcd-449a-89d1-c30a6c436c3b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:47.876586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55230383-edcd-449a-89d1-c30a6c436c3b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:47.877028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55230383-edcd-449a-89d1-c30a6c436c3b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:48.055863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-55230383-edcd-449a-89d1-c30a6c436c3b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:48.063918 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-55230383-edcd-449a-89d1-c30a6c436c3b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.199053 May 28 04:37:48.064507 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 621/1121] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:47 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:48.069307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1ef1b531-59fc-4af6-9bc4-033a3ed92608 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:48.070320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1ef1b531-59fc-4af6-9bc4-033a3ed92608 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:48.076438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ef1b531-59fc-4af6-9bc4-033a3ed92608 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:48.078337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ef1b531-59fc-4af6-9bc4-033a3ed92608 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:48.079570 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ef1b531-59fc-4af6-9bc4-033a3ed92608 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:48.082577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ef1b531-59fc-4af6-9bc4-033a3ed92608 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:48.150491 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7871a196-eea1-4c0a-8a08-e4418f7fa071 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/dfc97d24-8f92-4295-8950-f7187f033e49" status: 202 len: 0 microversion: 2.1 time: 0.458607 May 28 04:37:48.150491 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 501/1122] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:37:47 2022] DELETE /compute/v2.1/os-security-groups/dfc97d24-8f92-4295-8950-f7187f033e49 => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:37:48.150491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-43be7def-e8a8-4ba9-b4e1-82168826937d tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:48.150491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-43be7def-e8a8-4ba9-b4e1-82168826937d tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:48.150491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43be7def-e8a8-4ba9-b4e1-82168826937d tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:48.152634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43be7def-e8a8-4ba9-b4e1-82168826937d tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:48.152634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43be7def-e8a8-4ba9-b4e1-82168826937d tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:48.152634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43be7def-e8a8-4ba9-b4e1-82168826937d tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:48.378301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1ef1b531-59fc-4af6-9bc4-033a3ed92608 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:48.392158 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1ef1b531-59fc-4af6-9bc4-033a3ed92608 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.326398 May 28 04:37:48.392772 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 622/1123] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:48 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:48.397927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-43be7def-e8a8-4ba9-b4e1-82168826937d tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:48.406818 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-43be7def-e8a8-4ba9-b4e1-82168826937d tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d" status: 200 len: 1315 microversion: 2.1 time: 0.297699 May 28 04:37:48.407442 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 502/1124] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:48 2022] GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:48.410977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e5d2de7e-1f93-4915-9e1c-84dc983cad61 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] Calling method '.version_select at 0x7f7701dfc670>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:48.456515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-685b03dd-e7da-42f8-a615-102f5698abde tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:48.457129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-685b03dd-e7da-42f8-a615-102f5698abde tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:48.463812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-685b03dd-e7da-42f8-a615-102f5698abde tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:48.464502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-685b03dd-e7da-42f8-a615-102f5698abde tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:48.465543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-685b03dd-e7da-42f8-a615-102f5698abde tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:48.466160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-685b03dd-e7da-42f8-a615-102f5698abde tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:48.729551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-685b03dd-e7da-42f8-a615-102f5698abde tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:48.738571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-685b03dd-e7da-42f8-a615-102f5698abde tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:48.740276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-685b03dd-e7da-42f8-a615-102f5698abde tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:48.741537 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-685b03dd-e7da-42f8-a615-102f5698abde tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.289658 May 28 04:37:48.742176 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 503/1125] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:48 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:37:48.755933 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-db3102fd-3a1d-471d-b591-284e2d759517 req-4b4be6bc-4713-4da8-a765-4dcea4597f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f59d61-d661-41f7-9475-5a35ec9e3f2d", "name": "network-vif-deleted", "tag": "a218fa08-86a8-47f1-a150-98d4861266c8"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:48.764272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-db3102fd-3a1d-471d-b591-284e2d759517 req-4b4be6bc-4713-4da8-a765-4dcea4597f1e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:48.764800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-db3102fd-3a1d-471d-b591-284e2d759517 req-4b4be6bc-4713-4da8-a765-4dcea4597f1e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:48.776601 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-db3102fd-3a1d-471d-b591-284e2d759517 req-4b4be6bc-4713-4da8-a765-4dcea4597f1e service nova] Creating event network-vif-deleted:a218fa08-86a8-47f1-a150-98d4861266c8 for instance e3f59d61-d661-41f7-9475-5a35ec9e3f2d on n-h1-843700-1 May 28 04:37:48.781631 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-db3102fd-3a1d-471d-b591-284e2d759517 req-4b4be6bc-4713-4da8-a765-4dcea4597f1e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029355 May 28 04:37:48.782227 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 504/1126] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:48.787445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4b1881e2-c3f5-4f8a-9e85-3264da826613 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:48.788154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4b1881e2-c3f5-4f8a-9e85-3264da826613 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:48.794467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b1881e2-c3f5-4f8a-9e85-3264da826613 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:48.794924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b1881e2-c3f5-4f8a-9e85-3264da826613 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:48.795832 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b1881e2-c3f5-4f8a-9e85-3264da826613 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:48.796237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b1881e2-c3f5-4f8a-9e85-3264da826613 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:48.871789 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e5d2de7e-1f93-4915-9e1c-84dc983cad61 tempest-SecurityGroupRulesNegativeTestJSON-82288089 tempest-SecurityGroupRulesNegativeTestJSON-82288089-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/42f03a8f-077b-45a1-a920-8ef39df1b4d1" status: 202 len: 0 microversion: 2.1 time: 0.477942 May 28 04:37:48.875377 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 623/1127] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:37:48 2022] DELETE /compute/v2.1/os-security-groups/42f03a8f-077b-45a1-a920-8ef39df1b4d1 => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:37:48.891896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-52a80ac7-9168-4173-960d-1a54a2b64a4c tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:48.891896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-52a80ac7-9168-4173-960d-1a54a2b64a4c tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:48.891896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52a80ac7-9168-4173-960d-1a54a2b64a4c tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:48.891896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52a80ac7-9168-4173-960d-1a54a2b64a4c tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:48.892320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52a80ac7-9168-4173-960d-1a54a2b64a4c tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:48.892320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52a80ac7-9168-4173-960d-1a54a2b64a4c tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:48.993286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-52a80ac7-9168-4173-960d-1a54a2b64a4c tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:49.004493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:49.011923 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-52a80ac7-9168-4173-960d-1a54a2b64a4c tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d" status: 200 len: 1436 microversion: 2.1 time: 0.129389 May 28 04:37:49.023730 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 624/1128] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:48 2022] GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d => generated 1436 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:49.057688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4b1881e2-c3f5-4f8a-9e85-3264da826613 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:49.071354 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4b1881e2-c3f5-4f8a-9e85-3264da826613 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287" status: 200 len: 1316 microversion: 2.1 time: 0.285192 May 28 04:37:49.073142 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 505/1129] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:48 2022] GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287 => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:49.085919 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-90706a90-45cc-44ba-8f05-04c24ab5c915 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:49.086624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-90706a90-45cc-44ba-8f05-04c24ab5c915 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:49.094442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90706a90-45cc-44ba-8f05-04c24ab5c915 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:49.095417 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90706a90-45cc-44ba-8f05-04c24ab5c915 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:49.096600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90706a90-45cc-44ba-8f05-04c24ab5c915 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:49.097264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90706a90-45cc-44ba-8f05-04c24ab5c915 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:49.257640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-90706a90-45cc-44ba-8f05-04c24ab5c915 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:49.266259 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-90706a90-45cc-44ba-8f05-04c24ab5c915 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.188677 May 28 04:37:49.266863 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 625/1130] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:49 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:49.414396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-157fdf41-a87b-49e1-a71f-78e465ddb83c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:49.414396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-157fdf41-a87b-49e1-a71f-78e465ddb83c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:49.423448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dabadc45-054f-4c91-86f0-8e04fa197787 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:49.424098 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dabadc45-054f-4c91-86f0-8e04fa197787 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:49.427434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-157fdf41-a87b-49e1-a71f-78e465ddb83c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:49.428174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-157fdf41-a87b-49e1-a71f-78e465ddb83c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:49.429086 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-157fdf41-a87b-49e1-a71f-78e465ddb83c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:49.429464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-157fdf41-a87b-49e1-a71f-78e465ddb83c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:49.432906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dabadc45-054f-4c91-86f0-8e04fa197787 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:49.433367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dabadc45-054f-4c91-86f0-8e04fa197787 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:49.434150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dabadc45-054f-4c91-86f0-8e04fa197787 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:49.434596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dabadc45-054f-4c91-86f0-8e04fa197787 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:49.667575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-157fdf41-a87b-49e1-a71f-78e465ddb83c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:49.670296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dabadc45-054f-4c91-86f0-8e04fa197787 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:49.676711 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-157fdf41-a87b-49e1-a71f-78e465ddb83c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.270753 May 28 04:37:49.677885 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 506/1131] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:49 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:49.689005 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dabadc45-054f-4c91-86f0-8e04fa197787 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d" status: 200 len: 1502 microversion: 2.1 time: 0.269970 May 28 04:37:49.689842 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 626/1132] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:49 2022] GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d => generated 1502 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:49.706315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bf6b3d29-ede8-4759-a658-245d67942813 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2069620213"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:49.706863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bf6b3d29-ede8-4759-a658-245d67942813 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:49.713929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf6b3d29-ede8-4759-a658-245d67942813 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:49.714595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf6b3d29-ede8-4759-a658-245d67942813 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:49.715654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf6b3d29-ede8-4759-a658-245d67942813 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:49.716295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf6b3d29-ede8-4759-a658-245d67942813 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:49.759607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3760aba7-3026-4f4a-a78e-f645032dc35f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:49.760408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3760aba7-3026-4f4a-a78e-f645032dc35f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:49.769634 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3760aba7-3026-4f4a-a78e-f645032dc35f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:49.770305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3760aba7-3026-4f4a-a78e-f645032dc35f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:49.771365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3760aba7-3026-4f4a-a78e-f645032dc35f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:49.771970 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3760aba7-3026-4f4a-a78e-f645032dc35f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:49.970182 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.network.security_group_api [None req-bf6b3d29-ede8-4759-a658-245d67942813 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Adding security group 055f69a7-97e2-49ab-8764-dd19e2c58784 to port 1582e229-4bed-4dd2-b97c-c1575e0fac14 May 28 04:37:50.088921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3760aba7-3026-4f4a-a78e-f645032dc35f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:50.100395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3760aba7-3026-4f4a-a78e-f645032dc35f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:50.101977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3760aba7-3026-4f4a-a78e-f645032dc35f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:50.103951 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3760aba7-3026-4f4a-a78e-f645032dc35f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.348207 May 28 04:37:50.119399 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 627/1133] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:49 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:50.121104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e3ada66c-28e9-4d9c-8c3c-a5bb78d6e8dc tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:50.121253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e3ada66c-28e9-4d9c-8c3c-a5bb78d6e8dc tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:50.134586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3ada66c-28e9-4d9c-8c3c-a5bb78d6e8dc tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:50.135360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3ada66c-28e9-4d9c-8c3c-a5bb78d6e8dc tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:50.136369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3ada66c-28e9-4d9c-8c3c-a5bb78d6e8dc tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:50.136972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3ada66c-28e9-4d9c-8c3c-a5bb78d6e8dc tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:50.198830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3ada66c-28e9-4d9c-8c3c-a5bb78d6e8dc tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:50.200283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3ada66c-28e9-4d9c-8c3c-a5bb78d6e8dc tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:50.200283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-e3ada66c-28e9-4d9c-8c3c-a5bb78d6e8dc tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lazy-loading 'fault' on Instance uuid e3f59d61-d661-41f7-9475-5a35ec9e3f2d {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:37:50.303596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e3ada66c-28e9-4d9c-8c3c-a5bb78d6e8dc tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75ff372428143249395a635a1766f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c84426a50904071bfa68e7529a40945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:50.311706 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e3ada66c-28e9-4d9c-8c3c-a5bb78d6e8dc tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d" status: 200 len: 1312 microversion: 2.1 time: 0.204949 May 28 04:37:50.312866 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 628/1134] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:50 2022] GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d => generated 1312 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:50.321855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-0a538830-7409-493c-b943-be398ae9f7c1 req-949f1a00-1650-4c3c-ac91-a2099203217b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7015ae59-a219-4897-97c4-ba6ead622287", "name": "network-vif-plugged", "status": "completed", "tag": "808893f1-2f18-4655-af40-220ed920c0ea"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:50.325960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-0a538830-7409-493c-b943-be398ae9f7c1 req-949f1a00-1650-4c3c-ac91-a2099203217b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:50.331796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-0a538830-7409-493c-b943-be398ae9f7c1 req-949f1a00-1650-4c3c-ac91-a2099203217b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:50.340311 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-0a538830-7409-493c-b943-be398ae9f7c1 req-949f1a00-1650-4c3c-ac91-a2099203217b service nova] Creating event network-vif-plugged:808893f1-2f18-4655-af40-220ed920c0ea for instance 7015ae59-a219-4897-97c4-ba6ead622287 on n-h2-843700-1 May 28 04:37:50.352525 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-0a538830-7409-493c-b943-be398ae9f7c1 req-949f1a00-1650-4c3c-ac91-a2099203217b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038102 May 28 04:37:50.357283 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 629/1135] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:50.379146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-26036be4-10ff-46a9-aa55-2850b4d25880 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:50.383686 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-26036be4-10ff-46a9-aa55-2850b4d25880 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:50.387521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26036be4-10ff-46a9-aa55-2850b4d25880 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:50.388045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26036be4-10ff-46a9-aa55-2850b4d25880 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:50.388901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26036be4-10ff-46a9-aa55-2850b4d25880 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:50.389367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26036be4-10ff-46a9-aa55-2850b4d25880 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:50.670454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-26036be4-10ff-46a9-aa55-2850b4d25880 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:50.681731 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-26036be4-10ff-46a9-aa55-2850b4d25880 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287" status: 200 len: 1316 microversion: 2.1 time: 0.323061 May 28 04:37:50.688771 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 630/1136] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:50 2022] GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287 => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:50.694669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-86832431-955f-4392-91e7-e7a66726ee41 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:50.695320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-86832431-955f-4392-91e7-e7a66726ee41 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:50.703017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-86832431-955f-4392-91e7-e7a66726ee41 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:50.703483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-86832431-955f-4392-91e7-e7a66726ee41 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:50.704265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-86832431-955f-4392-91e7-e7a66726ee41 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:50.704702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-86832431-955f-4392-91e7-e7a66726ee41 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:50.815059 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bf6b3d29-ede8-4759-a658-245d67942813 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "POST /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d/action" status: 202 len: 0 microversion: 2.1 time: 1.113324 May 28 04:37:50.816281 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 507/1137] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:37:49 2022] POST /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d/action => generated 0 bytes in 1115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:37:50.825609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-33b889c6-238e-4c40-9deb-8dfe4dbf2009 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:50.829574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-33b889c6-238e-4c40-9deb-8dfe4dbf2009 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:50.845534 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33b889c6-238e-4c40-9deb-8dfe4dbf2009 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:50.846361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33b889c6-238e-4c40-9deb-8dfe4dbf2009 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:50.847334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33b889c6-238e-4c40-9deb-8dfe4dbf2009 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:50.848097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33b889c6-238e-4c40-9deb-8dfe4dbf2009 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:50.949908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-86832431-955f-4392-91e7-e7a66726ee41 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:50.987635 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-86832431-955f-4392-91e7-e7a66726ee41 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.301833 May 28 04:37:50.991367 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 631/1138] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:50 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:51.006695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-7c1a2083-b93d-4947-919d-2d24500b8f5f req-5876324f-934e-4297-8214-73ea6dba824c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f64b8b-70f7-43c3-85df-66f0e9104617", "name": "network-vif-unplugged", "status": "completed", "tag": "e2fe83fa-067b-4eba-9577-f8b896d605be"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:51.037559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-33b889c6-238e-4c40-9deb-8dfe4dbf2009 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:51.041369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-7c1a2083-b93d-4947-919d-2d24500b8f5f req-5876324f-934e-4297-8214-73ea6dba824c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:51.042562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-7c1a2083-b93d-4947-919d-2d24500b8f5f req-5876324f-934e-4297-8214-73ea6dba824c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:51.047744 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-33b889c6-238e-4c40-9deb-8dfe4dbf2009 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.229536 May 28 04:37:51.057473 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 508/1139] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:50 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:51.065370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-4a3446c8-313d-4f23-9d6c-13935777eb68 req-01845d8d-a4b1-4fc7-9c15-3507f45f5976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6f58077-195c-4172-bacf-33dfd66cbe4d", "tag": "1582e229-4bed-4dd2-b97c-c1575e0fac14"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:51.071019 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-7c1a2083-b93d-4947-919d-2d24500b8f5f req-5876324f-934e-4297-8214-73ea6dba824c service nova] Creating event network-vif-unplugged:e2fe83fa-067b-4eba-9577-f8b896d605be for instance 67f64b8b-70f7-43c3-85df-66f0e9104617 on n-h2-843700-1 May 28 04:37:51.076262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4a3446c8-313d-4f23-9d6c-13935777eb68 req-01845d8d-a4b1-4fc7-9c15-3507f45f5976 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:51.076802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4a3446c8-313d-4f23-9d6c-13935777eb68 req-01845d8d-a4b1-4fc7-9c15-3507f45f5976 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:51.079394 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-7c1a2083-b93d-4947-919d-2d24500b8f5f req-5876324f-934e-4297-8214-73ea6dba824c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086313 May 28 04:37:51.080305 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 632/1140] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:51.086305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-66aa1f29-41b8-4a18-8107-d0ab1ff6577b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-915209342"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:51.087169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-66aa1f29-41b8-4a18-8107-d0ab1ff6577b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:51.094234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66aa1f29-41b8-4a18-8107-d0ab1ff6577b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:51.094879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66aa1f29-41b8-4a18-8107-d0ab1ff6577b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:51.095501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66aa1f29-41b8-4a18-8107-d0ab1ff6577b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:51.095662 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-4a3446c8-313d-4f23-9d6c-13935777eb68 req-01845d8d-a4b1-4fc7-9c15-3507f45f5976 service nova] Creating event network-changed:1582e229-4bed-4dd2-b97c-c1575e0fac14 for instance b6f58077-195c-4172-bacf-33dfd66cbe4d on n-h2-843700-1 May 28 04:37:51.095946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66aa1f29-41b8-4a18-8107-d0ab1ff6577b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:51.102301 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-4a3446c8-313d-4f23-9d6c-13935777eb68 req-01845d8d-a4b1-4fc7-9c15-3507f45f5976 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043000 May 28 04:37:51.103391 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 509/1141] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:51.143148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9f471b8e-b469-4cef-a63d-2ac9313fc9bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:51.143852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9f471b8e-b469-4cef-a63d-2ac9313fc9bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:51.153110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f471b8e-b469-4cef-a63d-2ac9313fc9bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:51.153563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f471b8e-b469-4cef-a63d-2ac9313fc9bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:51.154905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f471b8e-b469-4cef-a63d-2ac9313fc9bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:51.155398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f471b8e-b469-4cef-a63d-2ac9313fc9bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:51.298549 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.network.security_group_api [None req-66aa1f29-41b8-4a18-8107-d0ab1ff6577b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Adding security group 45ba2c97-9859-49b9-937a-6c414fdbd0fd to port 1582e229-4bed-4dd2-b97c-c1575e0fac14 May 28 04:37:51.384541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9f471b8e-b469-4cef-a63d-2ac9313fc9bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:51.401515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9f471b8e-b469-4cef-a63d-2ac9313fc9bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:51.403503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9f471b8e-b469-4cef-a63d-2ac9313fc9bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:51.404814 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9f471b8e-b469-4cef-a63d-2ac9313fc9bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.272641 May 28 04:37:51.406597 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 510/1142] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:51 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:51.411737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5255c176-0097-46a2-8320-f4f1d42a297d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:51.412626 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5255c176-0097-46a2-8320-f4f1d42a297d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] [instance: e3f59d61-d661-41f7-9475-5a35ec9e3f2d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:51.427713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5255c176-0097-46a2-8320-f4f1d42a297d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:51.428464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5255c176-0097-46a2-8320-f4f1d42a297d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:51.431316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5255c176-0097-46a2-8320-f4f1d42a297d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:51.432720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5255c176-0097-46a2-8320-f4f1d42a297d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:51.466871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:51.471390 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-5255c176-0097-46a2-8320-f4f1d42a297d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] HTTP exception thrown: Instance e3f59d61-d661-41f7-9475-5a35ec9e3f2d could not be found. May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5255c176-0097-46a2-8320-f4f1d42a297d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Request method failure captured: May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d HTTP/1.1 May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikabnXo-AJt712KG8MGyeyWVBWyntMYo1B421v_yrpzMaSgx-0QqwUQo8l5FD0s1vi9u7AjEsfVk056N60WHOU5MzT2jiWCvL_i4VRStj-k16sqjV2E8L9RabqkhtVBqUlMYYIqfPUU_b19Eq7aRyUSLXHSTYnGjA1K6kvhmDt-VryhI May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 7c84426a50904071bfa68e7529a40945 May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-793629218 May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:37:51.482196 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:37:51.484849 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7c84426a50904071bfa68e7529a40945"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7c84426a50904071bfa68e7529a40945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7c84426a50904071bfa68e7529a40945"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7c84426a50904071bfa68e7529a40945"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:51.484849 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersAdminNegativeTestJSON-793629218 May 28 04:37:51.484849 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 7c84426a50904071bfa68e7529a40945 May 28 04:37:51.484849 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-793629218 May 28 04:37:51.484849 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersAdminNegativeTestJSON-793629218-project May 28 04:37:51.484849 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:37:51.484849 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:37:51.484849 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: e75ff372428143249395a635a1766f9f May 28 04:37:51.484849 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersAdminNegativeTestJSON-793629218-project May 28 04:37:51.484849 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:37:51.484849 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance e3f59d61-d661-41f7-9475-5a35ec9e3f2d could not be found. May 28 04:37:51.484849 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'e3f59d61-d661-41f7-9475-5a35ec9e3f2d'} May 28 04:37:51.485752 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:51.485752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:51.485752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:37:51.485752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:37:51.485752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:37:51.485752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:37:51.485752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:37:51.485752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:37:51.485752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:37:51.485752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:37:51.485752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3f59d61-d661-41f7-9475-5a35ec9e3f2d could not be found. May 28 04:37:51.485752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:51.485752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:51.485752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:51.485752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:51.485752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:51.485752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:51.485752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:51.485752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:51.485752 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:51.487276 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:51.487276 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:37:51.487276 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:37:51.487276 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:37:51.487276 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:37:51.487276 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:37:51.487276 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:37:51.487276 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3f59d61-d661-41f7-9475-5a35ec9e3f2d could not be found. May 28 04:37:51.487276 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:51.487276 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:51.487276 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:51.487276 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:51.487276 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:51.487276 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:51.487276 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:51.487276 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:51.487276 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3f59d61-d661-41f7-9475-5a35ec9e3f2d could not be found. May 28 04:37:51.487276 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:51.489053 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5255c176-0097-46a2-8320-f4f1d42a297d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] Returning 404 to user: Instance e3f59d61-d661-41f7-9475-5a35ec9e3f2d could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:51.489053 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5255c176-0097-46a2-8320-f4f1d42a297d tempest-ServersAdminNegativeTestJSON-793629218 tempest-ServersAdminNegativeTestJSON-793629218-project] 10.222.0.58 "GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d" status: 404 len: 111 microversion: 2.1 time: 0.066635 May 28 04:37:51.489053 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 511/1143] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:51 2022] GET /compute/v2.1/servers/e3f59d61-d661-41f7-9475-5a35ec9e3f2d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:37:51.699782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fc65cd73-7b0e-4495-9eb6-70a025dd84e6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:51.700382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fc65cd73-7b0e-4495-9eb6-70a025dd84e6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:51.708046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc65cd73-7b0e-4495-9eb6-70a025dd84e6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:51.708891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc65cd73-7b0e-4495-9eb6-70a025dd84e6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:51.710074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc65cd73-7b0e-4495-9eb6-70a025dd84e6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:51.710662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc65cd73-7b0e-4495-9eb6-70a025dd84e6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:51.901130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fc65cd73-7b0e-4495-9eb6-70a025dd84e6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:51.909455 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fc65cd73-7b0e-4495-9eb6-70a025dd84e6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287" status: 200 len: 1316 microversion: 2.1 time: 0.214529 May 28 04:37:51.910223 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 512/1144] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:51 2022] GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:37:52.013121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ae61a8d5-debe-42be-8767-b2d7f9942edb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:52.014059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ae61a8d5-debe-42be-8767-b2d7f9942edb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:52.028580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae61a8d5-debe-42be-8767-b2d7f9942edb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:52.032658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae61a8d5-debe-42be-8767-b2d7f9942edb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:52.032658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae61a8d5-debe-42be-8767-b2d7f9942edb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:52.032658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae61a8d5-debe-42be-8767-b2d7f9942edb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:52.070210 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-66aa1f29-41b8-4a18-8107-d0ab1ff6577b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "POST /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d/action" status: 202 len: 0 microversion: 2.1 time: 0.988474 May 28 04:37:52.071392 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 633/1145] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:37:51 2022] POST /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d/action => generated 0 bytes in 990 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:37:52.076343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3da25035-3322-408c-8366-f742fb7a7fba tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:52.077162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3da25035-3322-408c-8366-f742fb7a7fba tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:52.089855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3da25035-3322-408c-8366-f742fb7a7fba tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:52.090299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3da25035-3322-408c-8366-f742fb7a7fba tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:52.091094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3da25035-3322-408c-8366-f742fb7a7fba tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:52.091556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3da25035-3322-408c-8366-f742fb7a7fba tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:52.335810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ae61a8d5-debe-42be-8767-b2d7f9942edb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:52.345819 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ae61a8d5-debe-42be-8767-b2d7f9942edb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.342939 May 28 04:37:52.349955 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 513/1146] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:52 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:52.354926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3f9e1cc4-cff0-4c44-af82-4f6523ba9b58 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:52.358116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3f9e1cc4-cff0-4c44-af82-4f6523ba9b58 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:52.370773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f9e1cc4-cff0-4c44-af82-4f6523ba9b58 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:52.373891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f9e1cc4-cff0-4c44-af82-4f6523ba9b58 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:52.374700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f9e1cc4-cff0-4c44-af82-4f6523ba9b58 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:52.377936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f9e1cc4-cff0-4c44-af82-4f6523ba9b58 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:52.399656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3da25035-3322-408c-8366-f742fb7a7fba tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:52.410396 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3da25035-3322-408c-8366-f742fb7a7fba tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.337404 May 28 04:37:52.411663 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 634/1147] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:52 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:52.435554 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ca170115-3694-4ddf-a50e-6e03fb30e8ac tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:52.436497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ca170115-3694-4ddf-a50e-6e03fb30e8ac tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:52.461200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca170115-3694-4ddf-a50e-6e03fb30e8ac tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:52.464188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca170115-3694-4ddf-a50e-6e03fb30e8ac tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:52.465180 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca170115-3694-4ddf-a50e-6e03fb30e8ac tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:52.469126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca170115-3694-4ddf-a50e-6e03fb30e8ac tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:52.708031 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3f9e1cc4-cff0-4c44-af82-4f6523ba9b58 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.356779 May 28 04:37:52.711439 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 514/1148] 10.222.0.58 () {58 vars in 1292 bytes} [Sat May 28 04:37:52 2022] GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d/os-security-groups => generated 1156 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:52.723353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b3021889-0dc4-4382-bba4-379750020865 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Action: 'create', calling method: .version_select at 0x7f7701c93550>, body: {"security_group": {"name": " tempest-securitygroup -1017840402 ", "description": "tempest-description-1984429021"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:52.807204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ca170115-3694-4ddf-a50e-6e03fb30e8ac tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:52.815714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ca170115-3694-4ddf-a50e-6e03fb30e8ac tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:52.817217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ca170115-3694-4ddf-a50e-6e03fb30e8ac tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:52.818373 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ca170115-3694-4ddf-a50e-6e03fb30e8ac tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.391074 May 28 04:37:52.818939 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 635/1149] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:52 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:52.930592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-52224a4b-0c8f-40aa-b632-466f47df7fc5 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:52.931749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-52224a4b-0c8f-40aa-b632-466f47df7fc5 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:52.948584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52224a4b-0c8f-40aa-b632-466f47df7fc5 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:52.950006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52224a4b-0c8f-40aa-b632-466f47df7fc5 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:52.950135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52224a4b-0c8f-40aa-b632-466f47df7fc5 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:52.950581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52224a4b-0c8f-40aa-b632-466f47df7fc5 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:53.127353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-52224a4b-0c8f-40aa-b632-466f47df7fc5 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:53.135756 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-52224a4b-0c8f-40aa-b632-466f47df7fc5 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287" status: 200 len: 1466 microversion: 2.1 time: 0.211696 May 28 04:37:53.136352 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 636/1150] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:52 2022] GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287 => generated 1466 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:53.143204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-64352e2a-ebbb-4dd3-a902-85223eb5b89d req-f9fcbbde-e475-4857-b22e-ec70c50bbaef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6f58077-195c-4172-bacf-33dfd66cbe4d", "tag": "1582e229-4bed-4dd2-b97c-c1575e0fac14"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:53.153431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-64352e2a-ebbb-4dd3-a902-85223eb5b89d req-f9fcbbde-e475-4857-b22e-ec70c50bbaef service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:53.153884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-64352e2a-ebbb-4dd3-a902-85223eb5b89d req-f9fcbbde-e475-4857-b22e-ec70c50bbaef service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:53.166093 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-64352e2a-ebbb-4dd3-a902-85223eb5b89d req-f9fcbbde-e475-4857-b22e-ec70c50bbaef service nova] Creating event network-changed:1582e229-4bed-4dd2-b97c-c1575e0fac14 for instance b6f58077-195c-4172-bacf-33dfd66cbe4d on n-h2-843700-1 May 28 04:37:53.171006 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-64352e2a-ebbb-4dd3-a902-85223eb5b89d req-f9fcbbde-e475-4857-b22e-ec70c50bbaef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032953 May 28 04:37:53.184358 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 637/1151] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:53.184358 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-ab1bc588-512a-4865-afb8-d10e0005285e req-506e9b10-5ab3-4884-b559-437066763937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f64b8b-70f7-43c3-85df-66f0e9104617", "tag": "e2fe83fa-067b-4eba-9577-f8b896d605be"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:53.185637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ab1bc588-512a-4865-afb8-d10e0005285e req-506e9b10-5ab3-4884-b559-437066763937 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:53.186075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ab1bc588-512a-4865-afb8-d10e0005285e req-506e9b10-5ab3-4884-b559-437066763937 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:53.197915 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-ab1bc588-512a-4865-afb8-d10e0005285e req-506e9b10-5ab3-4884-b559-437066763937 service nova] Creating event network-changed:e2fe83fa-067b-4eba-9577-f8b896d605be for instance 67f64b8b-70f7-43c3-85df-66f0e9104617 on n-h2-843700-1 May 28 04:37:53.203703 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-ab1bc588-512a-4865-afb8-d10e0005285e req-506e9b10-5ab3-4884-b559-437066763937 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029956 May 28 04:37:53.204468 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 638/1152] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:53.208753 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b3021889-0dc4-4382-bba4-379750020865 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.489110 May 28 04:37:53.217502 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 515/1153] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:37:52 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:53.224059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fca27e03-a9b1-4a31-8ee1-66a533046504 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f7701c931f0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:53.302510 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fca27e03-a9b1-4a31-8ee1-66a533046504 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/a82404d6-47e6-40b4-b418-2c9748234166" status: 200 len: 224 microversion: 2.1 time: 0.083587 May 28 04:37:53.303274 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 516/1154] 10.222.0.58 () {58 vars in 1268 bytes} [Sat May 28 04:37:53 2022] GET /compute/v2.1/os-security-groups/a82404d6-47e6-40b4-b418-2c9748234166 => generated 224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:53.320492 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0f7c0724-cc4a-4af5-b4bf-a7c624c9f5f4 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f7701ca6dc0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:53.503982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-affe9564-5072-4667-a8d2-c22c03a577e0 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:53.504685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-affe9564-5072-4667-a8d2-c22c03a577e0 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:53.512939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-affe9564-5072-4667-a8d2-c22c03a577e0 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:53.513707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-affe9564-5072-4667-a8d2-c22c03a577e0 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:53.514920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-affe9564-5072-4667-a8d2-c22c03a577e0 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:53.515545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-affe9564-5072-4667-a8d2-c22c03a577e0 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:53.604656 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0f7c0724-cc4a-4af5-b4bf-a7c624c9f5f4 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/a82404d6-47e6-40b4-b418-2c9748234166" status: 202 len: 0 microversion: 2.1 time: 0.293107 May 28 04:37:53.606610 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 517/1155] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:37:53 2022] DELETE /compute/v2.1/os-security-groups/a82404d6-47e6-40b4-b418-2c9748234166 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:37:53.613997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dc1bcff7-850f-471e-9b53-37657f815a2e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:53.615358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dc1bcff7-850f-471e-9b53-37657f815a2e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:53.623423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:53.632310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc1bcff7-850f-471e-9b53-37657f815a2e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:53.633973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc1bcff7-850f-471e-9b53-37657f815a2e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:53.635261 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc1bcff7-850f-471e-9b53-37657f815a2e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:53.636365 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc1bcff7-850f-471e-9b53-37657f815a2e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:53.866258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dc1bcff7-850f-471e-9b53-37657f815a2e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:53.874059 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dc1bcff7-850f-471e-9b53-37657f815a2e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.266096 May 28 04:37:53.874722 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 518/1156] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:53 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:53.879620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a68ce73e-5713-430a-9cc7-4f40160a2226 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:53.880424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a68ce73e-5713-430a-9cc7-4f40160a2226 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:53.887288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a68ce73e-5713-430a-9cc7-4f40160a2226 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:53.892781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a68ce73e-5713-430a-9cc7-4f40160a2226 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:53.892781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a68ce73e-5713-430a-9cc7-4f40160a2226 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:53.892781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a68ce73e-5713-430a-9cc7-4f40160a2226 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:53.997759 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-affe9564-5072-4667-a8d2-c22c03a577e0 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287" status: 200 len: 1617 microversion: 2.1 time: 0.791936 May 28 04:37:53.999659 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 639/1157] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:53 2022] GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287 => generated 1617 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:54.007537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7820f7d7-6d45-4e07-a1fc-d2f8a252cbef tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f7701b84ca0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:54.296578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG neutronclient.v2_0.client [None req-7820f7d7-6d45-4e07-a1fc-d2f8a252cbef tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a82404d6-47e6-40b4-b418-2c9748234166 does not exist", "detail": ""}} {{(pid=126044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:37:54.297279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.security_group_api [None req-7820f7d7-6d45-4e07-a1fc-d2f8a252cbef tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Neutron security group a82404d6-47e6-40b4-b418-2c9748234166 not found {{(pid=126044) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 04:37:54.297987 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-7820f7d7-6d45-4e07-a1fc-d2f8a252cbef tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] HTTP exception thrown: Security group a82404d6-47e6-40b4-b418-2c9748234166 does not exist May 28 04:37:54.297987 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-3262deb8-7145-4ae5-893e-cc8c4a49ddf7'] May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7820f7d7-6d45-4e07-a1fc-d2f8a252cbef tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Request method failure captured: May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-security-groups/a82404d6-47e6-40b4-b418-2c9748234166 HTTP/1.1 May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikacH3mPNflVe6LL6bg9_A8pzAabYS23jRSixTFQfefIS8h0xsq17YlHMuAQcMYGioTiJUzGf5HQ_8pUjy0pwazx5CoRz1nqfCdunQxIHFcBiGin6OUttjeU6RRcr_kTDInnBBWYYOIl_RyOz0kb25BPKfu6ZYOhMuIQdqMRnqceoVqo May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:37:54.300165 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:37:54.301503 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:54.301503 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:37:54.301503 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:37:54.301503 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:37:54.301503 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:37:54.301503 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:37:54.301503 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:37:54.301503 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 54a0d2f3e0184d14ae4050562e236581 May 28 04:37:54.301503 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:37:54.301503 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:37:54.301503 n-d-843700-1 devstack@n-api.service[126044]: exception: Security group a82404d6-47e6-40b4-b418-2c9748234166 does not exist May 28 04:37:54.301503 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-3262deb8-7145-4ae5-893e-cc8c4a49ddf7'] May 28 04:37:54.301503 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'a82404d6-47e6-40b4-b418-2c9748234166'} May 28 04:37:54.302313 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:54.302313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:54.302313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 04:37:54.302313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 04:37:54.302313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:54.302313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:54.302313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 04:37:54.302313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 04:37:54.302313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:54.302313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:54.302313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 04:37:54.302313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 04:37:54.302313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:54.302313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:54.302313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:37:54.302313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:37:54.302313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:54.302313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:54.302313 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:37:54.304267 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:37:54.304267 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:54.304267 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:54.304267 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:37:54.304267 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:37:54.304267 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:37:54.304267 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:37:54.304267 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a82404d6-47e6-40b4-b418-2c9748234166 does not exist May 28 04:37:54.304267 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3262deb8-7145-4ae5-893e-cc8c4a49ddf7'] May 28 04:37:54.304267 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:54.304267 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:54.304267 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:54.304267 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:54.304267 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 28 04:37:54.304267 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 04:37:54.304267 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 04:37:54.304267 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 04:37:54.304267 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a82404d6-47e6-40b4-b418-2c9748234166 does not exist May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3262deb8-7145-4ae5-893e-cc8c4a49ddf7'] May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a82404d6-47e6-40b4-b418-2c9748234166 does not exist May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3262deb8-7145-4ae5-893e-cc8c4a49ddf7'] May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:54.305365 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:54.306605 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:54.306605 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:54.306605 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:54.306605 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:54.306605 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a82404d6-47e6-40b4-b418-2c9748234166 does not exist May 28 04:37:54.306605 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3262deb8-7145-4ae5-893e-cc8c4a49ddf7'] May 28 04:37:54.306605 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:54.306605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7820f7d7-6d45-4e07-a1fc-d2f8a252cbef tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Returning 404 to user: Security group a82404d6-47e6-40b4-b418-2c9748234166 does not exist May 28 04:37:54.306605 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-3262deb8-7145-4ae5-893e-cc8c4a49ddf7'] {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:54.306605 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7820f7d7-6d45-4e07-a1fc-d2f8a252cbef tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/a82404d6-47e6-40b4-b418-2c9748234166" status: 404 len: 194 microversion: 2.1 time: 0.300713 May 28 04:37:54.306605 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 640/1158] 10.222.0.58 () {58 vars in 1268 bytes} [Sat May 28 04:37:53 2022] GET /compute/v2.1/os-security-groups/a82404d6-47e6-40b4-b418-2c9748234166 => generated 194 bytes in 302 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:37:54.312568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-41fdfbaf-417b-4f80-85db-84ea39e4081e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:54.313521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-41fdfbaf-417b-4f80-85db-84ea39e4081e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:54.322518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41fdfbaf-417b-4f80-85db-84ea39e4081e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:54.323024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41fdfbaf-417b-4f80-85db-84ea39e4081e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:54.328229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41fdfbaf-417b-4f80-85db-84ea39e4081e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:54.328229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41fdfbaf-417b-4f80-85db-84ea39e4081e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:54.335781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a68ce73e-5713-430a-9cc7-4f40160a2226 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:54.346731 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a68ce73e-5713-430a-9cc7-4f40160a2226 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.469536 May 28 04:37:54.348337 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 519/1159] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:53 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:54.356059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4a7c2d42-acfa-4e3b-bb3b-30a0c4041c7e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Action: 'create', calling method: .version_select at 0x7f7701c6cdc0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1290589518", "policies": ["affinity"]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:54.379693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-4a7c2d42-acfa-4e3b-bb3b-30a0c4041c7e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for project e7a5b721a538475cbac9c95c61647753. Resources: {'server_groups'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:37:54.388160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-4a7c2d42-acfa-4e3b-bb3b-30a0c4041c7e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for user d398d45627fc4d33bc9a736ddf8f9215 and project e7a5b721a538475cbac9c95c61647753. Resources: {'server_groups'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:37:54.465415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-41fdfbaf-417b-4f80-85db-84ea39e4081e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:54.473440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-41fdfbaf-417b-4f80-85db-84ea39e4081e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:54.474960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-41fdfbaf-417b-4f80-85db-84ea39e4081e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:54.476173 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-41fdfbaf-417b-4f80-85db-84ea39e4081e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.172962 May 28 04:37:54.476737 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 641/1160] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:54 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:54.481149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-90ef3711-3dcf-4e27-814d-c712e8a0be23 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Action: 'create', calling method: .version_select at 0x7f7701b3f040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1657572815", "description": "tempest-description-1561724361"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:54.572315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-4a7c2d42-acfa-4e3b-bb3b-30a0c4041c7e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for project e7a5b721a538475cbac9c95c61647753. Resources: {'server_groups'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:37:54.598203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-4a7c2d42-acfa-4e3b-bb3b-30a0c4041c7e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for user d398d45627fc4d33bc9a736ddf8f9215 and project e7a5b721a538475cbac9c95c61647753. Resources: {'server_groups'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:37:54.619811 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4a7c2d42-acfa-4e3b-bb3b-30a0c4041c7e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.269500 May 28 04:37:54.631879 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 520/1161] 10.222.0.58 () {60 vars in 1173 bytes} [Sat May 28 04:37:54 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:54.721539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1003639411", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "55040dbc-5a65-4d89-abb3-32604ea8386a"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:54.782476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] validate_networks() for None {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:37:54.840146 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-90ef3711-3dcf-4e27-814d-c712e8a0be23 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.361987 May 28 04:37:54.841661 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 642/1162] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:37:54 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:54.852668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9c6478f4-f38b-40e8-91bf-4a27a7a5b53a tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Action: 'create', calling method: .version_select at 0x7f7701ba25e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-130732785", "description": "tempest-description-390721155"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:55.059699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:37:55.060887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:37:55.061666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:37:55.063333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:37:55.064035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:37:55.127793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:55.128410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:55.129298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:55.129831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:55.148481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for project e7a5b721a538475cbac9c95c61647753. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:37:55.153345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for user d398d45627fc4d33bc9a736ddf8f9215 and project e7a5b721a538475cbac9c95c61647753. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:37:55.165728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Going to run 2 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:37:55.168159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 95514daa-06bd-483c-bd44-b9a7aa12b51c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:37:55.315999 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=126043) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} May 28 04:37:55.337691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for project e7a5b721a538475cbac9c95c61647753. Resources: {'server_group_members'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:37:55.342859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for user d398d45627fc4d33bc9a736ddf8f9215 and project e7a5b721a538475cbac9c95c61647753. Resources: {'server_group_members'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:37:55.356845 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9c6478f4-f38b-40e8-91bf-4a27a7a5b53a tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.508458 May 28 04:37:55.357924 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 643/1163] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:37:54 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:55.366450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8222209d-f887-47b8-937e-ec5430bb448f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:55.367380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8222209d-f887-47b8-937e-ec5430bb448f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:55.374267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8222209d-f887-47b8-937e-ec5430bb448f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:55.374641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8222209d-f887-47b8-937e-ec5430bb448f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:55.375610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8222209d-f887-47b8-937e-ec5430bb448f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:55.376054 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8222209d-f887-47b8-937e-ec5430bb448f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:55.477306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for project e7a5b721a538475cbac9c95c61647753. Resources: {'server_group_members'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:37:55.488537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for user d398d45627fc4d33bc9a736ddf8f9215 and project e7a5b721a538475cbac9c95c61647753. Resources: {'server_group_members'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:37:55.508030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 565a3cb7-ae9f-41af-8e36-43b39b2e43e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=95514daa-06bd-483c-bd44-b9a7aa12b51c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:37:55.616003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8222209d-f887-47b8-937e-ec5430bb448f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:55.623956 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8222209d-f887-47b8-937e-ec5430bb448f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.264034 May 28 04:37:55.635125 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 644/1164] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:55 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:55.643307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-155f7fd6-db80-41ab-a8ae-c43a65bea3f3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:55.644298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-155f7fd6-db80-41ab-a8ae-c43a65bea3f3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:55.652365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-155f7fd6-db80-41ab-a8ae-c43a65bea3f3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:55.654047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-155f7fd6-db80-41ab-a8ae-c43a65bea3f3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:55.655053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-155f7fd6-db80-41ab-a8ae-c43a65bea3f3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:55.655593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-155f7fd6-db80-41ab-a8ae-c43a65bea3f3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:55.691595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for project e7a5b721a538475cbac9c95c61647753. Resources: {'server_group_members'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:37:55.696496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for user d398d45627fc4d33bc9a736ddf8f9215 and project e7a5b721a538475cbac9c95c61647753. Resources: {'server_group_members'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:37:55.813999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-155f7fd6-db80-41ab-a8ae-c43a65bea3f3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:55.822230 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-155f7fd6-db80-41ab-a8ae-c43a65bea3f3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.184842 May 28 04:37:55.823291 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 645/1165] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:55 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:55.832323 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8ec88d1b-2ec4-4055-8510-e6fe7b66864f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Action: 'create', calling method: .version_select at 0x7f7701b3fdc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2011798857", "description": "tempest-description-862473248"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:55.863116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for project e7a5b721a538475cbac9c95c61647753. Resources: {'server_group_members'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:37:55.870327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for user d398d45627fc4d33bc9a736ddf8f9215 and project e7a5b721a538475cbac9c95c61647753. Resources: {'server_group_members'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:37:55.881730 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:55.915532 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0843dad0-9b61-439b-b91b-03745ea076b9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.196531 May 28 04:37:55.916459 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 521/1166] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:37:54 2022] POST /compute/v2.1/servers => generated 32 bytes in 1200 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) May 28 04:37:55.924736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8811f6c7-ae3c-447d-aa4e-5ef8bd47b81f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:55.925661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8811f6c7-ae3c-447d-aa4e-5ef8bd47b81f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:55.935512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8811f6c7-ae3c-447d-aa4e-5ef8bd47b81f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:55.936185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8811f6c7-ae3c-447d-aa4e-5ef8bd47b81f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:55.938148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8811f6c7-ae3c-447d-aa4e-5ef8bd47b81f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:55.941531 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8811f6c7-ae3c-447d-aa4e-5ef8bd47b81f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:56.173337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8811f6c7-ae3c-447d-aa4e-5ef8bd47b81f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:56.183235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8811f6c7-ae3c-447d-aa4e-5ef8bd47b81f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:56.184819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8811f6c7-ae3c-447d-aa4e-5ef8bd47b81f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:56.186004 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8811f6c7-ae3c-447d-aa4e-5ef8bd47b81f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.268355 May 28 04:37:56.186566 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 522/1167] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:55 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:56.204932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ff8a9772-b2a2-445d-b511-1ae75a0d8d28 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:56.208811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ff8a9772-b2a2-445d-b511-1ae75a0d8d28 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:56.210017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ff8a9772-b2a2-445d-b511-1ae75a0d8d28 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Searching by: {'deleted': False, 'project_id': 'e7a5b721a538475cbac9c95c61647753'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:37:56.229593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff8a9772-b2a2-445d-b511-1ae75a0d8d28 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:56.230056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff8a9772-b2a2-445d-b511-1ae75a0d8d28 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:56.231270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff8a9772-b2a2-445d-b511-1ae75a0d8d28 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:56.231724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff8a9772-b2a2-445d-b511-1ae75a0d8d28 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:56.343453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-ff8a9772-b2a2-445d-b511-1ae75a0d8d28 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:37:56.368239 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8ec88d1b-2ec4-4055-8510-e6fe7b66864f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.542888 May 28 04:37:56.369111 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 646/1168] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:37:55 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:56.444115 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ff8a9772-b2a2-445d-b511-1ae75a0d8d28 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.244584 May 28 04:37:56.444723 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 523/1169] 10.222.0.58 () {58 vars in 1124 bytes} [Sat May 28 04:37:56 2022] GET /compute/v2.1/servers => generated 1003 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:56.449289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-86df90a8-9a15-42cb-83b8-9011ee2ed752 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f7701df5ca0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:56.508484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-53129b16-eb3d-42f0-ba93-7e01bce38b28 tempest-FlavorsV2NegativeTest-1066154169 tempest-FlavorsV2NegativeTest-1066154169-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:56.517448 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-53129b16-eb3d-42f0-ba93-7e01bce38b28 tempest-FlavorsV2NegativeTest-1066154169 tempest-FlavorsV2NegativeTest-1066154169-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.147103 May 28 04:37:56.542883 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 647/1170] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:37:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:37:56.549649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-12dcfc8c-8a51-4073-9eb1-ec80bc14fd8c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:56.550097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-12dcfc8c-8a51-4073-9eb1-ec80bc14fd8c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 565a3cb7-ae9f-41af-8e36-43b39b2e43e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:56.623885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-12dcfc8c-8a51-4073-9eb1-ec80bc14fd8c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:56.634099 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-12dcfc8c-8a51-4073-9eb1-ec80bc14fd8c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8" status: 200 len: 1219 microversion: 2.1 time: 0.089424 May 28 04:37:56.644094 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 648/1171] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:56 2022] GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:56.644094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0f408ab4-2e6a-447f-83df-6ca25846afcf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:56.644094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0f408ab4-2e6a-447f-83df-6ca25846afcf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:56.668660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f408ab4-2e6a-447f-83df-6ca25846afcf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:56.669212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f408ab4-2e6a-447f-83df-6ca25846afcf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:56.670026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f408ab4-2e6a-447f-83df-6ca25846afcf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:56.670527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f408ab4-2e6a-447f-83df-6ca25846afcf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:56.848527 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-86df90a8-9a15-42cb-83b8-9011ee2ed752 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.402644 May 28 04:37:56.849142 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 524/1172] 10.222.0.58 () {58 vars in 1157 bytes} [Sat May 28 04:37:56 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:56.861571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0e2b710d-92a7-432a-9fd5-79a50707322a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:56.862438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0e2b710d-92a7-432a-9fd5-79a50707322a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:56.873284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e2b710d-92a7-432a-9fd5-79a50707322a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:56.873957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e2b710d-92a7-432a-9fd5-79a50707322a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:56.875652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e2b710d-92a7-432a-9fd5-79a50707322a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:56.876916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e2b710d-92a7-432a-9fd5-79a50707322a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:56.906142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0f408ab4-2e6a-447f-83df-6ca25846afcf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:56.916648 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0f408ab4-2e6a-447f-83df-6ca25846afcf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.279541 May 28 04:37:56.917820 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 649/1173] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:56 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:37:56.922919 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-40d67974-1ed5-4dbf-a5d6-e981eccf11e9 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f7701b3f9d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:57.153212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0e2b710d-92a7-432a-9fd5-79a50707322a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:57.165380 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0e2b710d-92a7-432a-9fd5-79a50707322a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.307673 May 28 04:37:57.166634 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 525/1174] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:56 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:57.205633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0bfacc02-5ac2-4125-a207-fbd07b887589 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:57.206451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0bfacc02-5ac2-4125-a207-fbd07b887589 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:57.214427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0bfacc02-5ac2-4125-a207-fbd07b887589 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:57.215344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0bfacc02-5ac2-4125-a207-fbd07b887589 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:57.217855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0bfacc02-5ac2-4125-a207-fbd07b887589 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:57.218652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0bfacc02-5ac2-4125-a207-fbd07b887589 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:57.358441 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-40d67974-1ed5-4dbf-a5d6-e981eccf11e9 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d" status: 202 len: 0 microversion: 2.1 time: 0.439264 May 28 04:37:57.359821 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 650/1175] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:37:56 2022] DELETE /compute/v2.1/os-security-groups/4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:37:57.368047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6c17041c-514a-4214-8723-4b479b0faeec tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f7701b3f160>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:57.392391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0bfacc02-5ac2-4125-a207-fbd07b887589 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:57.407654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0bfacc02-5ac2-4125-a207-fbd07b887589 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:57.411116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG neutronclient.v2_0.client [None req-6c17041c-514a-4214-8723-4b479b0faeec tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d does not exist", "detail": ""}} {{(pid=126044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:37:57.412789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.security_group_api [None req-6c17041c-514a-4214-8723-4b479b0faeec tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Neutron security group 4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d not found {{(pid=126044) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 04:37:57.413506 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-6c17041c-514a-4214-8723-4b479b0faeec tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] HTTP exception thrown: Security group 4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d does not exist May 28 04:37:57.413506 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-4a639c3c-8648-4ec1-b46f-d3740f619525'] May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6c17041c-514a-4214-8723-4b479b0faeec tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Request method failure captured: May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-security-groups/4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d HTTP/1.1 May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikacH3mPNflVe6LL6bg9_A8pzAabYS23jRSixTFQfefIS8h0xsq17YlHMuAQcMYGioTiJUzGf5HQ_8pUjy0pwazx5CoRz1nqfCdunQxIHFcBiGin6OUttjeU6RRcr_kTDInnBBWYYOIl_RyOz0kb25BPKfu6ZYOhMuIQdqMRnqceoVqo May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:37:57.415635 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:37:57.417007 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:57.417007 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:37:57.417007 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:37:57.417007 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:37:57.417007 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:37:57.417007 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:37:57.417007 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:37:57.417007 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 54a0d2f3e0184d14ae4050562e236581 May 28 04:37:57.417007 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:37:57.417007 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:37:57.417007 n-d-843700-1 devstack@n-api.service[126044]: exception: Security group 4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d does not exist May 28 04:37:57.417007 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-4a639c3c-8648-4ec1-b46f-d3740f619525'] May 28 04:37:57.417007 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d'} May 28 04:37:57.417855 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:57.417855 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:57.417855 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 04:37:57.417855 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 04:37:57.417855 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:57.417855 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:57.417855 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 04:37:57.417855 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 04:37:57.417855 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:57.417855 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:57.417855 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 04:37:57.417855 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 04:37:57.417855 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:57.417855 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:57.417855 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:37:57.417855 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:37:57.417855 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:57.417855 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:57.417855 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:37:57.431586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:37:57.431586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:57.431586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:57.431586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:37:57.431586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:37:57.431586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:37:57.431586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:37:57.431586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d does not exist May 28 04:37:57.431586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a639c3c-8648-4ec1-b46f-d3740f619525'] May 28 04:37:57.431586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:57.431586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:57.431586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:57.431586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:57.431586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 28 04:37:57.431586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 04:37:57.431586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 04:37:57.431586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 04:37:57.431586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d does not exist May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a639c3c-8648-4ec1-b46f-d3740f619525'] May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d does not exist May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a639c3c-8648-4ec1-b46f-d3740f619525'] May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:57.432723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:57.434005 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:57.434005 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:57.434005 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:57.434005 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:57.434005 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d does not exist May 28 04:37:57.434005 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a639c3c-8648-4ec1-b46f-d3740f619525'] May 28 04:37:57.434005 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:57.434005 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6c17041c-514a-4214-8723-4b479b0faeec tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Returning 404 to user: Security group 4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d does not exist May 28 04:37:57.434005 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-4a639c3c-8648-4ec1-b46f-d3740f619525'] {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:57.434005 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6c17041c-514a-4214-8723-4b479b0faeec tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d" status: 404 len: 194 microversion: 2.1 time: 0.052846 May 28 04:37:57.434615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0bfacc02-5ac2-4125-a207-fbd07b887589 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:57.434718 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 651/1176] 10.222.0.58 () {58 vars in 1268 bytes} [Sat May 28 04:37:57 2022] GET /compute/v2.1/os-security-groups/4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:37:57.434795 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0bfacc02-5ac2-4125-a207-fbd07b887589 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.220205 May 28 04:37:57.434795 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 526/1177] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:57 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:37:57.436165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c0486822-b103-4b0b-a088-fb4432d469ec tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f7701b4e8b0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:57.651811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-951e93fe-fd78-4bba-9318-8587c0365f66 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:57.652437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-951e93fe-fd78-4bba-9318-8587c0365f66 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 565a3cb7-ae9f-41af-8e36-43b39b2e43e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:57.720513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-951e93fe-fd78-4bba-9318-8587c0365f66 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:57.729996 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-951e93fe-fd78-4bba-9318-8587c0365f66 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8" status: 200 len: 1219 microversion: 2.1 time: 0.081498 May 28 04:37:57.730210 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c0486822-b103-4b0b-a088-fb4432d469ec tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/2a362a30-6bfd-4338-bfa5-c739a893df16" status: 202 len: 0 microversion: 2.1 time: 0.301403 May 28 04:37:57.730524 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 527/1178] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:57 2022] GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:37:57.739468 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 652/1179] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:37:57 2022] DELETE /compute/v2.1/os-security-groups/2a362a30-6bfd-4338-bfa5-c739a893df16 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:37:57.748060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-346f08b4-17ea-4ee2-8a0c-636ca921b85c tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f7701b47b80>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:57.773311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fe473714-8ab2-45e4-ac71-c159efb2d262 tempest-FlavorsV2NegativeTest-1066154169 tempest-FlavorsV2NegativeTest-1066154169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1391447956", "imageRef": "cdbecf20-39f9-4024-bd9a-cd17b56d3a0a", "flavorRef": "452"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:57.826388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG neutronclient.v2_0.client [None req-346f08b4-17ea-4ee2-8a0c-636ca921b85c tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2a362a30-6bfd-4338-bfa5-c739a893df16 does not exist", "detail": ""}} {{(pid=126043) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:37:57.828643 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.security_group_api [None req-346f08b4-17ea-4ee2-8a0c-636ca921b85c tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Neutron security group 2a362a30-6bfd-4338-bfa5-c739a893df16 not found {{(pid=126043) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 04:37:57.834406 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-346f08b4-17ea-4ee2-8a0c-636ca921b85c tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] HTTP exception thrown: Security group 2a362a30-6bfd-4338-bfa5-c739a893df16 does not exist May 28 04:37:57.834406 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-02f82755-f69f-4fde-a753-9e611ff9369d'] May 28 04:37:57.837044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-fe473714-8ab2-45e4-ac71-c159efb2d262 tempest-FlavorsV2NegativeTest-1066154169 tempest-FlavorsV2NegativeTest-1066154169-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-346f08b4-17ea-4ee2-8a0c-636ca921b85c tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Request method failure captured: May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/os-security-groups/2a362a30-6bfd-4338-bfa5-c739a893df16 HTTP/1.1 May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikacH3mPNflVe6LL6bg9_A8pzAabYS23jRSixTFQfefIS8h0xsq17YlHMuAQcMYGioTiJUzGf5HQ_8pUjy0pwazx5CoRz1nqfCdunQxIHFcBiGin6OUttjeU6RRcr_kTDInnBBWYYOIl_RyOz0kb25BPKfu6ZYOhMuIQdqMRnqceoVqo May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:37:57.838618 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:37:57.840068 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:57.840068 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:37:57.840068 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:37:57.840068 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:37:57.840068 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:37:57.840068 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:37:57.840068 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:37:57.840068 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 54a0d2f3e0184d14ae4050562e236581 May 28 04:37:57.840068 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:37:57.840068 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:37:57.840068 n-d-843700-1 devstack@n-api.service[126043]: exception: Security group 2a362a30-6bfd-4338-bfa5-c739a893df16 does not exist May 28 04:37:57.840068 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-02f82755-f69f-4fde-a753-9e611ff9369d'] May 28 04:37:57.840068 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '2a362a30-6bfd-4338-bfa5-c739a893df16'} May 28 04:37:57.840988 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:57.840988 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:57.840988 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 04:37:57.840988 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 04:37:57.840988 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:57.840988 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:57.840988 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 04:37:57.840988 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 04:37:57.840988 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:57.840988 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:57.840988 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 04:37:57.840988 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 04:37:57.840988 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:57.840988 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:57.840988 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:37:57.840988 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:37:57.840988 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:57.840988 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:57.840988 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:37:57.842361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:37:57.842361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:57.842361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:57.842361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:37:57.842361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:37:57.842361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:37:57.842361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:37:57.842361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2a362a30-6bfd-4338-bfa5-c739a893df16 does not exist May 28 04:37:57.842361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02f82755-f69f-4fde-a753-9e611ff9369d'] May 28 04:37:57.842361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:57.842361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:57.842361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:57.842361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:57.842361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 28 04:37:57.842361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 04:37:57.842361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 04:37:57.842361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 04:37:57.842361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2a362a30-6bfd-4338-bfa5-c739a893df16 does not exist May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02f82755-f69f-4fde-a753-9e611ff9369d'] May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2a362a30-6bfd-4338-bfa5-c739a893df16 does not exist May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02f82755-f69f-4fde-a753-9e611ff9369d'] May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:57.844100 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:57.845565 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:57.845565 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:57.845565 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:57.845565 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:57.845565 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2a362a30-6bfd-4338-bfa5-c739a893df16 does not exist May 28 04:37:57.845565 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02f82755-f69f-4fde-a753-9e611ff9369d'] May 28 04:37:57.845565 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:57.847818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-346f08b4-17ea-4ee2-8a0c-636ca921b85c tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Returning 404 to user: Security group 2a362a30-6bfd-4338-bfa5-c739a893df16 does not exist May 28 04:37:57.847818 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-02f82755-f69f-4fde-a753-9e611ff9369d'] {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:57.848493 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-346f08b4-17ea-4ee2-8a0c-636ca921b85c tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/2a362a30-6bfd-4338-bfa5-c739a893df16" status: 404 len: 194 microversion: 2.1 time: 0.104072 May 28 04:37:57.852668 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 528/1180] 10.222.0.58 () {58 vars in 1268 bytes} [Sat May 28 04:37:57 2022] GET /compute/v2.1/os-security-groups/2a362a30-6bfd-4338-bfa5-c739a893df16 => generated 194 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:37:57.861140 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b1ab5f75-3dc7-4b12-b56f-dc2f42617944 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f7701a784c0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:58.353459 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-fe473714-8ab2-45e4-ac71-c159efb2d262 tempest-FlavorsV2NegativeTest-1066154169 tempest-FlavorsV2NegativeTest-1066154169-project] HTTP exception thrown: Flavor's memory is too small for requested image. May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fe473714-8ab2-45e4-ac71-c159efb2d262 tempest-FlavorsV2NegativeTest-1066154169 tempest-FlavorsV2NegativeTest-1066154169-project] Request method failure captured: May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 143 May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikacj8c3xVZ3U-9u1kIoN-ISyoE_GtJ9VUvG9R8cROIRNv4YdbqLK6WRpby0iSGqI2q_GAoQimvRXz6GI9l3Aw1iiFxgNenWLyPefCCX2woswiJfnGXq3_x7xE_0FzqIVjHW92Kh_CTO6TCcFrRuVm6_8Qncm6Hz3iUVadfcydSuwuUw May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: ce9d67021ef74bb1ae747870f5a4fd32 May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-FlavorsV2NegativeTest-1066154169 May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:37:58.356892 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:37:58.358581 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ce9d67021ef74bb1ae747870f5a4fd32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ce9d67021ef74bb1ae747870f5a4fd32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce9d67021ef74bb1ae747870f5a4fd32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce9d67021ef74bb1ae747870f5a4fd32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:58.358581 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-FlavorsV2NegativeTest-1066154169 May 28 04:37:58.358581 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: ce9d67021ef74bb1ae747870f5a4fd32 May 28 04:37:58.358581 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1066154169 May 28 04:37:58.358581 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-FlavorsV2NegativeTest-1066154169-project May 28 04:37:58.358581 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:37:58.358581 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:37:58.358581 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: ec9ea0c907c54f06995cf9c729aa1251 May 28 04:37:58.358581 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-FlavorsV2NegativeTest-1066154169-project May 28 04:37:58.358581 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:37:58.358581 n-d-843700-1 devstack@n-api.service[126044]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1391447956", "imageRef": "cdbecf20-39f9-4024-bd9a-cd17b56d3a0a", "flavorRef": "452"}} May 28 04:37:58.358581 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:37:58.359572 n-d-843700-1 devstack@n-api.service[126044]: exception: Flavor's memory is too small for requested image. May 28 04:37:58.359572 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1391447956', 'imageRef': 'cdbecf20-39f9-4024-bd9a-cd17b56d3a0a', 'flavorRef': '452'}}} May 28 04:37:58.359572 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:58.359572 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:58.359572 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 28 04:37:58.359572 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 28 04:37:58.359572 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 28 04:37:58.359572 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._create_instance( May 28 04:37:58.359572 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance May 28 04:37:58.359572 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, May 28 04:37:58.359572 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild May 28 04:37:58.359572 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, May 28 04:37:58.359572 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image May 28 04:37:58.359572 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( May 28 04:37:58.359572 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus May 28 04:37:58.359572 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() May 28 04:37:58.359572 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. May 28 04:37:58.359572 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:58.359572 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:58.359572 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:58.360840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:58.362887 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:58.362887 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:58.362887 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:58.362887 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:58.362887 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. May 28 04:37:58.362887 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:37:58.362887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fe473714-8ab2-45e4-ac71-c159efb2d262 tempest-FlavorsV2NegativeTest-1066154169 tempest-FlavorsV2NegativeTest-1066154169-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:58.362887 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fe473714-8ab2-45e4-ac71-c159efb2d262 tempest-FlavorsV2NegativeTest-1066154169 tempest-FlavorsV2NegativeTest-1066154169-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.590846 May 28 04:37:58.362887 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 653/1181] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:37:57 2022] POST /compute/v2.1/servers => generated 93 bytes in 592 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) May 28 04:37:58.372272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-244fd1dc-7056-4812-869c-9bbd7fed82ba tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:58.373314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-244fd1dc-7056-4812-869c-9bbd7fed82ba tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:58.383513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-244fd1dc-7056-4812-869c-9bbd7fed82ba tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:58.385311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-244fd1dc-7056-4812-869c-9bbd7fed82ba tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:58.386436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-244fd1dc-7056-4812-869c-9bbd7fed82ba tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:58.387288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-244fd1dc-7056-4812-869c-9bbd7fed82ba tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:58.398304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:37:58.627820 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b1ab5f75-3dc7-4b12-b56f-dc2f42617944 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/5db699c3-5ad0-426b-af22-63ec90bba84a" status: 202 len: 0 microversion: 2.1 time: 0.773864 May 28 04:37:58.632528 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 529/1182] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:37:57 2022] DELETE /compute/v2.1/os-security-groups/5db699c3-5ad0-426b-af22-63ec90bba84a => generated 0 bytes in 779 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:37:58.638396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-63b8a84c-2871-41ab-a924-5e1adad9f731 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:58.639514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-63b8a84c-2871-41ab-a924-5e1adad9f731 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:58.648720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63b8a84c-2871-41ab-a924-5e1adad9f731 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:58.659630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63b8a84c-2871-41ab-a924-5e1adad9f731 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:58.659630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63b8a84c-2871-41ab-a924-5e1adad9f731 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:58.659630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63b8a84c-2871-41ab-a924-5e1adad9f731 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:58.721743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-244fd1dc-7056-4812-869c-9bbd7fed82ba tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:58.730529 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-244fd1dc-7056-4812-869c-9bbd7fed82ba tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.364412 May 28 04:37:58.742273 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 654/1183] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:58 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:58.742273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-51f94636-ba07-4cec-a240-5acd9c081342 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:58.742273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-51f94636-ba07-4cec-a240-5acd9c081342 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:58.745890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51f94636-ba07-4cec-a240-5acd9c081342 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:58.746459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51f94636-ba07-4cec-a240-5acd9c081342 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:58.747669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51f94636-ba07-4cec-a240-5acd9c081342 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:58.748212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51f94636-ba07-4cec-a240-5acd9c081342 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:58.945707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-63b8a84c-2871-41ab-a924-5e1adad9f731 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:58.959477 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-63b8a84c-2871-41ab-a924-5e1adad9f731 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.325072 May 28 04:37:58.962537 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 530/1184] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:58 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:58.991046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2a38aa1e-c9d5-492e-8095-ee2e711912b7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f7701ce2c10>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:59.034610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-51f94636-ba07-4cec-a240-5acd9c081342 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:59.045394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG neutronclient.v2_0.client [None req-2a38aa1e-c9d5-492e-8095-ee2e711912b7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5db699c3-5ad0-426b-af22-63ec90bba84a does not exist", "detail": ""}} {{(pid=126043) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:37:59.048083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.security_group_api [None req-2a38aa1e-c9d5-492e-8095-ee2e711912b7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Neutron security group 5db699c3-5ad0-426b-af22-63ec90bba84a not found {{(pid=126043) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 04:37:59.049251 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-2a38aa1e-c9d5-492e-8095-ee2e711912b7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] HTTP exception thrown: Security group 5db699c3-5ad0-426b-af22-63ec90bba84a does not exist May 28 04:37:59.049251 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-a562efc7-cfcd-491a-b443-4ce12bcb15bb'] May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2a38aa1e-c9d5-492e-8095-ee2e711912b7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Request method failure captured: May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/os-security-groups/5db699c3-5ad0-426b-af22-63ec90bba84a HTTP/1.1 May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikacH3mPNflVe6LL6bg9_A8pzAabYS23jRSixTFQfefIS8h0xsq17YlHMuAQcMYGioTiJUzGf5HQ_8pUjy0pwazx5CoRz1nqfCdunQxIHFcBiGin6OUttjeU6RRcr_kTDInnBBWYYOIl_RyOz0kb25BPKfu6ZYOhMuIQdqMRnqceoVqo May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:37:59.051983 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:37:59.053623 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:37:59.053623 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:37:59.053623 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:37:59.053623 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:37:59.053623 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:37:59.053623 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:37:59.053623 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:37:59.053623 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 54a0d2f3e0184d14ae4050562e236581 May 28 04:37:59.053623 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:37:59.053623 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:37:59.053623 n-d-843700-1 devstack@n-api.service[126043]: exception: Security group 5db699c3-5ad0-426b-af22-63ec90bba84a does not exist May 28 04:37:59.053623 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-a562efc7-cfcd-491a-b443-4ce12bcb15bb'] May 28 04:37:59.053623 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '5db699c3-5ad0-426b-af22-63ec90bba84a'} May 28 04:37:59.054578 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:37:59.054578 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:59.054578 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 04:37:59.054578 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 04:37:59.054578 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:59.054578 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:59.054578 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 04:37:59.054578 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 04:37:59.054578 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:59.054578 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:59.054578 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 04:37:59.054578 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 04:37:59.054578 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:59.054578 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:59.054578 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:37:59.054578 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:37:59.054578 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:59.054578 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:59.054578 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:37:59.055978 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:37:59.055978 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:37:59.055978 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:37:59.055978 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:37:59.055978 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:37:59.055978 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:37:59.055978 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:37:59.055978 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5db699c3-5ad0-426b-af22-63ec90bba84a does not exist May 28 04:37:59.055978 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a562efc7-cfcd-491a-b443-4ce12bcb15bb'] May 28 04:37:59.055978 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:59.055978 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:59.055978 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:59.055978 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:59.055978 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 28 04:37:59.055978 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 04:37:59.055978 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 04:37:59.055978 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 04:37:59.055978 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5db699c3-5ad0-426b-af22-63ec90bba84a does not exist May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a562efc7-cfcd-491a-b443-4ce12bcb15bb'] May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5db699c3-5ad0-426b-af22-63ec90bba84a does not exist May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a562efc7-cfcd-491a-b443-4ce12bcb15bb'] May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:59.057633 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:37:59.059310 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:37:59.059310 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:37:59.059310 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:37:59.059310 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:37:59.059310 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5db699c3-5ad0-426b-af22-63ec90bba84a does not exist May 28 04:37:59.059310 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a562efc7-cfcd-491a-b443-4ce12bcb15bb'] May 28 04:37:59.059310 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:37:59.061364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2a38aa1e-c9d5-492e-8095-ee2e711912b7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Returning 404 to user: Security group 5db699c3-5ad0-426b-af22-63ec90bba84a does not exist May 28 04:37:59.061364 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-a562efc7-cfcd-491a-b443-4ce12bcb15bb'] {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:37:59.062816 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2a38aa1e-c9d5-492e-8095-ee2e711912b7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/5db699c3-5ad0-426b-af22-63ec90bba84a" status: 404 len: 194 microversion: 2.1 time: 0.099129 May 28 04:37:59.068350 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 531/1185] 10.222.0.58 () {58 vars in 1268 bytes} [Sat May 28 04:37:58 2022] GET /compute/v2.1/os-security-groups/5db699c3-5ad0-426b-af22-63ec90bba84a => generated 194 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:37:59.069795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-51f94636-ba07-4cec-a240-5acd9c081342 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:59.073766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-51f94636-ba07-4cec-a240-5acd9c081342 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:59.077551 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-51f94636-ba07-4cec-a240-5acd9c081342 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.343507 May 28 04:37:59.079115 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 655/1186] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:37:58 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:37:59.092155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-856c6430-15b8-446b-a3ba-a9606aa80823 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:59.093615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c625dc05-ca1d-4747-b649-eab3a8e4a9dd tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f7701e4e700>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:59.093772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-856c6430-15b8-446b-a3ba-a9606aa80823 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 565a3cb7-ae9f-41af-8e36-43b39b2e43e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:59.106496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-856c6430-15b8-446b-a3ba-a9606aa80823 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:59.133386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-856c6430-15b8-446b-a3ba-a9606aa80823 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:59.134027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-856c6430-15b8-446b-a3ba-a9606aa80823 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:59.137189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-856c6430-15b8-446b-a3ba-a9606aa80823 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:59.276741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-856c6430-15b8-446b-a3ba-a9606aa80823 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:37:59.295374 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-856c6430-15b8-446b-a3ba-a9606aa80823 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8" status: 200 len: 1215 microversion: 2.1 time: 0.221957 May 28 04:37:59.297359 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 532/1187] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:59 2022] GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8 => generated 1215 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:59.441297 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c625dc05-ca1d-4747-b649-eab3a8e4a9dd tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.360135 May 28 04:37:59.441899 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 656/1188] 10.222.0.58 () {58 vars in 1157 bytes} [Sat May 28 04:37:59 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:37:59.457019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-40e2811b-ba0b-4393-8628-1cc5b28d7973 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Action: 'create', calling method: .version_select at 0x7f7701a78f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1500564102", "description": "tempest-description-278577432"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:37:59.750274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f60f10df-9d73-4aa9-a59a-2dd568bd539d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:37:59.751583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f60f10df-9d73-4aa9-a59a-2dd568bd539d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:37:59.768765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f60f10df-9d73-4aa9-a59a-2dd568bd539d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:59.770689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f60f10df-9d73-4aa9-a59a-2dd568bd539d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:37:59.772251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f60f10df-9d73-4aa9-a59a-2dd568bd539d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:37:59.772872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f60f10df-9d73-4aa9-a59a-2dd568bd539d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:00.071181 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-40e2811b-ba0b-4393-8628-1cc5b28d7973 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.619104 May 28 04:38:00.075363 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 533/1189] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:37:59 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:00.103688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-709a884d-1954-4cbc-80a9-d5068cca40ae tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:00.104452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-709a884d-1954-4cbc-80a9-d5068cca40ae tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:00.131204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-709a884d-1954-4cbc-80a9-d5068cca40ae tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:00.133561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-709a884d-1954-4cbc-80a9-d5068cca40ae tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:00.138846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-709a884d-1954-4cbc-80a9-d5068cca40ae tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:00.139622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-709a884d-1954-4cbc-80a9-d5068cca40ae tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:00.202217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f60f10df-9d73-4aa9-a59a-2dd568bd539d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:00.216542 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f60f10df-9d73-4aa9-a59a-2dd568bd539d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.471826 May 28 04:38:00.219479 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 657/1190] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:37:59 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:00.238410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b65659bf-7602-40c7-bf61-23733fc81efe tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Action: 'create', calling method: .version_select at 0x7f77075f2430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-82267849", "description": "tempest-description-1511074059"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:00.515209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-709a884d-1954-4cbc-80a9-d5068cca40ae tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:00.526734 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-709a884d-1954-4cbc-80a9-d5068cca40ae tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.449098 May 28 04:38:00.527847 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 534/1191] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:00 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:00.533916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-70a0768f-d3b1-43bc-81b7-b798a83d692c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:00.534783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-70a0768f-d3b1-43bc-81b7-b798a83d692c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:00.542910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70a0768f-d3b1-43bc-81b7-b798a83d692c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:00.545997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70a0768f-d3b1-43bc-81b7-b798a83d692c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:00.545997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70a0768f-d3b1-43bc-81b7-b798a83d692c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:00.545997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70a0768f-d3b1-43bc-81b7-b798a83d692c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:00.893923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-70a0768f-d3b1-43bc-81b7-b798a83d692c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:00.905214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-70a0768f-d3b1-43bc-81b7-b798a83d692c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:00.912295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-70a0768f-d3b1-43bc-81b7-b798a83d692c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:00.917086 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-70a0768f-d3b1-43bc-81b7-b798a83d692c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.387435 May 28 04:38:00.928664 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 535/1192] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:00 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:00.933153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7ca2df7b-753d-411f-a032-6f035ce4e1fc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:00.933771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7ca2df7b-753d-411f-a032-6f035ce4e1fc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 565a3cb7-ae9f-41af-8e36-43b39b2e43e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:00.943027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7ca2df7b-753d-411f-a032-6f035ce4e1fc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:00.943970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7ca2df7b-753d-411f-a032-6f035ce4e1fc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:00.944265 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7ca2df7b-753d-411f-a032-6f035ce4e1fc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:00.944702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7ca2df7b-753d-411f-a032-6f035ce4e1fc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:01.073553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7ca2df7b-753d-411f-a032-6f035ce4e1fc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:01.093633 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7ca2df7b-753d-411f-a032-6f035ce4e1fc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8" status: 200 len: 1277 microversion: 2.1 time: 0.170762 May 28 04:38:01.094960 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 536/1193] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:00 2022] GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:01.243586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b225118e-4518-4f81-ac88-f10d6a362835 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:01.244369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b225118e-4518-4f81-ac88-f10d6a362835 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:01.252689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b225118e-4518-4f81-ac88-f10d6a362835 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:01.253673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b225118e-4518-4f81-ac88-f10d6a362835 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:01.254688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b225118e-4518-4f81-ac88-f10d6a362835 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:01.259823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b225118e-4518-4f81-ac88-f10d6a362835 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:01.270576 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b65659bf-7602-40c7-bf61-23733fc81efe tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.049995 May 28 04:38:01.271227 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 658/1194] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:38:00 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:01.463433 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-054d32a8-cb91-41a9-b710-39e88b9358c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-356498242", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "86536437-8d35-4af2-b7d8-a39846bdeaf6"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:01.543183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-054d32a8-cb91-41a9-b710-39e88b9358c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] validate_networks() for [('86536437-8d35-4af2-b7d8-a39846bdeaf6', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:38:02.086317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b225118e-4518-4f81-ac88-f10d6a362835 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:02.106474 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b225118e-4518-4f81-ac88-f10d6a362835 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.872283 May 28 04:38:02.109946 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 537/1195] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:01 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:02.129482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-999c5850-509b-4f6c-adee-2f5529b8ed1a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:02.130483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-999c5850-509b-4f6c-adee-2f5529b8ed1a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:02.145487 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-999c5850-509b-4f6c-adee-2f5529b8ed1a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:02.146272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-999c5850-509b-4f6c-adee-2f5529b8ed1a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:02.147378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-999c5850-509b-4f6c-adee-2f5529b8ed1a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:02.148059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-999c5850-509b-4f6c-adee-2f5529b8ed1a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:03.113769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-999c5850-509b-4f6c-adee-2f5529b8ed1a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:03.136221 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-999c5850-509b-4f6c-adee-2f5529b8ed1a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 1.024087 May 28 04:38:03.148867 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 538/1196] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:02 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:03.161220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-65271dd1-d953-416a-a378-ece985810663 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:03.163912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-65271dd1-d953-416a-a378-ece985810663 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:03.174585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65271dd1-d953-416a-a378-ece985810663 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:03.174771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-054d32a8-cb91-41a9-b710-39e88b9358c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:38:03.176491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-054d32a8-cb91-41a9-b710-39e88b9358c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:38:03.176491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-054d32a8-cb91-41a9-b710-39e88b9358c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:38:03.176708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-054d32a8-cb91-41a9-b710-39e88b9358c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:38:03.177132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-054d32a8-cb91-41a9-b710-39e88b9358c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:38:03.182975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65271dd1-d953-416a-a378-ece985810663 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:03.184204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65271dd1-d953-416a-a378-ece985810663 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:03.184823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65271dd1-d953-416a-a378-ece985810663 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:03.189172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-054d32a8-cb91-41a9-b710-39e88b9358c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:03.190112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-054d32a8-cb91-41a9-b710-39e88b9358c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:03.192299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-054d32a8-cb91-41a9-b710-39e88b9358c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:03.193541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-054d32a8-cb91-41a9-b710-39e88b9358c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:03.199693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:03.234184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-054d32a8-cb91-41a9-b710-39e88b9358c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Getting quotas for project 9b443a65fedd4511b931cd5130b7e618. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:38:03.240863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-054d32a8-cb91-41a9-b710-39e88b9358c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Getting quotas for user 54a0d2f3e0184d14ae4050562e236581 and project 9b443a65fedd4511b931cd5130b7e618. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:38:03.265385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-054d32a8-cb91-41a9-b710-39e88b9358c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:38:03.268960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-054d32a8-cb91-41a9-b710-39e88b9358c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:38:03.440546 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-054d32a8-cb91-41a9-b710-39e88b9358c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.982177 May 28 04:38:03.444997 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 659/1197] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:38:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:38:03.460810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c9fa8d4f-5d7c-4e7d-8368-6e8da08c02ab tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:03.461645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c9fa8d4f-5d7c-4e7d-8368-6e8da08c02ab tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 565a3cb7-ae9f-41af-8e36-43b39b2e43e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:03.479571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9fa8d4f-5d7c-4e7d-8368-6e8da08c02ab tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:03.482435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9fa8d4f-5d7c-4e7d-8368-6e8da08c02ab tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:03.486211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9fa8d4f-5d7c-4e7d-8368-6e8da08c02ab tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:03.487014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9fa8d4f-5d7c-4e7d-8368-6e8da08c02ab tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:03.534192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-65271dd1-d953-416a-a378-ece985810663 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:03.561615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-65271dd1-d953-416a-a378-ece985810663 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:03.561615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-65271dd1-d953-416a-a378-ece985810663 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:03.561615 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-65271dd1-d953-416a-a378-ece985810663 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.407404 May 28 04:38:03.562336 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 539/1198] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:03 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:03.825685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c9fa8d4f-5d7c-4e7d-8368-6e8da08c02ab tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:03.835932 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c9fa8d4f-5d7c-4e7d-8368-6e8da08c02ab tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8" status: 200 len: 1319 microversion: 2.1 time: 0.387839 May 28 04:38:03.839852 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 660/1199] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:03 2022] GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8 => generated 1319 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:03.850247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-030f9707-ab73-4bd5-a7e4-0125a8345248 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:03.851080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-030f9707-ab73-4bd5-a7e4-0125a8345248 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:03.864907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-030f9707-ab73-4bd5-a7e4-0125a8345248 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:03.866653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-030f9707-ab73-4bd5-a7e4-0125a8345248 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:03.870647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-030f9707-ab73-4bd5-a7e4-0125a8345248 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:03.871139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-030f9707-ab73-4bd5-a7e4-0125a8345248 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:03.957105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b89a0390-faae-4d33-a637-2d886f5bfa70 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Action: 'create', calling method: .version_select at 0x7f7701a8cb80>, body: {"keypair": {"name": "tempest-keypair-1634178433", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmUUNMA/IEoc94fGRafm7DE2GKc5BYTaf8cUzk7WbE8qHTjyxqug1x0rkyE8kogbzZdpcVIiw4A7aAGp5r6bPOuYRquOGzyVsUSO8WN7yKaO6Go4EC7QAQqf9bGsKB0hw=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:04.024176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-b89a0390-faae-4d33-a637-2d886f5bfa70 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Getting quotas for project 811638c702ad48ac81d203aeac82dcee. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:38:04.040745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-b89a0390-faae-4d33-a637-2d886f5bfa70 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Getting quotas for user 80e2e341401649898ed5a366da7e24e7 and project 811638c702ad48ac81d203aeac82dcee. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:38:04.144507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-030f9707-ab73-4bd5-a7e4-0125a8345248 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:04.155264 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-030f9707-ab73-4bd5-a7e4-0125a8345248 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.308577 May 28 04:38:04.156746 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 661/1200] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:03 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:04.180092 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e336a64d-9a76-4450-97df-2d8999314e4d tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:04.184704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e336a64d-9a76-4450-97df-2d8999314e4d tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:04.194444 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b89a0390-faae-4d33-a637-2d886f5bfa70 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.632241 May 28 04:38:04.199038 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 540/1201] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:38:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:04.203385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a428c66b-9058-44d5-bb63-c4bff3df1d55 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:04.204132 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a428c66b-9058-44d5-bb63-c4bff3df1d55 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:04.218469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a428c66b-9058-44d5-bb63-c4bff3df1d55 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:04.226408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a428c66b-9058-44d5-bb63-c4bff3df1d55 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:04.228660 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a428c66b-9058-44d5-bb63-c4bff3df1d55 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:04.232411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a428c66b-9058-44d5-bb63-c4bff3df1d55 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:04.411164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e336a64d-9a76-4450-97df-2d8999314e4d tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:04.420531 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e336a64d-9a76-4450-97df-2d8999314e4d tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 200 len: 1215 microversion: 2.1 time: 0.262353 May 28 04:38:04.421991 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 662/1202] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:04 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 1215 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:04.558817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e15e5f90-b8b8-4693-be93-ab54b9e8e0cc req-de36726c-89ee-4ef4-8061-b390d19bf80a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95514daa-06bd-483c-bd44-b9a7aa12b51c", "tag": "a3934b31-3593-413f-bf33-dffe073500de"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:04.572772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e15e5f90-b8b8-4693-be93-ab54b9e8e0cc req-de36726c-89ee-4ef4-8061-b390d19bf80a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:04.576662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e15e5f90-b8b8-4693-be93-ab54b9e8e0cc req-de36726c-89ee-4ef4-8061-b390d19bf80a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:04.605505 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e15e5f90-b8b8-4693-be93-ab54b9e8e0cc req-de36726c-89ee-4ef4-8061-b390d19bf80a service nova] Creating event network-changed:a3934b31-3593-413f-bf33-dffe073500de for instance 95514daa-06bd-483c-bd44-b9a7aa12b51c on n-h1-843700-1 May 28 04:38:04.613319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a428c66b-9058-44d5-bb63-c4bff3df1d55 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:04.636074 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a428c66b-9058-44d5-bb63-c4bff3df1d55 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.425894 May 28 04:38:04.642373 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e15e5f90-b8b8-4693-be93-ab54b9e8e0cc req-de36726c-89ee-4ef4-8061-b390d19bf80a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080790 May 28 04:38:04.643645 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 541/1203] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:04 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:04.663141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e6671825-ef11-4523-bc39-40bcd74796f8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:04.663545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e6671825-ef11-4523-bc39-40bcd74796f8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:04.664905 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 663/1204] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:04.675831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6671825-ef11-4523-bc39-40bcd74796f8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:04.680510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6671825-ef11-4523-bc39-40bcd74796f8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:04.683225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6671825-ef11-4523-bc39-40bcd74796f8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:04.684181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6671825-ef11-4523-bc39-40bcd74796f8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:04.858401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f24e74dc-2267-496d-8658-e3f72a6a4294 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:04.861669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f24e74dc-2267-496d-8658-e3f72a6a4294 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 565a3cb7-ae9f-41af-8e36-43b39b2e43e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:04.902405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f24e74dc-2267-496d-8658-e3f72a6a4294 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:04.904579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f24e74dc-2267-496d-8658-e3f72a6a4294 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:04.906154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f24e74dc-2267-496d-8658-e3f72a6a4294 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:04.908112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f24e74dc-2267-496d-8658-e3f72a6a4294 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:05.114539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e6671825-ef11-4523-bc39-40bcd74796f8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:05.133297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e6671825-ef11-4523-bc39-40bcd74796f8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:05.152878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e6671825-ef11-4523-bc39-40bcd74796f8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:05.154976 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e6671825-ef11-4523-bc39-40bcd74796f8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.509838 May 28 04:38:05.170696 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 542/1205] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:04 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:05.180733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f3a7f367-1994-4636-9459-f3800e6d3697 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:05.181657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f3a7f367-1994-4636-9459-f3800e6d3697 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:05.192349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3a7f367-1994-4636-9459-f3800e6d3697 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:05.193117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3a7f367-1994-4636-9459-f3800e6d3697 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:05.194381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3a7f367-1994-4636-9459-f3800e6d3697 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:05.196244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3a7f367-1994-4636-9459-f3800e6d3697 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:05.301697 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f24e74dc-2267-496d-8658-e3f72a6a4294 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:05.315083 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f24e74dc-2267-496d-8658-e3f72a6a4294 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8" status: 200 len: 1319 microversion: 2.1 time: 0.462428 May 28 04:38:05.317456 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 664/1206] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:04 2022] GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8 => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:38:05.439748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-636da834-d798-40a6-ac26-70ca1952c755 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:05.440635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-636da834-d798-40a6-ac26-70ca1952c755 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:05.490461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-636da834-d798-40a6-ac26-70ca1952c755 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:05.495335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-636da834-d798-40a6-ac26-70ca1952c755 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:05.506895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-636da834-d798-40a6-ac26-70ca1952c755 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:05.513460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-636da834-d798-40a6-ac26-70ca1952c755 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:05.677058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-636da834-d798-40a6-ac26-70ca1952c755 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:05.685549 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-636da834-d798-40a6-ac26-70ca1952c755 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 200 len: 1211 microversion: 2.1 time: 0.251098 May 28 04:38:05.686825 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 665/1207] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:05 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 1211 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:38:05.692471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6be9f9a6-eee1-4058-901d-7403c7a17171 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:05.693552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6be9f9a6-eee1-4058-901d-7403c7a17171 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:05.701067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6be9f9a6-eee1-4058-901d-7403c7a17171 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:05.701921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6be9f9a6-eee1-4058-901d-7403c7a17171 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:05.703029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6be9f9a6-eee1-4058-901d-7403c7a17171 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:05.703977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6be9f9a6-eee1-4058-901d-7403c7a17171 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:05.736815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f3a7f367-1994-4636-9459-f3800e6d3697 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:05.745501 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f3a7f367-1994-4636-9459-f3800e6d3697 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.572498 May 28 04:38:05.749584 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 543/1208] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:05 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:05.974640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6be9f9a6-eee1-4058-901d-7403c7a17171 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:05.995306 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6be9f9a6-eee1-4058-901d-7403c7a17171 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.306712 May 28 04:38:05.995955 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 666/1209] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:05 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:06.178272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7ba50940-24e3-490b-a2be-eb386c92b5b2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:06.179354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7ba50940-24e3-490b-a2be-eb386c92b5b2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:06.187450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7ba50940-24e3-490b-a2be-eb386c92b5b2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:06.188300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7ba50940-24e3-490b-a2be-eb386c92b5b2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:06.190838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7ba50940-24e3-490b-a2be-eb386c92b5b2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:06.192321 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7ba50940-24e3-490b-a2be-eb386c92b5b2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:06.270654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:06.342149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-43930f3d-7ef7-4135-9e4b-a5615968dd1a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:06.343406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-43930f3d-7ef7-4135-9e4b-a5615968dd1a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 565a3cb7-ae9f-41af-8e36-43b39b2e43e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:06.383361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43930f3d-7ef7-4135-9e4b-a5615968dd1a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:06.383361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43930f3d-7ef7-4135-9e4b-a5615968dd1a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:06.383361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43930f3d-7ef7-4135-9e4b-a5615968dd1a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:06.383361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43930f3d-7ef7-4135-9e4b-a5615968dd1a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:06.590637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7ba50940-24e3-490b-a2be-eb386c92b5b2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:06.608866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7ba50940-24e3-490b-a2be-eb386c92b5b2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:06.610351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7ba50940-24e3-490b-a2be-eb386c92b5b2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:06.611708 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7ba50940-24e3-490b-a2be-eb386c92b5b2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.437834 May 28 04:38:06.615371 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 544/1210] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:06 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:06.703956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-badf0ce6-fbfb-4999-8e82-1775a7c78cca tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:06.705013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-badf0ce6-fbfb-4999-8e82-1775a7c78cca tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:06.712228 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-badf0ce6-fbfb-4999-8e82-1775a7c78cca tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:06.713017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-badf0ce6-fbfb-4999-8e82-1775a7c78cca tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:06.714048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-badf0ce6-fbfb-4999-8e82-1775a7c78cca tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:06.714689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-badf0ce6-fbfb-4999-8e82-1775a7c78cca tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:06.762569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-43930f3d-7ef7-4135-9e4b-a5615968dd1a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:06.784173 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-43930f3d-7ef7-4135-9e4b-a5615968dd1a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8" status: 200 len: 1319 microversion: 2.1 time: 0.449706 May 28 04:38:06.789315 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 667/1211] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:06 2022] GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8 => generated 1319 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:06.798472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-4ead3cf7-e6cc-4643-99ef-6d902a7e91d0 req-c6a1f727-187f-4027-972c-6cbbb7fda748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "565a3cb7-ae9f-41af-8e36-43b39b2e43e8", "tag": "02c55ea3-528b-43eb-907c-789ef583cf3b"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:06.819506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-4ead3cf7-e6cc-4643-99ef-6d902a7e91d0 req-c6a1f727-187f-4027-972c-6cbbb7fda748 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:06.820467 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-4ead3cf7-e6cc-4643-99ef-6d902a7e91d0 req-c6a1f727-187f-4027-972c-6cbbb7fda748 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:06.835458 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-4ead3cf7-e6cc-4643-99ef-6d902a7e91d0 req-c6a1f727-187f-4027-972c-6cbbb7fda748 service nova] Creating event network-changed:02c55ea3-528b-43eb-907c-789ef583cf3b for instance 565a3cb7-ae9f-41af-8e36-43b39b2e43e8 on n-h1-843700-1 May 28 04:38:06.846457 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-4ead3cf7-e6cc-4643-99ef-6d902a7e91d0 req-c6a1f727-187f-4027-972c-6cbbb7fda748 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055809 May 28 04:38:06.846457 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 668/1212] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:06.879381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a484dcb6-d18b-4ef4-b2e8-3823e12b67f2 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:06.882188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a484dcb6-d18b-4ef4-b2e8-3823e12b67f2 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:06.887676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:06.899718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a484dcb6-d18b-4ef4-b2e8-3823e12b67f2 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:06.903119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a484dcb6-d18b-4ef4-b2e8-3823e12b67f2 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:06.903119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a484dcb6-d18b-4ef4-b2e8-3823e12b67f2 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:06.903678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a484dcb6-d18b-4ef4-b2e8-3823e12b67f2 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:06.960314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-badf0ce6-fbfb-4999-8e82-1775a7c78cca tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:06.974327 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-badf0ce6-fbfb-4999-8e82-1775a7c78cca tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 200 len: 1285 microversion: 2.1 time: 0.274809 May 28 04:38:06.974916 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 545/1213] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:06 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 1285 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:07.012672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0855981b-2b4d-40f1-a069-9f10d4f2d5cb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:07.013361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0855981b-2b4d-40f1-a069-9f10d4f2d5cb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:07.023764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0855981b-2b4d-40f1-a069-9f10d4f2d5cb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:07.023764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0855981b-2b4d-40f1-a069-9f10d4f2d5cb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:07.024481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0855981b-2b4d-40f1-a069-9f10d4f2d5cb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:07.025115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0855981b-2b4d-40f1-a069-9f10d4f2d5cb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:07.362019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a484dcb6-d18b-4ef4-b2e8-3823e12b67f2 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:07.370434 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a484dcb6-d18b-4ef4-b2e8-3823e12b67f2 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.524386 May 28 04:38:07.371235 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 669/1214] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:06 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:07.441380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0855981b-2b4d-40f1-a069-9f10d4f2d5cb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:07.449572 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0855981b-2b4d-40f1-a069-9f10d4f2d5cb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.440801 May 28 04:38:07.450077 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 546/1215] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:07 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:38:07.630311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e6fcc0db-b190-4f5a-954b-1eb5854fa4e3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:07.630920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e6fcc0db-b190-4f5a-954b-1eb5854fa4e3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:07.640045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e6fcc0db-b190-4f5a-954b-1eb5854fa4e3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:07.640909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e6fcc0db-b190-4f5a-954b-1eb5854fa4e3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:07.642082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e6fcc0db-b190-4f5a-954b-1eb5854fa4e3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:07.643045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e6fcc0db-b190-4f5a-954b-1eb5854fa4e3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:07.803986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-77f9f8b2-5ec6-4e08-879b-566aa6883b3b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:07.804683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-77f9f8b2-5ec6-4e08-879b-566aa6883b3b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 565a3cb7-ae9f-41af-8e36-43b39b2e43e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:07.810946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77f9f8b2-5ec6-4e08-879b-566aa6883b3b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:07.816580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77f9f8b2-5ec6-4e08-879b-566aa6883b3b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:07.819841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77f9f8b2-5ec6-4e08-879b-566aa6883b3b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:07.820484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77f9f8b2-5ec6-4e08-879b-566aa6883b3b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:07.893566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e6fcc0db-b190-4f5a-954b-1eb5854fa4e3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:07.908043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e6fcc0db-b190-4f5a-954b-1eb5854fa4e3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:07.910066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e6fcc0db-b190-4f5a-954b-1eb5854fa4e3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:07.911865 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e6fcc0db-b190-4f5a-954b-1eb5854fa4e3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.285285 May 28 04:38:07.920251 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 670/1216] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:07 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:38:07.992062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-467e30f4-c747-444a-b286-013bca6f3e9f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:07.992728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-467e30f4-c747-444a-b286-013bca6f3e9f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:08.002235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-467e30f4-c747-444a-b286-013bca6f3e9f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:08.007258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-467e30f4-c747-444a-b286-013bca6f3e9f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:08.008376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-467e30f4-c747-444a-b286-013bca6f3e9f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:08.008974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-467e30f4-c747-444a-b286-013bca6f3e9f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:08.401611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-77f9f8b2-5ec6-4e08-879b-566aa6883b3b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:08.411417 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-77f9f8b2-5ec6-4e08-879b-566aa6883b3b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8" status: 200 len: 1319 microversion: 2.1 time: 0.611260 May 28 04:38:08.421479 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 547/1217] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:07 2022] GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8 => generated 1319 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:38:08.421479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-102cf0ea-f1aa-4ea2-8b01-02cd93fd730d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:08.421479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-102cf0ea-f1aa-4ea2-8b01-02cd93fd730d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:08.428950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-102cf0ea-f1aa-4ea2-8b01-02cd93fd730d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:08.431239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-102cf0ea-f1aa-4ea2-8b01-02cd93fd730d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:08.431239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-102cf0ea-f1aa-4ea2-8b01-02cd93fd730d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:08.431239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-102cf0ea-f1aa-4ea2-8b01-02cd93fd730d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:08.466706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-467e30f4-c747-444a-b286-013bca6f3e9f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:08.474450 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-467e30f4-c747-444a-b286-013bca6f3e9f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 200 len: 1315 microversion: 2.1 time: 0.486618 May 28 04:38:08.475100 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 671/1218] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:07 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:08.479576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-76c70510-2842-481d-abc0-b3d7e96669ff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:08.480207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-76c70510-2842-481d-abc0-b3d7e96669ff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:08.488335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76c70510-2842-481d-abc0-b3d7e96669ff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:08.488788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76c70510-2842-481d-abc0-b3d7e96669ff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:08.489564 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76c70510-2842-481d-abc0-b3d7e96669ff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:08.490005 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76c70510-2842-481d-abc0-b3d7e96669ff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:08.663098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-102cf0ea-f1aa-4ea2-8b01-02cd93fd730d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:08.677095 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-102cf0ea-f1aa-4ea2-8b01-02cd93fd730d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.263186 May 28 04:38:08.677880 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 548/1219] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:08 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:08.729291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-76c70510-2842-481d-abc0-b3d7e96669ff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:08.742559 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-76c70510-2842-481d-abc0-b3d7e96669ff tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.266324 May 28 04:38:08.743374 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 672/1220] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:08 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:08.930168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-50668e57-1c7b-4ebc-9cf5-2aef6db76ca3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:08.931363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-50668e57-1c7b-4ebc-9cf5-2aef6db76ca3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:08.938857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50668e57-1c7b-4ebc-9cf5-2aef6db76ca3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:08.939883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50668e57-1c7b-4ebc-9cf5-2aef6db76ca3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:08.941167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50668e57-1c7b-4ebc-9cf5-2aef6db76ca3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:08.941812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50668e57-1c7b-4ebc-9cf5-2aef6db76ca3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:09.159907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-50668e57-1c7b-4ebc-9cf5-2aef6db76ca3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:09.170037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-50668e57-1c7b-4ebc-9cf5-2aef6db76ca3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:09.171699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-50668e57-1c7b-4ebc-9cf5-2aef6db76ca3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:09.172997 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-50668e57-1c7b-4ebc-9cf5-2aef6db76ca3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.247122 May 28 04:38:09.184733 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 549/1221] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:08 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:09.242143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c3610b9c-c4c7-4177-b7ad-1454882c3e2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1688076730", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1c44d536-7c11-46a3-93ec-161ebcc5b6c6"}], "security_groups": [{"name": "tempest-securitygroup--1573046198"}], "key_name": "tempest-keypair-1634178433", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:09.430618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1ce48b44-0599-4815-9ea6-af8902d30d54 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:09.431207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1ce48b44-0599-4815-9ea6-af8902d30d54 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 565a3cb7-ae9f-41af-8e36-43b39b2e43e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:09.439744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ce48b44-0599-4815-9ea6-af8902d30d54 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:09.440196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ce48b44-0599-4815-9ea6-af8902d30d54 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:09.441134 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ce48b44-0599-4815-9ea6-af8902d30d54 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:09.441575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ce48b44-0599-4815-9ea6-af8902d30d54 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:09.679783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-c3610b9c-c4c7-4177-b7ad-1454882c3e2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] validate_networks() for [('1c44d536-7c11-46a3-93ec-161ebcc5b6c6', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:38:09.898651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1ce48b44-0599-4815-9ea6-af8902d30d54 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:09.917513 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1ce48b44-0599-4815-9ea6-af8902d30d54 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8" status: 200 len: 1319 microversion: 2.1 time: 0.491380 May 28 04:38:09.928941 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 550/1222] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:09 2022] GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8 => generated 1319 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:38:09.933943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b65ea204-6fcb-4831-865c-f503773661e0 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:09.938590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b65ea204-6fcb-4831-865c-f503773661e0 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:09.944812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b65ea204-6fcb-4831-865c-f503773661e0 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:09.946738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b65ea204-6fcb-4831-865c-f503773661e0 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:09.955212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b65ea204-6fcb-4831-865c-f503773661e0 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:09.957060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b65ea204-6fcb-4831-865c-f503773661e0 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:10.291737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b65ea204-6fcb-4831-865c-f503773661e0 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:10.305237 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b65ea204-6fcb-4831-865c-f503773661e0 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 200 len: 1315 microversion: 2.1 time: 0.375050 May 28 04:38:10.317950 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 551/1223] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:09 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:10.325022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eccd12ec-482b-4900-a81d-6bd7501077f4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:10.326116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eccd12ec-482b-4900-a81d-6bd7501077f4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:10.335239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eccd12ec-482b-4900-a81d-6bd7501077f4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:10.335833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eccd12ec-482b-4900-a81d-6bd7501077f4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:10.336777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eccd12ec-482b-4900-a81d-6bd7501077f4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:10.337320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eccd12ec-482b-4900-a81d-6bd7501077f4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:10.652666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-c3610b9c-c4c7-4177-b7ad-1454882c3e2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Getting quotas for project 811638c702ad48ac81d203aeac82dcee. Resources: dict_keys(['metadata_items']) {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:38:10.659336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-c3610b9c-c4c7-4177-b7ad-1454882c3e2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Getting quotas for user 80e2e341401649898ed5a366da7e24e7 and project 811638c702ad48ac81d203aeac82dcee. Resources: dict_keys(['metadata_items']) {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:38:10.678861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c3610b9c-c4c7-4177-b7ad-1454882c3e2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:38:10.679911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c3610b9c-c4c7-4177-b7ad-1454882c3e2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:38:10.680516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c3610b9c-c4c7-4177-b7ad-1454882c3e2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:38:10.692879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c3610b9c-c4c7-4177-b7ad-1454882c3e2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:38:10.692879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c3610b9c-c4c7-4177-b7ad-1454882c3e2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:38:10.699194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3610b9c-c4c7-4177-b7ad-1454882c3e2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:10.699935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3610b9c-c4c7-4177-b7ad-1454882c3e2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:10.700887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3610b9c-c4c7-4177-b7ad-1454882c3e2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:10.701660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3610b9c-c4c7-4177-b7ad-1454882c3e2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:10.722441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-c3610b9c-c4c7-4177-b7ad-1454882c3e2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Getting quotas for project 811638c702ad48ac81d203aeac82dcee. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:38:10.729091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-c3610b9c-c4c7-4177-b7ad-1454882c3e2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Getting quotas for user 80e2e341401649898ed5a366da7e24e7 and project 811638c702ad48ac81d203aeac82dcee. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:38:10.744806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c3610b9c-c4c7-4177-b7ad-1454882c3e2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:38:10.747971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c3610b9c-c4c7-4177-b7ad-1454882c3e2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:38:10.757877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eccd12ec-482b-4900-a81d-6bd7501077f4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:10.774408 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eccd12ec-482b-4900-a81d-6bd7501077f4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.454914 May 28 04:38:10.787480 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 552/1224] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:10 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:10.793237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-021eb0d8-2684-4437-a6db-c2cbdb8f8616 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:10.794162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-021eb0d8-2684-4437-a6db-c2cbdb8f8616 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:10.802949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-021eb0d8-2684-4437-a6db-c2cbdb8f8616 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:10.804267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-021eb0d8-2684-4437-a6db-c2cbdb8f8616 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:10.805285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-021eb0d8-2684-4437-a6db-c2cbdb8f8616 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:10.806271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-021eb0d8-2684-4437-a6db-c2cbdb8f8616 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:10.929048 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c3610b9c-c4c7-4177-b7ad-1454882c3e2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.692908 May 28 04:38:10.938872 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 673/1225] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:38:09 2022] POST /compute/v2.1/servers => generated 407 bytes in 1704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:38:10.968112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3ac4103a-74fc-429b-8f15-76d2d749dca5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:10.968809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3ac4103a-74fc-429b-8f15-76d2d749dca5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:10.976078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ac4103a-74fc-429b-8f15-76d2d749dca5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:10.976738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ac4103a-74fc-429b-8f15-76d2d749dca5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:10.977689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ac4103a-74fc-429b-8f15-76d2d749dca5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:10.978321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ac4103a-74fc-429b-8f15-76d2d749dca5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:11.222504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-021eb0d8-2684-4437-a6db-c2cbdb8f8616 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:11.230345 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-021eb0d8-2684-4437-a6db-c2cbdb8f8616 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1551 microversion: 2.1 time: 0.441346 May 28 04:38:11.231162 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 553/1226] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:10 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1551 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:11.235715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-325fc8d2-4e93-4777-9fff-20c9857ce3b4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:11.236339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-325fc8d2-4e93-4777-9fff-20c9857ce3b4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 565a3cb7-ae9f-41af-8e36-43b39b2e43e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:11.242619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-325fc8d2-4e93-4777-9fff-20c9857ce3b4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:11.250229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-325fc8d2-4e93-4777-9fff-20c9857ce3b4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:11.250229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-325fc8d2-4e93-4777-9fff-20c9857ce3b4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:11.250229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-325fc8d2-4e93-4777-9fff-20c9857ce3b4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:11.416109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3ac4103a-74fc-429b-8f15-76d2d749dca5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:11.425888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3ac4103a-74fc-429b-8f15-76d2d749dca5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:11.428600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3ac4103a-74fc-429b-8f15-76d2d749dca5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:11.429883 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3ac4103a-74fc-429b-8f15-76d2d749dca5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.487942 May 28 04:38:11.430536 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 674/1227] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:10 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:11.445297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-44c948a6-2003-4c07-97ce-9c2f0ecd2679 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:11.446301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-44c948a6-2003-4c07-97ce-9c2f0ecd2679 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:11.530715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-325fc8d2-4e93-4777-9fff-20c9857ce3b4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:11.540488 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-325fc8d2-4e93-4777-9fff-20c9857ce3b4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8" status: 200 len: 1319 microversion: 2.1 time: 0.308427 May 28 04:38:11.541460 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 554/1228] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:11 2022] GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8 => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:11.550168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-49a7a991-822f-4d70-b416-1ada8e9becb6 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:11.550168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-49a7a991-822f-4d70-b416-1ada8e9becb6 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:11.558169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49a7a991-822f-4d70-b416-1ada8e9becb6 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:11.558637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49a7a991-822f-4d70-b416-1ada8e9becb6 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:11.559497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49a7a991-822f-4d70-b416-1ada8e9becb6 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:11.560119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49a7a991-822f-4d70-b416-1ada8e9becb6 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:11.570195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-44c948a6-2003-4c07-97ce-9c2f0ecd2679 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e2e341401649898ed5a366da7e24e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811638c702ad48ac81d203aeac82dcee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:11.584360 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-44c948a6-2003-4c07-97ce-9c2f0ecd2679 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892" status: 200 len: 1270 microversion: 2.1 time: 0.151491 May 28 04:38:11.585601 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 675/1229] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:11 2022] GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892 => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:11.598334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-2b68fd47-f91c-4200-af8a-ee9e9a5a62ec req-fd3d4f47-d748-47c8-9a3a-71a50171833c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ceda1f-e500-41ce-a086-8bcd9979435a", "tag": "539b57c9-d282-4ec4-9581-f4091e5f2833"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:11.609653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2b68fd47-f91c-4200-af8a-ee9e9a5a62ec req-fd3d4f47-d748-47c8-9a3a-71a50171833c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:11.610100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2b68fd47-f91c-4200-af8a-ee9e9a5a62ec req-fd3d4f47-d748-47c8-9a3a-71a50171833c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:11.634919 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-2b68fd47-f91c-4200-af8a-ee9e9a5a62ec req-fd3d4f47-d748-47c8-9a3a-71a50171833c service nova] Creating event network-changed:539b57c9-d282-4ec4-9581-f4091e5f2833 for instance 90ceda1f-e500-41ce-a086-8bcd9979435a on n-h1-843700-1 May 28 04:38:11.644096 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-2b68fd47-f91c-4200-af8a-ee9e9a5a62ec req-fd3d4f47-d748-47c8-9a3a-71a50171833c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056394 May 28 04:38:11.644746 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 676/1230] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:11.793073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-52562ed2-ac1b-4ca0-88ec-83d486afda59 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:11.793843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-52562ed2-ac1b-4ca0-88ec-83d486afda59 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:11.800640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52562ed2-ac1b-4ca0-88ec-83d486afda59 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:11.801130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52562ed2-ac1b-4ca0-88ec-83d486afda59 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:11.802087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52562ed2-ac1b-4ca0-88ec-83d486afda59 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:11.802533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52562ed2-ac1b-4ca0-88ec-83d486afda59 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:12.009176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-49a7a991-822f-4d70-b416-1ada8e9becb6 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:12.019680 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-49a7a991-822f-4d70-b416-1ada8e9becb6 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 200 len: 1315 microversion: 2.1 time: 0.477061 May 28 04:38:12.020877 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 555/1231] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:11 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:12.252862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-508a8a47-08c1-41f6-8c43-ab175f32dc6d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:12.253490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-508a8a47-08c1-41f6-8c43-ab175f32dc6d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:12.260354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-508a8a47-08c1-41f6-8c43-ab175f32dc6d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:12.260901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-508a8a47-08c1-41f6-8c43-ab175f32dc6d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:12.261766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-508a8a47-08c1-41f6-8c43-ab175f32dc6d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:12.262631 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-508a8a47-08c1-41f6-8c43-ab175f32dc6d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:12.552909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-52562ed2-ac1b-4ca0-88ec-83d486afda59 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:12.562881 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-52562ed2-ac1b-4ca0-88ec-83d486afda59 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.772702 May 28 04:38:12.579165 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 677/1232] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:11 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:38:12.595477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8d870828-f761-432d-b127-07dc84d4490c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:12.596958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8d870828-f761-432d-b127-07dc84d4490c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:12.605552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d870828-f761-432d-b127-07dc84d4490c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:12.606339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d870828-f761-432d-b127-07dc84d4490c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:12.607458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d870828-f761-432d-b127-07dc84d4490c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:12.609026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d870828-f761-432d-b127-07dc84d4490c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:12.614122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:12.663661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-508a8a47-08c1-41f6-8c43-ab175f32dc6d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:12.667192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:12.673775 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-508a8a47-08c1-41f6-8c43-ab175f32dc6d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1541 microversion: 2.1 time: 0.430135 May 28 04:38:12.680770 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 556/1233] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:12 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1541 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:38:12.705448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1969e7a3-90c6-46a9-bf5c-ff9e6c051c94 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:12.706517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1969e7a3-90c6-46a9-bf5c-ff9e6c051c94 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 565a3cb7-ae9f-41af-8e36-43b39b2e43e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:12.722045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1969e7a3-90c6-46a9-bf5c-ff9e6c051c94 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:12.722510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1969e7a3-90c6-46a9-bf5c-ff9e6c051c94 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:12.724112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1969e7a3-90c6-46a9-bf5c-ff9e6c051c94 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:12.724630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1969e7a3-90c6-46a9-bf5c-ff9e6c051c94 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:13.047729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8d870828-f761-432d-b127-07dc84d4490c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:13.058785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8d870828-f761-432d-b127-07dc84d4490c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:13.066370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1969e7a3-90c6-46a9-bf5c-ff9e6c051c94 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:13.068729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8d870828-f761-432d-b127-07dc84d4490c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:13.073926 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1969e7a3-90c6-46a9-bf5c-ff9e6c051c94 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8" status: 200 len: 1319 microversion: 2.1 time: 0.391644 May 28 04:38:13.074519 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 557/1234] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:12 2022] GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8 => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:13.077987 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8d870828-f761-432d-b127-07dc84d4490c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.488928 May 28 04:38:13.079620 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 678/1235] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:12 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:13.084957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e3e446be-01f1-48ba-ac45-56033626f0cc tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:13.091907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e3e446be-01f1-48ba-ac45-56033626f0cc tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:13.105707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-590efeab-e7c1-4271-8794-5e342817fb4d tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '.version_select at 0x7f7701b4e8b0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:13.124989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3e446be-01f1-48ba-ac45-56033626f0cc tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:13.127636 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3e446be-01f1-48ba-ac45-56033626f0cc tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:13.127636 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3e446be-01f1-48ba-ac45-56033626f0cc tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:13.127636 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3e446be-01f1-48ba-ac45-56033626f0cc tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:13.135044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-590efeab-e7c1-4271-8794-5e342817fb4d tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:13.135791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-590efeab-e7c1-4271-8794-5e342817fb4d tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:13.167057 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-590efeab-e7c1-4271-8794-5e342817fb4d tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 3115 microversion: 2.1 time: 0.085463 May 28 04:38:13.168040 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 679/1236] 10.222.0.58 () {58 vars in 1142 bytes} [Sat May 28 04:38:13 2022] GET /compute/v2.1/os-migrations => generated 3115 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:13.173566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-9def963d-a48c-4b53-8f65-fe164c10c937 req-35dbd628-83ff-41cf-9ece-c12c9a6f80a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95514daa-06bd-483c-bd44-b9a7aa12b51c", "name": "network-vif-plugged", "status": "completed", "tag": "a3934b31-3593-413f-bf33-dffe073500de"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:13.193716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-9def963d-a48c-4b53-8f65-fe164c10c937 req-35dbd628-83ff-41cf-9ece-c12c9a6f80a9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:13.195806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-9def963d-a48c-4b53-8f65-fe164c10c937 req-35dbd628-83ff-41cf-9ece-c12c9a6f80a9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:13.221443 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-9def963d-a48c-4b53-8f65-fe164c10c937 req-35dbd628-83ff-41cf-9ece-c12c9a6f80a9 service nova] Creating event network-vif-plugged:a3934b31-3593-413f-bf33-dffe073500de for instance 95514daa-06bd-483c-bd44-b9a7aa12b51c on n-h1-843700-1 May 28 04:38:13.230793 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-9def963d-a48c-4b53-8f65-fe164c10c937 req-35dbd628-83ff-41cf-9ece-c12c9a6f80a9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061304 May 28 04:38:13.231487 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 680/1237] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:13.246464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-acaa38f8-4cd4-4e46-a0cd-f6cd5a547b14 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:13.249626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-acaa38f8-4cd4-4e46-a0cd-f6cd5a547b14 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:13.267387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-acaa38f8-4cd4-4e46-a0cd-f6cd5a547b14 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:13.267387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-acaa38f8-4cd4-4e46-a0cd-f6cd5a547b14 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:13.267387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-acaa38f8-4cd4-4e46-a0cd-f6cd5a547b14 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:13.267387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-acaa38f8-4cd4-4e46-a0cd-f6cd5a547b14 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:13.272980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e3e446be-01f1-48ba-ac45-56033626f0cc tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e2e341401649898ed5a366da7e24e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811638c702ad48ac81d203aeac82dcee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:13.283118 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e3e446be-01f1-48ba-ac45-56033626f0cc tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892" status: 200 len: 1322 microversion: 2.1 time: 0.203741 May 28 04:38:13.287633 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 558/1238] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:13 2022] GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:13.300623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-821b54dc-5e46-4826-aced-38dc6b55167d tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:13.305100 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-821b54dc-5e46-4826-aced-38dc6b55167d tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:13.314418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-821b54dc-5e46-4826-aced-38dc6b55167d tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:13.314884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-821b54dc-5e46-4826-aced-38dc6b55167d tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:13.315731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-821b54dc-5e46-4826-aced-38dc6b55167d tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:13.316169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-821b54dc-5e46-4826-aced-38dc6b55167d tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:13.642363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-acaa38f8-4cd4-4e46-a0cd-f6cd5a547b14 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:13.650860 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-acaa38f8-4cd4-4e46-a0cd-f6cd5a547b14 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 200 len: 1315 microversion: 2.1 time: 0.418221 May 28 04:38:13.651658 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 681/1239] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:13 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:13.656715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-efd01766-8805-421a-9479-d711f4a0ff10 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:13.657308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-efd01766-8805-421a-9479-d711f4a0ff10 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:13.663865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efd01766-8805-421a-9479-d711f4a0ff10 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:13.664419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efd01766-8805-421a-9479-d711f4a0ff10 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:13.665197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efd01766-8805-421a-9479-d711f4a0ff10 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:13.665633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efd01766-8805-421a-9479-d711f4a0ff10 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:13.675086 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-821b54dc-5e46-4826-aced-38dc6b55167d tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1692 microversion: 2.1 time: 0.379023 May 28 04:38:13.675802 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 559/1240] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:13 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1692 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:13.691708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4058fc16-3b15-43ac-96cd-c4d654513b69 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:13.692563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4058fc16-3b15-43ac-96cd-c4d654513b69 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:13.699087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4058fc16-3b15-43ac-96cd-c4d654513b69 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:13.699532 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4058fc16-3b15-43ac-96cd-c4d654513b69 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:13.700295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4058fc16-3b15-43ac-96cd-c4d654513b69 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:13.700727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4058fc16-3b15-43ac-96cd-c4d654513b69 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:14.057671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=36 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:14.244012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-efd01766-8805-421a-9479-d711f4a0ff10 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:14.253224 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-efd01766-8805-421a-9479-d711f4a0ff10 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1542 microversion: 2.1 time: 0.600533 May 28 04:38:14.272712 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 682/1241] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:13 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1542 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:14.277507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-590eaef0-b149-4b04-8426-b43ea7cb6415 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:14.277507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-590eaef0-b149-4b04-8426-b43ea7cb6415 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 565a3cb7-ae9f-41af-8e36-43b39b2e43e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:14.286529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-590eaef0-b149-4b04-8426-b43ea7cb6415 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:14.287217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-590eaef0-b149-4b04-8426-b43ea7cb6415 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:14.288018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-590eaef0-b149-4b04-8426-b43ea7cb6415 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:14.288463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-590eaef0-b149-4b04-8426-b43ea7cb6415 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:14.344183 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4058fc16-3b15-43ac-96cd-c4d654513b69 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1692 microversion: 2.1 time: 0.656149 May 28 04:38:14.356401 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 560/1242] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:13 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1692 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:38:14.363606 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f70a40ef-7fc1-460b-8fdc-95a85b9245a7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:14.372057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f70a40ef-7fc1-460b-8fdc-95a85b9245a7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:14.372057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f70a40ef-7fc1-460b-8fdc-95a85b9245a7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:14.372596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f70a40ef-7fc1-460b-8fdc-95a85b9245a7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:14.373382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f70a40ef-7fc1-460b-8fdc-95a85b9245a7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:14.374360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f70a40ef-7fc1-460b-8fdc-95a85b9245a7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:14.663658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-590eaef0-b149-4b04-8426-b43ea7cb6415 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:14.676103 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-590eaef0-b149-4b04-8426-b43ea7cb6415 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8" status: 200 len: 1319 microversion: 2.1 time: 0.410410 May 28 04:38:14.677695 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 683/1243] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:14 2022] GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8 => generated 1319 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:14.684929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef9033fd-a370-4ff0-9414-8f2c3ce8432d tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:14.685945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ef9033fd-a370-4ff0-9414-8f2c3ce8432d tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:14.705036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef9033fd-a370-4ff0-9414-8f2c3ce8432d tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:14.706490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef9033fd-a370-4ff0-9414-8f2c3ce8432d tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:14.707968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef9033fd-a370-4ff0-9414-8f2c3ce8432d tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:14.708693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef9033fd-a370-4ff0-9414-8f2c3ce8432d tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:14.806182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f70a40ef-7fc1-460b-8fdc-95a85b9245a7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:14.817364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f70a40ef-7fc1-460b-8fdc-95a85b9245a7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:14.820000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f70a40ef-7fc1-460b-8fdc-95a85b9245a7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:14.821485 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f70a40ef-7fc1-460b-8fdc-95a85b9245a7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.463692 May 28 04:38:14.834508 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 561/1244] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:14 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:14.835755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef9033fd-a370-4ff0-9414-8f2c3ce8432d tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e2e341401649898ed5a366da7e24e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811638c702ad48ac81d203aeac82dcee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:14.840606 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4a1c7f32-65fe-43cd-b7a1-dd7c55167987 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:14.841441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4a1c7f32-65fe-43cd-b7a1-dd7c55167987 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:14.848040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4a1c7f32-65fe-43cd-b7a1-dd7c55167987 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:14.848813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4a1c7f32-65fe-43cd-b7a1-dd7c55167987 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:14.849814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4a1c7f32-65fe-43cd-b7a1-dd7c55167987 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:14.850450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4a1c7f32-65fe-43cd-b7a1-dd7c55167987 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:14.853838 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ef9033fd-a370-4ff0-9414-8f2c3ce8432d tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892" status: 200 len: 1328 microversion: 2.1 time: 0.173944 May 28 04:38:14.858525 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 684/1245] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:14 2022] GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892 => generated 1328 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:14.870289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2e230ed5-33d5-427d-889e-e43491cff5e5 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:14.870907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2e230ed5-33d5-427d-889e-e43491cff5e5 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:14.880675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e230ed5-33d5-427d-889e-e43491cff5e5 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:14.881134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e230ed5-33d5-427d-889e-e43491cff5e5 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:14.882027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e230ed5-33d5-427d-889e-e43491cff5e5 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:14.882400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e230ed5-33d5-427d-889e-e43491cff5e5 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:15.060531 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-4a1c7f32-65fe-43cd-b7a1-dd7c55167987 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lazy-loading 'services' on Instance uuid 67f64b8b-70f7-43c3-85df-66f0e9104617 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:38:15.191933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2e230ed5-33d5-427d-889e-e43491cff5e5 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:15.199904 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2e230ed5-33d5-427d-889e-e43491cff5e5 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 200 len: 1315 microversion: 2.1 time: 0.333693 May 28 04:38:15.201133 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 685/1246] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:14 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:15.288560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a361e991-9d76-4734-8a4d-63c6379f54f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:15.291451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a361e991-9d76-4734-8a4d-63c6379f54f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:15.304388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a361e991-9d76-4734-8a4d-63c6379f54f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:15.305580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a361e991-9d76-4734-8a4d-63c6379f54f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:15.306446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a361e991-9d76-4734-8a4d-63c6379f54f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:15.306964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a361e991-9d76-4734-8a4d-63c6379f54f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:15.409668 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4a1c7f32-65fe-43cd-b7a1-dd7c55167987 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "DELETE /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617/os-volume_attachments/5452aff9-3213-4393-945d-6b7505959125" status: 202 len: 0 microversion: 2.1 time: 0.574102 May 28 04:38:15.411339 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 562/1247] 10.222.0.58 () {58 vars in 1415 bytes} [Sat May 28 04:38:14 2022] DELETE /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617/os-volume_attachments/5452aff9-3213-4393-945d-6b7505959125 => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:38:15.423476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-57c5465b-72d9-4b9b-9d5a-304a493985ad req-4e612844-f0b5-4899-9ad4-27af049679d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "565a3cb7-ae9f-41af-8e36-43b39b2e43e8", "name": "network-vif-plugged", "status": "completed", "tag": "02c55ea3-528b-43eb-907c-789ef583cf3b"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:15.442331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-57c5465b-72d9-4b9b-9d5a-304a493985ad req-4e612844-f0b5-4899-9ad4-27af049679d3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:15.447521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-57c5465b-72d9-4b9b-9d5a-304a493985ad req-4e612844-f0b5-4899-9ad4-27af049679d3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:15.477762 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-57c5465b-72d9-4b9b-9d5a-304a493985ad req-4e612844-f0b5-4899-9ad4-27af049679d3 service nova] Creating event network-vif-plugged:02c55ea3-528b-43eb-907c-789ef583cf3b for instance 565a3cb7-ae9f-41af-8e36-43b39b2e43e8 on n-h1-843700-1 May 28 04:38:15.484300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a361e991-9d76-4734-8a4d-63c6379f54f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:15.497951 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a361e991-9d76-4734-8a4d-63c6379f54f0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1541 microversion: 2.1 time: 0.221504 May 28 04:38:15.512713 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-57c5465b-72d9-4b9b-9d5a-304a493985ad req-4e612844-f0b5-4899-9ad4-27af049679d3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087274 May 28 04:38:15.512713 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 563/1248] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:15.513959 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 686/1249] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:15 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1541 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:38:15.527491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5ccacf82-6124-4ac9-b078-1f9c53765a41 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:15.528885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5ccacf82-6124-4ac9-b078-1f9c53765a41 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:15.538495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ccacf82-6124-4ac9-b078-1f9c53765a41 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:15.538956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ccacf82-6124-4ac9-b078-1f9c53765a41 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:15.540639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ccacf82-6124-4ac9-b078-1f9c53765a41 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:15.541097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ccacf82-6124-4ac9-b078-1f9c53765a41 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:15.587008 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5ccacf82-6124-4ac9-b078-1f9c53765a41 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084242 May 28 04:38:15.588149 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 564/1250] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:38:15 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:15.622740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-12e44803-5a90-4852-962b-f93679dbdd99 tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] Action: 'create', calling method: .version_select at 0x7f77075f21f0>, body: {"pool": null} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:15.693604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e4e17cf2-e31c-4a13-8668-d6cdafea4967 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:15.694622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e4e17cf2-e31c-4a13-8668-d6cdafea4967 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 565a3cb7-ae9f-41af-8e36-43b39b2e43e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:15.701397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4e17cf2-e31c-4a13-8668-d6cdafea4967 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:15.702476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4e17cf2-e31c-4a13-8668-d6cdafea4967 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:15.703296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4e17cf2-e31c-4a13-8668-d6cdafea4967 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:15.706736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4e17cf2-e31c-4a13-8668-d6cdafea4967 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:15.978737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e4e17cf2-e31c-4a13-8668-d6cdafea4967 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:15.994547 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e4e17cf2-e31c-4a13-8668-d6cdafea4967 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8" status: 200 len: 1319 microversion: 2.1 time: 0.304852 May 28 04:38:16.005246 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 565/1251] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:15 2022] GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8 => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:38:16.010924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f161cc0e-2b3c-4250-b5db-0cbbacaf67bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:16.012579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f161cc0e-2b3c-4250-b5db-0cbbacaf67bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:16.018870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f161cc0e-2b3c-4250-b5db-0cbbacaf67bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:16.019648 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f161cc0e-2b3c-4250-b5db-0cbbacaf67bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:16.020521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f161cc0e-2b3c-4250-b5db-0cbbacaf67bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:16.021087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f161cc0e-2b3c-4250-b5db-0cbbacaf67bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:16.436342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f161cc0e-2b3c-4250-b5db-0cbbacaf67bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:16.441372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f161cc0e-2b3c-4250-b5db-0cbbacaf67bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:16.443292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f161cc0e-2b3c-4250-b5db-0cbbacaf67bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:16.444570 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f161cc0e-2b3c-4250-b5db-0cbbacaf67bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.437918 May 28 04:38:16.445214 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 566/1252] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:16 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:16.450245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dfb16c14-a0c9-4743-b82d-d7fe71f6fc1c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:16.451173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dfb16c14-a0c9-4743-b82d-d7fe71f6fc1c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:16.459906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfb16c14-a0c9-4743-b82d-d7fe71f6fc1c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:16.460484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfb16c14-a0c9-4743-b82d-d7fe71f6fc1c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:16.461339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfb16c14-a0c9-4743-b82d-d7fe71f6fc1c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:16.461853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfb16c14-a0c9-4743-b82d-d7fe71f6fc1c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:17.054353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dfb16c14-a0c9-4743-b82d-d7fe71f6fc1c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e2e341401649898ed5a366da7e24e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811638c702ad48ac81d203aeac82dcee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:17.063855 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dfb16c14-a0c9-4743-b82d-d7fe71f6fc1c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892" status: 200 len: 1396 microversion: 2.1 time: 0.617371 May 28 04:38:17.069312 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 567/1253] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:16 2022] GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892 => generated 1396 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:17.074231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5c08beb4-ae1a-4b70-9daa-c79c591dc3a8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:17.085940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5c08beb4-ae1a-4b70-9daa-c79c591dc3a8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:17.097257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c08beb4-ae1a-4b70-9daa-c79c591dc3a8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:17.100151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c08beb4-ae1a-4b70-9daa-c79c591dc3a8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:17.101274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c08beb4-ae1a-4b70-9daa-c79c591dc3a8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:17.103331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c08beb4-ae1a-4b70-9daa-c79c591dc3a8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:17.726617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5c08beb4-ae1a-4b70-9daa-c79c591dc3a8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:17.740111 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5c08beb4-ae1a-4b70-9daa-c79c591dc3a8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 200 len: 1315 microversion: 2.1 time: 0.668747 May 28 04:38:17.741419 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 568/1254] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:17 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 1315 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:17.760802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-51a31a55-2e2b-4d66-a420-6dd81dfbab74 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:17.763714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-51a31a55-2e2b-4d66-a420-6dd81dfbab74 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:17.777616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-51a31a55-2e2b-4d66-a420-6dd81dfbab74 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:17.785238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-51a31a55-2e2b-4d66-a420-6dd81dfbab74 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:17.787595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-51a31a55-2e2b-4d66-a420-6dd81dfbab74 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:17.788175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-51a31a55-2e2b-4d66-a420-6dd81dfbab74 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:18.401465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-51a31a55-2e2b-4d66-a420-6dd81dfbab74 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:18.411355 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-51a31a55-2e2b-4d66-a420-6dd81dfbab74 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1541 microversion: 2.1 time: 0.662042 May 28 04:38:18.411948 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 569/1255] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:17 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1541 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:18.423753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4bc49c6e-31e8-43a0-8dff-bc98160a266b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:18.425053 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4bc49c6e-31e8-43a0-8dff-bc98160a266b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:18.440858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:18.443886 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4bc49c6e-31e8-43a0-8dff-bc98160a266b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:18.444530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4bc49c6e-31e8-43a0-8dff-bc98160a266b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:18.446089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4bc49c6e-31e8-43a0-8dff-bc98160a266b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:18.457216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4bc49c6e-31e8-43a0-8dff-bc98160a266b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:18.494956 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4bc49c6e-31e8-43a0-8dff-bc98160a266b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081873 May 28 04:38:18.502229 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 570/1256] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:38:18 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:18.505326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-3e276709-892d-4e2d-bcb7-8f7236354252 req-33bff62e-2fa5-465e-9b8a-ee68e904f13d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18cb68a1-94a5-4af2-a376-46e7493e7454", "name": "network-vif-unplugged", "status": "completed", "tag": "453ca3f5-cda2-4f33-aa1e-444133d83763"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:18.515778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3e276709-892d-4e2d-bcb7-8f7236354252 req-33bff62e-2fa5-465e-9b8a-ee68e904f13d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:18.516452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3e276709-892d-4e2d-bcb7-8f7236354252 req-33bff62e-2fa5-465e-9b8a-ee68e904f13d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:18.529133 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-3e276709-892d-4e2d-bcb7-8f7236354252 req-33bff62e-2fa5-465e-9b8a-ee68e904f13d service nova] Creating event network-vif-unplugged:453ca3f5-cda2-4f33-aa1e-444133d83763 for instance 18cb68a1-94a5-4af2-a376-46e7493e7454 on n-h2-843700-1 May 28 04:38:18.535498 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-3e276709-892d-4e2d-bcb7-8f7236354252 req-33bff62e-2fa5-465e-9b8a-ee68e904f13d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033721 May 28 04:38:18.536684 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 571/1257] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:18.543950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cf1c4c93-d138-4ada-bd71-4046b702ff8c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:18.544849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cf1c4c93-d138-4ada-bd71-4046b702ff8c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 565a3cb7-ae9f-41af-8e36-43b39b2e43e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:18.554067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf1c4c93-d138-4ada-bd71-4046b702ff8c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:18.554067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf1c4c93-d138-4ada-bd71-4046b702ff8c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:18.554402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf1c4c93-d138-4ada-bd71-4046b702ff8c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:18.554863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf1c4c93-d138-4ada-bd71-4046b702ff8c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:19.063839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cf1c4c93-d138-4ada-bd71-4046b702ff8c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:19.077270 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cf1c4c93-d138-4ada-bd71-4046b702ff8c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8" status: 200 len: 1469 microversion: 2.1 time: 0.536893 May 28 04:38:19.080505 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 572/1258] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:18 2022] GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8 => generated 1469 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:19.088535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-30e161aa-6f2d-4323-b42d-2fb4a02c1dc7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:19.093808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-30e161aa-6f2d-4323-b42d-2fb4a02c1dc7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:19.104585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-30e161aa-6f2d-4323-b42d-2fb4a02c1dc7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:19.105048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-30e161aa-6f2d-4323-b42d-2fb4a02c1dc7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:19.107191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-30e161aa-6f2d-4323-b42d-2fb4a02c1dc7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:19.108804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-30e161aa-6f2d-4323-b42d-2fb4a02c1dc7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:19.679805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-30e161aa-6f2d-4323-b42d-2fb4a02c1dc7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:19.702693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-30e161aa-6f2d-4323-b42d-2fb4a02c1dc7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:19.708419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-30e161aa-6f2d-4323-b42d-2fb4a02c1dc7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:19.711686 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-30e161aa-6f2d-4323-b42d-2fb4a02c1dc7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.629961 May 28 04:38:19.712457 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 573/1259] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:19 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:19.718378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-11737e29-74e7-4b19-891b-6a7088be2c26 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:19.719230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-11737e29-74e7-4b19-891b-6a7088be2c26 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:19.726909 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11737e29-74e7-4b19-891b-6a7088be2c26 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:19.727600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11737e29-74e7-4b19-891b-6a7088be2c26 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:19.728389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11737e29-74e7-4b19-891b-6a7088be2c26 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:19.729024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11737e29-74e7-4b19-891b-6a7088be2c26 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:19.736610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:20.040243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-11737e29-74e7-4b19-891b-6a7088be2c26 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e2e341401649898ed5a366da7e24e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811638c702ad48ac81d203aeac82dcee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:20.054063 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-11737e29-74e7-4b19-891b-6a7088be2c26 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892" status: 200 len: 1396 microversion: 2.1 time: 0.340275 May 28 04:38:20.055026 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 574/1260] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:19 2022] GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892 => generated 1396 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:20.060605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-f51b57a2-4c20-4bd3-86c6-1d9e5abf7348 req-4dd01d11-94ca-4819-ac6e-e87eb8b40004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17bf9454-cf2b-4049-b817-556e4c74b350", "name": "network-vif-unplugged", "status": "completed", "tag": "9a1c5bed-5c2a-4af6-98f9-e6c6cf8a4d4c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:20.070906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f51b57a2-4c20-4bd3-86c6-1d9e5abf7348 req-4dd01d11-94ca-4819-ac6e-e87eb8b40004 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:20.073994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f51b57a2-4c20-4bd3-86c6-1d9e5abf7348 req-4dd01d11-94ca-4819-ac6e-e87eb8b40004 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:20.088926 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-f51b57a2-4c20-4bd3-86c6-1d9e5abf7348 req-4dd01d11-94ca-4819-ac6e-e87eb8b40004 service nova] Creating event network-vif-unplugged:9a1c5bed-5c2a-4af6-98f9-e6c6cf8a4d4c for instance 17bf9454-cf2b-4049-b817-556e4c74b350 on n-h1-843700-1 May 28 04:38:20.095402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-f51b57a2-4c20-4bd3-86c6-1d9e5abf7348 req-4dd01d11-94ca-4819-ac6e-e87eb8b40004 service nova] Instance 17bf9454-cf2b-4049-b817-556e4c74b350 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:38:20.107562 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-f51b57a2-4c20-4bd3-86c6-1d9e5abf7348 req-4dd01d11-94ca-4819-ac6e-e87eb8b40004 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050565 May 28 04:38:20.108769 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 575/1261] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:20.116761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e5939f96-0adb-4895-9e6a-55447f97bbbb tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:20.116761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e5939f96-0adb-4895-9e6a-55447f97bbbb tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:20.125901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e5939f96-0adb-4895-9e6a-55447f97bbbb tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:20.126835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e5939f96-0adb-4895-9e6a-55447f97bbbb tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:20.127922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e5939f96-0adb-4895-9e6a-55447f97bbbb tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:20.128818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e5939f96-0adb-4895-9e6a-55447f97bbbb tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:20.408305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e5939f96-0adb-4895-9e6a-55447f97bbbb tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:20.417805 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e5939f96-0adb-4895-9e6a-55447f97bbbb tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 200 len: 1315 microversion: 2.1 time: 0.307616 May 28 04:38:20.418388 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 576/1262] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:20 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:20.424537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b809ca3f-ff80-4943-9ac9-a6fa1f6509df tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:20.425379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b809ca3f-ff80-4943-9ac9-a6fa1f6509df tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 95514daa-06bd-483c-bd44-b9a7aa12b51c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:20.431789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b809ca3f-ff80-4943-9ac9-a6fa1f6509df tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:20.434564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b809ca3f-ff80-4943-9ac9-a6fa1f6509df tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:20.434564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b809ca3f-ff80-4943-9ac9-a6fa1f6509df tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:20.434564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b809ca3f-ff80-4943-9ac9-a6fa1f6509df tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:20.456850 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-12e44803-5a90-4852-962b-f93679dbdd99 tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.930926 May 28 04:38:20.461669 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 687/1263] 10.222.0.58 () {60 vars in 1169 bytes} [Sat May 28 04:38:15 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:20.462758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a6fef00a-93b9-4570-92f2-e6f6a870924c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:20.464161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a6fef00a-93b9-4570-92f2-e6f6a870924c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:20.472483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6fef00a-93b9-4570-92f2-e6f6a870924c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:20.473151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6fef00a-93b9-4570-92f2-e6f6a870924c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:20.473959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6fef00a-93b9-4570-92f2-e6f6a870924c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:20.474449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6fef00a-93b9-4570-92f2-e6f6a870924c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:20.650458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b809ca3f-ff80-4943-9ac9-a6fa1f6509df tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:20.658005 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b809ca3f-ff80-4943-9ac9-a6fa1f6509df tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/95514daa-06bd-483c-bd44-b9a7aa12b51c" status: 200 len: 1469 microversion: 2.1 time: 0.238461 May 28 04:38:20.658891 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 577/1264] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:20 2022] GET /compute/v2.1/servers/95514daa-06bd-483c-bd44-b9a7aa12b51c => generated 1469 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:20.663831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bd019207-3de1-49ff-a1fb-26bf87ac70b3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:20.670277 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bd019207-3de1-49ff-a1fb-26bf87ac70b3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:20.672200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd019207-3de1-49ff-a1fb-26bf87ac70b3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:20.673252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd019207-3de1-49ff-a1fb-26bf87ac70b3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:20.674096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd019207-3de1-49ff-a1fb-26bf87ac70b3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:20.675306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd019207-3de1-49ff-a1fb-26bf87ac70b3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:20.689636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a6fef00a-93b9-4570-92f2-e6f6a870924c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:20.697585 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a6fef00a-93b9-4570-92f2-e6f6a870924c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1541 microversion: 2.1 time: 0.239105 May 28 04:38:20.698169 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 688/1265] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:20 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1541 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:20.704032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a5955c2d-ce67-4179-b11a-16c6ebcc15ba tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] Action: 'create', calling method: .version_select at 0x7f77075f2b80>, body: {"pool": null} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:20.712197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:20.715575 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bd019207-3de1-49ff-a1fb-26bf87ac70b3 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054605 May 28 04:38:20.715709 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 578/1266] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:38:20 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:20.720651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-871f88a6-989a-4529-a37f-582e0c24a119 req-280a8a47-69a1-45ca-a06d-b22a3e50d5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d08c157a-afe1-41d5-8199-65e1b838d892", "tag": "e6d43522-ea01-42b0-be39-ee92dd8cd1b2"}, {"name": "network-changed", "server_uuid": "18cb68a1-94a5-4af2-a376-46e7493e7454", "tag": "453ca3f5-cda2-4f33-aa1e-444133d83763"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:20.734270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-871f88a6-989a-4529-a37f-582e0c24a119 req-280a8a47-69a1-45ca-a06d-b22a3e50d5c4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:20.735213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-871f88a6-989a-4529-a37f-582e0c24a119 req-280a8a47-69a1-45ca-a06d-b22a3e50d5c4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:20.751494 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-871f88a6-989a-4529-a37f-582e0c24a119 req-280a8a47-69a1-45ca-a06d-b22a3e50d5c4 service nova] Creating event network-changed:e6d43522-ea01-42b0-be39-ee92dd8cd1b2 for instance d08c157a-afe1-41d5-8199-65e1b838d892 on n-h1-843700-1 May 28 04:38:20.752360 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-871f88a6-989a-4529-a37f-582e0c24a119 req-280a8a47-69a1-45ca-a06d-b22a3e50d5c4 service nova] Creating event network-changed:453ca3f5-cda2-4f33-aa1e-444133d83763 for instance 18cb68a1-94a5-4af2-a376-46e7493e7454 on n-h2-843700-1 May 28 04:38:20.769003 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-871f88a6-989a-4529-a37f-582e0c24a119 req-280a8a47-69a1-45ca-a06d-b22a3e50d5c4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.051728 May 28 04:38:20.770478 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 579/1267] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:20.789550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-44745421-b750-4193-a577-8d8e5cb364fc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:20.794717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-44745421-b750-4193-a577-8d8e5cb364fc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:20.797672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-44745421-b750-4193-a577-8d8e5cb364fc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Searching by: {'reservation_id': 'r-r09hrlbm', 'deleted': False, 'project_id': 'e7a5b721a538475cbac9c95c61647753'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:38:20.804417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44745421-b750-4193-a577-8d8e5cb364fc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:20.805831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44745421-b750-4193-a577-8d8e5cb364fc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:20.807468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44745421-b750-4193-a577-8d8e5cb364fc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:20.807994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44745421-b750-4193-a577-8d8e5cb364fc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:20.993349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-44745421-b750-4193-a577-8d8e5cb364fc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:38:21.109668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-44745421-b750-4193-a577-8d8e5cb364fc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:21.118028 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44745421-b750-4193-a577-8d8e5cb364fc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:21.118740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44745421-b750-4193-a577-8d8e5cb364fc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:21.467139 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-44745421-b750-4193-a577-8d8e5cb364fc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?reservation_id=r-r09hrlbm" status: 200 len: 2931 microversion: 2.1 time: 0.683864 May 28 04:38:21.467139 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 580/1268] 10.222.0.58 () {58 vars in 1196 bytes} [Sat May 28 04:38:20 2022] GET /compute/v2.1/servers/detail?reservation_id=r-r09hrlbm => generated 2931 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:21.467139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e7abac71-a624-441b-9c5c-bdd4b3fb2912 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:21.467139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e7abac71-a624-441b-9c5c-bdd4b3fb2912 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:21.474017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e7abac71-a624-441b-9c5c-bdd4b3fb2912 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:21.474936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e7abac71-a624-441b-9c5c-bdd4b3fb2912 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:21.476170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e7abac71-a624-441b-9c5c-bdd4b3fb2912 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:21.476722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e7abac71-a624-441b-9c5c-bdd4b3fb2912 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:21.579955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=22 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:22.116304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e7abac71-a624-441b-9c5c-bdd4b3fb2912 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:22.128967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e7abac71-a624-441b-9c5c-bdd4b3fb2912 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:22.132478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e7abac71-a624-441b-9c5c-bdd4b3fb2912 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:22.134056 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e7abac71-a624-441b-9c5c-bdd4b3fb2912 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.676501 May 28 04:38:22.134700 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 581/1269] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:21 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:22.140169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-043270cb-ee78-4d7e-b49e-b05bb1e34ba6 req-608e4e53-cf0a-4a78-9269-4f2d24d27213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ceda1f-e500-41ce-a086-8bcd9979435a", "name": "network-vif-plugged", "status": "completed", "tag": "539b57c9-d282-4ec4-9581-f4091e5f2833"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:22.150214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-043270cb-ee78-4d7e-b49e-b05bb1e34ba6 req-608e4e53-cf0a-4a78-9269-4f2d24d27213 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:22.151072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-043270cb-ee78-4d7e-b49e-b05bb1e34ba6 req-608e4e53-cf0a-4a78-9269-4f2d24d27213 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:22.163000 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-043270cb-ee78-4d7e-b49e-b05bb1e34ba6 req-608e4e53-cf0a-4a78-9269-4f2d24d27213 service nova] Creating event network-vif-plugged:539b57c9-d282-4ec4-9581-f4091e5f2833 for instance 90ceda1f-e500-41ce-a086-8bcd9979435a on n-h1-843700-1 May 28 04:38:22.168212 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-043270cb-ee78-4d7e-b49e-b05bb1e34ba6 req-608e4e53-cf0a-4a78-9269-4f2d24d27213 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032194 May 28 04:38:22.168986 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 582/1270] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:22.174824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-09ba53b8-0614-423f-8326-e57d42d29173 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:22.175821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-09ba53b8-0614-423f-8326-e57d42d29173 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:22.186448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09ba53b8-0614-423f-8326-e57d42d29173 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:22.186914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09ba53b8-0614-423f-8326-e57d42d29173 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:22.188143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09ba53b8-0614-423f-8326-e57d42d29173 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:22.189017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09ba53b8-0614-423f-8326-e57d42d29173 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:22.499524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-09ba53b8-0614-423f-8326-e57d42d29173 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e2e341401649898ed5a366da7e24e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811638c702ad48ac81d203aeac82dcee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:22.508320 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-09ba53b8-0614-423f-8326-e57d42d29173 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892" status: 200 len: 1396 microversion: 2.1 time: 0.337887 May 28 04:38:22.509765 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 583/1271] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:22 2022] GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892 => generated 1396 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:22.514077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e7b2f28c-46ac-4946-925f-9766d65bc9a0 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:22.514772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e7b2f28c-46ac-4946-925f-9766d65bc9a0 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:22.520937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e7b2f28c-46ac-4946-925f-9766d65bc9a0 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:22.521462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e7b2f28c-46ac-4946-925f-9766d65bc9a0 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:22.522247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e7b2f28c-46ac-4946-925f-9766d65bc9a0 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:22.522868 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e7b2f28c-46ac-4946-925f-9766d65bc9a0 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:22.669790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e7b2f28c-46ac-4946-925f-9766d65bc9a0 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:22.679378 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e7b2f28c-46ac-4946-925f-9766d65bc9a0 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 200 len: 1315 microversion: 2.1 time: 0.168703 May 28 04:38:22.680683 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 584/1272] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:22 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:22.685577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-80fff7ca-13d8-45eb-b788-e22f3f719420 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:22.703688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.compute.server_groups [None req-80fff7ca-13d8-45eb-b788-e22f3f719420 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Querying cell 8c12a9b9-d304-4763-b71f-4058d5ce2ded(cell1) for 2 instances {{(pid=126043) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 28 04:38:22.704857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80fff7ca-13d8-45eb-b788-e22f3f719420 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:22.705816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80fff7ca-13d8-45eb-b788-e22f3f719420 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:22.742014 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-80fff7ca-13d8-45eb-b788-e22f3f719420 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/55040dbc-5a65-4d89-abb3-32604ea8386a" status: 200 len: 266 microversion: 2.1 time: 0.060486 May 28 04:38:22.747261 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 585/1273] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 04:38:22 2022] GET /compute/v2.1/os-server-groups/55040dbc-5a65-4d89-abb3-32604ea8386a => generated 266 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:22.747791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-14bc91d6-462f-4cbb-8f7e-a91875c2fef7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:22.748486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-14bc91d6-462f-4cbb-8f7e-a91875c2fef7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:22.755833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-14bc91d6-462f-4cbb-8f7e-a91875c2fef7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:22.756001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-14bc91d6-462f-4cbb-8f7e-a91875c2fef7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:22.756753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-14bc91d6-462f-4cbb-8f7e-a91875c2fef7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:22.757193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-14bc91d6-462f-4cbb-8f7e-a91875c2fef7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:22.969654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-14bc91d6-462f-4cbb-8f7e-a91875c2fef7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:22.977597 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-14bc91d6-462f-4cbb-8f7e-a91875c2fef7 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1541 microversion: 2.1 time: 0.233644 May 28 04:38:22.978575 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 586/1274] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:22 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1541 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:22.983459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5623b776-1f62-4f0f-ba63-0ebe2acc9b8d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:22.984561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5623b776-1f62-4f0f-ba63-0ebe2acc9b8d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:22.991032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5623b776-1f62-4f0f-ba63-0ebe2acc9b8d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:22.991443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5623b776-1f62-4f0f-ba63-0ebe2acc9b8d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:22.992220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5623b776-1f62-4f0f-ba63-0ebe2acc9b8d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:22.992669 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5623b776-1f62-4f0f-ba63-0ebe2acc9b8d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:23.029252 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5623b776-1f62-4f0f-ba63-0ebe2acc9b8d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049282 May 28 04:38:23.030873 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 587/1275] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:38:22 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:23.037060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-9b107a1d-72f8-456b-93c9-fce571aad9de req-9265150a-6749-4b57-b056-c1dd2d0b0939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17bf9454-cf2b-4049-b817-556e4c74b350", "tag": "9a1c5bed-5c2a-4af6-98f9-e6c6cf8a4d4c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:23.052828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9b107a1d-72f8-456b-93c9-fce571aad9de req-9265150a-6749-4b57-b056-c1dd2d0b0939 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:23.053506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9b107a1d-72f8-456b-93c9-fce571aad9de req-9265150a-6749-4b57-b056-c1dd2d0b0939 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:23.070239 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-9b107a1d-72f8-456b-93c9-fce571aad9de req-9265150a-6749-4b57-b056-c1dd2d0b0939 service nova] Creating event network-changed:9a1c5bed-5c2a-4af6-98f9-e6c6cf8a4d4c for instance 17bf9454-cf2b-4049-b817-556e4c74b350 on n-h1-843700-1 May 28 04:38:23.078315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-9b107a1d-72f8-456b-93c9-fce571aad9de req-9265150a-6749-4b57-b056-c1dd2d0b0939 service nova] Instance 17bf9454-cf2b-4049-b817-556e4c74b350 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:38:23.091573 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-9b107a1d-72f8-456b-93c9-fce571aad9de req-9265150a-6749-4b57-b056-c1dd2d0b0939 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059223 May 28 04:38:23.092917 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 588/1276] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:23.109709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f20f764d-d7bc-463f-a013-d841dc747be4 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:23.111212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f20f764d-d7bc-463f-a013-d841dc747be4 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] [instance: 565a3cb7-ae9f-41af-8e36-43b39b2e43e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:23.121028 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f20f764d-d7bc-463f-a013-d841dc747be4 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:23.122202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f20f764d-d7bc-463f-a013-d841dc747be4 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:23.123211 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f20f764d-d7bc-463f-a013-d841dc747be4 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:23.124543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f20f764d-d7bc-463f-a013-d841dc747be4 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:23.337012 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f20f764d-d7bc-463f-a013-d841dc747be4 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8" status: 200 len: 1620 microversion: 2.1 time: 0.242014 May 28 04:38:23.348554 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 589/1277] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:23 2022] GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8 => generated 1620 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:23.353892 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-21c88180-5ae8-487c-8650-d0405670f55b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:23.354509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-21c88180-5ae8-487c-8650-d0405670f55b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:23.361850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21c88180-5ae8-487c-8650-d0405670f55b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:23.362301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21c88180-5ae8-487c-8650-d0405670f55b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:23.363156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21c88180-5ae8-487c-8650-d0405670f55b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:23.363597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21c88180-5ae8-487c-8650-d0405670f55b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:23.461874 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a5955c2d-ce67-4179-b11a-16c6ebcc15ba tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.760808 May 28 04:38:23.470432 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 689/1278] 10.222.0.58 () {60 vars in 1169 bytes} [Sat May 28 04:38:20 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:23.473916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-69d99680-20d4-4a7a-9020-317fbd6e734b tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:23.477840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-69d99680-20d4-4a7a-9020-317fbd6e734b tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] [instance: 95514daa-06bd-483c-bd44-b9a7aa12b51c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:23.485888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-69d99680-20d4-4a7a-9020-317fbd6e734b tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:23.486659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-69d99680-20d4-4a7a-9020-317fbd6e734b tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:23.487824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-69d99680-20d4-4a7a-9020-317fbd6e734b tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:23.488619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-69d99680-20d4-4a7a-9020-317fbd6e734b tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:23.564177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-21c88180-5ae8-487c-8650-d0405670f55b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:23.582670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-21c88180-5ae8-487c-8650-d0405670f55b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:23.586705 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-21c88180-5ae8-487c-8650-d0405670f55b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:23.588162 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-21c88180-5ae8-487c-8650-d0405670f55b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.238369 May 28 04:38:23.589540 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 590/1279] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:23 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:23.596088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d081d4bf-78ce-447a-b714-d1705749d028 tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] Action: 'create', calling method: .version_select at 0x7f7701a51790>, body: {"pool": null} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:23.743204 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-69d99680-20d4-4a7a-9020-317fbd6e734b tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/95514daa-06bd-483c-bd44-b9a7aa12b51c" status: 200 len: 1620 microversion: 2.1 time: 0.273599 May 28 04:38:23.744269 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 690/1280] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:23 2022] GET /compute/v2.1/servers/95514daa-06bd-483c-bd44-b9a7aa12b51c => generated 1620 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:23.751483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1eb8d4d5-1d24-43f1-ab5a-1eab9a1cbf2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:23.752609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1eb8d4d5-1d24-43f1-ab5a-1eab9a1cbf2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:23.769937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1eb8d4d5-1d24-43f1-ab5a-1eab9a1cbf2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:23.770399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1eb8d4d5-1d24-43f1-ab5a-1eab9a1cbf2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:23.771232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1eb8d4d5-1d24-43f1-ab5a-1eab9a1cbf2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:23.771838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1eb8d4d5-1d24-43f1-ab5a-1eab9a1cbf2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:24.107554 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1eb8d4d5-1d24-43f1-ab5a-1eab9a1cbf2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e2e341401649898ed5a366da7e24e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811638c702ad48ac81d203aeac82dcee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:24.138036 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1eb8d4d5-1d24-43f1-ab5a-1eab9a1cbf2c tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892" status: 200 len: 1396 microversion: 2.1 time: 0.392261 May 28 04:38:24.148582 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 691/1281] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:23 2022] GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892 => generated 1396 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:24.149653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4f01e6e6-0707-4739-8f05-61110ed38690 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:24.152050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4f01e6e6-0707-4739-8f05-61110ed38690 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:24.159059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f01e6e6-0707-4739-8f05-61110ed38690 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:24.159968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f01e6e6-0707-4739-8f05-61110ed38690 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:24.160972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f01e6e6-0707-4739-8f05-61110ed38690 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:24.161570 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f01e6e6-0707-4739-8f05-61110ed38690 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:24.366143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4f01e6e6-0707-4739-8f05-61110ed38690 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:24.375388 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4f01e6e6-0707-4739-8f05-61110ed38690 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 200 len: 1315 microversion: 2.1 time: 0.229660 May 28 04:38:24.378616 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 692/1282] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:24 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:24.385531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-50d0b764-dfb2-471e-beb1-683ea1854da8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Action: 'create', calling method: .version_select at 0x7f7701b4e700>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-426883168", "policies": ["anti-affinity"]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:24.407269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-50d0b764-dfb2-471e-beb1-683ea1854da8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for project e7a5b721a538475cbac9c95c61647753. Resources: {'server_groups'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:38:24.413034 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-50d0b764-dfb2-471e-beb1-683ea1854da8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for user d398d45627fc4d33bc9a736ddf8f9215 and project e7a5b721a538475cbac9c95c61647753. Resources: {'server_groups'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:38:24.523440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-50d0b764-dfb2-471e-beb1-683ea1854da8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for project e7a5b721a538475cbac9c95c61647753. Resources: {'server_groups'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:38:24.528733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-50d0b764-dfb2-471e-beb1-683ea1854da8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for user d398d45627fc4d33bc9a736ddf8f9215 and project e7a5b721a538475cbac9c95c61647753. Resources: {'server_groups'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:38:24.546215 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-50d0b764-dfb2-471e-beb1-683ea1854da8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.165379 May 28 04:38:24.557231 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 693/1283] 10.222.0.58 () {60 vars in 1173 bytes} [Sat May 28 04:38:24 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:24.563502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cc638ca9-39fe-4462-ab2b-9ded8885a522 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:24.564051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cc638ca9-39fe-4462-ab2b-9ded8885a522 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:24.571130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc638ca9-39fe-4462-ab2b-9ded8885a522 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:24.571447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc638ca9-39fe-4462-ab2b-9ded8885a522 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:24.572239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc638ca9-39fe-4462-ab2b-9ded8885a522 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:24.572842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc638ca9-39fe-4462-ab2b-9ded8885a522 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:24.851374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cc638ca9-39fe-4462-ab2b-9ded8885a522 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:24.892438 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cc638ca9-39fe-4462-ab2b-9ded8885a522 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1541 microversion: 2.1 time: 0.333830 May 28 04:38:24.893307 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 694/1284] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:24 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1541 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:24.901188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef6386aa-da79-4b9c-b466-64eb3d71cc69 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:24.908382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ef6386aa-da79-4b9c-b466-64eb3d71cc69 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:24.918768 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef6386aa-da79-4b9c-b466-64eb3d71cc69 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:24.919584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef6386aa-da79-4b9c-b466-64eb3d71cc69 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:24.923451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef6386aa-da79-4b9c-b466-64eb3d71cc69 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:24.923942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef6386aa-da79-4b9c-b466-64eb3d71cc69 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:24.992231 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ef6386aa-da79-4b9c-b466-64eb3d71cc69 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097645 May 28 04:38:24.997436 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 695/1285] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:38:24 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:25.011270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3e3b0aca-c4e9-46a1-b874-842ac379334e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:25.012286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3e3b0aca-c4e9-46a1-b874-842ac379334e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:25.020355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3e3b0aca-c4e9-46a1-b874-842ac379334e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:25.021200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3e3b0aca-c4e9-46a1-b874-842ac379334e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:25.022176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3e3b0aca-c4e9-46a1-b874-842ac379334e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:25.023319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3e3b0aca-c4e9-46a1-b874-842ac379334e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:25.213397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3e3b0aca-c4e9-46a1-b874-842ac379334e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:25.222281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3e3b0aca-c4e9-46a1-b874-842ac379334e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:25.225319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3e3b0aca-c4e9-46a1-b874-842ac379334e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:25.226538 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3e3b0aca-c4e9-46a1-b874-842ac379334e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.225981 May 28 04:38:25.235893 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 696/1286] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:24 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:25.242162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1085306370", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "83cd0df2-5264-47c5-929b-92c17952213c"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:25.247771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:25.298298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:38:25.620461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:38:25.621023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:38:25.622270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:38:25.624096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:38:25.624578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:38:25.653724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:25.654187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:25.655652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:25.656096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:25.674390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for project e7a5b721a538475cbac9c95c61647753. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:38:25.679400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for user d398d45627fc4d33bc9a736ddf8f9215 and project e7a5b721a538475cbac9c95c61647753. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:38:25.691442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Going to run 2 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:38:25.693788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 3e7c11b5-0b9f-4264-b178-d9be01a2abfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:38:25.836081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=126044) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} May 28 04:38:25.855072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for project e7a5b721a538475cbac9c95c61647753. Resources: {'server_group_members'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:38:25.860225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for user d398d45627fc4d33bc9a736ddf8f9215 and project e7a5b721a538475cbac9c95c61647753. Resources: {'server_group_members'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:38:25.915176 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d081d4bf-78ce-447a-b714-d1705749d028 tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.324062 May 28 04:38:25.915792 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 591/1287] 10.222.0.58 () {60 vars in 1169 bytes} [Sat May 28 04:38:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:25.920459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6f584651-604b-4fde-949a-cc10dc61d2c7 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:25.921529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6f584651-604b-4fde-949a-cc10dc61d2c7 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:25.928516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f584651-604b-4fde-949a-cc10dc61d2c7 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:25.928970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f584651-604b-4fde-949a-cc10dc61d2c7 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:25.929743 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f584651-604b-4fde-949a-cc10dc61d2c7 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:25.930184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f584651-604b-4fde-949a-cc10dc61d2c7 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:25.999034 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for project e7a5b721a538475cbac9c95c61647753. Resources: {'server_group_members'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:38:26.006395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for user d398d45627fc4d33bc9a736ddf8f9215 and project e7a5b721a538475cbac9c95c61647753. Resources: {'server_group_members'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:38:26.023411 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 37d0f5e8-9f68-4ef2-9310-59c143ba90ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=3e7c11b5-0b9f-4264-b178-d9be01a2abfb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:38:26.089050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6f584651-604b-4fde-949a-cc10dc61d2c7 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e2e341401649898ed5a366da7e24e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811638c702ad48ac81d203aeac82dcee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:26.097126 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6f584651-604b-4fde-949a-cc10dc61d2c7 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892" status: 200 len: 1396 microversion: 2.1 time: 0.180375 May 28 04:38:26.097709 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 592/1288] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:25 2022] GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892 => generated 1396 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:26.102167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-904f2000-82ee-4684-9f26-1612dc938949 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:26.102957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-904f2000-82ee-4684-9f26-1612dc938949 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:26.109329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-904f2000-82ee-4684-9f26-1612dc938949 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:26.109787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-904f2000-82ee-4684-9f26-1612dc938949 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:26.110565 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-904f2000-82ee-4684-9f26-1612dc938949 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:26.111021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-904f2000-82ee-4684-9f26-1612dc938949 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:26.131818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for project e7a5b721a538475cbac9c95c61647753. Resources: {'server_group_members'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:38:26.135042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:26.136849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for user d398d45627fc4d33bc9a736ddf8f9215 and project e7a5b721a538475cbac9c95c61647753. Resources: {'server_group_members'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:38:26.246912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for project e7a5b721a538475cbac9c95c61647753. Resources: {'server_group_members'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:38:26.249492 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-904f2000-82ee-4684-9f26-1612dc938949 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:26.252310 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for user d398d45627fc4d33bc9a736ddf8f9215 and project e7a5b721a538475cbac9c95c61647753. Resources: {'server_group_members'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:38:26.260037 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-904f2000-82ee-4684-9f26-1612dc938949 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 200 len: 1501 microversion: 2.1 time: 0.161093 May 28 04:38:26.261043 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 593/1289] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:26 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:26.266328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-48f24859-a2fb-4841-bc05-c649ddf25012 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:26.266932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-48f24859-a2fb-4841-bc05-c649ddf25012 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:26.273429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48f24859-a2fb-4841-bc05-c649ddf25012 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:26.274161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48f24859-a2fb-4841-bc05-c649ddf25012 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:26.275254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48f24859-a2fb-4841-bc05-c649ddf25012 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:26.276644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48f24859-a2fb-4841-bc05-c649ddf25012 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:26.300431 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3e56eab0-ded3-4db1-b5e6-d3d2b026b987 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.062892 May 28 04:38:26.304610 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 697/1290] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:38:25 2022] POST /compute/v2.1/servers => generated 32 bytes in 1068 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 28 04:38:26.309584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5e50b61d-22b9-4c27-ae0e-5eb064d1aa0d tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] Action: 'create', calling method: .version_select at 0x7f7701be28b0>, body: {"pool": null} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:26.796262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-48f24859-a2fb-4841-bc05-c649ddf25012 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:26.808347 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-48f24859-a2fb-4841-bc05-c649ddf25012 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1473 microversion: 2.1 time: 0.546022 May 28 04:38:26.809088 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 594/1291] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:26 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1473 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:26.814778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d733a719-b7d8-4bef-88fb-02d5d40d8c15 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:26.816009 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d733a719-b7d8-4bef-88fb-02d5d40d8c15 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:26.823287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d733a719-b7d8-4bef-88fb-02d5d40d8c15 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:26.823924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d733a719-b7d8-4bef-88fb-02d5d40d8c15 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:26.824722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d733a719-b7d8-4bef-88fb-02d5d40d8c15 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:26.825224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d733a719-b7d8-4bef-88fb-02d5d40d8c15 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:26.861835 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d733a719-b7d8-4bef-88fb-02d5d40d8c15 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051141 May 28 04:38:26.863614 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 595/1292] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:38:26 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:26.868645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-87f1ea59-0827-4767-83d0-7bc50899a61f tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:26.869142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-87f1ea59-0827-4767-83d0-7bc50899a61f tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:26.877942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87f1ea59-0827-4767-83d0-7bc50899a61f tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:26.878810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87f1ea59-0827-4767-83d0-7bc50899a61f tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:26.880031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87f1ea59-0827-4767-83d0-7bc50899a61f tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:26.880600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87f1ea59-0827-4767-83d0-7bc50899a61f tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:26.909653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-87f1ea59-0827-4767-83d0-7bc50899a61f tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:38:27.261271 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-87f1ea59-0827-4767-83d0-7bc50899a61f tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3" status: 204 len: 0 microversion: 2.1 time: 0.395944 May 28 04:38:27.262739 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 596/1293] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:38:26 2022] DELETE /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:38:27.270711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3bae7d1c-ea97-4229-8454-cc368ff61bbd tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:27.275094 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3bae7d1c-ea97-4229-8454-cc368ff61bbd tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:27.283782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3bae7d1c-ea97-4229-8454-cc368ff61bbd tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:27.284352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3bae7d1c-ea97-4229-8454-cc368ff61bbd tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:27.285238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3bae7d1c-ea97-4229-8454-cc368ff61bbd tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:27.286087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3bae7d1c-ea97-4229-8454-cc368ff61bbd tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:27.500113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3bae7d1c-ea97-4229-8454-cc368ff61bbd tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:27.508242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3bae7d1c-ea97-4229-8454-cc368ff61bbd tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:27.509755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3bae7d1c-ea97-4229-8454-cc368ff61bbd tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:27.510910 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3bae7d1c-ea97-4229-8454-cc368ff61bbd tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.246709 May 28 04:38:27.511505 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 597/1294] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:27 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:27.517000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-991bc45d-a05b-4fbf-82c1-0f82900e5941 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1500564102"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:27.517573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-991bc45d-a05b-4fbf-82c1-0f82900e5941 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:27.523883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-991bc45d-a05b-4fbf-82c1-0f82900e5941 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:27.531147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-991bc45d-a05b-4fbf-82c1-0f82900e5941 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:27.531147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-991bc45d-a05b-4fbf-82c1-0f82900e5941 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:27.531147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-991bc45d-a05b-4fbf-82c1-0f82900e5941 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:27.720812 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.network.security_group_api [None req-991bc45d-a05b-4fbf-82c1-0f82900e5941 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Adding security group 5cc2ab59-9db2-4875-bf34-78750c9bccc8 to port 539b57c9-d282-4ec4-9581-f4091e5f2833 May 28 04:38:28.401056 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-991bc45d-a05b-4fbf-82c1-0f82900e5941 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "POST /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a/action" status: 202 len: 0 microversion: 2.1 time: 0.886008 May 28 04:38:28.401056 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 598/1295] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:38:27 2022] POST /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a/action => generated 0 bytes in 887 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:38:28.408480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e9d8a748-15fa-409b-a8ce-89eb57f2a7c1 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:28.413457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e9d8a748-15fa-409b-a8ce-89eb57f2a7c1 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:28.414421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e9d8a748-15fa-409b-a8ce-89eb57f2a7c1 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Searching by: {'deleted': False, 'project_id': 'e7a5b721a538475cbac9c95c61647753'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:38:28.420997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9d8a748-15fa-409b-a8ce-89eb57f2a7c1 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:28.421834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9d8a748-15fa-409b-a8ce-89eb57f2a7c1 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:28.422750 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9d8a748-15fa-409b-a8ce-89eb57f2a7c1 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:28.423485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9d8a748-15fa-409b-a8ce-89eb57f2a7c1 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:28.458113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-e9d8a748-15fa-409b-a8ce-89eb57f2a7c1 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:38:28.493459 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e9d8a748-15fa-409b-a8ce-89eb57f2a7c1 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.089309 May 28 04:38:28.494233 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 599/1296] 10.222.0.58 () {58 vars in 1124 bytes} [Sat May 28 04:38:28 2022] GET /compute/v2.1/servers => generated 1665 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:28.499165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-cf663231-02ca-4423-a8b5-5515be306e59 req-b0f245d2-6d59-4e39-8057-b5fb4432cbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d08c157a-afe1-41d5-8199-65e1b838d892", "name": "network-vif-plugged", "status": "completed", "tag": "e6d43522-ea01-42b0-be39-ee92dd8cd1b2"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:28.519611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-cf663231-02ca-4423-a8b5-5515be306e59 req-b0f245d2-6d59-4e39-8057-b5fb4432cbe0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:28.523987 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-cf663231-02ca-4423-a8b5-5515be306e59 req-b0f245d2-6d59-4e39-8057-b5fb4432cbe0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:28.546830 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-cf663231-02ca-4423-a8b5-5515be306e59 req-b0f245d2-6d59-4e39-8057-b5fb4432cbe0 service nova] Creating event network-vif-plugged:e6d43522-ea01-42b0-be39-ee92dd8cd1b2 for instance d08c157a-afe1-41d5-8199-65e1b838d892 on n-h1-843700-1 May 28 04:38:28.558784 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-cf663231-02ca-4423-a8b5-5515be306e59 req-b0f245d2-6d59-4e39-8057-b5fb4432cbe0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063437 May 28 04:38:28.562408 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 600/1297] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:28.570753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a397a72f-a651-41b8-a5cc-d384fa70ab71 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:28.572179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a397a72f-a651-41b8-a5cc-d384fa70ab71 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:28.580348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a397a72f-a651-41b8-a5cc-d384fa70ab71 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:28.580862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a397a72f-a651-41b8-a5cc-d384fa70ab71 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:28.581721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a397a72f-a651-41b8-a5cc-d384fa70ab71 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:28.582168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a397a72f-a651-41b8-a5cc-d384fa70ab71 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:28.884220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a397a72f-a651-41b8-a5cc-d384fa70ab71 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e2e341401649898ed5a366da7e24e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811638c702ad48ac81d203aeac82dcee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:28.896396 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a397a72f-a651-41b8-a5cc-d384fa70ab71 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892" status: 200 len: 1396 microversion: 2.1 time: 0.332423 May 28 04:38:28.897497 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 601/1298] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:28 2022] GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892 => generated 1396 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:28.909109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-75dbfd78-268e-4c46-8a8d-c57936e48da5 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:28.909895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-75dbfd78-268e-4c46-8a8d-c57936e48da5 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:28.925174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75dbfd78-268e-4c46-8a8d-c57936e48da5 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:28.925984 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75dbfd78-268e-4c46-8a8d-c57936e48da5 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:28.928899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75dbfd78-268e-4c46-8a8d-c57936e48da5 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:28.930074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75dbfd78-268e-4c46-8a8d-c57936e48da5 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:29.195595 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5e50b61d-22b9-4c27-ae0e-5eb064d1aa0d tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.889492 May 28 04:38:29.202687 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 698/1299] 10.222.0.58 () {60 vars in 1169 bytes} [Sat May 28 04:38:26 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:29.213800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8fa035fb-4981-4979-97b8-3b437c2a1194 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:29.214441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8fa035fb-4981-4979-97b8-3b437c2a1194 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:29.224813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8fa035fb-4981-4979-97b8-3b437c2a1194 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:29.225287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8fa035fb-4981-4979-97b8-3b437c2a1194 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:29.226064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8fa035fb-4981-4979-97b8-3b437c2a1194 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:29.226841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8fa035fb-4981-4979-97b8-3b437c2a1194 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:29.230326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-75dbfd78-268e-4c46-8a8d-c57936e48da5 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:29.250783 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-75dbfd78-268e-4c46-8a8d-c57936e48da5 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3" status: 200 len: 1713 microversion: 2.1 time: 0.350736 May 28 04:38:29.251838 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 602/1300] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:28 2022] GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 => generated 1713 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:29.260508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b344e411-da0d-4c36-9391-7e7ba25132b5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:29.264807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b344e411-da0d-4c36-9391-7e7ba25132b5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:29.277594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b344e411-da0d-4c36-9391-7e7ba25132b5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:29.278319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b344e411-da0d-4c36-9391-7e7ba25132b5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:29.279563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b344e411-da0d-4c36-9391-7e7ba25132b5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:29.280623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b344e411-da0d-4c36-9391-7e7ba25132b5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:29.325213 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b344e411-da0d-4c36-9391-7e7ba25132b5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071719 May 28 04:38:29.326015 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 603/1301] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:38:29 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:38:29.331554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c44864fd-3f12-4bfe-95aa-9fe56e17eb82 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f7701a23dc0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:29.722235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8fa035fb-4981-4979-97b8-3b437c2a1194 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:29.731616 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8fa035fb-4981-4979-97b8-3b437c2a1194 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1470 microversion: 2.1 time: 0.527540 May 28 04:38:29.733468 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 699/1302] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:29 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1470 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:29.738791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-fa6685e5-5e8d-4837-8d21-aafa672ec0da req-415d6c58-fbc9-430c-978f-92bf7e3c041d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ceda1f-e500-41ce-a086-8bcd9979435a", "tag": "539b57c9-d282-4ec4-9581-f4091e5f2833"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:29.747816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-fa6685e5-5e8d-4837-8d21-aafa672ec0da req-415d6c58-fbc9-430c-978f-92bf7e3c041d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:29.749008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-fa6685e5-5e8d-4837-8d21-aafa672ec0da req-415d6c58-fbc9-430c-978f-92bf7e3c041d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:29.750327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG neutronclient.v2_0.client [None req-c44864fd-3f12-4bfe-95aa-9fe56e17eb82 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 5cc2ab59-9db2-4875-bf34-78750c9bccc8 in use.", "detail": ""}} {{(pid=126043) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:38:29.751073 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-c44864fd-3f12-4bfe-95aa-9fe56e17eb82 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] HTTP exception thrown: Security Group 5cc2ab59-9db2-4875-bf34-78750c9bccc8 in use. May 28 04:38:29.751073 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-2debea78-9727-4318-a1d0-15e142b65c68'] May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c44864fd-3f12-4bfe-95aa-9fe56e17eb82 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Request method failure captured: May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/os-security-groups/5cc2ab59-9db2-4875-bf34-78750c9bccc8 HTTP/1.1 May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikacH3mPNflVe6LL6bg9_A8pzAabYS23jRSixTFQfefIS8h0xsq17YlHMuAQcMYGioTiJUzGf5HQ_8pUjy0pwazx5CoRz1nqfCdunQxIHFcBiGin6OUttjeU6RRcr_kTDInnBBWYYOIl_RyOz0kb25BPKfu6ZYOhMuIQdqMRnqceoVqo May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:38:29.753027 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:38:29.754680 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:38:29.754680 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:29.754680 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:29.754680 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:29.754680 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:29.754680 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:38:29.754680 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:38:29.754680 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 54a0d2f3e0184d14ae4050562e236581 May 28 04:38:29.754680 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:29.754680 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:38:29.754680 n-d-843700-1 devstack@n-api.service[126043]: exception: Security Group 5cc2ab59-9db2-4875-bf34-78750c9bccc8 in use. May 28 04:38:29.754680 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-2debea78-9727-4318-a1d0-15e142b65c68'] May 28 04:38:29.754680 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '5cc2ab59-9db2-4875-bf34-78750c9bccc8'} May 28 04:38:29.755656 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:38:29.755656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:29.755656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 28 04:38:29.755656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 28 04:38:29.755656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:29.755656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:29.755656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 28 04:38:29.755656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 28 04:38:29.755656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:29.755656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:29.755656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 28 04:38:29.755656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 28 04:38:29.755656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:29.755656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:29.755656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:38:29.755656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:38:29.755656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:29.755656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:29.755656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:38:29.757445 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:38:29.757445 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:29.757445 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:29.757445 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:38:29.757445 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:38:29.757445 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:38:29.757445 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:38:29.757445 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 5cc2ab59-9db2-4875-bf34-78750c9bccc8 in use. May 28 04:38:29.757445 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2debea78-9727-4318-a1d0-15e142b65c68'] May 28 04:38:29.757445 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:29.757445 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:29.757445 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:29.757445 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:29.757445 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 28 04:38:29.757445 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 28 04:38:29.757445 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 28 04:38:29.757445 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 28 04:38:29.757445 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 5cc2ab59-9db2-4875-bf34-78750c9bccc8 in use. May 28 04:38:29.757445 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2debea78-9727-4318-a1d0-15e142b65c68'] May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 5cc2ab59-9db2-4875-bf34-78750c9bccc8 in use. May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2debea78-9727-4318-a1d0-15e142b65c68'] May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:29.759559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:29.762124 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:29.762124 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:38:29.762124 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:38:29.762124 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 5cc2ab59-9db2-4875-bf34-78750c9bccc8 in use. May 28 04:38:29.762124 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2debea78-9727-4318-a1d0-15e142b65c68'] May 28 04:38:29.762124 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:29.762124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c44864fd-3f12-4bfe-95aa-9fe56e17eb82 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Returning 400 to user: Security Group 5cc2ab59-9db2-4875-bf34-78750c9bccc8 in use. May 28 04:38:29.762124 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-2debea78-9727-4318-a1d0-15e142b65c68'] {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:38:29.762124 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c44864fd-3f12-4bfe-95aa-9fe56e17eb82 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/5cc2ab59-9db2-4875-bf34-78750c9bccc8" status: 400 len: 185 microversion: 2.1 time: 0.427384 May 28 04:38:29.762124 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 604/1303] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:38:29 2022] DELETE /compute/v2.1/os-security-groups/5cc2ab59-9db2-4875-bf34-78750c9bccc8 => generated 185 bytes in 432 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:38:29.771408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-046e2fd5-458d-473f-ab05-3315ef3701f6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:29.772034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-046e2fd5-458d-473f-ab05-3315ef3701f6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 37d0f5e8-9f68-4ef2-9310-59c143ba90ad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:29.776863 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-fa6685e5-5e8d-4837-8d21-aafa672ec0da req-415d6c58-fbc9-430c-978f-92bf7e3c041d service nova] Creating event network-changed:539b57c9-d282-4ec4-9581-f4091e5f2833 for instance 90ceda1f-e500-41ce-a086-8bcd9979435a on n-h1-843700-1 May 28 04:38:29.783817 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-fa6685e5-5e8d-4837-8d21-aafa672ec0da req-415d6c58-fbc9-430c-978f-92bf7e3c041d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048860 May 28 04:38:29.785259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-046e2fd5-458d-473f-ab05-3315ef3701f6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:29.785547 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 700/1304] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:29.785770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-046e2fd5-458d-473f-ab05-3315ef3701f6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:29.786477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-046e2fd5-458d-473f-ab05-3315ef3701f6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:29.786926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-046e2fd5-458d-473f-ab05-3315ef3701f6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:29.792824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d36a11b8-cff6-4aa3-982d-12e9635faccf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:29.793971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d36a11b8-cff6-4aa3-982d-12e9635faccf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:29.804583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d36a11b8-cff6-4aa3-982d-12e9635faccf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:29.804583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d36a11b8-cff6-4aa3-982d-12e9635faccf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:29.804583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d36a11b8-cff6-4aa3-982d-12e9635faccf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:29.805342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d36a11b8-cff6-4aa3-982d-12e9635faccf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:29.828056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:29.922285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-046e2fd5-458d-473f-ab05-3315ef3701f6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:29.934592 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-046e2fd5-458d-473f-ab05-3315ef3701f6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad" status: 200 len: 1271 microversion: 2.1 time: 0.175231 May 28 04:38:29.938239 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 605/1305] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:29 2022] GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:29.950149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0f9c5284-0a03-4c0c-8ac8-deb95c996a50 tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] Calling method '.version_select at 0x7f7701a8eb80>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:30.257961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d36a11b8-cff6-4aa3-982d-12e9635faccf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:30.270059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d36a11b8-cff6-4aa3-982d-12e9635faccf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:30.271616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d36a11b8-cff6-4aa3-982d-12e9635faccf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:30.287397 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d36a11b8-cff6-4aa3-982d-12e9635faccf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1567 microversion: 2.25 time: 0.485022 May 28 04:38:30.288095 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 701/1306] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:29 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1567 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:30.304169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7e8aa436-2c40-451d-85a4-023e94d77443 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:30.304879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7e8aa436-2c40-451d-85a4-023e94d77443 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:30.313215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e8aa436-2c40-451d-85a4-023e94d77443 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:30.319549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e8aa436-2c40-451d-85a4-023e94d77443 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:30.319549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e8aa436-2c40-451d-85a4-023e94d77443 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:30.319549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e8aa436-2c40-451d-85a4-023e94d77443 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:30.329265 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0f9c5284-0a03-4c0c-8ac8-deb95c996a50 tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/5e39a67c-9472-48b3-b0c5-910e09cd2352" status: 200 len: 141 microversion: 2.1 time: 0.389605 May 28 04:38:30.330014 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 606/1307] 10.222.0.58 () {58 vars in 1259 bytes} [Sat May 28 04:38:29 2022] GET /compute/v2.1/os-floating-ips/5e39a67c-9472-48b3-b0c5-910e09cd2352 => generated 141 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:30.340193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6f7c8ee4-8511-498f-877e-566709700e60 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:30.341444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6f7c8ee4-8511-498f-877e-566709700e60 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:30.358908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f7c8ee4-8511-498f-877e-566709700e60 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:30.360021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f7c8ee4-8511-498f-877e-566709700e60 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:30.366336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f7c8ee4-8511-498f-877e-566709700e60 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:30.367036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f7c8ee4-8511-498f-877e-566709700e60 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:30.458485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e8aa436-2c40-451d-85a4-023e94d77443 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:30.459249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e8aa436-2c40-451d-85a4-023e94d77443 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:30.460373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e8aa436-2c40-451d-85a4-023e94d77443 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:30.460802 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e8aa436-2c40-451d-85a4-023e94d77443 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:30.496137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-7e8aa436-2c40-451d-85a4-023e94d77443 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Getting quotas for project 506fcf1e564049258c90cf33d274fc5f. Resources: {'cores', 'ram'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:38:30.501129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-7e8aa436-2c40-451d-85a4-023e94d77443 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Getting quotas for user 6d208bde90d54f7487f39c505b884285 and project 506fcf1e564049258c90cf33d274fc5f. Resources: {'cores', 'ram'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:38:30.725353 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6f7c8ee4-8511-498f-877e-566709700e60 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "POST /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a/action" status: 202 len: 0 microversion: 2.1 time: 0.388823 May 28 04:38:30.726000 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 607/1308] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:38:30 2022] POST /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:38:30.734616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-be252b1c-92b3-4d09-add4-a7b75c60d7ad tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:30.735340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-be252b1c-92b3-4d09-add4-a7b75c60d7ad tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:30.742937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-be252b1c-92b3-4d09-add4-a7b75c60d7ad tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:30.743429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-be252b1c-92b3-4d09-add4-a7b75c60d7ad tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:30.744205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-be252b1c-92b3-4d09-add4-a7b75c60d7ad tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:30.748683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-be252b1c-92b3-4d09-add4-a7b75c60d7ad tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:30.938786 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7e8aa436-2c40-451d-85a4-023e94d77443 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "POST /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350/action" status: 202 len: 0 microversion: 2.1 time: 0.649243 May 28 04:38:30.943524 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 702/1309] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:38:30 2022] POST /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:38:30.949598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d301a03b-008c-4e60-ba4b-08384f28ff6e tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:30.950604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d301a03b-008c-4e60-ba4b-08384f28ff6e tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:30.957654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d301a03b-008c-4e60-ba4b-08384f28ff6e tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:30.958374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d301a03b-008c-4e60-ba4b-08384f28ff6e tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:30.959655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d301a03b-008c-4e60-ba4b-08384f28ff6e tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:30.960390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d301a03b-008c-4e60-ba4b-08384f28ff6e tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:31.107374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:31.624708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d301a03b-008c-4e60-ba4b-08384f28ff6e tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c567ca604e0743bf874889ba69bbeb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5e68532952468cbd37fad9b381d355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:31.632976 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d301a03b-008c-4e60-ba4b-08384f28ff6e tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3" status: 200 len: 1646 microversion: 2.1 time: 0.687804 May 28 04:38:31.643518 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 703/1310] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:30 2022] GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 => generated 1646 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:31.649268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-05318639-1935-4673-8381-8da59934da4b tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] Calling method '.version_select at 0x7f77075f29d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:32.037190 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-be252b1c-92b3-4d09-add4-a7b75c60d7ad tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e2e341401649898ed5a366da7e24e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811638c702ad48ac81d203aeac82dcee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:32.045758 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-be252b1c-92b3-4d09-add4-a7b75c60d7ad tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892" status: 200 len: 1396 microversion: 2.1 time: 1.318211 May 28 04:38:32.051325 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 608/1311] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:30 2022] GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892 => generated 1396 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:32.061450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5005be28-5976-4281-9303-8dd46a3eb397 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:32.065862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5005be28-5976-4281-9303-8dd46a3eb397 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:32.083441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5005be28-5976-4281-9303-8dd46a3eb397 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:32.084420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5005be28-5976-4281-9303-8dd46a3eb397 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:32.085229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5005be28-5976-4281-9303-8dd46a3eb397 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:32.085678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5005be28-5976-4281-9303-8dd46a3eb397 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:32.814120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5005be28-5976-4281-9303-8dd46a3eb397 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:32.832653 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5005be28-5976-4281-9303-8dd46a3eb397 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 200 len: 1572 microversion: 2.1 time: 0.767603 May 28 04:38:32.835241 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 609/1312] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:32 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 1572 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:32.846592 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9e46a906-cad2-4ada-b180-2bb65ee25583 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:32.848978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9e46a906-cad2-4ada-b180-2bb65ee25583 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:32.865875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e46a906-cad2-4ada-b180-2bb65ee25583 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:32.866342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e46a906-cad2-4ada-b180-2bb65ee25583 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:32.867209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e46a906-cad2-4ada-b180-2bb65ee25583 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:32.869880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e46a906-cad2-4ada-b180-2bb65ee25583 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:32.877586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:33.403407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9e46a906-cad2-4ada-b180-2bb65ee25583 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:33.415181 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9e46a906-cad2-4ada-b180-2bb65ee25583 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1469 microversion: 2.1 time: 0.577983 May 28 04:38:33.420388 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 610/1313] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:32 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1469 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:33.439576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-715acdc2-ed3d-44a0-96bb-94c7afea083b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:33.441956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-715acdc2-ed3d-44a0-96bb-94c7afea083b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 37d0f5e8-9f68-4ef2-9310-59c143ba90ad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:33.451080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-715acdc2-ed3d-44a0-96bb-94c7afea083b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:33.452338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-715acdc2-ed3d-44a0-96bb-94c7afea083b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:33.454221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-715acdc2-ed3d-44a0-96bb-94c7afea083b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:33.455474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-715acdc2-ed3d-44a0-96bb-94c7afea083b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:33.644663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-715acdc2-ed3d-44a0-96bb-94c7afea083b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:33.663268 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-715acdc2-ed3d-44a0-96bb-94c7afea083b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad" status: 200 len: 1277 microversion: 2.1 time: 0.237664 May 28 04:38:33.667170 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 611/1314] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:33 2022] GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad => generated 1277 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:33.690186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fc60b57f-b621-4d8e-b571-36874046ead8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:33.690186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fc60b57f-b621-4d8e-b571-36874046ead8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:33.693978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc60b57f-b621-4d8e-b571-36874046ead8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:33.694526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc60b57f-b621-4d8e-b571-36874046ead8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:33.696251 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc60b57f-b621-4d8e-b571-36874046ead8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:33.696769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc60b57f-b621-4d8e-b571-36874046ead8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:34.024221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fc60b57f-b621-4d8e-b571-36874046ead8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:34.034696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fc60b57f-b621-4d8e-b571-36874046ead8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:34.036838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fc60b57f-b621-4d8e-b571-36874046ead8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:34.038051 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fc60b57f-b621-4d8e-b571-36874046ead8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1542 microversion: 2.25 time: 0.372074 May 28 04:38:34.038616 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 612/1315] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:33 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1542 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:34.044063 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-68462d72-31ad-4f0a-bdc5-b536f10c14b5 req-64cf3830-5486-431b-92d7-abf00eb440a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17bf9454-cf2b-4049-b817-556e4c74b350", "name": "network-vif-plugged", "status": "completed", "tag": "9a1c5bed-5c2a-4af6-98f9-e6c6cf8a4d4c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:34.053359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-68462d72-31ad-4f0a-bdc5-b536f10c14b5 req-64cf3830-5486-431b-92d7-abf00eb440a0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:34.054018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-68462d72-31ad-4f0a-bdc5-b536f10c14b5 req-64cf3830-5486-431b-92d7-abf00eb440a0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:34.067068 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-68462d72-31ad-4f0a-bdc5-b536f10c14b5 req-64cf3830-5486-431b-92d7-abf00eb440a0 service nova] Creating event network-vif-plugged:9a1c5bed-5c2a-4af6-98f9-e6c6cf8a4d4c for instance 17bf9454-cf2b-4049-b817-556e4c74b350 on n-h1-843700-1 May 28 04:38:34.073780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-68462d72-31ad-4f0a-bdc5-b536f10c14b5 req-64cf3830-5486-431b-92d7-abf00eb440a0 service nova] Instance 17bf9454-cf2b-4049-b817-556e4c74b350 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:38:34.085914 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-68462d72-31ad-4f0a-bdc5-b536f10c14b5 req-64cf3830-5486-431b-92d7-abf00eb440a0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045845 May 28 04:38:34.086699 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 613/1316] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:34.091862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-2b43ed99-45c0-4707-bc59-4ba9b87830e2 req-2c9d1b27-d12b-4c62-9ac0-fc9bbc1ed75a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cf16b71-8fa1-4433-9af1-869667b8f7e3", "name": "network-vif-deleted", "tag": "4096714a-e49b-4b7e-b0ac-30da053e7819"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:34.100822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2b43ed99-45c0-4707-bc59-4ba9b87830e2 req-2c9d1b27-d12b-4c62-9ac0-fc9bbc1ed75a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:34.101275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2b43ed99-45c0-4707-bc59-4ba9b87830e2 req-2c9d1b27-d12b-4c62-9ac0-fc9bbc1ed75a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:34.115303 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-2b43ed99-45c0-4707-bc59-4ba9b87830e2 req-2c9d1b27-d12b-4c62-9ac0-fc9bbc1ed75a service nova] Creating event network-vif-deleted:4096714a-e49b-4b7e-b0ac-30da053e7819 for instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 on n-h1-843700-1 May 28 04:38:34.121546 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-2b43ed99-45c0-4707-bc59-4ba9b87830e2 req-2c9d1b27-d12b-4c62-9ac0-fc9bbc1ed75a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033447 May 28 04:38:34.123546 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 614/1317] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:34.130080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b60c57ac-3104-4dad-913c-2d5cdb836468 req-aed4741f-2599-4302-9469-c5eca9767353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e7c11b5-0b9f-4264-b178-d9be01a2abfb", "tag": "9d3dccec-39ea-4342-8fba-7599d04f53f4"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:34.140824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b60c57ac-3104-4dad-913c-2d5cdb836468 req-aed4741f-2599-4302-9469-c5eca9767353 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:34.141262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b60c57ac-3104-4dad-913c-2d5cdb836468 req-aed4741f-2599-4302-9469-c5eca9767353 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:34.154548 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b60c57ac-3104-4dad-913c-2d5cdb836468 req-aed4741f-2599-4302-9469-c5eca9767353 service nova] Creating event network-changed:9d3dccec-39ea-4342-8fba-7599d04f53f4 for instance 3e7c11b5-0b9f-4264-b178-d9be01a2abfb on n-h2-843700-1 May 28 04:38:34.167802 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b60c57ac-3104-4dad-913c-2d5cdb836468 req-aed4741f-2599-4302-9469-c5eca9767353 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035376 May 28 04:38:34.167802 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 615/1318] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:34.168803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9b454d1e-3f66-4367-8969-85efcaf7281c tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:34.168803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9b454d1e-3f66-4367-8969-85efcaf7281c tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:34.176887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b454d1e-3f66-4367-8969-85efcaf7281c tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:34.177417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b454d1e-3f66-4367-8969-85efcaf7281c tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:34.178320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b454d1e-3f66-4367-8969-85efcaf7281c tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:34.178758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b454d1e-3f66-4367-8969-85efcaf7281c tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:34.196057 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-9b454d1e-3f66-4367-8969-85efcaf7281c tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] HTTP exception thrown: Instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 could not be found. May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9b454d1e-3f66-4367-8969-85efcaf7281c tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Request method failure captured: May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 HTTP/1.1 May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaaptvX93jncUvtDm1M67CLWO3joyo0E09c_c5FiJQQfrfRcVdXnjfTGtDwuB8oYr_k2K7FUogNWi8ibbbR1-2rtm46el9R3k-feuOlqBBEe2y6QpisrLZUsQ4zm5OUUNfINKKeFkozJMGAPHkZeN4XCaYYKd002U0ilJwVrdrS6P2M May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 7b5e68532952468cbd37fad9b381d355 May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:38:34.198097 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:38:34.199767 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7b5e68532952468cbd37fad9b381d355"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:38:34.199767 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:34.199767 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 7b5e68532952468cbd37fad9b381d355 May 28 04:38:34.199767 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:34.199767 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersWithSpecificFlavorTestJSON-622287351-project May 28 04:38:34.199767 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:38:34.199767 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:38:34.199767 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c567ca604e0743bf874889ba69bbeb49 May 28 04:38:34.199767 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351-project May 28 04:38:34.199767 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:38:34.199767 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 could not be found. May 28 04:38:34.199767 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '7cf16b71-8fa1-4433-9af1-869667b8f7e3'} May 28 04:38:34.200916 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:38:34.200916 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:34.200916 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:38:34.200916 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:38:34.200916 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:38:34.200916 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:38:34.200916 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:38:34.200916 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:38:34.200916 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:38:34.200916 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:38:34.200916 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 could not be found. May 28 04:38:34.200916 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:34.200916 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:34.200916 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:34.200916 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:34.200916 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:34.200916 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:34.200916 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:38:34.200916 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:38:34.200916 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:38:34.203448 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:38:34.203448 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:38:34.203448 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:38:34.203448 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:38:34.203448 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:38:34.203448 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:38:34.203448 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:38:34.203448 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 could not be found. May 28 04:38:34.203448 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:34.203448 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:34.203448 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:34.203448 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:34.203448 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:34.203448 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:34.203448 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:38:34.203448 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:38:34.203448 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 could not be found. May 28 04:38:34.203448 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:34.205512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9b454d1e-3f66-4367-8969-85efcaf7281c tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Returning 404 to user: Instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:38:34.205512 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9b454d1e-3f66-4367-8969-85efcaf7281c tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3" status: 404 len: 111 microversion: 2.1 time: 0.036964 May 28 04:38:34.205512 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 616/1319] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:34 2022] GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:38:34.207026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dc26b203-b933-49ec-b4f0-839dd38c0c8d tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:34.207781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dc26b203-b933-49ec-b4f0-839dd38c0c8d tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:34.218411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc26b203-b933-49ec-b4f0-839dd38c0c8d tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:34.219174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc26b203-b933-49ec-b4f0-839dd38c0c8d tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:34.220241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc26b203-b933-49ec-b4f0-839dd38c0c8d tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:34.220719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc26b203-b933-49ec-b4f0-839dd38c0c8d tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:34.371850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dc26b203-b933-49ec-b4f0-839dd38c0c8d tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e2e341401649898ed5a366da7e24e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811638c702ad48ac81d203aeac82dcee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:34.378136 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dc26b203-b933-49ec-b4f0-839dd38c0c8d tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892" status: 200 len: 1577 microversion: 2.1 time: 0.175545 May 28 04:38:34.378913 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 617/1320] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:34 2022] GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:34.394156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ef6b2394-520a-45e2-9e28-6cec86ba035b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:34.395346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ef6b2394-520a-45e2-9e28-6cec86ba035b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:34.401984 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:34.407874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ef6b2394-520a-45e2-9e28-6cec86ba035b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:34.408338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ef6b2394-520a-45e2-9e28-6cec86ba035b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:34.410045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ef6b2394-520a-45e2-9e28-6cec86ba035b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:34.410491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ef6b2394-520a-45e2-9e28-6cec86ba035b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:34.725565 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-05318639-1935-4673-8381-8da59934da4b tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/5e39a67c-9472-48b3-b0c5-910e09cd2352" status: 202 len: 0 microversion: 2.1 time: 3.080523 May 28 04:38:34.727183 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 704/1321] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 04:38:31 2022] DELETE /compute/v2.1/os-floating-ips/5e39a67c-9472-48b3-b0c5-910e09cd2352 => generated 0 bytes in 3083 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:38:34.733433 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4d2a657e-c2df-481b-9fb2-e14cd4bca5be tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '.version_select at 0x7f7701b3f4c0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:34.736585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d2a657e-c2df-481b-9fb2-e14cd4bca5be tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:34.742941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d2a657e-c2df-481b-9fb2-e14cd4bca5be tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:34.767387 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4d2a657e-c2df-481b-9fb2-e14cd4bca5be tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 3382 microversion: 2.25 time: 0.038651 May 28 04:38:34.773461 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 705/1322] 10.222.0.58 () {60 vars in 1183 bytes} [Sat May 28 04:38:34 2022] GET /compute/v2.1/os-migrations => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:34.784473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8a773dfb-7e31-43b5-8e6a-4e9a0fa88821 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:34.784966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8a773dfb-7e31-43b5-8e6a-4e9a0fa88821 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:34.793145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a773dfb-7e31-43b5-8e6a-4e9a0fa88821 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:34.799713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a773dfb-7e31-43b5-8e6a-4e9a0fa88821 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:34.799713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a773dfb-7e31-43b5-8e6a-4e9a0fa88821 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:34.799713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a773dfb-7e31-43b5-8e6a-4e9a0fa88821 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:34.817828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ef6b2394-520a-45e2-9e28-6cec86ba035b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:34.830096 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ef6b2394-520a-45e2-9e28-6cec86ba035b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 200 len: 1577 microversion: 2.1 time: 0.449945 May 28 04:38:34.832092 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-8a773dfb-7e31-43b5-8e6a-4e9a0fa88821 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] HTTP exception thrown: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8a773dfb-7e31-43b5-8e6a-4e9a0fa88821 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Request method failure captured: May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 HTTP/1.1 May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaaptvX93jncUvtDm1M67CLWO3joyo0E09c_c5FiJQQfrfRcVdXnjfTGtDwuB8oYr_k2K7FUogNWi8ibbbR1-2rtm46el9R3k-feuOlqBBEe2y6QpisrLZUsQ4zm5OUUNfINKKeFkozJMGAPHkZeN4XCaYYKd002U0ilJwVrdrS6P2M May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 7b5e68532952468cbd37fad9b381d355 May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:38:34.834262 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:38:34.835888 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7b5e68532952468cbd37fad9b381d355"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:38:34.835888 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:34.835888 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 7b5e68532952468cbd37fad9b381d355 May 28 04:38:34.835888 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:34.835888 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersWithSpecificFlavorTestJSON-622287351-project May 28 04:38:34.835888 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:38:34.835888 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:38:34.835888 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: c567ca604e0743bf874889ba69bbeb49 May 28 04:38:34.835888 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351-project May 28 04:38:34.835888 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:38:34.835888 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. May 28 04:38:34.835888 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '88c86c50-5759-4619-9f17-a61d7452a6e8'} May 28 04:38:34.837016 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:38:34.837016 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:34.837016 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:38:34.837016 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:38:34.837016 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:38:34.837016 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:38:34.837016 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:38:34.837016 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:38:34.837016 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:38:34.837016 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:38:34.837016 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. May 28 04:38:34.837016 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:34.837016 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:34.837016 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:34.837016 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:34.837016 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:34.837016 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:34.837016 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:38:34.837016 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:38:34.837016 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:38:34.838453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:38:34.838453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:38:34.838453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:38:34.838453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:38:34.838453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:38:34.838453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:38:34.838453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:38:34.838453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:38:34.838453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:38:34.838453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. May 28 04:38:34.838453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:34.838453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:34.838453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:34.838453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:34.838453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:34.838453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:34.838453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:38:34.838453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:38:34.838453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. May 28 04:38:34.838453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:34.843345 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 618/1323] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:34 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 1577 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:34.843955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8a773dfb-7e31-43b5-8e6a-4e9a0fa88821 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Returning 404 to user: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:38:34.847278 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8a773dfb-7e31-43b5-8e6a-4e9a0fa88821 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "DELETE /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8" status: 404 len: 111 microversion: 2.1 time: 0.071257 May 28 04:38:34.854210 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 706/1324] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:38:34 2022] DELETE /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:38:34.854446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-72e68099-f31e-4560-8a1c-0672b948e04b tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:34.854446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-72e68099-f31e-4560-8a1c-0672b948e04b tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:34.862097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-72e68099-f31e-4560-8a1c-0672b948e04b tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:34.862667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6f3211d3-e2ab-4950-8c6e-9f62459dbd69 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:34.862858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-72e68099-f31e-4560-8a1c-0672b948e04b tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:34.863765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6f3211d3-e2ab-4950-8c6e-9f62459dbd69 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:34.864587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-72e68099-f31e-4560-8a1c-0672b948e04b tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:34.865787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-72e68099-f31e-4560-8a1c-0672b948e04b tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:34.869442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:34.873227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f3211d3-e2ab-4950-8c6e-9f62459dbd69 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:34.874500 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f3211d3-e2ab-4950-8c6e-9f62459dbd69 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:34.875668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f3211d3-e2ab-4950-8c6e-9f62459dbd69 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:34.876270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f3211d3-e2ab-4950-8c6e-9f62459dbd69 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:35.034936 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-72e68099-f31e-4560-8a1c-0672b948e04b tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.189987 May 28 04:38:35.046388 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 619/1325] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 04:38:34 2022] GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892/os-interface => generated 285 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:35.049011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e74f7963-ef45-4534-b538-55623a7d2365 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:35.049774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e74f7963-ef45-4534-b538-55623a7d2365 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 37d0f5e8-9f68-4ef2-9310-59c143ba90ad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:35.058069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e74f7963-ef45-4534-b538-55623a7d2365 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:35.058574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e74f7963-ef45-4534-b538-55623a7d2365 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:35.059405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e74f7963-ef45-4534-b538-55623a7d2365 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:35.059847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e74f7963-ef45-4534-b538-55623a7d2365 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:35.082836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6f3211d3-e2ab-4950-8c6e-9f62459dbd69 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:35.095334 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6f3211d3-e2ab-4950-8c6e-9f62459dbd69 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1469 microversion: 2.1 time: 0.246140 May 28 04:38:35.096565 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 707/1326] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:34 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1469 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:35.102055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e2c3719f-c2d6-49a0-88bc-a31664835ff4 tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] Calling method '.version_select at 0x7f77075f2c10>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:35.732129 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e2c3719f-c2d6-49a0-88bc-a31664835ff4 tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.632466 May 28 04:38:35.740854 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 708/1327] 10.222.0.58 () {58 vars in 1163 bytes} [Sat May 28 04:38:35 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:38:35.746060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-541d6ff4-51e9-48d4-b7eb-cbba0b3ec7d5 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:35.748669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-541d6ff4-51e9-48d4-b7eb-cbba0b3ec7d5 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:35.758202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-541d6ff4-51e9-48d4-b7eb-cbba0b3ec7d5 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:35.759602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-541d6ff4-51e9-48d4-b7eb-cbba0b3ec7d5 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:35.760704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-541d6ff4-51e9-48d4-b7eb-cbba0b3ec7d5 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:35.761523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-541d6ff4-51e9-48d4-b7eb-cbba0b3ec7d5 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:35.858443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e74f7963-ef45-4534-b538-55623a7d2365 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:35.867030 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e74f7963-ef45-4534-b538-55623a7d2365 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad" status: 200 len: 1319 microversion: 2.1 time: 0.823573 May 28 04:38:35.868607 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 620/1328] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:35 2022] GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad => generated 1319 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:35.882857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ad9ac2f5-6f39-4b51-b4ff-d745b6f4c6a1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:35.883520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ad9ac2f5-6f39-4b51-b4ff-d745b6f4c6a1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:35.901200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ad9ac2f5-6f39-4b51-b4ff-d745b6f4c6a1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:35.901200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ad9ac2f5-6f39-4b51-b4ff-d745b6f4c6a1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:35.901200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ad9ac2f5-6f39-4b51-b4ff-d745b6f4c6a1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:35.901471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ad9ac2f5-6f39-4b51-b4ff-d745b6f4c6a1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:35.930060 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-ad9ac2f5-6f39-4b51-b4ff-d745b6f4c6a1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] HTTP exception thrown: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ad9ac2f5-6f39-4b51-b4ff-d745b6f4c6a1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Request method failure captured: May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 HTTP/1.1 May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaaptvX93jncUvtDm1M67CLWO3joyo0E09c_c5FiJQQfrfRcVdXnjfTGtDwuB8oYr_k2K7FUogNWi8ibbbR1-2rtm46el9R3k-feuOlqBBEe2y6QpisrLZUsQ4zm5OUUNfINKKeFkozJMGAPHkZeN4XCaYYKd002U0ilJwVrdrS6P2M May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 7b5e68532952468cbd37fad9b381d355 May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:38:35.931720 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:38:35.933236 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7b5e68532952468cbd37fad9b381d355"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:38:35.933236 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:35.933236 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 7b5e68532952468cbd37fad9b381d355 May 28 04:38:35.933236 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:35.933236 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersWithSpecificFlavorTestJSON-622287351-project May 28 04:38:35.933236 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:38:35.933236 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:38:35.933236 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c567ca604e0743bf874889ba69bbeb49 May 28 04:38:35.933236 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351-project May 28 04:38:35.933236 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:38:35.933236 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. May 28 04:38:35.933236 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '88c86c50-5759-4619-9f17-a61d7452a6e8'} May 28 04:38:35.933970 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:38:35.933970 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:35.933970 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:38:35.933970 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:38:35.933970 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:38:35.933970 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:38:35.933970 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:38:35.933970 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:38:35.933970 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:38:35.933970 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:38:35.933970 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. May 28 04:38:35.933970 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:35.933970 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:35.933970 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:35.933970 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:35.933970 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:35.933970 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:35.933970 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:38:35.933970 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:38:35.933970 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:38:35.936095 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:38:35.936095 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:38:35.936095 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:38:35.936095 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:38:35.936095 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:38:35.936095 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:38:35.936095 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:38:35.936095 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. May 28 04:38:35.936095 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:35.936095 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:35.936095 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:35.936095 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:35.936095 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:35.936095 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:35.936095 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:38:35.936095 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:38:35.936095 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. May 28 04:38:35.936095 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:35.938602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ad9ac2f5-6f39-4b51-b4ff-d745b6f4c6a1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Returning 404 to user: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:38:35.938602 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ad9ac2f5-6f39-4b51-b4ff-d745b6f4c6a1 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8" status: 404 len: 111 microversion: 2.1 time: 0.060347 May 28 04:38:35.938602 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 621/1329] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:35 2022] GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:38:35.943302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-148d5356-3051-4334-819f-057ccb93d0eb tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] Calling method '.version_select at 0x7f770184baf0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:36.047941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-541d6ff4-51e9-48d4-b7eb-cbba0b3ec7d5 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lazy-loading 'services' on Instance uuid 18cb68a1-94a5-4af2-a376-46e7493e7454 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:38:36.069274 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-541d6ff4-51e9-48d4-b7eb-cbba0b3ec7d5 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 2034 microversion: 2.25 time: 0.326962 May 28 04:38:36.075679 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 709/1330] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:35 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 2034 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:36.091536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bdb12d7a-0644-4ec0-879b-bf9205aedcb7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:36.093231 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bdb12d7a-0644-4ec0-879b-bf9205aedcb7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:36.103423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdb12d7a-0644-4ec0-879b-bf9205aedcb7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:36.104589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdb12d7a-0644-4ec0-879b-bf9205aedcb7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:36.105445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdb12d7a-0644-4ec0-879b-bf9205aedcb7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:36.105885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdb12d7a-0644-4ec0-879b-bf9205aedcb7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:36.259308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=30 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:36.477987 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-148d5356-3051-4334-819f-057ccb93d0eb tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.529183 May 28 04:38:36.477987 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 622/1331] 10.222.0.58 () {58 vars in 1148 bytes} [Sat May 28 04:38:35 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:36.477987 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2ca32ab2-0b43-444d-a30d-c70cc48fc902 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '.version_select at 0x7f770198f310>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:36.563273 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2ca32ab2-0b43-444d-a30d-c70cc48fc902 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-255921009" status: 202 len: 0 microversion: 2.1 time: 0.093660 May 28 04:38:36.564869 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 623/1332] 10.222.0.58 () {58 vars in 1217 bytes} [Sat May 28 04:38:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-255921009 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:38:36.565642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bdb12d7a-0644-4ec0-879b-bf9205aedcb7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:36.575141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d6bc6a80-ba5a-44b9-a699-71184e2f5bee tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:36.576462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d6bc6a80-ba5a-44b9-a699-71184e2f5bee tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:36.579057 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bdb12d7a-0644-4ec0-879b-bf9205aedcb7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 200 len: 1570 microversion: 2.1 time: 0.500817 May 28 04:38:36.579611 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 710/1333] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:36 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 1570 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:36.584554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6bc6a80-ba5a-44b9-a699-71184e2f5bee tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:36.585312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6bc6a80-ba5a-44b9-a699-71184e2f5bee tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:36.586401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6bc6a80-ba5a-44b9-a699-71184e2f5bee tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:36.587076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6bc6a80-ba5a-44b9-a699-71184e2f5bee tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:36.592801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-378c2123-cde9-402c-b9d3-0eb76ba7b0e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-508055665", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "244ceb49-a9c1-42ce-900e-8ae28e09e3a9"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:36.686952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-378c2123-cde9-402c-b9d3-0eb76ba7b0e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] validate_networks() for [('244ceb49-a9c1-42ce-900e-8ae28e09e3a9', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:38:36.987815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d6bc6a80-ba5a-44b9-a699-71184e2f5bee tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:36.994960 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d6bc6a80-ba5a-44b9-a699-71184e2f5bee tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1469 microversion: 2.1 time: 0.428525 May 28 04:38:36.997855 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 624/1334] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:36 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1469 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:37.014459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e796bd32-a72c-4a6f-8a20-417e4ac65267 tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] Calling method '.version_select at 0x7f770198ad30>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:38.016632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-378c2123-cde9-402c-b9d3-0eb76ba7b0e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:38:38.017196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-378c2123-cde9-402c-b9d3-0eb76ba7b0e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:38:38.017697 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-378c2123-cde9-402c-b9d3-0eb76ba7b0e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:38:38.018612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-378c2123-cde9-402c-b9d3-0eb76ba7b0e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:38:38.019363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-378c2123-cde9-402c-b9d3-0eb76ba7b0e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:38:38.048665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-378c2123-cde9-402c-b9d3-0eb76ba7b0e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:38.049184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-378c2123-cde9-402c-b9d3-0eb76ba7b0e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:38.053400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-378c2123-cde9-402c-b9d3-0eb76ba7b0e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:38.058876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-378c2123-cde9-402c-b9d3-0eb76ba7b0e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:38.171192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-378c2123-cde9-402c-b9d3-0eb76ba7b0e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Getting quotas for project 99f14746bfbc460eb4a21e7eb567de46. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:38:38.178325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-378c2123-cde9-402c-b9d3-0eb76ba7b0e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Getting quotas for user ed90faaaee584c3a8d1385b8d873d12d and project 99f14746bfbc460eb4a21e7eb567de46. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:38:38.215670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-378c2123-cde9-402c-b9d3-0eb76ba7b0e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:38:38.221281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-378c2123-cde9-402c-b9d3-0eb76ba7b0e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:38:38.395571 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-378c2123-cde9-402c-b9d3-0eb76ba7b0e5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.812999 May 28 04:38:38.398638 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 711/1335] 10.222.0.58 () {62 vars in 1187 bytes} [Sat May 28 04:38:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 04:38:38.427413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-75cafd2e-57cf-4bc7-a29f-c9eb1db9583f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-82267849"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:38.429076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-75cafd2e-57cf-4bc7-a29f-c9eb1db9583f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:38.429924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:38.456739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75cafd2e-57cf-4bc7-a29f-c9eb1db9583f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:38.459777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75cafd2e-57cf-4bc7-a29f-c9eb1db9583f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:38.470463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75cafd2e-57cf-4bc7-a29f-c9eb1db9583f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:38.471468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75cafd2e-57cf-4bc7-a29f-c9eb1db9583f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:39.041404 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.network.security_group_api [None req-75cafd2e-57cf-4bc7-a29f-c9eb1db9583f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Adding security group ca18ddaf-83b6-4a10-82db-36a36dadf314 to port 539b57c9-d282-4ec4-9581-f4091e5f2833 May 28 04:38:39.565544 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e796bd32-a72c-4a6f-8a20-417e4ac65267 tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/5442fc5f-1697-4d99-b1c1-04ddbfd21b53" status: 202 len: 0 microversion: 2.1 time: 2.557712 May 28 04:38:39.572333 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 625/1336] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 04:38:36 2022] DELETE /compute/v2.1/os-floating-ips/5442fc5f-1697-4d99-b1c1-04ddbfd21b53 => generated 0 bytes in 2574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:38:39.581738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4d55c2c9-15a9-4dc7-8785-2a7f14a01f00 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:39.582541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4d55c2c9-15a9-4dc7-8785-2a7f14a01f00 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:39.600118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d55c2c9-15a9-4dc7-8785-2a7f14a01f00 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:39.601707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d55c2c9-15a9-4dc7-8785-2a7f14a01f00 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:39.602983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d55c2c9-15a9-4dc7-8785-2a7f14a01f00 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:39.603879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d55c2c9-15a9-4dc7-8785-2a7f14a01f00 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:40.216306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4d55c2c9-15a9-4dc7-8785-2a7f14a01f00 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e2e341401649898ed5a366da7e24e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811638c702ad48ac81d203aeac82dcee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:40.226563 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4d55c2c9-15a9-4dc7-8785-2a7f14a01f00 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892" status: 200 len: 1577 microversion: 2.1 time: 0.652752 May 28 04:38:40.238059 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 626/1337] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:39 2022] GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892 => generated 1577 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:40.242542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-f9ecb522-3015-4865-a8a7-7d794578365b req-7d4ef688-8dd6-4707-bf56-d0a6137d8791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d08c157a-afe1-41d5-8199-65e1b838d892", "tag": "e6d43522-ea01-42b0-be39-ee92dd8cd1b2"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:40.252780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f9ecb522-3015-4865-a8a7-7d794578365b req-7d4ef688-8dd6-4707-bf56-d0a6137d8791 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:40.253226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f9ecb522-3015-4865-a8a7-7d794578365b req-7d4ef688-8dd6-4707-bf56-d0a6137d8791 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:40.265597 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-f9ecb522-3015-4865-a8a7-7d794578365b req-7d4ef688-8dd6-4707-bf56-d0a6137d8791 service nova] Creating event network-changed:e6d43522-ea01-42b0-be39-ee92dd8cd1b2 for instance d08c157a-afe1-41d5-8199-65e1b838d892 on n-h1-843700-1 May 28 04:38:40.271709 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-f9ecb522-3015-4865-a8a7-7d794578365b req-7d4ef688-8dd6-4707-bf56-d0a6137d8791 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032717 May 28 04:38:40.272516 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 627/1338] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:40.278787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-92b045cf-301a-4b28-ab41-3b2c0796cccd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:40.279930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-92b045cf-301a-4b28-ab41-3b2c0796cccd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 37d0f5e8-9f68-4ef2-9310-59c143ba90ad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:40.286825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-92b045cf-301a-4b28-ab41-3b2c0796cccd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:40.287580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-92b045cf-301a-4b28-ab41-3b2c0796cccd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:40.288559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-92b045cf-301a-4b28-ab41-3b2c0796cccd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:40.289000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-92b045cf-301a-4b28-ab41-3b2c0796cccd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:40.448557 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-75cafd2e-57cf-4bc7-a29f-c9eb1db9583f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "POST /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a/action" status: 202 len: 0 microversion: 2.1 time: 2.042757 May 28 04:38:40.449187 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 712/1339] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:38:38 2022] POST /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a/action => generated 0 bytes in 2050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:38:40.462628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-61220ae3-fdda-4941-a358-f720bcd65378 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:40.463206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-61220ae3-fdda-4941-a358-f720bcd65378 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:40.483467 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-61220ae3-fdda-4941-a358-f720bcd65378 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:40.484197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-61220ae3-fdda-4941-a358-f720bcd65378 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:40.485267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-61220ae3-fdda-4941-a358-f720bcd65378 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:40.485866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-61220ae3-fdda-4941-a358-f720bcd65378 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:40.550217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-92b045cf-301a-4b28-ab41-3b2c0796cccd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:40.561134 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-92b045cf-301a-4b28-ab41-3b2c0796cccd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad" status: 200 len: 1319 microversion: 2.1 time: 0.286434 May 28 04:38:40.562272 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 628/1340] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:40 2022] GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:40.568040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-172eddb9-ce19-464e-8854-ede962512ee7 req-82bfdc48-f74c-4149-bf48-6847dd770348 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37d0f5e8-9f68-4ef2-9310-59c143ba90ad", "tag": "15222ba8-2eb7-4295-9f75-798d9d032881"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:40.577656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-172eddb9-ce19-464e-8854-ede962512ee7 req-82bfdc48-f74c-4149-bf48-6847dd770348 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:40.578560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-172eddb9-ce19-464e-8854-ede962512ee7 req-82bfdc48-f74c-4149-bf48-6847dd770348 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:40.594569 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-172eddb9-ce19-464e-8854-ede962512ee7 req-82bfdc48-f74c-4149-bf48-6847dd770348 service nova] Creating event network-changed:15222ba8-2eb7-4295-9f75-798d9d032881 for instance 37d0f5e8-9f68-4ef2-9310-59c143ba90ad on n-h1-843700-1 May 28 04:38:40.602117 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-172eddb9-ce19-464e-8854-ede962512ee7 req-82bfdc48-f74c-4149-bf48-6847dd770348 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036316 May 28 04:38:40.603573 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 629/1341] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:40.615146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e2eb68ef-b16c-4183-b8fb-7e12808858a3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:40.616054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e2eb68ef-b16c-4183-b8fb-7e12808858a3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:40.625677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2eb68ef-b16c-4183-b8fb-7e12808858a3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:40.626231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2eb68ef-b16c-4183-b8fb-7e12808858a3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:40.627564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2eb68ef-b16c-4183-b8fb-7e12808858a3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:40.628098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2eb68ef-b16c-4183-b8fb-7e12808858a3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:40.684119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-61220ae3-fdda-4941-a358-f720bcd65378 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:40.693718 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-61220ae3-fdda-4941-a358-f720bcd65378 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1535 microversion: 2.1 time: 0.243294 May 28 04:38:40.694588 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 713/1342] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:40 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1535 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:40.699671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-16204f48-4c30-4ba4-840a-09d566124504 tempest-ServersWithSpecificFlavorTestJSON-201764576 tempest-ServersWithSpecificFlavorTestJSON-201764576-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:40.700707 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:38:40.700707 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:38:40.721717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e2eb68ef-b16c-4183-b8fb-7e12808858a3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:40.733618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e2eb68ef-b16c-4183-b8fb-7e12808858a3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:40.735535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e2eb68ef-b16c-4183-b8fb-7e12808858a3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:40.737090 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e2eb68ef-b16c-4183-b8fb-7e12808858a3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1313 microversion: 2.25 time: 0.131866 May 28 04:38:40.737670 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 630/1343] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:40 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1313 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:40.744467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-049789bc-fc2f-47c7-9e7e-22c6b7721c1a tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] Calling method '.version_select at 0x7f770198f280>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:40.825119 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-16204f48-4c30-4ba4-840a-09d566124504 tempest-ServersWithSpecificFlavorTestJSON-201764576 tempest-ServersWithSpecificFlavorTestJSON-201764576-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/790028090" status: 202 len: 0 microversion: 2.1 time: 0.128409 May 28 04:38:40.832559 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 714/1344] 10.222.0.58 () {58 vars in 1157 bytes} [Sat May 28 04:38:40 2022] DELETE /compute/v2.1/flavors/790028090 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:38:40.839216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a9ed9d80-ba94-4e72-9a76-827377d5a32f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f770753f310>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:41.156848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG neutronclient.v2_0.client [None req-a9ed9d80-ba94-4e72-9a76-827377d5a32f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group ca18ddaf-83b6-4a10-82db-36a36dadf314 in use.", "detail": ""}} {{(pid=126044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:38:41.159516 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-a9ed9d80-ba94-4e72-9a76-827377d5a32f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] HTTP exception thrown: Security Group ca18ddaf-83b6-4a10-82db-36a36dadf314 in use. May 28 04:38:41.159516 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-98b3e3fc-05da-4fa6-991e-cc7a0b3f7e6a'] May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a9ed9d80-ba94-4e72-9a76-827377d5a32f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Request method failure captured: May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/os-security-groups/ca18ddaf-83b6-4a10-82db-36a36dadf314 HTTP/1.1 May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikacH3mPNflVe6LL6bg9_A8pzAabYS23jRSixTFQfefIS8h0xsq17YlHMuAQcMYGioTiJUzGf5HQ_8pUjy0pwazx5CoRz1nqfCdunQxIHFcBiGin6OUttjeU6RRcr_kTDInnBBWYYOIl_RyOz0kb25BPKfu6ZYOhMuIQdqMRnqceoVqo May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:38:41.162289 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:38:41.163670 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:38:41.163670 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:41.163670 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:41.163670 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:41.163670 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:41.163670 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:38:41.163670 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:38:41.163670 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 54a0d2f3e0184d14ae4050562e236581 May 28 04:38:41.163670 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:41.163670 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:38:41.163670 n-d-843700-1 devstack@n-api.service[126044]: exception: Security Group ca18ddaf-83b6-4a10-82db-36a36dadf314 in use. May 28 04:38:41.163670 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-98b3e3fc-05da-4fa6-991e-cc7a0b3f7e6a'] May 28 04:38:41.163670 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'ca18ddaf-83b6-4a10-82db-36a36dadf314'} May 28 04:38:41.175051 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:38:41.175051 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:41.175051 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 28 04:38:41.175051 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 28 04:38:41.175051 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:41.175051 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:41.175051 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 28 04:38:41.175051 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 28 04:38:41.175051 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:41.175051 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:41.175051 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 28 04:38:41.175051 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 28 04:38:41.175051 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:41.175051 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:41.175051 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:38:41.175051 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:38:41.175051 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:41.175051 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:41.175051 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:38:41.176364 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:38:41.176364 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:41.176364 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:41.176364 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:38:41.176364 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:38:41.176364 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:38:41.176364 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:38:41.176364 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group ca18ddaf-83b6-4a10-82db-36a36dadf314 in use. May 28 04:38:41.176364 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98b3e3fc-05da-4fa6-991e-cc7a0b3f7e6a'] May 28 04:38:41.176364 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:41.176364 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:41.176364 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:41.176364 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:41.176364 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 28 04:38:41.176364 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 28 04:38:41.176364 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 28 04:38:41.176364 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 28 04:38:41.176364 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group ca18ddaf-83b6-4a10-82db-36a36dadf314 in use. May 28 04:38:41.176364 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98b3e3fc-05da-4fa6-991e-cc7a0b3f7e6a'] May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group ca18ddaf-83b6-4a10-82db-36a36dadf314 in use. May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98b3e3fc-05da-4fa6-991e-cc7a0b3f7e6a'] May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:41.177502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:41.178744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:41.178744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:38:41.178744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:38:41.178744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group ca18ddaf-83b6-4a10-82db-36a36dadf314 in use. May 28 04:38:41.178744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98b3e3fc-05da-4fa6-991e-cc7a0b3f7e6a'] May 28 04:38:41.178744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:41.178744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a9ed9d80-ba94-4e72-9a76-827377d5a32f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Returning 400 to user: Security Group ca18ddaf-83b6-4a10-82db-36a36dadf314 in use. May 28 04:38:41.178744 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-98b3e3fc-05da-4fa6-991e-cc7a0b3f7e6a'] {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:38:41.178744 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a9ed9d80-ba94-4e72-9a76-827377d5a32f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/ca18ddaf-83b6-4a10-82db-36a36dadf314" status: 400 len: 185 microversion: 2.1 time: 0.330133 May 28 04:38:41.178744 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 715/1345] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:38:40 2022] DELETE /compute/v2.1/os-security-groups/ca18ddaf-83b6-4a10-82db-36a36dadf314 => generated 185 bytes in 331 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:38:41.179497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-b6a81c84-cb27-49f4-bd3c-b12d8756083f req-a488ff1e-91d7-4d69-b50c-b85aa9f2a306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7c11b5-0b9f-4264-b178-d9be01a2abfb", "name": "network-vif-plugged", "status": "completed", "tag": "9d3dccec-39ea-4342-8fba-7599d04f53f4"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:41.189066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b6a81c84-cb27-49f4-bd3c-b12d8756083f req-a488ff1e-91d7-4d69-b50c-b85aa9f2a306 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:41.190362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b6a81c84-cb27-49f4-bd3c-b12d8756083f req-a488ff1e-91d7-4d69-b50c-b85aa9f2a306 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:41.207524 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-b6a81c84-cb27-49f4-bd3c-b12d8756083f req-a488ff1e-91d7-4d69-b50c-b85aa9f2a306 service nova] Creating event network-vif-plugged:9d3dccec-39ea-4342-8fba-7599d04f53f4 for instance 3e7c11b5-0b9f-4264-b178-d9be01a2abfb on n-h2-843700-1 May 28 04:38:41.221433 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-b6a81c84-cb27-49f4-bd3c-b12d8756083f req-a488ff1e-91d7-4d69-b50c-b85aa9f2a306 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055128 May 28 04:38:41.223373 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 716/1346] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:41.237250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c9c13029-fa14-49db-9530-efeac6451a35 tempest-ServersWithSpecificFlavorTestJSON-201764576 tempest-ServersWithSpecificFlavorTestJSON-201764576-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:41.265755 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c9c13029-fa14-49db-9530-efeac6451a35 tempest-ServersWithSpecificFlavorTestJSON-201764576 tempest-ServersWithSpecificFlavorTestJSON-201764576-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.041022 May 28 04:38:41.273691 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 717/1347] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:38:41 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:41.273691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bb5155c7-fa6b-408d-976e-438da56c6d39 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:41.273691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bb5155c7-fa6b-408d-976e-438da56c6d39 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:41.279871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb5155c7-fa6b-408d-976e-438da56c6d39 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:41.280327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb5155c7-fa6b-408d-976e-438da56c6d39 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:41.281748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb5155c7-fa6b-408d-976e-438da56c6d39 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:41.282423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb5155c7-fa6b-408d-976e-438da56c6d39 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:41.321946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bb5155c7-fa6b-408d-976e-438da56c6d39 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:38:41.603608 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bb5155c7-fa6b-408d-976e-438da56c6d39 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "DELETE /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 204 len: 0 microversion: 2.1 time: 0.335633 May 28 04:38:41.607148 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 718/1348] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:38:41 2022] DELETE /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:38:41.609526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7b367833-6bc8-457f-b80e-4743ce79bd18 tempest-ServersWithSpecificFlavorTestJSON-201764576 tempest-ServersWithSpecificFlavorTestJSON-201764576-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:41.610464 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:38:41.610464 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:38:41.746599 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7b367833-6bc8-457f-b80e-4743ce79bd18 tempest-ServersWithSpecificFlavorTestJSON-201764576 tempest-ServersWithSpecificFlavorTestJSON-201764576-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1960087950" status: 202 len: 0 microversion: 2.1 time: 0.141107 May 28 04:38:41.747690 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 719/1349] 10.222.0.58 () {58 vars in 1160 bytes} [Sat May 28 04:38:41 2022] DELETE /compute/v2.1/flavors/1960087950 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:38:41.754702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a5c5420b-e7a2-48da-ab09-1d5fe988fe9c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:41.755774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a5c5420b-e7a2-48da-ab09-1d5fe988fe9c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 37d0f5e8-9f68-4ef2-9310-59c143ba90ad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:41.761969 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5c5420b-e7a2-48da-ab09-1d5fe988fe9c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:41.762424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5c5420b-e7a2-48da-ab09-1d5fe988fe9c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:41.764932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5c5420b-e7a2-48da-ab09-1d5fe988fe9c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:41.764932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5c5420b-e7a2-48da-ab09-1d5fe988fe9c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:41.983071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a5c5420b-e7a2-48da-ab09-1d5fe988fe9c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:41.994122 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a5c5420b-e7a2-48da-ab09-1d5fe988fe9c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad" status: 200 len: 1319 microversion: 2.1 time: 0.241819 May 28 04:38:41.996059 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 720/1350] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:41 2022] GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:42.002646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1271524e-99eb-46e1-bf17-adf7d5ea1975 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:42.005636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1271524e-99eb-46e1-bf17-adf7d5ea1975 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:42.010803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1271524e-99eb-46e1-bf17-adf7d5ea1975 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:42.014172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1271524e-99eb-46e1-bf17-adf7d5ea1975 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:42.014172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1271524e-99eb-46e1-bf17-adf7d5ea1975 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:42.014172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1271524e-99eb-46e1-bf17-adf7d5ea1975 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:42.155279 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-049789bc-fc2f-47c7-9e7e-22c6b7721c1a tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/164fa4a7-0c06-447b-a068-0ca3b0a41726" status: 202 len: 0 microversion: 2.1 time: 1.415757 May 28 04:38:42.158779 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 631/1351] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 04:38:40 2022] DELETE /compute/v2.1/os-floating-ips/164fa4a7-0c06-447b-a068-0ca3b0a41726 => generated 0 bytes in 1417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:38:42.164822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ff7ca784-88c1-4aef-8b12-38d133a3dc47 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:42.165733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ff7ca784-88c1-4aef-8b12-38d133a3dc47 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:42.182488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff7ca784-88c1-4aef-8b12-38d133a3dc47 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:42.194526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff7ca784-88c1-4aef-8b12-38d133a3dc47 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:42.195668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff7ca784-88c1-4aef-8b12-38d133a3dc47 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:42.196400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff7ca784-88c1-4aef-8b12-38d133a3dc47 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:42.258049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1271524e-99eb-46e1-bf17-adf7d5ea1975 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:42.270260 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1271524e-99eb-46e1-bf17-adf7d5ea1975 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 200 len: 1643 microversion: 2.1 time: 0.271774 May 28 04:38:42.270858 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 721/1352] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:41 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 1643 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:42.288346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7b9825db-0b66-4e53-8f53-a508bfa2d2b4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:42.288939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7b9825db-0b66-4e53-8f53-a508bfa2d2b4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:42.300279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b9825db-0b66-4e53-8f53-a508bfa2d2b4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:42.301346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b9825db-0b66-4e53-8f53-a508bfa2d2b4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:42.302549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b9825db-0b66-4e53-8f53-a508bfa2d2b4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:42.303282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b9825db-0b66-4e53-8f53-a508bfa2d2b4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:42.309612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:42.385951 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7b9825db-0b66-4e53-8f53-a508bfa2d2b4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:42.396683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7b9825db-0b66-4e53-8f53-a508bfa2d2b4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:42.400374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7b9825db-0b66-4e53-8f53-a508bfa2d2b4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:42.401853 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7b9825db-0b66-4e53-8f53-a508bfa2d2b4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1321 microversion: 2.25 time: 0.119099 May 28 04:38:42.431917 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 722/1353] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:42 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:42.442114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e8cb909c-39c3-4baf-8598-ab81724e6e24 tempest-ServersWithSpecificFlavorTestJSON-201764576 tempest-ServersWithSpecificFlavorTestJSON-201764576-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:42.461153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ff7ca784-88c1-4aef-8b12-38d133a3dc47 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:42.467106 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e8cb909c-39c3-4baf-8598-ab81724e6e24 tempest-ServersWithSpecificFlavorTestJSON-201764576 tempest-ServersWithSpecificFlavorTestJSON-201764576-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033604 May 28 04:38:42.467703 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 723/1354] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:38:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:42.470380 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ff7ca784-88c1-4aef-8b12-38d133a3dc47 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1535 microversion: 2.1 time: 0.312834 May 28 04:38:42.470971 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 632/1355] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:42 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1535 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:42.473351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0c8d6107-f70c-4f33-a0b4-4bc08f1f91c4 tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] Calling method '.version_select at 0x7f770754c940>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:42.476325 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b9cf0937-5b93-46ba-9f20-f62b9ff0abb2 req-09eb001b-fc8a-48a0-8c0f-355494b0b12d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17bf9454-cf2b-4049-b817-556e4c74b350", "name": "network-vif-unplugged", "status": "completed", "tag": "9a1c5bed-5c2a-4af6-98f9-e6c6cf8a4d4c"}, {"name": "network-changed", "server_uuid": "17bf9454-cf2b-4049-b817-556e4c74b350", "tag": "9a1c5bed-5c2a-4af6-98f9-e6c6cf8a4d4c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:42.486433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b9cf0937-5b93-46ba-9f20-f62b9ff0abb2 req-09eb001b-fc8a-48a0-8c0f-355494b0b12d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:42.487205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b9cf0937-5b93-46ba-9f20-f62b9ff0abb2 req-09eb001b-fc8a-48a0-8c0f-355494b0b12d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:42.522771 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b9cf0937-5b93-46ba-9f20-f62b9ff0abb2 req-09eb001b-fc8a-48a0-8c0f-355494b0b12d service nova] Creating event network-vif-unplugged:9a1c5bed-5c2a-4af6-98f9-e6c6cf8a4d4c for instance 17bf9454-cf2b-4049-b817-556e4c74b350 on n-h2-843700-1 May 28 04:38:42.523504 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b9cf0937-5b93-46ba-9f20-f62b9ff0abb2 req-09eb001b-fc8a-48a0-8c0f-355494b0b12d service nova] Creating event network-changed:9a1c5bed-5c2a-4af6-98f9-e6c6cf8a4d4c for instance 17bf9454-cf2b-4049-b817-556e4c74b350 on n-h2-843700-1 May 28 04:38:42.531183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-b9cf0937-5b93-46ba-9f20-f62b9ff0abb2 req-09eb001b-fc8a-48a0-8c0f-355494b0b12d service nova] Instance 17bf9454-cf2b-4049-b817-556e4c74b350 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:38:42.544207 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b9cf0937-5b93-46ba-9f20-f62b9ff0abb2 req-09eb001b-fc8a-48a0-8c0f-355494b0b12d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.071857 May 28 04:38:42.546204 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 633/1356] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:42.551774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-058d9e90-7521-4734-afe8-2fc235d4d579 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:42.554318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-058d9e90-7521-4734-afe8-2fc235d4d579 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:42.578762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-058d9e90-7521-4734-afe8-2fc235d4d579 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:42.579267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-058d9e90-7521-4734-afe8-2fc235d4d579 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:42.580065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-058d9e90-7521-4734-afe8-2fc235d4d579 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:42.582091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-058d9e90-7521-4734-afe8-2fc235d4d579 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:42.613657 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-058d9e90-7521-4734-afe8-2fc235d4d579 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] HTTP exception thrown: Instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 could not be found. May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-058d9e90-7521-4734-afe8-2fc235d4d579 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Request method failure captured: May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 HTTP/1.1 May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaaptvX93jncUvtDm1M67CLWO3joyo0E09c_c5FiJQQfrfRcVdXnjfTGtDwuB8oYr_k2K7FUogNWi8ibbbR1-2rtm46el9R3k-feuOlqBBEe2y6QpisrLZUsQ4zm5OUUNfINKKeFkozJMGAPHkZeN4XCaYYKd002U0ilJwVrdrS6P2M May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 7b5e68532952468cbd37fad9b381d355 May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:38:42.620581 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:38:42.622369 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7b5e68532952468cbd37fad9b381d355"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:38:42.622369 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:42.622369 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 7b5e68532952468cbd37fad9b381d355 May 28 04:38:42.622369 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:42.622369 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersWithSpecificFlavorTestJSON-622287351-project May 28 04:38:42.622369 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:38:42.622369 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:38:42.622369 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c567ca604e0743bf874889ba69bbeb49 May 28 04:38:42.622369 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351-project May 28 04:38:42.622369 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:38:42.622369 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 could not be found. May 28 04:38:42.622369 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '7cf16b71-8fa1-4433-9af1-869667b8f7e3'} May 28 04:38:42.623919 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:38:42.623919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:42.623919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:38:42.623919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:38:42.623919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:38:42.623919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:38:42.623919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:38:42.623919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:38:42.623919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:38:42.623919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:38:42.623919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 could not be found. May 28 04:38:42.623919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:42.623919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:42.623919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:42.623919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:42.623919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:42.623919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:42.623919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:38:42.623919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:38:42.623919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:38:42.625611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:38:42.625611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:38:42.625611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:38:42.625611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:38:42.625611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:38:42.625611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:38:42.625611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:38:42.625611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:38:42.625611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:38:42.625611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 could not be found. May 28 04:38:42.625611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:42.625611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:42.625611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:42.625611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:42.625611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:42.625611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:42.625611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:38:42.625611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:38:42.625611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 could not be found. May 28 04:38:42.625611 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:42.628051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-058d9e90-7521-4734-afe8-2fc235d4d579 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Returning 404 to user: Instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:38:42.628335 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-058d9e90-7521-4734-afe8-2fc235d4d579 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3" status: 404 len: 111 microversion: 2.1 time: 0.080796 May 28 04:38:42.633117 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 634/1357] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:38:42 2022] DELETE /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:38:42.645297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5843418b-60a9-4d9f-9047-06f2eed1a48b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:42.645996 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5843418b-60a9-4d9f-9047-06f2eed1a48b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 7cf16b71-8fa1-4433-9af1-869667b8f7e3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:42.660227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5843418b-60a9-4d9f-9047-06f2eed1a48b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:42.667231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5843418b-60a9-4d9f-9047-06f2eed1a48b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:42.667231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5843418b-60a9-4d9f-9047-06f2eed1a48b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:42.667231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5843418b-60a9-4d9f-9047-06f2eed1a48b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:42.699357 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-5843418b-60a9-4d9f-9047-06f2eed1a48b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] HTTP exception thrown: Instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 could not be found. May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5843418b-60a9-4d9f-9047-06f2eed1a48b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Request method failure captured: May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 HTTP/1.1 May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaaptvX93jncUvtDm1M67CLWO3joyo0E09c_c5FiJQQfrfRcVdXnjfTGtDwuB8oYr_k2K7FUogNWi8ibbbR1-2rtm46el9R3k-feuOlqBBEe2y6QpisrLZUsQ4zm5OUUNfINKKeFkozJMGAPHkZeN4XCaYYKd002U0ilJwVrdrS6P2M May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 7b5e68532952468cbd37fad9b381d355 May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:38:42.701418 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:38:42.703044 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7b5e68532952468cbd37fad9b381d355"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:38:42.703044 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:42.703044 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 7b5e68532952468cbd37fad9b381d355 May 28 04:38:42.703044 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:42.703044 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersWithSpecificFlavorTestJSON-622287351-project May 28 04:38:42.703044 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:38:42.703044 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:38:42.703044 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c567ca604e0743bf874889ba69bbeb49 May 28 04:38:42.703044 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351-project May 28 04:38:42.703044 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:38:42.703044 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 could not be found. May 28 04:38:42.703044 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '7cf16b71-8fa1-4433-9af1-869667b8f7e3'} May 28 04:38:42.703914 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:38:42.703914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:42.703914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:38:42.703914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:38:42.703914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:38:42.703914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:38:42.703914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:38:42.703914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:38:42.703914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:38:42.703914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:38:42.703914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 could not be found. May 28 04:38:42.703914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:42.703914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:42.703914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:42.703914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:42.703914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:42.703914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:42.703914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:38:42.703914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:38:42.703914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:38:42.705273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:38:42.705273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:38:42.705273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:38:42.705273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:38:42.705273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:38:42.705273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:38:42.705273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:38:42.705273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 could not be found. May 28 04:38:42.705273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:42.705273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:42.705273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:42.705273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:42.705273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:42.705273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:42.705273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:38:42.705273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:38:42.705273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 could not be found. May 28 04:38:42.705273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:42.707301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5843418b-60a9-4d9f-9047-06f2eed1a48b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Returning 404 to user: Instance 7cf16b71-8fa1-4433-9af1-869667b8f7e3 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:38:42.708311 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5843418b-60a9-4d9f-9047-06f2eed1a48b tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3" status: 404 len: 111 microversion: 2.1 time: 0.073902 May 28 04:38:42.709412 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 635/1358] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:42 2022] GET /compute/v2.1/servers/7cf16b71-8fa1-4433-9af1-869667b8f7e3 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:38:42.714676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-1ad709e1-c20f-4065-a266-7894691db118 req-c3f4330c-825a-4e65-9698-48953f5e78cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ceda1f-e500-41ce-a086-8bcd9979435a", "tag": "539b57c9-d282-4ec4-9581-f4091e5f2833"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:42.725830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1ad709e1-c20f-4065-a266-7894691db118 req-c3f4330c-825a-4e65-9698-48953f5e78cb service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:42.726617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1ad709e1-c20f-4065-a266-7894691db118 req-c3f4330c-825a-4e65-9698-48953f5e78cb service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:42.740102 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-1ad709e1-c20f-4065-a266-7894691db118 req-c3f4330c-825a-4e65-9698-48953f5e78cb service nova] Creating event network-changed:539b57c9-d282-4ec4-9581-f4091e5f2833 for instance 90ceda1f-e500-41ce-a086-8bcd9979435a on n-h1-843700-1 May 28 04:38:42.746006 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-1ad709e1-c20f-4065-a266-7894691db118 req-c3f4330c-825a-4e65-9698-48953f5e78cb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035140 May 28 04:38:42.747221 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 636/1359] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:42.754582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e09dd51f-005e-4042-982a-d1d996ad1dbc tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:42.755551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e09dd51f-005e-4042-982a-d1d996ad1dbc tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:42.765398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e09dd51f-005e-4042-982a-d1d996ad1dbc tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:42.769566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e09dd51f-005e-4042-982a-d1d996ad1dbc tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:42.769566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e09dd51f-005e-4042-982a-d1d996ad1dbc tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:42.769566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e09dd51f-005e-4042-982a-d1d996ad1dbc tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:42.787114 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-e09dd51f-005e-4042-982a-d1d996ad1dbc tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] HTTP exception thrown: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e09dd51f-005e-4042-982a-d1d996ad1dbc tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Request method failure captured: May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 HTTP/1.1 May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaaptvX93jncUvtDm1M67CLWO3joyo0E09c_c5FiJQQfrfRcVdXnjfTGtDwuB8oYr_k2K7FUogNWi8ibbbR1-2rtm46el9R3k-feuOlqBBEe2y6QpisrLZUsQ4zm5OUUNfINKKeFkozJMGAPHkZeN4XCaYYKd002U0ilJwVrdrS6P2M May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 7b5e68532952468cbd37fad9b381d355 May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:38:42.787464 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:38:42.789109 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7b5e68532952468cbd37fad9b381d355"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:38:42.789109 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:42.789109 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 7b5e68532952468cbd37fad9b381d355 May 28 04:38:42.789109 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:42.789109 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersWithSpecificFlavorTestJSON-622287351-project May 28 04:38:42.789109 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:38:42.789109 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:38:42.789109 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c567ca604e0743bf874889ba69bbeb49 May 28 04:38:42.789109 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351-project May 28 04:38:42.789109 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:38:42.789109 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. May 28 04:38:42.789109 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '88c86c50-5759-4619-9f17-a61d7452a6e8'} May 28 04:38:42.790007 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:38:42.790007 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:42.790007 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:38:42.790007 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:38:42.790007 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:38:42.790007 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:38:42.790007 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:38:42.790007 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:38:42.790007 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:38:42.790007 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:38:42.790007 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. May 28 04:38:42.790007 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:42.790007 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:42.790007 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:42.790007 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:42.790007 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:42.790007 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:42.790007 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:38:42.790007 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:38:42.790007 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:38:42.791519 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:38:42.791519 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:38:42.791519 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:38:42.791519 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:38:42.791519 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:38:42.791519 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:38:42.791519 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:38:42.791519 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:38:42.791519 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:38:42.791519 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. May 28 04:38:42.791519 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:42.791519 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:42.791519 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:42.791519 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:42.791519 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:42.791519 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:42.791519 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:38:42.791519 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:38:42.791519 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. May 28 04:38:42.791519 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:42.793044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e09dd51f-005e-4042-982a-d1d996ad1dbc tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Returning 404 to user: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:38:42.793044 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e09dd51f-005e-4042-982a-d1d996ad1dbc tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "DELETE /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8" status: 404 len: 111 microversion: 2.1 time: 0.041116 May 28 04:38:42.796724 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 637/1360] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:38:42 2022] DELETE /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:38:42.802142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9aa496e4-6c2c-4d2b-b9c5-97bcb26db115 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:42.803067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9aa496e4-6c2c-4d2b-b9c5-97bcb26db115 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] [instance: 88c86c50-5759-4619-9f17-a61d7452a6e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:42.811815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9aa496e4-6c2c-4d2b-b9c5-97bcb26db115 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:42.812894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9aa496e4-6c2c-4d2b-b9c5-97bcb26db115 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:42.814284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9aa496e4-6c2c-4d2b-b9c5-97bcb26db115 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:42.815234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9aa496e4-6c2c-4d2b-b9c5-97bcb26db115 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:42.834924 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-9aa496e4-6c2c-4d2b-b9c5-97bcb26db115 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] HTTP exception thrown: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9aa496e4-6c2c-4d2b-b9c5-97bcb26db115 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Request method failure captured: May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 HTTP/1.1 May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaaptvX93jncUvtDm1M67CLWO3joyo0E09c_c5FiJQQfrfRcVdXnjfTGtDwuB8oYr_k2K7FUogNWi8ibbbR1-2rtm46el9R3k-feuOlqBBEe2y6QpisrLZUsQ4zm5OUUNfINKKeFkozJMGAPHkZeN4XCaYYKd002U0ilJwVrdrS6P2M May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 7b5e68532952468cbd37fad9b381d355 May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:38:42.836647 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:38:42.838012 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7b5e68532952468cbd37fad9b381d355"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7b5e68532952468cbd37fad9b381d355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:38:42.838012 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:42.838012 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 7b5e68532952468cbd37fad9b381d355 May 28 04:38:42.838012 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351 May 28 04:38:42.838012 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersWithSpecificFlavorTestJSON-622287351-project May 28 04:38:42.838012 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:38:42.838012 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:38:42.838012 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c567ca604e0743bf874889ba69bbeb49 May 28 04:38:42.838012 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-622287351-project May 28 04:38:42.838012 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:38:42.838012 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. May 28 04:38:42.838012 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '88c86c50-5759-4619-9f17-a61d7452a6e8'} May 28 04:38:42.838817 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:38:42.838817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:42.838817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:38:42.838817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:38:42.838817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:38:42.838817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:38:42.838817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:38:42.838817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:38:42.838817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:38:42.838817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:38:42.838817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. May 28 04:38:42.838817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:42.838817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:42.838817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:42.838817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:42.838817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:42.838817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:42.838817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:38:42.838817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:38:42.838817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:38:42.840041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:38:42.840041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:38:42.840041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:38:42.840041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:38:42.840041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:38:42.840041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:38:42.840041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:38:42.840041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. May 28 04:38:42.840041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:42.840041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:42.840041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:42.840041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:42.840041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:42.840041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:42.840041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:38:42.840041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:38:42.840041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. May 28 04:38:42.840041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:42.841136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9aa496e4-6c2c-4d2b-b9c5-97bcb26db115 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] Returning 404 to user: Instance 88c86c50-5759-4619-9f17-a61d7452a6e8 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:38:42.841136 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9aa496e4-6c2c-4d2b-b9c5-97bcb26db115 tempest-ServersWithSpecificFlavorTestJSON-622287351 tempest-ServersWithSpecificFlavorTestJSON-622287351-project] 10.222.0.58 "GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8" status: 404 len: 111 microversion: 2.1 time: 0.040278 May 28 04:38:42.843086 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 638/1361] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:42 2022] GET /compute/v2.1/servers/88c86c50-5759-4619-9f17-a61d7452a6e8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:38:43.015149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-abd3941d-ffe1-4fa2-95f7-1aad06cfaf10 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:43.017396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-abd3941d-ffe1-4fa2-95f7-1aad06cfaf10 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 37d0f5e8-9f68-4ef2-9310-59c143ba90ad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:43.025904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abd3941d-ffe1-4fa2-95f7-1aad06cfaf10 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:43.026685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abd3941d-ffe1-4fa2-95f7-1aad06cfaf10 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:43.027831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abd3941d-ffe1-4fa2-95f7-1aad06cfaf10 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:43.028195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abd3941d-ffe1-4fa2-95f7-1aad06cfaf10 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:43.035029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:44.001518 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-abd3941d-ffe1-4fa2-95f7-1aad06cfaf10 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:44.011129 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-abd3941d-ffe1-4fa2-95f7-1aad06cfaf10 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad" status: 200 len: 1319 microversion: 2.1 time: 1.001866 May 28 04:38:44.019794 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 639/1362] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:43 2022] GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad => generated 1319 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:44.035017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9fef2e10-d0c8-4241-9605-601a2d6ad165 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:44.037611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9fef2e10-d0c8-4241-9605-601a2d6ad165 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:44.046979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fef2e10-d0c8-4241-9605-601a2d6ad165 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:44.047708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fef2e10-d0c8-4241-9605-601a2d6ad165 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:44.048671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fef2e10-d0c8-4241-9605-601a2d6ad165 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:44.049279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fef2e10-d0c8-4241-9605-601a2d6ad165 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:45.089523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9fef2e10-d0c8-4241-9605-601a2d6ad165 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:45.100502 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9fef2e10-d0c8-4241-9605-601a2d6ad165 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 200 len: 1643 microversion: 2.1 time: 1.079367 May 28 04:38:45.104242 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 640/1363] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:44 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 1643 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:45.115983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fe151efb-6435-4a7b-a10a-6ccec4016221 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:45.126506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fe151efb-6435-4a7b-a10a-6ccec4016221 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:45.136619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe151efb-6435-4a7b-a10a-6ccec4016221 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:45.137341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe151efb-6435-4a7b-a10a-6ccec4016221 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:45.139186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe151efb-6435-4a7b-a10a-6ccec4016221 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:45.140394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe151efb-6435-4a7b-a10a-6ccec4016221 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:45.510479 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0c8d6107-f70c-4f33-a0b4-4bc08f1f91c4 tempest-FloatingIPDetailsTestJSON-678093942 tempest-FloatingIPDetailsTestJSON-678093942-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/30a5a78c-bdc6-457d-a3d7-d93c33131455" status: 202 len: 0 microversion: 2.1 time: 3.041333 May 28 04:38:45.512186 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 724/1364] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 04:38:42 2022] DELETE /compute/v2.1/os-floating-ips/30a5a78c-bdc6-457d-a3d7-d93c33131455 => generated 0 bytes in 3043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:38:45.523155 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a9aba57e-93f8-4165-ae5a-1aaaf1e0bf42 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:45.523780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a9aba57e-93f8-4165-ae5a-1aaaf1e0bf42 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:45.559316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a9aba57e-93f8-4165-ae5a-1aaaf1e0bf42 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:45.564252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a9aba57e-93f8-4165-ae5a-1aaaf1e0bf42 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:45.565176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a9aba57e-93f8-4165-ae5a-1aaaf1e0bf42 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:45.566610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a9aba57e-93f8-4165-ae5a-1aaaf1e0bf42 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:45.636231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fe151efb-6435-4a7b-a10a-6ccec4016221 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:45.665393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fe151efb-6435-4a7b-a10a-6ccec4016221 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:45.667158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fe151efb-6435-4a7b-a10a-6ccec4016221 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:45.668355 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fe151efb-6435-4a7b-a10a-6ccec4016221 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1361 microversion: 2.25 time: 0.565459 May 28 04:38:45.669237 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 641/1365] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:45 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1361 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:45.674615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-90f327a6-73b5-489a-83b5-1cd81a38af38 req-4746adba-7525-4751-a2f3-82d125922130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37d0f5e8-9f68-4ef2-9310-59c143ba90ad", "name": "network-vif-plugged", "status": "completed", "tag": "15222ba8-2eb7-4295-9f75-798d9d032881"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:45.683154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-90f327a6-73b5-489a-83b5-1cd81a38af38 req-4746adba-7525-4751-a2f3-82d125922130 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:45.683819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-90f327a6-73b5-489a-83b5-1cd81a38af38 req-4746adba-7525-4751-a2f3-82d125922130 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:45.703883 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-90f327a6-73b5-489a-83b5-1cd81a38af38 req-4746adba-7525-4751-a2f3-82d125922130 service nova] Creating event network-vif-plugged:15222ba8-2eb7-4295-9f75-798d9d032881 for instance 37d0f5e8-9f68-4ef2-9310-59c143ba90ad on n-h1-843700-1 May 28 04:38:45.718406 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-90f327a6-73b5-489a-83b5-1cd81a38af38 req-4746adba-7525-4751-a2f3-82d125922130 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047663 May 28 04:38:45.719079 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 642/1366] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:45.729200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fc96ec95-c088-4230-b3ee-310b55f889c9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:45.730001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fc96ec95-c088-4230-b3ee-310b55f889c9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 37d0f5e8-9f68-4ef2-9310-59c143ba90ad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:45.747494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc96ec95-c088-4230-b3ee-310b55f889c9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:45.748628 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc96ec95-c088-4230-b3ee-310b55f889c9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:45.749493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc96ec95-c088-4230-b3ee-310b55f889c9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:45.750007 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc96ec95-c088-4230-b3ee-310b55f889c9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:45.987486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a9aba57e-93f8-4165-ae5a-1aaaf1e0bf42 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:46.004584 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a9aba57e-93f8-4165-ae5a-1aaaf1e0bf42 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1528 microversion: 2.1 time: 0.487573 May 28 04:38:46.017532 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 725/1367] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:45 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1528 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:46.017532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-8d5fd942-68d8-40c0-9bc1-0c060f7d1d99 req-f60ee21d-55dc-4d6c-8905-b892fa8ffe74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ceda1f-e500-41ce-a086-8bcd9979435a", "name": "network-vif-deleted", "tag": "539b57c9-d282-4ec4-9581-f4091e5f2833"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:46.026592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8d5fd942-68d8-40c0-9bc1-0c060f7d1d99 req-f60ee21d-55dc-4d6c-8905-b892fa8ffe74 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:46.027162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8d5fd942-68d8-40c0-9bc1-0c060f7d1d99 req-f60ee21d-55dc-4d6c-8905-b892fa8ffe74 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:46.042180 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-8d5fd942-68d8-40c0-9bc1-0c060f7d1d99 req-f60ee21d-55dc-4d6c-8905-b892fa8ffe74 service nova] Creating event network-vif-deleted:539b57c9-d282-4ec4-9581-f4091e5f2833 for instance 90ceda1f-e500-41ce-a086-8bcd9979435a on n-h1-843700-1 May 28 04:38:46.047514 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-8d5fd942-68d8-40c0-9bc1-0c060f7d1d99 req-f60ee21d-55dc-4d6c-8905-b892fa8ffe74 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038551 May 28 04:38:46.048886 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 726/1368] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:46.054267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cd687b61-6c43-4b16-aa9a-e573abe773c6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:46.055205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cd687b61-6c43-4b16-aa9a-e573abe773c6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:46.069294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cd687b61-6c43-4b16-aa9a-e573abe773c6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:46.070023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cd687b61-6c43-4b16-aa9a-e573abe773c6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:46.071449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cd687b61-6c43-4b16-aa9a-e573abe773c6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:46.071950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cd687b61-6c43-4b16-aa9a-e573abe773c6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:46.251456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fc96ec95-c088-4230-b3ee-310b55f889c9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:46.261263 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fc96ec95-c088-4230-b3ee-310b55f889c9 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad" status: 200 len: 1319 microversion: 2.1 time: 0.537606 May 28 04:38:46.262767 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 643/1369] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:45 2022] GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad => generated 1319 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:46.269033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5587de04-a406-43eb-98e3-ea8b63fd9463 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:46.269951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5587de04-a406-43eb-98e3-ea8b63fd9463 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:46.283012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5587de04-a406-43eb-98e3-ea8b63fd9463 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:46.283012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5587de04-a406-43eb-98e3-ea8b63fd9463 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:46.283823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5587de04-a406-43eb-98e3-ea8b63fd9463 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:46.284351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5587de04-a406-43eb-98e3-ea8b63fd9463 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:46.323908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5587de04-a406-43eb-98e3-ea8b63fd9463 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:46.330750 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5587de04-a406-43eb-98e3-ea8b63fd9463 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:46.330750 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-5587de04-a406-43eb-98e3-ea8b63fd9463 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lazy-loading 'fault' on Instance uuid 90ceda1f-e500-41ce-a086-8bcd9979435a {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:38:46.782169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5587de04-a406-43eb-98e3-ea8b63fd9463 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:46.790981 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5587de04-a406-43eb-98e3-ea8b63fd9463 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 200 len: 1305 microversion: 2.1 time: 0.526660 May 28 04:38:46.793432 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 644/1370] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:46 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 1305 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:46.798240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bf3ab625-cce4-49e7-a725-bac4a01320a7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:46.798855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bf3ab625-cce4-49e7-a725-bac4a01320a7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:46.805201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf3ab625-cce4-49e7-a725-bac4a01320a7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:46.805994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf3ab625-cce4-49e7-a725-bac4a01320a7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:46.807257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf3ab625-cce4-49e7-a725-bac4a01320a7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:46.808122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf3ab625-cce4-49e7-a725-bac4a01320a7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:46.812910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cd687b61-6c43-4b16-aa9a-e573abe773c6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:46.822972 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cd687b61-6c43-4b16-aa9a-e573abe773c6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1528 microversion: 2.1 time: 0.772631 May 28 04:38:46.824109 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 727/1371] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:46 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1528 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:46.844913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ceec9f34-8208-4e49-b7c9-4898c017aa24 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:46.846020 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:38:46.846020 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:38:46.852082 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-ceec9f34-8208-4e49-b7c9-4898c017aa24 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] HTTP exception thrown: Flavor f4fa1d39-7abe-438c-9c7b-1c96bd104438 could not be found. May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ceec9f34-8208-4e49-b7c9-4898c017aa24 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Request method failure captured: May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/flavors/f4fa1d39-7abe-438c-9c7b-1c96bd104438 HTTP/1.1 May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZixPzYZupKpfYORlujRmi7AEi-KgT5iaJ-zdVtE9QxRCw5XCQQ1p1Iwgzaw5l3rbkti4Yc_DH5peMdbLX1xAF7aYw0a57gl71IfCD_O2wBwoebgoaw5xvJQ_u7YqA3anOU1lW3CaCPVfbVV_gIbq9bfjX9PtZW-iIavlr9UtxhImc May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: b724702716164d928271e58ac2b375ef May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-MigrationsAdminTest-930472004 May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:38:46.856873 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:38:46.859094 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b724702716164d928271e58ac2b375ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b724702716164d928271e58ac2b375ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b724702716164d928271e58ac2b375ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b724702716164d928271e58ac2b375ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:38:46.859094 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-MigrationsAdminTest-930472004 May 28 04:38:46.859094 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: b724702716164d928271e58ac2b375ef May 28 04:38:46.859094 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-MigrationsAdminTest-930472004 May 28 04:38:46.859094 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-MigrationsAdminTest-930472004-project-admin May 28 04:38:46.859094 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:38:46.859094 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:38:46.859094 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: dd2f32c3deaa43c38bd7f296c35b09ae May 28 04:38:46.859094 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-MigrationsAdminTest-930472004-project-admin May 28 04:38:46.859094 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:38:46.859094 n-d-843700-1 devstack@n-api.service[126044]: exception: Flavor f4fa1d39-7abe-438c-9c7b-1c96bd104438 could not be found. May 28 04:38:46.859094 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'f4fa1d39-7abe-438c-9c7b-1c96bd104438'} May 28 04:38:46.859900 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:38:46.859900 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:46.859900 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete May 28 04:38:46.859900 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi flavor.destroy() May 28 04:38:46.859900 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 28 04:38:46.859900 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 28 04:38:46.859900 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy May 28 04:38:46.859900 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, May 28 04:38:46.859900 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy May 28 04:38:46.859900 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) May 28 04:38:46.859900 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:38:46.859900 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:38:46.859900 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy May 28 04:38:46.859900 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) May 28 04:38:46.859900 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor f4fa1d39-7abe-438c-9c7b-1c96bd104438 could not be found. May 28 04:38:46.859900 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:46.859900 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:46.859900 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:46.859900 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:46.859900 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:46.861229 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:46.861229 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:38:46.861229 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:38:46.861229 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:38:46.861229 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:38:46.861229 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete May 28 04:38:46.861229 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:38:46.861229 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor f4fa1d39-7abe-438c-9c7b-1c96bd104438 could not be found. May 28 04:38:46.861229 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:46.861229 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:46.861229 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:46.861229 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:46.861229 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:46.861229 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:46.861229 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:38:46.861229 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:38:46.861229 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor f4fa1d39-7abe-438c-9c7b-1c96bd104438 could not be found. May 28 04:38:46.861229 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:46.862279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ceec9f34-8208-4e49-b7c9-4898c017aa24 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Returning 404 to user: Flavor f4fa1d39-7abe-438c-9c7b-1c96bd104438 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:38:46.862279 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ceec9f34-8208-4e49-b7c9-4898c017aa24 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/f4fa1d39-7abe-438c-9c7b-1c96bd104438" status: 404 len: 109 microversion: 2.1 time: 0.016136 May 28 04:38:46.863160 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 728/1372] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:38:46 2022] DELETE /compute/v2.1/flavors/f4fa1d39-7abe-438c-9c7b-1c96bd104438 => generated 109 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:38:46.981369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e4add809-9c7e-40e5-af7c-9e86ab51fb60 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1808919002", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:47.037804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-e4add809-9c7e-40e5-af7c-9e86ab51fb60 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:38:47.207586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bf3ab625-cce4-49e7-a725-bac4a01320a7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:47.218616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bf3ab625-cce4-49e7-a725-bac4a01320a7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:47.220196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bf3ab625-cce4-49e7-a725-bac4a01320a7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:47.221331 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bf3ab625-cce4-49e7-a725-bac4a01320a7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1361 microversion: 2.25 time: 0.428334 May 28 04:38:47.231371 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 645/1373] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:46 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1361 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:47.279562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-61166df7-4bf0-43f0-bc90-338ed6736e6f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:47.281160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-61166df7-4bf0-43f0-bc90-338ed6736e6f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 37d0f5e8-9f68-4ef2-9310-59c143ba90ad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:47.288953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-61166df7-4bf0-43f0-bc90-338ed6736e6f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:47.289777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-61166df7-4bf0-43f0-bc90-338ed6736e6f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:47.290727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-61166df7-4bf0-43f0-bc90-338ed6736e6f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:47.291568 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-61166df7-4bf0-43f0-bc90-338ed6736e6f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:47.683656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-e4add809-9c7e-40e5-af7c-9e86ab51fb60 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:38:47.683656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-e4add809-9c7e-40e5-af7c-9e86ab51fb60 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:38:47.683656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-e4add809-9c7e-40e5-af7c-9e86ab51fb60 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:38:47.683656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-e4add809-9c7e-40e5-af7c-9e86ab51fb60 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:38:47.683656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-e4add809-9c7e-40e5-af7c-9e86ab51fb60 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:38:47.684444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e4add809-9c7e-40e5-af7c-9e86ab51fb60 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:47.684444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e4add809-9c7e-40e5-af7c-9e86ab51fb60 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:47.684444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e4add809-9c7e-40e5-af7c-9e86ab51fb60 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:47.684444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e4add809-9c7e-40e5-af7c-9e86ab51fb60 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:47.697751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-61166df7-4bf0-43f0-bc90-338ed6736e6f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:47.710826 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-61166df7-4bf0-43f0-bc90-338ed6736e6f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad" status: 200 len: 1319 microversion: 2.1 time: 0.436481 May 28 04:38:47.712353 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 646/1374] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:47 2022] GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad => generated 1319 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:38:47.715233 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-e4add809-9c7e-40e5-af7c-9e86ab51fb60 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Getting quotas for project 506fcf1e564049258c90cf33d274fc5f. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:38:47.720809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-e4add809-9c7e-40e5-af7c-9e86ab51fb60 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Getting quotas for user 6d208bde90d54f7487f39c505b884285 and project 506fcf1e564049258c90cf33d274fc5f. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:38:47.743512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-d608d354-3827-4d59-81c9-610dfccbe0bb req-2c1e84c2-d810-4a84-9f9c-4d303598056a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ceda1f-e500-41ce-a086-8bcd9979435a", "name": "network-vif-unplugged", "status": "completed", "tag": "539b57c9-d282-4ec4-9581-f4091e5f2833"}, {"server_uuid": "17bf9454-cf2b-4049-b817-556e4c74b350", "name": "network-vif-plugged", "status": "completed", "tag": "9a1c5bed-5c2a-4af6-98f9-e6c6cf8a4d4c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:47.754127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e4add809-9c7e-40e5-af7c-9e86ab51fb60 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:38:47.765617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e4add809-9c7e-40e5-af7c-9e86ab51fb60 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:38:47.765802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d608d354-3827-4d59-81c9-610dfccbe0bb req-2c1e84c2-d810-4a84-9f9c-4d303598056a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:47.765802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d608d354-3827-4d59-81c9-610dfccbe0bb req-2c1e84c2-d810-4a84-9f9c-4d303598056a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:47.801089 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-d608d354-3827-4d59-81c9-610dfccbe0bb req-2c1e84c2-d810-4a84-9f9c-4d303598056a service nova] Creating event network-vif-unplugged:539b57c9-d282-4ec4-9581-f4091e5f2833 for instance 90ceda1f-e500-41ce-a086-8bcd9979435a on n-h1-843700-1 May 28 04:38:47.801904 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-d608d354-3827-4d59-81c9-610dfccbe0bb req-2c1e84c2-d810-4a84-9f9c-4d303598056a service nova] Creating event network-vif-plugged:9a1c5bed-5c2a-4af6-98f9-e6c6cf8a4d4c for instance 17bf9454-cf2b-4049-b817-556e4c74b350 on n-h2-843700-1 May 28 04:38:47.817478 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-d608d354-3827-4d59-81c9-610dfccbe0bb req-2c1e84c2-d810-4a84-9f9c-4d303598056a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.080731 May 28 04:38:47.822193 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 647/1375] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:38:47.836466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e6753e7c-9712-4f06-9d34-49bd7b5f0462 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:47.838450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e6753e7c-9712-4f06-9d34-49bd7b5f0462 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:47.846724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6753e7c-9712-4f06-9d34-49bd7b5f0462 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:47.847462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6753e7c-9712-4f06-9d34-49bd7b5f0462 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:47.849041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6753e7c-9712-4f06-9d34-49bd7b5f0462 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:47.849841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6753e7c-9712-4f06-9d34-49bd7b5f0462 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:47.866537 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-e6753e7c-9712-4f06-9d34-49bd7b5f0462 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] HTTP exception thrown: Instance 90ceda1f-e500-41ce-a086-8bcd9979435a could not be found. May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e6753e7c-9712-4f06-9d34-49bd7b5f0462 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Request method failure captured: May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a HTTP/1.1 May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikacH3mPNflVe6LL6bg9_A8pzAabYS23jRSixTFQfefIS8h0xsq17YlHMuAQcMYGioTiJUzGf5HQ_8pUjy0pwazx5CoRz1nqfCdunQxIHFcBiGin6OUttjeU6RRcr_kTDInnBBWYYOIl_RyOz0kb25BPKfu6ZYOhMuIQdqMRnqceoVqo May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:38:47.868274 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:38:47.869878 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:38:47.869878 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:47.869878 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:47.869878 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:47.869878 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:47.869878 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:38:47.869878 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:38:47.869878 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 54a0d2f3e0184d14ae4050562e236581 May 28 04:38:47.869878 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:47.869878 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:38:47.869878 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 90ceda1f-e500-41ce-a086-8bcd9979435a could not be found. May 28 04:38:47.869878 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '90ceda1f-e500-41ce-a086-8bcd9979435a'} May 28 04:38:47.870665 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:38:47.870665 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:47.870665 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:38:47.870665 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:38:47.870665 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:38:47.870665 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:38:47.870665 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:38:47.870665 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:38:47.870665 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:38:47.870665 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:38:47.870665 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ceda1f-e500-41ce-a086-8bcd9979435a could not be found. May 28 04:38:47.870665 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:47.870665 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:47.870665 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:47.870665 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:47.870665 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:47.870665 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:47.870665 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:38:47.870665 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:38:47.870665 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:38:47.872489 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:38:47.872489 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:38:47.872489 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:38:47.872489 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:38:47.872489 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:38:47.872489 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:38:47.872489 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:38:47.872489 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ceda1f-e500-41ce-a086-8bcd9979435a could not be found. May 28 04:38:47.872489 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:47.872489 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:47.872489 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:47.872489 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:47.872489 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:47.872489 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:47.872489 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:38:47.872489 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:38:47.872489 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ceda1f-e500-41ce-a086-8bcd9979435a could not be found. May 28 04:38:47.872489 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:47.875841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e6753e7c-9712-4f06-9d34-49bd7b5f0462 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Returning 404 to user: Instance 90ceda1f-e500-41ce-a086-8bcd9979435a could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:38:47.875841 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e6753e7c-9712-4f06-9d34-49bd7b5f0462 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 404 len: 111 microversion: 2.1 time: 0.042172 May 28 04:38:47.875841 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 648/1376] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:47 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:38:47.878580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-74dd00b2-b34b-461c-991c-fbef8bf065de tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f770196e1f0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:47.917965 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e4add809-9c7e-40e5-af7c-9e86ab51fb60 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.940028 May 28 04:38:47.919320 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 729/1377] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:38:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 04:38:47.935699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-180009ef-1573-4310-93f1-89570cd24ead tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:47.936870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-180009ef-1573-4310-93f1-89570cd24ead tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:48.114909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-180009ef-1573-4310-93f1-89570cd24ead tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:48.129711 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-180009ef-1573-4310-93f1-89570cd24ead tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1213 microversion: 2.1 time: 0.201317 May 28 04:38:48.130567 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 730/1378] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:47 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1213 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:48.136965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-dcfe25ba-e85e-42a5-a238-49d21b115009 req-9f53ce5f-f45e-45f3-8de9-c945d2fb7493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "315db9ca-6acb-462a-a538-1b888d62e083", "tag": "a9fec711-5850-498d-a2d4-9fb1b16772de"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:48.148141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-dcfe25ba-e85e-42a5-a238-49d21b115009 req-9f53ce5f-f45e-45f3-8de9-c945d2fb7493 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:48.148853 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-dcfe25ba-e85e-42a5-a238-49d21b115009 req-9f53ce5f-f45e-45f3-8de9-c945d2fb7493 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:48.164907 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-dcfe25ba-e85e-42a5-a238-49d21b115009 req-9f53ce5f-f45e-45f3-8de9-c945d2fb7493 service nova] Creating event network-changed:a9fec711-5850-498d-a2d4-9fb1b16772de for instance 315db9ca-6acb-462a-a538-1b888d62e083 on n-h2-843700-1 May 28 04:38:48.172548 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-dcfe25ba-e85e-42a5-a238-49d21b115009 req-9f53ce5f-f45e-45f3-8de9-c945d2fb7493 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040062 May 28 04:38:48.173765 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 731/1379] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:48.247825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-14314e72-13b3-469f-ab53-c46fd5b0b687 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:48.249088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-14314e72-13b3-469f-ab53-c46fd5b0b687 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:48.262358 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14314e72-13b3-469f-ab53-c46fd5b0b687 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:48.265070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14314e72-13b3-469f-ab53-c46fd5b0b687 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:48.266122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14314e72-13b3-469f-ab53-c46fd5b0b687 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:48.267353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14314e72-13b3-469f-ab53-c46fd5b0b687 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:48.690804 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-74dd00b2-b34b-461c-991c-fbef8bf065de tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/5cc2ab59-9db2-4875-bf34-78750c9bccc8" status: 202 len: 0 microversion: 2.1 time: 0.815722 May 28 04:38:48.692327 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 649/1380] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:38:47 2022] DELETE /compute/v2.1/os-security-groups/5cc2ab59-9db2-4875-bf34-78750c9bccc8 => generated 0 bytes in 818 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:38:48.701926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d9c3fd08-4412-41c4-933f-70ccc3aa7c0b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f7701a2dd30>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:48.770446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-14314e72-13b3-469f-ab53-c46fd5b0b687 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:48.786573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-14314e72-13b3-469f-ab53-c46fd5b0b687 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:48.788303 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-14314e72-13b3-469f-ab53-c46fd5b0b687 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:48.793331 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-14314e72-13b3-469f-ab53-c46fd5b0b687 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1361 microversion: 2.25 time: 0.557994 May 28 04:38:48.821891 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 732/1381] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:48 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1361 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:38:48.821891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-026feb70-ad57-4fc5-bf6e-2392a869e267 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:48.821891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-026feb70-ad57-4fc5-bf6e-2392a869e267 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 37d0f5e8-9f68-4ef2-9310-59c143ba90ad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:48.821891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-026feb70-ad57-4fc5-bf6e-2392a869e267 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:48.822294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-026feb70-ad57-4fc5-bf6e-2392a869e267 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:48.822294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-026feb70-ad57-4fc5-bf6e-2392a869e267 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:48.822294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-026feb70-ad57-4fc5-bf6e-2392a869e267 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:49.242587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-026feb70-ad57-4fc5-bf6e-2392a869e267 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:49.262267 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-026feb70-ad57-4fc5-bf6e-2392a869e267 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad" status: 200 len: 1468 microversion: 2.1 time: 0.455431 May 28 04:38:49.264163 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 733/1382] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:48 2022] GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad => generated 1468 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:49.269812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8fcf263f-e180-4a3a-ae0e-a6e5c488aa1f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:49.280382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8fcf263f-e180-4a3a-ae0e-a6e5c488aa1f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:49.455563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8fcf263f-e180-4a3a-ae0e-a6e5c488aa1f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:49.465057 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8fcf263f-e180-4a3a-ae0e-a6e5c488aa1f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1213 microversion: 2.1 time: 0.199233 May 28 04:38:49.468720 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 734/1383] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:49 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1213 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:49.489661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8deb97bd-6099-4390-9825-c93dbfe859f2 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:49.490527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8deb97bd-6099-4390-9825-c93dbfe859f2 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 3e7c11b5-0b9f-4264-b178-d9be01a2abfb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:49.510233 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8deb97bd-6099-4390-9825-c93dbfe859f2 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:49.511027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8deb97bd-6099-4390-9825-c93dbfe859f2 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:49.512871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8deb97bd-6099-4390-9825-c93dbfe859f2 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:49.512871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8deb97bd-6099-4390-9825-c93dbfe859f2 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:49.808205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8deb97bd-6099-4390-9825-c93dbfe859f2 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:49.817197 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8deb97bd-6099-4390-9825-c93dbfe859f2 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/3e7c11b5-0b9f-4264-b178-d9be01a2abfb" status: 200 len: 1469 microversion: 2.1 time: 0.337837 May 28 04:38:49.822519 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 735/1384] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:49 2022] GET /compute/v2.1/servers/3e7c11b5-0b9f-4264-b178-d9be01a2abfb => generated 1469 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:49.841597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-35396e5c-3774-45c4-a45e-690db968dc52 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:49.845779 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d9c3fd08-4412-41c4-933f-70ccc3aa7c0b tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/ca18ddaf-83b6-4a10-82db-36a36dadf314" status: 202 len: 0 microversion: 2.1 time: 1.148654 May 28 04:38:49.846349 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 650/1385] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:38:48 2022] DELETE /compute/v2.1/os-security-groups/ca18ddaf-83b6-4a10-82db-36a36dadf314 => generated 0 bytes in 1150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:38:49.847188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-35396e5c-3774-45c4-a45e-690db968dc52 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:49.851819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d3fdf850-9b09-484c-947b-33b74f485662 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:49.856233 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:49.865410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35396e5c-3774-45c4-a45e-690db968dc52 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:49.866707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d3fdf850-9b09-484c-947b-33b74f485662 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:49.867284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35396e5c-3774-45c4-a45e-690db968dc52 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:49.868176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35396e5c-3774-45c4-a45e-690db968dc52 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:49.869742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35396e5c-3774-45c4-a45e-690db968dc52 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:49.875986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d3fdf850-9b09-484c-947b-33b74f485662 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Searching by: {'reservation_id': 'r-kif64n9p', 'deleted': False, 'project_id': 'e7a5b721a538475cbac9c95c61647753'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:38:49.889384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3fdf850-9b09-484c-947b-33b74f485662 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:49.892138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3fdf850-9b09-484c-947b-33b74f485662 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:49.893079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3fdf850-9b09-484c-947b-33b74f485662 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:49.893725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3fdf850-9b09-484c-947b-33b74f485662 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:50.104974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-d3fdf850-9b09-484c-947b-33b74f485662 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:38:50.364648 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d3fdf850-9b09-484c-947b-33b74f485662 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:50.411478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3fdf850-9b09-484c-947b-33b74f485662 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:50.412205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3fdf850-9b09-484c-947b-33b74f485662 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:51.223869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-35396e5c-3774-45c4-a45e-690db968dc52 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:51.246268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-35396e5c-3774-45c4-a45e-690db968dc52 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:51.250889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-35396e5c-3774-45c4-a45e-690db968dc52 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:51.254838 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-35396e5c-3774-45c4-a45e-690db968dc52 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1361 microversion: 2.25 time: 1.418753 May 28 04:38:51.259950 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 736/1386] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:49 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1361 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:51.265712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4ae353f2-8f27-4a1b-9304-0bc7c700fb24 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Action: 'create', calling method: .version_select at 0x7f7707535dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2130593412", "description": "tempest-description-1704531426"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:51.755894 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d3fdf850-9b09-484c-947b-33b74f485662 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?reservation_id=r-kif64n9p" status: 200 len: 2930 microversion: 2.1 time: 1.908396 May 28 04:38:51.758892 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 651/1387] 10.222.0.58 () {58 vars in 1196 bytes} [Sat May 28 04:38:49 2022] GET /compute/v2.1/servers/detail?reservation_id=r-kif64n9p => generated 2930 bytes in 1911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:51.764233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-701d1abd-fcfb-40b3-98c7-611b6752bf6d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:51.765265 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-701d1abd-fcfb-40b3-98c7-611b6752bf6d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:51.780562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-701d1abd-fcfb-40b3-98c7-611b6752bf6d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:51.783721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-701d1abd-fcfb-40b3-98c7-611b6752bf6d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:51.786788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-701d1abd-fcfb-40b3-98c7-611b6752bf6d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:51.789644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-701d1abd-fcfb-40b3-98c7-611b6752bf6d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:51.901809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-701d1abd-fcfb-40b3-98c7-611b6752bf6d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:51.910663 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-701d1abd-fcfb-40b3-98c7-611b6752bf6d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1271 microversion: 2.1 time: 0.150408 May 28 04:38:51.911311 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 652/1388] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:51 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1271 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:51.916283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a3386391-ddea-4190-9b83-b0245c57a5bb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:51.936289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.compute.server_groups [None req-a3386391-ddea-4190-9b83-b0245c57a5bb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Querying cell 8c12a9b9-d304-4763-b71f-4058d5ce2ded(cell1) for 2 instances {{(pid=126043) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 28 04:38:51.936818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3386391-ddea-4190-9b83-b0245c57a5bb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:51.937839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3386391-ddea-4190-9b83-b0245c57a5bb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:51.981514 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a3386391-ddea-4190-9b83-b0245c57a5bb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/83cd0df2-5264-47c5-929b-92c17952213c" status: 200 len: 270 microversion: 2.1 time: 0.068947 May 28 04:38:51.987489 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 653/1389] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 04:38:51 2022] GET /compute/v2.1/os-server-groups/83cd0df2-5264-47c5-929b-92c17952213c => generated 270 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:51.994363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9922e213-0158-47fe-ab56-58777b1042ad tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:51.994363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9922e213-0158-47fe-ab56-58777b1042ad tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] [instance: 37d0f5e8-9f68-4ef2-9310-59c143ba90ad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:52.005854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9922e213-0158-47fe-ab56-58777b1042ad tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:52.005854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9922e213-0158-47fe-ab56-58777b1042ad tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:52.005854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9922e213-0158-47fe-ab56-58777b1042ad tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:52.005854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9922e213-0158-47fe-ab56-58777b1042ad tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:52.405610 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9922e213-0158-47fe-ab56-58777b1042ad tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad" status: 200 len: 1619 microversion: 2.1 time: 0.414723 May 28 04:38:52.419282 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 654/1390] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:51 2022] GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad => generated 1619 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:52.425597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8c6a0df4-fc1c-4d0b-a428-37b100209331 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:52.426842 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8c6a0df4-fc1c-4d0b-a428-37b100209331 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:52.428590 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4ae353f2-8f27-4a1b-9304-0bc7c700fb24 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.167262 May 28 04:38:52.430391 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 737/1391] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:38:51 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:52.437709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-77f9b542-a9f6-46fc-a9cc-9d3f6422c4d9 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:52.438835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-77f9b542-a9f6-46fc-a9cc-9d3f6422c4d9 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] [instance: 3e7c11b5-0b9f-4264-b178-d9be01a2abfb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:52.447139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c6a0df4-fc1c-4d0b-a428-37b100209331 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:52.449023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c6a0df4-fc1c-4d0b-a428-37b100209331 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:52.450483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c6a0df4-fc1c-4d0b-a428-37b100209331 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:52.451864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c6a0df4-fc1c-4d0b-a428-37b100209331 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:52.462905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77f9b542-a9f6-46fc-a9cc-9d3f6422c4d9 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:52.463588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77f9b542-a9f6-46fc-a9cc-9d3f6422c4d9 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:52.464279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77f9b542-a9f6-46fc-a9cc-9d3f6422c4d9 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:52.464726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77f9b542-a9f6-46fc-a9cc-9d3f6422c4d9 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:52.950517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8c6a0df4-fc1c-4d0b-a428-37b100209331 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:52.966325 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8c6a0df4-fc1c-4d0b-a428-37b100209331 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:52.972997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8c6a0df4-fc1c-4d0b-a428-37b100209331 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:52.974639 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8c6a0df4-fc1c-4d0b-a428-37b100209331 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1361 microversion: 2.25 time: 0.553203 May 28 04:38:52.975873 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 655/1392] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:52 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1361 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:52.982268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2a54ab65-5f2e-4dc7-8f81-18a50f5b14f5 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Action: 'update', calling method: .version_select at 0x7f7701a23f70>, body: {"security_group": {"name": "tempest-sg-hth-910545085", "description": "tempest-description-hth-806933942"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:53.018809 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-77f9b542-a9f6-46fc-a9cc-9d3f6422c4d9 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/3e7c11b5-0b9f-4264-b178-d9be01a2abfb" status: 200 len: 1620 microversion: 2.1 time: 0.587501 May 28 04:38:53.019878 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 738/1393] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:52 2022] GET /compute/v2.1/servers/3e7c11b5-0b9f-4264-b178-d9be01a2abfb => generated 1620 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:53.031565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7509d745-1e2c-489a-98d1-6f05d9e96e7c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:53.033026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7509d745-1e2c-489a-98d1-6f05d9e96e7c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:53.051654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7509d745-1e2c-489a-98d1-6f05d9e96e7c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:53.052311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7509d745-1e2c-489a-98d1-6f05d9e96e7c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:53.055019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7509d745-1e2c-489a-98d1-6f05d9e96e7c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:53.055653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7509d745-1e2c-489a-98d1-6f05d9e96e7c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:53.495792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7509d745-1e2c-489a-98d1-6f05d9e96e7c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:53.509010 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7509d745-1e2c-489a-98d1-6f05d9e96e7c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1313 microversion: 2.1 time: 0.484777 May 28 04:38:53.509010 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 739/1394] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:53 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1313 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:53.520483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d9f719f3-a305-4385-947a-e6379646e07e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-423845611", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "7015ae59-a219-4897-97c4-ba6ead622287"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:53.613746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-d9f719f3-a305-4385-947a-e6379646e07e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:38:53.703467 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2a54ab65-5f2e-4dc7-8f81-18a50f5b14f5 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "PUT /compute/v2.1/os-security-groups/8393b64e-99b3-4a68-853b-0bdf6c386831" status: 200 len: 216 microversion: 2.1 time: 0.722918 May 28 04:38:53.703467 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 656/1395] 10.222.0.58 () {60 vars in 1289 bytes} [Sat May 28 04:38:52 2022] PUT /compute/v2.1/os-security-groups/8393b64e-99b3-4a68-853b-0bdf6c386831 => generated 216 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:53.705121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-89623eeb-c337-4bec-b6c7-c72cbdabae9c req-8b2f1506-e0dc-45e7-a603-b213006455f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315db9ca-6acb-462a-a538-1b888d62e083", "name": "network-vif-plugged", "status": "completed", "tag": "a9fec711-5850-498d-a2d4-9fb1b16772de"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:53.721372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-89623eeb-c337-4bec-b6c7-c72cbdabae9c req-8b2f1506-e0dc-45e7-a603-b213006455f4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:53.721826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-89623eeb-c337-4bec-b6c7-c72cbdabae9c req-8b2f1506-e0dc-45e7-a603-b213006455f4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:53.736097 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-89623eeb-c337-4bec-b6c7-c72cbdabae9c req-8b2f1506-e0dc-45e7-a603-b213006455f4 service nova] Creating event network-vif-plugged:a9fec711-5850-498d-a2d4-9fb1b16772de for instance 315db9ca-6acb-462a-a538-1b888d62e083 on n-h2-843700-1 May 28 04:38:53.738515 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-89623eeb-c337-4bec-b6c7-c72cbdabae9c req-8b2f1506-e0dc-45e7-a603-b213006455f4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036629 May 28 04:38:53.739715 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 657/1396] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:53.745678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fb4f65ae-c080-4224-b4c0-dbea39b9d740 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f7701a23e50>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:54.014029 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fb4f65ae-c080-4224-b4c0-dbea39b9d740 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/8393b64e-99b3-4a68-853b-0bdf6c386831" status: 200 len: 216 microversion: 2.1 time: 0.272392 May 28 04:38:54.035058 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 658/1397] 10.222.0.58 () {58 vars in 1268 bytes} [Sat May 28 04:38:53 2022] GET /compute/v2.1/os-security-groups/8393b64e-99b3-4a68-853b-0bdf6c386831 => generated 216 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:54.049539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b47e3fdf-986c-43c7-a081-0eb41608faed tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:54.059347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b47e3fdf-986c-43c7-a081-0eb41608faed tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:54.067542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b47e3fdf-986c-43c7-a081-0eb41608faed tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:54.068627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b47e3fdf-986c-43c7-a081-0eb41608faed tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:54.070610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b47e3fdf-986c-43c7-a081-0eb41608faed tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:54.071393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b47e3fdf-986c-43c7-a081-0eb41608faed tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:54.281942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d9f719f3-a305-4385-947a-e6379646e07e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:38:54.282739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d9f719f3-a305-4385-947a-e6379646e07e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:38:54.283305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d9f719f3-a305-4385-947a-e6379646e07e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:38:54.283785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d9f719f3-a305-4385-947a-e6379646e07e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:38:54.284404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d9f719f3-a305-4385-947a-e6379646e07e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:38:54.298902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9f719f3-a305-4385-947a-e6379646e07e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:54.305699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9f719f3-a305-4385-947a-e6379646e07e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:54.306772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9f719f3-a305-4385-947a-e6379646e07e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:54.310947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9f719f3-a305-4385-947a-e6379646e07e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:54.330252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=10 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:54.378476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-d9f719f3-a305-4385-947a-e6379646e07e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for project e7a5b721a538475cbac9c95c61647753. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:38:54.388791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-d9f719f3-a305-4385-947a-e6379646e07e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for user d398d45627fc4d33bc9a736ddf8f9215 and project e7a5b721a538475cbac9c95c61647753. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:38:54.437549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d9f719f3-a305-4385-947a-e6379646e07e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:38:54.445688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d9f719f3-a305-4385-947a-e6379646e07e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:38:54.541771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b47e3fdf-986c-43c7-a081-0eb41608faed tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:54.557063 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b47e3fdf-986c-43c7-a081-0eb41608faed tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:54.560972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b47e3fdf-986c-43c7-a081-0eb41608faed tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:54.562365 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b47e3fdf-986c-43c7-a081-0eb41608faed tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1361 microversion: 2.25 time: 0.526030 May 28 04:38:54.567619 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 659/1398] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:54 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1361 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:54.573994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-56ea2cdd-6e5f-4e91-993f-3d89e4f4acf0 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f7701a23700>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:54.723348 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d9f719f3-a305-4385-947a-e6379646e07e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.213960 May 28 04:38:54.724249 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 740/1399] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:38:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:38:54.728939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b0c85976-4d8d-49df-941f-ef4d445b767a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:54.729533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b0c85976-4d8d-49df-941f-ef4d445b767a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:54.735807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0c85976-4d8d-49df-941f-ef4d445b767a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:54.736446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0c85976-4d8d-49df-941f-ef4d445b767a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:54.737391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0c85976-4d8d-49df-941f-ef4d445b767a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:54.738049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0c85976-4d8d-49df-941f-ef4d445b767a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:55.375869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b0c85976-4d8d-49df-941f-ef4d445b767a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:55.392510 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b0c85976-4d8d-49df-941f-ef4d445b767a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1313 microversion: 2.1 time: 0.666961 May 28 04:38:55.396996 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 741/1400] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:54 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1313 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:55.403460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-86792f8a-32e3-432d-b20c-d1ebca71c338 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:55.404333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-86792f8a-32e3-432d-b20c-d1ebca71c338 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:55.525940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-86792f8a-32e3-432d-b20c-d1ebca71c338 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:55.529936 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-56ea2cdd-6e5f-4e91-993f-3d89e4f4acf0 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/8393b64e-99b3-4a68-853b-0bdf6c386831" status: 202 len: 0 microversion: 2.1 time: 0.959355 May 28 04:38:55.535507 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 660/1401] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:38:54 2022] DELETE /compute/v2.1/os-security-groups/8393b64e-99b3-4a68-853b-0bdf6c386831 => generated 0 bytes in 967 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:38:55.539724 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-86792f8a-32e3-432d-b20c-d1ebca71c338 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726" status: 200 len: 1216 microversion: 2.1 time: 0.139952 May 28 04:38:55.549710 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 742/1402] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:55 2022] GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726 => generated 1216 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:55.556853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-a1e2ae01-e817-45c5-8fb0-d5dfd8d179c6 req-ac7eeaf3-66fc-48f7-99a1-a62fdad03ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2879396-59ef-44c3-ba44-5626191ec11e", "tag": "2c964bd0-98e9-472c-a6fe-946d0b7b8704"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:38:55.567302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3e802364-58f0-4139-a9aa-a5b66b017d7a tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:55.567918 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3e802364-58f0-4139-a9aa-a5b66b017d7a tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:55.572342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a1e2ae01-e817-45c5-8fb0-d5dfd8d179c6 req-ac7eeaf3-66fc-48f7-99a1-a62fdad03ba6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:55.573036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a1e2ae01-e817-45c5-8fb0-d5dfd8d179c6 req-ac7eeaf3-66fc-48f7-99a1-a62fdad03ba6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:55.588607 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-a1e2ae01-e817-45c5-8fb0-d5dfd8d179c6 req-ac7eeaf3-66fc-48f7-99a1-a62fdad03ba6 service nova] Creating event network-changed:2c964bd0-98e9-472c-a6fe-946d0b7b8704 for instance b2879396-59ef-44c3-ba44-5626191ec11e on n-h2-843700-1 May 28 04:38:55.604851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3e802364-58f0-4139-a9aa-a5b66b017d7a tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:55.605354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3e802364-58f0-4139-a9aa-a5b66b017d7a tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:55.606221 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-a1e2ae01-e817-45c5-8fb0-d5dfd8d179c6 req-ac7eeaf3-66fc-48f7-99a1-a62fdad03ba6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068496 May 28 04:38:55.607801 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 661/1403] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:55.613758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a5b104f4-07c3-4b56-a867-67b8c5115884 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:55.614753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a5b104f4-07c3-4b56-a867-67b8c5115884 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:55.622539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5b104f4-07c3-4b56-a867-67b8c5115884 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:55.623786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5b104f4-07c3-4b56-a867-67b8c5115884 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:55.624656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5b104f4-07c3-4b56-a867-67b8c5115884 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:55.625169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5b104f4-07c3-4b56-a867-67b8c5115884 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:55.629117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3e802364-58f0-4139-a9aa-a5b66b017d7a tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:55.629573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3e802364-58f0-4139-a9aa-a5b66b017d7a tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:55.670023 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-3e802364-58f0-4139-a9aa-a5b66b017d7a tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] HTTP exception thrown: Instance 90ceda1f-e500-41ce-a086-8bcd9979435a could not be found. May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3e802364-58f0-4139-a9aa-a5b66b017d7a tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Request method failure captured: May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a HTTP/1.1 May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikacH3mPNflVe6LL6bg9_A8pzAabYS23jRSixTFQfefIS8h0xsq17YlHMuAQcMYGioTiJUzGf5HQ_8pUjy0pwazx5CoRz1nqfCdunQxIHFcBiGin6OUttjeU6RRcr_kTDInnBBWYYOIl_RyOz0kb25BPKfu6ZYOhMuIQdqMRnqceoVqo May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:38:55.671825 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:38:55.673128 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:38:55.673128 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:55.673128 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:55.673128 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:55.673128 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:55.673128 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:38:55.673128 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:38:55.673128 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 54a0d2f3e0184d14ae4050562e236581 May 28 04:38:55.673128 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:55.673128 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:38:55.673128 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 90ceda1f-e500-41ce-a086-8bcd9979435a could not be found. May 28 04:38:55.673128 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '90ceda1f-e500-41ce-a086-8bcd9979435a'} May 28 04:38:55.673840 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:38:55.673840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:55.673840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:38:55.673840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:38:55.673840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:38:55.673840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:38:55.673840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:38:55.673840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:38:55.673840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:38:55.673840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:38:55.673840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ceda1f-e500-41ce-a086-8bcd9979435a could not be found. May 28 04:38:55.673840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.673840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:55.673840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.673840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:55.673840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:55.673840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:55.673840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:38:55.673840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:38:55.673840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:38:55.675090 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:38:55.675090 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:38:55.675090 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:38:55.675090 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:38:55.675090 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:38:55.675090 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:38:55.675090 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:38:55.675090 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:38:55.675090 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:38:55.675090 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ceda1f-e500-41ce-a086-8bcd9979435a could not be found. May 28 04:38:55.675090 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.675090 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:55.675090 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.675090 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:55.675090 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:55.675090 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:55.675090 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:38:55.675090 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:38:55.675090 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ceda1f-e500-41ce-a086-8bcd9979435a could not be found. May 28 04:38:55.675090 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.676451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3e802364-58f0-4139-a9aa-a5b66b017d7a tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Returning 404 to user: Instance 90ceda1f-e500-41ce-a086-8bcd9979435a could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:38:55.676451 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3e802364-58f0-4139-a9aa-a5b66b017d7a tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "DELETE /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 404 len: 111 microversion: 2.1 time: 0.131141 May 28 04:38:55.676451 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 743/1404] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:38:55 2022] DELETE /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:38:55.682706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-57c13842-837f-481b-80bf-dd3d9327a420 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:55.684617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-57c13842-837f-481b-80bf-dd3d9327a420 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: 90ceda1f-e500-41ce-a086-8bcd9979435a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:55.692534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57c13842-837f-481b-80bf-dd3d9327a420 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:55.693408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57c13842-837f-481b-80bf-dd3d9327a420 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:55.694781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57c13842-837f-481b-80bf-dd3d9327a420 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:55.695444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57c13842-837f-481b-80bf-dd3d9327a420 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:55.718749 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-57c13842-837f-481b-80bf-dd3d9327a420 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] HTTP exception thrown: Instance 90ceda1f-e500-41ce-a086-8bcd9979435a could not be found. May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-57c13842-837f-481b-80bf-dd3d9327a420 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Request method failure captured: May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a HTTP/1.1 May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikacH3mPNflVe6LL6bg9_A8pzAabYS23jRSixTFQfefIS8h0xsq17YlHMuAQcMYGioTiJUzGf5HQ_8pUjy0pwazx5CoRz1nqfCdunQxIHFcBiGin6OUttjeU6RRcr_kTDInnBBWYYOIl_RyOz0kb25BPKfu6ZYOhMuIQdqMRnqceoVqo May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:38:55.739922 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:38:55.741676 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:38:55.741676 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:55.741676 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:55.741676 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:55.741676 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:55.741676 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:38:55.741676 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:38:55.741676 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 54a0d2f3e0184d14ae4050562e236581 May 28 04:38:55.741676 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:55.741676 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:38:55.741676 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 90ceda1f-e500-41ce-a086-8bcd9979435a could not be found. May 28 04:38:55.741676 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '90ceda1f-e500-41ce-a086-8bcd9979435a'} May 28 04:38:55.742400 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:38:55.742400 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:55.742400 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:38:55.742400 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:38:55.742400 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:38:55.742400 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:38:55.742400 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:38:55.742400 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:38:55.742400 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:38:55.742400 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:38:55.742400 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ceda1f-e500-41ce-a086-8bcd9979435a could not be found. May 28 04:38:55.742400 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.742400 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:55.742400 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.742400 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:55.742400 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:55.742400 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:55.742400 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:38:55.742400 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:38:55.742400 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:38:55.743595 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:38:55.743595 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:38:55.743595 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:38:55.743595 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:38:55.743595 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:38:55.743595 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:38:55.743595 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:38:55.743595 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ceda1f-e500-41ce-a086-8bcd9979435a could not be found. May 28 04:38:55.743595 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.743595 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:55.743595 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.743595 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:55.743595 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:55.743595 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:55.743595 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:38:55.743595 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:38:55.743595 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ceda1f-e500-41ce-a086-8bcd9979435a could not be found. May 28 04:38:55.743595 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.744627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-57c13842-837f-481b-80bf-dd3d9327a420 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Returning 404 to user: Instance 90ceda1f-e500-41ce-a086-8bcd9979435a could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:38:55.744627 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-57c13842-837f-481b-80bf-dd3d9327a420 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a" status: 404 len: 111 microversion: 2.1 time: 0.056288 May 28 04:38:55.744627 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 744/1405] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:55 2022] GET /compute/v2.1/servers/90ceda1f-e500-41ce-a086-8bcd9979435a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:38:55.751299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ee51c974-9469-4f55-aa04-004c19557408 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f770754c160>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:55.829899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG neutronclient.v2_0.client [None req-ee51c974-9469-4f55-aa04-004c19557408 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ca18ddaf-83b6-4a10-82db-36a36dadf314 does not exist", "detail": ""}} {{(pid=126044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:38:55.830504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.security_group_api [None req-ee51c974-9469-4f55-aa04-004c19557408 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Neutron security group ca18ddaf-83b6-4a10-82db-36a36dadf314 not found {{(pid=126044) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 04:38:55.831055 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-ee51c974-9469-4f55-aa04-004c19557408 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] HTTP exception thrown: Security group ca18ddaf-83b6-4a10-82db-36a36dadf314 does not exist May 28 04:38:55.831055 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-b6cce55f-b450-4e0d-91fb-7099a85cd53c'] May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ee51c974-9469-4f55-aa04-004c19557408 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Request method failure captured: May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/os-security-groups/ca18ddaf-83b6-4a10-82db-36a36dadf314 HTTP/1.1 May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikacH3mPNflVe6LL6bg9_A8pzAabYS23jRSixTFQfefIS8h0xsq17YlHMuAQcMYGioTiJUzGf5HQ_8pUjy0pwazx5CoRz1nqfCdunQxIHFcBiGin6OUttjeU6RRcr_kTDInnBBWYYOIl_RyOz0kb25BPKfu6ZYOhMuIQdqMRnqceoVqo May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:38:55.833413 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:38:55.835020 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:38:55.835020 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:55.835020 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:55.835020 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:55.835020 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:55.835020 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:38:55.835020 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:38:55.835020 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 54a0d2f3e0184d14ae4050562e236581 May 28 04:38:55.835020 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:55.835020 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:38:55.835020 n-d-843700-1 devstack@n-api.service[126044]: exception: Security group ca18ddaf-83b6-4a10-82db-36a36dadf314 does not exist May 28 04:38:55.835020 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-b6cce55f-b450-4e0d-91fb-7099a85cd53c'] May 28 04:38:55.835020 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'ca18ddaf-83b6-4a10-82db-36a36dadf314'} May 28 04:38:55.836007 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:38:55.836007 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:55.836007 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 04:38:55.836007 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 04:38:55.836007 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:55.836007 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:55.836007 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 04:38:55.836007 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 04:38:55.836007 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:55.836007 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:55.836007 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 04:38:55.836007 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 04:38:55.836007 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:55.836007 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:55.836007 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:38:55.836007 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:38:55.836007 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:55.836007 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:55.836007 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:38:55.837458 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:38:55.837458 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:55.837458 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:55.837458 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:38:55.837458 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:38:55.837458 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:38:55.837458 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:38:55.837458 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ca18ddaf-83b6-4a10-82db-36a36dadf314 does not exist May 28 04:38:55.837458 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6cce55f-b450-4e0d-91fb-7099a85cd53c'] May 28 04:38:55.837458 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.837458 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:55.837458 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.837458 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:55.837458 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 28 04:38:55.837458 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 04:38:55.837458 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 04:38:55.837458 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 04:38:55.837458 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ca18ddaf-83b6-4a10-82db-36a36dadf314 does not exist May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6cce55f-b450-4e0d-91fb-7099a85cd53c'] May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ca18ddaf-83b6-4a10-82db-36a36dadf314 does not exist May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6cce55f-b450-4e0d-91fb-7099a85cd53c'] May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.838947 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:55.844549 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:55.844549 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:55.844549 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:38:55.844549 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:38:55.844549 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ca18ddaf-83b6-4a10-82db-36a36dadf314 does not exist May 28 04:38:55.844549 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6cce55f-b450-4e0d-91fb-7099a85cd53c'] May 28 04:38:55.844549 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.844549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ee51c974-9469-4f55-aa04-004c19557408 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Returning 404 to user: Security group ca18ddaf-83b6-4a10-82db-36a36dadf314 does not exist May 28 04:38:55.844549 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-b6cce55f-b450-4e0d-91fb-7099a85cd53c'] {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:38:55.844549 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ee51c974-9469-4f55-aa04-004c19557408 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/ca18ddaf-83b6-4a10-82db-36a36dadf314" status: 404 len: 194 microversion: 2.1 time: 0.095857 May 28 04:38:55.844549 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 745/1406] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:38:55 2022] DELETE /compute/v2.1/os-security-groups/ca18ddaf-83b6-4a10-82db-36a36dadf314 => generated 194 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:38:55.847136 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-40c109db-0170-4e6b-b42b-02563ceda4c8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f77074e9670>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:55.917882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG neutronclient.v2_0.client [None req-40c109db-0170-4e6b-b42b-02563ceda4c8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5cc2ab59-9db2-4875-bf34-78750c9bccc8 does not exist", "detail": ""}} {{(pid=126044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:38:55.917882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.security_group_api [None req-40c109db-0170-4e6b-b42b-02563ceda4c8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Neutron security group 5cc2ab59-9db2-4875-bf34-78750c9bccc8 not found {{(pid=126044) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 04:38:55.917882 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-40c109db-0170-4e6b-b42b-02563ceda4c8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] HTTP exception thrown: Security group 5cc2ab59-9db2-4875-bf34-78750c9bccc8 does not exist May 28 04:38:55.917882 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-dee23302-8f1e-4a18-a15c-c670e6482075'] May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-40c109db-0170-4e6b-b42b-02563ceda4c8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Request method failure captured: May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/os-security-groups/5cc2ab59-9db2-4875-bf34-78750c9bccc8 HTTP/1.1 May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikacH3mPNflVe6LL6bg9_A8pzAabYS23jRSixTFQfefIS8h0xsq17YlHMuAQcMYGioTiJUzGf5HQ_8pUjy0pwazx5CoRz1nqfCdunQxIHFcBiGin6OUttjeU6RRcr_kTDInnBBWYYOIl_RyOz0kb25BPKfu6ZYOhMuIQdqMRnqceoVqo May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:38:55.918420 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:38:55.920211 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:38:55.920211 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:55.920211 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:55.920211 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:55.920211 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:55.920211 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:38:55.920211 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:38:55.920211 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 54a0d2f3e0184d14ae4050562e236581 May 28 04:38:55.920211 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:55.920211 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:38:55.920211 n-d-843700-1 devstack@n-api.service[126044]: exception: Security group 5cc2ab59-9db2-4875-bf34-78750c9bccc8 does not exist May 28 04:38:55.920211 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-dee23302-8f1e-4a18-a15c-c670e6482075'] May 28 04:38:55.920211 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '5cc2ab59-9db2-4875-bf34-78750c9bccc8'} May 28 04:38:55.921069 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:38:55.921069 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:55.921069 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 04:38:55.921069 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 04:38:55.921069 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:55.921069 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:55.921069 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 04:38:55.921069 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 04:38:55.921069 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:55.921069 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:55.921069 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 04:38:55.921069 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 04:38:55.921069 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:55.921069 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:55.921069 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:38:55.921069 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:38:55.921069 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:55.921069 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:55.921069 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:38:55.922445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:38:55.922445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:55.922445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:55.922445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:38:55.922445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:38:55.922445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:38:55.922445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:38:55.922445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5cc2ab59-9db2-4875-bf34-78750c9bccc8 does not exist May 28 04:38:55.922445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dee23302-8f1e-4a18-a15c-c670e6482075'] May 28 04:38:55.922445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.922445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:55.922445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.922445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:55.922445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 28 04:38:55.922445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 04:38:55.922445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 04:38:55.922445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 04:38:55.922445 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5cc2ab59-9db2-4875-bf34-78750c9bccc8 does not exist May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dee23302-8f1e-4a18-a15c-c670e6482075'] May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5cc2ab59-9db2-4875-bf34-78750c9bccc8 does not exist May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dee23302-8f1e-4a18-a15c-c670e6482075'] May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.924369 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:55.927971 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:55.927971 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:55.927971 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:38:55.927971 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:38:55.927971 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5cc2ab59-9db2-4875-bf34-78750c9bccc8 does not exist May 28 04:38:55.927971 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dee23302-8f1e-4a18-a15c-c670e6482075'] May 28 04:38:55.927971 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.932211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-40c109db-0170-4e6b-b42b-02563ceda4c8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Returning 404 to user: Security group 5cc2ab59-9db2-4875-bf34-78750c9bccc8 does not exist May 28 04:38:55.932211 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-dee23302-8f1e-4a18-a15c-c670e6482075'] {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:38:55.932211 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-40c109db-0170-4e6b-b42b-02563ceda4c8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/5cc2ab59-9db2-4875-bf34-78750c9bccc8" status: 404 len: 194 microversion: 2.1 time: 0.087913 May 28 04:38:55.932211 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 746/1407] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:38:55 2022] DELETE /compute/v2.1/os-security-groups/5cc2ab59-9db2-4875-bf34-78750c9bccc8 => generated 194 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:38:55.940302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b0b6b2c9-3fd7-4a9d-b641-b32398f3e0c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f77075f2280>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:55.945137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a5b104f4-07c3-4b56-a867-67b8c5115884 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:55.957861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a5b104f4-07c3-4b56-a867-67b8c5115884 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:55.960822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a5b104f4-07c3-4b56-a867-67b8c5115884 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:55.962228 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a5b104f4-07c3-4b56-a867-67b8c5115884 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1361 microversion: 2.25 time: 0.353087 May 28 04:38:55.963439 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 662/1408] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:55 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1361 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:55.982012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG neutronclient.v2_0.client [None req-b0b6b2c9-3fd7-4a9d-b641-b32398f3e0c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5db699c3-5ad0-426b-af22-63ec90bba84a does not exist", "detail": ""}} {{(pid=126044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:38:55.982874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.security_group_api [None req-b0b6b2c9-3fd7-4a9d-b641-b32398f3e0c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Neutron security group 5db699c3-5ad0-426b-af22-63ec90bba84a not found {{(pid=126044) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 04:38:55.983703 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-b0b6b2c9-3fd7-4a9d-b641-b32398f3e0c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] HTTP exception thrown: Security group 5db699c3-5ad0-426b-af22-63ec90bba84a does not exist May 28 04:38:55.983703 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-347cc38c-cb11-4779-be16-db9ed3075dce'] May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b0b6b2c9-3fd7-4a9d-b641-b32398f3e0c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Request method failure captured: May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/os-security-groups/5db699c3-5ad0-426b-af22-63ec90bba84a HTTP/1.1 May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikacH3mPNflVe6LL6bg9_A8pzAabYS23jRSixTFQfefIS8h0xsq17YlHMuAQcMYGioTiJUzGf5HQ_8pUjy0pwazx5CoRz1nqfCdunQxIHFcBiGin6OUttjeU6RRcr_kTDInnBBWYYOIl_RyOz0kb25BPKfu6ZYOhMuIQdqMRnqceoVqo May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:38:55.986718 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:38:55.988081 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:38:55.988081 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:55.988081 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:55.988081 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:55.988081 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:55.988081 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:38:55.988081 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:38:55.988081 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 54a0d2f3e0184d14ae4050562e236581 May 28 04:38:55.988081 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:55.988081 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:38:55.988081 n-d-843700-1 devstack@n-api.service[126044]: exception: Security group 5db699c3-5ad0-426b-af22-63ec90bba84a does not exist May 28 04:38:55.988081 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-347cc38c-cb11-4779-be16-db9ed3075dce'] May 28 04:38:55.988081 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '5db699c3-5ad0-426b-af22-63ec90bba84a'} May 28 04:38:55.988906 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:38:55.988906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:55.988906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 04:38:55.988906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 04:38:55.988906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:55.988906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:55.988906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 04:38:55.988906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 04:38:55.988906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:55.988906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:55.988906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 04:38:55.988906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 04:38:55.988906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:55.988906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:55.988906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:38:55.988906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:38:55.988906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:55.988906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:55.988906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:38:55.990550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:38:55.990550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:55.990550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:55.990550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:38:55.990550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:38:55.990550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:38:55.990550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:38:55.990550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5db699c3-5ad0-426b-af22-63ec90bba84a does not exist May 28 04:38:55.990550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-347cc38c-cb11-4779-be16-db9ed3075dce'] May 28 04:38:55.990550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.990550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:55.990550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.990550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:55.990550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 28 04:38:55.990550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 04:38:55.990550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 04:38:55.990550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 04:38:55.990550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5db699c3-5ad0-426b-af22-63ec90bba84a does not exist May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-347cc38c-cb11-4779-be16-db9ed3075dce'] May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5db699c3-5ad0-426b-af22-63ec90bba84a does not exist May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-347cc38c-cb11-4779-be16-db9ed3075dce'] May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.992842 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:55.995871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:55.995871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:55.995871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:38:55.995871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:38:55.995871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5db699c3-5ad0-426b-af22-63ec90bba84a does not exist May 28 04:38:55.995871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-347cc38c-cb11-4779-be16-db9ed3075dce'] May 28 04:38:55.995871 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:55.999480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b0b6b2c9-3fd7-4a9d-b641-b32398f3e0c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Returning 404 to user: Security group 5db699c3-5ad0-426b-af22-63ec90bba84a does not exist May 28 04:38:55.999480 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-347cc38c-cb11-4779-be16-db9ed3075dce'] {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:38:56.000914 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b0b6b2c9-3fd7-4a9d-b641-b32398f3e0c7 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/5db699c3-5ad0-426b-af22-63ec90bba84a" status: 404 len: 194 microversion: 2.1 time: 0.064504 May 28 04:38:56.001792 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 747/1409] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:38:55 2022] DELETE /compute/v2.1/os-security-groups/5db699c3-5ad0-426b-af22-63ec90bba84a => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:38:56.010512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-03a5c16c-e725-48ca-b4d9-09d604e86b02 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f7701a80a60>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:56.063209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG neutronclient.v2_0.client [None req-03a5c16c-e725-48ca-b4d9-09d604e86b02 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2a362a30-6bfd-4338-bfa5-c739a893df16 does not exist", "detail": ""}} {{(pid=126043) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:38:56.064061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.security_group_api [None req-03a5c16c-e725-48ca-b4d9-09d604e86b02 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Neutron security group 2a362a30-6bfd-4338-bfa5-c739a893df16 not found {{(pid=126043) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 04:38:56.064883 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-03a5c16c-e725-48ca-b4d9-09d604e86b02 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] HTTP exception thrown: Security group 2a362a30-6bfd-4338-bfa5-c739a893df16 does not exist May 28 04:38:56.064883 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-5b03486d-4f1b-4147-b290-0cb198cec67c'] May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-03a5c16c-e725-48ca-b4d9-09d604e86b02 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Request method failure captured: May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/os-security-groups/2a362a30-6bfd-4338-bfa5-c739a893df16 HTTP/1.1 May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikacH3mPNflVe6LL6bg9_A8pzAabYS23jRSixTFQfefIS8h0xsq17YlHMuAQcMYGioTiJUzGf5HQ_8pUjy0pwazx5CoRz1nqfCdunQxIHFcBiGin6OUttjeU6RRcr_kTDInnBBWYYOIl_RyOz0kb25BPKfu6ZYOhMuIQdqMRnqceoVqo May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:38:56.068305 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:38:56.070026 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:38:56.070026 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:56.070026 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:56.070026 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:56.070026 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:56.070026 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:38:56.070026 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:38:56.070026 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 54a0d2f3e0184d14ae4050562e236581 May 28 04:38:56.070026 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:56.070026 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:38:56.070026 n-d-843700-1 devstack@n-api.service[126043]: exception: Security group 2a362a30-6bfd-4338-bfa5-c739a893df16 does not exist May 28 04:38:56.070026 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-5b03486d-4f1b-4147-b290-0cb198cec67c'] May 28 04:38:56.070026 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '2a362a30-6bfd-4338-bfa5-c739a893df16'} May 28 04:38:56.071031 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:38:56.071031 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:56.071031 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 04:38:56.071031 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 04:38:56.071031 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:56.071031 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:56.071031 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 04:38:56.071031 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 04:38:56.071031 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:56.071031 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:56.071031 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 04:38:56.071031 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 04:38:56.071031 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:56.071031 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:56.071031 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:38:56.071031 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:38:56.071031 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:56.071031 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:56.071031 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:38:56.072381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:38:56.072381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:56.072381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:56.072381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:38:56.072381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:38:56.072381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:38:56.072381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:38:56.072381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2a362a30-6bfd-4338-bfa5-c739a893df16 does not exist May 28 04:38:56.072381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5b03486d-4f1b-4147-b290-0cb198cec67c'] May 28 04:38:56.072381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:56.072381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:56.072381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:56.072381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:56.072381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 28 04:38:56.072381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 04:38:56.072381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 04:38:56.072381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 04:38:56.072381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2a362a30-6bfd-4338-bfa5-c739a893df16 does not exist May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5b03486d-4f1b-4147-b290-0cb198cec67c'] May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2a362a30-6bfd-4338-bfa5-c739a893df16 does not exist May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5b03486d-4f1b-4147-b290-0cb198cec67c'] May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:56.073703 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:56.075242 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:56.075242 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:56.075242 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:38:56.075242 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:38:56.075242 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2a362a30-6bfd-4338-bfa5-c739a893df16 does not exist May 28 04:38:56.075242 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5b03486d-4f1b-4147-b290-0cb198cec67c'] May 28 04:38:56.075242 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:56.075242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-03a5c16c-e725-48ca-b4d9-09d604e86b02 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Returning 404 to user: Security group 2a362a30-6bfd-4338-bfa5-c739a893df16 does not exist May 28 04:38:56.075242 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-5b03486d-4f1b-4147-b290-0cb198cec67c'] {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:38:56.078343 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-03a5c16c-e725-48ca-b4d9-09d604e86b02 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/2a362a30-6bfd-4338-bfa5-c739a893df16" status: 404 len: 194 microversion: 2.1 time: 0.071159 May 28 04:38:56.078343 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 663/1410] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:38:56 2022] DELETE /compute/v2.1/os-security-groups/2a362a30-6bfd-4338-bfa5-c739a893df16 => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:38:56.087276 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-75814288-04d3-47ef-9e83-e3464022d058 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f770753f1f0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:56.123826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG neutronclient.v2_0.client [None req-75814288-04d3-47ef-9e83-e3464022d058 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d does not exist", "detail": ""}} {{(pid=126044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:38:56.124429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.security_group_api [None req-75814288-04d3-47ef-9e83-e3464022d058 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Neutron security group 4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d not found {{(pid=126044) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 04:38:56.124948 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-75814288-04d3-47ef-9e83-e3464022d058 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] HTTP exception thrown: Security group 4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d does not exist May 28 04:38:56.124948 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-e5009a8b-8c53-42c0-a495-5151015e23ac'] May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-75814288-04d3-47ef-9e83-e3464022d058 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Request method failure captured: May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/os-security-groups/4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d HTTP/1.1 May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikacH3mPNflVe6LL6bg9_A8pzAabYS23jRSixTFQfefIS8h0xsq17YlHMuAQcMYGioTiJUzGf5HQ_8pUjy0pwazx5CoRz1nqfCdunQxIHFcBiGin6OUttjeU6RRcr_kTDInnBBWYYOIl_RyOz0kb25BPKfu6ZYOhMuIQdqMRnqceoVqo May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:38:56.126884 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:38:56.128384 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:38:56.128384 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:56.128384 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:56.128384 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:56.128384 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:56.128384 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:38:56.128384 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:38:56.128384 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 54a0d2f3e0184d14ae4050562e236581 May 28 04:38:56.128384 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:56.128384 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:38:56.128384 n-d-843700-1 devstack@n-api.service[126044]: exception: Security group 4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d does not exist May 28 04:38:56.128384 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-e5009a8b-8c53-42c0-a495-5151015e23ac'] May 28 04:38:56.128384 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d'} May 28 04:38:56.129306 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:38:56.129306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:56.129306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 04:38:56.129306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 04:38:56.129306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:56.129306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:56.129306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 04:38:56.129306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 04:38:56.129306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:56.129306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:56.129306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 04:38:56.129306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 04:38:56.129306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:56.129306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:56.129306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:38:56.129306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:38:56.129306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:56.129306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:56.129306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:38:56.130756 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:38:56.130756 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:56.130756 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:56.130756 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:38:56.130756 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:38:56.130756 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:38:56.130756 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:38:56.130756 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d does not exist May 28 04:38:56.130756 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5009a8b-8c53-42c0-a495-5151015e23ac'] May 28 04:38:56.130756 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:56.130756 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:56.130756 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:56.130756 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:56.130756 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 28 04:38:56.130756 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 04:38:56.130756 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 04:38:56.130756 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 04:38:56.130756 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d does not exist May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5009a8b-8c53-42c0-a495-5151015e23ac'] May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d does not exist May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5009a8b-8c53-42c0-a495-5151015e23ac'] May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:56.131895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:56.133483 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:56.133483 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:56.133483 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:38:56.133483 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:38:56.133483 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d does not exist May 28 04:38:56.133483 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5009a8b-8c53-42c0-a495-5151015e23ac'] May 28 04:38:56.133483 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:38:56.133483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-75814288-04d3-47ef-9e83-e3464022d058 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Returning 404 to user: Security group 4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d does not exist May 28 04:38:56.133483 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-e5009a8b-8c53-42c0-a495-5151015e23ac'] {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:38:56.133483 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-75814288-04d3-47ef-9e83-e3464022d058 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d" status: 404 len: 194 microversion: 2.1 time: 0.047024 May 28 04:38:56.133483 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 748/1411] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:38:56 2022] DELETE /compute/v2.1/os-security-groups/4204ca9e-8b94-4a98-9bcf-2d1d6c6ec76d => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:38:56.137906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-99e7583c-885e-44f4-bcec-a4a974bdfbcc tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f770196e1f0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:56.166223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG neutronclient.v2_0.client [None req-99e7583c-885e-44f4-bcec-a4a974bdfbcc tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a82404d6-47e6-40b4-b418-2c9748234166 does not exist", "detail": ""}} {{(pid=126043) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:38:56.167158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.security_group_api [None req-99e7583c-885e-44f4-bcec-a4a974bdfbcc tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Neutron security group a82404d6-47e6-40b4-b418-2c9748234166 not found {{(pid=126043) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 04:38:56.169113 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-99e7583c-885e-44f4-bcec-a4a974bdfbcc tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] HTTP exception thrown: Security group a82404d6-47e6-40b4-b418-2c9748234166 does not exist May 28 04:38:56.169113 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-5d58e0e8-7b12-4641-bc03-04e82dd3fec4'] May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-99e7583c-885e-44f4-bcec-a4a974bdfbcc tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Request method failure captured: May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/os-security-groups/a82404d6-47e6-40b4-b418-2c9748234166 HTTP/1.1 May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikacH3mPNflVe6LL6bg9_A8pzAabYS23jRSixTFQfefIS8h0xsq17YlHMuAQcMYGioTiJUzGf5HQ_8pUjy0pwazx5CoRz1nqfCdunQxIHFcBiGin6OUttjeU6RRcr_kTDInnBBWYYOIl_RyOz0kb25BPKfu6ZYOhMuIQdqMRnqceoVqo May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:38:56.171968 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:38:56.174169 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:38:56.174169 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:56.174169 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:38:56.174169 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:38:56.174169 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:56.174169 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:38:56.174169 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:38:56.174169 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 54a0d2f3e0184d14ae4050562e236581 May 28 04:38:56.174169 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:38:56.174169 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:38:56.174169 n-d-843700-1 devstack@n-api.service[126043]: exception: Security group a82404d6-47e6-40b4-b418-2c9748234166 does not exist May 28 04:38:56.174169 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-5d58e0e8-7b12-4641-bc03-04e82dd3fec4'] May 28 04:38:56.174169 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'a82404d6-47e6-40b4-b418-2c9748234166'} May 28 04:38:56.174973 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:38:56.174973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:56.174973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 04:38:56.174973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 04:38:56.174973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:56.174973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:56.174973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 04:38:56.174973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 04:38:56.174973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:56.174973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:56.174973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 04:38:56.174973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 04:38:56.174973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:56.174973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:56.174973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:38:56.174973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:38:56.174973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:56.174973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:56.174973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:38:56.176216 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:38:56.176216 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:38:56.176216 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:38:56.176216 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:38:56.176216 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:38:56.176216 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:38:56.176216 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:38:56.176216 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a82404d6-47e6-40b4-b418-2c9748234166 does not exist May 28 04:38:56.176216 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d58e0e8-7b12-4641-bc03-04e82dd3fec4'] May 28 04:38:56.176216 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:56.176216 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:56.176216 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:56.176216 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:56.176216 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 28 04:38:56.176216 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 04:38:56.176216 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 04:38:56.176216 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 04:38:56.176216 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a82404d6-47e6-40b4-b418-2c9748234166 does not exist May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d58e0e8-7b12-4641-bc03-04e82dd3fec4'] May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a82404d6-47e6-40b4-b418-2c9748234166 does not exist May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d58e0e8-7b12-4641-bc03-04e82dd3fec4'] May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:56.177263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:38:56.179964 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:38:56.179964 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:38:56.179964 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:38:56.179964 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:38:56.179964 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a82404d6-47e6-40b4-b418-2c9748234166 does not exist May 28 04:38:56.179964 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d58e0e8-7b12-4641-bc03-04e82dd3fec4'] May 28 04:38:56.179964 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:38:56.182593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-99e7583c-885e-44f4-bcec-a4a974bdfbcc tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Returning 404 to user: Security group a82404d6-47e6-40b4-b418-2c9748234166 does not exist May 28 04:38:56.182593 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-5d58e0e8-7b12-4641-bc03-04e82dd3fec4'] {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:38:56.183816 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-99e7583c-885e-44f4-bcec-a4a974bdfbcc tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/a82404d6-47e6-40b4-b418-2c9748234166" status: 404 len: 194 microversion: 2.1 time: 0.049898 May 28 04:38:56.185561 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 664/1412] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:38:56 2022] DELETE /compute/v2.1/os-security-groups/a82404d6-47e6-40b4-b418-2c9748234166 => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:38:56.193033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f7eb5d4f-4e2f-444a-a070-fe7df3c6e4e8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:56.193541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f7eb5d4f-4e2f-444a-a070-fe7df3c6e4e8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:56.200173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7eb5d4f-4e2f-444a-a070-fe7df3c6e4e8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:56.201195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7eb5d4f-4e2f-444a-a070-fe7df3c6e4e8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:56.201984 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7eb5d4f-4e2f-444a-a070-fe7df3c6e4e8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:56.202426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7eb5d4f-4e2f-444a-a070-fe7df3c6e4e8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:56.245310 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f7eb5d4f-4e2f-444a-a070-fe7df3c6e4e8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:38:56.423613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d23ccbbc-ee99-4c14-bc4f-ed959c1f5aef tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:56.424250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d23ccbbc-ee99-4c14-bc4f-ed959c1f5aef tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:56.448963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d23ccbbc-ee99-4c14-bc4f-ed959c1f5aef tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:56.448963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d23ccbbc-ee99-4c14-bc4f-ed959c1f5aef tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:56.448963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d23ccbbc-ee99-4c14-bc4f-ed959c1f5aef tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:56.448963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d23ccbbc-ee99-4c14-bc4f-ed959c1f5aef tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:56.517009 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:56.598100 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f7eb5d4f-4e2f-444a-a070-fe7df3c6e4e8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d" status: 204 len: 0 microversion: 2.1 time: 0.408028 May 28 04:38:56.599405 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 749/1413] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:38:56 2022] DELETE /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:38:56.609748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c8b8a89c-6200-4293-adde-1f3aedbd5894 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:56.611206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c8b8a89c-6200-4293-adde-1f3aedbd5894 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:56.625671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8b8a89c-6200-4293-adde-1f3aedbd5894 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:56.626230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8b8a89c-6200-4293-adde-1f3aedbd5894 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:56.631352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8b8a89c-6200-4293-adde-1f3aedbd5894 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:56.632140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8b8a89c-6200-4293-adde-1f3aedbd5894 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:56.933805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c8b8a89c-6200-4293-adde-1f3aedbd5894 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:56.944260 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c8b8a89c-6200-4293-adde-1f3aedbd5894 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726" status: 200 len: 1212 microversion: 2.1 time: 0.343100 May 28 04:38:56.955723 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 750/1414] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:56 2022] GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726 => generated 1212 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:56.961696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-edd7cce9-e244-458f-bdab-9382092e9103 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:56.962811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-edd7cce9-e244-458f-bdab-9382092e9103 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:56.970551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-edd7cce9-e244-458f-bdab-9382092e9103 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:56.971246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-edd7cce9-e244-458f-bdab-9382092e9103 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:56.972204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-edd7cce9-e244-458f-bdab-9382092e9103 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:56.972806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-edd7cce9-e244-458f-bdab-9382092e9103 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:57.184402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d23ccbbc-ee99-4c14-bc4f-ed959c1f5aef tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:57.205409 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d23ccbbc-ee99-4c14-bc4f-ed959c1f5aef tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1313 microversion: 2.1 time: 0.795973 May 28 04:38:57.211558 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 665/1415] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:56 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1313 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:57.222157 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-40644899-e204-474a-9c17-9cbc44614ac3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:57.226624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-40644899-e204-474a-9c17-9cbc44614ac3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:57.241045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40644899-e204-474a-9c17-9cbc44614ac3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:57.243074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40644899-e204-474a-9c17-9cbc44614ac3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:57.244985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40644899-e204-474a-9c17-9cbc44614ac3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:57.248736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40644899-e204-474a-9c17-9cbc44614ac3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:57.262044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-edd7cce9-e244-458f-bdab-9382092e9103 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:57.272176 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-edd7cce9-e244-458f-bdab-9382092e9103 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d" status: 200 len: 1645 microversion: 2.1 time: 0.315008 May 28 04:38:57.273082 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 751/1416] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:56 2022] GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d => generated 1645 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:57.535287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-40644899-e204-474a-9c17-9cbc44614ac3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:57.563394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-40644899-e204-474a-9c17-9cbc44614ac3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:57.566916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-40644899-e204-474a-9c17-9cbc44614ac3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:57.572369 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-40644899-e204-474a-9c17-9cbc44614ac3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1557 microversion: 2.25 time: 0.359052 May 28 04:38:57.577030 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 666/1417] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:57 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1557 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:57.589559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef4e8ba2-18b1-4ac8-8a98-a7cbd21df51c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:57.600752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ef4e8ba2-18b1-4ac8-8a98-a7cbd21df51c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:57.617674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef4e8ba2-18b1-4ac8-8a98-a7cbd21df51c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:57.620088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef4e8ba2-18b1-4ac8-8a98-a7cbd21df51c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:57.621603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef4e8ba2-18b1-4ac8-8a98-a7cbd21df51c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:57.622966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef4e8ba2-18b1-4ac8-8a98-a7cbd21df51c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:57.628825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:38:57.939093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-ef4e8ba2-18b1-4ac8-8a98-a7cbd21df51c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lazy-loading 'services' on Instance uuid 315db9ca-6acb-462a-a538-1b888d62e083 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:38:57.965134 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ef4e8ba2-18b1-4ac8-8a98-a7cbd21df51c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 2049 microversion: 2.25 time: 0.379205 May 28 04:38:57.969835 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 752/1418] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:38:57 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 2049 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:38:57.970280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3be7e05e-d8c8-41d5-a3ce-6e8a6dac532c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:57.971045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3be7e05e-d8c8-41d5-a3ce-6e8a6dac532c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:57.990792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3be7e05e-d8c8-41d5-a3ce-6e8a6dac532c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:57.991283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3be7e05e-d8c8-41d5-a3ce-6e8a6dac532c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:57.992074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3be7e05e-d8c8-41d5-a3ce-6e8a6dac532c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:57.992523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3be7e05e-d8c8-41d5-a3ce-6e8a6dac532c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:57.994541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6daa7eb4-37c4-4ebe-957c-5cd8be11514e tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:58.002848 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:38:58.002848 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:38:58.004967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6daa7eb4-37c4-4ebe-957c-5cd8be11514e tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:58.006192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6daa7eb4-37c4-4ebe-957c-5cd8be11514e tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:58.014762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6daa7eb4-37c4-4ebe-957c-5cd8be11514e tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:58.016208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6daa7eb4-37c4-4ebe-957c-5cd8be11514e tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:58.073193 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6daa7eb4-37c4-4ebe-957c-5cd8be11514e tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.086506 May 28 04:38:58.076888 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 753/1419] 10.222.0.58 () {60 vars in 1216 bytes} [Sat May 28 04:38:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:38:58.163473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3be7e05e-d8c8-41d5-a3ce-6e8a6dac532c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:58.179150 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3be7e05e-d8c8-41d5-a3ce-6e8a6dac532c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726" status: 200 len: 1274 microversion: 2.1 time: 0.220968 May 28 04:38:58.179751 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 667/1420] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:57 2022] GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726 => generated 1274 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:38:58.226121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d8258a29-0123-4f35-873e-942bae54f045 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:58.230729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d8258a29-0123-4f35-873e-942bae54f045 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:58.238949 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8258a29-0123-4f35-873e-942bae54f045 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:58.241559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8258a29-0123-4f35-873e-942bae54f045 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:58.242631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8258a29-0123-4f35-873e-942bae54f045 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:58.243614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8258a29-0123-4f35-873e-942bae54f045 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:58.289702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7df56ea3-3393-4645-8248-fc58fcb7cc30 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:58.291187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7df56ea3-3393-4645-8248-fc58fcb7cc30 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:58.307436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7df56ea3-3393-4645-8248-fc58fcb7cc30 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:58.310674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7df56ea3-3393-4645-8248-fc58fcb7cc30 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:58.312280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7df56ea3-3393-4645-8248-fc58fcb7cc30 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:58.312640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7df56ea3-3393-4645-8248-fc58fcb7cc30 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:58.643223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d8258a29-0123-4f35-873e-942bae54f045 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:58.655052 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d8258a29-0123-4f35-873e-942bae54f045 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1313 microversion: 2.1 time: 0.433711 May 28 04:38:58.664666 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 754/1421] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:58 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:58.730004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7df56ea3-3393-4645-8248-fc58fcb7cc30 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:58.751736 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7df56ea3-3393-4645-8248-fc58fcb7cc30 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d" status: 200 len: 1645 microversion: 2.1 time: 0.465468 May 28 04:38:58.753345 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 668/1422] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:58 2022] GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d => generated 1645 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:59.186140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a1f48190-86f4-44b6-b5cb-da0b36fbc2a5 tempest-AbsoluteLimitsTestJSON-1452981037 tempest-AbsoluteLimitsTestJSON-1452981037-project] Calling method '.version_select at 0x7f77074e93a0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:59.211033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1597b84c-ed2b-4353-a14a-f2062d944938 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:59.211176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1f48190-86f4-44b6-b5cb-da0b36fbc2a5 tempest-AbsoluteLimitsTestJSON-1452981037 tempest-AbsoluteLimitsTestJSON-1452981037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:59.211717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1f48190-86f4-44b6-b5cb-da0b36fbc2a5 tempest-AbsoluteLimitsTestJSON-1452981037 tempest-AbsoluteLimitsTestJSON-1452981037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:59.212942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1f48190-86f4-44b6-b5cb-da0b36fbc2a5 tempest-AbsoluteLimitsTestJSON-1452981037 tempest-AbsoluteLimitsTestJSON-1452981037-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:59.213780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1597b84c-ed2b-4353-a14a-f2062d944938 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:59.216017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1f48190-86f4-44b6-b5cb-da0b36fbc2a5 tempest-AbsoluteLimitsTestJSON-1452981037 tempest-AbsoluteLimitsTestJSON-1452981037-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:59.227518 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1597b84c-ed2b-4353-a14a-f2062d944938 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:59.228331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1597b84c-ed2b-4353-a14a-f2062d944938 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:59.229579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1597b84c-ed2b-4353-a14a-f2062d944938 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:59.236792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1597b84c-ed2b-4353-a14a-f2062d944938 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:59.285410 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a1f48190-86f4-44b6-b5cb-da0b36fbc2a5 tempest-AbsoluteLimitsTestJSON-1452981037 tempest-AbsoluteLimitsTestJSON-1452981037-project] 10.222.0.58 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.403713 May 28 04:38:59.286077 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 755/1423] 10.222.0.58 () {58 vars in 1121 bytes} [Sat May 28 04:38:58 2022] GET /compute/v2.1/limits => generated 511 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:38:59.598140 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1597b84c-ed2b-4353-a14a-f2062d944938 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:38:59.610231 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1597b84c-ed2b-4353-a14a-f2062d944938 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726" status: 200 len: 1316 microversion: 2.1 time: 0.416775 May 28 04:38:59.614393 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 669/1424] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:59 2022] GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726 => generated 1316 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:38:59.672740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e497f1e4-27c4-4e29-855b-61c97df1cc63 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:59.673594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e497f1e4-27c4-4e29-855b-61c97df1cc63 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:59.688769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e497f1e4-27c4-4e29-855b-61c97df1cc63 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:59.689227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e497f1e4-27c4-4e29-855b-61c97df1cc63 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:59.690597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e497f1e4-27c4-4e29-855b-61c97df1cc63 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:59.690597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e497f1e4-27c4-4e29-855b-61c97df1cc63 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:59.770196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-81f8373a-b4a8-41fb-bfc4-9e5fc65a2585 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:38:59.770978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-81f8373a-b4a8-41fb-bfc4-9e5fc65a2585 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:38:59.791318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81f8373a-b4a8-41fb-bfc4-9e5fc65a2585 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:59.793777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81f8373a-b4a8-41fb-bfc4-9e5fc65a2585 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:59.798855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81f8373a-b4a8-41fb-bfc4-9e5fc65a2585 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:38:59.802079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81f8373a-b4a8-41fb-bfc4-9e5fc65a2585 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:38:59.963630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:00.336181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:00.516410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e497f1e4-27c4-4e29-855b-61c97df1cc63 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:00.528689 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e497f1e4-27c4-4e29-855b-61c97df1cc63 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1313 microversion: 2.1 time: 0.860337 May 28 04:39:00.531153 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 756/1425] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:59 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1313 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:00.630796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c5839312-1559-4186-b7de-b5990839b9c6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:00.635816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c5839312-1559-4186-b7de-b5990839b9c6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:00.644508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c5839312-1559-4186-b7de-b5990839b9c6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:00.645918 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c5839312-1559-4186-b7de-b5990839b9c6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:00.647471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c5839312-1559-4186-b7de-b5990839b9c6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:00.652249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c5839312-1559-4186-b7de-b5990839b9c6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:01.178411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-81f8373a-b4a8-41fb-bfc4-9e5fc65a2585 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:01.191360 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-81f8373a-b4a8-41fb-bfc4-9e5fc65a2585 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d" status: 200 len: 1645 microversion: 2.1 time: 1.423781 May 28 04:39:01.192863 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 670/1426] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:38:59 2022] GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d => generated 1645 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:39:01.214084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c5839312-1559-4186-b7de-b5990839b9c6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:01.224378 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c5839312-1559-4186-b7de-b5990839b9c6 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726" status: 200 len: 1316 microversion: 2.1 time: 0.599083 May 28 04:39:01.225515 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 757/1427] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:00 2022] GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726 => generated 1316 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:39:01.249898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-c8b7d74c-021f-419f-a6d5-c76af9f726b7 req-88be8984-830b-460c-ac97-ce18cbe48bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ca89b1-056f-4926-95d4-fb4b04a07726", "tag": "450cde40-853d-4a07-a420-3788b25387d1"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:01.265952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c8b7d74c-021f-419f-a6d5-c76af9f726b7 req-88be8984-830b-460c-ac97-ce18cbe48bee service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:01.266412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c8b7d74c-021f-419f-a6d5-c76af9f726b7 req-88be8984-830b-460c-ac97-ce18cbe48bee service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:01.301494 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-c8b7d74c-021f-419f-a6d5-c76af9f726b7 req-88be8984-830b-460c-ac97-ce18cbe48bee service nova] Creating event network-changed:450cde40-853d-4a07-a420-3788b25387d1 for instance 97ca89b1-056f-4926-95d4-fb4b04a07726 on n-h1-843700-1 May 28 04:39:01.307400 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-c8b7d74c-021f-419f-a6d5-c76af9f726b7 req-88be8984-830b-460c-ac97-ce18cbe48bee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062347 May 28 04:39:01.308025 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 671/1428] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:01.372662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-ca169cd0-994e-460c-97f1-05ad905e9f7c req-a83280a4-3332-4494-b2a9-280d317a753f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6f58077-195c-4172-bacf-33dfd66cbe4d", "name": "network-vif-deleted", "tag": "1582e229-4bed-4dd2-b97c-c1575e0fac14"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:01.402413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ca169cd0-994e-460c-97f1-05ad905e9f7c req-a83280a4-3332-4494-b2a9-280d317a753f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:01.405209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ca169cd0-994e-460c-97f1-05ad905e9f7c req-a83280a4-3332-4494-b2a9-280d317a753f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:01.453025 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-ca169cd0-994e-460c-97f1-05ad905e9f7c req-a83280a4-3332-4494-b2a9-280d317a753f service nova] Creating event network-vif-deleted:1582e229-4bed-4dd2-b97c-c1575e0fac14 for instance b6f58077-195c-4172-bacf-33dfd66cbe4d on n-h2-843700-1 May 28 04:39:01.468606 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-ca169cd0-994e-460c-97f1-05ad905e9f7c req-a83280a4-3332-4494-b2a9-280d317a753f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099269 May 28 04:39:01.508834 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 758/1429] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:01.546727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a862be76-a09d-41ac-b972-c76c07da847c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:01.547752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a862be76-a09d-41ac-b972-c76c07da847c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:01.562725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a862be76-a09d-41ac-b972-c76c07da847c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:01.566404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a862be76-a09d-41ac-b972-c76c07da847c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:01.573443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a862be76-a09d-41ac-b972-c76c07da847c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:01.573443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a862be76-a09d-41ac-b972-c76c07da847c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:02.145951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a862be76-a09d-41ac-b972-c76c07da847c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:02.162766 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a862be76-a09d-41ac-b972-c76c07da847c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1313 microversion: 2.1 time: 0.620662 May 28 04:39:02.165301 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 672/1430] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:01 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1313 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:02.215197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7cdb3876-e432-429e-a0d3-c480cd152366 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:02.222736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7cdb3876-e432-429e-a0d3-c480cd152366 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:02.230232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7cdb3876-e432-429e-a0d3-c480cd152366 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:02.230957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7cdb3876-e432-429e-a0d3-c480cd152366 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:02.232007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7cdb3876-e432-429e-a0d3-c480cd152366 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:02.232698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7cdb3876-e432-429e-a0d3-c480cd152366 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:02.242215 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2f75aa7a-29fe-40fd-8fd6-b002bb06fd9e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:02.243619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2f75aa7a-29fe-40fd-8fd6-b002bb06fd9e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:02.256989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f75aa7a-29fe-40fd-8fd6-b002bb06fd9e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:02.258213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f75aa7a-29fe-40fd-8fd6-b002bb06fd9e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:02.261618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f75aa7a-29fe-40fd-8fd6-b002bb06fd9e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:02.267457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f75aa7a-29fe-40fd-8fd6-b002bb06fd9e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:02.298926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7cdb3876-e432-429e-a0d3-c480cd152366 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:02.299405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7cdb3876-e432-429e-a0d3-c480cd152366 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:02.299861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-7cdb3876-e432-429e-a0d3-c480cd152366 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lazy-loading 'fault' on Instance uuid b6f58077-195c-4172-bacf-33dfd66cbe4d {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:39:02.386380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7cdb3876-e432-429e-a0d3-c480cd152366 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a0d2f3e0184d14ae4050562e236581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b443a65fedd4511b931cd5130b7e618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:02.412516 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7cdb3876-e432-429e-a0d3-c480cd152366 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d" status: 200 len: 1305 microversion: 2.1 time: 0.205033 May 28 04:39:02.413312 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 759/1431] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:02 2022] GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d => generated 1305 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:02.479457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2f75aa7a-29fe-40fd-8fd6-b002bb06fd9e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:02.503727 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2f75aa7a-29fe-40fd-8fd6-b002bb06fd9e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726" status: 200 len: 1316 microversion: 2.1 time: 0.265698 May 28 04:39:02.517548 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 673/1432] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:02 2022] GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726 => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:39:02.600581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2595daa6-80cd-4d4c-9331-40e6b0a7ff77 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc20310d-8753-44ba-9332-a63e13d07b1d", "device": "/dev/xvdb"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:02.602982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2595daa6-80cd-4d4c-9331-40e6b0a7ff77 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:02.613217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2595daa6-80cd-4d4c-9331-40e6b0a7ff77 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:02.614267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2595daa6-80cd-4d4c-9331-40e6b0a7ff77 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:02.614768 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2595daa6-80cd-4d4c-9331-40e6b0a7ff77 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:02.615715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2595daa6-80cd-4d4c-9331-40e6b0a7ff77 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:02.942801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-90abe6fa-efaf-4c76-99db-b388da11530a req-8d997b0a-949f-4829-8239-f4ce1b824fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2879396-59ef-44c3-ba44-5626191ec11e", "name": "network-vif-plugged", "status": "completed", "tag": "2c964bd0-98e9-472c-a6fe-946d0b7b8704"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:02.947078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:02.954727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-90abe6fa-efaf-4c76-99db-b388da11530a req-8d997b0a-949f-4829-8239-f4ce1b824fb5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:02.963527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-90abe6fa-efaf-4c76-99db-b388da11530a req-8d997b0a-949f-4829-8239-f4ce1b824fb5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:02.968738 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-90abe6fa-efaf-4c76-99db-b388da11530a req-8d997b0a-949f-4829-8239-f4ce1b824fb5 service nova] Creating event network-vif-plugged:2c964bd0-98e9-472c-a6fe-946d0b7b8704 for instance b2879396-59ef-44c3-ba44-5626191ec11e on n-h2-843700-1 May 28 04:39:02.974006 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-90abe6fa-efaf-4c76-99db-b388da11530a req-8d997b0a-949f-4829-8239-f4ce1b824fb5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035994 May 28 04:39:02.974912 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 674/1433] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:39:03.183768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b141a623-2705-4f0d-9720-5014e6ac93d6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:03.184485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b141a623-2705-4f0d-9720-5014e6ac93d6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:03.191485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b141a623-2705-4f0d-9720-5014e6ac93d6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:03.191950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b141a623-2705-4f0d-9720-5014e6ac93d6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:03.192735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b141a623-2705-4f0d-9720-5014e6ac93d6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:03.193212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b141a623-2705-4f0d-9720-5014e6ac93d6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:03.331742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b141a623-2705-4f0d-9720-5014e6ac93d6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:03.341106 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b141a623-2705-4f0d-9720-5014e6ac93d6 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1313 microversion: 2.1 time: 0.161637 May 28 04:39:03.341855 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 675/1434] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:03 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:39:03.430314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-af778465-260a-434e-a53b-2dc9f0610fb8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:03.430925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-af778465-260a-434e-a53b-2dc9f0610fb8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] [instance: b6f58077-195c-4172-bacf-33dfd66cbe4d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:03.438183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af778465-260a-434e-a53b-2dc9f0610fb8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:03.438641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af778465-260a-434e-a53b-2dc9f0610fb8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:03.439443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af778465-260a-434e-a53b-2dc9f0610fb8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:03.439877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af778465-260a-434e-a53b-2dc9f0610fb8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:03.454026 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-af778465-260a-434e-a53b-2dc9f0610fb8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] HTTP exception thrown: Instance b6f58077-195c-4172-bacf-33dfd66cbe4d could not be found. May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-af778465-260a-434e-a53b-2dc9f0610fb8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Request method failure captured: May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d HTTP/1.1 May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikacH3mPNflVe6LL6bg9_A8pzAabYS23jRSixTFQfefIS8h0xsq17YlHMuAQcMYGioTiJUzGf5HQ_8pUjy0pwazx5CoRz1nqfCdunQxIHFcBiGin6OUttjeU6RRcr_kTDInnBBWYYOIl_RyOz0kb25BPKfu6ZYOhMuIQdqMRnqceoVqo May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:39:03.455724 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:39:03.457669 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b443a65fedd4511b931cd5130b7e618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:39:03.457669 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:39:03.457669 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 9b443a65fedd4511b931cd5130b7e618 May 28 04:39:03.457669 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1600393038 May 28 04:39:03.457669 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:39:03.457669 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:39:03.457669 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:39:03.457669 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 54a0d2f3e0184d14ae4050562e236581 May 28 04:39:03.457669 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-SecurityGroupsTestJSON-1600393038-project May 28 04:39:03.457669 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:39:03.457669 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance b6f58077-195c-4172-bacf-33dfd66cbe4d could not be found. May 28 04:39:03.457669 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'b6f58077-195c-4172-bacf-33dfd66cbe4d'} May 28 04:39:03.459212 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:39:03.459212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:39:03.459212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:39:03.459212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:39:03.459212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:39:03.459212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:39:03.459212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:39:03.459212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:39:03.459212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:39:03.459212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:39:03.459212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6f58077-195c-4172-bacf-33dfd66cbe4d could not be found. May 28 04:39:03.459212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:39:03.459212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:39:03.459212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:39:03.459212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:39:03.459212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:39:03.459212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:39:03.459212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:39:03.459212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:39:03.459212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:39:03.460768 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:39:03.460768 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:39:03.460768 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:39:03.460768 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:39:03.460768 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:39:03.460768 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:39:03.460768 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:39:03.460768 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6f58077-195c-4172-bacf-33dfd66cbe4d could not be found. May 28 04:39:03.460768 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:39:03.460768 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:39:03.460768 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:39:03.460768 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:39:03.460768 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:39:03.460768 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:39:03.460768 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:39:03.460768 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:39:03.460768 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6f58077-195c-4172-bacf-33dfd66cbe4d could not be found. May 28 04:39:03.460768 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:39:03.462125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-af778465-260a-434e-a53b-2dc9f0610fb8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Returning 404 to user: Instance b6f58077-195c-4172-bacf-33dfd66cbe4d could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:39:03.462125 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-af778465-260a-434e-a53b-2dc9f0610fb8 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d" status: 404 len: 111 microversion: 2.1 time: 0.030762 May 28 04:39:03.462125 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 676/1435] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:03 2022] GET /compute/v2.1/servers/b6f58077-195c-4172-bacf-33dfd66cbe4d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:39:03.465409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6a6c24ff-ffc1-459e-a3fe-6282b9b9862f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f7701a80e50>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:03.854025 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6a6c24ff-ffc1-459e-a3fe-6282b9b9862f tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/45ba2c97-9859-49b9-937a-6c414fdbd0fd" status: 202 len: 0 microversion: 2.1 time: 0.391963 May 28 04:39:03.854688 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 677/1436] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:39:03 2022] DELETE /compute/v2.1/os-security-groups/45ba2c97-9859-49b9-937a-6c414fdbd0fd => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:39:03.867204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-408dcfbe-0ee8-4372-b22f-6806b95dd78f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:03.867204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-408dcfbe-0ee8-4372-b22f-6806b95dd78f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:03.873522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-408dcfbe-0ee8-4372-b22f-6806b95dd78f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:03.874127 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-408dcfbe-0ee8-4372-b22f-6806b95dd78f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:03.875102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-408dcfbe-0ee8-4372-b22f-6806b95dd78f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:03.875559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-408dcfbe-0ee8-4372-b22f-6806b95dd78f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:03.950713 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2595daa6-80cd-4d4c-9331-40e6b0a7ff77 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "POST /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.347927 May 28 04:39:03.950713 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 760/1437] 10.222.0.58 () {62 vars in 1363 bytes} [Sat May 28 04:39:02 2022] POST /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments => generated 194 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:39:04.062479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-408dcfbe-0ee8-4372-b22f-6806b95dd78f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:04.070357 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-408dcfbe-0ee8-4372-b22f-6806b95dd78f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726" status: 200 len: 1316 microversion: 2.1 time: 0.214665 May 28 04:39:04.070958 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 678/1438] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:03 2022] GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:04.075589 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-57b4b4ee-b63e-46dd-b88c-356419a49958 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] Calling method '.version_select at 0x7f770184b040>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:04.134502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8d532703-62c3-4f29-95b5-0eddbc0e875d tempest-AZV2TestJSON-461266277 tempest-AZV2TestJSON-461266277-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:04.136625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d532703-62c3-4f29-95b5-0eddbc0e875d tempest-AZV2TestJSON-461266277 tempest-AZV2TestJSON-461266277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:04.137961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d532703-62c3-4f29-95b5-0eddbc0e875d tempest-AZV2TestJSON-461266277 tempest-AZV2TestJSON-461266277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:04.140372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d532703-62c3-4f29-95b5-0eddbc0e875d tempest-AZV2TestJSON-461266277 tempest-AZV2TestJSON-461266277-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:04.141645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d532703-62c3-4f29-95b5-0eddbc0e875d tempest-AZV2TestJSON-461266277 tempest-AZV2TestJSON-461266277-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:04.181189 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8d532703-62c3-4f29-95b5-0eddbc0e875d tempest-AZV2TestJSON-461266277 tempest-AZV2TestJSON-461266277-project] 10.222.0.58 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.235040 May 28 04:39:04.182119 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 761/1439] 10.222.0.58 () {58 vars in 1163 bytes} [Sat May 28 04:39:03 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:39:04.362002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f72b8cb2-99ce-4066-917d-230d634fa6a2 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:04.362754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f72b8cb2-99ce-4066-917d-230d634fa6a2 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:04.369530 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-57b4b4ee-b63e-46dd-b88c-356419a49958 tempest-SecurityGroupsTestJSON-1600393038 tempest-SecurityGroupsTestJSON-1600393038-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/055f69a7-97e2-49ab-8764-dd19e2c58784" status: 202 len: 0 microversion: 2.1 time: 0.297489 May 28 04:39:04.374370 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 679/1440] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:39:04 2022] DELETE /compute/v2.1/os-security-groups/055f69a7-97e2-49ab-8764-dd19e2c58784 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:39:04.375925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f72b8cb2-99ce-4066-917d-230d634fa6a2 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:04.376388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f72b8cb2-99ce-4066-917d-230d634fa6a2 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:04.377183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f72b8cb2-99ce-4066-917d-230d634fa6a2 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:04.379363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f72b8cb2-99ce-4066-917d-230d634fa6a2 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:04.580951 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f72b8cb2-99ce-4066-917d-230d634fa6a2 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:04.595043 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f72b8cb2-99ce-4066-917d-230d634fa6a2 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1313 microversion: 2.1 time: 0.240580 May 28 04:39:04.596225 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 762/1441] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:04 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:39:05.090636 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6876770f-61d0-4637-964a-ba1abe0d546b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:05.092328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6876770f-61d0-4637-964a-ba1abe0d546b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:05.110519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6876770f-61d0-4637-964a-ba1abe0d546b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:05.111491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6876770f-61d0-4637-964a-ba1abe0d546b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:05.114849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6876770f-61d0-4637-964a-ba1abe0d546b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:05.115564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6876770f-61d0-4637-964a-ba1abe0d546b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:05.286389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6876770f-61d0-4637-964a-ba1abe0d546b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:05.294109 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6876770f-61d0-4637-964a-ba1abe0d546b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726" status: 200 len: 1316 microversion: 2.1 time: 0.210982 May 28 04:39:05.294670 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 680/1442] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:05 2022] GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726 => generated 1316 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:05.613749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fec5f1a6-5466-4be1-95d4-76cfe4fa9842 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:05.614447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fec5f1a6-5466-4be1-95d4-76cfe4fa9842 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:05.624370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fec5f1a6-5466-4be1-95d4-76cfe4fa9842 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:05.624370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fec5f1a6-5466-4be1-95d4-76cfe4fa9842 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:05.624370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fec5f1a6-5466-4be1-95d4-76cfe4fa9842 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:05.624370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fec5f1a6-5466-4be1-95d4-76cfe4fa9842 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:05.777603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fec5f1a6-5466-4be1-95d4-76cfe4fa9842 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:05.785522 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fec5f1a6-5466-4be1-95d4-76cfe4fa9842 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1462 microversion: 2.1 time: 0.177043 May 28 04:39:05.792586 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 763/1443] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:05 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1462 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:05.802465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3082edec-7b2b-4cfc-a1cd-bf4211c2411b tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:05.804304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3082edec-7b2b-4cfc-a1cd-bf4211c2411b tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:05.809246 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3082edec-7b2b-4cfc-a1cd-bf4211c2411b tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:05.810241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3082edec-7b2b-4cfc-a1cd-bf4211c2411b tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:05.811256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3082edec-7b2b-4cfc-a1cd-bf4211c2411b tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:05.811697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3082edec-7b2b-4cfc-a1cd-bf4211c2411b tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:05.960164 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3082edec-7b2b-4cfc-a1cd-bf4211c2411b tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1613 microversion: 2.1 time: 0.161943 May 28 04:39:05.961515 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 681/1444] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:05 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1613 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:39:05.979712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-64df39b8-e4fe-4da9-afb4-93f244fadea3 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:05.980295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-64df39b8-e4fe-4da9-afb4-93f244fadea3 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:05.998559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64df39b8-e4fe-4da9-afb4-93f244fadea3 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:05.999032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64df39b8-e4fe-4da9-afb4-93f244fadea3 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:05.999824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64df39b8-e4fe-4da9-afb4-93f244fadea3 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:06.000341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64df39b8-e4fe-4da9-afb4-93f244fadea3 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:06.084645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-64df39b8-e4fe-4da9-afb4-93f244fadea3 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dd2f32c3deaa43c38bd7f296c35b09ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b724702716164d928271e58ac2b375ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:06.090475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-64df39b8-e4fe-4da9-afb4-93f244fadea3 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] flavor_id is None. Assuming migration. {{(pid=126044) resize /opt/stack/nova/nova/compute/api.py:4142}} May 28 04:39:06.091063 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-64df39b8-e4fe-4da9-afb4-93f244fadea3 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126044) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 04:39:06.311714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-73ce0a02-4b26-487c-9d51-c0420612b2c7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:06.312433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-73ce0a02-4b26-487c-9d51-c0420612b2c7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:06.320429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73ce0a02-4b26-487c-9d51-c0420612b2c7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:06.321145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73ce0a02-4b26-487c-9d51-c0420612b2c7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:06.321966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73ce0a02-4b26-487c-9d51-c0420612b2c7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:06.322539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73ce0a02-4b26-487c-9d51-c0420612b2c7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:06.558697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-73ce0a02-4b26-487c-9d51-c0420612b2c7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:06.568193 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-73ce0a02-4b26-487c-9d51-c0420612b2c7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726" status: 200 len: 1316 microversion: 2.1 time: 0.261104 May 28 04:39:06.569557 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 682/1445] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:06 2022] GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726 => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:39:07.002482 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-64df39b8-e4fe-4da9-afb4-93f244fadea3 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e/action" status: 202 len: 0 microversion: 2.1 time: 1.026563 May 28 04:39:07.003892 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 764/1446] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:39:05 2022] POST /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e/action => generated 0 bytes in 1029 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:39:07.015864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-af12c14d-c76e-444a-8e63-1e6d66a3c47b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:07.017439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-af12c14d-c76e-444a-8e63-1e6d66a3c47b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:07.030674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af12c14d-c76e-444a-8e63-1e6d66a3c47b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:07.031547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af12c14d-c76e-444a-8e63-1e6d66a3c47b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:07.033240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af12c14d-c76e-444a-8e63-1e6d66a3c47b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:07.034343 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af12c14d-c76e-444a-8e63-1e6d66a3c47b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:07.176517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-af12c14d-c76e-444a-8e63-1e6d66a3c47b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:07.184307 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-af12c14d-c76e-444a-8e63-1e6d66a3c47b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1471 microversion: 2.1 time: 0.176094 May 28 04:39:07.184916 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 683/1447] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:07 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:07.586524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1735c89a-a5ac-49be-8170-696bc5911274 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:07.587343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1735c89a-a5ac-49be-8170-696bc5911274 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:07.599460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1735c89a-a5ac-49be-8170-696bc5911274 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:07.599919 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1735c89a-a5ac-49be-8170-696bc5911274 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:07.600697 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1735c89a-a5ac-49be-8170-696bc5911274 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:07.601185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1735c89a-a5ac-49be-8170-696bc5911274 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:07.742067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1735c89a-a5ac-49be-8170-696bc5911274 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:07.750318 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1735c89a-a5ac-49be-8170-696bc5911274 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726" status: 200 len: 1316 microversion: 2.1 time: 0.168330 May 28 04:39:07.750935 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 765/1448] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:07 2022] GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:08.202968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a3cbfcff-1e93-4c2c-be7c-baa1df19a8ae tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:08.203796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a3cbfcff-1e93-4c2c-be7c-baa1df19a8ae tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:08.216851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3cbfcff-1e93-4c2c-be7c-baa1df19a8ae tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:08.217433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3cbfcff-1e93-4c2c-be7c-baa1df19a8ae tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:08.219071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3cbfcff-1e93-4c2c-be7c-baa1df19a8ae tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:08.219995 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3cbfcff-1e93-4c2c-be7c-baa1df19a8ae tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:08.374704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-b4525775-b7a7-45d1-800e-0bb6afe1405f req-160b43da-4093-4bc2-be68-4713da64d499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ca89b1-056f-4926-95d4-fb4b04a07726", "name": "network-vif-plugged", "status": "completed", "tag": "450cde40-853d-4a07-a420-3788b25387d1"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:08.400067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b4525775-b7a7-45d1-800e-0bb6afe1405f req-160b43da-4093-4bc2-be68-4713da64d499 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:08.400067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b4525775-b7a7-45d1-800e-0bb6afe1405f req-160b43da-4093-4bc2-be68-4713da64d499 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:08.424544 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-b4525775-b7a7-45d1-800e-0bb6afe1405f req-160b43da-4093-4bc2-be68-4713da64d499 service nova] Creating event network-vif-plugged:450cde40-853d-4a07-a420-3788b25387d1 for instance 97ca89b1-056f-4926-95d4-fb4b04a07726 on n-h1-843700-1 May 28 04:39:08.448722 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-b4525775-b7a7-45d1-800e-0bb6afe1405f req-160b43da-4093-4bc2-be68-4713da64d499 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073166 May 28 04:39:08.448722 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 766/1449] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:39:08.842915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a8310294-0344-435b-ab3e-f9df708e7632 tempest-FlavorsV261TestJSON-670004135 tempest-FlavorsV261TestJSON-670004135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1463621855", "id": 1802285224, "os-flavor-access:is_public": "True"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:08.844514 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:39:08.844514 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:39:08.923696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a3cbfcff-1e93-4c2c-be7c-baa1df19a8ae tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:08.931682 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a3cbfcff-1e93-4c2c-be7c-baa1df19a8ae tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1471 microversion: 2.1 time: 0.733781 May 28 04:39:08.937933 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 684/1450] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:08 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1471 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:08.943075 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-144d654c-3c5d-4a79-a253-28aeb91da196 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:08.946612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-144d654c-3c5d-4a79-a253-28aeb91da196 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:08.968304 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a8310294-0344-435b-ab3e-f9df708e7632 tempest-FlavorsV261TestJSON-670004135 tempest-FlavorsV261TestJSON-670004135-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.421223 May 28 04:39:08.969305 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 767/1451] 10.222.0.58 () {62 vars in 1187 bytes} [Sat May 28 04:39:08 2022] POST /compute/v2.1/flavors => generated 468 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 04:39:08.978693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-144d654c-3c5d-4a79-a253-28aeb91da196 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:08.978693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-144d654c-3c5d-4a79-a253-28aeb91da196 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:08.978693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-144d654c-3c5d-4a79-a253-28aeb91da196 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:08.978693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-144d654c-3c5d-4a79-a253-28aeb91da196 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:09.198319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=26 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:09.205142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5334d96a-ead3-4b8f-ae6f-030d0a11c010 tempest-FlavorsV261TestJSON-2071058245 tempest-FlavorsV261TestJSON-2071058245-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:09.224863 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5334d96a-ead3-4b8f-ae6f-030d0a11c010 tempest-FlavorsV261TestJSON-2071058245 tempest-FlavorsV261TestJSON-2071058245-project] 10.222.0.58 "GET /compute/v2.1/flavors/1802285224" status: 200 len: 468 microversion: 2.61 time: 0.243829 May 28 04:39:09.225047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-144d654c-3c5d-4a79-a253-28aeb91da196 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:09.231766 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 768/1452] 10.222.0.58 () {60 vars in 1198 bytes} [Sat May 28 04:39:08 2022] GET /compute/v2.1/flavors/1802285224 => generated 468 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:39:09.237707 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-144d654c-3c5d-4a79-a253-28aeb91da196 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726" status: 200 len: 1316 microversion: 2.1 time: 0.297474 May 28 04:39:09.238950 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 685/1453] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:08 2022] GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:09.239544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f667af4a-3b6f-409b-9fce-82fcbcb9d74d tempest-FlavorsV261TestJSON-670004135 tempest-FlavorsV261TestJSON-670004135-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:09.242399 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:39:09.242399 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:39:09.353679 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f667af4a-3b6f-409b-9fce-82fcbcb9d74d tempest-FlavorsV261TestJSON-670004135 tempest-FlavorsV261TestJSON-670004135-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/1802285224" status: 200 len: 469 microversion: 2.61 time: 0.119246 May 28 04:39:09.354896 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 769/1454] 10.222.0.58 () {62 vars in 1218 bytes} [Sat May 28 04:39:09 2022] PUT /compute/v2.1/flavors/1802285224 => generated 469 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 04:39:09.367590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b26d43f7-86a8-4367-937e-454db1373542 tempest-FlavorsV261TestJSON-2071058245 tempest-FlavorsV261TestJSON-2071058245-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:09.394740 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b26d43f7-86a8-4367-937e-454db1373542 tempest-FlavorsV261TestJSON-2071058245 tempest-FlavorsV261TestJSON-2071058245-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.032055 May 28 04:39:09.396035 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 686/1455] 10.222.0.58 () {60 vars in 1186 bytes} [Sat May 28 04:39:09 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:39:09.412320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6b53f074-4952-406e-ab17-0c972b2a678e tempest-FlavorsV261TestJSON-2071058245 tempest-FlavorsV261TestJSON-2071058245-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:09.454922 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6b53f074-4952-406e-ab17-0c972b2a678e tempest-FlavorsV261TestJSON-2071058245 tempest-FlavorsV261TestJSON-2071058245-project] 10.222.0.58 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.044262 May 28 04:39:09.455513 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 770/1456] 10.222.0.58 () {60 vars in 1165 bytes} [Sat May 28 04:39:09 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:39:09.469237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fb4b057e-80ea-44a4-a8dc-3fd156ed40e3 tempest-FlavorsV261TestJSON-670004135 tempest-FlavorsV261TestJSON-670004135-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:09.470539 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:39:09.470539 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:39:09.638254 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fb4b057e-80ea-44a4-a8dc-3fd156ed40e3 tempest-FlavorsV261TestJSON-670004135 tempest-FlavorsV261TestJSON-670004135-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1802285224" status: 202 len: 0 microversion: 2.61 time: 0.172081 May 28 04:39:09.645677 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 687/1457] 10.222.0.58 () {60 vars in 1201 bytes} [Sat May 28 04:39:09 2022] DELETE /compute/v2.1/flavors/1802285224 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 04:39:09.650187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2deb886c-e843-4a44-8995-a065ac5b2bfe tempest-FlavorsV261TestJSON-670004135 tempest-FlavorsV261TestJSON-670004135-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:09.654527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:09.677204 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2deb886c-e843-4a44-8995-a065ac5b2bfe tempest-FlavorsV261TestJSON-670004135 tempest-FlavorsV261TestJSON-670004135-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.030243 May 28 04:39:09.678359 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 771/1458] 10.222.0.58 () {60 vars in 1186 bytes} [Sat May 28 04:39:09 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:39:09.954400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-33463f25-233d-4d8a-b729-460f8a88d40b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:09.955009 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-33463f25-233d-4d8a-b729-460f8a88d40b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:09.961491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33463f25-233d-4d8a-b729-460f8a88d40b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:09.961949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33463f25-233d-4d8a-b729-460f8a88d40b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:09.962739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33463f25-233d-4d8a-b729-460f8a88d40b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:09.963213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33463f25-233d-4d8a-b729-460f8a88d40b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:09.968052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:10.255348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6c5262f5-bf88-4a4a-bbaa-ad71b27dae84 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:10.256476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6c5262f5-bf88-4a4a-bbaa-ad71b27dae84 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:10.262047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-33463f25-233d-4d8a-b729-460f8a88d40b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:10.267362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c5262f5-bf88-4a4a-bbaa-ad71b27dae84 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:10.268578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c5262f5-bf88-4a4a-bbaa-ad71b27dae84 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:10.271291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c5262f5-bf88-4a4a-bbaa-ad71b27dae84 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:10.272947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c5262f5-bf88-4a4a-bbaa-ad71b27dae84 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:10.278949 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-33463f25-233d-4d8a-b729-460f8a88d40b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1471 microversion: 2.1 time: 0.328138 May 28 04:39:10.289735 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 688/1459] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:09 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1471 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:10.539100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6c5262f5-bf88-4a4a-bbaa-ad71b27dae84 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:10.551209 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6c5262f5-bf88-4a4a-bbaa-ad71b27dae84 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726" status: 200 len: 1316 microversion: 2.1 time: 0.300424 May 28 04:39:10.564387 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 772/1460] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:10 2022] GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726 => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:39:11.303488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-431c42c2-9b93-4740-9358-efc8b596d35d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:11.304102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-431c42c2-9b93-4740-9358-efc8b596d35d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:11.312392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-431c42c2-9b93-4740-9358-efc8b596d35d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:11.312392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-431c42c2-9b93-4740-9358-efc8b596d35d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:11.313144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-431c42c2-9b93-4740-9358-efc8b596d35d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:11.313587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-431c42c2-9b93-4740-9358-efc8b596d35d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:11.492406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-431c42c2-9b93-4740-9358-efc8b596d35d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:11.500489 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-431c42c2-9b93-4740-9358-efc8b596d35d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1471 microversion: 2.1 time: 0.200889 May 28 04:39:11.501087 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 689/1461] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:11 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1471 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:11.571835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8c5d0180-0b0d-4d81-b175-9a5f0ff71734 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:11.573179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8c5d0180-0b0d-4d81-b175-9a5f0ff71734 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:11.581442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8c5d0180-0b0d-4d81-b175-9a5f0ff71734 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:11.582145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8c5d0180-0b0d-4d81-b175-9a5f0ff71734 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:11.583451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8c5d0180-0b0d-4d81-b175-9a5f0ff71734 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:11.584139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8c5d0180-0b0d-4d81-b175-9a5f0ff71734 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:11.647446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:11.812139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8c5d0180-0b0d-4d81-b175-9a5f0ff71734 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:11.821598 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8c5d0180-0b0d-4d81-b175-9a5f0ff71734 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726" status: 200 len: 1466 microversion: 2.1 time: 0.255890 May 28 04:39:11.822746 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 773/1462] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:11 2022] GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726 => generated 1466 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:11.839334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-89bd8455-22a1-4a6f-a32e-a32c1a2ce908 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:11.840382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-89bd8455-22a1-4a6f-a32e-a32c1a2ce908 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:11.847922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-89bd8455-22a1-4a6f-a32e-a32c1a2ce908 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:11.848572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-89bd8455-22a1-4a6f-a32e-a32c1a2ce908 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:11.849583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-89bd8455-22a1-4a6f-a32e-a32c1a2ce908 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:11.850182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-89bd8455-22a1-4a6f-a32e-a32c1a2ce908 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:12.041609 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-89bd8455-22a1-4a6f-a32e-a32c1a2ce908 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726" status: 200 len: 1617 microversion: 2.1 time: 0.205535 May 28 04:39:12.056261 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 690/1463] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:11 2022] GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726 => generated 1617 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:12.194867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a5687b8b-4736-4048-afc5-6419fb97bf71 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-113020012", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["7015ae59-a219-4897-97c4-ba6ead622287"]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:12.272891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-a5687b8b-4736-4048-afc5-6419fb97bf71 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:39:12.519013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a2ba04cd-aa66-4a6f-8488-7e4225ca0d6e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:12.520281 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a2ba04cd-aa66-4a6f-8488-7e4225ca0d6e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:12.530884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2ba04cd-aa66-4a6f-8488-7e4225ca0d6e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:12.533758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2ba04cd-aa66-4a6f-8488-7e4225ca0d6e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:12.536217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2ba04cd-aa66-4a6f-8488-7e4225ca0d6e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:12.538324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2ba04cd-aa66-4a6f-8488-7e4225ca0d6e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:12.571700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a5687b8b-4736-4048-afc5-6419fb97bf71 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:39:12.572246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a5687b8b-4736-4048-afc5-6419fb97bf71 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:39:12.572779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a5687b8b-4736-4048-afc5-6419fb97bf71 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:39:12.573175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a5687b8b-4736-4048-afc5-6419fb97bf71 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:39:12.573778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a5687b8b-4736-4048-afc5-6419fb97bf71 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:39:12.587935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5687b8b-4736-4048-afc5-6419fb97bf71 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:12.588615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5687b8b-4736-4048-afc5-6419fb97bf71 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:12.589639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5687b8b-4736-4048-afc5-6419fb97bf71 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:12.590388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5687b8b-4736-4048-afc5-6419fb97bf71 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:12.628901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-a5687b8b-4736-4048-afc5-6419fb97bf71 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for project e7a5b721a538475cbac9c95c61647753. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:39:12.644905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-a5687b8b-4736-4048-afc5-6419fb97bf71 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for user d398d45627fc4d33bc9a736ddf8f9215 and project e7a5b721a538475cbac9c95c61647753. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:39:12.674112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a5687b8b-4736-4048-afc5-6419fb97bf71 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:39:12.687070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a5687b8b-4736-4048-afc5-6419fb97bf71 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:39:12.915292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a2ba04cd-aa66-4a6f-8488-7e4225ca0d6e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:12.925961 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a2ba04cd-aa66-4a6f-8488-7e4225ca0d6e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1471 microversion: 2.1 time: 0.411122 May 28 04:39:12.926664 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 691/1464] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:12 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1471 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:12.953044 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a5687b8b-4736-4048-afc5-6419fb97bf71 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762430 May 28 04:39:12.958645 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 774/1465] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:39:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:39:12.966636 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-87a57fe9-db25-4404-ad12-9a001055316d tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:12.968051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-87a57fe9-db25-4404-ad12-9a001055316d tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:13.082156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-87a57fe9-db25-4404-ad12-9a001055316d tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:13.094625 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-87a57fe9-db25-4404-ad12-9a001055316d tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1216 microversion: 2.1 time: 0.134425 May 28 04:39:13.095307 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 692/1466] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:12 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1216 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:13.947301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ebb6c5bc-018b-4f20-927a-1a3dda253509 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:13.947948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ebb6c5bc-018b-4f20-927a-1a3dda253509 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:13.971118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ebb6c5bc-018b-4f20-927a-1a3dda253509 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:13.971589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ebb6c5bc-018b-4f20-927a-1a3dda253509 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:13.973545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ebb6c5bc-018b-4f20-927a-1a3dda253509 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:13.976751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ebb6c5bc-018b-4f20-927a-1a3dda253509 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:14.111291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5b7795dd-d601-4539-abf4-d93323840f53 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:14.111919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5b7795dd-d601-4539-abf4-d93323840f53 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:14.243358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5b7795dd-d601-4539-abf4-d93323840f53 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:14.253064 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5b7795dd-d601-4539-abf4-d93323840f53 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1216 microversion: 2.1 time: 0.145985 May 28 04:39:14.257243 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 693/1467] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:14 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1216 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:14.441615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ebb6c5bc-018b-4f20-927a-1a3dda253509 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:14.453592 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ebb6c5bc-018b-4f20-927a-1a3dda253509 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1471 microversion: 2.1 time: 0.513602 May 28 04:39:14.456145 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 775/1468] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:13 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1471 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:15.274597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c2c1425a-aaf7-40fc-b34b-52b27c7eecdc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:15.280562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c2c1425a-aaf7-40fc-b34b-52b27c7eecdc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:15.290328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c2c1425a-aaf7-40fc-b34b-52b27c7eecdc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:15.290785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c2c1425a-aaf7-40fc-b34b-52b27c7eecdc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:15.296064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c2c1425a-aaf7-40fc-b34b-52b27c7eecdc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:15.296720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c2c1425a-aaf7-40fc-b34b-52b27c7eecdc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:15.463023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c2c1425a-aaf7-40fc-b34b-52b27c7eecdc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:15.473012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b71a7f5d-d954-44ed-b504-d436b0a37ac0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:15.473690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b71a7f5d-d954-44ed-b504-d436b0a37ac0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:15.489523 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c2c1425a-aaf7-40fc-b34b-52b27c7eecdc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1268 microversion: 2.1 time: 0.219084 May 28 04:39:15.490159 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 694/1469] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:15 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1268 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:15.501876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b71a7f5d-d954-44ed-b504-d436b0a37ac0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:15.502606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b71a7f5d-d954-44ed-b504-d436b0a37ac0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:15.505973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b71a7f5d-d954-44ed-b504-d436b0a37ac0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:15.506632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b71a7f5d-d954-44ed-b504-d436b0a37ac0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:15.817117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b71a7f5d-d954-44ed-b504-d436b0a37ac0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:15.830621 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b71a7f5d-d954-44ed-b504-d436b0a37ac0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1476 microversion: 2.1 time: 0.360510 May 28 04:39:15.833214 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 776/1470] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:15 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1476 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:39:16.507282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-88527940-9335-40c6-93ba-d01fb5f45717 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:16.507897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-88527940-9335-40c6-93ba-d01fb5f45717 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:16.519513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88527940-9335-40c6-93ba-d01fb5f45717 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:16.519983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88527940-9335-40c6-93ba-d01fb5f45717 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:16.520793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88527940-9335-40c6-93ba-d01fb5f45717 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:16.521262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88527940-9335-40c6-93ba-d01fb5f45717 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:16.677288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-88527940-9335-40c6-93ba-d01fb5f45717 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:16.689969 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-88527940-9335-40c6-93ba-d01fb5f45717 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1286 microversion: 2.1 time: 0.183778 May 28 04:39:16.689969 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 695/1471] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:16 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1286 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:16.851509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-846f2ba5-d94a-48b2-8780-f2743a1e025a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:16.853109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-846f2ba5-d94a-48b2-8780-f2743a1e025a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:16.860868 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-846f2ba5-d94a-48b2-8780-f2743a1e025a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:16.861663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-846f2ba5-d94a-48b2-8780-f2743a1e025a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:16.863516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-846f2ba5-d94a-48b2-8780-f2743a1e025a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:16.864183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-846f2ba5-d94a-48b2-8780-f2743a1e025a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:17.020127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b718c37c-2097-4e00-a341-b5b67a35ed0e tempest-NetworksTest-1572889218 tempest-NetworksTest-1572889218-project-admin] Calling method '.version_select at 0x7f77073ae4c0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:17.290733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-846f2ba5-d94a-48b2-8780-f2743a1e025a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:17.309079 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-846f2ba5-d94a-48b2-8780-f2743a1e025a tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1476 microversion: 2.1 time: 0.454043 May 28 04:39:17.317423 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 696/1472] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:16 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1476 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:17.336376 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b718c37c-2097-4e00-a341-b5b67a35ed0e tempest-NetworksTest-1572889218 tempest-NetworksTest-1572889218-project-admin] 10.222.0.58 "GET /compute/v2.1/os-networks" status: 200 len: 6724 microversion: 2.1 time: 0.604572 May 28 04:39:17.336376 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 777/1473] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:39:16 2022] GET /compute/v2.1/os-networks => generated 6724 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:17.343754 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ecbeb533-12fd-4e3e-9e31-f11a21eb55be tempest-NetworksTest-1572889218 tempest-NetworksTest-1572889218-project-admin] Calling method '.version_select at 0x7f7701a809d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:17.476765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-057efb80-2bb4-4f8d-8514-f0649b17e0e1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1173296191", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "68123182-7714-4432-8648-5b70eb3b9ead"}], "block_device_mapping_v2": [{"uuid": "27072b66-85ec-4ba7-a231-a30254073fb4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:17.516845 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ecbeb533-12fd-4e3e-9e31-f11a21eb55be tempest-NetworksTest-1572889218 tempest-NetworksTest-1572889218-project-admin] 10.222.0.58 "GET /compute/v2.1/os-networks/edf1485f-0c2a-463d-b852-0c8f29141a31" status: 200 len: 652 microversion: 2.1 time: 0.177428 May 28 04:39:17.527365 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 697/1474] 10.222.0.58 () {58 vars in 1247 bytes} [Sat May 28 04:39:17 2022] GET /compute/v2.1/os-networks/edf1485f-0c2a-463d-b852-0c8f29141a31 => generated 652 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:17.527998 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8a0bb6d2-4f6c-4fe6-9a76-6991620e21a7 tempest-NetworksTest-1572889218 tempest-NetworksTest-1572889218-project-admin] Calling method '.version_select at 0x7f7701ca61f0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:17.620721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-057efb80-2bb4-4f8d-8514-f0649b17e0e1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] validate_networks() for [('68123182-7714-4432-8648-5b70eb3b9ead', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:39:17.748331 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8a0bb6d2-4f6c-4fe6-9a76-6991620e21a7 tempest-NetworksTest-1572889218 tempest-NetworksTest-1572889218-project-admin] 10.222.0.58 "GET /compute/v2.1/os-networks" status: 200 len: 6724 microversion: 2.1 time: 0.225150 May 28 04:39:17.748943 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 698/1475] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:39:17 2022] GET /compute/v2.1/os-networks => generated 6724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:39:17.753599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-30ff0a1d-7bea-419b-ac53-75a6a7f8d173 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:17.760068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-30ff0a1d-7bea-419b-ac53-75a6a7f8d173 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80e2e341401649898ed5a366da7e24e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811638c702ad48ac81d203aeac82dcee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:17.760766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-30ff0a1d-7bea-419b-ac53-75a6a7f8d173 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Searching by: {'deleted': False, 'project_id': '811638c702ad48ac81d203aeac82dcee'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:39:17.781478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-30ff0a1d-7bea-419b-ac53-75a6a7f8d173 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:17.781941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-30ff0a1d-7bea-419b-ac53-75a6a7f8d173 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:17.782764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-30ff0a1d-7bea-419b-ac53-75a6a7f8d173 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:17.783477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-30ff0a1d-7bea-419b-ac53-75a6a7f8d173 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:17.831846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-30ff0a1d-7bea-419b-ac53-75a6a7f8d173 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:39:17.897124 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-30ff0a1d-7bea-419b-ac53-75a6a7f8d173 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.147083 May 28 04:39:17.907313 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 699/1476] 10.222.0.58 () {58 vars in 1124 bytes} [Sat May 28 04:39:17 2022] GET /compute/v2.1/servers => generated 334 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:17.913134 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-05ae1084-de93-4332-8397-673aae9ea62c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:17.913778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-05ae1084-de93-4332-8397-673aae9ea62c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:17.934745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-05ae1084-de93-4332-8397-673aae9ea62c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:17.935245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-05ae1084-de93-4332-8397-673aae9ea62c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:17.936048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-05ae1084-de93-4332-8397-673aae9ea62c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:17.936493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-05ae1084-de93-4332-8397-673aae9ea62c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:18.527724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-05ae1084-de93-4332-8397-673aae9ea62c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:18.551955 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-05ae1084-de93-4332-8397-673aae9ea62c tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1316 microversion: 2.1 time: 0.643220 May 28 04:39:18.554936 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 700/1477] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:17 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1316 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:18.557174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ecf482d8-502d-4684-a656-8344c57db72a tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:18.564952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ecf482d8-502d-4684-a656-8344c57db72a tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80e2e341401649898ed5a366da7e24e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811638c702ad48ac81d203aeac82dcee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:18.565746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ecf482d8-502d-4684-a656-8344c57db72a tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Searching by: {'deleted': False, 'project_id': '811638c702ad48ac81d203aeac82dcee'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:39:18.571312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecf482d8-502d-4684-a656-8344c57db72a tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:18.572044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecf482d8-502d-4684-a656-8344c57db72a tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:18.573045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecf482d8-502d-4684-a656-8344c57db72a tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:18.573678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecf482d8-502d-4684-a656-8344c57db72a tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:18.712911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-ecf482d8-502d-4684-a656-8344c57db72a tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:39:18.790477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-057efb80-2bb4-4f8d-8514-f0649b17e0e1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:39:18.790477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-057efb80-2bb4-4f8d-8514-f0649b17e0e1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:39:18.790477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-057efb80-2bb4-4f8d-8514-f0649b17e0e1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:39:18.790477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-057efb80-2bb4-4f8d-8514-f0649b17e0e1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:39:18.790477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-057efb80-2bb4-4f8d-8514-f0649b17e0e1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:39:18.808861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-057efb80-2bb4-4f8d-8514-f0649b17e0e1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:18.813587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-057efb80-2bb4-4f8d-8514-f0649b17e0e1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:18.816297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-057efb80-2bb4-4f8d-8514-f0649b17e0e1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:18.825384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-057efb80-2bb4-4f8d-8514-f0649b17e0e1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:18.865818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-057efb80-2bb4-4f8d-8514-f0649b17e0e1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Getting quotas for project d908671a46484d2082cc88a1d2c93f98. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:39:18.872448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ecf482d8-502d-4684-a656-8344c57db72a tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e2e341401649898ed5a366da7e24e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811638c702ad48ac81d203aeac82dcee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:18.878102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-057efb80-2bb4-4f8d-8514-f0649b17e0e1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Getting quotas for user da8fff3851eb4ecc927400c09117f5ee and project d908671a46484d2082cc88a1d2c93f98. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:39:18.888176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecf482d8-502d-4684-a656-8344c57db72a tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:18.888640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecf482d8-502d-4684-a656-8344c57db72a tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:19.050838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-057efb80-2bb4-4f8d-8514-f0649b17e0e1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:39:19.053387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-057efb80-2bb4-4f8d-8514-f0649b17e0e1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='27072b66-85ec-4ba7-a231-a30254073fb4',volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:39:19.302596 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ecf482d8-502d-4684-a656-8344c57db72a tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 0.748650 May 28 04:39:19.304624 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 701/1478] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:39:18 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:19.317474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4315e19e-2aa7-4947-b42b-1b20a79361ec tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:19.321962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4315e19e-2aa7-4947-b42b-1b20a79361ec tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:19.339179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4315e19e-2aa7-4947-b42b-1b20a79361ec tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:19.343179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4315e19e-2aa7-4947-b42b-1b20a79361ec tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:19.345477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4315e19e-2aa7-4947-b42b-1b20a79361ec tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:19.346551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4315e19e-2aa7-4947-b42b-1b20a79361ec tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:19.609270 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-057efb80-2bb4-4f8d-8514-f0649b17e0e1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.132706 May 28 04:39:19.638220 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 778/1479] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:39:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:39:19.644015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d9c74fcc-6743-4144-939c-ee333f402c9a tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:19.664070 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d9c74fcc-6743-4144-939c-ee333f402c9a tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024619 May 28 04:39:19.670723 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 779/1480] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:39:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:19.684292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-96462ba6-18d3-431b-946f-67fa7d38b848 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:19.684917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-96462ba6-18d3-431b-946f-67fa7d38b848 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:19.705800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96462ba6-18d3-431b-946f-67fa7d38b848 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:19.706263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96462ba6-18d3-431b-946f-67fa7d38b848 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:19.707076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96462ba6-18d3-431b-946f-67fa7d38b848 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:19.707522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96462ba6-18d3-431b-946f-67fa7d38b848 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:19.965896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4315e19e-2aa7-4947-b42b-1b20a79361ec tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:19.984821 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4315e19e-2aa7-4947-b42b-1b20a79361ec tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1476 microversion: 2.1 time: 0.677776 May 28 04:39:19.994437 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 702/1481] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:19 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1476 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:20.007316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1794884b-971f-42f6-8bc8-29149b126e86 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:20.009180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1794884b-971f-42f6-8bc8-29149b126e86 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:20.131430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-96462ba6-18d3-431b-946f-67fa7d38b848 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:20.146970 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-96462ba6-18d3-431b-946f-67fa7d38b848 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1316 microversion: 2.1 time: 0.463419 May 28 04:39:20.157990 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 780/1482] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:19 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1316 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:20.161962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1794884b-971f-42f6-8bc8-29149b126e86 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:20.177151 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1794884b-971f-42f6-8bc8-29149b126e86 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1053 microversion: 2.1 time: 0.189664 May 28 04:39:20.177999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3d721706-0405-46b7-b4ce-b08258e058eb tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:20.178257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3d721706-0405-46b7-b4ce-b08258e058eb tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:20.184651 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 703/1483] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:19 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1053 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:20.197730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d721706-0405-46b7-b4ce-b08258e058eb tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:20.198447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d721706-0405-46b7-b4ce-b08258e058eb tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:20.200346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d721706-0405-46b7-b4ce-b08258e058eb tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:20.200989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d721706-0405-46b7-b4ce-b08258e058eb tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:20.249985 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3d721706-0405-46b7-b4ce-b08258e058eb tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:39:20.685689 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3d721706-0405-46b7-b4ce-b08258e058eb tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892" status: 204 len: 0 microversion: 2.1 time: 0.502791 May 28 04:39:20.686542 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 781/1484] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:39:20 2022] DELETE /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:39:20.688046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6e00cf85-13b7-43d8-85de-8bd6748d51be tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:20.688673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6e00cf85-13b7-43d8-85de-8bd6748d51be tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:20.704879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6e00cf85-13b7-43d8-85de-8bd6748d51be tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:20.706439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6e00cf85-13b7-43d8-85de-8bd6748d51be tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:20.707520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6e00cf85-13b7-43d8-85de-8bd6748d51be tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:20.708583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6e00cf85-13b7-43d8-85de-8bd6748d51be tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:20.779885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-ceda1fb1-dae3-46be-b966-21ef48586a9f req-9efad551-a893-4f9b-85e6-1b62da713ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ffc58d-f5a5-4f93-aac8-6348d9d576ba", "tag": "0a34d596-0c1e-4988-a19f-7e0e80837d92"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:20.796572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ceda1fb1-dae3-46be-b966-21ef48586a9f req-9efad551-a893-4f9b-85e6-1b62da713ddb service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:20.799371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ceda1fb1-dae3-46be-b966-21ef48586a9f req-9efad551-a893-4f9b-85e6-1b62da713ddb service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:20.826097 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-ceda1fb1-dae3-46be-b966-21ef48586a9f req-9efad551-a893-4f9b-85e6-1b62da713ddb service nova] Creating event network-changed:0a34d596-0c1e-4988-a19f-7e0e80837d92 for instance 23ffc58d-f5a5-4f93-aac8-6348d9d576ba on n-h1-843700-1 May 28 04:39:20.841839 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-ceda1fb1-dae3-46be-b966-21ef48586a9f req-9efad551-a893-4f9b-85e6-1b62da713ddb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066317 May 28 04:39:20.842588 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 782/1485] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:39:21.003420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-546dc34e-0132-40e9-8f91-ffec61d13ebf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:21.006010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-546dc34e-0132-40e9-8f91-ffec61d13ebf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:21.019022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-546dc34e-0132-40e9-8f91-ffec61d13ebf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:21.019946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-546dc34e-0132-40e9-8f91-ffec61d13ebf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:21.021582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-546dc34e-0132-40e9-8f91-ffec61d13ebf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:21.023371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-546dc34e-0132-40e9-8f91-ffec61d13ebf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:21.030911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6e00cf85-13b7-43d8-85de-8bd6748d51be tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e2e341401649898ed5a366da7e24e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811638c702ad48ac81d203aeac82dcee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:21.040403 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6e00cf85-13b7-43d8-85de-8bd6748d51be tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892" status: 200 len: 1702 microversion: 2.1 time: 0.358464 May 28 04:39:21.042826 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 704/1486] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:20 2022] GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892 => generated 1702 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:21.164777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cf148f16-1cf5-4fcf-9ae5-f999ab17fcc7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:21.165895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cf148f16-1cf5-4fcf-9ae5-f999ab17fcc7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:21.178279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf148f16-1cf5-4fcf-9ae5-f999ab17fcc7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:21.179087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf148f16-1cf5-4fcf-9ae5-f999ab17fcc7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:21.190694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf148f16-1cf5-4fcf-9ae5-f999ab17fcc7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:21.191555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf148f16-1cf5-4fcf-9ae5-f999ab17fcc7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:21.451750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-546dc34e-0132-40e9-8f91-ffec61d13ebf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:21.464183 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-546dc34e-0132-40e9-8f91-ffec61d13ebf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1476 microversion: 2.1 time: 0.464917 May 28 04:39:21.464784 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 783/1487] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:20 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1476 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:21.474194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f6e52ddb-69e9-4efb-b2dc-bbaf6e1a8853 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:21.474822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f6e52ddb-69e9-4efb-b2dc-bbaf6e1a8853 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:21.486518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6e52ddb-69e9-4efb-b2dc-bbaf6e1a8853 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:21.491321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6e52ddb-69e9-4efb-b2dc-bbaf6e1a8853 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:21.492372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6e52ddb-69e9-4efb-b2dc-bbaf6e1a8853 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:21.493326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6e52ddb-69e9-4efb-b2dc-bbaf6e1a8853 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:21.494013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cf148f16-1cf5-4fcf-9ae5-f999ab17fcc7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:21.503654 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cf148f16-1cf5-4fcf-9ae5-f999ab17fcc7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1316 microversion: 2.1 time: 0.342993 May 28 04:39:21.504259 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 705/1488] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:21 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:21.595753 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f6e52ddb-69e9-4efb-b2dc-bbaf6e1a8853 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:21.609984 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f6e52ddb-69e9-4efb-b2dc-bbaf6e1a8853 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1095 microversion: 2.1 time: 0.143764 May 28 04:39:21.611129 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 784/1489] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:21 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1095 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:22.058505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-238de59f-4aa9-4965-ae98-70ae18b7de4f tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:22.059893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-238de59f-4aa9-4965-ae98-70ae18b7de4f tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:22.074000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-238de59f-4aa9-4965-ae98-70ae18b7de4f tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:22.074465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-238de59f-4aa9-4965-ae98-70ae18b7de4f tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:22.075320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-238de59f-4aa9-4965-ae98-70ae18b7de4f tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:22.075768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-238de59f-4aa9-4965-ae98-70ae18b7de4f tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:22.483118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-83b0b771-ebb4-4432-b9d4-2c68cb0dcd12 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:22.484038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-83b0b771-ebb4-4432-b9d4-2c68cb0dcd12 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:22.503263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83b0b771-ebb4-4432-b9d4-2c68cb0dcd12 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:22.504031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83b0b771-ebb4-4432-b9d4-2c68cb0dcd12 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:22.505208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83b0b771-ebb4-4432-b9d4-2c68cb0dcd12 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:22.505877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83b0b771-ebb4-4432-b9d4-2c68cb0dcd12 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:23.142227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-238de59f-4aa9-4965-ae98-70ae18b7de4f tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e2e341401649898ed5a366da7e24e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811638c702ad48ac81d203aeac82dcee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:23.152888 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-238de59f-4aa9-4965-ae98-70ae18b7de4f tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892" status: 200 len: 1702 microversion: 2.1 time: 1.098645 May 28 04:39:23.156588 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 706/1490] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:22 2022] GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892 => generated 1702 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:23.172534 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8d90390c-4e1d-448a-a350-f18cb965d043 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:23.175166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8d90390c-4e1d-448a-a350-f18cb965d043 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:23.190971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d90390c-4e1d-448a-a350-f18cb965d043 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:23.191470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d90390c-4e1d-448a-a350-f18cb965d043 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:23.201345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d90390c-4e1d-448a-a350-f18cb965d043 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:23.202043 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d90390c-4e1d-448a-a350-f18cb965d043 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:23.463026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-83b0b771-ebb4-4432-b9d4-2c68cb0dcd12 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:23.471575 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-83b0b771-ebb4-4432-b9d4-2c68cb0dcd12 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1476 microversion: 2.1 time: 0.993743 May 28 04:39:23.476394 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 785/1491] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:22 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1476 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:39:23.484702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-903a13dc-95f1-49b5-8ac0-5f8bbfc4d23d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:23.487454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-903a13dc-95f1-49b5-8ac0-5f8bbfc4d23d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:23.503509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-903a13dc-95f1-49b5-8ac0-5f8bbfc4d23d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:23.504002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-903a13dc-95f1-49b5-8ac0-5f8bbfc4d23d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:23.505564 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-903a13dc-95f1-49b5-8ac0-5f8bbfc4d23d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:23.506659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-903a13dc-95f1-49b5-8ac0-5f8bbfc4d23d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:23.655007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-903a13dc-95f1-49b5-8ac0-5f8bbfc4d23d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:23.663945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8d90390c-4e1d-448a-a350-f18cb965d043 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:23.676036 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8d90390c-4e1d-448a-a350-f18cb965d043 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1316 microversion: 2.1 time: 0.516351 May 28 04:39:23.677364 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 707/1492] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:23 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1316 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:23.689240 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-903a13dc-95f1-49b5-8ac0-5f8bbfc4d23d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1169 microversion: 2.1 time: 0.211548 May 28 04:39:23.699146 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 786/1493] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:23 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1169 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:24.175584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1e43a879-540a-422b-9c39-904ebcf1327e tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:24.175584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1e43a879-540a-422b-9c39-904ebcf1327e tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:24.180983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e43a879-540a-422b-9c39-904ebcf1327e tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:24.181636 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e43a879-540a-422b-9c39-904ebcf1327e tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:24.182574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e43a879-540a-422b-9c39-904ebcf1327e tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:24.183212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e43a879-540a-422b-9c39-904ebcf1327e tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:24.450840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1e43a879-540a-422b-9c39-904ebcf1327e tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e2e341401649898ed5a366da7e24e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811638c702ad48ac81d203aeac82dcee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:24.455886 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:24.463363 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1e43a879-540a-422b-9c39-904ebcf1327e tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892" status: 200 len: 1702 microversion: 2.1 time: 0.293553 May 28 04:39:24.464716 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 708/1494] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:24 2022] GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892 => generated 1702 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:24.494550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9a871bbb-bd32-45a4-9012-cbeb6fa3f48e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:24.495966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9a871bbb-bd32-45a4-9012-cbeb6fa3f48e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:24.504374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a871bbb-bd32-45a4-9012-cbeb6fa3f48e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:24.505234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a871bbb-bd32-45a4-9012-cbeb6fa3f48e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:24.506479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a871bbb-bd32-45a4-9012-cbeb6fa3f48e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:24.513710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a871bbb-bd32-45a4-9012-cbeb6fa3f48e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:24.694345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-23fd3e24-91e9-43a5-9837-ff6207ed492a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:24.694900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-23fd3e24-91e9-43a5-9837-ff6207ed492a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:24.706659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23fd3e24-91e9-43a5-9837-ff6207ed492a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:24.708084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9a871bbb-bd32-45a4-9012-cbeb6fa3f48e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:24.708788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23fd3e24-91e9-43a5-9837-ff6207ed492a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:24.709788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23fd3e24-91e9-43a5-9837-ff6207ed492a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:24.712369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23fd3e24-91e9-43a5-9837-ff6207ed492a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:24.723252 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9a871bbb-bd32-45a4-9012-cbeb6fa3f48e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1476 microversion: 2.1 time: 0.233390 May 28 04:39:24.735768 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 787/1495] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:24 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1476 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:24.748855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c9675523-dc7a-44be-87fd-82c821f940e6 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:24.750359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c9675523-dc7a-44be-87fd-82c821f940e6 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:24.769167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9675523-dc7a-44be-87fd-82c821f940e6 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:24.770908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9675523-dc7a-44be-87fd-82c821f940e6 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:24.771850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9675523-dc7a-44be-87fd-82c821f940e6 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:24.774682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9675523-dc7a-44be-87fd-82c821f940e6 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:24.898673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c9675523-dc7a-44be-87fd-82c821f940e6 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:24.913313 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c9675523-dc7a-44be-87fd-82c821f940e6 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1169 microversion: 2.1 time: 0.176110 May 28 04:39:24.920601 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 788/1496] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:24 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1169 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:24.982619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-23fd3e24-91e9-43a5-9837-ff6207ed492a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:24.995810 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-23fd3e24-91e9-43a5-9837-ff6207ed492a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1316 microversion: 2.1 time: 0.305387 May 28 04:39:24.996441 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 709/1497] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:24 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1316 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:39:25.131772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fc2ad6a8-ebd5-4674-b7fc-241019db9f89 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:25.132394 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fc2ad6a8-ebd5-4674-b7fc-241019db9f89 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:25.142281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc2ad6a8-ebd5-4674-b7fc-241019db9f89 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:25.143034 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc2ad6a8-ebd5-4674-b7fc-241019db9f89 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:25.143986 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc2ad6a8-ebd5-4674-b7fc-241019db9f89 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:25.144575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc2ad6a8-ebd5-4674-b7fc-241019db9f89 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:25.336518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-fc2ad6a8-ebd5-4674-b7fc-241019db9f89 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lazy-loading 'services' on Instance uuid 315db9ca-6acb-462a-a538-1b888d62e083 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:39:25.351835 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fc2ad6a8-ebd5-4674-b7fc-241019db9f89 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 2127 microversion: 2.25 time: 0.223867 May 28 04:39:25.354373 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 789/1498] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:39:25 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 2127 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:39:25.373869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ce92078c-ef23-4db7-9062-8dec9e39ba46 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843700-1", "block_migration": "auto"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:25.375944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ce92078c-ef23-4db7-9062-8dec9e39ba46 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:25.384381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce92078c-ef23-4db7-9062-8dec9e39ba46 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:25.385117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce92078c-ef23-4db7-9062-8dec9e39ba46 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:25.386274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce92078c-ef23-4db7-9062-8dec9e39ba46 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:25.386881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce92078c-ef23-4db7-9062-8dec9e39ba46 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:25.417531 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-ce92078c-ef23-4db7-9062-8dec9e39ba46 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lazy-loading 'flavor' on Instance uuid 315db9ca-6acb-462a-a538-1b888d62e083 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:39:25.431633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ce92078c-ef23-4db7-9062-8dec9e39ba46 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Going to try to live migrate instance to n-h1-843700-1 {{(pid=126043) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 28 04:39:25.481322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3966f0b2-7b73-4901-aedb-d7f364640012 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:25.482774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3966f0b2-7b73-4901-aedb-d7f364640012 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:25.491632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3966f0b2-7b73-4901-aedb-d7f364640012 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:25.492403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3966f0b2-7b73-4901-aedb-d7f364640012 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:25.493550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3966f0b2-7b73-4901-aedb-d7f364640012 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:25.494254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3966f0b2-7b73-4901-aedb-d7f364640012 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:25.603553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3966f0b2-7b73-4901-aedb-d7f364640012 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e2e341401649898ed5a366da7e24e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811638c702ad48ac81d203aeac82dcee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:25.613996 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3966f0b2-7b73-4901-aedb-d7f364640012 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892" status: 200 len: 1634 microversion: 2.1 time: 0.136941 May 28 04:39:25.628733 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 790/1499] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:25 2022] GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892 => generated 1634 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:25.742828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d366bf09-9808-45b9-92a8-07b522492c94 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:25.743803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d366bf09-9808-45b9-92a8-07b522492c94 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:25.755074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d366bf09-9808-45b9-92a8-07b522492c94 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:25.758625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d366bf09-9808-45b9-92a8-07b522492c94 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:25.759523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d366bf09-9808-45b9-92a8-07b522492c94 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:25.759977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d366bf09-9808-45b9-92a8-07b522492c94 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:25.952980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d366bf09-9808-45b9-92a8-07b522492c94 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:25.963967 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d366bf09-9808-45b9-92a8-07b522492c94 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1476 microversion: 2.1 time: 0.225740 May 28 04:39:25.968461 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 791/1500] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:25 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1476 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:26.352524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-37d094fa-cfcb-4f8f-82e9-11015d24e813 tempest-SecurityGroupsTestAdminJSON-1725155449 tempest-SecurityGroupsTestAdminJSON-1725155449-project] Action: 'create', calling method: .version_select at 0x7f77073ae430>, body: {"security_group": {"name": "tempest-securitygroup-631770321", "description": "tempest-description-988452109"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:27.149608 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-37d094fa-cfcb-4f8f-82e9-11015d24e813 tempest-SecurityGroupsTestAdminJSON-1725155449 tempest-SecurityGroupsTestAdminJSON-1725155449-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.181484 May 28 04:39:27.152376 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 792/1501] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:39:25 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:27.159579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b40dd484-294d-4a53-8c99-d62a82ee0a51 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:27.160498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b40dd484-294d-4a53-8c99-d62a82ee0a51 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:27.170008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b40dd484-294d-4a53-8c99-d62a82ee0a51 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:27.170576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b40dd484-294d-4a53-8c99-d62a82ee0a51 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:27.172810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b40dd484-294d-4a53-8c99-d62a82ee0a51 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:27.173370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b40dd484-294d-4a53-8c99-d62a82ee0a51 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:27.178755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:27.472581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b40dd484-294d-4a53-8c99-d62a82ee0a51 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:27.481673 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b40dd484-294d-4a53-8c99-d62a82ee0a51 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1211 microversion: 2.1 time: 0.326652 May 28 04:39:27.482690 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 793/1502] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:27 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1211 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:27.488940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-39c91e30-e520-4172-a8d1-51e9a10b67c3 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:27.489865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-39c91e30-e520-4172-a8d1-51e9a10b67c3 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:27.496832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39c91e30-e520-4172-a8d1-51e9a10b67c3 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:27.497769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39c91e30-e520-4172-a8d1-51e9a10b67c3 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:27.498781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39c91e30-e520-4172-a8d1-51e9a10b67c3 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:27.499438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39c91e30-e520-4172-a8d1-51e9a10b67c3 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:27.726432 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-39c91e30-e520-4172-a8d1-51e9a10b67c3 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:27.737131 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-39c91e30-e520-4172-a8d1-51e9a10b67c3 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1316 microversion: 2.1 time: 0.252017 May 28 04:39:27.753146 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 794/1503] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:27 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:27.761504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-adf4bf51-e2a7-4b59-ac48-5b78a9c1713e tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:27.762177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-adf4bf51-e2a7-4b59-ac48-5b78a9c1713e tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:27.768774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-adf4bf51-e2a7-4b59-ac48-5b78a9c1713e tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:27.769328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-adf4bf51-e2a7-4b59-ac48-5b78a9c1713e tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:27.770123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-adf4bf51-e2a7-4b59-ac48-5b78a9c1713e tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:27.770567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-adf4bf51-e2a7-4b59-ac48-5b78a9c1713e tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:27.856748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-adf4bf51-e2a7-4b59-ac48-5b78a9c1713e tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:27.857333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-adf4bf51-e2a7-4b59-ac48-5b78a9c1713e tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:27.857804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-adf4bf51-e2a7-4b59-ac48-5b78a9c1713e tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lazy-loading 'fault' on Instance uuid d08c157a-afe1-41d5-8199-65e1b838d892 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:39:27.956333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-adf4bf51-e2a7-4b59-ac48-5b78a9c1713e tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e2e341401649898ed5a366da7e24e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811638c702ad48ac81d203aeac82dcee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:27.967431 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-adf4bf51-e2a7-4b59-ac48-5b78a9c1713e tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892" status: 200 len: 1360 microversion: 2.1 time: 0.213066 May 28 04:39:27.968263 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 795/1504] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:27 2022] GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892 => generated 1360 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:28.086973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-097a635c-4447-4e29-b2f6-7e2bbff4c9a8 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Action: 'create', calling method: .version_select at 0x7f77073c9670>, body: {"keypair": {"name": "tempest-keypair-57404145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0h4GyzxFIefkTFi3zxoYfXhxzX/XFRWXzIiwam3utQQmgwfKLbfRK77x59FJqPPHbIE22++A17QB6EPoMGWAKRO4LqIMEN6OiXhmmIJH9dC1BLFkW2/FocEl2HMeYhSA=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:28.110715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-097a635c-4447-4e29-b2f6-7e2bbff4c9a8 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Getting quotas for project 01907ddfb9d54b159d84a63586b8338f. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:39:28.122635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-097a635c-4447-4e29-b2f6-7e2bbff4c9a8 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Getting quotas for user 18e3755f97184714b26326adebbe1f17 and project 01907ddfb9d54b159d84a63586b8338f. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:39:28.268624 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-097a635c-4447-4e29-b2f6-7e2bbff4c9a8 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.284656 May 28 04:39:28.269692 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 796/1505] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:39:27 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:28.409208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7d17f3a5-721e-4c03-8eb0-bc7bb60fa20c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Action: 'create', calling method: .version_select at 0x7f7707423ca0>, body: {"keypair": {"name": "tempest-keypair-751070852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWVrKrnaRArC3HAJV7b4+nkwMQF6zF4iOQ8AxW6Ur+nKlWsso0zoYB9PjN/Mi8UAkaekaueFaRyPROCjkQGPsoa5lgFIKFImiFfQkcj5TIM8hG/LTo+khBk/Mj6rBsvbg=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:28.460154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-7d17f3a5-721e-4c03-8eb0-bc7bb60fa20c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Getting quotas for project 30126363eb444c78a459e1beaa9ddce6. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:39:28.484671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-7d17f3a5-721e-4c03-8eb0-bc7bb60fa20c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Getting quotas for user 85f99e2be7184b41acd8481762d85254 and project 30126363eb444c78a459e1beaa9ddce6. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:39:28.491719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:28.604599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:28.667628 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7d17f3a5-721e-4c03-8eb0-bc7bb60fa20c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.396947 May 28 04:39:28.671510 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 797/1506] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:39:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:28.686558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-979e4375-b049-48cd-8dd8-c943f7b9a8ee req-6fa75160-13ee-40d5-a99d-36d63aa2ee58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d08c157a-afe1-41d5-8199-65e1b838d892", "name": "network-vif-deleted", "tag": "e6d43522-ea01-42b0-be39-ee92dd8cd1b2"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:28.737449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-979e4375-b049-48cd-8dd8-c943f7b9a8ee req-6fa75160-13ee-40d5-a99d-36d63aa2ee58 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:28.739271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-979e4375-b049-48cd-8dd8-c943f7b9a8ee req-6fa75160-13ee-40d5-a99d-36d63aa2ee58 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:28.754364 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-979e4375-b049-48cd-8dd8-c943f7b9a8ee req-6fa75160-13ee-40d5-a99d-36d63aa2ee58 service nova] Creating event network-vif-deleted:e6d43522-ea01-42b0-be39-ee92dd8cd1b2 for instance d08c157a-afe1-41d5-8199-65e1b838d892 on n-h1-843700-1 May 28 04:39:28.762743 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-979e4375-b049-48cd-8dd8-c943f7b9a8ee req-6fa75160-13ee-40d5-a99d-36d63aa2ee58 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085108 May 28 04:39:28.765832 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 798/1507] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:28.772731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fd98db82-b718-47df-97f7-6e3bd84226e1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:28.773899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fd98db82-b718-47df-97f7-6e3bd84226e1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:28.802293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd98db82-b718-47df-97f7-6e3bd84226e1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:28.802761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd98db82-b718-47df-97f7-6e3bd84226e1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:28.803580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd98db82-b718-47df-97f7-6e3bd84226e1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:28.806252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd98db82-b718-47df-97f7-6e3bd84226e1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:28.881207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=11 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:29.283162 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ce92078c-ef23-4db7-9062-8dec9e39ba46 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/action" status: 202 len: 0 microversion: 2.25 time: 3.913806 May 28 04:39:29.284913 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 710/1508] 10.222.0.58 () {62 vars in 1318 bytes} [Sat May 28 04:39:25 2022] POST /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/action => generated 0 bytes in 3916 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 04:39:29.290060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-244de68e-8f4b-43a4-a7c1-34412177c3ad tempest-SecurityGroupsTestAdminJSON-1725155449 tempest-SecurityGroupsTestAdminJSON-1725155449-project] Action: 'create', calling method: .version_select at 0x7f7701a91ee0>, body: {"security_group": {"name": "tempest-securitygroup-149846149", "description": "tempest-description-442843497"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:29.299766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fd98db82-b718-47df-97f7-6e3bd84226e1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:29.312331 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fd98db82-b718-47df-97f7-6e3bd84226e1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1476 microversion: 2.1 time: 0.546636 May 28 04:39:29.313913 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 799/1509] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:28 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1476 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:29.322186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-681bd6a6-3ba1-4c77-8a22-fe704c808147 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:29.325750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-681bd6a6-3ba1-4c77-8a22-fe704c808147 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:29.344053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-681bd6a6-3ba1-4c77-8a22-fe704c808147 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:29.345544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-681bd6a6-3ba1-4c77-8a22-fe704c808147 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:29.346546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-681bd6a6-3ba1-4c77-8a22-fe704c808147 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:29.348423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-681bd6a6-3ba1-4c77-8a22-fe704c808147 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:29.777778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-681bd6a6-3ba1-4c77-8a22-fe704c808147 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:29.796192 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-681bd6a6-3ba1-4c77-8a22-fe704c808147 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1211 microversion: 2.1 time: 0.480910 May 28 04:39:29.807153 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 800/1510] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:29 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1211 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:29.818746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-764d7bb4-7752-40db-86dc-1e9ea63dc4e7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:29.820894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-764d7bb4-7752-40db-86dc-1e9ea63dc4e7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:29.828594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-764d7bb4-7752-40db-86dc-1e9ea63dc4e7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:29.829268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-764d7bb4-7752-40db-86dc-1e9ea63dc4e7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:29.830252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-764d7bb4-7752-40db-86dc-1e9ea63dc4e7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:29.830892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-764d7bb4-7752-40db-86dc-1e9ea63dc4e7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:30.016418 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-244de68e-8f4b-43a4-a7c1-34412177c3ad tempest-SecurityGroupsTestAdminJSON-1725155449 tempest-SecurityGroupsTestAdminJSON-1725155449-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.730014 May 28 04:39:30.017040 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 711/1511] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:39:29 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:30.021637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-23663b69-74d2-4d00-a5a2-6e5843f02456 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:30.022494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-23663b69-74d2-4d00-a5a2-6e5843f02456 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] [instance: d08c157a-afe1-41d5-8199-65e1b838d892] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:30.037476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23663b69-74d2-4d00-a5a2-6e5843f02456 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:30.041241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23663b69-74d2-4d00-a5a2-6e5843f02456 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:30.042300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23663b69-74d2-4d00-a5a2-6e5843f02456 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:30.044736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23663b69-74d2-4d00-a5a2-6e5843f02456 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:30.078233 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-23663b69-74d2-4d00-a5a2-6e5843f02456 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] HTTP exception thrown: Instance d08c157a-afe1-41d5-8199-65e1b838d892 could not be found. May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-23663b69-74d2-4d00-a5a2-6e5843f02456 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Request method failure captured: May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892 HTTP/1.1 May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikacq-nSrn43nZ96tSGZEQDWfNf2OM9Ntu9OunxVpbuMXREltMXDZby8f9WW5P1g3JLkAg64c-RbPDOK3CEBvclpkhwXz_QGCbu3IYOo0T0nWqXIP-uETHMvd7fxxGrfGOswoB5MFpABzeeLLfZh7gl31dPzniKVoLQL2IpHYuiw91bk May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 811638c702ad48ac81d203aeac82dcee May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersTestJSON-1129232128 May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:39:30.083474 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:39:30.085279 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_811638c702ad48ac81d203aeac82dcee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/811638c702ad48ac81d203aeac82dcee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/811638c702ad48ac81d203aeac82dcee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/811638c702ad48ac81d203aeac82dcee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:39:30.085279 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersTestJSON-1129232128 May 28 04:39:30.085279 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 811638c702ad48ac81d203aeac82dcee May 28 04:39:30.085279 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersTestJSON-1129232128 May 28 04:39:30.085279 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersTestJSON-1129232128-project May 28 04:39:30.085279 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:39:30.085279 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:39:30.085279 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 80e2e341401649898ed5a366da7e24e7 May 28 04:39:30.085279 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersTestJSON-1129232128-project May 28 04:39:30.085279 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:39:30.085279 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance d08c157a-afe1-41d5-8199-65e1b838d892 could not be found. May 28 04:39:30.085279 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'd08c157a-afe1-41d5-8199-65e1b838d892'} May 28 04:39:30.086302 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:39:30.086302 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:39:30.086302 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:39:30.086302 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:39:30.086302 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:39:30.086302 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:39:30.086302 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:39:30.086302 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:39:30.086302 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:39:30.086302 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:39:30.086302 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d08c157a-afe1-41d5-8199-65e1b838d892 could not be found. May 28 04:39:30.086302 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:39:30.086302 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:39:30.086302 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:39:30.086302 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:39:30.086302 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:39:30.086302 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:39:30.086302 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:39:30.086302 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:39:30.086302 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:39:30.087909 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:39:30.087909 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:39:30.087909 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:39:30.087909 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:39:30.087909 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:39:30.087909 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:39:30.087909 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:39:30.087909 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d08c157a-afe1-41d5-8199-65e1b838d892 could not be found. May 28 04:39:30.087909 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:39:30.087909 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:39:30.087909 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:39:30.087909 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:39:30.087909 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:39:30.087909 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:39:30.087909 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:39:30.087909 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:39:30.087909 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d08c157a-afe1-41d5-8199-65e1b838d892 could not be found. May 28 04:39:30.087909 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:39:30.092380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-23663b69-74d2-4d00-a5a2-6e5843f02456 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Returning 404 to user: Instance d08c157a-afe1-41d5-8199-65e1b838d892 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:39:30.098072 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-23663b69-74d2-4d00-a5a2-6e5843f02456 tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892" status: 404 len: 111 microversion: 2.1 time: 0.076561 May 28 04:39:30.100217 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 712/1512] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:30 2022] GET /compute/v2.1/servers/d08c157a-afe1-41d5-8199-65e1b838d892 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:39:30.104574 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-764d7bb4-7752-40db-86dc-1e9ea63dc4e7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:30.107153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5c92b8ec-3e32-4d52-96dd-79d78e65482b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:30.108172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5c92b8ec-3e32-4d52-96dd-79d78e65482b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:30.116499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c92b8ec-3e32-4d52-96dd-79d78e65482b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:30.123361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c92b8ec-3e32-4d52-96dd-79d78e65482b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:30.123361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c92b8ec-3e32-4d52-96dd-79d78e65482b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:30.123361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c92b8ec-3e32-4d52-96dd-79d78e65482b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:30.141207 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-764d7bb4-7752-40db-86dc-1e9ea63dc4e7 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1316 microversion: 2.1 time: 0.331728 May 28 04:39:30.163379 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 801/1513] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:29 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1316 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:30.182110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=8 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:30.255209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-64e4c967-cfda-499d-868c-edb3af6f8ccc tempest-SecurityGroupsTestAdminJSON-1327447945 tempest-SecurityGroupsTestAdminJSON-1327447945-project-admin] Action: 'create', calling method: .version_select at 0x7f7707535b80>, body: {"security_group": {"name": "tempest-securitygroup-1800776268", "description": "tempest-description-2125893704"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:30.436963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5c92b8ec-3e32-4d52-96dd-79d78e65482b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:30.466276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5c92b8ec-3e32-4d52-96dd-79d78e65482b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:30.470448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5c92b8ec-3e32-4d52-96dd-79d78e65482b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:30.473008 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5c92b8ec-3e32-4d52-96dd-79d78e65482b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.371454 May 28 04:39:30.490614 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 713/1514] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:39:30 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:39:30.511574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2a105ab3-9b31-42b0-b1b5-15083b944cea tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] Calling method '.version_select at 0x7f7701a8c700>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:30.633606 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2a105ab3-9b31-42b0-b1b5-15083b944cea tempest-ServersTestJSON-1129232128 tempest-ServersTestJSON-1129232128-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1634178433" status: 202 len: 0 microversion: 2.1 time: 0.140213 May 28 04:39:30.641664 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 714/1515] 10.222.0.58 () {58 vars in 1220 bytes} [Sat May 28 04:39:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1634178433 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:39:30.643153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6215e134-9651-493b-9249-b258b486e81f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:30.643778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6215e134-9651-493b-9249-b258b486e81f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:30.651018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6215e134-9651-493b-9249-b258b486e81f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:30.651772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6215e134-9651-493b-9249-b258b486e81f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:30.652775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6215e134-9651-493b-9249-b258b486e81f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:30.653396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6215e134-9651-493b-9249-b258b486e81f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:31.122808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6215e134-9651-493b-9249-b258b486e81f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:31.148715 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6215e134-9651-493b-9249-b258b486e81f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1476 microversion: 2.1 time: 0.505550 May 28 04:39:31.149647 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 715/1516] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:30 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1476 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:31.163928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-30b9175c-de6a-4e71-aaec-8a4dfa894450 req-fcaf4512-4bb5-41bf-870e-c5321684709c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2fe6e3-8187-4ba2-b31d-10b4f602b332", "tag": "3031f11b-74bc-424b-8498-fb24d06f2874"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:31.179898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-30b9175c-de6a-4e71-aaec-8a4dfa894450 req-fcaf4512-4bb5-41bf-870e-c5321684709c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:31.187440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-30b9175c-de6a-4e71-aaec-8a4dfa894450 req-fcaf4512-4bb5-41bf-870e-c5321684709c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:31.217874 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-30b9175c-de6a-4e71-aaec-8a4dfa894450 req-fcaf4512-4bb5-41bf-870e-c5321684709c service nova] Creating event network-changed:3031f11b-74bc-424b-8498-fb24d06f2874 for instance ac2fe6e3-8187-4ba2-b31d-10b4f602b332 on n-h2-843700-1 May 28 04:39:31.225475 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-30b9175c-de6a-4e71-aaec-8a4dfa894450 req-fcaf4512-4bb5-41bf-870e-c5321684709c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073876 May 28 04:39:31.227384 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 716/1517] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:31.237866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-399b4ae1-8f5a-4165-ad81-be5eaccc6be2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:31.239218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-399b4ae1-8f5a-4165-ad81-be5eaccc6be2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:31.246956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-399b4ae1-8f5a-4165-ad81-be5eaccc6be2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:31.247718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-399b4ae1-8f5a-4165-ad81-be5eaccc6be2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:31.265424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-399b4ae1-8f5a-4165-ad81-be5eaccc6be2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:31.266168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-399b4ae1-8f5a-4165-ad81-be5eaccc6be2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:31.410676 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-64e4c967-cfda-499d-868c-edb3af6f8ccc tempest-SecurityGroupsTestAdminJSON-1327447945 tempest-SecurityGroupsTestAdminJSON-1327447945-project-admin] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.245840 May 28 04:39:31.411329 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 802/1518] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:39:30 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:31.421329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-2c620e54-86ed-448b-916f-ccb72f7bcc6f req-ca8f95c9-b303-4a37-9b52-ceb538d49285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ffc58d-f5a5-4f93-aac8-6348d9d576ba", "name": "network-vif-plugged", "status": "completed", "tag": "0a34d596-0c1e-4988-a19f-7e0e80837d92"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:31.439136 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2c620e54-86ed-448b-916f-ccb72f7bcc6f req-ca8f95c9-b303-4a37-9b52-ceb538d49285 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:31.439863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2c620e54-86ed-448b-916f-ccb72f7bcc6f req-ca8f95c9-b303-4a37-9b52-ceb538d49285 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:31.464680 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-2c620e54-86ed-448b-916f-ccb72f7bcc6f req-ca8f95c9-b303-4a37-9b52-ceb538d49285 service nova] Creating event network-vif-plugged:0a34d596-0c1e-4988-a19f-7e0e80837d92 for instance 23ffc58d-f5a5-4f93-aac8-6348d9d576ba on n-h1-843700-1 May 28 04:39:31.473172 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-2c620e54-86ed-448b-916f-ccb72f7bcc6f req-ca8f95c9-b303-4a37-9b52-ceb538d49285 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059739 May 28 04:39:31.473803 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 803/1519] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:31.502932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-938ba90d-d6de-488d-96ac-250aefb21ffc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:31.505911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-938ba90d-d6de-488d-96ac-250aefb21ffc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:31.528067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-938ba90d-d6de-488d-96ac-250aefb21ffc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:31.534370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-938ba90d-d6de-488d-96ac-250aefb21ffc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:31.535470 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-938ba90d-d6de-488d-96ac-250aefb21ffc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:31.536082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-938ba90d-d6de-488d-96ac-250aefb21ffc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:31.825934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-399b4ae1-8f5a-4165-ad81-be5eaccc6be2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:31.847541 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-399b4ae1-8f5a-4165-ad81-be5eaccc6be2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1211 microversion: 2.1 time: 0.617587 May 28 04:39:31.849484 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 717/1520] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:31 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1211 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:31.876106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e87a62f2-46ac-4bb1-a891-bfb77ba2a84a tempest-SecurityGroupsTestAdminJSON-1327447945 tempest-SecurityGroupsTestAdminJSON-1327447945-project-admin] Action: 'create', calling method: .version_select at 0x7f7701d85430>, body: {"security_group": {"name": "tempest-securitygroup-989181847", "description": "tempest-description-329165234"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:32.136744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-938ba90d-d6de-488d-96ac-250aefb21ffc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:32.164190 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-938ba90d-d6de-488d-96ac-250aefb21ffc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1316 microversion: 2.1 time: 0.687642 May 28 04:39:32.167506 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 804/1521] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:31 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1316 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:32.203662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f8ba52c5-b4a6-4bd5-937c-8890273de50c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:32.204652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f8ba52c5-b4a6-4bd5-937c-8890273de50c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:32.214225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8ba52c5-b4a6-4bd5-937c-8890273de50c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:32.215042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8ba52c5-b4a6-4bd5-937c-8890273de50c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:32.216008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8ba52c5-b4a6-4bd5-937c-8890273de50c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:32.216670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8ba52c5-b4a6-4bd5-937c-8890273de50c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:32.701477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f8ba52c5-b4a6-4bd5-937c-8890273de50c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:32.732579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f8ba52c5-b4a6-4bd5-937c-8890273de50c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:32.734179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f8ba52c5-b4a6-4bd5-937c-8890273de50c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:32.735435 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f8ba52c5-b4a6-4bd5-937c-8890273de50c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.565771 May 28 04:39:32.736009 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 805/1522] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:39:32 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:39:32.740772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cc47fc5b-2b56-483a-a769-c39e6c72ab0e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:32.741576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cc47fc5b-2b56-483a-a769-c39e6c72ab0e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:32.759360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc47fc5b-2b56-483a-a769-c39e6c72ab0e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:32.760386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc47fc5b-2b56-483a-a769-c39e6c72ab0e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:32.761327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc47fc5b-2b56-483a-a769-c39e6c72ab0e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:32.761965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc47fc5b-2b56-483a-a769-c39e6c72ab0e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:33.037967 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e87a62f2-46ac-4bb1-a891-bfb77ba2a84a tempest-SecurityGroupsTestAdminJSON-1327447945 tempest-SecurityGroupsTestAdminJSON-1327447945-project-admin] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.187068 May 28 04:39:33.039527 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 718/1523] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:39:31 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:33.045009 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4c807315-08a6-4020-a5c7-46f9cdf99ca2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:33.045874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4c807315-08a6-4020-a5c7-46f9cdf99ca2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:33.064713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c807315-08a6-4020-a5c7-46f9cdf99ca2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:33.065168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c807315-08a6-4020-a5c7-46f9cdf99ca2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:33.065967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c807315-08a6-4020-a5c7-46f9cdf99ca2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:33.066404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c807315-08a6-4020-a5c7-46f9cdf99ca2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:33.370646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cc47fc5b-2b56-483a-a769-c39e6c72ab0e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:33.379653 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cc47fc5b-2b56-483a-a769-c39e6c72ab0e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1475 microversion: 2.1 time: 0.642385 May 28 04:39:33.381442 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 806/1524] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:32 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1475 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:33.395321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2518fe1b-d97a-435a-a60e-7282a31f46fd tempest-SecurityGroupsTestAdminJSON-1327447945 tempest-SecurityGroupsTestAdminJSON-1327447945-project-admin] Calling method '.version_select at 0x7f7707470310>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:33.647685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4c807315-08a6-4020-a5c7-46f9cdf99ca2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:33.657423 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4c807315-08a6-4020-a5c7-46f9cdf99ca2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1211 microversion: 2.1 time: 0.616078 May 28 04:39:33.658550 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 719/1525] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:33 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1211 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:33.665045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-310c4230-9ca4-4884-a0ac-43a65f372438 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:33.666709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-310c4230-9ca4-4884-a0ac-43a65f372438 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:33.674159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-310c4230-9ca4-4884-a0ac-43a65f372438 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:33.674615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-310c4230-9ca4-4884-a0ac-43a65f372438 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:33.675851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-310c4230-9ca4-4884-a0ac-43a65f372438 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:33.676293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-310c4230-9ca4-4884-a0ac-43a65f372438 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:34.474081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-310c4230-9ca4-4884-a0ac-43a65f372438 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:34.484656 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-310c4230-9ca4-4884-a0ac-43a65f372438 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1465 microversion: 2.1 time: 0.824825 May 28 04:39:34.485271 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 720/1526] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:33 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1465 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:34.495841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6326c883-aa22-429a-b247-a1030db86664 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:34.496503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6326c883-aa22-429a-b247-a1030db86664 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:34.510519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:34.514340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6326c883-aa22-429a-b247-a1030db86664 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:34.514804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6326c883-aa22-429a-b247-a1030db86664 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:34.515635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6326c883-aa22-429a-b247-a1030db86664 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:34.518394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6326c883-aa22-429a-b247-a1030db86664 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:35.042902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6326c883-aa22-429a-b247-a1030db86664 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:35.055757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6326c883-aa22-429a-b247-a1030db86664 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:35.061183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6326c883-aa22-429a-b247-a1030db86664 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:35.066082 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6326c883-aa22-429a-b247-a1030db86664 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.579821 May 28 04:39:35.068892 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 721/1527] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:39:34 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:39:35.104965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-a29d4033-b62a-4c90-a9e9-5e91aee6dcc9 req-0818be10-5bac-451e-8654-a9782e3f8184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2879396-59ef-44c3-ba44-5626191ec11e", "name": "network-vif-unplugged", "status": "completed", "tag": "2c964bd0-98e9-472c-a6fe-946d0b7b8704"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:35.129949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a29d4033-b62a-4c90-a9e9-5e91aee6dcc9 req-0818be10-5bac-451e-8654-a9782e3f8184 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:35.131390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a29d4033-b62a-4c90-a9e9-5e91aee6dcc9 req-0818be10-5bac-451e-8654-a9782e3f8184 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:35.165740 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-a29d4033-b62a-4c90-a9e9-5e91aee6dcc9 req-0818be10-5bac-451e-8654-a9782e3f8184 service nova] Creating event network-vif-unplugged:2c964bd0-98e9-472c-a6fe-946d0b7b8704 for instance b2879396-59ef-44c3-ba44-5626191ec11e on n-h1-843700-1 May 28 04:39:35.185523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-a29d4033-b62a-4c90-a9e9-5e91aee6dcc9 req-0818be10-5bac-451e-8654-a9782e3f8184 service nova] Instance b2879396-59ef-44c3-ba44-5626191ec11e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:39:35.208456 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-a29d4033-b62a-4c90-a9e9-5e91aee6dcc9 req-0818be10-5bac-451e-8654-a9782e3f8184 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135970 May 28 04:39:35.210607 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 722/1528] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:35.228015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-50fd466f-d150-44bb-93d6-02577d4fcdee tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:35.231383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-50fd466f-d150-44bb-93d6-02577d4fcdee tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:35.249920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50fd466f-d150-44bb-93d6-02577d4fcdee tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:35.249920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50fd466f-d150-44bb-93d6-02577d4fcdee tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:35.251671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50fd466f-d150-44bb-93d6-02577d4fcdee tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:35.253947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50fd466f-d150-44bb-93d6-02577d4fcdee tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:35.692635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-50fd466f-d150-44bb-93d6-02577d4fcdee tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:35.702930 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-50fd466f-d150-44bb-93d6-02577d4fcdee tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1475 microversion: 2.1 time: 0.490360 May 28 04:39:35.714303 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 723/1529] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:35 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1475 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:35.719373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b395be7f-9969-4d54-99cb-f62327832893 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:35.720150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b395be7f-9969-4d54-99cb-f62327832893 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:35.728160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b395be7f-9969-4d54-99cb-f62327832893 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:35.731920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b395be7f-9969-4d54-99cb-f62327832893 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:35.731920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b395be7f-9969-4d54-99cb-f62327832893 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:35.731920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b395be7f-9969-4d54-99cb-f62327832893 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:36.084020 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b395be7f-9969-4d54-99cb-f62327832893 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1616 microversion: 2.1 time: 0.368253 May 28 04:39:36.100342 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 724/1530] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:35 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1616 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:36.110573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d95eed69-0a9a-488a-bdbd-18e5e6873555 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:36.117921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d95eed69-0a9a-488a-bdbd-18e5e6873555 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:36.136287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d95eed69-0a9a-488a-bdbd-18e5e6873555 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:36.137156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d95eed69-0a9a-488a-bdbd-18e5e6873555 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:36.138163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d95eed69-0a9a-488a-bdbd-18e5e6873555 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:36.138820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d95eed69-0a9a-488a-bdbd-18e5e6873555 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:36.421155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d95eed69-0a9a-488a-bdbd-18e5e6873555 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:36.429782 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d95eed69-0a9a-488a-bdbd-18e5e6873555 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1211 microversion: 2.1 time: 0.327873 May 28 04:39:36.431084 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 725/1531] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:36 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1211 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:36.436441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e59b27ef-f8b5-4608-b95a-30355098f205 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1202558064", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ffb8f4db-cca5-49b8-91fd-8f0479ba81aa"}], "security_groups": [{"name": "tempest-securitygroup--1106025357"}], "key_name": "tempest-keypair-57404145", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:36.656795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-e59b27ef-f8b5-4608-b95a-30355098f205 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] validate_networks() for [('ffb8f4db-cca5-49b8-91fd-8f0479ba81aa', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:39:37.297551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-e59b27ef-f8b5-4608-b95a-30355098f205 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Getting quotas for project 01907ddfb9d54b159d84a63586b8338f. Resources: dict_keys(['metadata_items']) {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:39:37.304464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-e59b27ef-f8b5-4608-b95a-30355098f205 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Getting quotas for user 18e3755f97184714b26326adebbe1f17 and project 01907ddfb9d54b159d84a63586b8338f. Resources: dict_keys(['metadata_items']) {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:39:37.319325 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-e59b27ef-f8b5-4608-b95a-30355098f205 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:39:37.320003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-e59b27ef-f8b5-4608-b95a-30355098f205 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:39:37.320643 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-e59b27ef-f8b5-4608-b95a-30355098f205 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:39:37.321218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-e59b27ef-f8b5-4608-b95a-30355098f205 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:39:37.329973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-e59b27ef-f8b5-4608-b95a-30355098f205 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:39:37.332166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e59b27ef-f8b5-4608-b95a-30355098f205 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:37.333366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e59b27ef-f8b5-4608-b95a-30355098f205 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:37.334618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e59b27ef-f8b5-4608-b95a-30355098f205 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:37.335278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e59b27ef-f8b5-4608-b95a-30355098f205 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:37.361904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-e59b27ef-f8b5-4608-b95a-30355098f205 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Getting quotas for project 01907ddfb9d54b159d84a63586b8338f. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:39:37.370708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-e59b27ef-f8b5-4608-b95a-30355098f205 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Getting quotas for user 18e3755f97184714b26326adebbe1f17 and project 01907ddfb9d54b159d84a63586b8338f. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:39:37.394245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e59b27ef-f8b5-4608-b95a-30355098f205 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:39:37.397729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e59b27ef-f8b5-4608-b95a-30355098f205 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:39:37.565501 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e59b27ef-f8b5-4608-b95a-30355098f205 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.132529 May 28 04:39:37.567639 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 726/1532] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:39:36 2022] POST /compute/v2.1/servers => generated 409 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:39:37.579600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-742d2f9a-6302-46f5-a679-375b5b3a9b50 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:37.580572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-742d2f9a-6302-46f5-a679-375b5b3a9b50 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:37.595208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-742d2f9a-6302-46f5-a679-375b5b3a9b50 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:37.595676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-742d2f9a-6302-46f5-a679-375b5b3a9b50 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:37.596503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-742d2f9a-6302-46f5-a679-375b5b3a9b50 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:37.596947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-742d2f9a-6302-46f5-a679-375b5b3a9b50 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:37.830770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-742d2f9a-6302-46f5-a679-375b5b3a9b50 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:37.852017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-742d2f9a-6302-46f5-a679-375b5b3a9b50 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:37.857100 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-742d2f9a-6302-46f5-a679-375b5b3a9b50 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:37.861892 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-742d2f9a-6302-46f5-a679-375b5b3a9b50 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.291556 May 28 04:39:37.862804 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 727/1533] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:39:37 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:39:37.870250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a512b343-74ea-49d7-9822-4d443fe5f409 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1652792420", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "7015ae59-a219-4897-97c4-ba6ead622287"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:37.947193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-a512b343-74ea-49d7-9822-4d443fe5f409 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] validate_networks() for None {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:39:38.435593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a512b343-74ea-49d7-9822-4d443fe5f409 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:39:38.436735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a512b343-74ea-49d7-9822-4d443fe5f409 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:39:38.437711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a512b343-74ea-49d7-9822-4d443fe5f409 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:39:38.438467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a512b343-74ea-49d7-9822-4d443fe5f409 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:39:38.439102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a512b343-74ea-49d7-9822-4d443fe5f409 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:39:38.461335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a512b343-74ea-49d7-9822-4d443fe5f409 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:38.466038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a512b343-74ea-49d7-9822-4d443fe5f409 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:38.468703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a512b343-74ea-49d7-9822-4d443fe5f409 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:38.474015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a512b343-74ea-49d7-9822-4d443fe5f409 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:38.499852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=20 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:38.520167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-a512b343-74ea-49d7-9822-4d443fe5f409 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for project e7a5b721a538475cbac9c95c61647753. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:39:38.541577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-a512b343-74ea-49d7-9822-4d443fe5f409 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Getting quotas for user d398d45627fc4d33bc9a736ddf8f9215 and project e7a5b721a538475cbac9c95c61647753. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:39:38.572291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a512b343-74ea-49d7-9822-4d443fe5f409 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:39:38.573424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a512b343-74ea-49d7-9822-4d443fe5f409 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:39:38.777130 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a512b343-74ea-49d7-9822-4d443fe5f409 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.913382 May 28 04:39:38.780735 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 728/1534] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:39:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:39:38.786918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d73f6b43-7cb1-4ce0-939f-9a0b29e17557 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:38.787890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d73f6b43-7cb1-4ce0-939f-9a0b29e17557 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:38.795390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d73f6b43-7cb1-4ce0-939f-9a0b29e17557 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:38.796337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d73f6b43-7cb1-4ce0-939f-9a0b29e17557 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:38.797348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d73f6b43-7cb1-4ce0-939f-9a0b29e17557 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:38.798031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d73f6b43-7cb1-4ce0-939f-9a0b29e17557 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:38.820020 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2518fe1b-d97a-435a-a60e-7282a31f46fd tempest-SecurityGroupsTestAdminJSON-1327447945 tempest-SecurityGroupsTestAdminJSON-1327447945-project-admin] 10.222.0.58 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13047 microversion: 2.1 time: 5.436938 May 28 04:39:38.820634 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 807/1535] 10.222.0.58 () {58 vars in 1190 bytes} [Sat May 28 04:39:33 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13047 bytes in 5438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:39:38.834100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-919d0bf9-bc96-42ac-a5d4-b46cd4db9a78 req-09dbecfb-4b39-46f5-a868-1cab3f8cc8a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2879396-59ef-44c3-ba44-5626191ec11e", "tag": "2c964bd0-98e9-472c-a6fe-946d0b7b8704"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:38.845732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-919d0bf9-bc96-42ac-a5d4-b46cd4db9a78 req-09dbecfb-4b39-46f5-a868-1cab3f8cc8a3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:38.846188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-919d0bf9-bc96-42ac-a5d4-b46cd4db9a78 req-09dbecfb-4b39-46f5-a868-1cab3f8cc8a3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:38.883116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:38.893238 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-919d0bf9-bc96-42ac-a5d4-b46cd4db9a78 req-09dbecfb-4b39-46f5-a868-1cab3f8cc8a3 service nova] Creating event network-changed:2c964bd0-98e9-472c-a6fe-946d0b7b8704 for instance b2879396-59ef-44c3-ba44-5626191ec11e on n-h1-843700-1 May 28 04:39:38.904923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-919d0bf9-bc96-42ac-a5d4-b46cd4db9a78 req-09dbecfb-4b39-46f5-a868-1cab3f8cc8a3 service nova] Instance b2879396-59ef-44c3-ba44-5626191ec11e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:39:38.921153 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-919d0bf9-bc96-42ac-a5d4-b46cd4db9a78 req-09dbecfb-4b39-46f5-a868-1cab3f8cc8a3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099039 May 28 04:39:38.922037 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 808/1536] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:38.930850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4e5e1094-e163-4f4f-a870-a077bb7abdf5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:38.932444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4e5e1094-e163-4f4f-a870-a077bb7abdf5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:38.956581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e5e1094-e163-4f4f-a870-a077bb7abdf5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:38.957039 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e5e1094-e163-4f4f-a870-a077bb7abdf5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:38.959003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e5e1094-e163-4f4f-a870-a077bb7abdf5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:38.959615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e5e1094-e163-4f4f-a870-a077bb7abdf5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:39.537657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d73f6b43-7cb1-4ce0-939f-9a0b29e17557 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:39.547389 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d73f6b43-7cb1-4ce0-939f-9a0b29e17557 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1473 microversion: 2.1 time: 0.765138 May 28 04:39:39.547979 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 729/1537] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:38 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1473 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:39.581637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4e5e1094-e163-4f4f-a870-a077bb7abdf5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:39.582144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-267307a6-89af-465b-85ff-666c67d49612 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:39.583503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-267307a6-89af-465b-85ff-666c67d49612 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:39.600510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-267307a6-89af-465b-85ff-666c67d49612 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:39.603773 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4e5e1094-e163-4f4f-a870-a077bb7abdf5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1211 microversion: 2.1 time: 0.674932 May 28 04:39:39.604092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-267307a6-89af-465b-85ff-666c67d49612 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:39.604367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-267307a6-89af-465b-85ff-666c67d49612 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:39.606850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-267307a6-89af-465b-85ff-666c67d49612 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:39.614725 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 809/1538] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:38 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1211 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:39.630015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-227a6e2e-9461-4454-b5ba-74980b8e2b65 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:39.630928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-227a6e2e-9461-4454-b5ba-74980b8e2b65 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:39.785489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-227a6e2e-9461-4454-b5ba-74980b8e2b65 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:39.802968 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-227a6e2e-9461-4454-b5ba-74980b8e2b65 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f" status: 200 len: 1217 microversion: 2.1 time: 0.182660 May 28 04:39:39.803705 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-267307a6-89af-465b-85ff-666c67d49612 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18e3755f97184714b26326adebbe1f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01907ddfb9d54b159d84a63586b8338f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:39.806387 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 810/1539] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:39 2022] GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f => generated 1217 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:39.821287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f68d15c8-0220-4aba-b06c-3cd84de65878 tempest-SecurityGroupsTestAdminJSON-1725155449 tempest-SecurityGroupsTestAdminJSON-1725155449-project] Calling method '.version_select at 0x7f77015edc10>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:39.825543 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-267307a6-89af-465b-85ff-666c67d49612 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79" status: 200 len: 1272 microversion: 2.1 time: 0.258984 May 28 04:39:39.826499 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 730/1540] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:39 2022] GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79 => generated 1272 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:39.840763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8081e6a8-c7d1-451f-8611-319ac1e1e4bf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:39.845359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8081e6a8-c7d1-451f-8611-319ac1e1e4bf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:39.860257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8081e6a8-c7d1-451f-8611-319ac1e1e4bf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:39.860925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8081e6a8-c7d1-451f-8611-319ac1e1e4bf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:39.861989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8081e6a8-c7d1-451f-8611-319ac1e1e4bf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:39.862437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8081e6a8-c7d1-451f-8611-319ac1e1e4bf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:40.186253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8081e6a8-c7d1-451f-8611-319ac1e1e4bf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:40.195210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8081e6a8-c7d1-451f-8611-319ac1e1e4bf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:40.205475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8081e6a8-c7d1-451f-8611-319ac1e1e4bf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:40.207942 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8081e6a8-c7d1-451f-8611-319ac1e1e4bf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.379957 May 28 04:39:40.208746 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 731/1541] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:39:39 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:39:40.343116 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f68d15c8-0220-4aba-b06c-3cd84de65878 tempest-SecurityGroupsTestAdminJSON-1725155449 tempest-SecurityGroupsTestAdminJSON-1725155449-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 0.533072 May 28 04:39:40.343930 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 811/1542] 10.222.0.58 () {58 vars in 1190 bytes} [Sat May 28 04:39:39 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:40.356421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d453ed00-4b81-43e8-ac3e-5a875d67aac0 tempest-SecurityGroupsTestAdminJSON-1327447945 tempest-SecurityGroupsTestAdminJSON-1327447945-project-admin] Calling method '.version_select at 0x7f7701d93e50>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:40.567229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5429fd71-9cfc-4dee-914b-c6bfb1bc53e5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:40.568109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5429fd71-9cfc-4dee-914b-c6bfb1bc53e5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:40.582260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5429fd71-9cfc-4dee-914b-c6bfb1bc53e5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:40.584240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5429fd71-9cfc-4dee-914b-c6bfb1bc53e5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:40.585249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5429fd71-9cfc-4dee-914b-c6bfb1bc53e5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:40.586560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5429fd71-9cfc-4dee-914b-c6bfb1bc53e5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:40.977530 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5429fd71-9cfc-4dee-914b-c6bfb1bc53e5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:40.990054 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5429fd71-9cfc-4dee-914b-c6bfb1bc53e5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1470 microversion: 2.1 time: 0.428368 May 28 04:39:40.991400 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 812/1543] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:40 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1470 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:41.007223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-48921199-79f4-43ce-b9a8-88cff60846bc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:41.009606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-48921199-79f4-43ce-b9a8-88cff60846bc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:41.019882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48921199-79f4-43ce-b9a8-88cff60846bc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:41.020330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48921199-79f4-43ce-b9a8-88cff60846bc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:41.024653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48921199-79f4-43ce-b9a8-88cff60846bc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:41.026065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48921199-79f4-43ce-b9a8-88cff60846bc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:41.277953 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d453ed00-4b81-43e8-ac3e-5a875d67aac0 tempest-SecurityGroupsTestAdminJSON-1327447945 tempest-SecurityGroupsTestAdminJSON-1327447945-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/3a68bf3c-7ffc-4925-8033-dcb85e1d30db" status: 202 len: 0 microversion: 2.1 time: 0.925556 May 28 04:39:41.282899 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 732/1544] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:39:40 2022] DELETE /compute/v2.1/os-security-groups/3a68bf3c-7ffc-4925-8033-dcb85e1d30db => generated 0 bytes in 927 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:39:41.295378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1cc8060d-849a-4210-9848-f19e30db1f84 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:41.309894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1cc8060d-849a-4210-9848-f19e30db1f84 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:41.337350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cc8060d-849a-4210-9848-f19e30db1f84 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:41.338312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cc8060d-849a-4210-9848-f19e30db1f84 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:41.340630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cc8060d-849a-4210-9848-f19e30db1f84 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:41.342236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cc8060d-849a-4210-9848-f19e30db1f84 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:41.439247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-48921199-79f4-43ce-b9a8-88cff60846bc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:41.444088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1cc8060d-849a-4210-9848-f19e30db1f84 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:41.450748 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-48921199-79f4-43ce-b9a8-88cff60846bc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1211 microversion: 2.1 time: 0.455250 May 28 04:39:41.453507 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 813/1545] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:40 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1211 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:41.466112 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1cc8060d-849a-4210-9848-f19e30db1f84 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f" status: 200 len: 1269 microversion: 2.1 time: 0.180999 May 28 04:39:41.466579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0e9d8fbc-1b7e-467b-88e9-a01b73e0d984 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:41.469392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0e9d8fbc-1b7e-467b-88e9-a01b73e0d984 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:41.472297 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 733/1546] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:41 2022] GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f => generated 1269 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:41.479262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8235102f-3e7e-4f98-86fa-8944d11c8aaf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:41.480363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8235102f-3e7e-4f98-86fa-8944d11c8aaf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:41.481680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0e9d8fbc-1b7e-467b-88e9-a01b73e0d984 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:41.482917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0e9d8fbc-1b7e-467b-88e9-a01b73e0d984 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:41.483777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0e9d8fbc-1b7e-467b-88e9-a01b73e0d984 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:41.485811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0e9d8fbc-1b7e-467b-88e9-a01b73e0d984 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:41.488360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8235102f-3e7e-4f98-86fa-8944d11c8aaf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:41.489163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8235102f-3e7e-4f98-86fa-8944d11c8aaf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:41.490234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8235102f-3e7e-4f98-86fa-8944d11c8aaf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:41.491011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8235102f-3e7e-4f98-86fa-8944d11c8aaf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:41.669069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0e9d8fbc-1b7e-467b-88e9-a01b73e0d984 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18e3755f97184714b26326adebbe1f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01907ddfb9d54b159d84a63586b8338f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:41.680952 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0e9d8fbc-1b7e-467b-88e9-a01b73e0d984 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79" status: 200 len: 1334 microversion: 2.1 time: 0.226200 May 28 04:39:41.682095 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 814/1547] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:41 2022] GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79 => generated 1334 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:41.687665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b21c117c-54cb-4df4-87ad-b65e94cb3a54 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:41.695536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b21c117c-54cb-4df4-87ad-b65e94cb3a54 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:41.702840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b21c117c-54cb-4df4-87ad-b65e94cb3a54 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:41.707075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b21c117c-54cb-4df4-87ad-b65e94cb3a54 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:41.711175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b21c117c-54cb-4df4-87ad-b65e94cb3a54 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:41.714251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b21c117c-54cb-4df4-87ad-b65e94cb3a54 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:41.815245 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8235102f-3e7e-4f98-86fa-8944d11c8aaf tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "POST /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e/action" status: 202 len: 0 microversion: 2.1 time: 0.341536 May 28 04:39:41.815890 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 734/1548] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:39:41 2022] POST /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:39:41.852828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-48565e4a-6fed-41dd-ba69-a5d5527e7a3c tempest-SecurityGroupsTestAdminJSON-1327447945 tempest-SecurityGroupsTestAdminJSON-1327447945-project-admin] Calling method '.version_select at 0x7f7701db3c10>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:42.159539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b21c117c-54cb-4df4-87ad-b65e94cb3a54 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:42.171772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b21c117c-54cb-4df4-87ad-b65e94cb3a54 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:42.178033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b21c117c-54cb-4df4-87ad-b65e94cb3a54 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:42.182512 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b21c117c-54cb-4df4-87ad-b65e94cb3a54 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.497134 May 28 04:39:42.182512 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 815/1549] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:39:41 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:39:42.195088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-76997b2b-e97b-446c-8630-83d6a3b5ef46 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:42.195839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-76997b2b-e97b-446c-8630-83d6a3b5ef46 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:42.211544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76997b2b-e97b-446c-8630-83d6a3b5ef46 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:42.212022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76997b2b-e97b-446c-8630-83d6a3b5ef46 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:42.214066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76997b2b-e97b-446c-8630-83d6a3b5ef46 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:42.214544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76997b2b-e97b-446c-8630-83d6a3b5ef46 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:42.467354 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-48565e4a-6fed-41dd-ba69-a5d5527e7a3c tempest-SecurityGroupsTestAdminJSON-1327447945 tempest-SecurityGroupsTestAdminJSON-1327447945-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/7e9b72a3-e9b7-4732-84df-c2c4df9d2605" status: 202 len: 0 microversion: 2.1 time: 0.647242 May 28 04:39:42.468919 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 735/1550] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:39:41 2022] DELETE /compute/v2.1/os-security-groups/7e9b72a3-e9b7-4732-84df-c2c4df9d2605 => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:39:42.485515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0b196dbd-4d3e-440b-96a4-7fd9cb0e535c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:42.485515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0b196dbd-4d3e-440b-96a4-7fd9cb0e535c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:42.495681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b196dbd-4d3e-440b-96a4-7fd9cb0e535c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:42.497515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b196dbd-4d3e-440b-96a4-7fd9cb0e535c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:42.499829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b196dbd-4d3e-440b-96a4-7fd9cb0e535c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:42.500837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b196dbd-4d3e-440b-96a4-7fd9cb0e535c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:42.743010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-76997b2b-e97b-446c-8630-83d6a3b5ef46 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:42.752448 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-76997b2b-e97b-446c-8630-83d6a3b5ef46 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1469 microversion: 2.1 time: 0.570117 May 28 04:39:42.756446 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 816/1551] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:42 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1469 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:42.773958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f5272a6e-03df-4bff-b645-d06c7df181fc tempest-SecurityGroupsTestAdminJSON-1725155449 tempest-SecurityGroupsTestAdminJSON-1725155449-project] Calling method '.version_select at 0x7f7707535310>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:43.092938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0b196dbd-4d3e-440b-96a4-7fd9cb0e535c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:43.105498 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0b196dbd-4d3e-440b-96a4-7fd9cb0e535c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1199 microversion: 2.1 time: 0.633124 May 28 04:39:43.105498 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 736/1552] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:42 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1199 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:43.109036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-58d268f5-4484-4cae-aa2a-0ca2dba47678 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:43.111380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-58d268f5-4484-4cae-aa2a-0ca2dba47678 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:43.124542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-58d268f5-4484-4cae-aa2a-0ca2dba47678 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:43.128876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-58d268f5-4484-4cae-aa2a-0ca2dba47678 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:43.132406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-58d268f5-4484-4cae-aa2a-0ca2dba47678 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:43.133024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-58d268f5-4484-4cae-aa2a-0ca2dba47678 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:43.730527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-58d268f5-4484-4cae-aa2a-0ca2dba47678 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:43.752103 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-58d268f5-4484-4cae-aa2a-0ca2dba47678 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f" status: 200 len: 1275 microversion: 2.1 time: 0.646999 May 28 04:39:43.755130 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 737/1553] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:43 2022] GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f => generated 1275 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:43.767283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-85de904c-37d5-4afb-8b92-27b8ec482c50 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:43.768422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-85de904c-37d5-4afb-8b92-27b8ec482c50 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:43.795825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85de904c-37d5-4afb-8b92-27b8ec482c50 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:43.796545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85de904c-37d5-4afb-8b92-27b8ec482c50 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:43.797537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85de904c-37d5-4afb-8b92-27b8ec482c50 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:43.798173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85de904c-37d5-4afb-8b92-27b8ec482c50 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:43.830150 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f5272a6e-03df-4bff-b645-d06c7df181fc tempest-SecurityGroupsTestAdminJSON-1725155449 tempest-SecurityGroupsTestAdminJSON-1725155449-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/c607f803-b085-4bdf-80f9-caa0b370d96d" status: 202 len: 0 microversion: 2.1 time: 1.062776 May 28 04:39:43.830852 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 817/1554] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:39:42 2022] DELETE /compute/v2.1/os-security-groups/c607f803-b085-4bdf-80f9-caa0b370d96d => generated 0 bytes in 1074 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:39:43.836751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d41d5211-c37b-4415-8c7b-09108f82452e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:43.837555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d41d5211-c37b-4415-8c7b-09108f82452e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:43.853037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d41d5211-c37b-4415-8c7b-09108f82452e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:43.854491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d41d5211-c37b-4415-8c7b-09108f82452e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:43.856189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d41d5211-c37b-4415-8c7b-09108f82452e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:43.856827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d41d5211-c37b-4415-8c7b-09108f82452e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:43.862768 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:44.266262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-85de904c-37d5-4afb-8b92-27b8ec482c50 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18e3755f97184714b26326adebbe1f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01907ddfb9d54b159d84a63586b8338f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:44.287215 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-85de904c-37d5-4afb-8b92-27b8ec482c50 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79" status: 200 len: 1402 microversion: 2.1 time: 0.525154 May 28 04:39:44.291190 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 738/1555] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:43 2022] GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79 => generated 1402 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:44.304706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-8f53e7d2-1480-4d83-9db0-dd086cce7bcd req-2053b64d-fa0b-44b8-9bde-44495221de4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2879396-59ef-44c3-ba44-5626191ec11e", "name": "network-vif-plugged", "status": "completed", "tag": "2c964bd0-98e9-472c-a6fe-946d0b7b8704"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:44.336586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8f53e7d2-1480-4d83-9db0-dd086cce7bcd req-2053b64d-fa0b-44b8-9bde-44495221de4e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:44.338054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8f53e7d2-1480-4d83-9db0-dd086cce7bcd req-2053b64d-fa0b-44b8-9bde-44495221de4e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:44.380279 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-8f53e7d2-1480-4d83-9db0-dd086cce7bcd req-2053b64d-fa0b-44b8-9bde-44495221de4e service nova] Creating event network-vif-plugged:2c964bd0-98e9-472c-a6fe-946d0b7b8704 for instance b2879396-59ef-44c3-ba44-5626191ec11e on n-h1-843700-1 May 28 04:39:44.426437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-8f53e7d2-1480-4d83-9db0-dd086cce7bcd req-2053b64d-fa0b-44b8-9bde-44495221de4e service nova] Instance b2879396-59ef-44c3-ba44-5626191ec11e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:39:44.472709 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-8f53e7d2-1480-4d83-9db0-dd086cce7bcd req-2053b64d-fa0b-44b8-9bde-44495221de4e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177746 May 28 04:39:44.474554 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 739/1556] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:44.559680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d41d5211-c37b-4415-8c7b-09108f82452e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:44.572024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d41d5211-c37b-4415-8c7b-09108f82452e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:44.577105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d41d5211-c37b-4415-8c7b-09108f82452e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:44.577105 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d41d5211-c37b-4415-8c7b-09108f82452e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.742518 May 28 04:39:44.586150 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 818/1557] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:39:43 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:39:44.600100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f9da7761-f0e5-40af-b736-4258fe592efa tempest-SecurityGroupsTestAdminJSON-1725155449 tempest-SecurityGroupsTestAdminJSON-1725155449-project] Calling method '.version_select at 0x7f77073c9700>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:44.893875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e5239ee3-6a32-4a23-90e0-a28c3b1ae3ce tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:44.895009 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e5239ee3-6a32-4a23-90e0-a28c3b1ae3ce tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:44.917482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e5239ee3-6a32-4a23-90e0-a28c3b1ae3ce tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:44.918513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e5239ee3-6a32-4a23-90e0-a28c3b1ae3ce tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:44.924477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e5239ee3-6a32-4a23-90e0-a28c3b1ae3ce tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:44.925138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e5239ee3-6a32-4a23-90e0-a28c3b1ae3ce tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:45.347991 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e5239ee3-6a32-4a23-90e0-a28c3b1ae3ce tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:45.356874 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e5239ee3-6a32-4a23-90e0-a28c3b1ae3ce tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1469 microversion: 2.1 time: 0.879380 May 28 04:39:45.383289 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 740/1558] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:44 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1469 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:45.389127 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a1537927-86f9-4b4b-b154-91ed02a8742d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:45.393723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a1537927-86f9-4b4b-b154-91ed02a8742d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:45.411468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1537927-86f9-4b4b-b154-91ed02a8742d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:45.412221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1537927-86f9-4b4b-b154-91ed02a8742d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:45.413191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1537927-86f9-4b4b-b154-91ed02a8742d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:45.413792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1537927-86f9-4b4b-b154-91ed02a8742d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:45.592744 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f9da7761-f0e5-40af-b736-4258fe592efa tempest-SecurityGroupsTestAdminJSON-1725155449 tempest-SecurityGroupsTestAdminJSON-1725155449-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/60f39b89-0c2f-4def-8f3f-7e784d3c020d" status: 202 len: 0 microversion: 2.1 time: 1.004196 May 28 04:39:45.594441 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 819/1559] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:39:44 2022] DELETE /compute/v2.1/os-security-groups/60f39b89-0c2f-4def-8f3f-7e784d3c020d => generated 0 bytes in 1008 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:39:45.609544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2eb48bc3-b95b-4c5d-a1d3-27cc882815bb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:45.611395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2eb48bc3-b95b-4c5d-a1d3-27cc882815bb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:45.624304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2eb48bc3-b95b-4c5d-a1d3-27cc882815bb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:45.625054 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2eb48bc3-b95b-4c5d-a1d3-27cc882815bb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:45.626007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2eb48bc3-b95b-4c5d-a1d3-27cc882815bb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:45.627387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2eb48bc3-b95b-4c5d-a1d3-27cc882815bb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:45.982800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a1537927-86f9-4b4b-b154-91ed02a8742d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:45.994140 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a1537927-86f9-4b4b-b154-91ed02a8742d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1199 microversion: 2.1 time: 0.609256 May 28 04:39:46.006825 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 741/1560] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:45 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1199 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:46.014776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8110a8ea-4ba4-4392-873e-645fa151adef tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:46.017074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8110a8ea-4ba4-4392-873e-645fa151adef tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:46.024416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8110a8ea-4ba4-4392-873e-645fa151adef tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:46.025180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8110a8ea-4ba4-4392-873e-645fa151adef tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:46.028358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8110a8ea-4ba4-4392-873e-645fa151adef tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:46.030787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8110a8ea-4ba4-4392-873e-645fa151adef tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:46.137035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2eb48bc3-b95b-4c5d-a1d3-27cc882815bb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:46.146165 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2eb48bc3-b95b-4c5d-a1d3-27cc882815bb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f" status: 200 len: 1317 microversion: 2.1 time: 0.550208 May 28 04:39:46.146762 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 820/1561] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:45 2022] GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:46.158317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-28f3b83e-9dd6-4482-bb68-628bd774f237 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:46.163930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-28f3b83e-9dd6-4482-bb68-628bd774f237 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:46.171891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-28f3b83e-9dd6-4482-bb68-628bd774f237 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:46.172752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-28f3b83e-9dd6-4482-bb68-628bd774f237 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:46.173938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-28f3b83e-9dd6-4482-bb68-628bd774f237 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:46.174533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-28f3b83e-9dd6-4482-bb68-628bd774f237 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:46.515671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8110a8ea-4ba4-4392-873e-645fa151adef tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18e3755f97184714b26326adebbe1f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01907ddfb9d54b159d84a63586b8338f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:46.524459 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8110a8ea-4ba4-4392-873e-645fa151adef tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79" status: 200 len: 1402 microversion: 2.1 time: 0.515236 May 28 04:39:46.527689 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 742/1562] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:46 2022] GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79 => generated 1402 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:46.535223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-7a342c79-c2bb-4644-81f9-11793ae2f069 req-cc34036e-babe-4505-9a70-c0eee7fdc1dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d337611-9c22-48c2-99e7-8dc13d7dbe6f", "tag": "3257acbd-81a4-4090-9a76-6394762da82c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:46.563951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-7a342c79-c2bb-4644-81f9-11793ae2f069 req-cc34036e-babe-4505-9a70-c0eee7fdc1dc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:46.565156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-7a342c79-c2bb-4644-81f9-11793ae2f069 req-cc34036e-babe-4505-9a70-c0eee7fdc1dc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:46.606050 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-7a342c79-c2bb-4644-81f9-11793ae2f069 req-cc34036e-babe-4505-9a70-c0eee7fdc1dc service nova] Creating event network-changed:3257acbd-81a4-4090-9a76-6394762da82c for instance 6d337611-9c22-48c2-99e7-8dc13d7dbe6f on n-h2-843700-1 May 28 04:39:46.616041 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-7a342c79-c2bb-4644-81f9-11793ae2f069 req-cc34036e-babe-4505-9a70-c0eee7fdc1dc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086817 May 28 04:39:46.618375 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 743/1563] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:46.632050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-efbdab42-7bb9-48d2-b78d-f2a01357313d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:46.634386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-efbdab42-7bb9-48d2-b78d-f2a01357313d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:46.649351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-efbdab42-7bb9-48d2-b78d-f2a01357313d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:46.650081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-efbdab42-7bb9-48d2-b78d-f2a01357313d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:46.650317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-28f3b83e-9dd6-4482-bb68-628bd774f237 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:46.653484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-efbdab42-7bb9-48d2-b78d-f2a01357313d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:46.656741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-efbdab42-7bb9-48d2-b78d-f2a01357313d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:46.666856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-28f3b83e-9dd6-4482-bb68-628bd774f237 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:46.673283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-28f3b83e-9dd6-4482-bb68-628bd774f237 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:46.676170 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-28f3b83e-9dd6-4482-bb68-628bd774f237 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.525204 May 28 04:39:46.680006 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 821/1564] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:39:46 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:39:46.700367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-ad802468-7923-4b90-a93e-1caed1fc77ab req-f94ac878-e68d-41da-92b3-e750875cfa8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6099edfb-c389-4614-937f-11b41943ed79", "tag": "b1318bdd-cad5-4bc2-9aa4-fd6b51949f14"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:46.720763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ad802468-7923-4b90-a93e-1caed1fc77ab req-f94ac878-e68d-41da-92b3-e750875cfa8b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:46.724051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ad802468-7923-4b90-a93e-1caed1fc77ab req-f94ac878-e68d-41da-92b3-e750875cfa8b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:46.775465 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-ad802468-7923-4b90-a93e-1caed1fc77ab req-f94ac878-e68d-41da-92b3-e750875cfa8b service nova] Creating event network-changed:b1318bdd-cad5-4bc2-9aa4-fd6b51949f14 for instance 6099edfb-c389-4614-937f-11b41943ed79 on n-h1-843700-1 May 28 04:39:46.788911 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-ad802468-7923-4b90-a93e-1caed1fc77ab req-f94ac878-e68d-41da-92b3-e750875cfa8b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110178 May 28 04:39:46.795199 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 822/1565] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:47.018622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-16cf8fd8-f4e5-45ac-8aef-85fe049fb58d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:47.019746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-16cf8fd8-f4e5-45ac-8aef-85fe049fb58d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:47.037301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-16cf8fd8-f4e5-45ac-8aef-85fe049fb58d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:47.038543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-16cf8fd8-f4e5-45ac-8aef-85fe049fb58d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:47.049923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-16cf8fd8-f4e5-45ac-8aef-85fe049fb58d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:47.051344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-16cf8fd8-f4e5-45ac-8aef-85fe049fb58d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:47.060097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-efbdab42-7bb9-48d2-b78d-f2a01357313d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:47.069891 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-efbdab42-7bb9-48d2-b78d-f2a01357313d tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1469 microversion: 2.1 time: 0.449472 May 28 04:39:47.072465 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 744/1566] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:46 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1469 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:47.164182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6aea19ae-c452-4b9f-bc51-70c5f1a91ab1 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:47.164817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6aea19ae-c452-4b9f-bc51-70c5f1a91ab1 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:47.185310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6aea19ae-c452-4b9f-bc51-70c5f1a91ab1 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:47.186010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6aea19ae-c452-4b9f-bc51-70c5f1a91ab1 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:47.190297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6aea19ae-c452-4b9f-bc51-70c5f1a91ab1 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:47.193126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6aea19ae-c452-4b9f-bc51-70c5f1a91ab1 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:47.559249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-16cf8fd8-f4e5-45ac-8aef-85fe049fb58d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:47.567090 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-16cf8fd8-f4e5-45ac-8aef-85fe049fb58d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1199 microversion: 2.1 time: 0.559126 May 28 04:39:47.567695 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 823/1567] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:47 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1199 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:39:47.586250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5bf03558-60bc-4ab0-950c-4ceedb1a2e46 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:47.586866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5bf03558-60bc-4ab0-950c-4ceedb1a2e46 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:47.610737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5bf03558-60bc-4ab0-950c-4ceedb1a2e46 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:47.611254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5bf03558-60bc-4ab0-950c-4ceedb1a2e46 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:47.612060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5bf03558-60bc-4ab0-950c-4ceedb1a2e46 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:47.612768 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5bf03558-60bc-4ab0-950c-4ceedb1a2e46 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:47.643474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6aea19ae-c452-4b9f-bc51-70c5f1a91ab1 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:47.662077 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6aea19ae-c452-4b9f-bc51-70c5f1a91ab1 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f" status: 200 len: 1317 microversion: 2.1 time: 0.502190 May 28 04:39:47.668306 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 745/1568] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:47 2022] GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f => generated 1317 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:47.930706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7370fc25-f873-40aa-9d3b-ca0c216120a4 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-716798550", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "0b071355-3caa-4245-97d7-429c69b37f21"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:47.989569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5bf03558-60bc-4ab0-950c-4ceedb1a2e46 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18e3755f97184714b26326adebbe1f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01907ddfb9d54b159d84a63586b8338f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:47.998830 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5bf03558-60bc-4ab0-950c-4ceedb1a2e46 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79" status: 200 len: 1402 microversion: 2.1 time: 0.416563 May 28 04:39:47.999865 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 824/1569] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:47 2022] GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79 => generated 1402 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:48.004614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-74c2cee7-16f2-4796-8000-461787d60cb2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:48.008013 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-74c2cee7-16f2-4796-8000-461787d60cb2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:48.011993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74c2cee7-16f2-4796-8000-461787d60cb2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:48.012741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74c2cee7-16f2-4796-8000-461787d60cb2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:48.013997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74c2cee7-16f2-4796-8000-461787d60cb2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:48.014658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74c2cee7-16f2-4796-8000-461787d60cb2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:48.054506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-7370fc25-f873-40aa-9d3b-ca0c216120a4 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] validate_networks() for [('0b071355-3caa-4245-97d7-429c69b37f21', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:39:48.458170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-74c2cee7-16f2-4796-8000-461787d60cb2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:48.468474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-74c2cee7-16f2-4796-8000-461787d60cb2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:48.474775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-74c2cee7-16f2-4796-8000-461787d60cb2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:48.479467 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-74c2cee7-16f2-4796-8000-461787d60cb2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.478336 May 28 04:39:48.491702 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 825/1570] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:39:48 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:39:48.492968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:48.501026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a82cdd7b-5c15-40bd-9c3e-b59568a02180 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:48.506176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a82cdd7b-5c15-40bd-9c3e-b59568a02180 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:48.524602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a82cdd7b-5c15-40bd-9c3e-b59568a02180 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:48.525436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a82cdd7b-5c15-40bd-9c3e-b59568a02180 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:48.526486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a82cdd7b-5c15-40bd-9c3e-b59568a02180 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:48.527730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a82cdd7b-5c15-40bd-9c3e-b59568a02180 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:48.558699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=16 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:48.972919 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a82cdd7b-5c15-40bd-9c3e-b59568a02180 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:49.000316 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a82cdd7b-5c15-40bd-9c3e-b59568a02180 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1469 microversion: 2.1 time: 0.507102 May 28 04:39:49.015499 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 826/1571] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:48 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1469 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:49.283612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7370fc25-f873-40aa-9d3b-ca0c216120a4 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:39:49.285374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7370fc25-f873-40aa-9d3b-ca0c216120a4 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:39:49.286296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7370fc25-f873-40aa-9d3b-ca0c216120a4 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:39:49.286877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7370fc25-f873-40aa-9d3b-ca0c216120a4 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:39:49.287470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7370fc25-f873-40aa-9d3b-ca0c216120a4 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:39:49.317427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7370fc25-f873-40aa-9d3b-ca0c216120a4 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:49.318405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7370fc25-f873-40aa-9d3b-ca0c216120a4 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:49.319990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7370fc25-f873-40aa-9d3b-ca0c216120a4 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:49.323873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7370fc25-f873-40aa-9d3b-ca0c216120a4 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:49.412272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-7370fc25-f873-40aa-9d3b-ca0c216120a4 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Getting quotas for project 55c4deea6ba047db89f3bdedb33cfe8b. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:39:49.434111 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-7370fc25-f873-40aa-9d3b-ca0c216120a4 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Getting quotas for user d54c0e12aa2f4bde96dfad15ed07511d and project 55c4deea6ba047db89f3bdedb33cfe8b. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:39:49.467250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a4ce8dda-e0a4-403f-b83a-029714d6b38a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:49.468353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a4ce8dda-e0a4-403f-b83a-029714d6b38a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:49.478956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4ce8dda-e0a4-403f-b83a-029714d6b38a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:49.479303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7370fc25-f873-40aa-9d3b-ca0c216120a4 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:39:49.484024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4ce8dda-e0a4-403f-b83a-029714d6b38a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:49.484775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4ce8dda-e0a4-403f-b83a-029714d6b38a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:49.485216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4ce8dda-e0a4-403f-b83a-029714d6b38a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:49.487311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7370fc25-f873-40aa-9d3b-ca0c216120a4 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:39:49.576940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:49.697220 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7370fc25-f873-40aa-9d3b-ca0c216120a4 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.027740 May 28 04:39:49.702209 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 746/1572] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:39:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:39:49.716617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-51dc6aa6-5eb0-4a06-8c9e-cd502a4da8eb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:49.717268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-51dc6aa6-5eb0-4a06-8c9e-cd502a4da8eb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:49.759234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-51dc6aa6-5eb0-4a06-8c9e-cd502a4da8eb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:49.759234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-51dc6aa6-5eb0-4a06-8c9e-cd502a4da8eb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:49.759234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-51dc6aa6-5eb0-4a06-8c9e-cd502a4da8eb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:49.759234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-51dc6aa6-5eb0-4a06-8c9e-cd502a4da8eb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:49.796687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:49.986312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a4ce8dda-e0a4-403f-b83a-029714d6b38a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:50.005786 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a4ce8dda-e0a4-403f-b83a-029714d6b38a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1199 microversion: 2.1 time: 0.978618 May 28 04:39:50.005786 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 827/1573] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:49 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1199 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:50.010387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-73989737-8ed9-433c-9015-784e4f913ca7 req-54da256b-7688-4ff4-a6d5-c50b18141889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2879396-59ef-44c3-ba44-5626191ec11e", "name": "network-vif-unplugged", "status": "completed", "tag": "2c964bd0-98e9-472c-a6fe-946d0b7b8704"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:50.031772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-73989737-8ed9-433c-9015-784e4f913ca7 req-54da256b-7688-4ff4-a6d5-c50b18141889 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:50.034189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-73989737-8ed9-433c-9015-784e4f913ca7 req-54da256b-7688-4ff4-a6d5-c50b18141889 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:50.063492 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-73989737-8ed9-433c-9015-784e4f913ca7 req-54da256b-7688-4ff4-a6d5-c50b18141889 service nova] Creating event network-vif-unplugged:2c964bd0-98e9-472c-a6fe-946d0b7b8704 for instance b2879396-59ef-44c3-ba44-5626191ec11e on n-h2-843700-1 May 28 04:39:50.077972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-73989737-8ed9-433c-9015-784e4f913ca7 req-54da256b-7688-4ff4-a6d5-c50b18141889 service nova] Instance b2879396-59ef-44c3-ba44-5626191ec11e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:39:50.121225 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-73989737-8ed9-433c-9015-784e4f913ca7 req-54da256b-7688-4ff4-a6d5-c50b18141889 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116135 May 28 04:39:50.132855 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 828/1574] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:50.148295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-22c88c15-26be-4ab4-8cc4-a98f034528dd tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:50.151354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-22c88c15-26be-4ab4-8cc4-a98f034528dd tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:50.164815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22c88c15-26be-4ab4-8cc4-a98f034528dd tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:50.166463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22c88c15-26be-4ab4-8cc4-a98f034528dd tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:50.169840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22c88c15-26be-4ab4-8cc4-a98f034528dd tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:50.171417 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22c88c15-26be-4ab4-8cc4-a98f034528dd tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:50.647908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-51dc6aa6-5eb0-4a06-8c9e-cd502a4da8eb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:50.662470 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-51dc6aa6-5eb0-4a06-8c9e-cd502a4da8eb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f" status: 200 len: 1317 microversion: 2.1 time: 0.955898 May 28 04:39:50.663646 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 747/1575] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:49 2022] GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f => generated 1317 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:50.673330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-264d997e-2a79-4a29-872d-3b6795a39f6f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:50.690246 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-264d997e-2a79-4a29-872d-3b6795a39f6f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:50.706965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-264d997e-2a79-4a29-872d-3b6795a39f6f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:50.707696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-264d997e-2a79-4a29-872d-3b6795a39f6f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:50.713876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-264d997e-2a79-4a29-872d-3b6795a39f6f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:50.713876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-264d997e-2a79-4a29-872d-3b6795a39f6f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:50.713876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:50.811038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-22c88c15-26be-4ab4-8cc4-a98f034528dd tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18e3755f97184714b26326adebbe1f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01907ddfb9d54b159d84a63586b8338f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:50.829949 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-22c88c15-26be-4ab4-8cc4-a98f034528dd tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79" status: 200 len: 1402 microversion: 2.1 time: 0.686148 May 28 04:39:50.830700 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 829/1576] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:50 2022] GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79 => generated 1402 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:50.842457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6d831a9f-45f2-43b2-bc02-6b2f98207b30 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:50.845797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6d831a9f-45f2-43b2-bc02-6b2f98207b30 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:51.009739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6d831a9f-45f2-43b2-bc02-6b2f98207b30 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:51.021244 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6d831a9f-45f2-43b2-bc02-6b2f98207b30 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1216 microversion: 2.1 time: 0.187203 May 28 04:39:51.022212 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 830/1577] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:50 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1216 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:51.048457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-90321b07-cf35-4491-b832-931a0818b0d0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:51.048457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-90321b07-cf35-4491-b832-931a0818b0d0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:51.055278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90321b07-cf35-4491-b832-931a0818b0d0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:51.055732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90321b07-cf35-4491-b832-931a0818b0d0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:51.062053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90321b07-cf35-4491-b832-931a0818b0d0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:51.062509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90321b07-cf35-4491-b832-931a0818b0d0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:51.142856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-264d997e-2a79-4a29-872d-3b6795a39f6f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:51.156225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-264d997e-2a79-4a29-872d-3b6795a39f6f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:51.162493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-264d997e-2a79-4a29-872d-3b6795a39f6f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:51.178495 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-264d997e-2a79-4a29-872d-3b6795a39f6f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.501916 May 28 04:39:51.178495 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 748/1578] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:39:50 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:39:51.180271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-877b21d7-18c7-42ad-9987-0444f2e0341f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:51.181241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-877b21d7-18c7-42ad-9987-0444f2e0341f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:51.200478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-877b21d7-18c7-42ad-9987-0444f2e0341f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:51.205429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-877b21d7-18c7-42ad-9987-0444f2e0341f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:51.205429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-877b21d7-18c7-42ad-9987-0444f2e0341f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:51.205429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-877b21d7-18c7-42ad-9987-0444f2e0341f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:52.550870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-90321b07-cf35-4491-b832-931a0818b0d0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:52.562476 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-90321b07-cf35-4491-b832-931a0818b0d0 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1469 microversion: 2.1 time: 1.530414 May 28 04:39:52.565359 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 831/1579] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:51 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1469 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:52.572078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5f45cbc6-d2cb-4523-8102-abaeaf5419a8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:52.574920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5f45cbc6-d2cb-4523-8102-abaeaf5419a8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:52.590389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f45cbc6-d2cb-4523-8102-abaeaf5419a8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:52.599113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f45cbc6-d2cb-4523-8102-abaeaf5419a8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:52.599113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f45cbc6-d2cb-4523-8102-abaeaf5419a8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:52.599113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f45cbc6-d2cb-4523-8102-abaeaf5419a8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:52.636919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-877b21d7-18c7-42ad-9987-0444f2e0341f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:52.652473 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-877b21d7-18c7-42ad-9987-0444f2e0341f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1199 microversion: 2.1 time: 1.482033 May 28 04:39:52.655051 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 749/1580] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:51 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1199 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:52.665135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-39ac73d8-1902-4f8a-9f57-a0c2dc60cf74 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:52.665135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-39ac73d8-1902-4f8a-9f57-a0c2dc60cf74 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:52.682427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-39ac73d8-1902-4f8a-9f57-a0c2dc60cf74 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:52.682900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-39ac73d8-1902-4f8a-9f57-a0c2dc60cf74 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:52.688742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-39ac73d8-1902-4f8a-9f57-a0c2dc60cf74 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:52.691027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-39ac73d8-1902-4f8a-9f57-a0c2dc60cf74 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:52.914443 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5f45cbc6-d2cb-4523-8102-abaeaf5419a8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:52.923249 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5f45cbc6-d2cb-4523-8102-abaeaf5419a8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f" status: 200 len: 1317 microversion: 2.1 time: 0.356431 May 28 04:39:52.927100 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 832/1581] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:52 2022] GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:52.932273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e668f894-3050-4ddf-bbaa-f65f332a577c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:52.951375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e668f894-3050-4ddf-bbaa-f65f332a577c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:52.969248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e668f894-3050-4ddf-bbaa-f65f332a577c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:52.970755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e668f894-3050-4ddf-bbaa-f65f332a577c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:52.973281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e668f894-3050-4ddf-bbaa-f65f332a577c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:52.974040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e668f894-3050-4ddf-bbaa-f65f332a577c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:53.034812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-39ac73d8-1902-4f8a-9f57-a0c2dc60cf74 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18e3755f97184714b26326adebbe1f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01907ddfb9d54b159d84a63586b8338f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:53.043844 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-39ac73d8-1902-4f8a-9f57-a0c2dc60cf74 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79" status: 200 len: 1402 microversion: 2.1 time: 0.387107 May 28 04:39:53.051850 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 750/1582] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:52 2022] GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79 => generated 1402 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:53.067939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-71157903-725f-4b93-82d1-1e7507432f1a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:53.069414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-71157903-725f-4b93-82d1-1e7507432f1a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:53.088166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71157903-725f-4b93-82d1-1e7507432f1a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:53.088753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71157903-725f-4b93-82d1-1e7507432f1a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:53.089964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71157903-725f-4b93-82d1-1e7507432f1a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:53.093376 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71157903-725f-4b93-82d1-1e7507432f1a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:53.110842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e668f894-3050-4ddf-bbaa-f65f332a577c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:53.121491 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e668f894-3050-4ddf-bbaa-f65f332a577c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1268 microversion: 2.1 time: 0.192426 May 28 04:39:53.131196 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 833/1583] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:52 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1268 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:53.138386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-1eb599b3-13ae-462f-befd-261b7dcac4f0 req-06e6b6a6-0be1-4c3b-a2e7-bdeae8ad6433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2879396-59ef-44c3-ba44-5626191ec11e", "tag": "2c964bd0-98e9-472c-a6fe-946d0b7b8704"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:53.146968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-1eb599b3-13ae-462f-befd-261b7dcac4f0 req-06e6b6a6-0be1-4c3b-a2e7-bdeae8ad6433 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:53.147968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-1eb599b3-13ae-462f-befd-261b7dcac4f0 req-06e6b6a6-0be1-4c3b-a2e7-bdeae8ad6433 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:53.172585 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-1eb599b3-13ae-462f-befd-261b7dcac4f0 req-06e6b6a6-0be1-4c3b-a2e7-bdeae8ad6433 service nova] Creating event network-changed:2c964bd0-98e9-472c-a6fe-946d0b7b8704 for instance b2879396-59ef-44c3-ba44-5626191ec11e on n-h2-843700-1 May 28 04:39:53.192322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-1eb599b3-13ae-462f-befd-261b7dcac4f0 req-06e6b6a6-0be1-4c3b-a2e7-bdeae8ad6433 service nova] Instance b2879396-59ef-44c3-ba44-5626191ec11e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:39:53.230461 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-1eb599b3-13ae-462f-befd-261b7dcac4f0 req-06e6b6a6-0be1-4c3b-a2e7-bdeae8ad6433 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097060 May 28 04:39:53.232494 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 834/1584] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:53.256029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-26929b1b-ccfd-4bf4-b51d-5976ee3ee297 req-efeace45-e2a5-455c-b8a0-f73710273e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2fe6e3-8187-4ba2-b31d-10b4f602b332", "name": "network-vif-plugged", "status": "completed", "tag": "3031f11b-74bc-424b-8498-fb24d06f2874"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:53.266584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-26929b1b-ccfd-4bf4-b51d-5976ee3ee297 req-efeace45-e2a5-455c-b8a0-f73710273e7d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:53.277724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-26929b1b-ccfd-4bf4-b51d-5976ee3ee297 req-efeace45-e2a5-455c-b8a0-f73710273e7d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:53.307419 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-26929b1b-ccfd-4bf4-b51d-5976ee3ee297 req-efeace45-e2a5-455c-b8a0-f73710273e7d service nova] Creating event network-vif-plugged:3031f11b-74bc-424b-8498-fb24d06f2874 for instance ac2fe6e3-8187-4ba2-b31d-10b4f602b332 on n-h2-843700-1 May 28 04:39:53.320328 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-26929b1b-ccfd-4bf4-b51d-5976ee3ee297 req-efeace45-e2a5-455c-b8a0-f73710273e7d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084756 May 28 04:39:53.321673 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 835/1585] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:53.483066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-71157903-725f-4b93-82d1-1e7507432f1a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:53.496940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-71157903-725f-4b93-82d1-1e7507432f1a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:53.500175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-71157903-725f-4b93-82d1-1e7507432f1a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:53.502950 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-71157903-725f-4b93-82d1-1e7507432f1a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.449031 May 28 04:39:53.515341 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 751/1586] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:39:53 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:39:53.584664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0ac442bd-b4ac-441d-875b-54b2e1a9cd77 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:53.586320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0ac442bd-b4ac-441d-875b-54b2e1a9cd77 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:53.595728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ac442bd-b4ac-441d-875b-54b2e1a9cd77 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:53.596591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ac442bd-b4ac-441d-875b-54b2e1a9cd77 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:53.598387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ac442bd-b4ac-441d-875b-54b2e1a9cd77 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:53.599069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ac442bd-b4ac-441d-875b-54b2e1a9cd77 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:53.677340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-282fb580-798e-48b6-acb3-56165fd6e8ad tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:53.679491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-282fb580-798e-48b6-acb3-56165fd6e8ad tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:53.695100 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-282fb580-798e-48b6-acb3-56165fd6e8ad tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:53.700750 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-282fb580-798e-48b6-acb3-56165fd6e8ad tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:53.702239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-282fb580-798e-48b6-acb3-56165fd6e8ad tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:53.704555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-282fb580-798e-48b6-acb3-56165fd6e8ad tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:54.080391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0ac442bd-b4ac-441d-875b-54b2e1a9cd77 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:54.087308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-282fb580-798e-48b6-acb3-56165fd6e8ad tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:54.090627 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0ac442bd-b4ac-441d-875b-54b2e1a9cd77 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1469 microversion: 2.1 time: 0.512358 May 28 04:39:54.101469 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-282fb580-798e-48b6-acb3-56165fd6e8ad tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1199 microversion: 2.1 time: 0.434184 May 28 04:39:54.103824 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 836/1587] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:53 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1469 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:54.124463 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 752/1588] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:53 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1199 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:54.125372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f83b5f54-643b-4889-a2d8-33183b6a086e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:54.125372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f83b5f54-643b-4889-a2d8-33183b6a086e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:54.136599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f83b5f54-643b-4889-a2d8-33183b6a086e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:54.137861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f83b5f54-643b-4889-a2d8-33183b6a086e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:54.139331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f83b5f54-643b-4889-a2d8-33183b6a086e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:54.140079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-92fe63ca-bdc7-4c12-bbee-e62934b26504 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:54.140924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-92fe63ca-bdc7-4c12-bbee-e62934b26504 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:54.141640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f83b5f54-643b-4889-a2d8-33183b6a086e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:54.160576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-92fe63ca-bdc7-4c12-bbee-e62934b26504 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:54.161044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-92fe63ca-bdc7-4c12-bbee-e62934b26504 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:54.161840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-92fe63ca-bdc7-4c12-bbee-e62934b26504 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:54.166488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-92fe63ca-bdc7-4c12-bbee-e62934b26504 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:54.499161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f83b5f54-643b-4889-a2d8-33183b6a086e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:54.504604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-92fe63ca-bdc7-4c12-bbee-e62934b26504 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18e3755f97184714b26326adebbe1f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01907ddfb9d54b159d84a63586b8338f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:54.511508 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f83b5f54-643b-4889-a2d8-33183b6a086e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f" status: 200 len: 1317 microversion: 2.1 time: 0.406406 May 28 04:39:54.512177 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 837/1589] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:54 2022] GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:54.516234 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-92fe63ca-bdc7-4c12-bbee-e62934b26504 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79" status: 200 len: 1402 microversion: 2.1 time: 0.401007 May 28 04:39:54.527814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-25c8fe4e-1fd2-45d5-954b-ac844719e79f tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:54.528321 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 753/1590] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:54 2022] GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79 => generated 1402 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:54.528415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-25c8fe4e-1fd2-45d5-954b-ac844719e79f tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:54.534361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7600a1db-e5de-4499-979f-b81411f26085 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:54.535102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7600a1db-e5de-4499-979f-b81411f26085 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:54.541874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7600a1db-e5de-4499-979f-b81411f26085 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:54.544427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7600a1db-e5de-4499-979f-b81411f26085 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:54.545273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7600a1db-e5de-4499-979f-b81411f26085 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:54.545963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7600a1db-e5de-4499-979f-b81411f26085 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:54.561172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25c8fe4e-1fd2-45d5-954b-ac844719e79f tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:54.562007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25c8fe4e-1fd2-45d5-954b-ac844719e79f tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:54.563101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25c8fe4e-1fd2-45d5-954b-ac844719e79f tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:54.563740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25c8fe4e-1fd2-45d5-954b-ac844719e79f tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:54.672471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-25c8fe4e-1fd2-45d5-954b-ac844719e79f tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:54.681807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:54.687725 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-25c8fe4e-1fd2-45d5-954b-ac844719e79f tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1274 microversion: 2.1 time: 0.172220 May 28 04:39:54.689768 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 838/1591] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:54 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1274 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:54.786124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7600a1db-e5de-4499-979f-b81411f26085 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:54.796889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7600a1db-e5de-4499-979f-b81411f26085 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:54.798737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7600a1db-e5de-4499-979f-b81411f26085 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:54.800264 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7600a1db-e5de-4499-979f-b81411f26085 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.279740 May 28 04:39:54.804215 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 754/1592] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:39:54 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:39:55.110034 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2d4da6fa-545e-434d-8ee8-abf484dba927 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:55.111225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2d4da6fa-545e-434d-8ee8-abf484dba927 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:55.119120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d4da6fa-545e-434d-8ee8-abf484dba927 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:55.120064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d4da6fa-545e-434d-8ee8-abf484dba927 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:55.125246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d4da6fa-545e-434d-8ee8-abf484dba927 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:55.125246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d4da6fa-545e-434d-8ee8-abf484dba927 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:55.140247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3b0805fc-dd7e-4da2-9c88-76a2a6ab8654 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:55.141220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3b0805fc-dd7e-4da2-9c88-76a2a6ab8654 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:55.151002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b0805fc-dd7e-4da2-9c88-76a2a6ab8654 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:55.154052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b0805fc-dd7e-4da2-9c88-76a2a6ab8654 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:55.154052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b0805fc-dd7e-4da2-9c88-76a2a6ab8654 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:55.154052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b0805fc-dd7e-4da2-9c88-76a2a6ab8654 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:55.436102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2d4da6fa-545e-434d-8ee8-abf484dba927 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:55.437327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3b0805fc-dd7e-4da2-9c88-76a2a6ab8654 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:55.446272 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3b0805fc-dd7e-4da2-9c88-76a2a6ab8654 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1199 microversion: 2.1 time: 0.312800 May 28 04:39:55.446874 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 755/1593] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:55 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1199 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:39:55.463654 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2d4da6fa-545e-434d-8ee8-abf484dba927 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1462 microversion: 2.1 time: 0.357908 May 28 04:39:55.468391 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 839/1594] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:55 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1462 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:55.492361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-abe78618-37b8-4c48-9b69-4bf30be4f3f8 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:55.497976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-abe78618-37b8-4c48-9b69-4bf30be4f3f8 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:55.514152 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abe78618-37b8-4c48-9b69-4bf30be4f3f8 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:55.515098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abe78618-37b8-4c48-9b69-4bf30be4f3f8 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:55.516211 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abe78618-37b8-4c48-9b69-4bf30be4f3f8 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:55.518238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abe78618-37b8-4c48-9b69-4bf30be4f3f8 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:55.537595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d274f6f3-79ae-4ce3-820d-7dc14fd4df93 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:55.538469 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d274f6f3-79ae-4ce3-820d-7dc14fd4df93 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:55.568015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d274f6f3-79ae-4ce3-820d-7dc14fd4df93 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:55.568015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d274f6f3-79ae-4ce3-820d-7dc14fd4df93 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:55.568621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d274f6f3-79ae-4ce3-820d-7dc14fd4df93 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:55.569537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d274f6f3-79ae-4ce3-820d-7dc14fd4df93 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:55.733777 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-abe78618-37b8-4c48-9b69-4bf30be4f3f8 tempest-MigrationsAdminTest-930472004 tempest-MigrationsAdminTest-930472004-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1613 microversion: 2.1 time: 0.256469 May 28 04:39:55.738951 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 756/1595] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:55 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1613 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:39:55.759724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-997edea8-669c-4910-9cd0-5c3ce41d4f15 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:55.761256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-997edea8-669c-4910-9cd0-5c3ce41d4f15 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:55.768260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-997edea8-669c-4910-9cd0-5c3ce41d4f15 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:55.768976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-997edea8-669c-4910-9cd0-5c3ce41d4f15 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:55.770017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-997edea8-669c-4910-9cd0-5c3ce41d4f15 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:55.770700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-997edea8-669c-4910-9cd0-5c3ce41d4f15 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:55.888505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d274f6f3-79ae-4ce3-820d-7dc14fd4df93 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:55.897867 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d274f6f3-79ae-4ce3-820d-7dc14fd4df93 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f" status: 200 len: 1317 microversion: 2.1 time: 0.365316 May 28 04:39:55.899910 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 840/1596] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:55 2022] GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:55.907405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1c2c1715-4f1b-4e64-94b6-668ab8837274 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:55.908629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1c2c1715-4f1b-4e64-94b6-668ab8837274 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:55.922371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1c2c1715-4f1b-4e64-94b6-668ab8837274 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:55.922371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1c2c1715-4f1b-4e64-94b6-668ab8837274 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:55.922371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1c2c1715-4f1b-4e64-94b6-668ab8837274 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:55.922947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1c2c1715-4f1b-4e64-94b6-668ab8837274 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:56.080288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-997edea8-669c-4910-9cd0-5c3ce41d4f15 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18e3755f97184714b26326adebbe1f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01907ddfb9d54b159d84a63586b8338f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:56.093726 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-997edea8-669c-4910-9cd0-5c3ce41d4f15 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79" status: 200 len: 1402 microversion: 2.1 time: 0.337882 May 28 04:39:56.103689 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 757/1597] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:55 2022] GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79 => generated 1402 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:56.108720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6ec55746-ebe9-4db4-9e7b-3485adf3f438 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:56.109167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6ec55746-ebe9-4db4-9e7b-3485adf3f438 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:56.132982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ec55746-ebe9-4db4-9e7b-3485adf3f438 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:56.133934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ec55746-ebe9-4db4-9e7b-3485adf3f438 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:56.135060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ec55746-ebe9-4db4-9e7b-3485adf3f438 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:56.135060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ec55746-ebe9-4db4-9e7b-3485adf3f438 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:56.169047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6ec55746-ebe9-4db4-9e7b-3485adf3f438 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:39:56.218841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1c2c1715-4f1b-4e64-94b6-668ab8837274 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:56.243580 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1c2c1715-4f1b-4e64-94b6-668ab8837274 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1316 microversion: 2.1 time: 0.342181 May 28 04:39:56.245182 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 841/1598] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:55 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:56.259613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-adafb69a-bce7-4f81-9748-e51df4bf2468 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:56.260446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-adafb69a-bce7-4f81-9748-e51df4bf2468 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:56.277399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-adafb69a-bce7-4f81-9748-e51df4bf2468 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:56.278776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-adafb69a-bce7-4f81-9748-e51df4bf2468 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:56.280288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-adafb69a-bce7-4f81-9748-e51df4bf2468 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:56.281043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-adafb69a-bce7-4f81-9748-e51df4bf2468 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:56.564075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-adafb69a-bce7-4f81-9748-e51df4bf2468 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:56.576631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-adafb69a-bce7-4f81-9748-e51df4bf2468 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:56.578485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-adafb69a-bce7-4f81-9748-e51df4bf2468 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:56.579898 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-adafb69a-bce7-4f81-9748-e51df4bf2468 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.332837 May 28 04:39:56.580912 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 842/1599] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:39:56 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:39:56.592976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-d559c96a-2b08-42de-a56d-598ee4795345 req-78cfaefd-bf11-4fc9-8fc2-2e0d43ed38cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6099edfb-c389-4614-937f-11b41943ed79", "name": "network-vif-plugged", "status": "completed", "tag": "b1318bdd-cad5-4bc2-9aa4-fd6b51949f14"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:56.602833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d559c96a-2b08-42de-a56d-598ee4795345 req-78cfaefd-bf11-4fc9-8fc2-2e0d43ed38cb service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:56.605996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d559c96a-2b08-42de-a56d-598ee4795345 req-78cfaefd-bf11-4fc9-8fc2-2e0d43ed38cb service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:56.622669 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-d559c96a-2b08-42de-a56d-598ee4795345 req-78cfaefd-bf11-4fc9-8fc2-2e0d43ed38cb service nova] Creating event network-vif-plugged:b1318bdd-cad5-4bc2-9aa4-fd6b51949f14 for instance 6099edfb-c389-4614-937f-11b41943ed79 on n-h1-843700-1 May 28 04:39:56.631061 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-d559c96a-2b08-42de-a56d-598ee4795345 req-78cfaefd-bf11-4fc9-8fc2-2e0d43ed38cb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048603 May 28 04:39:56.635935 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 843/1600] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:56.645839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1ae73296-9f7b-4679-bb43-339e4e221390 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:56.650070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1ae73296-9f7b-4679-bb43-339e4e221390 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:56.654249 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6ec55746-ebe9-4db4-9e7b-3485adf3f438 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 204 len: 0 microversion: 2.1 time: 0.549132 May 28 04:39:56.654844 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 758/1601] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:39:56 2022] DELETE /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:39:56.664330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-84d23ec6-7c75-46c2-b6ea-2d4df0655dd5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:56.665062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-84d23ec6-7c75-46c2-b6ea-2d4df0655dd5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:56.668901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ae73296-9f7b-4679-bb43-339e4e221390 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:56.673153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ae73296-9f7b-4679-bb43-339e4e221390 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:56.673153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ae73296-9f7b-4679-bb43-339e4e221390 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:56.673153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ae73296-9f7b-4679-bb43-339e4e221390 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:56.674045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84d23ec6-7c75-46c2-b6ea-2d4df0655dd5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:56.679619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84d23ec6-7c75-46c2-b6ea-2d4df0655dd5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:56.680742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84d23ec6-7c75-46c2-b6ea-2d4df0655dd5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:56.682414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84d23ec6-7c75-46c2-b6ea-2d4df0655dd5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:57.039915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-84d23ec6-7c75-46c2-b6ea-2d4df0655dd5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:57.039915 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-84d23ec6-7c75-46c2-b6ea-2d4df0655dd5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1468 microversion: 2.1 time: 0.354285 May 28 04:39:57.039915 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 759/1602] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:56 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1468 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:39:57.039915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6fe42500-81d8-4a7f-af91-1bf79dee8b21 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:57.040437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6fe42500-81d8-4a7f-af91-1bf79dee8b21 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:57.040437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6fe42500-81d8-4a7f-af91-1bf79dee8b21 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:57.040437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6fe42500-81d8-4a7f-af91-1bf79dee8b21 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:57.040437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6fe42500-81d8-4a7f-af91-1bf79dee8b21 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:57.040752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6fe42500-81d8-4a7f-af91-1bf79dee8b21 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:57.040829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1ae73296-9f7b-4679-bb43-339e4e221390 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:57.054611 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1ae73296-9f7b-4679-bb43-339e4e221390 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1383 microversion: 2.1 time: 0.416842 May 28 04:39:57.055523 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 844/1603] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:56 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1383 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:57.073068 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d8e02b1e-3476-478a-bbba-65bc8bbba63d tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:57.074919 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d8e02b1e-3476-478a-bbba-65bc8bbba63d tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:57.085196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8e02b1e-3476-478a-bbba-65bc8bbba63d tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:57.086825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8e02b1e-3476-478a-bbba-65bc8bbba63d tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:57.088653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8e02b1e-3476-478a-bbba-65bc8bbba63d tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:57.090494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8e02b1e-3476-478a-bbba-65bc8bbba63d tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:57.261754 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6fe42500-81d8-4a7f-af91-1bf79dee8b21 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:57.267960 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6fe42500-81d8-4a7f-af91-1bf79dee8b21 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f" status: 200 len: 1317 microversion: 2.1 time: 0.252689 May 28 04:39:57.269759 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 760/1604] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:57 2022] GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:57.277704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5b8699fe-2267-4805-a535-0ade3770cab7 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:57.278434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5b8699fe-2267-4805-a535-0ade3770cab7 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:57.285119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5b8699fe-2267-4805-a535-0ade3770cab7 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:57.285706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5b8699fe-2267-4805-a535-0ade3770cab7 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:57.286839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5b8699fe-2267-4805-a535-0ade3770cab7 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:57.287382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5b8699fe-2267-4805-a535-0ade3770cab7 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:57.320891 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d8e02b1e-3476-478a-bbba-65bc8bbba63d tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1534 microversion: 2.1 time: 0.252412 May 28 04:39:57.332576 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 845/1605] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:57 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1534 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:39:57.333571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1f0c7bb0-ecbb-406d-916f-93a71ec48aaf tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:57.334365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1f0c7bb0-ecbb-406d-916f-93a71ec48aaf tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:57.368768 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f0c7bb0-ecbb-406d-916f-93a71ec48aaf tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:57.369611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f0c7bb0-ecbb-406d-916f-93a71ec48aaf tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:57.371812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f0c7bb0-ecbb-406d-916f-93a71ec48aaf tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:57.372566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f0c7bb0-ecbb-406d-916f-93a71ec48aaf tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:57.638062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5b8699fe-2267-4805-a535-0ade3770cab7 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18e3755f97184714b26326adebbe1f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01907ddfb9d54b159d84a63586b8338f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:57.648022 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5b8699fe-2267-4805-a535-0ade3770cab7 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79" status: 200 len: 1402 microversion: 2.1 time: 0.375790 May 28 04:39:57.650702 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 761/1606] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:57 2022] GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79 => generated 1402 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:57.656687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2e223301-f3ad-462f-ad42-aa18d7aa87aa tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:57.661272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1f0c7bb0-ecbb-406d-916f-93a71ec48aaf tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:57.665562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2e223301-f3ad-462f-ad42-aa18d7aa87aa tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:57.672420 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1f0c7bb0-ecbb-406d-916f-93a71ec48aaf tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1316 microversion: 2.1 time: 0.347564 May 28 04:39:57.674363 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 846/1607] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:57 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1316 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:57.681401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2e223301-f3ad-462f-ad42-aa18d7aa87aa tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:57.684922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2e223301-f3ad-462f-ad42-aa18d7aa87aa tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:57.686041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-14cf2131-f041-432b-9641-c8eae87dfd5e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:57.689166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2e223301-f3ad-462f-ad42-aa18d7aa87aa tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:57.689895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2e223301-f3ad-462f-ad42-aa18d7aa87aa tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:57.690170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-14cf2131-f041-432b-9641-c8eae87dfd5e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:57.706041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14cf2131-f041-432b-9641-c8eae87dfd5e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:57.706861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14cf2131-f041-432b-9641-c8eae87dfd5e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:57.708294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14cf2131-f041-432b-9641-c8eae87dfd5e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:57.708980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14cf2131-f041-432b-9641-c8eae87dfd5e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:57.975517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-14cf2131-f041-432b-9641-c8eae87dfd5e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:58.008013 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-14cf2131-f041-432b-9641-c8eae87dfd5e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:58.012770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-14cf2131-f041-432b-9641-c8eae87dfd5e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:58.018011 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-14cf2131-f041-432b-9641-c8eae87dfd5e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.339315 May 28 04:39:58.022379 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 847/1608] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:39:57 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:39:58.041543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4abf2c10-7496-4368-8413-df4c070c9433 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:58.043973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4abf2c10-7496-4368-8413-df4c070c9433 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:58.046743 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2e223301-f3ad-462f-ad42-aa18d7aa87aa tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1534 microversion: 2.1 time: 0.393810 May 28 04:39:58.052801 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 762/1609] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:57 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1534 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:58.055022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:58.065467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-360349c3-bf48-4388-bef5-725342da92f5 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:58.070861 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:39:58.070861 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:39:58.070861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-360349c3-bf48-4388-bef5-725342da92f5 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:58.070861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-360349c3-bf48-4388-bef5-725342da92f5 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:58.070861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-360349c3-bf48-4388-bef5-725342da92f5 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:58.072128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-360349c3-bf48-4388-bef5-725342da92f5 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:58.074920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4abf2c10-7496-4368-8413-df4c070c9433 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:58.077404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4abf2c10-7496-4368-8413-df4c070c9433 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:58.078965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4abf2c10-7496-4368-8413-df4c070c9433 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:58.080980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4abf2c10-7496-4368-8413-df4c070c9433 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:58.084455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:58.109620 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-360349c3-bf48-4388-bef5-725342da92f5 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.048007 May 28 04:39:58.117477 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 763/1610] 10.222.0.58 () {58 vars in 1175 bytes} [Sat May 28 04:39:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:39:58.345839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4abf2c10-7496-4368-8413-df4c070c9433 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:58.362040 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4abf2c10-7496-4368-8413-df4c070c9433 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1468 microversion: 2.1 time: 0.328248 May 28 04:39:58.362040 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 848/1611] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:58 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1468 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:58.380786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6a50373c-eb53-4962-a2ff-151f05e5c9c9 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843700-1", "block_migration": false, "disk_over_commit": false}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:58.385752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6a50373c-eb53-4962-a2ff-151f05e5c9c9 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:58.400431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a50373c-eb53-4962-a2ff-151f05e5c9c9 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:58.402090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a50373c-eb53-4962-a2ff-151f05e5c9c9 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:58.403178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a50373c-eb53-4962-a2ff-151f05e5c9c9 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:58.403639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a50373c-eb53-4962-a2ff-151f05e5c9c9 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:58.430802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-dbe2523d-4201-429f-8774-fc14d1bc33e4 req-73916f1f-5af4-4bc2-9cbf-4fbe67e5ece8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54045fbc-26d8-48c2-a385-c62ee2e4e1ed", "tag": "4be01961-66da-42a9-8515-382ddd7b2e3e"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:58.443171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-dbe2523d-4201-429f-8774-fc14d1bc33e4 req-73916f1f-5af4-4bc2-9cbf-4fbe67e5ece8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:58.443917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-dbe2523d-4201-429f-8774-fc14d1bc33e4 req-73916f1f-5af4-4bc2-9cbf-4fbe67e5ece8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:58.456739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-6a50373c-eb53-4962-a2ff-151f05e5c9c9 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lazy-loading 'flavor' on Instance uuid ac2fe6e3-8187-4ba2-b31d-10b4f602b332 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:39:58.458211 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-dbe2523d-4201-429f-8774-fc14d1bc33e4 req-73916f1f-5af4-4bc2-9cbf-4fbe67e5ece8 service nova] Creating event network-changed:4be01961-66da-42a9-8515-382ddd7b2e3e for instance 54045fbc-26d8-48c2-a385-c62ee2e4e1ed on n-h1-843700-1 May 28 04:39:58.470817 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-dbe2523d-4201-429f-8774-fc14d1bc33e4 req-73916f1f-5af4-4bc2-9cbf-4fbe67e5ece8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.352118 May 28 04:39:58.472145 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 764/1612] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:58.478290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6a50373c-eb53-4962-a2ff-151f05e5c9c9 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Going to try to live migrate instance to n-h1-843700-1 {{(pid=126044) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 28 04:39:58.487812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0380b369-a99f-4b1e-969a-6f67bb434427 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:58.487812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0380b369-a99f-4b1e-969a-6f67bb434427 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:58.492452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0380b369-a99f-4b1e-969a-6f67bb434427 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:58.493123 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0380b369-a99f-4b1e-969a-6f67bb434427 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:58.494340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0380b369-a99f-4b1e-969a-6f67bb434427 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:58.495372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0380b369-a99f-4b1e-969a-6f67bb434427 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:58.710373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0380b369-a99f-4b1e-969a-6f67bb434427 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:58.718954 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0380b369-a99f-4b1e-969a-6f67bb434427 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f" status: 200 len: 1317 microversion: 2.1 time: 0.244930 May 28 04:39:58.722323 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 765/1613] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:58 2022] GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:58.724878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-8cc2aa5f-02bc-43b9-8684-319e64f942b2 req-b31b9eae-07fa-43f3-8512-9046b43eda2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d337611-9c22-48c2-99e7-8dc13d7dbe6f", "name": "network-vif-plugged", "status": "completed", "tag": "3257acbd-81a4-4090-9a76-6394762da82c"}, {"server_uuid": "b2879396-59ef-44c3-ba44-5626191ec11e", "name": "network-vif-plugged", "status": "completed", "tag": "2c964bd0-98e9-472c-a6fe-946d0b7b8704"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:39:58.735205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8cc2aa5f-02bc-43b9-8684-319e64f942b2 req-b31b9eae-07fa-43f3-8512-9046b43eda2a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:58.735657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8cc2aa5f-02bc-43b9-8684-319e64f942b2 req-b31b9eae-07fa-43f3-8512-9046b43eda2a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:58.751222 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-8cc2aa5f-02bc-43b9-8684-319e64f942b2 req-b31b9eae-07fa-43f3-8512-9046b43eda2a service nova] Creating event network-vif-plugged:3257acbd-81a4-4090-9a76-6394762da82c for instance 6d337611-9c22-48c2-99e7-8dc13d7dbe6f on n-h2-843700-1 May 28 04:39:58.756173 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-8cc2aa5f-02bc-43b9-8684-319e64f942b2 req-b31b9eae-07fa-43f3-8512-9046b43eda2a service nova] Creating event network-vif-plugged:2c964bd0-98e9-472c-a6fe-946d0b7b8704 for instance b2879396-59ef-44c3-ba44-5626191ec11e on n-h2-843700-1 May 28 04:39:58.758920 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-8cc2aa5f-02bc-43b9-8684-319e64f942b2 req-b31b9eae-07fa-43f3-8512-9046b43eda2a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038048 May 28 04:39:58.763655 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 766/1614] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:58.768929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-883aa93e-7458-43ce-ac86-1f23a0344cff tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:58.769601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-883aa93e-7458-43ce-ac86-1f23a0344cff tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:58.791193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-883aa93e-7458-43ce-ac86-1f23a0344cff tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:58.791948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-883aa93e-7458-43ce-ac86-1f23a0344cff tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:58.793503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-883aa93e-7458-43ce-ac86-1f23a0344cff tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:58.794126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-883aa93e-7458-43ce-ac86-1f23a0344cff tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:58.992266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-883aa93e-7458-43ce-ac86-1f23a0344cff tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18e3755f97184714b26326adebbe1f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01907ddfb9d54b159d84a63586b8338f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:59.005668 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-883aa93e-7458-43ce-ac86-1f23a0344cff tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79" status: 200 len: 1588 microversion: 2.1 time: 0.236437 May 28 04:39:59.005668 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 767/1615] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:58 2022] GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79 => generated 1588 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:59.007314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8c793c71-c2cf-4a09-a0cc-d114ed77aa69 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:59.007932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8c793c71-c2cf-4a09-a0cc-d114ed77aa69 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:59.014300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c793c71-c2cf-4a09-a0cc-d114ed77aa69 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:59.015033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c793c71-c2cf-4a09-a0cc-d114ed77aa69 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:59.016179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c793c71-c2cf-4a09-a0cc-d114ed77aa69 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:59.016633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c793c71-c2cf-4a09-a0cc-d114ed77aa69 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:59.179549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8c793c71-c2cf-4a09-a0cc-d114ed77aa69 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:59.195511 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8c793c71-c2cf-4a09-a0cc-d114ed77aa69 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1316 microversion: 2.1 time: 0.190550 May 28 04:39:59.197962 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 768/1616] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:59 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:39:59.204954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ba91db14-e44b-4423-aa0b-f5f1d8c8b1ba tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:59.205849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ba91db14-e44b-4423-aa0b-f5f1d8c8b1ba tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:59.216134 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba91db14-e44b-4423-aa0b-f5f1d8c8b1ba tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:59.216748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba91db14-e44b-4423-aa0b-f5f1d8c8b1ba tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:59.218031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba91db14-e44b-4423-aa0b-f5f1d8c8b1ba tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:59.219063 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba91db14-e44b-4423-aa0b-f5f1d8c8b1ba tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:59.325452 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ba91db14-e44b-4423-aa0b-f5f1d8c8b1ba tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125085 May 28 04:39:59.327194 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 769/1617] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 04:39:59 2022] GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:39:59.332898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-96792293-10b9-47fc-bc4c-adb186ca8197 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:59.333544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-96792293-10b9-47fc-bc4c-adb186ca8197 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:59.350853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-96792293-10b9-47fc-bc4c-adb186ca8197 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:59.351508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-96792293-10b9-47fc-bc4c-adb186ca8197 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:59.352567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-96792293-10b9-47fc-bc4c-adb186ca8197 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:59.353365 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-96792293-10b9-47fc-bc4c-adb186ca8197 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:59.463432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:39:59.687911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-96792293-10b9-47fc-bc4c-adb186ca8197 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:59.701756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-96792293-10b9-47fc-bc4c-adb186ca8197 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:59.704411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-96792293-10b9-47fc-bc4c-adb186ca8197 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:59.706016 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-96792293-10b9-47fc-bc4c-adb186ca8197 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.377529 May 28 04:39:59.706591 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 770/1618] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:39:59 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:39:59.712572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ed3487fa-b8e7-4a53-adf7-5e4e52c5eeb1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:39:59.713481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ed3487fa-b8e7-4a53-adf7-5e4e52c5eeb1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:39:59.721117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ed3487fa-b8e7-4a53-adf7-5e4e52c5eeb1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:59.721327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ed3487fa-b8e7-4a53-adf7-5e4e52c5eeb1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:59.722103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ed3487fa-b8e7-4a53-adf7-5e4e52c5eeb1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:39:59.722708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ed3487fa-b8e7-4a53-adf7-5e4e52c5eeb1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:39:59.987746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ed3487fa-b8e7-4a53-adf7-5e4e52c5eeb1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:39:59.996246 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ed3487fa-b8e7-4a53-adf7-5e4e52c5eeb1 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1468 microversion: 2.1 time: 0.287889 May 28 04:39:59.996831 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 771/1619] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:59 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1468 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:00.001876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3e86228f-a106-4372-a053-181c52f0b7ce tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:00.002515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3e86228f-a106-4372-a053-181c52f0b7ce tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:00.010400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e86228f-a106-4372-a053-181c52f0b7ce tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:00.011405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e86228f-a106-4372-a053-181c52f0b7ce tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:00.012216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e86228f-a106-4372-a053-181c52f0b7ce tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:00.012659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e86228f-a106-4372-a053-181c52f0b7ce tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:00.166239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3e86228f-a106-4372-a053-181c52f0b7ce tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:00.174667 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3e86228f-a106-4372-a053-181c52f0b7ce tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f" status: 200 len: 1317 microversion: 2.1 time: 0.176595 May 28 04:40:00.175580 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 772/1620] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:39:59 2022] GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:00.217077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-09a2d4ee-4ff5-4d4c-bee9-3964a40c884b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:00.218508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-09a2d4ee-4ff5-4d4c-bee9-3964a40c884b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:00.225048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09a2d4ee-4ff5-4d4c-bee9-3964a40c884b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:00.225816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09a2d4ee-4ff5-4d4c-bee9-3964a40c884b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:00.226686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09a2d4ee-4ff5-4d4c-bee9-3964a40c884b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:00.227636 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09a2d4ee-4ff5-4d4c-bee9-3964a40c884b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:00.449810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-09a2d4ee-4ff5-4d4c-bee9-3964a40c884b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:00.458541 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-09a2d4ee-4ff5-4d4c-bee9-3964a40c884b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1316 microversion: 2.1 time: 0.246261 May 28 04:40:00.463572 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 773/1621] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:00 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:40:00.702153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-4317af46-e713-44e7-9b67-083f5cc99624 req-9ab10418-4bf6-41dc-a68a-97d3c35c253e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2879396-59ef-44c3-ba44-5626191ec11e", "name": "network-vif-deleted", "tag": "2c964bd0-98e9-472c-a6fe-946d0b7b8704"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:00.718939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4317af46-e713-44e7-9b67-083f5cc99624 req-9ab10418-4bf6-41dc-a68a-97d3c35c253e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:00.722926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4317af46-e713-44e7-9b67-083f5cc99624 req-9ab10418-4bf6-41dc-a68a-97d3c35c253e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:00.746251 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-4317af46-e713-44e7-9b67-083f5cc99624 req-9ab10418-4bf6-41dc-a68a-97d3c35c253e service nova] Creating event network-vif-deleted:2c964bd0-98e9-472c-a6fe-946d0b7b8704 for instance b2879396-59ef-44c3-ba44-5626191ec11e on n-h2-843700-1 May 28 04:40:00.760887 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-4317af46-e713-44e7-9b67-083f5cc99624 req-9ab10418-4bf6-41dc-a68a-97d3c35c253e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063390 May 28 04:40:00.771998 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 774/1622] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:40:00.771998 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-325bb6ec-ec8f-4ff8-8ea9-880ac33a9943 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:00.773789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-325bb6ec-ec8f-4ff8-8ea9-880ac33a9943 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:00.794934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-325bb6ec-ec8f-4ff8-8ea9-880ac33a9943 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:00.803231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-325bb6ec-ec8f-4ff8-8ea9-880ac33a9943 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:00.803231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-325bb6ec-ec8f-4ff8-8ea9-880ac33a9943 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:00.803231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-325bb6ec-ec8f-4ff8-8ea9-880ac33a9943 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:01.014567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:01.154795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-325bb6ec-ec8f-4ff8-8ea9-880ac33a9943 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:01.165137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-325bb6ec-ec8f-4ff8-8ea9-880ac33a9943 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:01.168069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-325bb6ec-ec8f-4ff8-8ea9-880ac33a9943 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:01.175149 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-325bb6ec-ec8f-4ff8-8ea9-880ac33a9943 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.406022 May 28 04:40:01.175149 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 775/1623] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:40:00 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:40:01.182540 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-775d6a7b-eeb6-4b84-923a-3ab1bcecb8e8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:01.184006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-775d6a7b-eeb6-4b84-923a-3ab1bcecb8e8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:01.195802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-775d6a7b-eeb6-4b84-923a-3ab1bcecb8e8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:01.196294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-775d6a7b-eeb6-4b84-923a-3ab1bcecb8e8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:01.198713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-775d6a7b-eeb6-4b84-923a-3ab1bcecb8e8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:01.199330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-775d6a7b-eeb6-4b84-923a-3ab1bcecb8e8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:01.247164 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-775d6a7b-eeb6-4b84-923a-3ab1bcecb8e8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:01.247675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-775d6a7b-eeb6-4b84-923a-3ab1bcecb8e8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:01.248139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-775d6a7b-eeb6-4b84-923a-3ab1bcecb8e8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lazy-loading 'fault' on Instance uuid b2879396-59ef-44c3-ba44-5626191ec11e {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:40:01.318553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-775d6a7b-eeb6-4b84-923a-3ab1bcecb8e8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:01.323254 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-775d6a7b-eeb6-4b84-923a-3ab1bcecb8e8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 200 len: 1303 microversion: 2.1 time: 0.150534 May 28 04:40:01.333816 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 776/1624] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:01 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 1303 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:01.354328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8e3c8584-13be-4c62-9fde-a4214e3c79b3 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:01.354328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8e3c8584-13be-4c62-9fde-a4214e3c79b3 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:01.354328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e3c8584-13be-4c62-9fde-a4214e3c79b3 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:01.354328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e3c8584-13be-4c62-9fde-a4214e3c79b3 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:01.355496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e3c8584-13be-4c62-9fde-a4214e3c79b3 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:01.355496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e3c8584-13be-4c62-9fde-a4214e3c79b3 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:01.984981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8e3c8584-13be-4c62-9fde-a4214e3c79b3 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:02.000127 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8e3c8584-13be-4c62-9fde-a4214e3c79b3 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f" status: 200 len: 1467 microversion: 2.1 time: 0.664860 May 28 04:40:02.001647 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 777/1625] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:01 2022] GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f => generated 1467 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:02.009063 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b8db40d3-a61f-440b-b2bc-4ca72f00c24c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:02.010002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b8db40d3-a61f-440b-b2bc-4ca72f00c24c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:02.017993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8db40d3-a61f-440b-b2bc-4ca72f00c24c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:02.019061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8db40d3-a61f-440b-b2bc-4ca72f00c24c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:02.020104 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8db40d3-a61f-440b-b2bc-4ca72f00c24c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:02.020705 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8db40d3-a61f-440b-b2bc-4ca72f00c24c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:02.499830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b8db40d3-a61f-440b-b2bc-4ca72f00c24c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:02.516248 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b8db40d3-a61f-440b-b2bc-4ca72f00c24c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1316 microversion: 2.1 time: 0.512098 May 28 04:40:02.521956 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 778/1626] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:02 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1316 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:02.529641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-491c337c-b062-4aee-a5fe-c69de9b1b0a1 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:02.530259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-491c337c-b062-4aee-a5fe-c69de9b1b0a1 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:02.542501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-491c337c-b062-4aee-a5fe-c69de9b1b0a1 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:02.544884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-491c337c-b062-4aee-a5fe-c69de9b1b0a1 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:02.545923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-491c337c-b062-4aee-a5fe-c69de9b1b0a1 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:02.546416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-491c337c-b062-4aee-a5fe-c69de9b1b0a1 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:02.825533 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-491c337c-b062-4aee-a5fe-c69de9b1b0a1 tempest-ServersOnMultiNodesTest-2145509727 tempest-ServersOnMultiNodesTest-2145509727-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f" status: 200 len: 1618 microversion: 2.1 time: 0.307600 May 28 04:40:02.831474 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 779/1627] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:02 2022] GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f => generated 1618 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:02.840226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-248feba0-a8bd-4d64-ab03-122db3c55cba tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:02.840226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-248feba0-a8bd-4d64-ab03-122db3c55cba tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:02.847739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-248feba0-a8bd-4d64-ab03-122db3c55cba tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:02.848216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-248feba0-a8bd-4d64-ab03-122db3c55cba tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:02.849016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-248feba0-a8bd-4d64-ab03-122db3c55cba tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:02.849464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-248feba0-a8bd-4d64-ab03-122db3c55cba tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:03.289999 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-248feba0-a8bd-4d64-ab03-122db3c55cba tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:03.301740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-248feba0-a8bd-4d64-ab03-122db3c55cba tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:03.310962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-248feba0-a8bd-4d64-ab03-122db3c55cba tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:03.313985 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-248feba0-a8bd-4d64-ab03-122db3c55cba tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.481133 May 28 04:40:03.316150 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 780/1628] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:40:02 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:40:03.329599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9ce8d356-ee51-4ee8-b201-01ddef7dba2e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:03.330355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9ce8d356-ee51-4ee8-b201-01ddef7dba2e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: b2879396-59ef-44c3-ba44-5626191ec11e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:03.344105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ce8d356-ee51-4ee8-b201-01ddef7dba2e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:03.344839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ce8d356-ee51-4ee8-b201-01ddef7dba2e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:03.345787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ce8d356-ee51-4ee8-b201-01ddef7dba2e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:03.346800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ce8d356-ee51-4ee8-b201-01ddef7dba2e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:03.375300 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-9ce8d356-ee51-4ee8-b201-01ddef7dba2e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] HTTP exception thrown: Instance b2879396-59ef-44c3-ba44-5626191ec11e could not be found. May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9ce8d356-ee51-4ee8-b201-01ddef7dba2e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Request method failure captured: May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e HTTP/1.1 May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZgUmcA-Sbmftb2t5Q6OHdXxcGW6GI-KfaMZyu750yKZujQOQ2OUFdsVNU5ZhfEP0s4eC_5zGdA9j4c0NgvwSNrcuXtruIwW5QtrLthHvaPIoqs6h9Vt8iOqvfR3KPSxIjH6obhSU1Pnurm7zq-PcxF51E9TAmeQOA3XTnORd0X6DM May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 506fcf1e564049258c90cf33d274fc5f May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-MigrationsAdminTest-1790988062 May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:40:03.377456 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:40:03.380410 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_506fcf1e564049258c90cf33d274fc5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/506fcf1e564049258c90cf33d274fc5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/506fcf1e564049258c90cf33d274fc5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/506fcf1e564049258c90cf33d274fc5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:40:03.380410 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-MigrationsAdminTest-1790988062 May 28 04:40:03.380410 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 506fcf1e564049258c90cf33d274fc5f May 28 04:40:03.380410 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-MigrationsAdminTest-1790988062 May 28 04:40:03.380410 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-MigrationsAdminTest-1790988062-project May 28 04:40:03.380410 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:40:03.380410 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:40:03.380410 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 6d208bde90d54f7487f39c505b884285 May 28 04:40:03.380410 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-MigrationsAdminTest-1790988062-project May 28 04:40:03.380410 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:40:03.380410 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance b2879396-59ef-44c3-ba44-5626191ec11e could not be found. May 28 04:40:03.380410 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'b2879396-59ef-44c3-ba44-5626191ec11e'} May 28 04:40:03.381224 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:40:03.381224 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:03.381224 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:40:03.381224 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:40:03.381224 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:40:03.381224 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:40:03.381224 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:40:03.381224 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:40:03.381224 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:40:03.381224 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:40:03.381224 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2879396-59ef-44c3-ba44-5626191ec11e could not be found. May 28 04:40:03.381224 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:03.381224 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:03.381224 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:03.381224 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:03.381224 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:03.381224 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:03.381224 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:40:03.381224 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:40:03.381224 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:40:03.382540 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:40:03.382540 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:40:03.382540 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:40:03.382540 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:40:03.382540 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:40:03.382540 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:40:03.382540 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:40:03.382540 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2879396-59ef-44c3-ba44-5626191ec11e could not be found. May 28 04:40:03.382540 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:03.382540 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:03.382540 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:03.382540 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:03.382540 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:03.382540 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:03.382540 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:40:03.382540 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:40:03.382540 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2879396-59ef-44c3-ba44-5626191ec11e could not be found. May 28 04:40:03.382540 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:03.384993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9ce8d356-ee51-4ee8-b201-01ddef7dba2e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Returning 404 to user: Instance b2879396-59ef-44c3-ba44-5626191ec11e could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:40:03.384993 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9ce8d356-ee51-4ee8-b201-01ddef7dba2e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e" status: 404 len: 111 microversion: 2.1 time: 0.059886 May 28 04:40:03.384993 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 781/1629] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:03 2022] GET /compute/v2.1/servers/b2879396-59ef-44c3-ba44-5626191ec11e => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:40:03.385380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-956657d8-a4b9-4990-a927-2549fa256f69 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:03.385747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-956657d8-a4b9-4990-a927-2549fa256f69 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:03.396203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-956657d8-a4b9-4990-a927-2549fa256f69 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:03.396690 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-956657d8-a4b9-4990-a927-2549fa256f69 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:03.407315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-956657d8-a4b9-4990-a927-2549fa256f69 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:03.407860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-956657d8-a4b9-4990-a927-2549fa256f69 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:03.475526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-956657d8-a4b9-4990-a927-2549fa256f69 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:40:03.606269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:03.839928 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6a50373c-eb53-4962-a2ff-151f05e5c9c9 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332/action" status: 202 len: 0 microversion: 2.1 time: 5.463077 May 28 04:40:03.842075 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 849/1630] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:39:58 2022] POST /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332/action => generated 0 bytes in 5480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:40:03.848447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-21bfc886-33b9-4199-96c9-43bc782368db tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:03.849584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-21bfc886-33b9-4199-96c9-43bc782368db tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:03.860606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21bfc886-33b9-4199-96c9-43bc782368db tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:03.863176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21bfc886-33b9-4199-96c9-43bc782368db tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:03.863176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21bfc886-33b9-4199-96c9-43bc782368db tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:03.863176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21bfc886-33b9-4199-96c9-43bc782368db tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:03.910365 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-956657d8-a4b9-4990-a927-2549fa256f69 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f" status: 204 len: 0 microversion: 2.1 time: 0.529041 May 28 04:40:03.910964 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 782/1631] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:40:03 2022] DELETE /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:40:04.072359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-322db8da-d9ec-4f9c-b91d-ea1a55e73ae7 req-e7190580-333f-4899-ac20-5d7c3f4570a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6099edfb-c389-4614-937f-11b41943ed79", "tag": "b1318bdd-cad5-4bc2-9aa4-fd6b51949f14"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:04.093268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-322db8da-d9ec-4f9c-b91d-ea1a55e73ae7 req-e7190580-333f-4899-ac20-5d7c3f4570a1 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:04.093906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-322db8da-d9ec-4f9c-b91d-ea1a55e73ae7 req-e7190580-333f-4899-ac20-5d7c3f4570a1 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:04.150177 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-322db8da-d9ec-4f9c-b91d-ea1a55e73ae7 req-e7190580-333f-4899-ac20-5d7c3f4570a1 service nova] Creating event network-changed:b1318bdd-cad5-4bc2-9aa4-fd6b51949f14 for instance 6099edfb-c389-4614-937f-11b41943ed79 on n-h1-843700-1 May 28 04:40:04.164071 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-322db8da-d9ec-4f9c-b91d-ea1a55e73ae7 req-e7190580-333f-4899-ac20-5d7c3f4570a1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251250 May 28 04:40:04.164980 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 783/1632] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:04.176060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1bf6fbea-a89d-4b77-a396-6fb09b6205bd tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:04.176669 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1bf6fbea-a89d-4b77-a396-6fb09b6205bd tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:04.186203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1bf6fbea-a89d-4b77-a396-6fb09b6205bd tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:04.186669 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1bf6fbea-a89d-4b77-a396-6fb09b6205bd tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:04.196195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1bf6fbea-a89d-4b77-a396-6fb09b6205bd tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:04.196696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1bf6fbea-a89d-4b77-a396-6fb09b6205bd tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:04.262432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1bf6fbea-a89d-4b77-a396-6fb09b6205bd tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:40:04.336740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-21bfc886-33b9-4199-96c9-43bc782368db tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18e3755f97184714b26326adebbe1f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01907ddfb9d54b159d84a63586b8338f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:04.349681 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-21bfc886-33b9-4199-96c9-43bc782368db tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79" status: 200 len: 1588 microversion: 2.1 time: 0.506303 May 28 04:40:04.364360 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 850/1633] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:03 2022] GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79 => generated 1588 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:04.370032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c32c104a-abc8-4d4b-bfac-1d374326523b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:04.370964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c32c104a-abc8-4d4b-bfac-1d374326523b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:04.378959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c32c104a-abc8-4d4b-bfac-1d374326523b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:04.382835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c32c104a-abc8-4d4b-bfac-1d374326523b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:04.382835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c32c104a-abc8-4d4b-bfac-1d374326523b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:04.382835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c32c104a-abc8-4d4b-bfac-1d374326523b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:04.558243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=95,nova_api:UPDATE=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:04.648053 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1bf6fbea-a89d-4b77-a396-6fb09b6205bd tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "DELETE /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 204 len: 0 microversion: 2.1 time: 0.481619 May 28 04:40:04.649152 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 784/1634] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:40:04 2022] DELETE /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:40:04.657905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0699cffe-f3f5-41cc-8082-98e9798111fe tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:04.660384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0699cffe-f3f5-41cc-8082-98e9798111fe tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:04.697478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0699cffe-f3f5-41cc-8082-98e9798111fe tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:04.698814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0699cffe-f3f5-41cc-8082-98e9798111fe tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:04.700745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0699cffe-f3f5-41cc-8082-98e9798111fe tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:04.701397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0699cffe-f3f5-41cc-8082-98e9798111fe tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:04.711810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c32c104a-abc8-4d4b-bfac-1d374326523b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:04.723705 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c32c104a-abc8-4d4b-bfac-1d374326523b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1316 microversion: 2.1 time: 0.357739 May 28 04:40:04.737374 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 851/1635] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:04 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1316 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:04.751119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cfbeb8d3-06d6-42f1-b96c-8cf8f749f8bc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:04.756942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cfbeb8d3-06d6-42f1-b96c-8cf8f749f8bc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:04.800208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfbeb8d3-06d6-42f1-b96c-8cf8f749f8bc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:04.803821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfbeb8d3-06d6-42f1-b96c-8cf8f749f8bc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:04.808353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfbeb8d3-06d6-42f1-b96c-8cf8f749f8bc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:04.815259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfbeb8d3-06d6-42f1-b96c-8cf8f749f8bc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:05.231093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cfbeb8d3-06d6-42f1-b96c-8cf8f749f8bc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:05.244502 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cfbeb8d3-06d6-42f1-b96c-8cf8f749f8bc tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f" status: 200 len: 1473 microversion: 2.1 time: 0.503053 May 28 04:40:05.247992 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 852/1636] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:04 2022] GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f => generated 1473 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:05.260802 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2348abef-cfab-472d-b52e-658fa6623e8b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:05.261818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2348abef-cfab-472d-b52e-658fa6623e8b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:05.279578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2348abef-cfab-472d-b52e-658fa6623e8b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:05.283560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2348abef-cfab-472d-b52e-658fa6623e8b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:05.285668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2348abef-cfab-472d-b52e-658fa6623e8b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:05.286331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2348abef-cfab-472d-b52e-658fa6623e8b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:05.314232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0699cffe-f3f5-41cc-8082-98e9798111fe tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:05.325310 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0699cffe-f3f5-41cc-8082-98e9798111fe tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.674580 May 28 04:40:05.338114 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 785/1637] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:04 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:05.353343 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-355e4d0e-ecf9-440e-a721-cdf17fc1aee8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:05.354187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-355e4d0e-ecf9-440e-a721-cdf17fc1aee8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:05.372423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-355e4d0e-ecf9-440e-a721-cdf17fc1aee8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:05.373270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-355e4d0e-ecf9-440e-a721-cdf17fc1aee8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:05.374295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-355e4d0e-ecf9-440e-a721-cdf17fc1aee8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:05.374944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-355e4d0e-ecf9-440e-a721-cdf17fc1aee8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:05.614455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-355e4d0e-ecf9-440e-a721-cdf17fc1aee8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:05.625459 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-355e4d0e-ecf9-440e-a721-cdf17fc1aee8 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1534 microversion: 2.1 time: 0.286005 May 28 04:40:05.637961 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 786/1638] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:05 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1534 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:05.743772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f31fa39d-7c27-4d5b-a4a9-90efb07912d7 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:05.744618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f31fa39d-7c27-4d5b-a4a9-90efb07912d7 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:05.757313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f31fa39d-7c27-4d5b-a4a9-90efb07912d7 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:05.766453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f31fa39d-7c27-4d5b-a4a9-90efb07912d7 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:05.767511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f31fa39d-7c27-4d5b-a4a9-90efb07912d7 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:05.768142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f31fa39d-7c27-4d5b-a4a9-90efb07912d7 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:05.924921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2348abef-cfab-472d-b52e-658fa6623e8b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:05.941284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2348abef-cfab-472d-b52e-658fa6623e8b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:05.942796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2348abef-cfab-472d-b52e-658fa6623e8b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:05.949774 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2348abef-cfab-472d-b52e-658fa6623e8b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.698225 May 28 04:40:05.951181 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 853/1639] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:40:05 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:40:05.984345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f31fa39d-7c27-4d5b-a4a9-90efb07912d7 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:05.993712 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f31fa39d-7c27-4d5b-a4a9-90efb07912d7 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1316 microversion: 2.1 time: 0.253597 May 28 04:40:05.994919 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 787/1640] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:05 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1316 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:06.192780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-59511408-7582-4079-8ce0-e491c2dd1dfd req-357d9a09-de52-43df-9c0f-caaef4e17f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315db9ca-6acb-462a-a538-1b888d62e083", "name": "network-vif-unplugged", "status": "completed", "tag": "a9fec711-5850-498d-a2d4-9fb1b16772de"}, {"name": "network-changed", "server_uuid": "315db9ca-6acb-462a-a538-1b888d62e083", "tag": "a9fec711-5850-498d-a2d4-9fb1b16772de"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:06.238579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-59511408-7582-4079-8ce0-e491c2dd1dfd req-357d9a09-de52-43df-9c0f-caaef4e17f12 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:06.239224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-59511408-7582-4079-8ce0-e491c2dd1dfd req-357d9a09-de52-43df-9c0f-caaef4e17f12 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:06.244779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:06.264671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-66b39f55-1584-457e-af57-635a4fbd85b0 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:06.268313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-66b39f55-1584-457e-af57-635a4fbd85b0 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:06.269147 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-59511408-7582-4079-8ce0-e491c2dd1dfd req-357d9a09-de52-43df-9c0f-caaef4e17f12 service nova] Creating event network-vif-unplugged:a9fec711-5850-498d-a2d4-9fb1b16772de for instance 315db9ca-6acb-462a-a538-1b888d62e083 on n-h2-843700-1 May 28 04:40:06.272015 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-59511408-7582-4079-8ce0-e491c2dd1dfd req-357d9a09-de52-43df-9c0f-caaef4e17f12 service nova] Creating event network-changed:a9fec711-5850-498d-a2d4-9fb1b16772de for instance 315db9ca-6acb-462a-a538-1b888d62e083 on n-h2-843700-1 May 28 04:40:06.281490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-66b39f55-1584-457e-af57-635a4fbd85b0 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:06.281947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-66b39f55-1584-457e-af57-635a4fbd85b0 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:06.282771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-66b39f55-1584-457e-af57-635a4fbd85b0 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:06.283512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-66b39f55-1584-457e-af57-635a4fbd85b0 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:06.285465 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-59511408-7582-4079-8ce0-e491c2dd1dfd req-357d9a09-de52-43df-9c0f-caaef4e17f12 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.094136 May 28 04:40:06.288686 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 854/1641] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:06.346080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c4acb9ed-7ad1-40fb-ae3b-09113f69b715 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:06.346795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c4acb9ed-7ad1-40fb-ae3b-09113f69b715 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:06.353654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4acb9ed-7ad1-40fb-ae3b-09113f69b715 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:06.354117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4acb9ed-7ad1-40fb-ae3b-09113f69b715 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:06.355908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4acb9ed-7ad1-40fb-ae3b-09113f69b715 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:06.356356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4acb9ed-7ad1-40fb-ae3b-09113f69b715 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:06.616248 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-66b39f55-1584-457e-af57-635a4fbd85b0 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:06.625493 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-66b39f55-1584-457e-af57-635a4fbd85b0 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f" status: 200 len: 1473 microversion: 2.1 time: 0.364618 May 28 04:40:06.626557 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 788/1642] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:06 2022] GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f => generated 1473 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:06.630193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c4acb9ed-7ad1-40fb-ae3b-09113f69b715 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:06.643527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5395ea53-e8c5-4605-94fc-c41eced76423 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:06.644492 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5395ea53-e8c5-4605-94fc-c41eced76423 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:06.646495 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c4acb9ed-7ad1-40fb-ae3b-09113f69b715 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.305286 May 28 04:40:06.647812 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 855/1643] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:06 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:06.652967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5395ea53-e8c5-4605-94fc-c41eced76423 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:06.653597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5395ea53-e8c5-4605-94fc-c41eced76423 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:06.654533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5395ea53-e8c5-4605-94fc-c41eced76423 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:06.655278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5395ea53-e8c5-4605-94fc-c41eced76423 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:06.923702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5395ea53-e8c5-4605-94fc-c41eced76423 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:06.936988 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5395ea53-e8c5-4605-94fc-c41eced76423 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1534 microversion: 2.1 time: 0.297503 May 28 04:40:06.937856 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 789/1644] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:06 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1534 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:40:06.968127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5afd3013-3927-48f0-add7-19b1f0686a0b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:06.969173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5afd3013-3927-48f0-add7-19b1f0686a0b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:06.976678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5afd3013-3927-48f0-add7-19b1f0686a0b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:06.977420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5afd3013-3927-48f0-add7-19b1f0686a0b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:06.978468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5afd3013-3927-48f0-add7-19b1f0686a0b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:06.979244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5afd3013-3927-48f0-add7-19b1f0686a0b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:07.012821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-da4fbe84-0ce8-4720-9d22-89a7d92160d1 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:07.013465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-da4fbe84-0ce8-4720-9d22-89a7d92160d1 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:07.024352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-da4fbe84-0ce8-4720-9d22-89a7d92160d1 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:07.024973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-da4fbe84-0ce8-4720-9d22-89a7d92160d1 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:07.025867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-da4fbe84-0ce8-4720-9d22-89a7d92160d1 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:07.028955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-da4fbe84-0ce8-4720-9d22-89a7d92160d1 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:07.320571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5afd3013-3927-48f0-add7-19b1f0686a0b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:07.334378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5afd3013-3927-48f0-add7-19b1f0686a0b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:07.336108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5afd3013-3927-48f0-add7-19b1f0686a0b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:07.341186 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5afd3013-3927-48f0-add7-19b1f0686a0b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.377480 May 28 04:40:07.341939 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 856/1645] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:40:06 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:40:07.416037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-da4fbe84-0ce8-4720-9d22-89a7d92160d1 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:07.421367 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-da4fbe84-0ce8-4720-9d22-89a7d92160d1 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1316 microversion: 2.1 time: 0.413694 May 28 04:40:07.422036 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 790/1646] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:07 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1316 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:40:07.645445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-410e5f13-005a-4f06-a61a-118929a6109f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:07.645684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-410e5f13-005a-4f06-a61a-118929a6109f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:07.652888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-410e5f13-005a-4f06-a61a-118929a6109f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:07.653555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-410e5f13-005a-4f06-a61a-118929a6109f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:07.654508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-410e5f13-005a-4f06-a61a-118929a6109f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:07.654944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-410e5f13-005a-4f06-a61a-118929a6109f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:07.679375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-984a7180-68f5-4054-958a-efc6c8447e71 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:07.681315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-984a7180-68f5-4054-958a-efc6c8447e71 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:07.692954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-984a7180-68f5-4054-958a-efc6c8447e71 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:07.693883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-984a7180-68f5-4054-958a-efc6c8447e71 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:07.695042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-984a7180-68f5-4054-958a-efc6c8447e71 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:07.696173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-984a7180-68f5-4054-958a-efc6c8447e71 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:08.085296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:08.304006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-410e5f13-005a-4f06-a61a-118929a6109f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:08.314538 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-410e5f13-005a-4f06-a61a-118929a6109f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f" status: 200 len: 1473 microversion: 2.1 time: 0.675613 May 28 04:40:08.315356 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 857/1647] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:07 2022] GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f => generated 1473 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:08.334566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2cdb884a-513a-490e-99f7-cd0bbbd64f4f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:08.335302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2cdb884a-513a-490e-99f7-cd0bbbd64f4f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:08.345693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2cdb884a-513a-490e-99f7-cd0bbbd64f4f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:08.346153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2cdb884a-513a-490e-99f7-cd0bbbd64f4f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:08.346930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2cdb884a-513a-490e-99f7-cd0bbbd64f4f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:08.347390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2cdb884a-513a-490e-99f7-cd0bbbd64f4f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:08.559704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-984a7180-68f5-4054-958a-efc6c8447e71 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:08.567689 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-984a7180-68f5-4054-958a-efc6c8447e71 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.906859 May 28 04:40:08.568286 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 791/1648] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:07 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:08.593667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1788d1e4-ee21-49ad-be78-e7ef4dc9163d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:08.594464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1788d1e4-ee21-49ad-be78-e7ef4dc9163d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:08.611167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1788d1e4-ee21-49ad-be78-e7ef4dc9163d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:08.612819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1788d1e4-ee21-49ad-be78-e7ef4dc9163d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:08.613654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1788d1e4-ee21-49ad-be78-e7ef4dc9163d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:08.614629 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1788d1e4-ee21-49ad-be78-e7ef4dc9163d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:08.734501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2cdb884a-513a-490e-99f7-cd0bbbd64f4f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:08.749057 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2cdb884a-513a-490e-99f7-cd0bbbd64f4f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1534 microversion: 2.1 time: 0.423933 May 28 04:40:08.749641 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 858/1649] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:08 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1534 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:08.754428 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0c31518a-8934-4e93-9500-a7449fbfcba3 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:08.763848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0c31518a-8934-4e93-9500-a7449fbfcba3 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:08.770317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c31518a-8934-4e93-9500-a7449fbfcba3 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:08.771027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c31518a-8934-4e93-9500-a7449fbfcba3 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:08.771970 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c31518a-8934-4e93-9500-a7449fbfcba3 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:08.776769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c31518a-8934-4e93-9500-a7449fbfcba3 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:09.063114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1788d1e4-ee21-49ad-be78-e7ef4dc9163d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:09.081799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1788d1e4-ee21-49ad-be78-e7ef4dc9163d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:09.091958 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1788d1e4-ee21-49ad-be78-e7ef4dc9163d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:09.093216 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1788d1e4-ee21-49ad-be78-e7ef4dc9163d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.503582 May 28 04:40:09.093808 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 792/1650] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:40:08 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:40:09.098374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b81bd269-f68d-4b9b-b831-3c5a8624eeb3 req-6462e6df-5707-495b-ad79-a33e1a7c9318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17bf9454-cf2b-4049-b817-556e4c74b350", "name": "network-vif-deleted", "tag": "9a1c5bed-5c2a-4af6-98f9-e6c6cf8a4d4c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:09.112309 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b81bd269-f68d-4b9b-b831-3c5a8624eeb3 req-6462e6df-5707-495b-ad79-a33e1a7c9318 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:09.115749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b81bd269-f68d-4b9b-b831-3c5a8624eeb3 req-6462e6df-5707-495b-ad79-a33e1a7c9318 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:09.128656 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b81bd269-f68d-4b9b-b831-3c5a8624eeb3 req-6462e6df-5707-495b-ad79-a33e1a7c9318 service nova] Creating event network-vif-deleted:9a1c5bed-5c2a-4af6-98f9-e6c6cf8a4d4c for instance 17bf9454-cf2b-4049-b817-556e4c74b350 on n-h2-843700-1 May 28 04:40:09.135099 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b81bd269-f68d-4b9b-b831-3c5a8624eeb3 req-6462e6df-5707-495b-ad79-a33e1a7c9318 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039651 May 28 04:40:09.138716 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 793/1651] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:09.286741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0c31518a-8934-4e93-9500-a7449fbfcba3 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:09.299690 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0c31518a-8934-4e93-9500-a7449fbfcba3 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1316 microversion: 2.1 time: 0.545888 May 28 04:40:09.301234 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 859/1652] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:08 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1316 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:09.332603 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-97fc371d-87ba-4612-925f-4da444bc323f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:09.333590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-97fc371d-87ba-4612-925f-4da444bc323f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:09.357656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97fc371d-87ba-4612-925f-4da444bc323f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:09.358322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97fc371d-87ba-4612-925f-4da444bc323f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:09.359301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97fc371d-87ba-4612-925f-4da444bc323f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:09.361820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97fc371d-87ba-4612-925f-4da444bc323f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:09.467688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-97fc371d-87ba-4612-925f-4da444bc323f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:09.478752 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-97fc371d-87ba-4612-925f-4da444bc323f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f" status: 200 len: 1302 microversion: 2.1 time: 0.149354 May 28 04:40:09.493513 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 794/1653] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:09 2022] GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f => generated 1302 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:40:09.586134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b04b54f2-a9bb-4b18-9a80-f6c6dd030662 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:09.587123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b04b54f2-a9bb-4b18-9a80-f6c6dd030662 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:09.598033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b04b54f2-a9bb-4b18-9a80-f6c6dd030662 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:09.598601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b04b54f2-a9bb-4b18-9a80-f6c6dd030662 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:09.599428 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b04b54f2-a9bb-4b18-9a80-f6c6dd030662 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:09.600077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b04b54f2-a9bb-4b18-9a80-f6c6dd030662 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:10.060550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b04b54f2-a9bb-4b18-9a80-f6c6dd030662 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:10.076322 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b04b54f2-a9bb-4b18-9a80-f6c6dd030662 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.492181 May 28 04:40:10.077227 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 860/1654] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:09 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:10.088385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9858bda7-c583-40b2-9f22-4a7cab7e5119 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:10.090947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9858bda7-c583-40b2-9f22-4a7cab7e5119 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:10.104458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9858bda7-c583-40b2-9f22-4a7cab7e5119 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:10.104458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9858bda7-c583-40b2-9f22-4a7cab7e5119 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:10.104458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9858bda7-c583-40b2-9f22-4a7cab7e5119 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:10.104458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9858bda7-c583-40b2-9f22-4a7cab7e5119 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:10.177079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9858bda7-c583-40b2-9f22-4a7cab7e5119 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:10.177883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9858bda7-c583-40b2-9f22-4a7cab7e5119 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:10.184526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-5c7eef71-5142-4a66-91c0-f06aeafccc88 req-83c420f6-4551-4dfa-aa8a-41f1d5e4d23a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54045fbc-26d8-48c2-a385-c62ee2e4e1ed", "name": "network-vif-plugged", "status": "completed", "tag": "4be01961-66da-42a9-8515-382ddd7b2e3e"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:10.184988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-9858bda7-c583-40b2-9f22-4a7cab7e5119 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lazy-loading 'fault' on Instance uuid 17bf9454-cf2b-4049-b817-556e4c74b350 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:40:10.191055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5c7eef71-5142-4a66-91c0-f06aeafccc88 req-83c420f6-4551-4dfa-aa8a-41f1d5e4d23a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:10.191510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5c7eef71-5142-4a66-91c0-f06aeafccc88 req-83c420f6-4551-4dfa-aa8a-41f1d5e4d23a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:10.228822 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-5c7eef71-5142-4a66-91c0-f06aeafccc88 req-83c420f6-4551-4dfa-aa8a-41f1d5e4d23a service nova] Creating event network-vif-plugged:4be01961-66da-42a9-8515-382ddd7b2e3e for instance 54045fbc-26d8-48c2-a385-c62ee2e4e1ed on n-h1-843700-1 May 28 04:40:10.238951 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-5c7eef71-5142-4a66-91c0-f06aeafccc88 req-83c420f6-4551-4dfa-aa8a-41f1d5e4d23a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.518109 May 28 04:40:10.239603 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 795/1655] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:40:10.274194 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ce681e57-cb07-4ff0-b9f4-b5235932ccc4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:10.275750 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ce681e57-cb07-4ff0-b9f4-b5235932ccc4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:10.285473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce681e57-cb07-4ff0-b9f4-b5235932ccc4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:10.286129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce681e57-cb07-4ff0-b9f4-b5235932ccc4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:10.293217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce681e57-cb07-4ff0-b9f4-b5235932ccc4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:10.293217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce681e57-cb07-4ff0-b9f4-b5235932ccc4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:10.294742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9858bda7-c583-40b2-9f22-4a7cab7e5119 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:10.306124 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9858bda7-c583-40b2-9f22-4a7cab7e5119 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 200 len: 1369 microversion: 2.1 time: 0.223152 May 28 04:40:10.310141 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 861/1656] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:10 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 1369 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:10.328136 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9540e637-7678-4d6e-a553-2c06237d5221 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:10.331166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9540e637-7678-4d6e-a553-2c06237d5221 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:10.343480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9540e637-7678-4d6e-a553-2c06237d5221 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:10.351050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9540e637-7678-4d6e-a553-2c06237d5221 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:10.351050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9540e637-7678-4d6e-a553-2c06237d5221 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:10.351050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9540e637-7678-4d6e-a553-2c06237d5221 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:10.801536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9540e637-7678-4d6e-a553-2c06237d5221 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:10.810732 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9540e637-7678-4d6e-a553-2c06237d5221 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1316 microversion: 2.1 time: 0.497000 May 28 04:40:10.813585 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 862/1657] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:10 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1316 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:10.828363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ac00d49b-f8f5-4a92-9d4d-a92c866a81ca tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:10.831147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ac00d49b-f8f5-4a92-9d4d-a92c866a81ca tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 6d337611-9c22-48c2-99e7-8dc13d7dbe6f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:10.843031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ce681e57-cb07-4ff0-b9f4-b5235932ccc4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:10.844578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac00d49b-f8f5-4a92-9d4d-a92c866a81ca tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:10.845235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac00d49b-f8f5-4a92-9d4d-a92c866a81ca tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:10.848279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac00d49b-f8f5-4a92-9d4d-a92c866a81ca tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:10.855269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac00d49b-f8f5-4a92-9d4d-a92c866a81ca tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:10.862117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ce681e57-cb07-4ff0-b9f4-b5235932ccc4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:10.866155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ce681e57-cb07-4ff0-b9f4-b5235932ccc4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:10.868732 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ce681e57-cb07-4ff0-b9f4-b5235932ccc4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.627846 May 28 04:40:10.871167 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 796/1658] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:40:10 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:40:10.905172 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-ac00d49b-f8f5-4a92-9d4d-a92c866a81ca tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] HTTP exception thrown: Instance 6d337611-9c22-48c2-99e7-8dc13d7dbe6f could not be found. May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ac00d49b-f8f5-4a92-9d4d-a92c866a81ca tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Request method failure captured: May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f HTTP/1.1 May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikacM2KhD78yFRK4EsqhrSyTkAV6Nk1F7FXJklf8auTvIKGrUmSmLWcwCIjKaPM6QlxxtXfRYh5fIpqbGQIq7lvQWGQ3on9q1XMdmR40ZvjC765A16ijPz3gObMshF2VFgwx83uBQA7MXjlNEOTRDuEMLE2TFSD0l-hdWW3mhb5DGOiM May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: e7a5b721a538475cbac9c95c61647753 May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:40:10.907554 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:40:10.909148 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e7a5b721a538475cbac9c95c61647753"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:40:10.909148 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:10.909148 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: e7a5b721a538475cbac9c95c61647753 May 28 04:40:10.909148 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:10.909148 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersOnMultiNodesTest-1039499615-project May 28 04:40:10.909148 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:40:10.909148 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:40:10.909148 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: d398d45627fc4d33bc9a736ddf8f9215 May 28 04:40:10.909148 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersOnMultiNodesTest-1039499615-project May 28 04:40:10.909148 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:40:10.909148 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 6d337611-9c22-48c2-99e7-8dc13d7dbe6f could not be found. May 28 04:40:10.909148 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '6d337611-9c22-48c2-99e7-8dc13d7dbe6f'} May 28 04:40:10.910064 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:40:10.910064 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:10.910064 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:40:10.910064 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:40:10.910064 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:40:10.910064 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:40:10.910064 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:40:10.910064 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:40:10.910064 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:40:10.910064 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:40:10.910064 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d337611-9c22-48c2-99e7-8dc13d7dbe6f could not be found. May 28 04:40:10.910064 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:10.910064 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:10.910064 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:10.910064 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:10.910064 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:10.910064 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:10.910064 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:40:10.910064 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:40:10.910064 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:40:10.911441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:40:10.911441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:40:10.911441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:40:10.911441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:40:10.911441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:40:10.911441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:40:10.911441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:40:10.911441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d337611-9c22-48c2-99e7-8dc13d7dbe6f could not be found. May 28 04:40:10.911441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:10.911441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:10.911441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:10.911441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:10.911441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:10.911441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:10.911441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:40:10.911441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:40:10.911441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d337611-9c22-48c2-99e7-8dc13d7dbe6f could not be found. May 28 04:40:10.911441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:10.913322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ac00d49b-f8f5-4a92-9d4d-a92c866a81ca tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Returning 404 to user: Instance 6d337611-9c22-48c2-99e7-8dc13d7dbe6f could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:40:10.914364 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ac00d49b-f8f5-4a92-9d4d-a92c866a81ca tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f" status: 404 len: 111 microversion: 2.1 time: 0.091278 May 28 04:40:10.915558 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 863/1659] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:10 2022] GET /compute/v2.1/servers/6d337611-9c22-48c2-99e7-8dc13d7dbe6f => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:40:10.927725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4bf591ba-036c-4f06-b62c-eff77080d201 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:10.928870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4bf591ba-036c-4f06-b62c-eff77080d201 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:10.941953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4bf591ba-036c-4f06-b62c-eff77080d201 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:10.942576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4bf591ba-036c-4f06-b62c-eff77080d201 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:10.946062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4bf591ba-036c-4f06-b62c-eff77080d201 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:10.949455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4bf591ba-036c-4f06-b62c-eff77080d201 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:11.033005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4bf591ba-036c-4f06-b62c-eff77080d201 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:40:11.083570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:11.095288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-37a52bfa-da12-41ad-a72a-cd589de16b91 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:11.096129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-37a52bfa-da12-41ad-a72a-cd589de16b91 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:11.106370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-37a52bfa-da12-41ad-a72a-cd589de16b91 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:11.107794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-37a52bfa-da12-41ad-a72a-cd589de16b91 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:11.109702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-37a52bfa-da12-41ad-a72a-cd589de16b91 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:11.121747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-37a52bfa-da12-41ad-a72a-cd589de16b91 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:11.415671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-37a52bfa-da12-41ad-a72a-cd589de16b91 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:11.432114 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-37a52bfa-da12-41ad-a72a-cd589de16b91 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.341025 May 28 04:40:11.433883 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 864/1660] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:11 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:40:11.444090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-6665c994-8e4a-44de-955d-8dcecc59e8dd req-99199f1b-b98e-4510-b95f-52148d691ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d337611-9c22-48c2-99e7-8dc13d7dbe6f", "name": "network-vif-deleted", "tag": "3257acbd-81a4-4090-9a76-6394762da82c"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:11.465765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-6665c994-8e4a-44de-955d-8dcecc59e8dd req-99199f1b-b98e-4510-b95f-52148d691ab4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:11.466116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-6665c994-8e4a-44de-955d-8dcecc59e8dd req-99199f1b-b98e-4510-b95f-52148d691ab4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:11.480557 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-6665c994-8e4a-44de-955d-8dcecc59e8dd req-99199f1b-b98e-4510-b95f-52148d691ab4 service nova] Creating event network-vif-deleted:3257acbd-81a4-4090-9a76-6394762da82c for instance 6d337611-9c22-48c2-99e7-8dc13d7dbe6f on n-h2-843700-1 May 28 04:40:11.487984 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4bf591ba-036c-4f06-b62c-eff77080d201 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "DELETE /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 204 len: 0 microversion: 2.1 time: 0.567168 May 28 04:40:11.489418 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 797/1661] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:40:10 2022] DELETE /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:40:11.492976 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-6665c994-8e4a-44de-955d-8dcecc59e8dd req-99199f1b-b98e-4510-b95f-52148d691ab4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057216 May 28 04:40:11.498149 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 865/1662] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:11.500063 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a36c4619-9cd1-4702-941c-901869a1b6a4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:11.500988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a36c4619-9cd1-4702-941c-901869a1b6a4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 17bf9454-cf2b-4049-b817-556e4c74b350] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:11.505287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-552e9d4b-9fb4-4de5-a558-5a4136b04c13 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:11.506265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-552e9d4b-9fb4-4de5-a558-5a4136b04c13 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:11.508068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a36c4619-9cd1-4702-941c-901869a1b6a4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:11.508590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a36c4619-9cd1-4702-941c-901869a1b6a4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:11.509788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a36c4619-9cd1-4702-941c-901869a1b6a4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:11.511036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a36c4619-9cd1-4702-941c-901869a1b6a4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:11.516050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-552e9d4b-9fb4-4de5-a558-5a4136b04c13 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:11.516678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-552e9d4b-9fb4-4de5-a558-5a4136b04c13 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:11.517628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-552e9d4b-9fb4-4de5-a558-5a4136b04c13 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:11.518206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-552e9d4b-9fb4-4de5-a558-5a4136b04c13 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:11.530913 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-a36c4619-9cd1-4702-941c-901869a1b6a4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] HTTP exception thrown: Instance 17bf9454-cf2b-4049-b817-556e4c74b350 could not be found. May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a36c4619-9cd1-4702-941c-901869a1b6a4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Request method failure captured: May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 HTTP/1.1 May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZgUmcA-Sbmftb2t5Q6OHdXxcGW6GI-KfaMZyu750yKZujQOQ2OUFdsVNU5ZhfEP0s4eC_5zGdA9j4c0NgvwSNrcuXtruIwW5QtrLthHvaPIoqs6h9Vt8iOqvfR3KPSxIjH6obhSU1Pnurm7zq-PcxF51E9TAmeQOA3XTnORd0X6DM May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 506fcf1e564049258c90cf33d274fc5f May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-MigrationsAdminTest-1790988062 May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:40:11.533193 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:40:11.534748 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_506fcf1e564049258c90cf33d274fc5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/506fcf1e564049258c90cf33d274fc5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/506fcf1e564049258c90cf33d274fc5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/506fcf1e564049258c90cf33d274fc5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:40:11.534748 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-MigrationsAdminTest-1790988062 May 28 04:40:11.534748 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 506fcf1e564049258c90cf33d274fc5f May 28 04:40:11.534748 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-MigrationsAdminTest-1790988062 May 28 04:40:11.534748 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-MigrationsAdminTest-1790988062-project May 28 04:40:11.534748 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:40:11.534748 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:40:11.534748 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 6d208bde90d54f7487f39c505b884285 May 28 04:40:11.534748 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-MigrationsAdminTest-1790988062-project May 28 04:40:11.534748 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:40:11.534748 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 17bf9454-cf2b-4049-b817-556e4c74b350 could not be found. May 28 04:40:11.534748 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '17bf9454-cf2b-4049-b817-556e4c74b350'} May 28 04:40:11.535584 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:40:11.535584 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:11.535584 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:40:11.535584 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:40:11.535584 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:40:11.535584 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:40:11.535584 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:40:11.535584 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:40:11.535584 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:40:11.535584 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:40:11.535584 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17bf9454-cf2b-4049-b817-556e4c74b350 could not be found. May 28 04:40:11.535584 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:11.535584 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:11.535584 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:11.535584 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:11.535584 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:11.535584 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:11.535584 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:40:11.535584 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:40:11.535584 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:40:11.537183 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:40:11.537183 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:40:11.537183 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:40:11.537183 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:40:11.537183 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:40:11.537183 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:40:11.537183 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:40:11.537183 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17bf9454-cf2b-4049-b817-556e4c74b350 could not be found. May 28 04:40:11.537183 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:11.537183 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:11.537183 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:11.537183 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:11.537183 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:11.537183 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:11.537183 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:40:11.537183 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:40:11.537183 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17bf9454-cf2b-4049-b817-556e4c74b350 could not be found. May 28 04:40:11.537183 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:11.540791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a36c4619-9cd1-4702-941c-901869a1b6a4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Returning 404 to user: Instance 17bf9454-cf2b-4049-b817-556e4c74b350 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:40:11.540791 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a36c4619-9cd1-4702-941c-901869a1b6a4 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350" status: 404 len: 111 microversion: 2.1 time: 0.040759 May 28 04:40:11.541635 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 798/1663] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:11 2022] GET /compute/v2.1/servers/17bf9454-cf2b-4049-b817-556e4c74b350 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:40:11.548698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-65d63a35-2775-4e7b-b95b-817c18226b3b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:11.549119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-65d63a35-2775-4e7b-b95b-817c18226b3b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:11.555913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65d63a35-2775-4e7b-b95b-817c18226b3b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:11.556107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65d63a35-2775-4e7b-b95b-817c18226b3b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:11.558205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65d63a35-2775-4e7b-b95b-817c18226b3b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:11.558580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65d63a35-2775-4e7b-b95b-817c18226b3b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:11.590472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-65d63a35-2775-4e7b-b95b-817c18226b3b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:40:11.791357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-552e9d4b-9fb4-4de5-a558-5a4136b04c13 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:11.799466 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-552e9d4b-9fb4-4de5-a558-5a4136b04c13 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1471 microversion: 2.1 time: 0.298910 May 28 04:40:11.810801 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 866/1664] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:11 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1471 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:11.841621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9523a4dd-8988-4dce-84aa-9c47c70ff35f tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:11.842526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9523a4dd-8988-4dce-84aa-9c47c70ff35f tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:11.850750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9523a4dd-8988-4dce-84aa-9c47c70ff35f tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:11.852443 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9523a4dd-8988-4dce-84aa-9c47c70ff35f tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:11.854940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9523a4dd-8988-4dce-84aa-9c47c70ff35f tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:11.857819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9523a4dd-8988-4dce-84aa-9c47c70ff35f tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:11.985695 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-65d63a35-2775-4e7b-b95b-817c18226b3b tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "DELETE /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 204 len: 0 microversion: 2.1 time: 0.442610 May 28 04:40:11.986305 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 799/1665] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:40:11 2022] DELETE /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:40:12.000292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4d63cf7e-0cdb-4c98-b8fa-e5a1bef85688 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:12.002114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4d63cf7e-0cdb-4c98-b8fa-e5a1bef85688 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:12.024232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d63cf7e-0cdb-4c98-b8fa-e5a1bef85688 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:12.028562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d63cf7e-0cdb-4c98-b8fa-e5a1bef85688 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:12.028562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d63cf7e-0cdb-4c98-b8fa-e5a1bef85688 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:12.031982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d63cf7e-0cdb-4c98-b8fa-e5a1bef85688 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:12.129259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9523a4dd-8988-4dce-84aa-9c47c70ff35f tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:12.140683 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9523a4dd-8988-4dce-84aa-9c47c70ff35f tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1316 microversion: 2.1 time: 0.314361 May 28 04:40:12.150640 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 867/1666] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:11 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:12.167324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4b07ddb0-daf2-4a19-8ec9-e7d741cde981 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:12.167948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4b07ddb0-daf2-4a19-8ec9-e7d741cde981 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:12.188416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4b07ddb0-daf2-4a19-8ec9-e7d741cde981 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:12.188879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4b07ddb0-daf2-4a19-8ec9-e7d741cde981 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:12.189675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4b07ddb0-daf2-4a19-8ec9-e7d741cde981 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:12.190126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4b07ddb0-daf2-4a19-8ec9-e7d741cde981 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:12.359071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4d63cf7e-0cdb-4c98-b8fa-e5a1bef85688 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:12.373146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4d63cf7e-0cdb-4c98-b8fa-e5a1bef85688 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:12.379616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4d63cf7e-0cdb-4c98-b8fa-e5a1bef85688 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:12.382613 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4d63cf7e-0cdb-4c98-b8fa-e5a1bef85688 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.395202 May 28 04:40:12.384031 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 800/1667] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:40:11 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:40:12.439185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4b07ddb0-daf2-4a19-8ec9-e7d741cde981 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:12.449566 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4b07ddb0-daf2-4a19-8ec9-e7d741cde981 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1467 microversion: 2.1 time: 0.293617 May 28 04:40:12.451390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-77b3fa0f-945b-4eba-9f64-d015e618a9d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:12.451832 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 868/1668] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:12 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1467 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:12.451949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-77b3fa0f-945b-4eba-9f64-d015e618a9d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:12.459118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77b3fa0f-945b-4eba-9f64-d015e618a9d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:12.459580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77b3fa0f-945b-4eba-9f64-d015e618a9d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:12.460361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77b3fa0f-945b-4eba-9f64-d015e618a9d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:12.460874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77b3fa0f-945b-4eba-9f64-d015e618a9d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:12.641253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-77b3fa0f-945b-4eba-9f64-d015e618a9d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:12.654749 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-77b3fa0f-945b-4eba-9f64-d015e618a9d9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.207477 May 28 04:40:12.657323 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 801/1669] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:12 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:40:12.824828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a4f28ac3-a4a0-40c9-a2dd-b2213d748c74 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:12.828259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a4f28ac3-a4a0-40c9-a2dd-b2213d748c74 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:12.843487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4f28ac3-a4a0-40c9-a2dd-b2213d748c74 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:12.846125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4f28ac3-a4a0-40c9-a2dd-b2213d748c74 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:12.849742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4f28ac3-a4a0-40c9-a2dd-b2213d748c74 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:12.850761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4f28ac3-a4a0-40c9-a2dd-b2213d748c74 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:13.058463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a4f28ac3-a4a0-40c9-a2dd-b2213d748c74 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:13.070067 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a4f28ac3-a4a0-40c9-a2dd-b2213d748c74 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1471 microversion: 2.1 time: 0.256101 May 28 04:40:13.081334 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 869/1670] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:12 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1471 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:13.157837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8cb08f73-1a46-4aad-94f3-ff8b9f480cae tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:13.158439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8cb08f73-1a46-4aad-94f3-ff8b9f480cae tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:13.178012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cb08f73-1a46-4aad-94f3-ff8b9f480cae tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:13.178791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cb08f73-1a46-4aad-94f3-ff8b9f480cae tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:13.179922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cb08f73-1a46-4aad-94f3-ff8b9f480cae tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:13.180532 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cb08f73-1a46-4aad-94f3-ff8b9f480cae tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:13.360431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8cb08f73-1a46-4aad-94f3-ff8b9f480cae tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:13.376695 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8cb08f73-1a46-4aad-94f3-ff8b9f480cae tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1316 microversion: 2.1 time: 0.218597 May 28 04:40:13.394812 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 802/1671] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:13 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:13.402155 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d850e5e4-c658-4b17-8a96-d27b4dd13233 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:13.402803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d850e5e4-c658-4b17-8a96-d27b4dd13233 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:13.423740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d850e5e4-c658-4b17-8a96-d27b4dd13233 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:13.424194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d850e5e4-c658-4b17-8a96-d27b4dd13233 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:13.424970 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d850e5e4-c658-4b17-8a96-d27b4dd13233 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:13.425405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d850e5e4-c658-4b17-8a96-d27b4dd13233 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:13.468329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f7b0611d-e6b1-4a47-8313-d3d23f93bed5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:13.469326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f7b0611d-e6b1-4a47-8313-d3d23f93bed5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:13.483252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7b0611d-e6b1-4a47-8313-d3d23f93bed5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:13.483968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7b0611d-e6b1-4a47-8313-d3d23f93bed5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:13.489156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7b0611d-e6b1-4a47-8313-d3d23f93bed5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:13.490312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7b0611d-e6b1-4a47-8313-d3d23f93bed5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:13.772366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f7b0611d-e6b1-4a47-8313-d3d23f93bed5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:13.780436 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f7b0611d-e6b1-4a47-8313-d3d23f93bed5 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1467 microversion: 2.1 time: 0.316146 May 28 04:40:13.782025 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 803/1672] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:13 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1467 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:13.792888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b21978c7-f0fb-48ac-b635-32199a0d82eb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:13.795306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b21978c7-f0fb-48ac-b635-32199a0d82eb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:13.798574 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d850e5e4-c658-4b17-8a96-d27b4dd13233 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:13.804736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b21978c7-f0fb-48ac-b635-32199a0d82eb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:13.812182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b21978c7-f0fb-48ac-b635-32199a0d82eb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:13.813140 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b21978c7-f0fb-48ac-b635-32199a0d82eb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:13.813360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d850e5e4-c658-4b17-8a96-d27b4dd13233 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:13.813798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b21978c7-f0fb-48ac-b635-32199a0d82eb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:13.815582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d850e5e4-c658-4b17-8a96-d27b4dd13233 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:13.816947 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d850e5e4-c658-4b17-8a96-d27b4dd13233 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.420311 May 28 04:40:13.817981 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 870/1673] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:40:13 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:40:13.975034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b21978c7-f0fb-48ac-b635-32199a0d82eb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:13.987360 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b21978c7-f0fb-48ac-b635-32199a0d82eb tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.203499 May 28 04:40:13.988291 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 804/1674] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:13 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:14.086939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cc213bbc-ef0f-44d8-ab8d-bfc2d49e8793 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:14.088168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cc213bbc-ef0f-44d8-ab8d-bfc2d49e8793 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:14.103015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc213bbc-ef0f-44d8-ab8d-bfc2d49e8793 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:14.103706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc213bbc-ef0f-44d8-ab8d-bfc2d49e8793 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:14.105264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc213bbc-ef0f-44d8-ab8d-bfc2d49e8793 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:14.105861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc213bbc-ef0f-44d8-ab8d-bfc2d49e8793 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:14.316626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cc213bbc-ef0f-44d8-ab8d-bfc2d49e8793 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:14.325826 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cc213bbc-ef0f-44d8-ab8d-bfc2d49e8793 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1471 microversion: 2.1 time: 0.242603 May 28 04:40:14.327282 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 871/1675] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:14 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1471 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:14.394919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-76b639d3-bfe0-4f7f-adac-24f973351f18 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:14.395862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-76b639d3-bfe0-4f7f-adac-24f973351f18 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:14.407494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76b639d3-bfe0-4f7f-adac-24f973351f18 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:14.409972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76b639d3-bfe0-4f7f-adac-24f973351f18 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:14.411144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76b639d3-bfe0-4f7f-adac-24f973351f18 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:14.411772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76b639d3-bfe0-4f7f-adac-24f973351f18 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:14.698783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-76b639d3-bfe0-4f7f-adac-24f973351f18 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:14.712578 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-76b639d3-bfe0-4f7f-adac-24f973351f18 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1316 microversion: 2.1 time: 0.321540 May 28 04:40:14.714740 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 805/1676] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:14 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:14.802633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6a9fd4fd-2819-4ef9-9dca-00e74a63e933 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:14.802633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6a9fd4fd-2819-4ef9-9dca-00e74a63e933 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:14.811373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a9fd4fd-2819-4ef9-9dca-00e74a63e933 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:14.819202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a9fd4fd-2819-4ef9-9dca-00e74a63e933 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:14.820417 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a9fd4fd-2819-4ef9-9dca-00e74a63e933 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:14.821344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a9fd4fd-2819-4ef9-9dca-00e74a63e933 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:14.840271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-15ba8431-4e94-47d8-9351-5224965a2f5e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:14.841663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-15ba8431-4e94-47d8-9351-5224965a2f5e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:14.847988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:14.861232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15ba8431-4e94-47d8-9351-5224965a2f5e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:14.861931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15ba8431-4e94-47d8-9351-5224965a2f5e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:14.862752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15ba8431-4e94-47d8-9351-5224965a2f5e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:14.863220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15ba8431-4e94-47d8-9351-5224965a2f5e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:15.248256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6a9fd4fd-2819-4ef9-9dca-00e74a63e933 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:15.263106 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6a9fd4fd-2819-4ef9-9dca-00e74a63e933 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1467 microversion: 2.1 time: 0.466013 May 28 04:40:15.273395 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 872/1677] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:14 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1467 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:15.279103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f352afa7-25f9-482b-b558-a8f43820303a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:15.279670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f352afa7-25f9-482b-b558-a8f43820303a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:15.305471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f352afa7-25f9-482b-b558-a8f43820303a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:15.305978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f352afa7-25f9-482b-b558-a8f43820303a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:15.306802 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f352afa7-25f9-482b-b558-a8f43820303a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:15.310598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f352afa7-25f9-482b-b558-a8f43820303a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:15.332468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-15ba8431-4e94-47d8-9351-5224965a2f5e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:15.356325 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-15ba8431-4e94-47d8-9351-5224965a2f5e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:15.358672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-15ba8431-4e94-47d8-9351-5224965a2f5e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:15.360348 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-15ba8431-4e94-47d8-9351-5224965a2f5e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.526543 May 28 04:40:15.361445 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 806/1678] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:40:14 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:40:15.369351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-1ff146ec-5a26-4fd9-beec-2448ced6d42a req-37841005-9a46-413c-b8a1-4c9dd76cdf9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87cc4d83-fd02-4a96-a640-3cad08bba4f4", "name": "network-vif-deleted", "tag": "47bf89ee-9954-4b95-8607-a086661df3bd"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:15.390839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1ff146ec-5a26-4fd9-beec-2448ced6d42a req-37841005-9a46-413c-b8a1-4c9dd76cdf9d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:15.391184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1ff146ec-5a26-4fd9-beec-2448ced6d42a req-37841005-9a46-413c-b8a1-4c9dd76cdf9d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:15.409996 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-1ff146ec-5a26-4fd9-beec-2448ced6d42a req-37841005-9a46-413c-b8a1-4c9dd76cdf9d service nova] Creating event network-vif-deleted:47bf89ee-9954-4b95-8607-a086661df3bd for instance 87cc4d83-fd02-4a96-a640-3cad08bba4f4 on n-h2-843700-1 May 28 04:40:15.419701 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-1ff146ec-5a26-4fd9-beec-2448ced6d42a req-37841005-9a46-413c-b8a1-4c9dd76cdf9d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056571 May 28 04:40:15.420624 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 807/1679] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:15.433110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c3629f70-5974-450e-8965-117c27c82d4b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:15.433110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c3629f70-5974-450e-8965-117c27c82d4b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:15.436945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3629f70-5974-450e-8965-117c27c82d4b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:15.437695 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3629f70-5974-450e-8965-117c27c82d4b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:15.438930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3629f70-5974-450e-8965-117c27c82d4b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:15.439910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3629f70-5974-450e-8965-117c27c82d4b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:15.556665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f352afa7-25f9-482b-b558-a8f43820303a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:15.568547 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f352afa7-25f9-482b-b558-a8f43820303a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.290371 May 28 04:40:15.569783 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 873/1680] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:15 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:15.680143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c3629f70-5974-450e-8965-117c27c82d4b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:15.689697 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c3629f70-5974-450e-8965-117c27c82d4b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1471 microversion: 2.1 time: 0.267545 May 28 04:40:15.691731 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 808/1681] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:15 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1471 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:15.734158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2fd561be-a146-48a1-8aa9-be481c2c4360 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:15.734784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2fd561be-a146-48a1-8aa9-be481c2c4360 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:15.760145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2fd561be-a146-48a1-8aa9-be481c2c4360 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:15.761007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2fd561be-a146-48a1-8aa9-be481c2c4360 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:15.762255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2fd561be-a146-48a1-8aa9-be481c2c4360 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:15.762917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2fd561be-a146-48a1-8aa9-be481c2c4360 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:15.947844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2fd561be-a146-48a1-8aa9-be481c2c4360 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:15.985529 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2fd561be-a146-48a1-8aa9-be481c2c4360 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1316 microversion: 2.1 time: 0.240373 May 28 04:40:16.018075 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 874/1682] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:15 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1316 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:16.281673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e4c2bf32-336b-47d3-a51c-442e1ff05acb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:16.283189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e4c2bf32-336b-47d3-a51c-442e1ff05acb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:16.290766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4c2bf32-336b-47d3-a51c-442e1ff05acb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:16.292320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4c2bf32-336b-47d3-a51c-442e1ff05acb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:16.293908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4c2bf32-336b-47d3-a51c-442e1ff05acb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:16.294972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4c2bf32-336b-47d3-a51c-442e1ff05acb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:16.333573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4c2bf32-336b-47d3-a51c-442e1ff05acb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:16.334402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4c2bf32-336b-47d3-a51c-442e1ff05acb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:16.335092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-e4c2bf32-336b-47d3-a51c-442e1ff05acb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lazy-loading 'fault' on Instance uuid 87cc4d83-fd02-4a96-a640-3cad08bba4f4 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:40:16.388441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ad6e67a7-d74f-48ad-ab7a-b22ef656b36b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:16.392915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ad6e67a7-d74f-48ad-ab7a-b22ef656b36b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:16.424145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad6e67a7-d74f-48ad-ab7a-b22ef656b36b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:16.424145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad6e67a7-d74f-48ad-ab7a-b22ef656b36b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:16.431028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad6e67a7-d74f-48ad-ab7a-b22ef656b36b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:16.439728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad6e67a7-d74f-48ad-ab7a-b22ef656b36b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:16.447713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e4c2bf32-336b-47d3-a51c-442e1ff05acb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:16.460306 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e4c2bf32-336b-47d3-a51c-442e1ff05acb tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 200 len: 1303 microversion: 2.1 time: 0.183125 May 28 04:40:16.461924 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 809/1683] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:16 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 1303 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:16.587426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2a3f1cb1-7931-42d2-9354-22d3b5bcc04b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:16.587683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2a3f1cb1-7931-42d2-9354-22d3b5bcc04b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:16.598568 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a3f1cb1-7931-42d2-9354-22d3b5bcc04b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:16.599327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a3f1cb1-7931-42d2-9354-22d3b5bcc04b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:16.611501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a3f1cb1-7931-42d2-9354-22d3b5bcc04b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:16.611982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a3f1cb1-7931-42d2-9354-22d3b5bcc04b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:16.960981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ad6e67a7-d74f-48ad-ab7a-b22ef656b36b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:16.976142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ad6e67a7-d74f-48ad-ab7a-b22ef656b36b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:16.979216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ad6e67a7-d74f-48ad-ab7a-b22ef656b36b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:16.981234 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ad6e67a7-d74f-48ad-ab7a-b22ef656b36b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.603436 May 28 04:40:16.989310 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 875/1684] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:40:16 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:40:16.999097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e9e73e3c-84b2-455d-942a-dd6ac7d2b58f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:17.000081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e9e73e3c-84b2-455d-942a-dd6ac7d2b58f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:17.007692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9e73e3c-84b2-455d-942a-dd6ac7d2b58f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:17.008433 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9e73e3c-84b2-455d-942a-dd6ac7d2b58f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:17.009407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9e73e3c-84b2-455d-942a-dd6ac7d2b58f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:17.010043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9e73e3c-84b2-455d-942a-dd6ac7d2b58f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:17.027872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2a3f1cb1-7931-42d2-9354-22d3b5bcc04b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:17.037939 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2a3f1cb1-7931-42d2-9354-22d3b5bcc04b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.455159 May 28 04:40:17.038899 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 810/1685] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:16 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:17.080317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c1ef5d95-3c19-47cc-ac52-5a7ceb5a0cbc tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:17.082640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c1ef5d95-3c19-47cc-ac52-5a7ceb5a0cbc tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:17.108981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1ef5d95-3c19-47cc-ac52-5a7ceb5a0cbc tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:17.109946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1ef5d95-3c19-47cc-ac52-5a7ceb5a0cbc tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:17.110937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1ef5d95-3c19-47cc-ac52-5a7ceb5a0cbc tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:17.115112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1ef5d95-3c19-47cc-ac52-5a7ceb5a0cbc tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:17.237176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e9e73e3c-84b2-455d-942a-dd6ac7d2b58f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:17.250643 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e9e73e3c-84b2-455d-942a-dd6ac7d2b58f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1471 microversion: 2.1 time: 0.259239 May 28 04:40:17.264187 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 876/1686] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:16 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:17.419067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c1ef5d95-3c19-47cc-ac52-5a7ceb5a0cbc tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:17.433978 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c1ef5d95-3c19-47cc-ac52-5a7ceb5a0cbc tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1316 microversion: 2.1 time: 0.393085 May 28 04:40:17.450325 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 811/1687] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:17 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1316 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:17.488160 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-732952a0-85a3-43d6-b678-8abed72b806f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:17.489664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-732952a0-85a3-43d6-b678-8abed72b806f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: 87cc4d83-fd02-4a96-a640-3cad08bba4f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:17.498676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-732952a0-85a3-43d6-b678-8abed72b806f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:17.499173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-732952a0-85a3-43d6-b678-8abed72b806f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:17.500055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-732952a0-85a3-43d6-b678-8abed72b806f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:17.500501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-732952a0-85a3-43d6-b678-8abed72b806f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:17.527612 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-732952a0-85a3-43d6-b678-8abed72b806f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] HTTP exception thrown: Instance 87cc4d83-fd02-4a96-a640-3cad08bba4f4 could not be found. May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-732952a0-85a3-43d6-b678-8abed72b806f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Request method failure captured: May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 HTTP/1.1 May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZgUmcA-Sbmftb2t5Q6OHdXxcGW6GI-KfaMZyu750yKZujQOQ2OUFdsVNU5ZhfEP0s4eC_5zGdA9j4c0NgvwSNrcuXtruIwW5QtrLthHvaPIoqs6h9Vt8iOqvfR3KPSxIjH6obhSU1Pnurm7zq-PcxF51E9TAmeQOA3XTnORd0X6DM May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 506fcf1e564049258c90cf33d274fc5f May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-MigrationsAdminTest-1790988062 May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:40:17.529435 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:40:17.530948 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_506fcf1e564049258c90cf33d274fc5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/506fcf1e564049258c90cf33d274fc5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/506fcf1e564049258c90cf33d274fc5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/506fcf1e564049258c90cf33d274fc5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:40:17.530948 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-MigrationsAdminTest-1790988062 May 28 04:40:17.530948 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 506fcf1e564049258c90cf33d274fc5f May 28 04:40:17.530948 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-MigrationsAdminTest-1790988062 May 28 04:40:17.530948 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-MigrationsAdminTest-1790988062-project May 28 04:40:17.530948 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:40:17.530948 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:40:17.530948 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 6d208bde90d54f7487f39c505b884285 May 28 04:40:17.530948 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-MigrationsAdminTest-1790988062-project May 28 04:40:17.530948 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:40:17.530948 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 87cc4d83-fd02-4a96-a640-3cad08bba4f4 could not be found. May 28 04:40:17.530948 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '87cc4d83-fd02-4a96-a640-3cad08bba4f4'} May 28 04:40:17.531909 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:40:17.531909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:17.531909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:40:17.531909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:40:17.531909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:40:17.531909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:40:17.531909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:40:17.531909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:40:17.531909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:40:17.531909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:40:17.531909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87cc4d83-fd02-4a96-a640-3cad08bba4f4 could not be found. May 28 04:40:17.531909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:17.531909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:17.531909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:17.531909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:17.531909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:17.531909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:17.531909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:40:17.531909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:40:17.531909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:40:17.543184 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:40:17.543184 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:40:17.543184 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:40:17.543184 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:40:17.543184 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:40:17.543184 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:40:17.543184 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:40:17.543184 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87cc4d83-fd02-4a96-a640-3cad08bba4f4 could not be found. May 28 04:40:17.543184 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:17.543184 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:17.543184 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:17.543184 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:17.543184 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:17.543184 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:17.543184 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:40:17.543184 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:40:17.543184 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87cc4d83-fd02-4a96-a640-3cad08bba4f4 could not be found. May 28 04:40:17.543184 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:17.544478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-732952a0-85a3-43d6-b678-8abed72b806f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Returning 404 to user: Instance 87cc4d83-fd02-4a96-a640-3cad08bba4f4 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:40:17.544478 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-732952a0-85a3-43d6-b678-8abed72b806f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4" status: 404 len: 111 microversion: 2.1 time: 0.049038 May 28 04:40:17.544478 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 877/1688] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:17 2022] GET /compute/v2.1/servers/87cc4d83-fd02-4a96-a640-3cad08bba4f4 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:40:17.544717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-50306b63-e5b2-4502-a267-979f6b5ff90e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:17.544717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-50306b63-e5b2-4502-a267-979f6b5ff90e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:17.552115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50306b63-e5b2-4502-a267-979f6b5ff90e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:17.553077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50306b63-e5b2-4502-a267-979f6b5ff90e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:17.553955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50306b63-e5b2-4502-a267-979f6b5ff90e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:17.554670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50306b63-e5b2-4502-a267-979f6b5ff90e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:17.591754 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-50306b63-e5b2-4502-a267-979f6b5ff90e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:40:17.594136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:18.006261 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-02077152-1f1b-46dd-96f4-9b5dc8ca12d1 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:18.007187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-02077152-1f1b-46dd-96f4-9b5dc8ca12d1 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:18.024583 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-50306b63-e5b2-4502-a267-979f6b5ff90e tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 204 len: 0 microversion: 2.1 time: 0.488369 May 28 04:40:18.026929 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 812/1689] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:40:17 2022] DELETE /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:40:18.027086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02077152-1f1b-46dd-96f4-9b5dc8ca12d1 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:18.034966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bc332851-6c14-4e3a-8234-6ae0cdf8840f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:18.035960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bc332851-6c14-4e3a-8234-6ae0cdf8840f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:18.038501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02077152-1f1b-46dd-96f4-9b5dc8ca12d1 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:18.046922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02077152-1f1b-46dd-96f4-9b5dc8ca12d1 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:18.049626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02077152-1f1b-46dd-96f4-9b5dc8ca12d1 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:18.056416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc332851-6c14-4e3a-8234-6ae0cdf8840f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:18.056416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc332851-6c14-4e3a-8234-6ae0cdf8840f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:18.064710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc332851-6c14-4e3a-8234-6ae0cdf8840f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:18.065731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc332851-6c14-4e3a-8234-6ae0cdf8840f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:18.324741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-02077152-1f1b-46dd-96f4-9b5dc8ca12d1 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:18.348819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-02077152-1f1b-46dd-96f4-9b5dc8ca12d1 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:18.350813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-02077152-1f1b-46dd-96f4-9b5dc8ca12d1 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:18.352387 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-02077152-1f1b-46dd-96f4-9b5dc8ca12d1 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.350338 May 28 04:40:18.363662 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 878/1690] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:40:18 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:40:18.376277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-584a235a-1151-4b03-9469-65b7cde178e8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:18.378467 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-584a235a-1151-4b03-9469-65b7cde178e8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:18.386947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-584a235a-1151-4b03-9469-65b7cde178e8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:18.389911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-584a235a-1151-4b03-9469-65b7cde178e8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:18.391020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-584a235a-1151-4b03-9469-65b7cde178e8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:18.391639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-584a235a-1151-4b03-9469-65b7cde178e8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:18.561523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bc332851-6c14-4e3a-8234-6ae0cdf8840f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:18.576102 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bc332851-6c14-4e3a-8234-6ae0cdf8840f tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1468 microversion: 2.1 time: 0.544952 May 28 04:40:18.577419 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 813/1691] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:18 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1468 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:18.587615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8d765603-ad6c-430c-a72c-cd064894bdce tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:18.588240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8d765603-ad6c-430c-a72c-cd064894bdce tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:18.627048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d765603-ad6c-430c-a72c-cd064894bdce tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:18.628442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d765603-ad6c-430c-a72c-cd064894bdce tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:18.629256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d765603-ad6c-430c-a72c-cd064894bdce tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:18.629692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d765603-ad6c-430c-a72c-cd064894bdce tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:18.715953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-584a235a-1151-4b03-9469-65b7cde178e8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:18.739907 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-584a235a-1151-4b03-9469-65b7cde178e8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.362677 May 28 04:40:18.740899 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 879/1692] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:18 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:18.755226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1e3b71a4-4139-4604-b165-ea20dfaeeddb tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:18.756548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1e3b71a4-4139-4604-b165-ea20dfaeeddb tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:18.771546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e3b71a4-4139-4604-b165-ea20dfaeeddb tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:18.772544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e3b71a4-4139-4604-b165-ea20dfaeeddb tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:18.773564 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e3b71a4-4139-4604-b165-ea20dfaeeddb tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:18.774980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e3b71a4-4139-4604-b165-ea20dfaeeddb tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:18.948425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8d765603-ad6c-430c-a72c-cd064894bdce tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:18.960694 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8d765603-ad6c-430c-a72c-cd064894bdce tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1471 microversion: 2.1 time: 0.382111 May 28 04:40:18.962588 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 814/1693] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:18 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1471 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:19.013827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1e3b71a4-4139-4604-b165-ea20dfaeeddb tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:19.023143 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1e3b71a4-4139-4604-b165-ea20dfaeeddb tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1316 microversion: 2.1 time: 0.279259 May 28 04:40:19.023940 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 880/1694] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:18 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1316 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:19.378061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-17de809a-f19a-48d8-8e46-32977bce5ed8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:19.379205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-17de809a-f19a-48d8-8e46-32977bce5ed8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:19.389972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17de809a-f19a-48d8-8e46-32977bce5ed8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:19.391924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17de809a-f19a-48d8-8e46-32977bce5ed8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:19.393229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17de809a-f19a-48d8-8e46-32977bce5ed8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:19.394100 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17de809a-f19a-48d8-8e46-32977bce5ed8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:19.601475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dc84398e-4bbe-408c-9db7-87864d7eea32 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:19.602453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dc84398e-4bbe-408c-9db7-87864d7eea32 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:19.616365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc84398e-4bbe-408c-9db7-87864d7eea32 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:19.620477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc84398e-4bbe-408c-9db7-87864d7eea32 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:19.625105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc84398e-4bbe-408c-9db7-87864d7eea32 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:19.625832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc84398e-4bbe-408c-9db7-87864d7eea32 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:19.945389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-17de809a-f19a-48d8-8e46-32977bce5ed8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:20.000696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-17de809a-f19a-48d8-8e46-32977bce5ed8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:20.006467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-17de809a-f19a-48d8-8e46-32977bce5ed8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:20.009731 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-17de809a-f19a-48d8-8e46-32977bce5ed8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.637206 May 28 04:40:20.017716 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 815/1695] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:40:19 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:40:20.030159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-60ed2a16-6a94-440b-80fd-0fe3df8ec263 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:20.047270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-60ed2a16-6a94-440b-80fd-0fe3df8ec263 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:20.068235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60ed2a16-6a94-440b-80fd-0fe3df8ec263 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:20.070767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60ed2a16-6a94-440b-80fd-0fe3df8ec263 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:20.071866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60ed2a16-6a94-440b-80fd-0fe3df8ec263 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:20.080011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60ed2a16-6a94-440b-80fd-0fe3df8ec263 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:20.188137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dc84398e-4bbe-408c-9db7-87864d7eea32 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:20.188137 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dc84398e-4bbe-408c-9db7-87864d7eea32 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1468 microversion: 2.1 time: 0.592213 May 28 04:40:20.194707 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 881/1696] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:19 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1468 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:20.226152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a601d312-f9e9-4c10-9b49-55026cc44d8a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:20.226740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a601d312-f9e9-4c10-9b49-55026cc44d8a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:20.262323 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a601d312-f9e9-4c10-9b49-55026cc44d8a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:20.267499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a601d312-f9e9-4c10-9b49-55026cc44d8a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:20.270499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a601d312-f9e9-4c10-9b49-55026cc44d8a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:20.272204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a601d312-f9e9-4c10-9b49-55026cc44d8a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:20.479646 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-60ed2a16-6a94-440b-80fd-0fe3df8ec263 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:20.496715 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-60ed2a16-6a94-440b-80fd-0fe3df8ec263 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.477509 May 28 04:40:20.503717 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 816/1697] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:20 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:20.518955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cd920045-74f8-48ab-abea-a0aa579f5261 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:20.524151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cd920045-74f8-48ab-abea-a0aa579f5261 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:20.551241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd920045-74f8-48ab-abea-a0aa579f5261 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:20.551760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd920045-74f8-48ab-abea-a0aa579f5261 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:20.553096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd920045-74f8-48ab-abea-a0aa579f5261 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:20.553096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd920045-74f8-48ab-abea-a0aa579f5261 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:20.583933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a601d312-f9e9-4c10-9b49-55026cc44d8a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:20.597595 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a601d312-f9e9-4c10-9b49-55026cc44d8a tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1471 microversion: 2.1 time: 0.400822 May 28 04:40:20.599049 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 882/1698] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:20 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1471 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:20.910573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cd920045-74f8-48ab-abea-a0aa579f5261 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:20.920735 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cd920045-74f8-48ab-abea-a0aa579f5261 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1316 microversion: 2.1 time: 0.412212 May 28 04:40:20.927751 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 817/1699] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:20 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1316 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:21.038968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-836dfffe-0961-4e97-85c8-44ce465da5ab tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:21.040069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-836dfffe-0961-4e97-85c8-44ce465da5ab tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:21.064429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-836dfffe-0961-4e97-85c8-44ce465da5ab tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:21.068105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-836dfffe-0961-4e97-85c8-44ce465da5ab tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:21.071993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-836dfffe-0961-4e97-85c8-44ce465da5ab tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:21.073992 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-836dfffe-0961-4e97-85c8-44ce465da5ab tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:21.213997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b0a5ac6a-2b84-46bc-93be-c2b86b9bb871 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:21.215617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b0a5ac6a-2b84-46bc-93be-c2b86b9bb871 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:21.234477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0a5ac6a-2b84-46bc-93be-c2b86b9bb871 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:21.236035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0a5ac6a-2b84-46bc-93be-c2b86b9bb871 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:21.237785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0a5ac6a-2b84-46bc-93be-c2b86b9bb871 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:21.239664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0a5ac6a-2b84-46bc-93be-c2b86b9bb871 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:21.829887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b0a5ac6a-2b84-46bc-93be-c2b86b9bb871 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:21.850700 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b0a5ac6a-2b84-46bc-93be-c2b86b9bb871 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1468 microversion: 2.1 time: 0.643569 May 28 04:40:21.851543 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 818/1700] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:21 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1468 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:40:21.866510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e0b9f45b-6897-4112-896c-334ae5d15331 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:21.867443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e0b9f45b-6897-4112-896c-334ae5d15331 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:21.884606 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0b9f45b-6897-4112-896c-334ae5d15331 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:21.885499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0b9f45b-6897-4112-896c-334ae5d15331 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:21.886590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0b9f45b-6897-4112-896c-334ae5d15331 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:21.887253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0b9f45b-6897-4112-896c-334ae5d15331 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:22.467887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e0b9f45b-6897-4112-896c-334ae5d15331 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:22.470695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-836dfffe-0961-4e97-85c8-44ce465da5ab tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:22.484881 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-836dfffe-0961-4e97-85c8-44ce465da5ab tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:22.490088 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e0b9f45b-6897-4112-896c-334ae5d15331 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.632343 May 28 04:40:22.491649 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 819/1701] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:21 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:22.492292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-836dfffe-0961-4e97-85c8-44ce465da5ab tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:22.498568 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-836dfffe-0961-4e97-85c8-44ce465da5ab tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 1.465327 May 28 04:40:22.499266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2d6d30ea-8c43-409a-835b-e1b95e561f59 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:22.503178 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 883/1702] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:40:21 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:40:22.518601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b146ed66-6611-456d-a353-265e95c4686e tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:22.520003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b146ed66-6611-456d-a353-265e95c4686e tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:22.538667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2d6d30ea-8c43-409a-835b-e1b95e561f59 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:22.543790 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b146ed66-6611-456d-a353-265e95c4686e tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:22.546945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b146ed66-6611-456d-a353-265e95c4686e tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:22.551448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b146ed66-6611-456d-a353-265e95c4686e tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:22.553250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b146ed66-6611-456d-a353-265e95c4686e tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:22.558683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d6d30ea-8c43-409a-835b-e1b95e561f59 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:22.559767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d6d30ea-8c43-409a-835b-e1b95e561f59 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:22.560920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d6d30ea-8c43-409a-835b-e1b95e561f59 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:22.563492 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d6d30ea-8c43-409a-835b-e1b95e561f59 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:23.191930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2d6d30ea-8c43-409a-835b-e1b95e561f59 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:23.205044 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2d6d30ea-8c43-409a-835b-e1b95e561f59 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1471 microversion: 2.1 time: 0.711608 May 28 04:40:23.218511 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 820/1703] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:22 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1471 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:23.228142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7a8a6d92-8e84-4ac0-a52a-bac637086f06 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:23.229633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7a8a6d92-8e84-4ac0-a52a-bac637086f06 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:23.246662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a8a6d92-8e84-4ac0-a52a-bac637086f06 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:23.250168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a8a6d92-8e84-4ac0-a52a-bac637086f06 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:23.251245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a8a6d92-8e84-4ac0-a52a-bac637086f06 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:23.255342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a8a6d92-8e84-4ac0-a52a-bac637086f06 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:23.318632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b146ed66-6611-456d-a353-265e95c4686e tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:23.333874 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b146ed66-6611-456d-a353-265e95c4686e tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1503 microversion: 2.1 time: 0.831646 May 28 04:40:23.334532 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 884/1704] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:22 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1503 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:23.343078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-ccd03cd7-a7aa-4dbb-8b3b-a21b4c8fd315 req-245de8d9-b75f-4e52-87ad-f8eda4f89125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ffc58d-f5a5-4f93-aac8-6348d9d576ba", "name": "network-vif-deleted", "tag": "0a34d596-0c1e-4988-a19f-7e0e80837d92"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:23.365970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:23.381584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ccd03cd7-a7aa-4dbb-8b3b-a21b4c8fd315 req-245de8d9-b75f-4e52-87ad-f8eda4f89125 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:23.382109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ccd03cd7-a7aa-4dbb-8b3b-a21b4c8fd315 req-245de8d9-b75f-4e52-87ad-f8eda4f89125 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:23.431764 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-ccd03cd7-a7aa-4dbb-8b3b-a21b4c8fd315 req-245de8d9-b75f-4e52-87ad-f8eda4f89125 service nova] Creating event network-vif-deleted:0a34d596-0c1e-4988-a19f-7e0e80837d92 for instance 23ffc58d-f5a5-4f93-aac8-6348d9d576ba on n-h1-843700-1 May 28 04:40:23.447065 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-ccd03cd7-a7aa-4dbb-8b3b-a21b4c8fd315 req-245de8d9-b75f-4e52-87ad-f8eda4f89125 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107357 May 28 04:40:23.452544 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 885/1705] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:23.482683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a47ce3f4-f9e8-422f-ae8d-8574d7038509 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:23.483361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a47ce3f4-f9e8-422f-ae8d-8574d7038509 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:23.507885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a47ce3f4-f9e8-422f-ae8d-8574d7038509 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:23.508374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a47ce3f4-f9e8-422f-ae8d-8574d7038509 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:23.513649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a47ce3f4-f9e8-422f-ae8d-8574d7038509 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:23.514115 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a47ce3f4-f9e8-422f-ae8d-8574d7038509 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:23.614593 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a47ce3f4-f9e8-422f-ae8d-8574d7038509 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed/ips" status: 200 len: 107 microversion: 2.1 time: 0.156455 May 28 04:40:23.616820 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 886/1706] 10.222.0.58 () {58 vars in 1247 bytes} [Sat May 28 04:40:23 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed/ips => generated 107 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:23.632121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-569972ec-e7be-479d-9933-60d813ff55c1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:23.632747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-569972ec-e7be-479d-9933-60d813ff55c1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:23.641126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-569972ec-e7be-479d-9933-60d813ff55c1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:23.642044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-569972ec-e7be-479d-9933-60d813ff55c1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:23.642981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-569972ec-e7be-479d-9933-60d813ff55c1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:23.643765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-569972ec-e7be-479d-9933-60d813ff55c1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:23.787055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7a8a6d92-8e84-4ac0-a52a-bac637086f06 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:23.806892 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7a8a6d92-8e84-4ac0-a52a-bac637086f06 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1468 microversion: 2.1 time: 0.584991 May 28 04:40:23.820457 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 821/1707] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:23 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1468 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:23.855820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-87fcf32f-7229-451e-84d4-6ae7ed000d75 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:23.863913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-87fcf32f-7229-451e-84d4-6ae7ed000d75 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:23.876754 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87fcf32f-7229-451e-84d4-6ae7ed000d75 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:23.878761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87fcf32f-7229-451e-84d4-6ae7ed000d75 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:23.879839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87fcf32f-7229-451e-84d4-6ae7ed000d75 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:23.881194 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87fcf32f-7229-451e-84d4-6ae7ed000d75 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:23.918636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-569972ec-e7be-479d-9933-60d813ff55c1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:23.927998 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-569972ec-e7be-479d-9933-60d813ff55c1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.300048 May 28 04:40:23.941679 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 887/1708] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:23 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:23.978544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6bd6136c-8da2-458d-b417-539a6bbe6258 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:23.978544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6bd6136c-8da2-458d-b417-539a6bbe6258 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:23.978544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6bd6136c-8da2-458d-b417-539a6bbe6258 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:23.978544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6bd6136c-8da2-458d-b417-539a6bbe6258 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:23.980673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6bd6136c-8da2-458d-b417-539a6bbe6258 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:23.980673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6bd6136c-8da2-458d-b417-539a6bbe6258 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:24.039130 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6bd6136c-8da2-458d-b417-539a6bbe6258 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed/ips" status: 200 len: 107 microversion: 2.1 time: 0.085491 May 28 04:40:24.047942 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 888/1709] 10.222.0.58 () {58 vars in 1247 bytes} [Sat May 28 04:40:23 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed/ips => generated 107 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:24.054220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e2fe9916-50c3-4227-9464-8fe282632c42 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:24.054953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e2fe9916-50c3-4227-9464-8fe282632c42 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:24.068779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2fe9916-50c3-4227-9464-8fe282632c42 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:24.069545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2fe9916-50c3-4227-9464-8fe282632c42 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:24.070576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2fe9916-50c3-4227-9464-8fe282632c42 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:24.071389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2fe9916-50c3-4227-9464-8fe282632c42 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:24.112444 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e2fe9916-50c3-4227-9464-8fe282632c42 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed/ips/tempest-ServerAddressesTestJSON-84048950-network" status: 200 len: 92 microversion: 2.1 time: 0.062661 May 28 04:40:24.120867 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 889/1710] 10.222.0.58 () {58 vars in 1394 bytes} [Sat May 28 04:40:24 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed/ips/tempest-ServerAddressesTestJSON-84048950-network => generated 92 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:40:24.140201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3086afdd-f54a-4696-a319-59fada2db83c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:24.140781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3086afdd-f54a-4696-a319-59fada2db83c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:24.149807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3086afdd-f54a-4696-a319-59fada2db83c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:24.151758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3086afdd-f54a-4696-a319-59fada2db83c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:24.151758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3086afdd-f54a-4696-a319-59fada2db83c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:24.152899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3086afdd-f54a-4696-a319-59fada2db83c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:24.221829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3086afdd-f54a-4696-a319-59fada2db83c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:40:24.275210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:24.357440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-87fcf32f-7229-451e-84d4-6ae7ed000d75 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:24.369054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-87fcf32f-7229-451e-84d4-6ae7ed000d75 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:24.371622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-87fcf32f-7229-451e-84d4-6ae7ed000d75 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:24.373109 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-87fcf32f-7229-451e-84d4-6ae7ed000d75 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.551580 May 28 04:40:24.378014 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 822/1711] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:40:23 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:40:24.380024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2d52371f-9d28-4d94-b413-ec912ecbdc4f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:24.380200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2d52371f-9d28-4d94-b413-ec912ecbdc4f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:24.398411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d52371f-9d28-4d94-b413-ec912ecbdc4f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:24.401649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d52371f-9d28-4d94-b413-ec912ecbdc4f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:24.401649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d52371f-9d28-4d94-b413-ec912ecbdc4f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:24.401649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d52371f-9d28-4d94-b413-ec912ecbdc4f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:24.502578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d52371f-9d28-4d94-b413-ec912ecbdc4f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:24.504257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d52371f-9d28-4d94-b413-ec912ecbdc4f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:24.504881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-2d52371f-9d28-4d94-b413-ec912ecbdc4f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lazy-loading 'fault' on Instance uuid 23ffc58d-f5a5-4f93-aac8-6348d9d576ba {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:40:24.590748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2d52371f-9d28-4d94-b413-ec912ecbdc4f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:24.600628 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2d52371f-9d28-4d94-b413-ec912ecbdc4f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1306 microversion: 2.1 time: 0.225775 May 28 04:40:24.611101 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 823/1712] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:24 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1306 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:24.611101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-85815455-9877-4563-9998-792af08484c2 req-d75fdb58-2b1d-4209-88b7-e44457798ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2af79f0-ae7c-40fd-8034-3a957e218bbd", "name": "network-vif-deleted", "tag": "e0a73643-7263-4551-8d5a-5ef51b6fe3b3"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:24.621464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-85815455-9877-4563-9998-792af08484c2 req-d75fdb58-2b1d-4209-88b7-e44457798ca4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:24.622194 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-85815455-9877-4563-9998-792af08484c2 req-d75fdb58-2b1d-4209-88b7-e44457798ca4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:24.640308 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-85815455-9877-4563-9998-792af08484c2 req-d75fdb58-2b1d-4209-88b7-e44457798ca4 service nova] Creating event network-vif-deleted:e0a73643-7263-4551-8d5a-5ef51b6fe3b3 for instance c2af79f0-ae7c-40fd-8034-3a957e218bbd on n-h1-843700-1 May 28 04:40:24.648694 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-85815455-9877-4563-9998-792af08484c2 req-d75fdb58-2b1d-4209-88b7-e44457798ca4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046055 May 28 04:40:24.650161 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 824/1713] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:24.684164 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3086afdd-f54a-4696-a319-59fada2db83c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "DELETE /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 204 len: 0 microversion: 2.1 time: 0.557677 May 28 04:40:24.689100 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 890/1714] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:40:24 2022] DELETE /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:40:24.694736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8f6f98bd-68f0-43ca-be58-000fd41b25f2 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:24.695475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8f6f98bd-68f0-43ca-be58-000fd41b25f2 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:24.703826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f6f98bd-68f0-43ca-be58-000fd41b25f2 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:24.704278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f6f98bd-68f0-43ca-be58-000fd41b25f2 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:24.705156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f6f98bd-68f0-43ca-be58-000fd41b25f2 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:24.705827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f6f98bd-68f0-43ca-be58-000fd41b25f2 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:24.835581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0f30d328-c9de-41e0-a276-566c4a10350c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:24.836231 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0f30d328-c9de-41e0-a276-566c4a10350c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:24.843617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f30d328-c9de-41e0-a276-566c4a10350c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:24.844072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f30d328-c9de-41e0-a276-566c4a10350c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:24.844851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f30d328-c9de-41e0-a276-566c4a10350c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:24.845580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f30d328-c9de-41e0-a276-566c4a10350c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:24.861578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8f6f98bd-68f0-43ca-be58-000fd41b25f2 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:24.872186 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8f6f98bd-68f0-43ca-be58-000fd41b25f2 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1509 microversion: 2.1 time: 0.181723 May 28 04:40:24.880491 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 825/1715] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:24 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:40:24.904503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:24.948842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0f30d328-c9de-41e0-a276-566c4a10350c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:24.950037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6eb1f234-a120-45f2-ba73-edcd5884c23b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:24.950681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6eb1f234-a120-45f2-ba73-edcd5884c23b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:24.958259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6eb1f234-a120-45f2-ba73-edcd5884c23b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:24.958664 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0f30d328-c9de-41e0-a276-566c4a10350c tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1297 microversion: 2.1 time: 0.128402 May 28 04:40:24.958801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6eb1f234-a120-45f2-ba73-edcd5884c23b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:24.959543 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 891/1716] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:24 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1297 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:40:24.969029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6eb1f234-a120-45f2-ba73-edcd5884c23b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:24.969604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6eb1f234-a120-45f2-ba73-edcd5884c23b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:25.157160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6eb1f234-a120-45f2-ba73-edcd5884c23b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:25.164490 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6eb1f234-a120-45f2-ba73-edcd5884c23b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.219496 May 28 04:40:25.165091 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 826/1717] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:24 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:40:25.393788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-480a5b48-0cbe-48cd-ac0f-41c537a02684 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:25.394375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-480a5b48-0cbe-48cd-ac0f-41c537a02684 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:25.403279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-480a5b48-0cbe-48cd-ac0f-41c537a02684 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:25.403768 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-480a5b48-0cbe-48cd-ac0f-41c537a02684 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:25.404544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-480a5b48-0cbe-48cd-ac0f-41c537a02684 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:25.404976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-480a5b48-0cbe-48cd-ac0f-41c537a02684 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:25.558684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-480a5b48-0cbe-48cd-ac0f-41c537a02684 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:25.567951 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-480a5b48-0cbe-48cd-ac0f-41c537a02684 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:25.569639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-480a5b48-0cbe-48cd-ac0f-41c537a02684 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:25.571043 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-480a5b48-0cbe-48cd-ac0f-41c537a02684 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.181249 May 28 04:40:25.578477 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 892/1718] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:40:25 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:40:25.626502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aa73d6f4-bab3-4c74-8e45-5a30c0516900 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:25.627274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-aa73d6f4-bab3-4c74-8e45-5a30c0516900 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:25.634545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa73d6f4-bab3-4c74-8e45-5a30c0516900 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:25.638875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa73d6f4-bab3-4c74-8e45-5a30c0516900 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:25.638875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa73d6f4-bab3-4c74-8e45-5a30c0516900 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:25.638875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa73d6f4-bab3-4c74-8e45-5a30c0516900 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:25.674880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa73d6f4-bab3-4c74-8e45-5a30c0516900 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:25.675177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa73d6f4-bab3-4c74-8e45-5a30c0516900 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:25.675488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-aa73d6f4-bab3-4c74-8e45-5a30c0516900 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lazy-loading 'fault' on Instance uuid 23ffc58d-f5a5-4f93-aac8-6348d9d576ba {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:40:25.718896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-aa73d6f4-bab3-4c74-8e45-5a30c0516900 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:25.721635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:25.728200 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aa73d6f4-bab3-4c74-8e45-5a30c0516900 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1306 microversion: 2.1 time: 0.105637 May 28 04:40:25.729477 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 827/1719] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:25 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1306 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:25.892176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-225aec21-7803-472c-b19d-1e712c835599 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:25.892909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-225aec21-7803-472c-b19d-1e712c835599 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:25.899244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-225aec21-7803-472c-b19d-1e712c835599 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:25.899720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-225aec21-7803-472c-b19d-1e712c835599 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:25.900556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-225aec21-7803-472c-b19d-1e712c835599 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:25.901523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-225aec21-7803-472c-b19d-1e712c835599 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:25.977521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fcf93cde-e861-4e5b-99e7-5c1953ed5ab9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:25.978044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fcf93cde-e861-4e5b-99e7-5c1953ed5ab9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:25.985936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcf93cde-e861-4e5b-99e7-5c1953ed5ab9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:25.986395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcf93cde-e861-4e5b-99e7-5c1953ed5ab9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:25.987321 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcf93cde-e861-4e5b-99e7-5c1953ed5ab9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:25.988062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcf93cde-e861-4e5b-99e7-5c1953ed5ab9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:26.073571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fcf93cde-e861-4e5b-99e7-5c1953ed5ab9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:26.078042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-225aec21-7803-472c-b19d-1e712c835599 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:26.082120 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fcf93cde-e861-4e5b-99e7-5c1953ed5ab9 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1297 microversion: 2.1 time: 0.109013 May 28 04:40:26.083069 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 828/1720] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:25 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1297 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:26.087772 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-225aec21-7803-472c-b19d-1e712c835599 tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1509 microversion: 2.1 time: 0.199742 May 28 04:40:26.089111 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 893/1721] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:25 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1509 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:26.184043 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5259d732-432b-41bb-a44f-5fd9a15b2c26 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:26.184695 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5259d732-432b-41bb-a44f-5fd9a15b2c26 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:26.191106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5259d732-432b-41bb-a44f-5fd9a15b2c26 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:26.191564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5259d732-432b-41bb-a44f-5fd9a15b2c26 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:26.192344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5259d732-432b-41bb-a44f-5fd9a15b2c26 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:26.192814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5259d732-432b-41bb-a44f-5fd9a15b2c26 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:26.375178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5259d732-432b-41bb-a44f-5fd9a15b2c26 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:26.387068 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5259d732-432b-41bb-a44f-5fd9a15b2c26 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.206789 May 28 04:40:26.387876 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 829/1722] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:26 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:26.608091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9bd3c7fd-d639-4f51-9e27-75f8ccddfcf0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:26.608091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9bd3c7fd-d639-4f51-9e27-75f8ccddfcf0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:26.629302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9bd3c7fd-d639-4f51-9e27-75f8ccddfcf0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:26.630235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9bd3c7fd-d639-4f51-9e27-75f8ccddfcf0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:26.640361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9bd3c7fd-d639-4f51-9e27-75f8ccddfcf0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:26.641503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9bd3c7fd-d639-4f51-9e27-75f8ccddfcf0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:26.748658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e6285054-cf1e-40d1-a040-bf3fcb2bbfad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:26.749284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e6285054-cf1e-40d1-a040-bf3fcb2bbfad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:26.759353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6285054-cf1e-40d1-a040-bf3fcb2bbfad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:26.759353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6285054-cf1e-40d1-a040-bf3fcb2bbfad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:26.759802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6285054-cf1e-40d1-a040-bf3fcb2bbfad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:26.760902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6285054-cf1e-40d1-a040-bf3fcb2bbfad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:26.819142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9bd3c7fd-d639-4f51-9e27-75f8ccddfcf0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:26.832601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9bd3c7fd-d639-4f51-9e27-75f8ccddfcf0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:26.834466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9bd3c7fd-d639-4f51-9e27-75f8ccddfcf0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:26.835969 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9bd3c7fd-d639-4f51-9e27-75f8ccddfcf0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1645 microversion: 2.25 time: 0.248492 May 28 04:40:26.837165 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 894/1723] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:40:26 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1645 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:40:26.857556 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6285054-cf1e-40d1-a040-bf3fcb2bbfad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:26.858015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6285054-cf1e-40d1-a040-bf3fcb2bbfad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:26.864116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-e6285054-cf1e-40d1-a040-bf3fcb2bbfad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lazy-loading 'fault' on Instance uuid 23ffc58d-f5a5-4f93-aac8-6348d9d576ba {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:40:26.934596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e6285054-cf1e-40d1-a040-bf3fcb2bbfad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:26.943709 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e6285054-cf1e-40d1-a040-bf3fcb2bbfad tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 200 len: 1306 microversion: 2.1 time: 0.200640 May 28 04:40:26.944572 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 830/1724] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:26 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 1306 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:27.104562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a4e4a80b-ae7c-4449-bf06-3039e94e2d07 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:27.105302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a4e4a80b-ae7c-4449-bf06-3039e94e2d07 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:27.106738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5dad5ef2-80c7-453d-920d-ece5a871056e tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:27.114902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5dad5ef2-80c7-453d-920d-ece5a871056e tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:27.124799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5dad5ef2-80c7-453d-920d-ece5a871056e tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:27.124990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5dad5ef2-80c7-453d-920d-ece5a871056e tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:27.125852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5dad5ef2-80c7-453d-920d-ece5a871056e tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:27.126285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5dad5ef2-80c7-453d-920d-ece5a871056e tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:27.136335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4e4a80b-ae7c-4449-bf06-3039e94e2d07 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:27.146848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4e4a80b-ae7c-4449-bf06-3039e94e2d07 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:27.146848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4e4a80b-ae7c-4449-bf06-3039e94e2d07 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:27.146848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4e4a80b-ae7c-4449-bf06-3039e94e2d07 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:27.185655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4e4a80b-ae7c-4449-bf06-3039e94e2d07 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:27.192806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4e4a80b-ae7c-4449-bf06-3039e94e2d07 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:27.192806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-a4e4a80b-ae7c-4449-bf06-3039e94e2d07 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lazy-loading 'fault' on Instance uuid c2af79f0-ae7c-40fd-8034-3a957e218bbd {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:40:27.278215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a4e4a80b-ae7c-4449-bf06-3039e94e2d07 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d208bde90d54f7487f39c505b884285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fcf1e564049258c90cf33d274fc5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:27.287541 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a4e4a80b-ae7c-4449-bf06-3039e94e2d07 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 200 len: 1302 microversion: 2.1 time: 0.190042 May 28 04:40:27.298440 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 895/1725] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:27 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 1302 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:27.405349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0ddcc4f2-9e55-43e2-b1d3-2708f8a2ce21 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:27.406644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0ddcc4f2-9e55-43e2-b1d3-2708f8a2ce21 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:27.414357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ddcc4f2-9e55-43e2-b1d3-2708f8a2ce21 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:27.415256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ddcc4f2-9e55-43e2-b1d3-2708f8a2ce21 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:27.416268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ddcc4f2-9e55-43e2-b1d3-2708f8a2ce21 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:27.417348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ddcc4f2-9e55-43e2-b1d3-2708f8a2ce21 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:27.495160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5dad5ef2-80c7-453d-920d-ece5a871056e tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:27.519095 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5dad5ef2-80c7-453d-920d-ece5a871056e tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1509 microversion: 2.1 time: 0.417398 May 28 04:40:27.519940 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 831/1726] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:27 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1509 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:40:27.524920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-0377392c-8e65-4846-915e-3ef6a2b1902a req-7c3624b8-c00a-4484-ad07-cac4d737dee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54045fbc-26d8-48c2-a385-c62ee2e4e1ed", "name": "network-vif-deleted", "tag": "4be01961-66da-42a9-8515-382ddd7b2e3e"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:27.534507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0377392c-8e65-4846-915e-3ef6a2b1902a req-7c3624b8-c00a-4484-ad07-cac4d737dee5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:27.535046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0377392c-8e65-4846-915e-3ef6a2b1902a req-7c3624b8-c00a-4484-ad07-cac4d737dee5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:27.548304 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-0377392c-8e65-4846-915e-3ef6a2b1902a req-7c3624b8-c00a-4484-ad07-cac4d737dee5 service nova] Creating event network-vif-deleted:4be01961-66da-42a9-8515-382ddd7b2e3e for instance 54045fbc-26d8-48c2-a385-c62ee2e4e1ed on n-h1-843700-1 May 28 04:40:27.553598 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-0377392c-8e65-4846-915e-3ef6a2b1902a req-7c3624b8-c00a-4484-ad07-cac4d737dee5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032753 May 28 04:40:27.554410 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 832/1727] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:27.606057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0ddcc4f2-9e55-43e2-b1d3-2708f8a2ce21 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:27.617745 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0ddcc4f2-9e55-43e2-b1d3-2708f8a2ce21 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.215874 May 28 04:40:27.627085 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 896/1728] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:27 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:40:27.859701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d85e738a-356c-4926-af7a-eb5a4064f044 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:27.860402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d85e738a-356c-4926-af7a-eb5a4064f044 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:27.867623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d85e738a-356c-4926-af7a-eb5a4064f044 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:27.868076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d85e738a-356c-4926-af7a-eb5a4064f044 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:27.868845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d85e738a-356c-4926-af7a-eb5a4064f044 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:27.869307 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d85e738a-356c-4926-af7a-eb5a4064f044 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:27.962308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1795ea0e-ce62-4680-b6d7-7d339f993090 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:27.964075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1795ea0e-ce62-4680-b6d7-7d339f993090 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 23ffc58d-f5a5-4f93-aac8-6348d9d576ba] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:27.979239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1795ea0e-ce62-4680-b6d7-7d339f993090 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:27.979712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1795ea0e-ce62-4680-b6d7-7d339f993090 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:27.980513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1795ea0e-ce62-4680-b6d7-7d339f993090 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:27.980956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1795ea0e-ce62-4680-b6d7-7d339f993090 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:28.012329 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-1795ea0e-ce62-4680-b6d7-7d339f993090 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] HTTP exception thrown: Instance 23ffc58d-f5a5-4f93-aac8-6348d9d576ba could not be found. May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1795ea0e-ce62-4680-b6d7-7d339f993090 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Request method failure captured: May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba HTTP/1.1 May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikacM2KhD78yFRK4EsqhrSyTkAV6Nk1F7FXJklf8auTvIKGrUmSmLWcwCIjKaPM6QlxxtXfRYh5fIpqbGQIq7lvQWGQ3on9q1XMdmR40ZvjC765A16ijPz3gObMshF2VFgwx83uBQA7MXjlNEOTRDuEMLE2TFSD0l-hdWW3mhb5DGOiM May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: e7a5b721a538475cbac9c95c61647753 May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:40:28.014031 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:40:28.015608 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e7a5b721a538475cbac9c95c61647753"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:40:28.015608 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:28.015608 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: e7a5b721a538475cbac9c95c61647753 May 28 04:40:28.015608 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:28.015608 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersOnMultiNodesTest-1039499615-project May 28 04:40:28.015608 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:40:28.015608 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:40:28.015608 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: d398d45627fc4d33bc9a736ddf8f9215 May 28 04:40:28.015608 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersOnMultiNodesTest-1039499615-project May 28 04:40:28.015608 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:40:28.015608 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 23ffc58d-f5a5-4f93-aac8-6348d9d576ba could not be found. May 28 04:40:28.015608 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '23ffc58d-f5a5-4f93-aac8-6348d9d576ba'} May 28 04:40:28.016542 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:40:28.016542 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:28.016542 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:40:28.016542 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:40:28.016542 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:40:28.016542 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:40:28.016542 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:40:28.016542 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:40:28.016542 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:40:28.016542 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:40:28.016542 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23ffc58d-f5a5-4f93-aac8-6348d9d576ba could not be found. May 28 04:40:28.016542 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:28.016542 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:28.016542 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:28.016542 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:28.016542 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:28.016542 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:28.016542 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:40:28.016542 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:40:28.016542 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:40:28.018471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:40:28.018471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:40:28.018471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:40:28.018471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:40:28.018471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:40:28.018471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:40:28.018471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:40:28.018471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23ffc58d-f5a5-4f93-aac8-6348d9d576ba could not be found. May 28 04:40:28.018471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:28.018471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:28.018471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:28.018471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:28.018471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:28.018471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:28.018471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:40:28.018471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:40:28.018471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23ffc58d-f5a5-4f93-aac8-6348d9d576ba could not be found. May 28 04:40:28.018471 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:28.020552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1795ea0e-ce62-4680-b6d7-7d339f993090 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Returning 404 to user: Instance 23ffc58d-f5a5-4f93-aac8-6348d9d576ba could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:40:28.020552 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1795ea0e-ce62-4680-b6d7-7d339f993090 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba" status: 404 len: 111 microversion: 2.1 time: 0.059066 May 28 04:40:28.020552 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 897/1729] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:27 2022] GET /compute/v2.1/servers/23ffc58d-f5a5-4f93-aac8-6348d9d576ba => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:40:28.023647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d85e738a-356c-4926-af7a-eb5a4064f044 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:28.030087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2756320c-e174-4938-a96a-3f9e991465f4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:28.034149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2756320c-e174-4938-a96a-3f9e991465f4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:28.035359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d85e738a-356c-4926-af7a-eb5a4064f044 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:28.036987 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d85e738a-356c-4926-af7a-eb5a4064f044 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:28.038435 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d85e738a-356c-4926-af7a-eb5a4064f044 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1635 microversion: 2.25 time: 0.183141 May 28 04:40:28.039410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2756320c-e174-4938-a96a-3f9e991465f4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:28.039872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2756320c-e174-4938-a96a-3f9e991465f4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:28.040657 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2756320c-e174-4938-a96a-3f9e991465f4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:28.041326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2756320c-e174-4938-a96a-3f9e991465f4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:28.048402 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 833/1730] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:40:27 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1635 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:40:28.056056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d637676f-d3cc-43a3-80b5-ac70ba810422 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '.version_select at 0x7f7701d931f0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:28.061469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d637676f-d3cc-43a3-80b5-ac70ba810422 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:28.061469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d637676f-d3cc-43a3-80b5-ac70ba810422 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:28.069516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2756320c-e174-4938-a96a-3f9e991465f4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:40:28.071043 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d637676f-d3cc-43a3-80b5-ac70ba810422 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 3449 microversion: 2.25 time: 0.018918 May 28 04:40:28.071877 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 834/1731] 10.222.0.58 () {60 vars in 1183 bytes} [Sat May 28 04:40:28 2022] GET /compute/v2.1/os-migrations => generated 3449 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:40:28.086349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-67c825fd-3837-45e8-bd70-886ef4ec2349 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:28.086349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-67c825fd-3837-45e8-bd70-886ef4ec2349 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:28.092193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-67c825fd-3837-45e8-bd70-886ef4ec2349 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:28.092649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-67c825fd-3837-45e8-bd70-886ef4ec2349 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:28.093427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-67c825fd-3837-45e8-bd70-886ef4ec2349 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:28.093872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-67c825fd-3837-45e8-bd70-886ef4ec2349 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:28.236976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-67c825fd-3837-45e8-bd70-886ef4ec2349 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lazy-loading 'services' on Instance uuid 315db9ca-6acb-462a-a538-1b888d62e083 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:40:28.253548 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-67c825fd-3837-45e8-bd70-886ef4ec2349 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 2127 microversion: 2.25 time: 0.172196 May 28 04:40:28.254188 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 835/1732] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:40:28 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 2127 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:40:28.272527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1fbd0197-afae-4b01-99e3-64257dd4e5bf tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:28.273189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1fbd0197-afae-4b01-99e3-64257dd4e5bf tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:28.279787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1fbd0197-afae-4b01-99e3-64257dd4e5bf tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:28.280421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1fbd0197-afae-4b01-99e3-64257dd4e5bf tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:28.281465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1fbd0197-afae-4b01-99e3-64257dd4e5bf tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:28.282098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1fbd0197-afae-4b01-99e3-64257dd4e5bf tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:28.425438 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2756320c-e174-4938-a96a-3f9e991465f4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "DELETE /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726" status: 204 len: 0 microversion: 2.1 time: 0.400016 May 28 04:40:28.426809 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 898/1733] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:40:28 2022] DELETE /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 04:40:28.434967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d1157326-d20d-48f1-9ec2-cb9c0ffe7e95 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:28.435742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d1157326-d20d-48f1-9ec2-cb9c0ffe7e95 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] [instance: c2af79f0-ae7c-40fd-8034-3a957e218bbd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:28.443152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d1157326-d20d-48f1-9ec2-cb9c0ffe7e95 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:28.443651 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d1157326-d20d-48f1-9ec2-cb9c0ffe7e95 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:28.444795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d1157326-d20d-48f1-9ec2-cb9c0ffe7e95 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:28.445290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d1157326-d20d-48f1-9ec2-cb9c0ffe7e95 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:28.445621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-1fbd0197-afae-4b01-99e3-64257dd4e5bf tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lazy-loading 'services' on Instance uuid 315db9ca-6acb-462a-a538-1b888d62e083 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:40:28.460919 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1fbd0197-afae-4b01-99e3-64257dd4e5bf tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 2127 microversion: 2.25 time: 0.192744 May 28 04:40:28.461957 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-d1157326-d20d-48f1-9ec2-cb9c0ffe7e95 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] HTTP exception thrown: Instance c2af79f0-ae7c-40fd-8034-3a957e218bbd could not be found. May 28 04:40:28.462547 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 836/1734] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:40:28 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 2127 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d1157326-d20d-48f1-9ec2-cb9c0ffe7e95 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Request method failure captured: May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd HTTP/1.1 May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZgUmcA-Sbmftb2t5Q6OHdXxcGW6GI-KfaMZyu750yKZujQOQ2OUFdsVNU5ZhfEP0s4eC_5zGdA9j4c0NgvwSNrcuXtruIwW5QtrLthHvaPIoqs6h9Vt8iOqvfR3KPSxIjH6obhSU1Pnurm7zq-PcxF51E9TAmeQOA3XTnORd0X6DM May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 506fcf1e564049258c90cf33d274fc5f May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-MigrationsAdminTest-1790988062 May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:40:28.463713 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:40:28.465409 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_506fcf1e564049258c90cf33d274fc5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/506fcf1e564049258c90cf33d274fc5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/506fcf1e564049258c90cf33d274fc5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/506fcf1e564049258c90cf33d274fc5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:40:28.465409 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-MigrationsAdminTest-1790988062 May 28 04:40:28.465409 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 506fcf1e564049258c90cf33d274fc5f May 28 04:40:28.465409 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-MigrationsAdminTest-1790988062 May 28 04:40:28.465409 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-MigrationsAdminTest-1790988062-project May 28 04:40:28.465409 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:40:28.465409 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:40:28.465409 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 6d208bde90d54f7487f39c505b884285 May 28 04:40:28.465409 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-MigrationsAdminTest-1790988062-project May 28 04:40:28.465409 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:40:28.465409 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance c2af79f0-ae7c-40fd-8034-3a957e218bbd could not be found. May 28 04:40:28.465409 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'c2af79f0-ae7c-40fd-8034-3a957e218bbd'} May 28 04:40:28.466362 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:40:28.466362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:28.466362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:40:28.466362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:40:28.466362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:40:28.466362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:40:28.466362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:40:28.466362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:40:28.466362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:40:28.466362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:40:28.466362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2af79f0-ae7c-40fd-8034-3a957e218bbd could not be found. May 28 04:40:28.466362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:28.466362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:28.466362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:28.466362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:28.466362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:28.466362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:28.466362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:40:28.466362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:40:28.466362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:40:28.467968 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:40:28.467968 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:40:28.467968 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:40:28.467968 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:40:28.467968 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:40:28.467968 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:40:28.467968 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:40:28.467968 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2af79f0-ae7c-40fd-8034-3a957e218bbd could not be found. May 28 04:40:28.467968 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:28.467968 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:28.467968 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:28.467968 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:28.467968 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:28.467968 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:28.467968 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:40:28.467968 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:40:28.467968 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2af79f0-ae7c-40fd-8034-3a957e218bbd could not be found. May 28 04:40:28.467968 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:28.469328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d1157326-d20d-48f1-9ec2-cb9c0ffe7e95 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] Returning 404 to user: Instance c2af79f0-ae7c-40fd-8034-3a957e218bbd could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:40:28.469328 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d1157326-d20d-48f1-9ec2-cb9c0ffe7e95 tempest-MigrationsAdminTest-1790988062 tempest-MigrationsAdminTest-1790988062-project] 10.222.0.58 "GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd" status: 404 len: 111 microversion: 2.1 time: 0.036942 May 28 04:40:28.469328 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 899/1735] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:28 2022] GET /compute/v2.1/servers/c2af79f0-ae7c-40fd-8034-3a957e218bbd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:40:28.473735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-08f210ed-e62a-48f5-aa1c-ad7e7aa24143 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:28.474824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-08f210ed-e62a-48f5-aa1c-ad7e7aa24143 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:28.491865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-08f210ed-e62a-48f5-aa1c-ad7e7aa24143 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:28.491865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-08f210ed-e62a-48f5-aa1c-ad7e7aa24143 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:28.491865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-08f210ed-e62a-48f5-aa1c-ad7e7aa24143 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:28.491865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-08f210ed-e62a-48f5-aa1c-ad7e7aa24143 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:28.537523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7b1e74cf-fcd9-4c4f-a3d3-7b2a8dec2ceb tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:28.538870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7b1e74cf-fcd9-4c4f-a3d3-7b2a8dec2ceb tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:28.557819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b1e74cf-fcd9-4c4f-a3d3-7b2a8dec2ceb tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:28.558580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b1e74cf-fcd9-4c4f-a3d3-7b2a8dec2ceb tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:28.561435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b1e74cf-fcd9-4c4f-a3d3-7b2a8dec2ceb tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:28.563668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b1e74cf-fcd9-4c4f-a3d3-7b2a8dec2ceb tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:28.618366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b1e74cf-fcd9-4c4f-a3d3-7b2a8dec2ceb tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:28.619422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b1e74cf-fcd9-4c4f-a3d3-7b2a8dec2ceb tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:28.624561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-7b1e74cf-fcd9-4c4f-a3d3-7b2a8dec2ceb tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lazy-loading 'fault' on Instance uuid 54045fbc-26d8-48c2-a385-c62ee2e4e1ed {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:40:28.683531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7b1e74cf-fcd9-4c4f-a3d3-7b2a8dec2ceb tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:28.693913 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7b1e74cf-fcd9-4c4f-a3d3-7b2a8dec2ceb tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1306 microversion: 2.1 time: 0.161448 May 28 04:40:28.694527 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 900/1736] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:28 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1306 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:40:28.718579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f3a01959-1be1-49a9-ad87-85b58c4d724b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:28.719774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f3a01959-1be1-49a9-ad87-85b58c4d724b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:28.736522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f3a01959-1be1-49a9-ad87-85b58c4d724b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:28.737281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f3a01959-1be1-49a9-ad87-85b58c4d724b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:28.738370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f3a01959-1be1-49a9-ad87-85b58c4d724b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:28.738826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f3a01959-1be1-49a9-ad87-85b58c4d724b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:28.757885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-08f210ed-e62a-48f5-aa1c-ad7e7aa24143 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:28.770825 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-08f210ed-e62a-48f5-aa1c-ad7e7aa24143 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726" status: 200 len: 1472 microversion: 2.1 time: 0.306387 May 28 04:40:28.772159 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 837/1737] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:28 2022] GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726 => generated 1472 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:28.777509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d61272e2-851e-4c4b-9047-c3c6e077322e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:28.778347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d61272e2-851e-4c4b-9047-c3c6e077322e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:28.788972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d61272e2-851e-4c4b-9047-c3c6e077322e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:28.789877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d61272e2-851e-4c4b-9047-c3c6e077322e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:28.791766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d61272e2-851e-4c4b-9047-c3c6e077322e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:28.792502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d61272e2-851e-4c4b-9047-c3c6e077322e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:28.955879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-f3a01959-1be1-49a9-ad87-85b58c4d724b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lazy-loading 'services' on Instance uuid 315db9ca-6acb-462a-a538-1b888d62e083 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:40:29.018308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d61272e2-851e-4c4b-9047-c3c6e077322e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:29.030874 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d61272e2-851e-4c4b-9047-c3c6e077322e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.257379 May 28 04:40:29.031716 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 838/1738] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:28 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:29.318784 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f3a01959-1be1-49a9-ad87-85b58c4d724b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments/dc20310d-8753-44ba-9332-a63e13d07b1d" status: 202 len: 0 microversion: 2.25 time: 0.622723 May 28 04:40:29.319847 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 901/1739] 10.222.0.58 () {60 vars in 1456 bytes} [Sat May 28 04:40:28 2022] DELETE /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments/dc20310d-8753-44ba-9332-a63e13d07b1d => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 04:40:29.328948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d8d64649-e399-4317-b556-fe84612ff64e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:29.329937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d8d64649-e399-4317-b556-fe84612ff64e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:29.338701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8d64649-e399-4317-b556-fe84612ff64e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:29.339187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8d64649-e399-4317-b556-fe84612ff64e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:29.348662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8d64649-e399-4317-b556-fe84612ff64e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:29.349195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8d64649-e399-4317-b556-fe84612ff64e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:29.419406 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d8d64649-e399-4317-b556-fe84612ff64e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.094976 May 28 04:40:29.422072 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 839/1740] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 04:40:29 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:40:29.714531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d9140623-7e80-441a-b1ef-4091676bb61b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:29.715939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d9140623-7e80-441a-b1ef-4091676bb61b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:29.724452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9140623-7e80-441a-b1ef-4091676bb61b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:29.726158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9140623-7e80-441a-b1ef-4091676bb61b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:29.727322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9140623-7e80-441a-b1ef-4091676bb61b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:29.728010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9140623-7e80-441a-b1ef-4091676bb61b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:29.777894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9140623-7e80-441a-b1ef-4091676bb61b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:29.778694 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9140623-7e80-441a-b1ef-4091676bb61b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:29.780115 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-d9140623-7e80-441a-b1ef-4091676bb61b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lazy-loading 'fault' on Instance uuid 54045fbc-26d8-48c2-a385-c62ee2e4e1ed {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:40:29.790330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cb74db41-ef42-46f0-8d90-3754e9389dc4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:29.791632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cb74db41-ef42-46f0-8d90-3754e9389dc4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:29.813277 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb74db41-ef42-46f0-8d90-3754e9389dc4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:29.813277 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb74db41-ef42-46f0-8d90-3754e9389dc4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:29.813277 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb74db41-ef42-46f0-8d90-3754e9389dc4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:29.813277 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb74db41-ef42-46f0-8d90-3754e9389dc4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:29.893639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d9140623-7e80-441a-b1ef-4091676bb61b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c0e12aa2f4bde96dfad15ed07511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4deea6ba047db89f3bdedb33cfe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:29.906507 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d9140623-7e80-441a-b1ef-4091676bb61b tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 200 len: 1306 microversion: 2.1 time: 0.194459 May 28 04:40:29.915775 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 902/1741] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:29 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 1306 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:30.051454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ddc57005-b618-41e8-bb7d-cefecb178fa1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:30.052696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ddc57005-b618-41e8-bb7d-cefecb178fa1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:30.068250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddc57005-b618-41e8-bb7d-cefecb178fa1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:30.071241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddc57005-b618-41e8-bb7d-cefecb178fa1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:30.073398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddc57005-b618-41e8-bb7d-cefecb178fa1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:30.076026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddc57005-b618-41e8-bb7d-cefecb178fa1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:30.578912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cb74db41-ef42-46f0-8d90-3754e9389dc4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:30.587858 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cb74db41-ef42-46f0-8d90-3754e9389dc4 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726" status: 200 len: 1472 microversion: 2.1 time: 0.801450 May 28 04:40:30.602699 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 840/1742] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:29 2022] GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726 => generated 1472 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:30.613502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b37d0666-4acb-4809-a766-7f058b67f965 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:30.617633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b37d0666-4acb-4809-a766-7f058b67f965 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:30.642642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b37d0666-4acb-4809-a766-7f058b67f965 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:30.644948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b37d0666-4acb-4809-a766-7f058b67f965 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:30.657404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b37d0666-4acb-4809-a766-7f058b67f965 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:30.658169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b37d0666-4acb-4809-a766-7f058b67f965 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:30.715581 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b37d0666-4acb-4809-a766-7f058b67f965 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.111264 May 28 04:40:30.716731 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 841/1743] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 04:40:30 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:40:30.924204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0a8eb8ec-00fc-4234-9d53-fc6afdf8be3c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:30.924882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0a8eb8ec-00fc-4234-9d53-fc6afdf8be3c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] [instance: 54045fbc-26d8-48c2-a385-c62ee2e4e1ed] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:30.936723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a8eb8ec-00fc-4234-9d53-fc6afdf8be3c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:30.947078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a8eb8ec-00fc-4234-9d53-fc6afdf8be3c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:30.948963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a8eb8ec-00fc-4234-9d53-fc6afdf8be3c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:30.949091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a8eb8ec-00fc-4234-9d53-fc6afdf8be3c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:30.980628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ddc57005-b618-41e8-bb7d-cefecb178fa1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:30.989738 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ddc57005-b618-41e8-bb7d-cefecb178fa1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.945258 May 28 04:40:30.993044 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 903/1744] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:30 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:31.005021 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-0a8eb8ec-00fc-4234-9d53-fc6afdf8be3c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] HTTP exception thrown: Instance 54045fbc-26d8-48c2-a385-c62ee2e4e1ed could not be found. May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0a8eb8ec-00fc-4234-9d53-fc6afdf8be3c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Request method failure captured: May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed HTTP/1.1 May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaeTEKm6WaIPGS_rwehZeneAPXtlpMFrIPJrEunaeHEcxzPlTpHMQR0hNfqxgnQL3WP-lUcBg-MObUWKjtK2T-0sVHMzrvZGMqhv7WzCudYMxs_TmWPqNG6kVjqO4EK2gZZi5kfl5XU-baumWSruuuTDJQCMivs6CEvPZESfqWiHzwc May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 55c4deea6ba047db89f3bdedb33cfe8b May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerAddressesTestJSON-1859289470 May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:40:31.007408 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:40:31.011624 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_55c4deea6ba047db89f3bdedb33cfe8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/55c4deea6ba047db89f3bdedb33cfe8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55c4deea6ba047db89f3bdedb33cfe8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55c4deea6ba047db89f3bdedb33cfe8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:40:31.011624 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerAddressesTestJSON-1859289470 May 28 04:40:31.011624 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 55c4deea6ba047db89f3bdedb33cfe8b May 28 04:40:31.011624 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1859289470 May 28 04:40:31.011624 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerAddressesTestJSON-1859289470-project May 28 04:40:31.011624 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:40:31.011624 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:40:31.011624 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: d54c0e12aa2f4bde96dfad15ed07511d May 28 04:40:31.011624 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerAddressesTestJSON-1859289470-project May 28 04:40:31.011624 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:40:31.011624 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 54045fbc-26d8-48c2-a385-c62ee2e4e1ed could not be found. May 28 04:40:31.011624 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '54045fbc-26d8-48c2-a385-c62ee2e4e1ed'} May 28 04:40:31.012466 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:40:31.012466 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:31.012466 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:40:31.012466 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:40:31.012466 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:40:31.012466 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:40:31.012466 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:40:31.012466 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:40:31.012466 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:40:31.012466 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:40:31.012466 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54045fbc-26d8-48c2-a385-c62ee2e4e1ed could not be found. May 28 04:40:31.012466 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:31.012466 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:31.012466 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:31.012466 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:31.012466 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:31.012466 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:31.012466 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:40:31.012466 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:40:31.012466 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:40:31.013686 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:40:31.013686 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:40:31.013686 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:40:31.013686 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:40:31.013686 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:40:31.013686 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:40:31.013686 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:40:31.013686 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54045fbc-26d8-48c2-a385-c62ee2e4e1ed could not be found. May 28 04:40:31.013686 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:31.013686 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:31.013686 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:31.013686 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:31.013686 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:31.013686 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:31.013686 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:40:31.013686 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:40:31.013686 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54045fbc-26d8-48c2-a385-c62ee2e4e1ed could not be found. May 28 04:40:31.013686 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:31.015919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0a8eb8ec-00fc-4234-9d53-fc6afdf8be3c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] Returning 404 to user: Instance 54045fbc-26d8-48c2-a385-c62ee2e4e1ed could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:40:31.015919 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0a8eb8ec-00fc-4234-9d53-fc6afdf8be3c tempest-ServerAddressesTestJSON-1859289470 tempest-ServerAddressesTestJSON-1859289470-project] 10.222.0.58 "GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed" status: 404 len: 111 microversion: 2.1 time: 0.089725 May 28 04:40:31.015919 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 842/1745] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:30 2022] GET /compute/v2.1/servers/54045fbc-26d8-48c2-a385-c62ee2e4e1ed => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:40:31.403419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-2926dc92-0cdf-4c43-bf61-9a00bbcaf43d req-2891ba02-e233-4a19-857a-c47ebc3bdd7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ca89b1-056f-4926-95d4-fb4b04a07726", "name": "network-vif-deleted", "tag": "450cde40-853d-4a07-a420-3788b25387d1"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:31.431224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2926dc92-0cdf-4c43-bf61-9a00bbcaf43d req-2891ba02-e233-4a19-857a-c47ebc3bdd7f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:31.434623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2926dc92-0cdf-4c43-bf61-9a00bbcaf43d req-2891ba02-e233-4a19-857a-c47ebc3bdd7f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:31.493208 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-2926dc92-0cdf-4c43-bf61-9a00bbcaf43d req-2891ba02-e233-4a19-857a-c47ebc3bdd7f service nova] Creating event network-vif-deleted:450cde40-853d-4a07-a420-3788b25387d1 for instance 97ca89b1-056f-4926-95d4-fb4b04a07726 on n-h1-843700-1 May 28 04:40:31.508641 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-2926dc92-0cdf-4c43-bf61-9a00bbcaf43d req-2891ba02-e233-4a19-857a-c47ebc3bdd7f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112556 May 28 04:40:31.511322 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 904/1746] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:31.608117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-11d2d706-3fab-455c-92b2-e55a839a7b67 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:31.608749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-11d2d706-3fab-455c-92b2-e55a839a7b67 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:31.617734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11d2d706-3fab-455c-92b2-e55a839a7b67 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:31.617734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11d2d706-3fab-455c-92b2-e55a839a7b67 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:31.617734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11d2d706-3fab-455c-92b2-e55a839a7b67 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:31.617734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11d2d706-3fab-455c-92b2-e55a839a7b67 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:31.730745 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7b803e4c-326b-4a63-88bb-26c95f11ed2c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:31.731850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7b803e4c-326b-4a63-88bb-26c95f11ed2c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:31.740462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-11d2d706-3fab-455c-92b2-e55a839a7b67 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:31.758334 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-11d2d706-3fab-455c-92b2-e55a839a7b67 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726" status: 200 len: 1301 microversion: 2.1 time: 0.151459 May 28 04:40:31.760522 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 843/1747] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:31 2022] GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726 => generated 1301 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:31.766982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b803e4c-326b-4a63-88bb-26c95f11ed2c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:31.768691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b803e4c-326b-4a63-88bb-26c95f11ed2c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:31.769729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b803e4c-326b-4a63-88bb-26c95f11ed2c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:31.779812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b803e4c-326b-4a63-88bb-26c95f11ed2c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:31.796683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:31.927802 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7b803e4c-326b-4a63-88bb-26c95f11ed2c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.199857 May 28 04:40:31.933261 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 905/1748] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 04:40:31 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 04:40:32.010159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c6d40bb0-eacc-4b67-885d-54810ade6b07 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:32.011197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c6d40bb0-eacc-4b67-885d-54810ade6b07 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:32.022586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6d40bb0-eacc-4b67-885d-54810ade6b07 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:32.035813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6d40bb0-eacc-4b67-885d-54810ade6b07 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:32.037012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6d40bb0-eacc-4b67-885d-54810ade6b07 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:32.039297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6d40bb0-eacc-4b67-885d-54810ade6b07 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:32.401602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c6d40bb0-eacc-4b67-885d-54810ade6b07 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:32.418438 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c6d40bb0-eacc-4b67-885d-54810ade6b07 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.412453 May 28 04:40:32.425736 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 844/1749] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:32 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:32.777166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-36ff64e6-c631-4cd6-b663-9cb8bba6c420 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:32.777915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-36ff64e6-c631-4cd6-b663-9cb8bba6c420 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 97ca89b1-056f-4926-95d4-fb4b04a07726] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:32.794678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36ff64e6-c631-4cd6-b663-9cb8bba6c420 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:32.795342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36ff64e6-c631-4cd6-b663-9cb8bba6c420 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:32.798963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36ff64e6-c631-4cd6-b663-9cb8bba6c420 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:32.798963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36ff64e6-c631-4cd6-b663-9cb8bba6c420 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:32.820439 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-36ff64e6-c631-4cd6-b663-9cb8bba6c420 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] HTTP exception thrown: Instance 97ca89b1-056f-4926-95d4-fb4b04a07726 could not be found. May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-36ff64e6-c631-4cd6-b663-9cb8bba6c420 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Request method failure captured: May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726 HTTP/1.1 May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikacM2KhD78yFRK4EsqhrSyTkAV6Nk1F7FXJklf8auTvIKGrUmSmLWcwCIjKaPM6QlxxtXfRYh5fIpqbGQIq7lvQWGQ3on9q1XMdmR40ZvjC765A16ijPz3gObMshF2VFgwx83uBQA7MXjlNEOTRDuEMLE2TFSD0l-hdWW3mhb5DGOiM May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: e7a5b721a538475cbac9c95c61647753 May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:40:32.827945 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:40:32.829621 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e7a5b721a538475cbac9c95c61647753"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:40:32.829621 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:32.829621 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: e7a5b721a538475cbac9c95c61647753 May 28 04:40:32.829621 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:32.829621 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersOnMultiNodesTest-1039499615-project May 28 04:40:32.829621 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:40:32.829621 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:40:32.829621 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: d398d45627fc4d33bc9a736ddf8f9215 May 28 04:40:32.829621 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersOnMultiNodesTest-1039499615-project May 28 04:40:32.829621 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:40:32.829621 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 97ca89b1-056f-4926-95d4-fb4b04a07726 could not be found. May 28 04:40:32.829621 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '97ca89b1-056f-4926-95d4-fb4b04a07726'} May 28 04:40:32.830650 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:40:32.830650 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:32.830650 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:40:32.830650 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:40:32.830650 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:40:32.830650 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:40:32.830650 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:40:32.830650 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:40:32.830650 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:40:32.830650 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:40:32.830650 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ca89b1-056f-4926-95d4-fb4b04a07726 could not be found. May 28 04:40:32.830650 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:32.830650 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:32.830650 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:32.830650 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:32.830650 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:32.830650 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:32.830650 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:40:32.830650 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:40:32.830650 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:40:32.832453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:40:32.832453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:40:32.832453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:40:32.832453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:40:32.832453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:40:32.832453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:40:32.832453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:40:32.832453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ca89b1-056f-4926-95d4-fb4b04a07726 could not be found. May 28 04:40:32.832453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:32.832453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:32.832453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:32.832453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:32.832453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:32.832453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:32.832453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:40:32.832453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:40:32.832453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ca89b1-056f-4926-95d4-fb4b04a07726 could not be found. May 28 04:40:32.832453 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:32.843833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-36ff64e6-c631-4cd6-b663-9cb8bba6c420 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Returning 404 to user: Instance 97ca89b1-056f-4926-95d4-fb4b04a07726 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:40:32.845014 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-36ff64e6-c631-4cd6-b663-9cb8bba6c420 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726" status: 404 len: 111 microversion: 2.1 time: 0.071882 May 28 04:40:32.846082 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 906/1750] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:32 2022] GET /compute/v2.1/servers/97ca89b1-056f-4926-95d4-fb4b04a07726 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:40:32.854869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f6010b64-4450-467a-aefe-559abb7cbd05 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:32.856045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f6010b64-4450-467a-aefe-559abb7cbd05 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 3e7c11b5-0b9f-4264-b178-d9be01a2abfb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:32.862452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6010b64-4450-467a-aefe-559abb7cbd05 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:32.863205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6010b64-4450-467a-aefe-559abb7cbd05 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:32.864222 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6010b64-4450-467a-aefe-559abb7cbd05 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:32.864864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6010b64-4450-467a-aefe-559abb7cbd05 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:32.909950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:32.928500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f6010b64-4450-467a-aefe-559abb7cbd05 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 3e7c11b5-0b9f-4264-b178-d9be01a2abfb] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:40:32.947981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ba7b26e5-39f3-4588-a955-4cac49537429 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:32.947981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ba7b26e5-39f3-4588-a955-4cac49537429 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:32.958154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba7b26e5-39f3-4588-a955-4cac49537429 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:32.967441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba7b26e5-39f3-4588-a955-4cac49537429 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:32.971961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba7b26e5-39f3-4588-a955-4cac49537429 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:32.972950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba7b26e5-39f3-4588-a955-4cac49537429 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:33.031879 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ba7b26e5-39f3-4588-a955-4cac49537429 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.090826 May 28 04:40:33.033021 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 907/1751] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 04:40:32 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 04:40:33.298872 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f6010b64-4450-467a-aefe-559abb7cbd05 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3e7c11b5-0b9f-4264-b178-d9be01a2abfb" status: 204 len: 0 microversion: 2.1 time: 0.448153 May 28 04:40:33.302584 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 845/1752] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:40:32 2022] DELETE /compute/v2.1/servers/3e7c11b5-0b9f-4264-b178-d9be01a2abfb => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:40:33.310183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3ab97c0a-cc23-4327-8cbd-e919bf223587 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:33.311262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3ab97c0a-cc23-4327-8cbd-e919bf223587 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 37d0f5e8-9f68-4ef2-9310-59c143ba90ad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:33.318810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ab97c0a-cc23-4327-8cbd-e919bf223587 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:33.323546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ab97c0a-cc23-4327-8cbd-e919bf223587 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:33.326543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ab97c0a-cc23-4327-8cbd-e919bf223587 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:33.328711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ab97c0a-cc23-4327-8cbd-e919bf223587 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:33.446446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c9273306-6c6f-4e4f-8e92-aba87ac79073 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:33.448371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c9273306-6c6f-4e4f-8e92-aba87ac79073 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:33.464617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9273306-6c6f-4e4f-8e92-aba87ac79073 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:33.465077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9273306-6c6f-4e4f-8e92-aba87ac79073 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:33.465682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3ab97c0a-cc23-4327-8cbd-e919bf223587 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 37d0f5e8-9f68-4ef2-9310-59c143ba90ad] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:40:33.466440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9273306-6c6f-4e4f-8e92-aba87ac79073 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:33.466898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9273306-6c6f-4e4f-8e92-aba87ac79073 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:33.749819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c9273306-6c6f-4e4f-8e92-aba87ac79073 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:33.767623 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c9273306-6c6f-4e4f-8e92-aba87ac79073 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.327568 May 28 04:40:33.768636 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 846/1753] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:33 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:33.916994 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3ab97c0a-cc23-4327-8cbd-e919bf223587 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "DELETE /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad" status: 204 len: 0 microversion: 2.1 time: 0.612053 May 28 04:40:33.922112 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 908/1754] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:40:33 2022] DELETE /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad => generated 0 bytes in 614 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:40:33.929758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5ef6bc0c-a423-464e-a600-a08bd13b2ccb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:33.933064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5ef6bc0c-a423-464e-a600-a08bd13b2ccb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 3e7c11b5-0b9f-4264-b178-d9be01a2abfb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:33.941930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ef6bc0c-a423-464e-a600-a08bd13b2ccb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:33.943831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ef6bc0c-a423-464e-a600-a08bd13b2ccb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:33.944938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ef6bc0c-a423-464e-a600-a08bd13b2ccb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:33.945646 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ef6bc0c-a423-464e-a600-a08bd13b2ccb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:34.046863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5d87e8e4-2ae8-4813-aade-1d5b1e526c81 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:34.049148 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5d87e8e4-2ae8-4813-aade-1d5b1e526c81 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:34.058110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d87e8e4-2ae8-4813-aade-1d5b1e526c81 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:34.058962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d87e8e4-2ae8-4813-aade-1d5b1e526c81 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:34.060558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d87e8e4-2ae8-4813-aade-1d5b1e526c81 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:34.061247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d87e8e4-2ae8-4813-aade-1d5b1e526c81 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:34.108671 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5d87e8e4-2ae8-4813-aade-1d5b1e526c81 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.067971 May 28 04:40:34.110053 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 909/1755] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 04:40:34 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:40:34.201972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5ef6bc0c-a423-464e-a600-a08bd13b2ccb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:34.213884 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5ef6bc0c-a423-464e-a600-a08bd13b2ccb tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/3e7c11b5-0b9f-4264-b178-d9be01a2abfb" status: 200 len: 1475 microversion: 2.1 time: 0.290381 May 28 04:40:34.224680 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 847/1756] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:33 2022] GET /compute/v2.1/servers/3e7c11b5-0b9f-4264-b178-d9be01a2abfb => generated 1475 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:34.845249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cf454f07-1e59-4141-b4a0-fe68f2226178 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:34.845249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cf454f07-1e59-4141-b4a0-fe68f2226178 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:34.845249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf454f07-1e59-4141-b4a0-fe68f2226178 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:34.845249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf454f07-1e59-4141-b4a0-fe68f2226178 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:34.845662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf454f07-1e59-4141-b4a0-fe68f2226178 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:34.845662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf454f07-1e59-4141-b4a0-fe68f2226178 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:34.940977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cf454f07-1e59-4141-b4a0-fe68f2226178 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:34.950263 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cf454f07-1e59-4141-b4a0-fe68f2226178 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.168803 May 28 04:40:34.951046 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 910/1757] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:34 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:35.133106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-792b1368-77b0-4b8b-87e7-fa0dc1976b9f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:35.136551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-792b1368-77b0-4b8b-87e7-fa0dc1976b9f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:35.153016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-792b1368-77b0-4b8b-87e7-fa0dc1976b9f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:35.153016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-792b1368-77b0-4b8b-87e7-fa0dc1976b9f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:35.153016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-792b1368-77b0-4b8b-87e7-fa0dc1976b9f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:35.153316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-792b1368-77b0-4b8b-87e7-fa0dc1976b9f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:35.235852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-24904330-add3-4902-8ba1-de6f1dc9f90f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:35.236675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-24904330-add3-4902-8ba1-de6f1dc9f90f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 3e7c11b5-0b9f-4264-b178-d9be01a2abfb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:35.245674 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-792b1368-77b0-4b8b-87e7-fa0dc1976b9f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.126452 May 28 04:40:35.251296 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 848/1758] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 04:40:35 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:40:35.262489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24904330-add3-4902-8ba1-de6f1dc9f90f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:35.262959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24904330-add3-4902-8ba1-de6f1dc9f90f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:35.265736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24904330-add3-4902-8ba1-de6f1dc9f90f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:35.266409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24904330-add3-4902-8ba1-de6f1dc9f90f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:35.768977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-24904330-add3-4902-8ba1-de6f1dc9f90f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:35.786218 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-24904330-add3-4902-8ba1-de6f1dc9f90f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/3e7c11b5-0b9f-4264-b178-d9be01a2abfb" status: 200 len: 1475 microversion: 2.1 time: 0.557298 May 28 04:40:35.796584 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 911/1759] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:35 2022] GET /compute/v2.1/servers/3e7c11b5-0b9f-4264-b178-d9be01a2abfb => generated 1475 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:35.800891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-b11794cc-67fc-4430-b35b-9e75c990ce8f req-9658a223-c9c0-49b3-8964-b23dd329603e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7c11b5-0b9f-4264-b178-d9be01a2abfb", "name": "network-vif-deleted", "tag": "9d3dccec-39ea-4342-8fba-7599d04f53f4"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:35.861369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b11794cc-67fc-4430-b35b-9e75c990ce8f req-9658a223-c9c0-49b3-8964-b23dd329603e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:35.862741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b11794cc-67fc-4430-b35b-9e75c990ce8f req-9658a223-c9c0-49b3-8964-b23dd329603e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:35.864657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-903e35ec-4b21-4f0d-81aa-7279e2b39db0 tempest-QuotaClassesAdminTestJSON-2124048461 tempest-QuotaClassesAdminTestJSON-2124048461-project-admin] Calling method '.version_select at 0x7f7701f9b0d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:35.866049 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:40:35.866049 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:40:35.888720 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-903e35ec-4b21-4f0d-81aa-7279e2b39db0 tempest-QuotaClassesAdminTestJSON-2124048461 tempest-QuotaClassesAdminTestJSON-2124048461-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.282831 May 28 04:40:35.895772 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 849/1760] 10.222.0.58 () {58 vars in 1184 bytes} [Sat May 28 04:40:35 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:40:35.906433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8099e066-dacb-41a7-a1c8-7d18920a9092 tempest-QuotaClassesAdminTestJSON-2124048461 tempest-QuotaClassesAdminTestJSON-2124048461-project-admin] Action: 'update', calling method: .version_select at 0x7f77021cfc10>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:35.908923 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:40:35.908923 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:40:35.914384 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-b11794cc-67fc-4430-b35b-9e75c990ce8f req-9658a223-c9c0-49b3-8964-b23dd329603e service nova] Creating event network-vif-deleted:9d3dccec-39ea-4342-8fba-7599d04f53f4 for instance 3e7c11b5-0b9f-4264-b178-d9be01a2abfb on n-h2-843700-1 May 28 04:40:35.937945 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-b11794cc-67fc-4430-b35b-9e75c990ce8f req-9658a223-c9c0-49b3-8964-b23dd329603e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141497 May 28 04:40:35.937945 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 912/1761] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:35.975113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-548647f0-75ac-4e84-b3da-2a586afd09f9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:35.975829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-548647f0-75ac-4e84-b3da-2a586afd09f9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:36.006736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-548647f0-75ac-4e84-b3da-2a586afd09f9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:36.010074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-548647f0-75ac-4e84-b3da-2a586afd09f9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:36.012132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-548647f0-75ac-4e84-b3da-2a586afd09f9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:36.012391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-548647f0-75ac-4e84-b3da-2a586afd09f9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:36.595037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-548647f0-75ac-4e84-b3da-2a586afd09f9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:36.603420 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-548647f0-75ac-4e84-b3da-2a586afd09f9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.636366 May 28 04:40:36.604562 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 913/1762] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:35 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:40:36.625601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-57c81671-5424-4b73-9617-8a3ef2800cad tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:36.626606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-57c81671-5424-4b73-9617-8a3ef2800cad tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:36.637941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57c81671-5424-4b73-9617-8a3ef2800cad tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:36.638528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57c81671-5424-4b73-9617-8a3ef2800cad tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:36.639141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57c81671-5424-4b73-9617-8a3ef2800cad tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:36.639729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57c81671-5424-4b73-9617-8a3ef2800cad tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:36.759035 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-57c81671-5424-4b73-9617-8a3ef2800cad tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.151193 May 28 04:40:36.770841 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 914/1763] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 04:40:36 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:40:36.805969 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-78d49d4d-a237-4e46-a363-9527a1d87d7e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:36.810198 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-78d49d4d-a237-4e46-a363-9527a1d87d7e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 3e7c11b5-0b9f-4264-b178-d9be01a2abfb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:36.813890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=9,nova_api:INSERT=5 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:36.822592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78d49d4d-a237-4e46-a363-9527a1d87d7e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:36.824270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78d49d4d-a237-4e46-a363-9527a1d87d7e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:36.826250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78d49d4d-a237-4e46-a363-9527a1d87d7e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:36.829547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78d49d4d-a237-4e46-a363-9527a1d87d7e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:36.901098 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78d49d4d-a237-4e46-a363-9527a1d87d7e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:36.901098 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78d49d4d-a237-4e46-a363-9527a1d87d7e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:36.901098 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-78d49d4d-a237-4e46-a363-9527a1d87d7e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lazy-loading 'fault' on Instance uuid 3e7c11b5-0b9f-4264-b178-d9be01a2abfb {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:40:37.054938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-78d49d4d-a237-4e46-a363-9527a1d87d7e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:37.087442 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-78d49d4d-a237-4e46-a363-9527a1d87d7e tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/3e7c11b5-0b9f-4264-b178-d9be01a2abfb" status: 200 len: 1309 microversion: 2.1 time: 0.286705 May 28 04:40:37.089263 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 915/1764] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:36 2022] GET /compute/v2.1/servers/3e7c11b5-0b9f-4264-b178-d9be01a2abfb => generated 1309 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:37.097968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-1572ef05-61ed-47ad-83b3-3d5e5b4be6d4 req-3c97ee58-d284-4bd0-b889-5bb243db45e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37d0f5e8-9f68-4ef2-9310-59c143ba90ad", "name": "network-vif-deleted", "tag": "15222ba8-2eb7-4295-9f75-798d9d032881"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:37.161114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-1572ef05-61ed-47ad-83b3-3d5e5b4be6d4 req-3c97ee58-d284-4bd0-b889-5bb243db45e0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:37.161568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-1572ef05-61ed-47ad-83b3-3d5e5b4be6d4 req-3c97ee58-d284-4bd0-b889-5bb243db45e0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:37.189295 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-1572ef05-61ed-47ad-83b3-3d5e5b4be6d4 req-3c97ee58-d284-4bd0-b889-5bb243db45e0 service nova] Creating event network-vif-deleted:15222ba8-2eb7-4295-9f75-798d9d032881 for instance 37d0f5e8-9f68-4ef2-9310-59c143ba90ad on n-h1-843700-1 May 28 04:40:37.195316 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-1572ef05-61ed-47ad-83b3-3d5e5b4be6d4 req-3c97ee58-d284-4bd0-b889-5bb243db45e0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104438 May 28 04:40:37.196258 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 916/1765] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:37.230833 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8099e066-dacb-41a7-a1c8-7d18920a9092 tempest-QuotaClassesAdminTestJSON-2124048461 tempest-QuotaClassesAdminTestJSON-2124048461-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.328148 May 28 04:40:37.231486 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 850/1766] 10.222.0.58 () {60 vars in 1205 bytes} [Sat May 28 04:40:35 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:37.247029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0e9586db-11ca-4427-a96a-c1be49e8fca6 tempest-QuotaClassesAdminTestJSON-2124048461 tempest-QuotaClassesAdminTestJSON-2124048461-project-admin] Calling method '.version_select at 0x7f7701b849d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:37.248578 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:40:37.248578 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:40:37.266194 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0e9586db-11ca-4427-a96a-c1be49e8fca6 tempest-QuotaClassesAdminTestJSON-2124048461 tempest-QuotaClassesAdminTestJSON-2124048461-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.026587 May 28 04:40:37.267289 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 917/1767] 10.222.0.58 () {58 vars in 1184 bytes} [Sat May 28 04:40:37 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:37.278976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a2a49e4f-792a-4586-b200-47a84f7d11df tempest-QuotaClassesAdminTestJSON-2124048461 tempest-QuotaClassesAdminTestJSON-2124048461-project-admin] Action: 'update', calling method: .version_select at 0x7f7702024a60>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:37.633773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-25b78cd4-9002-4269-b73f-14c23c909a16 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:37.647817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-25b78cd4-9002-4269-b73f-14c23c909a16 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:37.668229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25b78cd4-9002-4269-b73f-14c23c909a16 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:37.668954 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25b78cd4-9002-4269-b73f-14c23c909a16 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:37.669970 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25b78cd4-9002-4269-b73f-14c23c909a16 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:37.670576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25b78cd4-9002-4269-b73f-14c23c909a16 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:37.872490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-25b78cd4-9002-4269-b73f-14c23c909a16 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:37.882111 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-25b78cd4-9002-4269-b73f-14c23c909a16 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.257908 May 28 04:40:37.893620 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 918/1768] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:37 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:37.898897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-21235261-1669-444f-8062-bafc9ab73bcf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:37.900039 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-21235261-1669-444f-8062-bafc9ab73bcf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:37.906553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21235261-1669-444f-8062-bafc9ab73bcf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:37.907180 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21235261-1669-444f-8062-bafc9ab73bcf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:37.908384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21235261-1669-444f-8062-bafc9ab73bcf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:37.909425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21235261-1669-444f-8062-bafc9ab73bcf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:37.955691 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-21235261-1669-444f-8062-bafc9ab73bcf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.060733 May 28 04:40:37.956862 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 919/1769] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 04:40:37 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:40:38.106434 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-58a72393-efb3-4feb-b966-f48c8bba0954 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:38.107192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-58a72393-efb3-4feb-b966-f48c8bba0954 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 3e7c11b5-0b9f-4264-b178-d9be01a2abfb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:38.115236 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58a72393-efb3-4feb-b966-f48c8bba0954 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:38.117701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58a72393-efb3-4feb-b966-f48c8bba0954 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:38.117701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58a72393-efb3-4feb-b966-f48c8bba0954 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:38.117701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58a72393-efb3-4feb-b966-f48c8bba0954 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:38.161767 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-58a72393-efb3-4feb-b966-f48c8bba0954 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] HTTP exception thrown: Instance 3e7c11b5-0b9f-4264-b178-d9be01a2abfb could not be found. May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-58a72393-efb3-4feb-b966-f48c8bba0954 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Request method failure captured: May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/3e7c11b5-0b9f-4264-b178-d9be01a2abfb HTTP/1.1 May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikacM2KhD78yFRK4EsqhrSyTkAV6Nk1F7FXJklf8auTvIKGrUmSmLWcwCIjKaPM6QlxxtXfRYh5fIpqbGQIq7lvQWGQ3on9q1XMdmR40ZvjC765A16ijPz3gObMshF2VFgwx83uBQA7MXjlNEOTRDuEMLE2TFSD0l-hdWW3mhb5DGOiM May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: e7a5b721a538475cbac9c95c61647753 May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:40:38.166266 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:40:38.168158 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e7a5b721a538475cbac9c95c61647753"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:40:38.168158 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:38.168158 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: e7a5b721a538475cbac9c95c61647753 May 28 04:40:38.168158 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:38.168158 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersOnMultiNodesTest-1039499615-project May 28 04:40:38.168158 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:40:38.168158 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:40:38.168158 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: d398d45627fc4d33bc9a736ddf8f9215 May 28 04:40:38.168158 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersOnMultiNodesTest-1039499615-project May 28 04:40:38.168158 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:40:38.168158 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 3e7c11b5-0b9f-4264-b178-d9be01a2abfb could not be found. May 28 04:40:38.168158 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '3e7c11b5-0b9f-4264-b178-d9be01a2abfb'} May 28 04:40:38.169104 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:40:38.169104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:38.169104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:40:38.169104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:40:38.169104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:40:38.169104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:40:38.169104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:40:38.169104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:40:38.169104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:40:38.169104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:40:38.169104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e7c11b5-0b9f-4264-b178-d9be01a2abfb could not be found. May 28 04:40:38.169104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:38.169104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:38.169104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:38.169104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:38.169104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:38.169104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:38.169104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:40:38.169104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:40:38.169104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:40:38.171577 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:40:38.171577 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:40:38.171577 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:40:38.171577 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:40:38.171577 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:40:38.171577 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:40:38.171577 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:40:38.171577 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e7c11b5-0b9f-4264-b178-d9be01a2abfb could not be found. May 28 04:40:38.171577 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:38.171577 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:38.171577 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:38.171577 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:38.171577 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:38.171577 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:38.171577 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:40:38.171577 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:40:38.171577 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e7c11b5-0b9f-4264-b178-d9be01a2abfb could not be found. May 28 04:40:38.171577 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:38.176931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-58a72393-efb3-4feb-b966-f48c8bba0954 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Returning 404 to user: Instance 3e7c11b5-0b9f-4264-b178-d9be01a2abfb could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:40:38.179196 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-58a72393-efb3-4feb-b966-f48c8bba0954 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/3e7c11b5-0b9f-4264-b178-d9be01a2abfb" status: 404 len: 111 microversion: 2.1 time: 0.077158 May 28 04:40:38.185448 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 920/1770] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:38 2022] GET /compute/v2.1/servers/3e7c11b5-0b9f-4264-b178-d9be01a2abfb => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:40:38.191278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-680cf6cf-3d4b-4a17-ad05-7b0af1328856 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:38.192176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-680cf6cf-3d4b-4a17-ad05-7b0af1328856 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 37d0f5e8-9f68-4ef2-9310-59c143ba90ad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:38.202444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-680cf6cf-3d4b-4a17-ad05-7b0af1328856 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:38.203257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-680cf6cf-3d4b-4a17-ad05-7b0af1328856 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:38.204333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-680cf6cf-3d4b-4a17-ad05-7b0af1328856 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:38.205528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-680cf6cf-3d4b-4a17-ad05-7b0af1328856 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:38.261234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-680cf6cf-3d4b-4a17-ad05-7b0af1328856 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:38.261785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-680cf6cf-3d4b-4a17-ad05-7b0af1328856 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:38.262493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-680cf6cf-3d4b-4a17-ad05-7b0af1328856 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lazy-loading 'fault' on Instance uuid 37d0f5e8-9f68-4ef2-9310-59c143ba90ad {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:40:38.323331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-680cf6cf-3d4b-4a17-ad05-7b0af1328856 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:38.342017 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-680cf6cf-3d4b-4a17-ad05-7b0af1328856 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad" status: 200 len: 1309 microversion: 2.1 time: 0.155095 May 28 04:40:38.342626 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 921/1771] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:38 2022] GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad => generated 1309 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:38.491445 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a2a49e4f-792a-4586-b200-47a84f7d11df tempest-QuotaClassesAdminTestJSON-2124048461 tempest-QuotaClassesAdminTestJSON-2124048461-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.217762 May 28 04:40:38.498326 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 851/1772] 10.222.0.58 () {60 vars in 1205 bytes} [Sat May 28 04:40:37 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:38.774816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-df3c2b19-553b-4082-ad11-34e9f51be85a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1596017066", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "d1810576-acba-46c5-8bf2-968cfbdd599f"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:38.852433 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-df3c2b19-553b-4082-ad11-34e9f51be85a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] validate_networks() for [('d1810576-acba-46c5-8bf2-968cfbdd599f', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:40:38.913708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1229a5c5-f76b-458c-8937-8ac4f76e275c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:38.915500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1229a5c5-f76b-458c-8937-8ac4f76e275c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:38.936487 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1229a5c5-f76b-458c-8937-8ac4f76e275c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:38.938006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1229a5c5-f76b-458c-8937-8ac4f76e275c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:38.940362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1229a5c5-f76b-458c-8937-8ac4f76e275c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:38.944425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1229a5c5-f76b-458c-8937-8ac4f76e275c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:39.300183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1229a5c5-f76b-458c-8937-8ac4f76e275c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:39.311539 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1229a5c5-f76b-458c-8937-8ac4f76e275c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.415421 May 28 04:40:39.312275 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 852/1773] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:38 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:40:39.321998 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-50d525e7-a54f-4f6e-8260-d671d548e1f7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:39.327209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-50d525e7-a54f-4f6e-8260-d671d548e1f7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:39.341153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50d525e7-a54f-4f6e-8260-d671d548e1f7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:39.341750 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50d525e7-a54f-4f6e-8260-d671d548e1f7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:39.344301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50d525e7-a54f-4f6e-8260-d671d548e1f7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:39.346931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50d525e7-a54f-4f6e-8260-d671d548e1f7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:39.389995 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-50d525e7-a54f-4f6e-8260-d671d548e1f7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.075243 May 28 04:40:39.394418 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 853/1774] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 04:40:39 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:40:39.396671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b3dbe8af-292d-4c5e-9960-94c015e69a3b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:39.397585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b3dbe8af-292d-4c5e-9960-94c015e69a3b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 37d0f5e8-9f68-4ef2-9310-59c143ba90ad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:39.404881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b3dbe8af-292d-4c5e-9960-94c015e69a3b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:39.406405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b3dbe8af-292d-4c5e-9960-94c015e69a3b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:39.407443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b3dbe8af-292d-4c5e-9960-94c015e69a3b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:39.408127 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b3dbe8af-292d-4c5e-9960-94c015e69a3b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:39.429914 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-b3dbe8af-292d-4c5e-9960-94c015e69a3b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] HTTP exception thrown: Instance 37d0f5e8-9f68-4ef2-9310-59c143ba90ad could not be found. May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b3dbe8af-292d-4c5e-9960-94c015e69a3b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Request method failure captured: May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad HTTP/1.1 May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikacM2KhD78yFRK4EsqhrSyTkAV6Nk1F7FXJklf8auTvIKGrUmSmLWcwCIjKaPM6QlxxtXfRYh5fIpqbGQIq7lvQWGQ3on9q1XMdmR40ZvjC765A16ijPz3gObMshF2VFgwx83uBQA7MXjlNEOTRDuEMLE2TFSD0l-hdWW3mhb5DGOiM May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: e7a5b721a538475cbac9c95c61647753 May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:40:39.432629 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:40:39.433970 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e7a5b721a538475cbac9c95c61647753"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:40:39.433970 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:39.433970 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: e7a5b721a538475cbac9c95c61647753 May 28 04:40:39.433970 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:39.433970 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersOnMultiNodesTest-1039499615-project May 28 04:40:39.433970 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:40:39.433970 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:40:39.433970 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: d398d45627fc4d33bc9a736ddf8f9215 May 28 04:40:39.433970 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersOnMultiNodesTest-1039499615-project May 28 04:40:39.433970 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:40:39.433970 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 37d0f5e8-9f68-4ef2-9310-59c143ba90ad could not be found. May 28 04:40:39.433970 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '37d0f5e8-9f68-4ef2-9310-59c143ba90ad'} May 28 04:40:39.434746 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:40:39.434746 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:39.434746 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:40:39.434746 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:40:39.434746 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:40:39.434746 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:40:39.434746 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:40:39.434746 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:40:39.434746 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:40:39.434746 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:40:39.434746 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37d0f5e8-9f68-4ef2-9310-59c143ba90ad could not be found. May 28 04:40:39.434746 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:39.434746 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:39.434746 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:39.434746 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:39.434746 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:39.434746 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:39.434746 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:40:39.434746 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:40:39.434746 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:40:39.436570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:40:39.436570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:40:39.436570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:40:39.436570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:40:39.436570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:40:39.436570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:40:39.436570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:40:39.436570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37d0f5e8-9f68-4ef2-9310-59c143ba90ad could not be found. May 28 04:40:39.436570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:39.436570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:39.436570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:39.436570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:39.436570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:39.436570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:39.436570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:40:39.436570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:40:39.436570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37d0f5e8-9f68-4ef2-9310-59c143ba90ad could not be found. May 28 04:40:39.436570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:39.441645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b3dbe8af-292d-4c5e-9960-94c015e69a3b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Returning 404 to user: Instance 37d0f5e8-9f68-4ef2-9310-59c143ba90ad could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:40:39.442786 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b3dbe8af-292d-4c5e-9960-94c015e69a3b tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad" status: 404 len: 111 microversion: 2.1 time: 0.050893 May 28 04:40:39.447879 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 854/1775] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:39 2022] GET /compute/v2.1/servers/37d0f5e8-9f68-4ef2-9310-59c143ba90ad => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:40:39.455291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-75d6621c-da32-4226-8a50-0522269833af tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:39.606756 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-df3c2b19-553b-4082-ad11-34e9f51be85a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:40:39.613342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-df3c2b19-553b-4082-ad11-34e9f51be85a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:40:39.614094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-df3c2b19-553b-4082-ad11-34e9f51be85a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:40:39.614737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-df3c2b19-553b-4082-ad11-34e9f51be85a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:40:39.615361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-df3c2b19-553b-4082-ad11-34e9f51be85a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:40:39.626634 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df3c2b19-553b-4082-ad11-34e9f51be85a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:39.627362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df3c2b19-553b-4082-ad11-34e9f51be85a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:39.633123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df3c2b19-553b-4082-ad11-34e9f51be85a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:39.633123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df3c2b19-553b-4082-ad11-34e9f51be85a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:39.658830 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-75d6621c-da32-4226-8a50-0522269833af tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/83cd0df2-5264-47c5-929b-92c17952213c" status: 204 len: 0 microversion: 2.1 time: 0.209937 May 28 04:40:39.659595 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 855/1776] 10.222.0.58 () {58 vars in 1265 bytes} [Sat May 28 04:40:39 2022] DELETE /compute/v2.1/os-server-groups/83cd0df2-5264-47c5-929b-92c17952213c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 04:40:39.672374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1752eecf-0a0b-438e-a69c-79c261187faa tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:39.677688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1752eecf-0a0b-438e-a69c-79c261187faa tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 95514daa-06bd-483c-bd44-b9a7aa12b51c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:39.681225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-df3c2b19-553b-4082-ad11-34e9f51be85a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Getting quotas for project 59e5de6fa6624b709373d974bafdbbff. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:40:39.691981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-df3c2b19-553b-4082-ad11-34e9f51be85a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Getting quotas for user 411ca2ed8fa940aa9c379719026ca32f and project 59e5de6fa6624b709373d974bafdbbff. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:40:39.704049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1752eecf-0a0b-438e-a69c-79c261187faa tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:39.705986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1752eecf-0a0b-438e-a69c-79c261187faa tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:39.708607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-df3c2b19-553b-4082-ad11-34e9f51be85a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:40:39.712424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1752eecf-0a0b-438e-a69c-79c261187faa tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:39.712546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-df3c2b19-553b-4082-ad11-34e9f51be85a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: ca6b84e0-8473-4692-bfa5-e9749726440d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:40:39.712700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1752eecf-0a0b-438e-a69c-79c261187faa tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:39.747981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:39.781219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1752eecf-0a0b-438e-a69c-79c261187faa tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 95514daa-06bd-483c-bd44-b9a7aa12b51c] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:40:39.939869 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-df3c2b19-553b-4082-ad11-34e9f51be85a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.310501 May 28 04:40:39.947372 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 922/1777] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:40:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 04:40:39.953513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e48b3f44-c739-42e4-a368-3c92332f56b1 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:39.954146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e48b3f44-c739-42e4-a368-3c92332f56b1 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: ca6b84e0-8473-4692-bfa5-e9749726440d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:40.098783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e48b3f44-c739-42e4-a368-3c92332f56b1 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ca2ed8fa940aa9c379719026ca32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e5de6fa6624b709373d974bafdbbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:40.108130 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e48b3f44-c739-42e4-a368-3c92332f56b1 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d" status: 200 len: 1224 microversion: 2.1 time: 0.158442 May 28 04:40:40.111308 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 923/1778] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:39 2022] GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d => generated 1224 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:40.176011 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1752eecf-0a0b-438e-a69c-79c261187faa tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "DELETE /compute/v2.1/servers/95514daa-06bd-483c-bd44-b9a7aa12b51c" status: 204 len: 0 microversion: 2.1 time: 0.504695 May 28 04:40:40.176011 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 856/1779] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:40:39 2022] DELETE /compute/v2.1/servers/95514daa-06bd-483c-bd44-b9a7aa12b51c => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:40:40.184269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-edffdab2-8051-494b-a27a-2924043967da tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:40.184996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-edffdab2-8051-494b-a27a-2924043967da tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 565a3cb7-ae9f-41af-8e36-43b39b2e43e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:40.194143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-edffdab2-8051-494b-a27a-2924043967da tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:40.194901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-edffdab2-8051-494b-a27a-2924043967da tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:40.195967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-edffdab2-8051-494b-a27a-2924043967da tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:40.196606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-edffdab2-8051-494b-a27a-2924043967da tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:40.247374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-edffdab2-8051-494b-a27a-2924043967da tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 565a3cb7-ae9f-41af-8e36-43b39b2e43e8] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:40:40.251677 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:40.329242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0c4dd4a8-9658-4b8e-bad6-176f1da04030 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:40.330255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0c4dd4a8-9658-4b8e-bad6-176f1da04030 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:40.342397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c4dd4a8-9658-4b8e-bad6-176f1da04030 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:40.342397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c4dd4a8-9658-4b8e-bad6-176f1da04030 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:40.342397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c4dd4a8-9658-4b8e-bad6-176f1da04030 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:40.342397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c4dd4a8-9658-4b8e-bad6-176f1da04030 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:40.533753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0c4dd4a8-9658-4b8e-bad6-176f1da04030 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:40.543136 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0c4dd4a8-9658-4b8e-bad6-176f1da04030 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.218286 May 28 04:40:40.544423 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 857/1780] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:40 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:40.549786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-92aacef2-dfb2-473c-a56f-88a358020b45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:40.551087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-92aacef2-dfb2-473c-a56f-88a358020b45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:40.557975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-92aacef2-dfb2-473c-a56f-88a358020b45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:40.563828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-92aacef2-dfb2-473c-a56f-88a358020b45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:40.569187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-92aacef2-dfb2-473c-a56f-88a358020b45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:40.571837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-92aacef2-dfb2-473c-a56f-88a358020b45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:40.618191 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-92aacef2-dfb2-473c-a56f-88a358020b45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.072416 May 28 04:40:40.619353 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 858/1781] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 04:40:40 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:40:40.682776 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-edffdab2-8051-494b-a27a-2924043967da tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "DELETE /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8" status: 204 len: 0 microversion: 2.1 time: 0.502703 May 28 04:40:40.684199 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 924/1782] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:40:40 2022] DELETE /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:40:40.692822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-52930382-0857-4b8c-baca-96f78c8d3c50 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:40.694310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-52930382-0857-4b8c-baca-96f78c8d3c50 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 95514daa-06bd-483c-bd44-b9a7aa12b51c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:40.702188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52930382-0857-4b8c-baca-96f78c8d3c50 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:40.703004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52930382-0857-4b8c-baca-96f78c8d3c50 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:40.704121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52930382-0857-4b8c-baca-96f78c8d3c50 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:40.704729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52930382-0857-4b8c-baca-96f78c8d3c50 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:40.860616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-52930382-0857-4b8c-baca-96f78c8d3c50 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:40.869212 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-52930382-0857-4b8c-baca-96f78c8d3c50 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/95514daa-06bd-483c-bd44-b9a7aa12b51c" status: 200 len: 1475 microversion: 2.1 time: 0.180722 May 28 04:40:40.871808 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 859/1783] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:40 2022] GET /compute/v2.1/servers/95514daa-06bd-483c-bd44-b9a7aa12b51c => generated 1475 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:41.125815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-517c120c-4aca-4f30-ac39-0ca4a2cf81a9 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:41.126635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-517c120c-4aca-4f30-ac39-0ca4a2cf81a9 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: ca6b84e0-8473-4692-bfa5-e9749726440d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:41.184481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3154c627-dbca-499a-b3b2-c4e33cffc168 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:41.192735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3154c627-dbca-499a-b3b2-c4e33cffc168 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '18e3755f97184714b26326adebbe1f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01907ddfb9d54b159d84a63586b8338f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:41.193486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3154c627-dbca-499a-b3b2-c4e33cffc168 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Searching by: {'deleted': False, 'project_id': '01907ddfb9d54b159d84a63586b8338f'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:40:41.202510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3154c627-dbca-499a-b3b2-c4e33cffc168 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:41.202998 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3154c627-dbca-499a-b3b2-c4e33cffc168 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:41.204054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3154c627-dbca-499a-b3b2-c4e33cffc168 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:41.204512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3154c627-dbca-499a-b3b2-c4e33cffc168 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:41.212304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-517c120c-4aca-4f30-ac39-0ca4a2cf81a9 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ca2ed8fa940aa9c379719026ca32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e5de6fa6624b709373d974bafdbbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:41.236354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-3154c627-dbca-499a-b3b2-c4e33cffc168 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:40:41.238130 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-517c120c-4aca-4f30-ac39-0ca4a2cf81a9 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d" status: 200 len: 1224 microversion: 2.1 time: 0.114485 May 28 04:40:41.252982 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 925/1784] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:41 2022] GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d => generated 1224 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:41.289777 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3154c627-dbca-499a-b3b2-c4e33cffc168 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.108979 May 28 04:40:41.296927 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 860/1785] 10.222.0.58 () {58 vars in 1124 bytes} [Sat May 28 04:40:41 2022] GET /compute/v2.1/servers => generated 340 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:41.303089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-553a4d7c-bfdc-4248-b805-9bedfa30d48a tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:41.310583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-553a4d7c-bfdc-4248-b805-9bedfa30d48a tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '18e3755f97184714b26326adebbe1f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01907ddfb9d54b159d84a63586b8338f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:41.311511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-553a4d7c-bfdc-4248-b805-9bedfa30d48a tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Searching by: {'deleted': False, 'project_id': '01907ddfb9d54b159d84a63586b8338f'} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:40:41.321657 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-553a4d7c-bfdc-4248-b805-9bedfa30d48a tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:41.322769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-553a4d7c-bfdc-4248-b805-9bedfa30d48a tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:41.323615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-553a4d7c-bfdc-4248-b805-9bedfa30d48a tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:41.324701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-553a4d7c-bfdc-4248-b805-9bedfa30d48a tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:41.439836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.multi_cell_list [None req-553a4d7c-bfdc-4248-b805-9bedfa30d48a tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:40:41.562362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a94059d3-8bd5-4748-9727-509b2801e524 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:41.563311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a94059d3-8bd5-4748-9727-509b2801e524 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:41.577148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a94059d3-8bd5-4748-9727-509b2801e524 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:41.583562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a94059d3-8bd5-4748-9727-509b2801e524 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:41.583562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a94059d3-8bd5-4748-9727-509b2801e524 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:41.583562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a94059d3-8bd5-4748-9727-509b2801e524 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:41.601197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-553a4d7c-bfdc-4248-b805-9bedfa30d48a tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18e3755f97184714b26326adebbe1f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01907ddfb9d54b159d84a63586b8338f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:41.612132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-553a4d7c-bfdc-4248-b805-9bedfa30d48a tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:41.612596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-553a4d7c-bfdc-4248-b805-9bedfa30d48a tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:41.872980 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-553a4d7c-bfdc-4248-b805-9bedfa30d48a tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 0.574571 May 28 04:40:41.874959 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 926/1786] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:40:41 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:41.879697 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-708a4df9-8d41-4bd4-9102-727394d788ec tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:41.880665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-708a4df9-8d41-4bd4-9102-727394d788ec tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:41.894383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-708a4df9-8d41-4bd4-9102-727394d788ec tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:41.894841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-708a4df9-8d41-4bd4-9102-727394d788ec tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:41.907939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-708a4df9-8d41-4bd4-9102-727394d788ec tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:41.908552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-708a4df9-8d41-4bd4-9102-727394d788ec tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:41.939199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a94059d3-8bd5-4748-9727-509b2801e524 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:41.951973 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a94059d3-8bd5-4748-9727-509b2801e524 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.395140 May 28 04:40:41.955063 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 861/1787] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:41 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:41.964400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-931d0a57-eec7-451e-a23f-e18efee4880a tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:41.983647 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-931d0a57-eec7-451e-a23f-e18efee4880a tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027269 May 28 04:40:41.989544 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 862/1788] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:40:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:41.997573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-80b7a54a-ab88-44cc-b7dd-b02c7db17e78 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:42.000074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-80b7a54a-ab88-44cc-b7dd-b02c7db17e78 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 95514daa-06bd-483c-bd44-b9a7aa12b51c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:42.004187 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-708a4df9-8d41-4bd4-9102-727394d788ec tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.128314 May 28 04:40:42.007321 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 927/1789] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 04:40:41 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:40:42.018354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80b7a54a-ab88-44cc-b7dd-b02c7db17e78 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:42.019268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80b7a54a-ab88-44cc-b7dd-b02c7db17e78 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:42.020375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80b7a54a-ab88-44cc-b7dd-b02c7db17e78 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:42.021109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80b7a54a-ab88-44cc-b7dd-b02c7db17e78 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:42.257121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5d4ddda3-22f0-4870-b735-7cc362734894 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:42.258547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5d4ddda3-22f0-4870-b735-7cc362734894 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: ca6b84e0-8473-4692-bfa5-e9749726440d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:42.263962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-80b7a54a-ab88-44cc-b7dd-b02c7db17e78 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:42.272791 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-80b7a54a-ab88-44cc-b7dd-b02c7db17e78 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/95514daa-06bd-483c-bd44-b9a7aa12b51c" status: 200 len: 1475 microversion: 2.1 time: 0.281668 May 28 04:40:42.282649 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 863/1790] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:41 2022] GET /compute/v2.1/servers/95514daa-06bd-483c-bd44-b9a7aa12b51c => generated 1475 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:42.286534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d4ddda3-22f0-4870-b735-7cc362734894 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:42.286534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d4ddda3-22f0-4870-b735-7cc362734894 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:42.286534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d4ddda3-22f0-4870-b735-7cc362734894 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:42.286534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d4ddda3-22f0-4870-b735-7cc362734894 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:42.386685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5d4ddda3-22f0-4870-b735-7cc362734894 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ca2ed8fa940aa9c379719026ca32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e5de6fa6624b709373d974bafdbbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:42.396567 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5d4ddda3-22f0-4870-b735-7cc362734894 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d" status: 200 len: 1228 microversion: 2.1 time: 0.143275 May 28 04:40:42.407798 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 928/1791] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:42 2022] GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d => generated 1228 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:40:42.412816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9fbfeafa-fa99-459a-8d77-347e49f351f2 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:42.413329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9fbfeafa-fa99-459a-8d77-347e49f351f2 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:42.422538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fbfeafa-fa99-459a-8d77-347e49f351f2 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:42.424211 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fbfeafa-fa99-459a-8d77-347e49f351f2 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:42.425150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fbfeafa-fa99-459a-8d77-347e49f351f2 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:42.425671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fbfeafa-fa99-459a-8d77-347e49f351f2 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:42.431031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:42.462032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9fbfeafa-fa99-459a-8d77-347e49f351f2 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:40:42.841931 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9fbfeafa-fa99-459a-8d77-347e49f351f2 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79" status: 204 len: 0 microversion: 2.1 time: 0.433085 May 28 04:40:42.843098 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 864/1792] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:40:42 2022] DELETE /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:40:42.851249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1fea6fae-76a7-491a-99e1-5d50f3d8e03d tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:42.852137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1fea6fae-76a7-491a-99e1-5d50f3d8e03d tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:42.870355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fea6fae-76a7-491a-99e1-5d50f3d8e03d tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:42.870820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fea6fae-76a7-491a-99e1-5d50f3d8e03d tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:42.873751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fea6fae-76a7-491a-99e1-5d50f3d8e03d tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:42.875580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fea6fae-76a7-491a-99e1-5d50f3d8e03d tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:42.975557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8a77e6f0-1ff5-42d9-997a-766b8b60782c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:42.976370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8a77e6f0-1ff5-42d9-997a-766b8b60782c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:42.994504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a77e6f0-1ff5-42d9-997a-766b8b60782c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:42.994504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a77e6f0-1ff5-42d9-997a-766b8b60782c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:42.994504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a77e6f0-1ff5-42d9-997a-766b8b60782c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:42.994504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a77e6f0-1ff5-42d9-997a-766b8b60782c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:43.414529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1fea6fae-76a7-491a-99e1-5d50f3d8e03d tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18e3755f97184714b26326adebbe1f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01907ddfb9d54b159d84a63586b8338f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:43.432983 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1fea6fae-76a7-491a-99e1-5d50f3d8e03d tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79" status: 200 len: 1712 microversion: 2.1 time: 0.585465 May 28 04:40:43.437284 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 929/1793] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:42 2022] GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79 => generated 1712 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:43.447651 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-49521482-b8cd-47a9-b935-dc79c3b0a93e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:43.448842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-49521482-b8cd-47a9-b935-dc79c3b0a93e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:43.460909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49521482-b8cd-47a9-b935-dc79c3b0a93e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:43.461694 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49521482-b8cd-47a9-b935-dc79c3b0a93e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:43.467291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49521482-b8cd-47a9-b935-dc79c3b0a93e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:43.468361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49521482-b8cd-47a9-b935-dc79c3b0a93e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:43.488121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8a77e6f0-1ff5-42d9-997a-766b8b60782c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:43.505450 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8a77e6f0-1ff5-42d9-997a-766b8b60782c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.535327 May 28 04:40:43.506253 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 865/1794] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:42 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:43.518767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-31ac86fa-4c91-4c3d-bfca-4af97f964740 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:43.531379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-31ac86fa-4c91-4c3d-bfca-4af97f964740 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 95514daa-06bd-483c-bd44-b9a7aa12b51c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:43.538100 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31ac86fa-4c91-4c3d-bfca-4af97f964740 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:43.538779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31ac86fa-4c91-4c3d-bfca-4af97f964740 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:43.541970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31ac86fa-4c91-4c3d-bfca-4af97f964740 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:43.542586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31ac86fa-4c91-4c3d-bfca-4af97f964740 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:43.581000 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-49521482-b8cd-47a9-b935-dc79c3b0a93e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.144531 May 28 04:40:43.583302 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 930/1795] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 04:40:43 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:40:43.595163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dd0bd602-d8b5-4a07-9642-c16ef4dd02c8 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:43.599070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dd0bd602-d8b5-4a07-9642-c16ef4dd02c8 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: ca6b84e0-8473-4692-bfa5-e9749726440d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:43.617446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd0bd602-d8b5-4a07-9642-c16ef4dd02c8 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:43.618166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd0bd602-d8b5-4a07-9642-c16ef4dd02c8 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:43.621521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd0bd602-d8b5-4a07-9642-c16ef4dd02c8 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:43.623513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd0bd602-d8b5-4a07-9642-c16ef4dd02c8 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:43.813657 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dd0bd602-d8b5-4a07-9642-c16ef4dd02c8 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ca2ed8fa940aa9c379719026ca32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e5de6fa6624b709373d974bafdbbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:43.827502 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dd0bd602-d8b5-4a07-9642-c16ef4dd02c8 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d" status: 200 len: 1284 microversion: 2.1 time: 0.241254 May 28 04:40:43.838187 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 931/1796] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:43 2022] GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d => generated 1284 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:43.924927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-5961a133-ef65-47b7-84f0-15ff45ec07a6 req-e83e68f2-8bd2-40ab-bc09-7a6bfa83d2ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95514daa-06bd-483c-bd44-b9a7aa12b51c", "name": "network-vif-deleted", "tag": "a3934b31-3593-413f-bf33-dffe073500de"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:43.938869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5961a133-ef65-47b7-84f0-15ff45ec07a6 req-e83e68f2-8bd2-40ab-bc09-7a6bfa83d2ad service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:43.942665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5961a133-ef65-47b7-84f0-15ff45ec07a6 req-e83e68f2-8bd2-40ab-bc09-7a6bfa83d2ad service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:43.979791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-31ac86fa-4c91-4c3d-bfca-4af97f964740 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:43.994128 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-31ac86fa-4c91-4c3d-bfca-4af97f964740 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/95514daa-06bd-483c-bd44-b9a7aa12b51c" status: 200 len: 1475 microversion: 2.1 time: 0.477686 May 28 04:40:43.999110 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 866/1797] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:43 2022] GET /compute/v2.1/servers/95514daa-06bd-483c-bd44-b9a7aa12b51c => generated 1475 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:44.005220 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-5961a133-ef65-47b7-84f0-15ff45ec07a6 req-e83e68f2-8bd2-40ab-bc09-7a6bfa83d2ad service nova] Creating event network-vif-deleted:a3934b31-3593-413f-bf33-dffe073500de for instance 95514daa-06bd-483c-bd44-b9a7aa12b51c on n-h1-843700-1 May 28 04:40:44.036107 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-5961a133-ef65-47b7-84f0-15ff45ec07a6 req-e83e68f2-8bd2-40ab-bc09-7a6bfa83d2ad service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114952 May 28 04:40:44.045462 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 932/1798] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:44.053374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-74aa7142-b568-4960-b407-a79697cea61a req-1501e473-6d35-4c4e-9fe1-539ee44b1411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "565a3cb7-ae9f-41af-8e36-43b39b2e43e8", "name": "network-vif-deleted", "tag": "02c55ea3-528b-43eb-907c-789ef583cf3b"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:44.062929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-74aa7142-b568-4960-b407-a79697cea61a req-1501e473-6d35-4c4e-9fe1-539ee44b1411 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:44.063493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-74aa7142-b568-4960-b407-a79697cea61a req-1501e473-6d35-4c4e-9fe1-539ee44b1411 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:44.082374 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-74aa7142-b568-4960-b407-a79697cea61a req-1501e473-6d35-4c4e-9fe1-539ee44b1411 service nova] Creating event network-vif-deleted:02c55ea3-528b-43eb-907c-789ef583cf3b for instance 565a3cb7-ae9f-41af-8e36-43b39b2e43e8 on n-h1-843700-1 May 28 04:40:44.086291 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-74aa7142-b568-4960-b407-a79697cea61a req-1501e473-6d35-4c4e-9fe1-539ee44b1411 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036565 May 28 04:40:44.087458 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 867/1799] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:40:44.452993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2545a725-56c5-448d-b816-b02f2dcfcaa8 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:44.453713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2545a725-56c5-448d-b816-b02f2dcfcaa8 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:44.475528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2545a725-56c5-448d-b816-b02f2dcfcaa8 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:44.476288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2545a725-56c5-448d-b816-b02f2dcfcaa8 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:44.480385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2545a725-56c5-448d-b816-b02f2dcfcaa8 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:44.481761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2545a725-56c5-448d-b816-b02f2dcfcaa8 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:44.534444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-72ce4e3c-b1dc-4eb6-ab6a-64c0980cec46 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:44.536623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-72ce4e3c-b1dc-4eb6-ab6a-64c0980cec46 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:44.563584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-72ce4e3c-b1dc-4eb6-ab6a-64c0980cec46 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:44.563584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-72ce4e3c-b1dc-4eb6-ab6a-64c0980cec46 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:44.568079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-72ce4e3c-b1dc-4eb6-ab6a-64c0980cec46 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:44.568582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-72ce4e3c-b1dc-4eb6-ab6a-64c0980cec46 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:44.855345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2545a725-56c5-448d-b816-b02f2dcfcaa8 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18e3755f97184714b26326adebbe1f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01907ddfb9d54b159d84a63586b8338f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:44.866507 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2545a725-56c5-448d-b816-b02f2dcfcaa8 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79" status: 200 len: 1712 microversion: 2.1 time: 0.418960 May 28 04:40:44.873024 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 933/1800] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:44 2022] GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79 => generated 1712 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:44.890312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-acd0389b-b426-4c9e-a684-3c49b901cd69 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:44.890312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-acd0389b-b426-4c9e-a684-3c49b901cd69 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:44.908995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-acd0389b-b426-4c9e-a684-3c49b901cd69 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:44.909470 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-acd0389b-b426-4c9e-a684-3c49b901cd69 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:44.912846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-72ce4e3c-b1dc-4eb6-ab6a-64c0980cec46 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:44.921689 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-72ce4e3c-b1dc-4eb6-ab6a-64c0980cec46 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.401210 May 28 04:40:44.922281 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 868/1801] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:44 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:44.926357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-acd0389b-b426-4c9e-a684-3c49b901cd69 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:44.927522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-acd0389b-b426-4c9e-a684-3c49b901cd69 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:44.943837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b9cb320e-51f0-4403-b9cc-b3b8e9125306 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:44.955527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b9cb320e-51f0-4403-b9cc-b3b8e9125306 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: ca6b84e0-8473-4692-bfa5-e9749726440d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:44.982150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9cb320e-51f0-4403-b9cc-b3b8e9125306 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:44.982805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9cb320e-51f0-4403-b9cc-b3b8e9125306 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:44.983465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9cb320e-51f0-4403-b9cc-b3b8e9125306 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:44.983906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9cb320e-51f0-4403-b9cc-b3b8e9125306 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:45.049179 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-acd0389b-b426-4c9e-a684-3c49b901cd69 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.172060 May 28 04:40:45.051180 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 934/1802] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 04:40:44 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:40:45.064091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9e7cf19c-b3bd-4d89-bc13-92aeb166e966 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:45.065001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9e7cf19c-b3bd-4d89-bc13-92aeb166e966 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 95514daa-06bd-483c-bd44-b9a7aa12b51c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:45.099878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e7cf19c-b3bd-4d89-bc13-92aeb166e966 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:45.100479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e7cf19c-b3bd-4d89-bc13-92aeb166e966 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:45.102754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e7cf19c-b3bd-4d89-bc13-92aeb166e966 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:45.104954 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e7cf19c-b3bd-4d89-bc13-92aeb166e966 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:45.160364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b9cb320e-51f0-4403-b9cc-b3b8e9125306 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ca2ed8fa940aa9c379719026ca32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e5de6fa6624b709373d974bafdbbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:45.170244 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b9cb320e-51f0-4403-b9cc-b3b8e9125306 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d" status: 200 len: 1282 microversion: 2.1 time: 0.238723 May 28 04:40:45.179237 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 869/1803] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:44 2022] GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d => generated 1282 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:45.193276 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e7cf19c-b3bd-4d89-bc13-92aeb166e966 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:45.195837 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e7cf19c-b3bd-4d89-bc13-92aeb166e966 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:45.196327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-9e7cf19c-b3bd-4d89-bc13-92aeb166e966 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lazy-loading 'fault' on Instance uuid 95514daa-06bd-483c-bd44-b9a7aa12b51c {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:40:45.292933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9e7cf19c-b3bd-4d89-bc13-92aeb166e966 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:45.308744 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9e7cf19c-b3bd-4d89-bc13-92aeb166e966 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/95514daa-06bd-483c-bd44-b9a7aa12b51c" status: 200 len: 1309 microversion: 2.1 time: 0.255901 May 28 04:40:45.309365 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 935/1804] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:45 2022] GET /compute/v2.1/servers/95514daa-06bd-483c-bd44-b9a7aa12b51c => generated 1309 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:45.401368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1bf0d4bc-a472-4b98-9051-8e8a71666724 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-514639397", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d55fc48d-3da7-441d-9f9d-b92e251b7523"}], "security_groups": [{"name": "tempest-securitygroup--1827544790"}], "key_name": "tempest-keypair-751070852", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "1e2ad259-8235-4f7e-ba32-0e9aba9cb4f1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:45.629560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-1bf0d4bc-a472-4b98-9051-8e8a71666724 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] validate_networks() for [('d55fc48d-3da7-441d-9f9d-b92e251b7523', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:40:45.891043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c2318340-a090-4c9e-9fb7-dd98ef66ff63 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:45.892174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c2318340-a090-4c9e-9fb7-dd98ef66ff63 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:45.913060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2318340-a090-4c9e-9fb7-dd98ef66ff63 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:45.916281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2318340-a090-4c9e-9fb7-dd98ef66ff63 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:45.922868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2318340-a090-4c9e-9fb7-dd98ef66ff63 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:45.923644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2318340-a090-4c9e-9fb7-dd98ef66ff63 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:46.861707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c2318340-a090-4c9e-9fb7-dd98ef66ff63 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18e3755f97184714b26326adebbe1f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01907ddfb9d54b159d84a63586b8338f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:46.874053 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c2318340-a090-4c9e-9fb7-dd98ef66ff63 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79" status: 200 len: 1712 microversion: 2.1 time: 0.987579 May 28 04:40:46.878461 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 936/1805] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:45 2022] GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79 => generated 1712 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:46.896023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c8da53d4-5d38-43ce-ad1a-fc7dcb33390c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:46.899387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c8da53d4-5d38-43ce-ad1a-fc7dcb33390c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:46.919288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8da53d4-5d38-43ce-ad1a-fc7dcb33390c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:46.924458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8da53d4-5d38-43ce-ad1a-fc7dcb33390c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:46.925375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8da53d4-5d38-43ce-ad1a-fc7dcb33390c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:46.926853 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8da53d4-5d38-43ce-ad1a-fc7dcb33390c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:47.242644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:UPDATE=18,nova_api:SELECT=77,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:47.283996 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-1bf0d4bc-a472-4b98-9051-8e8a71666724 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Getting quotas for project 30126363eb444c78a459e1beaa9ddce6. Resources: dict_keys(['metadata_items']) {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:40:47.293006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-1bf0d4bc-a472-4b98-9051-8e8a71666724 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Getting quotas for user 85f99e2be7184b41acd8481762d85254 and project 30126363eb444c78a459e1beaa9ddce6. Resources: dict_keys(['metadata_items']) {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:40:47.340187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c8da53d4-5d38-43ce-ad1a-fc7dcb33390c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:47.348920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-1bf0d4bc-a472-4b98-9051-8e8a71666724 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:40:47.349583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-1bf0d4bc-a472-4b98-9051-8e8a71666724 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:40:47.350235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-1bf0d4bc-a472-4b98-9051-8e8a71666724 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:40:47.350982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-1bf0d4bc-a472-4b98-9051-8e8a71666724 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:40:47.351570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-1bf0d4bc-a472-4b98-9051-8e8a71666724 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:40:47.374884 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c8da53d4-5d38-43ce-ad1a-fc7dcb33390c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.494268 May 28 04:40:47.388136 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 937/1806] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:46 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:47.393304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f4adf70b-acc4-45ab-80d2-41fa8ec35b4e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:47.394287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f4adf70b-acc4-45ab-80d2-41fa8ec35b4e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:47.402463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1bf0d4bc-a472-4b98-9051-8e8a71666724 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:47.403012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1bf0d4bc-a472-4b98-9051-8e8a71666724 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:47.404679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1bf0d4bc-a472-4b98-9051-8e8a71666724 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:47.405124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1bf0d4bc-a472-4b98-9051-8e8a71666724 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:47.497471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4adf70b-acc4-45ab-80d2-41fa8ec35b4e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:47.497471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4adf70b-acc4-45ab-80d2-41fa8ec35b4e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:47.497471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4adf70b-acc4-45ab-80d2-41fa8ec35b4e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:47.497471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4adf70b-acc4-45ab-80d2-41fa8ec35b4e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:47.498396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-1bf0d4bc-a472-4b98-9051-8e8a71666724 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Getting quotas for project 30126363eb444c78a459e1beaa9ddce6. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:40:47.498396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-1bf0d4bc-a472-4b98-9051-8e8a71666724 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Getting quotas for user 85f99e2be7184b41acd8481762d85254 and project 30126363eb444c78a459e1beaa9ddce6. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:40:47.523255 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f4adf70b-acc4-45ab-80d2-41fa8ec35b4e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.133797 May 28 04:40:47.529285 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 938/1807] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 04:40:47 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083/os-volume_attachments => generated 25 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:47.537024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-30d51bf6-7de9-4368-8474-5bab6dc0cfdb tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:47.537800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-30d51bf6-7de9-4368-8474-5bab6dc0cfdb tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: ca6b84e0-8473-4692-bfa5-e9749726440d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:47.545744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30d51bf6-7de9-4368-8474-5bab6dc0cfdb tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:47.546279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30d51bf6-7de9-4368-8474-5bab6dc0cfdb tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:47.547144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30d51bf6-7de9-4368-8474-5bab6dc0cfdb tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:47.548216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30d51bf6-7de9-4368-8474-5bab6dc0cfdb tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:47.717907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1bf0d4bc-a472-4b98-9051-8e8a71666724 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:40:47.720183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1bf0d4bc-a472-4b98-9051-8e8a71666724 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1e2ad259-8235-4f7e-ba32-0e9aba9cb4f1',volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:40:47.898835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-30d51bf6-7de9-4368-8474-5bab6dc0cfdb tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ca2ed8fa940aa9c379719026ca32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e5de6fa6624b709373d974bafdbbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:47.913119 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-30d51bf6-7de9-4368-8474-5bab6dc0cfdb tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d" status: 200 len: 1324 microversion: 2.1 time: 0.379976 May 28 04:40:47.913119 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 939/1808] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:47 2022] GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d => generated 1324 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:48.374407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4f449a0c-25a1-4535-91fd-aaec5cb7bd22 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1677845737", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:48.483327 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1bf0d4bc-a472-4b98-9051-8e8a71666724 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.093510 May 28 04:40:48.490884 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 870/1809] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:40:45 2022] POST /compute/v2.1/servers => generated 407 bytes in 3096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:40:48.500510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-dfe83e2f-d56f-469f-91e7-c91272b241c9 req-e3c437ae-94d9-4617-a290-0154de058142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6099edfb-c389-4614-937f-11b41943ed79", "name": "network-vif-unplugged", "status": "completed", "tag": "b1318bdd-cad5-4bc2-9aa4-fd6b51949f14"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:48.535273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-4f449a0c-25a1-4535-91fd-aaec5cb7bd22 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:40:48.548829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-dfe83e2f-d56f-469f-91e7-c91272b241c9 req-e3c437ae-94d9-4617-a290-0154de058142 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:48.549380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-dfe83e2f-d56f-469f-91e7-c91272b241c9 req-e3c437ae-94d9-4617-a290-0154de058142 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:48.603921 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-dfe83e2f-d56f-469f-91e7-c91272b241c9 req-e3c437ae-94d9-4617-a290-0154de058142 service nova] Creating event network-vif-unplugged:b1318bdd-cad5-4bc2-9aa4-fd6b51949f14 for instance 6099edfb-c389-4614-937f-11b41943ed79 on n-h1-843700-1 May 28 04:40:48.624191 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-dfe83e2f-d56f-469f-91e7-c91272b241c9 req-e3c437ae-94d9-4617-a290-0154de058142 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138564 May 28 04:40:48.632893 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 871/1810] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:48.653243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fdefa98b-59da-40f8-b13a-18507207148f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:48.658749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fdefa98b-59da-40f8-b13a-18507207148f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 95514daa-06bd-483c-bd44-b9a7aa12b51c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:48.695759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdefa98b-59da-40f8-b13a-18507207148f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:48.696229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdefa98b-59da-40f8-b13a-18507207148f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:48.697116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdefa98b-59da-40f8-b13a-18507207148f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:48.697554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdefa98b-59da-40f8-b13a-18507207148f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:48.793399 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-fdefa98b-59da-40f8-b13a-18507207148f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] HTTP exception thrown: Instance 95514daa-06bd-483c-bd44-b9a7aa12b51c could not be found. May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fdefa98b-59da-40f8-b13a-18507207148f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Request method failure captured: May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/95514daa-06bd-483c-bd44-b9a7aa12b51c HTTP/1.1 May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikacM2KhD78yFRK4EsqhrSyTkAV6Nk1F7FXJklf8auTvIKGrUmSmLWcwCIjKaPM6QlxxtXfRYh5fIpqbGQIq7lvQWGQ3on9q1XMdmR40ZvjC765A16ijPz3gObMshF2VFgwx83uBQA7MXjlNEOTRDuEMLE2TFSD0l-hdWW3mhb5DGOiM May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: e7a5b721a538475cbac9c95c61647753 May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:40:48.799789 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:40:48.801443 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e7a5b721a538475cbac9c95c61647753"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:40:48.801443 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:48.801443 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: e7a5b721a538475cbac9c95c61647753 May 28 04:40:48.801443 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:48.801443 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersOnMultiNodesTest-1039499615-project May 28 04:40:48.801443 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:40:48.801443 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:40:48.801443 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: d398d45627fc4d33bc9a736ddf8f9215 May 28 04:40:48.801443 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersOnMultiNodesTest-1039499615-project May 28 04:40:48.801443 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:40:48.801443 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 95514daa-06bd-483c-bd44-b9a7aa12b51c could not be found. May 28 04:40:48.801443 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '95514daa-06bd-483c-bd44-b9a7aa12b51c'} May 28 04:40:48.802376 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:40:48.802376 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:48.802376 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:40:48.802376 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:40:48.802376 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:40:48.802376 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:40:48.802376 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:40:48.802376 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:40:48.802376 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:40:48.802376 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:40:48.802376 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95514daa-06bd-483c-bd44-b9a7aa12b51c could not be found. May 28 04:40:48.802376 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:48.802376 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:48.802376 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:48.802376 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:48.802376 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:48.802376 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:48.802376 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:40:48.802376 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:40:48.802376 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:40:48.804015 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:40:48.804015 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:40:48.804015 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:40:48.804015 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:40:48.804015 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:40:48.804015 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:40:48.804015 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:40:48.804015 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95514daa-06bd-483c-bd44-b9a7aa12b51c could not be found. May 28 04:40:48.804015 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:48.804015 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:48.804015 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:48.804015 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:48.804015 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:48.804015 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:48.804015 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:40:48.804015 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:40:48.804015 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95514daa-06bd-483c-bd44-b9a7aa12b51c could not be found. May 28 04:40:48.804015 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:48.809494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fdefa98b-59da-40f8-b13a-18507207148f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Returning 404 to user: Instance 95514daa-06bd-483c-bd44-b9a7aa12b51c could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:40:48.810557 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fdefa98b-59da-40f8-b13a-18507207148f tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/95514daa-06bd-483c-bd44-b9a7aa12b51c" status: 404 len: 111 microversion: 2.1 time: 0.176329 May 28 04:40:48.813325 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 872/1811] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:48 2022] GET /compute/v2.1/servers/95514daa-06bd-483c-bd44-b9a7aa12b51c => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:40:48.841283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-2ac2f850-62d4-47b6-84a3-b276f007e94c req-215373be-ba6f-4dc1-b13d-5777a0dd4bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6099edfb-c389-4614-937f-11b41943ed79", "name": "network-vif-deleted", "tag": "b1318bdd-cad5-4bc2-9aa4-fd6b51949f14"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:48.870616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2ac2f850-62d4-47b6-84a3-b276f007e94c req-215373be-ba6f-4dc1-b13d-5777a0dd4bf7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:48.872900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2ac2f850-62d4-47b6-84a3-b276f007e94c req-215373be-ba6f-4dc1-b13d-5777a0dd4bf7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:48.892084 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-2ac2f850-62d4-47b6-84a3-b276f007e94c req-215373be-ba6f-4dc1-b13d-5777a0dd4bf7 service nova] Creating event network-vif-deleted:b1318bdd-cad5-4bc2-9aa4-fd6b51949f14 for instance 6099edfb-c389-4614-937f-11b41943ed79 on n-h1-843700-1 May 28 04:40:48.898178 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-2ac2f850-62d4-47b6-84a3-b276f007e94c req-215373be-ba6f-4dc1-b13d-5777a0dd4bf7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083454 May 28 04:40:48.900202 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 873/1812] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:48.908251 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7b341e0e-313e-43d2-8cb3-b1fbe4d10914 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:48.909411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7b341e0e-313e-43d2-8cb3-b1fbe4d10914 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:48.918332 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b341e0e-313e-43d2-8cb3-b1fbe4d10914 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:48.919418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b341e0e-313e-43d2-8cb3-b1fbe4d10914 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:48.920439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b341e0e-313e-43d2-8cb3-b1fbe4d10914 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:48.921800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b341e0e-313e-43d2-8cb3-b1fbe4d10914 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:49.059811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4f449a0c-25a1-4535-91fd-aaec5cb7bd22 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:40:49.060695 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b341e0e-313e-43d2-8cb3-b1fbe4d10914 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:49.061159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b341e0e-313e-43d2-8cb3-b1fbe4d10914 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:49.061527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4f449a0c-25a1-4535-91fd-aaec5cb7bd22 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:40:49.062186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4f449a0c-25a1-4535-91fd-aaec5cb7bd22 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:40:49.062939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4f449a0c-25a1-4535-91fd-aaec5cb7bd22 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:40:49.063556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4f449a0c-25a1-4535-91fd-aaec5cb7bd22 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:40:49.067307 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-7b341e0e-313e-43d2-8cb3-b1fbe4d10914 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lazy-loading 'fault' on Instance uuid 6099edfb-c389-4614-937f-11b41943ed79 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:40:49.095540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f449a0c-25a1-4535-91fd-aaec5cb7bd22 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:49.100103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f449a0c-25a1-4535-91fd-aaec5cb7bd22 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:49.100972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f449a0c-25a1-4535-91fd-aaec5cb7bd22 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:49.101447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f449a0c-25a1-4535-91fd-aaec5cb7bd22 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:49.150699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-4f449a0c-25a1-4535-91fd-aaec5cb7bd22 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Getting quotas for project 13ea83404c554681912477aa3f6d0798. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:40:49.170335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-4f449a0c-25a1-4535-91fd-aaec5cb7bd22 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Getting quotas for user 7850cd7487c94107b6cfdc0c956f01d0 and project 13ea83404c554681912477aa3f6d0798. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:40:49.173949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7b341e0e-313e-43d2-8cb3-b1fbe4d10914 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18e3755f97184714b26326adebbe1f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01907ddfb9d54b159d84a63586b8338f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:49.201223 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7b341e0e-313e-43d2-8cb3-b1fbe4d10914 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79" status: 200 len: 1366 microversion: 2.1 time: 0.296526 May 28 04:40:49.201881 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4f449a0c-25a1-4535-91fd-aaec5cb7bd22 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:40:49.208401 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 874/1813] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:48 2022] GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79 => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:49.208793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4f449a0c-25a1-4535-91fd-aaec5cb7bd22 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:40:49.218610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bf6918d2-2b86-49f1-8927-6f5fcdf52806 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:49.220111 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bf6918d2-2b86-49f1-8927-6f5fcdf52806 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:49.235070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf6918d2-2b86-49f1-8927-6f5fcdf52806 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:49.237356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf6918d2-2b86-49f1-8927-6f5fcdf52806 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:49.237356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf6918d2-2b86-49f1-8927-6f5fcdf52806 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:49.240249 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf6918d2-2b86-49f1-8927-6f5fcdf52806 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:49.457521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bf6918d2-2b86-49f1-8927-6f5fcdf52806 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:49.465892 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bf6918d2-2b86-49f1-8927-6f5fcdf52806 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.255806 May 28 04:40:49.468822 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 875/1814] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:49 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:49.480344 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4f449a0c-25a1-4535-91fd-aaec5cb7bd22 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.557384 May 28 04:40:49.484784 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 940/1815] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:40:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:40:49.489492 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-63400dde-2bcf-417d-abb9-7d3e2e168dab tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:49.490235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-63400dde-2bcf-417d-abb9-7d3e2e168dab tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:49.497540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3195dd15-955d-481c-8ff1-22d83d18b4cd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:49.512177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3195dd15-955d-481c-8ff1-22d83d18b4cd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 565a3cb7-ae9f-41af-8e36-43b39b2e43e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:49.529990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3195dd15-955d-481c-8ff1-22d83d18b4cd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:49.542791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3195dd15-955d-481c-8ff1-22d83d18b4cd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:49.543959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3195dd15-955d-481c-8ff1-22d83d18b4cd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:49.544595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3195dd15-955d-481c-8ff1-22d83d18b4cd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:49.554883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:49.622254 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-3195dd15-955d-481c-8ff1-22d83d18b4cd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] HTTP exception thrown: Instance 565a3cb7-ae9f-41af-8e36-43b39b2e43e8 could not be found. May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3195dd15-955d-481c-8ff1-22d83d18b4cd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Request method failure captured: May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8 HTTP/1.1 May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikacM2KhD78yFRK4EsqhrSyTkAV6Nk1F7FXJklf8auTvIKGrUmSmLWcwCIjKaPM6QlxxtXfRYh5fIpqbGQIq7lvQWGQ3on9q1XMdmR40ZvjC765A16ijPz3gObMshF2VFgwx83uBQA7MXjlNEOTRDuEMLE2TFSD0l-hdWW3mhb5DGOiM May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: e7a5b721a538475cbac9c95c61647753 May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:40:49.624559 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:40:49.632475 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e7a5b721a538475cbac9c95c61647753"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:40:49.632475 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:49.632475 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: e7a5b721a538475cbac9c95c61647753 May 28 04:40:49.632475 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:49.632475 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersOnMultiNodesTest-1039499615-project May 28 04:40:49.632475 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:40:49.632475 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:40:49.632475 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: d398d45627fc4d33bc9a736ddf8f9215 May 28 04:40:49.632475 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersOnMultiNodesTest-1039499615-project May 28 04:40:49.632475 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:40:49.632475 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 565a3cb7-ae9f-41af-8e36-43b39b2e43e8 could not be found. May 28 04:40:49.632475 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '565a3cb7-ae9f-41af-8e36-43b39b2e43e8'} May 28 04:40:49.633665 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:40:49.633665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:49.633665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:40:49.633665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:40:49.633665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:40:49.633665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:40:49.633665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:40:49.633665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:40:49.633665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:40:49.633665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:40:49.633665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 565a3cb7-ae9f-41af-8e36-43b39b2e43e8 could not be found. May 28 04:40:49.633665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:49.633665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:49.633665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:49.633665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:49.633665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:49.633665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:49.633665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:40:49.633665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:40:49.633665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:40:49.635732 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:40:49.635732 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:40:49.635732 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:40:49.635732 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:40:49.635732 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:40:49.635732 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:40:49.635732 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:40:49.635732 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 565a3cb7-ae9f-41af-8e36-43b39b2e43e8 could not be found. May 28 04:40:49.635732 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:49.635732 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:49.635732 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:49.635732 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:49.635732 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:49.635732 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:49.635732 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:40:49.635732 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:40:49.635732 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 565a3cb7-ae9f-41af-8e36-43b39b2e43e8 could not be found. May 28 04:40:49.635732 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:40:49.637047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3195dd15-955d-481c-8ff1-22d83d18b4cd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Returning 404 to user: Instance 565a3cb7-ae9f-41af-8e36-43b39b2e43e8 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:40:49.637047 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3195dd15-955d-481c-8ff1-22d83d18b4cd tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8" status: 404 len: 111 microversion: 2.1 time: 0.140245 May 28 04:40:49.639228 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 941/1816] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:49 2022] GET /compute/v2.1/servers/565a3cb7-ae9f-41af-8e36-43b39b2e43e8 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:40:49.644292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a786dc84-70e4-41d0-9135-24c42aafa217 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:49.651307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a786dc84-70e4-41d0-9135-24c42aafa217 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: ca6b84e0-8473-4692-bfa5-e9749726440d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:49.663564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-63400dde-2bcf-417d-abb9-7d3e2e168dab tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:49.676581 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-63400dde-2bcf-417d-abb9-7d3e2e168dab tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1120 microversion: 2.1 time: 0.194929 May 28 04:40:49.677172 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 876/1817] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:49 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1120 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:49.687075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a786dc84-70e4-41d0-9135-24c42aafa217 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:49.687744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a786dc84-70e4-41d0-9135-24c42aafa217 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:49.693699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a786dc84-70e4-41d0-9135-24c42aafa217 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:49.693699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a786dc84-70e4-41d0-9135-24c42aafa217 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:49.695218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-74148e41-1c3f-4a81-b2ff-f71a2b9f8e65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-716995479", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:49.862479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-74148e41-1c3f-4a81-b2ff-f71a2b9f8e65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] validate_networks() for None {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:40:50.067896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a786dc84-70e4-41d0-9135-24c42aafa217 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ca2ed8fa940aa9c379719026ca32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e5de6fa6624b709373d974bafdbbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:50.080774 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a786dc84-70e4-41d0-9135-24c42aafa217 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d" status: 200 len: 1324 microversion: 2.1 time: 0.440166 May 28 04:40:50.091585 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 942/1818] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:49 2022] GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d => generated 1324 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:50.097834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e750dd8c-2989-4a92-a1d0-5a3e69396867 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:50.230671 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e750dd8c-2989-4a92-a1d0-5a3e69396867 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/55040dbc-5a65-4d89-abb3-32604ea8386a" status: 204 len: 0 microversion: 2.1 time: 0.137332 May 28 04:40:50.232067 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 943/1819] 10.222.0.58 () {58 vars in 1265 bytes} [Sat May 28 04:40:50 2022] DELETE /compute/v2.1/os-server-groups/55040dbc-5a65-4d89-abb3-32604ea8386a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:40:50.455320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-74148e41-1c3f-4a81-b2ff-f71a2b9f8e65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:40:50.455765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-74148e41-1c3f-4a81-b2ff-f71a2b9f8e65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:40:50.462059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-74148e41-1c3f-4a81-b2ff-f71a2b9f8e65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:40:50.462059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-74148e41-1c3f-4a81-b2ff-f71a2b9f8e65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:40:50.462059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-74148e41-1c3f-4a81-b2ff-f71a2b9f8e65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:40:50.475197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74148e41-1c3f-4a81-b2ff-f71a2b9f8e65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:50.479706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74148e41-1c3f-4a81-b2ff-f71a2b9f8e65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:50.483836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74148e41-1c3f-4a81-b2ff-f71a2b9f8e65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:50.485872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74148e41-1c3f-4a81-b2ff-f71a2b9f8e65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:50.544271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-74148e41-1c3f-4a81-b2ff-f71a2b9f8e65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Getting quotas for project 13ea83404c554681912477aa3f6d0798. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:40:50.551990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-74148e41-1c3f-4a81-b2ff-f71a2b9f8e65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Getting quotas for user 7850cd7487c94107b6cfdc0c956f01d0 and project 13ea83404c554681912477aa3f6d0798. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:40:50.570670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-74148e41-1c3f-4a81-b2ff-f71a2b9f8e65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:40:50.574919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-74148e41-1c3f-4a81-b2ff-f71a2b9f8e65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:40:50.734511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-697b3646-df3b-4e37-b1d1-d69385706631 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Action: 'create', calling method: .version_select at 0x7f7701e4ef70>, body: {"keypair": {"name": "tempest-keypair-1637303593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9yXy/EVse5tDcfeqFagxaXxJ9051s76hR6+gs040CjHGLQPbCbh9S6bhx3vBA9+xOuXhL7+ISbKW73a2JzwcEbbAEwg75Q7my+7nFmaBVYjdfY5lWVQwk+5ttJXduBvg=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:50.777930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-697b3646-df3b-4e37-b1d1-d69385706631 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Getting quotas for project f5cf1a786cba41cd88ea6a766ca8a673. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:40:50.790700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-697b3646-df3b-4e37-b1d1-d69385706631 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Getting quotas for user 99e2ff86a2484cd38b6e4176109f6b53 and project f5cf1a786cba41cd88ea6a766ca8a673. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:40:50.856236 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-74148e41-1c3f-4a81-b2ff-f71a2b9f8e65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.176239 May 28 04:40:50.857836 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 877/1820] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:40:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:40:50.873680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9c7146ae-a2cb-4699-877c-c65541a56d83 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:50.874763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9c7146ae-a2cb-4699-877c-c65541a56d83 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] [instance: 6099edfb-c389-4614-937f-11b41943ed79] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:50.905990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9c7146ae-a2cb-4699-877c-c65541a56d83 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:50.907673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9c7146ae-a2cb-4699-877c-c65541a56d83 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:50.908685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9c7146ae-a2cb-4699-877c-c65541a56d83 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:50.909313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9c7146ae-a2cb-4699-877c-c65541a56d83 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:50.948742 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-9c7146ae-a2cb-4699-877c-c65541a56d83 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] HTTP exception thrown: Instance 6099edfb-c389-4614-937f-11b41943ed79 could not be found. May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9c7146ae-a2cb-4699-877c-c65541a56d83 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Request method failure captured: May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79 HTTP/1.1 May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikad--Y0KYE9vzdAsfawxcst8qjb2AXFODLYCdAKFesOv2RzKOkBNRWSQr6lMIcC909NyYQhYkJxRVjocPx0FLGN4ljmJXSFL49pvKlzdkD5gd94_Zrs0YJU2E4baf4r2JPygLNAh4_rAmydAWnL-l04gx3eH8lHa7CwlEDxheC2WIzs May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 01907ddfb9d54b159d84a63586b8338f May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersTestManualDisk-1529630046 May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:40:50.960225 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:40:50.961927 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_01907ddfb9d54b159d84a63586b8338f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/01907ddfb9d54b159d84a63586b8338f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/01907ddfb9d54b159d84a63586b8338f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/01907ddfb9d54b159d84a63586b8338f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:40:50.961927 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersTestManualDisk-1529630046 May 28 04:40:50.961927 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 01907ddfb9d54b159d84a63586b8338f May 28 04:40:50.961927 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersTestManualDisk-1529630046 May 28 04:40:50.961927 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersTestManualDisk-1529630046-project May 28 04:40:50.961927 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:40:50.961927 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:40:50.961927 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 18e3755f97184714b26326adebbe1f17 May 28 04:40:50.961927 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersTestManualDisk-1529630046-project May 28 04:40:50.961927 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:40:50.961927 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 6099edfb-c389-4614-937f-11b41943ed79 could not be found. May 28 04:40:50.961927 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '6099edfb-c389-4614-937f-11b41943ed79'} May 28 04:40:50.962918 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:40:50.962918 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:50.962918 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:40:50.962918 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:40:50.962918 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:40:50.962918 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:40:50.962918 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:40:50.962918 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:40:50.962918 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:40:50.962918 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:40:50.962918 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6099edfb-c389-4614-937f-11b41943ed79 could not be found. May 28 04:40:50.962918 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:50.962918 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:50.962918 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:50.962918 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:50.962918 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:50.962918 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:50.962918 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:40:50.962918 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:40:50.962918 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:40:50.964533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:40:50.964533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:40:50.964533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:40:50.964533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:40:50.964533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:40:50.964533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:40:50.964533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:40:50.964533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6099edfb-c389-4614-937f-11b41943ed79 could not be found. May 28 04:40:50.964533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:50.964533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:50.964533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:50.964533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:50.964533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:50.964533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:50.964533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:40:50.964533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:40:50.964533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6099edfb-c389-4614-937f-11b41943ed79 could not be found. May 28 04:40:50.964533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:50.965953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9c7146ae-a2cb-4699-877c-c65541a56d83 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Returning 404 to user: Instance 6099edfb-c389-4614-937f-11b41943ed79 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:40:50.965953 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9c7146ae-a2cb-4699-877c-c65541a56d83 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79" status: 404 len: 111 microversion: 2.1 time: 0.097311 May 28 04:40:50.965953 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 878/1821] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:50 2022] GET /compute/v2.1/servers/6099edfb-c389-4614-937f-11b41943ed79 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:40:50.970699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5465fef0-ca29-42ed-ab68-ecab825e0cb0 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:50.971081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5465fef0-ca29-42ed-ab68-ecab825e0cb0 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:50.983483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5465fef0-ca29-42ed-ab68-ecab825e0cb0 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:50.985839 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-697b3646-df3b-4e37-b1d1-d69385706631 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.752449 May 28 04:40:50.986438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5465fef0-ca29-42ed-ab68-ecab825e0cb0 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:50.987324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5465fef0-ca29-42ed-ab68-ecab825e0cb0 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:50.987773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5465fef0-ca29-42ed-ab68-ecab825e0cb0 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:50.989137 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 944/1822] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:40:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:51.001567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d4fe03a9-8efb-4085-811f-d96c00e6fce0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:51.007574 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d4fe03a9-8efb-4085-811f-d96c00e6fce0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:51.024995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d4fe03a9-8efb-4085-811f-d96c00e6fce0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:51.032775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d4fe03a9-8efb-4085-811f-d96c00e6fce0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:51.034524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d4fe03a9-8efb-4085-811f-d96c00e6fce0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:51.038688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d4fe03a9-8efb-4085-811f-d96c00e6fce0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:51.077145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5465fef0-ca29-42ed-ab68-ecab825e0cb0 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:40:51.376503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d4fe03a9-8efb-4085-811f-d96c00e6fce0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:51.388773 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d4fe03a9-8efb-4085-811f-d96c00e6fce0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.398048 May 28 04:40:51.401634 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 945/1823] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:50 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:51.408246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ac19f3cb-dd61-40aa-ba9c-425b549840a4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:51.409100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ac19f3cb-dd61-40aa-ba9c-425b549840a4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:51.419890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac19f3cb-dd61-40aa-ba9c-425b549840a4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:51.422065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac19f3cb-dd61-40aa-ba9c-425b549840a4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:51.424110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac19f3cb-dd61-40aa-ba9c-425b549840a4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:51.425006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac19f3cb-dd61-40aa-ba9c-425b549840a4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:51.544025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ac19f3cb-dd61-40aa-ba9c-425b549840a4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:51.554409 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ac19f3cb-dd61-40aa-ba9c-425b549840a4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1218 microversion: 2.1 time: 0.150541 May 28 04:40:51.555731 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 946/1824] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:51 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:51.561644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e06d0e07-315e-4c0d-8c5a-05a3b8e89437 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:51.563195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e06d0e07-315e-4c0d-8c5a-05a3b8e89437 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:51.607183 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5465fef0-ca29-42ed-ab68-ecab825e0cb0 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287" status: 204 len: 0 microversion: 2.1 time: 0.646086 May 28 04:40:51.609029 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 879/1825] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:40:50 2022] DELETE /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:40:51.615731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b3bb15fb-a1e9-4770-a900-31a60656ee95 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] Calling method '.version_select at 0x7f77074f45e0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:51.692269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e06d0e07-315e-4c0d-8c5a-05a3b8e89437 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:51.704701 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e06d0e07-315e-4c0d-8c5a-05a3b8e89437 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 200 len: 1213 microversion: 2.1 time: 0.146540 May 28 04:40:51.705827 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 947/1826] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:51 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 1213 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:51.713164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-08f580e2-688b-48a0-89a7-5489024af510 req-780ef896-15b7-41d5-8a73-6c52215f113b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6b84e0-8473-4692-bfa5-e9749726440d", "tag": "ee411ea1-7312-4093-a879-b2685b3fff34"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:51.724848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-08f580e2-688b-48a0-89a7-5489024af510 req-780ef896-15b7-41d5-8a73-6c52215f113b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:51.725687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-08f580e2-688b-48a0-89a7-5489024af510 req-780ef896-15b7-41d5-8a73-6c52215f113b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:51.740549 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-08f580e2-688b-48a0-89a7-5489024af510 req-780ef896-15b7-41d5-8a73-6c52215f113b service nova] Creating event network-changed:ee411ea1-7312-4093-a879-b2685b3fff34 for instance ca6b84e0-8473-4692-bfa5-e9749726440d on n-h2-843700-1 May 28 04:40:51.747878 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-08f580e2-688b-48a0-89a7-5489024af510 req-780ef896-15b7-41d5-8a73-6c52215f113b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040020 May 28 04:40:51.749647 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 948/1827] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:51.757888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-64f5fa61-4f08-490b-ac7e-92070ca75eab tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:51.759709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-64f5fa61-4f08-490b-ac7e-92070ca75eab tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: ca6b84e0-8473-4692-bfa5-e9749726440d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:51.762127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:51.770176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64f5fa61-4f08-490b-ac7e-92070ca75eab tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:51.770924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64f5fa61-4f08-490b-ac7e-92070ca75eab tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:51.772130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64f5fa61-4f08-490b-ac7e-92070ca75eab tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:51.773780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64f5fa61-4f08-490b-ac7e-92070ca75eab tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:51.810952 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b3bb15fb-a1e9-4770-a900-31a60656ee95 tempest-ServersTestManualDisk-1529630046 tempest-ServersTestManualDisk-1529630046-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-57404145" status: 202 len: 0 microversion: 2.1 time: 0.200097 May 28 04:40:51.819182 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 880/1828] 10.222.0.58 () {58 vars in 1214 bytes} [Sat May 28 04:40:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-57404145 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:40:51.831990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-76f655a3-a1e7-4fa1-b1c2-63a2ba82b823 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:51.833625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-76f655a3-a1e7-4fa1-b1c2-63a2ba82b823 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:51.857083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76f655a3-a1e7-4fa1-b1c2-63a2ba82b823 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:51.861086 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76f655a3-a1e7-4fa1-b1c2-63a2ba82b823 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:51.862188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76f655a3-a1e7-4fa1-b1c2-63a2ba82b823 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:51.871553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76f655a3-a1e7-4fa1-b1c2-63a2ba82b823 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:52.249781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-64f5fa61-4f08-490b-ac7e-92070ca75eab tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ca2ed8fa940aa9c379719026ca32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e5de6fa6624b709373d974bafdbbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:52.285585 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-64f5fa61-4f08-490b-ac7e-92070ca75eab tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d" status: 200 len: 1324 microversion: 2.1 time: 0.528380 May 28 04:40:52.287279 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 949/1829] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:51 2022] GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d => generated 1324 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:52.408484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7a6cef5e-15f1-4f62-a2ec-43e1ac2092c8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:52.422279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7a6cef5e-15f1-4f62-a2ec-43e1ac2092c8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:52.422279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7a6cef5e-15f1-4f62-a2ec-43e1ac2092c8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:52.422279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7a6cef5e-15f1-4f62-a2ec-43e1ac2092c8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:52.422279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7a6cef5e-15f1-4f62-a2ec-43e1ac2092c8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:52.423184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7a6cef5e-15f1-4f62-a2ec-43e1ac2092c8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:52.459925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-76f655a3-a1e7-4fa1-b1c2-63a2ba82b823 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:52.473789 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-76f655a3-a1e7-4fa1-b1c2-63a2ba82b823 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287" status: 200 len: 1472 microversion: 2.1 time: 0.652935 May 28 04:40:52.503371 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 881/1830] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:51 2022] GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287 => generated 1472 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:52.579211 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4969b4a5-28a6-4bd8-81df-19fc1157a045 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:52.581162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4969b4a5-28a6-4bd8-81df-19fc1157a045 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:52.613175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4969b4a5-28a6-4bd8-81df-19fc1157a045 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:52.616625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4969b4a5-28a6-4bd8-81df-19fc1157a045 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:52.617747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4969b4a5-28a6-4bd8-81df-19fc1157a045 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:52.622632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4969b4a5-28a6-4bd8-81df-19fc1157a045 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:52.910976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4969b4a5-28a6-4bd8-81df-19fc1157a045 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:52.924584 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4969b4a5-28a6-4bd8-81df-19fc1157a045 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1236 microversion: 2.1 time: 0.356314 May 28 04:40:52.934760 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 882/1831] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:52 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1236 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:52.950370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6b1fc0dd-6519-47a6-8eb5-5d9b5b6e207e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:52.959242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6b1fc0dd-6519-47a6-8eb5-5d9b5b6e207e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:52.966371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b1fc0dd-6519-47a6-8eb5-5d9b5b6e207e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:52.971808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b1fc0dd-6519-47a6-8eb5-5d9b5b6e207e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:52.973435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b1fc0dd-6519-47a6-8eb5-5d9b5b6e207e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:52.974051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b1fc0dd-6519-47a6-8eb5-5d9b5b6e207e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:53.039801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7a6cef5e-15f1-4f62-a2ec-43e1ac2092c8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:53.051782 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7a6cef5e-15f1-4f62-a2ec-43e1ac2092c8 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.647003 May 28 04:40:53.054342 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 950/1832] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:52 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:53.202790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6b1fc0dd-6519-47a6-8eb5-5d9b5b6e207e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:53.212870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:53.217083 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6b1fc0dd-6519-47a6-8eb5-5d9b5b6e207e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 200 len: 1217 microversion: 2.1 time: 0.280732 May 28 04:40:53.230798 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 883/1833] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:52 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 1217 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:53.303146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ed547dff-169b-423a-81e6-570e1a9cda0b tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:53.303977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ed547dff-169b-423a-81e6-570e1a9cda0b tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: ca6b84e0-8473-4692-bfa5-e9749726440d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:53.316456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed547dff-169b-423a-81e6-570e1a9cda0b tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:53.318852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed547dff-169b-423a-81e6-570e1a9cda0b tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:53.320001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed547dff-169b-423a-81e6-570e1a9cda0b tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:53.323288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed547dff-169b-423a-81e6-570e1a9cda0b tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:53.496992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-65f6f2b9-ce2d-45b1-8cd3-e4208ba0bd60 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:53.498207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-65f6f2b9-ce2d-45b1-8cd3-e4208ba0bd60 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:53.514555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65f6f2b9-ce2d-45b1-8cd3-e4208ba0bd60 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:53.521819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65f6f2b9-ce2d-45b1-8cd3-e4208ba0bd60 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:53.523180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65f6f2b9-ce2d-45b1-8cd3-e4208ba0bd60 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:53.525993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65f6f2b9-ce2d-45b1-8cd3-e4208ba0bd60 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:53.875726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ed547dff-169b-423a-81e6-570e1a9cda0b tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ca2ed8fa940aa9c379719026ca32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e5de6fa6624b709373d974bafdbbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:53.884849 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ed547dff-169b-423a-81e6-570e1a9cda0b tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d" status: 200 len: 1324 microversion: 2.1 time: 0.585610 May 28 04:40:53.889728 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 951/1834] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:53 2022] GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d => generated 1324 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:40:53.942055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ad97645a-56b7-422e-a4e2-3e4b3c04f692 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:53.942958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ad97645a-56b7-422e-a4e2-3e4b3c04f692 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:53.955185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad97645a-56b7-422e-a4e2-3e4b3c04f692 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:53.963691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad97645a-56b7-422e-a4e2-3e4b3c04f692 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:53.966290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad97645a-56b7-422e-a4e2-3e4b3c04f692 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:53.966290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad97645a-56b7-422e-a4e2-3e4b3c04f692 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:54.219785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ad97645a-56b7-422e-a4e2-3e4b3c04f692 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:54.229751 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ad97645a-56b7-422e-a4e2-3e4b3c04f692 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1236 microversion: 2.1 time: 0.291128 May 28 04:40:54.238741 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 952/1835] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:53 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1236 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:54.247955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d5c9a013-5265-4e9c-8125-f733170477ee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:54.248579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d5c9a013-5265-4e9c-8125-f733170477ee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:54.271357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5c9a013-5265-4e9c-8125-f733170477ee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:54.282838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5c9a013-5265-4e9c-8125-f733170477ee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:54.283768 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5c9a013-5265-4e9c-8125-f733170477ee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:54.284216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5c9a013-5265-4e9c-8125-f733170477ee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:54.304676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-65f6f2b9-ce2d-45b1-8cd3-e4208ba0bd60 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd398d45627fc4d33bc9a736ddf8f9215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a5b721a538475cbac9c95c61647753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:54.340011 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-65f6f2b9-ce2d-45b1-8cd3-e4208ba0bd60 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287" status: 200 len: 1472 microversion: 2.1 time: 0.844179 May 28 04:40:54.343235 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 884/1836] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:53 2022] GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287 => generated 1472 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:40:54.355169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d82073d7-9948-4c08-bf98-0f6a4b1f2644 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:54.359937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d82073d7-9948-4c08-bf98-0f6a4b1f2644 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:54.395945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d82073d7-9948-4c08-bf98-0f6a4b1f2644 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:54.396657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d82073d7-9948-4c08-bf98-0f6a4b1f2644 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:54.397522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d82073d7-9948-4c08-bf98-0f6a4b1f2644 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:54.397973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d82073d7-9948-4c08-bf98-0f6a4b1f2644 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:54.941170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d82073d7-9948-4c08-bf98-0f6a4b1f2644 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:54.948395 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d82073d7-9948-4c08-bf98-0f6a4b1f2644 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 200 len: 1273 microversion: 2.1 time: 0.603262 May 28 04:40:54.948988 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 885/1837] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:54 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 1273 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:54.971845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-af1608be-1b54-46b1-ae3b-c9ab0f7e39bd req-f6fda337-02db-49cd-a8d8-4bd1256219fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7015ae59-a219-4897-97c4-ba6ead622287", "name": "network-vif-deleted", "tag": "808893f1-2f18-4655-af40-220ed920c0ea"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:55.006415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-af1608be-1b54-46b1-ae3b-c9ab0f7e39bd req-f6fda337-02db-49cd-a8d8-4bd1256219fe service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:55.006963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-af1608be-1b54-46b1-ae3b-c9ab0f7e39bd req-f6fda337-02db-49cd-a8d8-4bd1256219fe service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:55.047376 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-af1608be-1b54-46b1-ae3b-c9ab0f7e39bd req-f6fda337-02db-49cd-a8d8-4bd1256219fe service nova] Creating event network-vif-deleted:808893f1-2f18-4655-af40-220ed920c0ea for instance 7015ae59-a219-4897-97c4-ba6ead622287 on n-h2-843700-1 May 28 04:40:55.060618 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-af1608be-1b54-46b1-ae3b-c9ab0f7e39bd req-f6fda337-02db-49cd-a8d8-4bd1256219fe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110218 May 28 04:40:55.063374 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 886/1838] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:55.076481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-5b9db24b-c4e7-4f93-91e4-3098a1a10b85 req-01c76e8d-5988-4793-a183-468b384f41dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6b84e0-8473-4692-bfa5-e9749726440d", "name": "network-vif-plugged", "status": "completed", "tag": "ee411ea1-7312-4093-a879-b2685b3fff34"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:55.093637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5b9db24b-c4e7-4f93-91e4-3098a1a10b85 req-01c76e8d-5988-4793-a183-468b384f41dc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:55.094390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5b9db24b-c4e7-4f93-91e4-3098a1a10b85 req-01c76e8d-5988-4793-a183-468b384f41dc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:55.108999 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-5b9db24b-c4e7-4f93-91e4-3098a1a10b85 req-01c76e8d-5988-4793-a183-468b384f41dc service nova] Creating event network-vif-plugged:ee411ea1-7312-4093-a879-b2685b3fff34 for instance ca6b84e0-8473-4692-bfa5-e9749726440d on n-h2-843700-1 May 28 04:40:55.135123 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-5b9db24b-c4e7-4f93-91e4-3098a1a10b85 req-01c76e8d-5988-4793-a183-468b384f41dc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069699 May 28 04:40:55.136250 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 887/1839] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:55.144992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5673f4a1-e1ec-40d0-bd98-75b66e6d4d00 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:55.146121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5673f4a1-e1ec-40d0-bd98-75b66e6d4d00 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: ca6b84e0-8473-4692-bfa5-e9749726440d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:55.153811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5673f4a1-e1ec-40d0-bd98-75b66e6d4d00 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:55.155127 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5673f4a1-e1ec-40d0-bd98-75b66e6d4d00 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:55.155782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5673f4a1-e1ec-40d0-bd98-75b66e6d4d00 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:55.156512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5673f4a1-e1ec-40d0-bd98-75b66e6d4d00 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:55.516870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d5c9a013-5265-4e9c-8125-f733170477ee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:55.530628 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d5c9a013-5265-4e9c-8125-f733170477ee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 1.288149 May 28 04:40:55.532821 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 953/1840] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:54 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:55.545675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1a5acede-51a5-4019-8665-cc58bcf4ce26 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:55.550114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1a5acede-51a5-4019-8665-cc58bcf4ce26 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:55.563230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a5acede-51a5-4019-8665-cc58bcf4ce26 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:55.563814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a5acede-51a5-4019-8665-cc58bcf4ce26 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:55.564600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a5acede-51a5-4019-8665-cc58bcf4ce26 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:55.565143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a5acede-51a5-4019-8665-cc58bcf4ce26 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:55.662336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5673f4a1-e1ec-40d0-bd98-75b66e6d4d00 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ca2ed8fa940aa9c379719026ca32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e5de6fa6624b709373d974bafdbbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:55.681709 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5673f4a1-e1ec-40d0-bd98-75b66e6d4d00 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d" status: 200 len: 1324 microversion: 2.1 time: 0.543096 May 28 04:40:55.682827 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 888/1841] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:55 2022] GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d => generated 1324 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:55.700338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-54c93d92-738a-4183-b044-b457cea940b8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:55.701224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-54c93d92-738a-4183-b044-b457cea940b8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] [instance: 7015ae59-a219-4897-97c4-ba6ead622287] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:55.712615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54c93d92-738a-4183-b044-b457cea940b8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:55.714040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54c93d92-738a-4183-b044-b457cea940b8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:55.715052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54c93d92-738a-4183-b044-b457cea940b8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:55.715671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54c93d92-738a-4183-b044-b457cea940b8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:55.747235 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-54c93d92-738a-4183-b044-b457cea940b8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] HTTP exception thrown: Instance 7015ae59-a219-4897-97c4-ba6ead622287 could not be found. May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-54c93d92-738a-4183-b044-b457cea940b8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Request method failure captured: May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287 HTTP/1.1 May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikacM2KhD78yFRK4EsqhrSyTkAV6Nk1F7FXJklf8auTvIKGrUmSmLWcwCIjKaPM6QlxxtXfRYh5fIpqbGQIq7lvQWGQ3on9q1XMdmR40ZvjC765A16ijPz3gObMshF2VFgwx83uBQA7MXjlNEOTRDuEMLE2TFSD0l-hdWW3mhb5DGOiM May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: e7a5b721a538475cbac9c95c61647753 May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:40:55.750258 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:40:55.752703 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e7a5b721a538475cbac9c95c61647753"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7a5b721a538475cbac9c95c61647753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:40:55.752703 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:55.752703 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: e7a5b721a538475cbac9c95c61647753 May 28 04:40:55.752703 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1039499615 May 28 04:40:55.752703 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersOnMultiNodesTest-1039499615-project May 28 04:40:55.752703 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:40:55.752703 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:40:55.752703 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: d398d45627fc4d33bc9a736ddf8f9215 May 28 04:40:55.752703 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersOnMultiNodesTest-1039499615-project May 28 04:40:55.752703 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:40:55.752703 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 7015ae59-a219-4897-97c4-ba6ead622287 could not be found. May 28 04:40:55.752703 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '7015ae59-a219-4897-97c4-ba6ead622287'} May 28 04:40:55.753732 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:40:55.753732 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:55.753732 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:40:55.753732 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:40:55.753732 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:40:55.753732 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:40:55.753732 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:40:55.753732 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:40:55.753732 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:40:55.753732 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:40:55.753732 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7015ae59-a219-4897-97c4-ba6ead622287 could not be found. May 28 04:40:55.753732 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:55.753732 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:55.753732 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:55.753732 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:55.753732 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:55.753732 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:55.753732 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:40:55.753732 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:40:55.753732 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:40:55.755387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:40:55.755387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:40:55.755387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:40:55.755387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:40:55.755387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:40:55.755387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:40:55.755387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:40:55.755387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7015ae59-a219-4897-97c4-ba6ead622287 could not be found. May 28 04:40:55.755387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:55.755387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:40:55.755387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:55.755387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:40:55.755387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:40:55.755387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:40:55.755387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:40:55.755387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:40:55.755387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7015ae59-a219-4897-97c4-ba6ead622287 could not be found. May 28 04:40:55.755387 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:40:55.758409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-54c93d92-738a-4183-b044-b457cea940b8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] Returning 404 to user: Instance 7015ae59-a219-4897-97c4-ba6ead622287 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:40:55.760351 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-54c93d92-738a-4183-b044-b457cea940b8 tempest-ServersOnMultiNodesTest-1039499615 tempest-ServersOnMultiNodesTest-1039499615-project] 10.222.0.58 "GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287" status: 404 len: 111 microversion: 2.1 time: 0.064243 May 28 04:40:55.761643 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 889/1842] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:55 2022] GET /compute/v2.1/servers/7015ae59-a219-4897-97c4-ba6ead622287 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:40:55.785885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1a5acede-51a5-4019-8665-cc58bcf4ce26 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:55.801595 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1a5acede-51a5-4019-8665-cc58bcf4ce26 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1236 microversion: 2.1 time: 0.267472 May 28 04:40:55.807863 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 954/1843] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:55 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1236 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:55.966472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3c21d68a-8354-4bc7-b0c1-bc65e4a59839 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:55.967156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3c21d68a-8354-4bc7-b0c1-bc65e4a59839 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:55.977505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c21d68a-8354-4bc7-b0c1-bc65e4a59839 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:55.978004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c21d68a-8354-4bc7-b0c1-bc65e4a59839 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:55.978805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c21d68a-8354-4bc7-b0c1-bc65e4a59839 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:55.985043 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c21d68a-8354-4bc7-b0c1-bc65e4a59839 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:56.551434 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7e6f4eb7-855c-4562-beef-50a3eb743e30 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:56.552893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3c21d68a-8354-4bc7-b0c1-bc65e4a59839 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:56.553378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7e6f4eb7-855c-4562-beef-50a3eb743e30 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:56.567945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e6f4eb7-855c-4562-beef-50a3eb743e30 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:56.572458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e6f4eb7-855c-4562-beef-50a3eb743e30 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:56.577576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e6f4eb7-855c-4562-beef-50a3eb743e30 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:56.577576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e6f4eb7-855c-4562-beef-50a3eb743e30 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:56.577813 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3c21d68a-8354-4bc7-b0c1-bc65e4a59839 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 200 len: 1271 microversion: 2.1 time: 0.604972 May 28 04:40:56.577813 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 890/1844] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:55 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 1271 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:56.710915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ea2bb4e9-60d9-4298-adce-5940fe27215f tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:56.716074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ea2bb4e9-60d9-4298-adce-5940fe27215f tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: ca6b84e0-8473-4692-bfa5-e9749726440d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:56.748235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea2bb4e9-60d9-4298-adce-5940fe27215f tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:56.750600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea2bb4e9-60d9-4298-adce-5940fe27215f tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:56.755597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea2bb4e9-60d9-4298-adce-5940fe27215f tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:56.756754 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea2bb4e9-60d9-4298-adce-5940fe27215f tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:57.099421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7e6f4eb7-855c-4562-beef-50a3eb743e30 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:57.109717 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7e6f4eb7-855c-4562-beef-50a3eb743e30 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.563448 May 28 04:40:57.112923 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 955/1845] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:56 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:57.122450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d9d9090e-2192-4764-a6fa-1393eb2ca3a4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:57.124871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d9d9090e-2192-4764-a6fa-1393eb2ca3a4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:57.145073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9d9090e-2192-4764-a6fa-1393eb2ca3a4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:57.145543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9d9090e-2192-4764-a6fa-1393eb2ca3a4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:57.146336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9d9090e-2192-4764-a6fa-1393eb2ca3a4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:57.146776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9d9090e-2192-4764-a6fa-1393eb2ca3a4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:57.424120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ea2bb4e9-60d9-4298-adce-5940fe27215f tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ca2ed8fa940aa9c379719026ca32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e5de6fa6624b709373d974bafdbbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:57.438116 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ea2bb4e9-60d9-4298-adce-5940fe27215f tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d" status: 200 len: 1324 microversion: 2.1 time: 0.738044 May 28 04:40:57.439131 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 891/1846] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:56 2022] GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d => generated 1324 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:57.593153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1cad16c4-d437-4bae-9e72-0507d988dd29 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:57.594178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1cad16c4-d437-4bae-9e72-0507d988dd29 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:57.606947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cad16c4-d437-4bae-9e72-0507d988dd29 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:57.607509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cad16c4-d437-4bae-9e72-0507d988dd29 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:57.609854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cad16c4-d437-4bae-9e72-0507d988dd29 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:57.613602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cad16c4-d437-4bae-9e72-0507d988dd29 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:57.644243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d9d9090e-2192-4764-a6fa-1393eb2ca3a4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:57.661703 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d9d9090e-2192-4764-a6fa-1393eb2ca3a4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1304 microversion: 2.1 time: 0.540842 May 28 04:40:57.662435 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 956/1847] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:57 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1304 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:57.781501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1cad16c4-d437-4bae-9e72-0507d988dd29 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:57.819129 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1cad16c4-d437-4bae-9e72-0507d988dd29 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 200 len: 1271 microversion: 2.1 time: 0.230694 May 28 04:40:57.830981 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 892/1848] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:57 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:58.137689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e0d60223-0ecd-4914-b886-2d8b0e081daf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:58.138753 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e0d60223-0ecd-4914-b886-2d8b0e081daf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:58.149355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0d60223-0ecd-4914-b886-2d8b0e081daf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:58.155656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0d60223-0ecd-4914-b886-2d8b0e081daf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:58.155656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0d60223-0ecd-4914-b886-2d8b0e081daf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:58.160841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0d60223-0ecd-4914-b886-2d8b0e081daf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:58.184496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b8359e99-c484-4e45-a74b-e9d130ad4e11 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1930071221", "imageRef": "49459a42-c0ac-4f92-85cf-9df1c7b84b6d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f155d9b5-8a59-4280-ad82-f4dea0d01fc2"}], "security_groups": [{"name": "tempest-securitygroup--1374537333"}], "key_name": "tempest-keypair-1637303593", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:58.611778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-b8359e99-c484-4e45-a74b-e9d130ad4e11 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] validate_networks() for [('f155d9b5-8a59-4280-ad82-f4dea0d01fc2', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:40:58.751827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e0d60223-0ecd-4914-b886-2d8b0e081daf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:58.761726 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e0d60223-0ecd-4914-b886-2d8b0e081daf tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.631404 May 28 04:40:58.762322 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 957/1849] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:58 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:58.767494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-04e1e11f-20ed-46f7-88fd-09b8ad18b19d tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:58.768287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-04e1e11f-20ed-46f7-88fd-09b8ad18b19d tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: ca6b84e0-8473-4692-bfa5-e9749726440d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:58.794335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-04e1e11f-20ed-46f7-88fd-09b8ad18b19d tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:58.794793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-04e1e11f-20ed-46f7-88fd-09b8ad18b19d tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:58.806383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-04e1e11f-20ed-46f7-88fd-09b8ad18b19d tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:58.807157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-04e1e11f-20ed-46f7-88fd-09b8ad18b19d tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:59.130362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:40:59.569818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-04e1e11f-20ed-46f7-88fd-09b8ad18b19d tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ca2ed8fa940aa9c379719026ca32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e5de6fa6624b709373d974bafdbbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:40:59.585541 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-04e1e11f-20ed-46f7-88fd-09b8ad18b19d tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d" status: 200 len: 1521 microversion: 2.1 time: 0.821268 May 28 04:40:59.588486 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 958/1850] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:58 2022] GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d => generated 1521 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:40:59.597852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-0418afc4-c6b3-4dc6-bdc7-174821d00f83 req-2702157e-310c-4250-8087-42e92b6d8dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5", "tag": "8377d9fd-2493-4628-960b-9f1440849e31"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:40:59.610052 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-0418afc4-c6b3-4dc6-bdc7-174821d00f83 req-2702157e-310c-4250-8087-42e92b6d8dc0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:59.611014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-0418afc4-c6b3-4dc6-bdc7-174821d00f83 req-2702157e-310c-4250-8087-42e92b6d8dc0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:59.635096 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-0418afc4-c6b3-4dc6-bdc7-174821d00f83 req-2702157e-310c-4250-8087-42e92b6d8dc0 service nova] Creating event network-changed:8377d9fd-2493-4628-960b-9f1440849e31 for instance b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 on n-h1-843700-1 May 28 04:40:59.645425 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-0418afc4-c6b3-4dc6-bdc7-174821d00f83 req-2702157e-310c-4250-8087-42e92b6d8dc0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053890 May 28 04:40:59.651535 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 959/1851] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:40:59.675333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-11d67b75-4f78-4409-89b9-0b0ffdfd6546 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:40:59.676416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-11d67b75-4f78-4409-89b9-0b0ffdfd6546 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:40:59.685880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11d67b75-4f78-4409-89b9-0b0ffdfd6546 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:59.687206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11d67b75-4f78-4409-89b9-0b0ffdfd6546 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:40:59.688595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11d67b75-4f78-4409-89b9-0b0ffdfd6546 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:40:59.689451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11d67b75-4f78-4409-89b9-0b0ffdfd6546 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:00.511666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:00.658524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=45,nova_cell0:UPDATE=7 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:00.658762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-11d67b75-4f78-4409-89b9-0b0ffdfd6546 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:00.658762 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-11d67b75-4f78-4409-89b9-0b0ffdfd6546 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1304 microversion: 2.1 time: 0.952860 May 28 04:41:00.658762 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 960/1852] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:40:59 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1304 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:00.658762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9e16d009-7762-4fd4-8d6b-50c5fc4685d3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:00.659468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9e16d009-7762-4fd4-8d6b-50c5fc4685d3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:00.659468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e16d009-7762-4fd4-8d6b-50c5fc4685d3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:00.659468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e16d009-7762-4fd4-8d6b-50c5fc4685d3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:00.659468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e16d009-7762-4fd4-8d6b-50c5fc4685d3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:00.659886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e16d009-7762-4fd4-8d6b-50c5fc4685d3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:00.733406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9e16d009-7762-4fd4-8d6b-50c5fc4685d3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:00.736976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-b8359e99-c484-4e45-a74b-e9d130ad4e11 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:41:00.737415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-b8359e99-c484-4e45-a74b-e9d130ad4e11 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:41:00.737902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-b8359e99-c484-4e45-a74b-e9d130ad4e11 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:41:00.738313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-b8359e99-c484-4e45-a74b-e9d130ad4e11 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:41:00.739734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-b8359e99-c484-4e45-a74b-e9d130ad4e11 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:41:00.752051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8359e99-c484-4e45-a74b-e9d130ad4e11 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:00.757423 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9e16d009-7762-4fd4-8d6b-50c5fc4685d3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 200 len: 1271 microversion: 2.1 time: 0.127985 May 28 04:41:00.757576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8359e99-c484-4e45-a74b-e9d130ad4e11 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:00.757576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8359e99-c484-4e45-a74b-e9d130ad4e11 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:00.757576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8359e99-c484-4e45-a74b-e9d130ad4e11 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:00.757866 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 961/1853] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:00 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 1271 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:00.770244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bed68e6c-6834-4244-8417-0b3372a075a4 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-131909294", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "d1810576-acba-46c5-8bf2-968cfbdd599f"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bed68e6c-6834-4244-8417-0b3372a075a4 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Request method failure captured: May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 242 May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikafGt6CZ-NQloqPmZklajHUtcnEHokuEFrG_MryQx3LbG73ZzCB8e2AKKUg2y0HR12PLJXaB-vgvROO6VxsiHgT5CplKY-QsUKCBx19TiZxjoueQtgBtQZ2zACjgp_mHBGjtjPgOJgfbMCW58_2U_YOxo7K5sN2FVrA_bOYIRhzQdKc May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 59e5de6fa6624b709373d974bafdbbff May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:41:00.773735 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:41:00.776147 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:41:00.776147 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:00.776147 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 59e5de6fa6624b709373d974bafdbbff May 28 04:41:00.776147 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:00.776147 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerMetadataNegativeTestJSON-2052830768-project May 28 04:41:00.776147 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:41:00.776147 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:41:00.776147 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 411ca2ed8fa940aa9c379719026ca32f May 28 04:41:00.776147 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2052830768-project May 28 04:41:00.776147 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:41:00.776147 n-d-843700-1 devstack@n-api.service[126044]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-131909294", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "d1810576-acba-46c5-8bf2-968cfbdd599f"}]}} May 28 04:41:00.777079 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:41:00.777079 n-d-843700-1 devstack@n-api.service[126044]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:41:00.777079 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-131909294', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'd1810576-acba-46c5-8bf2-968cfbdd599f'}]}}} May 28 04:41:00.777079 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:41:00.777079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:00.777079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:41:00.777079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:41:00.777079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:41:00.777079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise error May 28 04:41:00.777079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:41:00.777079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:00.777079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 28 04:41:00.777079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 28 04:41:00.777079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 28 04:41:00.777079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 28 04:41:00.777079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 28 04:41:00.777079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:00.777079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 04:41:00.777079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi {'': 'data1'} May 28 04:41:00.778674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:00.778674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:00.778674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:00.778674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:00.778674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:00.778674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:00.778674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:41:00.778674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:41:00.778674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:41:00.778674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:41:00.778674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:41:00.778674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:41:00.778674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:41:00.778674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:41:00.778674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:41:00.778674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:41:00.778674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:41:00.778674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:41:00.778674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:41:00.778674 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:00.781459 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:00.781459 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:00.781459 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:00.781459 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:00.781459 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:00.781459 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:41:00.781459 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:41:00.781459 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:41:00.781459 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:00.781459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bed68e6c-6834-4244-8417-0b3372a075a4 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:41:00.781459 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bed68e6c-6834-4244-8417-0b3372a075a4 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.020185 May 28 04:41:00.781459 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 962/1854] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:41:00 2022] POST /compute/v2.1/servers => generated 175 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:41:00.788079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-b8359e99-c484-4e45-a74b-e9d130ad4e11 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Getting quotas for project f5cf1a786cba41cd88ea6a766ca8a673. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:41:00.791020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e71c4bdc-2859-4bd6-abfe-c0511f347d74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:00.791755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e71c4bdc-2859-4bd6-abfe-c0511f347d74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:00.792864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:00.798791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e71c4bdc-2859-4bd6-abfe-c0511f347d74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:00.799099 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-b8359e99-c484-4e45-a74b-e9d130ad4e11 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Getting quotas for user 99e2ff86a2484cd38b6e4176109f6b53 and project f5cf1a786cba41cd88ea6a766ca8a673. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:41:00.799266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e71c4bdc-2859-4bd6-abfe-c0511f347d74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:00.800045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e71c4bdc-2859-4bd6-abfe-c0511f347d74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:00.800626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e71c4bdc-2859-4bd6-abfe-c0511f347d74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:00.817322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b8359e99-c484-4e45-a74b-e9d130ad4e11 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:41:00.820088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b8359e99-c484-4e45-a74b-e9d130ad4e11 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49459a42-c0ac-4f92-85cf-9df1c7b84b6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:41:01.033524 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b8359e99-c484-4e45-a74b-e9d130ad4e11 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.860826 May 28 04:41:01.036005 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 893/1855] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:40:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 2864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 04:41:01.054650 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1e05e5f3-6d75-44c9-859d-b5cb115fbd0a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:01.057065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1e05e5f3-6d75-44c9-859d-b5cb115fbd0a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: f93caed8-72e4-4d8b-8ce2-56386caaea8c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:01.070302 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-1e05e5f3-6d75-44c9-859d-b5cb115fbd0a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] HTTP exception thrown: Instance f93caed8-72e4-4d8b-8ce2-56386caaea8c could not be found. May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1e05e5f3-6d75-44c9-859d-b5cb115fbd0a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Request method failure captured: May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/f93caed8-72e4-4d8b-8ce2-56386caaea8c/metadata HTTP/1.1 May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikafGt6CZ-NQloqPmZklajHUtcnEHokuEFrG_MryQx3LbG73ZzCB8e2AKKUg2y0HR12PLJXaB-vgvROO6VxsiHgT5CplKY-QsUKCBx19TiZxjoueQtgBtQZ2zACjgp_mHBGjtjPgOJgfbMCW58_2U_YOxo7K5sN2FVrA_bOYIRhzQdKc May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 59e5de6fa6624b709373d974bafdbbff May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:41:01.081865 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:41:01.087622 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:41:01.087622 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:01.087622 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 59e5de6fa6624b709373d974bafdbbff May 28 04:41:01.087622 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:01.087622 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerMetadataNegativeTestJSON-2052830768-project May 28 04:41:01.087622 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:41:01.087622 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:41:01.087622 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 411ca2ed8fa940aa9c379719026ca32f May 28 04:41:01.087622 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2052830768-project May 28 04:41:01.087622 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:41:01.087622 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance f93caed8-72e4-4d8b-8ce2-56386caaea8c could not be found. May 28 04:41:01.087622 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'server_id': 'f93caed8-72e4-4d8b-8ce2-56386caaea8c'} May 28 04:41:01.089545 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:41:01.089545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:01.089545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:41:01.089545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:41:01.089545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:41:01.089545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:41:01.089545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:41:01.089545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:41:01.089545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f93caed8-72e4-4d8b-8ce2-56386caaea8c could not be found. May 28 04:41:01.089545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:01.089545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:01.089545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:01.089545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:01.089545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:01.089545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:01.089545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:41:01.089545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:41:01.089545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:41:01.089545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:41:01.089545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index May 28 04:41:01.091338 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) May 28 04:41:01.091338 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:41:01.091338 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:41:01.091338 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f93caed8-72e4-4d8b-8ce2-56386caaea8c could not be found. May 28 04:41:01.091338 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:01.091338 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:01.091338 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:01.091338 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:01.091338 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:01.091338 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:01.091338 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:41:01.091338 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:41:01.091338 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f93caed8-72e4-4d8b-8ce2-56386caaea8c could not be found. May 28 04:41:01.091338 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:01.091338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1e05e5f3-6d75-44c9-859d-b5cb115fbd0a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Returning 404 to user: Instance f93caed8-72e4-4d8b-8ce2-56386caaea8c could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:41:01.094008 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1e05e5f3-6d75-44c9-859d-b5cb115fbd0a tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "GET /compute/v2.1/servers/f93caed8-72e4-4d8b-8ce2-56386caaea8c/metadata" status: 404 len: 111 microversion: 2.1 time: 0.050419 May 28 04:41:01.109992 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 894/1856] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 04:41:01 2022] GET /compute/v2.1/servers/f93caed8-72e4-4d8b-8ce2-56386caaea8c/metadata => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:41:01.132035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1ba5168a-d968-4606-9690-d92f646fd8d8 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:01.138378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1ba5168a-d968-4606-9690-d92f646fd8d8 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:01.451017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1ba5168a-d968-4606-9690-d92f646fd8d8 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:01.481517 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1ba5168a-d968-4606-9690-d92f646fd8d8 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1246 microversion: 2.1 time: 0.370325 May 28 04:41:01.490643 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 895/1857] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:01 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1246 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:01.509458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0fddec75-092f-4137-84c1-49f6184516b3 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1489677995", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d1810576-acba-46c5-8bf2-968cfbdd599f"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0fddec75-092f-4137-84c1-49f6184516b3 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Request method failure captured: May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 499 May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikafGt6CZ-NQloqPmZklajHUtcnEHokuEFrG_MryQx3LbG73ZzCB8e2AKKUg2y0HR12PLJXaB-vgvROO6VxsiHgT5CplKY-QsUKCBx19TiZxjoueQtgBtQZ2zACjgp_mHBGjtjPgOJgfbMCW58_2U_YOxo7K5sN2FVrA_bOYIRhzQdKc May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 59e5de6fa6624b709373d974bafdbbff May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:41:01.520708 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:41:01.522850 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:41:01.522850 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:01.522850 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 59e5de6fa6624b709373d974bafdbbff May 28 04:41:01.522850 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:01.522850 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerMetadataNegativeTestJSON-2052830768-project May 28 04:41:01.522850 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:41:01.522850 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:41:01.522850 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 411ca2ed8fa940aa9c379719026ca32f May 28 04:41:01.522850 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2052830768-project May 28 04:41:01.522850 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:41:01.523724 n-d-843700-1 devstack@n-api.service[126043]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1489677995", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d1810576-acba-46c5-8bf2-968cfbdd599f"}]}} May 28 04:41:01.523724 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:41:01.523724 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:41:01.523724 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1489677995', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd1810576-acba-46c5-8bf2-968cfbdd599f'}]}}} May 28 04:41:01.523724 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:41:01.523724 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:01.524173 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:41:01.524173 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:41:01.524173 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:41:01.524173 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:41:01.524173 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:41:01.524173 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:01.524173 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 28 04:41:01.524173 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 28 04:41:01.524173 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 28 04:41:01.524173 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 28 04:41:01.524173 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 28 04:41:01.524173 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:01.524173 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 04:41:01.524173 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 28 04:41:01.524173 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:01.524173 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:01.524173 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:01.527091 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:01.527091 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:01.527091 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:01.527091 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:41:01.527091 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:41:01.527091 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:41:01.527091 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:41:01.527091 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:41:01.527091 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:41:01.527091 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:41:01.527091 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:41:01.527091 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:41:01.527091 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:41:01.527091 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:41:01.527091 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:41:01.534506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:41:01.534506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:01.534506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:01.534506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:01.534506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:01.534506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:01.534506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:01.534506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:41:01.534506 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:41:01.535527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:41:01.535527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:01.535527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0fddec75-092f-4137-84c1-49f6184516b3 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:41:01.535798 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0fddec75-092f-4137-84c1-49f6184516b3 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.037318 May 28 04:41:01.535798 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 896/1858] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:41:01 2022] POST /compute/v2.1/servers => generated 687 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:41:01.535957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e71c4bdc-2859-4bd6-abfe-c0511f347d74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:01.550389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:01.573700 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e71c4bdc-2859-4bd6-abfe-c0511f347d74 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.786165 May 28 04:41:01.584971 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 963/1859] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:00 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:01.660096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b659d64d-c379-40e3-92dd-6c8aaff3030e tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-909307650", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d1810576-acba-46c5-8bf2-968cfbdd599f"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b659d64d-c379-40e3-92dd-6c8aaff3030e tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Request method failure captured: May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 499 May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikafGt6CZ-NQloqPmZklajHUtcnEHokuEFrG_MryQx3LbG73ZzCB8e2AKKUg2y0HR12PLJXaB-vgvROO6VxsiHgT5CplKY-QsUKCBx19TiZxjoueQtgBtQZ2zACjgp_mHBGjtjPgOJgfbMCW58_2U_YOxo7K5sN2FVrA_bOYIRhzQdKc May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 59e5de6fa6624b709373d974bafdbbff May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:41:01.689984 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:41:01.694066 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:41:01.694066 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:01.694066 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 59e5de6fa6624b709373d974bafdbbff May 28 04:41:01.694066 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:01.694066 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerMetadataNegativeTestJSON-2052830768-project May 28 04:41:01.694066 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:41:01.694066 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:41:01.694066 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 411ca2ed8fa940aa9c379719026ca32f May 28 04:41:01.694066 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2052830768-project May 28 04:41:01.694066 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:41:01.694839 n-d-843700-1 devstack@n-api.service[126044]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-909307650", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d1810576-acba-46c5-8bf2-968cfbdd599f"}]}} May 28 04:41:01.694839 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:41:01.694839 n-d-843700-1 devstack@n-api.service[126044]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:41:01.694839 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-909307650', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd1810576-acba-46c5-8bf2-968cfbdd599f'}]}}} May 28 04:41:01.694839 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:41:01.694839 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:01.696068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:41:01.696068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:41:01.696068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:41:01.696068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise error May 28 04:41:01.696068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:41:01.696068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:01.696068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 28 04:41:01.696068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 28 04:41:01.696068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 28 04:41:01.696068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 28 04:41:01.696068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 28 04:41:01.696068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:01.696068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 04:41:01.696068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 28 04:41:01.696068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:01.696068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:01.696068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:01.699676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:01.699676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:01.699676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:01.699676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:41:01.699676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:41:01.699676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:41:01.699676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:41:01.699676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:41:01.699676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:41:01.699676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:41:01.699676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:41:01.699676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:41:01.699676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:41:01.699676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:41:01.699676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:41:01.701965 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:41:01.701965 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:01.701965 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:01.701965 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:01.701965 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:01.701965 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:01.701965 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:01.701965 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:41:01.701965 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:41:01.703408 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:41:01.703408 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:01.703408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b659d64d-c379-40e3-92dd-6c8aaff3030e tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:41:01.703952 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b659d64d-c379-40e3-92dd-6c8aaff3030e tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.021049 May 28 04:41:01.703952 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 964/1860] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:41:01 2022] POST /compute/v2.1/servers => generated 689 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 04:41:01.703952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d6fc4987-7148-4cbf-9867-34026ad821a3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:01.703952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d6fc4987-7148-4cbf-9867-34026ad821a3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:01.710269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=26 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:01.724591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d6fc4987-7148-4cbf-9867-34026ad821a3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:01.729827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d6fc4987-7148-4cbf-9867-34026ad821a3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:01.736203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d6fc4987-7148-4cbf-9867-34026ad821a3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:01.736203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d6fc4987-7148-4cbf-9867-34026ad821a3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:01.818659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9fcae882-1f5c-421b-8c09-f999cdc012c8 tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:01.837802 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9fcae882-1f5c-421b-8c09-f999cdc012c8 tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.305957 May 28 04:41:01.846758 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 897/1861] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:41:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:01.852010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-49bb1b79-3928-4940-8c18-b0ab638a236e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:01.853443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-49bb1b79-3928-4940-8c18-b0ab638a236e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:01.864292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49bb1b79-3928-4940-8c18-b0ab638a236e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:01.870845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49bb1b79-3928-4940-8c18-b0ab638a236e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:01.870845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49bb1b79-3928-4940-8c18-b0ab638a236e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:01.870845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49bb1b79-3928-4940-8c18-b0ab638a236e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:02.395262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d6fc4987-7148-4cbf-9867-34026ad821a3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:02.405229 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d6fc4987-7148-4cbf-9867-34026ad821a3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1304 microversion: 2.1 time: 0.725592 May 28 04:41:02.405828 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 965/1862] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:01 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1304 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:02.418823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-de191904-5377-4bf1-8ed2-1fb52d69d26e tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1631648636", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d1810576-acba-46c5-8bf2-968cfbdd599f"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-de191904-5377-4bf1-8ed2-1fb52d69d26e tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Request method failure captured: May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 754 May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikafGt6CZ-NQloqPmZklajHUtcnEHokuEFrG_MryQx3LbG73ZzCB8e2AKKUg2y0HR12PLJXaB-vgvROO6VxsiHgT5CplKY-QsUKCBx19TiZxjoueQtgBtQZ2zACjgp_mHBGjtjPgOJgfbMCW58_2U_YOxo7K5sN2FVrA_bOYIRhzQdKc May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 59e5de6fa6624b709373d974bafdbbff May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:41:02.425289 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:41:02.427563 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:41:02.427563 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:02.427563 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 59e5de6fa6624b709373d974bafdbbff May 28 04:41:02.427563 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:02.427563 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerMetadataNegativeTestJSON-2052830768-project May 28 04:41:02.427563 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:41:02.427563 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:41:02.427563 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 411ca2ed8fa940aa9c379719026ca32f May 28 04:41:02.427563 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2052830768-project May 28 04:41:02.427563 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:41:02.428214 n-d-843700-1 devstack@n-api.service[126044]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1631648636", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d1810576-acba-46c5-8bf2-968cfbdd599f"}]}} May 28 04:41:02.428214 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:41:02.428214 n-d-843700-1 devstack@n-api.service[126044]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:41:02.428447 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1631648636', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd1810576-acba-46c5-8bf2-968cfbdd599f'}]}}} May 28 04:41:02.428447 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:41:02.428447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:02.428447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:41:02.428447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:41:02.428447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:41:02.428447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise error May 28 04:41:02.428447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:41:02.428984 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:02.428984 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 28 04:41:02.428984 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 28 04:41:02.428984 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 28 04:41:02.428984 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 28 04:41:02.428984 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 28 04:41:02.428984 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:02.428984 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 04:41:02.428984 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 28 04:41:02.428984 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:02.428984 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:02.428984 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:02.428984 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:02.428984 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:02.428984 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:02.428984 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:41:02.428984 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:41:02.430036 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:41:02.430036 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:41:02.430036 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:41:02.430036 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:41:02.430036 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:41:02.430036 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:41:02.430036 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:41:02.430036 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:41:02.430036 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:41:02.430036 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:41:02.430735 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:41:02.430735 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:02.430735 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:02.430735 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:02.430735 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:02.430735 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:02.430735 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:02.430735 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:41:02.430735 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:41:02.432944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:41:02.432944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:02.433277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-de191904-5377-4bf1-8ed2-1fb52d69d26e tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:41:02.433277 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-de191904-5377-4bf1-8ed2-1fb52d69d26e tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.017231 May 28 04:41:02.433572 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 966/1863] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:41:02 2022] POST /compute/v2.1/servers => generated 1197 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) May 28 04:41:02.441603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-09ff5f86-b866-48f6-9d08-e502f5aa098a tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:02.474278 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-09ff5f86-b866-48f6-9d08-e502f5aa098a tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] 10.222.0.58 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.042797 May 28 04:41:02.476556 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 967/1864] 10.222.0.58 () {58 vars in 1124 bytes} [Sat May 28 04:41:02 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:02.493364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-54a2085d-ea38-4379-93eb-0ce7b89829ce tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:02.512322 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-54a2085d-ea38-4379-93eb-0ce7b89829ce tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021836 May 28 04:41:02.512322 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 968/1865] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:41:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:02.525331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6bf2d948-15c8-4763-be8d-02d197ffb76f tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:02.525331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6bf2d948-15c8-4763-be8d-02d197ffb76f tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:02.627617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-49bb1b79-3928-4940-8c18-b0ab638a236e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:02.644622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6bf2d948-15c8-4763-be8d-02d197ffb76f tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:02.647931 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-49bb1b79-3928-4940-8c18-b0ab638a236e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 200 len: 1313 microversion: 2.1 time: 0.799724 May 28 04:41:02.653477 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6bf2d948-15c8-4763-be8d-02d197ffb76f tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1246 microversion: 2.1 time: 0.142988 May 28 04:41:02.656326 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 969/1866] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:02 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1246 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:02.660017 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 898/1867] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:01 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 1313 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:02.672999 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-86a14c09-1eba-425f-9258-d7ca70ca2fee tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-605891074", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d1810576-acba-46c5-8bf2-968cfbdd599f"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:02.679520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f126ff96-9e41-4b87-9442-95fb660aa6ff tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-86a14c09-1eba-425f-9258-d7ca70ca2fee tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Request method failure captured: May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 1265 May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikafGt6CZ-NQloqPmZklajHUtcnEHokuEFrG_MryQx3LbG73ZzCB8e2AKKUg2y0HR12PLJXaB-vgvROO6VxsiHgT5CplKY-QsUKCBx19TiZxjoueQtgBtQZ2zACjgp_mHBGjtjPgOJgfbMCW58_2U_YOxo7K5sN2FVrA_bOYIRhzQdKc May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 59e5de6fa6624b709373d974bafdbbff May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:41:02.680183 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:41:02.681731 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:41:02.681731 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:02.681731 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 59e5de6fa6624b709373d974bafdbbff May 28 04:41:02.681731 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:02.681731 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerMetadataNegativeTestJSON-2052830768-project May 28 04:41:02.681731 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:41:02.681731 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:41:02.681731 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 411ca2ed8fa940aa9c379719026ca32f May 28 04:41:02.681731 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2052830768-project May 28 04:41:02.681731 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:41:02.682875 n-d-843700-1 devstack@n-api.service[126043]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-605891074", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d1810576-acba-46c5-8bf2-968cfbdd599f"}]}} May 28 04:41:02.682875 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:41:02.683133 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:41:02.683133 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-605891074', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd1810576-acba-46c5-8bf2-968cfbdd599f'}]}}} May 28 04:41:02.683133 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:41:02.683133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:02.683133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:41:02.683133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:41:02.683133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:41:02.683133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:41:02.683133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:41:02.683133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:02.683133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 28 04:41:02.683133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 28 04:41:02.683133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 28 04:41:02.683133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 28 04:41:02.683133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 28 04:41:02.683133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:02.683133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:41:02.685407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:41:02.694220 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:41:02.694220 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:02.694220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-86a14c09-1eba-425f-9258-d7ca70ca2fee tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:41:02.694220 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-86a14c09-1eba-425f-9258-d7ca70ca2fee tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.025730 May 28 04:41:02.694220 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 899/1868] 10.222.0.58 () {60 vars in 1147 bytes} [Sat May 28 04:41:02 2022] POST /compute/v2.1/servers => generated 2221 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) May 28 04:41:02.704277 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f126ff96-9e41-4b87-9442-95fb660aa6ff tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037974 May 28 04:41:02.704277 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 970/1869] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:41:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:02.704695 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2778512f-8fdb-432c-b8ba-ef81309a0124 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:02.704695 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2778512f-8fdb-432c-b8ba-ef81309a0124 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:02.717019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-12107c1f-3b64-4c2a-8294-3ebadde0d379 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:02.717658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-12107c1f-3b64-4c2a-8294-3ebadde0d379 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: 3468acc1-3959-4015-9f93-32d6deae0ac9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:02.718926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2778512f-8fdb-432c-b8ba-ef81309a0124 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:02.719687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2778512f-8fdb-432c-b8ba-ef81309a0124 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:02.720753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2778512f-8fdb-432c-b8ba-ef81309a0124 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:02.721417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2778512f-8fdb-432c-b8ba-ef81309a0124 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:02.731490 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-12107c1f-3b64-4c2a-8294-3ebadde0d379 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] HTTP exception thrown: Instance 3468acc1-3959-4015-9f93-32d6deae0ac9 could not be found. May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-12107c1f-3b64-4c2a-8294-3ebadde0d379 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Request method failure captured: May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/3468acc1-3959-4015-9f93-32d6deae0ac9/metadata/test2 HTTP/1.1 May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikafGt6CZ-NQloqPmZklajHUtcnEHokuEFrG_MryQx3LbG73ZzCB8e2AKKUg2y0HR12PLJXaB-vgvROO6VxsiHgT5CplKY-QsUKCBx19TiZxjoueQtgBtQZ2zACjgp_mHBGjtjPgOJgfbMCW58_2U_YOxo7K5sN2FVrA_bOYIRhzQdKc May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 59e5de6fa6624b709373d974bafdbbff May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 59e5de6fa6624b709373d974bafdbbff May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerMetadataNegativeTestJSON-2052830768-project May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 411ca2ed8fa940aa9c379719026ca32f May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2052830768-project May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 3468acc1-3959-4015-9f93-32d6deae0ac9 could not be found. May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'server_id': '3468acc1-3959-4015-9f93-32d6deae0ac9', 'id': 'test2'} May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3468acc1-3959-4015-9f93-32d6deae0ac9 could not be found. May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3468acc1-3959-4015-9f93-32d6deae0ac9 could not be found. May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:02.734056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:02.739155 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:41:02.739155 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:41:02.739155 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3468acc1-3959-4015-9f93-32d6deae0ac9 could not be found. May 28 04:41:02.739155 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:02.741189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-12107c1f-3b64-4c2a-8294-3ebadde0d379 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Returning 404 to user: Instance 3468acc1-3959-4015-9f93-32d6deae0ac9 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:41:02.742295 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-12107c1f-3b64-4c2a-8294-3ebadde0d379 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "GET /compute/v2.1/servers/3468acc1-3959-4015-9f93-32d6deae0ac9/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.043137 May 28 04:41:02.743899 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 971/1870] 10.222.0.58 () {58 vars in 1280 bytes} [Sat May 28 04:41:02 2022] GET /compute/v2.1/servers/3468acc1-3959-4015-9f93-32d6deae0ac9/metadata/test2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:41:02.749192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bf9c9bf2-f759-4bf6-84cc-c5c624e2d851 tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:02.784543 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bf9c9bf2-f759-4bf6-84cc-c5c624e2d851 tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.039327 May 28 04:41:02.785786 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 972/1871] 10.222.0.58 () {58 vars in 1164 bytes} [Sat May 28 04:41:02 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:02.791429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-daadf0ed-725e-46c7-bc80-23bd12f00186 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:02.792496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-daadf0ed-725e-46c7-bc80-23bd12f00186 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: ca6b84e0-8473-4692-bfa5-e9749726440d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:02.804632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-daadf0ed-725e-46c7-bc80-23bd12f00186 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:02.805984 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-daadf0ed-725e-46c7-bc80-23bd12f00186 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:02.807642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-daadf0ed-725e-46c7-bc80-23bd12f00186 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:02.808878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-daadf0ed-725e-46c7-bc80-23bd12f00186 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:02.840446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-daadf0ed-725e-46c7-bc80-23bd12f00186 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: ca6b84e0-8473-4692-bfa5-e9749726440d] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:41:03.193573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2778512f-8fdb-432c-b8ba-ef81309a0124 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:03.207086 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2778512f-8fdb-432c-b8ba-ef81309a0124 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.516688 May 28 04:41:03.215560 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 900/1872] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:02 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:03.231769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5cb583f1-b672-443e-a25b-bbb9ff70faaf tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:03.253083 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-daadf0ed-725e-46c7-bc80-23bd12f00186 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d" status: 204 len: 0 microversion: 2.1 time: 0.465516 May 28 04:41:03.259249 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 973/1873] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:41:02 2022] DELETE /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:41:03.263477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5ce2e029-ed25-4396-8629-f80a3197c062 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:03.266517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5ce2e029-ed25-4396-8629-f80a3197c062 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: ca6b84e0-8473-4692-bfa5-e9749726440d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:03.283012 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5cb583f1-b672-443e-a25b-bbb9ff70faaf tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.066045 May 28 04:41:03.287679 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 901/1874] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:41:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:03.289351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ce2e029-ed25-4396-8629-f80a3197c062 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:03.292058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ce2e029-ed25-4396-8629-f80a3197c062 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:03.297206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ce2e029-ed25-4396-8629-f80a3197c062 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:03.298897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ce2e029-ed25-4396-8629-f80a3197c062 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:03.313889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e691e3c0-811c-4131-b5f5-318a48a83731 tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:03.388359 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e691e3c0-811c-4131-b5f5-318a48a83731 tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.093410 May 28 04:41:03.389900 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 902/1875] 10.222.0.58 () {58 vars in 1168 bytes} [Sat May 28 04:41:03 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:03.408680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9fc1576d-6ee9-48f8-9577-a5d0a17f38f5 tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:03.431562 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9fc1576d-6ee9-48f8-9577-a5d0a17f38f5 tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.031967 May 28 04:41:03.432752 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 903/1876] 10.222.0.58 () {58 vars in 1160 bytes} [Sat May 28 04:41:03 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:03.449799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-4ac3a24c-8dc6-49fe-b832-9d4eef64395d req-257c67dc-b151-4515-9b6f-d557a2c9ebd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b94a91-20fe-40ac-bd67-2864eef657f6", "tag": "7dbb06ba-323b-4edc-bc6d-380122278f70"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:03.474721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4ac3a24c-8dc6-49fe-b832-9d4eef64395d req-257c67dc-b151-4515-9b6f-d557a2c9ebd9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:03.481129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4ac3a24c-8dc6-49fe-b832-9d4eef64395d req-257c67dc-b151-4515-9b6f-d557a2c9ebd9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:03.515932 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-4ac3a24c-8dc6-49fe-b832-9d4eef64395d req-257c67dc-b151-4515-9b6f-d557a2c9ebd9 service nova] Creating event network-changed:7dbb06ba-323b-4edc-bc6d-380122278f70 for instance 12b94a91-20fe-40ac-bd67-2864eef657f6 on n-h1-843700-1 May 28 04:41:03.536783 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-4ac3a24c-8dc6-49fe-b832-9d4eef64395d req-257c67dc-b151-4515-9b6f-d557a2c9ebd9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102285 May 28 04:41:03.537753 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 904/1877] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:03.552238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a71eb43b-2236-4302-b2b8-40b3993d2d5e tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:03.553319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a71eb43b-2236-4302-b2b8-40b3993d2d5e tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:03.574979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a71eb43b-2236-4302-b2b8-40b3993d2d5e tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:03.579626 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a71eb43b-2236-4302-b2b8-40b3993d2d5e tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:03.580609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a71eb43b-2236-4302-b2b8-40b3993d2d5e tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:03.580920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a71eb43b-2236-4302-b2b8-40b3993d2d5e tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:04.117619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5ce2e029-ed25-4396-8629-f80a3197c062 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ca2ed8fa940aa9c379719026ca32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e5de6fa6624b709373d974bafdbbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:04.133938 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5ce2e029-ed25-4396-8629-f80a3197c062 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d" status: 200 len: 1527 microversion: 2.1 time: 0.870229 May 28 04:41:04.144159 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 974/1878] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:03 2022] GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d => generated 1527 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:41:04.161449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-203a775e-8880-462b-a91c-ab583189a4e1 tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:04.184139 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-203a775e-8880-462b-a91c-ab583189a4e1 tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.048084 May 28 04:41:04.188681 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 975/1879] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:41:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:04.199163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-337385c9-8b65-4fd8-9a59-a547801d4ee2 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:04.200901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-337385c9-8b65-4fd8-9a59-a547801d4ee2 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:04.215539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-337385c9-8b65-4fd8-9a59-a547801d4ee2 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:04.217010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-337385c9-8b65-4fd8-9a59-a547801d4ee2 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:04.218053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-337385c9-8b65-4fd8-9a59-a547801d4ee2 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:04.218665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-337385c9-8b65-4fd8-9a59-a547801d4ee2 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:04.304948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a71eb43b-2236-4302-b2b8-40b3993d2d5e tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:04.332166 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a71eb43b-2236-4302-b2b8-40b3993d2d5e tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1304 microversion: 2.1 time: 0.792410 May 28 04:41:04.343820 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 905/1880] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:03 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1304 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:04.349569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4e610436-0c7c-41b9-b0ac-58488d8998e8 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:04.351811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4e610436-0c7c-41b9-b0ac-58488d8998e8 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:04.359292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e610436-0c7c-41b9-b0ac-58488d8998e8 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:04.360028 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e610436-0c7c-41b9-b0ac-58488d8998e8 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:04.361229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e610436-0c7c-41b9-b0ac-58488d8998e8 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:04.361857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e610436-0c7c-41b9-b0ac-58488d8998e8 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:04.510356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4e610436-0c7c-41b9-b0ac-58488d8998e8 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:04.519338 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4e610436-0c7c-41b9-b0ac-58488d8998e8 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1242 microversion: 2.1 time: 0.174072 May 28 04:41:04.536258 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 906/1881] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:04 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1242 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:04.541724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0483ae95-f3fa-4c6a-aeee-85b5e0b44025 tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:04.615019 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0483ae95-f3fa-4c6a-aeee-85b5e0b44025 tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.077122 May 28 04:41:04.617432 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 907/1882] 10.222.0.58 () {58 vars in 1166 bytes} [Sat May 28 04:41:04 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:04.629203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ecdc3015-b201-4847-871c-df4bb896ff6e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:04.633134 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ecdc3015-b201-4847-871c-df4bb896ff6e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:04.659865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecdc3015-b201-4847-871c-df4bb896ff6e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:04.660439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecdc3015-b201-4847-871c-df4bb896ff6e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:04.661299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecdc3015-b201-4847-871c-df4bb896ff6e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:04.661738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecdc3015-b201-4847-871c-df4bb896ff6e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:05.250503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-337385c9-8b65-4fd8-9a59-a547801d4ee2 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:05.271726 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-337385c9-8b65-4fd8-9a59-a547801d4ee2 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 200 len: 1313 microversion: 2.1 time: 1.078248 May 28 04:41:05.273409 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 976/1883] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:04 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 1313 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:05.319612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7f12df86-e073-4621-9f84-af66591e771c tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:05.355167 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7f12df86-e073-4621-9f84-af66591e771c tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.065706 May 28 04:41:05.360153 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 977/1884] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:41:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:05.395240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2e18a5c5-c3c6-4dc6-88c8-46441a7d562c tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:05.401580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2e18a5c5-c3c6-4dc6-88c8-46441a7d562c tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: ca6b84e0-8473-4692-bfa5-e9749726440d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:05.418297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e18a5c5-c3c6-4dc6-88c8-46441a7d562c tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:05.421244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e18a5c5-c3c6-4dc6-88c8-46441a7d562c tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:05.423740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e18a5c5-c3c6-4dc6-88c8-46441a7d562c tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:05.423740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e18a5c5-c3c6-4dc6-88c8-46441a7d562c tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:05.448108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ecdc3015-b201-4847-871c-df4bb896ff6e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:05.469745 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ecdc3015-b201-4847-871c-df4bb896ff6e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.847649 May 28 04:41:05.479676 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 908/1885] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:04 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:05.482818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2ef3abf6-a6cd-4b92-852c-b3388ade1516 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:05.484335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2ef3abf6-a6cd-4b92-852c-b3388ade1516 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:05.500918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2ef3abf6-a6cd-4b92-852c-b3388ade1516 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:05.507673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2ef3abf6-a6cd-4b92-852c-b3388ade1516 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:05.507673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2ef3abf6-a6cd-4b92-852c-b3388ade1516 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:05.507673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2ef3abf6-a6cd-4b92-852c-b3388ade1516 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:05.878405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2ef3abf6-a6cd-4b92-852c-b3388ade1516 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:05.889825 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2ef3abf6-a6cd-4b92-852c-b3388ade1516 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1304 microversion: 2.1 time: 0.411982 May 28 04:41:05.920143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2e18a5c5-c3c6-4dc6-88c8-46441a7d562c tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ca2ed8fa940aa9c379719026ca32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e5de6fa6624b709373d974bafdbbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:05.920306 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 909/1886] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:05 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1304 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:05.920306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-23143cfc-0e48-4f86-b902-cfdf5121129d tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:05.925430 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2e18a5c5-c3c6-4dc6-88c8-46441a7d562c tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d" status: 200 len: 1527 microversion: 2.1 time: 0.562968 May 28 04:41:05.926475 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 978/1887] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:05 2022] GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d => generated 1527 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:05.933416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-30d44568-95d1-4f8d-8948-9ea3a7453e16 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:05.941862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-30d44568-95d1-4f8d-8948-9ea3a7453e16 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:05.959927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30d44568-95d1-4f8d-8948-9ea3a7453e16 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:05.960946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30d44568-95d1-4f8d-8948-9ea3a7453e16 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:05.961901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30d44568-95d1-4f8d-8948-9ea3a7453e16 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:05.962498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30d44568-95d1-4f8d-8948-9ea3a7453e16 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:05.984727 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-23143cfc-0e48-4f86-b902-cfdf5121129d tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] 10.222.0.58 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.075161 May 28 04:41:05.985809 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 910/1888] 10.222.0.58 () {58 vars in 1143 bytes} [Sat May 28 04:41:05 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:06.002493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-135292c4-001e-4d65-be4b-ab8b57055db8 req-82825618-921b-4e74-b726-44ae44765705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "292a1ab6-21e8-4cf4-a499-c0a65f10f617", "tag": "5f1534ca-86d2-4144-9e14-e51d146c6b8e"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:06.012520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-135292c4-001e-4d65-be4b-ab8b57055db8 req-82825618-921b-4e74-b726-44ae44765705 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:06.014503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-135292c4-001e-4d65-be4b-ab8b57055db8 req-82825618-921b-4e74-b726-44ae44765705 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:06.034748 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-135292c4-001e-4d65-be4b-ab8b57055db8 req-82825618-921b-4e74-b726-44ae44765705 service nova] Creating event network-changed:5f1534ca-86d2-4144-9e14-e51d146c6b8e for instance 292a1ab6-21e8-4cf4-a499-c0a65f10f617 on n-h1-843700-1 May 28 04:41:06.042596 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-135292c4-001e-4d65-be4b-ab8b57055db8 req-82825618-921b-4e74-b726-44ae44765705 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045368 May 28 04:41:06.043331 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 911/1889] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:06.063240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-be2249ef-875e-4b4c-b148-2a6612298612 tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:06.075842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-30d44568-95d1-4f8d-8948-9ea3a7453e16 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:06.083236 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-be2249ef-875e-4b4c-b148-2a6612298612 tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038660 May 28 04:41:06.084316 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 912/1890] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:41:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:06.090728 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-30d44568-95d1-4f8d-8948-9ea3a7453e16 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1316 microversion: 2.1 time: 0.162660 May 28 04:41:06.093120 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 979/1891] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:05 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:06.106717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ba674ac3-43e6-416d-a263-b288e71f5f50 tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:06.140079 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ba674ac3-43e6-416d-a263-b288e71f5f50 tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] 10.222.0.58 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.041332 May 28 04:41:06.141850 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 913/1892] 10.222.0.58 () {58 vars in 1147 bytes} [Sat May 28 04:41:06 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:06.161788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef2e7b46-9e0b-413e-aa0d-a910bceae44f tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:06.179629 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ef2e7b46-9e0b-413e-aa0d-a910bceae44f tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] 10.222.0.58 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.025227 May 28 04:41:06.182221 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 980/1893] 10.222.0.58 () {58 vars in 1139 bytes} [Sat May 28 04:41:06 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:41:06.195576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-57ed64b3-c740-4132-b56c-e4a72ac7c3ae tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:06.207010 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-57ed64b3-c740-4132-b56c-e4a72ac7c3ae tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016271 May 28 04:41:06.207888 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 914/1894] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:41:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:06.222446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d3be1374-083e-45db-be0f-2e16b7a5cd1e tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:06.281201 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d3be1374-083e-45db-be0f-2e16b7a5cd1e tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] 10.222.0.58 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.065250 May 28 04:41:06.283412 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 981/1895] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:41:06 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:06.294296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1882e089-64cc-40e9-8b6b-773982f212f4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:06.295367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1882e089-64cc-40e9-8b6b-773982f212f4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:06.301732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-82f357ed-13ee-48e9-bdb6-fa1db8dac0ff tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:06.307331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1882e089-64cc-40e9-8b6b-773982f212f4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:06.308249 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1882e089-64cc-40e9-8b6b-773982f212f4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:06.309882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1882e089-64cc-40e9-8b6b-773982f212f4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:06.310626 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1882e089-64cc-40e9-8b6b-773982f212f4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:06.332265 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-82f357ed-13ee-48e9-bdb6-fa1db8dac0ff tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034735 May 28 04:41:06.343372 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 982/1896] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:41:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:06.355519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-11d145f7-9b3e-4197-9bbb-8bb7a96effff tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:06.366118 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-11d145f7-9b3e-4197-9bbb-8bb7a96effff tempest-FlavorsV2TestJSON-1576307769 tempest-FlavorsV2TestJSON-1576307769-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020976 May 28 04:41:06.371990 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 983/1897] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:41:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:06.501088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-89d318f0-5843-4e22-b35b-028210025a03 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:06.502917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-89d318f0-5843-4e22-b35b-028210025a03 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:06.517385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89d318f0-5843-4e22-b35b-028210025a03 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:06.528403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89d318f0-5843-4e22-b35b-028210025a03 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:06.528403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89d318f0-5843-4e22-b35b-028210025a03 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:06.528403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89d318f0-5843-4e22-b35b-028210025a03 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:06.633698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1882e089-64cc-40e9-8b6b-773982f212f4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:06.643219 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1882e089-64cc-40e9-8b6b-773982f212f4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 200 len: 1313 microversion: 2.1 time: 0.356993 May 28 04:41:06.650197 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 915/1898] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:06 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:06.722057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-89d318f0-5843-4e22-b35b-028210025a03 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:06.737064 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-89d318f0-5843-4e22-b35b-028210025a03 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.243471 May 28 04:41:06.738631 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 984/1899] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:06 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:06.913198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4b5de34b-0ee8-4560-828d-84d1c8072a57 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:06.914215 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4b5de34b-0ee8-4560-828d-84d1c8072a57 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:06.935388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-04e26644-5834-466f-a845-8ed0943b7dd9 req-c8227af6-5488-4586-8caa-559d153d17ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6b84e0-8473-4692-bfa5-e9749726440d", "name": "network-vif-deleted", "tag": "ee411ea1-7312-4093-a879-b2685b3fff34"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:06.939455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b5de34b-0ee8-4560-828d-84d1c8072a57 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:06.939455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b5de34b-0ee8-4560-828d-84d1c8072a57 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:06.939455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b5de34b-0ee8-4560-828d-84d1c8072a57 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:06.939455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b5de34b-0ee8-4560-828d-84d1c8072a57 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:06.973688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-04e26644-5834-466f-a845-8ed0943b7dd9 req-c8227af6-5488-4586-8caa-559d153d17ec service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:06.974390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-04e26644-5834-466f-a845-8ed0943b7dd9 req-c8227af6-5488-4586-8caa-559d153d17ec service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:07.026553 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-04e26644-5834-466f-a845-8ed0943b7dd9 req-c8227af6-5488-4586-8caa-559d153d17ec service nova] Creating event network-vif-deleted:ee411ea1-7312-4093-a879-b2685b3fff34 for instance ca6b84e0-8473-4692-bfa5-e9749726440d on n-h2-843700-1 May 28 04:41:07.041806 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-04e26644-5834-466f-a845-8ed0943b7dd9 req-c8227af6-5488-4586-8caa-559d153d17ec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111996 May 28 04:41:07.046191 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 985/1900] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:07.071666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-afe9eb84-be06-4a36-ae33-11bf57108ac9 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:07.073700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-afe9eb84-be06-4a36-ae33-11bf57108ac9 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: ca6b84e0-8473-4692-bfa5-e9749726440d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:07.100032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-afe9eb84-be06-4a36-ae33-11bf57108ac9 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:07.100854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-afe9eb84-be06-4a36-ae33-11bf57108ac9 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:07.101902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-afe9eb84-be06-4a36-ae33-11bf57108ac9 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:07.105491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-afe9eb84-be06-4a36-ae33-11bf57108ac9 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:07.327681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-afe9eb84-be06-4a36-ae33-11bf57108ac9 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ca2ed8fa940aa9c379719026ca32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e5de6fa6624b709373d974bafdbbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:07.345088 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-afe9eb84-be06-4a36-ae33-11bf57108ac9 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d" status: 200 len: 1485 microversion: 2.1 time: 0.293983 May 28 04:41:07.350697 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 986/1901] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:07 2022] GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d => generated 1485 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:07.357256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9956f28f-d3e0-4b76-8d72-6082ebcc8fcf tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:07.373342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9956f28f-d3e0-4b76-8d72-6082ebcc8fcf tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:07.395416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9956f28f-d3e0-4b76-8d72-6082ebcc8fcf tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:07.395795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9956f28f-d3e0-4b76-8d72-6082ebcc8fcf tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:07.396646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9956f28f-d3e0-4b76-8d72-6082ebcc8fcf tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:07.397087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9956f28f-d3e0-4b76-8d72-6082ebcc8fcf tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:07.793375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4b5de34b-0ee8-4560-828d-84d1c8072a57 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:07.815447 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4b5de34b-0ee8-4560-828d-84d1c8072a57 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1304 microversion: 2.1 time: 0.912055 May 28 04:41:07.820360 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 916/1902] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:06 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1304 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:07.834752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f0506ea9-d8f7-484b-baf9-1c1dc5821d00 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:07.839575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f0506ea9-d8f7-484b-baf9-1c1dc5821d00 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:07.858080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0506ea9-d8f7-484b-baf9-1c1dc5821d00 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:07.862318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0506ea9-d8f7-484b-baf9-1c1dc5821d00 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:07.863710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0506ea9-d8f7-484b-baf9-1c1dc5821d00 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:07.864730 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0506ea9-d8f7-484b-baf9-1c1dc5821d00 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:07.917398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9956f28f-d3e0-4b76-8d72-6082ebcc8fcf tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:07.921854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:07.955157 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9956f28f-d3e0-4b76-8d72-6082ebcc8fcf tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1304 microversion: 2.1 time: 0.602214 May 28 04:41:07.962529 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 987/1903] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:07 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1304 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:08.007412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9506fbfc-17c6-47c5-9a1d-6c6e8a7dbb31 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:08.008293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9506fbfc-17c6-47c5-9a1d-6c6e8a7dbb31 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:08.037349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9506fbfc-17c6-47c5-9a1d-6c6e8a7dbb31 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:08.039558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9506fbfc-17c6-47c5-9a1d-6c6e8a7dbb31 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:08.043416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9506fbfc-17c6-47c5-9a1d-6c6e8a7dbb31 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:08.045345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9506fbfc-17c6-47c5-9a1d-6c6e8a7dbb31 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:08.680050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9506fbfc-17c6-47c5-9a1d-6c6e8a7dbb31 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:08.694620 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9506fbfc-17c6-47c5-9a1d-6c6e8a7dbb31 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.724396 May 28 04:41:08.697117 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 988/1904] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:07 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:08.710500 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a63fd253-f381-47e6-bffb-ea71d7a6c633 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:08.715584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a63fd253-f381-47e6-bffb-ea71d7a6c633 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] [instance: ca6b84e0-8473-4692-bfa5-e9749726440d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:08.734951 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a63fd253-f381-47e6-bffb-ea71d7a6c633 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:08.735381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a63fd253-f381-47e6-bffb-ea71d7a6c633 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:08.740871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a63fd253-f381-47e6-bffb-ea71d7a6c633 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:08.741391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a63fd253-f381-47e6-bffb-ea71d7a6c633 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:08.783899 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-a63fd253-f381-47e6-bffb-ea71d7a6c633 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] HTTP exception thrown: Instance ca6b84e0-8473-4692-bfa5-e9749726440d could not be found. May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a63fd253-f381-47e6-bffb-ea71d7a6c633 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Request method failure captured: May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d HTTP/1.1 May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikafGt6CZ-NQloqPmZklajHUtcnEHokuEFrG_MryQx3LbG73ZzCB8e2AKKUg2y0HR12PLJXaB-vgvROO6VxsiHgT5CplKY-QsUKCBx19TiZxjoueQtgBtQZ2zACjgp_mHBGjtjPgOJgfbMCW58_2U_YOxo7K5sN2FVrA_bOYIRhzQdKc May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 59e5de6fa6624b709373d974bafdbbff May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59e5de6fa6624b709373d974bafdbbff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 59e5de6fa6624b709373d974bafdbbff May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2052830768 May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerMetadataNegativeTestJSON-2052830768-project May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 411ca2ed8fa940aa9c379719026ca32f May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2052830768-project May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance ca6b84e0-8473-4692-bfa5-e9749726440d could not be found. May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'ca6b84e0-8473-4692-bfa5-e9749726440d'} May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca6b84e0-8473-4692-bfa5-e9749726440d could not be found. May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca6b84e0-8473-4692-bfa5-e9749726440d could not be found. May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:08.788610 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:08.795147 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:08.795147 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:08.795147 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:08.795147 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:08.795147 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:41:08.795147 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:41:08.795147 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca6b84e0-8473-4692-bfa5-e9749726440d could not be found. May 28 04:41:08.795147 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:08.795147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a63fd253-f381-47e6-bffb-ea71d7a6c633 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] Returning 404 to user: Instance ca6b84e0-8473-4692-bfa5-e9749726440d could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:41:08.795147 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a63fd253-f381-47e6-bffb-ea71d7a6c633 tempest-ServerMetadataNegativeTestJSON-2052830768 tempest-ServerMetadataNegativeTestJSON-2052830768-project] 10.222.0.58 "GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d" status: 404 len: 111 microversion: 2.1 time: 0.093995 May 28 04:41:08.808919 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 989/1905] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:08 2022] GET /compute/v2.1/servers/ca6b84e0-8473-4692-bfa5-e9749726440d => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:41:08.835720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7ff95cd6-588c-4ec1-a52b-14f12efc7c8d tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:08.836319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7ff95cd6-588c-4ec1-a52b-14f12efc7c8d tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:08.853045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ff95cd6-588c-4ec1-a52b-14f12efc7c8d tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:08.853586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ff95cd6-588c-4ec1-a52b-14f12efc7c8d tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:08.857401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ff95cd6-588c-4ec1-a52b-14f12efc7c8d tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:08.857908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ff95cd6-588c-4ec1-a52b-14f12efc7c8d tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:09.179974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f0506ea9-d8f7-484b-baf9-1c1dc5821d00 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:09.193632 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f0506ea9-d8f7-484b-baf9-1c1dc5821d00 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 200 len: 1313 microversion: 2.1 time: 1.370258 May 28 04:41:09.196577 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 917/1906] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:07 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 1313 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:09.213884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-74ad5aab-6e1e-4472-a215-65c8578aca27 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:09.214951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-74ad5aab-6e1e-4472-a215-65c8578aca27 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:09.221758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74ad5aab-6e1e-4472-a215-65c8578aca27 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:09.236552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74ad5aab-6e1e-4472-a215-65c8578aca27 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:09.243661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74ad5aab-6e1e-4472-a215-65c8578aca27 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:09.245167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74ad5aab-6e1e-4472-a215-65c8578aca27 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:09.567455 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7ff95cd6-588c-4ec1-a52b-14f12efc7c8d tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:09.586570 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7ff95cd6-588c-4ec1-a52b-14f12efc7c8d tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1304 microversion: 2.1 time: 0.755185 May 28 04:41:09.592142 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 990/1907] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:08 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1304 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:09.611069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-a0941349-f578-4030-88d7-420e42aa38b5 req-134182b4-1f4f-4216-acdc-7d5755837c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2fe6e3-8187-4ba2-b31d-10b4f602b332", "name": "network-vif-unplugged", "status": "completed", "tag": "3031f11b-74bc-424b-8498-fb24d06f2874"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:09.637491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a0941349-f578-4030-88d7-420e42aa38b5 req-134182b4-1f4f-4216-acdc-7d5755837c80 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:09.645166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a0941349-f578-4030-88d7-420e42aa38b5 req-134182b4-1f4f-4216-acdc-7d5755837c80 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:09.678979 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-a0941349-f578-4030-88d7-420e42aa38b5 req-134182b4-1f4f-4216-acdc-7d5755837c80 service nova] Creating event network-vif-unplugged:3031f11b-74bc-424b-8498-fb24d06f2874 for instance ac2fe6e3-8187-4ba2-b31d-10b4f602b332 on n-h2-843700-1 May 28 04:41:09.692897 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-a0941349-f578-4030-88d7-420e42aa38b5 req-134182b4-1f4f-4216-acdc-7d5755837c80 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098846 May 28 04:41:09.694679 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 991/1908] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:09.714020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4e298c5c-4659-4625-9049-6cc582170177 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:09.715327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4e298c5c-4659-4625-9049-6cc582170177 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:09.741497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e298c5c-4659-4625-9049-6cc582170177 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:09.747492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e298c5c-4659-4625-9049-6cc582170177 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:09.748689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e298c5c-4659-4625-9049-6cc582170177 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:09.749472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e298c5c-4659-4625-9049-6cc582170177 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:10.157947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4e298c5c-4659-4625-9049-6cc582170177 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:10.173819 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4e298c5c-4659-4625-9049-6cc582170177 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.464675 May 28 04:41:10.180202 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 992/1909] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:09 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:10.222685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f11d88ff-4eee-4b1e-a7e7-189cde8051a8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:10.223579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f11d88ff-4eee-4b1e-a7e7-189cde8051a8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:10.236849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f11d88ff-4eee-4b1e-a7e7-189cde8051a8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:10.237591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f11d88ff-4eee-4b1e-a7e7-189cde8051a8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:10.240539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f11d88ff-4eee-4b1e-a7e7-189cde8051a8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:10.249241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f11d88ff-4eee-4b1e-a7e7-189cde8051a8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:10.467988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-74ad5aab-6e1e-4472-a215-65c8578aca27 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:10.490633 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-74ad5aab-6e1e-4472-a215-65c8578aca27 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1372 microversion: 2.1 time: 1.282014 May 28 04:41:10.492641 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 918/1910] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:09 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1372 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:10.615353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b4f1dc03-9ddf-4149-aea5-9811144e7e3c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:10.617466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b4f1dc03-9ddf-4149-aea5-9811144e7e3c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:10.647415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b4f1dc03-9ddf-4149-aea5-9811144e7e3c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:10.655112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b4f1dc03-9ddf-4149-aea5-9811144e7e3c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:10.658662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b4f1dc03-9ddf-4149-aea5-9811144e7e3c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:10.660495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b4f1dc03-9ddf-4149-aea5-9811144e7e3c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:11.059742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f11d88ff-4eee-4b1e-a7e7-189cde8051a8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:11.073912 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f11d88ff-4eee-4b1e-a7e7-189cde8051a8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 200 len: 1313 microversion: 2.1 time: 0.853212 May 28 04:41:11.080022 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 993/1911] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:10 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 1313 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:41:11.153358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:11.201029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f464d940-945a-42a0-8e1e-6b8e804cbb55 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:11.202283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f464d940-945a-42a0-8e1e-6b8e804cbb55 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:11.215285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f464d940-945a-42a0-8e1e-6b8e804cbb55 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:11.228971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f464d940-945a-42a0-8e1e-6b8e804cbb55 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:11.235638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f464d940-945a-42a0-8e1e-6b8e804cbb55 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:11.235638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f464d940-945a-42a0-8e1e-6b8e804cbb55 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:11.590951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b4f1dc03-9ddf-4149-aea5-9811144e7e3c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:11.616254 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b4f1dc03-9ddf-4149-aea5-9811144e7e3c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1304 microversion: 2.1 time: 1.008360 May 28 04:41:11.619786 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 919/1912] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:10 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1304 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:11.630461 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-42206f82-ae73-4ad9-b044-08708b4d1856 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:11.631370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-42206f82-ae73-4ad9-b044-08708b4d1856 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:11.673595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=8 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:11.685629 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42206f82-ae73-4ad9-b044-08708b4d1856 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:11.689935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42206f82-ae73-4ad9-b044-08708b4d1856 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:11.691787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42206f82-ae73-4ad9-b044-08708b4d1856 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:11.697512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42206f82-ae73-4ad9-b044-08708b4d1856 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:12.028156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f464d940-945a-42a0-8e1e-6b8e804cbb55 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:12.053056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:12.068491 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f464d940-945a-42a0-8e1e-6b8e804cbb55 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.870749 May 28 04:41:12.074594 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 994/1913] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:11 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:41:12.095013 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-b792325b-1769-4be0-99fe-ec3e2a4615f5 req-2ef872f0-41f6-434c-bb52-b6eb6cd1b109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b94a91-20fe-40ac-bd67-2864eef657f6", "name": "network-vif-plugged", "status": "completed", "tag": "7dbb06ba-323b-4edc-bc6d-380122278f70"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:12.122705 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b792325b-1769-4be0-99fe-ec3e2a4615f5 req-2ef872f0-41f6-434c-bb52-b6eb6cd1b109 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:12.124679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b792325b-1769-4be0-99fe-ec3e2a4615f5 req-2ef872f0-41f6-434c-bb52-b6eb6cd1b109 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:12.158616 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-b792325b-1769-4be0-99fe-ec3e2a4615f5 req-2ef872f0-41f6-434c-bb52-b6eb6cd1b109 service nova] Creating event network-vif-plugged:7dbb06ba-323b-4edc-bc6d-380122278f70 for instance 12b94a91-20fe-40ac-bd67-2864eef657f6 on n-h1-843700-1 May 28 04:41:12.171983 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-b792325b-1769-4be0-99fe-ec3e2a4615f5 req-2ef872f0-41f6-434c-bb52-b6eb6cd1b109 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093327 May 28 04:41:12.173601 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 995/1914] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:12.179289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bdc3ac16-5495-47c5-9665-b5f052888669 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:12.180232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bdc3ac16-5495-47c5-9665-b5f052888669 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:12.188719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdc3ac16-5495-47c5-9665-b5f052888669 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:12.188719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdc3ac16-5495-47c5-9665-b5f052888669 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:12.200680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdc3ac16-5495-47c5-9665-b5f052888669 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:12.201670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdc3ac16-5495-47c5-9665-b5f052888669 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:12.649159 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:13.574086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bdc3ac16-5495-47c5-9665-b5f052888669 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:13.583903 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bdc3ac16-5495-47c5-9665-b5f052888669 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 200 len: 1313 microversion: 2.1 time: 1.408879 May 28 04:41:13.587624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-42206f82-ae73-4ad9-b044-08708b4d1856 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:13.591239 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 996/1915] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:12 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 1313 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:13.606595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-0bc224ec-aa11-468f-93b9-94cd42d16b1a req-a6ab03fa-ad38-4d31-8ac1-3dcddc7927a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2fe6e3-8187-4ba2-b31d-10b4f602b332", "tag": "3031f11b-74bc-424b-8498-fb24d06f2874"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:13.608496 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-42206f82-ae73-4ad9-b044-08708b4d1856 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1372 microversion: 2.1 time: 1.985865 May 28 04:41:13.627640 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 920/1916] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:11 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1372 bytes in 2007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:13.638510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:13.646483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-0bc224ec-aa11-468f-93b9-94cd42d16b1a req-a6ab03fa-ad38-4d31-8ac1-3dcddc7927a7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:13.649529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-0bc224ec-aa11-468f-93b9-94cd42d16b1a req-a6ab03fa-ad38-4d31-8ac1-3dcddc7927a7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:13.670321 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b0c9e9fd-ac65-4751-9b6d-754bbe0699f6 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:13.672430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b0c9e9fd-ac65-4751-9b6d-754bbe0699f6 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:13.707245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0c9e9fd-ac65-4751-9b6d-754bbe0699f6 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:13.709282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0c9e9fd-ac65-4751-9b6d-754bbe0699f6 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:13.710358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0c9e9fd-ac65-4751-9b6d-754bbe0699f6 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:13.712177 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-0bc224ec-aa11-468f-93b9-94cd42d16b1a req-a6ab03fa-ad38-4d31-8ac1-3dcddc7927a7 service nova] Creating event network-changed:3031f11b-74bc-424b-8498-fb24d06f2874 for instance ac2fe6e3-8187-4ba2-b31d-10b4f602b332 on n-h2-843700-1 May 28 04:41:13.712695 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0c9e9fd-ac65-4751-9b6d-754bbe0699f6 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:13.731410 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-0bc224ec-aa11-468f-93b9-94cd42d16b1a req-a6ab03fa-ad38-4d31-8ac1-3dcddc7927a7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137520 May 28 04:41:13.741736 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 997/1917] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:14.452292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a13b7d21-5813-44c6-b7dd-36c63d2d3784 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Action: 'create', calling method: .version_select at 0x7f770160e310>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpTMIsibHSvqwkytQuBiF3fPtDaTZs+zyl4myLlbXjE+NttE0Pu569MC8IYKQb/m6W/kbLWWbxVNGwysyAS1mNZkAjJCEQZri8w0lzkjYNnYlUh0RxDm2n2ynNXEQqo8A=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:14.475001 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-a13b7d21-5813-44c6-b7dd-36c63d2d3784 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a13b7d21-5813-44c6-b7dd-36c63d2d3784 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Request method failure captured: May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 257 May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikafofBmrVLx1WtN6yHzu4eqWHK2hoDTcbL0bo7ZPcyQ72au1Z-jTCCx-GU3aaxFQU4hDgXMvd6vMdygr9SsAb1bYYT0kaJkbxceE7_CzfQlEnzJRSqnaLKB2PgC98AYAVgNO4KN_BHk32YXYbri1nygJa3CmnGN1Pgn6HER5xyy8e84 May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 45031670bfca4abc8817162973c75ea1 May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_45031670bfca4abc8817162973c75ea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/45031670bfca4abc8817162973c75ea1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45031670bfca4abc8817162973c75ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45031670bfca4abc8817162973c75ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 45031670bfca4abc8817162973c75ea1 May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-KeyPairsNegativeTestJSON-1214004894-project May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 4371c46e0ecd42f69cb862e133ff922e May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1214004894-project May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpTMIsibHSvqwkytQuBiF3fPtDaTZs+zyl4myLlbXjE+NttE0Pu569MC8IYKQb/m6W/kbLWWbxVNGwysyAS1mNZkAjJCEQZri8w0lzkjYNnYlUh0RxDm2n2ynNXEQqo8A=="}} May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: exception: Keypair data is invalid: Keypair name contains unsafe characters May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpTMIsibHSvqwkytQuBiF3fPtDaTZs+zyl4myLlbXjE+NttE0Pu569MC8IYKQb/m6W/kbLWWbxVNGwysyAS1mNZkAjJCEQZri8w0lzkjYNnYlUh0RxDm2n2ynNXEQqo8A=='}}} May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:41:14.496626 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters May 28 04:41:14.501970 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:41:14.511636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a13b7d21-5813-44c6-b7dd-36c63d2d3784 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:41:14.518538 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a13b7d21-5813-44c6-b7dd-36c63d2d3784 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.771470 May 28 04:41:14.526444 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 998/1918] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:41:13 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 784 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:41:14.545817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-264b3e01-1c29-4a93-95c3-ffdca6fbc3c5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:14.550140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-264b3e01-1c29-4a93-95c3-ffdca6fbc3c5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:14.572982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-264b3e01-1c29-4a93-95c3-ffdca6fbc3c5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:14.586056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-264b3e01-1c29-4a93-95c3-ffdca6fbc3c5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:14.588461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-264b3e01-1c29-4a93-95c3-ffdca6fbc3c5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:14.589200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-264b3e01-1c29-4a93-95c3-ffdca6fbc3c5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:15.033772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b0c9e9fd-ac65-4751-9b6d-754bbe0699f6 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:15.040087 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b0c9e9fd-ac65-4751-9b6d-754bbe0699f6 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1304 microversion: 2.1 time: 1.399458 May 28 04:41:15.043792 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 921/1919] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:13 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1304 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:15.053885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c4e554c6-b690-4cc1-a991-2e821b8d5e98 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Action: 'create', calling method: .version_select at 0x7f7707461b80>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1727956320", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:15.096111 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-c4e554c6-b690-4cc1-a991-2e821b8d5e98 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Getting quotas for project 45031670bfca4abc8817162973c75ea1. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:41:15.104816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-c4e554c6-b690-4cc1-a991-2e821b8d5e98 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Getting quotas for user 4371c46e0ecd42f69cb862e133ff922e and project 45031670bfca4abc8817162973c75ea1. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:41:15.150082 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-c4e554c6-b690-4cc1-a991-2e821b8d5e98 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c4e554c6-b690-4cc1-a991-2e821b8d5e98 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Request method failure captured: May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 2167 May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikafofBmrVLx1WtN6yHzu4eqWHK2hoDTcbL0bo7ZPcyQ72au1Z-jTCCx-GU3aaxFQU4hDgXMvd6vMdygr9SsAb1bYYT0kaJkbxceE7_CzfQlEnzJRSqnaLKB2PgC98AYAVgNO4KN_BHk32YXYbri1nygJa3CmnGN1Pgn6HER5xyy8e84 May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 45031670bfca4abc8817162973c75ea1 May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_45031670bfca4abc8817162973c75ea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/45031670bfca4abc8817162973c75ea1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45031670bfca4abc8817162973c75ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45031670bfca4abc8817162973c75ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 45031670bfca4abc8817162973c75ea1 May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-KeyPairsNegativeTestJSON-1214004894-project May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 4371c46e0ecd42f69cb862e133ff922e May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1214004894-project May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1727956320", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:41:15.169289 n-d-843700-1 devstack@n-api.service[126043]: exception: Keypair data is invalid: failed to generate fingerprint May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1727956320', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:41:15.173814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c4e554c6-b690-4cc1-a991-2e821b8d5e98 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:41:15.177625 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c4e554c6-b690-4cc1-a991-2e821b8d5e98 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.126386 May 28 04:41:15.181867 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 922/1920] 10.222.0.58 () {60 vars in 1159 bytes} [Sat May 28 04:41:15 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 04:41:15.195597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-38009141-8898-470e-8710-e1b9f549002b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:15.200478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-38009141-8898-470e-8710-e1b9f549002b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:15.209500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-38009141-8898-470e-8710-e1b9f549002b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:15.210245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-38009141-8898-470e-8710-e1b9f549002b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:15.212049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-38009141-8898-470e-8710-e1b9f549002b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:15.212786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-38009141-8898-470e-8710-e1b9f549002b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:15.576214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-264b3e01-1c29-4a93-95c3-ffdca6fbc3c5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:15.585676 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-264b3e01-1c29-4a93-95c3-ffdca6fbc3c5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 1.057703 May 28 04:41:15.587382 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 999/1921] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:14 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:15.598245 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fec04746-7126-4d9a-9dc5-b8f9fda1e658 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:15.602117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fec04746-7126-4d9a-9dc5-b8f9fda1e658 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:15.617248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fec04746-7126-4d9a-9dc5-b8f9fda1e658 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:15.622464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fec04746-7126-4d9a-9dc5-b8f9fda1e658 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:15.623681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fec04746-7126-4d9a-9dc5-b8f9fda1e658 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:15.624362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fec04746-7126-4d9a-9dc5-b8f9fda1e658 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:16.003530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-38009141-8898-470e-8710-e1b9f549002b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:16.017633 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-38009141-8898-470e-8710-e1b9f549002b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 200 len: 1313 microversion: 2.1 time: 0.834553 May 28 04:41:16.018261 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 923/1922] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:15 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 1313 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:16.038287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fad75aa5-e8ed-4df7-8a71-06d3c1354268 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Action: 'create', calling method: .version_select at 0x7f7707461b80>, body: {"keypair": {"name": "tempest-keypair-1215286909", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYN6PyT3lHGdmxiTFN2I+TSdiKjaNWxmLsaLlxE0bqqkP/bAKGPL0ubIamOkkEErH3Q2SciroVcenmXuHNgQDjhemj1iDLIjqUr/6UYs/8BUdsb5utfFs+DKVpDH4AQtQ=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:16.075674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-fad75aa5-e8ed-4df7-8a71-06d3c1354268 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Getting quotas for project 45031670bfca4abc8817162973c75ea1. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:41:16.107498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-fad75aa5-e8ed-4df7-8a71-06d3c1354268 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Getting quotas for user 4371c46e0ecd42f69cb862e133ff922e and project 45031670bfca4abc8817162973c75ea1. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:41:16.205143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fec04746-7126-4d9a-9dc5-b8f9fda1e658 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:16.215642 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fec04746-7126-4d9a-9dc5-b8f9fda1e658 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1372 microversion: 2.1 time: 0.625768 May 28 04:41:16.218961 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1000/1923] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:15 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1372 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:16.236643 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fad75aa5-e8ed-4df7-8a71-06d3c1354268 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.207798 May 28 04:41:16.243516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6377423d-414d-4348-a901-4ae18350669a tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:16.244975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6377423d-414d-4348-a901-4ae18350669a tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:16.247013 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 924/1924] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:41:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:16.253018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dc80d632-a40b-4c40-9bee-98d68373998e tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Action: 'create', calling method: .version_select at 0x7f7707466820>, body: {"keypair": {"name": "tempest-keypair-1215286909", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsCWMIg2ieZnfYaYkorZQRKLgAI3R4l4ynQRl8kBHp6CtBSQBlXSmbJ/4AZMyPQpvcozAqgdgW9Y6tyeKDXedlOJm1eW2fLZxzeVNq/tBwlR/JVxEAyoG1ZetpIwZoKQA=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:16.274938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6377423d-414d-4348-a901-4ae18350669a tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:16.275931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6377423d-414d-4348-a901-4ae18350669a tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:16.277751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6377423d-414d-4348-a901-4ae18350669a tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:16.279931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6377423d-414d-4348-a901-4ae18350669a tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:16.308145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-dc80d632-a40b-4c40-9bee-98d68373998e tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Getting quotas for project 45031670bfca4abc8817162973c75ea1. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:41:16.316465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-dc80d632-a40b-4c40-9bee-98d68373998e tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Getting quotas for user 4371c46e0ecd42f69cb862e133ff922e and project 45031670bfca4abc8817162973c75ea1. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:41:16.346100 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:16.397791 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-dc80d632-a40b-4c40-9bee-98d68373998e tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] HTTP exception thrown: Key pair 'tempest-keypair-1215286909' already exists. May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dc80d632-a40b-4c40-9bee-98d68373998e tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Request method failure captured: May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 273 May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikafofBmrVLx1WtN6yHzu4eqWHK2hoDTcbL0bo7ZPcyQ72au1Z-jTCCx-GU3aaxFQU4hDgXMvd6vMdygr9SsAb1bYYT0kaJkbxceE7_CzfQlEnzJRSqnaLKB2PgC98AYAVgNO4KN_BHk32YXYbri1nygJa3CmnGN1Pgn6HER5xyy8e84 May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 45031670bfca4abc8817162973c75ea1 May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_45031670bfca4abc8817162973c75ea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/45031670bfca4abc8817162973c75ea1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45031670bfca4abc8817162973c75ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45031670bfca4abc8817162973c75ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 45031670bfca4abc8817162973c75ea1 May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-KeyPairsNegativeTestJSON-1214004894-project May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 4371c46e0ecd42f69cb862e133ff922e May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1214004894-project May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: {"keypair": {"name": "tempest-keypair-1215286909", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsCWMIg2ieZnfYaYkorZQRKLgAI3R4l4ynQRl8kBHp6CtBSQBlXSmbJ/4AZMyPQpvcozAqgdgW9Y6tyeKDXedlOJm1eW2fLZxzeVNq/tBwlR/JVxEAyoG1ZetpIwZoKQA=="}} May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: exception: Key pair 'tempest-keypair-1215286909' already exists. May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1215286909', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsCWMIg2ieZnfYaYkorZQRKLgAI3R4l4ynQRl8kBHp6CtBSQBlXSmbJ/4AZMyPQpvcozAqgdgW9Y6tyeKDXedlOJm1eW2fLZxzeVNq/tBwlR/JVxEAyoG1ZetpIwZoKQA=='}}} May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = self._query(query) May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi conn.query(q) May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result.read() May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '4371c46e0ecd42f69cb862e133ff922e-tempest-keypair-1215286909' for key 'key_pairs.uniq_key_pairs0user_id0name'") May 28 04:41:16.442027 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi kp.save(context.session) May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi session.flush() May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._flush(objects) May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi compat.raise_( May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi flush_context.execute() May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi rec.execute(self) May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = self._query(query) May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi conn.query(q) May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result.read() May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 28 04:41:16.447670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '4371c46e0ecd42f69cb862e133ff922e-tempest-keypair-1215286909' for key 'key_pairs.uniq_key_pairs0user_id0name'") May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 28, 4, 41, 16, 345373), 'updated_at': None, 'name': 'tempest-keypair-1215286909', 'user_id': '4371c46e0ecd42f69cb862e133ff922e', 'fingerprint': '52:b9:5c:9b:b5:5c:7c:26:2c:41:a6:30:3a:33:e6:78', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsCWMIg2ieZnfYaYkorZQRKLgAI3R4l4ynQRl8kBHp6CtBSQBlXSmbJ/4AZMyPQpvcozAqgdgW9Y6tyeKDXedlOJm1eW2fLZxzeVNq/tBwlR/JVxEAyoG1ZetpIwZoKQA==', 'type': 'ssh'}] May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi keypair.create() May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._create() May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1215286909' already exists. May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) May 28 04:41:16.454295 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1215286909' already exists. May 28 04:41:16.469536 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.469536 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:16.469536 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.469536 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:16.469536 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:16.469536 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:16.469536 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:41:16.469536 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:41:16.469536 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1215286909' already exists. May 28 04:41:16.469536 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.469536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dc80d632-a40b-4c40-9bee-98d68373998e tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Returning 409 to user: Key pair 'tempest-keypair-1215286909' already exists. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:41:16.469536 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dc80d632-a40b-4c40-9bee-98d68373998e tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.210036 May 28 04:41:16.469536 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 925/1925] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:41:16 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 211 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 04:41:16.479046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-1cb7ea71-4605-4ef8-b97c-0c74b3fcb301 req-05c452d8-0c7c-4c9f-aa6a-1df1f84166c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f4e280f-6de0-467b-b4ac-c13f9e780963", "tag": "6d445514-75cc-4831-8830-2257b5e25b63"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:16.506355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1cb7ea71-4605-4ef8-b97c-0c74b3fcb301 req-05c452d8-0c7c-4c9f-aa6a-1df1f84166c3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:16.507315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1cb7ea71-4605-4ef8-b97c-0c74b3fcb301 req-05c452d8-0c7c-4c9f-aa6a-1df1f84166c3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:16.527834 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-1cb7ea71-4605-4ef8-b97c-0c74b3fcb301 req-05c452d8-0c7c-4c9f-aa6a-1df1f84166c3 service nova] Creating event network-changed:6d445514-75cc-4831-8830-2257b5e25b63 for instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 on n-h2-843700-1 May 28 04:41:16.528617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6377423d-414d-4348-a901-4ae18350669a tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:16.560485 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6377423d-414d-4348-a901-4ae18350669a tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1304 microversion: 2.1 time: 0.325639 May 28 04:41:16.572745 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-1cb7ea71-4605-4ef8-b97c-0c74b3fcb301 req-05c452d8-0c7c-4c9f-aa6a-1df1f84166c3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102996 May 28 04:41:16.572745 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 926/1927] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:16.574117 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1001/1926] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:16 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1304 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:16.581815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d2f9f3b9-17b2-44c9-98c4-6173dfaf1737 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Calling method '.version_select at 0x7f770748bc10>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:16.604840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9f39ea46-b433-442a-a24c-90031ec31180 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:16.605978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9f39ea46-b433-442a-a24c-90031ec31180 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:16.619733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f39ea46-b433-442a-a24c-90031ec31180 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:16.621029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f39ea46-b433-442a-a24c-90031ec31180 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:16.622213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f39ea46-b433-442a-a24c-90031ec31180 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:16.622866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f39ea46-b433-442a-a24c-90031ec31180 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:16.776720 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d2f9f3b9-17b2-44c9-98c4-6173dfaf1737 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1215286909" status: 202 len: 0 microversion: 2.1 time: 0.205657 May 28 04:41:16.777322 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 927/1928] 10.222.0.58 () {58 vars in 1220 bytes} [Sat May 28 04:41:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1215286909 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:41:16.794781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3e3179c5-e9e5-4ad1-ad59-b7a3eaa7f81f tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Action: 'create', calling method: .version_select at 0x7f7701154b80>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHF8oiJl8B5kbNy/I4II7DJC06+34yPs24E8nTOtxy/RyxU26iPe25RIss/reomQwnqyc1YOAJbuvWv4bIjDtcjjo02ijpupEUG7B53x8lzT9p3tnyWyCuYIkyH72Uwcig=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3e3179c5-e9e5-4ad1-ad59-b7a3eaa7f81f tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Request method failure captured: May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 247 May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikafofBmrVLx1WtN6yHzu4eqWHK2hoDTcbL0bo7ZPcyQ72au1Z-jTCCx-GU3aaxFQU4hDgXMvd6vMdygr9SsAb1bYYT0kaJkbxceE7_CzfQlEnzJRSqnaLKB2PgC98AYAVgNO4KN_BHk32YXYbri1nygJa3CmnGN1Pgn6HER5xyy8e84 May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 45031670bfca4abc8817162973c75ea1 May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_45031670bfca4abc8817162973c75ea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/45031670bfca4abc8817162973c75ea1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45031670bfca4abc8817162973c75ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45031670bfca4abc8817162973c75ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 45031670bfca4abc8817162973c75ea1 May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-KeyPairsNegativeTestJSON-1214004894-project May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 4371c46e0ecd42f69cb862e133ff922e May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1214004894-project May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHF8oiJl8B5kbNy/I4II7DJC06+34yPs24E8nTOtxy/RyxU26iPe25RIss/reomQwnqyc1YOAJbuvWv4bIjDtcjjo02ijpupEUG7B53x8lzT9p3tnyWyCuYIkyH72Uwcig=="}} May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute name. Value: . '' is too short May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHF8oiJl8B5kbNy/I4II7DJC06+34yPs24E8nTOtxy/RyxU26iPe25RIss/reomQwnqyc1YOAJbuvWv4bIjDtcjjo02ijpupEUG7B53x8lzT9p3tnyWyCuYIkyH72Uwcig=='}}} May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['keypair']: May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi '' May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:41:16.800672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:41:16.811915 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:41:16.811915 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:41:16.811915 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:41:16.811915 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:41:16.811915 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 28 04:41:16.811915 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.811915 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:16.811915 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.811915 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:16.811915 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:16.811915 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:16.811915 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:41:16.811915 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:41:16.811915 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 28 04:41:16.811915 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.811915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3e3179c5-e9e5-4ad1-ad59-b7a3eaa7f81f tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:41:16.811915 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3e3179c5-e9e5-4ad1-ad59-b7a3eaa7f81f tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.016711 May 28 04:41:16.811915 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 928/1929] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:41:16 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 04:41:16.824656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-87c7a53f-5f06-4aee-9fbc-d5715475d66c tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Action: 'create', calling method: .version_select at 0x7f7701157f70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-337981334", "public_key": " "}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:16.890318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-87c7a53f-5f06-4aee-9fbc-d5715475d66c tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Getting quotas for project 45031670bfca4abc8817162973c75ea1. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:41:16.911199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-87c7a53f-5f06-4aee-9fbc-d5715475d66c tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Getting quotas for user 4371c46e0ecd42f69cb862e133ff922e and project 45031670bfca4abc8817162973c75ea1. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:41:16.962785 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-87c7a53f-5f06-4aee-9fbc-d5715475d66c tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-87c7a53f-5f06-4aee-9fbc-d5715475d66c tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Request method failure captured: May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 94 May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikafofBmrVLx1WtN6yHzu4eqWHK2hoDTcbL0bo7ZPcyQ72au1Z-jTCCx-GU3aaxFQU4hDgXMvd6vMdygr9SsAb1bYYT0kaJkbxceE7_CzfQlEnzJRSqnaLKB2PgC98AYAVgNO4KN_BHk32YXYbri1nygJa3CmnGN1Pgn6HER5xyy8e84 May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 45031670bfca4abc8817162973c75ea1 May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_45031670bfca4abc8817162973c75ea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/45031670bfca4abc8817162973c75ea1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45031670bfca4abc8817162973c75ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45031670bfca4abc8817162973c75ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 45031670bfca4abc8817162973c75ea1 May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-KeyPairsNegativeTestJSON-1214004894-project May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 4371c46e0ecd42f69cb862e133ff922e May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1214004894-project May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-337981334", "public_key": " "}} May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: exception: Keypair data is invalid: failed to generate fingerprint May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-337981334', 'public_key': ' '}}} May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:16.969875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-87c7a53f-5f06-4aee-9fbc-d5715475d66c tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-87c7a53f-5f06-4aee-9fbc-d5715475d66c tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.157039 May 28 04:41:16.977049 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 929/1930] 10.222.0.58 () {60 vars in 1157 bytes} [Sat May 28 04:41:16 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 04:41:17.002955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d6da16f7-44c3-4ecc-a31b-28cb377a6f6c tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Action: 'create', calling method: .version_select at 0x7f7701154310>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5PtPe3zLOGEYRFD60Xi16/Q06eEwmCDwo0isOtZQXoPf29Q7XVFmBDbousp9Qlo76EecHQ4fX5MuCQ62qqEmcNI2vPwca+6KiJuQIXqjH7uX9T4vl1Zyq9UHzP/Cyg+w=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d6da16f7-44c3-4ecc-a31b-28cb377a6f6c tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Request method failure captured: May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 507 May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikafofBmrVLx1WtN6yHzu4eqWHK2hoDTcbL0bo7ZPcyQ72au1Z-jTCCx-GU3aaxFQU4hDgXMvd6vMdygr9SsAb1bYYT0kaJkbxceE7_CzfQlEnzJRSqnaLKB2PgC98AYAVgNO4KN_BHk32YXYbri1nygJa3CmnGN1Pgn6HER5xyy8e84 May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 45031670bfca4abc8817162973c75ea1 May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_45031670bfca4abc8817162973c75ea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/45031670bfca4abc8817162973c75ea1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45031670bfca4abc8817162973c75ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45031670bfca4abc8817162973c75ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 45031670bfca4abc8817162973c75ea1 May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-KeyPairsNegativeTestJSON-1214004894-project May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 4371c46e0ecd42f69cb862e133ff922e May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1214004894-project May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5PtPe3zLOGEYRFD60Xi16/Q06eEwmCDwo0isOtZQXoPf29Q7XVFmBDbousp9Qlo76EecHQ4fX5MuCQ62qqEmcNI2vPwca+6KiJuQIXqjH7uX9T4vl1Zyq9UHzP/Cyg+w=="}} May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5PtPe3zLOGEYRFD60Xi16/Q06eEwmCDwo0isOtZQXoPf29Q7XVFmBDbousp9Qlo76EecHQ4fX5MuCQ62qqEmcNI2vPwca+6KiJuQIXqjH7uX9T4vl1Zyq9UHzP/Cyg+w=='}}} May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['keypair']: May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' May 28 04:41:17.005739 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 28 04:41:17.010420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:17.013774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d6da16f7-44c3-4ecc-a31b-28cb377a6f6c tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:41:17.014966 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d6da16f7-44c3-4ecc-a31b-28cb377a6f6c tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.025916 May 28 04:41:17.015858 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 930/1931] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:41:16 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:41:17.025205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ff97995b-87b4-49f0-b574-32fcf8a1f6a9 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Action: 'create', calling method: .version_select at 0x7f7707466700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1221821023", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:17.038883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9f39ea46-b433-442a-a24c-90031ec31180 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:17.046177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-ff97995b-87b4-49f0-b574-32fcf8a1f6a9 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Getting quotas for project 45031670bfca4abc8817162973c75ea1. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:41:17.050202 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9f39ea46-b433-442a-a24c-90031ec31180 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.450323 May 28 04:41:17.050798 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1002/1932] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:16 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:41:17.053999 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-ff97995b-87b4-49f0-b574-32fcf8a1f6a9 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Getting quotas for user 4371c46e0ecd42f69cb862e133ff922e and project 45031670bfca4abc8817162973c75ea1. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:41:17.060847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8d2d98e7-7fee-4f59-8b28-69531949fafe tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:17.067651 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8d2d98e7-7fee-4f59-8b28-69531949fafe tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:17.073023 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-ff97995b-87b4-49f0-b574-32fcf8a1f6a9 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ff97995b-87b4-49f0-b574-32fcf8a1f6a9 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Request method failure captured: May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 118 May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikafofBmrVLx1WtN6yHzu4eqWHK2hoDTcbL0bo7ZPcyQ72au1Z-jTCCx-GU3aaxFQU4hDgXMvd6vMdygr9SsAb1bYYT0kaJkbxceE7_CzfQlEnzJRSqnaLKB2PgC98AYAVgNO4KN_BHk32YXYbri1nygJa3CmnGN1Pgn6HER5xyy8e84 May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 45031670bfca4abc8817162973c75ea1 May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_45031670bfca4abc8817162973c75ea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/45031670bfca4abc8817162973c75ea1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45031670bfca4abc8817162973c75ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45031670bfca4abc8817162973c75ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 45031670bfca4abc8817162973c75ea1 May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-KeyPairsNegativeTestJSON-1214004894-project May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 4371c46e0ecd42f69cb862e133ff922e May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1214004894-project May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1221821023", "public_key": "ssh-rsa JUNK nova@ubuntu"}} May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: exception: Keypair data is invalid: failed to generate fingerprint May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1221821023', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ValueError: Invalid data May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 28 04:41:17.075582 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ff97995b-87b4-49f0-b574-32fcf8a1f6a9 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:41:17.086652 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ff97995b-87b4-49f0-b574-32fcf8a1f6a9 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.059818 May 28 04:41:17.089934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d2d98e7-7fee-4f59-8b28-69531949fafe tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:17.090040 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 931/1933] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:41:17 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 04:41:17.090867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d2d98e7-7fee-4f59-8b28-69531949fafe tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:17.091767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d2d98e7-7fee-4f59-8b28-69531949fafe tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:17.092216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d2d98e7-7fee-4f59-8b28-69531949fafe tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:17.102474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a65a62d9-a368-415d-be12-876e4af52044 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Calling method '.version_select at 0x7f7707400550>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:17.161093 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-a65a62d9-a368-415d-be12-876e4af52044 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1719601153 not found for user 4371c46e0ecd42f69cb862e133ff922e May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a65a62d9-a368-415d-be12-876e4af52044 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Request method failure captured: May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1719601153 HTTP/1.1 May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikafofBmrVLx1WtN6yHzu4eqWHK2hoDTcbL0bo7ZPcyQ72au1Z-jTCCx-GU3aaxFQU4hDgXMvd6vMdygr9SsAb1bYYT0kaJkbxceE7_CzfQlEnzJRSqnaLKB2PgC98AYAVgNO4KN_BHk32YXYbri1nygJa3CmnGN1Pgn6HER5xyy8e84 May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 45031670bfca4abc8817162973c75ea1 May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_45031670bfca4abc8817162973c75ea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/45031670bfca4abc8817162973c75ea1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45031670bfca4abc8817162973c75ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45031670bfca4abc8817162973c75ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 45031670bfca4abc8817162973c75ea1 May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1214004894 May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-KeyPairsNegativeTestJSON-1214004894-project May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 4371c46e0ecd42f69cb862e133ff922e May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1214004894-project May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: exception: Keypair tempest-keypair-non-existent-1719601153 not found for user 4371c46e0ecd42f69cb862e133ff922e May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'tempest-keypair-non-existent-1719601153'} May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1719601153 not found for user 4371c46e0ecd42f69cb862e133ff922e May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:17.163303 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req, id) May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1719601153 not found for user 4371c46e0ecd42f69cb862e133ff922e May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1719601153 not found for user 4371c46e0ecd42f69cb862e133ff922e May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a65a62d9-a368-415d-be12-876e4af52044 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1719601153 not found for user 4371c46e0ecd42f69cb862e133ff922e {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a65a62d9-a368-415d-be12-876e4af52044 tempest-KeyPairsNegativeTestJSON-1214004894 tempest-KeyPairsNegativeTestJSON-1214004894-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1719601153" status: 404 len: 145 microversion: 2.1 time: 0.075939 May 28 04:41:17.170371 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 932/1934] 10.222.0.58 () {58 vars in 1259 bytes} [Sat May 28 04:41:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1719601153 => generated 145 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:41:17.237537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-43a8a8f3-6000-4172-aec7-8082daa513a7 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:17.238276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-43a8a8f3-6000-4172-aec7-8082daa513a7 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:17.258682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43a8a8f3-6000-4172-aec7-8082daa513a7 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:17.259185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43a8a8f3-6000-4172-aec7-8082daa513a7 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:17.266595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43a8a8f3-6000-4172-aec7-8082daa513a7 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:17.267937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43a8a8f3-6000-4172-aec7-8082daa513a7 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:17.676040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8d2d98e7-7fee-4f59-8b28-69531949fafe tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:17.682773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-43a8a8f3-6000-4172-aec7-8082daa513a7 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:17.689231 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8d2d98e7-7fee-4f59-8b28-69531949fafe tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 200 len: 1313 microversion: 2.1 time: 0.635551 May 28 04:41:17.692963 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-43a8a8f3-6000-4172-aec7-8082daa513a7 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1372 microversion: 2.1 time: 0.461684 May 28 04:41:17.701443 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1003/1935] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:17 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 1313 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:17.713383 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 933/1936] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:17 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1372 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:17.719202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2ffcafdc-21e1-4ff2-b69f-27bc93a8435b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:17.720069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2ffcafdc-21e1-4ff2-b69f-27bc93a8435b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:17.728946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2ffcafdc-21e1-4ff2-b69f-27bc93a8435b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:17.730359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2ffcafdc-21e1-4ff2-b69f-27bc93a8435b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:17.736542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2ffcafdc-21e1-4ff2-b69f-27bc93a8435b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:17.736542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2ffcafdc-21e1-4ff2-b69f-27bc93a8435b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:18.050361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-dfd9b623-5a87-4e51-8822-b822188a6c3b req-1fe5764b-75a6-406e-84a7-40d40ce04576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "292a1ab6-21e8-4cf4-a499-c0a65f10f617", "name": "network-vif-plugged", "status": "completed", "tag": "5f1534ca-86d2-4144-9e14-e51d146c6b8e"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:18.069710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-dfd9b623-5a87-4e51-8822-b822188a6c3b req-1fe5764b-75a6-406e-84a7-40d40ce04576 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:18.070174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-dfd9b623-5a87-4e51-8822-b822188a6c3b req-1fe5764b-75a6-406e-84a7-40d40ce04576 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:18.134049 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-dfd9b623-5a87-4e51-8822-b822188a6c3b req-1fe5764b-75a6-406e-84a7-40d40ce04576 service nova] Creating event network-vif-plugged:5f1534ca-86d2-4144-9e14-e51d146c6b8e for instance 292a1ab6-21e8-4cf4-a499-c0a65f10f617 on n-h1-843700-1 May 28 04:41:18.148519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2ffcafdc-21e1-4ff2-b69f-27bc93a8435b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:18.154863 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-dfd9b623-5a87-4e51-8822-b822188a6c3b req-1fe5764b-75a6-406e-84a7-40d40ce04576 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108455 May 28 04:41:18.163033 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2ffcafdc-21e1-4ff2-b69f-27bc93a8435b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1304 microversion: 2.1 time: 0.460095 May 28 04:41:18.164338 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 934/1937] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:18.178384 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1004/1938] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:17 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1304 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:18.189924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cb0ee383-9f9f-4296-a9ae-5894675c861d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:18.190636 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cb0ee383-9f9f-4296-a9ae-5894675c861d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:18.228776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb0ee383-9f9f-4296-a9ae-5894675c861d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:18.231738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb0ee383-9f9f-4296-a9ae-5894675c861d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:18.232885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb0ee383-9f9f-4296-a9ae-5894675c861d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:18.236196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb0ee383-9f9f-4296-a9ae-5894675c861d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:18.712372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-42e5a99e-f742-45fc-a091-3bdbc6869959 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:18.723646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-42e5a99e-f742-45fc-a091-3bdbc6869959 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:18.725351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42e5a99e-f742-45fc-a091-3bdbc6869959 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:18.725654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42e5a99e-f742-45fc-a091-3bdbc6869959 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:18.726441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42e5a99e-f742-45fc-a091-3bdbc6869959 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:18.726876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42e5a99e-f742-45fc-a091-3bdbc6869959 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:19.383016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cb0ee383-9f9f-4296-a9ae-5894675c861d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:19.402360 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cb0ee383-9f9f-4296-a9ae-5894675c861d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 1.235051 May 28 04:41:19.405018 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 935/1939] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:18 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:19.429120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-256aba03-aa1e-435a-aa28-9da512f3030f tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:19.432326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-256aba03-aa1e-435a-aa28-9da512f3030f tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:19.452265 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-256aba03-aa1e-435a-aa28-9da512f3030f tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:19.452762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-256aba03-aa1e-435a-aa28-9da512f3030f tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:19.456960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-256aba03-aa1e-435a-aa28-9da512f3030f tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:19.457436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-256aba03-aa1e-435a-aa28-9da512f3030f tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:19.996169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-42e5a99e-f742-45fc-a091-3bdbc6869959 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:20.004036 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-42e5a99e-f742-45fc-a091-3bdbc6869959 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1372 microversion: 2.1 time: 1.295522 May 28 04:41:20.017646 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1005/1940] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:18 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1372 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:20.026824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-008ed845-6ff1-4c4c-a88f-6161fecb1b38 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:20.028066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-008ed845-6ff1-4c4c-a88f-6161fecb1b38 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:20.042496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-008ed845-6ff1-4c4c-a88f-6161fecb1b38 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:20.043245 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-008ed845-6ff1-4c4c-a88f-6161fecb1b38 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:20.044190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-008ed845-6ff1-4c4c-a88f-6161fecb1b38 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:20.044791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-008ed845-6ff1-4c4c-a88f-6161fecb1b38 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:20.150547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-256aba03-aa1e-435a-aa28-9da512f3030f tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:20.164605 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-256aba03-aa1e-435a-aa28-9da512f3030f tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 200 len: 1313 microversion: 2.1 time: 0.755971 May 28 04:41:20.180995 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 936/1941] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:19 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 1313 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:20.423993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e5f4db81-1292-4607-9676-4fc9b4105861 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:20.424778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e5f4db81-1292-4607-9676-4fc9b4105861 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:20.436220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e5f4db81-1292-4607-9676-4fc9b4105861 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:20.438184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e5f4db81-1292-4607-9676-4fc9b4105861 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:20.447392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e5f4db81-1292-4607-9676-4fc9b4105861 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:20.449165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e5f4db81-1292-4607-9676-4fc9b4105861 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:20.546690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-008ed845-6ff1-4c4c-a88f-6161fecb1b38 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:20.553390 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-008ed845-6ff1-4c4c-a88f-6161fecb1b38 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1292 microversion: 2.1 time: 0.534280 May 28 04:41:20.553977 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1006/1942] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:20 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1292 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:20.864803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e5f4db81-1292-4607-9676-4fc9b4105861 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:20.884546 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e5f4db81-1292-4607-9676-4fc9b4105861 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.466981 May 28 04:41:20.895251 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 937/1943] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:20 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:41:21.025405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bd5b6cd4-89fe-4251-86f9-ffe06d51df73 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:21.026697 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bd5b6cd4-89fe-4251-86f9-ffe06d51df73 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:21.044753 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd5b6cd4-89fe-4251-86f9-ffe06d51df73 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:21.045226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd5b6cd4-89fe-4251-86f9-ffe06d51df73 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:21.048794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd5b6cd4-89fe-4251-86f9-ffe06d51df73 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:21.050960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd5b6cd4-89fe-4251-86f9-ffe06d51df73 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:21.213344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-71000767-af5a-4ee2-b560-42424fbefc7c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:21.213344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-71000767-af5a-4ee2-b560-42424fbefc7c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:21.213344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71000767-af5a-4ee2-b560-42424fbefc7c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:21.213344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71000767-af5a-4ee2-b560-42424fbefc7c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:21.213344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71000767-af5a-4ee2-b560-42424fbefc7c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:21.213344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71000767-af5a-4ee2-b560-42424fbefc7c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:21.582659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bd5b6cd4-89fe-4251-86f9-ffe06d51df73 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:21.605198 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bd5b6cd4-89fe-4251-86f9-ffe06d51df73 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1372 microversion: 2.1 time: 0.575439 May 28 04:41:21.605198 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1007/1944] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:21 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1372 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:21.611238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-49094c0f-f8e1-49c5-bb1b-9a4831f41abe tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:21.612384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-49094c0f-f8e1-49c5-bb1b-9a4831f41abe tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:21.623549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49094c0f-f8e1-49c5-bb1b-9a4831f41abe tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:21.628120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49094c0f-f8e1-49c5-bb1b-9a4831f41abe tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:21.628120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49094c0f-f8e1-49c5-bb1b-9a4831f41abe tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:21.628120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49094c0f-f8e1-49c5-bb1b-9a4831f41abe tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:21.641476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-71000767-af5a-4ee2-b560-42424fbefc7c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:21.650571 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-71000767-af5a-4ee2-b560-42424fbefc7c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 200 len: 1463 microversion: 2.1 time: 0.468419 May 28 04:41:21.659812 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 938/1945] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:21 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 1463 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:21.696518 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fe9cc3f7-40d6-4745-9ea9-7014ef962d62 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:21.697582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fe9cc3f7-40d6-4745-9ea9-7014ef962d62 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:21.708757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe9cc3f7-40d6-4745-9ea9-7014ef962d62 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:21.708757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe9cc3f7-40d6-4745-9ea9-7014ef962d62 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:21.708757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe9cc3f7-40d6-4745-9ea9-7014ef962d62 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:21.708757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe9cc3f7-40d6-4745-9ea9-7014ef962d62 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:22.084299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-49094c0f-f8e1-49c5-bb1b-9a4831f41abe tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:22.096471 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-49094c0f-f8e1-49c5-bb1b-9a4831f41abe tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1292 microversion: 2.1 time: 0.495997 May 28 04:41:22.099839 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1008/1946] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:21 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1292 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:22.140146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-968e9644-2663-4f60-8ae9-a692551e825e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:22.140564 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-968e9644-2663-4f60-8ae9-a692551e825e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:22.156116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-968e9644-2663-4f60-8ae9-a692551e825e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:22.156576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-968e9644-2663-4f60-8ae9-a692551e825e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:22.157384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-968e9644-2663-4f60-8ae9-a692551e825e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:22.157825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-968e9644-2663-4f60-8ae9-a692551e825e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:22.260785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fe9cc3f7-40d6-4745-9ea9-7014ef962d62 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:22.275601 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fe9cc3f7-40d6-4745-9ea9-7014ef962d62 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1463 microversion: 2.1 time: 0.595639 May 28 04:41:22.291616 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 939/1947] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:21 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1463 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:22.512493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-968e9644-2663-4f60-8ae9-a692551e825e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:22.527731 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-968e9644-2663-4f60-8ae9-a692551e825e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.421359 May 28 04:41:22.536118 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1009/1948] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:22 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:22.613066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f539ce66-b170-4020-9bb6-71d60d694c62 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:22.613971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f539ce66-b170-4020-9bb6-71d60d694c62 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:22.632205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f539ce66-b170-4020-9bb6-71d60d694c62 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:22.632205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f539ce66-b170-4020-9bb6-71d60d694c62 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:22.632205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f539ce66-b170-4020-9bb6-71d60d694c62 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:22.632205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f539ce66-b170-4020-9bb6-71d60d694c62 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:23.011252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1a7293a6-0f31-420e-8e4a-a29baea237f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1563803828", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "76e10746-e2e9-4339-aae3-49ef9bc702b8"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:23.041589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f539ce66-b170-4020-9bb6-71d60d694c62 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:23.058652 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f539ce66-b170-4020-9bb6-71d60d694c62 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1372 microversion: 2.1 time: 0.449433 May 28 04:41:23.068197 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1010/1949] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:22 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1372 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:23.092183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4a69d545-4e9a-423e-b3b8-f1a3146ffe2c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-55403569", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "12b94a91-20fe-40ac-bd67-2864eef657f6"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:23.132764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-1a7293a6-0f31-420e-8e4a-a29baea237f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] validate_networks() for [('76e10746-e2e9-4339-aae3-49ef9bc702b8', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:41:23.214065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-4a69d545-4e9a-423e-b3b8-f1a3146ffe2c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:41:24.143148 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4a69d545-4e9a-423e-b3b8-f1a3146ffe2c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:41:24.144343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4a69d545-4e9a-423e-b3b8-f1a3146ffe2c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:41:24.145578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4a69d545-4e9a-423e-b3b8-f1a3146ffe2c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:41:24.146296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4a69d545-4e9a-423e-b3b8-f1a3146ffe2c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:41:24.147415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4a69d545-4e9a-423e-b3b8-f1a3146ffe2c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:41:24.161242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a69d545-4e9a-423e-b3b8-f1a3146ffe2c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:24.162029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a69d545-4e9a-423e-b3b8-f1a3146ffe2c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:24.163225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a69d545-4e9a-423e-b3b8-f1a3146ffe2c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:24.163862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a69d545-4e9a-423e-b3b8-f1a3146ffe2c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:24.174427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-1a7293a6-0f31-420e-8e4a-a29baea237f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:41:24.175028 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-1a7293a6-0f31-420e-8e4a-a29baea237f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:41:24.175480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-1a7293a6-0f31-420e-8e4a-a29baea237f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:41:24.175889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-1a7293a6-0f31-420e-8e4a-a29baea237f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:41:24.176303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-1a7293a6-0f31-420e-8e4a-a29baea237f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:41:24.186080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-4a69d545-4e9a-423e-b3b8-f1a3146ffe2c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Getting quotas for project 13ea83404c554681912477aa3f6d0798. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:41:24.190514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a7293a6-0f31-420e-8e4a-a29baea237f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:24.191276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a7293a6-0f31-420e-8e4a-a29baea237f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:24.192135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-4a69d545-4e9a-423e-b3b8-f1a3146ffe2c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Getting quotas for user 7850cd7487c94107b6cfdc0c956f01d0 and project 13ea83404c554681912477aa3f6d0798. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:41:24.192541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a7293a6-0f31-420e-8e4a-a29baea237f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:24.193203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a7293a6-0f31-420e-8e4a-a29baea237f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:24.208491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4a69d545-4e9a-423e-b3b8-f1a3146ffe2c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:41:24.213626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4a69d545-4e9a-423e-b3b8-f1a3146ffe2c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 2e714899-ae82-47c5-bd72-a65a0b4734a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:41:24.218598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-1a7293a6-0f31-420e-8e4a-a29baea237f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Getting quotas for project a93892cb2a75466a82fcb79f40b306ca. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:41:24.225840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-1a7293a6-0f31-420e-8e4a-a29baea237f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Getting quotas for user 0d4fff87c06440478b3a4536a289aa99 and project a93892cb2a75466a82fcb79f40b306ca. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:41:24.243112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1a7293a6-0f31-420e-8e4a-a29baea237f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:41:24.246236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1a7293a6-0f31-420e-8e4a-a29baea237f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:41:24.374947 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4a69d545-4e9a-423e-b3b8-f1a3146ffe2c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.305519 May 28 04:41:24.376329 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1011/1950] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:41:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:41:24.417953 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1a7293a6-0f31-420e-8e4a-a29baea237f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.903273 May 28 04:41:24.419582 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 940/1951] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:41:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:41:24.430950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fdd6b1cb-77cd-4eb7-89ff-27bed456dcb3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:24.432060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fdd6b1cb-77cd-4eb7-89ff-27bed456dcb3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:24.441596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdd6b1cb-77cd-4eb7-89ff-27bed456dcb3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:24.443277 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdd6b1cb-77cd-4eb7-89ff-27bed456dcb3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:24.444653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdd6b1cb-77cd-4eb7-89ff-27bed456dcb3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:24.445388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdd6b1cb-77cd-4eb7-89ff-27bed456dcb3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:24.662898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fdd6b1cb-77cd-4eb7-89ff-27bed456dcb3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:24.674436 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fdd6b1cb-77cd-4eb7-89ff-27bed456dcb3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1292 microversion: 2.1 time: 0.252305 May 28 04:41:24.693227 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 941/1952] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:24 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1292 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:24.693227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2f073e9d-6492-4211-8a78-6219e2392e0c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:24.694178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2f073e9d-6492-4211-8a78-6219e2392e0c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:24.699254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c70b21d4-7243-4438-9fd5-9d4b98b2dd86 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-534853711", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "147580da-30c4-4891-b7ad-13d615c4b0fc"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:24.701976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f073e9d-6492-4211-8a78-6219e2392e0c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:24.702577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f073e9d-6492-4211-8a78-6219e2392e0c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:24.703421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f073e9d-6492-4211-8a78-6219e2392e0c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:24.703858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f073e9d-6492-4211-8a78-6219e2392e0c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:24.787971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-c70b21d4-7243-4438-9fd5-9d4b98b2dd86 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] validate_networks() for [('147580da-30c4-4891-b7ad-13d615c4b0fc', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:41:24.974597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2f073e9d-6492-4211-8a78-6219e2392e0c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:24.985938 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2f073e9d-6492-4211-8a78-6219e2392e0c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.299113 May 28 04:41:24.988405 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 942/1953] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:24 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:25.067956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-478b0725-a1d0-40f9-ab4f-f1953532ca00 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Action: 'create', calling method: .version_select at 0x7f77010f30d0>, body: {"keypair": {"name": "tempest-keypair-26177300", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+T7Zi3LbcgxU7TTBWCnc/Phct3mRODvFMU+vQVFVoqPQUpIDyeItEqZfuhtGzOjCmgwf4GobhlsV5jibC2lpuJ423WQHJtgKEiGT26zjfLANapRdGcBpw6EUJHXSGIeQ=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:25.085357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-478b0725-a1d0-40f9-ab4f-f1953532ca00 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Getting quotas for project 7b362cef23b34e1d848f616e8c63dcce. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:41:25.092471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-478b0725-a1d0-40f9-ab4f-f1953532ca00 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Getting quotas for user ccd075fb0e354aa4a16b0b31a35838ae and project 7b362cef23b34e1d848f616e8c63dcce. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:41:25.164282 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-478b0725-a1d0-40f9-ab4f-f1953532ca00 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.174528 May 28 04:41:25.166145 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 943/1954] 10.222.0.58 () {62 vars in 1198 bytes} [Sat May 28 04:41:24 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 177 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 28 04:41:25.173302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-616925db-1580-418b-bd8f-8b08e38cb6f7 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:25.173936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-616925db-1580-418b-bd8f-8b08e38cb6f7 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:25.183807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-616925db-1580-418b-bd8f-8b08e38cb6f7 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:25.184439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-616925db-1580-418b-bd8f-8b08e38cb6f7 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:25.185521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-616925db-1580-418b-bd8f-8b08e38cb6f7 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:25.186822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-616925db-1580-418b-bd8f-8b08e38cb6f7 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:25.474568 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-616925db-1580-418b-bd8f-8b08e38cb6f7 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:25.485311 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-616925db-1580-418b-bd8f-8b08e38cb6f7 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1372 microversion: 2.1 time: 0.317489 May 28 04:41:25.486556 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 944/1955] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:25 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1372 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:25.493779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fbfd7491-40ee-4476-830a-dc1ceed08d8d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:25.495272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fbfd7491-40ee-4476-830a-dc1ceed08d8d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 2e714899-ae82-47c5-bd72-a65a0b4734a4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:25.512346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbfd7491-40ee-4476-830a-dc1ceed08d8d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:25.513215 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbfd7491-40ee-4476-830a-dc1ceed08d8d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:25.514462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbfd7491-40ee-4476-830a-dc1ceed08d8d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:25.516071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbfd7491-40ee-4476-830a-dc1ceed08d8d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:25.516774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c70b21d4-7243-4438-9fd5-9d4b98b2dd86 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:41:25.517270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c70b21d4-7243-4438-9fd5-9d4b98b2dd86 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:41:25.517674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c70b21d4-7243-4438-9fd5-9d4b98b2dd86 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:41:25.518086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c70b21d4-7243-4438-9fd5-9d4b98b2dd86 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:41:25.518714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c70b21d4-7243-4438-9fd5-9d4b98b2dd86 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:41:25.529786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c70b21d4-7243-4438-9fd5-9d4b98b2dd86 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:25.530563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c70b21d4-7243-4438-9fd5-9d4b98b2dd86 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:25.531614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c70b21d4-7243-4438-9fd5-9d4b98b2dd86 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:25.532230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c70b21d4-7243-4438-9fd5-9d4b98b2dd86 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:25.553838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-c70b21d4-7243-4438-9fd5-9d4b98b2dd86 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Getting quotas for project 4ab1bb14448e4f0c9e0f266f1f8500d0. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:41:25.561883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-c70b21d4-7243-4438-9fd5-9d4b98b2dd86 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Getting quotas for user 40d4faab008b493c9ea053036f3ef92f and project 4ab1bb14448e4f0c9e0f266f1f8500d0. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:41:25.576875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c70b21d4-7243-4438-9fd5-9d4b98b2dd86 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:41:25.579296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c70b21d4-7243-4438-9fd5-9d4b98b2dd86 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:41:25.615453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fbfd7491-40ee-4476-830a-dc1ceed08d8d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:25.623801 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fbfd7491-40ee-4476-830a-dc1ceed08d8d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4" status: 200 len: 1216 microversion: 2.1 time: 0.135301 May 28 04:41:25.634454 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 945/1956] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:25 2022] GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4 => generated 1216 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:25.640976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b266624e-9512-4341-9d71-e85945ddd5e3 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:25.641601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b266624e-9512-4341-9d71-e85945ddd5e3 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:25.717181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b266624e-9512-4341-9d71-e85945ddd5e3 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:25.724779 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c70b21d4-7243-4438-9fd5-9d4b98b2dd86 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.346953 May 28 04:41:25.724964 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b266624e-9512-4341-9d71-e85945ddd5e3 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1218 microversion: 2.1 time: 0.089243 May 28 04:41:25.734283 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 946/1957] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:25 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:25.734283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d17eefdf-fb32-4092-966a-3d6371d68200 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Calling method '.version_select at 0x7f7701154820>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:25.739421 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d17eefdf-fb32-4092-966a-3d6371d68200 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-26177300" status: 200 len: 511 microversion: 2.2 time: 0.012727 May 28 04:41:25.745087 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1012/1958] 10.222.0.58 () {62 vars in 1187 bytes} [Sat May 28 04:41:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1363 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 04:41:25.745087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-24fc620b-7f49-4686-a767-c1de0fa8c2f5 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:25.748697 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 947/1959] 10.222.0.58 () {60 vars in 1251 bytes} [Sat May 28 04:41:25 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-26177300 => generated 511 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:25.750906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-58518773-e281-411c-afb4-1a8ce0acfaaf tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Calling method '.version_select at 0x7f7701108700>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:25.755184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-24fc620b-7f49-4686-a767-c1de0fa8c2f5 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:25.762405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24fc620b-7f49-4686-a767-c1de0fa8c2f5 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:25.762865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24fc620b-7f49-4686-a767-c1de0fa8c2f5 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:25.763704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24fc620b-7f49-4686-a767-c1de0fa8c2f5 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:25.764138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24fc620b-7f49-4686-a767-c1de0fa8c2f5 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:25.853667 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-58518773-e281-411c-afb4-1a8ce0acfaaf tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-26177300" status: 204 len: 0 microversion: 2.2 time: 0.106620 May 28 04:41:25.861730 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 948/1960] 10.222.0.58 () {60 vars in 1254 bytes} [Sat May 28 04:41:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-26177300 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:41:25.868015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9e9db2bd-080e-4645-bcb3-01253e585596 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:25.869721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9e9db2bd-080e-4645-bcb3-01253e585596 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:25.965043 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9e9db2bd-080e-4645-bcb3-01253e585596 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:25.974495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9e9db2bd-080e-4645-bcb3-01253e585596 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:25.976855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9e9db2bd-080e-4645-bcb3-01253e585596 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:25.978547 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9e9db2bd-080e-4645-bcb3-01253e585596 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456" status: 200 len: 1261 microversion: 2.26 time: 0.115437 May 28 04:41:25.979409 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 949/1961] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:25 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 => generated 1261 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:25.989831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-24fc620b-7f49-4686-a767-c1de0fa8c2f5 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:26.004572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5fddd98c-aba4-498e-8c90-024e96dae498 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Action: 'create', calling method: .version_select at 0x7f7707400700>, body: {"keypair": {"name": "tempest-keypair-864864568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnoDYEBzILWfiPLOuTOB7bccTf+e5m2DVuq2WOYv7jQC8LOF33UeBxADlLbb9nc6KsZVcB/khE5vjFItcdevzd2KK3YkLA4ShXbTwoa3klh7DbM8gmcRaZu2vc3YqLKLw=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:26.016250 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-24fc620b-7f49-4686-a767-c1de0fa8c2f5 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1292 microversion: 2.1 time: 0.274921 May 28 04:41:26.017309 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1013/1962] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:25 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1292 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:26.028511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-5fddd98c-aba4-498e-8c90-024e96dae498 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Getting quotas for project 7b362cef23b34e1d848f616e8c63dcce. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:41:26.034957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e41d94f2-9221-43ef-804a-e977a73f8cf9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:26.035631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e41d94f2-9221-43ef-804a-e977a73f8cf9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:26.037456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-5fddd98c-aba4-498e-8c90-024e96dae498 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Getting quotas for user ccd075fb0e354aa4a16b0b31a35838ae and project 7b362cef23b34e1d848f616e8c63dcce. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:41:26.040860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:26.045815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e41d94f2-9221-43ef-804a-e977a73f8cf9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:26.046345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e41d94f2-9221-43ef-804a-e977a73f8cf9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:26.047375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e41d94f2-9221-43ef-804a-e977a73f8cf9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:26.047985 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e41d94f2-9221-43ef-804a-e977a73f8cf9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:26.132701 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5fddd98c-aba4-498e-8c90-024e96dae498 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.151808 May 28 04:41:26.138810 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 950/1963] 10.222.0.58 () {62 vars in 1198 bytes} [Sat May 28 04:41:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 28 04:41:26.144271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2b789851-7fa1-4e30-9b5e-28e7f3c7ac32 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Calling method '.version_select at 0x7f7701108ca0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:26.194141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e41d94f2-9221-43ef-804a-e977a73f8cf9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:26.203071 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e41d94f2-9221-43ef-804a-e977a73f8cf9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.175923 May 28 04:41:26.203809 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1014/1964] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:26 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:26.259993 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2b789851-7fa1-4e30-9b5e-28e7f3c7ac32 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-864864568" status: 204 len: 0 microversion: 2.2 time: 0.120041 May 28 04:41:26.271528 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 951/1965] 10.222.0.58 () {60 vars in 1257 bytes} [Sat May 28 04:41:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-864864568 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:41:26.273675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-93c76f12-8b15-4da0-81b1-aba41862e41a tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Action: 'create', calling method: .version_select at 0x7f7701f114c0>, body: {"keypair": {"name": "tempest-keypair-1143623310", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:26.312013 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-93c76f12-8b15-4da0-81b1-aba41862e41a tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Getting quotas for project 7b362cef23b34e1d848f616e8c63dcce. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:41:26.318480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-93c76f12-8b15-4da0-81b1-aba41862e41a tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Getting quotas for user ccd075fb0e354aa4a16b0b31a35838ae and project 7b362cef23b34e1d848f616e8c63dcce. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:41:26.403823 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-93c76f12-8b15-4da0-81b1-aba41862e41a tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.136497 May 28 04:41:26.411018 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1015/1966] 10.222.0.58 () {62 vars in 1198 bytes} [Sat May 28 04:41:26 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 145 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 28 04:41:26.417456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9daf7ae7-fe36-4bd1-8e2d-c5432c68d6ac tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Calling method '.version_select at 0x7f77074a3e50>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:26.504960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c4927413-27d0-465e-88f7-0f0e8bf5fc02 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:26.506004 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c4927413-27d0-465e-88f7-0f0e8bf5fc02 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:26.514291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4927413-27d0-465e-88f7-0f0e8bf5fc02 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:26.515874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4927413-27d0-465e-88f7-0f0e8bf5fc02 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:26.516722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4927413-27d0-465e-88f7-0f0e8bf5fc02 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:26.517324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4927413-27d0-465e-88f7-0f0e8bf5fc02 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:26.523001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:26.568213 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9daf7ae7-fe36-4bd1-8e2d-c5432c68d6ac tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1143623310" status: 204 len: 0 microversion: 2.2 time: 0.157188 May 28 04:41:26.568905 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 952/1967] 10.222.0.58 () {60 vars in 1260 bytes} [Sat May 28 04:41:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1143623310 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 04:41:26.581137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-89053e36-3cbb-49e9-b79c-6fa1a7a75dda tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Action: 'create', calling method: .version_select at 0x7f7701154670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-100416264", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgEFE3hjSfdRPu+WiLSv/0i7WAnzhmTSyUCkjNE1slOqZ+Xcqarz+dq9CacT/8o0VG8uTWXirQqCNmiijzeqCfF1InN7pUmpqWdTVfHinJcv0s3xCWYOMYWIwb/0BmCLg=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:26.600412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-89053e36-3cbb-49e9-b79c-6fa1a7a75dda tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Getting quotas for project 7b362cef23b34e1d848f616e8c63dcce. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:41:26.606636 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-89053e36-3cbb-49e9-b79c-6fa1a7a75dda tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Getting quotas for user ccd075fb0e354aa4a16b0b31a35838ae and project 7b362cef23b34e1d848f616e8c63dcce. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:41:26.712211 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-89053e36-3cbb-49e9-b79c-6fa1a7a75dda tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.134799 May 28 04:41:26.724073 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 953/1968] 10.222.0.58 () {62 vars in 1198 bytes} [Sat May 28 04:41:26 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 147 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 28 04:41:26.730360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-66e97d0b-881d-4060-8bb1-5e75116c061a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:26.731367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-66e97d0b-881d-4060-8bb1-5e75116c061a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 2e714899-ae82-47c5-bd72-a65a0b4734a4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:26.745210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-66e97d0b-881d-4060-8bb1-5e75116c061a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:26.745210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-66e97d0b-881d-4060-8bb1-5e75116c061a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:26.746639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-66e97d0b-881d-4060-8bb1-5e75116c061a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:26.747092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-66e97d0b-881d-4060-8bb1-5e75116c061a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:26.750744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:26.998789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-66e97d0b-881d-4060-8bb1-5e75116c061a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:27.006398 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-66e97d0b-881d-4060-8bb1-5e75116c061a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4" status: 200 len: 1208 microversion: 2.1 time: 0.280742 May 28 04:41:27.007010 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 954/1969] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:26 2022] GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4 => generated 1208 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:27.020661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-da3a7959-4d26-4bd5-b6ed-aad7998d34c7 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Action: 'create', calling method: .version_select at 0x7f77074a3940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1177393652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFe1vhKleZ722V4Geay+AhNvNFV05hEs233dCpbwGfFveBJIRlvKEyB/j+qXVQTxzkYtJMq2eLXBFci48Ndqpzg+RRJIw515WggRyuMIfD0DsdTqoMofrJIaALPOyBMrKA=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:27.036690 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-da3a7959-4d26-4bd5-b6ed-aad7998d34c7 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Getting quotas for project 7b362cef23b34e1d848f616e8c63dcce. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:41:27.042664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-da3a7959-4d26-4bd5-b6ed-aad7998d34c7 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Getting quotas for user ccd075fb0e354aa4a16b0b31a35838ae and project 7b362cef23b34e1d848f616e8c63dcce. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:41:27.132510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c4927413-27d0-465e-88f7-0f0e8bf5fc02 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:27.140188 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c4927413-27d0-465e-88f7-0f0e8bf5fc02 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1372 microversion: 2.1 time: 0.642351 May 28 04:41:27.141370 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1016/1970] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:26 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1372 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:27.151001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ea591e8b-1f5c-44dc-ab77-1ba26d10f2eb tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:27.151805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ea591e8b-1f5c-44dc-ab77-1ba26d10f2eb tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:27.156195 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-da3a7959-4d26-4bd5-b6ed-aad7998d34c7 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.139334 May 28 04:41:27.157817 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 955/1971] 10.222.0.58 () {62 vars in 1198 bytes} [Sat May 28 04:41:27 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 150 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 28 04:41:27.166184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea591e8b-1f5c-44dc-ab77-1ba26d10f2eb tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:27.166704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea591e8b-1f5c-44dc-ab77-1ba26d10f2eb tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:27.167774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea591e8b-1f5c-44dc-ab77-1ba26d10f2eb tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:27.168410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea591e8b-1f5c-44dc-ab77-1ba26d10f2eb tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:27.169594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-052f8eeb-f8e7-49f7-be4f-7233c0813102 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:27.170280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-052f8eeb-f8e7-49f7-be4f-7233c0813102 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:27.177778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-052f8eeb-f8e7-49f7-be4f-7233c0813102 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:27.178308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-052f8eeb-f8e7-49f7-be4f-7233c0813102 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:27.179359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-052f8eeb-f8e7-49f7-be4f-7233c0813102 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:27.180399 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-052f8eeb-f8e7-49f7-be4f-7233c0813102 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:27.238051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ea591e8b-1f5c-44dc-ab77-1ba26d10f2eb tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:27.273329 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ea591e8b-1f5c-44dc-ab77-1ba26d10f2eb tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1270 microversion: 2.1 time: 0.130606 May 28 04:41:27.286631 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1017/1972] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:27 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1270 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:27.311840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-97e64028-3d42-4206-be91-9034d2904621 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:27.319292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-97e64028-3d42-4206-be91-9034d2904621 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:27.328199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-052f8eeb-f8e7-49f7-be4f-7233c0813102 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:27.341778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-052f8eeb-f8e7-49f7-be4f-7233c0813102 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:27.344784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-052f8eeb-f8e7-49f7-be4f-7233c0813102 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:27.346386 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-052f8eeb-f8e7-49f7-be4f-7233c0813102 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456" status: 200 len: 1265 microversion: 2.26 time: 0.187225 May 28 04:41:27.348532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-97e64028-3d42-4206-be91-9034d2904621 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:27.353356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-97e64028-3d42-4206-be91-9034d2904621 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:27.353356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-97e64028-3d42-4206-be91-9034d2904621 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:27.353356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-97e64028-3d42-4206-be91-9034d2904621 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:27.363759 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 956/1973] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:27 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:27.369266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fdba5f09-221f-4113-a848-35faf81402b8 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Action: 'create', calling method: .version_select at 0x7f7701154f70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-105388420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnOw7Wr4UW3OyT9nyEztxkV7zV7rPssB5z5EE5W+FqcmgQei7gyrHb9eoXb6ckHDlKWHTVjlzJbOS7rapBZ1iE7BTXQvYlNIvdFCjtLMSw/VkKcPbVfAbL5vLeJOPDpiA=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:27.387855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-fdba5f09-221f-4113-a848-35faf81402b8 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Getting quotas for project 7b362cef23b34e1d848f616e8c63dcce. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:41:27.402860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-fdba5f09-221f-4113-a848-35faf81402b8 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Getting quotas for user ccd075fb0e354aa4a16b0b31a35838ae and project 7b362cef23b34e1d848f616e8c63dcce. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:41:27.540227 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fdba5f09-221f-4113-a848-35faf81402b8 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.175335 May 28 04:41:27.542846 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 957/1974] 10.222.0.58 () {62 vars in 1198 bytes} [Sat May 28 04:41:27 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 179 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 28 04:41:27.549647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-91db5127-d712-4b38-9a53-b5123068ac84 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:27.554413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-91db5127-d712-4b38-9a53-b5123068ac84 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:27.573577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91db5127-d712-4b38-9a53-b5123068ac84 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:27.573577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91db5127-d712-4b38-9a53-b5123068ac84 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:27.573577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91db5127-d712-4b38-9a53-b5123068ac84 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:27.573577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91db5127-d712-4b38-9a53-b5123068ac84 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:27.769510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-97e64028-3d42-4206-be91-9034d2904621 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:27.787220 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-97e64028-3d42-4206-be91-9034d2904621 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1292 microversion: 2.1 time: 0.495314 May 28 04:41:27.797445 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1018/1975] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:27 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1292 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:27.802302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f747af6b-8d00-4aff-9116-be5e47ae9b76 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Calling method '.version_select at 0x7f7701e119d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:27.820986 n-d-843700-1 devstack@n-api.service[126044]: WARNING oslo_db.sqlalchemy.utils [None req-f747af6b-8d00-4aff-9116-be5e47ae9b76 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Unique keys not in sort_keys. The sorting order may be unstable. May 28 04:41:27.842898 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f747af6b-8d00-4aff-9116-be5e47ae9b76 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.044232 May 28 04:41:27.843667 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1019/1976] 10.222.0.58 () {60 vars in 1176 bytes} [Sat May 28 04:41:27 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:27.854112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0200cd00-731c-44ae-98db-47e8e3c8c5da tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Calling method '.version_select at 0x7f7701d529d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:28.003097 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0200cd00-731c-44ae-98db-47e8e3c8c5da tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-105388420" status: 204 len: 0 microversion: 2.2 time: 0.152907 May 28 04:41:28.003904 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1020/1977] 10.222.0.58 () {60 vars in 1317 bytes} [Sat May 28 04:41:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-105388420 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 04:41:28.013686 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-96811649-85b1-421a-9e04-fd4352926bff tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Calling method '.version_select at 0x7f7701e7b700>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:28.017083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-91db5127-d712-4b38-9a53-b5123068ac84 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:28.028485 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-91db5127-d712-4b38-9a53-b5123068ac84 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1393 microversion: 2.1 time: 0.484340 May 28 04:41:28.032253 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 958/1978] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:27 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1393 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:28.040054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-26e8b2f6-8ac6-438a-9673-3b52c50380b5 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:28.040771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-26e8b2f6-8ac6-438a-9673-3b52c50380b5 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 2e714899-ae82-47c5-bd72-a65a0b4734a4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:28.047116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-26e8b2f6-8ac6-438a-9673-3b52c50380b5 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:28.047451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-26e8b2f6-8ac6-438a-9673-3b52c50380b5 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:28.048222 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-26e8b2f6-8ac6-438a-9673-3b52c50380b5 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:28.048669 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-26e8b2f6-8ac6-438a-9673-3b52c50380b5 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:28.122786 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-96811649-85b1-421a-9e04-fd4352926bff tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1177393652" status: 204 len: 0 microversion: 2.2 time: 0.114057 May 28 04:41:28.123282 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1021/1979] 10.222.0.58 () {60 vars in 1320 bytes} [Sat May 28 04:41:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1177393652 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:41:28.135160 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-67f533bb-a3c3-44d1-af72-79cd322e31b6 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Calling method '.version_select at 0x7f77073c99d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:28.145324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-26e8b2f6-8ac6-438a-9673-3b52c50380b5 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:28.156597 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-26e8b2f6-8ac6-438a-9673-3b52c50380b5 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4" status: 200 len: 1272 microversion: 2.1 time: 0.122612 May 28 04:41:28.164111 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 959/1980] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:28 2022] GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4 => generated 1272 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:28.169757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-089c4027-3a71-4baf-9aaa-2ab41a4242d3 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:28.170385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-089c4027-3a71-4baf-9aaa-2ab41a4242d3 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:28.178836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-089c4027-3a71-4baf-9aaa-2ab41a4242d3 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:28.179329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-089c4027-3a71-4baf-9aaa-2ab41a4242d3 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:28.180291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-089c4027-3a71-4baf-9aaa-2ab41a4242d3 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:28.184115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-089c4027-3a71-4baf-9aaa-2ab41a4242d3 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:28.313064 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-67f533bb-a3c3-44d1-af72-79cd322e31b6 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-100416264" status: 204 len: 0 microversion: 2.2 time: 0.182255 May 28 04:41:28.318058 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1022/1981] 10.222.0.58 () {60 vars in 1317 bytes} [Sat May 28 04:41:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-100416264 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:41:28.331823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c82aad5b-1888-4fb5-8b6d-6ec23f257270 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:28.332444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c82aad5b-1888-4fb5-8b6d-6ec23f257270 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:28.345577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c82aad5b-1888-4fb5-8b6d-6ec23f257270 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:28.346328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c82aad5b-1888-4fb5-8b6d-6ec23f257270 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:28.347292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c82aad5b-1888-4fb5-8b6d-6ec23f257270 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:28.347889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c82aad5b-1888-4fb5-8b6d-6ec23f257270 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:28.357149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-089c4027-3a71-4baf-9aaa-2ab41a4242d3 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:28.369972 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-089c4027-3a71-4baf-9aaa-2ab41a4242d3 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1372 microversion: 2.1 time: 0.204320 May 28 04:41:28.380238 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 960/1982] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:28 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1372 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:28.385032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9cb0833e-5817-4737-aa18-cbc56a7c28c0 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Action: 'create', calling method: .version_select at 0x7f77074a3280>, body: {"keypair": {"name": "tempest-keypair-842988637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE39or/9N0nNm9g6SfBKDNMO80wGEZnsP4SfQFesnIY5Y3m6A2HoVxHg8j7CG0esCrOQ25C6nZeGGen60Ynlt/chiG6atDmd4WrETW5IfgMhbJVUuDBtSLWJYh+eRn3vdw=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:28.410919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-9cb0833e-5817-4737-aa18-cbc56a7c28c0 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Getting quotas for project 7b362cef23b34e1d848f616e8c63dcce. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:41:28.417251 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-9cb0833e-5817-4737-aa18-cbc56a7c28c0 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Getting quotas for user ccd075fb0e354aa4a16b0b31a35838ae and project 7b362cef23b34e1d848f616e8c63dcce. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:41:28.452517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c82aad5b-1888-4fb5-8b6d-6ec23f257270 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:28.465897 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c82aad5b-1888-4fb5-8b6d-6ec23f257270 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1276 microversion: 2.1 time: 0.145485 May 28 04:41:28.466973 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1023/1983] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:28 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:28.475405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aeccce50-e3e6-48a3-90b7-fbdcf617dca8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:28.476312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aeccce50-e3e6-48a3-90b7-fbdcf617dca8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:28.485357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aeccce50-e3e6-48a3-90b7-fbdcf617dca8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:28.486143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aeccce50-e3e6-48a3-90b7-fbdcf617dca8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:28.487141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aeccce50-e3e6-48a3-90b7-fbdcf617dca8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:28.487816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aeccce50-e3e6-48a3-90b7-fbdcf617dca8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:28.568236 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9cb0833e-5817-4737-aa18-cbc56a7c28c0 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.193383 May 28 04:41:28.568852 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 961/1984] 10.222.0.58 () {62 vars in 1198 bytes} [Sat May 28 04:41:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 195 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 28 04:41:28.578831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f96b2e68-e54c-47b1-8a31-186639988b05 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Calling method '.version_select at 0x7f770740a280>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:28.591477 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f96b2e68-e54c-47b1-8a31-186639988b05 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-842988637" status: 200 len: 512 microversion: 2.2 time: 0.013553 May 28 04:41:28.592325 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 962/1985] 10.222.0.58 () {60 vars in 1254 bytes} [Sat May 28 04:41:28 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-842988637 => generated 512 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:41:28.606055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6215a6f8-3345-43b8-bc90-1658c0ee1145 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Calling method '.version_select at 0x7f7701157ee0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:28.609032 n-d-843700-1 devstack@n-api.service[126043]: WARNING oslo_db.sqlalchemy.utils [None req-6215a6f8-3345-43b8-bc90-1658c0ee1145 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Unique keys not in sort_keys. The sorting order may be unstable. May 28 04:41:28.627217 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6215a6f8-3345-43b8-bc90-1658c0ee1145 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.026120 May 28 04:41:28.628308 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 963/1986] 10.222.0.58 () {60 vars in 1176 bytes} [Sat May 28 04:41:28 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:28.640366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3f8d0b43-d877-4935-adfa-f0df19c8a01f tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Calling method '.version_select at 0x7f77010dcaf0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:28.663705 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aeccce50-e3e6-48a3-90b7-fbdcf617dca8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:28.672902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aeccce50-e3e6-48a3-90b7-fbdcf617dca8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:28.674485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aeccce50-e3e6-48a3-90b7-fbdcf617dca8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:28.675653 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aeccce50-e3e6-48a3-90b7-fbdcf617dca8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456" status: 200 len: 1313 microversion: 2.26 time: 0.204121 May 28 04:41:28.676426 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1024/1987] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:28 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:28.801730 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3f8d0b43-d877-4935-adfa-f0df19c8a01f tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-842988637" status: 204 len: 0 microversion: 2.2 time: 0.165221 May 28 04:41:28.802758 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 964/1988] 10.222.0.58 () {60 vars in 1257 bytes} [Sat May 28 04:41:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-842988637 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:41:28.812289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d2c30035-5a78-4dca-af56-35302c118464 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Action: 'create', calling method: .version_select at 0x7f7707400550>, body: {"keypair": {"name": "tempest-keypair-847056412", "type": "x509"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:28.814397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c3ecc7f4-174b-41b1-ae3c-a3aaf69fb0e4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:28.821311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c3ecc7f4-174b-41b1-ae3c-a3aaf69fb0e4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:28.827268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-d2c30035-5a78-4dca-af56-35302c118464 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Getting quotas for project 7b362cef23b34e1d848f616e8c63dcce. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:41:28.831802 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3ecc7f4-174b-41b1-ae3c-a3aaf69fb0e4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:28.833848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3ecc7f4-174b-41b1-ae3c-a3aaf69fb0e4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:28.833965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-d2c30035-5a78-4dca-af56-35302c118464 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Getting quotas for user ccd075fb0e354aa4a16b0b31a35838ae and project 7b362cef23b34e1d848f616e8c63dcce. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:41:28.838839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3ecc7f4-174b-41b1-ae3c-a3aaf69fb0e4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:28.840211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3ecc7f4-174b-41b1-ae3c-a3aaf69fb0e4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:28.854806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.processutils [None req-d2c30035-5a78-4dca-af56-35302c118464 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmphu4xypz0/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmphu4xypz0/temp.key -subj /CN=ccd075fb0e354aa4a16b0b31a35838ae -extensions v3_req_client {{(pid=126043) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 28 04:41:29.146475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.processutils [None req-d2c30035-5a78-4dca-af56-35302c118464 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmphu4xypz0/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmphu4xypz0/temp.key -subj /CN=ccd075fb0e354aa4a16b0b31a35838ae -extensions v3_req_client" returned: 0 in 0.291s {{(pid=126043) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 28 04:41:29.152095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.processutils [None req-d2c30035-5a78-4dca-af56-35302c118464 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmphu4xypz0/temp.key -password pass: {{(pid=126043) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 28 04:41:29.165253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c3ecc7f4-174b-41b1-ae3c-a3aaf69fb0e4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:29.188581 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c3ecc7f4-174b-41b1-ae3c-a3aaf69fb0e4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1292 microversion: 2.1 time: 0.390025 May 28 04:41:29.189977 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1025/1989] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:28 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1292 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:41:29.194690 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.processutils [None req-d2c30035-5a78-4dca-af56-35302c118464 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] CMD "openssl pkcs12 -export -inkey /tmp/tmphu4xypz0/temp.key -password pass:" returned: 0 in 0.041s {{(pid=126043) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 28 04:41:29.204064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-28f7d730-4bac-4abe-928a-2a66e18dd5f4 req-3d2005bd-21d4-4ca8-b99b-3bd2f070b437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f4e280f-6de0-467b-b4ac-c13f9e780963", "name": "network-vif-plugged", "status": "completed", "tag": "6d445514-75cc-4831-8830-2257b5e25b63"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:29.213420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:29.217731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-28f7d730-4bac-4abe-928a-2a66e18dd5f4 req-3d2005bd-21d4-4ca8-b99b-3bd2f070b437 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:29.218371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-28f7d730-4bac-4abe-928a-2a66e18dd5f4 req-3d2005bd-21d4-4ca8-b99b-3bd2f070b437 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:29.236828 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-28f7d730-4bac-4abe-928a-2a66e18dd5f4 req-3d2005bd-21d4-4ca8-b99b-3bd2f070b437 service nova] Creating event network-vif-plugged:6d445514-75cc-4831-8830-2257b5e25b63 for instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 on n-h2-843700-1 May 28 04:41:29.242972 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-28f7d730-4bac-4abe-928a-2a66e18dd5f4 req-3d2005bd-21d4-4ca8-b99b-3bd2f070b437 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042138 May 28 04:41:29.243814 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1026/1990] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:29.253465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-384ccdb4-1e42-4d64-a385-00cfe9be07c0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:29.253465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-384ccdb4-1e42-4d64-a385-00cfe9be07c0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:29.257489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-384ccdb4-1e42-4d64-a385-00cfe9be07c0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:29.258516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-384ccdb4-1e42-4d64-a385-00cfe9be07c0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:29.259732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-384ccdb4-1e42-4d64-a385-00cfe9be07c0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:29.260375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-384ccdb4-1e42-4d64-a385-00cfe9be07c0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:29.386428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-d2c30035-5a78-4dca-af56-35302c118464 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Getting quotas for project 7b362cef23b34e1d848f616e8c63dcce. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:41:29.394509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-d2c30035-5a78-4dca-af56-35302c118464 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Getting quotas for user ccd075fb0e354aa4a16b0b31a35838ae and project 7b362cef23b34e1d848f616e8c63dcce. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:41:29.417679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:29.450956 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d2c30035-5a78-4dca-af56-35302c118464 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.642423 May 28 04:41:29.453952 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 965/1991] 10.222.0.58 () {62 vars in 1197 bytes} [Sat May 28 04:41:28 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 646 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) May 28 04:41:29.463693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c8b6475f-6a94-4625-895c-a871779e5fc5 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:29.464819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c8b6475f-6a94-4625-895c-a871779e5fc5 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 2e714899-ae82-47c5-bd72-a65a0b4734a4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:29.475390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c8b6475f-6a94-4625-895c-a871779e5fc5 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:29.479988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c8b6475f-6a94-4625-895c-a871779e5fc5 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:29.481452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c8b6475f-6a94-4625-895c-a871779e5fc5 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:29.482151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c8b6475f-6a94-4625-895c-a871779e5fc5 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:29.488929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-384ccdb4-1e42-4d64-a385-00cfe9be07c0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:29.500505 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-384ccdb4-1e42-4d64-a385-00cfe9be07c0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1383 microversion: 2.1 time: 0.255174 May 28 04:41:29.502084 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1027/1992] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:29 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1383 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:29.516427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-da50460b-84e5-40c8-ba55-256a7ed631ef tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:29.519090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-da50460b-84e5-40c8-ba55-256a7ed631ef tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:29.526357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da50460b-84e5-40c8-ba55-256a7ed631ef tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:29.527229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da50460b-84e5-40c8-ba55-256a7ed631ef tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:29.528075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da50460b-84e5-40c8-ba55-256a7ed631ef tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:29.528691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da50460b-84e5-40c8-ba55-256a7ed631ef tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:29.812560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c8b6475f-6a94-4625-895c-a871779e5fc5 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:29.828674 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c8b6475f-6a94-4625-895c-a871779e5fc5 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4" status: 200 len: 1312 microversion: 2.1 time: 0.371802 May 28 04:41:29.836931 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 966/1993] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:29 2022] GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4 => generated 1312 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:29.837528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-08db2b2a-b5e6-4bd9-a4e1-d9001ef49be5 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Calling method '.version_select at 0x7f7701157820>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:29.848251 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-08db2b2a-b5e6-4bd9-a4e1-d9001ef49be5 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-847056412" status: 200 len: 1533 microversion: 2.2 time: 0.015648 May 28 04:41:29.854380 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 967/1994] 10.222.0.58 () {60 vars in 1254 bytes} [Sat May 28 04:41:29 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-847056412 => generated 1533 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:29.857223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-da50460b-84e5-40c8-ba55-256a7ed631ef tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:29.867860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0a91787c-ab72-40b0-97ea-367c855c9b09 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:29.868017 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-da50460b-84e5-40c8-ba55-256a7ed631ef tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1372 microversion: 2.1 time: 0.364599 May 28 04:41:29.877224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0a91787c-ab72-40b0-97ea-367c855c9b09 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:29.877469 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1028/1995] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:29 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1372 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:29.877469 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-153373e3-087b-42d7-b3ee-0f4e21c98ad2 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '.version_select at 0x7f770212a1f0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:29.878653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a91787c-ab72-40b0-97ea-367c855c9b09 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:29.879232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a91787c-ab72-40b0-97ea-367c855c9b09 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:29.880236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a91787c-ab72-40b0-97ea-367c855c9b09 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:29.880688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a91787c-ab72-40b0-97ea-367c855c9b09 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:29.881221 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-153373e3-087b-42d7-b3ee-0f4e21c98ad2 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:29.881687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-153373e3-087b-42d7-b3ee-0f4e21c98ad2 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:29.894677 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-153373e3-087b-42d7-b3ee-0f4e21c98ad2 tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 2704 microversion: 2.1 time: 0.024395 May 28 04:41:29.895321 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1029/1996] 10.222.0.58 () {58 vars in 1142 bytes} [Sat May 28 04:41:29 2022] GET /compute/v2.1/os-migrations => generated 2704 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:29.901540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-475dda90-05bd-4f68-943b-e186294e34d0 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:29.902172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-475dda90-05bd-4f68-943b-e186294e34d0 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:29.912886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-475dda90-05bd-4f68-943b-e186294e34d0 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:29.913334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-475dda90-05bd-4f68-943b-e186294e34d0 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:29.915078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-475dda90-05bd-4f68-943b-e186294e34d0 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:29.915752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-475dda90-05bd-4f68-943b-e186294e34d0 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:29.994661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-475dda90-05bd-4f68-943b-e186294e34d0 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:30.003852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-475dda90-05bd-4f68-943b-e186294e34d0 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:30.005714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-475dda90-05bd-4f68-943b-e186294e34d0 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:30.007071 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-475dda90-05bd-4f68-943b-e186294e34d0 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456" status: 200 len: 1319 microversion: 2.26 time: 0.110594 May 28 04:41:30.019246 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1030/1997] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:29 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 => generated 1319 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:30.025015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-59cf1fc2-1c20-422e-a5af-98cf7453c869 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Calling method '.version_select at 0x7f770212a1f0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:30.028319 n-d-843700-1 devstack@n-api.service[126044]: WARNING oslo_db.sqlalchemy.utils [None req-59cf1fc2-1c20-422e-a5af-98cf7453c869 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Unique keys not in sort_keys. The sorting order may be unstable. May 28 04:41:30.042172 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-59cf1fc2-1c20-422e-a5af-98cf7453c869 tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.021312 May 28 04:41:30.043693 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1031/1998] 10.222.0.58 () {60 vars in 1176 bytes} [Sat May 28 04:41:30 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:30.050449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-497a342e-3fa2-42e1-9c75-a66047da373e tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:30.052531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-497a342e-3fa2-42e1-9c75-a66047da373e tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:30.060074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-497a342e-3fa2-42e1-9c75-a66047da373e tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:30.060522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-497a342e-3fa2-42e1-9c75-a66047da373e tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:30.061558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-497a342e-3fa2-42e1-9c75-a66047da373e tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:30.062159 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-497a342e-3fa2-42e1-9c75-a66047da373e tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:30.092480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0a91787c-ab72-40b0-97ea-367c855c9b09 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:30.100286 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0a91787c-ab72-40b0-97ea-367c855c9b09 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1318 microversion: 2.1 time: 0.250067 May 28 04:41:30.101358 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 968/1999] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:29 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:30.105836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7f9ea6a3-5415-43a8-8426-f77f411fb2cf tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] Calling method '.version_select at 0x7f770740a790>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:30.222746 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-497a342e-3fa2-42e1-9c75-a66047da373e tempest-LiveMigrationTest-170127060 tempest-LiveMigrationTest-170127060-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1534 microversion: 2.1 time: 0.177421 May 28 04:41:30.223357 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1032/2000] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:30 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1534 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:30.227878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9fb23250-b013-4e05-8ffe-92977c953d57 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:30.228479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9fb23250-b013-4e05-8ffe-92977c953d57 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:30.235749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fb23250-b013-4e05-8ffe-92977c953d57 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:30.236203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fb23250-b013-4e05-8ffe-92977c953d57 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:30.237190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fb23250-b013-4e05-8ffe-92977c953d57 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:30.238043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fb23250-b013-4e05-8ffe-92977c953d57 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:30.244100 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7f9ea6a3-5415-43a8-8426-f77f411fb2cf tempest-KeyPairsV22TestJSON-1048710758 tempest-KeyPairsV22TestJSON-1048710758-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-847056412" status: 204 len: 0 microversion: 2.2 time: 0.142074 May 28 04:41:30.254430 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 969/2001] 10.222.0.58 () {60 vars in 1257 bytes} [Sat May 28 04:41:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-847056412 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:41:30.265663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b083d1f3-4542-41d6-9b94-79491e4ca377 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:30.266587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b083d1f3-4542-41d6-9b94-79491e4ca377 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:30.278129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b083d1f3-4542-41d6-9b94-79491e4ca377 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:30.278976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b083d1f3-4542-41d6-9b94-79491e4ca377 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:30.280236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b083d1f3-4542-41d6-9b94-79491e4ca377 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:30.280857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b083d1f3-4542-41d6-9b94-79491e4ca377 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:30.319432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b083d1f3-4542-41d6-9b94-79491e4ca377 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:41:30.404401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9fb23250-b013-4e05-8ffe-92977c953d57 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:30.412600 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9fb23250-b013-4e05-8ffe-92977c953d57 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1292 microversion: 2.1 time: 0.188197 May 28 04:41:30.413188 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1033/2002] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:30 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1292 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:30.789517 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b083d1f3-4542-41d6-9b94-79491e4ca377 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 204 len: 0 microversion: 2.1 time: 0.527489 May 28 04:41:30.794308 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 970/2003] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:41:30 2022] DELETE /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 04:41:30.799362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ca55a44f-d04a-4ffe-bd14-db30e488b5c1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:30.800087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ca55a44f-d04a-4ffe-bd14-db30e488b5c1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:30.807278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca55a44f-d04a-4ffe-bd14-db30e488b5c1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:30.807737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca55a44f-d04a-4ffe-bd14-db30e488b5c1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:30.814773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca55a44f-d04a-4ffe-bd14-db30e488b5c1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:30.814773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca55a44f-d04a-4ffe-bd14-db30e488b5c1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:30.852508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6977b101-827f-4f50-b14a-bd01fdaf2eb7 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:30.852508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6977b101-827f-4f50-b14a-bd01fdaf2eb7 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 2e714899-ae82-47c5-bd72-a65a0b4734a4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:30.859260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6977b101-827f-4f50-b14a-bd01fdaf2eb7 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:30.859861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6977b101-827f-4f50-b14a-bd01fdaf2eb7 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:30.861479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6977b101-827f-4f50-b14a-bd01fdaf2eb7 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:30.861918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6977b101-827f-4f50-b14a-bd01fdaf2eb7 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:31.040284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ca55a44f-d04a-4ffe-bd14-db30e488b5c1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:31.052195 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ca55a44f-d04a-4ffe-bd14-db30e488b5c1 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1389 microversion: 2.1 time: 0.256658 May 28 04:41:31.052759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6977b101-827f-4f50-b14a-bd01fdaf2eb7 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:31.057339 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1034/2004] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:30 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1389 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:31.069210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b4c76659-bf0d-432a-a973-24192b36462f tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:31.069210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b4c76659-bf0d-432a-a973-24192b36462f tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:31.072402 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6977b101-827f-4f50-b14a-bd01fdaf2eb7 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4" status: 200 len: 1312 microversion: 2.1 time: 0.228633 May 28 04:41:31.073381 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 971/2005] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:30 2022] GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4 => generated 1312 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:31.082127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4c76659-bf0d-432a-a973-24192b36462f tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:31.082847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4c76659-bf0d-432a-a973-24192b36462f tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:31.083862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4c76659-bf0d-432a-a973-24192b36462f tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:31.084479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4c76659-bf0d-432a-a973-24192b36462f tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:31.095133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3b179e24-53fc-49a9-a6e6-ad5445e500f6 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:31.099042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3b179e24-53fc-49a9-a6e6-ad5445e500f6 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:31.132477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b179e24-53fc-49a9-a6e6-ad5445e500f6 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:31.138324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b179e24-53fc-49a9-a6e6-ad5445e500f6 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:31.138324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b179e24-53fc-49a9-a6e6-ad5445e500f6 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:31.138324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b179e24-53fc-49a9-a6e6-ad5445e500f6 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:31.356074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b4c76659-bf0d-432a-a973-24192b36462f tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:31.367726 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b4c76659-bf0d-432a-a973-24192b36462f tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1372 microversion: 2.1 time: 0.308739 May 28 04:41:31.368325 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1035/2006] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:31 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1372 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:31.373354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5c6a3126-e26f-4893-a33b-e3ba60ac526c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:31.374209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5c6a3126-e26f-4893-a33b-e3ba60ac526c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:31.382639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c6a3126-e26f-4893-a33b-e3ba60ac526c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:31.383247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c6a3126-e26f-4893-a33b-e3ba60ac526c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:31.384230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c6a3126-e26f-4893-a33b-e3ba60ac526c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:31.385459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c6a3126-e26f-4893-a33b-e3ba60ac526c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:31.413322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3b179e24-53fc-49a9-a6e6-ad5445e500f6 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:31.426906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3b179e24-53fc-49a9-a6e6-ad5445e500f6 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:31.428804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3b179e24-53fc-49a9-a6e6-ad5445e500f6 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:31.430216 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3b179e24-53fc-49a9-a6e6-ad5445e500f6 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456" status: 200 len: 1361 microversion: 2.26 time: 0.355776 May 28 04:41:31.431007 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 972/2007] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:31 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 => generated 1361 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:31.449169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-6749a90f-25dd-4fbc-9053-270a4eb89f71 req-df741963-d486-4484-80cb-f2157219d6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5", "name": "network-vif-plugged", "status": "completed", "tag": "8377d9fd-2493-4628-960b-9f1440849e31"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:31.460035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-6749a90f-25dd-4fbc-9053-270a4eb89f71 req-df741963-d486-4484-80cb-f2157219d6a4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:31.461575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-6749a90f-25dd-4fbc-9053-270a4eb89f71 req-df741963-d486-4484-80cb-f2157219d6a4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:31.474816 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-6749a90f-25dd-4fbc-9053-270a4eb89f71 req-df741963-d486-4484-80cb-f2157219d6a4 service nova] Creating event network-vif-plugged:8377d9fd-2493-4628-960b-9f1440849e31 for instance b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 on n-h1-843700-1 May 28 04:41:31.480296 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-6749a90f-25dd-4fbc-9053-270a4eb89f71 req-df741963-d486-4484-80cb-f2157219d6a4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036336 May 28 04:41:31.481230 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 973/2008] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:31.487965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1f0a916c-5b8c-48dc-8c5e-24a25e74be9d tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:31.488743 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1f0a916c-5b8c-48dc-8c5e-24a25e74be9d tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:31.497698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1f0a916c-5b8c-48dc-8c5e-24a25e74be9d tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:31.501160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1f0a916c-5b8c-48dc-8c5e-24a25e74be9d tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:31.501160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1f0a916c-5b8c-48dc-8c5e-24a25e74be9d tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:31.501160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1f0a916c-5b8c-48dc-8c5e-24a25e74be9d tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:31.757690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5c6a3126-e26f-4893-a33b-e3ba60ac526c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:31.773542 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5c6a3126-e26f-4893-a33b-e3ba60ac526c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1318 microversion: 2.1 time: 0.403137 May 28 04:41:31.773542 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1036/2009] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:31 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:31.897798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-afcd3bf6-2067-4a1e-9d3d-e85eb8642429 req-50328d5f-096b-408a-b757-545b5d78768a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f9a53c-0202-4e9d-bf42-6b3c376b535f", "tag": "07124fc5-e96a-4da8-80b4-66723ac47caf"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:31.907603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-afcd3bf6-2067-4a1e-9d3d-e85eb8642429 req-50328d5f-096b-408a-b757-545b5d78768a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:31.911924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-afcd3bf6-2067-4a1e-9d3d-e85eb8642429 req-50328d5f-096b-408a-b757-545b5d78768a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:31.923615 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-afcd3bf6-2067-4a1e-9d3d-e85eb8642429 req-50328d5f-096b-408a-b757-545b5d78768a service nova] Creating event network-changed:07124fc5-e96a-4da8-80b4-66723ac47caf for instance 16f9a53c-0202-4e9d-bf42-6b3c376b535f on n-h2-843700-1 May 28 04:41:31.930508 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-afcd3bf6-2067-4a1e-9d3d-e85eb8642429 req-50328d5f-096b-408a-b757-545b5d78768a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036283 May 28 04:41:31.931348 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1037/2010] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:41:31.966057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1f0a916c-5b8c-48dc-8c5e-24a25e74be9d tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:31.980520 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1f0a916c-5b8c-48dc-8c5e-24a25e74be9d tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1292 microversion: 2.1 time: 0.497833 May 28 04:41:31.981120 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 974/2011] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:31 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1292 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:32.074891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-651eb8df-ec3d-4ca3-8b34-8f2b21c50829 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:32.077360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-651eb8df-ec3d-4ca3-8b34-8f2b21c50829 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:32.094156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a43b8c17-c268-4f1a-b694-6b29d744d9d6 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:32.095758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a43b8c17-c268-4f1a-b694-6b29d744d9d6 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 2e714899-ae82-47c5-bd72-a65a0b4734a4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:32.105985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a43b8c17-c268-4f1a-b694-6b29d744d9d6 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:32.106712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a43b8c17-c268-4f1a-b694-6b29d744d9d6 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:32.109039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a43b8c17-c268-4f1a-b694-6b29d744d9d6 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:32.110194 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a43b8c17-c268-4f1a-b694-6b29d744d9d6 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:32.120157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-651eb8df-ec3d-4ca3-8b34-8f2b21c50829 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:32.124383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-651eb8df-ec3d-4ca3-8b34-8f2b21c50829 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:32.124383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-651eb8df-ec3d-4ca3-8b34-8f2b21c50829 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:32.124383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-651eb8df-ec3d-4ca3-8b34-8f2b21c50829 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:32.513684 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a43b8c17-c268-4f1a-b694-6b29d744d9d6 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:32.521731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-651eb8df-ec3d-4ca3-8b34-8f2b21c50829 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:32.525387 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a43b8c17-c268-4f1a-b694-6b29d744d9d6 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4" status: 200 len: 1312 microversion: 2.1 time: 0.439026 May 28 04:41:32.525977 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 975/2012] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:32 2022] GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4 => generated 1312 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:32.529768 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-651eb8df-ec3d-4ca3-8b34-8f2b21c50829 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1389 microversion: 2.1 time: 0.460722 May 28 04:41:32.530471 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1038/2013] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:32 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1389 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:41:32.533309 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e9a04a91-90ff-4997-af70-ec7ecb84466a tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:32.534774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e9a04a91-90ff-4997-af70-ec7ecb84466a tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:32.536658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-917dec16-b40d-49f1-bfcb-6f2dd7a037ea tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:32.537607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-917dec16-b40d-49f1-bfcb-6f2dd7a037ea tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:32.545040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9a04a91-90ff-4997-af70-ec7ecb84466a tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:32.545040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9a04a91-90ff-4997-af70-ec7ecb84466a tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:32.545457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-917dec16-b40d-49f1-bfcb-6f2dd7a037ea tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:32.545602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9a04a91-90ff-4997-af70-ec7ecb84466a tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:32.545909 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9a04a91-90ff-4997-af70-ec7ecb84466a tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:32.546488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-917dec16-b40d-49f1-bfcb-6f2dd7a037ea tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:32.548671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-917dec16-b40d-49f1-bfcb-6f2dd7a037ea tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:32.549586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-917dec16-b40d-49f1-bfcb-6f2dd7a037ea tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:32.792125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-917dec16-b40d-49f1-bfcb-6f2dd7a037ea tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:32.796405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:32.804039 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-917dec16-b40d-49f1-bfcb-6f2dd7a037ea tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:32.806656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-917dec16-b40d-49f1-bfcb-6f2dd7a037ea tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:32.808220 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-917dec16-b40d-49f1-bfcb-6f2dd7a037ea tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456" status: 200 len: 1361 microversion: 2.26 time: 0.276590 May 28 04:41:32.809648 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1039/2014] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:32 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 => generated 1361 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:32.816958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7d9d594a-1f65-4fbd-a920-614a23e7f661 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:32.819539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7d9d594a-1f65-4fbd-a920-614a23e7f661 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:32.827813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d9d594a-1f65-4fbd-a920-614a23e7f661 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:32.829014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d9d594a-1f65-4fbd-a920-614a23e7f661 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:32.829882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d9d594a-1f65-4fbd-a920-614a23e7f661 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:32.830397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d9d594a-1f65-4fbd-a920-614a23e7f661 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:32.875508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e9a04a91-90ff-4997-af70-ec7ecb84466a tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:32.899829 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e9a04a91-90ff-4997-af70-ec7ecb84466a tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1555 microversion: 2.1 time: 0.362707 May 28 04:41:32.899829 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 976/2015] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:32 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1555 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:32.924090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-29e9fa3c-12b7-441d-86c0-53e88ebb85ca req-d237164e-5b97-4bcb-b6cb-3f222c9fa5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2fe6e3-8187-4ba2-b31d-10b4f602b332", "name": "network-vif-deleted", "tag": "3031f11b-74bc-424b-8498-fb24d06f2874"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:32.940187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-29e9fa3c-12b7-441d-86c0-53e88ebb85ca req-d237164e-5b97-4bcb-b6cb-3f222c9fa5f3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:32.940713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-29e9fa3c-12b7-441d-86c0-53e88ebb85ca req-d237164e-5b97-4bcb-b6cb-3f222c9fa5f3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:32.968241 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-29e9fa3c-12b7-441d-86c0-53e88ebb85ca req-d237164e-5b97-4bcb-b6cb-3f222c9fa5f3 service nova] Creating event network-vif-deleted:3031f11b-74bc-424b-8498-fb24d06f2874 for instance ac2fe6e3-8187-4ba2-b31d-10b4f602b332 on n-h1-843700-1 May 28 04:41:32.984343 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-29e9fa3c-12b7-441d-86c0-53e88ebb85ca req-d237164e-5b97-4bcb-b6cb-3f222c9fa5f3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067288 May 28 04:41:32.985015 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 977/2016] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:32.997209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f4e547ad-69d3-4ffb-9d13-41bd65227543 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:32.997817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f4e547ad-69d3-4ffb-9d13-41bd65227543 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:33.016735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4e547ad-69d3-4ffb-9d13-41bd65227543 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:33.018355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4e547ad-69d3-4ffb-9d13-41bd65227543 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:33.018355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4e547ad-69d3-4ffb-9d13-41bd65227543 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:33.018587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4e547ad-69d3-4ffb-9d13-41bd65227543 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:33.166425 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f4e547ad-69d3-4ffb-9d13-41bd65227543 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180181 May 28 04:41:33.167553 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 978/2017] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 04:41:32 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:33.173136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-734220ff-7ef2-4fe9-8efe-ca3f66ea4a9c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:33.174143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-734220ff-7ef2-4fe9-8efe-ca3f66ea4a9c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:33.183335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-734220ff-7ef2-4fe9-8efe-ca3f66ea4a9c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:33.190851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-734220ff-7ef2-4fe9-8efe-ca3f66ea4a9c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:33.190851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-734220ff-7ef2-4fe9-8efe-ca3f66ea4a9c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:33.190851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-734220ff-7ef2-4fe9-8efe-ca3f66ea4a9c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:33.359376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7d9d594a-1f65-4fbd-a920-614a23e7f661 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:33.372423 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7d9d594a-1f65-4fbd-a920-614a23e7f661 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1318 microversion: 2.1 time: 0.560159 May 28 04:41:33.373331 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1040/2018] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:32 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1318 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:33.553646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1d3e090f-eb84-4564-9d05-27799eeb36fd tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:33.554572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1d3e090f-eb84-4564-9d05-27799eeb36fd tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 2e714899-ae82-47c5-bd72-a65a0b4734a4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:33.568199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-734220ff-7ef2-4fe9-8efe-ca3f66ea4a9c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:33.572527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:33.590196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d3e090f-eb84-4564-9d05-27799eeb36fd tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:33.590666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d3e090f-eb84-4564-9d05-27799eeb36fd tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:33.591499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d3e090f-eb84-4564-9d05-27799eeb36fd tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:33.591945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d3e090f-eb84-4564-9d05-27799eeb36fd tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:33.592743 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-734220ff-7ef2-4fe9-8efe-ca3f66ea4a9c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1292 microversion: 2.1 time: 0.418179 May 28 04:41:33.593641 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 979/2019] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:33 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1292 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:33.603996 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-743131b4-28ce-4db6-8f2b-7094a86589ac tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:33.605623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-743131b4-28ce-4db6-8f2b-7094a86589ac tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:33.624365 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-743131b4-28ce-4db6-8f2b-7094a86589ac tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:33.624827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-743131b4-28ce-4db6-8f2b-7094a86589ac tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:33.625617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-743131b4-28ce-4db6-8f2b-7094a86589ac tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:33.626062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-743131b4-28ce-4db6-8f2b-7094a86589ac tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:34.034428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-743131b4-28ce-4db6-8f2b-7094a86589ac tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:34.044887 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-743131b4-28ce-4db6-8f2b-7094a86589ac tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1184 microversion: 2.1 time: 0.450002 May 28 04:41:34.049016 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 980/2020] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:33 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1184 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:34.054333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b91dd172-8fd2-4fe9-95a5-a68579200c53 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:34.055615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b91dd172-8fd2-4fe9-95a5-a68579200c53 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:34.066288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b91dd172-8fd2-4fe9-95a5-a68579200c53 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:34.068844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b91dd172-8fd2-4fe9-95a5-a68579200c53 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:34.070145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b91dd172-8fd2-4fe9-95a5-a68579200c53 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:34.071114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b91dd172-8fd2-4fe9-95a5-a68579200c53 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:34.206493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:34.361912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1d3e090f-eb84-4564-9d05-27799eeb36fd tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:34.380707 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1d3e090f-eb84-4564-9d05-27799eeb36fd tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4" status: 200 len: 1312 microversion: 2.1 time: 0.837727 May 28 04:41:34.383959 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1041/2021] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:33 2022] GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4 => generated 1312 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:41:34.391452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-dac92583-1faa-4a52-9dee-32271e2f2163 req-5712e4af-50e5-4df5-9965-82804b24d423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e714899-ae82-47c5-bd72-a65a0b4734a4", "tag": "ab17ea28-3974-4717-9100-cb1f12026e9f"}, {"name": "network-changed", "server_uuid": "700c00f1-c8d2-44e4-a015-cc6168d9b456", "tag": "929e4c25-a182-48aa-8642-8a664b22dbe2"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:34.410540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-dac92583-1faa-4a52-9dee-32271e2f2163 req-5712e4af-50e5-4df5-9965-82804b24d423 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:34.422242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-dac92583-1faa-4a52-9dee-32271e2f2163 req-5712e4af-50e5-4df5-9965-82804b24d423 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:34.428591 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-dac92583-1faa-4a52-9dee-32271e2f2163 req-5712e4af-50e5-4df5-9965-82804b24d423 service nova] Creating event network-changed:ab17ea28-3974-4717-9100-cb1f12026e9f for instance 2e714899-ae82-47c5-bd72-a65a0b4734a4 on n-h1-843700-1 May 28 04:41:34.429552 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-dac92583-1faa-4a52-9dee-32271e2f2163 req-5712e4af-50e5-4df5-9965-82804b24d423 service nova] Creating event network-changed:929e4c25-a182-48aa-8642-8a664b22dbe2 for instance 700c00f1-c8d2-44e4-a015-cc6168d9b456 on n-h2-843700-1 May 28 04:41:34.435823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b91dd172-8fd2-4fe9-95a5-a68579200c53 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:34.440187 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-dac92583-1faa-4a52-9dee-32271e2f2163 req-5712e4af-50e5-4df5-9965-82804b24d423 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.052633 May 28 04:41:34.440944 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1042/2022] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:34.451616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e06fafd3-9452-48df-b173-44a68fc6ad4a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:34.452150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b91dd172-8fd2-4fe9-95a5-a68579200c53 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:34.452736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e06fafd3-9452-48df-b173-44a68fc6ad4a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:34.454376 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b91dd172-8fd2-4fe9-95a5-a68579200c53 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:34.456771 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b91dd172-8fd2-4fe9-95a5-a68579200c53 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456" status: 200 len: 1361 microversion: 2.26 time: 0.409103 May 28 04:41:34.461398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e06fafd3-9452-48df-b173-44a68fc6ad4a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:34.462698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e06fafd3-9452-48df-b173-44a68fc6ad4a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:34.463739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e06fafd3-9452-48df-b173-44a68fc6ad4a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:34.464399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e06fafd3-9452-48df-b173-44a68fc6ad4a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:34.469471 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 981/2023] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:34 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 => generated 1361 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:34.613106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9aba37e8-56b1-40c9-ab33-f252fa584049 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:34.613913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9aba37e8-56b1-40c9-ab33-f252fa584049 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:34.629194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e06fafd3-9452-48df-b173-44a68fc6ad4a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:34.630771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9aba37e8-56b1-40c9-ab33-f252fa584049 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:34.633414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9aba37e8-56b1-40c9-ab33-f252fa584049 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:34.638186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9aba37e8-56b1-40c9-ab33-f252fa584049 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:34.640406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9aba37e8-56b1-40c9-ab33-f252fa584049 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:34.640603 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e06fafd3-9452-48df-b173-44a68fc6ad4a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1318 microversion: 2.1 time: 0.193391 May 28 04:41:34.652541 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1043/2024] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:34 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:35.001652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9aba37e8-56b1-40c9-ab33-f252fa584049 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:35.016046 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9aba37e8-56b1-40c9-ab33-f252fa584049 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1483 microversion: 2.1 time: 0.408024 May 28 04:41:35.026410 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 982/2025] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:34 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1483 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:41:35.058191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-17b7a30a-bf83-4769-a2d5-8bdedd9a62f4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:35.058191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-17b7a30a-bf83-4769-a2d5-8bdedd9a62f4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:35.063641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f1e509bc-0879-437a-97ad-b4d5845c4001 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:35.064256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f1e509bc-0879-437a-97ad-b4d5845c4001 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:35.080799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1e509bc-0879-437a-97ad-b4d5845c4001 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:35.081253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1e509bc-0879-437a-97ad-b4d5845c4001 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:35.082036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1e509bc-0879-437a-97ad-b4d5845c4001 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:35.082474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1e509bc-0879-437a-97ad-b4d5845c4001 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:35.086766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-17b7a30a-bf83-4769-a2d5-8bdedd9a62f4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:35.087250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-17b7a30a-bf83-4769-a2d5-8bdedd9a62f4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:35.088183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-17b7a30a-bf83-4769-a2d5-8bdedd9a62f4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:35.088620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-17b7a30a-bf83-4769-a2d5-8bdedd9a62f4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:35.267694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f1e509bc-0879-437a-97ad-b4d5845c4001 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:35.280015 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f1e509bc-0879-437a-97ad-b4d5845c4001 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1184 microversion: 2.1 time: 0.220179 May 28 04:41:35.290741 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 983/2026] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:35 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1184 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:41:35.301681 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-17b7a30a-bf83-4769-a2d5-8bdedd9a62f4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.251364 May 28 04:41:35.302715 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1044/2027] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 04:41:35 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5/os-interface => generated 284 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:35.400941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-edfe1b42-dd17-4aa8-9003-95cc69158f86 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:35.402132 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-edfe1b42-dd17-4aa8-9003-95cc69158f86 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 2e714899-ae82-47c5-bd72-a65a0b4734a4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:35.413260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-edfe1b42-dd17-4aa8-9003-95cc69158f86 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:35.417898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-edfe1b42-dd17-4aa8-9003-95cc69158f86 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:35.418969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-edfe1b42-dd17-4aa8-9003-95cc69158f86 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:35.422351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-edfe1b42-dd17-4aa8-9003-95cc69158f86 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:35.485215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d90c61b4-cfab-4a3e-afae-657dc7d13df2 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:35.485215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d90c61b4-cfab-4a3e-afae-657dc7d13df2 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:35.499066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d90c61b4-cfab-4a3e-afae-657dc7d13df2 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:35.501571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d90c61b4-cfab-4a3e-afae-657dc7d13df2 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:35.504502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d90c61b4-cfab-4a3e-afae-657dc7d13df2 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:35.506906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d90c61b4-cfab-4a3e-afae-657dc7d13df2 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:35.548889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:36.138522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-edfe1b42-dd17-4aa8-9003-95cc69158f86 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:36.147900 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-edfe1b42-dd17-4aa8-9003-95cc69158f86 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4" status: 200 len: 1312 microversion: 2.1 time: 0.751210 May 28 04:41:36.159216 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 984/2028] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:35 2022] GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4 => generated 1312 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:36.166221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-68fc73c6-6aab-49e1-8891-875cbefddc2d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:36.166865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-68fc73c6-6aab-49e1-8891-875cbefddc2d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:36.172464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d90c61b4-cfab-4a3e-afae-657dc7d13df2 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:36.176017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68fc73c6-6aab-49e1-8891-875cbefddc2d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:36.176517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68fc73c6-6aab-49e1-8891-875cbefddc2d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:36.178163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68fc73c6-6aab-49e1-8891-875cbefddc2d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:36.178280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68fc73c6-6aab-49e1-8891-875cbefddc2d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:36.188105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d90c61b4-cfab-4a3e-afae-657dc7d13df2 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:36.193662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d90c61b4-cfab-4a3e-afae-657dc7d13df2 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:36.194863 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d90c61b4-cfab-4a3e-afae-657dc7d13df2 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456" status: 200 len: 1361 microversion: 2.26 time: 0.720410 May 28 04:41:36.199783 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1045/2029] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:35 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 => generated 1361 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:36.212972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-a6409748-a75e-4681-823a-2a9dc91620c8 req-0696f0b4-6de6-4099-87d8-d8fd516a5ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f4e280f-6de0-467b-b4ac-c13f9e780963", "tag": "6d445514-75cc-4831-8830-2257b5e25b63"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:36.224244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a6409748-a75e-4681-823a-2a9dc91620c8 req-0696f0b4-6de6-4099-87d8-d8fd516a5ad1 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:36.224973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a6409748-a75e-4681-823a-2a9dc91620c8 req-0696f0b4-6de6-4099-87d8-d8fd516a5ad1 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:36.244665 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-a6409748-a75e-4681-823a-2a9dc91620c8 req-0696f0b4-6de6-4099-87d8-d8fd516a5ad1 service nova] Creating event network-changed:6d445514-75cc-4831-8830-2257b5e25b63 for instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 on n-h2-843700-1 May 28 04:41:36.250285 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-a6409748-a75e-4681-823a-2a9dc91620c8 req-0696f0b4-6de6-4099-87d8-d8fd516a5ad1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043615 May 28 04:41:36.252088 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1046/2030] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:36.301198 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-279b91cf-e7d1-4c6c-a5e7-15b3713c1e9c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:36.302182 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-279b91cf-e7d1-4c6c-a5e7-15b3713c1e9c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:36.314590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-279b91cf-e7d1-4c6c-a5e7-15b3713c1e9c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:36.319601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-279b91cf-e7d1-4c6c-a5e7-15b3713c1e9c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:36.320750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-279b91cf-e7d1-4c6c-a5e7-15b3713c1e9c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:36.321201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-279b91cf-e7d1-4c6c-a5e7-15b3713c1e9c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:36.337107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=16 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:36.789724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-68fc73c6-6aab-49e1-8891-875cbefddc2d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:36.799278 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-68fc73c6-6aab-49e1-8891-875cbefddc2d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1318 microversion: 2.1 time: 0.638683 May 28 04:41:36.803624 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 985/2031] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:36 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:36.845099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-279b91cf-e7d1-4c6c-a5e7-15b3713c1e9c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:36.855286 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-279b91cf-e7d1-4c6c-a5e7-15b3713c1e9c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1184 microversion: 2.1 time: 0.561579 May 28 04:41:36.860237 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1047/2032] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:36 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1184 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:41:37.167063 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-530e0360-04b1-4e8c-9a7b-1cf89adb5919 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:37.177162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-530e0360-04b1-4e8c-9a7b-1cf89adb5919 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 2e714899-ae82-47c5-bd72-a65a0b4734a4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:37.190523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-530e0360-04b1-4e8c-9a7b-1cf89adb5919 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:37.194109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-530e0360-04b1-4e8c-9a7b-1cf89adb5919 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:37.196924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-530e0360-04b1-4e8c-9a7b-1cf89adb5919 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:37.198541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-530e0360-04b1-4e8c-9a7b-1cf89adb5919 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:37.225546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a53f396d-2ef1-4610-a201-bfb093890f3f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:37.227063 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a53f396d-2ef1-4610-a201-bfb093890f3f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:37.236820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a53f396d-2ef1-4610-a201-bfb093890f3f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:37.244533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a53f396d-2ef1-4610-a201-bfb093890f3f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:37.247412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a53f396d-2ef1-4610-a201-bfb093890f3f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:37.249366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a53f396d-2ef1-4610-a201-bfb093890f3f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:37.777017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-530e0360-04b1-4e8c-9a7b-1cf89adb5919 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:37.788103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a53f396d-2ef1-4610-a201-bfb093890f3f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:37.789428 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-530e0360-04b1-4e8c-9a7b-1cf89adb5919 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4" status: 200 len: 1312 microversion: 2.1 time: 0.628356 May 28 04:41:37.800938 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 986/2033] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:37 2022] GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4 => generated 1312 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:37.806656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a53f396d-2ef1-4610-a201-bfb093890f3f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:37.813489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a53f396d-2ef1-4610-a201-bfb093890f3f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:37.815212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-c547b9ad-8ba2-4dc5-8098-a12617c95859 req-7aa87af0-359e-423c-b352-ddc24f164085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f9a53c-0202-4e9d-bf42-6b3c376b535f", "name": "network-vif-plugged", "status": "completed", "tag": "07124fc5-e96a-4da8-80b4-66723ac47caf"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:37.819863 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a53f396d-2ef1-4610-a201-bfb093890f3f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456" status: 200 len: 1361 microversion: 2.26 time: 0.605249 May 28 04:41:37.833492 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1048/2034] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:37 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 => generated 1361 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:37.847220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d502377a-0bec-4c98-bdbd-47997d737bb1 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:37.849515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d502377a-0bec-4c98-bdbd-47997d737bb1 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:37.852249 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c547b9ad-8ba2-4dc5-8098-a12617c95859 req-7aa87af0-359e-423c-b352-ddc24f164085 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:37.860052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c547b9ad-8ba2-4dc5-8098-a12617c95859 req-7aa87af0-359e-423c-b352-ddc24f164085 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:37.879864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d502377a-0bec-4c98-bdbd-47997d737bb1 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:37.880399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d502377a-0bec-4c98-bdbd-47997d737bb1 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:37.883585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d502377a-0bec-4c98-bdbd-47997d737bb1 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:37.884093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d502377a-0bec-4c98-bdbd-47997d737bb1 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:37.884913 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-c547b9ad-8ba2-4dc5-8098-a12617c95859 req-7aa87af0-359e-423c-b352-ddc24f164085 service nova] Creating event network-vif-plugged:07124fc5-e96a-4da8-80b4-66723ac47caf for instance 16f9a53c-0202-4e9d-bf42-6b3c376b535f on n-h2-843700-1 May 28 04:41:37.890647 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-c547b9ad-8ba2-4dc5-8098-a12617c95859 req-7aa87af0-359e-423c-b352-ddc24f164085 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088021 May 28 04:41:37.892210 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 987/2035] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:37.899473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-362cf078-4375-4ba8-841b-eb27812081f4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:37.902053 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-362cf078-4375-4ba8-841b-eb27812081f4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:37.910319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-362cf078-4375-4ba8-841b-eb27812081f4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:37.911400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-362cf078-4375-4ba8-841b-eb27812081f4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:37.913050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-362cf078-4375-4ba8-841b-eb27812081f4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:37.913727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-362cf078-4375-4ba8-841b-eb27812081f4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:38.031986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-362cf078-4375-4ba8-841b-eb27812081f4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:38.046981 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-362cf078-4375-4ba8-841b-eb27812081f4 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1184 microversion: 2.1 time: 0.153143 May 28 04:41:38.047974 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 988/2036] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:37 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1184 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:38.217205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d502377a-0bec-4c98-bdbd-47997d737bb1 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:38.240560 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d502377a-0bec-4c98-bdbd-47997d737bb1 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1318 microversion: 2.1 time: 0.415866 May 28 04:41:38.245262 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1049/2037] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:37 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:38.505927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eec872f1-25df-4042-b8b2-729b25d4ec20 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:38.505927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eec872f1-25df-4042-b8b2-729b25d4ec20 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:38.517311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eec872f1-25df-4042-b8b2-729b25d4ec20 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:38.518051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eec872f1-25df-4042-b8b2-729b25d4ec20 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:38.519295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eec872f1-25df-4042-b8b2-729b25d4ec20 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:38.521144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-a301d47a-ebbf-4aac-a009-712f23f44526 req-54219468-4d40-43b5-b569-2b8e46ded379 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5", "tag": "8377d9fd-2493-4628-960b-9f1440849e31"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:38.523923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eec872f1-25df-4042-b8b2-729b25d4ec20 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:38.553271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a301d47a-ebbf-4aac-a009-712f23f44526 req-54219468-4d40-43b5-b569-2b8e46ded379 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:38.555657 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a301d47a-ebbf-4aac-a009-712f23f44526 req-54219468-4d40-43b5-b569-2b8e46ded379 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:38.591722 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-a301d47a-ebbf-4aac-a009-712f23f44526 req-54219468-4d40-43b5-b569-2b8e46ded379 service nova] Creating event network-changed:8377d9fd-2493-4628-960b-9f1440849e31 for instance b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 on n-h1-843700-1 May 28 04:41:38.602134 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-a301d47a-ebbf-4aac-a009-712f23f44526 req-54219468-4d40-43b5-b569-2b8e46ded379 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098641 May 28 04:41:38.606755 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1050/2038] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:38.810168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-49c287b2-0b04-4850-bd9a-1f9e82fbbab3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:38.810892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-49c287b2-0b04-4850-bd9a-1f9e82fbbab3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 2e714899-ae82-47c5-bd72-a65a0b4734a4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:38.827555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49c287b2-0b04-4850-bd9a-1f9e82fbbab3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:38.828049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49c287b2-0b04-4850-bd9a-1f9e82fbbab3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:38.832876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49c287b2-0b04-4850-bd9a-1f9e82fbbab3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:38.832876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49c287b2-0b04-4850-bd9a-1f9e82fbbab3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:39.012238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eec872f1-25df-4042-b8b2-729b25d4ec20 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:39.022575 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eec872f1-25df-4042-b8b2-729b25d4ec20 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1483 microversion: 2.1 time: 0.527076 May 28 04:41:39.028673 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 989/2039] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:38 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1483 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:39.033693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3ecccddb-ef59-4624-b897-1e8d73201417 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:39.042004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3ecccddb-ef59-4624-b897-1e8d73201417 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:39.057582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ecccddb-ef59-4624-b897-1e8d73201417 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:39.059913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ecccddb-ef59-4624-b897-1e8d73201417 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:39.063862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ecccddb-ef59-4624-b897-1e8d73201417 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:39.064552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ecccddb-ef59-4624-b897-1e8d73201417 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:39.140112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-49c287b2-0b04-4850-bd9a-1f9e82fbbab3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:39.152998 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-49c287b2-0b04-4850-bd9a-1f9e82fbbab3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4" status: 200 len: 1312 microversion: 2.1 time: 0.348476 May 28 04:41:39.168676 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1051/2040] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:38 2022] GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4 => generated 1312 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:39.185094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5eb47581-eb45-4466-ac0d-735ae1600b37 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:39.189869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5eb47581-eb45-4466-ac0d-735ae1600b37 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:39.213192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5eb47581-eb45-4466-ac0d-735ae1600b37 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:39.213663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5eb47581-eb45-4466-ac0d-735ae1600b37 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:39.221819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5eb47581-eb45-4466-ac0d-735ae1600b37 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:39.222449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5eb47581-eb45-4466-ac0d-735ae1600b37 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:39.406862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=62 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:39.407685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5eb47581-eb45-4466-ac0d-735ae1600b37 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:39.424735 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5eb47581-eb45-4466-ac0d-735ae1600b37 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1184 microversion: 2.1 time: 0.254809 May 28 04:41:39.426593 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1052/2041] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:39 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1184 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:39.434874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-55ef1899-74cd-4bb9-b018-540c8835fc78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:39.443482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-55ef1899-74cd-4bb9-b018-540c8835fc78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:39.454235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3ecccddb-ef59-4624-b897-1e8d73201417 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:39.459988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55ef1899-74cd-4bb9-b018-540c8835fc78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:39.462487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55ef1899-74cd-4bb9-b018-540c8835fc78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:39.463468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55ef1899-74cd-4bb9-b018-540c8835fc78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:39.465697 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55ef1899-74cd-4bb9-b018-540c8835fc78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:39.469045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3ecccddb-ef59-4624-b897-1e8d73201417 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:39.470834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3ecccddb-ef59-4624-b897-1e8d73201417 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:39.473209 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3ecccddb-ef59-4624-b897-1e8d73201417 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456" status: 200 len: 1361 microversion: 2.26 time: 0.443372 May 28 04:41:39.477862 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 990/2042] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:39 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 => generated 1361 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:40.171428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cc70bd71-d6ed-494d-a38a-d5aa7d4ed5a6 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:40.173893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cc70bd71-d6ed-494d-a38a-d5aa7d4ed5a6 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 2e714899-ae82-47c5-bd72-a65a0b4734a4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:40.193837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc70bd71-d6ed-494d-a38a-d5aa7d4ed5a6 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:40.196133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc70bd71-d6ed-494d-a38a-d5aa7d4ed5a6 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:40.201717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc70bd71-d6ed-494d-a38a-d5aa7d4ed5a6 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:40.202419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc70bd71-d6ed-494d-a38a-d5aa7d4ed5a6 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:40.815952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cc70bd71-d6ed-494d-a38a-d5aa7d4ed5a6 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:40.831230 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cc70bd71-d6ed-494d-a38a-d5aa7d4ed5a6 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4" status: 200 len: 1312 microversion: 2.1 time: 0.664733 May 28 04:41:40.832548 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 991/2043] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:40 2022] GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4 => generated 1312 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:40.845435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6e5bfef3-4772-4244-92f5-9c42c06a960c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:40.846133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6e5bfef3-4772-4244-92f5-9c42c06a960c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:40.852846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-55ef1899-74cd-4bb9-b018-540c8835fc78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:40.861010 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-55ef1899-74cd-4bb9-b018-540c8835fc78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1318 microversion: 2.1 time: 1.431811 May 28 04:41:40.864767 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1053/2044] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:39 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1318 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:40.865520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6e5bfef3-4772-4244-92f5-9c42c06a960c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:40.867039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6e5bfef3-4772-4244-92f5-9c42c06a960c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:40.868774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6e5bfef3-4772-4244-92f5-9c42c06a960c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:40.869732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6e5bfef3-4772-4244-92f5-9c42c06a960c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:40.877629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c04a0c27-7f03-404e-97ef-83c8c0e2fd6b tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:40.878530 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c04a0c27-7f03-404e-97ef-83c8c0e2fd6b tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:40.888577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c04a0c27-7f03-404e-97ef-83c8c0e2fd6b tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:40.888577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c04a0c27-7f03-404e-97ef-83c8c0e2fd6b tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:40.889671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c04a0c27-7f03-404e-97ef-83c8c0e2fd6b tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:40.890313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c04a0c27-7f03-404e-97ef-83c8c0e2fd6b tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:41.010560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6e5bfef3-4772-4244-92f5-9c42c06a960c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:41.023452 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6e5bfef3-4772-4244-92f5-9c42c06a960c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1184 microversion: 2.1 time: 0.189511 May 28 04:41:41.036881 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 992/2045] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:40 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1184 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:41.177538 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c04a0c27-7f03-404e-97ef-83c8c0e2fd6b tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:41.190372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c04a0c27-7f03-404e-97ef-83c8c0e2fd6b tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:41.192610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c04a0c27-7f03-404e-97ef-83c8c0e2fd6b tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:41.194007 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c04a0c27-7f03-404e-97ef-83c8c0e2fd6b tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456" status: 200 len: 1361 microversion: 2.26 time: 0.327054 May 28 04:41:41.195548 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1054/2046] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:40 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 => generated 1361 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:41.302069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-e998151c-4346-497d-b36f-0a87a59e3d6b req-d2ec4f27-9ab9-4523-990b-c99a349b9a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e714899-ae82-47c5-bd72-a65a0b4734a4", "name": "network-vif-plugged", "status": "completed", "tag": "ab17ea28-3974-4717-9100-cb1f12026e9f"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:41.327452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-e998151c-4346-497d-b36f-0a87a59e3d6b req-d2ec4f27-9ab9-4523-990b-c99a349b9a68 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:41.328155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-e998151c-4346-497d-b36f-0a87a59e3d6b req-d2ec4f27-9ab9-4523-990b-c99a349b9a68 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:41.349494 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-e998151c-4346-497d-b36f-0a87a59e3d6b req-d2ec4f27-9ab9-4523-990b-c99a349b9a68 service nova] Creating event network-vif-plugged:ab17ea28-3974-4717-9100-cb1f12026e9f for instance 2e714899-ae82-47c5-bd72-a65a0b4734a4 on n-h1-843700-1 May 28 04:41:41.355986 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-e998151c-4346-497d-b36f-0a87a59e3d6b req-d2ec4f27-9ab9-4523-990b-c99a349b9a68 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063434 May 28 04:41:41.356984 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 993/2047] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:41.849085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-603e2039-3580-4763-adae-420b870aa1d4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:41.850105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-603e2039-3580-4763-adae-420b870aa1d4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 2e714899-ae82-47c5-bd72-a65a0b4734a4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:41.859502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-603e2039-3580-4763-adae-420b870aa1d4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:41.861210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-603e2039-3580-4763-adae-420b870aa1d4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:41.862073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-603e2039-3580-4763-adae-420b870aa1d4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:41.862936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-603e2039-3580-4763-adae-420b870aa1d4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:41.883495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c400db0b-1e9b-48be-9e2e-b7f5be43bf97 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:41.888595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c400db0b-1e9b-48be-9e2e-b7f5be43bf97 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:41.901982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c400db0b-1e9b-48be-9e2e-b7f5be43bf97 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:41.903680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c400db0b-1e9b-48be-9e2e-b7f5be43bf97 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:41.904543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c400db0b-1e9b-48be-9e2e-b7f5be43bf97 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:41.904987 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c400db0b-1e9b-48be-9e2e-b7f5be43bf97 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:42.207298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c400db0b-1e9b-48be-9e2e-b7f5be43bf97 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:42.219290 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c400db0b-1e9b-48be-9e2e-b7f5be43bf97 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1508 microversion: 2.1 time: 0.341656 May 28 04:41:42.221947 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 994/2048] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:41 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1508 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:41:42.230213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-130df21a-4ba1-4b7c-9d91-e5fabd5413fa tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:42.236408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-130df21a-4ba1-4b7c-9d91-e5fabd5413fa tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:42.247365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-603e2039-3580-4763-adae-420b870aa1d4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:42.261940 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-603e2039-3580-4763-adae-420b870aa1d4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4" status: 200 len: 1312 microversion: 2.1 time: 0.412290 May 28 04:41:42.264193 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1055/2049] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:41 2022] GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4 => generated 1312 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:42.265607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-130df21a-4ba1-4b7c-9d91-e5fabd5413fa tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:42.267188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-130df21a-4ba1-4b7c-9d91-e5fabd5413fa tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:42.271323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-130df21a-4ba1-4b7c-9d91-e5fabd5413fa tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:42.272006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-130df21a-4ba1-4b7c-9d91-e5fabd5413fa tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:42.280319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6c08c5b3-2a3c-4567-8e56-83c86b88d779 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:42.283582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6c08c5b3-2a3c-4567-8e56-83c86b88d779 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:42.297285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c08c5b3-2a3c-4567-8e56-83c86b88d779 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:42.305572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c08c5b3-2a3c-4567-8e56-83c86b88d779 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:42.305572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c08c5b3-2a3c-4567-8e56-83c86b88d779 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:42.305572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c08c5b3-2a3c-4567-8e56-83c86b88d779 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:42.365276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-130df21a-4ba1-4b7c-9d91-e5fabd5413fa tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:42.375925 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-130df21a-4ba1-4b7c-9d91-e5fabd5413fa tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1184 microversion: 2.1 time: 0.152655 May 28 04:41:42.388346 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 995/2050] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:42 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1184 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:42.394596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8a6e2be3-1dda-46fc-a424-5bd11ae09e62 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:42.395525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8a6e2be3-1dda-46fc-a424-5bd11ae09e62 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:42.404539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a6e2be3-1dda-46fc-a424-5bd11ae09e62 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:42.405231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a6e2be3-1dda-46fc-a424-5bd11ae09e62 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:42.406217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a6e2be3-1dda-46fc-a424-5bd11ae09e62 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:42.406852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a6e2be3-1dda-46fc-a424-5bd11ae09e62 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:42.666595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6c08c5b3-2a3c-4567-8e56-83c86b88d779 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:42.681869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6c08c5b3-2a3c-4567-8e56-83c86b88d779 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:42.684689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6c08c5b3-2a3c-4567-8e56-83c86b88d779 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:42.688573 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6c08c5b3-2a3c-4567-8e56-83c86b88d779 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456" status: 200 len: 1361 microversion: 2.26 time: 0.422094 May 28 04:41:42.695509 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1056/2051] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:42 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 => generated 1361 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:42.765577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8a6e2be3-1dda-46fc-a424-5bd11ae09e62 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:42.776690 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8a6e2be3-1dda-46fc-a424-5bd11ae09e62 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1508 microversion: 2.1 time: 0.386514 May 28 04:41:42.788338 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 996/2052] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:42 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1508 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:42.795009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e5edc143-d7ae-4673-8704-0132df8cbcf2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "OS-DCF:diskConfig": "AUTO"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:42.802318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e5edc143-d7ae-4673-8704-0132df8cbcf2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:42.808119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5edc143-d7ae-4673-8704-0132df8cbcf2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:42.808612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5edc143-d7ae-4673-8704-0132df8cbcf2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:42.809428 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5edc143-d7ae-4673-8704-0132df8cbcf2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:42.809870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5edc143-d7ae-4673-8704-0132df8cbcf2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:42.986398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-e5edc143-d7ae-4673-8704-0132df8cbcf2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:41:42.988707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-e5edc143-d7ae-4673-8704-0132df8cbcf2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:41:42.989448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-e5edc143-d7ae-4673-8704-0132df8cbcf2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:41:42.992794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-e5edc143-d7ae-4673-8704-0132df8cbcf2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:41:42.995850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-e5edc143-d7ae-4673-8704-0132df8cbcf2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:41:43.045177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:43.256343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e5edc143-d7ae-4673-8704-0132df8cbcf2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:43.281081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5edc143-d7ae-4673-8704-0132df8cbcf2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:43.282921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5edc143-d7ae-4673-8704-0132df8cbcf2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:43.283938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fbaa8f08-baad-432d-8172-6978e23c7c97 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:43.285150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fbaa8f08-baad-432d-8172-6978e23c7c97 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 2e714899-ae82-47c5-bd72-a65a0b4734a4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:43.285714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5edc143-d7ae-4673-8704-0132df8cbcf2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:43.286337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5edc143-d7ae-4673-8704-0132df8cbcf2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:43.297891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbaa8f08-baad-432d-8172-6978e23c7c97 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:43.298359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbaa8f08-baad-432d-8172-6978e23c7c97 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:43.299706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbaa8f08-baad-432d-8172-6978e23c7c97 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:43.300408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbaa8f08-baad-432d-8172-6978e23c7c97 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:43.317835 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e5edc143-d7ae-4673-8704-0132df8cbcf2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "POST /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f/action" status: 202 len: 1110 microversion: 2.1 time: 0.526098 May 28 04:41:43.318812 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1057/2053] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:41:42 2022] POST /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f/action => generated 1110 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 28 04:41:43.334101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-28afc466-68f5-4e2e-b551-d5da95e1a67c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:43.334823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-28afc466-68f5-4e2e-b551-d5da95e1a67c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:43.343634 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-28afc466-68f5-4e2e-b551-d5da95e1a67c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:43.349441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-28afc466-68f5-4e2e-b551-d5da95e1a67c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:43.351158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-28afc466-68f5-4e2e-b551-d5da95e1a67c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:43.357137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-28afc466-68f5-4e2e-b551-d5da95e1a67c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:43.544870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fbaa8f08-baad-432d-8172-6978e23c7c97 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:43.552208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:43.561318 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fbaa8f08-baad-432d-8172-6978e23c7c97 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4" status: 200 len: 1462 microversion: 2.1 time: 0.283923 May 28 04:41:43.561926 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 997/2054] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:43 2022] GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4 => generated 1462 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:43.570448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-e72694e2-6e15-4a1c-b0d7-80a77a641fdb req-e68db9a4-bc51-4f14-bd06-28e1bbbced00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "700c00f1-c8d2-44e4-a015-cc6168d9b456", "name": "network-vif-plugged", "status": "completed", "tag": "929e4c25-a182-48aa-8642-8a664b22dbe2"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:43.579120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-e72694e2-6e15-4a1c-b0d7-80a77a641fdb req-e68db9a4-bc51-4f14-bd06-28e1bbbced00 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:43.579863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-e72694e2-6e15-4a1c-b0d7-80a77a641fdb req-e68db9a4-bc51-4f14-bd06-28e1bbbced00 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:43.596503 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-e72694e2-6e15-4a1c-b0d7-80a77a641fdb req-e68db9a4-bc51-4f14-bd06-28e1bbbced00 service nova] Creating event network-vif-plugged:929e4c25-a182-48aa-8642-8a664b22dbe2 for instance 700c00f1-c8d2-44e4-a015-cc6168d9b456 on n-h2-843700-1 May 28 04:41:43.604255 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-e72694e2-6e15-4a1c-b0d7-80a77a641fdb req-e68db9a4-bc51-4f14-bd06-28e1bbbced00 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040593 May 28 04:41:43.605131 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 998/2055] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:43.612995 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d0e9c298-7149-4ac7-9f70-ea3fde4ffeee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:43.614088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d0e9c298-7149-4ac7-9f70-ea3fde4ffeee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:43.622224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0e9c298-7149-4ac7-9f70-ea3fde4ffeee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:43.622947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0e9c298-7149-4ac7-9f70-ea3fde4ffeee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:43.623330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-28afc466-68f5-4e2e-b551-d5da95e1a67c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:43.624159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0e9c298-7149-4ac7-9f70-ea3fde4ffeee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:43.624770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0e9c298-7149-4ac7-9f70-ea3fde4ffeee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:43.635229 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-28afc466-68f5-4e2e-b551-d5da95e1a67c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1515 microversion: 2.1 time: 0.305661 May 28 04:41:43.635863 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1058/2056] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:43 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1515 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:41:43.755796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d0e9c298-7149-4ac7-9f70-ea3fde4ffeee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:43.774822 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d0e9c298-7149-4ac7-9f70-ea3fde4ffeee tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1184 microversion: 2.1 time: 0.168155 May 28 04:41:43.777536 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 999/2057] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:43 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1184 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:43.791605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e3a29d6b-a0ae-4e2f-98bf-1e145932f13d tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:43.792601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e3a29d6b-a0ae-4e2f-98bf-1e145932f13d tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:43.801489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3a29d6b-a0ae-4e2f-98bf-1e145932f13d tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:43.802186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3a29d6b-a0ae-4e2f-98bf-1e145932f13d tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:43.803068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3a29d6b-a0ae-4e2f-98bf-1e145932f13d tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:43.804176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3a29d6b-a0ae-4e2f-98bf-1e145932f13d tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:43.953371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-79a368b5-f73e-4a20-9c56-4c329a9c01c3 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:43.957706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-79a368b5-f73e-4a20-9c56-4c329a9c01c3 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Searching by: {'deleted': False, 'project_id': '4e9a2e582db74581993ec20674180798'} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:41:43.966789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-79a368b5-f73e-4a20-9c56-4c329a9c01c3 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:43.967521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-79a368b5-f73e-4a20-9c56-4c329a9c01c3 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:43.968528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-79a368b5-f73e-4a20-9c56-4c329a9c01c3 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:43.969308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-79a368b5-f73e-4a20-9c56-4c329a9c01c3 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:44.021085 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e3a29d6b-a0ae-4e2f-98bf-1e145932f13d tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:44.025494 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-79a368b5-f73e-4a20-9c56-4c329a9c01c3 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.388565 May 28 04:41:44.038321 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1059/2058] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:41:43 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:41:44.043701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5d9ea797-f813-4439-b858-65794cdc5e42 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-836733151", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "244ceb49-a9c1-42ce-900e-8ae28e09e3a9"}], "block_device_mapping_v2": [{"uuid": "cf1320ca-23ce-4219-a524-bfa3f2260340", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:44.046835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e3a29d6b-a0ae-4e2f-98bf-1e145932f13d tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:44.050861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e3a29d6b-a0ae-4e2f-98bf-1e145932f13d tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:44.059209 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e3a29d6b-a0ae-4e2f-98bf-1e145932f13d tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456" status: 200 len: 1361 microversion: 2.26 time: 0.273980 May 28 04:41:44.059209 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1000/2059] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:43 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 => generated 1361 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:44.067486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-953f9e71-0f2d-413e-909a-ab44270be93f tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:44.092076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-953f9e71-0f2d-413e-909a-ab44270be93f tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Searching by: {'deleted': False} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:41:44.132241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-953f9e71-0f2d-413e-909a-ab44270be93f tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:44.138370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-953f9e71-0f2d-413e-909a-ab44270be93f tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:44.139609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-953f9e71-0f2d-413e-909a-ab44270be93f tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:44.140087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-953f9e71-0f2d-413e-909a-ab44270be93f tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:44.218193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-5d9ea797-f813-4439-b858-65794cdc5e42 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] validate_networks() for [('244ceb49-a9c1-42ce-900e-8ae28e09e3a9', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:41:44.856443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-953f9e71-0f2d-413e-909a-ab44270be93f tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Listed batch of 14 results from cell out of 1000 limit. Returned 14 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:41:44.978510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-953f9e71-0f2d-413e-909a-ab44270be93f tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:44.979197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-953f9e71-0f2d-413e-909a-ab44270be93f tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:45.358432 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-5d9ea797-f813-4439-b858-65794cdc5e42 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:41:45.359227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-5d9ea797-f813-4439-b858-65794cdc5e42 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:41:45.361400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-5d9ea797-f813-4439-b858-65794cdc5e42 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:41:45.361827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-5d9ea797-f813-4439-b858-65794cdc5e42 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:41:45.362242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-5d9ea797-f813-4439-b858-65794cdc5e42 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:41:45.383106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d9ea797-f813-4439-b858-65794cdc5e42 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:45.383891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d9ea797-f813-4439-b858-65794cdc5e42 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:45.384996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d9ea797-f813-4439-b858-65794cdc5e42 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:45.385929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d9ea797-f813-4439-b858-65794cdc5e42 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:45.414392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-5d9ea797-f813-4439-b858-65794cdc5e42 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Getting quotas for project 99f14746bfbc460eb4a21e7eb567de46. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:41:45.423145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-5d9ea797-f813-4439-b858-65794cdc5e42 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Getting quotas for user ed90faaaee584c3a8d1385b8d873d12d and project 99f14746bfbc460eb4a21e7eb567de46. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:41:45.516330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5d9ea797-f813-4439-b858-65794cdc5e42 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:41:45.520081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5d9ea797-f813-4439-b858-65794cdc5e42 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cf1320ca-23ce-4219-a524-bfa3f2260340',volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:41:45.608630 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-953f9e71-0f2d-413e-909a-ab44270be93f tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 22672 microversion: 2.1 time: 1.552623 May 28 04:41:45.609292 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1001/2060] 10.222.0.58 () {58 vars in 1170 bytes} [Sat May 28 04:41:44 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 22672 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:41:45.615020 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-487d916b-68c3-4c53-b1a4-9c32e69d6275 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:45.615810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-487d916b-68c3-4c53-b1a4-9c32e69d6275 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:45.624226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-487d916b-68c3-4c53-b1a4-9c32e69d6275 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:45.624904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-487d916b-68c3-4c53-b1a4-9c32e69d6275 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:45.625825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-487d916b-68c3-4c53-b1a4-9c32e69d6275 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:45.626566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-487d916b-68c3-4c53-b1a4-9c32e69d6275 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:45.799763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-487d916b-68c3-4c53-b1a4-9c32e69d6275 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:45.808539 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-487d916b-68c3-4c53-b1a4-9c32e69d6275 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1515 microversion: 2.1 time: 0.197801 May 28 04:41:45.809312 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1002/2061] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:45 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1515 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:45.814841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9e304277-5ae3-4025-84f3-98faa0a2198c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:45.815581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9e304277-5ae3-4025-84f3-98faa0a2198c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:45.823093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e304277-5ae3-4025-84f3-98faa0a2198c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:45.823625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e304277-5ae3-4025-84f3-98faa0a2198c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:45.824467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e304277-5ae3-4025-84f3-98faa0a2198c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:45.825011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e304277-5ae3-4025-84f3-98faa0a2198c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:45.898016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9e304277-5ae3-4025-84f3-98faa0a2198c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:45.910526 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9e304277-5ae3-4025-84f3-98faa0a2198c tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1184 microversion: 2.1 time: 0.099253 May 28 04:41:45.911477 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1003/2062] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:45 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1184 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:45.924573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-56060d08-f60c-4869-8cc8-92b9fa9148c7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:45.925264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-56060d08-f60c-4869-8cc8-92b9fa9148c7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:45.934656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-56060d08-f60c-4869-8cc8-92b9fa9148c7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:45.935260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-56060d08-f60c-4869-8cc8-92b9fa9148c7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:45.936058 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-56060d08-f60c-4869-8cc8-92b9fa9148c7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:45.936528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-56060d08-f60c-4869-8cc8-92b9fa9148c7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:46.014332 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5d9ea797-f813-4439-b858-65794cdc5e42 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.986531 May 28 04:41:46.019832 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1060/2063] 10.222.0.58 () {62 vars in 1187 bytes} [Sat May 28 04:41:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1993 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 04:41:46.026477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-85ab5e83-ed18-4d4e-b471-86ccd10279fa tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:46.031724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-85ab5e83-ed18-4d4e-b471-86ccd10279fa tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Searching by: {'deleted': False, 'project_id': '4e9a2e582db74581993ec20674180798'} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:41:46.056477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-85ab5e83-ed18-4d4e-b471-86ccd10279fa tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:46.057204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-85ab5e83-ed18-4d4e-b471-86ccd10279fa tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:46.058259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-85ab5e83-ed18-4d4e-b471-86ccd10279fa tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:46.058786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-85ab5e83-ed18-4d4e-b471-86ccd10279fa tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:46.094126 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-85ab5e83-ed18-4d4e-b471-86ccd10279fa tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?tenant_id=13ea83404c554681912477aa3f6d0798" status: 200 len: 15 microversion: 2.1 time: 0.072301 May 28 04:41:46.095169 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1061/2064] 10.222.0.58 () {58 vars in 1230 bytes} [Sat May 28 04:41:46 2022] GET /compute/v2.1/servers/detail?tenant_id=13ea83404c554681912477aa3f6d0798 => generated 15 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:41:46.103964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ce667087-8dbd-4c54-9d54-960748036e78 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:46.105106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ce667087-8dbd-4c54-9d54-960748036e78 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:46.204910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ce667087-8dbd-4c54-9d54-960748036e78 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:46.213386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ce667087-8dbd-4c54-9d54-960748036e78 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:46.224307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ce667087-8dbd-4c54-9d54-960748036e78 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:46.225563 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ce667087-8dbd-4c54-9d54-960748036e78 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1103 microversion: 2.25 time: 0.129335 May 28 04:41:46.248567 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1062/2065] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:46 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1103 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:46.251707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-56060d08-f60c-4869-8cc8-92b9fa9148c7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:46.259985 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fc2dca53-c1e0-4c15-9c55-9a29c733e6ab tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:46.264249 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-56060d08-f60c-4869-8cc8-92b9fa9148c7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:46.266960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-56060d08-f60c-4869-8cc8-92b9fa9148c7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:46.268776 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-56060d08-f60c-4869-8cc8-92b9fa9148c7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456" status: 200 len: 1545 microversion: 2.26 time: 0.356159 May 28 04:41:46.280098 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1004/2066] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:45 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 => generated 1545 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:46.286923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fc2dca53-c1e0-4c15-9c55-9a29c733e6ab tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Searching by: {'tenant_id': '13ea83404c554681912477aa3f6d0798', 'deleted': False} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:41:46.295080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-10291919-e603-4a8f-8b68-82aa1b952b9a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '.version_select at 0x7f77010f6ee0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:46.311966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10291919-e603-4a8f-8b68-82aa1b952b9a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:46.312769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10291919-e603-4a8f-8b68-82aa1b952b9a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:46.313145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-10291919-e603-4a8f-8b68-82aa1b952b9a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:46.322045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10291919-e603-4a8f-8b68-82aa1b952b9a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:46.322765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10291919-e603-4a8f-8b68-82aa1b952b9a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:46.324731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10291919-e603-4a8f-8b68-82aa1b952b9a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:46.325233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10291919-e603-4a8f-8b68-82aa1b952b9a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:46.327292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc2dca53-c1e0-4c15-9c55-9a29c733e6ab tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:46.328007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc2dca53-c1e0-4c15-9c55-9a29c733e6ab tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:46.329588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc2dca53-c1e0-4c15-9c55-9a29c733e6ab tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:46.330177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc2dca53-c1e0-4c15-9c55-9a29c733e6ab tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:46.390574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10291919-e603-4a8f-8b68-82aa1b952b9a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:46.394787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10291919-e603-4a8f-8b68-82aa1b952b9a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:46.398342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.multi_cell_list [None req-fc2dca53-c1e0-4c15-9c55-9a29c733e6ab tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:41:46.423916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10291919-e603-4a8f-8b68-82aa1b952b9a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:46.425026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10291919-e603-4a8f-8b68-82aa1b952b9a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:46.474390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc2dca53-c1e0-4c15-9c55-9a29c733e6ab tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:46.475326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc2dca53-c1e0-4c15-9c55-9a29c733e6ab tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:46.621422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-10291919-e603-4a8f-8b68-82aa1b952b9a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lazy-loading 'flavor' on Instance uuid 700c00f1-c8d2-44e4-a015-cc6168d9b456 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:41:46.677320 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fc2dca53-c1e0-4c15-9c55-9a29c733e6ab tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=13ea83404c554681912477aa3f6d0798" status: 200 len: 4824 microversion: 2.1 time: 0.427413 May 28 04:41:46.678576 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1063/2067] 10.222.0.58 () {58 vars in 1256 bytes} [Sat May 28 04:41:46 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=13ea83404c554681912477aa3f6d0798 => generated 4824 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:46.704022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a404b766-8202-47a4-9250-fddd8b7e8974 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:46.726242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a404b766-8202-47a4-9250-fddd8b7e8974 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Searching by: {'tenant_id': '4e9a2e582db74581993ec20674180798', 'deleted': False} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:41:46.729836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:46.740914 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-10291919-e603-4a8f-8b68-82aa1b952b9a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "PUT /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags/tempest-tag-345529727" status: 201 len: 0 microversion: 2.26 time: 0.450281 May 28 04:41:46.742925 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1005/2068] 10.222.0.58 () {62 vars in 1376 bytes} [Sat May 28 04:41:46 2022] PUT /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags/tempest-tag-345529727 => generated 0 bytes in 453 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) May 28 04:41:46.746205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a404b766-8202-47a4-9250-fddd8b7e8974 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:46.746897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a404b766-8202-47a4-9250-fddd8b7e8974 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:46.748038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a404b766-8202-47a4-9250-fddd8b7e8974 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:46.748797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a404b766-8202-47a4-9250-fddd8b7e8974 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:46.755645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-614dbd8a-1380-4dd2-94f0-fc5d8cf9f1e4 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '.version_select at 0x7f7701068310>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:46.769869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-614dbd8a-1380-4dd2-94f0-fc5d8cf9f1e4 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:46.770801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-614dbd8a-1380-4dd2-94f0-fc5d8cf9f1e4 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:46.790467 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a404b766-8202-47a4-9250-fddd8b7e8974 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=4e9a2e582db74581993ec20674180798" status: 200 len: 15 microversion: 2.1 time: 0.096821 May 28 04:41:46.791639 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1064/2069] 10.222.0.58 () {58 vars in 1256 bytes} [Sat May 28 04:41:46 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=4e9a2e582db74581993ec20674180798 => generated 15 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 04:41:46.792093 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-614dbd8a-1380-4dd2-94f0-fc5d8cf9f1e4 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags/tempest-tag-345529727" status: 204 len: 0 microversion: 2.26 time: 0.042814 May 28 04:41:46.793717 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1006/2070] 10.222.0.58 () {60 vars in 1357 bytes} [Sat May 28 04:41:46 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags/tempest-tag-345529727 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:41:46.805059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8333e215-4e6f-4799-a1db-30119d2ecd29 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '.version_select at 0x7f7701f11f70>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:46.809961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2f8001ec-0cba-4164-8098-59f0adabeac4 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:46.814208 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2f8001ec-0cba-4164-8098-59f0adabeac4 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.007987 May 28 04:41:46.815214 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1007/2071] 10.222.0.58 () {58 vars in 1188 bytes} [Sat May 28 04:41:46 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:41:46.830967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8333e215-4e6f-4799-a1db-30119d2ecd29 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:46.830967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8333e215-4e6f-4799-a1db-30119d2ecd29 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:46.830967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8333e215-4e6f-4799-a1db-30119d2ecd29 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:46.830967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8333e215-4e6f-4799-a1db-30119d2ecd29 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:46.830967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8333e215-4e6f-4799-a1db-30119d2ecd29 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:46.830967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8333e215-4e6f-4799-a1db-30119d2ecd29 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:46.830967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8333e215-4e6f-4799-a1db-30119d2ecd29 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:46.836966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b490041c-3b7e-49ed-a80b-66cd3ea2749d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:46.837632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b490041c-3b7e-49ed-a80b-66cd3ea2749d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:46.845624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b490041c-3b7e-49ed-a80b-66cd3ea2749d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:46.846090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b490041c-3b7e-49ed-a80b-66cd3ea2749d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:46.847224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b490041c-3b7e-49ed-a80b-66cd3ea2749d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:46.847698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b490041c-3b7e-49ed-a80b-66cd3ea2749d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:46.859434 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8333e215-4e6f-4799-a1db-30119d2ecd29 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:46.860028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8333e215-4e6f-4799-a1db-30119d2ecd29 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:46.973877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-8333e215-4e6f-4799-a1db-30119d2ecd29 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lazy-loading 'flavor' on Instance uuid 700c00f1-c8d2-44e4-a015-cc6168d9b456 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:41:47.029305 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8333e215-4e6f-4799-a1db-30119d2ecd29 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "DELETE /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags" status: 204 len: 0 microversion: 2.26 time: 0.231094 May 28 04:41:47.034503 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1065/2072] 10.222.0.58 () {60 vars in 1294 bytes} [Sat May 28 04:41:46 2022] DELETE /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 28 04:41:47.036109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6efed0c3-ee4c-43eb-bb25-4f9c6e12c7c1 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:47.037306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6efed0c3-ee4c-43eb-bb25-4f9c6e12c7c1 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:47.056457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6efed0c3-ee4c-43eb-bb25-4f9c6e12c7c1 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.057355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6efed0c3-ee4c-43eb-bb25-4f9c6e12c7c1 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.058473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6efed0c3-ee4c-43eb-bb25-4f9c6e12c7c1 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.059239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6efed0c3-ee4c-43eb-bb25-4f9c6e12c7c1 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.072935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b490041c-3b7e-49ed-a80b-66cd3ea2749d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:47.084287 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b490041c-3b7e-49ed-a80b-66cd3ea2749d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1515 microversion: 2.1 time: 0.256326 May 28 04:41:47.095776 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1008/2073] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:46 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1515 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:47.098768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f5612597-a232-412d-bc76-cfef76514d3a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:47.100910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f5612597-a232-412d-bc76-cfef76514d3a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:47.109098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5612597-a232-412d-bc76-cfef76514d3a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.109548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5612597-a232-412d-bc76-cfef76514d3a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.110383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5612597-a232-412d-bc76-cfef76514d3a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.110818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5612597-a232-412d-bc76-cfef76514d3a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.154726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:47.160474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5612597-a232-412d-bc76-cfef76514d3a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.161012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5612597-a232-412d-bc76-cfef76514d3a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.161482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-f5612597-a232-412d-bc76-cfef76514d3a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lazy-loading 'fault' on Instance uuid ac2fe6e3-8187-4ba2-b31d-10b4f602b332 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:41:47.207477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f5612597-a232-412d-bc76-cfef76514d3a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:47.231470 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f5612597-a232-412d-bc76-cfef76514d3a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 200 len: 1189 microversion: 2.1 time: 0.140894 May 28 04:41:47.234165 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1009/2074] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:47 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 1189 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:47.247769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5d896408-3e16-408d-9da5-a1cede7eea93 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '.version_select at 0x7f77010dcaf0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:47.259762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d896408-3e16-408d-9da5-a1cede7eea93 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.261268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d896408-3e16-408d-9da5-a1cede7eea93 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.271727 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5d896408-3e16-408d-9da5-a1cede7eea93 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags" status: 200 len: 12 microversion: 2.26 time: 0.036181 May 28 04:41:47.272857 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1010/2075] 10.222.0.58 () {60 vars in 1291 bytes} [Sat May 28 04:41:47 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags => generated 12 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:47.278370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d16d3ded-de38-4501-a51d-53f1d94e001f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:47.279126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d16d3ded-de38-4501-a51d-53f1d94e001f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:47.285858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d16d3ded-de38-4501-a51d-53f1d94e001f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.286512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d16d3ded-de38-4501-a51d-53f1d94e001f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.287430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d16d3ded-de38-4501-a51d-53f1d94e001f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.287940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d16d3ded-de38-4501-a51d-53f1d94e001f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.399490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d16d3ded-de38-4501-a51d-53f1d94e001f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:47.408915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d16d3ded-de38-4501-a51d-53f1d94e001f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:47.410748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d16d3ded-de38-4501-a51d-53f1d94e001f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:47.412298 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d16d3ded-de38-4501-a51d-53f1d94e001f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1184 microversion: 2.25 time: 0.138098 May 28 04:41:47.421866 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1011/2076] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:47 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1184 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:47.421866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a4b9a7c6-ac9b-4d28-8447-4d985cc3c882 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '.version_select at 0x7f77010f3040>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:47.426843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4b9a7c6-ac9b-4d28-8447-4d985cc3c882 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.427439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4b9a7c6-ac9b-4d28-8447-4d985cc3c882 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.427987 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a4b9a7c6-ac9b-4d28-8447-4d985cc3c882 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:47.434461 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4b9a7c6-ac9b-4d28-8447-4d985cc3c882 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.434919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4b9a7c6-ac9b-4d28-8447-4d985cc3c882 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.435767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4b9a7c6-ac9b-4d28-8447-4d985cc3c882 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.436336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4b9a7c6-ac9b-4d28-8447-4d985cc3c882 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.441793 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6efed0c3-ee4c-43eb-bb25-4f9c6e12c7c1 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6/action" status: 202 len: 0 microversion: 2.1 time: 0.408551 May 28 04:41:47.449670 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1066/2077] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:41:47 2022] POST /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:41:47.457912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-787f10ba-e2b6-48c1-a9ac-d709dbddae98 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:47.465976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4b9a7c6-ac9b-4d28-8447-4d985cc3c882 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.466415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4b9a7c6-ac9b-4d28-8447-4d985cc3c882 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.476246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-787f10ba-e2b6-48c1-a9ac-d709dbddae98 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:47.478409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-787f10ba-e2b6-48c1-a9ac-d709dbddae98 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '13ea83404c554681912477aa3f6d0798'} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:41:47.480188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4b9a7c6-ac9b-4d28-8447-4d985cc3c882 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.480654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4b9a7c6-ac9b-4d28-8447-4d985cc3c882 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.493329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-787f10ba-e2b6-48c1-a9ac-d709dbddae98 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.494851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-787f10ba-e2b6-48c1-a9ac-d709dbddae98 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.495982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-787f10ba-e2b6-48c1-a9ac-d709dbddae98 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.497477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-787f10ba-e2b6-48c1-a9ac-d709dbddae98 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.576042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:47.579798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-a4b9a7c6-ac9b-4d28-8447-4d985cc3c882 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lazy-loading 'flavor' on Instance uuid 700c00f1-c8d2-44e4-a015-cc6168d9b456 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:41:47.599949 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a4b9a7c6-ac9b-4d28-8447-4d985cc3c882 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "PUT /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags/tempest-tag-1480289172" status: 201 len: 0 microversion: 2.26 time: 0.185731 May 28 04:41:47.601153 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1012/2078] 10.222.0.58 () {62 vars in 1379 bytes} [Sat May 28 04:41:47 2022] PUT /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags/tempest-tag-1480289172 => generated 0 bytes in 188 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 28 04:41:47.614429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.multi_cell_list [None req-787f10ba-e2b6-48c1-a9ac-d709dbddae98 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:41:47.615474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-833acf3f-2151-446e-818f-73a810e1066c tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '.version_select at 0x7f77010dc430>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:47.629453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-833acf3f-2151-446e-818f-73a810e1066c tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.630310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-833acf3f-2151-446e-818f-73a810e1066c tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.645016 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-833acf3f-2151-446e-818f-73a810e1066c tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags" status: 200 len: 36 microversion: 2.26 time: 0.037231 May 28 04:41:47.647267 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1013/2079] 10.222.0.58 () {60 vars in 1291 bytes} [Sat May 28 04:41:47 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags => generated 36 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:41:47.669003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-12a1fedd-4477-4b63-9350-84a42fe241f8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '.version_select at 0x7f77010dcb80>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:47.687090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-12a1fedd-4477-4b63-9350-84a42fe241f8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.693161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-12a1fedd-4477-4b63-9350-84a42fe241f8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.693776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-12a1fedd-4477-4b63-9350-84a42fe241f8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:47.707720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-12a1fedd-4477-4b63-9350-84a42fe241f8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.711582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-12a1fedd-4477-4b63-9350-84a42fe241f8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.712649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-12a1fedd-4477-4b63-9350-84a42fe241f8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.715852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-12a1fedd-4477-4b63-9350-84a42fe241f8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.721985 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-787f10ba-e2b6-48c1-a9ac-d709dbddae98 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.270708 May 28 04:41:47.729259 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1067/2080] 10.222.0.58 () {58 vars in 1149 bytes} [Sat May 28 04:41:47 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:47.735428 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6ee6df62-31f2-4f59-90a3-21156308c3a9 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:47.736587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6ee6df62-31f2-4f59-90a3-21156308c3a9 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:47.744480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6ee6df62-31f2-4f59-90a3-21156308c3a9 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.744998 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6ee6df62-31f2-4f59-90a3-21156308c3a9 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.745915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6ee6df62-31f2-4f59-90a3-21156308c3a9 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.746301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6ee6df62-31f2-4f59-90a3-21156308c3a9 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.748641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-12a1fedd-4477-4b63-9350-84a42fe241f8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.749474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-12a1fedd-4477-4b63-9350-84a42fe241f8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:47.933480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-12a1fedd-4477-4b63-9350-84a42fe241f8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lazy-loading 'flavor' on Instance uuid 700c00f1-c8d2-44e4-a015-cc6168d9b456 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:41:47.972374 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-12a1fedd-4477-4b63-9350-84a42fe241f8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "DELETE /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags/tempest-tag-1480289172" status: 204 len: 0 microversion: 2.26 time: 0.309413 May 28 04:41:47.974054 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1014/2081] 10.222.0.58 () {60 vars in 1363 bytes} [Sat May 28 04:41:47 2022] DELETE /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags/tempest-tag-1480289172 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:41:47.983498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a48bddf6-1bc2-4b02-9f24-ec9bba9415da tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '.version_select at 0x7f7701108430>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:47.994375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a48bddf6-1bc2-4b02-9f24-ec9bba9415da tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:47.994930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a48bddf6-1bc2-4b02-9f24-ec9bba9415da tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:48.006214 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a48bddf6-1bc2-4b02-9f24-ec9bba9415da tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags" status: 200 len: 12 microversion: 2.26 time: 0.027544 May 28 04:41:48.008688 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1015/2082] 10.222.0.58 () {60 vars in 1291 bytes} [Sat May 28 04:41:47 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags => generated 12 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:48.039106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5e721d1c-4a7d-4ddd-a86a-92f110161f8a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '.version_select at 0x7f7701068e50>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:48.057272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e721d1c-4a7d-4ddd-a86a-92f110161f8a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:48.057272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e721d1c-4a7d-4ddd-a86a-92f110161f8a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:48.057610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5e721d1c-4a7d-4ddd-a86a-92f110161f8a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:48.078506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e721d1c-4a7d-4ddd-a86a-92f110161f8a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:48.078506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e721d1c-4a7d-4ddd-a86a-92f110161f8a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:48.079258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e721d1c-4a7d-4ddd-a86a-92f110161f8a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:48.079957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e721d1c-4a7d-4ddd-a86a-92f110161f8a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:48.146286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e721d1c-4a7d-4ddd-a86a-92f110161f8a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:48.147122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e721d1c-4a7d-4ddd-a86a-92f110161f8a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:48.163365 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-5e721d1c-4a7d-4ddd-a86a-92f110161f8a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lazy-loading 'flavor' on Instance uuid 700c00f1-c8d2-44e4-a015-cc6168d9b456 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:41:48.188484 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6ee6df62-31f2-4f59-90a3-21156308c3a9 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6/action" status: 202 len: 0 microversion: 2.1 time: 0.457519 May 28 04:41:48.191987 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1068/2083] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:41:47 2022] POST /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:41:48.198189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f36d6d2e-6881-45f4-9e58-dcdd53244b6d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:48.198818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f36d6d2e-6881-45f4-9e58-dcdd53244b6d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:48.202403 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5e721d1c-4a7d-4ddd-a86a-92f110161f8a tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "DELETE /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags" status: 204 len: 0 microversion: 2.26 time: 0.187622 May 28 04:41:48.203184 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1016/2084] 10.222.0.58 () {60 vars in 1294 bytes} [Sat May 28 04:41:48 2022] DELETE /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:41:48.215827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f36d6d2e-6881-45f4-9e58-dcdd53244b6d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:48.217566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-52c0d5d4-c6b5-47bd-9706-752ad77e9c74 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:48.218108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f36d6d2e-6881-45f4-9e58-dcdd53244b6d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:48.218241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-52c0d5d4-c6b5-47bd-9706-752ad77e9c74 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:48.219217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f36d6d2e-6881-45f4-9e58-dcdd53244b6d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:48.219589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f36d6d2e-6881-45f4-9e58-dcdd53244b6d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:48.233393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52c0d5d4-c6b5-47bd-9706-752ad77e9c74 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:48.233393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52c0d5d4-c6b5-47bd-9706-752ad77e9c74 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:48.233393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52c0d5d4-c6b5-47bd-9706-752ad77e9c74 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:48.233778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52c0d5d4-c6b5-47bd-9706-752ad77e9c74 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:48.620775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f36d6d2e-6881-45f4-9e58-dcdd53244b6d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:48.631269 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f36d6d2e-6881-45f4-9e58-dcdd53244b6d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1515 microversion: 2.1 time: 0.439708 May 28 04:41:48.633484 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1069/2085] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:48 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1515 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:48.642932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6e79c66f-4513-44c5-8be0-885051716ec8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '.version_select at 0x7f77013be430>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:48.659474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e79c66f-4513-44c5-8be0-885051716ec8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:48.660036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e79c66f-4513-44c5-8be0-885051716ec8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:48.660621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6e79c66f-4513-44c5-8be0-885051716ec8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:48.666184 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-52c0d5d4-c6b5-47bd-9706-752ad77e9c74 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1614 microversion: 2.1 time: 0.460751 May 28 04:41:48.679605 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1017/2086] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:48 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1614 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:48.681972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e79c66f-4513-44c5-8be0-885051716ec8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:48.682493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e79c66f-4513-44c5-8be0-885051716ec8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:48.683366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e79c66f-4513-44c5-8be0-885051716ec8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:48.692021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e79c66f-4513-44c5-8be0-885051716ec8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:48.692179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6da6a77c-4bf5-49dc-9657-a4d361e5eb4d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:48.692179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6da6a77c-4bf5-49dc-9657-a4d361e5eb4d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: ac2fe6e3-8187-4ba2-b31d-10b4f602b332] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:48.693970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6da6a77c-4bf5-49dc-9657-a4d361e5eb4d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:48.694763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6da6a77c-4bf5-49dc-9657-a4d361e5eb4d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:48.696268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6da6a77c-4bf5-49dc-9657-a4d361e5eb4d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:48.696885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6da6a77c-4bf5-49dc-9657-a4d361e5eb4d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:48.712936 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-6da6a77c-4bf5-49dc-9657-a4d361e5eb4d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] HTTP exception thrown: Instance ac2fe6e3-8187-4ba2-b31d-10b4f602b332 could not be found. May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6da6a77c-4bf5-49dc-9657-a4d361e5eb4d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Request method failure captured: May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 HTTP/1.1 May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZjiaepWU7TCYdX9MhCXgBBsJiLIK1lGWfcoQGt7uJIjKCUQfVxq-420KtmM_9aj9dVa8veVyEwuso9MhxkCBywM0PPE8IsZi1EvyxdRo2Zf-usIx7zhEkDTIzK3k51gQHZiF_UTPQVwZwHt-iCHX6z_NmsfKK-uFXeKxMtWWAULmo May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d908671a46484d2082cc88a1d2c93f98 May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-LiveMigrationTest-879087163 May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d908671a46484d2082cc88a1d2c93f98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d908671a46484d2082cc88a1d2c93f98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d908671a46484d2082cc88a1d2c93f98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d908671a46484d2082cc88a1d2c93f98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-LiveMigrationTest-879087163 May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d908671a46484d2082cc88a1d2c93f98 May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-LiveMigrationTest-879087163 May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-LiveMigrationTest-879087163-project May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: da8fff3851eb4ecc927400c09117f5ee May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-LiveMigrationTest-879087163-project May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance ac2fe6e3-8187-4ba2-b31d-10b4f602b332 could not be found. May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'ac2fe6e3-8187-4ba2-b31d-10b4f602b332'} May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac2fe6e3-8187-4ba2-b31d-10b4f602b332 could not be found. May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac2fe6e3-8187-4ba2-b31d-10b4f602b332 could not be found. May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:48.715155 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:48.720979 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:48.720979 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:48.720979 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:41:48.720979 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:41:48.720979 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac2fe6e3-8187-4ba2-b31d-10b4f602b332 could not be found. May 28 04:41:48.720979 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:48.722438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6da6a77c-4bf5-49dc-9657-a4d361e5eb4d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Returning 404 to user: Instance ac2fe6e3-8187-4ba2-b31d-10b4f602b332 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:41:48.723602 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6da6a77c-4bf5-49dc-9657-a4d361e5eb4d tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332" status: 404 len: 111 microversion: 2.1 time: 0.042714 May 28 04:41:48.724414 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1018/2087] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:48 2022] GET /compute/v2.1/servers/ac2fe6e3-8187-4ba2-b31d-10b4f602b332 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:41:48.731165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a2fb4f54-f0b6-4846-a7a9-7af321be3cf9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:48.736931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a2fb4f54-f0b6-4846-a7a9-7af321be3cf9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:48.739815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2fb4f54-f0b6-4846-a7a9-7af321be3cf9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:48.740553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2fb4f54-f0b6-4846-a7a9-7af321be3cf9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:48.741640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2fb4f54-f0b6-4846-a7a9-7af321be3cf9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:48.743071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2fb4f54-f0b6-4846-a7a9-7af321be3cf9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:48.778064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e79c66f-4513-44c5-8be0-885051716ec8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:48.782815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e79c66f-4513-44c5-8be0-885051716ec8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:48.808716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e79c66f-4513-44c5-8be0-885051716ec8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:48.812187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e79c66f-4513-44c5-8be0-885051716ec8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:48.863230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a2fb4f54-f0b6-4846-a7a9-7af321be3cf9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:48.884308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a2fb4f54-f0b6-4846-a7a9-7af321be3cf9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:48.889173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a2fb4f54-f0b6-4846-a7a9-7af321be3cf9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:48.892897 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a2fb4f54-f0b6-4846-a7a9-7af321be3cf9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1240 microversion: 2.25 time: 0.167181 May 28 04:41:48.894886 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1019/2088] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:48 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1240 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:48.905413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c00fc7e2-9e23-4d92-80fb-e53a12f246b7 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:48.906607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c00fc7e2-9e23-4d92-80fb-e53a12f246b7 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:48.927717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c00fc7e2-9e23-4d92-80fb-e53a12f246b7 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:48.928290 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c00fc7e2-9e23-4d92-80fb-e53a12f246b7 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:48.931102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c00fc7e2-9e23-4d92-80fb-e53a12f246b7 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:48.934501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c00fc7e2-9e23-4d92-80fb-e53a12f246b7 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:48.987084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-6e79c66f-4513-44c5-8be0-885051716ec8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lazy-loading 'flavor' on Instance uuid 700c00f1-c8d2-44e4-a015-cc6168d9b456 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:41:49.005722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:DELETE=1,nova_cell1:UPDATE=4,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:49.116931 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6e79c66f-4513-44c5-8be0-885051716ec8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "PUT /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags/tempest-tag-368425015" status: 201 len: 0 microversion: 2.26 time: 0.482156 May 28 04:41:49.126785 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1070/2089] 10.222.0.58 () {62 vars in 1376 bytes} [Sat May 28 04:41:48 2022] PUT /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags/tempest-tag-368425015 => generated 0 bytes in 493 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) May 28 04:41:49.134495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a828199b-f76b-4270-a6e1-f316c61d11c1 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '.version_select at 0x7f7701e459d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:49.173152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a828199b-f76b-4270-a6e1-f316c61d11c1 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:49.173655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a828199b-f76b-4270-a6e1-f316c61d11c1 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:49.174155 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a828199b-f76b-4270-a6e1-f316c61d11c1 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:49.194727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a828199b-f76b-4270-a6e1-f316c61d11c1 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:49.195314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a828199b-f76b-4270-a6e1-f316c61d11c1 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:49.197112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a828199b-f76b-4270-a6e1-f316c61d11c1 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:49.199420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a828199b-f76b-4270-a6e1-f316c61d11c1 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:49.323458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a828199b-f76b-4270-a6e1-f316c61d11c1 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:49.323930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a828199b-f76b-4270-a6e1-f316c61d11c1 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:49.371253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a828199b-f76b-4270-a6e1-f316c61d11c1 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:49.371719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a828199b-f76b-4270-a6e1-f316c61d11c1 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:49.383907 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c00fc7e2-9e23-4d92-80fb-e53a12f246b7 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1614 microversion: 2.1 time: 0.484882 May 28 04:41:49.385126 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1020/2090] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:48 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1614 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:49.401000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-42ae8ce3-6df3-4874-9b7e-d11d3f676d39 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:49.407557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-42ae8ce3-6df3-4874-9b7e-d11d3f676d39 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Searching by: {'host': 'n-h1-843700-1', 'deleted': False} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:41:49.411457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42ae8ce3-6df3-4874-9b7e-d11d3f676d39 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:49.411619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42ae8ce3-6df3-4874-9b7e-d11d3f676d39 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:49.412439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42ae8ce3-6df3-4874-9b7e-d11d3f676d39 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:49.412895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42ae8ce3-6df3-4874-9b7e-d11d3f676d39 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:49.528003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-a828199b-f76b-4270-a6e1-f316c61d11c1 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lazy-loading 'flavor' on Instance uuid 700c00f1-c8d2-44e4-a015-cc6168d9b456 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:41:49.574018 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a828199b-f76b-4270-a6e1-f316c61d11c1 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "PUT /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags/tempest-tag-512010537" status: 201 len: 0 microversion: 2.26 time: 0.442851 May 28 04:41:49.577712 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1071/2091] 10.222.0.58 () {62 vars in 1376 bytes} [Sat May 28 04:41:49 2022] PUT /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags/tempest-tag-512010537 => generated 0 bytes in 449 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) May 28 04:41:49.589545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-42ae8ce3-6df3-4874-9b7e-d11d3f676d39 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:41:49.601510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-78907927-5988-4c59-bedd-59c041aa2214 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '.version_select at 0x7f770160e310>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:49.625552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78907927-5988-4c59-bedd-59c041aa2214 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:49.628587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78907927-5988-4c59-bedd-59c041aa2214 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:49.630262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-78907927-5988-4c59-bedd-59c041aa2214 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:49.646746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78907927-5988-4c59-bedd-59c041aa2214 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:49.648858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78907927-5988-4c59-bedd-59c041aa2214 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:49.651563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78907927-5988-4c59-bedd-59c041aa2214 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:49.654078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78907927-5988-4c59-bedd-59c041aa2214 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:49.715306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78907927-5988-4c59-bedd-59c041aa2214 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:49.717900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78907927-5988-4c59-bedd-59c041aa2214 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:49.740497 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-42ae8ce3-6df3-4874-9b7e-d11d3f676d39 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] 10.222.0.58 "GET /compute/v2.1/servers?host=n-h1-843700-1&all_tenants=1" status: 200 len: 2646 microversion: 2.1 time: 0.342432 May 28 04:41:49.746574 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1021/2092] 10.222.0.58 () {58 vars in 1189 bytes} [Sat May 28 04:41:49 2022] GET /compute/v2.1/servers?host=n-h1-843700-1&all_tenants=1 => generated 2646 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:41:49.757846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bc06bb12-978a-4e85-a3b4-7b15cf54d429 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:49.763256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bc06bb12-978a-4e85-a3b4-7b15cf54d429 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:49.771178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc06bb12-978a-4e85-a3b4-7b15cf54d429 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:49.772487 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc06bb12-978a-4e85-a3b4-7b15cf54d429 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:49.774106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc06bb12-978a-4e85-a3b4-7b15cf54d429 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:49.774712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc06bb12-978a-4e85-a3b4-7b15cf54d429 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:49.831761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-78907927-5988-4c59-bedd-59c041aa2214 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lazy-loading 'flavor' on Instance uuid 700c00f1-c8d2-44e4-a015-cc6168d9b456 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:41:49.914821 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-78907927-5988-4c59-bedd-59c041aa2214 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "DELETE /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags" status: 204 len: 0 microversion: 2.26 time: 0.322602 May 28 04:41:49.919502 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1072/2093] 10.222.0.58 () {60 vars in 1294 bytes} [Sat May 28 04:41:49 2022] DELETE /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:41:49.947176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-948aa783-4b7e-435a-8d47-3ad0213c4d80 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:49.952422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-948aa783-4b7e-435a-8d47-3ad0213c4d80 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:41:49.967721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-948aa783-4b7e-435a-8d47-3ad0213c4d80 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:49.968180 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-948aa783-4b7e-435a-8d47-3ad0213c4d80 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:49.969002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-948aa783-4b7e-435a-8d47-3ad0213c4d80 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:49.969445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-948aa783-4b7e-435a-8d47-3ad0213c4d80 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.135166 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-948aa783-4b7e-435a-8d47-3ad0213c4d80 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] 10.222.0.58 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.213264 May 28 04:41:50.145590 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1073/2094] 10.222.0.58 () {58 vars in 1195 bytes} [Sat May 28 04:41:49 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:41:50.155962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c5347adc-612f-49b6-bb04-476c011a6c03 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:50.161150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c5347adc-612f-49b6-bb04-476c011a6c03 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:50.177859 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c5347adc-612f-49b6-bb04-476c011a6c03 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.182924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c5347adc-612f-49b6-bb04-476c011a6c03 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.185893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c5347adc-612f-49b6-bb04-476c011a6c03 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.190393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c5347adc-612f-49b6-bb04-476c011a6c03 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.214463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bc06bb12-978a-4e85-a3b4-7b15cf54d429 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:50.227218 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bc06bb12-978a-4e85-a3b4-7b15cf54d429 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1515 microversion: 2.1 time: 0.479390 May 28 04:41:50.228181 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1022/2095] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:49 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1515 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:50.244132 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6a67e732-580d-4f0c-9af7-6aebf54a68cd tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '.version_select at 0x7f7701068f70>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:50.270424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a67e732-580d-4f0c-9af7-6aebf54a68cd tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.270891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a67e732-580d-4f0c-9af7-6aebf54a68cd tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.295778 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6a67e732-580d-4f0c-9af7-6aebf54a68cd tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags" status: 200 len: 12 microversion: 2.26 time: 0.066309 May 28 04:41:50.297064 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1023/2096] 10.222.0.58 () {60 vars in 1291 bytes} [Sat May 28 04:41:50 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags => generated 12 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:50.311459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c5347adc-612f-49b6-bb04-476c011a6c03 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:50.312780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6aeb04ed-2fd7-4c34-b1b5-3537a9fb793a tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:50.313804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6aeb04ed-2fd7-4c34-b1b5-3537a9fb793a tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:50.323322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c5347adc-612f-49b6-bb04-476c011a6c03 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:50.323599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c5347adc-612f-49b6-bb04-476c011a6c03 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:50.324741 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c5347adc-612f-49b6-bb04-476c011a6c03 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1250 microversion: 2.25 time: 0.178061 May 28 04:41:50.325445 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1074/2097] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:50 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1250 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:50.331158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6aeb04ed-2fd7-4c34-b1b5-3537a9fb793a tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.331626 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6aeb04ed-2fd7-4c34-b1b5-3537a9fb793a tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.334741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6aeb04ed-2fd7-4c34-b1b5-3537a9fb793a tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.336199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6aeb04ed-2fd7-4c34-b1b5-3537a9fb793a tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.339041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-180ef8b2-f331-418e-a4be-52e481b20e0f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '.version_select at 0x7f77012283a0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:50.353577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-180ef8b2-f331-418e-a4be-52e481b20e0f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.354136 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-180ef8b2-f331-418e-a4be-52e481b20e0f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.354658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-180ef8b2-f331-418e-a4be-52e481b20e0f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:50.360933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-180ef8b2-f331-418e-a4be-52e481b20e0f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.361410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-180ef8b2-f331-418e-a4be-52e481b20e0f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.362183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-180ef8b2-f331-418e-a4be-52e481b20e0f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.363966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-180ef8b2-f331-418e-a4be-52e481b20e0f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.398280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-180ef8b2-f331-418e-a4be-52e481b20e0f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.398743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-180ef8b2-f331-418e-a4be-52e481b20e0f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.410579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-180ef8b2-f331-418e-a4be-52e481b20e0f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lazy-loading 'flavor' on Instance uuid 700c00f1-c8d2-44e4-a015-cc6168d9b456 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:41:50.453119 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-180ef8b2-f331-418e-a4be-52e481b20e0f tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "DELETE /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags" status: 204 len: 0 microversion: 2.26 time: 0.122665 May 28 04:41:50.463295 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1075/2098] 10.222.0.58 () {60 vars in 1294 bytes} [Sat May 28 04:41:50 2022] DELETE /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:41:50.489028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f287edce-ab0c-40f7-b491-84d55a852545 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '.version_select at 0x7f770200ab80>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:50.512314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f287edce-ab0c-40f7-b491-84d55a852545 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.514953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f287edce-ab0c-40f7-b491-84d55a852545 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.516064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f287edce-ab0c-40f7-b491-84d55a852545 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:50.537153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f287edce-ab0c-40f7-b491-84d55a852545 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.537840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f287edce-ab0c-40f7-b491-84d55a852545 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.539828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f287edce-ab0c-40f7-b491-84d55a852545 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.540498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f287edce-ab0c-40f7-b491-84d55a852545 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.594311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f287edce-ab0c-40f7-b491-84d55a852545 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.599441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f287edce-ab0c-40f7-b491-84d55a852545 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.625060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f287edce-ab0c-40f7-b491-84d55a852545 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.627845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f287edce-ab0c-40f7-b491-84d55a852545 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.780214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-f287edce-ab0c-40f7-b491-84d55a852545 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lazy-loading 'flavor' on Instance uuid 700c00f1-c8d2-44e4-a015-cc6168d9b456 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:41:50.814621 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f287edce-ab0c-40f7-b491-84d55a852545 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "PUT /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags/tempest-tag-830734714" status: 201 len: 0 microversion: 2.26 time: 0.339289 May 28 04:41:50.818369 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1076/2099] 10.222.0.58 () {62 vars in 1376 bytes} [Sat May 28 04:41:50 2022] PUT /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags/tempest-tag-830734714 => generated 0 bytes in 357 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) May 28 04:41:50.834220 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6aeb04ed-2fd7-4c34-b1b5-3537a9fb793a tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6/action" status: 202 len: 0 microversion: 2.1 time: 0.535542 May 28 04:41:50.836870 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1024/2100] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:41:50 2022] POST /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:41:50.843998 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-27099489-ae4b-43ed-b548-cfb02087e1c8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '.version_select at 0x7f77012288b0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:50.851502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0c4473e5-5b02-4678-a605-1556479e243a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "012b12af-263c-4753-8fad-4a4022b439aa"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:50.852978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0c4473e5-5b02-4678-a605-1556479e243a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:50.856793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27099489-ae4b-43ed-b548-cfb02087e1c8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.858183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27099489-ae4b-43ed-b548-cfb02087e1c8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.859299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-27099489-ae4b-43ed-b548-cfb02087e1c8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:50.872921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27099489-ae4b-43ed-b548-cfb02087e1c8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.874635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27099489-ae4b-43ed-b548-cfb02087e1c8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.878852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c4473e5-5b02-4678-a605-1556479e243a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.879493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27099489-ae4b-43ed-b548-cfb02087e1c8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.879776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c4473e5-5b02-4678-a605-1556479e243a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.880326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27099489-ae4b-43ed-b548-cfb02087e1c8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.880840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c4473e5-5b02-4678-a605-1556479e243a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.881291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c4473e5-5b02-4678-a605-1556479e243a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.964444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27099489-ae4b-43ed-b548-cfb02087e1c8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.969412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27099489-ae4b-43ed-b548-cfb02087e1c8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:50.989205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27099489-ae4b-43ed-b548-cfb02087e1c8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:50.989672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27099489-ae4b-43ed-b548-cfb02087e1c8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:51.077208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0c4473e5-5b02-4678-a605-1556479e243a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:41:51.077939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0c4473e5-5b02-4678-a605-1556479e243a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:41:51.079533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0c4473e5-5b02-4678-a605-1556479e243a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:41:51.087478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0c4473e5-5b02-4678-a605-1556479e243a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:41:51.088076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0c4473e5-5b02-4678-a605-1556479e243a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:41:51.105658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-27099489-ae4b-43ed-b548-cfb02087e1c8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lazy-loading 'flavor' on Instance uuid 700c00f1-c8d2-44e4-a015-cc6168d9b456 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:41:51.126200 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-27099489-ae4b-43ed-b548-cfb02087e1c8 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "PUT /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags/tempest-tag-1581787825" status: 201 len: 0 microversion: 2.26 time: 0.301738 May 28 04:41:51.132902 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1077/2101] 10.222.0.58 () {62 vars in 1379 bytes} [Sat May 28 04:41:50 2022] PUT /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags/tempest-tag-1581787825 => generated 0 bytes in 310 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 28 04:41:51.139262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-195e0f6b-3bfa-4eeb-bf80-050736debe5c tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Action: 'update_all', calling method: .version_select at 0x7f7701228670>, body: {"tags": ["tempest-tag-750608408", "tempest-tag-1946502336"]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:51.150578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-195e0f6b-3bfa-4eeb-bf80-050736debe5c tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:51.151371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-195e0f6b-3bfa-4eeb-bf80-050736debe5c tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:51.154837 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-195e0f6b-3bfa-4eeb-bf80-050736debe5c tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:51.170618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-195e0f6b-3bfa-4eeb-bf80-050736debe5c tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:51.172086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-195e0f6b-3bfa-4eeb-bf80-050736debe5c tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:51.173497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-195e0f6b-3bfa-4eeb-bf80-050736debe5c tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:51.174116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-195e0f6b-3bfa-4eeb-bf80-050736debe5c tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:51.218654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-195e0f6b-3bfa-4eeb-bf80-050736debe5c tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:51.219816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-195e0f6b-3bfa-4eeb-bf80-050736debe5c tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:51.367498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-195e0f6b-3bfa-4eeb-bf80-050736debe5c tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lazy-loading 'flavor' on Instance uuid 700c00f1-c8d2-44e4-a015-cc6168d9b456 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:41:51.410960 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-195e0f6b-3bfa-4eeb-bf80-050736debe5c tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "PUT /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags" status: 200 len: 61 microversion: 2.26 time: 0.276444 May 28 04:41:51.412247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0c4473e5-5b02-4678-a605-1556479e243a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:51.420437 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1078/2102] 10.222.0.58 () {62 vars in 1311 bytes} [Sat May 28 04:41:51 2022] PUT /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags => generated 61 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:51.436673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c4473e5-5b02-4678-a605-1556479e243a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:51.439974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6b8c6aa0-75e5-4ecb-ac36-f2ae32596a7e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:51.440664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6b8c6aa0-75e5-4ecb-ac36-f2ae32596a7e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:51.441741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c4473e5-5b02-4678-a605-1556479e243a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:51.451212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c4473e5-5b02-4678-a605-1556479e243a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:51.451473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c4473e5-5b02-4678-a605-1556479e243a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:51.464992 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6b8c6aa0-75e5-4ecb-ac36-f2ae32596a7e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:51.465459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6b8c6aa0-75e5-4ecb-ac36-f2ae32596a7e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:51.466254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6b8c6aa0-75e5-4ecb-ac36-f2ae32596a7e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:51.466776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6b8c6aa0-75e5-4ecb-ac36-f2ae32596a7e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:51.502258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=93,nova_cell1:DELETE=2,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:51.541995 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0c4473e5-5b02-4678-a605-1556479e243a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "POST /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6/action" status: 202 len: 1067 microversion: 2.1 time: 0.695263 May 28 04:41:51.545062 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1025/2103] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:41:50 2022] POST /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6/action => generated 1067 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 28 04:41:51.549968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-48666216-2be0-4797-bc52-7430a685eefb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:51.550586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-48666216-2be0-4797-bc52-7430a685eefb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:51.589407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48666216-2be0-4797-bc52-7430a685eefb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:51.592492 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48666216-2be0-4797-bc52-7430a685eefb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:51.593964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48666216-2be0-4797-bc52-7430a685eefb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:51.596403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48666216-2be0-4797-bc52-7430a685eefb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:52.094931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6b8c6aa0-75e5-4ecb-ac36-f2ae32596a7e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:52.103241 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6b8c6aa0-75e5-4ecb-ac36-f2ae32596a7e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1515 microversion: 2.1 time: 0.681620 May 28 04:41:52.123496 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1079/2104] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:51 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1515 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:52.140083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-63e1f063-84ea-4ddc-9b45-9cb5241eb82c tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '.version_select at 0x7f7701f11280>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:52.161099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-63e1f063-84ea-4ddc-9b45-9cb5241eb82c tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:52.165254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-63e1f063-84ea-4ddc-9b45-9cb5241eb82c tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:52.193285 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-63e1f063-84ea-4ddc-9b45-9cb5241eb82c tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags" status: 200 len: 61 microversion: 2.26 time: 0.068543 May 28 04:41:52.193918 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1080/2105] 10.222.0.58 () {60 vars in 1291 bytes} [Sat May 28 04:41:52 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags => generated 61 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:52.203727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4d96e451-389a-40b1-a625-4c76a0cbaf6e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:52.216946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4d96e451-389a-40b1-a625-4c76a0cbaf6e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:52.238948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d96e451-389a-40b1-a625-4c76a0cbaf6e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:52.239827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d96e451-389a-40b1-a625-4c76a0cbaf6e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:52.240798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d96e451-389a-40b1-a625-4c76a0cbaf6e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:52.247886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d96e451-389a-40b1-a625-4c76a0cbaf6e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:52.273771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-48666216-2be0-4797-bc52-7430a685eefb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:52.299555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-48666216-2be0-4797-bc52-7430a685eefb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:52.305581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:52.306764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-48666216-2be0-4797-bc52-7430a685eefb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:52.316433 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-48666216-2be0-4797-bc52-7430a685eefb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1292 microversion: 2.25 time: 0.769275 May 28 04:41:52.317349 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1026/2106] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:51 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1292 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:52.325594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f42d077b-052e-422c-81b9-876ebfdeddc7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '.version_select at 0x7f7707507940>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:52.359600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f42d077b-052e-422c-81b9-876ebfdeddc7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:52.362562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f42d077b-052e-422c-81b9-876ebfdeddc7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:52.366072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f42d077b-052e-422c-81b9-876ebfdeddc7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:52.381310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f42d077b-052e-422c-81b9-876ebfdeddc7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:52.382636 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f42d077b-052e-422c-81b9-876ebfdeddc7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:52.389745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f42d077b-052e-422c-81b9-876ebfdeddc7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:52.390440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f42d077b-052e-422c-81b9-876ebfdeddc7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:52.468748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f42d077b-052e-422c-81b9-876ebfdeddc7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:52.470421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f42d077b-052e-422c-81b9-876ebfdeddc7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:52.575781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-f42d077b-052e-422c-81b9-876ebfdeddc7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lazy-loading 'flavor' on Instance uuid 700c00f1-c8d2-44e4-a015-cc6168d9b456 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:41:52.596413 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f42d077b-052e-422c-81b9-876ebfdeddc7 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "DELETE /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags" status: 204 len: 0 microversion: 2.26 time: 0.274785 May 28 04:41:52.604011 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1027/2107] 10.222.0.58 () {60 vars in 1294 bytes} [Sat May 28 04:41:52 2022] DELETE /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456/tags => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:41:52.614919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-86b2b842-ebe3-4257-ac42-4436866b5e25 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:52.618071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-86b2b842-ebe3-4257-ac42-4436866b5e25 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:52.641066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-86b2b842-ebe3-4257-ac42-4436866b5e25 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:52.641538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-86b2b842-ebe3-4257-ac42-4436866b5e25 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:52.642360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-86b2b842-ebe3-4257-ac42-4436866b5e25 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:52.642802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-86b2b842-ebe3-4257-ac42-4436866b5e25 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:52.644835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4d96e451-389a-40b1-a625-4c76a0cbaf6e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:52.660606 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4d96e451-389a-40b1-a625-4c76a0cbaf6e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1471 microversion: 2.1 time: 0.458985 May 28 04:41:52.662354 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1081/2108] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:52 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1471 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:52.739752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-86b2b842-ebe3-4257-ac42-4436866b5e25 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:41:53.122368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c2595314-d097-4fd2-9bba-6faa8a2f58ea tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:53.123250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c2595314-d097-4fd2-9bba-6faa8a2f58ea tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:53.136677 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2595314-d097-4fd2-9bba-6faa8a2f58ea tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:53.137143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2595314-d097-4fd2-9bba-6faa8a2f58ea tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:53.144230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2595314-d097-4fd2-9bba-6faa8a2f58ea tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:53.144706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2595314-d097-4fd2-9bba-6faa8a2f58ea tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:53.212482 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-86b2b842-ebe3-4257-ac42-4436866b5e25 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "DELETE /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456" status: 204 len: 0 microversion: 2.26 time: 0.605674 May 28 04:41:53.214565 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1028/2109] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:41:52 2022] DELETE /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 28 04:41:53.224837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a9549c17-40a7-4d9f-b62b-adb9179e7987 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:53.226446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a9549c17-40a7-4d9f-b62b-adb9179e7987 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:53.240175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a9549c17-40a7-4d9f-b62b-adb9179e7987 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:53.241773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a9549c17-40a7-4d9f-b62b-adb9179e7987 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:53.248969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a9549c17-40a7-4d9f-b62b-adb9179e7987 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:53.248969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a9549c17-40a7-4d9f-b62b-adb9179e7987 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:53.458530 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c2595314-d097-4fd2-9bba-6faa8a2f58ea tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:53.469083 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c2595314-d097-4fd2-9bba-6faa8a2f58ea tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1515 microversion: 2.1 time: 0.351140 May 28 04:41:53.470529 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1082/2110] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:53 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1515 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:53.485247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ecc5444c-36cc-413c-b53f-04939a7e12f6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:53.486121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ecc5444c-36cc-413c-b53f-04939a7e12f6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:53.502905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ecc5444c-36cc-413c-b53f-04939a7e12f6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:53.503457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ecc5444c-36cc-413c-b53f-04939a7e12f6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:53.506041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ecc5444c-36cc-413c-b53f-04939a7e12f6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:53.506563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ecc5444c-36cc-413c-b53f-04939a7e12f6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:53.611280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a9549c17-40a7-4d9f-b62b-adb9179e7987 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:53.625593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a9549c17-40a7-4d9f-b62b-adb9179e7987 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:53.629738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a9549c17-40a7-4d9f-b62b-adb9179e7987 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:53.634023 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a9549c17-40a7-4d9f-b62b-adb9179e7987 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456" status: 200 len: 1551 microversion: 2.26 time: 0.415824 May 28 04:41:53.636847 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1029/2111] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:53 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 => generated 1551 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:41:53.682706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cdd6a705-6ed5-425d-957b-81aaa5cff942 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:53.690722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cdd6a705-6ed5-425d-957b-81aaa5cff942 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:53.707642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdd6a705-6ed5-425d-957b-81aaa5cff942 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:53.713748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdd6a705-6ed5-425d-957b-81aaa5cff942 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:53.714823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdd6a705-6ed5-425d-957b-81aaa5cff942 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:53.715470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdd6a705-6ed5-425d-957b-81aaa5cff942 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:53.788006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ecc5444c-36cc-413c-b53f-04939a7e12f6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:53.801928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ecc5444c-36cc-413c-b53f-04939a7e12f6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:53.806671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ecc5444c-36cc-413c-b53f-04939a7e12f6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:53.808098 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ecc5444c-36cc-413c-b53f-04939a7e12f6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1292 microversion: 2.25 time: 0.336604 May 28 04:41:53.823404 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1083/2112] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:53 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1292 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:54.019495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cdd6a705-6ed5-425d-957b-81aaa5cff942 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:54.035066 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cdd6a705-6ed5-425d-957b-81aaa5cff942 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1471 microversion: 2.1 time: 0.356316 May 28 04:41:54.036059 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1030/2113] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:53 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1471 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:54.517871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5eb3b79a-5649-4e24-8a87-b01f5368fd48 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:54.517871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5eb3b79a-5649-4e24-8a87-b01f5368fd48 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:54.517871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5eb3b79a-5649-4e24-8a87-b01f5368fd48 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:54.517871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5eb3b79a-5649-4e24-8a87-b01f5368fd48 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:54.517871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5eb3b79a-5649-4e24-8a87-b01f5368fd48 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:54.517871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5eb3b79a-5649-4e24-8a87-b01f5368fd48 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:54.653139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-582db830-59bd-4c12-80d3-d7d42d1e3cb0 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:54.654431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-582db830-59bd-4c12-80d3-d7d42d1e3cb0 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:54.666645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-582db830-59bd-4c12-80d3-d7d42d1e3cb0 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:54.667782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-582db830-59bd-4c12-80d3-d7d42d1e3cb0 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:54.672195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-582db830-59bd-4c12-80d3-d7d42d1e3cb0 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:54.672890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-582db830-59bd-4c12-80d3-d7d42d1e3cb0 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:54.727177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5eb3b79a-5649-4e24-8a87-b01f5368fd48 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:54.742290 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5eb3b79a-5649-4e24-8a87-b01f5368fd48 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1515 microversion: 2.1 time: 0.257286 May 28 04:41:54.752805 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1084/2114] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:54 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1515 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:54.832900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0b7fac4d-42f7-4c7b-8ff8-32bba8b5d99c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:54.835172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0b7fac4d-42f7-4c7b-8ff8-32bba8b5d99c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:54.849596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b7fac4d-42f7-4c7b-8ff8-32bba8b5d99c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:54.856472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b7fac4d-42f7-4c7b-8ff8-32bba8b5d99c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:54.857608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b7fac4d-42f7-4c7b-8ff8-32bba8b5d99c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:54.858223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b7fac4d-42f7-4c7b-8ff8-32bba8b5d99c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:54.924679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-582db830-59bd-4c12-80d3-d7d42d1e3cb0 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:54.936864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-582db830-59bd-4c12-80d3-d7d42d1e3cb0 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:54.948716 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-582db830-59bd-4c12-80d3-d7d42d1e3cb0 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:54.952796 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-582db830-59bd-4c12-80d3-d7d42d1e3cb0 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456" status: 200 len: 1551 microversion: 2.26 time: 0.302785 May 28 04:41:54.967423 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1031/2115] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:54 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 => generated 1551 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:41:54.979596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-2720968a-8ca7-4697-a40c-5e7d093ab3ae req-99cc217b-5275-4720-8ed9-cf0e7536f644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c3986b-245a-4454-95c7-63f826af6edc", "tag": "a8517f33-040a-4dc7-a1bf-9a16a458e569"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:54.994441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:55.008371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2720968a-8ca7-4697-a40c-5e7d093ab3ae req-99cc217b-5275-4720-8ed9-cf0e7536f644 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:55.009097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2720968a-8ca7-4697-a40c-5e7d093ab3ae req-99cc217b-5275-4720-8ed9-cf0e7536f644 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:55.035955 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-2720968a-8ca7-4697-a40c-5e7d093ab3ae req-99cc217b-5275-4720-8ed9-cf0e7536f644 service nova] Creating event network-changed:a8517f33-040a-4dc7-a1bf-9a16a458e569 for instance 05c3986b-245a-4454-95c7-63f826af6edc on n-h2-843700-1 May 28 04:41:55.056132 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-2720968a-8ca7-4697-a40c-5e7d093ab3ae req-99cc217b-5275-4720-8ed9-cf0e7536f644 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080589 May 28 04:41:55.057492 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1032/2116] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:41:55.066910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d99ceb91-cab7-4478-beb6-ee704a0d1a65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:55.069428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d99ceb91-cab7-4478-beb6-ee704a0d1a65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:55.086356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d99ceb91-cab7-4478-beb6-ee704a0d1a65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:55.091299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d99ceb91-cab7-4478-beb6-ee704a0d1a65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:55.092935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d99ceb91-cab7-4478-beb6-ee704a0d1a65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:55.097136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d99ceb91-cab7-4478-beb6-ee704a0d1a65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:55.239914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0b7fac4d-42f7-4c7b-8ff8-32bba8b5d99c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:55.253229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0b7fac4d-42f7-4c7b-8ff8-32bba8b5d99c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:55.261964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0b7fac4d-42f7-4c7b-8ff8-32bba8b5d99c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:55.266568 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0b7fac4d-42f7-4c7b-8ff8-32bba8b5d99c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1292 microversion: 2.25 time: 0.436614 May 28 04:41:55.268300 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1085/2117] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:54 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1292 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:55.395521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d99ceb91-cab7-4478-beb6-ee704a0d1a65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:55.407461 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d99ceb91-cab7-4478-beb6-ee704a0d1a65 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1471 microversion: 2.1 time: 0.347550 May 28 04:41:55.408489 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1033/2118] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:55 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1471 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:55.763107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d84796b1-4855-467c-a3ab-bd040807d545 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:55.764024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d84796b1-4855-467c-a3ab-bd040807d545 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:55.778604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d84796b1-4855-467c-a3ab-bd040807d545 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:55.779415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d84796b1-4855-467c-a3ab-bd040807d545 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:55.782118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d84796b1-4855-467c-a3ab-bd040807d545 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:55.782761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d84796b1-4855-467c-a3ab-bd040807d545 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:55.973416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cd3ec664-e1d9-4a9c-9002-ed5ddb045eb3 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:55.974786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cd3ec664-e1d9-4a9c-9002-ed5ddb045eb3 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:56.004936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd3ec664-e1d9-4a9c-9002-ed5ddb045eb3 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:56.005641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd3ec664-e1d9-4a9c-9002-ed5ddb045eb3 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:56.008775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd3ec664-e1d9-4a9c-9002-ed5ddb045eb3 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:56.010586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd3ec664-e1d9-4a9c-9002-ed5ddb045eb3 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:56.047533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d84796b1-4855-467c-a3ab-bd040807d545 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:56.056258 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d84796b1-4855-467c-a3ab-bd040807d545 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1515 microversion: 2.1 time: 0.300456 May 28 04:41:56.058941 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1086/2119] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:55 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1515 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:56.298338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cd3ec664-e1d9-4a9c-9002-ed5ddb045eb3 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:56.304666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b1aaaa56-443b-4c6f-babf-0b9939fd9c80 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:56.315435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b1aaaa56-443b-4c6f-babf-0b9939fd9c80 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:56.336405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cd3ec664-e1d9-4a9c-9002-ed5ddb045eb3 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:56.346062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1aaaa56-443b-4c6f-babf-0b9939fd9c80 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:56.350185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1aaaa56-443b-4c6f-babf-0b9939fd9c80 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:56.350352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cd3ec664-e1d9-4a9c-9002-ed5ddb045eb3 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:56.350537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1aaaa56-443b-4c6f-babf-0b9939fd9c80 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:56.352053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1aaaa56-443b-4c6f-babf-0b9939fd9c80 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:56.355894 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cd3ec664-e1d9-4a9c-9002-ed5ddb045eb3 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456" status: 200 len: 1551 microversion: 2.26 time: 0.386933 May 28 04:41:56.359477 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1034/2120] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:55 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 => generated 1551 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:41:56.426209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1d62216a-2aaa-4f48-b17a-409e70fc26d1 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:56.426909 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1d62216a-2aaa-4f48-b17a-409e70fc26d1 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:56.442264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d62216a-2aaa-4f48-b17a-409e70fc26d1 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:56.442264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d62216a-2aaa-4f48-b17a-409e70fc26d1 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:56.442264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d62216a-2aaa-4f48-b17a-409e70fc26d1 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:56.452716 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d62216a-2aaa-4f48-b17a-409e70fc26d1 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:56.461969 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=10 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:56.888214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b1aaaa56-443b-4c6f-babf-0b9939fd9c80 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:56.908447 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1d62216a-2aaa-4f48-b17a-409e70fc26d1 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:56.918208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b1aaaa56-443b-4c6f-babf-0b9939fd9c80 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:56.921402 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1d62216a-2aaa-4f48-b17a-409e70fc26d1 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1471 microversion: 2.1 time: 0.499336 May 28 04:41:56.925143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b1aaaa56-443b-4c6f-babf-0b9939fd9c80 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:56.929269 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b1aaaa56-443b-4c6f-babf-0b9939fd9c80 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1292 microversion: 2.25 time: 0.647374 May 28 04:41:56.933668 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1035/2121] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:56 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1471 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:56.934086 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1087/2122] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:56 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1292 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:41:57.082272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d6229ea1-7181-41a9-b08d-fe95cf39cf3e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:57.085870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d6229ea1-7181-41a9-b08d-fe95cf39cf3e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:57.092324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6229ea1-7181-41a9-b08d-fe95cf39cf3e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:57.092880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6229ea1-7181-41a9-b08d-fe95cf39cf3e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:57.094044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6229ea1-7181-41a9-b08d-fe95cf39cf3e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:57.094151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6229ea1-7181-41a9-b08d-fe95cf39cf3e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:57.138420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-fbd236ba-8715-4012-a25d-ae7ce46fa91c req-ffb17134-6873-4e10-8703-51bb935864ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "700c00f1-c8d2-44e4-a015-cc6168d9b456", "name": "network-vif-deleted", "tag": "929e4c25-a182-48aa-8642-8a664b22dbe2"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:41:57.155331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-fbd236ba-8715-4012-a25d-ae7ce46fa91c req-ffb17134-6873-4e10-8703-51bb935864ce service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:57.155878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-fbd236ba-8715-4012-a25d-ae7ce46fa91c req-ffb17134-6873-4e10-8703-51bb935864ce service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:57.179900 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-fbd236ba-8715-4012-a25d-ae7ce46fa91c req-ffb17134-6873-4e10-8703-51bb935864ce service nova] Creating event network-vif-deleted:929e4c25-a182-48aa-8642-8a664b22dbe2 for instance 700c00f1-c8d2-44e4-a015-cc6168d9b456 on n-h2-843700-1 May 28 04:41:57.187288 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-fbd236ba-8715-4012-a25d-ae7ce46fa91c req-ffb17134-6873-4e10-8703-51bb935864ce service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051857 May 28 04:41:57.188696 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1088/2123] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:41:57.359257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d6229ea1-7181-41a9-b08d-fe95cf39cf3e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:57.377315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-52e6f3c6-6b10-4bb3-badf-fb4a5b9b29fb tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:57.378198 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-52e6f3c6-6b10-4bb3-badf-fb4a5b9b29fb tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:57.384499 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d6229ea1-7181-41a9-b08d-fe95cf39cf3e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1515 microversion: 2.1 time: 0.308308 May 28 04:41:57.390881 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1036/2124] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:57 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1515 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:57.394456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52e6f3c6-6b10-4bb3-badf-fb4a5b9b29fb tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:57.396238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52e6f3c6-6b10-4bb3-badf-fb4a5b9b29fb tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:57.399539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52e6f3c6-6b10-4bb3-badf-fb4a5b9b29fb tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:57.400381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52e6f3c6-6b10-4bb3-badf-fb4a5b9b29fb tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:57.480640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52e6f3c6-6b10-4bb3-badf-fb4a5b9b29fb tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:57.481167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52e6f3c6-6b10-4bb3-badf-fb4a5b9b29fb tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:57.481745 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-52e6f3c6-6b10-4bb3-badf-fb4a5b9b29fb tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lazy-loading 'fault' on Instance uuid 700c00f1-c8d2-44e4-a015-cc6168d9b456 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:41:57.546528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-52e6f3c6-6b10-4bb3-badf-fb4a5b9b29fb tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:57.557893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-52e6f3c6-6b10-4bb3-badf-fb4a5b9b29fb tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:57.560260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-52e6f3c6-6b10-4bb3-badf-fb4a5b9b29fb tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d4faab008b493c9ea053036f3ef92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab1bb14448e4f0c9e0f266f1f8500d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:57.564652 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-52e6f3c6-6b10-4bb3-badf-fb4a5b9b29fb tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456" status: 200 len: 1351 microversion: 2.26 time: 0.190188 May 28 04:41:57.564652 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1089/2125] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:57 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 => generated 1351 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:41:57.938549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-992fb5a2-21e2-4832-87a6-b128b3c9c6c4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:57.951754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bf6558d9-bf61-4b36-8a15-888a865a456e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:57.952888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-992fb5a2-21e2-4832-87a6-b128b3c9c6c4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:57.953594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bf6558d9-bf61-4b36-8a15-888a865a456e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:57.992723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-992fb5a2-21e2-4832-87a6-b128b3c9c6c4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:57.993336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-992fb5a2-21e2-4832-87a6-b128b3c9c6c4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:57.993816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf6558d9-bf61-4b36-8a15-888a865a456e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:57.994728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-992fb5a2-21e2-4832-87a6-b128b3c9c6c4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:57.995874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf6558d9-bf61-4b36-8a15-888a865a456e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:57.996916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf6558d9-bf61-4b36-8a15-888a865a456e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:57.997618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-992fb5a2-21e2-4832-87a6-b128b3c9c6c4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:57.999412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf6558d9-bf61-4b36-8a15-888a865a456e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:58.448422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bf6558d9-bf61-4b36-8a15-888a865a456e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:58.468077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bf6558d9-bf61-4b36-8a15-888a865a456e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:58.472340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bf6558d9-bf61-4b36-8a15-888a865a456e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:58.479882 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bf6558d9-bf61-4b36-8a15-888a865a456e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1292 microversion: 2.25 time: 0.532205 May 28 04:41:58.481589 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1090/2126] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:57 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1292 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:58.501026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-992fb5a2-21e2-4832-87a6-b128b3c9c6c4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:58.511286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-df81cde3-db1e-4bfd-b6d6-ccce3e89b9d8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:58.522232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-df81cde3-db1e-4bfd-b6d6-ccce3e89b9d8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:58.535759 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-992fb5a2-21e2-4832-87a6-b128b3c9c6c4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1471 microversion: 2.1 time: 0.601264 May 28 04:41:58.546118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df81cde3-db1e-4bfd-b6d6-ccce3e89b9d8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:58.546118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df81cde3-db1e-4bfd-b6d6-ccce3e89b9d8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:58.546447 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1037/2127] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:57 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1471 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:58.546580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df81cde3-db1e-4bfd-b6d6-ccce3e89b9d8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:58.558670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df81cde3-db1e-4bfd-b6d6-ccce3e89b9d8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:58.585414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6fe281b6-6ed0-4440-8b8e-a23fbbf568c2 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:58.586387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6fe281b6-6ed0-4440-8b8e-a23fbbf568c2 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] [instance: 700c00f1-c8d2-44e4-a015-cc6168d9b456] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:58.596592 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6fe281b6-6ed0-4440-8b8e-a23fbbf568c2 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:58.597054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6fe281b6-6ed0-4440-8b8e-a23fbbf568c2 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:58.602851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6fe281b6-6ed0-4440-8b8e-a23fbbf568c2 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:58.605234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6fe281b6-6ed0-4440-8b8e-a23fbbf568c2 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:58.658031 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-6fe281b6-6ed0-4440-8b8e-a23fbbf568c2 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] HTTP exception thrown: Instance 700c00f1-c8d2-44e4-a015-cc6168d9b456 could not be found. May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6fe281b6-6ed0-4440-8b8e-a23fbbf568c2 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Request method failure captured: May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 HTTP/1.1 May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikafyscdzsebqvi78aRdhSHO_uWmHRN2yfRZbaWcYQ36aYPm9jw5FFBXFR9YFuW4u8JPa20Dptg0jApkrb2cy8yQ5_QZSHpuiUSxrBylZzXYM1hH5fxajtZo0h4FAecNIAWCrmOtV2V2-4YZebuzydBj49g6RlMP4lMbCdsKGfDleTQU May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-Openstack-Nova-Api-Version: 2.26 May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 4ab1bb14448e4f0c9e0f266f1f8500d0 May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerTagsTestJSON-1911739302 May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4ab1bb14448e4f0c9e0f266f1f8500d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4ab1bb14448e4f0c9e0f266f1f8500d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4ab1bb14448e4f0c9e0f266f1f8500d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4ab1bb14448e4f0c9e0f266f1f8500d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerTagsTestJSON-1911739302 May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 4ab1bb14448e4f0c9e0f266f1f8500d0 May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerTagsTestJSON-1911739302 May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerTagsTestJSON-1911739302-project May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 40d4faab008b493c9ea053036f3ef92f May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerTagsTestJSON-1911739302-project May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 700c00f1-c8d2-44e4-a015-cc6168d9b456 could not be found. May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '700c00f1-c8d2-44e4-a015-cc6168d9b456'} May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 700c00f1-c8d2-44e4-a015-cc6168d9b456 could not be found. May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 700c00f1-c8d2-44e4-a015-cc6168d9b456 could not be found. May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:41:58.666241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:58.674639 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:41:58.674639 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:41:58.674639 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:41:58.674639 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:41:58.674639 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:41:58.674639 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 700c00f1-c8d2-44e4-a015-cc6168d9b456 could not be found. May 28 04:41:58.674639 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:41:58.674639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6fe281b6-6ed0-4440-8b8e-a23fbbf568c2 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] Returning 404 to user: Instance 700c00f1-c8d2-44e4-a015-cc6168d9b456 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:41:58.674639 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6fe281b6-6ed0-4440-8b8e-a23fbbf568c2 tempest-ServerTagsTestJSON-1911739302 tempest-ServerTagsTestJSON-1911739302-project] 10.222.0.58 "GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456" status: 404 len: 111 microversion: 2.26 time: 0.089007 May 28 04:41:58.674639 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1038/2128] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:58 2022] GET /compute/v2.1/servers/700c00f1-c8d2-44e4-a015-cc6168d9b456 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 04:41:58.967261 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-df81cde3-db1e-4bfd-b6d6-ccce3e89b9d8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:58.979852 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-df81cde3-db1e-4bfd-b6d6-ccce3e89b9d8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1515 microversion: 2.1 time: 0.480425 May 28 04:41:58.981075 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1091/2129] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:58 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1515 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:41:59.499268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bd23abe8-9a0d-43af-9935-3d66509b8bee tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:59.500182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bd23abe8-9a0d-43af-9935-3d66509b8bee tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:59.504275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:41:59.512511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd23abe8-9a0d-43af-9935-3d66509b8bee tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:59.515104 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd23abe8-9a0d-43af-9935-3d66509b8bee tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:59.517167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd23abe8-9a0d-43af-9935-3d66509b8bee tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:59.519012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd23abe8-9a0d-43af-9935-3d66509b8bee tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:59.555500 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c4b92bb4-4e4b-46c8-919f-7e9311bf4045 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:59.556362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c4b92bb4-4e4b-46c8-919f-7e9311bf4045 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:41:59.572875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4b92bb4-4e4b-46c8-919f-7e9311bf4045 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:59.576164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4b92bb4-4e4b-46c8-919f-7e9311bf4045 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:59.582112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4b92bb4-4e4b-46c8-919f-7e9311bf4045 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:41:59.582838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4b92bb4-4e4b-46c8-919f-7e9311bf4045 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:41:59.909905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bd23abe8-9a0d-43af-9935-3d66509b8bee tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:59.923689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bd23abe8-9a0d-43af-9935-3d66509b8bee tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:59.929113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bd23abe8-9a0d-43af-9935-3d66509b8bee tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:59.930836 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bd23abe8-9a0d-43af-9935-3d66509b8bee tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1292 microversion: 2.25 time: 0.435916 May 28 04:41:59.933950 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1039/2130] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:41:59 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1292 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:41:59.968380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c4b92bb4-4e4b-46c8-919f-7e9311bf4045 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:41:59.989706 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c4b92bb4-4e4b-46c8-919f-7e9311bf4045 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1471 microversion: 2.1 time: 0.439505 May 28 04:41:59.997664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7e0b8863-d751-44af-973f-2b80627601e8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:41:59.998519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7e0b8863-d751-44af-973f-2b80627601e8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:00.008098 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1092/2131] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:59 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1471 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:00.013076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e0b8863-d751-44af-973f-2b80627601e8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:00.013669 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e0b8863-d751-44af-973f-2b80627601e8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:00.017647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e0b8863-d751-44af-973f-2b80627601e8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:00.018213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e0b8863-d751-44af-973f-2b80627601e8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:00.366234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7e0b8863-d751-44af-973f-2b80627601e8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:00.379037 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7e0b8863-d751-44af-973f-2b80627601e8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1515 microversion: 2.1 time: 0.383187 May 28 04:42:00.382471 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1040/2132] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:41:59 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1515 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:00.952334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4bd350be-9a0f-4c4f-86ec-ce8cb2d00501 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:00.953498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4bd350be-9a0f-4c4f-86ec-ce8cb2d00501 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:00.961604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=14 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:00.969876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4bd350be-9a0f-4c4f-86ec-ce8cb2d00501 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:00.971584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4bd350be-9a0f-4c4f-86ec-ce8cb2d00501 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:00.972439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4bd350be-9a0f-4c4f-86ec-ce8cb2d00501 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:00.975483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4bd350be-9a0f-4c4f-86ec-ce8cb2d00501 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:01.011620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ab10d6cd-a6f6-4250-b869-2959941ae24a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:01.012267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ab10d6cd-a6f6-4250-b869-2959941ae24a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:01.033131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ab10d6cd-a6f6-4250-b869-2959941ae24a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:01.033508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ab10d6cd-a6f6-4250-b869-2959941ae24a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:01.034532 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ab10d6cd-a6f6-4250-b869-2959941ae24a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:01.034981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ab10d6cd-a6f6-4250-b869-2959941ae24a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:01.408026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4bd350be-9a0f-4c4f-86ec-ce8cb2d00501 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:01.423619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4bd350be-9a0f-4c4f-86ec-ce8cb2d00501 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:01.426834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4bd350be-9a0f-4c4f-86ec-ce8cb2d00501 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:01.431778 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4bd350be-9a0f-4c4f-86ec-ce8cb2d00501 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1292 microversion: 2.25 time: 0.483750 May 28 04:42:01.449834 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1093/2133] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:00 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1292 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:01.459205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9ea941ba-6bfc-4ae9-89e1-373fdc2f9b06 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:01.460728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9ea941ba-6bfc-4ae9-89e1-373fdc2f9b06 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:01.467563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ea941ba-6bfc-4ae9-89e1-373fdc2f9b06 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:01.468399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ea941ba-6bfc-4ae9-89e1-373fdc2f9b06 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:01.469479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ea941ba-6bfc-4ae9-89e1-373fdc2f9b06 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:01.470184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ea941ba-6bfc-4ae9-89e1-373fdc2f9b06 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:01.488686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ab10d6cd-a6f6-4250-b869-2959941ae24a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:01.495392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:01.503142 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ab10d6cd-a6f6-4250-b869-2959941ae24a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1471 microversion: 2.1 time: 0.499116 May 28 04:42:01.503989 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1041/2134] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:01 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1471 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:01.638089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9ea941ba-6bfc-4ae9-89e1-373fdc2f9b06 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:01.646050 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9ea941ba-6bfc-4ae9-89e1-373fdc2f9b06 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1515 microversion: 2.1 time: 0.198918 May 28 04:42:01.646635 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1094/2135] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:01 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:02.067718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c32016f9-bb6c-4e28-a52d-ede429098a1e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:02.068529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c32016f9-bb6c-4e28-a52d-ede429098a1e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:02.093850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c32016f9-bb6c-4e28-a52d-ede429098a1e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:02.094875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c32016f9-bb6c-4e28-a52d-ede429098a1e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:02.100526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c32016f9-bb6c-4e28-a52d-ede429098a1e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:02.101515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c32016f9-bb6c-4e28-a52d-ede429098a1e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:02.187075 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c32016f9-bb6c-4e28-a52d-ede429098a1e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:42:02.451140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9a585562-f97f-4afd-8f38-78a2b61a6483 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:02.451926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9a585562-f97f-4afd-8f38-78a2b61a6483 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:02.461855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a585562-f97f-4afd-8f38-78a2b61a6483 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:02.465359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a585562-f97f-4afd-8f38-78a2b61a6483 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:02.466281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a585562-f97f-4afd-8f38-78a2b61a6483 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:02.467454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a585562-f97f-4afd-8f38-78a2b61a6483 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:02.493627 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c32016f9-bb6c-4e28-a52d-ede429098a1e tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "DELETE /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 204 len: 0 microversion: 2.1 time: 0.430242 May 28 04:42:02.494895 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1042/2136] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:42:02 2022] DELETE /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:42:02.504165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-93f6ef06-bc3f-4cad-92b4-4a9c42f536e9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:02.504928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-93f6ef06-bc3f-4cad-92b4-4a9c42f536e9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:02.518888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93f6ef06-bc3f-4cad-92b4-4a9c42f536e9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:02.519407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93f6ef06-bc3f-4cad-92b4-4a9c42f536e9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:02.522618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93f6ef06-bc3f-4cad-92b4-4a9c42f536e9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:02.523545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93f6ef06-bc3f-4cad-92b4-4a9c42f536e9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:02.947453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9a585562-f97f-4afd-8f38-78a2b61a6483 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:02.968694 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9a585562-f97f-4afd-8f38-78a2b61a6483 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:02.979776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9a585562-f97f-4afd-8f38-78a2b61a6483 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:02.981683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-93f6ef06-bc3f-4cad-92b4-4a9c42f536e9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:02.986633 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9a585562-f97f-4afd-8f38-78a2b61a6483 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1292 microversion: 2.25 time: 0.536098 May 28 04:42:02.988497 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1095/2137] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:02 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1292 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:02.993273 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-93f6ef06-bc3f-4cad-92b4-4a9c42f536e9 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1501 microversion: 2.1 time: 0.492131 May 28 04:42:03.009582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ddce4839-4e0f-454c-8cc3-a1dc2ce4998d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:03.010091 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1043/2138] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:02 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1501 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:03.010215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ddce4839-4e0f-454c-8cc3-a1dc2ce4998d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:03.015710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9d5902d9-32dd-448a-b01a-60aec671e334 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:03.016478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9d5902d9-32dd-448a-b01a-60aec671e334 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:03.024747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddce4839-4e0f-454c-8cc3-a1dc2ce4998d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:03.026934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddce4839-4e0f-454c-8cc3-a1dc2ce4998d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:03.026934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddce4839-4e0f-454c-8cc3-a1dc2ce4998d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:03.026934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddce4839-4e0f-454c-8cc3-a1dc2ce4998d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:03.029875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d5902d9-32dd-448a-b01a-60aec671e334 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:03.031671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d5902d9-32dd-448a-b01a-60aec671e334 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:03.035454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d5902d9-32dd-448a-b01a-60aec671e334 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:03.036176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d5902d9-32dd-448a-b01a-60aec671e334 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:03.629373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9d5902d9-32dd-448a-b01a-60aec671e334 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:03.642879 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9d5902d9-32dd-448a-b01a-60aec671e334 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1515 microversion: 2.1 time: 0.630183 May 28 04:42:03.655716 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1044/2139] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:03 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1515 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:03.686395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ddce4839-4e0f-454c-8cc3-a1dc2ce4998d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:03.697869 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ddce4839-4e0f-454c-8cc3-a1dc2ce4998d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1471 microversion: 2.1 time: 0.703248 May 28 04:42:03.699317 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1096/2140] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:02 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1471 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:03.901620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6f56eedf-aa73-44cc-8238-537d1eb6880e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-2065076853", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": "none"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:03.981377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-6f56eedf-aa73-44cc-8238-537d1eb6880e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:42:03.981817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-6f56eedf-aa73-44cc-8238-537d1eb6880e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:42:03.983025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-6f56eedf-aa73-44cc-8238-537d1eb6880e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:42:03.983620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-6f56eedf-aa73-44cc-8238-537d1eb6880e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:42:03.984229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-6f56eedf-aa73-44cc-8238-537d1eb6880e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:42:04.006431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-31f6a0b9-f331-4173-bd7b-38debac6919e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:04.007608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-31f6a0b9-f331-4173-bd7b-38debac6919e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:04.023130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f56eedf-aa73-44cc-8238-537d1eb6880e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:04.023473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31f6a0b9-f331-4173-bd7b-38debac6919e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:04.024147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31f6a0b9-f331-4173-bd7b-38debac6919e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:04.025142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31f6a0b9-f331-4173-bd7b-38debac6919e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:04.026315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31f6a0b9-f331-4173-bd7b-38debac6919e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:04.026751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f56eedf-aa73-44cc-8238-537d1eb6880e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:04.027802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f56eedf-aa73-44cc-8238-537d1eb6880e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:04.030354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f56eedf-aa73-44cc-8238-537d1eb6880e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:04.075744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:04.094783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-6f56eedf-aa73-44cc-8238-537d1eb6880e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Getting quotas for project 37fc7a1dcfe0415aa89d8d8f219cef09. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:42:04.106116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-6f56eedf-aa73-44cc-8238-537d1eb6880e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Getting quotas for user f5e947cd97b347d884f86d8a7c8a5fef and project 37fc7a1dcfe0415aa89d8d8f219cef09. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:42:04.143301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6f56eedf-aa73-44cc-8238-537d1eb6880e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:42:04.145870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6f56eedf-aa73-44cc-8238-537d1eb6880e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:42:04.287893 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6f56eedf-aa73-44cc-8238-537d1eb6880e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.630175 May 28 04:42:04.289214 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1045/2141] 10.222.0.58 () {62 vars in 1187 bytes} [Sat May 28 04:42:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 04:42:04.294319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-418f2c81-6a89-4976-858b-05201ff50c9a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:04.295336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-418f2c81-6a89-4976-858b-05201ff50c9a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:04.306922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-418f2c81-6a89-4976-858b-05201ff50c9a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:04.308928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-418f2c81-6a89-4976-858b-05201ff50c9a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:04.317276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-418f2c81-6a89-4976-858b-05201ff50c9a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:04.324817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-418f2c81-6a89-4976-858b-05201ff50c9a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:04.475433 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-31f6a0b9-f331-4173-bd7b-38debac6919e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:04.494246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-31f6a0b9-f331-4173-bd7b-38debac6919e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:04.513455 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-31f6a0b9-f331-4173-bd7b-38debac6919e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:04.519993 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-31f6a0b9-f331-4173-bd7b-38debac6919e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1292 microversion: 2.25 time: 0.517531 May 28 04:42:04.531192 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1097/2142] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:04 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1292 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:04.541765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-af11574a-f884-4f79-a1b0-051cc94c35b3 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:04.542457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-af11574a-f884-4f79-a1b0-051cc94c35b3 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:04.781215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-af11574a-f884-4f79-a1b0-051cc94c35b3 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:04.794255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-af11574a-f884-4f79-a1b0-051cc94c35b3 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:04.800659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-af11574a-f884-4f79-a1b0-051cc94c35b3 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:04.804574 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-af11574a-f884-4f79-a1b0-051cc94c35b3 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1278 microversion: 2.57 time: 0.280123 May 28 04:42:04.805392 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1098/2143] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:04 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1278 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:04.820338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9b1c9dee-c321-4f52-b8a5-d6a57df27ffd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:04.821180 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9b1c9dee-c321-4f52-b8a5-d6a57df27ffd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:04.834009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b1c9dee-c321-4f52-b8a5-d6a57df27ffd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:04.835214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b1c9dee-c321-4f52-b8a5-d6a57df27ffd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:04.839820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b1c9dee-c321-4f52-b8a5-d6a57df27ffd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:04.840482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b1c9dee-c321-4f52-b8a5-d6a57df27ffd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:04.891732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:04.922141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-418f2c81-6a89-4976-858b-05201ff50c9a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:04.937601 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-418f2c81-6a89-4976-858b-05201ff50c9a tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1501 microversion: 2.1 time: 0.646885 May 28 04:42:04.941557 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1046/2144] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:04 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1501 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:04.953118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-65effb16-7b87-44d0-b4c3-4b452209657b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:04.954267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-65effb16-7b87-44d0-b4c3-4b452209657b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:04.971149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65effb16-7b87-44d0-b4c3-4b452209657b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:04.980961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65effb16-7b87-44d0-b4c3-4b452209657b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:04.982133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65effb16-7b87-44d0-b4c3-4b452209657b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:04.982763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65effb16-7b87-44d0-b4c3-4b452209657b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:05.164552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9b1c9dee-c321-4f52-b8a5-d6a57df27ffd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:05.177532 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9b1c9dee-c321-4f52-b8a5-d6a57df27ffd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1515 microversion: 2.1 time: 0.367652 May 28 04:42:05.179513 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1099/2145] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:04 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1515 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:05.323696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-622afc0f-2d9b-4560-90db-1986731a75a1 req-ef6650cc-b100-4b2a-a6f6-4d6e8962eb45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f64b8b-70f7-43c3-85df-66f0e9104617", "name": "network-vif-deleted", "tag": "e2fe83fa-067b-4eba-9577-f8b896d605be"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:05.336297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-622afc0f-2d9b-4560-90db-1986731a75a1 req-ef6650cc-b100-4b2a-a6f6-4d6e8962eb45 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:05.347800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-622afc0f-2d9b-4560-90db-1986731a75a1 req-ef6650cc-b100-4b2a-a6f6-4d6e8962eb45 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:05.367734 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-622afc0f-2d9b-4560-90db-1986731a75a1 req-ef6650cc-b100-4b2a-a6f6-4d6e8962eb45 service nova] Creating event network-vif-deleted:e2fe83fa-067b-4eba-9577-f8b896d605be for instance 67f64b8b-70f7-43c3-85df-66f0e9104617 on n-h1-843700-1 May 28 04:42:05.383704 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-622afc0f-2d9b-4560-90db-1986731a75a1 req-ef6650cc-b100-4b2a-a6f6-4d6e8962eb45 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065523 May 28 04:42:05.384977 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1100/2146] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:42:05.421489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-65effb16-7b87-44d0-b4c3-4b452209657b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:05.445812 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-65effb16-7b87-44d0-b4c3-4b452209657b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1471 microversion: 2.1 time: 0.502936 May 28 04:42:05.449783 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1047/2147] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:04 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1471 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:05.541044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3684171b-d8e9-4c47-8348-ac0022cdae82 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:05.543118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3684171b-d8e9-4c47-8348-ac0022cdae82 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:05.556575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3684171b-d8e9-4c47-8348-ac0022cdae82 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:05.557024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3684171b-d8e9-4c47-8348-ac0022cdae82 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:05.564049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3684171b-d8e9-4c47-8348-ac0022cdae82 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:05.564451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3684171b-d8e9-4c47-8348-ac0022cdae82 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:05.757352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3684171b-d8e9-4c47-8348-ac0022cdae82 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:05.768723 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3684171b-d8e9-4c47-8348-ac0022cdae82 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:05.770256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3684171b-d8e9-4c47-8348-ac0022cdae82 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:05.771468 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3684171b-d8e9-4c47-8348-ac0022cdae82 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1292 microversion: 2.25 time: 0.236739 May 28 04:42:05.772056 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1101/2148] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:05 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1292 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:05.825092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-13a27d48-0be7-47e8-bb4c-dbdb5642e069 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:05.825717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-13a27d48-0be7-47e8-bb4c-dbdb5642e069 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:05.902579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-13a27d48-0be7-47e8-bb4c-dbdb5642e069 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:05.910697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-13a27d48-0be7-47e8-bb4c-dbdb5642e069 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:05.912230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-13a27d48-0be7-47e8-bb4c-dbdb5642e069 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:05.915009 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-13a27d48-0be7-47e8-bb4c-dbdb5642e069 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1278 microversion: 2.57 time: 0.095183 May 28 04:42:05.917147 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1048/2149] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:05 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1278 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:05.960515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-43ffbebf-4659-41bb-83f5-d0bcd39661c0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:05.960515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-43ffbebf-4659-41bb-83f5-d0bcd39661c0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:05.967034 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43ffbebf-4659-41bb-83f5-d0bcd39661c0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:05.967501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43ffbebf-4659-41bb-83f5-d0bcd39661c0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:05.968272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43ffbebf-4659-41bb-83f5-d0bcd39661c0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:05.968706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43ffbebf-4659-41bb-83f5-d0bcd39661c0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:06.004419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:06.007222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43ffbebf-4659-41bb-83f5-d0bcd39661c0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:06.007846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43ffbebf-4659-41bb-83f5-d0bcd39661c0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:06.008614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-43ffbebf-4659-41bb-83f5-d0bcd39661c0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lazy-loading 'fault' on Instance uuid 67f64b8b-70f7-43c3-85df-66f0e9104617 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:42:06.054051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-43ffbebf-4659-41bb-83f5-d0bcd39661c0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:06.064885 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-43ffbebf-4659-41bb-83f5-d0bcd39661c0 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 200 len: 1301 microversion: 2.1 time: 0.111005 May 28 04:42:06.065794 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1102/2150] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:05 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 1301 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:06.196438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7459bd76-f28e-40dc-8813-14588743a6b5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:06.197083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7459bd76-f28e-40dc-8813-14588743a6b5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:06.205840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7459bd76-f28e-40dc-8813-14588743a6b5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:06.206226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7459bd76-f28e-40dc-8813-14588743a6b5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:06.207054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7459bd76-f28e-40dc-8813-14588743a6b5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:06.207534 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7459bd76-f28e-40dc-8813-14588743a6b5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:06.396772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7459bd76-f28e-40dc-8813-14588743a6b5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:06.404725 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7459bd76-f28e-40dc-8813-14588743a6b5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1515 microversion: 2.1 time: 0.213284 May 28 04:42:06.405313 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1049/2151] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:06 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1515 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:06.467031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-38dd26d5-f21f-4ac8-922c-c9a07d47fc57 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:06.467665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-38dd26d5-f21f-4ac8-922c-c9a07d47fc57 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:06.474691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-38dd26d5-f21f-4ac8-922c-c9a07d47fc57 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:06.475193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-38dd26d5-f21f-4ac8-922c-c9a07d47fc57 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:06.476558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-38dd26d5-f21f-4ac8-922c-c9a07d47fc57 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:06.476998 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-38dd26d5-f21f-4ac8-922c-c9a07d47fc57 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:06.642700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-38dd26d5-f21f-4ac8-922c-c9a07d47fc57 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:06.652429 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-38dd26d5-f21f-4ac8-922c-c9a07d47fc57 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1471 microversion: 2.1 time: 0.189653 May 28 04:42:06.653400 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1103/2152] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:06 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1471 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:06.790262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2a00ec89-2c4e-457f-ab88-0060b3eb1c8b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:06.790817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2a00ec89-2c4e-457f-ab88-0060b3eb1c8b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:06.797859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a00ec89-2c4e-457f-ab88-0060b3eb1c8b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:06.798553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a00ec89-2c4e-457f-ab88-0060b3eb1c8b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:06.799413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a00ec89-2c4e-457f-ab88-0060b3eb1c8b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:06.800399 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a00ec89-2c4e-457f-ab88-0060b3eb1c8b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:06.935250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dab7aad6-f434-49af-a7bd-6231b1837b62 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:06.936529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dab7aad6-f434-49af-a7bd-6231b1837b62 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:06.942375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2a00ec89-2c4e-457f-ab88-0060b3eb1c8b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:06.945003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dab7aad6-f434-49af-a7bd-6231b1837b62 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:06.945647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dab7aad6-f434-49af-a7bd-6231b1837b62 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:06.946758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dab7aad6-f434-49af-a7bd-6231b1837b62 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:06.947404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dab7aad6-f434-49af-a7bd-6231b1837b62 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:06.953419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2a00ec89-2c4e-457f-ab88-0060b3eb1c8b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:06.956561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2a00ec89-2c4e-457f-ab88-0060b3eb1c8b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:06.957976 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2a00ec89-2c4e-457f-ab88-0060b3eb1c8b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1292 microversion: 2.25 time: 0.172236 May 28 04:42:06.959048 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1050/2153] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:06 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1292 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:07.042174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dab7aad6-f434-49af-a7bd-6231b1837b62 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:07.054389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dab7aad6-f434-49af-a7bd-6231b1837b62 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:07.056283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dab7aad6-f434-49af-a7bd-6231b1837b62 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:07.057607 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dab7aad6-f434-49af-a7bd-6231b1837b62 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1330 microversion: 2.57 time: 0.126595 May 28 04:42:07.058731 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1104/2154] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:06 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1330 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:07.081959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b7116bf4-b44c-4a07-8171-6b902c58edfe tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:07.082578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b7116bf4-b44c-4a07-8171-6b902c58edfe tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 67f64b8b-70f7-43c3-85df-66f0e9104617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:07.089767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7116bf4-b44c-4a07-8171-6b902c58edfe tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:07.090222 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7116bf4-b44c-4a07-8171-6b902c58edfe tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:07.091020 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7116bf4-b44c-4a07-8171-6b902c58edfe tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:07.091471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7116bf4-b44c-4a07-8171-6b902c58edfe tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:07.106895 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-b7116bf4-b44c-4a07-8171-6b902c58edfe tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] HTTP exception thrown: Instance 67f64b8b-70f7-43c3-85df-66f0e9104617 could not be found. May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b7116bf4-b44c-4a07-8171-6b902c58edfe tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Request method failure captured: May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 HTTP/1.1 May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZjiaepWU7TCYdX9MhCXgBBsJiLIK1lGWfcoQGt7uJIjKCUQfVxq-420KtmM_9aj9dVa8veVyEwuso9MhxkCBywM0PPE8IsZi1EvyxdRo2Zf-usIx7zhEkDTIzK3k51gQHZiF_UTPQVwZwHt-iCHX6z_NmsfKK-uFXeKxMtWWAULmo May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d908671a46484d2082cc88a1d2c93f98 May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-LiveMigrationTest-879087163 May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d908671a46484d2082cc88a1d2c93f98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d908671a46484d2082cc88a1d2c93f98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d908671a46484d2082cc88a1d2c93f98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d908671a46484d2082cc88a1d2c93f98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-LiveMigrationTest-879087163 May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d908671a46484d2082cc88a1d2c93f98 May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-LiveMigrationTest-879087163 May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-LiveMigrationTest-879087163-project May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: da8fff3851eb4ecc927400c09117f5ee May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-LiveMigrationTest-879087163-project May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 67f64b8b-70f7-43c3-85df-66f0e9104617 could not be found. May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '67f64b8b-70f7-43c3-85df-66f0e9104617'} May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67f64b8b-70f7-43c3-85df-66f0e9104617 could not be found. May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67f64b8b-70f7-43c3-85df-66f0e9104617 could not be found. May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:42:07.108658 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:42:07.118843 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:42:07.118843 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:42:07.118843 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:42:07.118843 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:42:07.118843 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67f64b8b-70f7-43c3-85df-66f0e9104617 could not be found. May 28 04:42:07.118843 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:42:07.118843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b7116bf4-b44c-4a07-8171-6b902c58edfe tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Returning 404 to user: Instance 67f64b8b-70f7-43c3-85df-66f0e9104617 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:42:07.118843 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b7116bf4-b44c-4a07-8171-6b902c58edfe tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617" status: 404 len: 111 microversion: 2.1 time: 0.036463 May 28 04:42:07.118843 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1051/2155] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:07 2022] GET /compute/v2.1/servers/67f64b8b-70f7-43c3-85df-66f0e9104617 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:42:07.124804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8d164d5d-c37e-416e-a98f-674d7135b4dc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:07.125758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8d164d5d-c37e-416e-a98f-674d7135b4dc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:07.135502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d164d5d-c37e-416e-a98f-674d7135b4dc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:07.138943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d164d5d-c37e-416e-a98f-674d7135b4dc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:07.138943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d164d5d-c37e-416e-a98f-674d7135b4dc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:07.138943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d164d5d-c37e-416e-a98f-674d7135b4dc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:07.169932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8d164d5d-c37e-416e-a98f-674d7135b4dc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:42:07.422248 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c0c2780c-759e-4706-b557-d5075bef5d99 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:07.423714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c0c2780c-759e-4706-b557-d5075bef5d99 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:07.433415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c0c2780c-759e-4706-b557-d5075bef5d99 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:07.434357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c0c2780c-759e-4706-b557-d5075bef5d99 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:07.435671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c0c2780c-759e-4706-b557-d5075bef5d99 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:07.436580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c0c2780c-759e-4706-b557-d5075bef5d99 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:07.469266 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8d164d5d-c37e-416e-a98f-674d7135b4dc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 204 len: 0 microversion: 2.1 time: 0.348069 May 28 04:42:07.472925 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1105/2156] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:42:07 2022] DELETE /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:42:07.479656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-34dcdb48-b4e9-4e90-ac76-8f0fc3e8319f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:07.480784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-34dcdb48-b4e9-4e90-ac76-8f0fc3e8319f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:07.489034 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-34dcdb48-b4e9-4e90-ac76-8f0fc3e8319f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:07.489758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-34dcdb48-b4e9-4e90-ac76-8f0fc3e8319f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:07.491731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-34dcdb48-b4e9-4e90-ac76-8f0fc3e8319f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:07.492275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-34dcdb48-b4e9-4e90-ac76-8f0fc3e8319f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:07.642484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c0c2780c-759e-4706-b557-d5075bef5d99 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:07.650404 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c0c2780c-759e-4706-b557-d5075bef5d99 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1515 microversion: 2.1 time: 0.232470 May 28 04:42:07.651375 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1052/2157] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:07 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:07.669800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b43d7fcf-e3cf-4d1b-9391-dd1c4a552184 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:07.674085 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b43d7fcf-e3cf-4d1b-9391-dd1c4a552184 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:07.683042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b43d7fcf-e3cf-4d1b-9391-dd1c4a552184 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:07.684129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b43d7fcf-e3cf-4d1b-9391-dd1c4a552184 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:07.685074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b43d7fcf-e3cf-4d1b-9391-dd1c4a552184 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:07.686008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b43d7fcf-e3cf-4d1b-9391-dd1c4a552184 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:07.729654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-34dcdb48-b4e9-4e90-ac76-8f0fc3e8319f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:07.741613 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-34dcdb48-b4e9-4e90-ac76-8f0fc3e8319f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1485 microversion: 2.1 time: 0.266381 May 28 04:42:07.753344 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1106/2158] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:07 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1485 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:07.861946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b43d7fcf-e3cf-4d1b-9391-dd1c4a552184 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:07.870928 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b43d7fcf-e3cf-4d1b-9391-dd1c4a552184 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1471 microversion: 2.1 time: 0.205029 May 28 04:42:07.871545 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1053/2159] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:07 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1471 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:07.980195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-27da3a3a-8e2e-4fe0-ac79-2230738c8244 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:07.981116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-27da3a3a-8e2e-4fe0-ac79-2230738c8244 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:07.987412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27da3a3a-8e2e-4fe0-ac79-2230738c8244 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:07.987869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27da3a3a-8e2e-4fe0-ac79-2230738c8244 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:07.988641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27da3a3a-8e2e-4fe0-ac79-2230738c8244 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:07.989079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27da3a3a-8e2e-4fe0-ac79-2230738c8244 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:08.077477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5e97e797-3cf7-410d-9b5e-c75050a0a9d2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:08.078143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5e97e797-3cf7-410d-9b5e-c75050a0a9d2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:08.086160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e97e797-3cf7-410d-9b5e-c75050a0a9d2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:08.086932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e97e797-3cf7-410d-9b5e-c75050a0a9d2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:08.090478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e97e797-3cf7-410d-9b5e-c75050a0a9d2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:08.091363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e97e797-3cf7-410d-9b5e-c75050a0a9d2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:08.153325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-27da3a3a-8e2e-4fe0-ac79-2230738c8244 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:08.164312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-27da3a3a-8e2e-4fe0-ac79-2230738c8244 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:08.166360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-27da3a3a-8e2e-4fe0-ac79-2230738c8244 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:08.168150 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-27da3a3a-8e2e-4fe0-ac79-2230738c8244 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1292 microversion: 2.25 time: 0.195061 May 28 04:42:08.169573 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1107/2160] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:07 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1292 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:08.185192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5e97e797-3cf7-410d-9b5e-c75050a0a9d2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:08.194789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5e97e797-3cf7-410d-9b5e-c75050a0a9d2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:08.196347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5e97e797-3cf7-410d-9b5e-c75050a0a9d2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:08.197514 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5e97e797-3cf7-410d-9b5e-c75050a0a9d2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1336 microversion: 2.57 time: 0.124051 May 28 04:42:08.202705 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1054/2161] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:08 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1336 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:08.670439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-80f9ec67-9144-4a04-ae74-e1374ac5a253 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:08.670439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-80f9ec67-9144-4a04-ae74-e1374ac5a253 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:08.675693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80f9ec67-9144-4a04-ae74-e1374ac5a253 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:08.676794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80f9ec67-9144-4a04-ae74-e1374ac5a253 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:08.677850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80f9ec67-9144-4a04-ae74-e1374ac5a253 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:08.678775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80f9ec67-9144-4a04-ae74-e1374ac5a253 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:08.761194 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9ea06a2e-15ee-4be0-846f-d2531956c017 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:08.761818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9ea06a2e-15ee-4be0-846f-d2531956c017 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:08.769027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ea06a2e-15ee-4be0-846f-d2531956c017 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:08.769487 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ea06a2e-15ee-4be0-846f-d2531956c017 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:08.770271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ea06a2e-15ee-4be0-846f-d2531956c017 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:08.770778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ea06a2e-15ee-4be0-846f-d2531956c017 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:08.853235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-80f9ec67-9144-4a04-ae74-e1374ac5a253 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:08.869726 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-80f9ec67-9144-4a04-ae74-e1374ac5a253 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1515 microversion: 2.1 time: 0.203297 May 28 04:42:08.875834 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1108/2162] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:08 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1515 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:08.888430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-83b1b6c0-565b-47cf-b7db-1ca5ed5991a7 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:08.889338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-83b1b6c0-565b-47cf-b7db-1ca5ed5991a7 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:08.898055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83b1b6c0-565b-47cf-b7db-1ca5ed5991a7 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:08.898606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83b1b6c0-565b-47cf-b7db-1ca5ed5991a7 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:08.899491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83b1b6c0-565b-47cf-b7db-1ca5ed5991a7 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:08.900160 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83b1b6c0-565b-47cf-b7db-1ca5ed5991a7 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:08.962415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9ea06a2e-15ee-4be0-846f-d2531956c017 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:08.980391 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9ea06a2e-15ee-4be0-846f-d2531956c017 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1485 microversion: 2.1 time: 0.223721 May 28 04:42:08.987890 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1055/2163] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:08 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1485 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:09.071317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-83b1b6c0-565b-47cf-b7db-1ca5ed5991a7 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:09.079754 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-83b1b6c0-565b-47cf-b7db-1ca5ed5991a7 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1471 microversion: 2.1 time: 0.195314 May 28 04:42:09.080810 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1109/2164] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:08 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1471 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:09.187407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-19cc7909-65a1-42a3-ab7b-ac7db55880bf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:09.188715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-19cc7909-65a1-42a3-ab7b-ac7db55880bf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:09.195793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-19cc7909-65a1-42a3-ab7b-ac7db55880bf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:09.196472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-19cc7909-65a1-42a3-ab7b-ac7db55880bf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:09.197488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-19cc7909-65a1-42a3-ab7b-ac7db55880bf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:09.198473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-19cc7909-65a1-42a3-ab7b-ac7db55880bf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:09.216596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2e334b5c-d8e5-4199-919a-901631bf6511 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:09.217323 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2e334b5c-d8e5-4199-919a-901631bf6511 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:09.226125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e334b5c-d8e5-4199-919a-901631bf6511 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:09.226571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e334b5c-d8e5-4199-919a-901631bf6511 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:09.227586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e334b5c-d8e5-4199-919a-901631bf6511 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:09.228327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e334b5c-d8e5-4199-919a-901631bf6511 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:09.316671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2e334b5c-d8e5-4199-919a-901631bf6511 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:09.328307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2e334b5c-d8e5-4199-919a-901631bf6511 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:09.330277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2e334b5c-d8e5-4199-919a-901631bf6511 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:09.331464 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2e334b5c-d8e5-4199-919a-901631bf6511 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1336 microversion: 2.57 time: 0.118973 May 28 04:42:09.332350 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1110/2165] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:09 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1336 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:09.389365 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-19cc7909-65a1-42a3-ab7b-ac7db55880bf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:09.398652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-19cc7909-65a1-42a3-ab7b-ac7db55880bf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:09.400194 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-19cc7909-65a1-42a3-ab7b-ac7db55880bf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:09.401307 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-19cc7909-65a1-42a3-ab7b-ac7db55880bf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1292 microversion: 2.25 time: 0.218065 May 28 04:42:09.402059 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1056/2166] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:09 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1292 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:09.511269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-847c0510-165b-4e50-9172-b8a5a7116513 req-c2b1f68e-a55d-4eca-8d78-6bad951ea1ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b500d99-8f98-409e-a0df-e2cea22343ca", "name": "network-vif-deleted", "tag": "89183d0a-5af7-462b-845f-59b3484b2c3b"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:09.519796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-847c0510-165b-4e50-9172-b8a5a7116513 req-c2b1f68e-a55d-4eca-8d78-6bad951ea1ef service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:09.520251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-847c0510-165b-4e50-9172-b8a5a7116513 req-c2b1f68e-a55d-4eca-8d78-6bad951ea1ef service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:09.531789 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-847c0510-165b-4e50-9172-b8a5a7116513 req-c2b1f68e-a55d-4eca-8d78-6bad951ea1ef service nova] Creating event network-vif-deleted:89183d0a-5af7-462b-845f-59b3484b2c3b for instance 7b500d99-8f98-409e-a0df-e2cea22343ca on n-h2-843700-1 May 28 04:42:09.536830 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-847c0510-165b-4e50-9172-b8a5a7116513 req-c2b1f68e-a55d-4eca-8d78-6bad951ea1ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030442 May 28 04:42:09.537599 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1111/2167] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:09.898355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-022b45d6-75dc-4472-95a1-c6074585a528 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:09.901882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-022b45d6-75dc-4472-95a1-c6074585a528 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:09.909682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-022b45d6-75dc-4472-95a1-c6074585a528 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:09.910161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-022b45d6-75dc-4472-95a1-c6074585a528 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:09.910952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-022b45d6-75dc-4472-95a1-c6074585a528 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:09.911446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-022b45d6-75dc-4472-95a1-c6074585a528 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:10.001158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3a46a799-f339-4b77-a68e-02660326a7cc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:10.002077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3a46a799-f339-4b77-a68e-02660326a7cc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:10.009309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a46a799-f339-4b77-a68e-02660326a7cc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:10.009767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a46a799-f339-4b77-a68e-02660326a7cc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:10.010557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a46a799-f339-4b77-a68e-02660326a7cc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:10.011217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a46a799-f339-4b77-a68e-02660326a7cc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:10.048210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-022b45d6-75dc-4472-95a1-c6074585a528 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:10.059611 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-022b45d6-75dc-4472-95a1-c6074585a528 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1515 microversion: 2.1 time: 0.165756 May 28 04:42:10.060690 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1057/2168] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:09 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:10.097857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a3fcb621-defa-46a0-85b4-36bfe819ef48 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:10.098596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a3fcb621-defa-46a0-85b4-36bfe819ef48 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:10.105479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3fcb621-defa-46a0-85b4-36bfe819ef48 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:10.106008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3fcb621-defa-46a0-85b4-36bfe819ef48 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:10.107032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3fcb621-defa-46a0-85b4-36bfe819ef48 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:10.107475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3fcb621-defa-46a0-85b4-36bfe819ef48 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:10.333574 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3a46a799-f339-4b77-a68e-02660326a7cc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:10.342790 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3a46a799-f339-4b77-a68e-02660326a7cc tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1281 microversion: 2.1 time: 0.346985 May 28 04:42:10.345038 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1112/2169] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:09 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1281 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:10.366940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8ca66d28-a1af-4022-a230-677862368963 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:10.367627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8ca66d28-a1af-4022-a230-677862368963 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:10.374638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ca66d28-a1af-4022-a230-677862368963 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:10.375179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ca66d28-a1af-4022-a230-677862368963 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:10.375964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ca66d28-a1af-4022-a230-677862368963 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:10.378300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ca66d28-a1af-4022-a230-677862368963 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:10.466267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a3fcb621-defa-46a0-85b4-36bfe819ef48 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:10.474580 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a3fcb621-defa-46a0-85b4-36bfe819ef48 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1477 microversion: 2.1 time: 0.380589 May 28 04:42:10.476525 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1058/2170] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:10 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1477 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:10.478930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8ca66d28-a1af-4022-a230-677862368963 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:10.481349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0096d626-24c3-4b4e-8e47-e80e9858c2fe tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:10.481973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0096d626-24c3-4b4e-8e47-e80e9858c2fe tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:10.488029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8ca66d28-a1af-4022-a230-677862368963 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:10.489567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8ca66d28-a1af-4022-a230-677862368963 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:10.489799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0096d626-24c3-4b4e-8e47-e80e9858c2fe tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:10.490210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0096d626-24c3-4b4e-8e47-e80e9858c2fe tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:10.490815 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8ca66d28-a1af-4022-a230-677862368963 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1336 microversion: 2.57 time: 0.129351 May 28 04:42:10.491783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0096d626-24c3-4b4e-8e47-e80e9858c2fe tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:10.492017 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1113/2171] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:10 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1336 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:10.503117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0096d626-24c3-4b4e-8e47-e80e9858c2fe tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:10.506511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:10.650834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0096d626-24c3-4b4e-8e47-e80e9858c2fe tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:10.658767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0096d626-24c3-4b4e-8e47-e80e9858c2fe tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:10.660443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0096d626-24c3-4b4e-8e47-e80e9858c2fe tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:10.661688 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0096d626-24c3-4b4e-8e47-e80e9858c2fe tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1292 microversion: 2.25 time: 0.184210 May 28 04:42:10.662259 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1059/2172] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:10 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1292 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:11.081488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-32b1c5f2-b42b-4f66-adb7-022f3e3d609d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:11.082483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-32b1c5f2-b42b-4f66-adb7-022f3e3d609d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:11.103528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-32b1c5f2-b42b-4f66-adb7-022f3e3d609d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:11.104247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-32b1c5f2-b42b-4f66-adb7-022f3e3d609d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:11.105444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-32b1c5f2-b42b-4f66-adb7-022f3e3d609d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:11.106083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-32b1c5f2-b42b-4f66-adb7-022f3e3d609d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:11.284624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-32b1c5f2-b42b-4f66-adb7-022f3e3d609d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:11.296319 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-32b1c5f2-b42b-4f66-adb7-022f3e3d609d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1515 microversion: 2.1 time: 0.223024 May 28 04:42:11.297175 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1114/2173] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:11 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1515 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:11.360000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-279bdf8f-c11b-4ed1-944b-0ab0c5620261 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:11.360623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-279bdf8f-c11b-4ed1-944b-0ab0c5620261 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:11.372176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-279bdf8f-c11b-4ed1-944b-0ab0c5620261 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:11.372637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-279bdf8f-c11b-4ed1-944b-0ab0c5620261 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:11.373449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-279bdf8f-c11b-4ed1-944b-0ab0c5620261 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:11.373933 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-279bdf8f-c11b-4ed1-944b-0ab0c5620261 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:11.442623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-279bdf8f-c11b-4ed1-944b-0ab0c5620261 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:11.451570 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-279bdf8f-c11b-4ed1-944b-0ab0c5620261 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1281 microversion: 2.1 time: 0.095603 May 28 04:42:11.452151 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1060/2174] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:11 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1281 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:11.495803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4efd74e4-8172-4149-880a-fd250ffefbfc tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:11.496420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4efd74e4-8172-4149-880a-fd250ffefbfc tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:11.502925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4efd74e4-8172-4149-880a-fd250ffefbfc tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:11.503431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4efd74e4-8172-4149-880a-fd250ffefbfc tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:11.504200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4efd74e4-8172-4149-880a-fd250ffefbfc tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:11.504642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4efd74e4-8172-4149-880a-fd250ffefbfc tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:11.508989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:11.510340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-de6b153c-34f9-4456-9386-b08eb9c6adb3 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:11.511215 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-de6b153c-34f9-4456-9386-b08eb9c6adb3 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:11.518151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de6b153c-34f9-4456-9386-b08eb9c6adb3 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:11.518612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de6b153c-34f9-4456-9386-b08eb9c6adb3 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:11.519417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de6b153c-34f9-4456-9386-b08eb9c6adb3 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:11.520286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de6b153c-34f9-4456-9386-b08eb9c6adb3 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:11.605325 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-de6b153c-34f9-4456-9386-b08eb9c6adb3 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:11.613482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-de6b153c-34f9-4456-9386-b08eb9c6adb3 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:11.615148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-de6b153c-34f9-4456-9386-b08eb9c6adb3 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:11.621434 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-de6b153c-34f9-4456-9386-b08eb9c6adb3 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1357 microversion: 2.57 time: 0.111203 May 28 04:42:11.630309 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1061/2175] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:11 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1357 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:11.636158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f7924853-d8a5-4506-8f76-11014b8d303a tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:11.637907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f7924853-d8a5-4506-8f76-11014b8d303a tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:11.645447 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7924853-d8a5-4506-8f76-11014b8d303a tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:11.646228 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7924853-d8a5-4506-8f76-11014b8d303a tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:11.646878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7924853-d8a5-4506-8f76-11014b8d303a tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:11.647428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7924853-d8a5-4506-8f76-11014b8d303a tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:11.670286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4efd74e4-8172-4149-880a-fd250ffefbfc tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:11.680310 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4efd74e4-8172-4149-880a-fd250ffefbfc tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1477 microversion: 2.1 time: 0.188283 May 28 04:42:11.681240 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1115/2176] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:11 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1477 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:11.693761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-14dadfb2-27cd-41c6-8845-52dd4d0bebde tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:11.695385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-14dadfb2-27cd-41c6-8845-52dd4d0bebde tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:11.701878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14dadfb2-27cd-41c6-8845-52dd4d0bebde tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:11.702561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14dadfb2-27cd-41c6-8845-52dd4d0bebde tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:11.703596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14dadfb2-27cd-41c6-8845-52dd4d0bebde tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:11.704236 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14dadfb2-27cd-41c6-8845-52dd4d0bebde tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:11.739070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f7924853-d8a5-4506-8f76-11014b8d303a tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:42:11.739826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f7924853-d8a5-4506-8f76-11014b8d303a tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:42:11.740548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f7924853-d8a5-4506-8f76-11014b8d303a tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:42:11.741756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f7924853-d8a5-4506-8f76-11014b8d303a tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:42:11.742374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f7924853-d8a5-4506-8f76-11014b8d303a tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:42:11.929440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-14dadfb2-27cd-41c6-8845-52dd4d0bebde tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:11.942415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-14dadfb2-27cd-41c6-8845-52dd4d0bebde tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:11.944885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-14dadfb2-27cd-41c6-8845-52dd4d0bebde tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:11.946050 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-14dadfb2-27cd-41c6-8845-52dd4d0bebde tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1280 microversion: 2.25 time: 0.263661 May 28 04:42:11.946828 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1116/2177] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:11 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1280 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:11.973768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f7924853-d8a5-4506-8f76-11014b8d303a tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:11.980888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7924853-d8a5-4506-8f76-11014b8d303a tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:11.981351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7924853-d8a5-4506-8f76-11014b8d303a tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:11.982214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7924853-d8a5-4506-8f76-11014b8d303a tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:11.982553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7924853-d8a5-4506-8f76-11014b8d303a tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:12.014348 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f7924853-d8a5-4506-8f76-11014b8d303a tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "POST /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8/action" status: 202 len: 1138 microversion: 2.57 time: 0.383013 May 28 04:42:12.015656 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1062/2178] 10.222.0.58 () {62 vars in 1319 bytes} [Sat May 28 04:42:11 2022] POST /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8/action => generated 1138 bytes in 385 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 28 04:42:12.031364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-44d144b8-1ccf-41d8-b189-b7b977ca1756 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:12.032424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-44d144b8-1ccf-41d8-b189-b7b977ca1756 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:12.048900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-44d144b8-1ccf-41d8-b189-b7b977ca1756 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:12.049362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-44d144b8-1ccf-41d8-b189-b7b977ca1756 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:12.050137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-44d144b8-1ccf-41d8-b189-b7b977ca1756 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:12.050582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-44d144b8-1ccf-41d8-b189-b7b977ca1756 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:12.147465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-44d144b8-1ccf-41d8-b189-b7b977ca1756 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:12.158432 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-44d144b8-1ccf-41d8-b189-b7b977ca1756 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:12.166248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-44d144b8-1ccf-41d8-b189-b7b977ca1756 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:12.166248 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-44d144b8-1ccf-41d8-b189-b7b977ca1756 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.135462 May 28 04:42:12.166248 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1117/2179] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:12 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:12.292679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-c3cda662-2305-4880-9612-3bda293bca86 req-807f7c4b-c5ce-4b8c-812b-a6970696d13e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b94a91-20fe-40ac-bd67-2864eef657f6", "name": "network-vif-unplugged", "status": "completed", "tag": "7dbb06ba-323b-4edc-bc6d-380122278f70"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:12.303936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c3cda662-2305-4880-9612-3bda293bca86 req-807f7c4b-c5ce-4b8c-812b-a6970696d13e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:12.304728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c3cda662-2305-4880-9612-3bda293bca86 req-807f7c4b-c5ce-4b8c-812b-a6970696d13e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:12.313422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-da91f72f-4052-432d-967b-ac9d4361dab8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:12.314304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-da91f72f-4052-432d-967b-ac9d4361dab8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:12.322638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da91f72f-4052-432d-967b-ac9d4361dab8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:12.327118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da91f72f-4052-432d-967b-ac9d4361dab8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:12.327118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da91f72f-4052-432d-967b-ac9d4361dab8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:12.327118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da91f72f-4052-432d-967b-ac9d4361dab8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:12.337409 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-c3cda662-2305-4880-9612-3bda293bca86 req-807f7c4b-c5ce-4b8c-812b-a6970696d13e service nova] Creating event network-vif-unplugged:7dbb06ba-323b-4edc-bc6d-380122278f70 for instance 12b94a91-20fe-40ac-bd67-2864eef657f6 on n-h1-843700-1 May 28 04:42:12.343485 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-c3cda662-2305-4880-9612-3bda293bca86 req-807f7c4b-c5ce-4b8c-812b-a6970696d13e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055885 May 28 04:42:12.344708 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1063/2180] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:12.469612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fbf5e735-741a-439b-ad76-7f3696c5293b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:12.471373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fbf5e735-741a-439b-ad76-7f3696c5293b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:12.480083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbf5e735-741a-439b-ad76-7f3696c5293b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:12.480083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbf5e735-741a-439b-ad76-7f3696c5293b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:12.480083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbf5e735-741a-439b-ad76-7f3696c5293b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:12.480355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbf5e735-741a-439b-ad76-7f3696c5293b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:12.497579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-da91f72f-4052-432d-967b-ac9d4361dab8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:12.509402 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-da91f72f-4052-432d-967b-ac9d4361dab8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1521 microversion: 2.1 time: 0.199665 May 28 04:42:12.519138 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1118/2181] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:12 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:12.525989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbf5e735-741a-439b-ad76-7f3696c5293b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:12.526516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbf5e735-741a-439b-ad76-7f3696c5293b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:12.526980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-fbf5e735-741a-439b-ad76-7f3696c5293b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lazy-loading 'fault' on Instance uuid 7b500d99-8f98-409e-a0df-e2cea22343ca {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:42:12.571694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fbf5e735-741a-439b-ad76-7f3696c5293b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:12.579419 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fbf5e735-741a-439b-ad76-7f3696c5293b tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 200 len: 1301 microversion: 2.1 time: 0.115000 May 28 04:42:12.580857 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1064/2182] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:12 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 1301 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:12.698826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-71c029d9-467a-4cfb-84bb-0bf06dadf158 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:12.699457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-71c029d9-467a-4cfb-84bb-0bf06dadf158 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:12.707373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71c029d9-467a-4cfb-84bb-0bf06dadf158 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:12.707868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71c029d9-467a-4cfb-84bb-0bf06dadf158 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:12.708724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71c029d9-467a-4cfb-84bb-0bf06dadf158 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:12.709167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71c029d9-467a-4cfb-84bb-0bf06dadf158 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:12.851832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-71c029d9-467a-4cfb-84bb-0bf06dadf158 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:12.859957 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-71c029d9-467a-4cfb-84bb-0bf06dadf158 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1477 microversion: 2.1 time: 0.166029 May 28 04:42:12.860546 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1119/2183] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:12 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1477 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:12.964868 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fd38166c-d5fb-48fd-aea4-f96f30b6a30f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:12.965764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fd38166c-d5fb-48fd-aea4-f96f30b6a30f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:12.976724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fd38166c-d5fb-48fd-aea4-f96f30b6a30f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:12.977179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fd38166c-d5fb-48fd-aea4-f96f30b6a30f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:12.978158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fd38166c-d5fb-48fd-aea4-f96f30b6a30f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:12.981423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fd38166c-d5fb-48fd-aea4-f96f30b6a30f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:13.146648 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fd38166c-d5fb-48fd-aea4-f96f30b6a30f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:13.157048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fd38166c-d5fb-48fd-aea4-f96f30b6a30f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:13.159180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fd38166c-d5fb-48fd-aea4-f96f30b6a30f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:13.160346 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fd38166c-d5fb-48fd-aea4-f96f30b6a30f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1280 microversion: 2.25 time: 0.199965 May 28 04:42:13.161299 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1065/2184] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:12 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1280 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:13.185321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-89d30c53-ed8a-4125-9200-aefce933345d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:13.185993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-89d30c53-ed8a-4125-9200-aefce933345d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:13.193117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89d30c53-ed8a-4125-9200-aefce933345d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:13.193577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89d30c53-ed8a-4125-9200-aefce933345d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:13.194383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89d30c53-ed8a-4125-9200-aefce933345d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:13.195030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89d30c53-ed8a-4125-9200-aefce933345d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:13.308413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-89d30c53-ed8a-4125-9200-aefce933345d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:13.310402 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-89d30c53-ed8a-4125-9200-aefce933345d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:13.312257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-89d30c53-ed8a-4125-9200-aefce933345d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:13.313529 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-89d30c53-ed8a-4125-9200-aefce933345d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.134272 May 28 04:42:13.314864 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1120/2185] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:13 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:13.533824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-97d28d95-7cfb-4257-9281-850358126c1f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:13.534752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-97d28d95-7cfb-4257-9281-850358126c1f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:13.544278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97d28d95-7cfb-4257-9281-850358126c1f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:13.545135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97d28d95-7cfb-4257-9281-850358126c1f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:13.546440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97d28d95-7cfb-4257-9281-850358126c1f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:13.547392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97d28d95-7cfb-4257-9281-850358126c1f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:13.596890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-78469705-c5e4-4803-8645-aa43c6c87c52 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:13.598502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-78469705-c5e4-4803-8645-aa43c6c87c52 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 7b500d99-8f98-409e-a0df-e2cea22343ca] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:13.605768 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78469705-c5e4-4803-8645-aa43c6c87c52 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:13.612452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78469705-c5e4-4803-8645-aa43c6c87c52 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:13.612452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78469705-c5e4-4803-8645-aa43c6c87c52 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:13.612452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78469705-c5e4-4803-8645-aa43c6c87c52 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:13.622285 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-78469705-c5e4-4803-8645-aa43c6c87c52 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] HTTP exception thrown: Instance 7b500d99-8f98-409e-a0df-e2cea22343ca could not be found. May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-78469705-c5e4-4803-8645-aa43c6c87c52 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Request method failure captured: May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca HTTP/1.1 May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaZjiaepWU7TCYdX9MhCXgBBsJiLIK1lGWfcoQGt7uJIjKCUQfVxq-420KtmM_9aj9dVa8veVyEwuso9MhxkCBywM0PPE8IsZi1EvyxdRo2Zf-usIx7zhEkDTIzK3k51gQHZiF_UTPQVwZwHt-iCHX6z_NmsfKK-uFXeKxMtWWAULmo May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d908671a46484d2082cc88a1d2c93f98 May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-LiveMigrationTest-879087163 May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d908671a46484d2082cc88a1d2c93f98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d908671a46484d2082cc88a1d2c93f98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d908671a46484d2082cc88a1d2c93f98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d908671a46484d2082cc88a1d2c93f98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-LiveMigrationTest-879087163 May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d908671a46484d2082cc88a1d2c93f98 May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-LiveMigrationTest-879087163 May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-LiveMigrationTest-879087163-project May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: da8fff3851eb4ecc927400c09117f5ee May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-LiveMigrationTest-879087163-project May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 7b500d99-8f98-409e-a0df-e2cea22343ca could not be found. May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '7b500d99-8f98-409e-a0df-e2cea22343ca'} May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b500d99-8f98-409e-a0df-e2cea22343ca could not be found. May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b500d99-8f98-409e-a0df-e2cea22343ca could not be found. May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:42:13.624068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:42:13.629507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:42:13.629507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:42:13.629507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:42:13.629507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:42:13.629507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b500d99-8f98-409e-a0df-e2cea22343ca could not be found. May 28 04:42:13.629507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:42:13.629507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-78469705-c5e4-4803-8645-aa43c6c87c52 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Returning 404 to user: Instance 7b500d99-8f98-409e-a0df-e2cea22343ca could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:42:13.629507 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-78469705-c5e4-4803-8645-aa43c6c87c52 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca" status: 404 len: 111 microversion: 2.1 time: 0.032735 May 28 04:42:13.629507 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1121/2186] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:13 2022] GET /compute/v2.1/servers/7b500d99-8f98-409e-a0df-e2cea22343ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:42:13.635041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-184544dc-9d16-4513-9797-15ea140eb06f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:13.636003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-184544dc-9d16-4513-9797-15ea140eb06f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:13.642593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-184544dc-9d16-4513-9797-15ea140eb06f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:13.643058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-184544dc-9d16-4513-9797-15ea140eb06f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:13.643838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-184544dc-9d16-4513-9797-15ea140eb06f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:13.644275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-184544dc-9d16-4513-9797-15ea140eb06f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:13.674021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-184544dc-9d16-4513-9797-15ea140eb06f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:42:13.699896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-97d28d95-7cfb-4257-9281-850358126c1f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:13.708985 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-97d28d95-7cfb-4257-9281-850358126c1f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1521 microversion: 2.1 time: 0.179595 May 28 04:42:13.717366 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1066/2187] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:13 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:13.877835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-336c9a5a-ca87-4f97-b05b-8faca38bf1ca tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:13.878536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-336c9a5a-ca87-4f97-b05b-8faca38bf1ca tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:13.886425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-336c9a5a-ca87-4f97-b05b-8faca38bf1ca tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:13.887011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-336c9a5a-ca87-4f97-b05b-8faca38bf1ca tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:13.888045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-336c9a5a-ca87-4f97-b05b-8faca38bf1ca tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:13.888550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-336c9a5a-ca87-4f97-b05b-8faca38bf1ca tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:14.045354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-336c9a5a-ca87-4f97-b05b-8faca38bf1ca tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:14.053813 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-336c9a5a-ca87-4f97-b05b-8faca38bf1ca tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1477 microversion: 2.1 time: 0.179576 May 28 04:42:14.054403 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1067/2188] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:13 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1477 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:14.109192 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-184544dc-9d16-4513-9797-15ea140eb06f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "DELETE /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 204 len: 0 microversion: 2.1 time: 0.478789 May 28 04:42:14.109819 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1122/2189] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:42:13 2022] DELETE /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:42:14.115124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:14.121009 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9a82c6bf-ea1d-4a37-a115-30a5fcf8dce5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:14.121728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9a82c6bf-ea1d-4a37-a115-30a5fcf8dce5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:14.129271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9a82c6bf-ea1d-4a37-a115-30a5fcf8dce5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:14.129899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9a82c6bf-ea1d-4a37-a115-30a5fcf8dce5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:14.130759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9a82c6bf-ea1d-4a37-a115-30a5fcf8dce5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:14.131378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9a82c6bf-ea1d-4a37-a115-30a5fcf8dce5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:14.179021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-75ed7273-7230-4ae9-bfc6-48c908e33f2f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:14.179844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-75ed7273-7230-4ae9-bfc6-48c908e33f2f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:14.186728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75ed7273-7230-4ae9-bfc6-48c908e33f2f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:14.187300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75ed7273-7230-4ae9-bfc6-48c908e33f2f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:14.188362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75ed7273-7230-4ae9-bfc6-48c908e33f2f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:14.188990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75ed7273-7230-4ae9-bfc6-48c908e33f2f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:14.330870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9a82c6bf-ea1d-4a37-a115-30a5fcf8dce5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:14.338716 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9a82c6bf-ea1d-4a37-a115-30a5fcf8dce5 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1501 microversion: 2.1 time: 0.224614 May 28 04:42:14.350545 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1068/2190] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:14 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1501 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:14.356224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d3c4990f-08b9-4e76-8ae5-fc0822209bab tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:14.357350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d3c4990f-08b9-4e76-8ae5-fc0822209bab tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:14.364833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3c4990f-08b9-4e76-8ae5-fc0822209bab tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:14.366516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3c4990f-08b9-4e76-8ae5-fc0822209bab tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:14.368611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3c4990f-08b9-4e76-8ae5-fc0822209bab tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:14.369484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3c4990f-08b9-4e76-8ae5-fc0822209bab tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:14.451880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-75ed7273-7230-4ae9-bfc6-48c908e33f2f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:14.471172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-75ed7273-7230-4ae9-bfc6-48c908e33f2f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:14.471172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-75ed7273-7230-4ae9-bfc6-48c908e33f2f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:14.471172 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-75ed7273-7230-4ae9-bfc6-48c908e33f2f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1280 microversion: 2.25 time: 0.291764 May 28 04:42:14.477844 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1123/2191] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:14 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1280 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:14.479496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d3c4990f-08b9-4e76-8ae5-fc0822209bab tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:14.486658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-000050d7-8fc8-4252-84b6-2a9b04e7decc req-7514ef70-e135-402f-9027-25c2f7fb51dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b94a91-20fe-40ac-bd67-2864eef657f6", "name": "network-vif-plugged", "status": "completed", "tag": "7dbb06ba-323b-4edc-bc6d-380122278f70"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:14.492705 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d3c4990f-08b9-4e76-8ae5-fc0822209bab tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:14.495303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d3c4990f-08b9-4e76-8ae5-fc0822209bab tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:14.497041 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d3c4990f-08b9-4e76-8ae5-fc0822209bab tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.144794 May 28 04:42:14.497931 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1069/2192] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:14 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:14.498476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-000050d7-8fc8-4252-84b6-2a9b04e7decc req-7514ef70-e135-402f-9027-25c2f7fb51dc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:14.499132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-000050d7-8fc8-4252-84b6-2a9b04e7decc req-7514ef70-e135-402f-9027-25c2f7fb51dc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:14.504047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ddc5b24e-ef99-47ae-bc7a-1182ca8a900d tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bd373fb-ce12-4993-b310-db6e4c817c33"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:14.505259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ddc5b24e-ef99-47ae-bc7a-1182ca8a900d tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:14.518912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ddc5b24e-ef99-47ae-bc7a-1182ca8a900d tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:14.519411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ddc5b24e-ef99-47ae-bc7a-1182ca8a900d tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:14.520224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ddc5b24e-ef99-47ae-bc7a-1182ca8a900d tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:14.520662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ddc5b24e-ef99-47ae-bc7a-1182ca8a900d tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:14.525694 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-000050d7-8fc8-4252-84b6-2a9b04e7decc req-7514ef70-e135-402f-9027-25c2f7fb51dc service nova] Creating event network-vif-plugged:7dbb06ba-323b-4edc-bc6d-380122278f70 for instance 12b94a91-20fe-40ac-bd67-2864eef657f6 on n-h1-843700-1 May 28 04:42:14.530858 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-000050d7-8fc8-4252-84b6-2a9b04e7decc req-7514ef70-e135-402f-9027-25c2f7fb51dc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049750 May 28 04:42:14.531998 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1124/2193] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:14.729137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fe5b0053-e7db-4392-917a-324066c3d567 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:14.734426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fe5b0053-e7db-4392-917a-324066c3d567 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:14.744078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe5b0053-e7db-4392-917a-324066c3d567 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:14.745106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe5b0053-e7db-4392-917a-324066c3d567 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:14.748310 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe5b0053-e7db-4392-917a-324066c3d567 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:14.749332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe5b0053-e7db-4392-917a-324066c3d567 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:14.795934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:14.971683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fe5b0053-e7db-4392-917a-324066c3d567 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:14.996766 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fe5b0053-e7db-4392-917a-324066c3d567 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1521 microversion: 2.1 time: 0.273630 May 28 04:42:15.007405 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1125/2194] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:14 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:15.085874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8803b2dd-4aef-4ee9-89fb-ea658c6df7cb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:15.086808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8803b2dd-4aef-4ee9-89fb-ea658c6df7cb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:15.098339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8803b2dd-4aef-4ee9-89fb-ea658c6df7cb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:15.098794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8803b2dd-4aef-4ee9-89fb-ea658c6df7cb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:15.099625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8803b2dd-4aef-4ee9-89fb-ea658c6df7cb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:15.100266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8803b2dd-4aef-4ee9-89fb-ea658c6df7cb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:15.268278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8803b2dd-4aef-4ee9-89fb-ea658c6df7cb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:15.277424 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8803b2dd-4aef-4ee9-89fb-ea658c6df7cb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1477 microversion: 2.1 time: 0.210427 May 28 04:42:15.278014 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1126/2195] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:15 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1477 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:15.283437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-207287bd-74dd-495d-b832-2203149ce847 req-344cbd7b-7684-4487-87fb-478f97ba53ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158412f0-30ee-458c-9da2-83be853d2ea4", "name": "network-vif-deleted", "tag": "3234e2dc-f459-4590-9dd3-6cfbc11536ed"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:15.292017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-207287bd-74dd-495d-b832-2203149ce847 req-344cbd7b-7684-4487-87fb-478f97ba53ec service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:15.292472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-207287bd-74dd-495d-b832-2203149ce847 req-344cbd7b-7684-4487-87fb-478f97ba53ec service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:15.304448 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-207287bd-74dd-495d-b832-2203149ce847 req-344cbd7b-7684-4487-87fb-478f97ba53ec service nova] Creating event network-vif-deleted:3234e2dc-f459-4590-9dd3-6cfbc11536ed for instance 158412f0-30ee-458c-9da2-83be853d2ea4 on n-h2-843700-1 May 28 04:42:15.309284 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-207287bd-74dd-495d-b832-2203149ce847 req-344cbd7b-7684-4487-87fb-478f97ba53ec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030166 May 28 04:42:15.309907 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1127/2196] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:15.361185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3b657095-3f52-4a4e-9221-4dc6bdff871f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:15.362058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3b657095-3f52-4a4e-9221-4dc6bdff871f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:15.375981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b657095-3f52-4a4e-9221-4dc6bdff871f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:15.376593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b657095-3f52-4a4e-9221-4dc6bdff871f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:15.377418 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b657095-3f52-4a4e-9221-4dc6bdff871f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:15.377863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b657095-3f52-4a4e-9221-4dc6bdff871f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:15.443119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3b657095-3f52-4a4e-9221-4dc6bdff871f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8fff3851eb4ecc927400c09117f5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd908671a46484d2082cc88a1d2c93f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:15.455167 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3b657095-3f52-4a4e-9221-4dc6bdff871f tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 200 len: 1459 microversion: 2.1 time: 0.098481 May 28 04:42:15.455167 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1128/2197] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:15 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 1459 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:15.483975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7ee78f9b-26fd-4b05-9d81-22d4dce961ab tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:15.489193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7ee78f9b-26fd-4b05-9d81-22d4dce961ab tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:15.491414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ee78f9b-26fd-4b05-9d81-22d4dce961ab tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:15.491875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ee78f9b-26fd-4b05-9d81-22d4dce961ab tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:15.492642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ee78f9b-26fd-4b05-9d81-22d4dce961ab tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:15.493079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ee78f9b-26fd-4b05-9d81-22d4dce961ab tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:15.637170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7ee78f9b-26fd-4b05-9d81-22d4dce961ab tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:15.645615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7ee78f9b-26fd-4b05-9d81-22d4dce961ab tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:15.647358 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7ee78f9b-26fd-4b05-9d81-22d4dce961ab tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:15.648469 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7ee78f9b-26fd-4b05-9d81-22d4dce961ab tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1280 microversion: 2.25 time: 0.168741 May 28 04:42:15.649267 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1129/2198] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:15 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1280 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:15.655188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c0431888-a45c-4c06-a52b-df06c5660317 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:15.655810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c0431888-a45c-4c06-a52b-df06c5660317 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:15.663524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0431888-a45c-4c06-a52b-df06c5660317 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:15.663974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0431888-a45c-4c06-a52b-df06c5660317 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:15.665643 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0431888-a45c-4c06-a52b-df06c5660317 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:15.666183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0431888-a45c-4c06-a52b-df06c5660317 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:15.667263 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ddc5b24e-ef99-47ae-bc7a-1182ca8a900d tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "POST /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.167973 May 28 04:42:15.676725 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1070/2199] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 04:42:14 2022] POST /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963/os-volume_attachments => generated 194 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:15.766912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c0431888-a45c-4c06-a52b-df06c5660317 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:15.776059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c0431888-a45c-4c06-a52b-df06c5660317 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:15.779694 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c0431888-a45c-4c06-a52b-df06c5660317 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:15.779694 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c0431888-a45c-4c06-a52b-df06c5660317 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.128808 May 28 04:42:15.779694 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1130/2200] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:15 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:16.011174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=8 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:16.015611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3a7e04a0-73aa-494f-bdc1-65fa1a160cd5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:16.021077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3a7e04a0-73aa-494f-bdc1-65fa1a160cd5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:16.024337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a7e04a0-73aa-494f-bdc1-65fa1a160cd5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:16.024796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a7e04a0-73aa-494f-bdc1-65fa1a160cd5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:16.025642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a7e04a0-73aa-494f-bdc1-65fa1a160cd5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:16.026097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a7e04a0-73aa-494f-bdc1-65fa1a160cd5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:16.199146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3a7e04a0-73aa-494f-bdc1-65fa1a160cd5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:16.215950 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3a7e04a0-73aa-494f-bdc1-65fa1a160cd5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1521 microversion: 2.1 time: 0.205846 May 28 04:42:16.216836 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1071/2201] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:16 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:16.294520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-926e486d-eee0-4623-91b3-0040623e8413 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:16.295187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-926e486d-eee0-4623-91b3-0040623e8413 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:16.302401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-926e486d-eee0-4623-91b3-0040623e8413 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:16.303681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-926e486d-eee0-4623-91b3-0040623e8413 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:16.304668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-926e486d-eee0-4623-91b3-0040623e8413 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:16.305284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-926e486d-eee0-4623-91b3-0040623e8413 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:16.458661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-926e486d-eee0-4623-91b3-0040623e8413 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:16.471236 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-926e486d-eee0-4623-91b3-0040623e8413 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1477 microversion: 2.1 time: 0.180379 May 28 04:42:16.480296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3fd1aebe-2a83-41aa-8998-75f74350aca2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:16.480456 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1131/2202] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:16 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1477 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:16.480558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3fd1aebe-2a83-41aa-8998-75f74350aca2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] [instance: 158412f0-30ee-458c-9da2-83be853d2ea4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:16.480558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3fd1aebe-2a83-41aa-8998-75f74350aca2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:16.481622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3fd1aebe-2a83-41aa-8998-75f74350aca2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:16.482663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3fd1aebe-2a83-41aa-8998-75f74350aca2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:16.484677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3fd1aebe-2a83-41aa-8998-75f74350aca2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:16.502322 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-3fd1aebe-2a83-41aa-8998-75f74350aca2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] HTTP exception thrown: Instance 158412f0-30ee-458c-9da2-83be853d2ea4 could not be found. May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3fd1aebe-2a83-41aa-8998-75f74350aca2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Request method failure captured: May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 HTTP/1.1 May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaZjiaepWU7TCYdX9MhCXgBBsJiLIK1lGWfcoQGt7uJIjKCUQfVxq-420KtmM_9aj9dVa8veVyEwuso9MhxkCBywM0PPE8IsZi1EvyxdRo2Zf-usIx7zhEkDTIzK3k51gQHZiF_UTPQVwZwHt-iCHX6z_NmsfKK-uFXeKxMtWWAULmo May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d908671a46484d2082cc88a1d2c93f98 May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-LiveMigrationTest-879087163 May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d908671a46484d2082cc88a1d2c93f98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d908671a46484d2082cc88a1d2c93f98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d908671a46484d2082cc88a1d2c93f98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d908671a46484d2082cc88a1d2c93f98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-LiveMigrationTest-879087163 May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d908671a46484d2082cc88a1d2c93f98 May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-LiveMigrationTest-879087163 May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-LiveMigrationTest-879087163-project May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: da8fff3851eb4ecc927400c09117f5ee May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-LiveMigrationTest-879087163-project May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 158412f0-30ee-458c-9da2-83be853d2ea4 could not be found. May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '158412f0-30ee-458c-9da2-83be853d2ea4'} May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158412f0-30ee-458c-9da2-83be853d2ea4 could not be found. May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158412f0-30ee-458c-9da2-83be853d2ea4 could not be found. May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:42:16.504337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:42:16.509316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:42:16.509316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:42:16.509316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:42:16.509316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:42:16.509316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158412f0-30ee-458c-9da2-83be853d2ea4 could not be found. May 28 04:42:16.509316 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:42:16.512836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3fd1aebe-2a83-41aa-8998-75f74350aca2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] Returning 404 to user: Instance 158412f0-30ee-458c-9da2-83be853d2ea4 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:42:16.514895 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3fd1aebe-2a83-41aa-8998-75f74350aca2 tempest-LiveMigrationTest-879087163 tempest-LiveMigrationTest-879087163-project] 10.222.0.58 "GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4" status: 404 len: 111 microversion: 2.1 time: 0.047961 May 28 04:42:16.514895 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1072/2203] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:16 2022] GET /compute/v2.1/servers/158412f0-30ee-458c-9da2-83be853d2ea4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:42:16.557486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-b765351d-1a50-4fe1-b289-7546e9e2e6f5 req-eb7fe373-5427-469e-837c-04eb3cea5d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f9a53c-0202-4e9d-bf42-6b3c376b535f", "name": "network-vif-unplugged", "status": "completed", "tag": "07124fc5-e96a-4da8-80b4-66723ac47caf"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:16.579203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b765351d-1a50-4fe1-b289-7546e9e2e6f5 req-eb7fe373-5427-469e-837c-04eb3cea5d31 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:16.580244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b765351d-1a50-4fe1-b289-7546e9e2e6f5 req-eb7fe373-5427-469e-837c-04eb3cea5d31 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:16.586269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:16.603760 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-b765351d-1a50-4fe1-b289-7546e9e2e6f5 req-eb7fe373-5427-469e-837c-04eb3cea5d31 service nova] Creating event network-vif-unplugged:07124fc5-e96a-4da8-80b4-66723ac47caf for instance 16f9a53c-0202-4e9d-bf42-6b3c376b535f on n-h2-843700-1 May 28 04:42:16.603760 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-b765351d-1a50-4fe1-b289-7546e9e2e6f5 req-eb7fe373-5427-469e-837c-04eb3cea5d31 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047395 May 28 04:42:16.603760 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1132/2204] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:16.672605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f4938ac9-2119-486c-991d-ea606ef921a4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:16.675091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f4938ac9-2119-486c-991d-ea606ef921a4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:16.691876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4938ac9-2119-486c-991d-ea606ef921a4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:16.695935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4938ac9-2119-486c-991d-ea606ef921a4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:16.701621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4938ac9-2119-486c-991d-ea606ef921a4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:16.701621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4938ac9-2119-486c-991d-ea606ef921a4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:16.751875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:16.799580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-116dce4c-0e9e-412f-956e-b06f33799e9e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:16.800454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-116dce4c-0e9e-412f-956e-b06f33799e9e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:16.817105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-116dce4c-0e9e-412f-956e-b06f33799e9e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:16.819752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-116dce4c-0e9e-412f-956e-b06f33799e9e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:16.827085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-116dce4c-0e9e-412f-956e-b06f33799e9e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:16.827085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-116dce4c-0e9e-412f-956e-b06f33799e9e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:17.026902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-116dce4c-0e9e-412f-956e-b06f33799e9e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:17.044219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f4938ac9-2119-486c-991d-ea606ef921a4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:17.053945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-116dce4c-0e9e-412f-956e-b06f33799e9e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:17.055729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f4938ac9-2119-486c-991d-ea606ef921a4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:17.057470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f4938ac9-2119-486c-991d-ea606ef921a4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:17.058810 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f4938ac9-2119-486c-991d-ea606ef921a4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1280 microversion: 2.25 time: 0.396781 May 28 04:42:17.059588 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1073/2205] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:16 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1280 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:17.065942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-116dce4c-0e9e-412f-956e-b06f33799e9e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:17.065942 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-116dce4c-0e9e-412f-956e-b06f33799e9e tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.270642 May 28 04:42:17.076670 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1133/2206] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:16 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:17.249844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-93c1eb7f-4981-4d58-9b58-b602da4e5efc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:17.251148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-93c1eb7f-4981-4d58-9b58-b602da4e5efc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:17.266382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93c1eb7f-4981-4d58-9b58-b602da4e5efc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:17.272439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93c1eb7f-4981-4d58-9b58-b602da4e5efc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:17.276303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93c1eb7f-4981-4d58-9b58-b602da4e5efc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:17.278822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93c1eb7f-4981-4d58-9b58-b602da4e5efc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:17.515416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-93c1eb7f-4981-4d58-9b58-b602da4e5efc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:17.515416 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-93c1eb7f-4981-4d58-9b58-b602da4e5efc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1521 microversion: 2.1 time: 0.210200 May 28 04:42:17.515416 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1074/2207] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:17 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:17.515805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c3041bb0-4b49-4303-ab1f-7a4184dccee2 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:17.515805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c3041bb0-4b49-4303-ab1f-7a4184dccee2 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:17.515805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3041bb0-4b49-4303-ab1f-7a4184dccee2 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:17.515805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3041bb0-4b49-4303-ab1f-7a4184dccee2 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:17.515805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3041bb0-4b49-4303-ab1f-7a4184dccee2 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:17.515805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3041bb0-4b49-4303-ab1f-7a4184dccee2 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:17.696425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c3041bb0-4b49-4303-ab1f-7a4184dccee2 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:17.705324 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c3041bb0-4b49-4303-ab1f-7a4184dccee2 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1463 microversion: 2.1 time: 0.219064 May 28 04:42:17.705928 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1134/2208] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:17 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1463 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:17.723493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8247565e-7b4d-41f7-acf5-bdc298942de9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:17.724186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8247565e-7b4d-41f7-acf5-bdc298942de9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:17.731380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8247565e-7b4d-41f7-acf5-bdc298942de9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:17.732283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8247565e-7b4d-41f7-acf5-bdc298942de9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:17.732787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8247565e-7b4d-41f7-acf5-bdc298942de9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:17.733809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8247565e-7b4d-41f7-acf5-bdc298942de9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:17.921581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8247565e-7b4d-41f7-acf5-bdc298942de9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:17.936129 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8247565e-7b4d-41f7-acf5-bdc298942de9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1463 microversion: 2.1 time: 0.216532 May 28 04:42:17.937230 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1075/2209] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:17 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1463 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:17.954511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-79fbc50d-11d2-4258-9d0b-19a4c66e6338 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "012b12af-263c-4753-8fad-4a4022b439aa"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:17.957585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-79fbc50d-11d2-4258-9d0b-19a4c66e6338 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:17.964284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-79fbc50d-11d2-4258-9d0b-19a4c66e6338 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:17.980241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-79fbc50d-11d2-4258-9d0b-19a4c66e6338 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:17.980241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-79fbc50d-11d2-4258-9d0b-19a4c66e6338 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:17.980241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-79fbc50d-11d2-4258-9d0b-19a4c66e6338 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:18.058835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-79fbc50d-11d2-4258-9d0b-19a4c66e6338 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:42:18.059301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-79fbc50d-11d2-4258-9d0b-19a4c66e6338 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:42:18.059780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-79fbc50d-11d2-4258-9d0b-19a4c66e6338 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:42:18.060221 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-79fbc50d-11d2-4258-9d0b-19a4c66e6338 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:42:18.060653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-79fbc50d-11d2-4258-9d0b-19a4c66e6338 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:42:18.077122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b11abef6-4251-44d6-93c6-e9ff5e9a8829 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:18.078439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b11abef6-4251-44d6-93c6-e9ff5e9a8829 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:18.089511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b11abef6-4251-44d6-93c6-e9ff5e9a8829 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:18.090297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b11abef6-4251-44d6-93c6-e9ff5e9a8829 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:18.094906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b11abef6-4251-44d6-93c6-e9ff5e9a8829 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:18.094906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b11abef6-4251-44d6-93c6-e9ff5e9a8829 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:18.296728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b11abef6-4251-44d6-93c6-e9ff5e9a8829 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:18.307600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b11abef6-4251-44d6-93c6-e9ff5e9a8829 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:18.309674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b11abef6-4251-44d6-93c6-e9ff5e9a8829 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:18.310701 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b11abef6-4251-44d6-93c6-e9ff5e9a8829 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1280 microversion: 2.25 time: 0.237878 May 28 04:42:18.313475 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1076/2210] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:18 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1280 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:18.320768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5aad2935-c97c-45b7-975b-173520195361 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:18.321658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5aad2935-c97c-45b7-975b-173520195361 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:18.354830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-79fbc50d-11d2-4258-9d0b-19a4c66e6338 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:18.362401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5aad2935-c97c-45b7-975b-173520195361 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:18.362401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5aad2935-c97c-45b7-975b-173520195361 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:18.365400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5aad2935-c97c-45b7-975b-173520195361 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:18.366354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5aad2935-c97c-45b7-975b-173520195361 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:18.385999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-79fbc50d-11d2-4258-9d0b-19a4c66e6338 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:18.386709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-79fbc50d-11d2-4258-9d0b-19a4c66e6338 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:18.391309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-79fbc50d-11d2-4258-9d0b-19a4c66e6338 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:18.391309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-79fbc50d-11d2-4258-9d0b-19a4c66e6338 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:18.422567 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-79fbc50d-11d2-4258-9d0b-19a4c66e6338 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "POST /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6/action" status: 202 len: 1067 microversion: 2.1 time: 0.472645 May 28 04:42:18.433298 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1135/2211] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:42:17 2022] POST /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6/action => generated 1067 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 28 04:42:18.445581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-53c42e75-1803-4484-b44a-1b641ad676a3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:18.452256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-53c42e75-1803-4484-b44a-1b641ad676a3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:18.458953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53c42e75-1803-4484-b44a-1b641ad676a3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:18.460117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53c42e75-1803-4484-b44a-1b641ad676a3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:18.460902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53c42e75-1803-4484-b44a-1b641ad676a3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:18.461350 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53c42e75-1803-4484-b44a-1b641ad676a3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:18.506966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5aad2935-c97c-45b7-975b-173520195361 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:18.517084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5aad2935-c97c-45b7-975b-173520195361 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:18.519202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5aad2935-c97c-45b7-975b-173520195361 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:18.520668 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5aad2935-c97c-45b7-975b-173520195361 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.205153 May 28 04:42:18.521305 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1077/2212] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:18 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:18.537726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3a73bf79-7160-49be-bda1-b13779c3cbd5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:18.538745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3a73bf79-7160-49be-bda1-b13779c3cbd5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:18.546928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a73bf79-7160-49be-bda1-b13779c3cbd5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:18.547447 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a73bf79-7160-49be-bda1-b13779c3cbd5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:18.548828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a73bf79-7160-49be-bda1-b13779c3cbd5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:18.548828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a73bf79-7160-49be-bda1-b13779c3cbd5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:18.775271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-53c42e75-1803-4484-b44a-1b641ad676a3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:18.785315 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-53c42e75-1803-4484-b44a-1b641ad676a3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1472 microversion: 2.1 time: 0.344888 May 28 04:42:18.790737 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1136/2213] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:18 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1472 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:18.920596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3a73bf79-7160-49be-bda1-b13779c3cbd5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:18.930854 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3a73bf79-7160-49be-bda1-b13779c3cbd5 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1521 microversion: 2.1 time: 0.397227 May 28 04:42:18.941323 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1078/2214] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:18 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:18.975649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-cf248c2d-e54e-4ed5-83e6-217240a299fa req-94d22a50-ccfb-4ad2-98e4-6312fba711a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f9a53c-0202-4e9d-bf42-6b3c376b535f", "name": "network-vif-plugged", "status": "completed", "tag": "07124fc5-e96a-4da8-80b4-66723ac47caf"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:19.002432 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-cf248c2d-e54e-4ed5-83e6-217240a299fa req-94d22a50-ccfb-4ad2-98e4-6312fba711a7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:19.006748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-cf248c2d-e54e-4ed5-83e6-217240a299fa req-94d22a50-ccfb-4ad2-98e4-6312fba711a7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:19.044954 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-cf248c2d-e54e-4ed5-83e6-217240a299fa req-94d22a50-ccfb-4ad2-98e4-6312fba711a7 service nova] Creating event network-vif-plugged:07124fc5-e96a-4da8-80b4-66723ac47caf for instance 16f9a53c-0202-4e9d-bf42-6b3c376b535f on n-h2-843700-1 May 28 04:42:19.060771 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-cf248c2d-e54e-4ed5-83e6-217240a299fa req-94d22a50-ccfb-4ad2-98e4-6312fba711a7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087619 May 28 04:42:19.061910 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1137/2215] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:19.331710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ed0183e0-3529-460c-87e0-fc530d7009c7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:19.332997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ed0183e0-3529-460c-87e0-fc530d7009c7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:19.354138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ed0183e0-3529-460c-87e0-fc530d7009c7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:19.356294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ed0183e0-3529-460c-87e0-fc530d7009c7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:19.357341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ed0183e0-3529-460c-87e0-fc530d7009c7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:19.359223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ed0183e0-3529-460c-87e0-fc530d7009c7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:19.542887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-24c5ca18-d2ed-4f73-9be4-6b17706030f7 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:19.543912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-24c5ca18-d2ed-4f73-9be4-6b17706030f7 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:19.553785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24c5ca18-d2ed-4f73-9be4-6b17706030f7 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:19.554383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24c5ca18-d2ed-4f73-9be4-6b17706030f7 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:19.555453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24c5ca18-d2ed-4f73-9be4-6b17706030f7 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:19.555996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24c5ca18-d2ed-4f73-9be4-6b17706030f7 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:19.587371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ed0183e0-3529-460c-87e0-fc530d7009c7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:19.595883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ed0183e0-3529-460c-87e0-fc530d7009c7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:19.597551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ed0183e0-3529-460c-87e0-fc530d7009c7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:19.609681 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ed0183e0-3529-460c-87e0-fc530d7009c7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1280 microversion: 2.25 time: 0.271975 May 28 04:42:19.610339 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1079/2216] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:19 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1280 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:19.643075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-24c5ca18-d2ed-4f73-9be4-6b17706030f7 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:19.661253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-24c5ca18-d2ed-4f73-9be4-6b17706030f7 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:19.666355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-24c5ca18-d2ed-4f73-9be4-6b17706030f7 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:19.668632 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-24c5ca18-d2ed-4f73-9be4-6b17706030f7 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.132374 May 28 04:42:19.680068 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1138/2217] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:19 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:19.802864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b74cfdc7-70a9-4a95-bd00-16aa85be399c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:19.804702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b74cfdc7-70a9-4a95-bd00-16aa85be399c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:19.812278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b74cfdc7-70a9-4a95-bd00-16aa85be399c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:19.813643 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b74cfdc7-70a9-4a95-bd00-16aa85be399c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:19.814671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b74cfdc7-70a9-4a95-bd00-16aa85be399c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:19.815681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b74cfdc7-70a9-4a95-bd00-16aa85be399c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:19.952711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-89278bc0-36fb-471c-9f4a-b8b831c5a9c0 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:19.953345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-89278bc0-36fb-471c-9f4a-b8b831c5a9c0 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:19.963905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89278bc0-36fb-471c-9f4a-b8b831c5a9c0 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:19.964375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89278bc0-36fb-471c-9f4a-b8b831c5a9c0 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:19.967959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b74cfdc7-70a9-4a95-bd00-16aa85be399c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:19.978059 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b74cfdc7-70a9-4a95-bd00-16aa85be399c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1472 microversion: 2.1 time: 0.179006 May 28 04:42:19.981354 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1080/2218] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:19 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1472 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:19.981649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89278bc0-36fb-471c-9f4a-b8b831c5a9c0 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:19.982642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89278bc0-36fb-471c-9f4a-b8b831c5a9c0 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:20.437474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-89278bc0-36fb-471c-9f4a-b8b831c5a9c0 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:20.446280 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-89278bc0-36fb-471c-9f4a-b8b831c5a9c0 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1521 microversion: 2.1 time: 0.501873 May 28 04:42:20.446869 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1139/2219] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:19 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1521 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:20.629370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-546d2d0d-02ac-4f46-9a62-f9d19a03e399 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:20.630306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-546d2d0d-02ac-4f46-9a62-f9d19a03e399 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:20.639077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-546d2d0d-02ac-4f46-9a62-f9d19a03e399 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:20.639878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-546d2d0d-02ac-4f46-9a62-f9d19a03e399 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:20.640880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-546d2d0d-02ac-4f46-9a62-f9d19a03e399 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:20.641540 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-546d2d0d-02ac-4f46-9a62-f9d19a03e399 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:20.688828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-67b87cc2-f4cd-4cef-a087-0f1f1accfcc2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:20.691097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-67b87cc2-f4cd-4cef-a087-0f1f1accfcc2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:20.701652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67b87cc2-f4cd-4cef-a087-0f1f1accfcc2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:20.702387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67b87cc2-f4cd-4cef-a087-0f1f1accfcc2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:20.703453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67b87cc2-f4cd-4cef-a087-0f1f1accfcc2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:20.704075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67b87cc2-f4cd-4cef-a087-0f1f1accfcc2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:20.925906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-67b87cc2-f4cd-4cef-a087-0f1f1accfcc2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:20.940192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-67b87cc2-f4cd-4cef-a087-0f1f1accfcc2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:20.944844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-67b87cc2-f4cd-4cef-a087-0f1f1accfcc2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:20.949159 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-67b87cc2-f4cd-4cef-a087-0f1f1accfcc2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.264663 May 28 04:42:20.953394 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1140/2220] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:20 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:20.997571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-55df86f0-53a5-47bf-9faa-fe6b708b10d0 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:20.998298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-546d2d0d-02ac-4f46-9a62-f9d19a03e399 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:20.999466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-55df86f0-53a5-47bf-9faa-fe6b708b10d0 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:21.011767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-546d2d0d-02ac-4f46-9a62-f9d19a03e399 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:21.014435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-546d2d0d-02ac-4f46-9a62-f9d19a03e399 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:21.018089 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-546d2d0d-02ac-4f46-9a62-f9d19a03e399 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1280 microversion: 2.25 time: 0.392445 May 28 04:42:21.018934 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1081/2221] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:20 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1280 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:21.031410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55df86f0-53a5-47bf-9faa-fe6b708b10d0 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:21.032220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55df86f0-53a5-47bf-9faa-fe6b708b10d0 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:21.033251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55df86f0-53a5-47bf-9faa-fe6b708b10d0 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:21.033904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55df86f0-53a5-47bf-9faa-fe6b708b10d0 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:21.249897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-55df86f0-53a5-47bf-9faa-fe6b708b10d0 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:21.260390 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-55df86f0-53a5-47bf-9faa-fe6b708b10d0 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1472 microversion: 2.1 time: 0.266817 May 28 04:42:21.265733 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1141/2222] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:20 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1472 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:21.464786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-78893c17-fcca-4af5-bc88-44be20c2d64e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:21.465588 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-78893c17-fcca-4af5-bc88-44be20c2d64e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:21.479887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78893c17-fcca-4af5-bc88-44be20c2d64e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:21.480670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78893c17-fcca-4af5-bc88-44be20c2d64e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:21.483674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78893c17-fcca-4af5-bc88-44be20c2d64e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:21.484259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78893c17-fcca-4af5-bc88-44be20c2d64e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:21.777030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-78893c17-fcca-4af5-bc88-44be20c2d64e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:21.785191 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-78893c17-fcca-4af5-bc88-44be20c2d64e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1506 microversion: 2.1 time: 0.324434 May 28 04:42:21.791036 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1082/2223] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:21 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:21.814407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ed6bc719-5453-418c-88a3-735c4bbd0a13 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:21.815511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ed6bc719-5453-418c-88a3-735c4bbd0a13 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:21.824801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed6bc719-5453-418c-88a3-735c4bbd0a13 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:21.825658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed6bc719-5453-418c-88a3-735c4bbd0a13 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:21.826744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed6bc719-5453-418c-88a3-735c4bbd0a13 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:21.827318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed6bc719-5453-418c-88a3-735c4bbd0a13 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:21.974133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f914fd49-edd6-4ad8-895f-f1bec6c20247 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:21.976421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f914fd49-edd6-4ad8-895f-f1bec6c20247 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:21.986349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f914fd49-edd6-4ad8-895f-f1bec6c20247 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:21.989805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f914fd49-edd6-4ad8-895f-f1bec6c20247 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:21.992226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f914fd49-edd6-4ad8-895f-f1bec6c20247 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:21.993222 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f914fd49-edd6-4ad8-895f-f1bec6c20247 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:22.191911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f914fd49-edd6-4ad8-895f-f1bec6c20247 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:22.232017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f914fd49-edd6-4ad8-895f-f1bec6c20247 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:22.233605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f914fd49-edd6-4ad8-895f-f1bec6c20247 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:22.234839 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f914fd49-edd6-4ad8-895f-f1bec6c20247 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.268788 May 28 04:42:22.244077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ed6bc719-5453-418c-88a3-735c4bbd0a13 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:22.247367 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1083/2224] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:21 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:22.252394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9af38a80-bdc1-4c04-ac21-8b1dfba258c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:22.253254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9af38a80-bdc1-4c04-ac21-8b1dfba258c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:22.255880 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ed6bc719-5453-418c-88a3-735c4bbd0a13 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 200 len: 1506 microversion: 2.1 time: 0.445844 May 28 04:42:22.262938 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1142/2225] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:21 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:22.267561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9af38a80-bdc1-4c04-ac21-8b1dfba258c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:22.272544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9af38a80-bdc1-4c04-ac21-8b1dfba258c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:22.272544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9af38a80-bdc1-4c04-ac21-8b1dfba258c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:22.272544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9af38a80-bdc1-4c04-ac21-8b1dfba258c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:22.280466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-108849b3-324e-4e98-938e-37b79fd399b9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:22.281406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-108849b3-324e-4e98-938e-37b79fd399b9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:22.290962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-108849b3-324e-4e98-938e-37b79fd399b9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:22.291767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-108849b3-324e-4e98-938e-37b79fd399b9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:22.292776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-108849b3-324e-4e98-938e-37b79fd399b9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:22.293865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-108849b3-324e-4e98-938e-37b79fd399b9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:22.758217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9af38a80-bdc1-4c04-ac21-8b1dfba258c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:22.779830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9af38a80-bdc1-4c04-ac21-8b1dfba258c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:22.779830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9af38a80-bdc1-4c04-ac21-8b1dfba258c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:22.779830 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9af38a80-bdc1-4c04-ac21-8b1dfba258c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1280 microversion: 2.25 time: 0.528658 May 28 04:42:22.786177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-108849b3-324e-4e98-938e-37b79fd399b9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:22.795427 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-108849b3-324e-4e98-938e-37b79fd399b9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1472 microversion: 2.1 time: 0.519808 May 28 04:42:22.796803 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1084/2226] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:22 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1280 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:22.799417 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1143/2227] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:22 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1472 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:22.803505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6f8c276f-d209-4a45-8274-1c26bf856b7f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:22.804171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6f8c276f-d209-4a45-8274-1c26bf856b7f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:22.814614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f8c276f-d209-4a45-8274-1c26bf856b7f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:22.815231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f8c276f-d209-4a45-8274-1c26bf856b7f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:22.816188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f8c276f-d209-4a45-8274-1c26bf856b7f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:22.816770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f8c276f-d209-4a45-8274-1c26bf856b7f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:22.852116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6f8c276f-d209-4a45-8274-1c26bf856b7f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:42:23.077869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-d3369ef4-6d84-455e-8b72-792cfc8aceea req-ecd4d46d-c79b-4c73-a885-1c32139a7c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c3986b-245a-4454-95c7-63f826af6edc", "name": "network-vif-plugged", "status": "completed", "tag": "a8517f33-040a-4dc7-a1bf-9a16a458e569"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:23.083624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:23.093169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d3369ef4-6d84-455e-8b72-792cfc8aceea req-ecd4d46d-c79b-4c73-a885-1c32139a7c13 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:23.094016 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d3369ef4-6d84-455e-8b72-792cfc8aceea req-ecd4d46d-c79b-4c73-a885-1c32139a7c13 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:23.109059 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-d3369ef4-6d84-455e-8b72-792cfc8aceea req-ecd4d46d-c79b-4c73-a885-1c32139a7c13 service nova] Creating event network-vif-plugged:a8517f33-040a-4dc7-a1bf-9a16a458e569 for instance 05c3986b-245a-4454-95c7-63f826af6edc on n-h2-843700-1 May 28 04:42:23.114946 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-d3369ef4-6d84-455e-8b72-792cfc8aceea req-ecd4d46d-c79b-4c73-a885-1c32139a7c13 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040487 May 28 04:42:23.121134 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1144/2228] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:42:23.141432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:23.257935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-40aedc62-99de-41fa-95fe-87e2b479794b tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:23.266005 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-40aedc62-99de-41fa-95fe-87e2b479794b tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:23.289563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40aedc62-99de-41fa-95fe-87e2b479794b tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:23.289810 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6f8c276f-d209-4a45-8274-1c26bf856b7f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "DELETE /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 204 len: 0 microversion: 2.1 time: 0.490495 May 28 04:42:23.290633 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1085/2229] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:42:22 2022] DELETE /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:42:23.292376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40aedc62-99de-41fa-95fe-87e2b479794b tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:23.295118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40aedc62-99de-41fa-95fe-87e2b479794b tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:23.296776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40aedc62-99de-41fa-95fe-87e2b479794b tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:23.450802 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-40aedc62-99de-41fa-95fe-87e2b479794b tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:23.461736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-40aedc62-99de-41fa-95fe-87e2b479794b tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:23.467429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-40aedc62-99de-41fa-95fe-87e2b479794b tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:23.472738 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-40aedc62-99de-41fa-95fe-87e2b479794b tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.218670 May 28 04:42:23.472738 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1145/2230] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:23 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:23.478741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-93fba9d9-6928-4b6d-81ec-8691d25e2e30 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2108794900", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "76e10746-e2e9-4339-aae3-49ef9bc702b8"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:23.552191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-93fba9d9-6928-4b6d-81ec-8691d25e2e30 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] validate_networks() for [('76e10746-e2e9-4339-aae3-49ef9bc702b8', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:42:23.819808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b366bfc0-f960-49c8-9c52-a5acacd78309 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:23.820434 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b366bfc0-f960-49c8-9c52-a5acacd78309 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:23.830813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b366bfc0-f960-49c8-9c52-a5acacd78309 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:23.831307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b366bfc0-f960-49c8-9c52-a5acacd78309 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:23.832109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b366bfc0-f960-49c8-9c52-a5acacd78309 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:23.832548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b366bfc0-f960-49c8-9c52-a5acacd78309 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:24.087254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b366bfc0-f960-49c8-9c52-a5acacd78309 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:24.103314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b366bfc0-f960-49c8-9c52-a5acacd78309 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:24.106717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-93fba9d9-6928-4b6d-81ec-8691d25e2e30 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:42:24.107180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-93fba9d9-6928-4b6d-81ec-8691d25e2e30 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:42:24.107661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-93fba9d9-6928-4b6d-81ec-8691d25e2e30 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:42:24.110762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-93fba9d9-6928-4b6d-81ec-8691d25e2e30 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:42:24.110762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-93fba9d9-6928-4b6d-81ec-8691d25e2e30 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:42:24.117099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b366bfc0-f960-49c8-9c52-a5acacd78309 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:24.118214 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b366bfc0-f960-49c8-9c52-a5acacd78309 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1280 microversion: 2.25 time: 0.304420 May 28 04:42:24.118780 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1146/2231] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:23 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1280 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:24.123861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93fba9d9-6928-4b6d-81ec-8691d25e2e30 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:24.124969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93fba9d9-6928-4b6d-81ec-8691d25e2e30 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:24.126394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93fba9d9-6928-4b6d-81ec-8691d25e2e30 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:24.127032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93fba9d9-6928-4b6d-81ec-8691d25e2e30 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:24.133276 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0128100b-151e-41ff-a10f-5a625d965b6e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:24.134571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0128100b-151e-41ff-a10f-5a625d965b6e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:24.141215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0128100b-151e-41ff-a10f-5a625d965b6e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:24.141670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0128100b-151e-41ff-a10f-5a625d965b6e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:24.142646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0128100b-151e-41ff-a10f-5a625d965b6e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:24.143144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0128100b-151e-41ff-a10f-5a625d965b6e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:24.153407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-93fba9d9-6928-4b6d-81ec-8691d25e2e30 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Getting quotas for project a93892cb2a75466a82fcb79f40b306ca. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:42:24.159166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-93fba9d9-6928-4b6d-81ec-8691d25e2e30 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Getting quotas for user 0d4fff87c06440478b3a4536a289aa99 and project a93892cb2a75466a82fcb79f40b306ca. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:42:24.174530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-93fba9d9-6928-4b6d-81ec-8691d25e2e30 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:42:24.177129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-93fba9d9-6928-4b6d-81ec-8691d25e2e30 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:42:24.284859 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0128100b-151e-41ff-a10f-5a625d965b6e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:24.293875 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0128100b-151e-41ff-a10f-5a625d965b6e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1472 microversion: 2.1 time: 0.174033 May 28 04:42:24.294975 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1147/2232] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:24 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1472 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:24.418358 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-93fba9d9-6928-4b6d-81ec-8691d25e2e30 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944308 May 28 04:42:24.424056 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1086/2233] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:42:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:42:24.430070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ed08504d-96a4-4639-bfb5-11623c33b0d7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:24.430816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ed08504d-96a4-4639-bfb5-11623c33b0d7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:24.488643 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eb263a59-70d3-4e15-b948-602dc936e1c1 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:24.489552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eb263a59-70d3-4e15-b948-602dc936e1c1 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:24.505002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb263a59-70d3-4e15-b948-602dc936e1c1 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:24.520089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb263a59-70d3-4e15-b948-602dc936e1c1 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:24.522249 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb263a59-70d3-4e15-b948-602dc936e1c1 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:24.525579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb263a59-70d3-4e15-b948-602dc936e1c1 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:24.577533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ed08504d-96a4-4639-bfb5-11623c33b0d7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:24.591985 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ed08504d-96a4-4639-bfb5-11623c33b0d7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1218 microversion: 2.1 time: 0.166574 May 28 04:42:24.594369 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1148/2234] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:24 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1218 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:24.674232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eb263a59-70d3-4e15-b948-602dc936e1c1 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:24.687905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eb263a59-70d3-4e15-b948-602dc936e1c1 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:24.689435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eb263a59-70d3-4e15-b948-602dc936e1c1 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:24.690639 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eb263a59-70d3-4e15-b948-602dc936e1c1 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.206467 May 28 04:42:24.691244 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1087/2235] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:24 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:25.136695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-98e6a762-d7c4-4317-a00e-dc75e8e6e301 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:25.138620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-98e6a762-d7c4-4317-a00e-dc75e8e6e301 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:25.166156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-98e6a762-d7c4-4317-a00e-dc75e8e6e301 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:25.168935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-98e6a762-d7c4-4317-a00e-dc75e8e6e301 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:25.171613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-98e6a762-d7c4-4317-a00e-dc75e8e6e301 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:25.174568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-98e6a762-d7c4-4317-a00e-dc75e8e6e301 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:25.314397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b552004c-97ab-4444-8409-d99d0082f228 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:25.315125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b552004c-97ab-4444-8409-d99d0082f228 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:25.327825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b552004c-97ab-4444-8409-d99d0082f228 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:25.332258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b552004c-97ab-4444-8409-d99d0082f228 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:25.334576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b552004c-97ab-4444-8409-d99d0082f228 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:25.334576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b552004c-97ab-4444-8409-d99d0082f228 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:25.421739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-98e6a762-d7c4-4317-a00e-dc75e8e6e301 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:25.430575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:25.436294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-98e6a762-d7c4-4317-a00e-dc75e8e6e301 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:25.438107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-98e6a762-d7c4-4317-a00e-dc75e8e6e301 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:25.444666 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-98e6a762-d7c4-4317-a00e-dc75e8e6e301 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1280 microversion: 2.25 time: 0.310473 May 28 04:42:25.455732 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1149/2236] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:25 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1280 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:25.573137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b552004c-97ab-4444-8409-d99d0082f228 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:25.582726 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b552004c-97ab-4444-8409-d99d0082f228 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1472 microversion: 2.1 time: 0.273658 May 28 04:42:25.586907 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1088/2237] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:25 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1472 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:25.612292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4b91e05e-082f-461f-8a3d-61a025bd0682 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:25.613193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4b91e05e-082f-461f-8a3d-61a025bd0682 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:25.758662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4b91e05e-082f-461f-8a3d-61a025bd0682 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:25.792616 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4b91e05e-082f-461f-8a3d-61a025bd0682 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1218 microversion: 2.1 time: 0.183787 May 28 04:42:25.802178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f6257d12-249a-4eff-8124-6c3fcc7c8b71 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Calling method '.version_select at 0x7f7701238e50>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:25.804105 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1089/2238] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:25 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1218 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:25.811483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7542bfcd-0ea3-47c7-9b90-ed1e6d0dd756 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:25.812498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7542bfcd-0ea3-47c7-9b90-ed1e6d0dd756 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:25.826296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7542bfcd-0ea3-47c7-9b90-ed1e6d0dd756 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:25.826296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7542bfcd-0ea3-47c7-9b90-ed1e6d0dd756 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:25.826296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7542bfcd-0ea3-47c7-9b90-ed1e6d0dd756 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:25.826296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7542bfcd-0ea3-47c7-9b90-ed1e6d0dd756 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:25.838243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:25.925653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7542bfcd-0ea3-47c7-9b90-ed1e6d0dd756 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:25.936069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7542bfcd-0ea3-47c7-9b90-ed1e6d0dd756 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:25.940907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7542bfcd-0ea3-47c7-9b90-ed1e6d0dd756 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:25.940907 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7542bfcd-0ea3-47c7-9b90-ed1e6d0dd756 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.135126 May 28 04:42:25.941166 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1090/2239] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:25 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:25.946065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-dd31bdc4-30e0-47e7-8c38-bd82e19e1894 req-b574c00c-4bae-4b7b-ae52-e1a9407ccaaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f9a53c-0202-4e9d-bf42-6b3c376b535f", "name": "network-vif-deleted", "tag": "07124fc5-e96a-4da8-80b4-66723ac47caf"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:25.955311 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f6257d12-249a-4eff-8124-6c3fcc7c8b71 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/989b840cdd4b4bf9a151f2f51ce07c0a" status: 200 len: 371 microversion: 2.1 time: 0.435589 May 28 04:42:25.955931 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1150/2240] 10.222.0.58 () {58 vars in 1241 bytes} [Sat May 28 04:42:25 2022] GET /compute/v2.1/os-quota-sets/989b840cdd4b4bf9a151f2f51ce07c0a => generated 371 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:25.958388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-dd31bdc4-30e0-47e7-8c38-bd82e19e1894 req-b574c00c-4bae-4b7b-ae52-e1a9407ccaaf service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:25.959508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-dd31bdc4-30e0-47e7-8c38-bd82e19e1894 req-b574c00c-4bae-4b7b-ae52-e1a9407ccaaf service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:25.969425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e109e41a-eef8-4ccf-97c8-89cba3e9f99a tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Action: 'update', calling method: .version_select at 0x7f77011793a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:25.972368 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-dd31bdc4-30e0-47e7-8c38-bd82e19e1894 req-b574c00c-4bae-4b7b-ae52-e1a9407ccaaf service nova] Creating event network-vif-deleted:07124fc5-e96a-4da8-80b4-66723ac47caf for instance 16f9a53c-0202-4e9d-bf42-6b3c376b535f on n-h2-843700-1 May 28 04:42:25.978379 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-dd31bdc4-30e0-47e7-8c38-bd82e19e1894 req-b574c00c-4bae-4b7b-ae52-e1a9407ccaaf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035982 May 28 04:42:25.979472 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1091/2241] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:26.108617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e109e41a-eef8-4ccf-97c8-89cba3e9f99a tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:26.110167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e109e41a-eef8-4ccf-97c8-89cba3e9f99a tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:26.111632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e109e41a-eef8-4ccf-97c8-89cba3e9f99a tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:26.112438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e109e41a-eef8-4ccf-97c8-89cba3e9f99a tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:26.273177 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e109e41a-eef8-4ccf-97c8-89cba3e9f99a tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/989b840cdd4b4bf9a151f2f51ce07c0a" status: 200 len: 328 microversion: 2.1 time: 0.309961 May 28 04:42:26.274527 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1151/2242] 10.222.0.58 () {60 vars in 1261 bytes} [Sat May 28 04:42:25 2022] PUT /compute/v2.1/os-quota-sets/989b840cdd4b4bf9a151f2f51ce07c0a => generated 328 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:42:26.284468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-88f6b2a1-259e-428f-8741-8734e17b9009 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:26.433889 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-88f6b2a1-259e-428f-8741-8734e17b9009 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-quota-sets/989b840cdd4b4bf9a151f2f51ce07c0a" status: 202 len: 0 microversion: 2.1 time: 0.153184 May 28 04:42:26.437961 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1092/2243] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 04:42:26 2022] DELETE /compute/v2.1/os-quota-sets/989b840cdd4b4bf9a151f2f51ce07c0a => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:42:26.444099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1314c7b4-69e3-45c5-a89e-00a9e5c46e38 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Calling method '.version_select at 0x7f7701179ca0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:26.474627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-acfc3843-e7fd-49bb-ade1-233631e2c442 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:26.475964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-acfc3843-e7fd-49bb-ade1-233631e2c442 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:26.484480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-acfc3843-e7fd-49bb-ade1-233631e2c442 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:26.485268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-acfc3843-e7fd-49bb-ade1-233631e2c442 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:26.486530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-acfc3843-e7fd-49bb-ade1-233631e2c442 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:26.487458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-acfc3843-e7fd-49bb-ade1-233631e2c442 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:26.564093 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1314c7b4-69e3-45c5-a89e-00a9e5c46e38 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/989b840cdd4b4bf9a151f2f51ce07c0a" status: 200 len: 371 microversion: 2.1 time: 0.124658 May 28 04:42:26.565038 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1152/2244] 10.222.0.58 () {58 vars in 1241 bytes} [Sat May 28 04:42:26 2022] GET /compute/v2.1/os-quota-sets/989b840cdd4b4bf9a151f2f51ce07c0a => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:42:26.602317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a101737c-1d5b-4895-8a99-f167050e00a8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:26.603266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a101737c-1d5b-4895-8a99-f167050e00a8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:26.610151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a101737c-1d5b-4895-8a99-f167050e00a8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:26.610895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a101737c-1d5b-4895-8a99-f167050e00a8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:26.611827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a101737c-1d5b-4895-8a99-f167050e00a8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:26.612355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a101737c-1d5b-4895-8a99-f167050e00a8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:26.731550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-acfc3843-e7fd-49bb-ade1-233631e2c442 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:26.746429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-acfc3843-e7fd-49bb-ade1-233631e2c442 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:26.748345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-acfc3843-e7fd-49bb-ade1-233631e2c442 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:26.773567 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-acfc3843-e7fd-49bb-ade1-233631e2c442 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1476 microversion: 2.25 time: 0.281759 May 28 04:42:26.777207 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1093/2245] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:26 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1476 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:26.812988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a101737c-1d5b-4895-8a99-f167050e00a8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:26.826443 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a101737c-1d5b-4895-8a99-f167050e00a8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1472 microversion: 2.1 time: 0.228576 May 28 04:42:26.836546 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1153/2246] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:26 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1472 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:26.836546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bca7b478-4251-4021-9e98-93b4ffacc5a0 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:26.836546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bca7b478-4251-4021-9e98-93b4ffacc5a0 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:26.841907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bca7b478-4251-4021-9e98-93b4ffacc5a0 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:26.842456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bca7b478-4251-4021-9e98-93b4ffacc5a0 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:26.843638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bca7b478-4251-4021-9e98-93b4ffacc5a0 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:26.844154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bca7b478-4251-4021-9e98-93b4ffacc5a0 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:26.953812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bca7b478-4251-4021-9e98-93b4ffacc5a0 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:26.963331 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bca7b478-4251-4021-9e98-93b4ffacc5a0 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1270 microversion: 2.1 time: 0.133934 May 28 04:42:26.965800 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1154/2247] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:26 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1270 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:26.971139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-809fcc7a-c820-4664-be44-f55d5545cc8c tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:26.975777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-809fcc7a-c820-4664-be44-f55d5545cc8c tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:26.983484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-809fcc7a-c820-4664-be44-f55d5545cc8c tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:26.983484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-809fcc7a-c820-4664-be44-f55d5545cc8c tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:26.983484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-809fcc7a-c820-4664-be44-f55d5545cc8c tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:26.983484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-809fcc7a-c820-4664-be44-f55d5545cc8c tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:27.092739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-809fcc7a-c820-4664-be44-f55d5545cc8c tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:27.105833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-809fcc7a-c820-4664-be44-f55d5545cc8c tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:27.107834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-809fcc7a-c820-4664-be44-f55d5545cc8c tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:27.109244 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-809fcc7a-c820-4664-be44-f55d5545cc8c tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.142210 May 28 04:42:27.110127 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1155/2248] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:26 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:27.115392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-712a2224-0dd0-44b3-99a0-a2d7c2e8dbcf tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Calling method '.version_select at 0x7f77012381f0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:27.180441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-058377c2-adef-4480-99d5-85aa9eb6a07f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:27.181073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-058377c2-adef-4480-99d5-85aa9eb6a07f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:27.196092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-058377c2-adef-4480-99d5-85aa9eb6a07f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:27.200627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-058377c2-adef-4480-99d5-85aa9eb6a07f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:27.201749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-058377c2-adef-4480-99d5-85aa9eb6a07f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:27.202367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-058377c2-adef-4480-99d5-85aa9eb6a07f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:27.341218 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-712a2224-0dd0-44b3-99a0-a2d7c2e8dbcf tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/0117320788a6422cbf69f4eabdca76eb/defaults" status: 200 len: 371 microversion: 2.1 time: 0.229997 May 28 04:42:27.350781 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1156/2249] 10.222.0.58 () {58 vars in 1268 bytes} [Sat May 28 04:42:27 2022] GET /compute/v2.1/os-quota-sets/0117320788a6422cbf69f4eabdca76eb/defaults => generated 371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:27.523740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-058377c2-adef-4480-99d5-85aa9eb6a07f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lazy-loading 'services' on Instance uuid 05c3986b-245a-4454-95c7-63f826af6edc {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:42:27.539141 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-058377c2-adef-4480-99d5-85aa9eb6a07f tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1968 microversion: 2.25 time: 0.746499 May 28 04:42:27.540509 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1094/2250] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:26 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1968 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:27.559275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a717c04f-6636-450d-9c39-d834506d90fe tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:27.560865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a717c04f-6636-450d-9c39-d834506d90fe tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:27.585349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a717c04f-6636-450d-9c39-d834506d90fe tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:27.586069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a717c04f-6636-450d-9c39-d834506d90fe tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:27.587110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a717c04f-6636-450d-9c39-d834506d90fe tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:27.587862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a717c04f-6636-450d-9c39-d834506d90fe tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:27.738199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-69083130-52ec-4386-96c5-f3bd95442f05 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Action: 'update', calling method: .version_select at 0x7f7701dfb940>, body: {"quota_set": {"ram": "5120"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:27.890355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-69083130-52ec-4386-96c5-f3bd95442f05 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:27.891396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-69083130-52ec-4386-96c5-f3bd95442f05 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:27.892624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-69083130-52ec-4386-96c5-f3bd95442f05 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:27.893428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-69083130-52ec-4386-96c5-f3bd95442f05 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:28.027908 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-69083130-52ec-4386-96c5-f3bd95442f05 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/8869b46662a54a2587145c2a8e58a27d" status: 200 len: 328 microversion: 2.1 time: 0.293469 May 28 04:42:28.033325 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1095/2251] 10.222.0.58 () {60 vars in 1261 bytes} [Sat May 28 04:42:27 2022] PUT /compute/v2.1/os-quota-sets/8869b46662a54a2587145c2a8e58a27d => generated 328 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:42:28.035181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fcc0a822-bb43-49a4-815a-4555e11c5c14 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:28.035947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fcc0a822-bb43-49a4-815a-4555e11c5c14 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:28.043337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcc0a822-bb43-49a4-815a-4555e11c5c14 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:28.044138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcc0a822-bb43-49a4-815a-4555e11c5c14 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:28.044924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcc0a822-bb43-49a4-815a-4555e11c5c14 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:28.045369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcc0a822-bb43-49a4-815a-4555e11c5c14 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:28.095645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-a717c04f-6636-450d-9c39-d834506d90fe tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lazy-loading 'services' on Instance uuid 05c3986b-245a-4454-95c7-63f826af6edc {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:42:28.122425 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a717c04f-6636-450d-9c39-d834506d90fe tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1968 microversion: 2.25 time: 0.558247 May 28 04:42:28.122425 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1157/2252] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:27 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1968 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:28.122425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-59d0a58f-c59e-473f-8ac0-3079b60a012b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:28.122425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-59d0a58f-c59e-473f-8ac0-3079b60a012b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:28.147118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-59d0a58f-c59e-473f-8ac0-3079b60a012b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:28.151980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-59d0a58f-c59e-473f-8ac0-3079b60a012b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:28.153926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-59d0a58f-c59e-473f-8ac0-3079b60a012b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:28.155948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-59d0a58f-c59e-473f-8ac0-3079b60a012b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:28.268451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-59d0a58f-c59e-473f-8ac0-3079b60a012b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:28.278225 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-59d0a58f-c59e-473f-8ac0-3079b60a012b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1276 microversion: 2.1 time: 0.163946 May 28 04:42:28.279470 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1158/2253] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:28 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:28.285659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-67113db2-c6cd-42c9-aefd-c8e595041be1 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Calling method '.version_select at 0x7f7701238ee0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:28.359865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67113db2-c6cd-42c9-aefd-c8e595041be1 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:28.360679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67113db2-c6cd-42c9-aefd-c8e595041be1 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:28.361795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67113db2-c6cd-42c9-aefd-c8e595041be1 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:28.366125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67113db2-c6cd-42c9-aefd-c8e595041be1 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:28.392749 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-67113db2-c6cd-42c9-aefd-c8e595041be1 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/8869b46662a54a2587145c2a8e58a27d/detail" status: 200 len: 916 microversion: 2.1 time: 0.108158 May 28 04:42:28.392749 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1159/2254] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 04:42:28 2022] GET /compute/v2.1/os-quota-sets/8869b46662a54a2587145c2a8e58a27d/detail => generated 916 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:28.393041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fcc0a822-bb43-49a4-815a-4555e11c5c14 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:28.399162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-35e499ea-fb08-4000-97db-c7d579894b74 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:28.400004 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-35e499ea-fb08-4000-97db-c7d579894b74 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:28.404428 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fcc0a822-bb43-49a4-815a-4555e11c5c14 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1472 microversion: 2.1 time: 0.373636 May 28 04:42:28.405654 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1096/2255] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:28 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1472 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:28.411693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35e499ea-fb08-4000-97db-c7d579894b74 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:28.414752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35e499ea-fb08-4000-97db-c7d579894b74 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:28.415648 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7c3ed0e4-192f-48d5-91bb-3563e7128c10 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:28.416236 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35e499ea-fb08-4000-97db-c7d579894b74 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:28.416851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35e499ea-fb08-4000-97db-c7d579894b74 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:28.420022 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:42:28.420022 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:42:28.421565 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c3ed0e4-192f-48d5-91bb-3563e7128c10 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:28.422030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c3ed0e4-192f-48d5-91bb-3563e7128c10 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:28.422855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c3ed0e4-192f-48d5-91bb-3563e7128c10 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:28.423316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c3ed0e4-192f-48d5-91bb-3563e7128c10 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:28.478232 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7c3ed0e4-192f-48d5-91bb-3563e7128c10 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.071396 May 28 04:42:28.479439 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1097/2256] 10.222.0.58 () {60 vars in 1216 bytes} [Sat May 28 04:42:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:42:28.507990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6883ad67-9257-425b-a0e1-f446cb07ac2a tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843700-1", "block_migration": "auto"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:28.512047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6883ad67-9257-425b-a0e1-f446cb07ac2a tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:28.521019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-35e499ea-fb08-4000-97db-c7d579894b74 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:28.535096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-35e499ea-fb08-4000-97db-c7d579894b74 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:28.538380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6883ad67-9257-425b-a0e1-f446cb07ac2a tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:28.538803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-35e499ea-fb08-4000-97db-c7d579894b74 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:28.539936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6883ad67-9257-425b-a0e1-f446cb07ac2a tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:28.541022 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-35e499ea-fb08-4000-97db-c7d579894b74 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.150074 May 28 04:42:28.542015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6883ad67-9257-425b-a0e1-f446cb07ac2a tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:28.543367 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1160/2257] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:28 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:28.543970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6883ad67-9257-425b-a0e1-f446cb07ac2a tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:28.572774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-6883ad67-9257-425b-a0e1-f446cb07ac2a tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lazy-loading 'flavor' on Instance uuid 05c3986b-245a-4454-95c7-63f826af6edc {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:42:28.587050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6883ad67-9257-425b-a0e1-f446cb07ac2a tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Going to try to live migrate instance to n-h1-843700-1 {{(pid=126043) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 28 04:42:28.864515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-640ca631-e1e4-49d6-b970-a3b93d4b49a4 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Action: 'update', calling method: .version_select at 0x7f770119c8b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:28.941714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-640ca631-e1e4-49d6-b970-a3b93d4b49a4 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:28.942167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-640ca631-e1e4-49d6-b970-a3b93d4b49a4 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:28.943019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-640ca631-e1e4-49d6-b970-a3b93d4b49a4 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:28.944045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-640ca631-e1e4-49d6-b970-a3b93d4b49a4 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:28.988230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-640ca631-e1e4-49d6-b970-a3b93d4b49a4 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:28.989103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-640ca631-e1e4-49d6-b970-a3b93d4b49a4 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:28.990032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-640ca631-e1e4-49d6-b970-a3b93d4b49a4 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:28.991196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-640ca631-e1e4-49d6-b970-a3b93d4b49a4 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:29.176849 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-640ca631-e1e4-49d6-b970-a3b93d4b49a4 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/8869b46662a54a2587145c2a8e58a27d?user_id=b07a64a4e73e416e8e03e25e95f45d37" status: 200 len: 328 microversion: 2.1 time: 0.316319 May 28 04:42:29.178080 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1161/2258] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 04:42:28 2022] PUT /compute/v2.1/os-quota-sets/8869b46662a54a2587145c2a8e58a27d?user_id=b07a64a4e73e416e8e03e25e95f45d37 => generated 328 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:42:29.190722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7bbd1c5d-b330-4dfc-b7ae-6d1c50e3ce8f tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Calling method '.version_select at 0x7f770137f4c0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:29.300908 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7bbd1c5d-b330-4dfc-b7ae-6d1c50e3ce8f tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/8869b46662a54a2587145c2a8e58a27d?user_id=b07a64a4e73e416e8e03e25e95f45d37" status: 200 len: 370 microversion: 2.1 time: 0.114568 May 28 04:42:29.302153 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1162/2259] 10.222.0.58 () {58 vars in 1322 bytes} [Sat May 28 04:42:29 2022] GET /compute/v2.1/os-quota-sets/8869b46662a54a2587145c2a8e58a27d?user_id=b07a64a4e73e416e8e03e25e95f45d37 => generated 370 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:29.317767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-20e1d0e7-3cda-4b02-9eec-21d8b1f9bf1e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:29.320547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-20e1d0e7-3cda-4b02-9eec-21d8b1f9bf1e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:29.336165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-20e1d0e7-3cda-4b02-9eec-21d8b1f9bf1e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:29.336715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-20e1d0e7-3cda-4b02-9eec-21d8b1f9bf1e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:29.338666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-20e1d0e7-3cda-4b02-9eec-21d8b1f9bf1e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:29.340371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-20e1d0e7-3cda-4b02-9eec-21d8b1f9bf1e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:29.559274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-20e1d0e7-3cda-4b02-9eec-21d8b1f9bf1e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:29.568439 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-20e1d0e7-3cda-4b02-9eec-21d8b1f9bf1e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1318 microversion: 2.1 time: 0.263408 May 28 04:42:29.569037 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1163/2260] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:29 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:29.575506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-64236067-53aa-4250-b199-613073c8760d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:29.576331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-64236067-53aa-4250-b199-613073c8760d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:29.582855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64236067-53aa-4250-b199-613073c8760d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:29.583335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64236067-53aa-4250-b199-613073c8760d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:29.584716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64236067-53aa-4250-b199-613073c8760d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:29.585149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64236067-53aa-4250-b199-613073c8760d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:29.748012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-64236067-53aa-4250-b199-613073c8760d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:29.758125 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-64236067-53aa-4250-b199-613073c8760d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1472 microversion: 2.1 time: 0.186676 May 28 04:42:29.758968 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1164/2261] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:29 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1472 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:29.763516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6cc70223-ec8e-40c8-956c-0da13ad416d4 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:29.764309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6cc70223-ec8e-40c8-956c-0da13ad416d4 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:29.774395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6cc70223-ec8e-40c8-956c-0da13ad416d4 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:29.774883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6cc70223-ec8e-40c8-956c-0da13ad416d4 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:29.775748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6cc70223-ec8e-40c8-956c-0da13ad416d4 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:29.776192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6cc70223-ec8e-40c8-956c-0da13ad416d4 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:29.880156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6cc70223-ec8e-40c8-956c-0da13ad416d4 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:29.907931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6cc70223-ec8e-40c8-956c-0da13ad416d4 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:29.911547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6cc70223-ec8e-40c8-956c-0da13ad416d4 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:29.916216 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6cc70223-ec8e-40c8-956c-0da13ad416d4 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.155318 May 28 04:42:29.918423 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1165/2262] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:29 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:30.121545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef009a1f-a952-43c5-9e7b-205694988cf4 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Calling method '.version_select at 0x7f770129dc10>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:30.325743 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ef009a1f-a952-43c5-9e7b-205694988cf4 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/0117320788a6422cbf69f4eabdca76eb/defaults" status: 200 len: 371 microversion: 2.1 time: 0.208105 May 28 04:42:30.326615 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1166/2263] 10.222.0.58 () {58 vars in 1268 bytes} [Sat May 28 04:42:30 2022] GET /compute/v2.1/os-quota-sets/0117320788a6422cbf69f4eabdca76eb/defaults => generated 371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:42:30.331586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-822e11e2-8aef-4df9-9872-252a60cb4917 req-1d4bdfa1-404b-4a2a-8c2b-2a60ee52647c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c8654f0-6755-46c3-8801-c2d3b4d37b48", "tag": "75fd5f82-f67a-4a99-99fd-45d2df08382c"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:30.340829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-822e11e2-8aef-4df9-9872-252a60cb4917 req-1d4bdfa1-404b-4a2a-8c2b-2a60ee52647c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:30.341282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-822e11e2-8aef-4df9-9872-252a60cb4917 req-1d4bdfa1-404b-4a2a-8c2b-2a60ee52647c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:30.362627 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-822e11e2-8aef-4df9-9872-252a60cb4917 req-1d4bdfa1-404b-4a2a-8c2b-2a60ee52647c service nova] Creating event network-changed:75fd5f82-f67a-4a99-99fd-45d2df08382c for instance 3c8654f0-6755-46c3-8801-c2d3b4d37b48 on n-h1-843700-1 May 28 04:42:30.362627 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-822e11e2-8aef-4df9-9872-252a60cb4917 req-1d4bdfa1-404b-4a2a-8c2b-2a60ee52647c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033719 May 28 04:42:30.363120 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1167/2264] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:30.367895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c72456da-8703-4e66-980c-c9502b38912d tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Action: 'update', calling method: .version_select at 0x7f770129df70>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:30.434549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c72456da-8703-4e66-980c-c9502b38912d tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:30.435024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c72456da-8703-4e66-980c-c9502b38912d tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:30.435831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c72456da-8703-4e66-980c-c9502b38912d tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:30.436267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c72456da-8703-4e66-980c-c9502b38912d tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:30.459946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:32.089835 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c72456da-8703-4e66-980c-c9502b38912d tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/0117320788a6422cbf69f4eabdca76eb" status: 200 len: 329 microversion: 2.1 time: 1.725785 May 28 04:42:32.096631 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1168/2265] 10.222.0.58 () {60 vars in 1262 bytes} [Sat May 28 04:42:30 2022] PUT /compute/v2.1/os-quota-sets/0117320788a6422cbf69f4eabdca76eb => generated 329 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:32.102941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-34ad59cb-830a-4888-83a6-864a28690a78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:32.104014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-34ad59cb-830a-4888-83a6-864a28690a78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:32.118590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-34ad59cb-830a-4888-83a6-864a28690a78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:32.119095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-34ad59cb-830a-4888-83a6-864a28690a78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:32.120087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-34ad59cb-830a-4888-83a6-864a28690a78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:32.120862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-34ad59cb-830a-4888-83a6-864a28690a78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:32.397418 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-34ad59cb-830a-4888-83a6-864a28690a78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:32.407129 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-34ad59cb-830a-4888-83a6-864a28690a78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1318 microversion: 2.1 time: 0.309364 May 28 04:42:32.408061 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1169/2266] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:32 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:32.414627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-901b7614-14d5-491e-93ad-8b6f245c7178 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:32.415731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-901b7614-14d5-491e-93ad-8b6f245c7178 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:32.422333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-901b7614-14d5-491e-93ad-8b6f245c7178 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:32.423641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-901b7614-14d5-491e-93ad-8b6f245c7178 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:32.424678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-901b7614-14d5-491e-93ad-8b6f245c7178 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:32.425348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-901b7614-14d5-491e-93ad-8b6f245c7178 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:32.652294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-901b7614-14d5-491e-93ad-8b6f245c7178 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:32.660309 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-901b7614-14d5-491e-93ad-8b6f245c7178 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1472 microversion: 2.1 time: 0.250616 May 28 04:42:32.660890 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1170/2267] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:32 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1472 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:32.665884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fd1ac128-f2f9-4ddd-af2a-27a3a0d41be1 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:32.666614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fd1ac128-f2f9-4ddd-af2a-27a3a0d41be1 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:32.672620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd1ac128-f2f9-4ddd-af2a-27a3a0d41be1 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:32.673064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd1ac128-f2f9-4ddd-af2a-27a3a0d41be1 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:32.673819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd1ac128-f2f9-4ddd-af2a-27a3a0d41be1 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:32.674250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd1ac128-f2f9-4ddd-af2a-27a3a0d41be1 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:32.738664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fd1ac128-f2f9-4ddd-af2a-27a3a0d41be1 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:32.747098 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fd1ac128-f2f9-4ddd-af2a-27a3a0d41be1 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:32.748594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fd1ac128-f2f9-4ddd-af2a-27a3a0d41be1 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:32.749748 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fd1ac128-f2f9-4ddd-af2a-27a3a0d41be1 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.087950 May 28 04:42:32.750313 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1171/2268] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:32 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:32.754555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a87c90b4-29e6-448c-a36b-208ff845eef6 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Action: 'update', calling method: .version_select at 0x7f77013c9e50>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:32.822777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a87c90b4-29e6-448c-a36b-208ff845eef6 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:32.828594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a87c90b4-29e6-448c-a36b-208ff845eef6 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:32.828594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a87c90b4-29e6-448c-a36b-208ff845eef6 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:32.828594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a87c90b4-29e6-448c-a36b-208ff845eef6 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:32.893415 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6883ad67-9257-425b-a0e1-f446cb07ac2a tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc/action" status: 202 len: 0 microversion: 2.25 time: 4.398493 May 28 04:42:32.894045 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1098/2269] 10.222.0.58 () {62 vars in 1318 bytes} [Sat May 28 04:42:28 2022] POST /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc/action => generated 0 bytes in 4400 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 04:42:32.901825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2a329e3d-8327-4ceb-9211-bb6d5b963ebf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:32.902458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2a329e3d-8327-4ceb-9211-bb6d5b963ebf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:32.909387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a329e3d-8327-4ceb-9211-bb6d5b963ebf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:32.909843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a329e3d-8327-4ceb-9211-bb6d5b963ebf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:32.910663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a329e3d-8327-4ceb-9211-bb6d5b963ebf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:32.911145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a329e3d-8327-4ceb-9211-bb6d5b963ebf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:33.049282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2a329e3d-8327-4ceb-9211-bb6d5b963ebf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:33.058126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2a329e3d-8327-4ceb-9211-bb6d5b963ebf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:33.059816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2a329e3d-8327-4ceb-9211-bb6d5b963ebf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:33.060985 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2a329e3d-8327-4ceb-9211-bb6d5b963ebf tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.162820 May 28 04:42:33.061564 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1099/2270] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:32 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:33.426175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-df4f6cfc-37a1-43cb-8eb4-d59ea7ccfa4d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:33.426922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-df4f6cfc-37a1-43cb-8eb4-d59ea7ccfa4d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:33.435139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df4f6cfc-37a1-43cb-8eb4-d59ea7ccfa4d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:33.435721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df4f6cfc-37a1-43cb-8eb4-d59ea7ccfa4d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:33.436540 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df4f6cfc-37a1-43cb-8eb4-d59ea7ccfa4d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:33.437017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df4f6cfc-37a1-43cb-8eb4-d59ea7ccfa4d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:33.668426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-df4f6cfc-37a1-43cb-8eb4-d59ea7ccfa4d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:33.676758 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-df4f6cfc-37a1-43cb-8eb4-d59ea7ccfa4d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1318 microversion: 2.1 time: 0.254725 May 28 04:42:33.677382 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1100/2271] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:33 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:33.686390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b843e636-e5f5-47a1-9703-90be8ab15fd9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:33.686390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b843e636-e5f5-47a1-9703-90be8ab15fd9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:33.689281 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b843e636-e5f5-47a1-9703-90be8ab15fd9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:33.689739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b843e636-e5f5-47a1-9703-90be8ab15fd9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:33.690519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b843e636-e5f5-47a1-9703-90be8ab15fd9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:33.690966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b843e636-e5f5-47a1-9703-90be8ab15fd9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:33.893081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b843e636-e5f5-47a1-9703-90be8ab15fd9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:33.901814 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b843e636-e5f5-47a1-9703-90be8ab15fd9 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1472 microversion: 2.1 time: 0.223364 May 28 04:42:33.911634 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1101/2272] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:33 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1472 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:33.911634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e2133408-a970-4e4b-8372-177ccd422993 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:33.911634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e2133408-a970-4e4b-8372-177ccd422993 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:33.914799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2133408-a970-4e4b-8372-177ccd422993 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:33.915287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2133408-a970-4e4b-8372-177ccd422993 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:33.916066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2133408-a970-4e4b-8372-177ccd422993 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:33.916511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2133408-a970-4e4b-8372-177ccd422993 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:33.992987 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e2133408-a970-4e4b-8372-177ccd422993 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:34.001210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e2133408-a970-4e4b-8372-177ccd422993 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:34.002740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e2133408-a970-4e4b-8372-177ccd422993 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:34.003934 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e2133408-a970-4e4b-8372-177ccd422993 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.100333 May 28 04:42:34.004500 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1102/2273] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:33 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:34.079990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2671c696-0d53-4526-a16b-25956d269a98 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:34.080806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2671c696-0d53-4526-a16b-25956d269a98 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:34.087803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2671c696-0d53-4526-a16b-25956d269a98 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:34.088256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2671c696-0d53-4526-a16b-25956d269a98 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:34.089022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2671c696-0d53-4526-a16b-25956d269a98 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:34.089459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2671c696-0d53-4526-a16b-25956d269a98 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:34.226648 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2671c696-0d53-4526-a16b-25956d269a98 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:34.235052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2671c696-0d53-4526-a16b-25956d269a98 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:34.236879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2671c696-0d53-4526-a16b-25956d269a98 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:34.238053 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2671c696-0d53-4526-a16b-25956d269a98 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.162735 May 28 04:42:34.238768 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1103/2274] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:34 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:34.693863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5493aeae-8f8a-4a9c-80f2-016ad2bdea1e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:34.694956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5493aeae-8f8a-4a9c-80f2-016ad2bdea1e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:34.701105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5493aeae-8f8a-4a9c-80f2-016ad2bdea1e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:34.701561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5493aeae-8f8a-4a9c-80f2-016ad2bdea1e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:34.702339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5493aeae-8f8a-4a9c-80f2-016ad2bdea1e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:34.702781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5493aeae-8f8a-4a9c-80f2-016ad2bdea1e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:34.844324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5493aeae-8f8a-4a9c-80f2-016ad2bdea1e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:34.852175 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5493aeae-8f8a-4a9c-80f2-016ad2bdea1e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1318 microversion: 2.1 time: 0.162280 May 28 04:42:34.852761 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1104/2275] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:34 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:34.919680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-170e5284-feef-4f60-bada-718f5b08b0af tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:34.920389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-170e5284-feef-4f60-bada-718f5b08b0af tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:34.926415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-170e5284-feef-4f60-bada-718f5b08b0af tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:34.926907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-170e5284-feef-4f60-bada-718f5b08b0af tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:34.927879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-170e5284-feef-4f60-bada-718f5b08b0af tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:34.928865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-170e5284-feef-4f60-bada-718f5b08b0af tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:35.037541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=27,nova_api:UPDATE=13 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:35.099162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-170e5284-feef-4f60-bada-718f5b08b0af tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:35.107709 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-170e5284-feef-4f60-bada-718f5b08b0af tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1472 microversion: 2.1 time: 0.192281 May 28 04:42:35.108296 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1105/2276] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:34 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1472 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:35.113712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2de2dbfc-7ae7-42c0-8615-e3560a4b3489 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:35.117860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2de2dbfc-7ae7-42c0-8615-e3560a4b3489 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:35.124351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2de2dbfc-7ae7-42c0-8615-e3560a4b3489 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:35.125009 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2de2dbfc-7ae7-42c0-8615-e3560a4b3489 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:35.126106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2de2dbfc-7ae7-42c0-8615-e3560a4b3489 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:35.126722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2de2dbfc-7ae7-42c0-8615-e3560a4b3489 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:35.196683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:35.199976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2de2dbfc-7ae7-42c0-8615-e3560a4b3489 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:35.205552 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a87c90b4-29e6-448c-a36b-208ff845eef6 tempest-QuotasAdminTestJSON-2097447506 tempest-QuotasAdminTestJSON-2097447506-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/0117320788a6422cbf69f4eabdca76eb" status: 200 len: 329 microversion: 2.1 time: 2.454213 May 28 04:42:35.206336 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1172/2277] 10.222.0.58 () {60 vars in 1262 bytes} [Sat May 28 04:42:32 2022] PUT /compute/v2.1/os-quota-sets/0117320788a6422cbf69f4eabdca76eb => generated 329 bytes in 2455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:35.210629 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2de2dbfc-7ae7-42c0-8615-e3560a4b3489 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:35.214012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2de2dbfc-7ae7-42c0-8615-e3560a4b3489 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:35.214012 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2de2dbfc-7ae7-42c0-8615-e3560a4b3489 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.104291 May 28 04:42:35.215890 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1106/2278] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:35 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:35.258002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-77406c88-3776-4afe-aa4f-538696d50702 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:35.258731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-77406c88-3776-4afe-aa4f-538696d50702 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:35.267188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77406c88-3776-4afe-aa4f-538696d50702 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:35.267642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77406c88-3776-4afe-aa4f-538696d50702 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:35.268441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77406c88-3776-4afe-aa4f-538696d50702 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:35.269096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77406c88-3776-4afe-aa4f-538696d50702 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:35.426496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-77406c88-3776-4afe-aa4f-538696d50702 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:35.440137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-77406c88-3776-4afe-aa4f-538696d50702 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:35.440137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-77406c88-3776-4afe-aa4f-538696d50702 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:35.440137 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-77406c88-3776-4afe-aa4f-538696d50702 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.186045 May 28 04:42:35.440569 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1173/2279] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:35 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:35.565114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9f53f82c-3672-4e9c-be03-63765126e028 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:35.566664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9f53f82c-3672-4e9c-be03-63765126e028 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:35.574751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f53f82c-3672-4e9c-be03-63765126e028 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:35.576007 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f53f82c-3672-4e9c-be03-63765126e028 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:35.577973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f53f82c-3672-4e9c-be03-63765126e028 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:35.577973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f53f82c-3672-4e9c-be03-63765126e028 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:35.596735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:35.617312 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9f53f82c-3672-4e9c-be03-63765126e028 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057318 May 28 04:42:35.618568 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1107/2280] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:42:35 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:35.639692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4c596c07-e5ef-48e6-a18c-ea6ca9623fe4 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:35.640240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4c596c07-e5ef-48e6-a18c-ea6ca9623fe4 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:35.646735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c596c07-e5ef-48e6-a18c-ea6ca9623fe4 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:35.647265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c596c07-e5ef-48e6-a18c-ea6ca9623fe4 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:35.648098 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c596c07-e5ef-48e6-a18c-ea6ca9623fe4 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:35.648535 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c596c07-e5ef-48e6-a18c-ea6ca9623fe4 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:35.729312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:35.734729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-4c596c07-e5ef-48e6-a18c-ea6ca9623fe4 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lazy-loading 'services' on Instance uuid 7f4e280f-6de0-467b-b4ac-c13f9e780963 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:42:35.870400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-71d71a5e-93e8-467d-a3e4-825b27465096 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:35.871177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-71d71a5e-93e8-467d-a3e4-825b27465096 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:35.879769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71d71a5e-93e8-467d-a3e4-825b27465096 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:35.880267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71d71a5e-93e8-467d-a3e4-825b27465096 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:35.881415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71d71a5e-93e8-467d-a3e4-825b27465096 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:35.882023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71d71a5e-93e8-467d-a3e4-825b27465096 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:36.033153 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4c596c07-e5ef-48e6-a18c-ea6ca9623fe4 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963/os-volume_attachments/7bd373fb-ce12-4993-b310-db6e4c817c33" status: 202 len: 0 microversion: 2.1 time: 0.408105 May 28 04:42:36.034068 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1174/2281] 10.222.0.58 () {58 vars in 1415 bytes} [Sat May 28 04:42:35 2022] DELETE /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963/os-volume_attachments/7bd373fb-ce12-4993-b310-db6e4c817c33 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:42:36.094845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-71d71a5e-93e8-467d-a3e4-825b27465096 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:36.102499 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-71d71a5e-93e8-467d-a3e4-825b27465096 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1318 microversion: 2.1 time: 0.237097 May 28 04:42:36.109704 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1108/2282] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:35 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:36.125518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c621469f-2970-4a40-9f84-e537fa9a852e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:36.127036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c621469f-2970-4a40-9f84-e537fa9a852e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:36.135194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c621469f-2970-4a40-9f84-e537fa9a852e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:36.135732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c621469f-2970-4a40-9f84-e537fa9a852e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:36.136629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c621469f-2970-4a40-9f84-e537fa9a852e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:36.137215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c621469f-2970-4a40-9f84-e537fa9a852e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:36.234054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-13a0e262-59bb-4ab4-a3be-8c17a976da54 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:36.234678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-13a0e262-59bb-4ab4-a3be-8c17a976da54 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:36.243833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13a0e262-59bb-4ab4-a3be-8c17a976da54 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:36.244480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13a0e262-59bb-4ab4-a3be-8c17a976da54 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:36.245401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13a0e262-59bb-4ab4-a3be-8c17a976da54 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:36.247141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13a0e262-59bb-4ab4-a3be-8c17a976da54 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:36.363997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-13a0e262-59bb-4ab4-a3be-8c17a976da54 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:36.378212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-13a0e262-59bb-4ab4-a3be-8c17a976da54 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:36.380406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-13a0e262-59bb-4ab4-a3be-8c17a976da54 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:36.381984 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-13a0e262-59bb-4ab4-a3be-8c17a976da54 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.152223 May 28 04:42:36.396270 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1109/2283] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:36 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:36.397743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c621469f-2970-4a40-9f84-e537fa9a852e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:36.406966 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c621469f-2970-4a40-9f84-e537fa9a852e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1472 microversion: 2.1 time: 0.285710 May 28 04:42:36.407574 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1175/2284] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:36 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1472 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:36.460928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-360055c6-70c6-441b-9145-9ddb57c86665 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:36.461830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-360055c6-70c6-441b-9145-9ddb57c86665 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:36.468187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-360055c6-70c6-441b-9145-9ddb57c86665 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:36.468861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-360055c6-70c6-441b-9145-9ddb57c86665 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:36.469819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-360055c6-70c6-441b-9145-9ddb57c86665 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:36.471295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-360055c6-70c6-441b-9145-9ddb57c86665 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:36.557457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-8d896f40-36de-4561-8c03-3a4e11715a03 req-ce20470b-ece6-43f1-b808-3fac94fae380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8654f0-6755-46c3-8801-c2d3b4d37b48", "name": "network-vif-plugged", "status": "completed", "tag": "75fd5f82-f67a-4a99-99fd-45d2df08382c"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:36.574635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8d896f40-36de-4561-8c03-3a4e11715a03 req-ce20470b-ece6-43f1-b808-3fac94fae380 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:36.575262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8d896f40-36de-4561-8c03-3a4e11715a03 req-ce20470b-ece6-43f1-b808-3fac94fae380 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:36.597717 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-8d896f40-36de-4561-8c03-3a4e11715a03 req-ce20470b-ece6-43f1-b808-3fac94fae380 service nova] Creating event network-vif-plugged:75fd5f82-f67a-4a99-99fd-45d2df08382c for instance 3c8654f0-6755-46c3-8801-c2d3b4d37b48 on n-h1-843700-1 May 28 04:42:36.603907 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-8d896f40-36de-4561-8c03-3a4e11715a03 req-ce20470b-ece6-43f1-b808-3fac94fae380 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049160 May 28 04:42:36.608264 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1176/2285] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:36.641961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-360055c6-70c6-441b-9145-9ddb57c86665 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:36.654524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-360055c6-70c6-441b-9145-9ddb57c86665 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:36.656556 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-360055c6-70c6-441b-9145-9ddb57c86665 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:36.657781 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-360055c6-70c6-441b-9145-9ddb57c86665 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.201604 May 28 04:42:36.669213 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1110/2286] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:36 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:37.126384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0840ab3b-e2e7-4751-8cff-7ac019b00891 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:37.127113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0840ab3b-e2e7-4751-8cff-7ac019b00891 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:37.134556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0840ab3b-e2e7-4751-8cff-7ac019b00891 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:37.135440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0840ab3b-e2e7-4751-8cff-7ac019b00891 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:37.137270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0840ab3b-e2e7-4751-8cff-7ac019b00891 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:37.137270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0840ab3b-e2e7-4751-8cff-7ac019b00891 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:37.279585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0840ab3b-e2e7-4751-8cff-7ac019b00891 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:37.288929 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0840ab3b-e2e7-4751-8cff-7ac019b00891 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1318 microversion: 2.1 time: 0.167549 May 28 04:42:37.289532 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1177/2287] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:37 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:37.402392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b41da0ed-5a20-41b8-8893-7d18afdd8cb2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:37.403050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b41da0ed-5a20-41b8-8893-7d18afdd8cb2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:37.411218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b41da0ed-5a20-41b8-8893-7d18afdd8cb2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:37.411723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b41da0ed-5a20-41b8-8893-7d18afdd8cb2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:37.412585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b41da0ed-5a20-41b8-8893-7d18afdd8cb2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:37.413564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b41da0ed-5a20-41b8-8893-7d18afdd8cb2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:37.429952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b798780b-d87b-4989-82d7-7f7117e736df tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:37.431915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b798780b-d87b-4989-82d7-7f7117e736df tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:37.439194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b798780b-d87b-4989-82d7-7f7117e736df tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:37.440010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b798780b-d87b-4989-82d7-7f7117e736df tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:37.440991 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b798780b-d87b-4989-82d7-7f7117e736df tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:37.441601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b798780b-d87b-4989-82d7-7f7117e736df tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:37.486579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b41da0ed-5a20-41b8-8893-7d18afdd8cb2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:37.498866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b41da0ed-5a20-41b8-8893-7d18afdd8cb2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:37.501364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b41da0ed-5a20-41b8-8893-7d18afdd8cb2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:37.503342 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b41da0ed-5a20-41b8-8893-7d18afdd8cb2 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.105384 May 28 04:42:37.515779 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1111/2288] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:37 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:37.605441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b798780b-d87b-4989-82d7-7f7117e736df tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:37.613534 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b798780b-d87b-4989-82d7-7f7117e736df tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1472 microversion: 2.1 time: 0.187648 May 28 04:42:37.614190 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1178/2289] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:37 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1472 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:37.677411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9fa5dbaf-c6b4-4683-abbd-45f2471a7953 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:37.678071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9fa5dbaf-c6b4-4683-abbd-45f2471a7953 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:37.684687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fa5dbaf-c6b4-4683-abbd-45f2471a7953 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:37.685180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fa5dbaf-c6b4-4683-abbd-45f2471a7953 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:37.685953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fa5dbaf-c6b4-4683-abbd-45f2471a7953 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:37.686431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fa5dbaf-c6b4-4683-abbd-45f2471a7953 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:37.833188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9fa5dbaf-c6b4-4683-abbd-45f2471a7953 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:37.843378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9fa5dbaf-c6b4-4683-abbd-45f2471a7953 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:37.843900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9fa5dbaf-c6b4-4683-abbd-45f2471a7953 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:37.845144 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9fa5dbaf-c6b4-4683-abbd-45f2471a7953 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.172332 May 28 04:42:37.845973 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1112/2290] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:37 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:38.306565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-760541fa-edba-4ded-a260-040622c5eb95 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:38.307207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-760541fa-edba-4ded-a260-040622c5eb95 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:38.314100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-760541fa-edba-4ded-a260-040622c5eb95 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:38.314551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-760541fa-edba-4ded-a260-040622c5eb95 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:38.315367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-760541fa-edba-4ded-a260-040622c5eb95 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:38.315805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-760541fa-edba-4ded-a260-040622c5eb95 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:38.455369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-760541fa-edba-4ded-a260-040622c5eb95 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:38.463466 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-760541fa-edba-4ded-a260-040622c5eb95 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1508 microversion: 2.1 time: 0.161527 May 28 04:42:38.464135 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1179/2291] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:38 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:38.491661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3b2ed56d-36d3-489b-8623-cc62bafe7653 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:38.492258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3b2ed56d-36d3-489b-8623-cc62bafe7653 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:38.494193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=16 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:38.495713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:38.501496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b2ed56d-36d3-489b-8623-cc62bafe7653 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:38.502070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b2ed56d-36d3-489b-8623-cc62bafe7653 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:38.502981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b2ed56d-36d3-489b-8623-cc62bafe7653 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:38.503468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b2ed56d-36d3-489b-8623-cc62bafe7653 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:38.533558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a274776d-dd08-4a9b-a41d-9d78be3871fc tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:38.534707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a274776d-dd08-4a9b-a41d-9d78be3871fc tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:38.542351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a274776d-dd08-4a9b-a41d-9d78be3871fc tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:38.543189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a274776d-dd08-4a9b-a41d-9d78be3871fc tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:38.546357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a274776d-dd08-4a9b-a41d-9d78be3871fc tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:38.546357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a274776d-dd08-4a9b-a41d-9d78be3871fc tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:38.625892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a274776d-dd08-4a9b-a41d-9d78be3871fc tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:38.647859 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a274776d-dd08-4a9b-a41d-9d78be3871fc tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:38.649949 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a274776d-dd08-4a9b-a41d-9d78be3871fc tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:38.651932 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a274776d-dd08-4a9b-a41d-9d78be3871fc tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.133604 May 28 04:42:38.653262 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1180/2292] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:38 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:38.658773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-494be802-d2ab-4bf6-8aad-99047932407b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:38.659652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-494be802-d2ab-4bf6-8aad-99047932407b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:38.668723 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-494be802-d2ab-4bf6-8aad-99047932407b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:38.669526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-494be802-d2ab-4bf6-8aad-99047932407b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:38.670631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-494be802-d2ab-4bf6-8aad-99047932407b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:38.671751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-494be802-d2ab-4bf6-8aad-99047932407b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:38.696948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3b2ed56d-36d3-489b-8623-cc62bafe7653 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:38.701063 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3b2ed56d-36d3-489b-8623-cc62bafe7653 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1508 microversion: 2.1 time: 0.213718 May 28 04:42:38.702249 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1113/2293] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:38 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1508 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:38.718003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b68f274d-7895-4a28-af53-42aca2774edf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:38.719411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b68f274d-7895-4a28-af53-42aca2774edf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:38.726563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b68f274d-7895-4a28-af53-42aca2774edf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:38.727282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b68f274d-7895-4a28-af53-42aca2774edf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:38.728604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b68f274d-7895-4a28-af53-42aca2774edf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:38.733099 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b68f274d-7895-4a28-af53-42aca2774edf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:38.868290 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b68f274d-7895-4a28-af53-42aca2774edf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "PUT /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1080 microversion: 2.1 time: 0.153866 May 28 04:42:38.869159 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1114/2294] 10.222.0.58 () {60 vars in 1255 bytes} [Sat May 28 04:42:38 2022] PUT /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1080 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:38.875054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-332bb77e-d0a3-4f4b-b405-ee14d5af406c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:38.876239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-332bb77e-d0a3-4f4b-b405-ee14d5af406c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:38.884081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-332bb77e-d0a3-4f4b-b405-ee14d5af406c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:38.886515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-332bb77e-d0a3-4f4b-b405-ee14d5af406c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:38.886515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-332bb77e-d0a3-4f4b-b405-ee14d5af406c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:38.886515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-332bb77e-d0a3-4f4b-b405-ee14d5af406c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:39.174835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-332bb77e-d0a3-4f4b-b405-ee14d5af406c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:39.179004 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-494be802-d2ab-4bf6-8aad-99047932407b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:39.189501 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-494be802-d2ab-4bf6-8aad-99047932407b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1472 microversion: 2.1 time: 0.534898 May 28 04:42:39.191130 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1181/2295] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:38 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1472 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:39.205502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-332bb77e-d0a3-4f4b-b405-ee14d5af406c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:39.205502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-332bb77e-d0a3-4f4b-b405-ee14d5af406c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:39.206390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-32f36297-e557-42bd-a715-c26bbab8905f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:39.206390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-32f36297-e557-42bd-a715-c26bbab8905f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:39.207871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-32f36297-e557-42bd-a715-c26bbab8905f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:39.212060 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-332bb77e-d0a3-4f4b-b405-ee14d5af406c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.341091 May 28 04:42:39.212282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-32f36297-e557-42bd-a715-c26bbab8905f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:39.213049 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1115/2296] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:38 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:39.219218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-32f36297-e557-42bd-a715-c26bbab8905f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:39.219218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-32f36297-e557-42bd-a715-c26bbab8905f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:39.360067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-32f36297-e557-42bd-a715-c26bbab8905f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:39.369961 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-32f36297-e557-42bd-a715-c26bbab8905f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1506 microversion: 2.1 time: 0.177581 May 28 04:42:39.370594 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1182/2297] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:39 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:39.387875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-14c59f06-774d-42e4-8b30-a5248073d57c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:39.388606 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-14c59f06-774d-42e4-8b30-a5248073d57c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:39.395660 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-14c59f06-774d-42e4-8b30-a5248073d57c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:39.396119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-14c59f06-774d-42e4-8b30-a5248073d57c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:39.397173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-14c59f06-774d-42e4-8b30-a5248073d57c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:39.397661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-14c59f06-774d-42e4-8b30-a5248073d57c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:39.549429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-14c59f06-774d-42e4-8b30-a5248073d57c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:39.559942 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-14c59f06-774d-42e4-8b30-a5248073d57c tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1506 microversion: 2.1 time: 0.175787 May 28 04:42:39.560986 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1116/2298] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:39 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:39.577734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-de579b1d-e60b-497d-9360-d2230b13f35d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:39.579636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-de579b1d-e60b-497d-9360-d2230b13f35d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:39.586207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de579b1d-e60b-497d-9360-d2230b13f35d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:39.586761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de579b1d-e60b-497d-9360-d2230b13f35d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:39.587908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de579b1d-e60b-497d-9360-d2230b13f35d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:39.588421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de579b1d-e60b-497d-9360-d2230b13f35d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:39.672802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-944c9822-f9ee-4e3c-857f-0f7a7a355053 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:39.673670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-944c9822-f9ee-4e3c-857f-0f7a7a355053 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:39.676972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:39.681737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-de579b1d-e60b-497d-9360-d2230b13f35d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:42:39.682135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-944c9822-f9ee-4e3c-857f-0f7a7a355053 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:39.682309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-de579b1d-e60b-497d-9360-d2230b13f35d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:42:39.682591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-944c9822-f9ee-4e3c-857f-0f7a7a355053 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:39.683569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-de579b1d-e60b-497d-9360-d2230b13f35d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:42:39.683957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-944c9822-f9ee-4e3c-857f-0f7a7a355053 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:39.686978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-944c9822-f9ee-4e3c-857f-0f7a7a355053 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:39.687122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-de579b1d-e60b-497d-9360-d2230b13f35d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:42:39.690402 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-de579b1d-e60b-497d-9360-d2230b13f35d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:42:39.765700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-944c9822-f9ee-4e3c-857f-0f7a7a355053 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:39.778811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-944c9822-f9ee-4e3c-857f-0f7a7a355053 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:39.784735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-944c9822-f9ee-4e3c-857f-0f7a7a355053 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:39.784735 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-944c9822-f9ee-4e3c-857f-0f7a7a355053 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.114323 May 28 04:42:39.784735 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1117/2299] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:39 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:39.940929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-de579b1d-e60b-497d-9360-d2230b13f35d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:39.959778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de579b1d-e60b-497d-9360-d2230b13f35d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:39.960289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de579b1d-e60b-497d-9360-d2230b13f35d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:39.961073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de579b1d-e60b-497d-9360-d2230b13f35d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:39.965110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de579b1d-e60b-497d-9360-d2230b13f35d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:39.999018 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-de579b1d-e60b-497d-9360-d2230b13f35d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "POST /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48/action" status: 202 len: 1112 microversion: 2.1 time: 0.425194 May 28 04:42:39.999877 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1183/2300] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:42:39 2022] POST /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48/action => generated 1112 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 28 04:42:40.014938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e6078045-9e87-4ef6-a214-5997d8a54c53 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:40.016070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e6078045-9e87-4ef6-a214-5997d8a54c53 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:40.025137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6078045-9e87-4ef6-a214-5997d8a54c53 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:40.025602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6078045-9e87-4ef6-a214-5997d8a54c53 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:40.026378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6078045-9e87-4ef6-a214-5997d8a54c53 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:40.026818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6078045-9e87-4ef6-a214-5997d8a54c53 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:40.206567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e6078045-9e87-4ef6-a214-5997d8a54c53 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:40.218900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9165deab-0a92-43a5-ab52-1b3c0d269fa4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:40.221243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9165deab-0a92-43a5-ab52-1b3c0d269fa4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:40.233051 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e6078045-9e87-4ef6-a214-5997d8a54c53 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.221380 May 28 04:42:40.233870 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1118/2301] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:40 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:40.244120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9165deab-0a92-43a5-ab52-1b3c0d269fa4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:40.244782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9165deab-0a92-43a5-ab52-1b3c0d269fa4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:40.245782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9165deab-0a92-43a5-ab52-1b3c0d269fa4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:40.246335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9165deab-0a92-43a5-ab52-1b3c0d269fa4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:40.248622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a7616ba6-523e-47e4-aea1-baccae7f248b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:40.255014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a7616ba6-523e-47e4-aea1-baccae7f248b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:40.257219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a7616ba6-523e-47e4-aea1-baccae7f248b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:40.257795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a7616ba6-523e-47e4-aea1-baccae7f248b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:40.259134 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a7616ba6-523e-47e4-aea1-baccae7f248b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:40.260083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a7616ba6-523e-47e4-aea1-baccae7f248b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:40.479682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9165deab-0a92-43a5-ab52-1b3c0d269fa4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:40.480760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a7616ba6-523e-47e4-aea1-baccae7f248b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:40.488855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a7616ba6-523e-47e4-aea1-baccae7f248b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:40.490288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a7616ba6-523e-47e4-aea1-baccae7f248b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:40.491533 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a7616ba6-523e-47e4-aea1-baccae7f248b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.254008 May 28 04:42:40.492090 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1119/2302] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:40 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:40.502108 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9165deab-0a92-43a5-ab52-1b3c0d269fa4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1472 microversion: 2.1 time: 0.293268 May 28 04:42:40.503370 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1184/2303] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:40 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1472 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:40.719373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-07192376-e36c-45e3-8d27-2a2e835c71d5 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1111655814", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": "none"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:40.778523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-07192376-e36c-45e3-8d27-2a2e835c71d5 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:42:40.779391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-07192376-e36c-45e3-8d27-2a2e835c71d5 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:42:40.780605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-07192376-e36c-45e3-8d27-2a2e835c71d5 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:42:40.781233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-07192376-e36c-45e3-8d27-2a2e835c71d5 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:42:40.781825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-07192376-e36c-45e3-8d27-2a2e835c71d5 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:42:40.801312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07192376-e36c-45e3-8d27-2a2e835c71d5 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:40.801312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07192376-e36c-45e3-8d27-2a2e835c71d5 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:40.801312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07192376-e36c-45e3-8d27-2a2e835c71d5 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:40.801312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07192376-e36c-45e3-8d27-2a2e835c71d5 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:40.801833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-877048ad-76da-4bbc-ac1c-7426f5eea380 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:40.802369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-877048ad-76da-4bbc-ac1c-7426f5eea380 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:40.809708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-877048ad-76da-4bbc-ac1c-7426f5eea380 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:40.810570 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-877048ad-76da-4bbc-ac1c-7426f5eea380 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:40.811446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-877048ad-76da-4bbc-ac1c-7426f5eea380 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:40.811972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-877048ad-76da-4bbc-ac1c-7426f5eea380 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:40.829735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-07192376-e36c-45e3-8d27-2a2e835c71d5 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Getting quotas for project f1299beacf1d41ed8a64020cd5e99201. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:42:40.836722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-07192376-e36c-45e3-8d27-2a2e835c71d5 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Getting quotas for user b86b76fae08d48bb9f3616092998c27d and project f1299beacf1d41ed8a64020cd5e99201. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:42:40.851483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-07192376-e36c-45e3-8d27-2a2e835c71d5 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:42:40.855090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-07192376-e36c-45e3-8d27-2a2e835c71d5 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:42:40.885540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-877048ad-76da-4bbc-ac1c-7426f5eea380 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:40.895081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-877048ad-76da-4bbc-ac1c-7426f5eea380 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:40.896993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-877048ad-76da-4bbc-ac1c-7426f5eea380 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:40.898601 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-877048ad-76da-4bbc-ac1c-7426f5eea380 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.100772 May 28 04:42:40.899865 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1185/2304] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:40 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:41.070958 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-07192376-e36c-45e3-8d27-2a2e835c71d5 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.495322 May 28 04:42:41.071694 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1120/2305] 10.222.0.58 () {62 vars in 1187 bytes} [Sat May 28 04:42:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 04:42:41.082689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-95163341-f27f-4961-b471-9ec596f5c40e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:41.084485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-95163341-f27f-4961-b471-9ec596f5c40e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:41.193840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-95163341-f27f-4961-b471-9ec596f5c40e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:41.200840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-95163341-f27f-4961-b471-9ec596f5c40e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:41.202356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-95163341-f27f-4961-b471-9ec596f5c40e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:41.209312 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-95163341-f27f-4961-b471-9ec596f5c40e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "PUT /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1359 microversion: 2.75 time: 0.131108 May 28 04:42:41.217147 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1186/2306] 10.222.0.58 () {62 vars in 1296 bytes} [Sat May 28 04:42:41 2022] PUT /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1359 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:41.229897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cb424ea5-f9ad-42c4-a25d-14ec0079509a tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:41.230397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cb424ea5-f9ad-42c4-a25d-14ec0079509a tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:41.253672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4f5ef311-fa75-47ab-a6ca-e2b4dae3d25a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:41.254347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4f5ef311-fa75-47ab-a6ca-e2b4dae3d25a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:41.261574 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f5ef311-fa75-47ab-a6ca-e2b4dae3d25a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:41.262449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f5ef311-fa75-47ab-a6ca-e2b4dae3d25a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:41.263526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f5ef311-fa75-47ab-a6ca-e2b4dae3d25a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:41.264016 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f5ef311-fa75-47ab-a6ca-e2b4dae3d25a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:41.314418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cb424ea5-f9ad-42c4-a25d-14ec0079509a tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:41.323938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cb424ea5-f9ad-42c4-a25d-14ec0079509a tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:41.325449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cb424ea5-f9ad-42c4-a25d-14ec0079509a tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:41.332852 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cb424ea5-f9ad-42c4-a25d-14ec0079509a tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1359 microversion: 2.75 time: 0.107732 May 28 04:42:41.339270 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1121/2307] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:41 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1359 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:41.420650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4f5ef311-fa75-47ab-a6ca-e2b4dae3d25a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:41.429054 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4f5ef311-fa75-47ab-a6ca-e2b4dae3d25a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.179404 May 28 04:42:41.429629 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1187/2308] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:41 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:41.509977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d22771e6-283e-434b-aa89-12dc6aec31c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:41.510510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d22771e6-283e-434b-aa89-12dc6aec31c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:41.517430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d22771e6-283e-434b-aa89-12dc6aec31c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:41.517891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d22771e6-283e-434b-aa89-12dc6aec31c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:41.518665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d22771e6-283e-434b-aa89-12dc6aec31c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:41.519129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d22771e6-283e-434b-aa89-12dc6aec31c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:41.525408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-258b27f6-09ee-491e-80c1-6859413b731a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:41.526022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-258b27f6-09ee-491e-80c1-6859413b731a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:41.533293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-258b27f6-09ee-491e-80c1-6859413b731a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:41.534169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-258b27f6-09ee-491e-80c1-6859413b731a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:41.535465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-258b27f6-09ee-491e-80c1-6859413b731a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:41.536094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-258b27f6-09ee-491e-80c1-6859413b731a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:41.765630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-258b27f6-09ee-491e-80c1-6859413b731a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:41.784731 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-258b27f6-09ee-491e-80c1-6859413b731a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1472 microversion: 2.1 time: 0.265313 May 28 04:42:41.786816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d22771e6-283e-434b-aa89-12dc6aec31c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:41.796295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d22771e6-283e-434b-aa89-12dc6aec31c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:41.806671 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1188/2309] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:41 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1472 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:41.806875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d22771e6-283e-434b-aa89-12dc6aec31c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:41.806875 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d22771e6-283e-434b-aa89-12dc6aec31c3 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.293462 May 28 04:42:41.810965 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1122/2310] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:41 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:41.918541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0b93716c-5db3-4dbb-b791-badf9faf2483 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:41.919120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0b93716c-5db3-4dbb-b791-badf9faf2483 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:41.932611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b93716c-5db3-4dbb-b791-badf9faf2483 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:41.933138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b93716c-5db3-4dbb-b791-badf9faf2483 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:41.933873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b93716c-5db3-4dbb-b791-badf9faf2483 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:41.934383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b93716c-5db3-4dbb-b791-badf9faf2483 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:42.016313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0b93716c-5db3-4dbb-b791-badf9faf2483 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:42.027482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0b93716c-5db3-4dbb-b791-badf9faf2483 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:42.029000 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0b93716c-5db3-4dbb-b791-badf9faf2483 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:42.030251 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0b93716c-5db3-4dbb-b791-badf9faf2483 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.115811 May 28 04:42:42.033612 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1189/2311] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:41 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:42.354792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7b714362-726a-46d6-8f3f-e0657a0493a9 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:42.355444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7b714362-726a-46d6-8f3f-e0657a0493a9 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:42.365910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b714362-726a-46d6-8f3f-e0657a0493a9 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:42.366441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b714362-726a-46d6-8f3f-e0657a0493a9 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:42.367227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b714362-726a-46d6-8f3f-e0657a0493a9 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:42.367731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b714362-726a-46d6-8f3f-e0657a0493a9 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:42.455362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-30484ff1-eb3b-43ab-ab19-71da8e487158 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:42.457654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-30484ff1-eb3b-43ab-ab19-71da8e487158 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:42.472471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30484ff1-eb3b-43ab-ab19-71da8e487158 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:42.476769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30484ff1-eb3b-43ab-ab19-71da8e487158 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:42.477661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30484ff1-eb3b-43ab-ab19-71da8e487158 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:42.479114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30484ff1-eb3b-43ab-ab19-71da8e487158 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:42.507501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:42.519542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7b714362-726a-46d6-8f3f-e0657a0493a9 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:42.530274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7b714362-726a-46d6-8f3f-e0657a0493a9 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:42.532075 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7b714362-726a-46d6-8f3f-e0657a0493a9 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:42.539623 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7b714362-726a-46d6-8f3f-e0657a0493a9 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1363 microversion: 2.75 time: 0.189687 May 28 04:42:42.540796 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1123/2312] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:42 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:42.657935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-30484ff1-eb3b-43ab-ab19-71da8e487158 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:42.666886 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-30484ff1-eb3b-43ab-ab19-71da8e487158 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.219056 May 28 04:42:42.667699 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1190/2313] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:42 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:42.819304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f7e1af41-30b0-4137-abf3-22469c3de289 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:42.822122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f7e1af41-30b0-4137-abf3-22469c3de289 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:42.822303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-41f869e8-a963-47a9-9fd6-5cf168dc02ac tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:42.823051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-41f869e8-a963-47a9-9fd6-5cf168dc02ac tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:42.834030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=13 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:42.837247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7e1af41-30b0-4137-abf3-22469c3de289 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:42.840003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41f869e8-a963-47a9-9fd6-5cf168dc02ac tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:42.841158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41f869e8-a963-47a9-9fd6-5cf168dc02ac tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:42.841496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7e1af41-30b0-4137-abf3-22469c3de289 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:42.843140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7e1af41-30b0-4137-abf3-22469c3de289 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:42.843873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7e1af41-30b0-4137-abf3-22469c3de289 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:42.844135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41f869e8-a963-47a9-9fd6-5cf168dc02ac tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:42.844589 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41f869e8-a963-47a9-9fd6-5cf168dc02ac tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:43.084877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f7e1af41-30b0-4137-abf3-22469c3de289 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:43.089272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-41f869e8-a963-47a9-9fd6-5cf168dc02ac tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:43.104678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f7e1af41-30b0-4137-abf3-22469c3de289 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:43.107898 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-41f869e8-a963-47a9-9fd6-5cf168dc02ac tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1472 microversion: 2.1 time: 0.297821 May 28 04:42:43.109686 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f7e1af41-30b0-4137-abf3-22469c3de289 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:43.110420 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1124/2314] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:42 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1472 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:43.119097 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f7e1af41-30b0-4137-abf3-22469c3de289 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.305000 May 28 04:42:43.129553 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1191/2315] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:42 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:43.131229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1349a700-8026-4f3e-8be2-9f9acd996c84 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:43.132193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1349a700-8026-4f3e-8be2-9f9acd996c84 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:43.138533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1349a700-8026-4f3e-8be2-9f9acd996c84 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:43.139036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1349a700-8026-4f3e-8be2-9f9acd996c84 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:43.140081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1349a700-8026-4f3e-8be2-9f9acd996c84 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:43.140530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1349a700-8026-4f3e-8be2-9f9acd996c84 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:43.143472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:43.207385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1349a700-8026-4f3e-8be2-9f9acd996c84 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:43.216620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1349a700-8026-4f3e-8be2-9f9acd996c84 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:43.218081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1349a700-8026-4f3e-8be2-9f9acd996c84 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:43.219290 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1349a700-8026-4f3e-8be2-9f9acd996c84 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.107563 May 28 04:42:43.219905 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1125/2316] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:43 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:43.560095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aa7ac9d0-78e1-4287-b917-836f0cccacd3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:43.560715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aa7ac9d0-78e1-4287-b917-836f0cccacd3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:43.567852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aa7ac9d0-78e1-4287-b917-836f0cccacd3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:43.568498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aa7ac9d0-78e1-4287-b917-836f0cccacd3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:43.569826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aa7ac9d0-78e1-4287-b917-836f0cccacd3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:43.570286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aa7ac9d0-78e1-4287-b917-836f0cccacd3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:43.685369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aa7ac9d0-78e1-4287-b917-836f0cccacd3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:43.686059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ff16402e-bfd2-48ce-8ce7-331a3b321b52 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:43.686498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ff16402e-bfd2-48ce-8ce7-331a3b321b52 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:43.694693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aa7ac9d0-78e1-4287-b917-836f0cccacd3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:43.696264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aa7ac9d0-78e1-4287-b917-836f0cccacd3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:43.701611 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aa7ac9d0-78e1-4287-b917-836f0cccacd3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1419 microversion: 2.75 time: 0.145530 May 28 04:42:43.702463 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1192/2317] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:43 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1419 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:43.711639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff16402e-bfd2-48ce-8ce7-331a3b321b52 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:43.712108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff16402e-bfd2-48ce-8ce7-331a3b321b52 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:43.712902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff16402e-bfd2-48ce-8ce7-331a3b321b52 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:43.713349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff16402e-bfd2-48ce-8ce7-331a3b321b52 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:43.868429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ff16402e-bfd2-48ce-8ce7-331a3b321b52 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:43.876379 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ff16402e-bfd2-48ce-8ce7-331a3b321b52 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.196372 May 28 04:42:43.877023 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1126/2318] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:43 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:44.128001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5dd76543-32cc-49bf-aae6-147e48e1107c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:44.128794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5dd76543-32cc-49bf-aae6-147e48e1107c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:44.135947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5dd76543-32cc-49bf-aae6-147e48e1107c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:44.136401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5dd76543-32cc-49bf-aae6-147e48e1107c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:44.137499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5dd76543-32cc-49bf-aae6-147e48e1107c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:44.141667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5dd76543-32cc-49bf-aae6-147e48e1107c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:44.151502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f995b858-642f-4076-a989-810c04dd2c74 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:44.152264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f995b858-642f-4076-a989-810c04dd2c74 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:44.159318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f995b858-642f-4076-a989-810c04dd2c74 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:44.159887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f995b858-642f-4076-a989-810c04dd2c74 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:44.163113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f995b858-642f-4076-a989-810c04dd2c74 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:44.163113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f995b858-642f-4076-a989-810c04dd2c74 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:44.352487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5dd76543-32cc-49bf-aae6-147e48e1107c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:44.358793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f995b858-642f-4076-a989-810c04dd2c74 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:44.361740 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5dd76543-32cc-49bf-aae6-147e48e1107c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1472 microversion: 2.1 time: 0.237414 May 28 04:42:44.362706 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1193/2319] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:44 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1472 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:44.368276 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-590f5756-cb28-4e61-ac40-6cd1e55e65ae tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:44.368878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-590f5756-cb28-4e61-ac40-6cd1e55e65ae tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:44.375752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-590f5756-cb28-4e61-ac40-6cd1e55e65ae tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:44.376203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-590f5756-cb28-4e61-ac40-6cd1e55e65ae tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:44.377081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-590f5756-cb28-4e61-ac40-6cd1e55e65ae tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:44.377431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-590f5756-cb28-4e61-ac40-6cd1e55e65ae tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:44.378008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f995b858-642f-4076-a989-810c04dd2c74 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:44.379797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f995b858-642f-4076-a989-810c04dd2c74 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:44.380939 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f995b858-642f-4076-a989-810c04dd2c74 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.233621 May 28 04:42:44.381749 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1127/2320] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:44 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:44.447358 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-590f5756-cb28-4e61-ac40-6cd1e55e65ae tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:44.456088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-590f5756-cb28-4e61-ac40-6cd1e55e65ae tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:44.457603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-590f5756-cb28-4e61-ac40-6cd1e55e65ae tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:44.458875 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-590f5756-cb28-4e61-ac40-6cd1e55e65ae tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.095255 May 28 04:42:44.459592 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1194/2321] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:44 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:44.721974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9cce888b-70bc-4950-9d3d-65376a2df323 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:44.722525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9cce888b-70bc-4950-9d3d-65376a2df323 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:44.729758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9cce888b-70bc-4950-9d3d-65376a2df323 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:44.730215 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9cce888b-70bc-4950-9d3d-65376a2df323 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:44.731028 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9cce888b-70bc-4950-9d3d-65376a2df323 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:44.731476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9cce888b-70bc-4950-9d3d-65376a2df323 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:44.801332 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9cce888b-70bc-4950-9d3d-65376a2df323 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:44.810476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9cce888b-70bc-4950-9d3d-65376a2df323 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:44.812186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9cce888b-70bc-4950-9d3d-65376a2df323 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:44.818599 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9cce888b-70bc-4950-9d3d-65376a2df323 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1417 microversion: 2.75 time: 0.100626 May 28 04:42:44.819749 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1128/2322] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:44 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1417 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:44.895691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-caf18191-240a-433d-9da2-060538a197db tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:44.896444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-caf18191-240a-433d-9da2-060538a197db tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:44.905000 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-caf18191-240a-433d-9da2-060538a197db tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:44.906218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-caf18191-240a-433d-9da2-060538a197db tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:44.907128 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-caf18191-240a-433d-9da2-060538a197db tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:44.907643 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-caf18191-240a-433d-9da2-060538a197db tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:45.040513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-caf18191-240a-433d-9da2-060538a197db tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:45.048650 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-caf18191-240a-433d-9da2-060538a197db tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.157779 May 28 04:42:45.049438 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1195/2323] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:44 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:45.380084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a6a7c323-24bf-4375-8f4b-0007ab0a18fc tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:45.380712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a6a7c323-24bf-4375-8f4b-0007ab0a18fc tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:45.387811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6a7c323-24bf-4375-8f4b-0007ab0a18fc tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:45.388287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6a7c323-24bf-4375-8f4b-0007ab0a18fc tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:45.389089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6a7c323-24bf-4375-8f4b-0007ab0a18fc tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:45.389560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6a7c323-24bf-4375-8f4b-0007ab0a18fc tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:45.401168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a59634ee-f2e6-48c2-8002-7fc77b256acc tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:45.401989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a59634ee-f2e6-48c2-8002-7fc77b256acc tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:45.409405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a59634ee-f2e6-48c2-8002-7fc77b256acc tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:45.409946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a59634ee-f2e6-48c2-8002-7fc77b256acc tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:45.410728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a59634ee-f2e6-48c2-8002-7fc77b256acc tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:45.411901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a59634ee-f2e6-48c2-8002-7fc77b256acc tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:45.593503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a6a7c323-24bf-4375-8f4b-0007ab0a18fc tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:45.601542 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a6a7c323-24bf-4375-8f4b-0007ab0a18fc tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1472 microversion: 2.1 time: 0.225446 May 28 04:42:45.605415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a59634ee-f2e6-48c2-8002-7fc77b256acc tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:45.611308 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1129/2324] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:45 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1472 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:45.614120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a59634ee-f2e6-48c2-8002-7fc77b256acc tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:45.616404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a59634ee-f2e6-48c2-8002-7fc77b256acc tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:45.616770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1caab8b7-e51e-470e-b0ab-2c7055feb495 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:45.617574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1caab8b7-e51e-470e-b0ab-2c7055feb495 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:45.617959 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a59634ee-f2e6-48c2-8002-7fc77b256acc tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.221208 May 28 04:42:45.618786 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1196/2325] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:45 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:45.623833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1caab8b7-e51e-470e-b0ab-2c7055feb495 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:45.624293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1caab8b7-e51e-470e-b0ab-2c7055feb495 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:45.625073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1caab8b7-e51e-470e-b0ab-2c7055feb495 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:45.625613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1caab8b7-e51e-470e-b0ab-2c7055feb495 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:45.692345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1caab8b7-e51e-470e-b0ab-2c7055feb495 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:45.700888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1caab8b7-e51e-470e-b0ab-2c7055feb495 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:45.702403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1caab8b7-e51e-470e-b0ab-2c7055feb495 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:45.703601 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1caab8b7-e51e-470e-b0ab-2c7055feb495 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1366 microversion: 2.57 time: 0.091114 May 28 04:42:45.704600 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1130/2326] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:45 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:45.840847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c3834bde-1ceb-4244-84ba-9018c5774e46 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:45.841588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c3834bde-1ceb-4244-84ba-9018c5774e46 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:45.848130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3834bde-1ceb-4244-84ba-9018c5774e46 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:45.848598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3834bde-1ceb-4244-84ba-9018c5774e46 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:45.849369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3834bde-1ceb-4244-84ba-9018c5774e46 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:45.850400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3834bde-1ceb-4244-84ba-9018c5774e46 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:45.918696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c3834bde-1ceb-4244-84ba-9018c5774e46 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:45.927270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c3834bde-1ceb-4244-84ba-9018c5774e46 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:45.929400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c3834bde-1ceb-4244-84ba-9018c5774e46 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:45.934199 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c3834bde-1ceb-4244-84ba-9018c5774e46 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1417 microversion: 2.75 time: 0.097387 May 28 04:42:45.934783 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1197/2327] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:45 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1417 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:46.064666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9cf94b30-639c-4c18-8cb3-0246523dc0c8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:46.065690 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9cf94b30-639c-4c18-8cb3-0246523dc0c8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:46.071977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9cf94b30-639c-4c18-8cb3-0246523dc0c8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:46.072429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9cf94b30-639c-4c18-8cb3-0246523dc0c8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:46.077036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9cf94b30-639c-4c18-8cb3-0246523dc0c8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:46.077036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9cf94b30-639c-4c18-8cb3-0246523dc0c8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:46.208468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9cf94b30-639c-4c18-8cb3-0246523dc0c8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:46.216653 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9cf94b30-639c-4c18-8cb3-0246523dc0c8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.155835 May 28 04:42:46.217311 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1131/2328] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:46 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:46.618447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0f5e43ff-b305-4b45-83db-782091c2fe02 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:46.619045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0f5e43ff-b305-4b45-83db-782091c2fe02 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:46.625486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f5e43ff-b305-4b45-83db-782091c2fe02 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:46.625964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f5e43ff-b305-4b45-83db-782091c2fe02 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:46.626743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f5e43ff-b305-4b45-83db-782091c2fe02 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:46.627241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f5e43ff-b305-4b45-83db-782091c2fe02 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:46.637368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a3089035-d9ee-41f3-a38c-7159dca4ad8d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:46.638124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a3089035-d9ee-41f3-a38c-7159dca4ad8d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:46.646702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3089035-d9ee-41f3-a38c-7159dca4ad8d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:46.647967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3089035-d9ee-41f3-a38c-7159dca4ad8d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:46.651284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3089035-d9ee-41f3-a38c-7159dca4ad8d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:46.651284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3089035-d9ee-41f3-a38c-7159dca4ad8d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:46.839656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0f5e43ff-b305-4b45-83db-782091c2fe02 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:46.841547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a3089035-d9ee-41f3-a38c-7159dca4ad8d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:46.849235 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0f5e43ff-b305-4b45-83db-782091c2fe02 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1478 microversion: 2.1 time: 0.235106 May 28 04:42:46.850185 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1198/2329] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:46 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1478 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:46.850529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a3089035-d9ee-41f3-a38c-7159dca4ad8d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:46.852190 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a3089035-d9ee-41f3-a38c-7159dca4ad8d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:46.853357 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a3089035-d9ee-41f3-a38c-7159dca4ad8d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.220977 May 28 04:42:46.854057 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1132/2330] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:46 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:46.855411 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-58dc6b88-cf8a-40f2-9ba0-1de8106552e8 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:46.856127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-58dc6b88-cf8a-40f2-9ba0-1de8106552e8 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:46.869024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58dc6b88-cf8a-40f2-9ba0-1de8106552e8 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:46.869415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58dc6b88-cf8a-40f2-9ba0-1de8106552e8 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:46.870179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58dc6b88-cf8a-40f2-9ba0-1de8106552e8 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:46.870671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58dc6b88-cf8a-40f2-9ba0-1de8106552e8 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:46.941457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-58dc6b88-cf8a-40f2-9ba0-1de8106552e8 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:46.950722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-58dc6b88-cf8a-40f2-9ba0-1de8106552e8 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:46.952512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-58dc6b88-cf8a-40f2-9ba0-1de8106552e8 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:46.953774 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-58dc6b88-cf8a-40f2-9ba0-1de8106552e8 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1384 microversion: 2.57 time: 0.102559 May 28 04:42:46.953959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d90bd675-c5d4-48b9-bd89-aad13c3e56e1 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:46.954905 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1199/2331] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:46 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1384 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:46.955050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d90bd675-c5d4-48b9-bd89-aad13c3e56e1 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:46.961817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d90bd675-c5d4-48b9-bd89-aad13c3e56e1 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:46.963137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d90bd675-c5d4-48b9-bd89-aad13c3e56e1 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:46.963137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d90bd675-c5d4-48b9-bd89-aad13c3e56e1 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:46.963533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d90bd675-c5d4-48b9-bd89-aad13c3e56e1 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:47.033149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d90bd675-c5d4-48b9-bd89-aad13c3e56e1 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:47.042023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d90bd675-c5d4-48b9-bd89-aad13c3e56e1 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:47.043571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d90bd675-c5d4-48b9-bd89-aad13c3e56e1 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:47.048367 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d90bd675-c5d4-48b9-bd89-aad13c3e56e1 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1417 microversion: 2.75 time: 0.098701 May 28 04:42:47.048947 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1133/2332] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:46 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1417 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:47.236245 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4a0dc59e-60a0-45af-8e8c-49bd9e88677e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:47.442095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4a0dc59e-60a0-45af-8e8c-49bd9e88677e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:47.442095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a0dc59e-60a0-45af-8e8c-49bd9e88677e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:47.442095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a0dc59e-60a0-45af-8e8c-49bd9e88677e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:47.442095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a0dc59e-60a0-45af-8e8c-49bd9e88677e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:47.442095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a0dc59e-60a0-45af-8e8c-49bd9e88677e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:47.442095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4a0dc59e-60a0-45af-8e8c-49bd9e88677e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:47.442095 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4a0dc59e-60a0-45af-8e8c-49bd9e88677e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.174603 May 28 04:42:47.442095 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1200/2333] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:47 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:47.866699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c13ef0f6-42a1-4d99-8882-16ba672270fb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:47.867461 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c13ef0f6-42a1-4d99-8882-16ba672270fb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:47.871717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8400968b-c245-4597-bba5-cbd29011ac9c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:47.872411 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8400968b-c245-4597-bba5-cbd29011ac9c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:47.874697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c13ef0f6-42a1-4d99-8882-16ba672270fb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:47.875206 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c13ef0f6-42a1-4d99-8882-16ba672270fb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:47.875975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c13ef0f6-42a1-4d99-8882-16ba672270fb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:47.876409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c13ef0f6-42a1-4d99-8882-16ba672270fb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:47.879325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8400968b-c245-4597-bba5-cbd29011ac9c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:47.879743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8400968b-c245-4597-bba5-cbd29011ac9c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:47.880519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8400968b-c245-4597-bba5-cbd29011ac9c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:47.880979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8400968b-c245-4597-bba5-cbd29011ac9c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:48.074797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c13ef0f6-42a1-4d99-8882-16ba672270fb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:48.078115 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8400968b-c245-4597-bba5-cbd29011ac9c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:48.084938 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c13ef0f6-42a1-4d99-8882-16ba672270fb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1478 microversion: 2.1 time: 0.221710 May 28 04:42:48.091939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8400968b-c245-4597-bba5-cbd29011ac9c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:48.091939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8400968b-c245-4597-bba5-cbd29011ac9c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:48.091939 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8400968b-c245-4597-bba5-cbd29011ac9c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.223331 May 28 04:42:48.091939 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1201/2334] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:47 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:48.094965 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1134/2335] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:47 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1478 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:48.100136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-691d5611-055d-4d7d-8041-f9c536224f93 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:48.100880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-691d5611-055d-4d7d-8041-f9c536224f93 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:48.107412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-691d5611-055d-4d7d-8041-f9c536224f93 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:48.107596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f4101110-b400-4438-b527-7d7187d8f766 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:48.108073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-691d5611-055d-4d7d-8041-f9c536224f93 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:48.108195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f4101110-b400-4438-b527-7d7187d8f766 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:48.109025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-691d5611-055d-4d7d-8041-f9c536224f93 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:48.109636 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-691d5611-055d-4d7d-8041-f9c536224f93 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:48.126488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4101110-b400-4438-b527-7d7187d8f766 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:48.126488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4101110-b400-4438-b527-7d7187d8f766 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:48.126488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4101110-b400-4438-b527-7d7187d8f766 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:48.126488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4101110-b400-4438-b527-7d7187d8f766 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:48.186726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-691d5611-055d-4d7d-8041-f9c536224f93 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:48.198788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-691d5611-055d-4d7d-8041-f9c536224f93 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:48.200978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-691d5611-055d-4d7d-8041-f9c536224f93 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:48.207564 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-691d5611-055d-4d7d-8041-f9c536224f93 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1438 microversion: 2.75 time: 0.111210 May 28 04:42:48.217597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f4101110-b400-4438-b527-7d7187d8f766 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:48.224318 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1135/2336] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:48 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1438 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:48.226692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f4101110-b400-4438-b527-7d7187d8f766 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:48.229502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f4101110-b400-4438-b527-7d7187d8f766 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:48.230238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0d8ad386-b39c-4e59-9ea1-cf870b4901ea tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "012b12af-263c-4753-8fad-4a4022b439aa"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:48.230691 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f4101110-b400-4438-b527-7d7187d8f766 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1372 microversion: 2.57 time: 0.127033 May 28 04:42:48.231713 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1202/2337] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:48 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1372 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:48.234806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0d8ad386-b39c-4e59-9ea1-cf870b4901ea tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:48.241777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d8ad386-b39c-4e59-9ea1-cf870b4901ea tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:48.242344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d8ad386-b39c-4e59-9ea1-cf870b4901ea tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:48.243278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d8ad386-b39c-4e59-9ea1-cf870b4901ea tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:48.243940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d8ad386-b39c-4e59-9ea1-cf870b4901ea tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:48.332621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0d8ad386-b39c-4e59-9ea1-cf870b4901ea tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:42:48.333056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0d8ad386-b39c-4e59-9ea1-cf870b4901ea tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:42:48.333741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0d8ad386-b39c-4e59-9ea1-cf870b4901ea tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:42:48.334905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0d8ad386-b39c-4e59-9ea1-cf870b4901ea tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:42:48.339330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0d8ad386-b39c-4e59-9ea1-cf870b4901ea tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:42:48.424735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-226ad61e-6777-47d6-9338-53b04216b377 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:48.426340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-226ad61e-6777-47d6-9338-53b04216b377 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:48.439616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-226ad61e-6777-47d6-9338-53b04216b377 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:48.440834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-226ad61e-6777-47d6-9338-53b04216b377 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:48.441807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-226ad61e-6777-47d6-9338-53b04216b377 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:48.443126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-226ad61e-6777-47d6-9338-53b04216b377 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:48.613983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0d8ad386-b39c-4e59-9ea1-cf870b4901ea tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:48.613983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d8ad386-b39c-4e59-9ea1-cf870b4901ea tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:48.613983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d8ad386-b39c-4e59-9ea1-cf870b4901ea tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:48.613983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d8ad386-b39c-4e59-9ea1-cf870b4901ea tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:48.613983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d8ad386-b39c-4e59-9ea1-cf870b4901ea tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:48.657165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-226ad61e-6777-47d6-9338-53b04216b377 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:48.667114 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-226ad61e-6777-47d6-9338-53b04216b377 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.246808 May 28 04:42:48.668295 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1203/2338] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:48 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:48.711628 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0d8ad386-b39c-4e59-9ea1-cf870b4901ea tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:48.720039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0d8ad386-b39c-4e59-9ea1-cf870b4901ea tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:48.721662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0d8ad386-b39c-4e59-9ea1-cf870b4901ea tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:48.727049 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0d8ad386-b39c-4e59-9ea1-cf870b4901ea tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "POST /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374/action" status: 202 len: 1495 microversion: 2.75 time: 0.501488 May 28 04:42:48.727944 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1136/2339] 10.222.0.58 () {62 vars in 1318 bytes} [Sat May 28 04:42:48 2022] POST /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374/action => generated 1495 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 28 04:42:48.745611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-38ed5548-a6a3-447e-be70-ec03fe08716f tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:48.746260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-38ed5548-a6a3-447e-be70-ec03fe08716f tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:48.752571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-38ed5548-a6a3-447e-be70-ec03fe08716f tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:48.753025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-38ed5548-a6a3-447e-be70-ec03fe08716f tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:48.753806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-38ed5548-a6a3-447e-be70-ec03fe08716f tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:48.754260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-38ed5548-a6a3-447e-be70-ec03fe08716f tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:48.836602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-38ed5548-a6a3-447e-be70-ec03fe08716f tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:48.844980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-38ed5548-a6a3-447e-be70-ec03fe08716f tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:48.846513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-38ed5548-a6a3-447e-be70-ec03fe08716f tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:48.853956 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-38ed5548-a6a3-447e-be70-ec03fe08716f tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.112280 May 28 04:42:48.867303 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1204/2340] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:48 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:49.103064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b7866a70-262f-45d5-b5b5-dbd44575340e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:49.104463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b7866a70-262f-45d5-b5b5-dbd44575340e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:49.109687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0d8a05fb-3736-4af0-b8f8-8635bb951807 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:49.110611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0d8a05fb-3736-4af0-b8f8-8635bb951807 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:49.114263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7866a70-262f-45d5-b5b5-dbd44575340e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:49.115336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7866a70-262f-45d5-b5b5-dbd44575340e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:49.116381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7866a70-262f-45d5-b5b5-dbd44575340e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:49.117054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7866a70-262f-45d5-b5b5-dbd44575340e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:49.124873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0d8a05fb-3736-4af0-b8f8-8635bb951807 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:49.125347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0d8a05fb-3736-4af0-b8f8-8635bb951807 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:49.126147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0d8a05fb-3736-4af0-b8f8-8635bb951807 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:49.126593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0d8a05fb-3736-4af0-b8f8-8635bb951807 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:49.344508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0d8a05fb-3736-4af0-b8f8-8635bb951807 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:49.358801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0d8a05fb-3736-4af0-b8f8-8635bb951807 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:49.359426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b7866a70-262f-45d5-b5b5-dbd44575340e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:49.360916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0d8a05fb-3736-4af0-b8f8-8635bb951807 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:49.362655 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0d8a05fb-3736-4af0-b8f8-8635bb951807 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.257819 May 28 04:42:49.364555 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1205/2341] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:49 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:49.370582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1ca84203-9a73-4b43-92ab-7356437eae30 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:49.371650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1ca84203-9a73-4b43-92ab-7356437eae30 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:49.378369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ca84203-9a73-4b43-92ab-7356437eae30 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:49.379444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ca84203-9a73-4b43-92ab-7356437eae30 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:49.380534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ca84203-9a73-4b43-92ab-7356437eae30 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:49.381237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ca84203-9a73-4b43-92ab-7356437eae30 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:49.383408 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b7866a70-262f-45d5-b5b5-dbd44575340e tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1478 microversion: 2.1 time: 0.284748 May 28 04:42:49.389255 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1137/2342] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:49 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1478 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:49.456863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1ca84203-9a73-4b43-92ab-7356437eae30 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:49.466738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1ca84203-9a73-4b43-92ab-7356437eae30 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:49.468344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1ca84203-9a73-4b43-92ab-7356437eae30 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:49.470662 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1ca84203-9a73-4b43-92ab-7356437eae30 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1372 microversion: 2.57 time: 0.104025 May 28 04:42:49.487145 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1206/2343] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:49 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1372 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:49.688578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f0031b52-3872-4acf-8189-b268378a9a3b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:49.689097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f0031b52-3872-4acf-8189-b268378a9a3b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:49.698696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0031b52-3872-4acf-8189-b268378a9a3b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:49.699298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0031b52-3872-4acf-8189-b268378a9a3b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:49.700137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0031b52-3872-4acf-8189-b268378a9a3b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:49.700577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0031b52-3872-4acf-8189-b268378a9a3b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:49.874296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-92e322c3-dcb0-44ef-8fe4-1754a18bcd39 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:49.874925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-92e322c3-dcb0-44ef-8fe4-1754a18bcd39 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:49.893183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-92e322c3-dcb0-44ef-8fe4-1754a18bcd39 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:49.893614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-92e322c3-dcb0-44ef-8fe4-1754a18bcd39 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:49.894430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-92e322c3-dcb0-44ef-8fe4-1754a18bcd39 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:49.894875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-92e322c3-dcb0-44ef-8fe4-1754a18bcd39 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:49.897342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f0031b52-3872-4acf-8189-b268378a9a3b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:49.899862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:49.907074 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f0031b52-3872-4acf-8189-b268378a9a3b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.225121 May 28 04:42:49.911078 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1138/2344] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:49 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:49.998178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-92e322c3-dcb0-44ef-8fe4-1754a18bcd39 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:50.007326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-92e322c3-dcb0-44ef-8fe4-1754a18bcd39 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:50.009423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-92e322c3-dcb0-44ef-8fe4-1754a18bcd39 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:50.015175 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-92e322c3-dcb0-44ef-8fe4-1754a18bcd39 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.144717 May 28 04:42:50.016119 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1207/2345] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:49 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:50.384341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0d6a7100-aeb2-42cf-9a3e-429269736a88 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:50.385121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0d6a7100-aeb2-42cf-9a3e-429269736a88 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:50.392412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d6a7100-aeb2-42cf-9a3e-429269736a88 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:50.392872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d6a7100-aeb2-42cf-9a3e-429269736a88 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:50.393732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d6a7100-aeb2-42cf-9a3e-429269736a88 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:50.394188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d6a7100-aeb2-42cf-9a3e-429269736a88 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:50.409327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5821d753-cf36-4166-87d1-7f4ae81e169a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:50.410261 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5821d753-cf36-4166-87d1-7f4ae81e169a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:50.411381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:50.423685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5821d753-cf36-4166-87d1-7f4ae81e169a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:50.426024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5821d753-cf36-4166-87d1-7f4ae81e169a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:50.427686 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5821d753-cf36-4166-87d1-7f4ae81e169a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:50.429275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5821d753-cf36-4166-87d1-7f4ae81e169a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:50.673424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5821d753-cf36-4166-87d1-7f4ae81e169a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:50.677573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0d6a7100-aeb2-42cf-9a3e-429269736a88 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:50.682685 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5821d753-cf36-4166-87d1-7f4ae81e169a tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1478 microversion: 2.1 time: 0.280731 May 28 04:42:50.683646 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1208/2346] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:50 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1478 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:50.686732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0d6a7100-aeb2-42cf-9a3e-429269736a88 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:50.688335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0d6a7100-aeb2-42cf-9a3e-429269736a88 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:50.689154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e890cea2-f2ef-4c84-8e42-685786ab8900 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:50.689557 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0d6a7100-aeb2-42cf-9a3e-429269736a88 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.309298 May 28 04:42:50.690413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e890cea2-f2ef-4c84-8e42-685786ab8900 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:50.691545 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1139/2347] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:50 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:50.699109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-905dcc7e-69db-4616-b30c-52e1d78c6ea8 req-f099bf8e-3a02-47ea-ac38-44451f61b904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b94a91-20fe-40ac-bd67-2864eef657f6", "name": "network-vif-plugged", "status": "completed", "tag": "7dbb06ba-323b-4edc-bc6d-380122278f70"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:50.699269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:50.699269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e890cea2-f2ef-4c84-8e42-685786ab8900 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:50.700025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e890cea2-f2ef-4c84-8e42-685786ab8900 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:50.701009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e890cea2-f2ef-4c84-8e42-685786ab8900 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:50.701447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e890cea2-f2ef-4c84-8e42-685786ab8900 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:50.713989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-905dcc7e-69db-4616-b30c-52e1d78c6ea8 req-f099bf8e-3a02-47ea-ac38-44451f61b904 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:50.714440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-905dcc7e-69db-4616-b30c-52e1d78c6ea8 req-f099bf8e-3a02-47ea-ac38-44451f61b904 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:50.729096 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-905dcc7e-69db-4616-b30c-52e1d78c6ea8 req-f099bf8e-3a02-47ea-ac38-44451f61b904 service nova] Creating event network-vif-plugged:7dbb06ba-323b-4edc-bc6d-380122278f70 for instance 12b94a91-20fe-40ac-bd67-2864eef657f6 on n-h1-843700-1 May 28 04:42:50.734858 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-905dcc7e-69db-4616-b30c-52e1d78c6ea8 req-f099bf8e-3a02-47ea-ac38-44451f61b904 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042145 May 28 04:42:50.735721 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1140/2348] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:50.800022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e890cea2-f2ef-4c84-8e42-685786ab8900 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:50.812398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e890cea2-f2ef-4c84-8e42-685786ab8900 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:50.814868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e890cea2-f2ef-4c84-8e42-685786ab8900 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:50.816201 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e890cea2-f2ef-4c84-8e42-685786ab8900 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1357 microversion: 2.57 time: 0.131173 May 28 04:42:50.817050 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1209/2349] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:50 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1357 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:50.836541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:50.841368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b1494820-e6b3-4ff4-bf03-89225436854c tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:50.842190 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b1494820-e6b3-4ff4-bf03-89225436854c tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:50.849408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b1494820-e6b3-4ff4-bf03-89225436854c tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:50.851884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b1494820-e6b3-4ff4-bf03-89225436854c tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:50.852491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b1494820-e6b3-4ff4-bf03-89225436854c tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:50.852939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b1494820-e6b3-4ff4-bf03-89225436854c tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:50.875585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-495828de-326d-4c40-857b-568f0762c3af tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:50.875585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-495828de-326d-4c40-857b-568f0762c3af tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:50.881653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-495828de-326d-4c40-857b-568f0762c3af tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:50.882191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-495828de-326d-4c40-857b-568f0762c3af tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:50.883205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-495828de-326d-4c40-857b-568f0762c3af tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:50.883878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-495828de-326d-4c40-857b-568f0762c3af tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:50.893512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b1494820-e6b3-4ff4-bf03-89225436854c tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:42:50.930065 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-495828de-326d-4c40-857b-568f0762c3af tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061460 May 28 04:42:50.942289 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1210/2350] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:42:50 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:50.942289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ce66ec17-5a51-4f97-a64f-8d82c73ab21b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:50.942289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ce66ec17-5a51-4f97-a64f-8d82c73ab21b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:50.949135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce66ec17-5a51-4f97-a64f-8d82c73ab21b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:50.949709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce66ec17-5a51-4f97-a64f-8d82c73ab21b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:50.950514 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce66ec17-5a51-4f97-a64f-8d82c73ab21b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:50.951264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce66ec17-5a51-4f97-a64f-8d82c73ab21b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:51.138495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ce66ec17-5a51-4f97-a64f-8d82c73ab21b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:51.147301 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ce66ec17-5a51-4f97-a64f-8d82c73ab21b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.211114 May 28 04:42:51.147887 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1211/2351] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:50 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:51.152931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bf9dc855-2b2d-4843-a3dc-a6d12ae05238 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:51.153712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bf9dc855-2b2d-4843-a3dc-a6d12ae05238 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:51.159777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf9dc855-2b2d-4843-a3dc-a6d12ae05238 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:51.160304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf9dc855-2b2d-4843-a3dc-a6d12ae05238 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:51.161104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf9dc855-2b2d-4843-a3dc-a6d12ae05238 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:51.161554 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf9dc855-2b2d-4843-a3dc-a6d12ae05238 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:51.200600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:51.235458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bf9dc855-2b2d-4843-a3dc-a6d12ae05238 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:51.244090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bf9dc855-2b2d-4843-a3dc-a6d12ae05238 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:51.245335 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b1494820-e6b3-4ff4-bf03-89225436854c tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "DELETE /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 204 len: 0 microversion: 2.57 time: 0.409380 May 28 04:42:51.245821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bf9dc855-2b2d-4843-a3dc-a6d12ae05238 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:51.246298 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1141/2352] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:42:50 2022] DELETE /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:42:51.251147 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bf9dc855-2b2d-4843-a3dc-a6d12ae05238 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.102190 May 28 04:42:51.251896 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1212/2353] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:51 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:51.254702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d15280f8-5b28-4134-854f-f3ed875f6f1f tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:51.255516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d15280f8-5b28-4134-854f-f3ed875f6f1f tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:51.261712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d15280f8-5b28-4134-854f-f3ed875f6f1f tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:51.262161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d15280f8-5b28-4134-854f-f3ed875f6f1f tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:51.263011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d15280f8-5b28-4134-854f-f3ed875f6f1f tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:51.263456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d15280f8-5b28-4134-854f-f3ed875f6f1f tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:51.319757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=8 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:51.339315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d15280f8-5b28-4134-854f-f3ed875f6f1f tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:51.347826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d15280f8-5b28-4134-854f-f3ed875f6f1f tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:51.349344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d15280f8-5b28-4134-854f-f3ed875f6f1f tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:51.351385 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d15280f8-5b28-4134-854f-f3ed875f6f1f tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1363 microversion: 2.57 time: 0.100918 May 28 04:42:51.352127 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1142/2354] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:51 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1363 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:51.700841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-76bf7618-ada7-4878-b0dd-0375ac305cce tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:51.708128 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-76bf7618-ada7-4878-b0dd-0375ac305cce tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:51.708899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76bf7618-ada7-4878-b0dd-0375ac305cce tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:51.709395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76bf7618-ada7-4878-b0dd-0375ac305cce tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:51.710174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76bf7618-ada7-4878-b0dd-0375ac305cce tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:51.710621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76bf7618-ada7-4878-b0dd-0375ac305cce tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:51.715978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-16e27bb0-765f-4058-ad8c-f0b641af117b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:51.716607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-16e27bb0-765f-4058-ad8c-f0b641af117b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:51.724359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16e27bb0-765f-4058-ad8c-f0b641af117b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:51.725589 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16e27bb0-765f-4058-ad8c-f0b641af117b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:51.726573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16e27bb0-765f-4058-ad8c-f0b641af117b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:51.727047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16e27bb0-765f-4058-ad8c-f0b641af117b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:51.918880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-76bf7618-ada7-4878-b0dd-0375ac305cce tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:51.924311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-16e27bb0-765f-4058-ad8c-f0b641af117b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:51.931247 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-76bf7618-ada7-4878-b0dd-0375ac305cce tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1478 microversion: 2.1 time: 0.234328 May 28 04:42:51.941236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-16e27bb0-765f-4058-ad8c-f0b641af117b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:51.941236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-16e27bb0-765f-4058-ad8c-f0b641af117b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:51.941236 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-16e27bb0-765f-4058-ad8c-f0b641af117b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.225894 May 28 04:42:51.943029 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1213/2355] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:51 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1478 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:51.948376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1a10d88d-f097-4751-a96c-a531777fbf67 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:51.948606 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1143/2356] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:51 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:51.949887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1a10d88d-f097-4751-a96c-a531777fbf67 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:51.957724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a10d88d-f097-4751-a96c-a531777fbf67 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:51.958663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a10d88d-f097-4751-a96c-a531777fbf67 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:51.959441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a10d88d-f097-4751-a96c-a531777fbf67 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:51.960081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a10d88d-f097-4751-a96c-a531777fbf67 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:51.999546 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1a10d88d-f097-4751-a96c-a531777fbf67 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055146 May 28 04:42:52.000330 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1214/2357] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:42:51 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:42:52.062321 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2a938c3d-160c-417a-a482-2a1df7ccd232 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:52.063364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2a938c3d-160c-417a-a482-2a1df7ccd232 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:52.069598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a938c3d-160c-417a-a482-2a1df7ccd232 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:52.070049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a938c3d-160c-417a-a482-2a1df7ccd232 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:52.070925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a938c3d-160c-417a-a482-2a1df7ccd232 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:52.071376 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a938c3d-160c-417a-a482-2a1df7ccd232 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:52.104248 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2a938c3d-160c-417a-a482-2a1df7ccd232 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045880 May 28 04:42:52.111723 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1144/2358] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:42:52 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:42:52.166646 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ebc57c32-af29-4c20-a0a7-224f109d3482 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:52.168259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ebc57c32-af29-4c20-a0a7-224f109d3482 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:52.168862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-90acaa4e-9aba-44da-9125-b37cc51af406 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:52.169895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-90acaa4e-9aba-44da-9125-b37cc51af406 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:52.174625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebc57c32-af29-4c20-a0a7-224f109d3482 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:52.175119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebc57c32-af29-4c20-a0a7-224f109d3482 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:52.176193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebc57c32-af29-4c20-a0a7-224f109d3482 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:52.176947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebc57c32-af29-4c20-a0a7-224f109d3482 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:52.178586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90acaa4e-9aba-44da-9125-b37cc51af406 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:52.179480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90acaa4e-9aba-44da-9125-b37cc51af406 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:52.183369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90acaa4e-9aba-44da-9125-b37cc51af406 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:52.184167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90acaa4e-9aba-44da-9125-b37cc51af406 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:52.204502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ebc57c32-af29-4c20-a0a7-224f109d3482 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:42:52.384057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-90acaa4e-9aba-44da-9125-b37cc51af406 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:52.394011 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-90acaa4e-9aba-44da-9125-b37cc51af406 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.233058 May 28 04:42:52.404865 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1215/2359] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:52 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:52.411532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cf6e8a32-47b0-4f45-bafa-2985b2772808 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:52.419743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cf6e8a32-47b0-4f45-bafa-2985b2772808 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:52.419939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf6e8a32-47b0-4f45-bafa-2985b2772808 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:52.420393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf6e8a32-47b0-4f45-bafa-2985b2772808 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:52.421524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf6e8a32-47b0-4f45-bafa-2985b2772808 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:52.422105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf6e8a32-47b0-4f45-bafa-2985b2772808 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:52.434106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:52.515181 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cf6e8a32-47b0-4f45-bafa-2985b2772808 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:52.526750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cf6e8a32-47b0-4f45-bafa-2985b2772808 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:52.529492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cf6e8a32-47b0-4f45-bafa-2985b2772808 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:52.532430 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ebc57c32-af29-4c20-a0a7-224f109d3482 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 204 len: 0 microversion: 2.1 time: 0.369557 May 28 04:42:52.537420 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1145/2360] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:42:52 2022] DELETE /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:42:52.537607 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cf6e8a32-47b0-4f45-bafa-2985b2772808 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.130577 May 28 04:42:52.538329 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1216/2361] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:52 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:52.540443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-170b7f92-95db-4e83-9cfd-4143951a9b92 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:52.542544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-170b7f92-95db-4e83-9cfd-4143951a9b92 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:52.543884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0719a866-faf3-4642-9bde-9feaa943c6ea tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:52.544739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0719a866-faf3-4642-9bde-9feaa943c6ea tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:52.553368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-170b7f92-95db-4e83-9cfd-4143951a9b92 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:52.553977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-170b7f92-95db-4e83-9cfd-4143951a9b92 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:52.554827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-170b7f92-95db-4e83-9cfd-4143951a9b92 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:52.560423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0719a866-faf3-4642-9bde-9feaa943c6ea tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:52.560577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-170b7f92-95db-4e83-9cfd-4143951a9b92 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:52.560674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0719a866-faf3-4642-9bde-9feaa943c6ea tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:52.560674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0719a866-faf3-4642-9bde-9feaa943c6ea tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:52.560674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0719a866-faf3-4642-9bde-9feaa943c6ea tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:52.691384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-170b7f92-95db-4e83-9cfd-4143951a9b92 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:52.701287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-170b7f92-95db-4e83-9cfd-4143951a9b92 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:52.702799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-170b7f92-95db-4e83-9cfd-4143951a9b92 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:52.704258 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-170b7f92-95db-4e83-9cfd-4143951a9b92 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1363 microversion: 2.57 time: 0.169419 May 28 04:42:52.705232 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1146/2362] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:52 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:52.801360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0719a866-faf3-4642-9bde-9feaa943c6ea tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:52.810506 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0719a866-faf3-4642-9bde-9feaa943c6ea tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1680 microversion: 2.1 time: 0.270840 May 28 04:42:52.812384 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1217/2363] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:52 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1680 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:52.948716 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c52fe065-6ff2-440a-ab90-64d83b38b8b4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:52.950036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c52fe065-6ff2-440a-ab90-64d83b38b8b4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:52.965425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8cdb6a58-c2d5-4462-b40c-4416f7d0ff5f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:52.966055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c52fe065-6ff2-440a-ab90-64d83b38b8b4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:52.966906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8cdb6a58-c2d5-4462-b40c-4416f7d0ff5f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:52.967683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c52fe065-6ff2-440a-ab90-64d83b38b8b4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:52.969027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c52fe065-6ff2-440a-ab90-64d83b38b8b4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:52.971034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c52fe065-6ff2-440a-ab90-64d83b38b8b4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:52.978878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8cdb6a58-c2d5-4462-b40c-4416f7d0ff5f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:52.979769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8cdb6a58-c2d5-4462-b40c-4416f7d0ff5f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:52.980941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8cdb6a58-c2d5-4462-b40c-4416f7d0ff5f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:52.981612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8cdb6a58-c2d5-4462-b40c-4416f7d0ff5f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:53.197468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8cdb6a58-c2d5-4462-b40c-4416f7d0ff5f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:53.206276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c52fe065-6ff2-440a-ab90-64d83b38b8b4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:53.208484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8cdb6a58-c2d5-4462-b40c-4416f7d0ff5f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:53.211238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8cdb6a58-c2d5-4462-b40c-4416f7d0ff5f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:53.212686 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8cdb6a58-c2d5-4462-b40c-4416f7d0ff5f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.258326 May 28 04:42:53.213499 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1218/2364] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:52 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:53.215214 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c52fe065-6ff2-440a-ab90-64d83b38b8b4 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1463 microversion: 2.1 time: 0.270802 May 28 04:42:53.215994 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1147/2365] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:52 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1463 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:53.240974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a354ba43-5cab-4aae-bcec-b085ce708d0d tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:53.242276 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a354ba43-5cab-4aae-bcec-b085ce708d0d tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:53.250722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a354ba43-5cab-4aae-bcec-b085ce708d0d tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:53.252872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a354ba43-5cab-4aae-bcec-b085ce708d0d tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:53.253695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a354ba43-5cab-4aae-bcec-b085ce708d0d tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:53.254163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a354ba43-5cab-4aae-bcec-b085ce708d0d tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:53.411974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fbf0debe-51c4-42bb-9fbb-fd24d4ba256a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:53.412676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fbf0debe-51c4-42bb-9fbb-fd24d4ba256a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:53.418812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbf0debe-51c4-42bb-9fbb-fd24d4ba256a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:53.419299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbf0debe-51c4-42bb-9fbb-fd24d4ba256a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:53.420159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbf0debe-51c4-42bb-9fbb-fd24d4ba256a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:53.420510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbf0debe-51c4-42bb-9fbb-fd24d4ba256a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:53.479226 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a354ba43-5cab-4aae-bcec-b085ce708d0d tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6/action" status: 202 len: 0 microversion: 2.1 time: 0.242525 May 28 04:42:53.480167 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1219/2366] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:42:53 2022] POST /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:42:53.488565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b306275f-4950-457d-9252-b6d2ce314080 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:53.489326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b306275f-4950-457d-9252-b6d2ce314080 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:53.496765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b306275f-4950-457d-9252-b6d2ce314080 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:53.497230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b306275f-4950-457d-9252-b6d2ce314080 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:53.498025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b306275f-4950-457d-9252-b6d2ce314080 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:53.498474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b306275f-4950-457d-9252-b6d2ce314080 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:53.541696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b306275f-4950-457d-9252-b6d2ce314080 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:53.542232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b306275f-4950-457d-9252-b6d2ce314080 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:53.542873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-b306275f-4950-457d-9252-b6d2ce314080 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lazy-loading 'fault' on Instance uuid 12b94a91-20fe-40ac-bd67-2864eef657f6 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:42:53.575067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fbf0debe-51c4-42bb-9fbb-fd24d4ba256a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:53.584004 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fbf0debe-51c4-42bb-9fbb-fd24d4ba256a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.176091 May 28 04:42:53.594244 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1148/2367] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:53 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:53.594244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d7689226-cd5a-4790-b682-9b40e0e0b754 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:53.594244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d7689226-cd5a-4790-b682-9b40e0e0b754 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:53.596903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d7689226-cd5a-4790-b682-9b40e0e0b754 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:53.599748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d7689226-cd5a-4790-b682-9b40e0e0b754 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:53.599748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d7689226-cd5a-4790-b682-9b40e0e0b754 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:53.599748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d7689226-cd5a-4790-b682-9b40e0e0b754 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:53.679980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d7689226-cd5a-4790-b682-9b40e0e0b754 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:53.692126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d7689226-cd5a-4790-b682-9b40e0e0b754 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:53.694618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d7689226-cd5a-4790-b682-9b40e0e0b754 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:53.702150 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d7689226-cd5a-4790-b682-9b40e0e0b754 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.115962 May 28 04:42:53.706247 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b306275f-4950-457d-9252-b6d2ce314080 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1597 microversion: 2.1 time: 0.221924 May 28 04:42:53.707032 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1220/2368] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:53 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1597 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:53.715023 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1149/2369] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:53 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:53.724087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-763739b7-e6d8-4ab9-907d-2d7b5b15cef5 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:53.724698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-763739b7-e6d8-4ab9-907d-2d7b5b15cef5 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:53.736705 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8c90ea49-3365-4198-afa4-c198c40b51b1 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:53.737714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8c90ea49-3365-4198-afa4-c198c40b51b1 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:53.741659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-763739b7-e6d8-4ab9-907d-2d7b5b15cef5 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:53.750961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-763739b7-e6d8-4ab9-907d-2d7b5b15cef5 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:53.750961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-763739b7-e6d8-4ab9-907d-2d7b5b15cef5 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:53.750961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-763739b7-e6d8-4ab9-907d-2d7b5b15cef5 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:53.751790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c90ea49-3365-4198-afa4-c198c40b51b1 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:53.751790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c90ea49-3365-4198-afa4-c198c40b51b1 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:53.751790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c90ea49-3365-4198-afa4-c198c40b51b1 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:53.751790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c90ea49-3365-4198-afa4-c198c40b51b1 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:53.823753 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-763739b7-e6d8-4ab9-907d-2d7b5b15cef5 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:53.828403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:53.836741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-763739b7-e6d8-4ab9-907d-2d7b5b15cef5 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:53.838629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-763739b7-e6d8-4ab9-907d-2d7b5b15cef5 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:53.841029 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-763739b7-e6d8-4ab9-907d-2d7b5b15cef5 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1363 microversion: 2.57 time: 0.120914 May 28 04:42:53.841829 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1221/2370] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:53 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1363 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:53.847251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-20e0bba2-14cd-4220-a45c-7b343050fa37 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:53.848289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-20e0bba2-14cd-4220-a45c-7b343050fa37 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:53.855233 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-20e0bba2-14cd-4220-a45c-7b343050fa37 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:53.856020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-20e0bba2-14cd-4220-a45c-7b343050fa37 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:53.856887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-20e0bba2-14cd-4220-a45c-7b343050fa37 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:53.857425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-20e0bba2-14cd-4220-a45c-7b343050fa37 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:54.006400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-20e0bba2-14cd-4220-a45c-7b343050fa37 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:54.014047 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-20e0bba2-14cd-4220-a45c-7b343050fa37 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1680 microversion: 2.1 time: 0.170939 May 28 04:42:54.015820 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1222/2371] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:53 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:54.045326 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8c90ea49-3365-4198-afa4-c198c40b51b1 tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6/action" status: 202 len: 0 microversion: 2.1 time: 0.311954 May 28 04:42:54.046680 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1150/2372] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:42:53 2022] POST /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:42:54.055551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-58891645-71bd-4816-b28a-dc2a7099ffbf tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:54.056244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-58891645-71bd-4816-b28a-dc2a7099ffbf tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:54.062772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58891645-71bd-4816-b28a-dc2a7099ffbf tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:54.063316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58891645-71bd-4816-b28a-dc2a7099ffbf tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:54.064082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58891645-71bd-4816-b28a-dc2a7099ffbf tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:54.064523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58891645-71bd-4816-b28a-dc2a7099ffbf tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:54.210331 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-58891645-71bd-4816-b28a-dc2a7099ffbf tempest-ServersAdminTestJSON-745653558 tempest-ServersAdminTestJSON-745653558-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1614 microversion: 2.1 time: 0.158959 May 28 04:42:54.211039 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1223/2373] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:54 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1614 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:54.227612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f9ffb1f2-a094-4574-8192-fd778d33d4ba tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:54.232304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f9ffb1f2-a094-4574-8192-fd778d33d4ba tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 2e714899-ae82-47c5-bd72-a65a0b4734a4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:54.234497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9ffb1f2-a094-4574-8192-fd778d33d4ba tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:54.235204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9ffb1f2-a094-4574-8192-fd778d33d4ba tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:54.236177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9ffb1f2-a094-4574-8192-fd778d33d4ba tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:54.236889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9ffb1f2-a094-4574-8192-fd778d33d4ba tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:54.238663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-655b56ed-ab40-407b-afdb-1763cafb01ec tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:54.244026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-655b56ed-ab40-407b-afdb-1763cafb01ec tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:54.256374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-655b56ed-ab40-407b-afdb-1763cafb01ec tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:54.256374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-655b56ed-ab40-407b-afdb-1763cafb01ec tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:54.256374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-655b56ed-ab40-407b-afdb-1763cafb01ec tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:54.257106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-655b56ed-ab40-407b-afdb-1763cafb01ec tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:54.280916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f9ffb1f2-a094-4574-8192-fd778d33d4ba tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 2e714899-ae82-47c5-bd72-a65a0b4734a4] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:42:54.288659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:42:54.426945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-655b56ed-ab40-407b-afdb-1763cafb01ec tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:54.437061 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-655b56ed-ab40-407b-afdb-1763cafb01ec tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:54.438943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-655b56ed-ab40-407b-afdb-1763cafb01ec tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:54.440199 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-655b56ed-ab40-407b-afdb-1763cafb01ec tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.206753 May 28 04:42:54.441184 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1224/2374] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:54 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:54.601826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-db499053-fb99-49f5-83e1-bef7f84aafdc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:54.602711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-db499053-fb99-49f5-83e1-bef7f84aafdc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:54.609459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db499053-fb99-49f5-83e1-bef7f84aafdc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:54.610079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db499053-fb99-49f5-83e1-bef7f84aafdc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:54.611049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db499053-fb99-49f5-83e1-bef7f84aafdc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:54.611604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db499053-fb99-49f5-83e1-bef7f84aafdc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:54.663608 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f9ffb1f2-a094-4574-8192-fd778d33d4ba tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4" status: 204 len: 0 microversion: 2.1 time: 0.439650 May 28 04:42:54.664678 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1151/2375] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:42:54 2022] DELETE /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:42:54.674099 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5c67015e-6617-431e-a266-e3e013e695bb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:54.675418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5c67015e-6617-431e-a266-e3e013e695bb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 2e714899-ae82-47c5-bd72-a65a0b4734a4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:54.682746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c67015e-6617-431e-a266-e3e013e695bb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:54.690123 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c67015e-6617-431e-a266-e3e013e695bb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:54.690123 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c67015e-6617-431e-a266-e3e013e695bb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:54.690123 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c67015e-6617-431e-a266-e3e013e695bb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:54.922409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5c67015e-6617-431e-a266-e3e013e695bb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:54.923548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-db499053-fb99-49f5-83e1-bef7f84aafdc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:54.935559 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-db499053-fb99-49f5-83e1-bef7f84aafdc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.338060 May 28 04:42:54.935791 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5c67015e-6617-431e-a266-e3e013e695bb tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4" status: 200 len: 1468 microversion: 2.1 time: 0.266570 May 28 04:42:54.945975 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1225/2376] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:54 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:54.952423 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1152/2377] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:54 2022] GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4 => generated 1468 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:54.952579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3af2518d-14dd-4717-9332-b5e9ed0e6ff9 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:54.952579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3af2518d-14dd-4717-9332-b5e9ed0e6ff9 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:54.952799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2913841f-8f7f-4514-ab02-a745a271239d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:54.953038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2913841f-8f7f-4514-ab02-a745a271239d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:54.959128 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3af2518d-14dd-4717-9332-b5e9ed0e6ff9 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:54.959595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3af2518d-14dd-4717-9332-b5e9ed0e6ff9 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:54.960426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3af2518d-14dd-4717-9332-b5e9ed0e6ff9 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:54.960875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3af2518d-14dd-4717-9332-b5e9ed0e6ff9 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:54.961424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2913841f-8f7f-4514-ab02-a745a271239d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:54.961971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2913841f-8f7f-4514-ab02-a745a271239d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:54.962861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2913841f-8f7f-4514-ab02-a745a271239d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:54.963547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2913841f-8f7f-4514-ab02-a745a271239d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:55.025682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2913841f-8f7f-4514-ab02-a745a271239d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:55.026598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2913841f-8f7f-4514-ab02-a745a271239d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:55.027302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-2913841f-8f7f-4514-ab02-a745a271239d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lazy-loading 'fault' on Instance uuid 341b154c-5e9b-42a0-b87d-b0a90296ffa8 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:42:55.041924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3af2518d-14dd-4717-9332-b5e9ed0e6ff9 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:55.051161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3af2518d-14dd-4717-9332-b5e9ed0e6ff9 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:55.052179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3af2518d-14dd-4717-9332-b5e9ed0e6ff9 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:55.057824 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3af2518d-14dd-4717-9332-b5e9ed0e6ff9 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.110421 May 28 04:42:55.059084 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1226/2378] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:54 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:55.063820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aad88f0a-f741-4cd5-954c-98930da0caca tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:55.064437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aad88f0a-f741-4cd5-954c-98930da0caca tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:55.072308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aad88f0a-f741-4cd5-954c-98930da0caca tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:55.072758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aad88f0a-f741-4cd5-954c-98930da0caca tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:55.073648 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aad88f0a-f741-4cd5-954c-98930da0caca tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:55.074097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aad88f0a-f741-4cd5-954c-98930da0caca tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:55.133012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2913841f-8f7f-4514-ab02-a745a271239d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:55.144072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2913841f-8f7f-4514-ab02-a745a271239d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:55.145716 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2913841f-8f7f-4514-ab02-a745a271239d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e947cd97b347d884f86d8a7c8a5fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fc7a1dcfe0415aa89d8d8f219cef09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:55.153067 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2913841f-8f7f-4514-ab02-a745a271239d tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 200 len: 1368 microversion: 2.57 time: 0.202136 May 28 04:42:55.153067 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1153/2379] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:54 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:55.180543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aad88f0a-f741-4cd5-954c-98930da0caca tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:55.191932 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aad88f0a-f741-4cd5-954c-98930da0caca tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1612 microversion: 2.1 time: 0.132007 May 28 04:42:55.193693 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1227/2380] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:55 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1612 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:55.459931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-06a3fce5-106f-45d2-b00f-11bf84e7f7fe tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:55.460725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-06a3fce5-106f-45d2-b00f-11bf84e7f7fe tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:55.467091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06a3fce5-106f-45d2-b00f-11bf84e7f7fe tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:55.467549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06a3fce5-106f-45d2-b00f-11bf84e7f7fe tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:55.468630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06a3fce5-106f-45d2-b00f-11bf84e7f7fe tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:55.469090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06a3fce5-106f-45d2-b00f-11bf84e7f7fe tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:55.622414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-06a3fce5-106f-45d2-b00f-11bf84e7f7fe tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:55.632807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-06a3fce5-106f-45d2-b00f-11bf84e7f7fe tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:55.634612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-06a3fce5-106f-45d2-b00f-11bf84e7f7fe tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:55.636083 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-06a3fce5-106f-45d2-b00f-11bf84e7f7fe tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.180557 May 28 04:42:55.636676 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1154/2381] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:55 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:55.756583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-f83e4c20-6dfa-4abf-846a-bc2519c46b1f req-a03aa351-ceb8-42f9-a88f-0fb6292c9756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f4e280f-6de0-467b-b4ac-c13f9e780963", "name": "network-vif-deleted", "tag": "6d445514-75cc-4831-8830-2257b5e25b63"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:55.766804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f83e4c20-6dfa-4abf-846a-bc2519c46b1f req-a03aa351-ceb8-42f9-a88f-0fb6292c9756 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:55.767358 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f83e4c20-6dfa-4abf-846a-bc2519c46b1f req-a03aa351-ceb8-42f9-a88f-0fb6292c9756 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:55.780687 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-f83e4c20-6dfa-4abf-846a-bc2519c46b1f req-a03aa351-ceb8-42f9-a88f-0fb6292c9756 service nova] Creating event network-vif-deleted:6d445514-75cc-4831-8830-2257b5e25b63 for instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 on n-h2-843700-1 May 28 04:42:55.786224 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-f83e4c20-6dfa-4abf-846a-bc2519c46b1f req-a03aa351-ceb8-42f9-a88f-0fb6292c9756 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034273 May 28 04:42:55.790925 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1228/2382] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:55.952907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-736643e6-968d-46c1-af6b-35e5197f6580 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:55.953743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c369a7e2-580f-4652-a96e-31c15793603c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:55.954924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c369a7e2-580f-4652-a96e-31c15793603c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 2e714899-ae82-47c5-bd72-a65a0b4734a4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:55.955209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-736643e6-968d-46c1-af6b-35e5197f6580 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:55.963735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-736643e6-968d-46c1-af6b-35e5197f6580 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:55.964476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-736643e6-968d-46c1-af6b-35e5197f6580 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:55.965447 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-736643e6-968d-46c1-af6b-35e5197f6580 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:55.966211 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-736643e6-968d-46c1-af6b-35e5197f6580 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:55.969184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c369a7e2-580f-4652-a96e-31c15793603c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:55.969878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c369a7e2-580f-4652-a96e-31c15793603c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:55.970799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c369a7e2-580f-4652-a96e-31c15793603c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:55.972028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c369a7e2-580f-4652-a96e-31c15793603c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:56.632549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c369a7e2-580f-4652-a96e-31c15793603c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:56.644763 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c369a7e2-580f-4652-a96e-31c15793603c tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4" status: 200 len: 1468 microversion: 2.1 time: 0.695627 May 28 04:42:56.657991 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1229/2383] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:55 2022] GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4 => generated 1468 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:56.675084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e56ee901-d802-4468-a1a4-a3700da51ca6 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:56.675682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e56ee901-d802-4468-a1a4-a3700da51ca6 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:56.683982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e56ee901-d802-4468-a1a4-a3700da51ca6 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:56.687567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e56ee901-d802-4468-a1a4-a3700da51ca6 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:56.687567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e56ee901-d802-4468-a1a4-a3700da51ca6 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:56.687567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e56ee901-d802-4468-a1a4-a3700da51ca6 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:56.730671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-736643e6-968d-46c1-af6b-35e5197f6580 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:56.744462 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-736643e6-968d-46c1-af6b-35e5197f6580 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.795587 May 28 04:42:56.745201 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1155/2384] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:55 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:56.750897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-30350a6a-f49d-4a41-af53-3f9398105016 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:56.751553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-30350a6a-f49d-4a41-af53-3f9398105016 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] [instance: 341b154c-5e9b-42a0-b87d-b0a90296ffa8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:56.760283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-30350a6a-f49d-4a41-af53-3f9398105016 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:56.760741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-30350a6a-f49d-4a41-af53-3f9398105016 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:56.761539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-30350a6a-f49d-4a41-af53-3f9398105016 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:56.761985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-30350a6a-f49d-4a41-af53-3f9398105016 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:56.778758 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-30350a6a-f49d-4a41-af53-3f9398105016 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] HTTP exception thrown: Instance 341b154c-5e9b-42a0-b87d-b0a90296ffa8 could not be found. May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-30350a6a-f49d-4a41-af53-3f9398105016 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Request method failure captured: May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 HTTP/1.1 May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikagbBdD7-tJkuo9_sz5qyprlZ4wPM8_pj0zkH8R13uRbQJ7cFjhQEwqIVfAMCLIUiUeu6jNxHao0sIx3yrPmCkOwTbLKdB-7BTuqnnaLhEKijDBsUvMHFW5Ij7zeALplhOBedCvdCNf_OJ7j3p_RE0b0dMa3XyDj8hbz9SVFCeMDikY May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-Openstack-Nova-Api-Version: 2.57 May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 37fc7a1dcfe0415aa89d8d8f219cef09 May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerShowV257Test-572657219 May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_37fc7a1dcfe0415aa89d8d8f219cef09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/37fc7a1dcfe0415aa89d8d8f219cef09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/37fc7a1dcfe0415aa89d8d8f219cef09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/37fc7a1dcfe0415aa89d8d8f219cef09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerShowV257Test-572657219 May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 37fc7a1dcfe0415aa89d8d8f219cef09 May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerShowV257Test-572657219 May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerShowV257Test-572657219-project May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: f5e947cd97b347d884f86d8a7c8a5fef May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerShowV257Test-572657219-project May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 341b154c-5e9b-42a0-b87d-b0a90296ffa8 could not be found. May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '341b154c-5e9b-42a0-b87d-b0a90296ffa8'} May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 341b154c-5e9b-42a0-b87d-b0a90296ffa8 could not be found. May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 341b154c-5e9b-42a0-b87d-b0a90296ffa8 could not be found. May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:42:56.780801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:42:56.786847 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:42:56.786847 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:42:56.786847 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:42:56.786847 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:42:56.786847 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:42:56.786847 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 341b154c-5e9b-42a0-b87d-b0a90296ffa8 could not be found. May 28 04:42:56.786847 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:42:56.786847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-30350a6a-f49d-4a41-af53-3f9398105016 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] Returning 404 to user: Instance 341b154c-5e9b-42a0-b87d-b0a90296ffa8 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:42:56.786847 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-30350a6a-f49d-4a41-af53-3f9398105016 tempest-ServerShowV257Test-572657219 tempest-ServerShowV257Test-572657219-project] 10.222.0.58 "GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8" status: 404 len: 111 microversion: 2.57 time: 0.035819 May 28 04:42:56.786847 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1156/2385] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:56 2022] GET /compute/v2.1/servers/341b154c-5e9b-42a0-b87d-b0a90296ffa8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 04:42:56.793918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9ed620db-48e8-4316-b8b6-530d37173443 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:56.793918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9ed620db-48e8-4316-b8b6-530d37173443 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:56.800807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ed620db-48e8-4316-b8b6-530d37173443 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:56.801276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ed620db-48e8-4316-b8b6-530d37173443 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:56.802330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ed620db-48e8-4316-b8b6-530d37173443 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:56.803586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ed620db-48e8-4316-b8b6-530d37173443 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:56.809999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e56ee901-d802-4468-a1a4-a3700da51ca6 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:56.829728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e56ee901-d802-4468-a1a4-a3700da51ca6 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:56.831566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e56ee901-d802-4468-a1a4-a3700da51ca6 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:56.843253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ed620db-48e8-4316-b8b6-530d37173443 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:56.845261 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ed620db-48e8-4316-b8b6-530d37173443 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:56.845952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-9ed620db-48e8-4316-b8b6-530d37173443 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lazy-loading 'fault' on Instance uuid 7f4e280f-6de0-467b-b4ac-c13f9e780963 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:42:56.850315 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e56ee901-d802-4468-a1a4-a3700da51ca6 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.182443 May 28 04:42:56.862551 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1230/2386] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:56 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:56.866901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dac0f6e7-901a-44af-b565-9359505a28c7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:56.869871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dac0f6e7-901a-44af-b565-9359505a28c7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:56.881463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dac0f6e7-901a-44af-b565-9359505a28c7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:56.882078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dac0f6e7-901a-44af-b565-9359505a28c7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:56.882879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dac0f6e7-901a-44af-b565-9359505a28c7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:56.883408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dac0f6e7-901a-44af-b565-9359505a28c7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:57.000807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9ed620db-48e8-4316-b8b6-530d37173443 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e2ff86a2484cd38b6e4176109f6b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cf1a786cba41cd88ea6a766ca8a673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:57.011762 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9ed620db-48e8-4316-b8b6-530d37173443 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 200 len: 1332 microversion: 2.1 time: 0.227177 May 28 04:42:57.012839 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1157/2387] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:56 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 1332 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:57.107504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dac0f6e7-901a-44af-b565-9359505a28c7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:57.122030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dac0f6e7-901a-44af-b565-9359505a28c7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:57.124340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dac0f6e7-901a-44af-b565-9359505a28c7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:57.127435 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dac0f6e7-901a-44af-b565-9359505a28c7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.266054 May 28 04:42:57.127435 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1231/2388] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:56 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:57.374746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-974ffe2a-2ac0-4122-995d-8a60d7df0d4a req-64c42d3c-b0d9-43b4-bd3b-fd96002f9bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e714899-ae82-47c5-bd72-a65a0b4734a4", "name": "network-vif-deleted", "tag": "ab17ea28-3974-4717-9100-cb1f12026e9f"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:42:57.384696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-974ffe2a-2ac0-4122-995d-8a60d7df0d4a req-64c42d3c-b0d9-43b4-bd3b-fd96002f9bde service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:57.385162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-974ffe2a-2ac0-4122-995d-8a60d7df0d4a req-64c42d3c-b0d9-43b4-bd3b-fd96002f9bde service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:57.412647 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-974ffe2a-2ac0-4122-995d-8a60d7df0d4a req-64c42d3c-b0d9-43b4-bd3b-fd96002f9bde service nova] Creating event network-vif-deleted:ab17ea28-3974-4717-9100-cb1f12026e9f for instance 2e714899-ae82-47c5-bd72-a65a0b4734a4 on n-h1-843700-1 May 28 04:42:57.421110 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-974ffe2a-2ac0-4122-995d-8a60d7df0d4a req-64c42d3c-b0d9-43b4-bd3b-fd96002f9bde service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050366 May 28 04:42:57.425407 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1158/2389] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:57.666367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-614adb3e-60b3-4c39-acca-7b31521202f8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:57.667009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-614adb3e-60b3-4c39-acca-7b31521202f8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 2e714899-ae82-47c5-bd72-a65a0b4734a4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:57.674247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-614adb3e-60b3-4c39-acca-7b31521202f8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:57.675048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-614adb3e-60b3-4c39-acca-7b31521202f8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:57.676235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-614adb3e-60b3-4c39-acca-7b31521202f8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:57.678453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-614adb3e-60b3-4c39-acca-7b31521202f8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:57.762095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-614adb3e-60b3-4c39-acca-7b31521202f8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:57.770559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dbb5ffb1-3ce3-42c7-b308-50ff3db808d4 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:57.772021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dbb5ffb1-3ce3-42c7-b308-50ff3db808d4 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:57.778414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dbb5ffb1-3ce3-42c7-b308-50ff3db808d4 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:57.779165 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-614adb3e-60b3-4c39-acca-7b31521202f8 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4" status: 200 len: 1297 microversion: 2.1 time: 0.117448 May 28 04:42:57.779336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dbb5ffb1-3ce3-42c7-b308-50ff3db808d4 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:57.779765 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1232/2390] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:57 2022] GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4 => generated 1297 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:57.780050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dbb5ffb1-3ce3-42c7-b308-50ff3db808d4 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:57.780751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dbb5ffb1-3ce3-42c7-b308-50ff3db808d4 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:57.870904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c2b132a4-64bd-4389-b3c3-9aec0cf11044 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:57.871685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c2b132a4-64bd-4389-b3c3-9aec0cf11044 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:57.877988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2b132a4-64bd-4389-b3c3-9aec0cf11044 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:57.878508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2b132a4-64bd-4389-b3c3-9aec0cf11044 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:57.879793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2b132a4-64bd-4389-b3c3-9aec0cf11044 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:57.880339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2b132a4-64bd-4389-b3c3-9aec0cf11044 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:58.022142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c2b132a4-64bd-4389-b3c3-9aec0cf11044 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:58.030862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c2b132a4-64bd-4389-b3c3-9aec0cf11044 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:58.032596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c2b132a4-64bd-4389-b3c3-9aec0cf11044 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:58.046812 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c2b132a4-64bd-4389-b3c3-9aec0cf11044 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.180162 May 28 04:42:58.059227 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1233/2391] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:57 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:58.059227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e9c04328-4c33-4fc7-ab79-e7dd1dbb91e5 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:58.059227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e9c04328-4c33-4fc7-ab79-e7dd1dbb91e5 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:58.059227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9c04328-4c33-4fc7-ab79-e7dd1dbb91e5 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:58.060135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9c04328-4c33-4fc7-ab79-e7dd1dbb91e5 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:58.061041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9c04328-4c33-4fc7-ab79-e7dd1dbb91e5 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:58.061041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9c04328-4c33-4fc7-ab79-e7dd1dbb91e5 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:58.078515 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-e9c04328-4c33-4fc7-ab79-e7dd1dbb91e5 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] HTTP exception thrown: Instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 could not be found. May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e9c04328-4c33-4fc7-ab79-e7dd1dbb91e5 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Request method failure captured: May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 HTTP/1.1 May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaekTXunuyl_KpGuIEvq6GM-tp6IzyfiiepiNlixAq6BM-u2Jr3PM4bkVXlkwwqG60-8wmnpAVGie7FpIwQD-EMAVlElLGs5ksCpIKM-eIHqe6U5vMDKn7ArfQ24H0PRQgSHooX54t-XVr9cqTI2ZJOGcl1HDbmDfEB8c1avlZmrj_M May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: f5cf1a786cba41cd88ea6a766ca8a673 May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1163432414 May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f5cf1a786cba41cd88ea6a766ca8a673"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f5cf1a786cba41cd88ea6a766ca8a673"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5cf1a786cba41cd88ea6a766ca8a673"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5cf1a786cba41cd88ea6a766ca8a673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1163432414 May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: f5cf1a786cba41cd88ea6a766ca8a673 May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1163432414 May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AttachSCSIVolumeTestJSON-1163432414-project May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 99e2ff86a2484cd38b6e4176109f6b53 May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1163432414-project May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 could not be found. May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '7f4e280f-6de0-467b-b4ac-c13f9e780963'} May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 could not be found. May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 could not be found. May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:42:58.078844 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:42:58.085264 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:42:58.085264 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:42:58.085264 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:42:58.085264 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:42:58.085264 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:42:58.085264 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 could not be found. May 28 04:42:58.085264 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:42:58.085264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e9c04328-4c33-4fc7-ab79-e7dd1dbb91e5 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Returning 404 to user: Instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:42:58.085264 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e9c04328-4c33-4fc7-ab79-e7dd1dbb91e5 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 404 len: 111 microversion: 2.1 time: 0.032111 May 28 04:42:58.085264 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1234/2392] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:58 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:42:58.088051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dbb5ffb1-3ce3-42c7-b308-50ff3db808d4 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:58.091817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c3d1af7a-34d1-459d-a9a3-1a1cc0e18d28 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '.version_select at 0x7f7701de5b80>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:58.099223 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dbb5ffb1-3ce3-42c7-b308-50ff3db808d4 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.340434 May 28 04:42:58.102251 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1159/2393] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:57 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:42:58.145832 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f77ff758-0885-4fd7-bcf2-d7cbdd9ad0b5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:58.146979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f77ff758-0885-4fd7-bcf2-d7cbdd9ad0b5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:58.153598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f77ff758-0885-4fd7-bcf2-d7cbdd9ad0b5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:58.156561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f77ff758-0885-4fd7-bcf2-d7cbdd9ad0b5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:58.156561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f77ff758-0885-4fd7-bcf2-d7cbdd9ad0b5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:58.156561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f77ff758-0885-4fd7-bcf2-d7cbdd9ad0b5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:58.224101 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c3d1af7a-34d1-459d-a9a3-1a1cc0e18d28 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1637303593" status: 202 len: 0 microversion: 2.1 time: 0.136869 May 28 04:42:58.225654 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1235/2394] 10.222.0.58 () {58 vars in 1220 bytes} [Sat May 28 04:42:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1637303593 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:42:58.335392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f77ff758-0885-4fd7-bcf2-d7cbdd9ad0b5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:58.345466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f77ff758-0885-4fd7-bcf2-d7cbdd9ad0b5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:58.347359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f77ff758-0885-4fd7-bcf2-d7cbdd9ad0b5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:58.348828 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f77ff758-0885-4fd7-bcf2-d7cbdd9ad0b5 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.207333 May 28 04:42:58.350559 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1160/2395] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:58 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:58.801124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f16ce6b4-1938-40c3-abf5-955d63d74ee3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:58.803012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f16ce6b4-1938-40c3-abf5-955d63d74ee3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 2e714899-ae82-47c5-bd72-a65a0b4734a4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:58.814066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f16ce6b4-1938-40c3-abf5-955d63d74ee3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:58.814534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f16ce6b4-1938-40c3-abf5-955d63d74ee3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:58.815526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f16ce6b4-1938-40c3-abf5-955d63d74ee3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:58.816864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f16ce6b4-1938-40c3-abf5-955d63d74ee3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:58.836475 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-f16ce6b4-1938-40c3-abf5-955d63d74ee3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] HTTP exception thrown: Instance 2e714899-ae82-47c5-bd72-a65a0b4734a4 could not be found. May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f16ce6b4-1938-40c3-abf5-955d63d74ee3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Request method failure captured: May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4 HTTP/1.1 May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikafMfbt2ghhvtNmhniorMdys3DWsZspcZ-UP1cx9sYVv6nlUx4WOTmZTUkluxIdlP99SFx65ktHfkEGVP8YEGPlb1yLxDNM-hRNDh1TZ24bvToVTe9oybPEtRB9XpeRYM_0A8l1WjXBDdlcrWWGWq0eQE_-gD3zMNk0HCCs8vbocfQ0 May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 13ea83404c554681912477aa3f6d0798 May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersAdminTestJSON-270789539 May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_13ea83404c554681912477aa3f6d0798"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/13ea83404c554681912477aa3f6d0798"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13ea83404c554681912477aa3f6d0798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13ea83404c554681912477aa3f6d0798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersAdminTestJSON-270789539 May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 13ea83404c554681912477aa3f6d0798 May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersAdminTestJSON-270789539 May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersAdminTestJSON-270789539-project May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 7850cd7487c94107b6cfdc0c956f01d0 May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersAdminTestJSON-270789539-project May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 2e714899-ae82-47c5-bd72-a65a0b4734a4 could not be found. May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '2e714899-ae82-47c5-bd72-a65a0b4734a4'} May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e714899-ae82-47c5-bd72-a65a0b4734a4 could not be found. May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e714899-ae82-47c5-bd72-a65a0b4734a4 could not be found. May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:42:58.838550 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:42:58.848906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:42:58.848906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:42:58.848906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:42:58.848906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:42:58.848906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:42:58.848906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e714899-ae82-47c5-bd72-a65a0b4734a4 could not be found. May 28 04:42:58.848906 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:42:58.848906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f16ce6b4-1938-40c3-abf5-955d63d74ee3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Returning 404 to user: Instance 2e714899-ae82-47c5-bd72-a65a0b4734a4 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:42:58.848906 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f16ce6b4-1938-40c3-abf5-955d63d74ee3 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4" status: 404 len: 111 microversion: 2.1 time: 0.043719 May 28 04:42:58.848906 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1236/2396] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:58 2022] GET /compute/v2.1/servers/2e714899-ae82-47c5-bd72-a65a0b4734a4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:42:58.850010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9add978a-c7bb-42c4-b9d1-09de1a525432 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:58.850010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9add978a-c7bb-42c4-b9d1-09de1a525432 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:58.858101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9add978a-c7bb-42c4-b9d1-09de1a525432 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:58.858101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9add978a-c7bb-42c4-b9d1-09de1a525432 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:58.858101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9add978a-c7bb-42c4-b9d1-09de1a525432 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:58.858454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9add978a-c7bb-42c4-b9d1-09de1a525432 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:58.897424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9add978a-c7bb-42c4-b9d1-09de1a525432 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:42:59.069907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-acac34c4-6c31-43aa-9b90-3b09e590a419 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:59.071100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-acac34c4-6c31-43aa-9b90-3b09e590a419 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:59.078142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-acac34c4-6c31-43aa-9b90-3b09e590a419 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:59.079208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-acac34c4-6c31-43aa-9b90-3b09e590a419 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:59.080211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-acac34c4-6c31-43aa-9b90-3b09e590a419 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:59.080731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-acac34c4-6c31-43aa-9b90-3b09e590a419 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:59.173153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-acac34c4-6c31-43aa-9b90-3b09e590a419 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:59.184233 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-acac34c4-6c31-43aa-9b90-3b09e590a419 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:59.188114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-acac34c4-6c31-43aa-9b90-3b09e590a419 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:59.195021 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-acac34c4-6c31-43aa-9b90-3b09e590a419 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.129162 May 28 04:42:59.208386 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1237/2397] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:59 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:42:59.215059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9e4337f8-dd3d-443d-b77d-e379ffb0f9e1 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:59.216184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9e4337f8-dd3d-443d-b77d-e379ffb0f9e1 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:59.221369 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9add978a-c7bb-42c4-b9d1-09de1a525432 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "DELETE /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 204 len: 0 microversion: 2.1 time: 0.375633 May 28 04:42:59.223558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e4337f8-dd3d-443d-b77d-e379ffb0f9e1 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:59.224558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e4337f8-dd3d-443d-b77d-e379ffb0f9e1 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:59.226676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e4337f8-dd3d-443d-b77d-e379ffb0f9e1 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:59.227740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e4337f8-dd3d-443d-b77d-e379ffb0f9e1 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:59.228810 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1161/2398] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:42:58 2022] DELETE /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:42:59.238823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2af5d9b0-eca3-4683-8f97-18be5d9edaef tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:59.239562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2af5d9b0-eca3-4683-8f97-18be5d9edaef tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:59.254466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2af5d9b0-eca3-4683-8f97-18be5d9edaef tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:59.254962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2af5d9b0-eca3-4683-8f97-18be5d9edaef tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:59.256338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2af5d9b0-eca3-4683-8f97-18be5d9edaef tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:59.256804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2af5d9b0-eca3-4683-8f97-18be5d9edaef tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:59.540854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9e4337f8-dd3d-443d-b77d-e379ffb0f9e1 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:59.542146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2af5d9b0-eca3-4683-8f97-18be5d9edaef tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:59.558336 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2af5d9b0-eca3-4683-8f97-18be5d9edaef tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 200 len: 1469 microversion: 2.1 time: 0.316593 May 28 04:42:59.558336 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1162/2399] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:59 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 1469 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:59.558336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-75dbe416-6438-4179-80e9-928fa9005433 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:59.558336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-75dbe416-6438-4179-80e9-928fa9005433 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:42:59.559804 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9e4337f8-dd3d-443d-b77d-e379ffb0f9e1 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.347933 May 28 04:42:59.560609 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1238/2400] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:42:59 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:42:59.564468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75dbe416-6438-4179-80e9-928fa9005433 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:59.564930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75dbe416-6438-4179-80e9-928fa9005433 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:59.565927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75dbe416-6438-4179-80e9-928fa9005433 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:59.566258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75dbe416-6438-4179-80e9-928fa9005433 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:59.719559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-75dbe416-6438-4179-80e9-928fa9005433 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:59.734794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-75dbe416-6438-4179-80e9-928fa9005433 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:59.736437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-75dbe416-6438-4179-80e9-928fa9005433 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:59.737661 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-75dbe416-6438-4179-80e9-928fa9005433 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.184863 May 28 04:42:59.738238 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1163/2401] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:42:59 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:42:59.783553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eb12eeba-a249-445d-8c17-f2cf691009c4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:59.788998 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-eb12eeba-a249-445d-8c17-f2cf691009c4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:59.790387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-eb12eeba-a249-445d-8c17-f2cf691009c4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Searching by: {'deleted': False, 'project_id': '30126363eb444c78a459e1beaa9ddce6'} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:42:59.795840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb12eeba-a249-445d-8c17-f2cf691009c4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:59.796778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb12eeba-a249-445d-8c17-f2cf691009c4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:59.797803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb12eeba-a249-445d-8c17-f2cf691009c4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:42:59.798411 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb12eeba-a249-445d-8c17-f2cf691009c4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:42:59.900373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.multi_cell_list [None req-eb12eeba-a249-445d-8c17-f2cf691009c4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:42:59.948696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-45ab2208-81f5-4182-9089-fe262282817e tempest-QuotasTestJSON-1850699983 tempest-QuotasTestJSON-1850699983-project] Calling method '.version_select at 0x7f7701cd5a60>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:59.972952 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-eb12eeba-a249-445d-8c17-f2cf691009c4 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.196019 May 28 04:42:59.974186 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1239/2402] 10.222.0.58 () {58 vars in 1124 bytes} [Sat May 28 04:42:59 2022] GET /compute/v2.1/servers => generated 343 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:42:59.985777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f9b6c855-120a-4bbc-aea6-5771a2abd036 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:42:59.991079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f9b6c855-120a-4bbc-aea6-5771a2abd036 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:42:59.993700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f9b6c855-120a-4bbc-aea6-5771a2abd036 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Searching by: {'deleted': False, 'project_id': '30126363eb444c78a459e1beaa9ddce6'} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:43:00.000886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9b6c855-120a-4bbc-aea6-5771a2abd036 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:00.001702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9b6c855-120a-4bbc-aea6-5771a2abd036 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:00.004052 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9b6c855-120a-4bbc-aea6-5771a2abd036 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:00.004588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9b6c855-120a-4bbc-aea6-5771a2abd036 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:00.067765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.multi_cell_list [None req-f9b6c855-120a-4bbc-aea6-5771a2abd036 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:43:00.114235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:00.117186 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-45ab2208-81f5-4182-9089-fe262282817e tempest-QuotasTestJSON-1850699983 tempest-QuotasTestJSON-1850699983-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/b706b0924270457ebefedda125d1ebe2/defaults" status: 200 len: 371 microversion: 2.1 time: 0.338628 May 28 04:43:00.117926 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1164/2403] 10.222.0.58 () {58 vars in 1268 bytes} [Sat May 28 04:42:59 2022] GET /compute/v2.1/os-quota-sets/b706b0924270457ebefedda125d1ebe2/defaults => generated 371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:43:00.129139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f9b6c855-120a-4bbc-aea6-5771a2abd036 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:00.137616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9b6c855-120a-4bbc-aea6-5771a2abd036 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:00.138272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9b6c855-120a-4bbc-aea6-5771a2abd036 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:00.148627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8201d5f0-05f4-43e8-948e-cb079ba919c4 tempest-QuotasTestJSON-1850699983 tempest-QuotasTestJSON-1850699983-project] Calling method '.version_select at 0x7f7701c540d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:00.280758 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8201d5f0-05f4-43e8-948e-cb079ba919c4 tempest-QuotasTestJSON-1850699983 tempest-QuotasTestJSON-1850699983-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/b706b0924270457ebefedda125d1ebe2" status: 200 len: 371 microversion: 2.1 time: 0.155410 May 28 04:43:00.282192 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1165/2404] 10.222.0.58 () {58 vars in 1241 bytes} [Sat May 28 04:43:00 2022] GET /compute/v2.1/os-quota-sets/b706b0924270457ebefedda125d1ebe2 => generated 371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:43:00.292943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2a5fb044-5aca-411f-8b03-5cdda8175b86 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:00.293675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2a5fb044-5aca-411f-8b03-5cdda8175b86 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:00.303821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a5fb044-5aca-411f-8b03-5cdda8175b86 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:00.304379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a5fb044-5aca-411f-8b03-5cdda8175b86 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:00.305975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a5fb044-5aca-411f-8b03-5cdda8175b86 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:00.306623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a5fb044-5aca-411f-8b03-5cdda8175b86 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:00.324403 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f9b6c855-120a-4bbc-aea6-5771a2abd036 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.342628 May 28 04:43:00.327685 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1240/2405] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:42:59 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:00.335429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-965da8b5-2089-4cee-bbc6-56ec1ae58ada tempest-QuotasTestJSON-1850699983 tempest-QuotasTestJSON-1850699983-project] Calling method '.version_select at 0x7f77011793a0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:00.408838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2a5fb044-5aca-411f-8b03-5cdda8175b86 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:00.418198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2a5fb044-5aca-411f-8b03-5cdda8175b86 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:00.420274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2a5fb044-5aca-411f-8b03-5cdda8175b86 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:00.435896 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2a5fb044-5aca-411f-8b03-5cdda8175b86 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.151939 May 28 04:43:00.446872 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1166/2406] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:00 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:00.446872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2e3e8ced-8c30-41ce-b4ea-40a6ee87315c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:00.460247 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2e3e8ced-8c30-41ce-b4ea-40a6ee87315c tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020088 May 28 04:43:00.460657 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1167/2407] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:43:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:43:00.512432 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-965da8b5-2089-4cee-bbc6-56ec1ae58ada tempest-QuotasTestJSON-1850699983 tempest-QuotasTestJSON-1850699983-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/b706b0924270457ebefedda125d1ebe2/defaults" status: 200 len: 371 microversion: 2.1 time: 0.185595 May 28 04:43:00.513073 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1241/2408] 10.222.0.58 () {58 vars in 1268 bytes} [Sat May 28 04:43:00 2022] GET /compute/v2.1/os-quota-sets/b706b0924270457ebefedda125d1ebe2/defaults => generated 371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:43:00.535911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1fc1f934-b799-48ee-b5f1-5b41006f9b43 tempest-QuotasTestJSON-1850699983 tempest-QuotasTestJSON-1850699983-project] Calling method '.version_select at 0x7f770196e1f0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:00.569394 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4f6d4fdd-ad59-4c93-9bcb-b2bcc80cc3df tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:00.570020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4f6d4fdd-ad59-4c93-9bcb-b2bcc80cc3df tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:00.588766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f6d4fdd-ad59-4c93-9bcb-b2bcc80cc3df tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:00.589925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f6d4fdd-ad59-4c93-9bcb-b2bcc80cc3df tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:00.591018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f6d4fdd-ad59-4c93-9bcb-b2bcc80cc3df tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:00.592211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f6d4fdd-ad59-4c93-9bcb-b2bcc80cc3df tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:00.669439 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1fc1f934-b799-48ee-b5f1-5b41006f9b43 tempest-QuotasTestJSON-1850699983 tempest-QuotasTestJSON-1850699983-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/b706b0924270457ebefedda125d1ebe2" status: 200 len: 371 microversion: 2.1 time: 0.140624 May 28 04:43:00.678871 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1168/2409] 10.222.0.58 () {58 vars in 1241 bytes} [Sat May 28 04:43:00 2022] GET /compute/v2.1/os-quota-sets/b706b0924270457ebefedda125d1ebe2 => generated 371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:43:00.678871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-31a62ac7-8a52-43cb-a803-c63eac7da9ff tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:00.678871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-31a62ac7-8a52-43cb-a803-c63eac7da9ff tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:00.703190 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31a62ac7-8a52-43cb-a803-c63eac7da9ff tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:00.704239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31a62ac7-8a52-43cb-a803-c63eac7da9ff tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:00.705411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31a62ac7-8a52-43cb-a803-c63eac7da9ff tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:00.706183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31a62ac7-8a52-43cb-a803-c63eac7da9ff tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:00.772603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4f6d4fdd-ad59-4c93-9bcb-b2bcc80cc3df tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:00.781196 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4f6d4fdd-ad59-4c93-9bcb-b2bcc80cc3df tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 200 len: 1469 microversion: 2.1 time: 0.215816 May 28 04:43:00.787416 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1242/2410] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:00 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 1469 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:00.796427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-812c851a-3c82-4b4c-89de-a8ad5e8c81fc tempest-QuotasTestJSON-1850699983 tempest-QuotasTestJSON-1850699983-project] Calling method '.version_select at 0x7f7702140700>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:00.958559 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-812c851a-3c82-4b4c-89de-a8ad5e8c81fc tempest-QuotasTestJSON-1850699983 tempest-QuotasTestJSON-1850699983-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/b706b0924270457ebefedda125d1ebe2?user_id=90b3a5f96a614f94b8191bcbe13cbb89" status: 200 len: 371 microversion: 2.1 time: 0.161685 May 28 04:43:00.958559 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1243/2411] 10.222.0.58 () {58 vars in 1322 bytes} [Sat May 28 04:43:00 2022] GET /compute/v2.1/os-quota-sets/b706b0924270457ebefedda125d1ebe2?user_id=90b3a5f96a614f94b8191bcbe13cbb89 => generated 371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:43:00.966356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e3fc0149-9694-42c5-8b34-a06f0391449f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:00.967034 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e3fc0149-9694-42c5-8b34-a06f0391449f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:00.979370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3fc0149-9694-42c5-8b34-a06f0391449f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:00.979831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3fc0149-9694-42c5-8b34-a06f0391449f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:00.980621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3fc0149-9694-42c5-8b34-a06f0391449f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:00.981073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3fc0149-9694-42c5-8b34-a06f0391449f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:01.220354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-31a62ac7-8a52-43cb-a803-c63eac7da9ff tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:01.224167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:01.236003 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-31a62ac7-8a52-43cb-a803-c63eac7da9ff tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.563905 May 28 04:43:01.246565 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1169/2412] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:00 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:01.252064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-627c4ee8-7216-49c7-82ce-f60b7643522b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:01.252897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-627c4ee8-7216-49c7-82ce-f60b7643522b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:01.260690 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-627c4ee8-7216-49c7-82ce-f60b7643522b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:01.261431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-627c4ee8-7216-49c7-82ce-f60b7643522b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:01.263400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-627c4ee8-7216-49c7-82ce-f60b7643522b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:01.264074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-627c4ee8-7216-49c7-82ce-f60b7643522b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:01.301368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-627c4ee8-7216-49c7-82ce-f60b7643522b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:43:01.410584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e3fc0149-9694-42c5-8b34-a06f0391449f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:01.423569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e3fc0149-9694-42c5-8b34-a06f0391449f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:01.425348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e3fc0149-9694-42c5-8b34-a06f0391449f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:01.426783 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e3fc0149-9694-42c5-8b34-a06f0391449f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.474827 May 28 04:43:01.427645 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1244/2413] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:00 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:01.460216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2bf2b8dc-9802-4774-bf82-8742994396a6 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:01.461154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2bf2b8dc-9802-4774-bf82-8742994396a6 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:01.471101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bf2b8dc-9802-4774-bf82-8742994396a6 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:01.477006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bf2b8dc-9802-4774-bf82-8742994396a6 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:01.477006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bf2b8dc-9802-4774-bf82-8742994396a6 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:01.477006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bf2b8dc-9802-4774-bf82-8742994396a6 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:01.612081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2bf2b8dc-9802-4774-bf82-8742994396a6 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:01.635168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2bf2b8dc-9802-4774-bf82-8742994396a6 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:01.638292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2bf2b8dc-9802-4774-bf82-8742994396a6 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:01.651114 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2bf2b8dc-9802-4774-bf82-8742994396a6 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.196996 May 28 04:43:01.654332 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1245/2414] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:01 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:01.701907 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-627c4ee8-7216-49c7-82ce-f60b7643522b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 204 len: 0 microversion: 2.1 time: 0.453593 May 28 04:43:01.706852 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1170/2415] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:43:01 2022] DELETE /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:43:01.714129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-092b7580-24b3-491f-8548-b656f9f6e14b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:01.715078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-092b7580-24b3-491f-8548-b656f9f6e14b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:01.724415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-092b7580-24b3-491f-8548-b656f9f6e14b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:01.724875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-092b7580-24b3-491f-8548-b656f9f6e14b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:01.725651 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-092b7580-24b3-491f-8548-b656f9f6e14b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:01.726087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-092b7580-24b3-491f-8548-b656f9f6e14b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:01.800982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e8420b12-aee7-467b-9853-eb1ad17d713b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:01.802068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e8420b12-aee7-467b-9853-eb1ad17d713b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:01.811073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e8420b12-aee7-467b-9853-eb1ad17d713b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:01.812006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e8420b12-aee7-467b-9853-eb1ad17d713b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:01.813056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e8420b12-aee7-467b-9853-eb1ad17d713b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:01.813919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e8420b12-aee7-467b-9853-eb1ad17d713b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:01.996361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e8420b12-aee7-467b-9853-eb1ad17d713b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:02.012488 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e8420b12-aee7-467b-9853-eb1ad17d713b tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 200 len: 1427 microversion: 2.1 time: 0.216964 May 28 04:43:02.013108 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1171/2416] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:01 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 1427 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:43:02.023625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-f77f4399-cf7f-4336-a00b-8dd86297bb76 req-580c4aab-65e9-47df-a011-afece56b4f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "292a1ab6-21e8-4cf4-a499-c0a65f10f617", "name": "network-vif-deleted", "tag": "5f1534ca-86d2-4144-9e14-e51d146c6b8e"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:02.045052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f77f4399-cf7f-4336-a00b-8dd86297bb76 req-580c4aab-65e9-47df-a011-afece56b4f94 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:02.045506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f77f4399-cf7f-4336-a00b-8dd86297bb76 req-580c4aab-65e9-47df-a011-afece56b4f94 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:02.071334 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-f77f4399-cf7f-4336-a00b-8dd86297bb76 req-580c4aab-65e9-47df-a011-afece56b4f94 service nova] Creating event network-vif-deleted:5f1534ca-86d2-4144-9e14-e51d146c6b8e for instance 292a1ab6-21e8-4cf4-a499-c0a65f10f617 on n-h1-843700-1 May 28 04:43:02.080853 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-f77f4399-cf7f-4336-a00b-8dd86297bb76 req-580c4aab-65e9-47df-a011-afece56b4f94 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065798 May 28 04:43:02.082661 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1172/2417] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:43:02.102507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-092b7580-24b3-491f-8548-b656f9f6e14b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:02.121049 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-092b7580-24b3-491f-8548-b656f9f6e14b tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1608 microversion: 2.1 time: 0.410825 May 28 04:43:02.122166 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1246/2418] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:01 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1608 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:02.266479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8b918b34-cf10-4d56-8725-032bde353caf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:02.267992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8b918b34-cf10-4d56-8725-032bde353caf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:02.284541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b918b34-cf10-4d56-8725-032bde353caf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:02.285543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b918b34-cf10-4d56-8725-032bde353caf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:02.287733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b918b34-cf10-4d56-8725-032bde353caf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:02.288839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b918b34-cf10-4d56-8725-032bde353caf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:02.446437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fdcdfefc-f11f-483f-80e1-0d088704ddc7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:02.446907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fdcdfefc-f11f-483f-80e1-0d088704ddc7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:02.448797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:02.475720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fdcdfefc-f11f-483f-80e1-0d088704ddc7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:02.485480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fdcdfefc-f11f-483f-80e1-0d088704ddc7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:02.486650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fdcdfefc-f11f-483f-80e1-0d088704ddc7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:02.487389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fdcdfefc-f11f-483f-80e1-0d088704ddc7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:02.891400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8b918b34-cf10-4d56-8725-032bde353caf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:02.911164 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8b918b34-cf10-4d56-8725-032bde353caf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.652138 May 28 04:43:02.911164 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1173/2419] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:02 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:02.911164 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5f3666c3-0802-421e-8923-bf765117c51e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:02.911164 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5f3666c3-0802-421e-8923-bf765117c51e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:02.918633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5f3666c3-0802-421e-8923-bf765117c51e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:02.919133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5f3666c3-0802-421e-8923-bf765117c51e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:02.919975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5f3666c3-0802-421e-8923-bf765117c51e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:02.920422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5f3666c3-0802-421e-8923-bf765117c51e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:02.929107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fdcdfefc-f11f-483f-80e1-0d088704ddc7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:02.938349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fdcdfefc-f11f-483f-80e1-0d088704ddc7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:02.940753 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fdcdfefc-f11f-483f-80e1-0d088704ddc7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:02.941960 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fdcdfefc-f11f-483f-80e1-0d088704ddc7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.500746 May 28 04:43:02.942607 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1247/2420] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:02 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:43:02.998302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5f3666c3-0802-421e-8923-bf765117c51e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:03.011073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5f3666c3-0802-421e-8923-bf765117c51e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:03.017281 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5f3666c3-0802-421e-8923-bf765117c51e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:03.022292 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5f3666c3-0802-421e-8923-bf765117c51e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.116159 May 28 04:43:03.023083 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1174/2421] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:02 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:03.032520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cfc3b08b-6898-4575-92fc-b1cb51802108 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:03.033140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cfc3b08b-6898-4575-92fc-b1cb51802108 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:03.040955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfc3b08b-6898-4575-92fc-b1cb51802108 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:03.041786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfc3b08b-6898-4575-92fc-b1cb51802108 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:03.046187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfc3b08b-6898-4575-92fc-b1cb51802108 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:03.046187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfc3b08b-6898-4575-92fc-b1cb51802108 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:03.123398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cfc3b08b-6898-4575-92fc-b1cb51802108 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:03.139681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-776839f5-8943-4a56-ae98-e962a5db5862 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:03.140575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-776839f5-8943-4a56-ae98-e962a5db5862 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:03.151872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-776839f5-8943-4a56-ae98-e962a5db5862 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:03.152422 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cfc3b08b-6898-4575-92fc-b1cb51802108 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 200 len: 1298 microversion: 2.1 time: 0.122985 May 28 04:43:03.154184 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1248/2422] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:03 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 1298 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:03.154677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-776839f5-8943-4a56-ae98-e962a5db5862 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:03.155959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-776839f5-8943-4a56-ae98-e962a5db5862 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:03.156638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-776839f5-8943-4a56-ae98-e962a5db5862 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:03.311459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-923da99f-9cb2-4319-bc24-7e1aedcd938a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Action: 'create', calling method: .version_select at 0x7f7701ec9f70>, body: {"keypair": {"name": "tempest-keypair-152914391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP32EZkFm/fkAgn6iLPBLc7Wq3Z1tJI6aKMXwihOmYMu9Xr2yRRv+R0e6lJrFQvL9r4QYf2+9Msq2LbmA3jHvzpRE7bebC1mmXGXEi+6EwdMtTvOl1KxDtEgFoFbJqp1kQ=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:03.337063 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-923da99f-9cb2-4319-bc24-7e1aedcd938a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Getting quotas for project 998b585dc62744008c3cbba9f6cbb827. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:43:03.346343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-923da99f-9cb2-4319-bc24-7e1aedcd938a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Getting quotas for user ed73a7e876d24e18b3b9add257169512 and project 998b585dc62744008c3cbba9f6cbb827. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:43:03.354430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-776839f5-8943-4a56-ae98-e962a5db5862 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:03.366377 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-776839f5-8943-4a56-ae98-e962a5db5862 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1608 microversion: 2.1 time: 0.232121 May 28 04:43:03.368824 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1175/2423] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:03 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1608 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:03.463982 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-923da99f-9cb2-4319-bc24-7e1aedcd938a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.162879 May 28 04:43:03.470485 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1249/2424] 10.222.0.58 () {62 vars in 1199 bytes} [Sat May 28 04:43:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 170 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 28 04:43:03.921872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e916ae09-5219-4570-839c-92c1086bf030 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:03.922637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e916ae09-5219-4570-839c-92c1086bf030 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:03.947296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e916ae09-5219-4570-839c-92c1086bf030 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:03.947849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e916ae09-5219-4570-839c-92c1086bf030 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:03.956836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e916ae09-5219-4570-839c-92c1086bf030 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:03.959007 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e916ae09-5219-4570-839c-92c1086bf030 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:03.969210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef56d96a-1176-4d71-92a6-89b238b2c9da tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:03.970416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ef56d96a-1176-4d71-92a6-89b238b2c9da tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:03.992795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef56d96a-1176-4d71-92a6-89b238b2c9da tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:04.004339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef56d96a-1176-4d71-92a6-89b238b2c9da tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:04.005199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef56d96a-1176-4d71-92a6-89b238b2c9da tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:04.005684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef56d96a-1176-4d71-92a6-89b238b2c9da tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:04.572003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e916ae09-5219-4570-839c-92c1086bf030 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:04.576975 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e916ae09-5219-4570-839c-92c1086bf030 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.659791 May 28 04:43:04.578200 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1176/2425] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:03 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:04.583851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-de31898e-2407-40f2-b69b-d3bc27ba2f5b tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:04.584780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-de31898e-2407-40f2-b69b-d3bc27ba2f5b tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:04.602034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de31898e-2407-40f2-b69b-d3bc27ba2f5b tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:04.604460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de31898e-2407-40f2-b69b-d3bc27ba2f5b tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:04.605405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de31898e-2407-40f2-b69b-d3bc27ba2f5b tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:04.607454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de31898e-2407-40f2-b69b-d3bc27ba2f5b tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:04.847155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-de31898e-2407-40f2-b69b-d3bc27ba2f5b tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:04.875600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-de31898e-2407-40f2-b69b-d3bc27ba2f5b tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:04.880828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-de31898e-2407-40f2-b69b-d3bc27ba2f5b tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:04.895736 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-de31898e-2407-40f2-b69b-d3bc27ba2f5b tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.315865 May 28 04:43:04.897132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef56d96a-1176-4d71-92a6-89b238b2c9da tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:04.901290 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1177/2426] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:04 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:04.907830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c19a2d59-bdca-4ab3-96be-aa7895a78375 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:04.910805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c19a2d59-bdca-4ab3-96be-aa7895a78375 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 292a1ab6-21e8-4cf4-a499-c0a65f10f617] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:04.925705 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:04.927662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef56d96a-1176-4d71-92a6-89b238b2c9da tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:04.929574 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef56d96a-1176-4d71-92a6-89b238b2c9da tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:04.933769 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ef56d96a-1176-4d71-92a6-89b238b2c9da tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.976224 May 28 04:43:04.935664 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1250/2427] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:03 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:04.938837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c19a2d59-bdca-4ab3-96be-aa7895a78375 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:04.938837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c19a2d59-bdca-4ab3-96be-aa7895a78375 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:04.942175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c19a2d59-bdca-4ab3-96be-aa7895a78375 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:04.942645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c19a2d59-bdca-4ab3-96be-aa7895a78375 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:04.946056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ae3c4378-aba5-4272-a13c-143db5d61324 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:04.949789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ae3c4378-aba5-4272-a13c-143db5d61324 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:04.960066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae3c4378-aba5-4272-a13c-143db5d61324 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:04.963588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae3c4378-aba5-4272-a13c-143db5d61324 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:04.968655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae3c4378-aba5-4272-a13c-143db5d61324 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:04.970790 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae3c4378-aba5-4272-a13c-143db5d61324 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:04.981436 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-c19a2d59-bdca-4ab3-96be-aa7895a78375 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] HTTP exception thrown: Instance 292a1ab6-21e8-4cf4-a499-c0a65f10f617 could not be found. May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c19a2d59-bdca-4ab3-96be-aa7895a78375 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Request method failure captured: May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 HTTP/1.1 May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikafMfbt2ghhvtNmhniorMdys3DWsZspcZ-UP1cx9sYVv6nlUx4WOTmZTUkluxIdlP99SFx65ktHfkEGVP8YEGPlb1yLxDNM-hRNDh1TZ24bvToVTe9oybPEtRB9XpeRYM_0A8l1WjXBDdlcrWWGWq0eQE_-gD3zMNk0HCCs8vbocfQ0 May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 13ea83404c554681912477aa3f6d0798 May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersAdminTestJSON-270789539 May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_13ea83404c554681912477aa3f6d0798"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/13ea83404c554681912477aa3f6d0798"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13ea83404c554681912477aa3f6d0798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13ea83404c554681912477aa3f6d0798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersAdminTestJSON-270789539 May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 13ea83404c554681912477aa3f6d0798 May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersAdminTestJSON-270789539 May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersAdminTestJSON-270789539-project May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 7850cd7487c94107b6cfdc0c956f01d0 May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersAdminTestJSON-270789539-project May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 292a1ab6-21e8-4cf4-a499-c0a65f10f617 could not be found. May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '292a1ab6-21e8-4cf4-a499-c0a65f10f617'} May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 292a1ab6-21e8-4cf4-a499-c0a65f10f617 could not be found. May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 292a1ab6-21e8-4cf4-a499-c0a65f10f617 could not be found. May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:43:04.986403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:43:04.993407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:43:04.993407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:43:04.993407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:43:04.993407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:43:04.993407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:43:04.993407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 292a1ab6-21e8-4cf4-a499-c0a65f10f617 could not be found. May 28 04:43:04.993407 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:43:04.993407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c19a2d59-bdca-4ab3-96be-aa7895a78375 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Returning 404 to user: Instance 292a1ab6-21e8-4cf4-a499-c0a65f10f617 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:43:04.993407 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c19a2d59-bdca-4ab3-96be-aa7895a78375 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617" status: 404 len: 111 microversion: 2.1 time: 0.087180 May 28 04:43:04.994663 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1178/2428] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:04 2022] GET /compute/v2.1/servers/292a1ab6-21e8-4cf4-a499-c0a65f10f617 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:43:05.000466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-8d596883-108e-47bc-95b6-55e3c267cdd3 req-924f7c64-868f-429c-b15d-6266f4d210e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c3986b-245a-4454-95c7-63f826af6edc", "name": "network-vif-unplugged", "status": "completed", "tag": "a8517f33-040a-4dc7-a1bf-9a16a458e569"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:05.023689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8d596883-108e-47bc-95b6-55e3c267cdd3 req-924f7c64-868f-429c-b15d-6266f4d210e0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:05.024140 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8d596883-108e-47bc-95b6-55e3c267cdd3 req-924f7c64-868f-429c-b15d-6266f4d210e0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:05.039079 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-8d596883-108e-47bc-95b6-55e3c267cdd3 req-924f7c64-868f-429c-b15d-6266f4d210e0 service nova] Creating event network-vif-unplugged:a8517f33-040a-4dc7-a1bf-9a16a458e569 for instance 05c3986b-245a-4454-95c7-63f826af6edc on n-h2-843700-1 May 28 04:43:05.043385 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-8d596883-108e-47bc-95b6-55e3c267cdd3 req-924f7c64-868f-429c-b15d-6266f4d210e0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048217 May 28 04:43:05.055250 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1179/2429] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:43:05.068299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fb25f2f0-dcc6-4f78-a4ea-d5af0d91ea4d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:05.087512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fb25f2f0-dcc6-4f78-a4ea-d5af0d91ea4d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:05.102622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fb25f2f0-dcc6-4f78-a4ea-d5af0d91ea4d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:05.105288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fb25f2f0-dcc6-4f78-a4ea-d5af0d91ea4d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:05.111404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fb25f2f0-dcc6-4f78-a4ea-d5af0d91ea4d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:05.112162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fb25f2f0-dcc6-4f78-a4ea-d5af0d91ea4d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:05.152694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fb25f2f0-dcc6-4f78-a4ea-d5af0d91ea4d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:43:05.591472 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fb25f2f0-dcc6-4f78-a4ea-d5af0d91ea4d tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "DELETE /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 204 len: 0 microversion: 2.1 time: 0.534404 May 28 04:43:05.593653 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1180/2430] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:43:05 2022] DELETE /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:43:05.603191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bfc7ec1c-7735-436a-84ec-2cbec2fdbe8d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:05.604992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bfc7ec1c-7735-436a-84ec-2cbec2fdbe8d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:05.624833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bfc7ec1c-7735-436a-84ec-2cbec2fdbe8d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:05.625493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bfc7ec1c-7735-436a-84ec-2cbec2fdbe8d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:05.626508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bfc7ec1c-7735-436a-84ec-2cbec2fdbe8d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:05.626966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bfc7ec1c-7735-436a-84ec-2cbec2fdbe8d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:05.673118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ae3c4378-aba5-4272-a13c-143db5d61324 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:05.683766 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ae3c4378-aba5-4272-a13c-143db5d61324 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1608 microversion: 2.1 time: 0.744277 May 28 04:43:05.686304 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1251/2431] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:04 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1608 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:05.700145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0fa87aad-fbda-4318-9eed-b7b62efe4d62 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:05.701322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0fa87aad-fbda-4318-9eed-b7b62efe4d62 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:05.708157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0fa87aad-fbda-4318-9eed-b7b62efe4d62 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:05.709318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0fa87aad-fbda-4318-9eed-b7b62efe4d62 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:05.710099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0fa87aad-fbda-4318-9eed-b7b62efe4d62 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:05.711142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0fa87aad-fbda-4318-9eed-b7b62efe4d62 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:05.952986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bfc7ec1c-7735-436a-84ec-2cbec2fdbe8d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:05.971738 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bfc7ec1c-7735-436a-84ec-2cbec2fdbe8d tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.373297 May 28 04:43:05.985654 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1181/2432] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:05 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:05.994226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e2a30c48-bd80-47ee-b8be-f0eb17a8b56d tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:05.995241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e2a30c48-bd80-47ee-b8be-f0eb17a8b56d tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:06.007066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2a30c48-bd80-47ee-b8be-f0eb17a8b56d tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:06.008594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2a30c48-bd80-47ee-b8be-f0eb17a8b56d tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:06.009668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2a30c48-bd80-47ee-b8be-f0eb17a8b56d tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:06.010384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2a30c48-bd80-47ee-b8be-f0eb17a8b56d tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:06.071253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0fa87aad-fbda-4318-9eed-b7b62efe4d62 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:06.080435 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0fa87aad-fbda-4318-9eed-b7b62efe4d62 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1469 microversion: 2.1 time: 0.392956 May 28 04:43:06.084751 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1252/2433] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:05 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1469 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:06.098066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c39f8cfb-42bd-4022-abca-efc835ad724b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:06.100410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c39f8cfb-42bd-4022-abca-efc835ad724b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:06.113491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c39f8cfb-42bd-4022-abca-efc835ad724b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:06.114277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c39f8cfb-42bd-4022-abca-efc835ad724b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:06.116427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c39f8cfb-42bd-4022-abca-efc835ad724b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:06.117099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c39f8cfb-42bd-4022-abca-efc835ad724b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:06.244319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e2a30c48-bd80-47ee-b8be-f0eb17a8b56d tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:06.259080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e2a30c48-bd80-47ee-b8be-f0eb17a8b56d tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:06.263399 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e2a30c48-bd80-47ee-b8be-f0eb17a8b56d tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:06.294280 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e2a30c48-bd80-47ee-b8be-f0eb17a8b56d tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.302821 May 28 04:43:06.296063 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1182/2434] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:05 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:06.522112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c39f8cfb-42bd-4022-abca-efc835ad724b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:06.535702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c39f8cfb-42bd-4022-abca-efc835ad724b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:06.538836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c39f8cfb-42bd-4022-abca-efc835ad724b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:06.539898 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c39f8cfb-42bd-4022-abca-efc835ad724b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.453480 May 28 04:43:06.540493 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1253/2435] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:06 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:06.701004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-927c969d-dbe5-4967-8f68-315cf0913404 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:06.701638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-927c969d-dbe5-4967-8f68-315cf0913404 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:06.710239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-927c969d-dbe5-4967-8f68-315cf0913404 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:06.714089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-927c969d-dbe5-4967-8f68-315cf0913404 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:06.726500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-927c969d-dbe5-4967-8f68-315cf0913404 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:06.727251 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-927c969d-dbe5-4967-8f68-315cf0913404 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:06.991286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f7e2d522-79f7-4b68-a5e3-e5e4e55027bf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:06.992209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f7e2d522-79f7-4b68-a5e3-e5e4e55027bf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:06.999546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7e2d522-79f7-4b68-a5e3-e5e4e55027bf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:07.000277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7e2d522-79f7-4b68-a5e3-e5e4e55027bf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:07.001378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7e2d522-79f7-4b68-a5e3-e5e4e55027bf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:07.001993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7e2d522-79f7-4b68-a5e3-e5e4e55027bf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:07.006185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-927c969d-dbe5-4967-8f68-315cf0913404 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:07.019110 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-927c969d-dbe5-4967-8f68-315cf0913404 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1540 microversion: 2.1 time: 0.321906 May 28 04:43:07.020194 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1183/2436] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:06 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1540 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:07.102201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-79f3148b-36a6-4830-9c22-93d20e2f5b91 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:07.104219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-79f3148b-36a6-4830-9c22-93d20e2f5b91 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:07.115919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-79f3148b-36a6-4830-9c22-93d20e2f5b91 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:07.119091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-79f3148b-36a6-4830-9c22-93d20e2f5b91 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:07.120781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-79f3148b-36a6-4830-9c22-93d20e2f5b91 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:07.121442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-79f3148b-36a6-4830-9c22-93d20e2f5b91 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:07.451619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f7e2d522-79f7-4b68-a5e3-e5e4e55027bf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:07.462518 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f7e2d522-79f7-4b68-a5e3-e5e4e55027bf tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.476400 May 28 04:43:07.463480 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1254/2437] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:06 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:43:07.470181 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4265eba8-7ea5-4701-ac07-acc57f1d8cd3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:07.471881 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4265eba8-7ea5-4701-ac07-acc57f1d8cd3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:07.497165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4265eba8-7ea5-4701-ac07-acc57f1d8cd3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:07.498074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4265eba8-7ea5-4701-ac07-acc57f1d8cd3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:07.504911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4265eba8-7ea5-4701-ac07-acc57f1d8cd3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:07.507983 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4265eba8-7ea5-4701-ac07-acc57f1d8cd3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:07.517009 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-79f3148b-36a6-4830-9c22-93d20e2f5b91 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:07.530440 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-79f3148b-36a6-4830-9c22-93d20e2f5b91 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1469 microversion: 2.1 time: 0.429773 May 28 04:43:07.536726 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1184/2438] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:07 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1469 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:43:07.559516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-da30de3b-3d3f-492d-ac52-085f1feb0584 req-40b7ced2-5de4-4084-8e50-fbda99a38bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c3986b-245a-4454-95c7-63f826af6edc", "tag": "a8517f33-040a-4dc7-a1bf-9a16a458e569"}, {"server_uuid": "b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5", "name": "network-vif-deleted", "tag": "8377d9fd-2493-4628-960b-9f1440849e31"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:07.589860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-da30de3b-3d3f-492d-ac52-085f1feb0584 req-40b7ced2-5de4-4084-8e50-fbda99a38bd0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:07.591563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-da30de3b-3d3f-492d-ac52-085f1feb0584 req-40b7ced2-5de4-4084-8e50-fbda99a38bd0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:07.609201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:07.641354 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-da30de3b-3d3f-492d-ac52-085f1feb0584 req-40b7ced2-5de4-4084-8e50-fbda99a38bd0 service nova] Creating event network-changed:a8517f33-040a-4dc7-a1bf-9a16a458e569 for instance 05c3986b-245a-4454-95c7-63f826af6edc on n-h2-843700-1 May 28 04:43:07.642233 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-da30de3b-3d3f-492d-ac52-085f1feb0584 req-40b7ced2-5de4-4084-8e50-fbda99a38bd0 service nova] Creating event network-vif-deleted:8377d9fd-2493-4628-960b-9f1440849e31 for instance b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 on n-h1-843700-1 May 28 04:43:07.660573 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-da30de3b-3d3f-492d-ac52-085f1feb0584 req-40b7ced2-5de4-4084-8e50-fbda99a38bd0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.118821 May 28 04:43:07.660573 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1185/2439] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:43:07.663551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f79daf69-2dbb-4015-9cfc-550283013043 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-779459237", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "abdef8d1-114d-434c-be25-ff2ef2267b29"}, {"port": "44f2f247-628a-486f-b27f-36ae37e73975", "tag": "port-1"}, {"port": "7fd4ecfb-9cd8-421b-9764-156bfec85136", "tag": "port-2"}, {"uuid": "10e41c79-9cef-44d5-89b6-2678d9fedcb1", "tag": "net-1"}, {"uuid": "10e41c79-9cef-44d5-89b6-2678d9fedcb1"}, {"uuid": "44b1983e-7cce-431e-ab77-3aaa0f5b3a91", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "44b1983e-7cce-431e-ab77-3aaa0f5b3a91", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "42f39bb2-e7be-4555-aba9-dd9d64fc78ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "154e1505-6e0f-4b2a-8015-f4d3aa590ade", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "0157825e-114a-4785-b4e0-0bf9f9b8f653", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--691204824"}], "key_name": "tempest-keypair-152914391", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:07.844053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4265eba8-7ea5-4701-ac07-acc57f1d8cd3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:07.859169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4265eba8-7ea5-4701-ac07-acc57f1d8cd3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:07.861235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4265eba8-7ea5-4701-ac07-acc57f1d8cd3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:07.877665 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4265eba8-7ea5-4701-ac07-acc57f1d8cd3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.411198 May 28 04:43:07.882629 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1255/2440] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:07 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:07.893803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cb09ea4d-f7e6-47b5-b30b-12c4067a3224 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:07.908726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cb09ea4d-f7e6-47b5-b30b-12c4067a3224 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:07.930328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb09ea4d-f7e6-47b5-b30b-12c4067a3224 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:07.930328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb09ea4d-f7e6-47b5-b30b-12c4067a3224 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:07.930328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb09ea4d-f7e6-47b5-b30b-12c4067a3224 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:07.930328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb09ea4d-f7e6-47b5-b30b-12c4067a3224 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:08.025157 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-f79daf69-2dbb-4015-9cfc-550283013043 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] validate_networks() for [('abdef8d1-114d-434c-be25-ff2ef2267b29', None, None, None, None, None), (None, None, '44f2f247-628a-486f-b27f-36ae37e73975', None, None, None), (None, None, '7fd4ecfb-9cd8-421b-9764-156bfec85136', None, None, None), ('10e41c79-9cef-44d5-89b6-2678d9fedcb1', None, None, None, None, None), ('10e41c79-9cef-44d5-89b6-2678d9fedcb1', None, None, None, None, None), ('44b1983e-7cce-431e-ab77-3aaa0f5b3a91', '10.2.2.100', None, None, None, None), ('44b1983e-7cce-431e-ab77-3aaa0f5b3a91', '10.2.2.200', None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:43:08.532143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cb09ea4d-f7e6-47b5-b30b-12c4067a3224 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:08.541956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cb09ea4d-f7e6-47b5-b30b-12c4067a3224 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:08.562518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cb09ea4d-f7e6-47b5-b30b-12c4067a3224 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:08.563822 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cb09ea4d-f7e6-47b5-b30b-12c4067a3224 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.679495 May 28 04:43:08.567517 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1256/2441] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:07 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:08.585834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-512fdee5-28df-46c9-97b8-463d3361a1c3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:08.587620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-512fdee5-28df-46c9-97b8-463d3361a1c3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:08.602974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-512fdee5-28df-46c9-97b8-463d3361a1c3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:08.603465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-512fdee5-28df-46c9-97b8-463d3361a1c3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:08.604558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-512fdee5-28df-46c9-97b8-463d3361a1c3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:08.607736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-512fdee5-28df-46c9-97b8-463d3361a1c3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:08.835342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-512fdee5-28df-46c9-97b8-463d3361a1c3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:08.861066 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-512fdee5-28df-46c9-97b8-463d3361a1c3 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1251 microversion: 2.1 time: 0.292097 May 28 04:43:08.862607 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1257/2442] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:08 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1251 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:08.868557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6ae86ea4-3efa-4377-bf76-6dc734b68799 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:08.882650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6ae86ea4-3efa-4377-bf76-6dc734b68799 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:08.904858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6ae86ea4-3efa-4377-bf76-6dc734b68799 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:08.905347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6ae86ea4-3efa-4377-bf76-6dc734b68799 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:08.906244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6ae86ea4-3efa-4377-bf76-6dc734b68799 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:08.906686 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6ae86ea4-3efa-4377-bf76-6dc734b68799 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:09.297773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6ae86ea4-3efa-4377-bf76-6dc734b68799 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:09.307963 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6ae86ea4-3efa-4377-bf76-6dc734b68799 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.443799 May 28 04:43:09.309274 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1258/2443] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:08 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:09.315369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-25c30ad0-c09b-418c-90a0-66127da91707 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:09.316240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-25c30ad0-c09b-418c-90a0-66127da91707 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:09.324956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25c30ad0-c09b-418c-90a0-66127da91707 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:09.325715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25c30ad0-c09b-418c-90a0-66127da91707 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:09.326725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25c30ad0-c09b-418c-90a0-66127da91707 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:09.327576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25c30ad0-c09b-418c-90a0-66127da91707 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:09.371762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25c30ad0-c09b-418c-90a0-66127da91707 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:09.372226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25c30ad0-c09b-418c-90a0-66127da91707 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:09.372691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-25c30ad0-c09b-418c-90a0-66127da91707 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lazy-loading 'fault' on Instance uuid 12b94a91-20fe-40ac-bd67-2864eef657f6 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:09.463293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-25c30ad0-c09b-418c-90a0-66127da91707 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7850cd7487c94107b6cfdc0c956f01d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ea83404c554681912477aa3f6d0798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:09.489965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:09.493677 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-25c30ad0-c09b-418c-90a0-66127da91707 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 200 len: 1304 microversion: 2.1 time: 0.181881 May 28 04:43:09.513299 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1259/2444] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:09 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 1304 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:09.522416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1ac0a7cd-955b-488b-9936-fc3a1b4bf993 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:09.523309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1ac0a7cd-955b-488b-9936-fc3a1b4bf993 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:09.532126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ac0a7cd-955b-488b-9936-fc3a1b4bf993 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:09.532959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ac0a7cd-955b-488b-9936-fc3a1b4bf993 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:09.534413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ac0a7cd-955b-488b-9936-fc3a1b4bf993 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:09.535277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ac0a7cd-955b-488b-9936-fc3a1b4bf993 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:09.651765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1ac0a7cd-955b-488b-9936-fc3a1b4bf993 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:09.660157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1ac0a7cd-955b-488b-9936-fc3a1b4bf993 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:09.662350 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1ac0a7cd-955b-488b-9936-fc3a1b4bf993 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:09.667421 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1ac0a7cd-955b-488b-9936-fc3a1b4bf993 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.151643 May 28 04:43:09.680061 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1260/2445] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:09 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:09.685252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-15e2c227-014d-4d07-a885-29f8f6f6efa1 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:09.685898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-15e2c227-014d-4d07-a885-29f8f6f6efa1 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:09.692191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-15e2c227-014d-4d07-a885-29f8f6f6efa1 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:09.692666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-15e2c227-014d-4d07-a885-29f8f6f6efa1 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:09.693922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-15e2c227-014d-4d07-a885-29f8f6f6efa1 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:09.694357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-15e2c227-014d-4d07-a885-29f8f6f6efa1 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:10.022113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:10.298158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-15e2c227-014d-4d07-a885-29f8f6f6efa1 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:10.306963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-15e2c227-014d-4d07-a885-29f8f6f6efa1 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:10.308860 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-15e2c227-014d-4d07-a885-29f8f6f6efa1 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:10.310395 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-15e2c227-014d-4d07-a885-29f8f6f6efa1 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.629217 May 28 04:43:10.311572 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1261/2446] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:09 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:10.316398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e96654de-8662-48c1-b2d9-31bd7f3c080f req-243a3eaa-daf8-4559-95e6-e2f0fafb32df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b94a91-20fe-40ac-bd67-2864eef657f6", "name": "network-vif-deleted", "tag": "7dbb06ba-323b-4edc-bc6d-380122278f70"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:10.326295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e96654de-8662-48c1-b2d9-31bd7f3c080f req-243a3eaa-daf8-4559-95e6-e2f0fafb32df service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:10.327145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e96654de-8662-48c1-b2d9-31bd7f3c080f req-243a3eaa-daf8-4559-95e6-e2f0fafb32df service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:10.340732 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e96654de-8662-48c1-b2d9-31bd7f3c080f req-243a3eaa-daf8-4559-95e6-e2f0fafb32df service nova] Creating event network-vif-deleted:7dbb06ba-323b-4edc-bc6d-380122278f70 for instance 12b94a91-20fe-40ac-bd67-2864eef657f6 on n-h1-843700-1 May 28 04:43:10.346448 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e96654de-8662-48c1-b2d9-31bd7f3c080f req-243a3eaa-daf8-4559-95e6-e2f0fafb32df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033300 May 28 04:43:10.347097 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1262/2447] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:43:10.356898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0d894ebf-a6a1-48d9-8b77-e0d9e8930412 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:10.357625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0d894ebf-a6a1-48d9-8b77-e0d9e8930412 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:10.371840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0d894ebf-a6a1-48d9-8b77-e0d9e8930412 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:10.372244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0d894ebf-a6a1-48d9-8b77-e0d9e8930412 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:10.373023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0d894ebf-a6a1-48d9-8b77-e0d9e8930412 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:10.373462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0d894ebf-a6a1-48d9-8b77-e0d9e8930412 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:10.458958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0d894ebf-a6a1-48d9-8b77-e0d9e8930412 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:10.478196 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0d894ebf-a6a1-48d9-8b77-e0d9e8930412 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1251 microversion: 2.1 time: 0.128345 May 28 04:43:10.480255 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1263/2448] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:10 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1251 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:10.495894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ba9872ab-c581-4dd3-9f97-526763326f40 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:10.500130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ba9872ab-c581-4dd3-9f97-526763326f40 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:10.518520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba9872ab-c581-4dd3-9f97-526763326f40 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:10.520595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba9872ab-c581-4dd3-9f97-526763326f40 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:10.521893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba9872ab-c581-4dd3-9f97-526763326f40 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:10.523315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba9872ab-c581-4dd3-9f97-526763326f40 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:10.651065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:10.856603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ba9872ab-c581-4dd3-9f97-526763326f40 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:10.868067 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ba9872ab-c581-4dd3-9f97-526763326f40 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.385326 May 28 04:43:10.879433 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1264/2449] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:10 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:10.887090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-74edf9fa-5f79-4830-9e59-baf851993b08 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:10.887090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-74edf9fa-5f79-4830-9e59-baf851993b08 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] [instance: 12b94a91-20fe-40ac-bd67-2864eef657f6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:10.894559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74edf9fa-5f79-4830-9e59-baf851993b08 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:10.895941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74edf9fa-5f79-4830-9e59-baf851993b08 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:10.897045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74edf9fa-5f79-4830-9e59-baf851993b08 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:10.897726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74edf9fa-5f79-4830-9e59-baf851993b08 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:10.920563 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-74edf9fa-5f79-4830-9e59-baf851993b08 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] HTTP exception thrown: Instance 12b94a91-20fe-40ac-bd67-2864eef657f6 could not be found. May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-74edf9fa-5f79-4830-9e59-baf851993b08 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Request method failure captured: May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 HTTP/1.1 May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikafMfbt2ghhvtNmhniorMdys3DWsZspcZ-UP1cx9sYVv6nlUx4WOTmZTUkluxIdlP99SFx65ktHfkEGVP8YEGPlb1yLxDNM-hRNDh1TZ24bvToVTe9oybPEtRB9XpeRYM_0A8l1WjXBDdlcrWWGWq0eQE_-gD3zMNk0HCCs8vbocfQ0 May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 13ea83404c554681912477aa3f6d0798 May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersAdminTestJSON-270789539 May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_13ea83404c554681912477aa3f6d0798"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/13ea83404c554681912477aa3f6d0798"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13ea83404c554681912477aa3f6d0798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13ea83404c554681912477aa3f6d0798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersAdminTestJSON-270789539 May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 13ea83404c554681912477aa3f6d0798 May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersAdminTestJSON-270789539 May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersAdminTestJSON-270789539-project May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 7850cd7487c94107b6cfdc0c956f01d0 May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersAdminTestJSON-270789539-project May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 12b94a91-20fe-40ac-bd67-2864eef657f6 could not be found. May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '12b94a91-20fe-40ac-bd67-2864eef657f6'} May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b94a91-20fe-40ac-bd67-2864eef657f6 could not be found. May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b94a91-20fe-40ac-bd67-2864eef657f6 could not be found. May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:43:10.924469 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:10.930386 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:43:10.930386 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:43:10.930386 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:43:10.930386 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:43:10.930386 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:43:10.930386 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b94a91-20fe-40ac-bd67-2864eef657f6 could not be found. May 28 04:43:10.930386 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:10.931984 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-74edf9fa-5f79-4830-9e59-baf851993b08 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] Returning 404 to user: Instance 12b94a91-20fe-40ac-bd67-2864eef657f6 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:43:10.932871 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-74edf9fa-5f79-4830-9e59-baf851993b08 tempest-ServersAdminTestJSON-270789539 tempest-ServersAdminTestJSON-270789539-project] 10.222.0.58 "GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6" status: 404 len: 111 microversion: 2.1 time: 0.051540 May 28 04:43:10.933468 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1265/2450] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:10 2022] GET /compute/v2.1/servers/12b94a91-20fe-40ac-bd67-2864eef657f6 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:43:10.938374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-40ae76b0-3e72-4433-9479-44f76f8a0d65 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:10.939027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-40ae76b0-3e72-4433-9479-44f76f8a0d65 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:10.950431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40ae76b0-3e72-4433-9479-44f76f8a0d65 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:10.950899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40ae76b0-3e72-4433-9479-44f76f8a0d65 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:10.952144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40ae76b0-3e72-4433-9479-44f76f8a0d65 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:10.952626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40ae76b0-3e72-4433-9479-44f76f8a0d65 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:11.076188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-40ae76b0-3e72-4433-9479-44f76f8a0d65 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:11.085021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-40ae76b0-3e72-4433-9479-44f76f8a0d65 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:11.087053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-40ae76b0-3e72-4433-9479-44f76f8a0d65 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:11.101155 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-40ae76b0-3e72-4433-9479-44f76f8a0d65 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.166602 May 28 04:43:11.101768 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1266/2451] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:10 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:11.331757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b9908878-b00e-4738-bdaa-9918a5129b6c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:11.333967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b9908878-b00e-4738-bdaa-9918a5129b6c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:11.343250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b9908878-b00e-4738-bdaa-9918a5129b6c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:11.344551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b9908878-b00e-4738-bdaa-9918a5129b6c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:11.347993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b9908878-b00e-4738-bdaa-9918a5129b6c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:11.348464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b9908878-b00e-4738-bdaa-9918a5129b6c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:11.673486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b9908878-b00e-4738-bdaa-9918a5129b6c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:11.685939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b9908878-b00e-4738-bdaa-9918a5129b6c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:11.687631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b9908878-b00e-4738-bdaa-9918a5129b6c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:11.689716 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b9908878-b00e-4738-bdaa-9918a5129b6c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.362448 May 28 04:43:11.701280 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1267/2452] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:11 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:43:11.706940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-07e8955a-bf3e-409c-9047-81dad59ae165 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:11.707694 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-07e8955a-bf3e-409c-9047-81dad59ae165 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:11.723684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07e8955a-bf3e-409c-9047-81dad59ae165 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:11.723925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07e8955a-bf3e-409c-9047-81dad59ae165 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:11.724687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07e8955a-bf3e-409c-9047-81dad59ae165 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:11.725137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07e8955a-bf3e-409c-9047-81dad59ae165 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:11.865329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-07e8955a-bf3e-409c-9047-81dad59ae165 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:11.878609 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-07e8955a-bf3e-409c-9047-81dad59ae165 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1251 microversion: 2.1 time: 0.184652 May 28 04:43:11.879418 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1268/2453] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:11 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1251 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:11.896268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d8e9863c-9beb-4956-a567-554766686ed8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:11.899222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d8e9863c-9beb-4956-a567-554766686ed8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:11.915144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8e9863c-9beb-4956-a567-554766686ed8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:11.915144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8e9863c-9beb-4956-a567-554766686ed8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:11.915144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8e9863c-9beb-4956-a567-554766686ed8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:11.915144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8e9863c-9beb-4956-a567-554766686ed8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:12.170807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f79daf69-2dbb-4015-9cfc-550283013043 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:43:12.172084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f79daf69-2dbb-4015-9cfc-550283013043 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:43:12.172762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f79daf69-2dbb-4015-9cfc-550283013043 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:43:12.173454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f79daf69-2dbb-4015-9cfc-550283013043 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:43:12.179396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d8e9863c-9beb-4956-a567-554766686ed8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:12.180429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f79daf69-2dbb-4015-9cfc-550283013043 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:43:12.190429 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d8e9863c-9beb-4956-a567-554766686ed8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1517 microversion: 2.1 time: 0.299729 May 28 04:43:12.194944 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1269/2454] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:11 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1517 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:12.205998 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f79daf69-2dbb-4015-9cfc-550283013043 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:12.209012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f79daf69-2dbb-4015-9cfc-550283013043 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:12.210071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f79daf69-2dbb-4015-9cfc-550283013043 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:12.211742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f79daf69-2dbb-4015-9cfc-550283013043 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:12.237419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2a16806f-8b0b-48e4-b319-536819bdcdb3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:12.242971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2a16806f-8b0b-48e4-b319-536819bdcdb3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:12.257849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2a16806f-8b0b-48e4-b319-536819bdcdb3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:12.258309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2a16806f-8b0b-48e4-b319-536819bdcdb3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:12.261151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-f79daf69-2dbb-4015-9cfc-550283013043 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Getting quotas for project 998b585dc62744008c3cbba9f6cbb827. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:43:12.263355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2a16806f-8b0b-48e4-b319-536819bdcdb3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:12.263813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2a16806f-8b0b-48e4-b319-536819bdcdb3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:12.267026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-f79daf69-2dbb-4015-9cfc-550283013043 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Getting quotas for user ed73a7e876d24e18b3b9add257169512 and project 998b585dc62744008c3cbba9f6cbb827. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:43:12.358667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2a16806f-8b0b-48e4-b319-536819bdcdb3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:12.368962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2a16806f-8b0b-48e4-b319-536819bdcdb3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:12.370812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2a16806f-8b0b-48e4-b319-536819bdcdb3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:12.377363 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2a16806f-8b0b-48e4-b319-536819bdcdb3 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.182778 May 28 04:43:12.381554 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1270/2455] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:12 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:12.710794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef920f1f-618a-40e2-a29e-ffb15ad3e743 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:12.711633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ef920f1f-618a-40e2-a29e-ffb15ad3e743 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:12.719566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef920f1f-618a-40e2-a29e-ffb15ad3e743 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:12.720221 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef920f1f-618a-40e2-a29e-ffb15ad3e743 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:12.721063 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef920f1f-618a-40e2-a29e-ffb15ad3e743 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:12.721572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef920f1f-618a-40e2-a29e-ffb15ad3e743 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:12.881537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef920f1f-618a-40e2-a29e-ffb15ad3e743 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:12.891294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef920f1f-618a-40e2-a29e-ffb15ad3e743 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:12.892286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef920f1f-618a-40e2-a29e-ffb15ad3e743 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:12.893733 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ef920f1f-618a-40e2-a29e-ffb15ad3e743 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.188210 May 28 04:43:12.904277 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1271/2456] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:12 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:43:12.909441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f4d9bd91-c305-4eb0-bf56-642df2153380 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:12.910058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f4d9bd91-c305-4eb0-bf56-642df2153380 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:12.916928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4d9bd91-c305-4eb0-bf56-642df2153380 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:12.917395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4d9bd91-c305-4eb0-bf56-642df2153380 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:12.918274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4d9bd91-c305-4eb0-bf56-642df2153380 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:12.918707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4d9bd91-c305-4eb0-bf56-642df2153380 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:13.010830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f4d9bd91-c305-4eb0-bf56-642df2153380 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:13.021972 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f4d9bd91-c305-4eb0-bf56-642df2153380 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1251 microversion: 2.1 time: 0.116257 May 28 04:43:13.022818 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1272/2457] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:12 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1251 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:13.211191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-031b3eba-2478-4d7b-951b-9637d4edac1a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:13.212764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-031b3eba-2478-4d7b-951b-9637d4edac1a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:13.219114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-031b3eba-2478-4d7b-951b-9637d4edac1a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:13.219961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-031b3eba-2478-4d7b-951b-9637d4edac1a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:13.220952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-031b3eba-2478-4d7b-951b-9637d4edac1a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:13.221608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-031b3eba-2478-4d7b-951b-9637d4edac1a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:13.358848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=10 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:13.389197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-031b3eba-2478-4d7b-951b-9637d4edac1a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:13.397717 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-031b3eba-2478-4d7b-951b-9637d4edac1a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1523 microversion: 2.1 time: 0.191555 May 28 04:43:13.398302 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1273/2458] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:13 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:13.413031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c2f9a867-4e7a-4b14-ac3b-7b94c5cbc2f7 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:13.413780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c2f9a867-4e7a-4b14-ac3b-7b94c5cbc2f7 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:13.420021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2f9a867-4e7a-4b14-ac3b-7b94c5cbc2f7 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:13.420552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2f9a867-4e7a-4b14-ac3b-7b94c5cbc2f7 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:13.421407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2f9a867-4e7a-4b14-ac3b-7b94c5cbc2f7 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:13.422058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2f9a867-4e7a-4b14-ac3b-7b94c5cbc2f7 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:13.500547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c2f9a867-4e7a-4b14-ac3b-7b94c5cbc2f7 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:13.510487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c2f9a867-4e7a-4b14-ac3b-7b94c5cbc2f7 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:13.512703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c2f9a867-4e7a-4b14-ac3b-7b94c5cbc2f7 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:13.518898 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c2f9a867-4e7a-4b14-ac3b-7b94c5cbc2f7 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.109615 May 28 04:43:13.518898 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1274/2459] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:13 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:13.915464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-92a756db-cb5b-4edf-8a4b-29ef936c6f82 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:13.917390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-92a756db-cb5b-4edf-8a4b-29ef936c6f82 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:13.927443 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-92a756db-cb5b-4edf-8a4b-29ef936c6f82 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:13.928524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-92a756db-cb5b-4edf-8a4b-29ef936c6f82 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:13.929563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-92a756db-cb5b-4edf-8a4b-29ef936c6f82 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:13.930887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-92a756db-cb5b-4edf-8a4b-29ef936c6f82 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:14.132944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-92a756db-cb5b-4edf-8a4b-29ef936c6f82 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:14.142166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-92a756db-cb5b-4edf-8a4b-29ef936c6f82 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:14.143736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-92a756db-cb5b-4edf-8a4b-29ef936c6f82 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:14.145123 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-92a756db-cb5b-4edf-8a4b-29ef936c6f82 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.237385 May 28 04:43:14.146728 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1275/2460] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:13 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:43:14.151237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-83069520-dffc-4629-a07b-61ba0f4a7359 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:14.152116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-83069520-dffc-4629-a07b-61ba0f4a7359 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:14.158109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83069520-dffc-4629-a07b-61ba0f4a7359 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:14.158574 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83069520-dffc-4629-a07b-61ba0f4a7359 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:14.159384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83069520-dffc-4629-a07b-61ba0f4a7359 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:14.159830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83069520-dffc-4629-a07b-61ba0f4a7359 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:14.226901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-83069520-dffc-4629-a07b-61ba0f4a7359 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:14.235363 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-83069520-dffc-4629-a07b-61ba0f4a7359 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1251 microversion: 2.1 time: 0.087484 May 28 04:43:14.236133 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1276/2461] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:14 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1251 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:14.417170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d8e7f891-1bc0-4bdb-9179-c1b5735f99d6 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:14.417743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d8e7f891-1bc0-4bdb-9179-c1b5735f99d6 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:14.424651 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8e7f891-1bc0-4bdb-9179-c1b5735f99d6 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:14.425342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8e7f891-1bc0-4bdb-9179-c1b5735f99d6 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:14.426127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8e7f891-1bc0-4bdb-9179-c1b5735f99d6 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:14.426570 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8e7f891-1bc0-4bdb-9179-c1b5735f99d6 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:14.612789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d8e7f891-1bc0-4bdb-9179-c1b5735f99d6 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:14.614706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:14.620970 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d8e7f891-1bc0-4bdb-9179-c1b5735f99d6 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1523 microversion: 2.1 time: 0.207655 May 28 04:43:14.622176 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1277/2462] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:14 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:14.627150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e1f78ed2-f859-4c69-af73-2bf007a69925 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:14.627996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e1f78ed2-f859-4c69-af73-2bf007a69925 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:14.635261 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1f78ed2-f859-4c69-af73-2bf007a69925 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:14.635936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1f78ed2-f859-4c69-af73-2bf007a69925 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:14.636834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1f78ed2-f859-4c69-af73-2bf007a69925 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:14.637552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1f78ed2-f859-4c69-af73-2bf007a69925 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:14.711295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e1f78ed2-f859-4c69-af73-2bf007a69925 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:14.722226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e1f78ed2-f859-4c69-af73-2bf007a69925 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:14.726309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e1f78ed2-f859-4c69-af73-2bf007a69925 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:14.739330 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e1f78ed2-f859-4c69-af73-2bf007a69925 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.115504 May 28 04:43:14.741182 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1278/2463] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:14 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:15.164561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-43827750-7e20-4722-89cf-e18deb5b83b0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:15.165264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-43827750-7e20-4722-89cf-e18deb5b83b0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:15.180770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43827750-7e20-4722-89cf-e18deb5b83b0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:15.181285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43827750-7e20-4722-89cf-e18deb5b83b0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:15.182324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43827750-7e20-4722-89cf-e18deb5b83b0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:15.182924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43827750-7e20-4722-89cf-e18deb5b83b0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:15.418442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-43827750-7e20-4722-89cf-e18deb5b83b0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:15.427771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-43827750-7e20-4722-89cf-e18deb5b83b0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:15.429431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-43827750-7e20-4722-89cf-e18deb5b83b0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:15.430405 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-43827750-7e20-4722-89cf-e18deb5b83b0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.270270 May 28 04:43:15.431180 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1279/2464] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:15 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:43:15.444287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c5fc5620-bd4a-459b-88e0-c7896d46c61a tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:15.445077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c5fc5620-bd4a-459b-88e0-c7896d46c61a tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:15.452067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c5fc5620-bd4a-459b-88e0-c7896d46c61a tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:15.452649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c5fc5620-bd4a-459b-88e0-c7896d46c61a tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:15.453786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c5fc5620-bd4a-459b-88e0-c7896d46c61a tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:15.454597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c5fc5620-bd4a-459b-88e0-c7896d46c61a tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:15.530093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c5fc5620-bd4a-459b-88e0-c7896d46c61a tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:15.539079 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c5fc5620-bd4a-459b-88e0-c7896d46c61a tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1251 microversion: 2.1 time: 0.098623 May 28 04:43:15.539997 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1280/2465] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:15 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1251 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:15.638294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d3fa3c73-bb36-473f-919a-d5d4e0402374 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:15.639763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d3fa3c73-bb36-473f-919a-d5d4e0402374 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:15.648264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3fa3c73-bb36-473f-919a-d5d4e0402374 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:15.648958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3fa3c73-bb36-473f-919a-d5d4e0402374 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:15.650051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3fa3c73-bb36-473f-919a-d5d4e0402374 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:15.650727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3fa3c73-bb36-473f-919a-d5d4e0402374 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:15.804594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d3fa3c73-bb36-473f-919a-d5d4e0402374 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:15.812124 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d3fa3c73-bb36-473f-919a-d5d4e0402374 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1523 microversion: 2.1 time: 0.178260 May 28 04:43:15.812696 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1281/2466] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:15 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:43:15.817026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2727a7c3-c877-4ca8-a092-826dbd302bac tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:15.818146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2727a7c3-c877-4ca8-a092-826dbd302bac tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:15.823995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2727a7c3-c877-4ca8-a092-826dbd302bac tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:15.824446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2727a7c3-c877-4ca8-a092-826dbd302bac tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:15.825265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2727a7c3-c877-4ca8-a092-826dbd302bac tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:15.825702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2727a7c3-c877-4ca8-a092-826dbd302bac tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:15.899777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2727a7c3-c877-4ca8-a092-826dbd302bac tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:15.908116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2727a7c3-c877-4ca8-a092-826dbd302bac tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:15.909760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2727a7c3-c877-4ca8-a092-826dbd302bac tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:15.915602 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2727a7c3-c877-4ca8-a092-826dbd302bac tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1447 microversion: 2.75 time: 0.101800 May 28 04:43:15.916700 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1282/2467] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:15 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1447 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:16.113084 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c34c0edd-b5b5-49f4-9619-dd488033ad82 tempest-TenantUsagesNegativeTestJSON-1583102554 tempest-TenantUsagesNegativeTestJSON-1583102554-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-05-27T04%3A43%3A15.783271&end=2022-05-29T04%3A43%3A15.783271" status: 404 len: 112 microversion: - time: 0.195014 May 28 04:43:16.113905 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1283/2468] 10.222.0.58 () {58 vars in 1315 bytes} [Sat May 28 04:43:15 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-05-27T04%3A43%3A15.783271&end=2022-05-29T04%3A43%3A15.783271 => generated 112 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 28 04:43:16.129846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-48b8aac6-cb7e-4e81-bb89-759e9c304f94 tempest-TenantUsagesNegativeTestJSON-1583102554 tempest-TenantUsagesNegativeTestJSON-1583102554-project-admin] Calling method '.version_select at 0x7f7701b84d30>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:16.129846 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-48b8aac6-cb7e-4e81-bb89-759e9c304f94 tempest-TenantUsagesNegativeTestJSON-1583102554 tempest-TenantUsagesNegativeTestJSON-1583102554-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-48b8aac6-cb7e-4e81-bb89-759e9c304f94 tempest-TenantUsagesNegativeTestJSON-1583102554 tempest-TenantUsagesNegativeTestJSON-1583102554-project-admin] Request method failure captured: May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-simple-tenant-usage/6e77b7e9fd684cacb5cb256748812a5a?start=2022-05-29T04%3A43%3A15.783271&end=2022-05-27T04%3A43%3A15.783271 HTTP/1.1 May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikahjPmdcs8Anw2qPkXTiniXs8EpZvwGybYlU-A2tbJmba41_CYsJnln327O1MSFpVBd3tEJ0zhW5uQ4w-BjFZ7KUTRrdWpcvZD-1s-_AOm03ZonvjQxdDJd56acyR4wUBiskAuu_irzj7N3LQoP9zUstYk_FR0Oe7vR23JDr48VkRX0 May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: fe2e5afccde848758eb6085395833a42 May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1583102554 May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fe2e5afccde848758eb6085395833a42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fe2e5afccde848758eb6085395833a42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe2e5afccde848758eb6085395833a42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe2e5afccde848758eb6085395833a42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1583102554 May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: fe2e5afccde848758eb6085395833a42 May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1583102554 May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TenantUsagesNegativeTestJSON-1583102554-project-admin May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 4554d42b9a464918aab98a53ad957d9c May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1583102554-project-admin May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: exception: Invalid start time. The start time cannot occur after the end time. May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '6e77b7e9fd684cacb5cb256748812a5a'} May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. May 28 04:43:16.132272 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:16.137394 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-48b8aac6-cb7e-4e81-bb89-759e9c304f94 tempest-TenantUsagesNegativeTestJSON-1583102554 tempest-TenantUsagesNegativeTestJSON-1583102554-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:43:16.137394 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-48b8aac6-cb7e-4e81-bb89-759e9c304f94 tempest-TenantUsagesNegativeTestJSON-1583102554 tempest-TenantUsagesNegativeTestJSON-1583102554-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/6e77b7e9fd684cacb5cb256748812a5a?start=2022-05-29T04%3A43%3A15.783271&end=2022-05-27T04%3A43%3A15.783271" status: 400 len: 111 microversion: 2.1 time: 0.014400 May 28 04:43:16.137394 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1284/2469] 10.222.0.58 () {58 vars in 1411 bytes} [Sat May 28 04:43:16 2022] GET /compute/v2.1/os-simple-tenant-usage/6e77b7e9fd684cacb5cb256748812a5a?start=2022-05-29T04%3A43%3A15.783271&end=2022-05-27T04%3A43%3A15.783271 => generated 111 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 04:43:16.250028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-428d971a-fa32-4da7-b740-2d039289899c tempest-TenantUsagesNegativeTestJSON-2085235483 tempest-TenantUsagesNegativeTestJSON-2085235483-project] Calling method '.version_select at 0x7f7701d0e940>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:16.253126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-428d971a-fa32-4da7-b740-2d039289899c tempest-TenantUsagesNegativeTestJSON-2085235483 tempest-TenantUsagesNegativeTestJSON-2085235483-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'fe4d2485509e4d5fa6aff7996c8548d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e77b7e9fd684cacb5cb256748812a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-428d971a-fa32-4da7-b740-2d039289899c tempest-TenantUsagesNegativeTestJSON-2085235483 tempest-TenantUsagesNegativeTestJSON-2085235483-project] Request method failure captured: May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-27T04%3A43%3A15.783271&end=2022-05-29T04%3A43%3A15.783271&detailed=1 HTTP/1.1 May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikahiXx5d3Td1cBH3M2O21r_kW7eOiKzXJcW-fKvCt8MMIMeCAhfeE7cvxlMMaBpNOkbmU0iOYtx8FWRGUPzwif3uSWKiD_BHJKECDOEw1OraGAzsl-p8exwtn2CNulC6Bzfrl3yaqjzBNCR7jCp4l6Foe7LQ9gA2tjhblBc-mJdqaxA May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 6e77b7e9fd684cacb5cb256748812a5a May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2085235483 May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6e77b7e9fd684cacb5cb256748812a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6e77b7e9fd684cacb5cb256748812a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6e77b7e9fd684cacb5cb256748812a5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6e77b7e9fd684cacb5cb256748812a5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2085235483 May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 6e77b7e9fd684cacb5cb256748812a5a May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2085235483 May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TenantUsagesNegativeTestJSON-2085235483-project May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: fe4d2485509e4d5fa6aff7996c8548d2 May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2085235483-project May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: action_args: {} May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._index(req) May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:43:16.254801 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:43:16.261014 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 28 04:43:16.261014 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:16.261014 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:43:16.261014 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:16.261014 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:43:16.261014 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:43:16.261014 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:43:16.261014 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:43:16.261014 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:43:16.261014 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 28 04:43:16.261014 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:16.261014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-428d971a-fa32-4da7-b740-2d039289899c tempest-TenantUsagesNegativeTestJSON-2085235483 tempest-TenantUsagesNegativeTestJSON-2085235483-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:43:16.261014 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-428d971a-fa32-4da7-b740-2d039289899c tempest-TenantUsagesNegativeTestJSON-2085235483 tempest-TenantUsagesNegativeTestJSON-2085235483-project] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-27T04%3A43%3A15.783271&end=2022-05-29T04%3A43%3A15.783271&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.116131 May 28 04:43:16.261014 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1285/2470] 10.222.0.58 () {58 vars in 1334 bytes} [Sat May 28 04:43:16 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-27T04%3A43%3A15.783271&end=2022-05-29T04%3A43%3A15.783271&detailed=1 => generated 123 bytes in 121 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 28 04:43:16.451293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fd37c273-f07e-44e7-b1fb-25003a2b5ee4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:16.456523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fd37c273-f07e-44e7-b1fb-25003a2b5ee4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:16.462091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd37c273-f07e-44e7-b1fb-25003a2b5ee4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:16.462804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd37c273-f07e-44e7-b1fb-25003a2b5ee4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:16.463916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd37c273-f07e-44e7-b1fb-25003a2b5ee4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:16.464977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd37c273-f07e-44e7-b1fb-25003a2b5ee4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:16.705064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fd37c273-f07e-44e7-b1fb-25003a2b5ee4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:16.713992 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fd37c273-f07e-44e7-b1fb-25003a2b5ee4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:16.719697 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fd37c273-f07e-44e7-b1fb-25003a2b5ee4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:16.723025 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fd37c273-f07e-44e7-b1fb-25003a2b5ee4 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.278318 May 28 04:43:16.726153 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1286/2471] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:16 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:16.741788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9d62bc2a-b5fd-4e77-aa7b-5fa2da11f35f tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:16.741788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9d62bc2a-b5fd-4e77-aa7b-5fa2da11f35f tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:16.748534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:16.758431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d62bc2a-b5fd-4e77-aa7b-5fa2da11f35f tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:16.758891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d62bc2a-b5fd-4e77-aa7b-5fa2da11f35f tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:16.759706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d62bc2a-b5fd-4e77-aa7b-5fa2da11f35f tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:16.760154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d62bc2a-b5fd-4e77-aa7b-5fa2da11f35f tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:16.885239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9d62bc2a-b5fd-4e77-aa7b-5fa2da11f35f tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:16.898900 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9d62bc2a-b5fd-4e77-aa7b-5fa2da11f35f tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1251 microversion: 2.1 time: 0.161896 May 28 04:43:16.898900 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1287/2472] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:16 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1251 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:16.922875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c030d7ba-3821-4868-ab74-5ab3e1751c54 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:16.927765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c030d7ba-3821-4868-ab74-5ab3e1751c54 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:16.952284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c030d7ba-3821-4868-ab74-5ab3e1751c54 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:16.955892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c030d7ba-3821-4868-ab74-5ab3e1751c54 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:16.955892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c030d7ba-3821-4868-ab74-5ab3e1751c54 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:16.955892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c030d7ba-3821-4868-ab74-5ab3e1751c54 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:17.141074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c030d7ba-3821-4868-ab74-5ab3e1751c54 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:17.149503 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c030d7ba-3821-4868-ab74-5ab3e1751c54 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1523 microversion: 2.1 time: 0.249463 May 28 04:43:17.150084 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1288/2473] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:16 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:17.155987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f1beb470-7d46-4cb7-9dbd-a7fc4fe2838e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:17.157125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f1beb470-7d46-4cb7-9dbd-a7fc4fe2838e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:17.164379 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f1beb470-7d46-4cb7-9dbd-a7fc4fe2838e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:17.173660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f1beb470-7d46-4cb7-9dbd-a7fc4fe2838e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:17.173660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f1beb470-7d46-4cb7-9dbd-a7fc4fe2838e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:17.173660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f1beb470-7d46-4cb7-9dbd-a7fc4fe2838e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:17.265712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f1beb470-7d46-4cb7-9dbd-a7fc4fe2838e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:17.276299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f1beb470-7d46-4cb7-9dbd-a7fc4fe2838e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:17.278607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f1beb470-7d46-4cb7-9dbd-a7fc4fe2838e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:17.284971 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f1beb470-7d46-4cb7-9dbd-a7fc4fe2838e tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1453 microversion: 2.75 time: 0.133090 May 28 04:43:17.285574 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1289/2474] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:17 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1453 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:17.292351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-139ba2bc-13d7-4634-931e-f591b0d226ee req-69323fe9-2db4-49c4-aced-d52c0bd92d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8654f0-6755-46c3-8801-c2d3b4d37b48", "name": "network-vif-plugged", "status": "completed", "tag": "75fd5f82-f67a-4a99-99fd-45d2df08382c"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:17.304733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-139ba2bc-13d7-4634-931e-f591b0d226ee req-69323fe9-2db4-49c4-aced-d52c0bd92d38 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:17.305670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-139ba2bc-13d7-4634-931e-f591b0d226ee req-69323fe9-2db4-49c4-aced-d52c0bd92d38 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:17.320595 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-139ba2bc-13d7-4634-931e-f591b0d226ee req-69323fe9-2db4-49c4-aced-d52c0bd92d38 service nova] Creating event network-vif-plugged:75fd5f82-f67a-4a99-99fd-45d2df08382c for instance 3c8654f0-6755-46c3-8801-c2d3b4d37b48 on n-h1-843700-1 May 28 04:43:17.327830 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-139ba2bc-13d7-4634-931e-f591b0d226ee req-69323fe9-2db4-49c4-aced-d52c0bd92d38 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040282 May 28 04:43:17.333130 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1290/2475] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:43:17.745480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f5636abf-7266-4c95-8908-d745f4060d58 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:17.746354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f5636abf-7266-4c95-8908-d745f4060d58 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:17.754358 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5636abf-7266-4c95-8908-d745f4060d58 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:17.756187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5636abf-7266-4c95-8908-d745f4060d58 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:17.757156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5636abf-7266-4c95-8908-d745f4060d58 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:17.757918 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5636abf-7266-4c95-8908-d745f4060d58 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:17.918106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f5636abf-7266-4c95-8908-d745f4060d58 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:17.928637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f5636abf-7266-4c95-8908-d745f4060d58 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:17.928750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f5636abf-7266-4c95-8908-d745f4060d58 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:17.930002 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f5636abf-7266-4c95-8908-d745f4060d58 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.190901 May 28 04:43:17.930584 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1291/2476] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:17 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:43:17.944337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-37f2c505-2605-46ae-aa7e-337d2c4ca4dd tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:17.944957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-37f2c505-2605-46ae-aa7e-337d2c4ca4dd tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:17.951350 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-37f2c505-2605-46ae-aa7e-337d2c4ca4dd tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:17.952554 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-37f2c505-2605-46ae-aa7e-337d2c4ca4dd tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:17.952843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-37f2c505-2605-46ae-aa7e-337d2c4ca4dd tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:17.953300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-37f2c505-2605-46ae-aa7e-337d2c4ca4dd tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:18.027537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-37f2c505-2605-46ae-aa7e-337d2c4ca4dd tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:18.036878 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-37f2c505-2605-46ae-aa7e-337d2c4ca4dd tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1251 microversion: 2.1 time: 0.095842 May 28 04:43:18.037459 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1292/2477] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:17 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1251 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:18.166550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ee19f620-21a4-47c8-893c-8bfe3c75fd80 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:18.167234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ee19f620-21a4-47c8-893c-8bfe3c75fd80 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:18.174602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ee19f620-21a4-47c8-893c-8bfe3c75fd80 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:18.175116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ee19f620-21a4-47c8-893c-8bfe3c75fd80 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:18.176104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ee19f620-21a4-47c8-893c-8bfe3c75fd80 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:18.176813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ee19f620-21a4-47c8-893c-8bfe3c75fd80 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:18.327636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ee19f620-21a4-47c8-893c-8bfe3c75fd80 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:18.338153 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ee19f620-21a4-47c8-893c-8bfe3c75fd80 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1523 microversion: 2.1 time: 0.175586 May 28 04:43:18.354429 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1293/2478] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:18 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:43:18.360415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5f130642-2cc7-491c-a5fe-1b2db5e412d4 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:18.361300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5f130642-2cc7-491c-a5fe-1b2db5e412d4 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:18.368932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f130642-2cc7-491c-a5fe-1b2db5e412d4 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:18.369925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f130642-2cc7-491c-a5fe-1b2db5e412d4 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:18.370981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f130642-2cc7-491c-a5fe-1b2db5e412d4 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:18.371615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f130642-2cc7-491c-a5fe-1b2db5e412d4 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:18.449945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5f130642-2cc7-491c-a5fe-1b2db5e412d4 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:18.460799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5f130642-2cc7-491c-a5fe-1b2db5e412d4 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:18.462404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5f130642-2cc7-491c-a5fe-1b2db5e412d4 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:18.468256 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5f130642-2cc7-491c-a5fe-1b2db5e412d4 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1453 microversion: 2.75 time: 0.112652 May 28 04:43:18.469056 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1294/2479] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:18 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:18.597597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-486ce2d6-c947-43a3-9d15-c912fa72d388 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:18.597597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-486ce2d6-c947-43a3-9d15-c912fa72d388 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:18.623288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-486ce2d6-c947-43a3-9d15-c912fa72d388 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:18.623896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-486ce2d6-c947-43a3-9d15-c912fa72d388 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:18.633022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-486ce2d6-c947-43a3-9d15-c912fa72d388 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:18.633505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-486ce2d6-c947-43a3-9d15-c912fa72d388 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:18.703424 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-486ce2d6-c947-43a3-9d15-c912fa72d388 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] HTTP exception thrown: Instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 could not be found. May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-486ce2d6-c947-43a3-9d15-c912fa72d388 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Request method failure captured: May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 HTTP/1.1 May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaekTXunuyl_KpGuIEvq6GM-tp6IzyfiiepiNlixAq6BM-u2Jr3PM4bkVXlkwwqG60-8wmnpAVGie7FpIwQD-EMAVlElLGs5ksCpIKM-eIHqe6U5vMDKn7ArfQ24H0PRQgSHooX54t-XVr9cqTI2ZJOGcl1HDbmDfEB8c1avlZmrj_M May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: f5cf1a786cba41cd88ea6a766ca8a673 May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1163432414 May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f5cf1a786cba41cd88ea6a766ca8a673"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f5cf1a786cba41cd88ea6a766ca8a673"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5cf1a786cba41cd88ea6a766ca8a673"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5cf1a786cba41cd88ea6a766ca8a673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1163432414 May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: f5cf1a786cba41cd88ea6a766ca8a673 May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1163432414 May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AttachSCSIVolumeTestJSON-1163432414-project May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 99e2ff86a2484cd38b6e4176109f6b53 May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1163432414-project May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 could not be found. May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '7f4e280f-6de0-467b-b4ac-c13f9e780963'} May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 could not be found. May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:43:18.705371 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:43:18.711645 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 could not be found. May 28 04:43:18.711645 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:18.711645 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:43:18.711645 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:18.711645 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:43:18.711645 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:43:18.711645 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:43:18.711645 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:43:18.711645 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:43:18.711645 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 could not be found. May 28 04:43:18.711645 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:18.711645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-486ce2d6-c947-43a3-9d15-c912fa72d388 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Returning 404 to user: Instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:43:18.711645 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-486ce2d6-c947-43a3-9d15-c912fa72d388 tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 404 len: 111 microversion: 2.1 time: 0.115786 May 28 04:43:18.719990 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1295/2480] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:43:18 2022] DELETE /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:43:18.730449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bb77ab1c-a152-4a15-af34-1c980417349e tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:18.731357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bb77ab1c-a152-4a15-af34-1c980417349e tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] [instance: 7f4e280f-6de0-467b-b4ac-c13f9e780963] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:18.739199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb77ab1c-a152-4a15-af34-1c980417349e tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:18.739944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb77ab1c-a152-4a15-af34-1c980417349e tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:18.741014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb77ab1c-a152-4a15-af34-1c980417349e tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:18.741697 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb77ab1c-a152-4a15-af34-1c980417349e tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:18.761753 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-bb77ab1c-a152-4a15-af34-1c980417349e tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] HTTP exception thrown: Instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 could not be found. May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bb77ab1c-a152-4a15-af34-1c980417349e tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Request method failure captured: May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 HTTP/1.1 May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaekTXunuyl_KpGuIEvq6GM-tp6IzyfiiepiNlixAq6BM-u2Jr3PM4bkVXlkwwqG60-8wmnpAVGie7FpIwQD-EMAVlElLGs5ksCpIKM-eIHqe6U5vMDKn7ArfQ24H0PRQgSHooX54t-XVr9cqTI2ZJOGcl1HDbmDfEB8c1avlZmrj_M May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: f5cf1a786cba41cd88ea6a766ca8a673 May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1163432414 May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f5cf1a786cba41cd88ea6a766ca8a673"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f5cf1a786cba41cd88ea6a766ca8a673"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5cf1a786cba41cd88ea6a766ca8a673"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5cf1a786cba41cd88ea6a766ca8a673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1163432414 May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: f5cf1a786cba41cd88ea6a766ca8a673 May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1163432414 May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AttachSCSIVolumeTestJSON-1163432414-project May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 99e2ff86a2484cd38b6e4176109f6b53 May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1163432414-project May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 could not be found. May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '7f4e280f-6de0-467b-b4ac-c13f9e780963'} May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 could not be found. May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 could not be found. May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:43:18.763794 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:18.769079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:43:18.769079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:43:18.769079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:43:18.769079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:43:18.769079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:43:18.769079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 could not be found. May 28 04:43:18.769079 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:18.771392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bb77ab1c-a152-4a15-af34-1c980417349e tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] Returning 404 to user: Instance 7f4e280f-6de0-467b-b4ac-c13f9e780963 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:43:18.772419 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bb77ab1c-a152-4a15-af34-1c980417349e tempest-AttachSCSIVolumeTestJSON-1163432414 tempest-AttachSCSIVolumeTestJSON-1163432414-project] 10.222.0.58 "GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963" status: 404 len: 111 microversion: 2.1 time: 0.047579 May 28 04:43:18.773537 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1296/2481] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:18 2022] GET /compute/v2.1/servers/7f4e280f-6de0-467b-b4ac-c13f9e780963 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:43:18.949576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3dc94736-2457-475a-82e7-f47597160ce8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:18.950694 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3dc94736-2457-475a-82e7-f47597160ce8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:18.962264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3dc94736-2457-475a-82e7-f47597160ce8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:18.963986 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3dc94736-2457-475a-82e7-f47597160ce8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:18.967118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3dc94736-2457-475a-82e7-f47597160ce8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:18.969179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3dc94736-2457-475a-82e7-f47597160ce8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:19.045516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f79daf69-2dbb-4015-9cfc-550283013043 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:43:19.048405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f79daf69-2dbb-4015-9cfc-550283013043 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='42f39bb2-e7be-4555-aba9-dd9d64fc78ff',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='154e1505-6e0f-4b2a-8015-f4d3aa590ade',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0157825e-114a-4785-b4e0-0bf9f9b8f653',volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:43:19.432074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3dc94736-2457-475a-82e7-f47597160ce8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:19.443128 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3dc94736-2457-475a-82e7-f47597160ce8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:19.445091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3dc94736-2457-475a-82e7-f47597160ce8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:19.446504 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3dc94736-2457-475a-82e7-f47597160ce8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.501507 May 28 04:43:19.447182 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1297/2482] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:18 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:19.462713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d64d0973-3ef6-4e0f-97b7-ef9572f84db9 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:19.463294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d64d0973-3ef6-4e0f-97b7-ef9572f84db9 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:19.469729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d64d0973-3ef6-4e0f-97b7-ef9572f84db9 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:19.470428 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d64d0973-3ef6-4e0f-97b7-ef9572f84db9 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:19.471496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d64d0973-3ef6-4e0f-97b7-ef9572f84db9 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:19.472161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d64d0973-3ef6-4e0f-97b7-ef9572f84db9 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:19.523938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d64d0973-3ef6-4e0f-97b7-ef9572f84db9 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:19.524701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d64d0973-3ef6-4e0f-97b7-ef9572f84db9 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:19.525716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-d64d0973-3ef6-4e0f-97b7-ef9572f84db9 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lazy-loading 'fault' on Instance uuid b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:19.595829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d64d0973-3ef6-4e0f-97b7-ef9572f84db9 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f99e2be7184b41acd8481762d85254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30126363eb444c78a459e1beaa9ddce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:19.604584 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d64d0973-3ef6-4e0f-97b7-ef9572f84db9 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 200 len: 1256 microversion: 2.1 time: 0.156125 May 28 04:43:19.605424 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1298/2483] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:19 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 1256 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:19.610233 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-54b69982-96a4-4422-9e86-be23bf80bb96 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:19.612678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-54b69982-96a4-4422-9e86-be23bf80bb96 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:19.618356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-54b69982-96a4-4422-9e86-be23bf80bb96 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:19.619081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-54b69982-96a4-4422-9e86-be23bf80bb96 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:19.620104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-54b69982-96a4-4422-9e86-be23bf80bb96 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:19.620720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-54b69982-96a4-4422-9e86-be23bf80bb96 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:19.625736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:19.830790 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-54b69982-96a4-4422-9e86-be23bf80bb96 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:19.843660 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-54b69982-96a4-4422-9e86-be23bf80bb96 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1508 microversion: 2.1 time: 0.236998 May 28 04:43:19.845223 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1299/2484] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:19 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:19.852108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-09c64c43-9a37-4661-b9d8-2d776c328267 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:19.852959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-09c64c43-9a37-4661-b9d8-2d776c328267 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:19.862015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09c64c43-9a37-4661-b9d8-2d776c328267 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:19.862740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09c64c43-9a37-4661-b9d8-2d776c328267 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:19.865385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09c64c43-9a37-4661-b9d8-2d776c328267 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:19.866028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09c64c43-9a37-4661-b9d8-2d776c328267 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:19.982089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-09c64c43-9a37-4661-b9d8-2d776c328267 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:19.993922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-09c64c43-9a37-4661-b9d8-2d776c328267 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:19.997026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-09c64c43-9a37-4661-b9d8-2d776c328267 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:20.007313 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-09c64c43-9a37-4661-b9d8-2d776c328267 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1438 microversion: 2.75 time: 0.157059 May 28 04:43:20.007313 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1300/2485] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:19 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1438 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:20.011998 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1ca5d09a-dba6-4465-96c1-417fd1757cfa tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:20.013153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1ca5d09a-dba6-4465-96c1-417fd1757cfa tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:20.027854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ca5d09a-dba6-4465-96c1-417fd1757cfa tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:20.052036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ca5d09a-dba6-4465-96c1-417fd1757cfa tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:20.052924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ca5d09a-dba6-4465-96c1-417fd1757cfa tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:20.055183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ca5d09a-dba6-4465-96c1-417fd1757cfa tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:20.428709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1ca5d09a-dba6-4465-96c1-417fd1757cfa tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:20.438596 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1ca5d09a-dba6-4465-96c1-417fd1757cfa tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 200 len: 1508 microversion: 2.1 time: 0.432114 May 28 04:43:20.442111 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1301/2486] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:20 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 1508 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:20.693990 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f79daf69-2dbb-4015-9cfc-550283013043 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 13.032301 May 28 04:43:20.699562 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1186/2487] 10.222.0.58 () {62 vars in 1188 bytes} [Sat May 28 04:43:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 13041 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 04:43:20.710052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-048fb707-bb4b-463f-8aa3-2cc46f402a95 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:20.713076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-048fb707-bb4b-463f-8aa3-2cc46f402a95 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:20.743206 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-048fb707-bb4b-463f-8aa3-2cc46f402a95 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:20.747337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-048fb707-bb4b-463f-8aa3-2cc46f402a95 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:20.747337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-048fb707-bb4b-463f-8aa3-2cc46f402a95 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:20.747337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-048fb707-bb4b-463f-8aa3-2cc46f402a95 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:20.792563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-048fb707-bb4b-463f-8aa3-2cc46f402a95 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:43:20.840149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a68cfea8-c1e3-41e5-88ff-833a401fcd3c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "012b12af-263c-4753-8fad-4a4022b439aa"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:20.842240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a68cfea8-c1e3-41e5-88ff-833a401fcd3c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:20.855020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a68cfea8-c1e3-41e5-88ff-833a401fcd3c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:20.857488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a68cfea8-c1e3-41e5-88ff-833a401fcd3c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:20.858510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a68cfea8-c1e3-41e5-88ff-833a401fcd3c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:20.865286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a68cfea8-c1e3-41e5-88ff-833a401fcd3c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:20.977613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a68cfea8-c1e3-41e5-88ff-833a401fcd3c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:43:20.978387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a68cfea8-c1e3-41e5-88ff-833a401fcd3c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:43:20.979223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a68cfea8-c1e3-41e5-88ff-833a401fcd3c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:43:20.986597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a68cfea8-c1e3-41e5-88ff-833a401fcd3c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:43:20.986597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a68cfea8-c1e3-41e5-88ff-833a401fcd3c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:43:21.206134 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-048fb707-bb4b-463f-8aa3-2cc46f402a95 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 204 len: 0 microversion: 2.1 time: 0.500243 May 28 04:43:21.208796 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1187/2488] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:43:20 2022] DELETE /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:43:21.233946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c7aab452-aa8e-4151-a0a3-24d36514e441 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:21.235895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c7aab452-aa8e-4151-a0a3-24d36514e441 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:21.254524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7aab452-aa8e-4151-a0a3-24d36514e441 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:21.256021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7aab452-aa8e-4151-a0a3-24d36514e441 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:21.258456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7aab452-aa8e-4151-a0a3-24d36514e441 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:21.262352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7aab452-aa8e-4151-a0a3-24d36514e441 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:21.320539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a68cfea8-c1e3-41e5-88ff-833a401fcd3c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:21.345128 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a68cfea8-c1e3-41e5-88ff-833a401fcd3c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:21.345753 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a68cfea8-c1e3-41e5-88ff-833a401fcd3c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:21.349449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a68cfea8-c1e3-41e5-88ff-833a401fcd3c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:21.351738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a68cfea8-c1e3-41e5-88ff-833a401fcd3c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:21.680222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-a68cfea8-c1e3-41e5-88ff-833a401fcd3c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:21.702288 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a68cfea8-c1e3-41e5-88ff-833a401fcd3c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374/action" status: 202 len: 1942 microversion: 2.75 time: 1.257807 May 28 04:43:21.716473 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1302/2489] 10.222.0.58 () {62 vars in 1318 bytes} [Sat May 28 04:43:20 2022] POST /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374/action => generated 1942 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 28 04:43:21.734728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7123c5de-947a-49b4-b610-974a17eae4b1 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:21.735449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7123c5de-947a-49b4-b610-974a17eae4b1 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] [instance: b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:21.750032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7123c5de-947a-49b4-b610-974a17eae4b1 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:21.751999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7123c5de-947a-49b4-b610-974a17eae4b1 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:21.758639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7123c5de-947a-49b4-b610-974a17eae4b1 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:21.758639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7123c5de-947a-49b4-b610-974a17eae4b1 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:21.778523 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-7123c5de-947a-49b4-b610-974a17eae4b1 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] HTTP exception thrown: Instance b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 could not be found. May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7123c5de-947a-49b4-b610-974a17eae4b1 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Request method failure captured: May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 HTTP/1.1 May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikad-HlSc-bwobDJF7nNiFKzO2_5qlBWEgNKrnBpcTqSBsz7NkRB90AseZ9qAN2TFToV-Vj1VemBl8jIaD25EAJB01REk8TXirldoP1fbHFAh2ZX91D5Tx1jUHRAgEm2oqY1xjjyH3gmbnHygJIkL57qB0lNwJvIKZj3RwlFmAwtNRtE May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 30126363eb444c78a459e1beaa9ddce6 May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestBootFromVolume-1083019567 May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_30126363eb444c78a459e1beaa9ddce6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/30126363eb444c78a459e1beaa9ddce6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/30126363eb444c78a459e1beaa9ddce6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/30126363eb444c78a459e1beaa9ddce6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestBootFromVolume-1083019567 May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 30126363eb444c78a459e1beaa9ddce6 May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1083019567 May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestBootFromVolume-1083019567-project May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 85f99e2be7184b41acd8481762d85254 May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestBootFromVolume-1083019567-project May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 could not be found. May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5'} May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 could not be found. May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 could not be found. May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:43:21.780513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:21.793621 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:43:21.793621 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:43:21.793621 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:43:21.793621 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:43:21.793621 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:43:21.793621 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 could not be found. May 28 04:43:21.793621 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:43:21.793621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7123c5de-947a-49b4-b610-974a17eae4b1 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Returning 404 to user: Instance b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:43:21.793621 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7123c5de-947a-49b4-b610-974a17eae4b1 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5" status: 404 len: 111 microversion: 2.1 time: 0.064410 May 28 04:43:21.793621 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1303/2490] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:21 2022] GET /compute/v2.1/servers/b7545aea-b5ad-4ef6-9ee2-2a42f9377ba5 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:43:21.796818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-87bb51e9-f332-4a23-a2f6-70307f40a1f1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:21.797739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-87bb51e9-f332-4a23-a2f6-70307f40a1f1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:21.937789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-87bb51e9-f332-4a23-a2f6-70307f40a1f1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:21.946390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-87bb51e9-f332-4a23-a2f6-70307f40a1f1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:21.952576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-87bb51e9-f332-4a23-a2f6-70307f40a1f1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:21.955628 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-87bb51e9-f332-4a23-a2f6-70307f40a1f1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1284 microversion: 2.42 time: 0.169866 May 28 04:43:21.955628 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1304/2491] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:21 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:21.969888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1fc15a61-8c39-40b4-8140-d867dfdf4713 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-516855738", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "76e10746-e2e9-4339-aae3-49ef9bc702b8"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:22.022910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c7aab452-aa8e-4151-a0a3-24d36514e441 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:22.035948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c7aab452-aa8e-4151-a0a3-24d36514e441 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:22.038071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c7aab452-aa8e-4151-a0a3-24d36514e441 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:22.039281 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c7aab452-aa8e-4151-a0a3-24d36514e441 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.828743 May 28 04:43:22.039848 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1188/2492] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:21 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:22.044639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-1fc15a61-8c39-40b4-8140-d867dfdf4713 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] validate_networks() for [('76e10746-e2e9-4339-aae3-49ef9bc702b8', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:43:22.057074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7a82b3b4-12c7-42de-acaa-e4d0f274aa59 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:22.060282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7a82b3b4-12c7-42de-acaa-e4d0f274aa59 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:22.074945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a82b3b4-12c7-42de-acaa-e4d0f274aa59 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:22.079065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a82b3b4-12c7-42de-acaa-e4d0f274aa59 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:22.080195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a82b3b4-12c7-42de-acaa-e4d0f274aa59 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:22.080895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a82b3b4-12c7-42de-acaa-e4d0f274aa59 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:22.227501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:22.279831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:22.415977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-7a82b3b4-12c7-42de-acaa-e4d0f274aa59 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:22.454059 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7a82b3b4-12c7-42de-acaa-e4d0f274aa59 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1929 microversion: 2.75 time: 0.409208 May 28 04:43:22.466740 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1189/2493] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:22 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1929 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:22.478341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c8fb95b8-ac55-432a-ac70-38c6e6f0b186 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] Calling method '.version_select at 0x7f7701a8c3a0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:22.589391 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c8fb95b8-ac55-432a-ac70-38c6e6f0b186 tempest-ServersTestBootFromVolume-1083019567 tempest-ServersTestBootFromVolume-1083019567-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-751070852" status: 202 len: 0 microversion: 2.1 time: 0.121394 May 28 04:43:22.590628 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1190/2494] 10.222.0.58 () {58 vars in 1217 bytes} [Sat May 28 04:43:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-751070852 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:43:22.975163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c66f332a-94e7-44ce-b194-1e84ebe361bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:22.976091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c66f332a-94e7-44ce-b194-1e84ebe361bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:23.276247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-1fc15a61-8c39-40b4-8140-d867dfdf4713 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:43:23.277355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-1fc15a61-8c39-40b4-8140-d867dfdf4713 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:43:23.277937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-1fc15a61-8c39-40b4-8140-d867dfdf4713 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:43:23.278639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-1fc15a61-8c39-40b4-8140-d867dfdf4713 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:43:23.279255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-1fc15a61-8c39-40b4-8140-d867dfdf4713 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:43:23.298183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fc15a61-8c39-40b4-8140-d867dfdf4713 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:23.301243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fc15a61-8c39-40b4-8140-d867dfdf4713 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:23.303863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fc15a61-8c39-40b4-8140-d867dfdf4713 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:23.305241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fc15a61-8c39-40b4-8140-d867dfdf4713 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:23.369291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-1fc15a61-8c39-40b4-8140-d867dfdf4713 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Getting quotas for project a93892cb2a75466a82fcb79f40b306ca. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:43:23.385631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-1fc15a61-8c39-40b4-8140-d867dfdf4713 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Getting quotas for user 0d4fff87c06440478b3a4536a289aa99 and project a93892cb2a75466a82fcb79f40b306ca. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:43:23.418043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1fc15a61-8c39-40b4-8140-d867dfdf4713 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:43:23.425184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1fc15a61-8c39-40b4-8140-d867dfdf4713 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:43:23.458634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c66f332a-94e7-44ce-b194-1e84ebe361bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:23.474279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c66f332a-94e7-44ce-b194-1e84ebe361bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:23.479896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c66f332a-94e7-44ce-b194-1e84ebe361bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:23.481143 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c66f332a-94e7-44ce-b194-1e84ebe361bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1284 microversion: 2.42 time: 0.511802 May 28 04:43:23.481728 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1191/2495] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:22 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1284 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:23.512645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ed6e300d-e570-4450-9d3f-861e80d33959 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:23.517872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ed6e300d-e570-4450-9d3f-861e80d33959 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:23.532713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ed6e300d-e570-4450-9d3f-861e80d33959 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:23.533768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ed6e300d-e570-4450-9d3f-861e80d33959 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:23.539199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ed6e300d-e570-4450-9d3f-861e80d33959 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:23.540022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ed6e300d-e570-4450-9d3f-861e80d33959 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:23.653163 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1fc15a61-8c39-40b4-8140-d867dfdf4713 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.694390 May 28 04:43:23.656411 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1305/2496] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:43:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:43:23.670358 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d4a94c57-a881-45c9-842f-eee58558749d tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:23.672505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d4a94c57-a881-45c9-842f-eee58558749d tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:23.743341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d4a94c57-a881-45c9-842f-eee58558749d tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:23.751779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d4a94c57-a881-45c9-842f-eee58558749d tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:23.758157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d4a94c57-a881-45c9-842f-eee58558749d tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:23.760942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d4a94c57-a881-45c9-842f-eee58558749d tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:24.588385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-d4a94c57-a881-45c9-842f-eee58558749d tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:24.639048 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d4a94c57-a881-45c9-842f-eee58558749d tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1929 microversion: 2.75 time: 0.980651 May 28 04:43:24.640658 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1306/2497] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:23 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1929 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:24.647655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-344317e8-5ec6-488b-829d-385decacce6e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:24.648672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-344317e8-5ec6-488b-829d-385decacce6e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:24.857458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-344317e8-5ec6-488b-829d-385decacce6e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:24.869717 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-344317e8-5ec6-488b-829d-385decacce6e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1217 microversion: 2.1 time: 0.227493 May 28 04:43:24.879840 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1307/2498] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:24 2022] GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1217 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:24.885232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-76eb47a9-94f1-4333-b8f2-3f6bcff14b5b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:24.886096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-76eb47a9-94f1-4333-b8f2-3f6bcff14b5b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:24.892843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76eb47a9-94f1-4333-b8f2-3f6bcff14b5b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:24.893311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76eb47a9-94f1-4333-b8f2-3f6bcff14b5b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:24.894178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76eb47a9-94f1-4333-b8f2-3f6bcff14b5b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:24.894626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76eb47a9-94f1-4333-b8f2-3f6bcff14b5b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:24.898539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ed6e300d-e570-4450-9d3f-861e80d33959 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:24.923105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ed6e300d-e570-4450-9d3f-861e80d33959 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:24.925167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ed6e300d-e570-4450-9d3f-861e80d33959 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:24.927459 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ed6e300d-e570-4450-9d3f-861e80d33959 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 1.425857 May 28 04:43:24.928263 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1192/2499] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:23 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:25.042316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-76eb47a9-94f1-4333-b8f2-3f6bcff14b5b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:25.052580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-76eb47a9-94f1-4333-b8f2-3f6bcff14b5b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:25.056996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-76eb47a9-94f1-4333-b8f2-3f6bcff14b5b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:25.058487 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-76eb47a9-94f1-4333-b8f2-3f6bcff14b5b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1574 microversion: 2.42 time: 0.177360 May 28 04:43:25.059719 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1308/2500] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:24 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:25.584332 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-3a60cf0e-c3f9-4e29-9284-fc9cca3120e4 req-5bb8f778-b36f-408c-830a-07cc0f5dd1ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8654f0-6755-46c3-8801-c2d3b4d37b48", "name": "network-vif-deleted", "tag": "75fd5f82-f67a-4a99-99fd-45d2df08382c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:25.595629 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3a60cf0e-c3f9-4e29-9284-fc9cca3120e4 req-5bb8f778-b36f-408c-830a-07cc0f5dd1ee service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:25.596375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3a60cf0e-c3f9-4e29-9284-fc9cca3120e4 req-5bb8f778-b36f-408c-830a-07cc0f5dd1ee service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:25.633564 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-3a60cf0e-c3f9-4e29-9284-fc9cca3120e4 req-5bb8f778-b36f-408c-830a-07cc0f5dd1ee service nova] Creating event network-vif-deleted:75fd5f82-f67a-4a99-99fd-45d2df08382c for instance 3c8654f0-6755-46c3-8801-c2d3b4d37b48 on n-h1-843700-1 May 28 04:43:25.648672 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-3a60cf0e-c3f9-4e29-9284-fc9cca3120e4 req-5bb8f778-b36f-408c-830a-07cc0f5dd1ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070313 May 28 04:43:25.649334 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1193/2501] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:43:25.671186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5fceb07c-37a7-4fe8-a0f0-00980efbc44b tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:25.671186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5fceb07c-37a7-4fe8-a0f0-00980efbc44b tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:25.692625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5fceb07c-37a7-4fe8-a0f0-00980efbc44b tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:25.693096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5fceb07c-37a7-4fe8-a0f0-00980efbc44b tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:25.702444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5fceb07c-37a7-4fe8-a0f0-00980efbc44b tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:25.702444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5fceb07c-37a7-4fe8-a0f0-00980efbc44b tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:25.898775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ce23b2df-04d2-44a1-be06-ab88be434f4f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:25.900061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ce23b2df-04d2-44a1-be06-ab88be434f4f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:25.917554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce23b2df-04d2-44a1-be06-ab88be434f4f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:25.919029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-5fceb07c-37a7-4fe8-a0f0-00980efbc44b tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:25.921341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce23b2df-04d2-44a1-be06-ab88be434f4f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:25.925524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce23b2df-04d2-44a1-be06-ab88be434f4f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:25.926193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce23b2df-04d2-44a1-be06-ab88be434f4f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:25.977364 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5fceb07c-37a7-4fe8-a0f0-00980efbc44b tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1929 microversion: 2.75 time: 0.320060 May 28 04:43:25.982774 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1309/2502] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:25 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1929 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:25.994707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2bb883a8-e7e4-45a5-a8f8-97ce1a4a4329 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:25.995632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2bb883a8-e7e4-45a5-a8f8-97ce1a4a4329 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:26.002218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bb883a8-e7e4-45a5-a8f8-97ce1a4a4329 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:26.003285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bb883a8-e7e4-45a5-a8f8-97ce1a4a4329 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:26.006555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bb883a8-e7e4-45a5-a8f8-97ce1a4a4329 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:26.007280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bb883a8-e7e4-45a5-a8f8-97ce1a4a4329 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:26.238889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ce23b2df-04d2-44a1-be06-ab88be434f4f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:26.247962 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ce23b2df-04d2-44a1-be06-ab88be434f4f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1221 microversion: 2.1 time: 0.361087 May 28 04:43:26.256422 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1194/2503] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:25 2022] GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1221 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:43:26.259577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f7ffe2d5-047c-4048-9cc0-aed945abcc65 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:26.265590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f7ffe2d5-047c-4048-9cc0-aed945abcc65 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:26.292147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7ffe2d5-047c-4048-9cc0-aed945abcc65 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:26.292991 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7ffe2d5-047c-4048-9cc0-aed945abcc65 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:26.293956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7ffe2d5-047c-4048-9cc0-aed945abcc65 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:26.295599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7ffe2d5-047c-4048-9cc0-aed945abcc65 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:26.504300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f7ffe2d5-047c-4048-9cc0-aed945abcc65 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:26.524426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f7ffe2d5-047c-4048-9cc0-aed945abcc65 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:26.526400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f7ffe2d5-047c-4048-9cc0-aed945abcc65 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:26.528344 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f7ffe2d5-047c-4048-9cc0-aed945abcc65 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1592 microversion: 2.42 time: 0.274233 May 28 04:43:26.529256 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1195/2504] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:26 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1592 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:26.541206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2bb883a8-e7e4-45a5-a8f8-97ce1a4a4329 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:26.553499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2bb883a8-e7e4-45a5-a8f8-97ce1a4a4329 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:26.555965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2bb883a8-e7e4-45a5-a8f8-97ce1a4a4329 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:26.559678 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2bb883a8-e7e4-45a5-a8f8-97ce1a4a4329 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.568900 May 28 04:43:26.569699 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1310/2505] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:25 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:26.998053 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6c5334c0-1cd8-465a-bc11-0cc0202d79b2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:26.998618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6c5334c0-1cd8-465a-bc11-0cc0202d79b2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:27.032645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c5334c0-1cd8-465a-bc11-0cc0202d79b2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:27.037329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c5334c0-1cd8-465a-bc11-0cc0202d79b2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:27.042370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c5334c0-1cd8-465a-bc11-0cc0202d79b2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:27.042370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c5334c0-1cd8-465a-bc11-0cc0202d79b2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:27.269248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3728579f-ef8d-4880-89c7-7f1d32ff21fd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:27.271086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3728579f-ef8d-4880-89c7-7f1d32ff21fd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:27.285427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3728579f-ef8d-4880-89c7-7f1d32ff21fd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:27.286483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3728579f-ef8d-4880-89c7-7f1d32ff21fd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:27.287489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3728579f-ef8d-4880-89c7-7f1d32ff21fd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:27.288848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3728579f-ef8d-4880-89c7-7f1d32ff21fd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:27.569483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-6c5334c0-1cd8-465a-bc11-0cc0202d79b2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:27.624260 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6c5334c0-1cd8-465a-bc11-0cc0202d79b2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1929 microversion: 2.75 time: 0.627599 May 28 04:43:27.640303 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1196/2506] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:26 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1929 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:27.652318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3728579f-ef8d-4880-89c7-7f1d32ff21fd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:27.669615 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3728579f-ef8d-4880-89c7-7f1d32ff21fd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1277 microversion: 2.1 time: 0.399340 May 28 04:43:27.670761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9f35f5ea-b1ba-4294-bd2b-5df62fad9ad9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:27.671273 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1311/2507] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:27 2022] GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1277 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:27.672087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9f35f5ea-b1ba-4294-bd2b-5df62fad9ad9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:27.679539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9d8c42b0-fff1-4599-bf6f-d2f993a4c2fa tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:27.687201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f35f5ea-b1ba-4294-bd2b-5df62fad9ad9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:27.688080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f35f5ea-b1ba-4294-bd2b-5df62fad9ad9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:27.689921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f35f5ea-b1ba-4294-bd2b-5df62fad9ad9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:27.690579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f35f5ea-b1ba-4294-bd2b-5df62fad9ad9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:27.695627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9d8c42b0-fff1-4599-bf6f-d2f993a4c2fa tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:27.709044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d8c42b0-fff1-4599-bf6f-d2f993a4c2fa tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:27.730479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d8c42b0-fff1-4599-bf6f-d2f993a4c2fa tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:27.739243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d8c42b0-fff1-4599-bf6f-d2f993a4c2fa tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:27.739911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d8c42b0-fff1-4599-bf6f-d2f993a4c2fa tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:28.225615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9f35f5ea-b1ba-4294-bd2b-5df62fad9ad9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:28.244524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9f35f5ea-b1ba-4294-bd2b-5df62fad9ad9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:28.262282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9f35f5ea-b1ba-4294-bd2b-5df62fad9ad9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:28.264405 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9f35f5ea-b1ba-4294-bd2b-5df62fad9ad9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1592 microversion: 2.42 time: 0.612473 May 28 04:43:28.266447 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1197/2508] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:27 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1592 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:28.645642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9420426f-2841-40ac-b6b7-bf84ddb71f4c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:28.646263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9420426f-2841-40ac-b6b7-bf84ddb71f4c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:28.659291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9420426f-2841-40ac-b6b7-bf84ddb71f4c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:28.659757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9420426f-2841-40ac-b6b7-bf84ddb71f4c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:28.660563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9420426f-2841-40ac-b6b7-bf84ddb71f4c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:28.661727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9420426f-2841-40ac-b6b7-bf84ddb71f4c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:28.802377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9d8c42b0-fff1-4599-bf6f-d2f993a4c2fa tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:28.812136 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9d8c42b0-fff1-4599-bf6f-d2f993a4c2fa tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:28.816188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-9420426f-2841-40ac-b6b7-bf84ddb71f4c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:28.827673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9d8c42b0-fff1-4599-bf6f-d2f993a4c2fa tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:28.829390 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9d8c42b0-fff1-4599-bf6f-d2f993a4c2fa tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 1.156973 May 28 04:43:28.831049 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1312/2509] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:27 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:28.835820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-222b3d17-4703-40bf-a5f1-e9b211c9f1cc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:28.836776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-222b3d17-4703-40bf-a5f1-e9b211c9f1cc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:28.847556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-222b3d17-4703-40bf-a5f1-e9b211c9f1cc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:28.849023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-222b3d17-4703-40bf-a5f1-e9b211c9f1cc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:28.853239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-222b3d17-4703-40bf-a5f1-e9b211c9f1cc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:28.854011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-222b3d17-4703-40bf-a5f1-e9b211c9f1cc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:28.869629 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9420426f-2841-40ac-b6b7-bf84ddb71f4c tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1929 microversion: 2.75 time: 0.227655 May 28 04:43:28.870223 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1198/2510] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:28 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1929 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:43:29.284442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4938c1d6-2689-447f-9ca5-843a8e8d96c2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:29.289640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4938c1d6-2689-447f-9ca5-843a8e8d96c2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:29.300860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4938c1d6-2689-447f-9ca5-843a8e8d96c2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:29.301333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4938c1d6-2689-447f-9ca5-843a8e8d96c2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:29.313840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4938c1d6-2689-447f-9ca5-843a8e8d96c2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:29.314305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4938c1d6-2689-447f-9ca5-843a8e8d96c2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:30.313160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4938c1d6-2689-447f-9ca5-843a8e8d96c2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:30.333186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4938c1d6-2689-447f-9ca5-843a8e8d96c2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:30.333186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4938c1d6-2689-447f-9ca5-843a8e8d96c2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:30.358309 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4938c1d6-2689-447f-9ca5-843a8e8d96c2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1659 microversion: 2.42 time: 1.067771 May 28 04:43:30.363763 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1199/2511] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:29 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1659 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:30.380268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7bfbd78d-831d-4ddf-a21b-3bebd68add92 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:30.380899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7bfbd78d-831d-4ddf-a21b-3bebd68add92 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:30.395785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-222b3d17-4703-40bf-a5f1-e9b211c9f1cc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:30.410042 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-222b3d17-4703-40bf-a5f1-e9b211c9f1cc tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1317 microversion: 2.1 time: 1.573557 May 28 04:43:30.418676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7bfbd78d-831d-4ddf-a21b-3bebd68add92 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:30.419033 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1313/2512] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:28 2022] GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1317 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:30.419171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7bfbd78d-831d-4ddf-a21b-3bebd68add92 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:30.427584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7bfbd78d-831d-4ddf-a21b-3bebd68add92 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:30.428040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7bfbd78d-831d-4ddf-a21b-3bebd68add92 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:30.438191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-123ac43c-3564-4c9b-88b3-6bee727dbbb7 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:30.438821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-123ac43c-3564-4c9b-88b3-6bee727dbbb7 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:30.468026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-123ac43c-3564-4c9b-88b3-6bee727dbbb7 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:30.468531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-123ac43c-3564-4c9b-88b3-6bee727dbbb7 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:30.469558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-123ac43c-3564-4c9b-88b3-6bee727dbbb7 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:30.470005 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-123ac43c-3564-4c9b-88b3-6bee727dbbb7 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:30.829658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-123ac43c-3564-4c9b-88b3-6bee727dbbb7 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:30.893703 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-123ac43c-3564-4c9b-88b3-6bee727dbbb7 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1929 microversion: 2.75 time: 0.473163 May 28 04:43:30.908435 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1314/2513] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:30 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1929 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:31.169865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7bfbd78d-831d-4ddf-a21b-3bebd68add92 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:31.186590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7bfbd78d-831d-4ddf-a21b-3bebd68add92 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:31.191775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7bfbd78d-831d-4ddf-a21b-3bebd68add92 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:31.196256 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7bfbd78d-831d-4ddf-a21b-3bebd68add92 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1486 microversion: 2.25 time: 0.830652 May 28 04:43:31.215770 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1200/2514] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:30 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1486 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:31.377413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c572ce3a-f550-427f-9c2e-020bf792dc11 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:31.378201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c572ce3a-f550-427f-9c2e-020bf792dc11 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:31.392918 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c572ce3a-f550-427f-9c2e-020bf792dc11 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:31.393949 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c572ce3a-f550-427f-9c2e-020bf792dc11 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:31.394717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c572ce3a-f550-427f-9c2e-020bf792dc11 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:31.395827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c572ce3a-f550-427f-9c2e-020bf792dc11 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:31.429687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-de197058-5227-4425-8bb3-be6f4d3139c4 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:31.431164 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-de197058-5227-4425-8bb3-be6f4d3139c4 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:31.440341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:31.465262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de197058-5227-4425-8bb3-be6f4d3139c4 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:31.474655 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de197058-5227-4425-8bb3-be6f4d3139c4 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:31.475822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de197058-5227-4425-8bb3-be6f4d3139c4 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:31.478794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de197058-5227-4425-8bb3-be6f4d3139c4 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:32.094854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c572ce3a-f550-427f-9c2e-020bf792dc11 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:32.108952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c572ce3a-f550-427f-9c2e-020bf792dc11 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:32.110481 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c572ce3a-f550-427f-9c2e-020bf792dc11 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:32.111689 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c572ce3a-f550-427f-9c2e-020bf792dc11 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1659 microversion: 2.42 time: 0.738234 May 28 04:43:32.118736 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1315/2515] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:31 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1659 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:32.123904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f03eeef6-9cd0-4c46-b3b2-dae605b95508 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:32.129334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f03eeef6-9cd0-4c46-b3b2-dae605b95508 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:32.142140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f03eeef6-9cd0-4c46-b3b2-dae605b95508 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:32.142595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f03eeef6-9cd0-4c46-b3b2-dae605b95508 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:32.143402 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f03eeef6-9cd0-4c46-b3b2-dae605b95508 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:32.151444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f03eeef6-9cd0-4c46-b3b2-dae605b95508 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:32.344605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-f03eeef6-9cd0-4c46-b3b2-dae605b95508 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:32.361500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-de197058-5227-4425-8bb3-be6f4d3139c4 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:32.372816 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-de197058-5227-4425-8bb3-be6f4d3139c4 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1317 microversion: 2.1 time: 0.948890 May 28 04:43:32.378893 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1201/2516] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:31 2022] GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1317 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:43:32.386348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-86827df6-14bc-4f21-a4a1-e97e78e0191c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:32.387455 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f03eeef6-9cd0-4c46-b3b2-dae605b95508 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1929 microversion: 2.75 time: 0.267196 May 28 04:43:32.388272 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1316/2517] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:32 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1929 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:32.403298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-86827df6-14bc-4f21-a4a1-e97e78e0191c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:32.414828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-86827df6-14bc-4f21-a4a1-e97e78e0191c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:32.416499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-86827df6-14bc-4f21-a4a1-e97e78e0191c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:32.417316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-86827df6-14bc-4f21-a4a1-e97e78e0191c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:32.417764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-86827df6-14bc-4f21-a4a1-e97e78e0191c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:32.718338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-de84d3d1-0463-41c0-9a0d-1136e1a354d3 req-2305314c-e820-471a-83c0-9fd399e09634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc34e958-c428-470e-8d16-e00f1c149a92", "tag": "83244984-3d75-4908-8213-6f9f60cb8dc6"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:32.738037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:32.745225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-de84d3d1-0463-41c0-9a0d-1136e1a354d3 req-2305314c-e820-471a-83c0-9fd399e09634 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:32.746032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-de84d3d1-0463-41c0-9a0d-1136e1a354d3 req-2305314c-e820-471a-83c0-9fd399e09634 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:32.799652 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-de84d3d1-0463-41c0-9a0d-1136e1a354d3 req-2305314c-e820-471a-83c0-9fd399e09634 service nova] Creating event network-changed:83244984-3d75-4908-8213-6f9f60cb8dc6 for instance cc34e958-c428-470e-8d16-e00f1c149a92 on n-h1-843700-1 May 28 04:43:32.822164 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-de84d3d1-0463-41c0-9a0d-1136e1a354d3 req-2305314c-e820-471a-83c0-9fd399e09634 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105957 May 28 04:43:32.842376 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1317/2518] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:43:33.137533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f27a9ccf-1f19-410f-846e-5c1fdb3da2d4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:33.138371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f27a9ccf-1f19-410f-846e-5c1fdb3da2d4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:33.152646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f27a9ccf-1f19-410f-846e-5c1fdb3da2d4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:33.154561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f27a9ccf-1f19-410f-846e-5c1fdb3da2d4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:33.155474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f27a9ccf-1f19-410f-846e-5c1fdb3da2d4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:33.166477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f27a9ccf-1f19-410f-846e-5c1fdb3da2d4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:33.346821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:33.464489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:34.212812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-86827df6-14bc-4f21-a4a1-e97e78e0191c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:34.222040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-86827df6-14bc-4f21-a4a1-e97e78e0191c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:34.228022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-86827df6-14bc-4f21-a4a1-e97e78e0191c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:34.231438 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-86827df6-14bc-4f21-a4a1-e97e78e0191c tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1476 microversion: 2.25 time: 1.851162 May 28 04:43:34.236395 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1202/2519] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:32 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1476 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:34.245822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5c9a6f31-7477-4e63-ae45-7a81af3d4ea9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:34.250727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5c9a6f31-7477-4e63-ae45-7a81af3d4ea9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:34.264075 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c9a6f31-7477-4e63-ae45-7a81af3d4ea9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:34.264903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c9a6f31-7477-4e63-ae45-7a81af3d4ea9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:34.265916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c9a6f31-7477-4e63-ae45-7a81af3d4ea9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:34.266562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c9a6f31-7477-4e63-ae45-7a81af3d4ea9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:34.324596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:34.678622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f27a9ccf-1f19-410f-846e-5c1fdb3da2d4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:34.709411 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f27a9ccf-1f19-410f-846e-5c1fdb3da2d4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:34.712180 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f27a9ccf-1f19-410f-846e-5c1fdb3da2d4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:34.721299 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f27a9ccf-1f19-410f-846e-5c1fdb3da2d4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1705 microversion: 2.42 time: 1.588597 May 28 04:43:34.722663 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1318/2520] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:33 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1705 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:34.735648 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-babc5f73-5b58-4dc4-be2a-99f179bbb566 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:34.742086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-babc5f73-5b58-4dc4-be2a-99f179bbb566 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:34.772478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-babc5f73-5b58-4dc4-be2a-99f179bbb566 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:34.785665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-babc5f73-5b58-4dc4-be2a-99f179bbb566 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:34.786641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-babc5f73-5b58-4dc4-be2a-99f179bbb566 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:34.787205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-babc5f73-5b58-4dc4-be2a-99f179bbb566 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:34.881884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=10 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:35.291105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-babc5f73-5b58-4dc4-be2a-99f179bbb566 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:35.311006 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-babc5f73-5b58-4dc4-be2a-99f179bbb566 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1929 microversion: 2.75 time: 0.584780 May 28 04:43:35.312030 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1319/2521] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:34 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1929 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:35.330554 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bdce1744-23c8-4e4e-8a70-10d8490e081c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '.version_select at 0x7f77015ba430>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:35.331755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5c9a6f31-7477-4e63-ae45-7a81af3d4ea9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:35.334203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdce1744-23c8-4e4e-8a70-10d8490e081c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:35.334980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdce1744-23c8-4e4e-8a70-10d8490e081c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:35.341393 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5c9a6f31-7477-4e63-ae45-7a81af3d4ea9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1317 microversion: 2.1 time: 1.103577 May 28 04:43:35.355596 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bdce1744-23c8-4e4e-8a70-10d8490e081c tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1698 microversion: 2.25 time: 0.028953 May 28 04:43:35.356605 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1320/2522] 10.222.0.58 () {60 vars in 1183 bytes} [Sat May 28 04:43:35 2022] GET /compute/v2.1/os-migrations => generated 1698 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:35.364334 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1203/2523] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:34 2022] GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1317 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:35.375700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-db4f988d-de81-4e0b-8118-7b778c750cf3 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:35.376335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-db4f988d-de81-4e0b-8118-7b778c750cf3 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:35.382665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:35.395092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db4f988d-de81-4e0b-8118-7b778c750cf3 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:35.395554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db4f988d-de81-4e0b-8118-7b778c750cf3 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:35.403107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db4f988d-de81-4e0b-8118-7b778c750cf3 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:35.403594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db4f988d-de81-4e0b-8118-7b778c750cf3 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:35.742967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-900592af-0c17-480a-8030-cfa697180773 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:35.762354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-900592af-0c17-480a-8030-cfa697180773 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:35.778104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-900592af-0c17-480a-8030-cfa697180773 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:35.779647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-900592af-0c17-480a-8030-cfa697180773 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:35.784222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-900592af-0c17-480a-8030-cfa697180773 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:35.785542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-900592af-0c17-480a-8030-cfa697180773 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:37.218659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-db4f988d-de81-4e0b-8118-7b778c750cf3 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] Lazy-loading 'services' on Instance uuid 05c3986b-245a-4454-95c7-63f826af6edc {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:37.242237 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-db4f988d-de81-4e0b-8118-7b778c750cf3 tempest-LiveAutoBlockMigrationV225Test-706189215 tempest-LiveAutoBlockMigrationV225Test-706189215-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1968 microversion: 2.25 time: 1.876729 May 28 04:43:37.243612 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1204/2524] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:35 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1968 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:37.253922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c1922297-c44a-4515-804f-c2fd1901bef3 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:37.256429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c1922297-c44a-4515-804f-c2fd1901bef3 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:37.279643 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1922297-c44a-4515-804f-c2fd1901bef3 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:37.280549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1922297-c44a-4515-804f-c2fd1901bef3 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:37.282162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1922297-c44a-4515-804f-c2fd1901bef3 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:37.283381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1922297-c44a-4515-804f-c2fd1901bef3 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:37.339859 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-900592af-0c17-480a-8030-cfa697180773 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:37.351933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-900592af-0c17-480a-8030-cfa697180773 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:37.353500 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-900592af-0c17-480a-8030-cfa697180773 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:37.354725 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-900592af-0c17-480a-8030-cfa697180773 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1705 microversion: 2.42 time: 1.617937 May 28 04:43:37.366836 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1321/2525] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:35 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1705 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:43:37.373038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-624820b8-c417-41a9-83a9-8e9316df3b17 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:37.373933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-624820b8-c417-41a9-83a9-8e9316df3b17 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:37.381271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-624820b8-c417-41a9-83a9-8e9316df3b17 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:37.381966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-624820b8-c417-41a9-83a9-8e9316df3b17 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:37.382935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-624820b8-c417-41a9-83a9-8e9316df3b17 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:37.383705 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-624820b8-c417-41a9-83a9-8e9316df3b17 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:37.458901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-c1922297-c44a-4515-804f-c2fd1901bef3 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:37.479916 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c1922297-c44a-4515-804f-c2fd1901bef3 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1929 microversion: 2.75 time: 0.234851 May 28 04:43:37.481864 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1205/2526] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:37 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1929 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:37.733969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d36f2884-d9d4-475d-b333-909ec3d93b6e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-809010056", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "9da21411-17dd-4f3c-904b-2ef597d53247"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:37.835020 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-d36f2884-d9d4-475d-b333-909ec3d93b6e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] validate_networks() for [('9da21411-17dd-4f3c-904b-2ef597d53247', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:43:38.034382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-624820b8-c417-41a9-83a9-8e9316df3b17 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:38.053069 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-624820b8-c417-41a9-83a9-8e9316df3b17 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1317 microversion: 2.1 time: 0.679794 May 28 04:43:38.054743 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1322/2527] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:37 2022] GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1317 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:38.062898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c099bd89-bb42-4a6c-96ca-8ae69d71e058 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:38.063902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c099bd89-bb42-4a6c-96ca-8ae69d71e058 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:38.075560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c099bd89-bb42-4a6c-96ca-8ae69d71e058 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:38.076373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c099bd89-bb42-4a6c-96ca-8ae69d71e058 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:38.077578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c099bd89-bb42-4a6c-96ca-8ae69d71e058 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:38.078672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c099bd89-bb42-4a6c-96ca-8ae69d71e058 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:38.111457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c099bd89-bb42-4a6c-96ca-8ae69d71e058 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:43:38.537967 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c099bd89-bb42-4a6c-96ca-8ae69d71e058 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 204 len: 0 microversion: 2.25 time: 0.480914 May 28 04:43:38.538603 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1323/2528] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:43:38 2022] DELETE /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:43:38.571220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-55324a6b-f79e-4b85-afa9-7990b0059c34 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:38.578733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-55324a6b-f79e-4b85-afa9-7990b0059c34 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:38.616823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55324a6b-f79e-4b85-afa9-7990b0059c34 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:38.617976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55324a6b-f79e-4b85-afa9-7990b0059c34 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:38.628274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55324a6b-f79e-4b85-afa9-7990b0059c34 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:38.629004 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55324a6b-f79e-4b85-afa9-7990b0059c34 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:39.380134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-55324a6b-f79e-4b85-afa9-7990b0059c34 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:39.396794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-55324a6b-f79e-4b85-afa9-7990b0059c34 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:39.401976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-55324a6b-f79e-4b85-afa9-7990b0059c34 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:39.408105 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-55324a6b-f79e-4b85-afa9-7990b0059c34 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1751 microversion: 2.42 time: 0.866950 May 28 04:43:39.411301 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1324/2529] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:38 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1751 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:39.450205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-60400f3b-2d20-46a2-9e96-51bd48ebcde2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:39.452442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-60400f3b-2d20-46a2-9e96-51bd48ebcde2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:39.466164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60400f3b-2d20-46a2-9e96-51bd48ebcde2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:39.466876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60400f3b-2d20-46a2-9e96-51bd48ebcde2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:39.467793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60400f3b-2d20-46a2-9e96-51bd48ebcde2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:39.468422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60400f3b-2d20-46a2-9e96-51bd48ebcde2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:39.653069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-d36f2884-d9d4-475d-b333-909ec3d93b6e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:43:39.653712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-d36f2884-d9d4-475d-b333-909ec3d93b6e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:43:39.654359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-d36f2884-d9d4-475d-b333-909ec3d93b6e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:43:39.654913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-d36f2884-d9d4-475d-b333-909ec3d93b6e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:43:39.655537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-d36f2884-d9d4-475d-b333-909ec3d93b6e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:43:39.673150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-60400f3b-2d20-46a2-9e96-51bd48ebcde2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:39.681421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d36f2884-d9d4-475d-b333-909ec3d93b6e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:39.681421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d36f2884-d9d4-475d-b333-909ec3d93b6e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:39.681421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d36f2884-d9d4-475d-b333-909ec3d93b6e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:39.681421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d36f2884-d9d4-475d-b333-909ec3d93b6e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:39.717231 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-60400f3b-2d20-46a2-9e96-51bd48ebcde2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1929 microversion: 2.75 time: 0.304302 May 28 04:43:39.718737 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1325/2530] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:39 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1929 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:39.728595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dc7c594c-30f5-4766-bbfa-b3edb8e942e0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:39.729445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dc7c594c-30f5-4766-bbfa-b3edb8e942e0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:39.733909 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-d36f2884-d9d4-475d-b333-909ec3d93b6e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Getting quotas for project 3c8d3282507f4edabcfe1c87e6a2186c. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:43:39.747371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-d36f2884-d9d4-475d-b333-909ec3d93b6e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Getting quotas for user 6cec66a6c50340749edc115608c6eeaa and project 3c8d3282507f4edabcfe1c87e6a2186c. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:43:39.748959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc7c594c-30f5-4766-bbfa-b3edb8e942e0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:39.755072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc7c594c-30f5-4766-bbfa-b3edb8e942e0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:39.756165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc7c594c-30f5-4766-bbfa-b3edb8e942e0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:39.758493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc7c594c-30f5-4766-bbfa-b3edb8e942e0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:39.783996 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d36f2884-d9d4-475d-b333-909ec3d93b6e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:43:39.791546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d36f2884-d9d4-475d-b333-909ec3d93b6e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:43:40.002911 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d36f2884-d9d4-475d-b333-909ec3d93b6e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.521011 May 28 04:43:40.006394 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1206/2531] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:43:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:43:40.016345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6937686b-3c33-427e-8be7-735c1915cfc7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:40.017198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6937686b-3c33-427e-8be7-735c1915cfc7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:40.032243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6937686b-3c33-427e-8be7-735c1915cfc7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:40.037467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6937686b-3c33-427e-8be7-735c1915cfc7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:40.040671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6937686b-3c33-427e-8be7-735c1915cfc7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:40.041567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6937686b-3c33-427e-8be7-735c1915cfc7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:41.005677 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dc7c594c-30f5-4766-bbfa-b3edb8e942e0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:41.019433 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dc7c594c-30f5-4766-bbfa-b3edb8e942e0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:41.027891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dc7c594c-30f5-4766-bbfa-b3edb8e942e0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:41.030297 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dc7c594c-30f5-4766-bbfa-b3edb8e942e0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1482 microversion: 2.25 time: 1.308664 May 28 04:43:41.038916 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1326/2532] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:39 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1482 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:41.052543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-98b0255d-7793-4136-9f89-e0106b36de2b tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:41.053949 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-98b0255d-7793-4136-9f89-e0106b36de2b tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:41.190718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6937686b-3c33-427e-8be7-735c1915cfc7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:41.219393 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6937686b-3c33-427e-8be7-735c1915cfc7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1317 microversion: 2.1 time: 1.211526 May 28 04:43:41.224612 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1207/2533] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:40 2022] GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1317 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:41.246010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fa25a081-553a-4edd-845f-e2ab9e975c24 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:41.246634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fa25a081-553a-4edd-845f-e2ab9e975c24 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:41.281856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa25a081-553a-4edd-845f-e2ab9e975c24 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:41.288301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa25a081-553a-4edd-845f-e2ab9e975c24 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:41.293860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa25a081-553a-4edd-845f-e2ab9e975c24 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:41.295808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-98b0255d-7793-4136-9f89-e0106b36de2b tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:41.298364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa25a081-553a-4edd-845f-e2ab9e975c24 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:41.304979 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-98b0255d-7793-4136-9f89-e0106b36de2b tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d" status: 200 len: 1223 microversion: 2.1 time: 0.264680 May 28 04:43:41.307272 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1327/2534] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:41 2022] GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d => generated 1223 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:41.321114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-efc9cb26-0685-4293-a07b-6e24381592e2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:41.322092 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-efc9cb26-0685-4293-a07b-6e24381592e2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:41.332751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efc9cb26-0685-4293-a07b-6e24381592e2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:41.336227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efc9cb26-0685-4293-a07b-6e24381592e2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:41.339710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efc9cb26-0685-4293-a07b-6e24381592e2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:41.340352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efc9cb26-0685-4293-a07b-6e24381592e2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:41.889376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-efc9cb26-0685-4293-a07b-6e24381592e2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:41.930372 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-efc9cb26-0685-4293-a07b-6e24381592e2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1929 microversion: 2.75 time: 0.617410 May 28 04:43:41.937956 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1328/2535] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:41 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1929 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:42.053330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d278fc0e-12fa-447a-bbce-27c74034c69a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:42.053330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d278fc0e-12fa-447a-bbce-27c74034c69a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:42.061817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d278fc0e-12fa-447a-bbce-27c74034c69a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:42.068521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d278fc0e-12fa-447a-bbce-27c74034c69a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:42.068521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d278fc0e-12fa-447a-bbce-27c74034c69a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:42.068521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d278fc0e-12fa-447a-bbce-27c74034c69a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:42.512089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fa25a081-553a-4edd-845f-e2ab9e975c24 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:42.527847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fa25a081-553a-4edd-845f-e2ab9e975c24 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:42.545069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fa25a081-553a-4edd-845f-e2ab9e975c24 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:42.546366 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fa25a081-553a-4edd-845f-e2ab9e975c24 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1751 microversion: 2.42 time: 1.320681 May 28 04:43:42.564921 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1208/2536] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:41 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1751 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:42.577807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7c6a9a95-2804-4a65-b634-8eb8813baec9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:42.588445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7c6a9a95-2804-4a65-b634-8eb8813baec9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:42.609096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c6a9a95-2804-4a65-b634-8eb8813baec9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:42.609567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c6a9a95-2804-4a65-b634-8eb8813baec9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:42.610367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c6a9a95-2804-4a65-b634-8eb8813baec9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:42.614195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c6a9a95-2804-4a65-b634-8eb8813baec9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:43.030755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d278fc0e-12fa-447a-bbce-27c74034c69a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:43.090548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d278fc0e-12fa-447a-bbce-27c74034c69a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:43.110191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d278fc0e-12fa-447a-bbce-27c74034c69a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:43.112508 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d278fc0e-12fa-447a-bbce-27c74034c69a tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1482 microversion: 2.25 time: 1.063920 May 28 04:43:43.125566 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1329/2537] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:42 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1482 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:43:43.156388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fe07002f-1424-45d1-abf1-aded4516cdd9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:43.175521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fe07002f-1424-45d1-abf1-aded4516cdd9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:43.206250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe07002f-1424-45d1-abf1-aded4516cdd9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:43.209979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe07002f-1424-45d1-abf1-aded4516cdd9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:43.214235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe07002f-1424-45d1-abf1-aded4516cdd9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:43.217901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe07002f-1424-45d1-abf1-aded4516cdd9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:43.526361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fe07002f-1424-45d1-abf1-aded4516cdd9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:43.538250 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fe07002f-1424-45d1-abf1-aded4516cdd9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d" status: 200 len: 1275 microversion: 2.1 time: 0.410791 May 28 04:43:43.547831 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1330/2538] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:43 2022] GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d => generated 1275 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:43.557986 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2be4385e-49a4-431f-871f-7796e86772d2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:43.561290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2be4385e-49a4-431f-871f-7796e86772d2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:43.595267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2be4385e-49a4-431f-871f-7796e86772d2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:43.598590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2be4385e-49a4-431f-871f-7796e86772d2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:43.599637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2be4385e-49a4-431f-871f-7796e86772d2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:43.602769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2be4385e-49a4-431f-871f-7796e86772d2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:43.648477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:43.855050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-2be4385e-49a4-431f-871f-7796e86772d2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:43.896286 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2be4385e-49a4-431f-871f-7796e86772d2 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1929 microversion: 2.75 time: 0.354152 May 28 04:43:43.897249 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1331/2539] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:43 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1929 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:43.914921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-64072c56-4008-44be-9771-7ade32f74579 req-4ee7b51e-1925-4774-baf4-9fa880cc0c19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc34e958-c428-470e-8d16-e00f1c149a92", "name": "network-vif-plugged", "status": "completed", "tag": "83244984-3d75-4908-8213-6f9f60cb8dc6"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:43.929792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-64072c56-4008-44be-9771-7ade32f74579 req-4ee7b51e-1925-4774-baf4-9fa880cc0c19 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:43.932131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-64072c56-4008-44be-9771-7ade32f74579 req-4ee7b51e-1925-4774-baf4-9fa880cc0c19 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:43.958978 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-64072c56-4008-44be-9771-7ade32f74579 req-4ee7b51e-1925-4774-baf4-9fa880cc0c19 service nova] Creating event network-vif-plugged:83244984-3d75-4908-8213-6f9f60cb8dc6 for instance cc34e958-c428-470e-8d16-e00f1c149a92 on n-h1-843700-1 May 28 04:43:43.970062 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-64072c56-4008-44be-9771-7ade32f74579 req-4ee7b51e-1925-4774-baf4-9fa880cc0c19 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069624 May 28 04:43:43.986167 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1332/2540] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:43:44.002463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5a9f8771-a102-412f-830f-a95fb3ec205b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:44.005775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5a9f8771-a102-412f-830f-a95fb3ec205b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:44.032668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a9f8771-a102-412f-830f-a95fb3ec205b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:44.034539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a9f8771-a102-412f-830f-a95fb3ec205b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:44.036761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a9f8771-a102-412f-830f-a95fb3ec205b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:44.040191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a9f8771-a102-412f-830f-a95fb3ec205b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:44.306212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7c6a9a95-2804-4a65-b634-8eb8813baec9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:44.314971 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7c6a9a95-2804-4a65-b634-8eb8813baec9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1317 microversion: 2.1 time: 1.748856 May 28 04:43:44.323780 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1209/2541] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:42 2022] GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1317 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:44.333800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b26dfbc6-9fe4-47dc-a9de-074256aa48df req-e6134ba3-45ff-463c-887d-49b68930f4ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c3986b-245a-4454-95c7-63f826af6edc", "name": "network-vif-deleted", "tag": "a8517f33-040a-4dc7-a1bf-9a16a458e569"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:44.374630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b26dfbc6-9fe4-47dc-a9de-074256aa48df req-e6134ba3-45ff-463c-887d-49b68930f4ce service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:44.376205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b26dfbc6-9fe4-47dc-a9de-074256aa48df req-e6134ba3-45ff-463c-887d-49b68930f4ce service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:44.417500 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b26dfbc6-9fe4-47dc-a9de-074256aa48df req-e6134ba3-45ff-463c-887d-49b68930f4ce service nova] Creating event network-vif-deleted:a8517f33-040a-4dc7-a1bf-9a16a458e569 for instance 05c3986b-245a-4454-95c7-63f826af6edc on n-h1-843700-1 May 28 04:43:44.429614 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b26dfbc6-9fe4-47dc-a9de-074256aa48df req-e6134ba3-45ff-463c-887d-49b68930f4ce service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102889 May 28 04:43:44.434336 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1210/2542] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:43:44.443996 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-85883007-d711-4181-aa45-5a9fc7dadb5b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:44.449373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-85883007-d711-4181-aa45-5a9fc7dadb5b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:44.472245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85883007-d711-4181-aa45-5a9fc7dadb5b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:44.476799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85883007-d711-4181-aa45-5a9fc7dadb5b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:44.476799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85883007-d711-4181-aa45-5a9fc7dadb5b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:44.476799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85883007-d711-4181-aa45-5a9fc7dadb5b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:45.003612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-85883007-d711-4181-aa45-5a9fc7dadb5b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:45.017863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-85883007-d711-4181-aa45-5a9fc7dadb5b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:45.017863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-85883007-d711-4181-aa45-5a9fc7dadb5b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:45.025201 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-85883007-d711-4181-aa45-5a9fc7dadb5b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1265 microversion: 2.25 time: 0.589459 May 28 04:43:45.026963 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1211/2543] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:44 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1265 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:45.038847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-93dffc53-ff60-4502-a584-4936c4ac4566 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:45.041329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-93dffc53-ff60-4502-a584-4936c4ac4566 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:45.049999 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93dffc53-ff60-4502-a584-4936c4ac4566 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:45.050822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93dffc53-ff60-4502-a584-4936c4ac4566 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:45.052750 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93dffc53-ff60-4502-a584-4936c4ac4566 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:45.053637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93dffc53-ff60-4502-a584-4936c4ac4566 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:45.235079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-93dffc53-ff60-4502-a584-4936c4ac4566 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:45.247131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5a9f8771-a102-412f-830f-a95fb3ec205b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:45.247719 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-93dffc53-ff60-4502-a584-4936c4ac4566 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d" status: 200 len: 1281 microversion: 2.1 time: 0.211692 May 28 04:43:45.254363 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1212/2544] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:45 2022] GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d => generated 1281 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:45.259822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aff94b74-b8cb-4fa9-9346-b3c91714e2af tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:45.262044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-aff94b74-b8cb-4fa9-9346-b3c91714e2af tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:45.262199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5a9f8771-a102-412f-830f-a95fb3ec205b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:45.264821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5a9f8771-a102-412f-830f-a95fb3ec205b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:45.266123 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5a9f8771-a102-412f-830f-a95fb3ec205b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1797 microversion: 2.42 time: 1.278447 May 28 04:43:45.266714 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1333/2545] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:43 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1797 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:45.279446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aff94b74-b8cb-4fa9-9346-b3c91714e2af tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:45.279446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aff94b74-b8cb-4fa9-9346-b3c91714e2af tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:45.279446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aff94b74-b8cb-4fa9-9346-b3c91714e2af tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:45.279446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aff94b74-b8cb-4fa9-9346-b3c91714e2af tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:45.352044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d39bd681-73ea-4174-822e-ce4747a73d78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:45.352989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d39bd681-73ea-4174-822e-ce4747a73d78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:45.363693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d39bd681-73ea-4174-822e-ce4747a73d78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:45.365331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d39bd681-73ea-4174-822e-ce4747a73d78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:45.366184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d39bd681-73ea-4174-822e-ce4747a73d78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:45.366845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d39bd681-73ea-4174-822e-ce4747a73d78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:45.425335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-aff94b74-b8cb-4fa9-9346-b3c91714e2af tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:45.467111 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aff94b74-b8cb-4fa9-9346-b3c91714e2af tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1929 microversion: 2.75 time: 0.208843 May 28 04:43:45.467750 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1213/2546] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:45 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1929 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:45.662718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d39bd681-73ea-4174-822e-ce4747a73d78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:45.671348 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d39bd681-73ea-4174-822e-ce4747a73d78 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1317 microversion: 2.1 time: 0.323612 May 28 04:43:45.672126 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1334/2547] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:45 2022] GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:46.045889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5024422f-26d6-4d83-bde4-7d45d97791d8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:46.046939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5024422f-26d6-4d83-bde4-7d45d97791d8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:46.061189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5024422f-26d6-4d83-bde4-7d45d97791d8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:46.063701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5024422f-26d6-4d83-bde4-7d45d97791d8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:46.084787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5024422f-26d6-4d83-bde4-7d45d97791d8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:46.090736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5024422f-26d6-4d83-bde4-7d45d97791d8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:46.269449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4cf67d45-9e60-4a82-9879-5c072212a1c2 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:46.270690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4cf67d45-9e60-4a82-9879-5c072212a1c2 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:46.283064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4cf67d45-9e60-4a82-9879-5c072212a1c2 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:46.283528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4cf67d45-9e60-4a82-9879-5c072212a1c2 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:46.284399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4cf67d45-9e60-4a82-9879-5c072212a1c2 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:46.286224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4cf67d45-9e60-4a82-9879-5c072212a1c2 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:46.320989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5024422f-26d6-4d83-bde4-7d45d97791d8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:46.347228 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5024422f-26d6-4d83-bde4-7d45d97791d8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:46.352146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5024422f-26d6-4d83-bde4-7d45d97791d8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:46.360630 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5024422f-26d6-4d83-bde4-7d45d97791d8 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1265 microversion: 2.25 time: 0.317023 May 28 04:43:46.364245 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1214/2548] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:46 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1265 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:46.376427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c5656d24-dfd3-4bf8-b9a5-fce5ad9c203d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:46.380715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c5656d24-dfd3-4bf8-b9a5-fce5ad9c203d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:46.389874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5656d24-dfd3-4bf8-b9a5-fce5ad9c203d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:46.390731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5656d24-dfd3-4bf8-b9a5-fce5ad9c203d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:46.392368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5656d24-dfd3-4bf8-b9a5-fce5ad9c203d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:46.393966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5656d24-dfd3-4bf8-b9a5-fce5ad9c203d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:46.711761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c5656d24-dfd3-4bf8-b9a5-fce5ad9c203d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:46.729433 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4cf67d45-9e60-4a82-9879-5c072212a1c2 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:46.738291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c5656d24-dfd3-4bf8-b9a5-fce5ad9c203d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:46.738639 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4cf67d45-9e60-4a82-9879-5c072212a1c2 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d" status: 200 len: 1323 microversion: 2.1 time: 0.479524 May 28 04:43:46.744033 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1335/2549] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:46 2022] GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d => generated 1323 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:43:46.747824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c5656d24-dfd3-4bf8-b9a5-fce5ad9c203d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:46.752585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8b109c08-2b1f-4dc6-b0e5-8038f790a570 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:46.753438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8b109c08-2b1f-4dc6-b0e5-8038f790a570 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:46.755222 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c5656d24-dfd3-4bf8-b9a5-fce5ad9c203d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1797 microversion: 2.42 time: 0.386254 May 28 04:43:46.758034 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1215/2550] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:46 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1797 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:46.771896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6c8c920a-68fb-4311-b015-aa60cc2cf491 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:46.783444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b109c08-2b1f-4dc6-b0e5-8038f790a570 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:46.784014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b109c08-2b1f-4dc6-b0e5-8038f790a570 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:46.784451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6c8c920a-68fb-4311-b015-aa60cc2cf491 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:46.785348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b109c08-2b1f-4dc6-b0e5-8038f790a570 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:46.785793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b109c08-2b1f-4dc6-b0e5-8038f790a570 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:46.791493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c8c920a-68fb-4311-b015-aa60cc2cf491 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:46.797537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c8c920a-68fb-4311-b015-aa60cc2cf491 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:46.798766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c8c920a-68fb-4311-b015-aa60cc2cf491 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:46.799533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c8c920a-68fb-4311-b015-aa60cc2cf491 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:47.038494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-8b109c08-2b1f-4dc6-b0e5-8038f790a570 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:47.084329 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8b109c08-2b1f-4dc6-b0e5-8038f790a570 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1929 microversion: 2.75 time: 0.338500 May 28 04:43:47.088798 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1336/2551] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:46 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1929 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:47.380648 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eeae35db-32cd-4b6e-b5fb-1d2d64ae1250 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:47.382822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-eeae35db-32cd-4b6e-b5fb-1d2d64ae1250 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:47.383377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6c8c920a-68fb-4311-b015-aa60cc2cf491 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:47.398502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eeae35db-32cd-4b6e-b5fb-1d2d64ae1250 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:47.399400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eeae35db-32cd-4b6e-b5fb-1d2d64ae1250 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:47.400969 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6c8c920a-68fb-4311-b015-aa60cc2cf491 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1507 microversion: 2.1 time: 0.641314 May 28 04:43:47.401579 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1216/2552] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:46 2022] GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1507 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:47.402680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eeae35db-32cd-4b6e-b5fb-1d2d64ae1250 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:47.404461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eeae35db-32cd-4b6e-b5fb-1d2d64ae1250 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:47.422942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-95256d4a-1376-4159-bdd4-0d7966263163 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:47.422942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-95256d4a-1376-4159-bdd4-0d7966263163 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:47.435935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-95256d4a-1376-4159-bdd4-0d7966263163 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:47.436414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-95256d4a-1376-4159-bdd4-0d7966263163 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:47.439130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-95256d4a-1376-4159-bdd4-0d7966263163 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:47.441222 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-95256d4a-1376-4159-bdd4-0d7966263163 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:47.745929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-eeae35db-32cd-4b6e-b5fb-1d2d64ae1250 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:47.759313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-eeae35db-32cd-4b6e-b5fb-1d2d64ae1250 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:47.764061 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-eeae35db-32cd-4b6e-b5fb-1d2d64ae1250 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:47.771362 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-eeae35db-32cd-4b6e-b5fb-1d2d64ae1250 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1265 microversion: 2.25 time: 0.394865 May 28 04:43:47.772310 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1337/2553] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:47 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1265 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:43:47.777460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dab7c443-f651-4c51-911c-bd6376ffa077 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:47.783674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dab7c443-f651-4c51-911c-bd6376ffa077 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:47.796356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dab7c443-f651-4c51-911c-bd6376ffa077 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:47.797093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dab7c443-f651-4c51-911c-bd6376ffa077 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:47.801854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dab7c443-f651-4c51-911c-bd6376ffa077 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:47.802626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dab7c443-f651-4c51-911c-bd6376ffa077 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:48.082943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-95256d4a-1376-4159-bdd4-0d7966263163 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:48.095882 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-95256d4a-1376-4159-bdd4-0d7966263163 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1507 microversion: 2.1 time: 0.680616 May 28 04:43:48.096831 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1217/2554] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:47 2022] GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1507 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:48.119324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bdac4dab-8cef-4016-ab00-1673e3f4fc87 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:48.120702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bdac4dab-8cef-4016-ab00-1673e3f4fc87 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:48.132258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bdac4dab-8cef-4016-ab00-1673e3f4fc87 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:48.132770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bdac4dab-8cef-4016-ab00-1673e3f4fc87 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:48.136528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bdac4dab-8cef-4016-ab00-1673e3f4fc87 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:48.137979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bdac4dab-8cef-4016-ab00-1673e3f4fc87 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:48.596504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dab7c443-f651-4c51-911c-bd6376ffa077 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:48.615838 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dab7c443-f651-4c51-911c-bd6376ffa077 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d" status: 200 len: 1323 microversion: 2.1 time: 0.833379 May 28 04:43:48.634261 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1338/2555] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:47 2022] GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d => generated 1323 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:48.649109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f8b182e1-4440-4c54-a435-9d1ce7464f3a tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:48.654886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f8b182e1-4440-4c54-a435-9d1ce7464f3a tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:48.683020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8b182e1-4440-4c54-a435-9d1ce7464f3a tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:48.684797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8b182e1-4440-4c54-a435-9d1ce7464f3a tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:48.693190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8b182e1-4440-4c54-a435-9d1ce7464f3a tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:48.693190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8b182e1-4440-4c54-a435-9d1ce7464f3a tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:48.850191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-f8b182e1-4440-4c54-a435-9d1ce7464f3a tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:48.907312 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f8b182e1-4440-4c54-a435-9d1ce7464f3a tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1929 microversion: 2.75 time: 0.269015 May 28 04:43:48.918787 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1339/2556] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:48 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1929 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:48.923801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8682e31d-7936-4aa4-a3de-6c2869ec8465 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:48.925108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8682e31d-7936-4aa4-a3de-6c2869ec8465 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:48.937481 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8682e31d-7936-4aa4-a3de-6c2869ec8465 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:48.937944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8682e31d-7936-4aa4-a3de-6c2869ec8465 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:48.938732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8682e31d-7936-4aa4-a3de-6c2869ec8465 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:48.947355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8682e31d-7936-4aa4-a3de-6c2869ec8465 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:49.036526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bdac4dab-8cef-4016-ab00-1673e3f4fc87 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:49.048988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bdac4dab-8cef-4016-ab00-1673e3f4fc87 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:49.048988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bdac4dab-8cef-4016-ab00-1673e3f4fc87 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:49.049880 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bdac4dab-8cef-4016-ab00-1673e3f4fc87 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1843 microversion: 2.42 time: 0.951996 May 28 04:43:49.061477 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1218/2557] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:48 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1843 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:49.066658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-21569176-c430-4c81-8181-8b2965f20d51 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:49.067314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-21569176-c430-4c81-8181-8b2965f20d51 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:49.086589 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21569176-c430-4c81-8181-8b2965f20d51 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:49.088446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21569176-c430-4c81-8181-8b2965f20d51 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:49.091639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21569176-c430-4c81-8181-8b2965f20d51 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:49.092328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21569176-c430-4c81-8181-8b2965f20d51 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:49.164411 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8682e31d-7936-4aa4-a3de-6c2869ec8465 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "PUT /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1079 microversion: 2.1 time: 0.244385 May 28 04:43:49.165066 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1340/2558] 10.222.0.58 () {60 vars in 1255 bytes} [Sat May 28 04:43:48 2022] PUT /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1079 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:49.178670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-11909788-d9b1-4056-80cc-c377ba8487f2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:49.179601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-11909788-d9b1-4056-80cc-c377ba8487f2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:49.191129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11909788-d9b1-4056-80cc-c377ba8487f2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:49.191851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11909788-d9b1-4056-80cc-c377ba8487f2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:49.192824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11909788-d9b1-4056-80cc-c377ba8487f2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:49.195542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11909788-d9b1-4056-80cc-c377ba8487f2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:49.273713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-21569176-c430-4c81-8181-8b2965f20d51 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:49.282198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-21569176-c430-4c81-8181-8b2965f20d51 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:49.284005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-21569176-c430-4c81-8181-8b2965f20d51 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:49.286004 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-21569176-c430-4c81-8181-8b2965f20d51 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1265 microversion: 2.25 time: 0.222796 May 28 04:43:49.299657 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1219/2559] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:49 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:49.574597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-11909788-d9b1-4056-80cc-c377ba8487f2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:49.586010 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-11909788-d9b1-4056-80cc-c377ba8487f2 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1505 microversion: 2.1 time: 0.411168 May 28 04:43:49.586932 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1341/2560] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:49 2022] GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1505 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:43:49.603324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c3dfe732-c3dc-4be3-8b10-186855bb012b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:49.604062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c3dfe732-c3dc-4be3-8b10-186855bb012b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:49.615953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3dfe732-c3dc-4be3-8b10-186855bb012b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:49.616680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3dfe732-c3dc-4be3-8b10-186855bb012b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:49.620823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3dfe732-c3dc-4be3-8b10-186855bb012b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:49.621594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3dfe732-c3dc-4be3-8b10-186855bb012b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:49.628551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:49.647025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2072d2a7-a309-4a16-8290-d6d8949463f3 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:49.648425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2072d2a7-a309-4a16-8290-d6d8949463f3 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:49.661320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2072d2a7-a309-4a16-8290-d6d8949463f3 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:49.662875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2072d2a7-a309-4a16-8290-d6d8949463f3 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:49.664066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2072d2a7-a309-4a16-8290-d6d8949463f3 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:49.667791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2072d2a7-a309-4a16-8290-d6d8949463f3 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:49.711839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:49.770221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:50.406604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2072d2a7-a309-4a16-8290-d6d8949463f3 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:50.434155 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2072d2a7-a309-4a16-8290-d6d8949463f3 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d" status: 200 len: 1323 microversion: 2.1 time: 0.787358 May 28 04:43:50.435351 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1342/2561] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:49 2022] GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d => generated 1323 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:50.464307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-8097b51c-afe6-4413-b72b-3c59d52fb887 req-1053704d-34b0-41eb-b862-0a8c7135adb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73298cda-5cfb-45df-8914-2c76ac9cc70d", "tag": "03b825a9-d5e4-41b3-b80b-08b10632a298"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:50.475812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8097b51c-afe6-4413-b72b-3c59d52fb887 req-1053704d-34b0-41eb-b862-0a8c7135adb9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:50.476610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8097b51c-afe6-4413-b72b-3c59d52fb887 req-1053704d-34b0-41eb-b862-0a8c7135adb9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:50.489772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c3dfe732-c3dc-4be3-8b10-186855bb012b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:50.501843 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c3dfe732-c3dc-4be3-8b10-186855bb012b tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1505 microversion: 2.1 time: 0.901543 May 28 04:43:50.503711 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1220/2562] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:49 2022] GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1505 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:50.518709 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-8097b51c-afe6-4413-b72b-3c59d52fb887 req-1053704d-34b0-41eb-b862-0a8c7135adb9 service nova] Creating event network-changed:03b825a9-d5e4-41b3-b80b-08b10632a298 for instance 73298cda-5cfb-45df-8914-2c76ac9cc70d on n-h2-843700-1 May 28 04:43:50.527826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-50d8e692-cd23-42a8-8164-3a4a55f43931 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:50.528749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-50d8e692-cd23-42a8-8164-3a4a55f43931 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:50.543583 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-8097b51c-afe6-4413-b72b-3c59d52fb887 req-1053704d-34b0-41eb-b862-0a8c7135adb9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092915 May 28 04:43:50.547035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50d8e692-cd23-42a8-8164-3a4a55f43931 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:50.548005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50d8e692-cd23-42a8-8164-3a4a55f43931 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:50.548166 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1343/2563] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:43:50.549149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50d8e692-cd23-42a8-8164-3a4a55f43931 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:50.551145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50d8e692-cd23-42a8-8164-3a4a55f43931 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:50.559221 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-c8e21c7c-999c-4a3a-91fe-116d1beb3cab req-738b60d0-4979-431b-abca-d854657be01f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "tag": "5dc343f6-efc0-48aa-9ea2-32a0164b02a4"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:50.574869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c8e21c7c-999c-4a3a-91fe-116d1beb3cab req-738b60d0-4979-431b-abca-d854657be01f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:50.578951 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c8e21c7c-999c-4a3a-91fe-116d1beb3cab req-738b60d0-4979-431b-abca-d854657be01f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:50.600658 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-c8e21c7c-999c-4a3a-91fe-116d1beb3cab req-738b60d0-4979-431b-abca-d854657be01f service nova] Creating event network-changed:5dc343f6-efc0-48aa-9ea2-32a0164b02a4 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:43:50.624781 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-c8e21c7c-999c-4a3a-91fe-116d1beb3cab req-738b60d0-4979-431b-abca-d854657be01f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075322 May 28 04:43:50.625887 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1344/2564] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:43:50.636663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9fd39c82-2556-4122-be38-5d1a91770253 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:50.637871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9fd39c82-2556-4122-be38-5d1a91770253 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:50.650442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fd39c82-2556-4122-be38-5d1a91770253 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:50.653711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fd39c82-2556-4122-be38-5d1a91770253 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:50.654803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fd39c82-2556-4122-be38-5d1a91770253 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:50.658556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fd39c82-2556-4122-be38-5d1a91770253 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:50.771616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-50d8e692-cd23-42a8-8164-3a4a55f43931 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:50.810764 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-50d8e692-cd23-42a8-8164-3a4a55f43931 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1929 microversion: 2.75 time: 0.294147 May 28 04:43:50.811403 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1221/2565] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:50 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1929 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:50.828635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a1392790-7efe-4682-805c-71f62138d836 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:50.829252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a1392790-7efe-4682-805c-71f62138d836 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:50.848824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1392790-7efe-4682-805c-71f62138d836 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:50.849263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1392790-7efe-4682-805c-71f62138d836 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:50.850051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1392790-7efe-4682-805c-71f62138d836 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:50.850711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1392790-7efe-4682-805c-71f62138d836 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:51.273934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a1392790-7efe-4682-805c-71f62138d836 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:51.288942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a1392790-7efe-4682-805c-71f62138d836 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:51.301131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a1392790-7efe-4682-805c-71f62138d836 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:51.301131 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a1392790-7efe-4682-805c-71f62138d836 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1265 microversion: 2.25 time: 0.483890 May 28 04:43:51.302125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:51.302349 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1222/2566] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:50 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1265 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:51.311835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-68d62469-4429-451b-925f-f37545c35766 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:51.315987 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-68d62469-4429-451b-925f-f37545c35766 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:51.334647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68d62469-4429-451b-925f-f37545c35766 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:51.335429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68d62469-4429-451b-925f-f37545c35766 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:51.336411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68d62469-4429-451b-925f-f37545c35766 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:51.337022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68d62469-4429-451b-925f-f37545c35766 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:51.565425 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-68d62469-4429-451b-925f-f37545c35766 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "PUT /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1081 microversion: 2.1 time: 0.261778 May 28 04:43:51.574733 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1223/2567] 10.222.0.58 () {60 vars in 1255 bytes} [Sat May 28 04:43:51 2022] PUT /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1081 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:51.577373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0c64a250-2bdd-4a7e-a293-baad5599e1cb tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:51.578279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0c64a250-2bdd-4a7e-a293-baad5599e1cb tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:51.595915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c64a250-2bdd-4a7e-a293-baad5599e1cb tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:51.596439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c64a250-2bdd-4a7e-a293-baad5599e1cb tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:51.598573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c64a250-2bdd-4a7e-a293-baad5599e1cb tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:51.599049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c64a250-2bdd-4a7e-a293-baad5599e1cb tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:51.894820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9fd39c82-2556-4122-be38-5d1a91770253 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:51.923670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9fd39c82-2556-4122-be38-5d1a91770253 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:51.931492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9fd39c82-2556-4122-be38-5d1a91770253 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:51.938144 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9fd39c82-2556-4122-be38-5d1a91770253 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1843 microversion: 2.42 time: 1.310796 May 28 04:43:51.940783 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1345/2568] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:50 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1843 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:51.956218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5bb90af9-6990-4d42-a24d-a4b96e353ca8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:51.963127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5bb90af9-6990-4d42-a24d-a4b96e353ca8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:51.980659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5bb90af9-6990-4d42-a24d-a4b96e353ca8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:51.981862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5bb90af9-6990-4d42-a24d-a4b96e353ca8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:51.983027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5bb90af9-6990-4d42-a24d-a4b96e353ca8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:51.984185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5bb90af9-6990-4d42-a24d-a4b96e353ca8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:52.196270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0c64a250-2bdd-4a7e-a293-baad5599e1cb tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:52.207857 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0c64a250-2bdd-4a7e-a293-baad5599e1cb tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d" status: 200 len: 1323 microversion: 2.1 time: 0.640031 May 28 04:43:52.212282 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1224/2569] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:51 2022] GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d => generated 1323 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:52.223664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4e6b78ac-46ab-44a9-8989-dc0870177904 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:52.224292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4e6b78ac-46ab-44a9-8989-dc0870177904 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:52.231239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e6b78ac-46ab-44a9-8989-dc0870177904 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:52.232129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e6b78ac-46ab-44a9-8989-dc0870177904 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:52.232982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e6b78ac-46ab-44a9-8989-dc0870177904 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:52.233431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e6b78ac-46ab-44a9-8989-dc0870177904 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:52.438170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-4e6b78ac-46ab-44a9-8989-dc0870177904 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:52.495739 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4e6b78ac-46ab-44a9-8989-dc0870177904 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1929 microversion: 2.75 time: 0.279904 May 28 04:43:52.497620 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1225/2570] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:52 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1929 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:52.521817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-48b44880-48a8-494d-a7d3-525f102bb1b7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:52.524953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-48b44880-48a8-494d-a7d3-525f102bb1b7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:52.541772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48b44880-48a8-494d-a7d3-525f102bb1b7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:52.542323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48b44880-48a8-494d-a7d3-525f102bb1b7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:52.543594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48b44880-48a8-494d-a7d3-525f102bb1b7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:52.544052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48b44880-48a8-494d-a7d3-525f102bb1b7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:52.715677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-48b44880-48a8-494d-a7d3-525f102bb1b7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:52.727631 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-48b44880-48a8-494d-a7d3-525f102bb1b7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:52.729805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5bb90af9-6990-4d42-a24d-a4b96e353ca8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:52.737417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-48b44880-48a8-494d-a7d3-525f102bb1b7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:52.743968 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-48b44880-48a8-494d-a7d3-525f102bb1b7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1265 microversion: 2.25 time: 0.233805 May 28 04:43:52.744450 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5bb90af9-6990-4d42-a24d-a4b96e353ca8 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1507 microversion: 2.1 time: 0.796852 May 28 04:43:52.746094 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1346/2571] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:51 2022] GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1507 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:52.746803 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1226/2572] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:52 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:52.766506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4a04906e-0c59-4794-87d0-e5bbefc834f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:52.767672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4a04906e-0c59-4794-87d0-e5bbefc834f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:52.773140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-5d6fe6f4-347d-4f45-b7b5-12d81cb45b53 req-12e7c72d-014c-481e-b327-663e291372e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "tag": "44f2f247-628a-486f-b27f-36ae37e73975"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:52.780550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4a04906e-0c59-4794-87d0-e5bbefc834f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:52.783444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4a04906e-0c59-4794-87d0-e5bbefc834f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:52.784368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4a04906e-0c59-4794-87d0-e5bbefc834f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:52.785993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4a04906e-0c59-4794-87d0-e5bbefc834f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:52.789573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5d6fe6f4-347d-4f45-b7b5-12d81cb45b53 req-12e7c72d-014c-481e-b327-663e291372e9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:52.794022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5d6fe6f4-347d-4f45-b7b5-12d81cb45b53 req-12e7c72d-014c-481e-b327-663e291372e9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:52.836276 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-5d6fe6f4-347d-4f45-b7b5-12d81cb45b53 req-12e7c72d-014c-481e-b327-663e291372e9 service nova] Creating event network-changed:44f2f247-628a-486f-b27f-36ae37e73975 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:43:52.855428 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-5d6fe6f4-347d-4f45-b7b5-12d81cb45b53 req-12e7c72d-014c-481e-b327-663e291372e9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091433 May 28 04:43:52.861455 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1347/2573] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:43:52.960050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-96518150-81bc-41e9-95a7-5fb85889fbfd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:52.961505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-96518150-81bc-41e9-95a7-5fb85889fbfd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:52.977184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96518150-81bc-41e9-95a7-5fb85889fbfd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:52.977939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96518150-81bc-41e9-95a7-5fb85889fbfd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:52.979077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96518150-81bc-41e9-95a7-5fb85889fbfd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:52.981884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96518150-81bc-41e9-95a7-5fb85889fbfd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:53.749317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4a04906e-0c59-4794-87d0-e5bbefc834f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:53.759688 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4a04906e-0c59-4794-87d0-e5bbefc834f9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1507 microversion: 2.1 time: 1.002012 May 28 04:43:53.767962 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1227/2574] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:52 2022] GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1507 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:43:53.778130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8ad6d69c-7ca3-4d9a-879c-1e3bb5ce555f tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:53.779206 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8ad6d69c-7ca3-4d9a-879c-1e3bb5ce555f tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:53.797927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ad6d69c-7ca3-4d9a-879c-1e3bb5ce555f tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:53.798683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ad6d69c-7ca3-4d9a-879c-1e3bb5ce555f tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:53.799791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ad6d69c-7ca3-4d9a-879c-1e3bb5ce555f tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:53.807731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ad6d69c-7ca3-4d9a-879c-1e3bb5ce555f tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:54.026698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-96518150-81bc-41e9-95a7-5fb85889fbfd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:54.042536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-96518150-81bc-41e9-95a7-5fb85889fbfd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:54.044585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-96518150-81bc-41e9-95a7-5fb85889fbfd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:54.046156 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-96518150-81bc-41e9-95a7-5fb85889fbfd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1864 microversion: 2.42 time: 1.091984 May 28 04:43:54.059727 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1348/2575] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:52 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1864 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:43:54.071357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a4d11055-a385-41ad-a50e-80eb9d40a7b8 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:54.073109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a4d11055-a385-41ad-a50e-80eb9d40a7b8 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:54.084332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4d11055-a385-41ad-a50e-80eb9d40a7b8 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:54.085035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4d11055-a385-41ad-a50e-80eb9d40a7b8 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:54.086312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4d11055-a385-41ad-a50e-80eb9d40a7b8 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:54.087018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4d11055-a385-41ad-a50e-80eb9d40a7b8 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:54.144195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:54.300323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8ad6d69c-7ca3-4d9a-879c-1e3bb5ce555f tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:54.310036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-a4d11055-a385-41ad-a50e-80eb9d40a7b8 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:54.313939 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8ad6d69c-7ca3-4d9a-879c-1e3bb5ce555f tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d" status: 200 len: 1323 microversion: 2.1 time: 0.544082 May 28 04:43:54.326350 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1228/2576] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:53 2022] GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d => generated 1323 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:54.332591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6a4e5387-eb0c-4fe0-af4b-de563e692ebb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:54.334108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6a4e5387-eb0c-4fe0-af4b-de563e692ebb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:54.344344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a4e5387-eb0c-4fe0-af4b-de563e692ebb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:54.356391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a4e5387-eb0c-4fe0-af4b-de563e692ebb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:54.356391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a4e5387-eb0c-4fe0-af4b-de563e692ebb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:54.356391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a4e5387-eb0c-4fe0-af4b-de563e692ebb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:54.356782 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a4d11055-a385-41ad-a50e-80eb9d40a7b8 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1947 microversion: 2.75 time: 0.289474 May 28 04:43:54.356782 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1349/2577] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:54 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1947 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:54.364857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-40b1c585-b22a-4ab7-b387-6aa3ad6a65a9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:54.365371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-40b1c585-b22a-4ab7-b387-6aa3ad6a65a9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:54.383803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40b1c585-b22a-4ab7-b387-6aa3ad6a65a9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:54.386429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40b1c585-b22a-4ab7-b387-6aa3ad6a65a9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:54.386429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40b1c585-b22a-4ab7-b387-6aa3ad6a65a9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:54.388614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40b1c585-b22a-4ab7-b387-6aa3ad6a65a9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:54.421354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-40b1c585-b22a-4ab7-b387-6aa3ad6a65a9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:43:54.599478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6a4e5387-eb0c-4fe0-af4b-de563e692ebb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:54.612633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6a4e5387-eb0c-4fe0-af4b-de563e692ebb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:54.615182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6a4e5387-eb0c-4fe0-af4b-de563e692ebb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:54.616471 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6a4e5387-eb0c-4fe0-af4b-de563e692ebb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1265 microversion: 2.25 time: 0.288601 May 28 04:43:54.617624 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1229/2578] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:54 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1265 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:54.938406 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-40b1c585-b22a-4ab7-b387-6aa3ad6a65a9 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 204 len: 0 microversion: 2.1 time: 0.583754 May 28 04:43:54.939470 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1350/2579] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:43:54 2022] DELETE /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:43:54.952121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1c38467b-d680-4f9f-a9ba-6d674f4cda9f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:54.953487 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1c38467b-d680-4f9f-a9ba-6d674f4cda9f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:54.961281 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1c38467b-d680-4f9f-a9ba-6d674f4cda9f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:54.962206 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1c38467b-d680-4f9f-a9ba-6d674f4cda9f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:54.964706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1c38467b-d680-4f9f-a9ba-6d674f4cda9f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:54.965372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1c38467b-d680-4f9f-a9ba-6d674f4cda9f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:55.031978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1c38467b-d680-4f9f-a9ba-6d674f4cda9f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:43:55.067256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6401a88a-c36b-4fa9-a828-72c8c4c7d744 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:55.068511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6401a88a-c36b-4fa9-a828-72c8c4c7d744 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:55.084714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6401a88a-c36b-4fa9-a828-72c8c4c7d744 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:55.084943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6401a88a-c36b-4fa9-a828-72c8c4c7d744 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:55.089097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6401a88a-c36b-4fa9-a828-72c8c4c7d744 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:55.089658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6401a88a-c36b-4fa9-a828-72c8c4c7d744 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:55.112637 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.compute.api [None req-1c38467b-d680-4f9f-a9ba-6d674f4cda9f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Instance is already in deleting state, ignoring this request May 28 04:43:55.113707 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1c38467b-d680-4f9f-a9ba-6d674f4cda9f tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 204 len: 0 microversion: 2.1 time: 0.166414 May 28 04:43:55.117251 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1230/2580] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:43:54 2022] DELETE /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:43:55.124379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-05971a9f-d99e-4956-8dad-55bbead2c0e6 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:55.134647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-05971a9f-d99e-4956-8dad-55bbead2c0e6 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:55.144861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-05971a9f-d99e-4956-8dad-55bbead2c0e6 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:55.145323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-05971a9f-d99e-4956-8dad-55bbead2c0e6 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:55.146128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-05971a9f-d99e-4956-8dad-55bbead2c0e6 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:55.148125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-05971a9f-d99e-4956-8dad-55bbead2c0e6 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:55.706315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-05971a9f-d99e-4956-8dad-55bbead2c0e6 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:55.718567 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-05971a9f-d99e-4956-8dad-55bbead2c0e6 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1513 microversion: 2.1 time: 0.598242 May 28 04:43:55.719396 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1231/2581] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:55 2022] GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1513 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:55.734703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dc091f52-f92f-4ad8-885e-121024268982 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:55.735367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dc091f52-f92f-4ad8-885e-121024268982 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:55.744733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc091f52-f92f-4ad8-885e-121024268982 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:55.749985 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6401a88a-c36b-4fa9-a828-72c8c4c7d744 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:55.756680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc091f52-f92f-4ad8-885e-121024268982 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:55.761113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc091f52-f92f-4ad8-885e-121024268982 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:55.761113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc091f52-f92f-4ad8-885e-121024268982 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:55.765976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6401a88a-c36b-4fa9-a828-72c8c4c7d744 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:55.771601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6401a88a-c36b-4fa9-a828-72c8c4c7d744 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:55.775888 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6401a88a-c36b-4fa9-a828-72c8c4c7d744 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1885 microversion: 2.42 time: 0.713776 May 28 04:43:55.776807 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1351/2582] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:55 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1885 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:55.784150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dfef7ac2-b49f-4fd2-84a6-2ffb690ebb97 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:55.796324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dfef7ac2-b49f-4fd2-84a6-2ffb690ebb97 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:55.803681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dfef7ac2-b49f-4fd2-84a6-2ffb690ebb97 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:55.807683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dfef7ac2-b49f-4fd2-84a6-2ffb690ebb97 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:55.808567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dfef7ac2-b49f-4fd2-84a6-2ffb690ebb97 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:55.809206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dfef7ac2-b49f-4fd2-84a6-2ffb690ebb97 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:55.972101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-dfef7ac2-b49f-4fd2-84a6-2ffb690ebb97 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:56.005773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dc091f52-f92f-4ad8-885e-121024268982 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:56.010874 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dfef7ac2-b49f-4fd2-84a6-2ffb690ebb97 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1935 microversion: 2.75 time: 0.232046 May 28 04:43:56.017114 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1352/2583] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:55 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1935 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:56.026340 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dc091f52-f92f-4ad8-885e-121024268982 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d" status: 200 len: 1323 microversion: 2.1 time: 0.305562 May 28 04:43:56.027513 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1232/2584] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:55 2022] GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d => generated 1323 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:56.030296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-f26f0479-2220-45a5-a86a-73b534740bbc req-7e7fdf91-88e9-461a-a5d7-c54713e58294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "tag": "7fd4ecfb-9cd8-421b-9764-156bfec85136"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:56.032772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cc3dd9e2-6e1c-43bb-8715-776bd9b0f798 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:56.033583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cc3dd9e2-6e1c-43bb-8715-776bd9b0f798 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:56.039192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:56.046835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f26f0479-2220-45a5-a86a-73b534740bbc req-7e7fdf91-88e9-461a-a5d7-c54713e58294 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:56.047332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f26f0479-2220-45a5-a86a-73b534740bbc req-7e7fdf91-88e9-461a-a5d7-c54713e58294 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:56.049112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc3dd9e2-6e1c-43bb-8715-776bd9b0f798 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:56.051580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc3dd9e2-6e1c-43bb-8715-776bd9b0f798 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:56.052662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc3dd9e2-6e1c-43bb-8715-776bd9b0f798 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:56.058704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc3dd9e2-6e1c-43bb-8715-776bd9b0f798 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:56.067761 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-f26f0479-2220-45a5-a86a-73b534740bbc req-7e7fdf91-88e9-461a-a5d7-c54713e58294 service nova] Creating event network-changed:7fd4ecfb-9cd8-421b-9764-156bfec85136 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:43:56.078113 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-f26f0479-2220-45a5-a86a-73b534740bbc req-7e7fdf91-88e9-461a-a5d7-c54713e58294 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064421 May 28 04:43:56.080750 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1353/2585] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:43:56.165215 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cc3dd9e2-6e1c-43bb-8715-776bd9b0f798 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:56.185644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cc3dd9e2-6e1c-43bb-8715-776bd9b0f798 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:56.187865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cc3dd9e2-6e1c-43bb-8715-776bd9b0f798 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:56.189276 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cc3dd9e2-6e1c-43bb-8715-776bd9b0f798 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1265 microversion: 2.25 time: 0.160535 May 28 04:43:56.190203 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1233/2586] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:56 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:56.739351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-47fab06c-8fe1-400b-a5e6-f3ec6bfbcefe tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:56.740254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-47fab06c-8fe1-400b-a5e6-f3ec6bfbcefe tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:56.757871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47fab06c-8fe1-400b-a5e6-f3ec6bfbcefe tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:56.758343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47fab06c-8fe1-400b-a5e6-f3ec6bfbcefe tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:56.759935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47fab06c-8fe1-400b-a5e6-f3ec6bfbcefe tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:56.760324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47fab06c-8fe1-400b-a5e6-f3ec6bfbcefe tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:56.797137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-266691b7-355e-44ad-bea7-5eb1fe0afd18 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:56.797516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-266691b7-355e-44ad-bea7-5eb1fe0afd18 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:56.810034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-266691b7-355e-44ad-bea7-5eb1fe0afd18 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:56.810696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-266691b7-355e-44ad-bea7-5eb1fe0afd18 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:56.811667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-266691b7-355e-44ad-bea7-5eb1fe0afd18 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:56.812268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-266691b7-355e-44ad-bea7-5eb1fe0afd18 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:56.818437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:57.268493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-47fab06c-8fe1-400b-a5e6-f3ec6bfbcefe tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:57.283573 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-47fab06c-8fe1-400b-a5e6-f3ec6bfbcefe tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1513 microversion: 2.1 time: 0.550187 May 28 04:43:57.284781 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1354/2587] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:56 2022] GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1513 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:57.294363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-635e2412-20b3-466e-966f-6b2677b8b3d9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:57.296147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-635e2412-20b3-466e-966f-6b2677b8b3d9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:57.310660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-635e2412-20b3-466e-966f-6b2677b8b3d9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:57.311150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-635e2412-20b3-466e-966f-6b2677b8b3d9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:57.311940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-635e2412-20b3-466e-966f-6b2677b8b3d9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:57.315522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-635e2412-20b3-466e-966f-6b2677b8b3d9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:57.602060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-266691b7-355e-44ad-bea7-5eb1fe0afd18 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:57.616745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-266691b7-355e-44ad-bea7-5eb1fe0afd18 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:57.620831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-266691b7-355e-44ad-bea7-5eb1fe0afd18 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:57.631266 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-266691b7-355e-44ad-bea7-5eb1fe0afd18 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1885 microversion: 2.42 time: 0.838163 May 28 04:43:57.632615 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1234/2588] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:56 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1885 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:43:57.662729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e29b0968-f4f4-4b3f-9ef8-76b9e1ea5520 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:57.666412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e29b0968-f4f4-4b3f-9ef8-76b9e1ea5520 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:57.712018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e29b0968-f4f4-4b3f-9ef8-76b9e1ea5520 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:57.716312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e29b0968-f4f4-4b3f-9ef8-76b9e1ea5520 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:57.717547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e29b0968-f4f4-4b3f-9ef8-76b9e1ea5520 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:57.723300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e29b0968-f4f4-4b3f-9ef8-76b9e1ea5520 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:57.828280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-635e2412-20b3-466e-966f-6b2677b8b3d9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:57.851073 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-635e2412-20b3-466e-966f-6b2677b8b3d9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d" status: 200 len: 1323 microversion: 2.1 time: 0.564964 May 28 04:43:57.852200 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1355/2589] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:57 2022] GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d => generated 1323 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:43:57.868147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-93a0c7a3-57c5-49b7-a1fd-3d5b55887be9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:57.868779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-93a0c7a3-57c5-49b7-a1fd-3d5b55887be9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:57.888783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93a0c7a3-57c5-49b7-a1fd-3d5b55887be9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:57.889571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93a0c7a3-57c5-49b7-a1fd-3d5b55887be9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:57.891260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93a0c7a3-57c5-49b7-a1fd-3d5b55887be9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:57.892925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93a0c7a3-57c5-49b7-a1fd-3d5b55887be9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:57.938850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-e29b0968-f4f4-4b3f-9ef8-76b9e1ea5520 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] Lazy-loading 'services' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:57.985727 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e29b0968-f4f4-4b3f-9ef8-76b9e1ea5520 tempest-ServersAdmin275Test-283270756 tempest-ServersAdmin275Test-283270756-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1920 microversion: 2.75 time: 0.351757 May 28 04:43:58.000953 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1235/2590] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:57 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1920 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:58.007884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-52e0f42a-61ce-4a8f-b4ff-780f4de546c2 req-cc63b207-bee4-49b1-aa8b-6eefdcfea4df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc34e958-c428-470e-8d16-e00f1c149a92", "name": "network-vif-deleted", "tag": "83244984-3d75-4908-8213-6f9f60cb8dc6"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:58.020107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-52e0f42a-61ce-4a8f-b4ff-780f4de546c2 req-cc63b207-bee4-49b1-aa8b-6eefdcfea4df service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:58.020965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-52e0f42a-61ce-4a8f-b4ff-780f4de546c2 req-cc63b207-bee4-49b1-aa8b-6eefdcfea4df service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:58.047732 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-52e0f42a-61ce-4a8f-b4ff-780f4de546c2 req-cc63b207-bee4-49b1-aa8b-6eefdcfea4df service nova] Creating event network-vif-deleted:83244984-3d75-4908-8213-6f9f60cb8dc6 for instance cc34e958-c428-470e-8d16-e00f1c149a92 on n-h1-843700-1 May 28 04:43:58.057803 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-52e0f42a-61ce-4a8f-b4ff-780f4de546c2 req-cc63b207-bee4-49b1-aa8b-6eefdcfea4df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055091 May 28 04:43:58.061287 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1236/2591] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:43:58.071218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-f7590df7-319c-47be-a4d2-540812236fd1 req-88c280da-3343-448d-962f-d117cf92ea9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73298cda-5cfb-45df-8914-2c76ac9cc70d", "name": "network-vif-plugged", "status": "completed", "tag": "03b825a9-d5e4-41b3-b80b-08b10632a298"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:58.090267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f7590df7-319c-47be-a4d2-540812236fd1 req-88c280da-3343-448d-962f-d117cf92ea9f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:58.093935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f7590df7-319c-47be-a4d2-540812236fd1 req-88c280da-3343-448d-962f-d117cf92ea9f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:58.135305 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-f7590df7-319c-47be-a4d2-540812236fd1 req-88c280da-3343-448d-962f-d117cf92ea9f service nova] Creating event network-vif-plugged:03b825a9-d5e4-41b3-b80b-08b10632a298 for instance 73298cda-5cfb-45df-8914-2c76ac9cc70d on n-h2-843700-1 May 28 04:43:58.137897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-93a0c7a3-57c5-49b7-a1fd-3d5b55887be9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:58.145356 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-f7590df7-319c-47be-a4d2-540812236fd1 req-88c280da-3343-448d-962f-d117cf92ea9f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082249 May 28 04:43:58.146648 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1237/2592] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:43:58.152472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-93a0c7a3-57c5-49b7-a1fd-3d5b55887be9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:58.153400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-745c635c-5add-454d-a3f3-d27139940129 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:58.153991 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-93a0c7a3-57c5-49b7-a1fd-3d5b55887be9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:58.165692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-745c635c-5add-454d-a3f3-d27139940129 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:58.166003 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-93a0c7a3-57c5-49b7-a1fd-3d5b55887be9 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1265 microversion: 2.25 time: 0.294812 May 28 04:43:58.166003 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1356/2593] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:57 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1265 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:58.173272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-745c635c-5add-454d-a3f3-d27139940129 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:58.174270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-745c635c-5add-454d-a3f3-d27139940129 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:58.175810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-745c635c-5add-454d-a3f3-d27139940129 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:58.176601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-745c635c-5add-454d-a3f3-d27139940129 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:58.215201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-745c635c-5add-454d-a3f3-d27139940129 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:43:58.307095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9b4cdfac-e5a8-48ff-ac24-19c5dfbc7695 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:58.309486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9b4cdfac-e5a8-48ff-ac24-19c5dfbc7695 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:58.336780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b4cdfac-e5a8-48ff-ac24-19c5dfbc7695 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:58.337332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b4cdfac-e5a8-48ff-ac24-19c5dfbc7695 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:58.338185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b4cdfac-e5a8-48ff-ac24-19c5dfbc7695 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:58.338625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b4cdfac-e5a8-48ff-ac24-19c5dfbc7695 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:58.436244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b4cdfac-e5a8-48ff-ac24-19c5dfbc7695 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:58.436701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b4cdfac-e5a8-48ff-ac24-19c5dfbc7695 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:58.439508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-9b4cdfac-e5a8-48ff-ac24-19c5dfbc7695 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lazy-loading 'fault' on Instance uuid cc34e958-c428-470e-8d16-e00f1c149a92 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:43:58.655585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9b4cdfac-e5a8-48ff-ac24-19c5dfbc7695 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4fff87c06440478b3a4536a289aa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93892cb2a75466a82fcb79f40b306ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:58.664482 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9b4cdfac-e5a8-48ff-ac24-19c5dfbc7695 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 200 len: 1307 microversion: 2.1 time: 0.366427 May 28 04:43:58.667450 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1357/2594] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:58 2022] GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 1307 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:43:58.674397 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-745c635c-5add-454d-a3f3-d27139940129 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 204 len: 0 microversion: 2.75 time: 0.525604 May 28 04:43:58.675937 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1238/2595] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:43:58 2022] DELETE /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:43:58.687846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e085429c-bcd8-4a30-86a9-4b55a2d69a10 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:58.688848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e085429c-bcd8-4a30-86a9-4b55a2d69a10 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:58.696083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:43:58.698711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1dcb3963-b97f-4d40-96ef-3aeae059d892 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:58.704561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1dcb3963-b97f-4d40-96ef-3aeae059d892 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:58.707579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e085429c-bcd8-4a30-86a9-4b55a2d69a10 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:58.708674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e085429c-bcd8-4a30-86a9-4b55a2d69a10 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:58.710655 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e085429c-bcd8-4a30-86a9-4b55a2d69a10 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:58.711429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e085429c-bcd8-4a30-86a9-4b55a2d69a10 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:58.728419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1dcb3963-b97f-4d40-96ef-3aeae059d892 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:58.728883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1dcb3963-b97f-4d40-96ef-3aeae059d892 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:58.729672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1dcb3963-b97f-4d40-96ef-3aeae059d892 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:58.736357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1dcb3963-b97f-4d40-96ef-3aeae059d892 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:59.311196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e085429c-bcd8-4a30-86a9-4b55a2d69a10 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:59.336253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e085429c-bcd8-4a30-86a9-4b55a2d69a10 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:59.338146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e085429c-bcd8-4a30-86a9-4b55a2d69a10 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:59.346208 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e085429c-bcd8-4a30-86a9-4b55a2d69a10 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1444 microversion: 2.75 time: 0.666058 May 28 04:43:59.347951 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1239/2596] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:58 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1444 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:59.362626 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-69a98f3e-7fbf-4ab6-93df-d3d302ebaa07 req-72cb4ab3-7bea-4e97-aa9a-acc1b1f6f641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "tag": "50e6b87b-0119-4477-a5c5-db24e4c2100a"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:59.378021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-69a98f3e-7fbf-4ab6-93df-d3d302ebaa07 req-72cb4ab3-7bea-4e97-aa9a-acc1b1f6f641 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:59.378609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-69a98f3e-7fbf-4ab6-93df-d3d302ebaa07 req-72cb4ab3-7bea-4e97-aa9a-acc1b1f6f641 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:59.404416 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-69a98f3e-7fbf-4ab6-93df-d3d302ebaa07 req-72cb4ab3-7bea-4e97-aa9a-acc1b1f6f641 service nova] Creating event network-changed:50e6b87b-0119-4477-a5c5-db24e4c2100a for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:43:59.410509 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-69a98f3e-7fbf-4ab6-93df-d3d302ebaa07 req-72cb4ab3-7bea-4e97-aa9a-acc1b1f6f641 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060638 May 28 04:43:59.411808 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1240/2597] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:43:59.419650 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5db87ed3-c0d8-4c2a-818b-1ce2ac842c55 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:43:59.421878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5db87ed3-c0d8-4c2a-818b-1ce2ac842c55 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:43:59.431491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5db87ed3-c0d8-4c2a-818b-1ce2ac842c55 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:59.432290 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5db87ed3-c0d8-4c2a-818b-1ce2ac842c55 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:59.433389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5db87ed3-c0d8-4c2a-818b-1ce2ac842c55 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:43:59.434065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5db87ed3-c0d8-4c2a-818b-1ce2ac842c55 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:43:59.473346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1dcb3963-b97f-4d40-96ef-3aeae059d892 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:59.485899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1dcb3963-b97f-4d40-96ef-3aeae059d892 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:59.488466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1dcb3963-b97f-4d40-96ef-3aeae059d892 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:43:59.490071 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1dcb3963-b97f-4d40-96ef-3aeae059d892 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1885 microversion: 2.42 time: 0.821430 May 28 04:43:59.502344 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1358/2598] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:58 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1885 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:43:59.745637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6f024086-66d8-496a-8bf4-c4d1d32bd9e9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'create', calling method: .version_select at 0x7f77073ae3a0>, body: {"keypair": {"name": "tempest-keypair-185302012", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG5qrTn7fSb3FXD2PxfQaK+Dg27mHWSLY8BgtT1GkmjtfhutuqJicKV9x9jo3MboGEzD0T3BUMelMLAUzIygKwOfyupwaCV7AA/tmGYX1AjHZswYOJyI58AsSPsFMmuSQ=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:43:59.766348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-6f024086-66d8-496a-8bf4-c4d1d32bd9e9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Getting quotas for project b0c48bf20efd4291b37e616c658f96ff. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:43:59.773340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-6f024086-66d8-496a-8bf4-c4d1d32bd9e9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Getting quotas for user 6272045226334bcf8b49a0aa41a07b95 and project b0c48bf20efd4291b37e616c658f96ff. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:44:00.031372 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6f024086-66d8-496a-8bf4-c4d1d32bd9e9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.395112 May 28 04:44:00.031372 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1359/2599] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:43:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:00.031372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bdd5b34d-c708-4220-ae01-5b8cfe23b16e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:00.031372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bdd5b34d-c708-4220-ae01-5b8cfe23b16e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:00.031372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdd5b34d-c708-4220-ae01-5b8cfe23b16e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:00.031372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdd5b34d-c708-4220-ae01-5b8cfe23b16e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:00.031372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdd5b34d-c708-4220-ae01-5b8cfe23b16e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:00.031372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdd5b34d-c708-4220-ae01-5b8cfe23b16e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:00.167516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bdd5b34d-c708-4220-ae01-5b8cfe23b16e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:00.180357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bdd5b34d-c708-4220-ae01-5b8cfe23b16e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:00.182287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bdd5b34d-c708-4220-ae01-5b8cfe23b16e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:00.183976 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bdd5b34d-c708-4220-ae01-5b8cfe23b16e tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1265 microversion: 2.25 time: 0.282675 May 28 04:44:00.202076 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1360/2600] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:43:59 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1265 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:00.212870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8d3ee3c4-6bd6-4f87-aa74-b5c0a9769388 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:00.214170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8d3ee3c4-6bd6-4f87-aa74-b5c0a9769388 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: cc34e958-c428-470e-8d16-e00f1c149a92] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:00.241430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d3ee3c4-6bd6-4f87-aa74-b5c0a9769388 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:00.243212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d3ee3c4-6bd6-4f87-aa74-b5c0a9769388 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:00.245220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d3ee3c4-6bd6-4f87-aa74-b5c0a9769388 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:00.246886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d3ee3c4-6bd6-4f87-aa74-b5c0a9769388 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:00.271955 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-8d3ee3c4-6bd6-4f87-aa74-b5c0a9769388 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] HTTP exception thrown: Instance cc34e958-c428-470e-8d16-e00f1c149a92 could not be found. May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8d3ee3c4-6bd6-4f87-aa74-b5c0a9769388 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Request method failure captured: May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 HTTP/1.1 May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikafxFfDK_JaZXUKn-JeW3IbJHz_iJlYZUlcGq4am0JlqfPZ6SSb1OGTYa-aPodgtXYYHkuJKv-4EiNaR1fYDe2NY9U2-dsIvqLirDGA3H-4f_VHStrmnpoO6EBNKn5v5uLCIGgm2LFPR7sZM2s3VYuy1JAxbSoQzzGh896I1rCb8xJ8 May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: a93892cb2a75466a82fcb79f40b306ca May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1554865769 May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a93892cb2a75466a82fcb79f40b306ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a93892cb2a75466a82fcb79f40b306ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a93892cb2a75466a82fcb79f40b306ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a93892cb2a75466a82fcb79f40b306ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerDiskConfigTestJSON-1554865769 May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: a93892cb2a75466a82fcb79f40b306ca May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1554865769 May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerDiskConfigTestJSON-1554865769-project May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 0d4fff87c06440478b3a4536a289aa99 May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerDiskConfigTestJSON-1554865769-project May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance cc34e958-c428-470e-8d16-e00f1c149a92 could not be found. May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'cc34e958-c428-470e-8d16-e00f1c149a92'} May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc34e958-c428-470e-8d16-e00f1c149a92 could not be found. May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc34e958-c428-470e-8d16-e00f1c149a92 could not be found. May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:00.276117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:00.278902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:00.278902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:00.278902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:00.278902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:44:00.278902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:44:00.278902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc34e958-c428-470e-8d16-e00f1c149a92 could not be found. May 28 04:44:00.278902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:00.280783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8d3ee3c4-6bd6-4f87-aa74-b5c0a9769388 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Returning 404 to user: Instance cc34e958-c428-470e-8d16-e00f1c149a92 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:00.280783 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8d3ee3c4-6bd6-4f87-aa74-b5c0a9769388 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92" status: 404 len: 111 microversion: 2.1 time: 0.076947 May 28 04:44:00.286897 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1361/2601] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:00 2022] GET /compute/v2.1/servers/cc34e958-c428-470e-8d16-e00f1c149a92 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:44:00.294924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-55c9c536-e173-4230-b72f-3f3c0c650afd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:00.295532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-55c9c536-e173-4230-b72f-3f3c0c650afd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:00.302583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55c9c536-e173-4230-b72f-3f3c0c650afd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:00.303288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55c9c536-e173-4230-b72f-3f3c0c650afd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:00.304295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55c9c536-e173-4230-b72f-3f3c0c650afd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:00.305049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55c9c536-e173-4230-b72f-3f3c0c650afd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:00.321764 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-55c9c536-e173-4230-b72f-3f3c0c650afd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] HTTP exception thrown: Instance 3c8654f0-6755-46c3-8801-c2d3b4d37b48 could not be found. May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-55c9c536-e173-4230-b72f-3f3c0c650afd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Request method failure captured: May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 HTTP/1.1 May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikafxFfDK_JaZXUKn-JeW3IbJHz_iJlYZUlcGq4am0JlqfPZ6SSb1OGTYa-aPodgtXYYHkuJKv-4EiNaR1fYDe2NY9U2-dsIvqLirDGA3H-4f_VHStrmnpoO6EBNKn5v5uLCIGgm2LFPR7sZM2s3VYuy1JAxbSoQzzGh896I1rCb8xJ8 May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: a93892cb2a75466a82fcb79f40b306ca May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1554865769 May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a93892cb2a75466a82fcb79f40b306ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a93892cb2a75466a82fcb79f40b306ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a93892cb2a75466a82fcb79f40b306ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a93892cb2a75466a82fcb79f40b306ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerDiskConfigTestJSON-1554865769 May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: a93892cb2a75466a82fcb79f40b306ca May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1554865769 May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerDiskConfigTestJSON-1554865769-project May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 0d4fff87c06440478b3a4536a289aa99 May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerDiskConfigTestJSON-1554865769-project May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 3c8654f0-6755-46c3-8801-c2d3b4d37b48 could not be found. May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '3c8654f0-6755-46c3-8801-c2d3b4d37b48'} May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c8654f0-6755-46c3-8801-c2d3b4d37b48 could not be found. May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:44:00.323592 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:44:00.327082 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c8654f0-6755-46c3-8801-c2d3b4d37b48 could not be found. May 28 04:44:00.327082 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:00.327082 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:00.327082 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:00.327082 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:00.327082 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:00.327082 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:00.327082 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:44:00.327082 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:44:00.327082 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c8654f0-6755-46c3-8801-c2d3b4d37b48 could not be found. May 28 04:44:00.327082 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:00.328798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-55c9c536-e173-4230-b72f-3f3c0c650afd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Returning 404 to user: Instance 3c8654f0-6755-46c3-8801-c2d3b4d37b48 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:00.330110 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-55c9c536-e173-4230-b72f-3f3c0c650afd tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 404 len: 111 microversion: 2.1 time: 0.039138 May 28 04:44:00.332481 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1362/2602] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:44:00 2022] DELETE /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:44:00.339876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a4ff539e-a79f-4934-8d90-5f341efa260a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:00.340720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a4ff539e-a79f-4934-8d90-5f341efa260a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 3c8654f0-6755-46c3-8801-c2d3b4d37b48] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:00.347999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4ff539e-a79f-4934-8d90-5f341efa260a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:00.348861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4ff539e-a79f-4934-8d90-5f341efa260a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:00.349796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4ff539e-a79f-4934-8d90-5f341efa260a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:00.350475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4ff539e-a79f-4934-8d90-5f341efa260a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:00.377217 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-a4ff539e-a79f-4934-8d90-5f341efa260a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] HTTP exception thrown: Instance 3c8654f0-6755-46c3-8801-c2d3b4d37b48 could not be found. May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a4ff539e-a79f-4934-8d90-5f341efa260a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Request method failure captured: May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 HTTP/1.1 May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikafxFfDK_JaZXUKn-JeW3IbJHz_iJlYZUlcGq4am0JlqfPZ6SSb1OGTYa-aPodgtXYYHkuJKv-4EiNaR1fYDe2NY9U2-dsIvqLirDGA3H-4f_VHStrmnpoO6EBNKn5v5uLCIGgm2LFPR7sZM2s3VYuy1JAxbSoQzzGh896I1rCb8xJ8 May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: a93892cb2a75466a82fcb79f40b306ca May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1554865769 May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a93892cb2a75466a82fcb79f40b306ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a93892cb2a75466a82fcb79f40b306ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a93892cb2a75466a82fcb79f40b306ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a93892cb2a75466a82fcb79f40b306ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerDiskConfigTestJSON-1554865769 May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: a93892cb2a75466a82fcb79f40b306ca May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1554865769 May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerDiskConfigTestJSON-1554865769-project May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 0d4fff87c06440478b3a4536a289aa99 May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerDiskConfigTestJSON-1554865769-project May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 3c8654f0-6755-46c3-8801-c2d3b4d37b48 could not be found. May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '3c8654f0-6755-46c3-8801-c2d3b4d37b48'} May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c8654f0-6755-46c3-8801-c2d3b4d37b48 could not be found. May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c8654f0-6755-46c3-8801-c2d3b4d37b48 could not be found. May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:00.379902 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:00.383241 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:00.383241 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:00.383241 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:00.383241 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:44:00.383241 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:44:00.383241 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c8654f0-6755-46c3-8801-c2d3b4d37b48 could not be found. May 28 04:44:00.383241 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:00.383241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a4ff539e-a79f-4934-8d90-5f341efa260a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Returning 404 to user: Instance 3c8654f0-6755-46c3-8801-c2d3b4d37b48 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:00.383241 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a4ff539e-a79f-4934-8d90-5f341efa260a tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48" status: 404 len: 111 microversion: 2.1 time: 0.045971 May 28 04:44:00.383241 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1363/2603] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:00 2022] GET /compute/v2.1/servers/3c8654f0-6755-46c3-8801-c2d3b4d37b48 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:44:00.387794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-976a8606-c681-4de8-875f-010b96e8c4d8 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:00.388410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-976a8606-c681-4de8-875f-010b96e8c4d8 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:00.390381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5db87ed3-c0d8-4c2a-818b-1ce2ac842c55 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:00.398300 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5db87ed3-c0d8-4c2a-818b-1ce2ac842c55 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d" status: 200 len: 1323 microversion: 2.1 time: 0.984989 May 28 04:44:00.398898 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1241/2604] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:43:59 2022] GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d => generated 1323 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:00.406530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e48f802c-e12e-4564-9b16-ff4884d6183e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:00.407097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e48f802c-e12e-4564-9b16-ff4884d6183e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:00.414223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-976a8606-c681-4de8-875f-010b96e8c4d8 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:00.414700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-976a8606-c681-4de8-875f-010b96e8c4d8 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:00.416320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-976a8606-c681-4de8-875f-010b96e8c4d8 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:00.416775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-976a8606-c681-4de8-875f-010b96e8c4d8 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:00.428767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e48f802c-e12e-4564-9b16-ff4884d6183e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:00.429233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e48f802c-e12e-4564-9b16-ff4884d6183e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:00.430005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e48f802c-e12e-4564-9b16-ff4884d6183e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:00.430441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e48f802c-e12e-4564-9b16-ff4884d6183e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:00.461981 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-e48f802c-e12e-4564-9b16-ff4884d6183e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] HTTP exception thrown: Instance 16f9a53c-0202-4e9d-bf42-6b3c376b535f could not be found. May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e48f802c-e12e-4564-9b16-ff4884d6183e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Request method failure captured: May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f HTTP/1.1 May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikafxFfDK_JaZXUKn-JeW3IbJHz_iJlYZUlcGq4am0JlqfPZ6SSb1OGTYa-aPodgtXYYHkuJKv-4EiNaR1fYDe2NY9U2-dsIvqLirDGA3H-4f_VHStrmnpoO6EBNKn5v5uLCIGgm2LFPR7sZM2s3VYuy1JAxbSoQzzGh896I1rCb8xJ8 May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: a93892cb2a75466a82fcb79f40b306ca May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1554865769 May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a93892cb2a75466a82fcb79f40b306ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a93892cb2a75466a82fcb79f40b306ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a93892cb2a75466a82fcb79f40b306ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a93892cb2a75466a82fcb79f40b306ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerDiskConfigTestJSON-1554865769 May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: a93892cb2a75466a82fcb79f40b306ca May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1554865769 May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerDiskConfigTestJSON-1554865769-project May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 0d4fff87c06440478b3a4536a289aa99 May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerDiskConfigTestJSON-1554865769-project May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 16f9a53c-0202-4e9d-bf42-6b3c376b535f could not be found. May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '16f9a53c-0202-4e9d-bf42-6b3c376b535f'} May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16f9a53c-0202-4e9d-bf42-6b3c376b535f could not be found. May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:44:00.469130 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:44:00.472452 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16f9a53c-0202-4e9d-bf42-6b3c376b535f could not be found. May 28 04:44:00.472452 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:00.472452 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:00.472452 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:00.472452 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:00.472452 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:00.472452 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:00.472452 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:44:00.472452 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:44:00.472452 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16f9a53c-0202-4e9d-bf42-6b3c376b535f could not be found. May 28 04:44:00.472452 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:00.474435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e48f802c-e12e-4564-9b16-ff4884d6183e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Returning 404 to user: Instance 16f9a53c-0202-4e9d-bf42-6b3c376b535f could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:00.475524 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e48f802c-e12e-4564-9b16-ff4884d6183e tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "DELETE /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 404 len: 111 microversion: 2.1 time: 0.075655 May 28 04:44:00.479534 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1242/2605] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:44:00 2022] DELETE /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:44:00.497627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c46cc151-8b99-4fc5-9e1e-67f3972b9bf7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:00.498689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c46cc151-8b99-4fc5-9e1e-67f3972b9bf7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] [instance: 16f9a53c-0202-4e9d-bf42-6b3c376b535f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:00.512454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c46cc151-8b99-4fc5-9e1e-67f3972b9bf7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:00.513143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c46cc151-8b99-4fc5-9e1e-67f3972b9bf7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:00.514103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c46cc151-8b99-4fc5-9e1e-67f3972b9bf7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:00.514717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c46cc151-8b99-4fc5-9e1e-67f3972b9bf7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:00.538595 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-c46cc151-8b99-4fc5-9e1e-67f3972b9bf7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] HTTP exception thrown: Instance 16f9a53c-0202-4e9d-bf42-6b3c376b535f could not be found. May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c46cc151-8b99-4fc5-9e1e-67f3972b9bf7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Request method failure captured: May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f HTTP/1.1 May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikafxFfDK_JaZXUKn-JeW3IbJHz_iJlYZUlcGq4am0JlqfPZ6SSb1OGTYa-aPodgtXYYHkuJKv-4EiNaR1fYDe2NY9U2-dsIvqLirDGA3H-4f_VHStrmnpoO6EBNKn5v5uLCIGgm2LFPR7sZM2s3VYuy1JAxbSoQzzGh896I1rCb8xJ8 May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: a93892cb2a75466a82fcb79f40b306ca May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1554865769 May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a93892cb2a75466a82fcb79f40b306ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a93892cb2a75466a82fcb79f40b306ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a93892cb2a75466a82fcb79f40b306ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a93892cb2a75466a82fcb79f40b306ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerDiskConfigTestJSON-1554865769 May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: a93892cb2a75466a82fcb79f40b306ca May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1554865769 May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerDiskConfigTestJSON-1554865769-project May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 0d4fff87c06440478b3a4536a289aa99 May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerDiskConfigTestJSON-1554865769-project May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 16f9a53c-0202-4e9d-bf42-6b3c376b535f could not be found. May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '16f9a53c-0202-4e9d-bf42-6b3c376b535f'} May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16f9a53c-0202-4e9d-bf42-6b3c376b535f could not be found. May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16f9a53c-0202-4e9d-bf42-6b3c376b535f could not be found. May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:00.540449 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:00.543329 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:00.543329 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:00.543329 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:00.543329 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:44:00.543329 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:44:00.543329 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16f9a53c-0202-4e9d-bf42-6b3c376b535f could not be found. May 28 04:44:00.543329 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:00.545370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c46cc151-8b99-4fc5-9e1e-67f3972b9bf7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] Returning 404 to user: Instance 16f9a53c-0202-4e9d-bf42-6b3c376b535f could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:00.547097 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c46cc151-8b99-4fc5-9e1e-67f3972b9bf7 tempest-ServerDiskConfigTestJSON-1554865769 tempest-ServerDiskConfigTestJSON-1554865769-project] 10.222.0.58 "GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f" status: 404 len: 111 microversion: 2.1 time: 0.065766 May 28 04:44:00.551949 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1243/2606] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:00 2022] GET /compute/v2.1/servers/16f9a53c-0202-4e9d-bf42-6b3c376b535f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:44:00.556994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-46c44b24-7391-4684-933a-0727b29cf37a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:00.557851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-46c44b24-7391-4684-933a-0727b29cf37a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:00.564650 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46c44b24-7391-4684-933a-0727b29cf37a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:00.565184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46c44b24-7391-4684-933a-0727b29cf37a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:00.566574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46c44b24-7391-4684-933a-0727b29cf37a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:00.567164 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46c44b24-7391-4684-933a-0727b29cf37a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:00.700665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-976a8606-c681-4de8-875f-010b96e8c4d8 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:00.717060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-976a8606-c681-4de8-875f-010b96e8c4d8 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:00.721240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-976a8606-c681-4de8-875f-010b96e8c4d8 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:00.734286 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-976a8606-c681-4de8-875f-010b96e8c4d8 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1444 microversion: 2.75 time: 0.350469 May 28 04:44:00.738003 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1364/2607] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:00 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1444 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:01.203414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-135fb879-1e65-4c24-b644-17b0eb1589d2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:01.204160 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-135fb879-1e65-4c24-b644-17b0eb1589d2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:01.216570 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-135fb879-1e65-4c24-b644-17b0eb1589d2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:01.217501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-135fb879-1e65-4c24-b644-17b0eb1589d2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:01.219636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-135fb879-1e65-4c24-b644-17b0eb1589d2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:01.220385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-135fb879-1e65-4c24-b644-17b0eb1589d2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:01.357319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-135fb879-1e65-4c24-b644-17b0eb1589d2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:01.366386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-135fb879-1e65-4c24-b644-17b0eb1589d2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:01.377773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-135fb879-1e65-4c24-b644-17b0eb1589d2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:01.379914 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-135fb879-1e65-4c24-b644-17b0eb1589d2 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1265 microversion: 2.25 time: 0.181528 May 28 04:44:01.390356 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1365/2608] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:01 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:44:01.396499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-46c44b24-7391-4684-933a-0727b29cf37a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:01.409467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-46c44b24-7391-4684-933a-0727b29cf37a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:01.416725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0ee65a5f-6dfa-4160-9e5f-9a56b2f7bb40 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:01.417480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0ee65a5f-6dfa-4160-9e5f-9a56b2f7bb40 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:01.427215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ee65a5f-6dfa-4160-9e5f-9a56b2f7bb40 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:01.433752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ee65a5f-6dfa-4160-9e5f-9a56b2f7bb40 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:01.433752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ee65a5f-6dfa-4160-9e5f-9a56b2f7bb40 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:01.433752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ee65a5f-6dfa-4160-9e5f-9a56b2f7bb40 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:01.434115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-46c44b24-7391-4684-933a-0727b29cf37a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:01.434115 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-46c44b24-7391-4684-933a-0727b29cf37a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1885 microversion: 2.42 time: 0.879210 May 28 04:44:01.446746 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1244/2609] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:00 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1885 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:01.757372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-51df87e8-9e01-4dc9-9a29-1077e38c3c6a tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:01.757906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-51df87e8-9e01-4dc9-9a29-1077e38c3c6a tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:01.769020 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-51df87e8-9e01-4dc9-9a29-1077e38c3c6a tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:01.769974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-51df87e8-9e01-4dc9-9a29-1077e38c3c6a tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:01.770770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-51df87e8-9e01-4dc9-9a29-1077e38c3c6a tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:01.771232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-51df87e8-9e01-4dc9-9a29-1077e38c3c6a tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:01.854803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-51df87e8-9e01-4dc9-9a29-1077e38c3c6a tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:01.855559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-51df87e8-9e01-4dc9-9a29-1077e38c3c6a tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:01.856190 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-51df87e8-9e01-4dc9-9a29-1077e38c3c6a tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lazy-loading 'fault' on Instance uuid 0052a0f0-e3bc-4893-8603-4f8639c16374 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:44:02.171389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0ee65a5f-6dfa-4160-9e5f-9a56b2f7bb40 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:02.178500 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:44:02.189049 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0ee65a5f-6dfa-4160-9e5f-9a56b2f7bb40 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d" status: 200 len: 1518 microversion: 2.1 time: 0.772576 May 28 04:44:02.189049 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1366/2610] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:01 2022] GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d => generated 1518 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:02.191447 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-51df87e8-9e01-4dc9-9a29-1077e38c3c6a tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:02.203075 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-51df87e8-9e01-4dc9-9a29-1077e38c3c6a tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:02.205509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b54c8fb0-76d9-4005-841a-5d399de0f409 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Action: 'create', calling method: .version_select at 0x7f7701b84d30>, body: {"pool": null} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:02.211014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-51df87e8-9e01-4dc9-9a29-1077e38c3c6a tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b86b76fae08d48bb9f3616092998c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1299beacf1d41ed8a64020cd5e99201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:02.223162 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-51df87e8-9e01-4dc9-9a29-1077e38c3c6a tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 200 len: 1449 microversion: 2.75 time: 0.470576 May 28 04:44:02.224064 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1245/2611] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:01 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 1449 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:44:02.399704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a35c9121-fe3f-410f-bc96-a26aedd95d09 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:02.401073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a35c9121-fe3f-410f-bc96-a26aedd95d09 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:02.412480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a35c9121-fe3f-410f-bc96-a26aedd95d09 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:02.413181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a35c9121-fe3f-410f-bc96-a26aedd95d09 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:02.414109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a35c9121-fe3f-410f-bc96-a26aedd95d09 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:02.414848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a35c9121-fe3f-410f-bc96-a26aedd95d09 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:02.494524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a35c9121-fe3f-410f-bc96-a26aedd95d09 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:02.494967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a35c9121-fe3f-410f-bc96-a26aedd95d09 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:02.495489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-a35c9121-fe3f-410f-bc96-a26aedd95d09 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lazy-loading 'fault' on Instance uuid 05c3986b-245a-4454-95c7-63f826af6edc {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:44:02.658471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a35c9121-fe3f-410f-bc96-a26aedd95d09 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:02.678422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a35c9121-fe3f-410f-bc96-a26aedd95d09 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:02.680257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a35c9121-fe3f-410f-bc96-a26aedd95d09 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:02.681586 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a35c9121-fe3f-410f-bc96-a26aedd95d09 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 200 len: 1193 microversion: 2.25 time: 0.287769 May 28 04:44:02.696178 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1246/2612] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:02 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 1193 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:02.716567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c32ff824-5757-4253-b41a-15f0a6ba4208 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:02.718183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c32ff824-5757-4253-b41a-15f0a6ba4208 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:02.738791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c32ff824-5757-4253-b41a-15f0a6ba4208 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:02.744370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c32ff824-5757-4253-b41a-15f0a6ba4208 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:02.746313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c32ff824-5757-4253-b41a-15f0a6ba4208 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:02.749399 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c32ff824-5757-4253-b41a-15f0a6ba4208 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:03.204466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c32ff824-5757-4253-b41a-15f0a6ba4208 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:03.221221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c32ff824-5757-4253-b41a-15f0a6ba4208 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:03.226918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c32ff824-5757-4253-b41a-15f0a6ba4208 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:03.228150 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c32ff824-5757-4253-b41a-15f0a6ba4208 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1885 microversion: 2.42 time: 0.526245 May 28 04:44:03.228721 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1247/2613] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:02 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1885 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:03.255918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-445cf503-d308-4571-a09b-c5253e2246d1 req-5806e81b-b15e-48d6-beb6-90035eac7ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "tag": "b1d39698-47fc-43c1-928b-c95c094c9118"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:03.293309 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-445cf503-d308-4571-a09b-c5253e2246d1 req-5806e81b-b15e-48d6-beb6-90035eac7ea9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:03.293822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-445cf503-d308-4571-a09b-c5253e2246d1 req-5806e81b-b15e-48d6-beb6-90035eac7ea9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:03.320677 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-445cf503-d308-4571-a09b-c5253e2246d1 req-5806e81b-b15e-48d6-beb6-90035eac7ea9 service nova] Creating event network-changed:b1d39698-47fc-43c1-928b-c95c094c9118 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:44:03.328521 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-445cf503-d308-4571-a09b-c5253e2246d1 req-5806e81b-b15e-48d6-beb6-90035eac7ea9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077119 May 28 04:44:03.329465 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1248/2614] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:03.339716 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d5dccccc-7cc1-4a91-ad38-bc0462a27373 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:03.340694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d5dccccc-7cc1-4a91-ad38-bc0462a27373 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] [instance: 0052a0f0-e3bc-4893-8603-4f8639c16374] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:03.349348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5dccccc-7cc1-4a91-ad38-bc0462a27373 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:03.354930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5dccccc-7cc1-4a91-ad38-bc0462a27373 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:03.354930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5dccccc-7cc1-4a91-ad38-bc0462a27373 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:03.354930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5dccccc-7cc1-4a91-ad38-bc0462a27373 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:03.398099 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-d5dccccc-7cc1-4a91-ad38-bc0462a27373 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] HTTP exception thrown: Instance 0052a0f0-e3bc-4893-8603-4f8639c16374 could not be found. May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d5dccccc-7cc1-4a91-ad38-bc0462a27373 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Request method failure captured: May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 HTTP/1.1 May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikag_NJ4cxzi5dlijEv3K_jQSeq9Sbanv6TBWmmwWn-k6xFvTmAxndUDsnGmljsDc3rzubGJOQepguL1Bjb4IzsxQ8WC8l9M54BtV-KzTm5svi12biuZqiG6g8D-jrS1ESdfGEaFDJx108DUNv_UTLysu1PdYI4LKZqo0IL6LOJDUvVs May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-Openstack-Nova-Api-Version: 2.75 May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: f1299beacf1d41ed8a64020cd5e99201 May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersAdmin275Test-597851834 May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f1299beacf1d41ed8a64020cd5e99201"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f1299beacf1d41ed8a64020cd5e99201"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f1299beacf1d41ed8a64020cd5e99201"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f1299beacf1d41ed8a64020cd5e99201"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersAdmin275Test-597851834 May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: f1299beacf1d41ed8a64020cd5e99201 May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersAdmin275Test-597851834 May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersAdmin275Test-597851834-project May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: b86b76fae08d48bb9f3616092998c27d May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersAdmin275Test-597851834-project May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 0052a0f0-e3bc-4893-8603-4f8639c16374 could not be found. May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '0052a0f0-e3bc-4893-8603-4f8639c16374'} May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0052a0f0-e3bc-4893-8603-4f8639c16374 could not be found. May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0052a0f0-e3bc-4893-8603-4f8639c16374 could not be found. May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:03.399820 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:03.403495 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:03.403495 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:03.403495 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:03.403495 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:44:03.403495 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:44:03.403495 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0052a0f0-e3bc-4893-8603-4f8639c16374 could not be found. May 28 04:44:03.403495 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:03.403495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d5dccccc-7cc1-4a91-ad38-bc0462a27373 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] Returning 404 to user: Instance 0052a0f0-e3bc-4893-8603-4f8639c16374 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:03.403495 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d5dccccc-7cc1-4a91-ad38-bc0462a27373 tempest-ServersAdmin275Test-597851834 tempest-ServersAdmin275Test-597851834-project] 10.222.0.58 "GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374" status: 404 len: 111 microversion: 2.75 time: 0.066111 May 28 04:44:03.404002 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1249/2615] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:03 2022] GET /compute/v2.1/servers/0052a0f0-e3bc-4893-8603-4f8639c16374 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 04:44:03.702026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b6ee04dd-e134-4aa6-9924-fee6687648bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:03.703558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b6ee04dd-e134-4aa6-9924-fee6687648bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 05c3986b-245a-4454-95c7-63f826af6edc] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:03.717546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6ee04dd-e134-4aa6-9924-fee6687648bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:03.723874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6ee04dd-e134-4aa6-9924-fee6687648bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:03.725559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6ee04dd-e134-4aa6-9924-fee6687648bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:03.726142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6ee04dd-e134-4aa6-9924-fee6687648bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:03.760891 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-b6ee04dd-e134-4aa6-9924-fee6687648bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] HTTP exception thrown: Instance 05c3986b-245a-4454-95c7-63f826af6edc could not be found. May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b6ee04dd-e134-4aa6-9924-fee6687648bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Request method failure captured: May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc HTTP/1.1 May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaa2z-mBC0Oqm9jSGg-o-K9zDEQfRKobRjEoonU0ns2YIeP-M7nIyd9FMtfufCiPXUpBFAXsdoE2GDbhmek38feXoiu1nkWEvJf4zUN3sHLUVl8rxo58WUYGAE6Ok0ye9isbgcQYaNdZ1NKU8RsK3oUctPhk5wtwAWoeRvkT_CCcR1o May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-Openstack-Nova-Api-Version: 2.25 May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 99f14746bfbc460eb4a21e7eb567de46 May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-678063580 May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_99f14746bfbc460eb4a21e7eb567de46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/99f14746bfbc460eb4a21e7eb567de46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/99f14746bfbc460eb4a21e7eb567de46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/99f14746bfbc460eb4a21e7eb567de46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-678063580 May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 99f14746bfbc460eb4a21e7eb567de46 May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-678063580 May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-LiveAutoBlockMigrationV225Test-678063580-project May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: ed90faaaee584c3a8d1385b8d873d12d May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-678063580-project May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 05c3986b-245a-4454-95c7-63f826af6edc could not be found. May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '05c3986b-245a-4454-95c7-63f826af6edc'} May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c3986b-245a-4454-95c7-63f826af6edc could not be found. May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c3986b-245a-4454-95c7-63f826af6edc could not be found. May 28 04:44:03.762627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:03.771379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:03.771379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:03.771379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:03.771379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:03.771379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:03.771379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:44:03.771379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:44:03.771379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c3986b-245a-4454-95c7-63f826af6edc could not be found. May 28 04:44:03.771379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:03.771379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b6ee04dd-e134-4aa6-9924-fee6687648bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Returning 404 to user: Instance 05c3986b-245a-4454-95c7-63f826af6edc could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:03.771379 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b6ee04dd-e134-4aa6-9924-fee6687648bb tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc" status: 404 len: 111 microversion: 2.25 time: 0.067545 May 28 04:44:03.771379 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1250/2616] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:03 2022] GET /compute/v2.1/servers/05c3986b-245a-4454-95c7-63f826af6edc => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 04:44:04.246885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-654126ff-93a6-470b-8570-15e8f12c3589 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:04.247878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-654126ff-93a6-470b-8570-15e8f12c3589 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:04.258312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-654126ff-93a6-470b-8570-15e8f12c3589 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:04.258772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-654126ff-93a6-470b-8570-15e8f12c3589 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:04.259583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-654126ff-93a6-470b-8570-15e8f12c3589 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:04.263667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-654126ff-93a6-470b-8570-15e8f12c3589 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:05.548240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-654126ff-93a6-470b-8570-15e8f12c3589 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:05.563894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-654126ff-93a6-470b-8570-15e8f12c3589 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:05.565720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-654126ff-93a6-470b-8570-15e8f12c3589 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:05.571379 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-654126ff-93a6-470b-8570-15e8f12c3589 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1885 microversion: 2.42 time: 1.328717 May 28 04:44:05.590900 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1251/2617] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:04 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1885 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:44:05.596497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f5d39dbb-78f2-4f52-8559-c82340d8753a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1645797113", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa4b7ae7-c4d1-4b2e-9365-36aea885e8cd"}], "security_groups": [{"name": "tempest-securitygroup--1620542819"}], "key_name": "tempest-keypair-185302012", "user_data": "}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:05.972500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-f5d39dbb-78f2-4f52-8559-c82340d8753a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] validate_networks() for [('fa4b7ae7-c4d1-4b2e-9365-36aea885e8cd', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:44:07.625378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f5d39dbb-78f2-4f52-8559-c82340d8753a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:44:07.625992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f5d39dbb-78f2-4f52-8559-c82340d8753a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:44:07.626943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f5d39dbb-78f2-4f52-8559-c82340d8753a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:44:07.626943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f5d39dbb-78f2-4f52-8559-c82340d8753a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:44:07.627503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f5d39dbb-78f2-4f52-8559-c82340d8753a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:44:07.638352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5d39dbb-78f2-4f52-8559-c82340d8753a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:07.638832 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5d39dbb-78f2-4f52-8559-c82340d8753a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:07.639759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5d39dbb-78f2-4f52-8559-c82340d8753a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:07.640222 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5d39dbb-78f2-4f52-8559-c82340d8753a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:07.661031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-f5d39dbb-78f2-4f52-8559-c82340d8753a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Getting quotas for project b0c48bf20efd4291b37e616c658f96ff. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:44:07.666770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-f5d39dbb-78f2-4f52-8559-c82340d8753a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Getting quotas for user 6272045226334bcf8b49a0aa41a07b95 and project b0c48bf20efd4291b37e616c658f96ff. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:44:07.683106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f5d39dbb-78f2-4f52-8559-c82340d8753a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:44:07.685482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f5d39dbb-78f2-4f52-8559-c82340d8753a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:44:07.826572 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f5d39dbb-78f2-4f52-8559-c82340d8753a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.234401 May 28 04:44:07.828697 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1252/2618] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:44:05 2022] POST /compute/v2.1/servers => generated 409 bytes in 2237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:44:07.836873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-db651f43-f8b8-433f-909d-19f439ac9d68 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:07.837880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-db651f43-f8b8-433f-909d-19f439ac9d68 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:07.846041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db651f43-f8b8-433f-909d-19f439ac9d68 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:07.846739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db651f43-f8b8-433f-909d-19f439ac9d68 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:07.848320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db651f43-f8b8-433f-909d-19f439ac9d68 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:07.848901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db651f43-f8b8-433f-909d-19f439ac9d68 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:08.504811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-db651f43-f8b8-433f-909d-19f439ac9d68 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:08.522097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-db651f43-f8b8-433f-909d-19f439ac9d68 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:08.524578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-db651f43-f8b8-433f-909d-19f439ac9d68 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:08.526618 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-db651f43-f8b8-433f-909d-19f439ac9d68 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1885 microversion: 2.42 time: 0.696362 May 28 04:44:08.541148 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1253/2619] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:07 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1885 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:08.548064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-217079a3-9af2-4a95-a664-03946571df8d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:08.549485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-217079a3-9af2-4a95-a664-03946571df8d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:08.650526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-217079a3-9af2-4a95-a664-03946571df8d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:08.678171 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-217079a3-9af2-4a95-a664-03946571df8d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1238 microversion: 2.1 time: 0.127510 May 28 04:44:08.680163 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1254/2620] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:08 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1238 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:08.692214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-8a0efa3f-af95-4353-af54-1fb1766b56cc req-1b4a75cc-62fc-4fe0-8966-22b58c0ed401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "tag": "1643fa1a-bc92-4b3e-9108-5707b60a8b27"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:08.738736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8a0efa3f-af95-4353-af54-1fb1766b56cc req-1b4a75cc-62fc-4fe0-8966-22b58c0ed401 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:08.747828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8a0efa3f-af95-4353-af54-1fb1766b56cc req-1b4a75cc-62fc-4fe0-8966-22b58c0ed401 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:08.780521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:44:08.784981 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-8a0efa3f-af95-4353-af54-1fb1766b56cc req-1b4a75cc-62fc-4fe0-8966-22b58c0ed401 service nova] Creating event network-changed:1643fa1a-bc92-4b3e-9108-5707b60a8b27 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:44:08.797157 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-8a0efa3f-af95-4353-af54-1fb1766b56cc req-1b4a75cc-62fc-4fe0-8966-22b58c0ed401 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114549 May 28 04:44:08.801533 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1255/2621] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:09.547624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-33dc29a2-5063-4b5f-97ca-745c2c357937 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:09.549236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-33dc29a2-5063-4b5f-97ca-745c2c357937 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:09.565146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33dc29a2-5063-4b5f-97ca-745c2c357937 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:09.566841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33dc29a2-5063-4b5f-97ca-745c2c357937 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:09.570188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33dc29a2-5063-4b5f-97ca-745c2c357937 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:09.570803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33dc29a2-5063-4b5f-97ca-745c2c357937 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:09.786964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:44:09.872048 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b54c8fb0-76d9-4005-841a-5d399de0f409 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.671335 May 28 04:44:09.873124 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1367/2622] 10.222.0.58 () {60 vars in 1169 bytes} [Sat May 28 04:44:02 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:44:09.879352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2bae367e-7e6c-43eb-9779-57dcf4f4e81b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:09.882762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2bae367e-7e6c-43eb-9779-57dcf4f4e81b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:09.896662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bae367e-7e6c-43eb-9779-57dcf4f4e81b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:09.898678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bae367e-7e6c-43eb-9779-57dcf4f4e81b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:09.901286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bae367e-7e6c-43eb-9779-57dcf4f4e81b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:09.901950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bae367e-7e6c-43eb-9779-57dcf4f4e81b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:10.067119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2bae367e-7e6c-43eb-9779-57dcf4f4e81b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:10.076052 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2bae367e-7e6c-43eb-9779-57dcf4f4e81b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1242 microversion: 2.1 time: 0.201735 May 28 04:44:10.080652 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1368/2623] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:09 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1242 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:10.254593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-33dc29a2-5063-4b5f-97ca-745c2c357937 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:10.273029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-33dc29a2-5063-4b5f-97ca-745c2c357937 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:10.277992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-33dc29a2-5063-4b5f-97ca-745c2c357937 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:10.282922 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-33dc29a2-5063-4b5f-97ca-745c2c357937 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1885 microversion: 2.42 time: 0.740427 May 28 04:44:10.289096 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1256/2624] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:09 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1885 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:10.308331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-45af5da3-f28b-4513-88fa-45db4379488a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1222901075", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "9da21411-17dd-4f3c-904b-2ef597d53247"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:10.433468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-45af5da3-f28b-4513-88fa-45db4379488a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] validate_networks() for [('9da21411-17dd-4f3c-904b-2ef597d53247', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:44:10.608523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9ec0bc1d-421d-4bd5-bdaa-a166df5d38b9 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1442901225", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "fbf1b488-c0f3-4bd7-b727-4dba34907d61"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:10.744010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-9ec0bc1d-421d-4bd5-bdaa-a166df5d38b9 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] validate_networks() for [('fbf1b488-c0f3-4bd7-b727-4dba34907d61', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:44:12.063616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-45af5da3-f28b-4513-88fa-45db4379488a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:44:12.064137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-45af5da3-f28b-4513-88fa-45db4379488a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:44:12.064603 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-45af5da3-f28b-4513-88fa-45db4379488a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:44:12.064907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-45af5da3-f28b-4513-88fa-45db4379488a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:44:12.065652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-45af5da3-f28b-4513-88fa-45db4379488a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:44:12.087102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45af5da3-f28b-4513-88fa-45db4379488a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:12.087102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45af5da3-f28b-4513-88fa-45db4379488a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:12.087102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45af5da3-f28b-4513-88fa-45db4379488a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:12.087102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45af5da3-f28b-4513-88fa-45db4379488a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:12.133556 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-45af5da3-f28b-4513-88fa-45db4379488a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Getting quotas for project 3c8d3282507f4edabcfe1c87e6a2186c. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:44:12.157993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-45af5da3-f28b-4513-88fa-45db4379488a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Getting quotas for user 6cec66a6c50340749edc115608c6eeaa and project 3c8d3282507f4edabcfe1c87e6a2186c. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:44:12.193403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-45af5da3-f28b-4513-88fa-45db4379488a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:44:12.197574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-45af5da3-f28b-4513-88fa-45db4379488a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:44:12.294221 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-9ec0bc1d-421d-4bd5-bdaa-a166df5d38b9 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:44:12.296455 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-9ec0bc1d-421d-4bd5-bdaa-a166df5d38b9 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:44:12.297214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-9ec0bc1d-421d-4bd5-bdaa-a166df5d38b9 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:44:12.297851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-9ec0bc1d-421d-4bd5-bdaa-a166df5d38b9 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:44:12.303055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-9ec0bc1d-421d-4bd5-bdaa-a166df5d38b9 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:44:12.327268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ec0bc1d-421d-4bd5-bdaa-a166df5d38b9 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:12.328752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ec0bc1d-421d-4bd5-bdaa-a166df5d38b9 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:12.329793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ec0bc1d-421d-4bd5-bdaa-a166df5d38b9 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:12.331873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ec0bc1d-421d-4bd5-bdaa-a166df5d38b9 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:12.351436 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-45af5da3-f28b-4513-88fa-45db4379488a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.059733 May 28 04:44:12.351436 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1257/2625] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:44:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:44:12.418614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-9ec0bc1d-421d-4bd5-bdaa-a166df5d38b9 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Getting quotas for project a73d1a2ff6564a9bb369414fc35461d4. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:44:12.435225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-9ec0bc1d-421d-4bd5-bdaa-a166df5d38b9 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Getting quotas for user 861f3ef8d2f84fe097697218cf3f46a8 and project a73d1a2ff6564a9bb369414fc35461d4. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:44:12.479960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9ec0bc1d-421d-4bd5-bdaa-a166df5d38b9 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:44:12.482317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9ec0bc1d-421d-4bd5-bdaa-a166df5d38b9 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] [instance: c74ce99c-676e-4db8-ab9d-3c062a8385ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:44:12.640547 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9ec0bc1d-421d-4bd5-bdaa-a166df5d38b9 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.558454 May 28 04:44:12.641386 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1369/2626] 10.222.0.58 () {62 vars in 1187 bytes} [Sat May 28 04:44:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2560 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 04:44:12.657540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-00983c2d-2cdf-48da-98e1-e1217d6e7b87 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:12.658180 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-00983c2d-2cdf-48da-98e1-e1217d6e7b87 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:12.676403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-10599bf9-8b58-4af3-ac8b-5b020120ddcc tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:12.677912 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:44:12.677912 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:44:12.679979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10599bf9-8b58-4af3-ac8b-5b020120ddcc tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:12.680616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10599bf9-8b58-4af3-ac8b-5b020120ddcc tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:12.681691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10599bf9-8b58-4af3-ac8b-5b020120ddcc tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:12.681869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10599bf9-8b58-4af3-ac8b-5b020120ddcc tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:12.696840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00983c2d-2cdf-48da-98e1-e1217d6e7b87 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:12.703505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00983c2d-2cdf-48da-98e1-e1217d6e7b87 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:12.704326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00983c2d-2cdf-48da-98e1-e1217d6e7b87 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:12.704844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00983c2d-2cdf-48da-98e1-e1217d6e7b87 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:12.747962 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-10599bf9-8b58-4af3-ac8b-5b020120ddcc tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.389537 May 28 04:44:12.762498 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1258/2627] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:44:12 2022] GET /compute/v2.1/os-services => generated 944 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:12.789558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-001adc9c-9932-4759-9535-b3c0f0590f32 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:12.790356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-001adc9c-9932-4759-9535-b3c0f0590f32 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:12.809800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-001adc9c-9932-4759-9535-b3c0f0590f32 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:12.810535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-001adc9c-9932-4759-9535-b3c0f0590f32 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:12.819268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-001adc9c-9932-4759-9535-b3c0f0590f32 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:12.822954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-001adc9c-9932-4759-9535-b3c0f0590f32 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:13.831294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-001adc9c-9932-4759-9535-b3c0f0590f32 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:13.855026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-00983c2d-2cdf-48da-98e1-e1217d6e7b87 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:13.866563 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-00983c2d-2cdf-48da-98e1-e1217d6e7b87 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1364 microversion: 2.1 time: 1.223969 May 28 04:44:13.867184 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1370/2628] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:12 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1364 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:13.882041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-001adc9c-9932-4759-9535-b3c0f0590f32 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:13.890826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-001adc9c-9932-4759-9535-b3c0f0590f32 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:13.894663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-bdcf1f8a-d07d-4131-917a-64eb946a8da1 req-09aef6b6-507a-45de-8fb1-02dbf13a07af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "tag": "6afb08ab-967d-491b-a721-74903258c9b2"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:13.897394 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-001adc9c-9932-4759-9535-b3c0f0590f32 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1885 microversion: 2.42 time: 1.128801 May 28 04:44:13.902667 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1259/2629] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:12 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1885 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:13.913294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-bdcf1f8a-d07d-4131-917a-64eb946a8da1 req-09aef6b6-507a-45de-8fb1-02dbf13a07af service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:13.913761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-bdcf1f8a-d07d-4131-917a-64eb946a8da1 req-09aef6b6-507a-45de-8fb1-02dbf13a07af service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:13.917664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-230742eb-89a3-45ac-bbb6-b2f5328ca34b tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:13.918402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-230742eb-89a3-45ac-bbb6-b2f5328ca34b tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:13.940303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-230742eb-89a3-45ac-bbb6-b2f5328ca34b tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:13.942961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-230742eb-89a3-45ac-bbb6-b2f5328ca34b tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:13.943859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-230742eb-89a3-45ac-bbb6-b2f5328ca34b tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:13.950321 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-230742eb-89a3-45ac-bbb6-b2f5328ca34b tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:13.978744 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-bdcf1f8a-d07d-4131-917a-64eb946a8da1 req-09aef6b6-507a-45de-8fb1-02dbf13a07af service nova] Creating event network-changed:6afb08ab-967d-491b-a721-74903258c9b2 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:44:13.992963 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-bdcf1f8a-d07d-4131-917a-64eb946a8da1 req-09aef6b6-507a-45de-8fb1-02dbf13a07af service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111334 May 28 04:44:14.000954 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1371/2630] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:14.121204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-15049c64-64ce-4313-82e9-5442bea09e89 tempest-FloatingIPDetailsNegativeTestJSON-1587037331 tempest-FloatingIPDetailsNegativeTestJSON-1587037331-project] Calling method '.version_select at 0x7f7701053af0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:14.129477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-230742eb-89a3-45ac-bbb6-b2f5328ca34b tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:14.144796 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-230742eb-89a3-45ac-bbb6-b2f5328ca34b tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019" status: 200 len: 1228 microversion: 2.1 time: 0.239327 May 28 04:44:14.145281 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1260/2631] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:13 2022] GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019 => generated 1228 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:14.157466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8ba731fd-a4ae-4974-93c3-a6faaf31cf92 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:14.158185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8ba731fd-a4ae-4974-93c3-a6faaf31cf92 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] [instance: c74ce99c-676e-4db8-ab9d-3c062a8385ef] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:14.275299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG neutronclient.v2_0.client [None req-15049c64-64ce-4313-82e9-5442bea09e89 tempest-FloatingIPDetailsNegativeTestJSON-1587037331 tempest-FloatingIPDetailsNegativeTestJSON-1587037331-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f6338538-da3a-4667-a6b4-bdc86ae71704 could not be found", "detail": ""}} {{(pid=126044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:44:14.276057 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-15049c64-64ce-4313-82e9-5442bea09e89 tempest-FloatingIPDetailsNegativeTestJSON-1587037331 tempest-FloatingIPDetailsNegativeTestJSON-1587037331-project] HTTP exception thrown: Floating IP not found for ID f6338538-da3a-4667-a6b4-bdc86ae71704 May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-15049c64-64ce-4313-82e9-5442bea09e89 tempest-FloatingIPDetailsNegativeTestJSON-1587037331 tempest-FloatingIPDetailsNegativeTestJSON-1587037331-project] Request method failure captured: May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-floating-ips/f6338538-da3a-4667-a6b4-bdc86ae71704 HTTP/1.1 May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaicooG3xdM03JYa_cYDM9QW6wjji6EKocZV8i7IjMnNbUJ6gsl2OmEo8_QihaS0ig8F97eZPoxkyaZ68TZJU7mM0zFK9nnnOgz8150GguZoljikO-bMAWpnMCvetHMe7wfdzUmt8eY_yv_FBVRvnTun9mzwi9xF3Rcb8edqxthnyFg May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 70f9bf5702ec4bebaa009f39c1edf27d May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1587037331 May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_70f9bf5702ec4bebaa009f39c1edf27d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/70f9bf5702ec4bebaa009f39c1edf27d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/70f9bf5702ec4bebaa009f39c1edf27d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/70f9bf5702ec4bebaa009f39c1edf27d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1587037331 May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 70f9bf5702ec4bebaa009f39c1edf27d May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1587037331 May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1587037331-project May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: de40619d4a44422494c0045a81be1573 May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1587037331-project May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: exception: Floating IP not found for ID f6338538-da3a-4667-a6b4-bdc86ae71704 May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'f6338538-da3a-4667-a6b4-bdc86ae71704'} May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f6338538-da3a-4667-a6b4-bdc86ae71704 could not be found May 28 04:44:14.278456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0245741-56f6-4b20-984a-7382b84a6772'] May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f6338538-da3a-4667-a6b4-bdc86ae71704. May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f6338538-da3a-4667-a6b4-bdc86ae71704 May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f6338538-da3a-4667-a6b4-bdc86ae71704 May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-15049c64-64ce-4313-82e9-5442bea09e89 tempest-FloatingIPDetailsNegativeTestJSON-1587037331 tempest-FloatingIPDetailsNegativeTestJSON-1587037331-project] Returning 404 to user: Floating IP not found for ID f6338538-da3a-4667-a6b4-bdc86ae71704 {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:14.281510 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-15049c64-64ce-4313-82e9-5442bea09e89 tempest-FloatingIPDetailsNegativeTestJSON-1587037331 tempest-FloatingIPDetailsNegativeTestJSON-1587037331-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/f6338538-da3a-4667-a6b4-bdc86ae71704" status: 404 len: 111 microversion: 2.1 time: 0.277937 May 28 04:44:14.283299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8ba731fd-a4ae-4974-93c3-a6faaf31cf92 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:14.286091 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1372/2632] 10.222.0.58 () {58 vars in 1259 bytes} [Sat May 28 04:44:14 2022] GET /compute/v2.1/os-floating-ips/f6338538-da3a-4667-a6b4-bdc86ae71704 => generated 111 bytes in 284 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:44:14.291106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8ba731fd-a4ae-4974-93c3-a6faaf31cf92 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:14.300508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8ba731fd-a4ae-4974-93c3-a6faaf31cf92 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:14.301697 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8ba731fd-a4ae-4974-93c3-a6faaf31cf92 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] 10.222.0.58 "GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef" status: 200 len: 1259 microversion: 2.21 time: 0.154322 May 28 04:44:14.306664 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1261/2633] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:14 2022] GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:14.312929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ab1e0258-a985-4d53-8161-4383230f0cbf tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:14.318008 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:44:14.318008 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:44:14.319825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab1e0258-a985-4d53-8161-4383230f0cbf tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:14.320675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab1e0258-a985-4d53-8161-4383230f0cbf tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:14.321507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab1e0258-a985-4d53-8161-4383230f0cbf tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:14.321953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab1e0258-a985-4d53-8161-4383230f0cbf tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:14.387751 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ab1e0258-a985-4d53-8161-4383230f0cbf tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.100453 May 28 04:44:14.388387 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1373/2634] 10.222.0.58 () {58 vars in 1169 bytes} [Sat May 28 04:44:14 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:14.409022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2a90e033-73fa-4998-ba4d-773b0031caf0 tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:14.414959 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:44:14.414959 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:44:14.419462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a90e033-73fa-4998-ba4d-773b0031caf0 tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:14.420167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a90e033-73fa-4998-ba4d-773b0031caf0 tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:14.426341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a90e033-73fa-4998-ba4d-773b0031caf0 tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:14.429350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a90e033-73fa-4998-ba4d-773b0031caf0 tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:14.520797 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2a90e033-73fa-4998-ba4d-773b0031caf0 tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.120800 May 28 04:44:14.521905 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1262/2635] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:44:14 2022] GET /compute/v2.1/os-services => generated 944 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:14.532657 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-db745524-2774-4713-9e37-22df6e2cbfa7 tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:14.534136 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:44:14.534136 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:44:14.536968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db745524-2774-4713-9e37-22df6e2cbfa7 tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:14.537431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db745524-2774-4713-9e37-22df6e2cbfa7 tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:14.555619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db745524-2774-4713-9e37-22df6e2cbfa7 tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:14.556098 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db745524-2774-4713-9e37-22df6e2cbfa7 tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:14.641296 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-db745524-2774-4713-9e37-22df6e2cbfa7 tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=n-d-843700-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.106624 May 28 04:44:14.644522 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1374/2636] 10.222.0.58 () {58 vars in 1193 bytes} [Sat May 28 04:44:14 2022] GET /compute/v2.1/os-services?host=n-d-843700-1&binary=xxx => generated 16 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:44:14.667294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-06c406cd-933e-4006-a6be-1876d108492f tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:14.669449 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:44:14.669449 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:44:14.673746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06c406cd-933e-4006-a6be-1876d108492f tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:14.675760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06c406cd-933e-4006-a6be-1876d108492f tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:14.680140 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06c406cd-933e-4006-a6be-1876d108492f tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:14.684155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06c406cd-933e-4006-a6be-1876d108492f tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:14.797214 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-06c406cd-933e-4006-a6be-1876d108492f tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.144064 May 28 04:44:14.814152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e5be29fd-b890-44aa-9b3f-038aa0ea9b62 tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:14.817333 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:44:14.817333 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 04:44:14.819615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5be29fd-b890-44aa-9b3f-038aa0ea9b62 tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:14.820094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5be29fd-b890-44aa-9b3f-038aa0ea9b62 tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:14.823124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5be29fd-b890-44aa-9b3f-038aa0ea9b62 tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:14.827768 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1263/2637] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:44:14 2022] GET /compute/v2.1/os-services => generated 944 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:14.827887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5be29fd-b890-44aa-9b3f-038aa0ea9b62 tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:14.885719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eceb6096-72b8-43f0-9e32-ea19a6f145f6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:14.886404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eceb6096-72b8-43f0-9e32-ea19a6f145f6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:14.904223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eceb6096-72b8-43f0-9e32-ea19a6f145f6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:14.907511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eceb6096-72b8-43f0-9e32-ea19a6f145f6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:14.908373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eceb6096-72b8-43f0-9e32-ea19a6f145f6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:14.908824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eceb6096-72b8-43f0-9e32-ea19a6f145f6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:14.921251 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e5be29fd-b890-44aa-9b3f-038aa0ea9b62 tempest-ServicesAdminNegativeTestJSON-1161816921 tempest-ServicesAdminNegativeTestJSON-1161816921-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.1 time: 0.108940 May 28 04:44:14.923895 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1375/2638] 10.222.0.58 () {58 vars in 1197 bytes} [Sat May 28 04:44:14 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 04:44:14.949122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-202bac7d-5f1b-4457-acb0-a9b91975e468 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:14.951869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-202bac7d-5f1b-4457-acb0-a9b91975e468 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:14.972832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-202bac7d-5f1b-4457-acb0-a9b91975e468 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:14.987039 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-202bac7d-5f1b-4457-acb0-a9b91975e468 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:14.991073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-202bac7d-5f1b-4457-acb0-a9b91975e468 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:14.993251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-202bac7d-5f1b-4457-acb0-a9b91975e468 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:15.559565 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eceb6096-72b8-43f0-9e32-ea19a6f145f6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:15.569659 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eceb6096-72b8-43f0-9e32-ea19a6f145f6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1364 microversion: 2.1 time: 0.688538 May 28 04:44:15.582882 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1264/2639] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:14 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1364 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:16.141309 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4feb8e44-7ebc-4023-8ac7-a465cf0fe5d3 tempest-ServicesAdminNegativeTestJSON-992400654 tempest-ServicesAdminNegativeTestJSON-992400654-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:16.143928 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:44:16.143928 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:44:16.145292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4feb8e44-7ebc-4023-8ac7-a465cf0fe5d3 tempest-ServicesAdminNegativeTestJSON-992400654 tempest-ServicesAdminNegativeTestJSON-992400654-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '03319a34688d4826bed4808b03c43bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7e64bc957e43ee8a6252c5a1214993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4feb8e44-7ebc-4023-8ac7-a465cf0fe5d3 tempest-ServicesAdminNegativeTestJSON-992400654 tempest-ServicesAdminNegativeTestJSON-992400654-project] Request method failure captured: May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/os-services HTTP/1.1 May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaiZfXHUcwGcxQxkN9byb_qX1gYZ2xOizgWi3RZwGW73b-NPYpHOlERcrCp9Vh6GhKM8awMfkVaXUSqb-zxCq42ZmUc9BE9dKvRY_QhLvEtfEpXbRFqGAWbasBoGt1hUFdEe9Weu6XTcy4daN9PvqCB5s5NA7KGCzmq9PQLHAMP9yH4 May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: eb7e64bc957e43ee8a6252c5a1214993 May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-992400654 May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_eb7e64bc957e43ee8a6252c5a1214993"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/eb7e64bc957e43ee8a6252c5a1214993"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/eb7e64bc957e43ee8a6252c5a1214993"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/eb7e64bc957e43ee8a6252c5a1214993"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-992400654 May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: eb7e64bc957e43ee8a6252c5a1214993 May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-992400654 May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServicesAdminNegativeTestJSON-992400654-project May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 03319a34688d4826bed4808b03c43bab May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-992400654-project May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: action_args: {} May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise self.value May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. May 28 04:44:16.147284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:16.150375 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:16.150375 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:16.150375 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:16.150375 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:16.150375 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:16.150375 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 04:44:16.150375 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 04:44:16.150375 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. May 28 04:44:16.150375 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:16.160546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4feb8e44-7ebc-4023-8ac7-a465cf0fe5d3 tempest-ServicesAdminNegativeTestJSON-992400654 tempest-ServicesAdminNegativeTestJSON-992400654-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:16.168427 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4feb8e44-7ebc-4023-8ac7-a465cf0fe5d3 tempest-ServicesAdminNegativeTestJSON-992400654 tempest-ServicesAdminNegativeTestJSON-992400654-project] 10.222.0.58 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.584137 May 28 04:44:16.175252 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1265/2640] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:44:15 2022] GET /compute/v2.1/os-services => generated 112 bytes in 591 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 04:44:16.192791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e00b1574-6b20-401c-b23c-4940995ec6f0 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:16.202153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e00b1574-6b20-401c-b23c-4940995ec6f0 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:16.211300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:44:16.237200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e00b1574-6b20-401c-b23c-4940995ec6f0 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:16.243443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e00b1574-6b20-401c-b23c-4940995ec6f0 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:16.254653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e00b1574-6b20-401c-b23c-4940995ec6f0 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:16.255861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e00b1574-6b20-401c-b23c-4940995ec6f0 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:16.478349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-202bac7d-5f1b-4457-acb0-a9b91975e468 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:16.494186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-202bac7d-5f1b-4457-acb0-a9b91975e468 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:16.499815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-202bac7d-5f1b-4457-acb0-a9b91975e468 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:16.506593 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-202bac7d-5f1b-4457-acb0-a9b91975e468 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1885 microversion: 2.42 time: 1.576297 May 28 04:44:16.517890 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1376/2641] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:14 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1885 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:16.517890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-04800219-7e50-403e-85fb-a9184fb3d713 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:16.517890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-04800219-7e50-403e-85fb-a9184fb3d713 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] [instance: c74ce99c-676e-4db8-ab9d-3c062a8385ef] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:16.536334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-04800219-7e50-403e-85fb-a9184fb3d713 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:16.537109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-04800219-7e50-403e-85fb-a9184fb3d713 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:16.542478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-04800219-7e50-403e-85fb-a9184fb3d713 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:16.543617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-04800219-7e50-403e-85fb-a9184fb3d713 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:16.849339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e00b1574-6b20-401c-b23c-4940995ec6f0 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:16.858859 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e00b1574-6b20-401c-b23c-4940995ec6f0 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019" status: 200 len: 1294 microversion: 2.1 time: 0.680870 May 28 04:44:16.871271 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1266/2642] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:16 2022] GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019 => generated 1294 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:16.882755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-04800219-7e50-403e-85fb-a9184fb3d713 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:16.912676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-2192a2f7-c8f1-425e-be6c-2154bb8e7409 req-4bcb0c88-4edb-4456-a9ec-65b45b503d36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "215a4357-1792-4f6e-ae11-f8574b806b73", "tag": "f007cebf-d19d-420d-891d-de3291249844"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:16.918945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-04800219-7e50-403e-85fb-a9184fb3d713 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:16.920497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-04800219-7e50-403e-85fb-a9184fb3d713 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:16.933181 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-04800219-7e50-403e-85fb-a9184fb3d713 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] 10.222.0.58 "GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef" status: 200 len: 1329 microversion: 2.21 time: 0.423782 May 28 04:44:16.935408 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1377/2643] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:16 2022] GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef => generated 1329 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:16.944701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2192a2f7-c8f1-425e-be6c-2154bb8e7409 req-4bcb0c88-4edb-4456-a9ec-65b45b503d36 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:16.945146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2192a2f7-c8f1-425e-be6c-2154bb8e7409 req-4bcb0c88-4edb-4456-a9ec-65b45b503d36 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:16.950378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7f5107cb-8ff5-4cd3-b23a-61cb2bc25913 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:16.954503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7f5107cb-8ff5-4cd3-b23a-61cb2bc25913 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:16.981692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f5107cb-8ff5-4cd3-b23a-61cb2bc25913 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:16.982143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f5107cb-8ff5-4cd3-b23a-61cb2bc25913 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:16.987066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f5107cb-8ff5-4cd3-b23a-61cb2bc25913 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:16.987555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f5107cb-8ff5-4cd3-b23a-61cb2bc25913 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:17.000407 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-2192a2f7-c8f1-425e-be6c-2154bb8e7409 req-4bcb0c88-4edb-4456-a9ec-65b45b503d36 service nova] Creating event network-changed:f007cebf-d19d-420d-891d-de3291249844 for instance 215a4357-1792-4f6e-ae11-f8574b806b73 on n-h2-843700-1 May 28 04:44:17.021606 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-2192a2f7-c8f1-425e-be6c-2154bb8e7409 req-4bcb0c88-4edb-4456-a9ec-65b45b503d36 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148673 May 28 04:44:17.029279 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1267/2644] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:17.530177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2c7e4404-7471-4a00-bff4-27f56edbf13c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:17.531547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2c7e4404-7471-4a00-bff4-27f56edbf13c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:17.555821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c7e4404-7471-4a00-bff4-27f56edbf13c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:17.558745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c7e4404-7471-4a00-bff4-27f56edbf13c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:17.568301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c7e4404-7471-4a00-bff4-27f56edbf13c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:17.569327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c7e4404-7471-4a00-bff4-27f56edbf13c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:19.284876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7f5107cb-8ff5-4cd3-b23a-61cb2bc25913 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:19.297202 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7f5107cb-8ff5-4cd3-b23a-61cb2bc25913 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1364 microversion: 2.1 time: 2.359973 May 28 04:44:19.300415 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1378/2645] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:16 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1364 bytes in 2364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:19.323363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-018451ee-a180-42b8-8899-eb3c5cab07a4 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:19.328775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-018451ee-a180-42b8-8899-eb3c5cab07a4 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:19.342391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-018451ee-a180-42b8-8899-eb3c5cab07a4 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:19.343086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-018451ee-a180-42b8-8899-eb3c5cab07a4 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:19.349288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-018451ee-a180-42b8-8899-eb3c5cab07a4 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:19.350067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-018451ee-a180-42b8-8899-eb3c5cab07a4 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:19.647005 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-018451ee-a180-42b8-8899-eb3c5cab07a4 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:19.665595 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-018451ee-a180-42b8-8899-eb3c5cab07a4 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019" status: 200 len: 1282 microversion: 2.1 time: 0.353602 May 28 04:44:19.667611 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1379/2646] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:19 2022] GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019 => generated 1282 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:19.679366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ea6de95c-57c5-4041-a543-8a4224c86ade tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:19.680121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ea6de95c-57c5-4041-a543-8a4224c86ade tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] [instance: c74ce99c-676e-4db8-ab9d-3c062a8385ef] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:19.700284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea6de95c-57c5-4041-a543-8a4224c86ade tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:19.702814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea6de95c-57c5-4041-a543-8a4224c86ade tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:19.704588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea6de95c-57c5-4041-a543-8a4224c86ade tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:19.709836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea6de95c-57c5-4041-a543-8a4224c86ade tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:20.830000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2c7e4404-7471-4a00-bff4-27f56edbf13c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:20.855076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2c7e4404-7471-4a00-bff4-27f56edbf13c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:20.869571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2c7e4404-7471-4a00-bff4-27f56edbf13c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:20.885468 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2c7e4404-7471-4a00-bff4-27f56edbf13c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1885 microversion: 2.42 time: 3.347348 May 28 04:44:20.886302 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1268/2647] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:17 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1885 bytes in 3362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:44:20.910091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-72c979aa-c630-4bfe-acdf-0245840dac74 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:20.912774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-72c979aa-c630-4bfe-acdf-0245840dac74 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:20.944015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-72c979aa-c630-4bfe-acdf-0245840dac74 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:20.944680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-72c979aa-c630-4bfe-acdf-0245840dac74 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:20.948123 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-72c979aa-c630-4bfe-acdf-0245840dac74 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:20.948919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-72c979aa-c630-4bfe-acdf-0245840dac74 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:21.408450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ea6de95c-57c5-4041-a543-8a4224c86ade tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:21.429538 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ea6de95c-57c5-4041-a543-8a4224c86ade tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:21.432952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ea6de95c-57c5-4041-a543-8a4224c86ade tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:21.442846 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ea6de95c-57c5-4041-a543-8a4224c86ade tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] 10.222.0.58 "GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef" status: 200 len: 1359 microversion: 2.21 time: 1.774148 May 28 04:44:21.445568 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1380/2648] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:19 2022] GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef => generated 1359 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:21.463527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-72c979aa-c630-4bfe-acdf-0245840dac74 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:21.466313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e48dd472-6033-4dbb-bc30-97577f3458ec tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:21.476951 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-72c979aa-c630-4bfe-acdf-0245840dac74 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1364 microversion: 2.1 time: 0.588842 May 28 04:44:21.478676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e48dd472-6033-4dbb-bc30-97577f3458ec tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:21.486693 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1269/2649] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:20 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1364 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:21.508700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e48dd472-6033-4dbb-bc30-97577f3458ec tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:21.509281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e48dd472-6033-4dbb-bc30-97577f3458ec tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:21.515971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e48dd472-6033-4dbb-bc30-97577f3458ec tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:21.516437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e48dd472-6033-4dbb-bc30-97577f3458ec tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:21.905696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-73cca9da-3198-4b50-aa76-36145602ab51 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:21.907404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-73cca9da-3198-4b50-aa76-36145602ab51 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:21.918727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73cca9da-3198-4b50-aa76-36145602ab51 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:21.920059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73cca9da-3198-4b50-aa76-36145602ab51 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:21.921358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73cca9da-3198-4b50-aa76-36145602ab51 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:21.923271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73cca9da-3198-4b50-aa76-36145602ab51 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:22.421248 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-73cca9da-3198-4b50-aa76-36145602ab51 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:22.438078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-73cca9da-3198-4b50-aa76-36145602ab51 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:22.439944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-73cca9da-3198-4b50-aa76-36145602ab51 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:22.450322 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-73cca9da-3198-4b50-aa76-36145602ab51 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1885 microversion: 2.42 time: 0.548388 May 28 04:44:22.463567 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1270/2650] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:21 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1885 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:44:22.469014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-5f5ba9fd-d89e-49bf-99f5-417dfccfb17c req-979806f2-1644-4462-84eb-90348d5ebf8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c74ce99c-676e-4db8-ab9d-3c062a8385ef", "tag": "d2d8f772-0501-4c65-a224-b7bee48d41ad"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:22.474320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:44:22.501783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5f5ba9fd-d89e-49bf-99f5-417dfccfb17c req-979806f2-1644-4462-84eb-90348d5ebf8d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:22.506844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5f5ba9fd-d89e-49bf-99f5-417dfccfb17c req-979806f2-1644-4462-84eb-90348d5ebf8d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:22.536648 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-5f5ba9fd-d89e-49bf-99f5-417dfccfb17c req-979806f2-1644-4462-84eb-90348d5ebf8d service nova] Creating event network-changed:d2d8f772-0501-4c65-a224-b7bee48d41ad for instance c74ce99c-676e-4db8-ab9d-3c062a8385ef on n-h1-843700-1 May 28 04:44:22.546193 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-5f5ba9fd-d89e-49bf-99f5-417dfccfb17c req-979806f2-1644-4462-84eb-90348d5ebf8d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080875 May 28 04:44:22.547471 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1271/2651] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:22.564555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b908c28e-ba0d-46a7-a8ea-37a8f73e05d5 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:22.566014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b908c28e-ba0d-46a7-a8ea-37a8f73e05d5 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] [instance: c74ce99c-676e-4db8-ab9d-3c062a8385ef] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:22.574848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b908c28e-ba0d-46a7-a8ea-37a8f73e05d5 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:22.575592 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b908c28e-ba0d-46a7-a8ea-37a8f73e05d5 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:22.581395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b908c28e-ba0d-46a7-a8ea-37a8f73e05d5 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:22.582027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b908c28e-ba0d-46a7-a8ea-37a8f73e05d5 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:22.704167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e48dd472-6033-4dbb-bc30-97577f3458ec tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:22.728877 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e48dd472-6033-4dbb-bc30-97577f3458ec tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019" status: 200 len: 1324 microversion: 2.1 time: 1.272883 May 28 04:44:22.729559 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1381/2652] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:21 2022] GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019 => generated 1324 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:22.781291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-042321f2-a9e7-4742-920d-8f611f85f3ca tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:22.781988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-042321f2-a9e7-4742-920d-8f611f85f3ca tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:22.796958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-042321f2-a9e7-4742-920d-8f611f85f3ca tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:22.797419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-042321f2-a9e7-4742-920d-8f611f85f3ca tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:22.798222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-042321f2-a9e7-4742-920d-8f611f85f3ca tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:22.798664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-042321f2-a9e7-4742-920d-8f611f85f3ca tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:23.960699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b908c28e-ba0d-46a7-a8ea-37a8f73e05d5 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:23.988202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b908c28e-ba0d-46a7-a8ea-37a8f73e05d5 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:24.000269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b908c28e-ba0d-46a7-a8ea-37a8f73e05d5 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:24.005073 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b908c28e-ba0d-46a7-a8ea-37a8f73e05d5 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] 10.222.0.58 "GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef" status: 200 len: 1359 microversion: 2.21 time: 1.452770 May 28 04:44:24.024267 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1272/2653] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:22 2022] GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef => generated 1359 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:24.050077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5b8d4f4d-840f-433d-9a37-e20e442accf8 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:24.051769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5b8d4f4d-840f-433d-9a37-e20e442accf8 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:24.054109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-042321f2-a9e7-4742-920d-8f611f85f3ca tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:24.074388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5b8d4f4d-840f-433d-9a37-e20e442accf8 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:24.074773 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-042321f2-a9e7-4742-920d-8f611f85f3ca tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1364 microversion: 2.1 time: 1.312218 May 28 04:44:24.075413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5b8d4f4d-840f-433d-9a37-e20e442accf8 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:24.078432 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1382/2654] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:22 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1364 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:24.079119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5b8d4f4d-840f-433d-9a37-e20e442accf8 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:24.079725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5b8d4f4d-840f-433d-9a37-e20e442accf8 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:24.096359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-06e0317a-d08b-4125-b817-5cf44c8c072a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:24.098863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-06e0317a-d08b-4125-b817-5cf44c8c072a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:24.121188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-06e0317a-d08b-4125-b817-5cf44c8c072a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:24.137334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-06e0317a-d08b-4125-b817-5cf44c8c072a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:24.138358 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-06e0317a-d08b-4125-b817-5cf44c8c072a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:24.141280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-06e0317a-d08b-4125-b817-5cf44c8c072a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:24.290696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=16 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:44:24.735010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=10 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:44:24.843077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=8 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:44:24.943606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-06e0317a-d08b-4125-b817-5cf44c8c072a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:24.958610 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-06e0317a-d08b-4125-b817-5cf44c8c072a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019" status: 200 len: 1324 microversion: 2.1 time: 0.878999 May 28 04:44:24.978939 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1383/2655] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:24 2022] GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019 => generated 1324 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:25.028067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e95b2456-7212-409f-b920-7e183f95d575 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:25.029080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e95b2456-7212-409f-b920-7e183f95d575 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] [instance: c74ce99c-676e-4db8-ab9d-3c062a8385ef] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:25.055863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e95b2456-7212-409f-b920-7e183f95d575 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:25.055863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e95b2456-7212-409f-b920-7e183f95d575 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:25.055863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e95b2456-7212-409f-b920-7e183f95d575 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:25.055863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e95b2456-7212-409f-b920-7e183f95d575 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:25.060679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5b8d4f4d-840f-433d-9a37-e20e442accf8 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:25.072465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5b8d4f4d-840f-433d-9a37-e20e442accf8 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:25.080224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5b8d4f4d-840f-433d-9a37-e20e442accf8 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:25.090334 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5b8d4f4d-840f-433d-9a37-e20e442accf8 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1885 microversion: 2.42 time: 1.056793 May 28 04:44:25.090334 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1273/2656] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:24 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1885 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:25.095845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ced3057e-9424-435f-b230-7f27be16e3b9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:25.099425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ced3057e-9424-435f-b230-7f27be16e3b9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:25.116023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ced3057e-9424-435f-b230-7f27be16e3b9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:25.116762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ced3057e-9424-435f-b230-7f27be16e3b9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:25.117918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ced3057e-9424-435f-b230-7f27be16e3b9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:25.118546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ced3057e-9424-435f-b230-7f27be16e3b9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:25.691047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ced3057e-9424-435f-b230-7f27be16e3b9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:25.695815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e95b2456-7212-409f-b920-7e183f95d575 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:25.706806 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ced3057e-9424-435f-b230-7f27be16e3b9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1364 microversion: 2.1 time: 0.612525 May 28 04:44:25.707672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e95b2456-7212-409f-b920-7e183f95d575 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:25.709413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e95b2456-7212-409f-b920-7e183f95d575 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:25.713126 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1274/2657] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:25 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1364 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:25.714689 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e95b2456-7212-409f-b920-7e183f95d575 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] 10.222.0.58 "GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef" status: 200 len: 1359 microversion: 2.21 time: 0.692417 May 28 04:44:25.715461 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1384/2658] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:25 2022] GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef => generated 1359 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:44:25.725209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2aae3f90-c5f7-4b0f-991b-31eaa0fd0d0d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:25.725209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2aae3f90-c5f7-4b0f-991b-31eaa0fd0d0d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:25.744445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2aae3f90-c5f7-4b0f-991b-31eaa0fd0d0d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:25.745447 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2aae3f90-c5f7-4b0f-991b-31eaa0fd0d0d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:25.745749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-bd615403-ae55-4bb1-add1-4c50b32469e0 req-cff825c0-3c9d-4f22-b69f-1aa831035af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "215a4357-1792-4f6e-ae11-f8574b806b73", "name": "network-vif-plugged", "status": "completed", "tag": "f007cebf-d19d-420d-891d-de3291249844"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:25.750894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2aae3f90-c5f7-4b0f-991b-31eaa0fd0d0d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:25.750894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2aae3f90-c5f7-4b0f-991b-31eaa0fd0d0d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:25.765100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-bd615403-ae55-4bb1-add1-4c50b32469e0 req-cff825c0-3c9d-4f22-b69f-1aa831035af2 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:25.765783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-bd615403-ae55-4bb1-add1-4c50b32469e0 req-cff825c0-3c9d-4f22-b69f-1aa831035af2 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:25.786323 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-bd615403-ae55-4bb1-add1-4c50b32469e0 req-cff825c0-3c9d-4f22-b69f-1aa831035af2 service nova] Creating event network-vif-plugged:f007cebf-d19d-420d-891d-de3291249844 for instance 215a4357-1792-4f6e-ae11-f8574b806b73 on n-h2-843700-1 May 28 04:44:25.794858 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-bd615403-ae55-4bb1-add1-4c50b32469e0 req-cff825c0-3c9d-4f22-b69f-1aa831035af2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066108 May 28 04:44:25.808108 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1385/2659] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:25.877347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2aae3f90-c5f7-4b0f-991b-31eaa0fd0d0d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:44:25.977185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2581594b-c860-4110-af7c-519eacf7173b tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:25.978200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2581594b-c860-4110-af7c-519eacf7173b tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:25.993245 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2581594b-c860-4110-af7c-519eacf7173b tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:25.995011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2581594b-c860-4110-af7c-519eacf7173b tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:25.997089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2581594b-c860-4110-af7c-519eacf7173b tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:25.997705 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2581594b-c860-4110-af7c-519eacf7173b tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:26.423851 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2aae3f90-c5f7-4b0f-991b-31eaa0fd0d0d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 204 len: 0 microversion: 2.25 time: 0.710090 May 28 04:44:26.433068 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1275/2660] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:44:25 2022] DELETE /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:44:26.437502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2790c832-54d5-41a1-a34e-603db8ae185a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:26.440835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2790c832-54d5-41a1-a34e-603db8ae185a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:26.458103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2790c832-54d5-41a1-a34e-603db8ae185a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:26.458972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2790c832-54d5-41a1-a34e-603db8ae185a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:26.459923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2790c832-54d5-41a1-a34e-603db8ae185a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:26.460962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2790c832-54d5-41a1-a34e-603db8ae185a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:26.824693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2581594b-c860-4110-af7c-519eacf7173b tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:26.838466 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2581594b-c860-4110-af7c-519eacf7173b tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019" status: 200 len: 1324 microversion: 2.1 time: 0.865060 May 28 04:44:26.841561 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1386/2661] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:25 2022] GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019 => generated 1324 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:26.855402 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0a3cffff-1be3-4b0a-bee6-835336b82570 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:26.856035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0a3cffff-1be3-4b0a-bee6-835336b82570 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:26.874922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0a3cffff-1be3-4b0a-bee6-835336b82570 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:26.875414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0a3cffff-1be3-4b0a-bee6-835336b82570 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:26.876851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0a3cffff-1be3-4b0a-bee6-835336b82570 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:26.877308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0a3cffff-1be3-4b0a-bee6-835336b82570 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:27.568601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0a3cffff-1be3-4b0a-bee6-835336b82570 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:27.578306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0a3cffff-1be3-4b0a-bee6-835336b82570 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:27.585443 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0a3cffff-1be3-4b0a-bee6-835336b82570 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:27.589189 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0a3cffff-1be3-4b0a-bee6-835336b82570 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1563 microversion: 2.25 time: 0.746405 May 28 04:44:27.594461 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1387/2662] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:26 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1563 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:27.601965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ee99c864-519a-4bee-8529-fb0c1a980711 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:27.604181 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ee99c864-519a-4bee-8529-fb0c1a980711 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:27.619574 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:44:27.622397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ee99c864-519a-4bee-8529-fb0c1a980711 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:27.623111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ee99c864-519a-4bee-8529-fb0c1a980711 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:27.626201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ee99c864-519a-4bee-8529-fb0c1a980711 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:27.626891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ee99c864-519a-4bee-8529-fb0c1a980711 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:27.711971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2790c832-54d5-41a1-a34e-603db8ae185a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:27.719438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:44:27.742093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2790c832-54d5-41a1-a34e-603db8ae185a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:27.744733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2790c832-54d5-41a1-a34e-603db8ae185a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:27.748238 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2790c832-54d5-41a1-a34e-603db8ae185a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1885 microversion: 2.42 time: 1.314014 May 28 04:44:27.756105 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1276/2663] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:26 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1885 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:27.767347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eaced05b-daff-45e8-a986-c44663689c51 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:27.775341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eaced05b-daff-45e8-a986-c44663689c51 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] [instance: c74ce99c-676e-4db8-ab9d-3c062a8385ef] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:27.787787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eaced05b-daff-45e8-a986-c44663689c51 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:27.788481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eaced05b-daff-45e8-a986-c44663689c51 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:27.795999 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eaced05b-daff-45e8-a986-c44663689c51 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:27.796863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eaced05b-daff-45e8-a986-c44663689c51 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:28.922688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ee99c864-519a-4bee-8529-fb0c1a980711 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:28.950876 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ee99c864-519a-4bee-8529-fb0c1a980711 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1551 microversion: 2.1 time: 1.351414 May 28 04:44:28.958505 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1388/2664] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:27 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1551 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:28.982952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f3693b55-55df-4fca-8c43-0b9e323bc74b tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Calling method '.version_select at 0x7f7700ff8790>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:29.092584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eaced05b-daff-45e8-a986-c44663689c51 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:29.109791 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f3693b55-55df-4fca-8c43-0b9e323bc74b tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] 10.222.0.58 "GET /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c" status: 200 len: 636 microversion: 2.1 time: 0.148938 May 28 04:44:29.110339 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1389/2665] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:44:28 2022] GET /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c => generated 636 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:29.112330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eaced05b-daff-45e8-a986-c44663689c51 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:29.119597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eaced05b-daff-45e8-a986-c44663689c51 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:29.129649 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eaced05b-daff-45e8-a986-c44663689c51 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] 10.222.0.58 "GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef" status: 200 len: 1359 microversion: 2.21 time: 1.366905 May 28 04:44:29.130852 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1277/2666] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:27 2022] GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef => generated 1359 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:29.132131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5d69c228-a969-44ab-997b-efa4a32c818a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:29.132777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5d69c228-a969-44ab-997b-efa4a32c818a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:29.152352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-18eb6fc1-0b55-4a5c-9374-bc29e70b22a6 req-b2422b53-d645-4487-aae3-13f82c19cae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315db9ca-6acb-462a-a538-1b888d62e083", "name": "network-vif-deleted", "tag": "a9fec711-5850-498d-a2d4-9fb1b16772de"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:29.157086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d69c228-a969-44ab-997b-efa4a32c818a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:29.162073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d69c228-a969-44ab-997b-efa4a32c818a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:29.163581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d69c228-a969-44ab-997b-efa4a32c818a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:29.164047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d69c228-a969-44ab-997b-efa4a32c818a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:29.168552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-18eb6fc1-0b55-4a5c-9374-bc29e70b22a6 req-b2422b53-d645-4487-aae3-13f82c19cae7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:29.169033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-18eb6fc1-0b55-4a5c-9374-bc29e70b22a6 req-b2422b53-d645-4487-aae3-13f82c19cae7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:29.196826 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-18eb6fc1-0b55-4a5c-9374-bc29e70b22a6 req-b2422b53-d645-4487-aae3-13f82c19cae7 service nova] Creating event network-vif-deleted:a9fec711-5850-498d-a2d4-9fb1b16772de for instance 315db9ca-6acb-462a-a538-1b888d62e083 on n-h1-843700-1 May 28 04:44:29.204705 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-18eb6fc1-0b55-4a5c-9374-bc29e70b22a6 req-b2422b53-d645-4487-aae3-13f82c19cae7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072176 May 28 04:44:29.207362 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1278/2667] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:29.217151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9ef6cc1e-1c5e-4e6f-8930-b0aa2659795f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:29.217857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9ef6cc1e-1c5e-4e6f-8930-b0aa2659795f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:29.228923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ef6cc1e-1c5e-4e6f-8930-b0aa2659795f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:29.229381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ef6cc1e-1c5e-4e6f-8930-b0aa2659795f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:29.232662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:44:29.234640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ef6cc1e-1c5e-4e6f-8930-b0aa2659795f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:29.235131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ef6cc1e-1c5e-4e6f-8930-b0aa2659795f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:29.329255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ef6cc1e-1c5e-4e6f-8930-b0aa2659795f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:29.329668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ef6cc1e-1c5e-4e6f-8930-b0aa2659795f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:29.330204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-9ef6cc1e-1c5e-4e6f-8930-b0aa2659795f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lazy-loading 'fault' on Instance uuid 315db9ca-6acb-462a-a538-1b888d62e083 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:44:29.443491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9ef6cc1e-1c5e-4e6f-8930-b0aa2659795f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:29.467414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9ef6cc1e-1c5e-4e6f-8930-b0aa2659795f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:29.472131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9ef6cc1e-1c5e-4e6f-8930-b0aa2659795f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:29.477700 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9ef6cc1e-1c5e-4e6f-8930-b0aa2659795f tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 200 len: 1351 microversion: 2.25 time: 0.264839 May 28 04:44:29.478506 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1279/2668] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:29 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 1351 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:29.488813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-daf133d8-5d85-4049-9571-be265a327a9b req-8a977cbd-c06f-4fac-9e52-ddaba666526d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e00cb82d-ba64-497a-96ba-71fe00f0a019", "tag": "7d1f10a0-da4d-41e6-a729-b21d906423a8"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:29.522899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-daf133d8-5d85-4049-9571-be265a327a9b req-8a977cbd-c06f-4fac-9e52-ddaba666526d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:29.525219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-daf133d8-5d85-4049-9571-be265a327a9b req-8a977cbd-c06f-4fac-9e52-ddaba666526d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:29.548302 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-daf133d8-5d85-4049-9571-be265a327a9b req-8a977cbd-c06f-4fac-9e52-ddaba666526d service nova] Creating event network-changed:7d1f10a0-da4d-41e6-a729-b21d906423a8 for instance e00cb82d-ba64-497a-96ba-71fe00f0a019 on n-h1-843700-1 May 28 04:44:29.557746 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-daf133d8-5d85-4049-9571-be265a327a9b req-8a977cbd-c06f-4fac-9e52-ddaba666526d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077810 May 28 04:44:29.558595 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1280/2669] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:29.567629 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-028e07a8-739a-471a-b7d5-8264479da52a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:29.568626 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-028e07a8-739a-471a-b7d5-8264479da52a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:29.578793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-028e07a8-739a-471a-b7d5-8264479da52a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:29.578793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-028e07a8-739a-471a-b7d5-8264479da52a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:29.583707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-028e07a8-739a-471a-b7d5-8264479da52a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:29.584557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-028e07a8-739a-471a-b7d5-8264479da52a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:30.095246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5d69c228-a969-44ab-997b-efa4a32c818a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:30.108013 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5d69c228-a969-44ab-997b-efa4a32c818a tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019" status: 200 len: 1324 microversion: 2.1 time: 0.992295 May 28 04:44:30.118925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-028e07a8-739a-471a-b7d5-8264479da52a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:30.121662 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1390/2670] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:29 2022] GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019 => generated 1324 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:30.131959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-60502912-2a7f-4f22-8ca3-c7ce58d0dd3d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:30.132713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-60502912-2a7f-4f22-8ca3-c7ce58d0dd3d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:30.144611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60502912-2a7f-4f22-8ca3-c7ce58d0dd3d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:30.145352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60502912-2a7f-4f22-8ca3-c7ce58d0dd3d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:30.146355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60502912-2a7f-4f22-8ca3-c7ce58d0dd3d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:30.146945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60502912-2a7f-4f22-8ca3-c7ce58d0dd3d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:30.154526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-028e07a8-739a-471a-b7d5-8264479da52a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:30.164903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-028e07a8-739a-471a-b7d5-8264479da52a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:30.171975 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-028e07a8-739a-471a-b7d5-8264479da52a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1885 microversion: 2.42 time: 0.609833 May 28 04:44:30.171975 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1281/2671] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:29 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1885 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:30.183554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1f55fe2e-437e-4ca9-b10d-d9ca8fdb1e0d tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Action: 'update_all', calling method: .version_select at 0x7f7700d97670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:30.326693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-1f55fe2e-437e-4ca9-b10d-d9ca8fdb1e0d tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Getting quotas for project eb80d14a419d40109d3f51291c1aebe3. Resources: dict_keys(['metadata_items']) {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:44:30.340764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-1f55fe2e-437e-4ca9-b10d-d9ca8fdb1e0d tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Getting quotas for user d442979ea329492dbb7a3b98142cd97d and project eb80d14a419d40109d3f51291c1aebe3. Resources: dict_keys(['metadata_items']) {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:44:30.469681 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-60502912-2a7f-4f22-8ca3-c7ce58d0dd3d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.344866 May 28 04:44:30.470533 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1391/2672] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 04:44:30 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/os-interface => generated 285 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:30.478381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-a496559d-4de9-4db9-82c5-bffa0cf3d1e2 req-9cf1e052-97cb-42bc-a79d-73ec5b299cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74ce99c-676e-4db8-ab9d-3c062a8385ef", "name": "network-vif-plugged", "status": "completed", "tag": "d2d8f772-0501-4c65-a224-b7bee48d41ad"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:30.510695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a496559d-4de9-4db9-82c5-bffa0cf3d1e2 req-9cf1e052-97cb-42bc-a79d-73ec5b299cb7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:30.513446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a496559d-4de9-4db9-82c5-bffa0cf3d1e2 req-9cf1e052-97cb-42bc-a79d-73ec5b299cb7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:30.546715 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-a496559d-4de9-4db9-82c5-bffa0cf3d1e2 req-9cf1e052-97cb-42bc-a79d-73ec5b299cb7 service nova] Creating event network-vif-plugged:d2d8f772-0501-4c65-a224-b7bee48d41ad for instance c74ce99c-676e-4db8-ab9d-3c062a8385ef on n-h1-843700-1 May 28 04:44:30.560701 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-a496559d-4de9-4db9-82c5-bffa0cf3d1e2 req-9cf1e052-97cb-42bc-a79d-73ec5b299cb7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087509 May 28 04:44:30.561607 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1392/2673] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:30.582682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2dd408b8-34b5-45db-8ba8-22937bdf312b tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:30.584890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2dd408b8-34b5-45db-8ba8-22937bdf312b tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] [instance: c74ce99c-676e-4db8-ab9d-3c062a8385ef] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:30.597217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2dd408b8-34b5-45db-8ba8-22937bdf312b tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:30.597974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2dd408b8-34b5-45db-8ba8-22937bdf312b tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:30.602301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2dd408b8-34b5-45db-8ba8-22937bdf312b tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:30.603551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2dd408b8-34b5-45db-8ba8-22937bdf312b tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:30.891342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2dd408b8-34b5-45db-8ba8-22937bdf312b tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:30.910197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2dd408b8-34b5-45db-8ba8-22937bdf312b tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:30.912299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2dd408b8-34b5-45db-8ba8-22937bdf312b tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:30.913782 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2dd408b8-34b5-45db-8ba8-22937bdf312b tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] 10.222.0.58 "GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef" status: 200 len: 1359 microversion: 2.21 time: 0.350821 May 28 04:44:30.925050 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1393/2674] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:30 2022] GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef => generated 1359 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:30.934649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-366c048f-3c68-4c9f-a904-f90bf0c28d1d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:30.934649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-366c048f-3c68-4c9f-a904-f90bf0c28d1d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 315db9ca-6acb-462a-a538-1b888d62e083] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:30.938715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-366c048f-3c68-4c9f-a904-f90bf0c28d1d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:30.940037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-366c048f-3c68-4c9f-a904-f90bf0c28d1d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:30.941034 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-366c048f-3c68-4c9f-a904-f90bf0c28d1d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:30.941683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-366c048f-3c68-4c9f-a904-f90bf0c28d1d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-366c048f-3c68-4c9f-a904-f90bf0c28d1d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] HTTP exception thrown: Instance 315db9ca-6acb-462a-a538-1b888d62e083 could not be found. May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-366c048f-3c68-4c9f-a904-f90bf0c28d1d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Request method failure captured: May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 HTTP/1.1 May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaa2z-mBC0Oqm9jSGg-o-K9zDEQfRKobRjEoonU0ns2YIeP-M7nIyd9FMtfufCiPXUpBFAXsdoE2GDbhmek38feXoiu1nkWEvJf4zUN3sHLUVl8rxo58WUYGAE6Ok0ye9isbgcQYaNdZ1NKU8RsK3oUctPhk5wtwAWoeRvkT_CCcR1o May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-Openstack-Nova-Api-Version: 2.25 May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 99f14746bfbc460eb4a21e7eb567de46 May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-678063580 May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_99f14746bfbc460eb4a21e7eb567de46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/99f14746bfbc460eb4a21e7eb567de46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/99f14746bfbc460eb4a21e7eb567de46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/99f14746bfbc460eb4a21e7eb567de46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-678063580 May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 99f14746bfbc460eb4a21e7eb567de46 May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-678063580 May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-LiveAutoBlockMigrationV225Test-678063580-project May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: ed90faaaee584c3a8d1385b8d873d12d May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-678063580-project May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 315db9ca-6acb-462a-a538-1b888d62e083 could not be found. May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '315db9ca-6acb-462a-a538-1b888d62e083'} May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 315db9ca-6acb-462a-a538-1b888d62e083 could not be found. May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:44:30.967667 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:44:30.971945 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:44:30.971945 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 315db9ca-6acb-462a-a538-1b888d62e083 could not be found. May 28 04:44:30.971945 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:30.971945 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:30.971945 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:30.971945 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:30.971945 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:30.971945 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:30.971945 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:44:30.971945 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:44:30.971945 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 315db9ca-6acb-462a-a538-1b888d62e083 could not be found. May 28 04:44:30.971945 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:30.971945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-366c048f-3c68-4c9f-a904-f90bf0c28d1d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Returning 404 to user: Instance 315db9ca-6acb-462a-a538-1b888d62e083 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:30.971945 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-366c048f-3c68-4c9f-a904-f90bf0c28d1d tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083" status: 404 len: 111 microversion: 2.25 time: 0.040326 May 28 04:44:30.982054 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1394/2675] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:30 2022] GET /compute/v2.1/servers/315db9ca-6acb-462a-a538-1b888d62e083 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 04:44:30.990624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b7a4fc4b-56f4-4c1b-b038-39eb8e088752 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:30.991163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b7a4fc4b-56f4-4c1b-b038-39eb8e088752 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:31.014849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b7a4fc4b-56f4-4c1b-b038-39eb8e088752 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:31.015079 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1f55fe2e-437e-4ca9-b10d-d9ca8fdb1e0d tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] 10.222.0.58 "PUT /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.831024 May 28 04:44:31.015692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b7a4fc4b-56f4-4c1b-b038-39eb8e088752 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:31.016631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b7a4fc4b-56f4-4c1b-b038-39eb8e088752 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:31.020887 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1282/2676] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:44:30 2022] PUT /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata => generated 61 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:44:31.021560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b7a4fc4b-56f4-4c1b-b038-39eb8e088752 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:31.026261 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dd5d0c69-7a4e-4c93-b9ad-e0908ed8f1c6 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Calling method '.version_select at 0x7f7700d61dc0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:31.082239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b7a4fc4b-56f4-4c1b-b038-39eb8e088752 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:44:31.571420 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b7a4fc4b-56f4-4c1b-b038-39eb8e088752 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 204 len: 0 microversion: 2.25 time: 0.582319 May 28 04:44:31.575169 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1395/2677] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:44:30 2022] DELETE /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:44:31.585194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5439473e-6a15-44e3-9236-60273b5067d9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:31.586005 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5439473e-6a15-44e3-9236-60273b5067d9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:31.593429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5439473e-6a15-44e3-9236-60273b5067d9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:31.593972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5439473e-6a15-44e3-9236-60273b5067d9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:31.594903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5439473e-6a15-44e3-9236-60273b5067d9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:31.595832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5439473e-6a15-44e3-9236-60273b5067d9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:31.707415 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dd5d0c69-7a4e-4c93-b9ad-e0908ed8f1c6 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] 10.222.0.58 "DELETE /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.684755 May 28 04:44:31.711331 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1283/2678] 10.222.0.58 () {58 vars in 1295 bytes} [Sat May 28 04:44:31 2022] DELETE /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata/os_version => generated 0 bytes in 686 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:44:31.716659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-54901936-25e3-47c0-b687-5783a288fe6c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:31.718435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-54901936-25e3-47c0-b687-5783a288fe6c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:31.733366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54901936-25e3-47c0-b687-5783a288fe6c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:31.734702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54901936-25e3-47c0-b687-5783a288fe6c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:31.736294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54901936-25e3-47c0-b687-5783a288fe6c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:31.737633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54901936-25e3-47c0-b687-5783a288fe6c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:32.083766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5439473e-6a15-44e3-9236-60273b5067d9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:32.093547 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5439473e-6a15-44e3-9236-60273b5067d9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019" status: 200 len: 1324 microversion: 2.1 time: 0.518185 May 28 04:44:32.094346 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1396/2679] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:31 2022] GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019 => generated 1324 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:32.102609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4ab4a321-965a-4cc5-91c5-79fcf27654f0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:32.103462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4ab4a321-965a-4cc5-91c5-79fcf27654f0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:32.115027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ab4a321-965a-4cc5-91c5-79fcf27654f0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:32.115850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ab4a321-965a-4cc5-91c5-79fcf27654f0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:32.116883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ab4a321-965a-4cc5-91c5-79fcf27654f0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:32.117468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ab4a321-965a-4cc5-91c5-79fcf27654f0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:32.332500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-54901936-25e3-47c0-b687-5783a288fe6c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:32.353818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-54901936-25e3-47c0-b687-5783a288fe6c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:32.355491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-54901936-25e3-47c0-b687-5783a288fe6c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:32.356937 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-54901936-25e3-47c0-b687-5783a288fe6c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1885 microversion: 2.42 time: 0.644621 May 28 04:44:32.358285 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1284/2680] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:31 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1885 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:32.377532 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2dbc3807-c9e4-4a9e-becf-b96e83945b17 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Calling method '.version_select at 0x7f7700d62430>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:32.435830 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2dbc3807-c9e4-4a9e-becf-b96e83945b17 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] 10.222.0.58 "GET /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata" status: 200 len: 37 microversion: 2.1 time: 0.062882 May 28 04:44:32.437142 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1285/2681] 10.222.0.58 () {58 vars in 1259 bytes} [Sat May 28 04:44:32 2022] GET /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata => generated 37 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:44:32.444837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fa520c20-1396-4b34-b7c3-8272a6b9a939 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:32.445805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fa520c20-1396-4b34-b7c3-8272a6b9a939 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] [instance: c74ce99c-676e-4db8-ab9d-3c062a8385ef] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:32.456003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa520c20-1396-4b34-b7c3-8272a6b9a939 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:32.456708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa520c20-1396-4b34-b7c3-8272a6b9a939 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:32.457970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa520c20-1396-4b34-b7c3-8272a6b9a939 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:32.459062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa520c20-1396-4b34-b7c3-8272a6b9a939 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:32.578246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4ab4a321-965a-4cc5-91c5-79fcf27654f0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:32.587732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4ab4a321-965a-4cc5-91c5-79fcf27654f0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:32.589675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4ab4a321-965a-4cc5-91c5-79fcf27654f0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:32.616951 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4ab4a321-965a-4cc5-91c5-79fcf27654f0 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1548 microversion: 2.25 time: 0.520958 May 28 04:44:32.617919 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1397/2682] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:32 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1548 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:32.639941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6f77d114-811b-4f30-8246-f53057def169 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Action: 'update_all', calling method: .version_select at 0x7f77074e9430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:32.717911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-6f77d114-811b-4f30-8246-f53057def169 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Getting quotas for project eb80d14a419d40109d3f51291c1aebe3. Resources: dict_keys(['metadata_items']) {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:44:32.723932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-6f77d114-811b-4f30-8246-f53057def169 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Getting quotas for user d442979ea329492dbb7a3b98142cd97d and project eb80d14a419d40109d3f51291c1aebe3. Resources: dict_keys(['metadata_items']) {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:44:33.119667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fa520c20-1396-4b34-b7c3-8272a6b9a939 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:33.136890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fa520c20-1396-4b34-b7c3-8272a6b9a939 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:33.138587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fa520c20-1396-4b34-b7c3-8272a6b9a939 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:33.144342 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fa520c20-1396-4b34-b7c3-8272a6b9a939 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] 10.222.0.58 "GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef" status: 200 len: 1359 microversion: 2.21 time: 0.705745 May 28 04:44:33.144936 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1286/2683] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:32 2022] GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef => generated 1359 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:33.163883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-da171738-be61-43ed-8d28-6e3856053bdd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:33.166513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-da171738-be61-43ed-8d28-6e3856053bdd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:33.186666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-da171738-be61-43ed-8d28-6e3856053bdd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:33.187752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-da171738-be61-43ed-8d28-6e3856053bdd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:33.189087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-da171738-be61-43ed-8d28-6e3856053bdd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:33.189535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-da171738-be61-43ed-8d28-6e3856053bdd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:33.239806 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6f77d114-811b-4f30-8246-f53057def169 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] 10.222.0.58 "PUT /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.609777 May 28 04:44:33.244400 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1398/2684] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:44:32 2022] PUT /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata => generated 61 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:44:33.246316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-5d52278e-ab33-4a00-9941-dbd2fe95b4cf req-79ae724b-8275-4dd0-8fa2-48556fe70a11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "215a4357-1792-4f6e-ae11-f8574b806b73", "tag": "f007cebf-d19d-420d-891d-de3291249844"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:33.256623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5d52278e-ab33-4a00-9941-dbd2fe95b4cf req-79ae724b-8275-4dd0-8fa2-48556fe70a11 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:33.257076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5d52278e-ab33-4a00-9941-dbd2fe95b4cf req-79ae724b-8275-4dd0-8fa2-48556fe70a11 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:33.270868 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-5d52278e-ab33-4a00-9941-dbd2fe95b4cf req-79ae724b-8275-4dd0-8fa2-48556fe70a11 service nova] Creating event network-changed:f007cebf-d19d-420d-891d-de3291249844 for instance 215a4357-1792-4f6e-ae11-f8574b806b73 on n-h2-843700-1 May 28 04:44:33.276846 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-5d52278e-ab33-4a00-9941-dbd2fe95b4cf req-79ae724b-8275-4dd0-8fa2-48556fe70a11 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034686 May 28 04:44:33.281116 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1399/2685] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:33.287808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dc94cd0b-1593-4334-bf18-9693a32da521 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:33.288525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dc94cd0b-1593-4334-bf18-9693a32da521 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:33.304418 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc94cd0b-1593-4334-bf18-9693a32da521 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:33.305309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc94cd0b-1593-4334-bf18-9693a32da521 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:33.306337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc94cd0b-1593-4334-bf18-9693a32da521 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:33.306934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc94cd0b-1593-4334-bf18-9693a32da521 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:34.251337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dc94cd0b-1593-4334-bf18-9693a32da521 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:34.263177 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dc94cd0b-1593-4334-bf18-9693a32da521 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019" status: 200 len: 1324 microversion: 2.1 time: 0.980648 May 28 04:44:34.264602 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1400/2686] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:33 2022] GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019 => generated 1324 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:34.273104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4d8e328d-b653-491f-ad0c-ad5285152399 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Calling method '.version_select at 0x7f7701bf8670>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:34.336332 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4d8e328d-b653-491f-ad0c-ad5285152399 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] 10.222.0.58 "GET /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.070245 May 28 04:44:34.337049 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1401/2687] 10.222.0.58 () {58 vars in 1289 bytes} [Sat May 28 04:44:34 2022] GET /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata/os_distro => generated 33 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:44:34.351773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-67005b70-46a0-4d9b-b7bf-947fe056aa3e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:34.351773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-67005b70-46a0-4d9b-b7bf-947fe056aa3e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:34.353851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67005b70-46a0-4d9b-b7bf-947fe056aa3e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:34.354426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67005b70-46a0-4d9b-b7bf-947fe056aa3e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:34.355581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67005b70-46a0-4d9b-b7bf-947fe056aa3e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:34.356114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67005b70-46a0-4d9b-b7bf-947fe056aa3e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:34.424797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-da171738-be61-43ed-8d28-6e3856053bdd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:34.445694 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-da171738-be61-43ed-8d28-6e3856053bdd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1551 microversion: 2.1 time: 1.289459 May 28 04:44:34.454303 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1287/2688] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:33 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1551 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:34.487117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c6f48ca8-1d9c-4b1c-9e3b-b599bb1ef3ae tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:34.488038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c6f48ca8-1d9c-4b1c-9e3b-b599bb1ef3ae tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:34.506608 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6f48ca8-1d9c-4b1c-9e3b-b599bb1ef3ae tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:34.507451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6f48ca8-1d9c-4b1c-9e3b-b599bb1ef3ae tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:34.509127 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6f48ca8-1d9c-4b1c-9e3b-b599bb1ef3ae tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:34.509844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6f48ca8-1d9c-4b1c-9e3b-b599bb1ef3ae tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:34.869985 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-67005b70-46a0-4d9b-b7bf-947fe056aa3e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:34.879891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c6f48ca8-1d9c-4b1c-9e3b-b599bb1ef3ae tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:34.881887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-67005b70-46a0-4d9b-b7bf-947fe056aa3e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:34.883923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-67005b70-46a0-4d9b-b7bf-947fe056aa3e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:34.885780 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-67005b70-46a0-4d9b-b7bf-947fe056aa3e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1885 microversion: 2.42 time: 0.547334 May 28 04:44:34.895033 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1402/2689] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:34 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1885 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:34.902040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c6f48ca8-1d9c-4b1c-9e3b-b599bb1ef3ae tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:34.902040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c6f48ca8-1d9c-4b1c-9e3b-b599bb1ef3ae tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:34.902040 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c6f48ca8-1d9c-4b1c-9e3b-b599bb1ef3ae tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1548 microversion: 2.25 time: 0.451463 May 28 04:44:34.902040 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1288/2690] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:34 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1548 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:34.906764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1aa3b4c1-810e-4e10-aea7-63ab64276744 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Action: 'update_all', calling method: .version_select at 0x7f7700d3ae50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:34.911489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-03b662be-de57-4c91-bbe2-43142bf754c2 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:34.912195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-03b662be-de57-4c91-bbe2-43142bf754c2 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] [instance: c74ce99c-676e-4db8-ab9d-3c062a8385ef] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:34.928763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03b662be-de57-4c91-bbe2-43142bf754c2 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:34.938707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03b662be-de57-4c91-bbe2-43142bf754c2 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:34.938707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03b662be-de57-4c91-bbe2-43142bf754c2 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:34.938707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03b662be-de57-4c91-bbe2-43142bf754c2 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:34.968045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-1aa3b4c1-810e-4e10-aea7-63ab64276744 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Getting quotas for project eb80d14a419d40109d3f51291c1aebe3. Resources: dict_keys(['metadata_items']) {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:44:34.971223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-1aa3b4c1-810e-4e10-aea7-63ab64276744 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Getting quotas for user d442979ea329492dbb7a3b98142cd97d and project eb80d14a419d40109d3f51291c1aebe3. Resources: dict_keys(['metadata_items']) {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:44:35.310380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-03b662be-de57-4c91-bbe2-43142bf754c2 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:35.317050 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1aa3b4c1-810e-4e10-aea7-63ab64276744 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] 10.222.0.58 "PUT /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.414334 May 28 04:44:35.317659 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1289/2691] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:44:34 2022] PUT /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata => generated 61 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:44:35.324032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8d95c0c6-bbbe-4b30-be45-df39e4f62738 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:35.324032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8d95c0c6-bbbe-4b30-be45-df39e4f62738 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:35.324278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-03b662be-de57-4c91-bbe2-43142bf754c2 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:35.327759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-03b662be-de57-4c91-bbe2-43142bf754c2 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:35.329138 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-03b662be-de57-4c91-bbe2-43142bf754c2 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] 10.222.0.58 "GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef" status: 200 len: 1551 microversion: 2.21 time: 0.437120 May 28 04:44:35.330205 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1403/2692] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:34 2022] GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef => generated 1551 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:35.336545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d95c0c6-bbbe-4b30-be45-df39e4f62738 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:35.337054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d95c0c6-bbbe-4b30-be45-df39e4f62738 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:35.338014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d95c0c6-bbbe-4b30-be45-df39e4f62738 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:35.338451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d95c0c6-bbbe-4b30-be45-df39e4f62738 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:35.352685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-356cc357-cf31-4832-a711-8402af74d08a req-f72014d4-c8dd-42cd-b98b-48d2066b4c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e00cb82d-ba64-497a-96ba-71fe00f0a019", "name": "network-vif-plugged", "status": "completed", "tag": "7d1f10a0-da4d-41e6-a729-b21d906423a8"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:35.363365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-356cc357-cf31-4832-a711-8402af74d08a req-f72014d4-c8dd-42cd-b98b-48d2066b4c88 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:35.364852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-356cc357-cf31-4832-a711-8402af74d08a req-f72014d4-c8dd-42cd-b98b-48d2066b4c88 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:35.381258 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-356cc357-cf31-4832-a711-8402af74d08a req-f72014d4-c8dd-42cd-b98b-48d2066b4c88 service nova] Creating event network-vif-plugged:7d1f10a0-da4d-41e6-a729-b21d906423a8 for instance e00cb82d-ba64-497a-96ba-71fe00f0a019 on n-h1-843700-1 May 28 04:44:35.386574 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-356cc357-cf31-4832-a711-8402af74d08a req-f72014d4-c8dd-42cd-b98b-48d2066b4c88 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055059 May 28 04:44:35.387442 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1404/2693] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:35.398544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-d8a199bd-27b2-4996-b301-de4707fd4b7b req-dd2c0b8d-b62b-47d0-afa5-2002b54cb995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18cb68a1-94a5-4af2-a376-46e7493e7454", "name": "network-vif-deleted", "tag": "453ca3f5-cda2-4f33-aa1e-444133d83763"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:35.431052 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d8a199bd-27b2-4996-b301-de4707fd4b7b req-dd2c0b8d-b62b-47d0-afa5-2002b54cb995 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:35.448234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d8a199bd-27b2-4996-b301-de4707fd4b7b req-dd2c0b8d-b62b-47d0-afa5-2002b54cb995 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:35.487551 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-d8a199bd-27b2-4996-b301-de4707fd4b7b req-dd2c0b8d-b62b-47d0-afa5-2002b54cb995 service nova] Creating event network-vif-deleted:453ca3f5-cda2-4f33-aa1e-444133d83763 for instance 18cb68a1-94a5-4af2-a376-46e7493e7454 on n-h1-843700-1 May 28 04:44:35.493106 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-d8a199bd-27b2-4996-b301-de4707fd4b7b req-dd2c0b8d-b62b-47d0-afa5-2002b54cb995 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100506 May 28 04:44:35.494000 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1405/2694] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:35.499642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e3f9b7e8-90bd-480e-8ef6-33413e56f4dd tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:35.504121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e3f9b7e8-90bd-480e-8ef6-33413e56f4dd tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:35.508150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3f9b7e8-90bd-480e-8ef6-33413e56f4dd tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:35.508780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3f9b7e8-90bd-480e-8ef6-33413e56f4dd tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:35.509963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3f9b7e8-90bd-480e-8ef6-33413e56f4dd tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:35.510555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3f9b7e8-90bd-480e-8ef6-33413e56f4dd tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:35.663363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8d95c0c6-bbbe-4b30-be45-df39e4f62738 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:35.672212 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8d95c0c6-bbbe-4b30-be45-df39e4f62738 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.353492 May 28 04:44:35.683773 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1290/2695] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:35 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:35.691539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d657cee1-9d89-4ac7-b098-c68ab70bb8a4 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Calling method '.version_select at 0x7f7700d8ff70>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:35.736931 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d657cee1-9d89-4ac7-b098-c68ab70bb8a4 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] 10.222.0.58 "GET /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.051017 May 28 04:44:35.738513 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1291/2696] 10.222.0.58 () {58 vars in 1259 bytes} [Sat May 28 04:44:35 2022] GET /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata => generated 61 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:44:35.748574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-40ed5154-4bd1-4fb2-88b6-1b8cabdf1c63 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:35.749193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-40ed5154-4bd1-4fb2-88b6-1b8cabdf1c63 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] [instance: c74ce99c-676e-4db8-ab9d-3c062a8385ef] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:35.749969 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e3f9b7e8-90bd-480e-8ef6-33413e56f4dd tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:35.756716 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40ed5154-4bd1-4fb2-88b6-1b8cabdf1c63 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:35.759574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40ed5154-4bd1-4fb2-88b6-1b8cabdf1c63 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:35.759574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40ed5154-4bd1-4fb2-88b6-1b8cabdf1c63 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:35.759574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40ed5154-4bd1-4fb2-88b6-1b8cabdf1c63 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:35.766000 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e3f9b7e8-90bd-480e-8ef6-33413e56f4dd tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019" status: 200 len: 1324 microversion: 2.1 time: 0.270564 May 28 04:44:35.767404 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1406/2697] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:35 2022] GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019 => generated 1324 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:35.788699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-40ed5154-4bd1-4fb2-88b6-1b8cabdf1c63 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] [instance: c74ce99c-676e-4db8-ab9d-3c062a8385ef] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:44:35.892170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eb64f7a7-ae7a-4a9c-ad14-5428f7b6331f tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] Calling method '.version_select at 0x7f7700fe8ee0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:35.915021 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-eb64f7a7-ae7a-4a9c-ad14-5428f7b6331f tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] HTTP exception thrown: Image not found. May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eb64f7a7-ae7a-4a9c-ad14-5428f7b6331f tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] Request method failure captured: May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/images/565b33f1-8f2a-4d0a-869a-fe8c33f6d404/metadata/os_distro HTTP/1.1 May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaiz7Tg765W86bhgAWB3ZvUoBja6GUXZFkrQvYl6Y_cZx7S1xmvHbqhN4991fToOkGDGH8w8OMa6qP8k407cUrnrTtbCifF3gyRazQOyCVMvaUKuj8I6UtHiOKE3IbVgjZHkXsyaah5tlZI8l893Fn5_OT4O0KPdiD2yMfeSa4kdLoM May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 474d1d39cd334cbf95c7efd988fafd16 May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1501733228 May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1501733228 May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 474d1d39cd334cbf95c7efd988fafd16 May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1501733228 May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ImagesMetadataNegativeTestJSON-1501733228-project May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: cbe4df5696da46f099f8391d2609eb4d May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1501733228-project May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: exception: Image not found. May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'image_id': '565b33f1-8f2a-4d0a-869a-fe8c33f6d404', 'id': 'os_distro'} May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 565b33f1-8f2a-4d0a-869a-fe8c33f6d404 May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 28 04:44:35.949663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 565b33f1-8f2a-4d0a-869a-fe8c33f6d404 could not be found. May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eb64f7a7-ae7a-4a9c-ad14-5428f7b6331f tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] Returning 404 to user: Image not found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-eb64f7a7-ae7a-4a9c-ad14-5428f7b6331f tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] 10.222.0.58 "DELETE /compute/v2.1/images/565b33f1-8f2a-4d0a-869a-fe8c33f6d404/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.184886 May 28 04:44:35.959883 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1407/2698] 10.222.0.58 () {58 vars in 1292 bytes} [Sat May 28 04:44:35 2022] DELETE /compute/v2.1/images/565b33f1-8f2a-4d0a-869a-fe8c33f6d404/metadata/os_distro => generated 62 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:44:35.978573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f9921411-d39e-489a-ba2e-00abec7ef809 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:35.979329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f9921411-d39e-489a-ba2e-00abec7ef809 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:35.991454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9921411-d39e-489a-ba2e-00abec7ef809 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:35.992139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9921411-d39e-489a-ba2e-00abec7ef809 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:35.993063 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9921411-d39e-489a-ba2e-00abec7ef809 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:35.993741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9921411-d39e-489a-ba2e-00abec7ef809 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:36.106384 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-40ed5154-4bd1-4fb2-88b6-1b8cabdf1c63 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef" status: 204 len: 0 microversion: 2.21 time: 0.361550 May 28 04:44:36.109307 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1292/2699] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:44:35 2022] DELETE /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:44:36.115427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f5d7001e-3e1d-4844-8b15-bf2d37d4c327 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Action: 'update_all', calling method: .version_select at 0x7f7700d62820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:36.173678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-f5d7001e-3e1d-4844-8b15-bf2d37d4c327 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Getting quotas for project eb80d14a419d40109d3f51291c1aebe3. Resources: dict_keys(['metadata_items']) {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:44:36.182044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-f5d7001e-3e1d-4844-8b15-bf2d37d4c327 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Getting quotas for user d442979ea329492dbb7a3b98142cd97d and project eb80d14a419d40109d3f51291c1aebe3. Resources: dict_keys(['metadata_items']) {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:44:36.188520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f9921411-d39e-489a-ba2e-00abec7ef809 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:36.196658 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f9921411-d39e-489a-ba2e-00abec7ef809 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.240433 May 28 04:44:36.197420 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1408/2700] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:35 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:36.211280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-230afa42-6fd4-4751-b39b-43b6e318bd50 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:36.212892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-230afa42-6fd4-4751-b39b-43b6e318bd50 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:36.219582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-230afa42-6fd4-4751-b39b-43b6e318bd50 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:36.220265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-230afa42-6fd4-4751-b39b-43b6e318bd50 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:36.223332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-230afa42-6fd4-4751-b39b-43b6e318bd50 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:36.224120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-230afa42-6fd4-4751-b39b-43b6e318bd50 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:36.434978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-230afa42-6fd4-4751-b39b-43b6e318bd50 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:36.445639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-230afa42-6fd4-4751-b39b-43b6e318bd50 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:36.448239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-230afa42-6fd4-4751-b39b-43b6e318bd50 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:36.450950 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-230afa42-6fd4-4751-b39b-43b6e318bd50 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1885 microversion: 2.42 time: 0.252433 May 28 04:44:36.451763 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1409/2701] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:36 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1885 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:36.457709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-541bc9ff-2308-4fd7-80d9-7c11fe8e4fce tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:36.458586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-541bc9ff-2308-4fd7-80d9-7c11fe8e4fce tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:36.465239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-541bc9ff-2308-4fd7-80d9-7c11fe8e4fce tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:36.465953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-541bc9ff-2308-4fd7-80d9-7c11fe8e4fce tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:36.466964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-541bc9ff-2308-4fd7-80d9-7c11fe8e4fce tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:36.467896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-541bc9ff-2308-4fd7-80d9-7c11fe8e4fce tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:36.473011 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f5d7001e-3e1d-4844-8b15-bf2d37d4c327 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] 10.222.0.58 "PUT /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.364610 May 28 04:44:36.473625 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1293/2702] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:44:36 2022] PUT /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata => generated 61 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:44:36.478824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-391b64e9-695e-44a1-9694-ffd64113fc2d tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] Calling method '.version_select at 0x7f7700d3a820>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:36.504186 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-391b64e9-695e-44a1-9694-ffd64113fc2d tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] HTTP exception thrown: Image not found. May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-391b64e9-695e-44a1-9694-ffd64113fc2d tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] Request method failure captured: May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/images/8f0c1fb0-0adf-4d24-9575-4275ff590c8a/metadata/os_version HTTP/1.1 May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaiz7Tg765W86bhgAWB3ZvUoBja6GUXZFkrQvYl6Y_cZx7S1xmvHbqhN4991fToOkGDGH8w8OMa6qP8k407cUrnrTtbCifF3gyRazQOyCVMvaUKuj8I6UtHiOKE3IbVgjZHkXsyaah5tlZI8l893Fn5_OT4O0KPdiD2yMfeSa4kdLoM May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 474d1d39cd334cbf95c7efd988fafd16 May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1501733228 May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1501733228 May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 474d1d39cd334cbf95c7efd988fafd16 May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1501733228 May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesMetadataNegativeTestJSON-1501733228-project May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: cbe4df5696da46f099f8391d2609eb4d May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1501733228-project May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: exception: Image not found. May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'image_id': '8f0c1fb0-0adf-4d24-9575-4275ff590c8a', 'id': 'os_version'} May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8f0c1fb0-0adf-4d24-9575-4275ff590c8a May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 28 04:44:36.509673 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8f0c1fb0-0adf-4d24-9575-4275ff590c8a could not be found. May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:36.512876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-391b64e9-695e-44a1-9694-ffd64113fc2d tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] Returning 404 to user: Image not found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:36.515187 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-391b64e9-695e-44a1-9694-ffd64113fc2d tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] 10.222.0.58 "GET /compute/v2.1/images/8f0c1fb0-0adf-4d24-9575-4275ff590c8a/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.039156 May 28 04:44:36.520102 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1294/2703] 10.222.0.58 () {58 vars in 1292 bytes} [Sat May 28 04:44:36 2022] GET /compute/v2.1/images/8f0c1fb0-0adf-4d24-9575-4275ff590c8a/metadata/os_version => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:44:36.527117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a2cd8c0e-7275-4ce5-9872-340ff519ef1d tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:36.527275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-541bc9ff-2308-4fd7-80d9-7c11fe8e4fce tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:36.527688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-541bc9ff-2308-4fd7-80d9-7c11fe8e4fce tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:36.528143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-541bc9ff-2308-4fd7-80d9-7c11fe8e4fce tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lazy-loading 'fault' on Instance uuid 18cb68a1-94a5-4af2-a376-46e7493e7454 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:44:36.529089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a2cd8c0e-7275-4ce5-9872-340ff519ef1d tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] [instance: c74ce99c-676e-4db8-ab9d-3c062a8385ef] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:36.536645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2cd8c0e-7275-4ce5-9872-340ff519ef1d tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:36.537239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2cd8c0e-7275-4ce5-9872-340ff519ef1d tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:36.538121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2cd8c0e-7275-4ce5-9872-340ff519ef1d tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:36.539083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2cd8c0e-7275-4ce5-9872-340ff519ef1d tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:36.577240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-541bc9ff-2308-4fd7-80d9-7c11fe8e4fce tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:36.586029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-541bc9ff-2308-4fd7-80d9-7c11fe8e4fce tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:36.588224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-541bc9ff-2308-4fd7-80d9-7c11fe8e4fce tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:36.589587 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-541bc9ff-2308-4fd7-80d9-7c11fe8e4fce tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 200 len: 1351 microversion: 2.25 time: 0.136453 May 28 04:44:36.590336 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1410/2704] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:36 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 1351 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:36.604691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e20b5575-7dc8-4386-9494-7d3508d1c000 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1365653"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:36.606079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e20b5575-7dc8-4386-9494-7d3508d1c000 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:36.615637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e20b5575-7dc8-4386-9494-7d3508d1c000 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:36.616423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e20b5575-7dc8-4386-9494-7d3508d1c000 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:36.619140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e20b5575-7dc8-4386-9494-7d3508d1c000 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:36.619140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e20b5575-7dc8-4386-9494-7d3508d1c000 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:36.663019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:44:36.709422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a2cd8c0e-7275-4ce5-9872-340ff519ef1d tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:36.718861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a2cd8c0e-7275-4ce5-9872-340ff519ef1d tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:36.722309 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a2cd8c0e-7275-4ce5-9872-340ff519ef1d tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:36.722309 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a2cd8c0e-7275-4ce5-9872-340ff519ef1d tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] 10.222.0.58 "GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef" status: 200 len: 1557 microversion: 2.21 time: 0.200914 May 28 04:44:36.734032 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1295/2705] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:36 2022] GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef => generated 1557 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:36.740161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-735a1f8b-e11d-43c9-9205-c1231687fe20 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Action: 'update_all', calling method: .version_select at 0x7f7700d3adc0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:36.792763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-735a1f8b-e11d-43c9-9205-c1231687fe20 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Getting quotas for project eb80d14a419d40109d3f51291c1aebe3. Resources: dict_keys(['metadata_items']) {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:44:36.798222 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-735a1f8b-e11d-43c9-9205-c1231687fe20 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Getting quotas for user d442979ea329492dbb7a3b98142cd97d and project eb80d14a419d40109d3f51291c1aebe3. Resources: dict_keys(['metadata_items']) {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:44:37.225949 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-735a1f8b-e11d-43c9-9205-c1231687fe20 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] 10.222.0.58 "PUT /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.490628 May 28 04:44:37.226558 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1296/2706] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:44:36 2022] PUT /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata => generated 64 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:44:37.231399 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d29895e8-782c-4b32-870d-114323bdeecc tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] Calling method '.version_select at 0x7f7700c9d790>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:37.254044 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-d29895e8-782c-4b32-870d-114323bdeecc tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] HTTP exception thrown: Image not found. May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d29895e8-782c-4b32-870d-114323bdeecc tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] Request method failure captured: May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/images/882b69e8-244e-4173-b81d-6a4978757726/metadata HTTP/1.1 May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaiz7Tg765W86bhgAWB3ZvUoBja6GUXZFkrQvYl6Y_cZx7S1xmvHbqhN4991fToOkGDGH8w8OMa6qP8k407cUrnrTtbCifF3gyRazQOyCVMvaUKuj8I6UtHiOKE3IbVgjZHkXsyaah5tlZI8l893Fn5_OT4O0KPdiD2yMfeSa4kdLoM May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 474d1d39cd334cbf95c7efd988fafd16 May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1501733228 May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1501733228 May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 474d1d39cd334cbf95c7efd988fafd16 May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1501733228 May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesMetadataNegativeTestJSON-1501733228-project May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: cbe4df5696da46f099f8391d2609eb4d May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1501733228-project May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: exception: Image not found. May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'image_id': '882b69e8-244e-4173-b81d-6a4978757726'} May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 882b69e8-244e-4173-b81d-6a4978757726 May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 28 04:44:37.257006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 882b69e8-244e-4173-b81d-6a4978757726 could not be found. May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d29895e8-782c-4b32-870d-114323bdeecc tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] Returning 404 to user: Image not found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d29895e8-782c-4b32-870d-114323bdeecc tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] 10.222.0.58 "GET /compute/v2.1/images/882b69e8-244e-4173-b81d-6a4978757726/metadata" status: 404 len: 62 microversion: 2.1 time: 0.031087 May 28 04:44:37.260993 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1297/2707] 10.222.0.58 () {58 vars in 1259 bytes} [Sat May 28 04:44:37 2022] GET /compute/v2.1/images/882b69e8-244e-4173-b81d-6a4978757726/metadata => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:44:37.264126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5e3f569c-c7c8-4cbc-9657-ef21cdbe3e0d tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:37.264752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5e3f569c-c7c8-4cbc-9657-ef21cdbe3e0d tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:37.280693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e3f569c-c7c8-4cbc-9657-ef21cdbe3e0d tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:37.284128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e3f569c-c7c8-4cbc-9657-ef21cdbe3e0d tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:37.284128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e3f569c-c7c8-4cbc-9657-ef21cdbe3e0d tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:37.284128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e3f569c-c7c8-4cbc-9657-ef21cdbe3e0d tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:37.366776 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e20b5575-7dc8-4386-9494-7d3508d1c000 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action" status: 202 len: 0 microversion: 2.1 time: 0.766985 May 28 04:44:37.367785 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1411/2708] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:44:36 2022] POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action => generated 0 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 28 04:44:37.381557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6aa478f6-a7ab-469f-b820-a3352e452255 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Calling method '.version_select at 0x7f7700f59ee0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:37.434653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5e3f569c-c7c8-4cbc-9657-ef21cdbe3e0d tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:37.448150 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5e3f569c-c7c8-4cbc-9657-ef21cdbe3e0d tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019" status: 200 len: 1324 microversion: 2.1 time: 0.183507 May 28 04:44:37.448150 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1298/2709] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:37 2022] GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019 => generated 1324 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:37.449075 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0ecbc72e-bdca-41fb-8bbd-a93d93763b4e tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] Action: 'update_all', calling method: .version_select at 0x7f770740a790>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:37.456685 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6aa478f6-a7ab-469f-b820-a3352e452255 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] 10.222.0.58 "GET /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.087125 May 28 04:44:37.459054 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1412/2710] 10.222.0.58 () {58 vars in 1259 bytes} [Sat May 28 04:44:37 2022] GET /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata => generated 64 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:44:37.469195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d038cbe3-c426-43c4-8008-ee499f71c12c tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Action: 'update_all', calling method: .version_select at 0x7f7700f594c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:37.483313 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-0ecbc72e-bdca-41fb-8bbd-a93d93763b4e tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] HTTP exception thrown: Image not found. May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0ecbc72e-bdca-41fb-8bbd-a93d93763b4e tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] Request method failure captured: May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: request: PUT /compute/v2.1/images/a68ff022-f14b-4412-8798-a786b0e6238f/metadata HTTP/1.1 May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 57 May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaiz7Tg765W86bhgAWB3ZvUoBja6GUXZFkrQvYl6Y_cZx7S1xmvHbqhN4991fToOkGDGH8w8OMa6qP8k407cUrnrTtbCifF3gyRazQOyCVMvaUKuj8I6UtHiOKE3IbVgjZHkXsyaah5tlZI8l893Fn5_OT4O0KPdiD2yMfeSa4kdLoM May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 474d1d39cd334cbf95c7efd988fafd16 May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1501733228 May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1501733228 May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 474d1d39cd334cbf95c7efd988fafd16 May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1501733228 May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesMetadataNegativeTestJSON-1501733228-project May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: cbe4df5696da46f099f8391d2609eb4d May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1501733228-project May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: exception: Image not found. May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'image_id': 'a68ff022-f14b-4412-8798-a786b0e6238f', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a68ff022-f14b-4412-8798-a786b0e6238f May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 28 04:44:37.487225 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a68ff022-f14b-4412-8798-a786b0e6238f could not be found. May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:44:37.490619 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:37.496888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0ecbc72e-bdca-41fb-8bbd-a93d93763b4e tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] Returning 404 to user: Image not found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:37.496888 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0ecbc72e-bdca-41fb-8bbd-a93d93763b4e tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] 10.222.0.58 "PUT /compute/v2.1/images/a68ff022-f14b-4412-8798-a786b0e6238f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.048013 May 28 04:44:37.496888 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1299/2711] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:44:37 2022] PUT /compute/v2.1/images/a68ff022-f14b-4412-8798-a786b0e6238f/metadata => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:44:37.502837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1035ae8a-6d78-4bc7-80cb-16948471d80a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:37.503437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1035ae8a-6d78-4bc7-80cb-16948471d80a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:37.515755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1035ae8a-6d78-4bc7-80cb-16948471d80a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:37.517088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1035ae8a-6d78-4bc7-80cb-16948471d80a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:37.518845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1035ae8a-6d78-4bc7-80cb-16948471d80a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:37.519889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1035ae8a-6d78-4bc7-80cb-16948471d80a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:37.526789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-d038cbe3-c426-43c4-8008-ee499f71c12c tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Getting quotas for project eb80d14a419d40109d3f51291c1aebe3. Resources: dict_keys(['metadata_items']) {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:44:37.532911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-d038cbe3-c426-43c4-8008-ee499f71c12c tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Getting quotas for user d442979ea329492dbb7a3b98142cd97d and project eb80d14a419d40109d3f51291c1aebe3. Resources: dict_keys(['metadata_items']) {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:44:37.941752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1035ae8a-6d78-4bc7-80cb-16948471d80a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:37.959679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1035ae8a-6d78-4bc7-80cb-16948471d80a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:37.961473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1035ae8a-6d78-4bc7-80cb-16948471d80a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:37.963290 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1035ae8a-6d78-4bc7-80cb-16948471d80a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1885 microversion: 2.42 time: 0.468166 May 28 04:44:37.976154 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1300/2712] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:37 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1885 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:37.981267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-700b4aca-add3-4dce-b2df-1820ad5551ac tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] Action: 'update', calling method: .version_select at 0x7f7700d8f5e0>, body: {"meta": {"os_distro": "alt"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:38.022343 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-700b4aca-add3-4dce-b2df-1820ad5551ac tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] HTTP exception thrown: Image not found. May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-700b4aca-add3-4dce-b2df-1820ad5551ac tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] Request method failure captured: May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: request: PUT /compute/v2.1/images/02d6be89-bbad-4659-a510-b36ca3533a74/metadata/os_distro HTTP/1.1 May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 30 May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaiz7Tg765W86bhgAWB3ZvUoBja6GUXZFkrQvYl6Y_cZx7S1xmvHbqhN4991fToOkGDGH8w8OMa6qP8k407cUrnrTtbCifF3gyRazQOyCVMvaUKuj8I6UtHiOKE3IbVgjZHkXsyaah5tlZI8l893Fn5_OT4O0KPdiD2yMfeSa4kdLoM May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 474d1d39cd334cbf95c7efd988fafd16 May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1501733228 May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1501733228 May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 474d1d39cd334cbf95c7efd988fafd16 May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1501733228 May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesMetadataNegativeTestJSON-1501733228-project May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: cbe4df5696da46f099f8391d2609eb4d May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1501733228-project May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: {"meta": {"os_distro": "alt"}} May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: exception: Image not found. May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'image_id': '02d6be89-bbad-4659-a510-b36ca3533a74', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 02d6be89-bbad-4659-a510-b36ca3533a74 May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 28 04:44:38.026844 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 02d6be89-bbad-4659-a510-b36ca3533a74 could not be found. May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:44:38.030332 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:38.034980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-700b4aca-add3-4dce-b2df-1820ad5551ac tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] Returning 404 to user: Image not found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:38.035613 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-700b4aca-add3-4dce-b2df-1820ad5551ac tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] 10.222.0.58 "PUT /compute/v2.1/images/02d6be89-bbad-4659-a510-b36ca3533a74/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.058323 May 28 04:44:38.042329 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1301/2713] 10.222.0.58 () {60 vars in 1309 bytes} [Sat May 28 04:44:37 2022] PUT /compute/v2.1/images/02d6be89-bbad-4659-a510-b36ca3533a74/metadata/os_distro => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:44:38.048184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-83732cb4-405a-4025-831d-1145a224d80b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:38.048982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-83732cb4-405a-4025-831d-1145a224d80b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: 18cb68a1-94a5-4af2-a376-46e7493e7454] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:38.065621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-83732cb4-405a-4025-831d-1145a224d80b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:38.066338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-83732cb4-405a-4025-831d-1145a224d80b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:38.067553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-83732cb4-405a-4025-831d-1145a224d80b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:38.068366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-83732cb4-405a-4025-831d-1145a224d80b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:38.100211 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d038cbe3-c426-43c4-8008-ee499f71c12c tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] 10.222.0.58 "PUT /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.634720 May 28 04:44:38.101227 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1413/2714] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:44:37 2022] PUT /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata => generated 61 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 04:44:38.115025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0448fbee-0c43-4521-81d6-58b30a1be067 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:38.115373 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-83732cb4-405a-4025-831d-1145a224d80b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] HTTP exception thrown: Instance 18cb68a1-94a5-4af2-a376-46e7493e7454 could not be found. May 28 04:44:38.115847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0448fbee-0c43-4521-81d6-58b30a1be067 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] [instance: c74ce99c-676e-4db8-ab9d-3c062a8385ef] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-83732cb4-405a-4025-831d-1145a224d80b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Request method failure captured: May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 HTTP/1.1 May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaa2z-mBC0Oqm9jSGg-o-K9zDEQfRKobRjEoonU0ns2YIeP-M7nIyd9FMtfufCiPXUpBFAXsdoE2GDbhmek38feXoiu1nkWEvJf4zUN3sHLUVl8rxo58WUYGAE6Ok0ye9isbgcQYaNdZ1NKU8RsK3oUctPhk5wtwAWoeRvkT_CCcR1o May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-Openstack-Nova-Api-Version: 2.25 May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 99f14746bfbc460eb4a21e7eb567de46 May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-678063580 May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_99f14746bfbc460eb4a21e7eb567de46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/99f14746bfbc460eb4a21e7eb567de46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/99f14746bfbc460eb4a21e7eb567de46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/99f14746bfbc460eb4a21e7eb567de46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-678063580 May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 99f14746bfbc460eb4a21e7eb567de46 May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-678063580 May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-LiveAutoBlockMigrationV225Test-678063580-project May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: ed90faaaee584c3a8d1385b8d873d12d May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-678063580-project May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 18cb68a1-94a5-4af2-a376-46e7493e7454 could not be found. May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '18cb68a1-94a5-4af2-a376-46e7493e7454'} May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18cb68a1-94a5-4af2-a376-46e7493e7454 could not be found. May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18cb68a1-94a5-4af2-a376-46e7493e7454 could not be found. May 28 04:44:38.116940 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:38.121080 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:38.121080 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:38.121080 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:38.121080 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:38.121080 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:38.121080 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:44:38.121080 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:44:38.121080 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18cb68a1-94a5-4af2-a376-46e7493e7454 could not be found. May 28 04:44:38.121080 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:38.126614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-83732cb4-405a-4025-831d-1145a224d80b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Returning 404 to user: Instance 18cb68a1-94a5-4af2-a376-46e7493e7454 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:38.127666 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-83732cb4-405a-4025-831d-1145a224d80b tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454" status: 404 len: 111 microversion: 2.25 time: 0.090406 May 28 04:44:38.128236 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1302/2715] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:38 2022] GET /compute/v2.1/servers/18cb68a1-94a5-4af2-a376-46e7493e7454 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 04:44:38.129880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0448fbee-0c43-4521-81d6-58b30a1be067 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:38.132818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0448fbee-0c43-4521-81d6-58b30a1be067 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:38.134725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0448fbee-0c43-4521-81d6-58b30a1be067 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:38.136890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0448fbee-0c43-4521-81d6-58b30a1be067 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:38.140603 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3bb0e76a-c76c-48d1-8a5d-b180766fdfac tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] Action: 'create', calling method: .version_select at 0x7f7700d8f5e0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:38.186878 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-3bb0e76a-c76c-48d1-8a5d-b180766fdfac tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] HTTP exception thrown: Image not found. May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3bb0e76a-c76c-48d1-8a5d-b180766fdfac tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] Request method failure captured: May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/images/33113e23-4bbb-4c77-89fd-d8096f6d6362/metadata HTTP/1.1 May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 57 May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaiz7Tg765W86bhgAWB3ZvUoBja6GUXZFkrQvYl6Y_cZx7S1xmvHbqhN4991fToOkGDGH8w8OMa6qP8k407cUrnrTtbCifF3gyRazQOyCVMvaUKuj8I6UtHiOKE3IbVgjZHkXsyaah5tlZI8l893Fn5_OT4O0KPdiD2yMfeSa4kdLoM May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 474d1d39cd334cbf95c7efd988fafd16 May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1501733228 May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/474d1d39cd334cbf95c7efd988fafd16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1501733228 May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 474d1d39cd334cbf95c7efd988fafd16 May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1501733228 May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesMetadataNegativeTestJSON-1501733228-project May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: cbe4df5696da46f099f8391d2609eb4d May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1501733228-project May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: exception: Image not found. May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'image_id': '33113e23-4bbb-4c77-89fd-d8096f6d6362', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 33113e23-4bbb-4c77-89fd-d8096f6d6362 May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 28 04:44:38.189077 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 33113e23-4bbb-4c77-89fd-d8096f6d6362 could not be found. May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3bb0e76a-c76c-48d1-8a5d-b180766fdfac tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] Returning 404 to user: Image not found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3bb0e76a-c76c-48d1-8a5d-b180766fdfac tempest-ImagesMetadataNegativeTestJSON-1501733228 tempest-ImagesMetadataNegativeTestJSON-1501733228-project] 10.222.0.58 "POST /compute/v2.1/images/33113e23-4bbb-4c77-89fd-d8096f6d6362/metadata" status: 404 len: 62 microversion: 2.1 time: 0.060090 May 28 04:44:38.193905 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1303/2716] 10.222.0.58 () {60 vars in 1280 bytes} [Sat May 28 04:44:38 2022] POST /compute/v2.1/images/33113e23-4bbb-4c77-89fd-d8096f6d6362/metadata => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:44:38.200260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-13a8d8e8-12f8-436d-8077-ec0c11bc9232 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Action: 'update', calling method: .version_select at 0x7f7700d62f70>, body: {"meta": {"os_version": "alt"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:38.273958 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-13a8d8e8-12f8-436d-8077-ec0c11bc9232 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Getting quotas for project eb80d14a419d40109d3f51291c1aebe3. Resources: dict_keys(['metadata_items']) {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:44:38.280823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:44:38.290517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-13a8d8e8-12f8-436d-8077-ec0c11bc9232 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Getting quotas for user d442979ea329492dbb7a3b98142cd97d and project eb80d14a419d40109d3f51291c1aebe3. Resources: dict_keys(['metadata_items']) {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:44:38.375665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0448fbee-0c43-4521-81d6-58b30a1be067 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:38.393445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0448fbee-0c43-4521-81d6-58b30a1be067 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:38.400963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0448fbee-0c43-4521-81d6-58b30a1be067 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:38.404237 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0448fbee-0c43-4521-81d6-58b30a1be067 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] 10.222.0.58 "GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef" status: 200 len: 1557 microversion: 2.21 time: 0.294153 May 28 04:44:38.409194 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1414/2717] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:38 2022] GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef => generated 1557 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:38.415370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-46a0d462-b9f3-43c5-bb89-a1be464b28ee tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:38.416077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-46a0d462-b9f3-43c5-bb89-a1be464b28ee tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:38.433037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-46a0d462-b9f3-43c5-bb89-a1be464b28ee tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:38.433812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-46a0d462-b9f3-43c5-bb89-a1be464b28ee tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:38.434810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-46a0d462-b9f3-43c5-bb89-a1be464b28ee tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:38.435612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-46a0d462-b9f3-43c5-bb89-a1be464b28ee tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:38.492061 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-46a0d462-b9f3-43c5-bb89-a1be464b28ee tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:44:39.022371 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-46a0d462-b9f3-43c5-bb89-a1be464b28ee tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 204 len: 0 microversion: 2.25 time: 0.611094 May 28 04:44:39.023543 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1415/2718] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:44:38 2022] DELETE /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:44:39.030561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4fddbd7a-94c0-4615-b2f3-1895a5287f40 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:39.031532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4fddbd7a-94c0-4615-b2f3-1895a5287f40 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:39.040407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fddbd7a-94c0-4615-b2f3-1895a5287f40 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:39.041135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fddbd7a-94c0-4615-b2f3-1895a5287f40 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:39.042430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fddbd7a-94c0-4615-b2f3-1895a5287f40 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:39.043565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fddbd7a-94c0-4615-b2f3-1895a5287f40 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:39.166003 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-13a8d8e8-12f8-436d-8077-ec0c11bc9232 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] 10.222.0.58 "PUT /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.972340 May 28 04:44:39.167206 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1304/2719] 10.222.0.58 () {60 vars in 1312 bytes} [Sat May 28 04:44:38 2022] PUT /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata/os_version => generated 31 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:44:39.172105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-d0fed78c-f02e-4518-8bbf-9981572d98ee req-5f47429a-c478-4914-88c6-bb83d122d9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74ce99c-676e-4db8-ab9d-3c062a8385ef", "name": "network-vif-deleted", "tag": "d2d8f772-0501-4c65-a224-b7bee48d41ad"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:39.181265 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d0fed78c-f02e-4518-8bbf-9981572d98ee req-5f47429a-c478-4914-88c6-bb83d122d9f6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:39.181928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d0fed78c-f02e-4518-8bbf-9981572d98ee req-5f47429a-c478-4914-88c6-bb83d122d9f6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:39.193233 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-d0fed78c-f02e-4518-8bbf-9981572d98ee req-5f47429a-c478-4914-88c6-bb83d122d9f6 service nova] Creating event network-vif-deleted:d2d8f772-0501-4c65-a224-b7bee48d41ad for instance c74ce99c-676e-4db8-ab9d-3c062a8385ef on n-h1-843700-1 May 28 04:44:39.198688 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-d0fed78c-f02e-4518-8bbf-9981572d98ee req-5f47429a-c478-4914-88c6-bb83d122d9f6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030143 May 28 04:44:39.199461 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1305/2720] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:39.205185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-24761a81-71cd-467e-afe6-bea452ae7ff9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:39.205706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-24761a81-71cd-467e-afe6-bea452ae7ff9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:39.212015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24761a81-71cd-467e-afe6-bea452ae7ff9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:39.212662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24761a81-71cd-467e-afe6-bea452ae7ff9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:39.213573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24761a81-71cd-467e-afe6-bea452ae7ff9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:39.214153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24761a81-71cd-467e-afe6-bea452ae7ff9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:39.332947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4fddbd7a-94c0-4615-b2f3-1895a5287f40 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:39.342002 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4fddbd7a-94c0-4615-b2f3-1895a5287f40 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019" status: 200 len: 1519 microversion: 2.1 time: 0.316933 May 28 04:44:39.342634 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1416/2721] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:39 2022] GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019 => generated 1519 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:39.360405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8fae32d1-dbe4-40c9-a652-bdbab0dfc2e7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:39.365309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8fae32d1-dbe4-40c9-a652-bdbab0dfc2e7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:39.368405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8fae32d1-dbe4-40c9-a652-bdbab0dfc2e7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:39.369542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8fae32d1-dbe4-40c9-a652-bdbab0dfc2e7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:39.370520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8fae32d1-dbe4-40c9-a652-bdbab0dfc2e7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:39.371162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8fae32d1-dbe4-40c9-a652-bdbab0dfc2e7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:39.507373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-24761a81-71cd-467e-afe6-bea452ae7ff9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:39.518115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-24761a81-71cd-467e-afe6-bea452ae7ff9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:39.519699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-24761a81-71cd-467e-afe6-bea452ae7ff9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:39.520911 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-24761a81-71cd-467e-afe6-bea452ae7ff9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1885 microversion: 2.42 time: 0.320245 May 28 04:44:39.529344 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1306/2722] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:39 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1885 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:39.547829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3612ba8b-3d22-49bb-b72d-057759692923 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Calling method '.version_select at 0x7f7700dc8dc0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:39.612359 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3612ba8b-3d22-49bb-b72d-057759692923 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] 10.222.0.58 "GET /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata" status: 200 len: 58 microversion: 2.1 time: 0.081113 May 28 04:44:39.613428 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1307/2723] 10.222.0.58 () {58 vars in 1259 bytes} [Sat May 28 04:44:39 2022] GET /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata => generated 58 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:44:39.619994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d3301e46-cf2e-48c3-84cb-3382a344a56f tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Action: 'action', calling method: .version_select at 0x7f77045164c0>, body: {"addFloatingIp": {"address": "172.25.2.43"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:39.621797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d3301e46-cf2e-48c3-84cb-3382a344a56f tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:39.623164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8fae32d1-dbe4-40c9-a652-bdbab0dfc2e7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:39.632321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8fae32d1-dbe4-40c9-a652-bdbab0dfc2e7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:39.639033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3301e46-cf2e-48c3-84cb-3382a344a56f tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:39.639033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3301e46-cf2e-48c3-84cb-3382a344a56f tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:39.639033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3301e46-cf2e-48c3-84cb-3382a344a56f tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:39.639033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3301e46-cf2e-48c3-84cb-3382a344a56f tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:39.639448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8fae32d1-dbe4-40c9-a652-bdbab0dfc2e7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:39.644452 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8fae32d1-dbe4-40c9-a652-bdbab0dfc2e7 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1563 microversion: 2.25 time: 0.288511 May 28 04:44:39.645057 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1417/2724] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:39 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1563 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:39.652189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-502157c7-f951-4036-a81c-aca96f59454c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:39.652784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-502157c7-f951-4036-a81c-aca96f59454c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] [instance: c74ce99c-676e-4db8-ab9d-3c062a8385ef] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:39.679373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-502157c7-f951-4036-a81c-aca96f59454c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:39.680295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-502157c7-f951-4036-a81c-aca96f59454c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:39.680619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-502157c7-f951-4036-a81c-aca96f59454c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:39.681060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-502157c7-f951-4036-a81c-aca96f59454c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:39.726803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-502157c7-f951-4036-a81c-aca96f59454c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:39.728570 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-502157c7-f951-4036-a81c-aca96f59454c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:39.729662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-502157c7-f951-4036-a81c-aca96f59454c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lazy-loading 'fault' on Instance uuid c74ce99c-676e-4db8-ab9d-3c062a8385ef {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:44:39.733733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:44:39.805269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3301e46-cf2e-48c3-84cb-3382a344a56f tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Acquired lock "refresh_cache-73298cda-5cfb-45df-8914-2c76ac9cc70d" {{(pid=126043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 04:44:39.808069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-502157c7-f951-4036-a81c-aca96f59454c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:39.816637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-502157c7-f951-4036-a81c-aca96f59454c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:39.833886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-502157c7-f951-4036-a81c-aca96f59454c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '861f3ef8d2f84fe097697218cf3f46a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73d1a2ff6564a9bb369414fc35461d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:39.835742 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-502157c7-f951-4036-a81c-aca96f59454c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] 10.222.0.58 "GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef" status: 200 len: 1349 microversion: 2.21 time: 0.189593 May 28 04:44:39.837903 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1418/2725] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:39 2022] GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef => generated 1349 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:39.857594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-22aa793a-21b2-4162-985b-341dfc06ae9b tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Action: 'update_all', calling method: .version_select at 0x7f7700fefa60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:39.929609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-22aa793a-21b2-4162-985b-341dfc06ae9b tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Getting quotas for project eb80d14a419d40109d3f51291c1aebe3. Resources: dict_keys(['metadata_items']) {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:44:39.935333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-22aa793a-21b2-4162-985b-341dfc06ae9b tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Getting quotas for user d442979ea329492dbb7a3b98142cd97d and project eb80d14a419d40109d3f51291c1aebe3. Resources: dict_keys(['metadata_items']) {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:44:40.445450 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-22aa793a-21b2-4162-985b-341dfc06ae9b tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] 10.222.0.58 "PUT /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.605105 May 28 04:44:40.446445 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1419/2726] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:44:39 2022] PUT /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata => generated 61 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:44:40.458340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7a41315c-67f1-428f-aa76-4daa18b8aa36 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Action: 'create', calling method: .version_select at 0x7f77073ae670>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:40.530385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-7a41315c-67f1-428f-aa76-4daa18b8aa36 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Getting quotas for project eb80d14a419d40109d3f51291c1aebe3. Resources: dict_keys(['metadata_items']) {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:44:40.536208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-7a41315c-67f1-428f-aa76-4daa18b8aa36 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Getting quotas for user d442979ea329492dbb7a3b98142cd97d and project eb80d14a419d40109d3f51291c1aebe3. Resources: dict_keys(['metadata_items']) {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:44:41.032343 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7a41315c-67f1-428f-aa76-4daa18b8aa36 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] 10.222.0.58 "POST /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.580600 May 28 04:44:41.032952 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1420/2727] 10.222.0.58 () {60 vars in 1280 bytes} [Sat May 28 04:44:40 2022] POST /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata => generated 85 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:44:41.038602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-95923476-303a-427b-af1c-52ad24ff8cc1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:41.039422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-95923476-303a-427b-af1c-52ad24ff8cc1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:41.046952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-95923476-303a-427b-af1c-52ad24ff8cc1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:41.047685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-95923476-303a-427b-af1c-52ad24ff8cc1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:41.048671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-95923476-303a-427b-af1c-52ad24ff8cc1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:41.049839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-95923476-303a-427b-af1c-52ad24ff8cc1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:41.448342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-95923476-303a-427b-af1c-52ad24ff8cc1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:41.460064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-95923476-303a-427b-af1c-52ad24ff8cc1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:41.461580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-95923476-303a-427b-af1c-52ad24ff8cc1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:41.462747 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-95923476-303a-427b-af1c-52ad24ff8cc1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1873 microversion: 2.42 time: 0.428706 May 28 04:44:41.463346 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1421/2728] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:41 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1873 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:41.469218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-36897a72-f34f-4a3d-9382-d8ab37181cb6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:41.470044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-36897a72-f34f-4a3d-9382-d8ab37181cb6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:41.472647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:44:41.478005 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36897a72-f34f-4a3d-9382-d8ab37181cb6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:41.479252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36897a72-f34f-4a3d-9382-d8ab37181cb6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:41.480299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36897a72-f34f-4a3d-9382-d8ab37181cb6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:41.480938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36897a72-f34f-4a3d-9382-d8ab37181cb6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:41.573239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-36897a72-f34f-4a3d-9382-d8ab37181cb6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:41.582049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-36897a72-f34f-4a3d-9382-d8ab37181cb6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:41.583578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-36897a72-f34f-4a3d-9382-d8ab37181cb6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed90faaaee584c3a8d1385b8d873d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f14746bfbc460eb4a21e7eb567de46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:41.584735 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-36897a72-f34f-4a3d-9382-d8ab37181cb6 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 200 len: 1521 microversion: 2.25 time: 0.119223 May 28 04:44:41.585710 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1422/2729] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:41 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 1521 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:41.590527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-53c739c0-833c-4019-a405-35cb34a2b7eb tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:41.592806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-53c739c0-833c-4019-a405-35cb34a2b7eb tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] [instance: c74ce99c-676e-4db8-ab9d-3c062a8385ef] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:41.598596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53c739c0-833c-4019-a405-35cb34a2b7eb tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:41.599251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53c739c0-833c-4019-a405-35cb34a2b7eb tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:41.604721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53c739c0-833c-4019-a405-35cb34a2b7eb tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:41.605427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53c739c0-833c-4019-a405-35cb34a2b7eb tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:41.645471 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-53c739c0-833c-4019-a405-35cb34a2b7eb tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] HTTP exception thrown: Instance c74ce99c-676e-4db8-ab9d-3c062a8385ef could not be found. May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-53c739c0-833c-4019-a405-35cb34a2b7eb tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Request method failure captured: May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef HTTP/1.1 May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaiZKRZohTZxaAZZwqs8K0lce_EdNQDC4kpWPGTL2Jn9xj1oPTEm5e_GY0HNGj7UmviCtrzZJIulMMKryYF0_2P_L5LIholEA9p4XjMYi0t8amZWSvpDmrF-dhm66RTensjDURvSuDNTlf-G7yFG-v33fNOrBub6fPG3XIcN_iBdD08 May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-Openstack-Nova-Api-Version: 2.21 May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: a73d1a2ff6564a9bb369414fc35461d4 May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1810787722 May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a73d1a2ff6564a9bb369414fc35461d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a73d1a2ff6564a9bb369414fc35461d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a73d1a2ff6564a9bb369414fc35461d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a73d1a2ff6564a9bb369414fc35461d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-InstanceActionsV221TestJSON-1810787722 May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: a73d1a2ff6564a9bb369414fc35461d4 May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1810787722 May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-InstanceActionsV221TestJSON-1810787722-project May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 861f3ef8d2f84fe097697218cf3f46a8 May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-InstanceActionsV221TestJSON-1810787722-project May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance c74ce99c-676e-4db8-ab9d-3c062a8385ef could not be found. May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'c74ce99c-676e-4db8-ab9d-3c062a8385ef'} May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c74ce99c-676e-4db8-ab9d-3c062a8385ef could not be found. May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c74ce99c-676e-4db8-ab9d-3c062a8385ef could not be found. May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:41.655334 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:41.664049 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:41.664049 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:41.664049 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:41.664049 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:41.664049 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:44:41.664049 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:44:41.664049 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c74ce99c-676e-4db8-ab9d-3c062a8385ef could not be found. May 28 04:44:41.664049 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:41.664049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-53c739c0-833c-4019-a405-35cb34a2b7eb tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Returning 404 to user: Instance c74ce99c-676e-4db8-ab9d-3c062a8385ef could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:41.664049 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-53c739c0-833c-4019-a405-35cb34a2b7eb tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] 10.222.0.58 "GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef" status: 404 len: 111 microversion: 2.21 time: 0.069749 May 28 04:44:41.664049 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1423/2730] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:41 2022] GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 04:44:41.664049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-23c75315-5916-4dac-989b-4c27e4cc4a13 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] Calling method '.version_select at 0x7f7700f8db80>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:41.809876 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-23c75315-5916-4dac-989b-4c27e4cc4a13 tempest-ImagesMetadataTestJSON-1018312813 tempest-ImagesMetadataTestJSON-1018312813-project] 10.222.0.58 "GET /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.145183 May 28 04:44:41.811972 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1424/2731] 10.222.0.58 () {58 vars in 1259 bytes} [Sat May 28 04:44:41 2022] GET /compute/v2.1/images/8c43d495-d464-48bf-b720-dcb2fdeee78c/metadata => generated 85 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:44:41.827179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e45bd12d-fb0c-450e-850a-230991b95c1d req-243d2158-8a02-46bc-b25d-6b95d5857513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64917b4-0e1c-4354-b5e5-e2925b14a602", "name": "network-vif-deleted", "tag": "de60a199-e862-4d4b-a623-cea20acebfcd"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:41.840904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e45bd12d-fb0c-450e-850a-230991b95c1d req-243d2158-8a02-46bc-b25d-6b95d5857513 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:41.841788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e45bd12d-fb0c-450e-850a-230991b95c1d req-243d2158-8a02-46bc-b25d-6b95d5857513 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:41.857324 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e45bd12d-fb0c-450e-850a-230991b95c1d req-243d2158-8a02-46bc-b25d-6b95d5857513 service nova] Creating event network-vif-deleted:de60a199-e862-4d4b-a623-cea20acebfcd for instance f64917b4-0e1c-4354-b5e5-e2925b14a602 on n-h1-843700-1 May 28 04:44:41.864840 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e45bd12d-fb0c-450e-850a-230991b95c1d req-243d2158-8a02-46bc-b25d-6b95d5857513 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051015 May 28 04:44:41.865937 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1425/2732] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:41.872240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2b21b640-cc5c-4e65-bcdb-c665c1068e20 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Calling method '.version_select at 0x7f7700f8df70>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:41.873179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2b21b640-cc5c-4e65-bcdb-c665c1068e20 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] [instance: c74ce99c-676e-4db8-ab9d-3c062a8385ef] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:41.887423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b21b640-cc5c-4e65-bcdb-c665c1068e20 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:41.888110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b21b640-cc5c-4e65-bcdb-c665c1068e20 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:41.889389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b21b640-cc5c-4e65-bcdb-c665c1068e20 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:41.890183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b21b640-cc5c-4e65-bcdb-c665c1068e20 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:41.995154 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2b21b640-cc5c-4e65-bcdb-c665c1068e20 tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] 10.222.0.58 "GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.127778 May 28 04:44:41.996564 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1426/2733] 10.222.0.58 () {60 vars in 1336 bytes} [Sat May 28 04:44:41 2022] GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef/os-instance-actions => generated 611 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:44:42.023452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4b0406e4-29cb-48c4-849d-8dcc7303162c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:42.024746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4b0406e4-29cb-48c4-849d-8dcc7303162c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] [instance: c74ce99c-676e-4db8-ab9d-3c062a8385ef] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:42.035507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4b0406e4-29cb-48c4-849d-8dcc7303162c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:42.037361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4b0406e4-29cb-48c4-849d-8dcc7303162c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:42.044180 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4b0406e4-29cb-48c4-849d-8dcc7303162c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:42.044887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4b0406e4-29cb-48c4-849d-8dcc7303162c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:42.081141 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-4b0406e4-29cb-48c4-849d-8dcc7303162c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] HTTP exception thrown: Instance c74ce99c-676e-4db8-ab9d-3c062a8385ef could not be found. May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4b0406e4-29cb-48c4-849d-8dcc7303162c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Request method failure captured: May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef HTTP/1.1 May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaiZKRZohTZxaAZZwqs8K0lce_EdNQDC4kpWPGTL2Jn9xj1oPTEm5e_GY0HNGj7UmviCtrzZJIulMMKryYF0_2P_L5LIholEA9p4XjMYi0t8amZWSvpDmrF-dhm66RTensjDURvSuDNTlf-G7yFG-v33fNOrBub6fPG3XIcN_iBdD08 May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-Openstack-Nova-Api-Version: 2.21 May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: a73d1a2ff6564a9bb369414fc35461d4 May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1810787722 May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a73d1a2ff6564a9bb369414fc35461d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a73d1a2ff6564a9bb369414fc35461d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a73d1a2ff6564a9bb369414fc35461d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a73d1a2ff6564a9bb369414fc35461d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-InstanceActionsV221TestJSON-1810787722 May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: a73d1a2ff6564a9bb369414fc35461d4 May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1810787722 May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-InstanceActionsV221TestJSON-1810787722-project May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 861f3ef8d2f84fe097697218cf3f46a8 May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-InstanceActionsV221TestJSON-1810787722-project May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance c74ce99c-676e-4db8-ab9d-3c062a8385ef could not be found. May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'c74ce99c-676e-4db8-ab9d-3c062a8385ef'} May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c74ce99c-676e-4db8-ab9d-3c062a8385ef could not be found. May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:44:42.084676 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:44:42.096494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c74ce99c-676e-4db8-ab9d-3c062a8385ef could not be found. May 28 04:44:42.096494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:42.096494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:42.096494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:42.096494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:42.096494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:42.096494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:42.096494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:44:42.096494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:44:42.096494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c74ce99c-676e-4db8-ab9d-3c062a8385ef could not be found. May 28 04:44:42.096494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:42.096494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4b0406e4-29cb-48c4-849d-8dcc7303162c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Returning 404 to user: Instance c74ce99c-676e-4db8-ab9d-3c062a8385ef could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:42.096494 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4b0406e4-29cb-48c4-849d-8dcc7303162c tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef" status: 404 len: 111 microversion: 2.21 time: 0.084113 May 28 04:44:42.096494 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1427/2734] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:44:42 2022] DELETE /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 28 04:44:42.107028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3946072a-8958-4851-8d2f-5e51f6dfac9f tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:42.115504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3946072a-8958-4851-8d2f-5e51f6dfac9f tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] [instance: c74ce99c-676e-4db8-ab9d-3c062a8385ef] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:42.123235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3946072a-8958-4851-8d2f-5e51f6dfac9f tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:42.124594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3946072a-8958-4851-8d2f-5e51f6dfac9f tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:42.126374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3946072a-8958-4851-8d2f-5e51f6dfac9f tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:42.127084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3946072a-8958-4851-8d2f-5e51f6dfac9f tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:42.142638 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-3946072a-8958-4851-8d2f-5e51f6dfac9f tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] HTTP exception thrown: Instance c74ce99c-676e-4db8-ab9d-3c062a8385ef could not be found. May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3946072a-8958-4851-8d2f-5e51f6dfac9f tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Request method failure captured: May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef HTTP/1.1 May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaiZKRZohTZxaAZZwqs8K0lce_EdNQDC4kpWPGTL2Jn9xj1oPTEm5e_GY0HNGj7UmviCtrzZJIulMMKryYF0_2P_L5LIholEA9p4XjMYi0t8amZWSvpDmrF-dhm66RTensjDURvSuDNTlf-G7yFG-v33fNOrBub6fPG3XIcN_iBdD08 May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-Openstack-Nova-Api-Version: 2.21 May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: a73d1a2ff6564a9bb369414fc35461d4 May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1810787722 May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a73d1a2ff6564a9bb369414fc35461d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a73d1a2ff6564a9bb369414fc35461d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a73d1a2ff6564a9bb369414fc35461d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a73d1a2ff6564a9bb369414fc35461d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-InstanceActionsV221TestJSON-1810787722 May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: a73d1a2ff6564a9bb369414fc35461d4 May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1810787722 May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-InstanceActionsV221TestJSON-1810787722-project May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 861f3ef8d2f84fe097697218cf3f46a8 May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-InstanceActionsV221TestJSON-1810787722-project May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance c74ce99c-676e-4db8-ab9d-3c062a8385ef could not be found. May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'c74ce99c-676e-4db8-ab9d-3c062a8385ef'} May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c74ce99c-676e-4db8-ab9d-3c062a8385ef could not be found. May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c74ce99c-676e-4db8-ab9d-3c062a8385ef could not be found. May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:42.144617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:42.148024 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:42.148024 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:42.148024 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:42.148024 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:42.148024 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:44:42.148024 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:44:42.148024 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c74ce99c-676e-4db8-ab9d-3c062a8385ef could not be found. May 28 04:44:42.148024 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:42.150279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3946072a-8958-4851-8d2f-5e51f6dfac9f tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] Returning 404 to user: Instance c74ce99c-676e-4db8-ab9d-3c062a8385ef could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:42.151384 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3946072a-8958-4851-8d2f-5e51f6dfac9f tempest-InstanceActionsV221TestJSON-1810787722 tempest-InstanceActionsV221TestJSON-1810787722-project] 10.222.0.58 "GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef" status: 404 len: 111 microversion: 2.21 time: 0.056080 May 28 04:44:42.152441 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1428/2735] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:42 2022] GET /compute/v2.1/servers/c74ce99c-676e-4db8-ab9d-3c062a8385ef => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 04:44:42.487764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b8f0de34-3dd7-4897-8193-10da59a0dd12 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:42.488547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b8f0de34-3dd7-4897-8193-10da59a0dd12 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:42.496892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8f0de34-3dd7-4897-8193-10da59a0dd12 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:42.516666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8f0de34-3dd7-4897-8193-10da59a0dd12 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:42.520500 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8f0de34-3dd7-4897-8193-10da59a0dd12 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:42.521022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8f0de34-3dd7-4897-8193-10da59a0dd12 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:42.711966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-d3301e46-cf2e-48c3-84cb-3382a344a56f tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Building network info cache for instance {{(pid=126043) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 28 04:44:43.065124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b8f0de34-3dd7-4897-8193-10da59a0dd12 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:43.078608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b8f0de34-3dd7-4897-8193-10da59a0dd12 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:43.080676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b8f0de34-3dd7-4897-8193-10da59a0dd12 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:43.081836 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b8f0de34-3dd7-4897-8193-10da59a0dd12 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1873 microversion: 2.42 time: 0.599744 May 28 04:44:43.082400 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1429/2736] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:42 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1873 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:44:43.105420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e2801fe0-aefe-40da-855a-a3067a9a6c45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:43.106047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e2801fe0-aefe-40da-855a-a3067a9a6c45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] [instance: f64917b4-0e1c-4354-b5e5-e2925b14a602] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:43.139562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2801fe0-aefe-40da-855a-a3067a9a6c45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:43.140112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2801fe0-aefe-40da-855a-a3067a9a6c45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:43.140942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2801fe0-aefe-40da-855a-a3067a9a6c45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:43.141374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2801fe0-aefe-40da-855a-a3067a9a6c45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:43.187688 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-e2801fe0-aefe-40da-855a-a3067a9a6c45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] HTTP exception thrown: Instance f64917b4-0e1c-4354-b5e5-e2925b14a602 could not be found. May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e2801fe0-aefe-40da-855a-a3067a9a6c45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Request method failure captured: May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 HTTP/1.1 May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaa2z-mBC0Oqm9jSGg-o-K9zDEQfRKobRjEoonU0ns2YIeP-M7nIyd9FMtfufCiPXUpBFAXsdoE2GDbhmek38feXoiu1nkWEvJf4zUN3sHLUVl8rxo58WUYGAE6Ok0ye9isbgcQYaNdZ1NKU8RsK3oUctPhk5wtwAWoeRvkT_CCcR1o May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-Openstack-Nova-Api-Version: 2.25 May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 99f14746bfbc460eb4a21e7eb567de46 May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-678063580 May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_99f14746bfbc460eb4a21e7eb567de46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/99f14746bfbc460eb4a21e7eb567de46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/99f14746bfbc460eb4a21e7eb567de46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/99f14746bfbc460eb4a21e7eb567de46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-678063580 May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 99f14746bfbc460eb4a21e7eb567de46 May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-678063580 May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-LiveAutoBlockMigrationV225Test-678063580-project May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: ed90faaaee584c3a8d1385b8d873d12d May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-678063580-project May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance f64917b4-0e1c-4354-b5e5-e2925b14a602 could not be found. May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'f64917b4-0e1c-4354-b5e5-e2925b14a602'} May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f64917b4-0e1c-4354-b5e5-e2925b14a602 could not be found. May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f64917b4-0e1c-4354-b5e5-e2925b14a602 could not be found. May 28 04:44:43.190120 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:43.194108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:44:43.194108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:43.194108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:44:43.194108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:44:43.194108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:44:43.194108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:44:43.194108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:44:43.194108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f64917b4-0e1c-4354-b5e5-e2925b14a602 could not be found. May 28 04:44:43.194108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:44:43.194108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e2801fe0-aefe-40da-855a-a3067a9a6c45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] Returning 404 to user: Instance f64917b4-0e1c-4354-b5e5-e2925b14a602 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:44:43.194108 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e2801fe0-aefe-40da-855a-a3067a9a6c45 tempest-LiveAutoBlockMigrationV225Test-678063580 tempest-LiveAutoBlockMigrationV225Test-678063580-project] 10.222.0.58 "GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602" status: 404 len: 111 microversion: 2.25 time: 0.108248 May 28 04:44:43.202522 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1430/2737] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:43 2022] GET /compute/v2.1/servers/f64917b4-0e1c-4354-b5e5-e2925b14a602 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 04:44:43.749772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-2499d850-07d8-43e9-ad10-c142f9c61391 req-936aaab4-6a6f-4679-aa59-237879d7dcef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "215a4357-1792-4f6e-ae11-f8574b806b73", "name": "network-vif-plugged", "status": "completed", "tag": "f007cebf-d19d-420d-891d-de3291249844"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:43.771840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2499d850-07d8-43e9-ad10-c142f9c61391 req-936aaab4-6a6f-4679-aa59-237879d7dcef service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:43.772426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2499d850-07d8-43e9-ad10-c142f9c61391 req-936aaab4-6a6f-4679-aa59-237879d7dcef service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:43.795608 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-2499d850-07d8-43e9-ad10-c142f9c61391 req-936aaab4-6a6f-4679-aa59-237879d7dcef service nova] Creating event network-vif-plugged:f007cebf-d19d-420d-891d-de3291249844 for instance 215a4357-1792-4f6e-ae11-f8574b806b73 on n-h2-843700-1 May 28 04:44:43.803140 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-2499d850-07d8-43e9-ad10-c142f9c61391 req-936aaab4-6a6f-4679-aa59-237879d7dcef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057063 May 28 04:44:43.803813 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1431/2738] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:44:43.889803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-70110d38-5bc0-470f-a4ab-732a6eedb843 req-293e8277-2230-43a7-a7e4-0c15e1f2e7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73298cda-5cfb-45df-8914-2c76ac9cc70d", "tag": "03b825a9-d5e4-41b3-b80b-08b10632a298"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:43.904925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-70110d38-5bc0-470f-a4ab-732a6eedb843 req-293e8277-2230-43a7-a7e4-0c15e1f2e7a4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:43.905611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-70110d38-5bc0-470f-a4ab-732a6eedb843 req-293e8277-2230-43a7-a7e4-0c15e1f2e7a4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:43.930340 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-70110d38-5bc0-470f-a4ab-732a6eedb843 req-293e8277-2230-43a7-a7e4-0c15e1f2e7a4 service nova] Creating event network-changed:03b825a9-d5e4-41b3-b80b-08b10632a298 for instance 73298cda-5cfb-45df-8914-2c76ac9cc70d on n-h2-843700-1 May 28 04:44:43.958318 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-70110d38-5bc0-470f-a4ab-732a6eedb843 req-293e8277-2230-43a7-a7e4-0c15e1f2e7a4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071841 May 28 04:44:43.960747 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1432/2739] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:44:44.109655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-09daf00d-07b9-469b-b570-5e0872cedcaf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:44.111177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-09daf00d-07b9-469b-b570-5e0872cedcaf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:44.128991 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09daf00d-07b9-469b-b570-5e0872cedcaf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:44.129723 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09daf00d-07b9-469b-b570-5e0872cedcaf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:44.130717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09daf00d-07b9-469b-b570-5e0872cedcaf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:44.131345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09daf00d-07b9-469b-b570-5e0872cedcaf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:44.643571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-d3301e46-cf2e-48c3-84cb-3382a344a56f tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Updating instance_info_cache with network_info: [{"id": "03b825a9-d5e4-41b3-b80b-08b10632a298", "address": "fa:16:3e:20:bd:c4", "network": {"id": "9da21411-17dd-4f3c-904b-2ef597d53247", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-86338778-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3c8d3282507f4edabcfe1c87e6a2186c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap03b825a9-d5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126043) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 04:44:44.729134 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3301e46-cf2e-48c3-84cb-3382a344a56f tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Releasing lock "refresh_cache-73298cda-5cfb-45df-8914-2c76ac9cc70d" {{(pid=126043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 04:44:44.730435 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d3301e46-cf2e-48c3-84cb-3382a344a56f tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "POST /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d/action" status: 202 len: 0 microversion: 2.1 time: 5.116211 May 28 04:44:44.736820 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1308/2740] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:44:39 2022] POST /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d/action => generated 0 bytes in 5118 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 28 04:44:44.746974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-88ed5731-19b8-4085-a018-2ef7461b4d97 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.43"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:44.753177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-88ed5731-19b8-4085-a018-2ef7461b4d97 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:44.771326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88ed5731-19b8-4085-a018-2ef7461b4d97 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:44.772137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88ed5731-19b8-4085-a018-2ef7461b4d97 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:44.773187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88ed5731-19b8-4085-a018-2ef7461b4d97 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:44.773826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88ed5731-19b8-4085-a018-2ef7461b4d97 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:44.791450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-09daf00d-07b9-469b-b570-5e0872cedcaf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:44.813907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-09daf00d-07b9-469b-b570-5e0872cedcaf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:44.819874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-09daf00d-07b9-469b-b570-5e0872cedcaf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:44.821957 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-09daf00d-07b9-469b-b570-5e0872cedcaf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1873 microversion: 2.42 time: 0.723872 May 28 04:44:44.826457 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1433/2741] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:44 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1873 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:44.832981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88ed5731-19b8-4085-a018-2ef7461b4d97 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Acquired lock "refresh_cache-e00cb82d-ba64-497a-96ba-71fe00f0a019" {{(pid=126043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 04:44:45.763362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-762b085f-2c58-43d8-b0a7-536a32d71ca7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2082769226", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "aaf67aae-c4ff-4ac3-8e4e-a4156646067f"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:45.864045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-762b085f-2c58-43d8-b0a7-536a32d71ca7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] validate_networks() for [('aaf67aae-c4ff-4ac3-8e4e-a4156646067f', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:44:47.149911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-762b085f-2c58-43d8-b0a7-536a32d71ca7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:44:47.151043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-762b085f-2c58-43d8-b0a7-536a32d71ca7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:44:47.151690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-762b085f-2c58-43d8-b0a7-536a32d71ca7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:44:47.152260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-762b085f-2c58-43d8-b0a7-536a32d71ca7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:44:47.152832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-762b085f-2c58-43d8-b0a7-536a32d71ca7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:44:47.171549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-762b085f-2c58-43d8-b0a7-536a32d71ca7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:47.172059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-762b085f-2c58-43d8-b0a7-536a32d71ca7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:47.172989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-762b085f-2c58-43d8-b0a7-536a32d71ca7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:47.173435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-762b085f-2c58-43d8-b0a7-536a32d71ca7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:47.200782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-762b085f-2c58-43d8-b0a7-536a32d71ca7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Getting quotas for project da841757a2094bad83e04816bb355969. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:44:47.207840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-762b085f-2c58-43d8-b0a7-536a32d71ca7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Getting quotas for user c07b3b1388d24bae9e8834c8b9a4f3a9 and project da841757a2094bad83e04816bb355969. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:44:47.223637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-762b085f-2c58-43d8-b0a7-536a32d71ca7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:44:47.226397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-762b085f-2c58-43d8-b0a7-536a32d71ca7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 265434ea-fb97-43f8-ab64-c1f65c9e42e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:44:47.624954 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-762b085f-2c58-43d8-b0a7-536a32d71ca7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.181118 May 28 04:44:47.631779 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1434/2742] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:44:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:44:47.639176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b5d8b8f4-a5bd-4f43-ba7b-b2df67851ca4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:47.640420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b5d8b8f4-a5bd-4f43-ba7b-b2df67851ca4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:47.661263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b5d8b8f4-a5bd-4f43-ba7b-b2df67851ca4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:47.661730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b5d8b8f4-a5bd-4f43-ba7b-b2df67851ca4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:47.662511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b5d8b8f4-a5bd-4f43-ba7b-b2df67851ca4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:47.667197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b5d8b8f4-a5bd-4f43-ba7b-b2df67851ca4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:47.715834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:44:48.101964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b5d8b8f4-a5bd-4f43-ba7b-b2df67851ca4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:48.127170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b5d8b8f4-a5bd-4f43-ba7b-b2df67851ca4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:48.135090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b5d8b8f4-a5bd-4f43-ba7b-b2df67851ca4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:48.142033 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b5d8b8f4-a5bd-4f43-ba7b-b2df67851ca4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1873 microversion: 2.42 time: 0.508963 May 28 04:44:48.143283 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1435/2743] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:47 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1873 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:48.158485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9c7acd6b-1a5b-46ff-a711-702e2e8e5a8a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:48.162378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9c7acd6b-1a5b-46ff-a711-702e2e8e5a8a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 265434ea-fb97-43f8-ab64-c1f65c9e42e7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:48.299581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=20 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:44:48.312280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9c7acd6b-1a5b-46ff-a711-702e2e8e5a8a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:48.327871 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9c7acd6b-1a5b-46ff-a711-702e2e8e5a8a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7" status: 200 len: 1208 microversion: 2.1 time: 0.183402 May 28 04:44:48.328735 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1436/2744] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:48 2022] GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7 => generated 1208 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:49.110280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0df997cd-fa50-40fe-8ec0-063de1eae828 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-631707339", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:49.185333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-0df997cd-fa50-40fe-8ec0-063de1eae828 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:44:50.171706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-0df997cd-fa50-40fe-8ec0-063de1eae828 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:44:50.172571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-0df997cd-fa50-40fe-8ec0-063de1eae828 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:44:50.173217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-0df997cd-fa50-40fe-8ec0-063de1eae828 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:44:50.175763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-0df997cd-fa50-40fe-8ec0-063de1eae828 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:44:50.176364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-0df997cd-fa50-40fe-8ec0-063de1eae828 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:44:50.191488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0df997cd-fa50-40fe-8ec0-063de1eae828 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:50.192108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0df997cd-fa50-40fe-8ec0-063de1eae828 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:50.196297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0df997cd-fa50-40fe-8ec0-063de1eae828 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:50.198119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0df997cd-fa50-40fe-8ec0-063de1eae828 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:50.245880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-0df997cd-fa50-40fe-8ec0-063de1eae828 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Getting quotas for project 31adf654f25449ae87a16578bb7930a5. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:44:50.260516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-0df997cd-fa50-40fe-8ec0-063de1eae828 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Getting quotas for user f883b4a05f5447b78be3f72888ad8138 and project 31adf654f25449ae87a16578bb7930a5. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:44:50.281334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0df997cd-fa50-40fe-8ec0-063de1eae828 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:44:50.290257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0df997cd-fa50-40fe-8ec0-063de1eae828 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:44:50.446187 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0df997cd-fa50-40fe-8ec0-063de1eae828 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.596494 May 28 04:44:50.454542 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1437/2745] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:44:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:44:50.471015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4fec8ec0-6d59-490d-8c47-42d284b2efbd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:50.474229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4fec8ec0-6d59-490d-8c47-42d284b2efbd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:50.507600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fec8ec0-6d59-490d-8c47-42d284b2efbd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:50.509366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fec8ec0-6d59-490d-8c47-42d284b2efbd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:50.512926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fec8ec0-6d59-490d-8c47-42d284b2efbd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:50.513353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fec8ec0-6d59-490d-8c47-42d284b2efbd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:50.988204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4fec8ec0-6d59-490d-8c47-42d284b2efbd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:50.998313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4fec8ec0-6d59-490d-8c47-42d284b2efbd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:51.010488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4fec8ec0-6d59-490d-8c47-42d284b2efbd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:51.012193 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4fec8ec0-6d59-490d-8c47-42d284b2efbd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1873 microversion: 2.42 time: 0.553751 May 28 04:44:51.013954 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1438/2746] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:50 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1873 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:51.027307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a0f16458-9cd3-4813-994b-6d21463f680b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:51.028384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a0f16458-9cd3-4813-994b-6d21463f680b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 265434ea-fb97-43f8-ab64-c1f65c9e42e7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:51.038882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0f16458-9cd3-4813-994b-6d21463f680b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:51.050608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0f16458-9cd3-4813-994b-6d21463f680b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:51.051543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0f16458-9cd3-4813-994b-6d21463f680b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:51.052009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0f16458-9cd3-4813-994b-6d21463f680b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:51.427493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a0f16458-9cd3-4813-994b-6d21463f680b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:51.450863 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a0f16458-9cd3-4813-994b-6d21463f680b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7" status: 200 len: 1268 microversion: 2.1 time: 0.435632 May 28 04:44:51.452021 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1439/2747] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:51 2022] GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7 => generated 1268 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:51.478887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bcb7a375-3e8f-46d6-b04f-9c1dd4ab6741 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:51.481060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bcb7a375-3e8f-46d6-b04f-9c1dd4ab6741 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:51.877215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bcb7a375-3e8f-46d6-b04f-9c1dd4ab6741 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883b4a05f5447b78be3f72888ad8138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31adf654f25449ae87a16578bb7930a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:51.902966 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bcb7a375-3e8f-46d6-b04f-9c1dd4ab6741 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 200 len: 1216 microversion: 2.1 time: 0.437084 May 28 04:44:51.906074 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1440/2748] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:51 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 1216 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:51.934706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e9a3bb51-0541-48ff-b7ec-19fb2d352323 req-f08c5b4e-520c-4a41-b572-23da22d5043e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73298cda-5cfb-45df-8914-2c76ac9cc70d", "tag": "03b825a9-d5e4-41b3-b80b-08b10632a298"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:51.984092 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e9a3bb51-0541-48ff-b7ec-19fb2d352323 req-f08c5b4e-520c-4a41-b572-23da22d5043e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:51.987950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e9a3bb51-0541-48ff-b7ec-19fb2d352323 req-f08c5b4e-520c-4a41-b572-23da22d5043e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:52.040981 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e9a3bb51-0541-48ff-b7ec-19fb2d352323 req-f08c5b4e-520c-4a41-b572-23da22d5043e service nova] Creating event network-changed:03b825a9-d5e4-41b3-b80b-08b10632a298 for instance 73298cda-5cfb-45df-8914-2c76ac9cc70d on n-h2-843700-1 May 28 04:44:52.079091 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e9a3bb51-0541-48ff-b7ec-19fb2d352323 req-f08c5b4e-520c-4a41-b572-23da22d5043e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147434 May 28 04:44:52.083427 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1441/2749] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:52.099408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6e0dd19b-6c19-4739-95c2-0bc9086f2583 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:52.100119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6e0dd19b-6c19-4739-95c2-0bc9086f2583 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:52.110171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e0dd19b-6c19-4739-95c2-0bc9086f2583 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:52.110716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e0dd19b-6c19-4739-95c2-0bc9086f2583 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:52.111587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e0dd19b-6c19-4739-95c2-0bc9086f2583 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:52.112030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e0dd19b-6c19-4739-95c2-0bc9086f2583 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:52.424107 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.network.neutron [None req-88ed5731-19b8-4085-a018-2ef7461b4d97 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] re-assign floating IP 172.25.2.43 from instance 73298cda-5cfb-45df-8914-2c76ac9cc70d May 28 04:44:52.581887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6e0dd19b-6c19-4739-95c2-0bc9086f2583 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:52.599345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6e0dd19b-6c19-4739-95c2-0bc9086f2583 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:52.600968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6e0dd19b-6c19-4739-95c2-0bc9086f2583 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:52.609227 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6e0dd19b-6c19-4739-95c2-0bc9086f2583 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1873 microversion: 2.42 time: 0.514996 May 28 04:44:52.623661 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1442/2750] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:52 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1873 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:52.637272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d094ca83-9ad7-490b-8eca-30f09536e64e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:52.649337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d094ca83-9ad7-490b-8eca-30f09536e64e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 265434ea-fb97-43f8-ab64-c1f65c9e42e7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:52.661938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d094ca83-9ad7-490b-8eca-30f09536e64e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:52.662390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d094ca83-9ad7-490b-8eca-30f09536e64e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:52.663202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d094ca83-9ad7-490b-8eca-30f09536e64e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:52.668297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d094ca83-9ad7-490b-8eca-30f09536e64e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:52.712830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-88ed5731-19b8-4085-a018-2ef7461b4d97 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Building network info cache for instance {{(pid=126043) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 28 04:44:53.008380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d094ca83-9ad7-490b-8eca-30f09536e64e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:53.021324 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d094ca83-9ad7-490b-8eca-30f09536e64e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7" status: 200 len: 1266 microversion: 2.1 time: 0.396405 May 28 04:44:53.021930 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1443/2751] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:52 2022] GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7 => generated 1266 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:53.026727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-598057ac-5877-4117-85ca-422ab6c3e421 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:53.039273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-598057ac-5877-4117-85ca-422ab6c3e421 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:53.078925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-598057ac-5877-4117-85ca-422ab6c3e421 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:53.080207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-598057ac-5877-4117-85ca-422ab6c3e421 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:53.081226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-598057ac-5877-4117-85ca-422ab6c3e421 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:53.088655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-598057ac-5877-4117-85ca-422ab6c3e421 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:53.774323 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-598057ac-5877-4117-85ca-422ab6c3e421 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883b4a05f5447b78be3f72888ad8138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31adf654f25449ae87a16578bb7930a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:53.784260 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-598057ac-5877-4117-85ca-422ab6c3e421 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 200 len: 1220 microversion: 2.1 time: 0.760740 May 28 04:44:53.784863 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1444/2752] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:53 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 1220 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:53.806738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-765f2c17-8ad3-4905-8049-8da0a795f9bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:53.807389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-765f2c17-8ad3-4905-8049-8da0a795f9bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:53.836117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-765f2c17-8ad3-4905-8049-8da0a795f9bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:53.836571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-765f2c17-8ad3-4905-8049-8da0a795f9bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:53.843713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-765f2c17-8ad3-4905-8049-8da0a795f9bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:53.846642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-765f2c17-8ad3-4905-8049-8da0a795f9bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:54.766899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=13 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:44:54.920993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-88ed5731-19b8-4085-a018-2ef7461b4d97 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Updating instance_info_cache with network_info: [{"id": "03b825a9-d5e4-41b3-b80b-08b10632a298", "address": "fa:16:3e:20:bd:c4", "network": {"id": "9da21411-17dd-4f3c-904b-2ef597d53247", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-86338778-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3c8d3282507f4edabcfe1c87e6a2186c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap03b825a9-d5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126043) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 04:44:54.934658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-88ed5731-19b8-4085-a018-2ef7461b4d97 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Building network info cache for instance {{(pid=126043) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 28 04:44:55.773899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-765f2c17-8ad3-4905-8049-8da0a795f9bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:55.791581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-765f2c17-8ad3-4905-8049-8da0a795f9bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:55.806191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-765f2c17-8ad3-4905-8049-8da0a795f9bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:55.818221 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-765f2c17-8ad3-4905-8049-8da0a795f9bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1873 microversion: 2.42 time: 2.020355 May 28 04:44:55.827592 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1445/2753] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:53 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1873 bytes in 2030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:55.855569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7e9f44d9-07e0-4a66-88a9-7fe737ed8a2f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:55.865542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7e9f44d9-07e0-4a66-88a9-7fe737ed8a2f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 265434ea-fb97-43f8-ab64-c1f65c9e42e7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:55.884366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e9f44d9-07e0-4a66-88a9-7fe737ed8a2f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:55.887867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e9f44d9-07e0-4a66-88a9-7fe737ed8a2f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:55.893369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e9f44d9-07e0-4a66-88a9-7fe737ed8a2f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:55.894200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e9f44d9-07e0-4a66-88a9-7fe737ed8a2f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:56.769810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7e9f44d9-07e0-4a66-88a9-7fe737ed8a2f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:56.777639 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7e9f44d9-07e0-4a66-88a9-7fe737ed8a2f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7" status: 200 len: 1308 microversion: 2.1 time: 0.933136 May 28 04:44:56.778322 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1446/2754] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:55 2022] GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7 => generated 1308 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:56.792006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-bc56cd61-0de0-49fd-99e3-b507494a3d22 req-465d7036-44b4-416d-a941-267484b38d8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e00cb82d-ba64-497a-96ba-71fe00f0a019", "tag": "7d1f10a0-da4d-41e6-a729-b21d906423a8"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:56.800956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-bc56cd61-0de0-49fd-99e3-b507494a3d22 req-465d7036-44b4-416d-a941-267484b38d8b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:56.801416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-bc56cd61-0de0-49fd-99e3-b507494a3d22 req-465d7036-44b4-416d-a941-267484b38d8b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:56.813071 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-bc56cd61-0de0-49fd-99e3-b507494a3d22 req-465d7036-44b4-416d-a941-267484b38d8b service nova] Creating event network-changed:7d1f10a0-da4d-41e6-a729-b21d906423a8 for instance e00cb82d-ba64-497a-96ba-71fe00f0a019 on n-h1-843700-1 May 28 04:44:56.819377 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-bc56cd61-0de0-49fd-99e3-b507494a3d22 req-465d7036-44b4-416d-a941-267484b38d8b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031015 May 28 04:44:56.820244 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1447/2755] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:56.825471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cfed526b-19a8-4126-880b-c51232ecb694 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:56.826308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cfed526b-19a8-4126-880b-c51232ecb694 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:56.834057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfed526b-19a8-4126-880b-c51232ecb694 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:56.834587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfed526b-19a8-4126-880b-c51232ecb694 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:56.835402 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfed526b-19a8-4126-880b-c51232ecb694 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:56.835843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfed526b-19a8-4126-880b-c51232ecb694 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:56.964682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cfed526b-19a8-4126-880b-c51232ecb694 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883b4a05f5447b78be3f72888ad8138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31adf654f25449ae87a16578bb7930a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:56.977059 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cfed526b-19a8-4126-880b-c51232ecb694 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 200 len: 1274 microversion: 2.1 time: 0.155439 May 28 04:44:56.985659 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1448/2756] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:56 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 1274 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:56.994699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-676b0a80-48f4-4679-8c27-c0908cd44e2c req-dffa7dc6-baa4-477c-b039-3355b764d976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "265434ea-fb97-43f8-ab64-c1f65c9e42e7", "tag": "afb98a08-89c9-4c0b-862a-2a876bc56852"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:57.009055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-676b0a80-48f4-4679-8c27-c0908cd44e2c req-dffa7dc6-baa4-477c-b039-3355b764d976 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:57.009735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-676b0a80-48f4-4679-8c27-c0908cd44e2c req-dffa7dc6-baa4-477c-b039-3355b764d976 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:57.031273 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-676b0a80-48f4-4679-8c27-c0908cd44e2c req-dffa7dc6-baa4-477c-b039-3355b764d976 service nova] Creating event network-changed:afb98a08-89c9-4c0b-862a-2a876bc56852 for instance 265434ea-fb97-43f8-ab64-c1f65c9e42e7 on n-h2-843700-1 May 28 04:44:57.038330 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-676b0a80-48f4-4679-8c27-c0908cd44e2c req-dffa7dc6-baa4-477c-b039-3355b764d976 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050867 May 28 04:44:57.040162 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1449/2757] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:44:57.048522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fdd6b52e-3d50-4c26-80e2-7185f0a6b00e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:57.048522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fdd6b52e-3d50-4c26-80e2-7185f0a6b00e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:57.060729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fdd6b52e-3d50-4c26-80e2-7185f0a6b00e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:57.061910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fdd6b52e-3d50-4c26-80e2-7185f0a6b00e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:57.063684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fdd6b52e-3d50-4c26-80e2-7185f0a6b00e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:57.064924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fdd6b52e-3d50-4c26-80e2-7185f0a6b00e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:58.177851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-88ed5731-19b8-4085-a018-2ef7461b4d97 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Updating instance_info_cache with network_info: [{"id": "7d1f10a0-da4d-41e6-a729-b21d906423a8", "address": "fa:16:3e:b4:9a:7d", "network": {"id": "9da21411-17dd-4f3c-904b-2ef597d53247", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-86338778-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3c8d3282507f4edabcfe1c87e6a2186c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7d1f10a0-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126043) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 04:44:58.248067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88ed5731-19b8-4085-a018-2ef7461b4d97 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Releasing lock "refresh_cache-e00cb82d-ba64-497a-96ba-71fe00f0a019" {{(pid=126043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 04:44:58.253315 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-88ed5731-19b8-4085-a018-2ef7461b4d97 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "POST /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019/action" status: 202 len: 0 microversion: 2.1 time: 13.509518 May 28 04:44:58.253315 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1309/2758] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:44:44 2022] POST /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019/action => generated 0 bytes in 13511 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) May 28 04:44:58.257612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-af0e2634-2ec6-4d0b-a25d-50dff1ad05ed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:58.259232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-af0e2634-2ec6-4d0b-a25d-50dff1ad05ed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 265434ea-fb97-43f8-ab64-c1f65c9e42e7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:58.278836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af0e2634-2ec6-4d0b-a25d-50dff1ad05ed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:58.279688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af0e2634-2ec6-4d0b-a25d-50dff1ad05ed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:58.280676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af0e2634-2ec6-4d0b-a25d-50dff1ad05ed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:58.281471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af0e2634-2ec6-4d0b-a25d-50dff1ad05ed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:58.286104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fdd6b52e-3d50-4c26-80e2-7185f0a6b00e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:58.304920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fdd6b52e-3d50-4c26-80e2-7185f0a6b00e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:58.310830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fdd6b52e-3d50-4c26-80e2-7185f0a6b00e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:58.315754 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fdd6b52e-3d50-4c26-80e2-7185f0a6b00e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1873 microversion: 2.42 time: 1.271049 May 28 04:44:58.318582 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1450/2759] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:44:57 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1873 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:44:58.335515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-296c8b1e-b6db-45dc-852c-20b39fbf6ba5 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:44:58.336656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-296c8b1e-b6db-45dc-852c-20b39fbf6ba5 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:44:58.344805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-296c8b1e-b6db-45dc-852c-20b39fbf6ba5 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:58.345536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-296c8b1e-b6db-45dc-852c-20b39fbf6ba5 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:58.346508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-296c8b1e-b6db-45dc-852c-20b39fbf6ba5 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:44:58.347146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-296c8b1e-b6db-45dc-852c-20b39fbf6ba5 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:44:58.507183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-296c8b1e-b6db-45dc-852c-20b39fbf6ba5 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883b4a05f5447b78be3f72888ad8138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31adf654f25449ae87a16578bb7930a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:58.521211 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-296c8b1e-b6db-45dc-852c-20b39fbf6ba5 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 200 len: 1274 microversion: 2.1 time: 0.200321 May 28 04:44:58.521818 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1451/2760] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:58 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 1274 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:58.786763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-af0e2634-2ec6-4d0b-a25d-50dff1ad05ed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:44:58.797455 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-af0e2634-2ec6-4d0b-a25d-50dff1ad05ed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7" status: 200 len: 1308 microversion: 2.1 time: 0.543916 May 28 04:44:58.797455 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1310/2761] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:44:58 2022] GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7 => generated 1308 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:44:58.814501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1f611d3c-8fc5-4ace-8375-832cda14eb49 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Action: 'action', calling method: .version_select at 0x7f7704516550>, body: {"removeFloatingIp": {"address": "172.25.2.43"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:58.953290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cba8a806-5d74-487e-8309-4f690a8e6f45 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1605683720", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:44:59.077862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-cba8a806-5d74-487e-8309-4f690a8e6f45 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:45:00.028408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1f611d3c-8fc5-4ace-8375-832cda14eb49 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:00.036408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1f611d3c-8fc5-4ace-8375-832cda14eb49 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:00.037552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1f611d3c-8fc5-4ace-8375-832cda14eb49 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:00.038539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1f611d3c-8fc5-4ace-8375-832cda14eb49 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:00.042173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1f611d3c-8fc5-4ace-8375-832cda14eb49 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:00.215732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:45:00.746381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-cba8a806-5d74-487e-8309-4f690a8e6f45 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:45:00.747126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-cba8a806-5d74-487e-8309-4f690a8e6f45 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:45:00.747845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-cba8a806-5d74-487e-8309-4f690a8e6f45 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:45:00.748430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-cba8a806-5d74-487e-8309-4f690a8e6f45 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:45:00.749042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-cba8a806-5d74-487e-8309-4f690a8e6f45 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:45:00.768407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cba8a806-5d74-487e-8309-4f690a8e6f45 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:00.769274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cba8a806-5d74-487e-8309-4f690a8e6f45 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:00.774805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cba8a806-5d74-487e-8309-4f690a8e6f45 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:00.775711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cba8a806-5d74-487e-8309-4f690a8e6f45 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:00.796017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-cba8a806-5d74-487e-8309-4f690a8e6f45 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Getting quotas for project 2db88d55696c44808cd30751011fed4b. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:45:00.802969 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-cba8a806-5d74-487e-8309-4f690a8e6f45 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Getting quotas for user 4df06b05648a41529c3c00cb6b37a77f and project 2db88d55696c44808cd30751011fed4b. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:45:00.820612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:45:00.822790 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cba8a806-5d74-487e-8309-4f690a8e6f45 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:45:00.827008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cba8a806-5d74-487e-8309-4f690a8e6f45 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] [instance: 0caacb3d-0cbd-4983-965a-859ba0d49bd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:45:00.984086 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cba8a806-5d74-487e-8309-4f690a8e6f45 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.449447 May 28 04:45:00.985220 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1452/2762] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:44:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:45:00.997238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0ce1b312-df02-4fba-9a39-11f2c8ecf131 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:00.998238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0ce1b312-df02-4fba-9a39-11f2c8ecf131 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:01.011024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ce1b312-df02-4fba-9a39-11f2c8ecf131 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:01.011720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ce1b312-df02-4fba-9a39-11f2c8ecf131 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:01.013559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ce1b312-df02-4fba-9a39-11f2c8ecf131 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:01.014235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ce1b312-df02-4fba-9a39-11f2c8ecf131 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:01.248309 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-1f611d3c-8fc5-4ace-8375-832cda14eb49 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] HTTP exception thrown: Floating IP 172.25.2.43 is not associated with instance 73298cda-5cfb-45df-8914-2c76ac9cc70d. May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1f611d3c-8fc5-4ace-8375-832cda14eb49 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Request method failure captured: May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d/action HTTP/1.1 May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 48 May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikah4eKvsiM5Xlel93oE0-8eEQSr_nk7XCjM6kjat7a7KKA2QGHB8CGECKg9ExbfcqycEhZmELsLoS96-NwkDSeuL3OWHioDenioYi3p12DHUnpBFDzNDeYKzvZjmQHHluS1qN5u22uAE3RCxZabV0Ipo8cnplkcQtmr4S8GxxKdTgyQ May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 3c8d3282507f4edabcfe1c87e6a2186c May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-568797371 May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3c8d3282507f4edabcfe1c87e6a2186c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3c8d3282507f4edabcfe1c87e6a2186c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3c8d3282507f4edabcfe1c87e6a2186c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3c8d3282507f4edabcfe1c87e6a2186c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-568797371 May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 3c8d3282507f4edabcfe1c87e6a2186c May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-568797371 May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-FloatingIPsAssociationTestJSON-568797371-project May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 6cec66a6c50340749edc115608c6eeaa May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-568797371-project May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: {"removeFloatingIp": {"address": "172.25.2.43"}} May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: exception: Floating IP 172.25.2.43 is not associated with instance 73298cda-5cfb-45df-8914-2c76ac9cc70d. May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '73298cda-5cfb-45df-8914-2c76ac9cc70d', 'body': {'removeFloatingIp': {'address': '172.25.2.43'}}} May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.43 is not associated with instance 73298cda-5cfb-45df-8914-2c76ac9cc70d. May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.43 is not associated with instance 73298cda-5cfb-45df-8914-2c76ac9cc70d. May 28 04:45:01.261126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:45:01.267787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1f611d3c-8fc5-4ace-8375-832cda14eb49 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Returning 409 to user: Floating IP 172.25.2.43 is not associated with instance 73298cda-5cfb-45df-8914-2c76ac9cc70d. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:45:01.271306 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1f611d3c-8fc5-4ace-8375-832cda14eb49 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "POST /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d/action" status: 409 len: 145 microversion: 2.1 time: 2.462555 May 28 04:45:01.274482 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1311/2763] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:44:58 2022] POST /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d/action => generated 145 bytes in 2478 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 04:45:01.294319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-008b4ba6-dc61-4c45-b2b1-ca414fa41950 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:01.294964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-008b4ba6-dc61-4c45-b2b1-ca414fa41950 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:01.311843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-008b4ba6-dc61-4c45-b2b1-ca414fa41950 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:01.312310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-008b4ba6-dc61-4c45-b2b1-ca414fa41950 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:01.313101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-008b4ba6-dc61-4c45-b2b1-ca414fa41950 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:01.313540 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-008b4ba6-dc61-4c45-b2b1-ca414fa41950 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:01.525460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0ce1b312-df02-4fba-9a39-11f2c8ecf131 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:01.536430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0ce1b312-df02-4fba-9a39-11f2c8ecf131 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:01.542141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0ce1b312-df02-4fba-9a39-11f2c8ecf131 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:01.548477 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0ce1b312-df02-4fba-9a39-11f2c8ecf131 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1873 microversion: 2.42 time: 0.555710 May 28 04:45:01.549328 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1453/2764] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:45:00 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1873 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:45:01.558527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bebd4226-a18e-4759-9700-24928b413523 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:01.561585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bebd4226-a18e-4759-9700-24928b413523 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 265434ea-fb97-43f8-ab64-c1f65c9e42e7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:01.578207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bebd4226-a18e-4759-9700-24928b413523 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:01.578742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bebd4226-a18e-4759-9700-24928b413523 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:01.580439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bebd4226-a18e-4759-9700-24928b413523 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:01.581079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bebd4226-a18e-4759-9700-24928b413523 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:01.817448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-008b4ba6-dc61-4c45-b2b1-ca414fa41950 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883b4a05f5447b78be3f72888ad8138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31adf654f25449ae87a16578bb7930a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:01.825711 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-008b4ba6-dc61-4c45-b2b1-ca414fa41950 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 200 len: 1316 microversion: 2.1 time: 0.550084 May 28 04:45:01.830363 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1312/2765] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:01 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 1316 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:01.839422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-65e84c24-a59b-4050-99c1-67c119342887 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:01.842576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-65e84c24-a59b-4050-99c1-67c119342887 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] [instance: 0caacb3d-0cbd-4983-965a-859ba0d49bd9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:02.134531 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-65e84c24-a59b-4050-99c1-67c119342887 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df06b05648a41529c3c00cb6b37a77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db88d55696c44808cd30751011fed4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:02.143988 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-65e84c24-a59b-4050-99c1-67c119342887 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] 10.222.0.58 "GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9" status: 200 len: 1214 microversion: 2.1 time: 0.312233 May 28 04:45:02.156981 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1313/2766] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:01 2022] GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9 => generated 1214 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:02.164557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-09cd074b-6eaf-4eea-a4a3-09afcd1f654c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.43"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:02.167524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bebd4226-a18e-4759-9700-24928b413523 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:02.185772 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bebd4226-a18e-4759-9700-24928b413523 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7" status: 200 len: 1308 microversion: 2.1 time: 0.632249 May 28 04:45:02.187395 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1454/2767] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:01 2022] GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7 => generated 1308 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:02.353915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-09cd074b-6eaf-4eea-a4a3-09afcd1f654c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:02.364203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09cd074b-6eaf-4eea-a4a3-09afcd1f654c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:02.364674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09cd074b-6eaf-4eea-a4a3-09afcd1f654c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:02.365468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09cd074b-6eaf-4eea-a4a3-09afcd1f654c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:02.366204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09cd074b-6eaf-4eea-a4a3-09afcd1f654c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:02.569569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-23660edd-e0ce-4869-9754-755a542d5f39 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:02.570192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-23660edd-e0ce-4869-9754-755a542d5f39 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:02.578743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-23660edd-e0ce-4869-9754-755a542d5f39 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:02.580117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-23660edd-e0ce-4869-9754-755a542d5f39 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:02.582133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-23660edd-e0ce-4869-9754-755a542d5f39 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:02.582790 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-23660edd-e0ce-4869-9754-755a542d5f39 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:03.207825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09cd074b-6eaf-4eea-a4a3-09afcd1f654c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Acquired lock "refresh_cache-e00cb82d-ba64-497a-96ba-71fe00f0a019" {{(pid=126043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 04:45:03.965935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-23660edd-e0ce-4869-9754-755a542d5f39 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:03.975945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-23660edd-e0ce-4869-9754-755a542d5f39 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:03.977489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-23660edd-e0ce-4869-9754-755a542d5f39 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:03.978950 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-23660edd-e0ce-4869-9754-755a542d5f39 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1873 microversion: 2.42 time: 1.413619 May 28 04:45:03.979557 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1455/2768] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:45:02 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1873 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:45:04.181777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-61323d6e-9073-4ef0-85cd-10271cb8ca6c req-11057b75-20a8-43b3-903a-fc2c9b739a9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07f65390-23fd-4b9f-9777-14f296eb7100", "tag": "8d31a54d-2623-47d5-b060-1331005f3589"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:04.214606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-61323d6e-9073-4ef0-85cd-10271cb8ca6c req-11057b75-20a8-43b3-903a-fc2c9b739a9a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:04.215848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-61323d6e-9073-4ef0-85cd-10271cb8ca6c req-11057b75-20a8-43b3-903a-fc2c9b739a9a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:04.239237 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-61323d6e-9073-4ef0-85cd-10271cb8ca6c req-11057b75-20a8-43b3-903a-fc2c9b739a9a service nova] Creating event network-changed:8d31a54d-2623-47d5-b060-1331005f3589 for instance 07f65390-23fd-4b9f-9777-14f296eb7100 on n-h1-843700-1 May 28 04:45:04.250423 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-61323d6e-9073-4ef0-85cd-10271cb8ca6c req-11057b75-20a8-43b3-903a-fc2c9b739a9a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267861 May 28 04:45:04.251941 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1456/2769] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:04.262298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8dbaa12d-aab3-43be-b232-6e977372d688 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:04.265660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8dbaa12d-aab3-43be-b232-6e977372d688 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:04.279646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8dbaa12d-aab3-43be-b232-6e977372d688 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:04.280271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8dbaa12d-aab3-43be-b232-6e977372d688 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:04.281553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8dbaa12d-aab3-43be-b232-6e977372d688 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:04.282270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8dbaa12d-aab3-43be-b232-6e977372d688 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:04.748091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8dbaa12d-aab3-43be-b232-6e977372d688 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883b4a05f5447b78be3f72888ad8138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31adf654f25449ae87a16578bb7930a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:04.759661 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8dbaa12d-aab3-43be-b232-6e977372d688 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 200 len: 1316 microversion: 2.1 time: 0.506309 May 28 04:45:04.761485 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1457/2770] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:04 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 1316 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:04.780197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-afd06c16-632f-4954-9f40-1c51f300e0f8 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:04.783014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-afd06c16-632f-4954-9f40-1c51f300e0f8 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] [instance: 0caacb3d-0cbd-4983-965a-859ba0d49bd9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:04.791068 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-afd06c16-632f-4954-9f40-1c51f300e0f8 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:04.791921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-afd06c16-632f-4954-9f40-1c51f300e0f8 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:04.792875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-afd06c16-632f-4954-9f40-1c51f300e0f8 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:04.794609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-afd06c16-632f-4954-9f40-1c51f300e0f8 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:04.840380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:45:04.943070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-09cd074b-6eaf-4eea-a4a3-09afcd1f654c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Building network info cache for instance {{(pid=126043) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 28 04:45:04.950229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-afd06c16-632f-4954-9f40-1c51f300e0f8 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df06b05648a41529c3c00cb6b37a77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db88d55696c44808cd30751011fed4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:04.965498 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-afd06c16-632f-4954-9f40-1c51f300e0f8 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] 10.222.0.58 "GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9" status: 200 len: 1274 microversion: 2.1 time: 0.189545 May 28 04:45:04.967364 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1458/2771] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:04 2022] GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9 => generated 1274 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:04.979708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-70ccaea2-971e-44c4-a4c8-537688233dba tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:04.981407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-70ccaea2-971e-44c4-a4c8-537688233dba tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 265434ea-fb97-43f8-ab64-c1f65c9e42e7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:04.994534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70ccaea2-971e-44c4-a4c8-537688233dba tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:04.996457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70ccaea2-971e-44c4-a4c8-537688233dba tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:04.998014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70ccaea2-971e-44c4-a4c8-537688233dba tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:04.998717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70ccaea2-971e-44c4-a4c8-537688233dba tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:05.483867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-70ccaea2-971e-44c4-a4c8-537688233dba tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:05.499569 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-70ccaea2-971e-44c4-a4c8-537688233dba tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7" status: 200 len: 1308 microversion: 2.1 time: 0.529817 May 28 04:45:05.501548 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1459/2772] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:04 2022] GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7 => generated 1308 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:05.510840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d81b26a2-c8e8-4927-b27f-6f5c639f5c30 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:05.513217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d81b26a2-c8e8-4927-b27f-6f5c639f5c30 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:05.540865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d81b26a2-c8e8-4927-b27f-6f5c639f5c30 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:05.541870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d81b26a2-c8e8-4927-b27f-6f5c639f5c30 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:05.542908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d81b26a2-c8e8-4927-b27f-6f5c639f5c30 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:05.544415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d81b26a2-c8e8-4927-b27f-6f5c639f5c30 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:06.145597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d81b26a2-c8e8-4927-b27f-6f5c639f5c30 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:06.159755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d81b26a2-c8e8-4927-b27f-6f5c639f5c30 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:06.161287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d81b26a2-c8e8-4927-b27f-6f5c639f5c30 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:06.162610 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d81b26a2-c8e8-4927-b27f-6f5c639f5c30 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1873 microversion: 2.42 time: 0.658636 May 28 04:45:06.172382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-09cd074b-6eaf-4eea-a4a3-09afcd1f654c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Updating instance_info_cache with network_info: [{"id": "7d1f10a0-da4d-41e6-a729-b21d906423a8", "address": "fa:16:3e:b4:9a:7d", "network": {"id": "9da21411-17dd-4f3c-904b-2ef597d53247", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-86338778-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3c8d3282507f4edabcfe1c87e6a2186c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7d1f10a0-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126043) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 04:45:06.178822 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1460/2773] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:45:05 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1873 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:45:06.187019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9b783a99-7918-4492-996e-a0fdfbc4e6e6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:06.192379 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9b783a99-7918-4492-996e-a0fdfbc4e6e6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:06.195286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b783a99-7918-4492-996e-a0fdfbc4e6e6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:06.195764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b783a99-7918-4492-996e-a0fdfbc4e6e6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:06.196551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b783a99-7918-4492-996e-a0fdfbc4e6e6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:06.196989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b783a99-7918-4492-996e-a0fdfbc4e6e6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:06.243677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09cd074b-6eaf-4eea-a4a3-09afcd1f654c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Releasing lock "refresh_cache-e00cb82d-ba64-497a-96ba-71fe00f0a019" {{(pid=126043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 04:45:06.244772 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-09cd074b-6eaf-4eea-a4a3-09afcd1f654c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "POST /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019/action" status: 202 len: 0 microversion: 2.1 time: 4.084878 May 28 04:45:06.246171 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1314/2774] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:45:02 2022] POST /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019/action => generated 0 bytes in 4088 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 28 04:45:06.253711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-6d18c4c6-99e6-47ec-81e9-4ef8b7100b45 req-59b5bce9-20f0-49d7-907d-af8cd766e705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265434ea-fb97-43f8-ab64-c1f65c9e42e7", "name": "network-vif-plugged", "status": "completed", "tag": "afb98a08-89c9-4c0b-862a-2a876bc56852"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:06.267493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-6d18c4c6-99e6-47ec-81e9-4ef8b7100b45 req-59b5bce9-20f0-49d7-907d-af8cd766e705 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:06.267493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-6d18c4c6-99e6-47ec-81e9-4ef8b7100b45 req-59b5bce9-20f0-49d7-907d-af8cd766e705 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:06.286592 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-6d18c4c6-99e6-47ec-81e9-4ef8b7100b45 req-59b5bce9-20f0-49d7-907d-af8cd766e705 service nova] Creating event network-vif-plugged:afb98a08-89c9-4c0b-862a-2a876bc56852 for instance 265434ea-fb97-43f8-ab64-c1f65c9e42e7 on n-h2-843700-1 May 28 04:45:06.293623 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-6d18c4c6-99e6-47ec-81e9-4ef8b7100b45 req-59b5bce9-20f0-49d7-907d-af8cd766e705 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044403 May 28 04:45:06.294882 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1315/2775] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:06.302582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fd8d54b6-9304-457d-9e40-020362542dde tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:06.334312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fd8d54b6-9304-457d-9e40-020362542dde tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:06.350593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fd8d54b6-9304-457d-9e40-020362542dde tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:06.351336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fd8d54b6-9304-457d-9e40-020362542dde tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:06.353306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fd8d54b6-9304-457d-9e40-020362542dde tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:06.354299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fd8d54b6-9304-457d-9e40-020362542dde tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:06.735137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9b783a99-7918-4492-996e-a0fdfbc4e6e6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:06.743762 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9b783a99-7918-4492-996e-a0fdfbc4e6e6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.560957 May 28 04:45:06.755739 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1461/2776] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:06 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:06.759213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9b7c69b5-c94a-4baf-a906-60b0ec85e7c8 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:06.759619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9b7c69b5-c94a-4baf-a906-60b0ec85e7c8 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] [instance: 0caacb3d-0cbd-4983-965a-859ba0d49bd9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:06.773107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b7c69b5-c94a-4baf-a906-60b0ec85e7c8 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:06.788624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b7c69b5-c94a-4baf-a906-60b0ec85e7c8 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:06.788624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b7c69b5-c94a-4baf-a906-60b0ec85e7c8 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:06.788624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b7c69b5-c94a-4baf-a906-60b0ec85e7c8 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:06.792607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fd8d54b6-9304-457d-9e40-020362542dde tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883b4a05f5447b78be3f72888ad8138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31adf654f25449ae87a16578bb7930a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:06.807560 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fd8d54b6-9304-457d-9e40-020362542dde tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 200 len: 1316 microversion: 2.1 time: 0.511074 May 28 04:45:06.808161 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1316/2777] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:06 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 1316 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:06.822490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9025919c-d66a-448a-9b19-94fa3bf3e492 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:06.823435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9025919c-d66a-448a-9b19-94fa3bf3e492 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:06.834650 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9025919c-d66a-448a-9b19-94fa3bf3e492 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:06.842772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9025919c-d66a-448a-9b19-94fa3bf3e492 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:06.844074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9025919c-d66a-448a-9b19-94fa3bf3e492 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:06.845285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9025919c-d66a-448a-9b19-94fa3bf3e492 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:06.909742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9025919c-d66a-448a-9b19-94fa3bf3e492 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:45:07.230735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9b7c69b5-c94a-4baf-a906-60b0ec85e7c8 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df06b05648a41529c3c00cb6b37a77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db88d55696c44808cd30751011fed4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:07.240806 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9b7c69b5-c94a-4baf-a906-60b0ec85e7c8 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] 10.222.0.58 "GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9" status: 200 len: 1314 microversion: 2.1 time: 0.495278 May 28 04:45:07.241782 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1462/2778] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:06 2022] GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9 => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:07.250012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-bcf47ac2-30a7-4dd7-98b5-28a2253ee110 req-7f2a0450-db25-4fec-bc90-2715ae66b66b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e00cb82d-ba64-497a-96ba-71fe00f0a019", "tag": "7d1f10a0-da4d-41e6-a729-b21d906423a8"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:07.263866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-bcf47ac2-30a7-4dd7-98b5-28a2253ee110 req-7f2a0450-db25-4fec-bc90-2715ae66b66b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:07.264808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-bcf47ac2-30a7-4dd7-98b5-28a2253ee110 req-7f2a0450-db25-4fec-bc90-2715ae66b66b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:07.277875 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-bcf47ac2-30a7-4dd7-98b5-28a2253ee110 req-7f2a0450-db25-4fec-bc90-2715ae66b66b service nova] Creating event network-changed:7d1f10a0-da4d-41e6-a729-b21d906423a8 for instance e00cb82d-ba64-497a-96ba-71fe00f0a019 on n-h1-843700-1 May 28 04:45:07.289244 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-bcf47ac2-30a7-4dd7-98b5-28a2253ee110 req-7f2a0450-db25-4fec-bc90-2715ae66b66b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046136 May 28 04:45:07.293358 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1463/2779] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:07.300482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7a200983-4ae4-430c-88f2-1cb2337efe9c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:07.301371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7a200983-4ae4-430c-88f2-1cb2337efe9c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 265434ea-fb97-43f8-ab64-c1f65c9e42e7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:07.308230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7a200983-4ae4-430c-88f2-1cb2337efe9c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:07.308913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7a200983-4ae4-430c-88f2-1cb2337efe9c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:07.309872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7a200983-4ae4-430c-88f2-1cb2337efe9c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:07.310461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7a200983-4ae4-430c-88f2-1cb2337efe9c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:07.312885 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9025919c-d66a-448a-9b19-94fa3bf3e492 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019" status: 204 len: 0 microversion: 2.1 time: 0.502523 May 28 04:45:07.314358 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1317/2780] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:45:06 2022] DELETE /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:45:07.323935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3d7f9f30-d5d9-4d8f-94af-c129aa560065 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1002756271"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:07.325506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3d7f9f30-d5d9-4d8f-94af-c129aa560065 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:07.334544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3d7f9f30-d5d9-4d8f-94af-c129aa560065 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:07.335055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3d7f9f30-d5d9-4d8f-94af-c129aa560065 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:07.336844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3d7f9f30-d5d9-4d8f-94af-c129aa560065 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:07.337305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3d7f9f30-d5d9-4d8f-94af-c129aa560065 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:07.577018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7a200983-4ae4-430c-88f2-1cb2337efe9c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:07.587889 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7a200983-4ae4-430c-88f2-1cb2337efe9c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7" status: 200 len: 1308 microversion: 2.1 time: 0.293102 May 28 04:45:07.588780 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1464/2781] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:07 2022] GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7 => generated 1308 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:07.594900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a10810b7-2980-497b-85aa-9659aedbb8e2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:07.595794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a10810b7-2980-497b-85aa-9659aedbb8e2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:07.602828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a10810b7-2980-497b-85aa-9659aedbb8e2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:07.610131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a10810b7-2980-497b-85aa-9659aedbb8e2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:07.610131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a10810b7-2980-497b-85aa-9659aedbb8e2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:07.610131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a10810b7-2980-497b-85aa-9659aedbb8e2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:07.830203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a10810b7-2980-497b-85aa-9659aedbb8e2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:07.842922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a10810b7-2980-497b-85aa-9659aedbb8e2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:07.844888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a10810b7-2980-497b-85aa-9659aedbb8e2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:07.846193 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a10810b7-2980-497b-85aa-9659aedbb8e2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1873 microversion: 2.42 time: 0.256143 May 28 04:45:07.847150 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1465/2782] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:45:07 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1873 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:45:08.054637 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3d7f9f30-d5d9-4d8f-94af-c129aa560065 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action" status: 202 len: 0 microversion: 2.1 time: 0.737279 May 28 04:45:08.054637 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1318/2783] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:45:07 2022] POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action => generated 0 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 28 04:45:08.068961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-52bf781c-93a6-4eae-842b-172b9e5c1ba9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.43"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:08.074263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-52bf781c-93a6-4eae-842b-172b9e5c1ba9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:08.097153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52bf781c-93a6-4eae-842b-172b9e5c1ba9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:08.099303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52bf781c-93a6-4eae-842b-172b9e5c1ba9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:08.102939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52bf781c-93a6-4eae-842b-172b9e5c1ba9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:08.103793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52bf781c-93a6-4eae-842b-172b9e5c1ba9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:08.158335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52bf781c-93a6-4eae-842b-172b9e5c1ba9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Acquired lock "refresh_cache-73298cda-5cfb-45df-8914-2c76ac9cc70d" {{(pid=126043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 04:45:08.246347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b440e25b-750e-4327-836a-e8d277c79292 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Action: 'create', calling method: .version_select at 0x7f7700f465e0>, body: {"keypair": {"name": "tempest-keypair-1066120182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzcaIsk+LTb1J4ACQlRpj+3W+T/aCWwo7bJ7Keq0C2yAg0+SGDZS676Kui9VyzXn4MibmpdjCOtKue6SKXxRUtztAxIbkZcJbV4tR0yTQFYsDxnSm690Osxjhi2E58gVw=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:08.304529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=39 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:45:08.312065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-b440e25b-750e-4327-836a-e8d277c79292 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Getting quotas for project d1e7c34036184ea8b80241695fdbf329. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:45:08.352137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-b440e25b-750e-4327-836a-e8d277c79292 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Getting quotas for user 025cb09c79a147b3a648c950edcd1dc3 and project d1e7c34036184ea8b80241695fdbf329. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:45:08.477557 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b440e25b-750e-4327-836a-e8d277c79292 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.617659 May 28 04:45:08.478485 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1466/2784] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:45:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:08.496735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-529cacc2-c34f-4bfd-bff5-2a805fbc5298 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:08.500247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-529cacc2-c34f-4bfd-bff5-2a805fbc5298 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:08.517907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-529cacc2-c34f-4bfd-bff5-2a805fbc5298 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:08.517907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-529cacc2-c34f-4bfd-bff5-2a805fbc5298 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:08.517907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-529cacc2-c34f-4bfd-bff5-2a805fbc5298 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:08.517907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-529cacc2-c34f-4bfd-bff5-2a805fbc5298 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:09.130086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-529cacc2-c34f-4bfd-bff5-2a805fbc5298 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883b4a05f5447b78be3f72888ad8138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31adf654f25449ae87a16578bb7930a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:09.138781 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-529cacc2-c34f-4bfd-bff5-2a805fbc5298 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 200 len: 1316 microversion: 2.1 time: 0.655103 May 28 04:45:09.143654 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1467/2785] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:08 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 1316 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:09.150389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4330ac95-3f85-4a92-84ba-bdf7d3ee4ff0 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:09.155749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4330ac95-3f85-4a92-84ba-bdf7d3ee4ff0 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] [instance: 0caacb3d-0cbd-4983-965a-859ba0d49bd9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:09.176575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4330ac95-3f85-4a92-84ba-bdf7d3ee4ff0 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:09.177321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4330ac95-3f85-4a92-84ba-bdf7d3ee4ff0 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:09.178340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4330ac95-3f85-4a92-84ba-bdf7d3ee4ff0 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:09.178968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4330ac95-3f85-4a92-84ba-bdf7d3ee4ff0 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:10.020990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4330ac95-3f85-4a92-84ba-bdf7d3ee4ff0 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df06b05648a41529c3c00cb6b37a77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db88d55696c44808cd30751011fed4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:10.036260 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4330ac95-3f85-4a92-84ba-bdf7d3ee4ff0 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] 10.222.0.58 "GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9" status: 200 len: 1314 microversion: 2.1 time: 0.891298 May 28 04:45:10.056360 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1468/2786] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:09 2022] GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9 => generated 1314 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:10.293847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-1b662e0c-49d3-4278-a507-7303a8e076ce req-4a613ab4-7b93-475e-b14b-091dd6f0a9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0caacb3d-0cbd-4983-965a-859ba0d49bd9", "tag": "18189ca0-0e47-4e8c-aa80-6d03e35ec814"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:10.323136 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-1b662e0c-49d3-4278-a507-7303a8e076ce req-4a613ab4-7b93-475e-b14b-091dd6f0a9f2 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:10.323944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-1b662e0c-49d3-4278-a507-7303a8e076ce req-4a613ab4-7b93-475e-b14b-091dd6f0a9f2 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:10.339831 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-1b662e0c-49d3-4278-a507-7303a8e076ce req-4a613ab4-7b93-475e-b14b-091dd6f0a9f2 service nova] Creating event network-changed:18189ca0-0e47-4e8c-aa80-6d03e35ec814 for instance 0caacb3d-0cbd-4983-965a-859ba0d49bd9 on n-h2-843700-1 May 28 04:45:10.346618 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-1b662e0c-49d3-4278-a507-7303a8e076ce req-4a613ab4-7b93-475e-b14b-091dd6f0a9f2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.287765 May 28 04:45:10.349936 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1469/2787] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:10.353830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-289f2767-72ac-4de4-94e1-ab5c2cfc6b5b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:10.355342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-289f2767-72ac-4de4-94e1-ab5c2cfc6b5b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 265434ea-fb97-43f8-ab64-c1f65c9e42e7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:10.365315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-289f2767-72ac-4de4-94e1-ab5c2cfc6b5b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:10.366157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-289f2767-72ac-4de4-94e1-ab5c2cfc6b5b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:10.370416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-289f2767-72ac-4de4-94e1-ab5c2cfc6b5b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:10.371798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-289f2767-72ac-4de4-94e1-ab5c2cfc6b5b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:10.784792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:45:10.897846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-289f2767-72ac-4de4-94e1-ab5c2cfc6b5b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:10.909381 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-289f2767-72ac-4de4-94e1-ab5c2cfc6b5b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7" status: 200 len: 1487 microversion: 2.1 time: 0.560140 May 28 04:45:10.912873 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1470/2788] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:10 2022] GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7 => generated 1487 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:10.931273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6aceb09b-4c72-40bc-9b68-bc4b70f525f8 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:10.932078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6aceb09b-4c72-40bc-9b68-bc4b70f525f8 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:10.941050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6aceb09b-4c72-40bc-9b68-bc4b70f525f8 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:10.947273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6aceb09b-4c72-40bc-9b68-bc4b70f525f8 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:10.949406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6aceb09b-4c72-40bc-9b68-bc4b70f525f8 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:10.950116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6aceb09b-4c72-40bc-9b68-bc4b70f525f8 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:11.462266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6aceb09b-4c72-40bc-9b68-bc4b70f525f8 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:11.477797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6aceb09b-4c72-40bc-9b68-bc4b70f525f8 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:11.482902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6aceb09b-4c72-40bc-9b68-bc4b70f525f8 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:11.484204 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6aceb09b-4c72-40bc-9b68-bc4b70f525f8 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1873 microversion: 2.42 time: 0.556804 May 28 04:45:11.490293 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1471/2789] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:45:10 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1873 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:45:11.576856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-52bf781c-93a6-4eae-842b-172b9e5c1ba9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Building network info cache for instance {{(pid=126043) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 28 04:45:11.580005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=83,nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=5,nova_cell1:RELEASE=4,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:45:11.601367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-9120a3d9-e2ad-4e58-b9fe-1d0e0eadf145 req-d238dcb2-c04c-4958-bb89-80990412f7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "name": "network-vif-plugged", "status": "completed", "tag": "44f2f247-628a-486f-b27f-36ae37e73975"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:11.624606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-9120a3d9-e2ad-4e58-b9fe-1d0e0eadf145 req-d238dcb2-c04c-4958-bb89-80990412f7b9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:11.630341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-9120a3d9-e2ad-4e58-b9fe-1d0e0eadf145 req-d238dcb2-c04c-4958-bb89-80990412f7b9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:11.675649 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-9120a3d9-e2ad-4e58-b9fe-1d0e0eadf145 req-d238dcb2-c04c-4958-bb89-80990412f7b9 service nova] Creating event network-vif-plugged:44f2f247-628a-486f-b27f-36ae37e73975 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:45:11.681875 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-9120a3d9-e2ad-4e58-b9fe-1d0e0eadf145 req-d238dcb2-c04c-4958-bb89-80990412f7b9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188500 May 28 04:45:11.682712 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1472/2790] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:11.689426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e6785ba0-e2c6-4a88-8bf0-56da8a1f1922 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:11.691519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e6785ba0-e2c6-4a88-8bf0-56da8a1f1922 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:11.700887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e6785ba0-e2c6-4a88-8bf0-56da8a1f1922 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:11.701636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e6785ba0-e2c6-4a88-8bf0-56da8a1f1922 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:11.702566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e6785ba0-e2c6-4a88-8bf0-56da8a1f1922 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:11.703023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e6785ba0-e2c6-4a88-8bf0-56da8a1f1922 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:11.931229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e6785ba0-e2c6-4a88-8bf0-56da8a1f1922 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883b4a05f5447b78be3f72888ad8138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31adf654f25449ae87a16578bb7930a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:11.944611 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e6785ba0-e2c6-4a88-8bf0-56da8a1f1922 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 200 len: 1316 microversion: 2.1 time: 0.260529 May 28 04:45:11.945207 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1473/2791] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:11 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 1316 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:11.963939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-2e9a31e2-0cf1-428a-9b9b-7555d885ef7e req-8259a792-7f04-4da2-a307-6da03b338381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e00cb82d-ba64-497a-96ba-71fe00f0a019", "name": "network-vif-deleted", "tag": "7d1f10a0-da4d-41e6-a729-b21d906423a8"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:11.972745 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2e9a31e2-0cf1-428a-9b9b-7555d885ef7e req-8259a792-7f04-4da2-a307-6da03b338381 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:11.973486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2e9a31e2-0cf1-428a-9b9b-7555d885ef7e req-8259a792-7f04-4da2-a307-6da03b338381 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:12.011694 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-2e9a31e2-0cf1-428a-9b9b-7555d885ef7e req-8259a792-7f04-4da2-a307-6da03b338381 service nova] Creating event network-vif-deleted:7d1f10a0-da4d-41e6-a729-b21d906423a8 for instance e00cb82d-ba64-497a-96ba-71fe00f0a019 on n-h1-843700-1 May 28 04:45:12.031717 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-2e9a31e2-0cf1-428a-9b9b-7555d885ef7e req-8259a792-7f04-4da2-a307-6da03b338381 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085275 May 28 04:45:12.037364 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1474/2792] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:12.045980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fc20003f-a7d7-4322-b533-8402b8c32c04 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:12.051996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fc20003f-a7d7-4322-b533-8402b8c32c04 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 265434ea-fb97-43f8-ab64-c1f65c9e42e7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:12.070099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc20003f-a7d7-4322-b533-8402b8c32c04 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:12.072425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc20003f-a7d7-4322-b533-8402b8c32c04 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:12.073451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc20003f-a7d7-4322-b533-8402b8c32c04 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:12.075033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc20003f-a7d7-4322-b533-8402b8c32c04 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:12.144879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:45:12.423581 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fc20003f-a7d7-4322-b533-8402b8c32c04 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "POST /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7/action" status: 202 len: 0 microversion: 2.1 time: 0.384389 May 28 04:45:12.440403 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1475/2793] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:45:12 2022] POST /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:45:12.463207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0b00ddea-ab39-4969-945a-9935871ad5ed tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:12.464612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0b00ddea-ab39-4969-945a-9935871ad5ed tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] [instance: 0caacb3d-0cbd-4983-965a-859ba0d49bd9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:12.484351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b00ddea-ab39-4969-945a-9935871ad5ed tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:12.485553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b00ddea-ab39-4969-945a-9935871ad5ed tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:12.491113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b00ddea-ab39-4969-945a-9935871ad5ed tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:12.491867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b00ddea-ab39-4969-945a-9935871ad5ed tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:12.849953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-52bf781c-93a6-4eae-842b-172b9e5c1ba9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Updating instance_info_cache with network_info: [{"id": "03b825a9-d5e4-41b3-b80b-08b10632a298", "address": "fa:16:3e:20:bd:c4", "network": {"id": "9da21411-17dd-4f3c-904b-2ef597d53247", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-86338778-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3c8d3282507f4edabcfe1c87e6a2186c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap03b825a9-d5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126043) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 04:45:12.910750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0b00ddea-ab39-4969-945a-9935871ad5ed tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df06b05648a41529c3c00cb6b37a77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db88d55696c44808cd30751011fed4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:12.922435 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0b00ddea-ab39-4969-945a-9935871ad5ed tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] 10.222.0.58 "GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9" status: 200 len: 1314 microversion: 2.1 time: 0.476098 May 28 04:45:12.931087 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1476/2794] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:12 2022] GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:12.940280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-36c42057-5a9d-488d-957e-a50afce41883 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:12.943550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-36c42057-5a9d-488d-957e-a50afce41883 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 265434ea-fb97-43f8-ab64-c1f65c9e42e7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:12.957300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36c42057-5a9d-488d-957e-a50afce41883 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:12.959452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36c42057-5a9d-488d-957e-a50afce41883 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:12.960516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36c42057-5a9d-488d-957e-a50afce41883 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:12.963366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36c42057-5a9d-488d-957e-a50afce41883 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:13.008471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:45:13.043200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52bf781c-93a6-4eae-842b-172b9e5c1ba9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Releasing lock "refresh_cache-73298cda-5cfb-45df-8914-2c76ac9cc70d" {{(pid=126043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 04:45:13.044075 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-52bf781c-93a6-4eae-842b-172b9e5c1ba9 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "POST /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d/action" status: 202 len: 0 microversion: 2.1 time: 4.988451 May 28 04:45:13.046346 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1319/2795] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:45:08 2022] POST /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d/action => generated 0 bytes in 4992 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 28 04:45:13.053911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2df36311-5827-4d04-b684-ed7c0d28e0dc tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:13.054718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2df36311-5827-4d04-b684-ed7c0d28e0dc tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:13.071675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2df36311-5827-4d04-b684-ed7c0d28e0dc tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:13.072378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2df36311-5827-4d04-b684-ed7c0d28e0dc tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:13.073386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2df36311-5827-4d04-b684-ed7c0d28e0dc tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:13.074207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2df36311-5827-4d04-b684-ed7c0d28e0dc tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:13.409297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-36c42057-5a9d-488d-957e-a50afce41883 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:13.422798 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-36c42057-5a9d-488d-957e-a50afce41883 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7" status: 200 len: 1492 microversion: 2.1 time: 0.490367 May 28 04:45:13.423432 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1477/2796] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:12 2022] GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7 => generated 1492 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:13.438972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-71c0a1af-7f60-4693-b313-c259adb742dc tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:13.442836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-71c0a1af-7f60-4693-b313-c259adb742dc tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:13.455729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71c0a1af-7f60-4693-b313-c259adb742dc tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:13.456188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71c0a1af-7f60-4693-b313-c259adb742dc tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:13.456967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71c0a1af-7f60-4693-b313-c259adb742dc tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:13.457408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71c0a1af-7f60-4693-b313-c259adb742dc tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:13.469102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2df36311-5827-4d04-b684-ed7c0d28e0dc tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:13.486351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2df36311-5827-4d04-b684-ed7c0d28e0dc tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:13.488834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2df36311-5827-4d04-b684-ed7c0d28e0dc tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:13.490415 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2df36311-5827-4d04-b684-ed7c0d28e0dc tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1873 microversion: 2.42 time: 0.442745 May 28 04:45:13.491252 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1320/2797] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:45:13 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1873 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:45:13.499145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-73e40b6a-4015-4d58-8c26-86839c5668dd tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '.version_select at 0x7f7701145b80>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:13.784649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-71c0a1af-7f60-4693-b313-c259adb742dc tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883b4a05f5447b78be3f72888ad8138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31adf654f25449ae87a16578bb7930a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:13.796399 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-71c0a1af-7f60-4693-b313-c259adb742dc tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 200 len: 1316 microversion: 2.1 time: 0.371506 May 28 04:45:13.797120 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1478/2798] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:13 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 1316 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:13.823725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-175a9d23-9e7f-47d4-ae2d-9aec9f6b6dea tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-628844011", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c0754133-921a-4aba-8b6d-6a18d70e57ec"}], "security_groups": [{"name": "tempest-securitygroup--61459881"}], "key_name": "tempest-keypair-1066120182", "user_data": "}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:13.846424 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-73e40b6a-4015-4d58-8c26-86839c5668dd tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/29f87255-ddfd-49fe-abd4-370dc0b8a4e6" status: 200 len: 184 microversion: 2.1 time: 0.351195 May 28 04:45:13.852058 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1321/2799] 10.222.0.58 () {58 vars in 1259 bytes} [Sat May 28 04:45:13 2022] GET /compute/v2.1/os-floating-ips/29f87255-ddfd-49fe-abd4-370dc0b8a4e6 => generated 184 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:13.859792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-553f92f4-edbc-4814-bb54-1945799847fb tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.43"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:14.093050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-175a9d23-9e7f-47d4-ae2d-9aec9f6b6dea tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] validate_networks() for [('c0754133-921a-4aba-8b6d-6a18d70e57ec', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:45:14.127605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-553f92f4-edbc-4814-bb54-1945799847fb tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:14.135430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-553f92f4-edbc-4814-bb54-1945799847fb tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:14.135792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-553f92f4-edbc-4814-bb54-1945799847fb tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:14.136596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-553f92f4-edbc-4814-bb54-1945799847fb tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:14.137042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-553f92f4-edbc-4814-bb54-1945799847fb tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:14.665351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-553f92f4-edbc-4814-bb54-1945799847fb tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Acquired lock "refresh_cache-73298cda-5cfb-45df-8914-2c76ac9cc70d" {{(pid=126043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 04:45:15.372772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-175a9d23-9e7f-47d4-ae2d-9aec9f6b6dea tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:45:15.373799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-175a9d23-9e7f-47d4-ae2d-9aec9f6b6dea tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:45:15.374441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-175a9d23-9e7f-47d4-ae2d-9aec9f6b6dea tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:45:15.375070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-175a9d23-9e7f-47d4-ae2d-9aec9f6b6dea tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:45:15.375863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-175a9d23-9e7f-47d4-ae2d-9aec9f6b6dea tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:45:15.389617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-175a9d23-9e7f-47d4-ae2d-9aec9f6b6dea tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:15.392832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-175a9d23-9e7f-47d4-ae2d-9aec9f6b6dea tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:15.396146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-175a9d23-9e7f-47d4-ae2d-9aec9f6b6dea tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:15.396146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-175a9d23-9e7f-47d4-ae2d-9aec9f6b6dea tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:15.441086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-175a9d23-9e7f-47d4-ae2d-9aec9f6b6dea tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Getting quotas for project d1e7c34036184ea8b80241695fdbf329. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:45:15.449119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-175a9d23-9e7f-47d4-ae2d-9aec9f6b6dea tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Getting quotas for user 025cb09c79a147b3a648c950edcd1dc3 and project d1e7c34036184ea8b80241695fdbf329. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:45:15.467311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-175a9d23-9e7f-47d4-ae2d-9aec9f6b6dea tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:45:15.470343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-175a9d23-9e7f-47d4-ae2d-9aec9f6b6dea tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:45:15.598715 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-175a9d23-9e7f-47d4-ae2d-9aec9f6b6dea tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.785701 May 28 04:45:15.605878 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1479/2800] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:45:13 2022] POST /compute/v2.1/servers => generated 400 bytes in 1804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:45:15.613718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-193617c3-fd9d-45a1-9950-9a06baefc672 req-e4e10b7d-3405-4b24-adc9-f0bfc3bb9c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "215a4357-1792-4f6e-ae11-f8574b806b73", "name": "network-vif-unplugged", "status": "completed", "tag": "f007cebf-d19d-420d-891d-de3291249844"}, {"server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "name": "network-vif-plugged", "status": "completed", "tag": "50e6b87b-0119-4477-a5c5-db24e4c2100a"}, {"server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "name": "network-vif-plugged", "status": "completed", "tag": "7fd4ecfb-9cd8-421b-9764-156bfec85136"}, {"server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "name": "network-vif-plugged", "status": "completed", "tag": "b1d39698-47fc-43c1-928b-c95c094c9118"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:15.648816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-193617c3-fd9d-45a1-9950-9a06baefc672 req-e4e10b7d-3405-4b24-adc9-f0bfc3bb9c72 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:15.652386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-193617c3-fd9d-45a1-9950-9a06baefc672 req-e4e10b7d-3405-4b24-adc9-f0bfc3bb9c72 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:15.681392 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-193617c3-fd9d-45a1-9950-9a06baefc672 req-e4e10b7d-3405-4b24-adc9-f0bfc3bb9c72 service nova] Creating event network-vif-unplugged:f007cebf-d19d-420d-891d-de3291249844 for instance 215a4357-1792-4f6e-ae11-f8574b806b73 on n-h2-843700-1 May 28 04:45:15.683103 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-193617c3-fd9d-45a1-9950-9a06baefc672 req-e4e10b7d-3405-4b24-adc9-f0bfc3bb9c72 service nova] Creating event network-vif-plugged:50e6b87b-0119-4477-a5c5-db24e4c2100a for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:45:15.684710 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-193617c3-fd9d-45a1-9950-9a06baefc672 req-e4e10b7d-3405-4b24-adc9-f0bfc3bb9c72 service nova] Creating event network-vif-plugged:7fd4ecfb-9cd8-421b-9764-156bfec85136 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:45:15.685510 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-193617c3-fd9d-45a1-9950-9a06baefc672 req-e4e10b7d-3405-4b24-adc9-f0bfc3bb9c72 service nova] Creating event network-vif-plugged:b1d39698-47fc-43c1-928b-c95c094c9118 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:45:15.718490 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-193617c3-fd9d-45a1-9950-9a06baefc672 req-e4e10b7d-3405-4b24-adc9-f0bfc3bb9c72 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.109739 May 28 04:45:15.722300 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1480/2801] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:15.734883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-718e8deb-d8b0-4df0-a3d5-70bd10aacf5a tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:15.741987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-718e8deb-d8b0-4df0-a3d5-70bd10aacf5a tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] [instance: 0caacb3d-0cbd-4983-965a-859ba0d49bd9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:15.755328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-718e8deb-d8b0-4df0-a3d5-70bd10aacf5a tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:15.756479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-718e8deb-d8b0-4df0-a3d5-70bd10aacf5a tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:15.759682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-718e8deb-d8b0-4df0-a3d5-70bd10aacf5a tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:15.761140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-718e8deb-d8b0-4df0-a3d5-70bd10aacf5a tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:16.271745 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-718e8deb-d8b0-4df0-a3d5-70bd10aacf5a tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df06b05648a41529c3c00cb6b37a77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db88d55696c44808cd30751011fed4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:16.284555 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-718e8deb-d8b0-4df0-a3d5-70bd10aacf5a tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] 10.222.0.58 "GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9" status: 200 len: 1314 microversion: 2.1 time: 0.558994 May 28 04:45:16.285564 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1481/2802] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:15 2022] GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:16.298589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-b36079e5-34a8-4d4a-83ff-c6f57e900e68 req-80cc0779-c49c-4a89-9016-448bd3de88d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73298cda-5cfb-45df-8914-2c76ac9cc70d", "tag": "03b825a9-d5e4-41b3-b80b-08b10632a298"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:16.332032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b36079e5-34a8-4d4a-83ff-c6f57e900e68 req-80cc0779-c49c-4a89-9016-448bd3de88d8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:16.333474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b36079e5-34a8-4d4a-83ff-c6f57e900e68 req-80cc0779-c49c-4a89-9016-448bd3de88d8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:16.359612 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-b36079e5-34a8-4d4a-83ff-c6f57e900e68 req-80cc0779-c49c-4a89-9016-448bd3de88d8 service nova] Creating event network-changed:03b825a9-d5e4-41b3-b80b-08b10632a298 for instance 73298cda-5cfb-45df-8914-2c76ac9cc70d on n-h2-843700-1 May 28 04:45:16.370332 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-b36079e5-34a8-4d4a-83ff-c6f57e900e68 req-80cc0779-c49c-4a89-9016-448bd3de88d8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080531 May 28 04:45:16.372464 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1482/2803] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:16.383916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a627f7d2-2f68-41b2-af58-f85d1cdbdfa0 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:16.386663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a627f7d2-2f68-41b2-af58-f85d1cdbdfa0 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 265434ea-fb97-43f8-ab64-c1f65c9e42e7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:16.404452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a627f7d2-2f68-41b2-af58-f85d1cdbdfa0 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:16.405162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a627f7d2-2f68-41b2-af58-f85d1cdbdfa0 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:16.408644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a627f7d2-2f68-41b2-af58-f85d1cdbdfa0 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:16.409292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a627f7d2-2f68-41b2-af58-f85d1cdbdfa0 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:16.888848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-553f92f4-edbc-4814-bb54-1945799847fb tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Building network info cache for instance {{(pid=126043) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 28 04:45:16.908282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a627f7d2-2f68-41b2-af58-f85d1cdbdfa0 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:16.917441 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a627f7d2-2f68-41b2-af58-f85d1cdbdfa0 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7" status: 200 len: 1472 microversion: 2.1 time: 0.543734 May 28 04:45:16.921156 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1483/2804] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:16 2022] GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7 => generated 1472 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:16.950153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7d499976-4599-417f-9281-33c5be2317b0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:16.950153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7d499976-4599-417f-9281-33c5be2317b0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:16.953383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d499976-4599-417f-9281-33c5be2317b0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:16.954219 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d499976-4599-417f-9281-33c5be2317b0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:16.958609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d499976-4599-417f-9281-33c5be2317b0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:16.958609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d499976-4599-417f-9281-33c5be2317b0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:17.538090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7d499976-4599-417f-9281-33c5be2317b0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:17.555058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7d499976-4599-417f-9281-33c5be2317b0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:17.558823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7d499976-4599-417f-9281-33c5be2317b0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:17.561263 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7d499976-4599-417f-9281-33c5be2317b0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1873 microversion: 2.42 time: 0.637567 May 28 04:45:17.573433 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1484/2805] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:45:16 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1873 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:45:17.590904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-68cac7cd-e1a0-438e-9be3-9c61554c50d2 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:17.593019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-68cac7cd-e1a0-438e-9be3-9c61554c50d2 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:17.609457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68cac7cd-e1a0-438e-9be3-9c61554c50d2 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:17.623748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68cac7cd-e1a0-438e-9be3-9c61554c50d2 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:17.626137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68cac7cd-e1a0-438e-9be3-9c61554c50d2 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:17.627674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68cac7cd-e1a0-438e-9be3-9c61554c50d2 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:17.986341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-553f92f4-edbc-4814-bb54-1945799847fb tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Updating instance_info_cache with network_info: [{"id": "03b825a9-d5e4-41b3-b80b-08b10632a298", "address": "fa:16:3e:20:bd:c4", "network": {"id": "9da21411-17dd-4f3c-904b-2ef597d53247", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-86338778-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3c8d3282507f4edabcfe1c87e6a2186c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap03b825a9-d5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126043) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 04:45:18.014139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-68cac7cd-e1a0-438e-9be3-9c61554c50d2 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883b4a05f5447b78be3f72888ad8138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31adf654f25449ae87a16578bb7930a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:18.025114 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-68cac7cd-e1a0-438e-9be3-9c61554c50d2 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 200 len: 1316 microversion: 2.1 time: 0.450501 May 28 04:45:18.035399 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1485/2806] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:17 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:18.035399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cdcb5412-1487-41eb-9aa2-1bcd92742d65 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:18.035399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cdcb5412-1487-41eb-9aa2-1bcd92742d65 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:18.057147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cdcb5412-1487-41eb-9aa2-1bcd92742d65 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:18.064079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cdcb5412-1487-41eb-9aa2-1bcd92742d65 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:18.064079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cdcb5412-1487-41eb-9aa2-1bcd92742d65 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:18.064079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cdcb5412-1487-41eb-9aa2-1bcd92742d65 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:18.137843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cdcb5412-1487-41eb-9aa2-1bcd92742d65 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:18.148254 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cdcb5412-1487-41eb-9aa2-1bcd92742d65 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52" status: 200 len: 1237 microversion: 2.1 time: 0.120417 May 28 04:45:18.160100 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1486/2807] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:18 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52 => generated 1237 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:18.165211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-94773c7d-29f7-45e1-9e7b-ef4db8e350e1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1227879706"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:18.166332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-94773c7d-29f7-45e1-9e7b-ef4db8e350e1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 265434ea-fb97-43f8-ab64-c1f65c9e42e7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:18.172680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:45:18.174388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-94773c7d-29f7-45e1-9e7b-ef4db8e350e1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:18.174844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-94773c7d-29f7-45e1-9e7b-ef4db8e350e1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:18.175678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-94773c7d-29f7-45e1-9e7b-ef4db8e350e1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:18.176119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-94773c7d-29f7-45e1-9e7b-ef4db8e350e1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:18.231129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-553f92f4-edbc-4814-bb54-1945799847fb tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Releasing lock "refresh_cache-73298cda-5cfb-45df-8914-2c76ac9cc70d" {{(pid=126043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 04:45:18.232001 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-553f92f4-edbc-4814-bb54-1945799847fb tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "POST /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d/action" status: 202 len: 0 microversion: 2.1 time: 4.376270 May 28 04:45:18.232660 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1322/2808] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:45:13 2022] POST /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d/action => generated 0 bytes in 4377 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 28 04:45:18.240591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-345a5262-27b1-4809-804b-6a1542b51ff1 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:18.241145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-345a5262-27b1-4809-804b-6a1542b51ff1 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] [instance: 0caacb3d-0cbd-4983-965a-859ba0d49bd9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:18.257999 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-345a5262-27b1-4809-804b-6a1542b51ff1 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:18.264620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-345a5262-27b1-4809-804b-6a1542b51ff1 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:18.264620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-345a5262-27b1-4809-804b-6a1542b51ff1 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:18.264620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-345a5262-27b1-4809-804b-6a1542b51ff1 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:18.534537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-345a5262-27b1-4809-804b-6a1542b51ff1 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df06b05648a41529c3c00cb6b37a77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db88d55696c44808cd30751011fed4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:18.540572 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-345a5262-27b1-4809-804b-6a1542b51ff1 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] 10.222.0.58 "GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9" status: 200 len: 1314 microversion: 2.1 time: 0.304837 May 28 04:45:18.541913 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1323/2809] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:18 2022] GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:18.548080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-e8fb9932-028d-4a7e-819c-b80617639ea1 req-25c5c249-46d1-44e7-bc01-28b8e6a0c011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "name": "network-vif-plugged", "status": "completed", "tag": "6afb08ab-967d-491b-a721-74903258c9b2"}, {"server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "name": "network-vif-plugged", "status": "completed", "tag": "5dc343f6-efc0-48aa-9ea2-32a0164b02a4"}, {"server_uuid": "215a4357-1792-4f6e-ae11-f8574b806b73", "name": "network-vif-plugged", "status": "completed", "tag": "f007cebf-d19d-420d-891d-de3291249844"}, {"server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "name": "network-vif-plugged", "status": "completed", "tag": "1643fa1a-bc92-4b3e-9108-5707b60a8b27"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:18.560704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-e8fb9932-028d-4a7e-819c-b80617639ea1 req-25c5c249-46d1-44e7-bc01-28b8e6a0c011 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:18.564651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-e8fb9932-028d-4a7e-819c-b80617639ea1 req-25c5c249-46d1-44e7-bc01-28b8e6a0c011 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:18.586089 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-e8fb9932-028d-4a7e-819c-b80617639ea1 req-25c5c249-46d1-44e7-bc01-28b8e6a0c011 service nova] Creating event network-vif-plugged:6afb08ab-967d-491b-a721-74903258c9b2 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:45:18.587057 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-e8fb9932-028d-4a7e-819c-b80617639ea1 req-25c5c249-46d1-44e7-bc01-28b8e6a0c011 service nova] Creating event network-vif-plugged:5dc343f6-efc0-48aa-9ea2-32a0164b02a4 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:45:18.587742 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-e8fb9932-028d-4a7e-819c-b80617639ea1 req-25c5c249-46d1-44e7-bc01-28b8e6a0c011 service nova] Creating event network-vif-plugged:f007cebf-d19d-420d-891d-de3291249844 for instance 215a4357-1792-4f6e-ae11-f8574b806b73 on n-h2-843700-1 May 28 04:45:18.588406 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-e8fb9932-028d-4a7e-819c-b80617639ea1 req-25c5c249-46d1-44e7-bc01-28b8e6a0c011 service nova] Creating event network-vif-plugged:1643fa1a-bc92-4b3e-9108-5707b60a8b27 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:45:18.612650 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-e8fb9932-028d-4a7e-819c-b80617639ea1 req-25c5c249-46d1-44e7-bc01-28b8e6a0c011 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.069333 May 28 04:45:18.615753 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1324/2810] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:18.624834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d5957bea-f37d-49ba-9395-c969311b4a3c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:18.627700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d5957bea-f37d-49ba-9395-c969311b4a3c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:18.642768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5957bea-f37d-49ba-9395-c969311b4a3c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:18.644015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5957bea-f37d-49ba-9395-c969311b4a3c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:18.644981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5957bea-f37d-49ba-9395-c969311b4a3c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:18.646381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5957bea-f37d-49ba-9395-c969311b4a3c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:18.667810 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-d5957bea-f37d-49ba-9395-c969311b4a3c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] HTTP exception thrown: Instance e00cb82d-ba64-497a-96ba-71fe00f0a019 could not be found. May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d5957bea-f37d-49ba-9395-c969311b4a3c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Request method failure captured: May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019 HTTP/1.1 May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikah4eKvsiM5Xlel93oE0-8eEQSr_nk7XCjM6kjat7a7KKA2QGHB8CGECKg9ExbfcqycEhZmELsLoS96-NwkDSeuL3OWHioDenioYi3p12DHUnpBFDzNDeYKzvZjmQHHluS1qN5u22uAE3RCxZabV0Ipo8cnplkcQtmr4S8GxxKdTgyQ May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 3c8d3282507f4edabcfe1c87e6a2186c May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-568797371 May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3c8d3282507f4edabcfe1c87e6a2186c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3c8d3282507f4edabcfe1c87e6a2186c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3c8d3282507f4edabcfe1c87e6a2186c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3c8d3282507f4edabcfe1c87e6a2186c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-568797371 May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 3c8d3282507f4edabcfe1c87e6a2186c May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-568797371 May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-FloatingIPsAssociationTestJSON-568797371-project May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 6cec66a6c50340749edc115608c6eeaa May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-568797371-project May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance e00cb82d-ba64-497a-96ba-71fe00f0a019 could not be found. May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'e00cb82d-ba64-497a-96ba-71fe00f0a019'} May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e00cb82d-ba64-497a-96ba-71fe00f0a019 could not be found. May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:45:18.671507 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:45:18.675547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e00cb82d-ba64-497a-96ba-71fe00f0a019 could not be found. May 28 04:45:18.675547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:45:18.675547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:45:18.675547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:45:18.675547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:45:18.675547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:45:18.675547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:45:18.675547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:45:18.675547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:45:18.675547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e00cb82d-ba64-497a-96ba-71fe00f0a019 could not be found. May 28 04:45:18.675547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:45:18.677839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d5957bea-f37d-49ba-9395-c969311b4a3c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Returning 404 to user: Instance e00cb82d-ba64-497a-96ba-71fe00f0a019 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:45:18.679600 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d5957bea-f37d-49ba-9395-c969311b4a3c tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019" status: 404 len: 111 microversion: 2.1 time: 0.061965 May 28 04:45:18.682286 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1325/2811] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:45:18 2022] DELETE /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:45:18.688605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-715f8a00-1006-4596-8580-8dec3af850f9 req-749c404d-aea2-4d55-b16f-d16f365a0559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73298cda-5cfb-45df-8914-2c76ac9cc70d", "tag": "03b825a9-d5e4-41b3-b80b-08b10632a298"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:18.732959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-715f8a00-1006-4596-8580-8dec3af850f9 req-749c404d-aea2-4d55-b16f-d16f365a0559 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:18.732959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-715f8a00-1006-4596-8580-8dec3af850f9 req-749c404d-aea2-4d55-b16f-d16f365a0559 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:18.732959 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-715f8a00-1006-4596-8580-8dec3af850f9 req-749c404d-aea2-4d55-b16f-d16f365a0559 service nova] Creating event network-changed:03b825a9-d5e4-41b3-b80b-08b10632a298 for instance 73298cda-5cfb-45df-8914-2c76ac9cc70d on n-h2-843700-1 May 28 04:45:18.732959 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-715f8a00-1006-4596-8580-8dec3af850f9 req-749c404d-aea2-4d55-b16f-d16f365a0559 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041306 May 28 04:45:18.732959 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1326/2812] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:18.738348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-86f8de72-d767-4210-8d87-aaa55d385262 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:18.739624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-86f8de72-d767-4210-8d87-aaa55d385262 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:18.747255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-86f8de72-d767-4210-8d87-aaa55d385262 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:18.748010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-86f8de72-d767-4210-8d87-aaa55d385262 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:18.749275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-86f8de72-d767-4210-8d87-aaa55d385262 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:18.749916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-86f8de72-d767-4210-8d87-aaa55d385262 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:19.039028 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-94773c7d-29f7-45e1-9e7b-ef4db8e350e1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "POST /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7/action" status: 202 len: 0 microversion: 2.1 time: 0.877298 May 28 04:45:19.043598 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1487/2813] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:45:18 2022] POST /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7/action => generated 0 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 04:45:19.068196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c08fed45-751e-4f2b-9b26-b548dd77a140 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:19.083135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c08fed45-751e-4f2b-9b26-b548dd77a140 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: e00cb82d-ba64-497a-96ba-71fe00f0a019] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:19.099213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c08fed45-751e-4f2b-9b26-b548dd77a140 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:19.126789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c08fed45-751e-4f2b-9b26-b548dd77a140 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:19.131548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c08fed45-751e-4f2b-9b26-b548dd77a140 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:19.131548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c08fed45-751e-4f2b-9b26-b548dd77a140 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:19.206944 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-c08fed45-751e-4f2b-9b26-b548dd77a140 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] HTTP exception thrown: Instance e00cb82d-ba64-497a-96ba-71fe00f0a019 could not be found. May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c08fed45-751e-4f2b-9b26-b548dd77a140 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Request method failure captured: May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019 HTTP/1.1 May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikah4eKvsiM5Xlel93oE0-8eEQSr_nk7XCjM6kjat7a7KKA2QGHB8CGECKg9ExbfcqycEhZmELsLoS96-NwkDSeuL3OWHioDenioYi3p12DHUnpBFDzNDeYKzvZjmQHHluS1qN5u22uAE3RCxZabV0Ipo8cnplkcQtmr4S8GxxKdTgyQ May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 3c8d3282507f4edabcfe1c87e6a2186c May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-568797371 May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3c8d3282507f4edabcfe1c87e6a2186c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3c8d3282507f4edabcfe1c87e6a2186c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3c8d3282507f4edabcfe1c87e6a2186c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3c8d3282507f4edabcfe1c87e6a2186c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-568797371 May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 3c8d3282507f4edabcfe1c87e6a2186c May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-568797371 May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-FloatingIPsAssociationTestJSON-568797371-project May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 6cec66a6c50340749edc115608c6eeaa May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-568797371-project May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance e00cb82d-ba64-497a-96ba-71fe00f0a019 could not be found. May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'e00cb82d-ba64-497a-96ba-71fe00f0a019'} May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e00cb82d-ba64-497a-96ba-71fe00f0a019 could not be found. May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e00cb82d-ba64-497a-96ba-71fe00f0a019 could not be found. May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:45:19.224600 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:45:19.228870 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:45:19.228870 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:45:19.228870 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:45:19.228870 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:45:19.228870 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:45:19.228870 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:45:19.228870 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e00cb82d-ba64-497a-96ba-71fe00f0a019 could not be found. May 28 04:45:19.228870 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:45:19.236024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c08fed45-751e-4f2b-9b26-b548dd77a140 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Returning 404 to user: Instance e00cb82d-ba64-497a-96ba-71fe00f0a019 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:45:19.239405 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c08fed45-751e-4f2b-9b26-b548dd77a140 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019" status: 404 len: 111 microversion: 2.1 time: 0.193745 May 28 04:45:19.245415 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1488/2814] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:19 2022] GET /compute/v2.1/servers/e00cb82d-ba64-497a-96ba-71fe00f0a019 => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:45:19.259329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-03a526a8-7a0d-427e-9931-e1e0091370ba tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:19.274372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-03a526a8-7a0d-427e-9931-e1e0091370ba tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:19.303222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03a526a8-7a0d-427e-9931-e1e0091370ba tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:19.304829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03a526a8-7a0d-427e-9931-e1e0091370ba tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:19.306907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03a526a8-7a0d-427e-9931-e1e0091370ba tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:19.308729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03a526a8-7a0d-427e-9931-e1e0091370ba tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:19.343926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-86f8de72-d767-4210-8d87-aaa55d385262 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:19.359944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-86f8de72-d767-4210-8d87-aaa55d385262 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:19.369649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-86f8de72-d767-4210-8d87-aaa55d385262 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:19.369649 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-86f8de72-d767-4210-8d87-aaa55d385262 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1873 microversion: 2.42 time: 0.633198 May 28 04:45:19.369649 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1327/2815] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:45:18 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1873 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:45:19.369649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1ed97159-8717-48be-b98a-f61ab2f0005f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700cd3d30>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:19.465912 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1ed97159-8717-48be-b98a-f61ab2f0005f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da" status: 200 len: 1412 microversion: 2.1 time: 0.100400 May 28 04:45:19.487648 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1328/2816] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:45:19 2022] GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da => generated 1412 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:19.513362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-69fe7956-3398-4c10-993e-9e732dae97c0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:19.518480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-69fe7956-3398-4c10-993e-9e732dae97c0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:19.541408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-69fe7956-3398-4c10-993e-9e732dae97c0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:19.542312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-69fe7956-3398-4c10-993e-9e732dae97c0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:19.543423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-69fe7956-3398-4c10-993e-9e732dae97c0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:19.544053 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-69fe7956-3398-4c10-993e-9e732dae97c0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:19.656516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-03a526a8-7a0d-427e-9931-e1e0091370ba tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883b4a05f5447b78be3f72888ad8138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31adf654f25449ae87a16578bb7930a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:19.668835 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-03a526a8-7a0d-427e-9931-e1e0091370ba tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 200 len: 1316 microversion: 2.1 time: 0.421336 May 28 04:45:19.669428 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1489/2817] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:19 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 1316 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:19.684640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-63ab9928-7949-495f-82b1-6908912e97d5 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '.version_select at 0x7f7700fefee0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:19.765929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-69fe7956-3398-4c10-993e-9e732dae97c0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:19.778603 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-69fe7956-3398-4c10-993e-9e732dae97c0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52" status: 200 len: 1311 microversion: 2.1 time: 0.286265 May 28 04:45:19.779848 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1329/2818] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:19 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52 => generated 1311 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:19.785961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2b9e20c5-a5c8-4922-8f85-fa3415189061 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:19.786785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2b9e20c5-a5c8-4922-8f85-fa3415189061 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] [instance: 0caacb3d-0cbd-4983-965a-859ba0d49bd9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:19.794655 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b9e20c5-a5c8-4922-8f85-fa3415189061 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:19.795435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b9e20c5-a5c8-4922-8f85-fa3415189061 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:19.801097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b9e20c5-a5c8-4922-8f85-fa3415189061 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:19.804323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b9e20c5-a5c8-4922-8f85-fa3415189061 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:20.090577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2b9e20c5-a5c8-4922-8f85-fa3415189061 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df06b05648a41529c3c00cb6b37a77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db88d55696c44808cd30751011fed4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:20.122632 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2b9e20c5-a5c8-4922-8f85-fa3415189061 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] 10.222.0.58 "GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9" status: 200 len: 1314 microversion: 2.1 time: 0.334682 May 28 04:45:20.123661 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1330/2819] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:19 2022] GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:20.386753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7198449b-eb0c-48fa-9752-3e782930be93 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:20.387500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7198449b-eb0c-48fa-9752-3e782930be93 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:20.398214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7198449b-eb0c-48fa-9752-3e782930be93 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:20.401896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7198449b-eb0c-48fa-9752-3e782930be93 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:20.401896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7198449b-eb0c-48fa-9752-3e782930be93 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:20.401896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7198449b-eb0c-48fa-9752-3e782930be93 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:20.933065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7198449b-eb0c-48fa-9752-3e782930be93 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:20.942857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7198449b-eb0c-48fa-9752-3e782930be93 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:20.945147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7198449b-eb0c-48fa-9752-3e782930be93 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:20.946520 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7198449b-eb0c-48fa-9752-3e782930be93 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1873 microversion: 2.42 time: 0.568595 May 28 04:45:20.947817 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1331/2820] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:45:20 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1873 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:45:20.956520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8ca11cbd-7a43-4e95-b979-184dc1e84a9e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700c2c790>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:21.012948 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8ca11cbd-7a43-4e95-b979-184dc1e84a9e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da" status: 200 len: 1412 microversion: 2.1 time: 0.063892 May 28 04:45:21.013527 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1332/2821] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:45:20 2022] GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da => generated 1412 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:21.018206 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-449160b5-22b1-456f-bfb1-73a8fe5bb040 req-4ea3e8e8-a71a-401e-8f14-eb9739bc886e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07f65390-23fd-4b9f-9777-14f296eb7100", "name": "network-vif-plugged", "status": "completed", "tag": "8d31a54d-2623-47d5-b060-1331005f3589"}, {"server_uuid": "0caacb3d-0cbd-4983-965a-859ba0d49bd9", "name": "network-vif-plugged", "status": "completed", "tag": "18189ca0-0e47-4e8c-aa80-6d03e35ec814"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:21.028241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-449160b5-22b1-456f-bfb1-73a8fe5bb040 req-4ea3e8e8-a71a-401e-8f14-eb9739bc886e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:21.028897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-449160b5-22b1-456f-bfb1-73a8fe5bb040 req-4ea3e8e8-a71a-401e-8f14-eb9739bc886e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:21.316831 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-449160b5-22b1-456f-bfb1-73a8fe5bb040 req-4ea3e8e8-a71a-401e-8f14-eb9739bc886e service nova] Creating event network-vif-plugged:8d31a54d-2623-47d5-b060-1331005f3589 for instance 07f65390-23fd-4b9f-9777-14f296eb7100 on n-h1-843700-1 May 28 04:45:21.317629 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-449160b5-22b1-456f-bfb1-73a8fe5bb040 req-4ea3e8e8-a71a-401e-8f14-eb9739bc886e service nova] Creating event network-vif-plugged:18189ca0-0e47-4e8c-aa80-6d03e35ec814 for instance 0caacb3d-0cbd-4983-965a-859ba0d49bd9 on n-h2-843700-1 May 28 04:45:21.329223 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-449160b5-22b1-456f-bfb1-73a8fe5bb040 req-4ea3e8e8-a71a-401e-8f14-eb9739bc886e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.313740 May 28 04:45:21.331506 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1333/2822] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:21.339674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fcf2da20-2877-45e8-8f5c-bd8c68d905c4 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:21.342352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fcf2da20-2877-45e8-8f5c-bd8c68d905c4 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:21.348856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcf2da20-2877-45e8-8f5c-bd8c68d905c4 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:21.349555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcf2da20-2877-45e8-8f5c-bd8c68d905c4 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:21.350499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcf2da20-2877-45e8-8f5c-bd8c68d905c4 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:21.351173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcf2da20-2877-45e8-8f5c-bd8c68d905c4 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:22.036791 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-63ab9928-7949-495f-82b1-6908912e97d5 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/29f87255-ddfd-49fe-abd4-370dc0b8a4e6" status: 202 len: 0 microversion: 2.1 time: 2.365810 May 28 04:45:22.037604 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1490/2823] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 04:45:19 2022] DELETE /compute/v2.1/os-floating-ips/29f87255-ddfd-49fe-abd4-370dc0b8a4e6 => generated 0 bytes in 2368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:45:22.043614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f375a266-67fb-4b36-abed-458ec98558ee tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:22.052748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f375a266-67fb-4b36-abed-458ec98558ee tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:22.090588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f375a266-67fb-4b36-abed-458ec98558ee tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:22.093728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f375a266-67fb-4b36-abed-458ec98558ee tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:22.097193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f375a266-67fb-4b36-abed-458ec98558ee tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:22.097889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f375a266-67fb-4b36-abed-458ec98558ee tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:22.198691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fcf2da20-2877-45e8-8f5c-bd8c68d905c4 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883b4a05f5447b78be3f72888ad8138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31adf654f25449ae87a16578bb7930a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:22.207587 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fcf2da20-2877-45e8-8f5c-bd8c68d905c4 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 200 len: 1316 microversion: 2.1 time: 0.873468 May 28 04:45:22.213964 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1334/2824] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:21 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 1316 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:22.219368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-693b8f00-5a31-40ad-84c0-36acea1378bb tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:22.222388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-693b8f00-5a31-40ad-84c0-36acea1378bb tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] [instance: 0caacb3d-0cbd-4983-965a-859ba0d49bd9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:22.237706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-693b8f00-5a31-40ad-84c0-36acea1378bb tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:22.238642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-693b8f00-5a31-40ad-84c0-36acea1378bb tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:22.240368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-693b8f00-5a31-40ad-84c0-36acea1378bb tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:22.243353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-693b8f00-5a31-40ad-84c0-36acea1378bb tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:22.349574 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f375a266-67fb-4b36-abed-458ec98558ee tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:22.366113 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f375a266-67fb-4b36-abed-458ec98558ee tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52" status: 200 len: 1365 microversion: 2.1 time: 0.327035 May 28 04:45:22.392728 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1491/2825] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:22 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52 => generated 1365 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:22.405103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2193dd79-6e9c-4fb2-a54c-823767288a9c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:22.406170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2193dd79-6e9c-4fb2-a54c-823767288a9c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:22.419561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2193dd79-6e9c-4fb2-a54c-823767288a9c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:22.421415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2193dd79-6e9c-4fb2-a54c-823767288a9c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:22.423969 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2193dd79-6e9c-4fb2-a54c-823767288a9c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:22.429436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2193dd79-6e9c-4fb2-a54c-823767288a9c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:22.727528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-693b8f00-5a31-40ad-84c0-36acea1378bb tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df06b05648a41529c3c00cb6b37a77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db88d55696c44808cd30751011fed4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:22.735852 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-693b8f00-5a31-40ad-84c0-36acea1378bb tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] 10.222.0.58 "GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9" status: 200 len: 1314 microversion: 2.1 time: 0.523085 May 28 04:45:22.746514 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1335/2826] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:22 2022] GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9 => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:22.752188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-72ce66a9-b6e4-4a44-9d69-abb989b5ae81 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700c333a0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:22.811526 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-72ce66a9-b6e4-4a44-9d69-abb989b5ae81 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da" status: 200 len: 1412 microversion: 2.1 time: 0.063489 May 28 04:45:22.813582 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1336/2827] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:45:22 2022] GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da => generated 1412 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:22.825461 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-16888b54-a5ba-47c6-9608-b7553b6ee16e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:22.830532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2193dd79-6e9c-4fb2-a54c-823767288a9c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:22.830783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-16888b54-a5ba-47c6-9608-b7553b6ee16e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:22.839608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2193dd79-6e9c-4fb2-a54c-823767288a9c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:22.841203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2193dd79-6e9c-4fb2-a54c-823767288a9c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:22.842312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16888b54-a5ba-47c6-9608-b7553b6ee16e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:22.842666 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2193dd79-6e9c-4fb2-a54c-823767288a9c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 2828 microversion: 2.42 time: 0.448294 May 28 04:45:22.843441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16888b54-a5ba-47c6-9608-b7553b6ee16e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:22.846000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16888b54-a5ba-47c6-9608-b7553b6ee16e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:22.847318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16888b54-a5ba-47c6-9608-b7553b6ee16e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:22.848146 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1492/2828] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:45:22 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 2828 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:45:22.871465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-13f873b5-d1f8-44ad-ae9e-ecc8af99a072 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:22.872280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-13f873b5-d1f8-44ad-ae9e-ecc8af99a072 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:22.880924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13f873b5-d1f8-44ad-ae9e-ecc8af99a072 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:22.883533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13f873b5-d1f8-44ad-ae9e-ecc8af99a072 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:22.886725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-16888b54-a5ba-47c6-9608-b7553b6ee16e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:45:22.887852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13f873b5-d1f8-44ad-ae9e-ecc8af99a072 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:22.888417 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13f873b5-d1f8-44ad-ae9e-ecc8af99a072 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:23.155236 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-13f873b5-d1f8-44ad-ae9e-ecc8af99a072 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.288465 May 28 04:45:23.156555 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1493/2829] 10.222.0.58 () {60 vars in 1315 bytes} [Sat May 28 04:45:22 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26/os-interface => generated 1830 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:45:23.230354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9d269734-a086-4ff4-b5d7-e00c61d34d52 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:23.231352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9d269734-a086-4ff4-b5d7-e00c61d34d52 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:23.240865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d269734-a086-4ff4-b5d7-e00c61d34d52 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:23.244042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d269734-a086-4ff4-b5d7-e00c61d34d52 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:23.245226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d269734-a086-4ff4-b5d7-e00c61d34d52 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:23.246296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d269734-a086-4ff4-b5d7-e00c61d34d52 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:23.327816 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-16888b54-a5ba-47c6-9608-b7553b6ee16e tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "DELETE /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d" status: 204 len: 0 microversion: 2.1 time: 0.512396 May 28 04:45:23.329329 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1337/2830] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:45:22 2022] DELETE /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:45:23.340069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aeb3f6a8-1919-4ece-b8c5-89b408b50c90 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:23.342465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-aeb3f6a8-1919-4ece-b8c5-89b408b50c90 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:23.350379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aeb3f6a8-1919-4ece-b8c5-89b408b50c90 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:23.351481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aeb3f6a8-1919-4ece-b8c5-89b408b50c90 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:23.352525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aeb3f6a8-1919-4ece-b8c5-89b408b50c90 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:23.353382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aeb3f6a8-1919-4ece-b8c5-89b408b50c90 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:23.606683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9d269734-a086-4ff4-b5d7-e00c61d34d52 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883b4a05f5447b78be3f72888ad8138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31adf654f25449ae87a16578bb7930a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:23.620860 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9d269734-a086-4ff4-b5d7-e00c61d34d52 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 200 len: 1316 microversion: 2.1 time: 0.394624 May 28 04:45:23.621458 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1494/2831] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:23 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 1316 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:45:23.627026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d178fea7-d3cf-43ef-bcbc-462b0cf069b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:23.634804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d178fea7-d3cf-43ef-bcbc-462b0cf069b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:23.647656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d178fea7-d3cf-43ef-bcbc-462b0cf069b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:23.648119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d178fea7-d3cf-43ef-bcbc-462b0cf069b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:23.651367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-aeb3f6a8-1919-4ece-b8c5-89b408b50c90 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:23.656390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d178fea7-d3cf-43ef-bcbc-462b0cf069b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:23.661509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d178fea7-d3cf-43ef-bcbc-462b0cf069b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:23.685549 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aeb3f6a8-1919-4ece-b8c5-89b408b50c90 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d" status: 200 len: 1524 microversion: 2.1 time: 0.327599 May 28 04:45:23.705833 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1338/2832] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:23 2022] GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d => generated 1524 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:23.756751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b98c9553-acbe-431d-8fa4-172185a70a2c tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:23.757755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b98c9553-acbe-431d-8fa4-172185a70a2c tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] [instance: 0caacb3d-0cbd-4983-965a-859ba0d49bd9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:23.769528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b98c9553-acbe-431d-8fa4-172185a70a2c tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:23.776498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b98c9553-acbe-431d-8fa4-172185a70a2c tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:23.778727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b98c9553-acbe-431d-8fa4-172185a70a2c tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:23.778727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b98c9553-acbe-431d-8fa4-172185a70a2c tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:24.009708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d178fea7-d3cf-43ef-bcbc-462b0cf069b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:24.024387 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d178fea7-d3cf-43ef-bcbc-462b0cf069b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52" status: 200 len: 1365 microversion: 2.1 time: 0.401479 May 28 04:45:24.024988 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1495/2833] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:23 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52 => generated 1365 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:24.037861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-432ae907-b5da-41d2-9e5b-2a2dce3cc046 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700fefa60>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:24.135198 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-432ae907-b5da-41d2-9e5b-2a2dce3cc046 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da" status: 200 len: 1412 microversion: 2.1 time: 0.109063 May 28 04:45:24.135807 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1496/2834] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:45:24 2022] GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da => generated 1412 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:24.244042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b98c9553-acbe-431d-8fa4-172185a70a2c tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df06b05648a41529c3c00cb6b37a77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db88d55696c44808cd30751011fed4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:24.251251 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:45:24.256173 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b98c9553-acbe-431d-8fa4-172185a70a2c tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] 10.222.0.58 "GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9" status: 200 len: 1463 microversion: 2.1 time: 0.507407 May 28 04:45:24.257568 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1339/2835] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:23 2022] GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9 => generated 1463 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:45:24.452674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-8d2dbdfc-862f-471b-b001-84f50b3908b7 req-8fa9d8ff-6536-40d8-bca6-b068fcda9600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265434ea-fb97-43f8-ab64-c1f65c9e42e7", "name": "network-vif-plugged", "status": "completed", "tag": "afb98a08-89c9-4c0b-862a-2a876bc56852"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:24.474431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8d2dbdfc-862f-471b-b001-84f50b3908b7 req-8fa9d8ff-6536-40d8-bca6-b068fcda9600 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:24.475331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8d2dbdfc-862f-471b-b001-84f50b3908b7 req-8fa9d8ff-6536-40d8-bca6-b068fcda9600 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:24.500930 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-8d2dbdfc-862f-471b-b001-84f50b3908b7 req-8fa9d8ff-6536-40d8-bca6-b068fcda9600 service nova] Creating event network-vif-plugged:afb98a08-89c9-4c0b-862a-2a876bc56852 for instance 265434ea-fb97-43f8-ab64-c1f65c9e42e7 on n-h2-843700-1 May 28 04:45:24.508315 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-8d2dbdfc-862f-471b-b001-84f50b3908b7 req-8fa9d8ff-6536-40d8-bca6-b068fcda9600 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060229 May 28 04:45:24.509400 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1340/2836] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:45:24.554235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5f537900-483b-4b6b-b762-6693b8c710d3 tempest-TenantUsagesTestJSON-532140495 tempest-TenantUsagesTestJSON-532140495-project-admin] Calling method '.version_select at 0x7f7700ed9550>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:24.566139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f537900-483b-4b6b-b762-6693b8c710d3 tempest-TenantUsagesTestJSON-532140495 tempest-TenantUsagesTestJSON-532140495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:24.566735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f537900-483b-4b6b-b762-6693b8c710d3 tempest-TenantUsagesTestJSON-532140495 tempest-TenantUsagesTestJSON-532140495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:24.586304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f537900-483b-4b6b-b762-6693b8c710d3 tempest-TenantUsagesTestJSON-532140495 tempest-TenantUsagesTestJSON-532140495-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:24.586846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f537900-483b-4b6b-b762-6693b8c710d3 tempest-TenantUsagesTestJSON-532140495 tempest-TenantUsagesTestJSON-532140495-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:24.616966 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5f537900-483b-4b6b-b762-6693b8c710d3 tempest-TenantUsagesTestJSON-532140495 tempest-TenantUsagesTestJSON-532140495-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/2db88d55696c44808cd30751011fed4b?start=2022-05-27T04%3A45%3A24.266730&end=2022-05-29T04%3A45%3A24.266730" status: 200 len: 695 microversion: 2.1 time: 0.345903 May 28 04:45:24.627363 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1497/2837] 10.222.0.58 () {58 vars in 1411 bytes} [Sat May 28 04:45:24 2022] GET /compute/v2.1/os-simple-tenant-usage/2db88d55696c44808cd30751011fed4b?start=2022-05-27T04%3A45%3A24.266730&end=2022-05-29T04%3A45%3A24.266730 => generated 695 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:24.638460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ff862d10-d368-4941-8561-12e6670166ac tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Calling method '.version_select at 0x7f7701a2d550>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:24.638559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3455eec1-9d59-461f-858d-b777a668194d tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:24.638744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3455eec1-9d59-461f-858d-b777a668194d tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:24.647216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff862d10-d368-4941-8561-12e6670166ac tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:24.648269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff862d10-d368-4941-8561-12e6670166ac tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:24.657854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3455eec1-9d59-461f-858d-b777a668194d tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:24.658656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3455eec1-9d59-461f-858d-b777a668194d tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:24.659801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3455eec1-9d59-461f-858d-b777a668194d tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:24.660457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3455eec1-9d59-461f-858d-b777a668194d tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:24.670212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff862d10-d368-4941-8561-12e6670166ac tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:24.671854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff862d10-d368-4941-8561-12e6670166ac tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:24.693592 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ff862d10-d368-4941-8561-12e6670166ac tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/2db88d55696c44808cd30751011fed4b?start=2022-05-27T04%3A45%3A24.266730&end=2022-05-29T04%3A45%3A24.266730" status: 200 len: 700 microversion: 2.1 time: 0.063663 May 28 04:45:24.694238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:45:24.695058 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1341/2838] 10.222.0.58 () {58 vars in 1411 bytes} [Sat May 28 04:45:24 2022] GET /compute/v2.1/os-simple-tenant-usage/2db88d55696c44808cd30751011fed4b?start=2022-05-27T04%3A45%3A24.266730&end=2022-05-29T04%3A45%3A24.266730 => generated 700 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:24.705184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-22d0d3cd-923f-4703-9a50-9697b4b87891 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:24.725087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-22d0d3cd-923f-4703-9a50-9697b4b87891 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:24.733472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22d0d3cd-923f-4703-9a50-9697b4b87891 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:24.734258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22d0d3cd-923f-4703-9a50-9697b4b87891 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:24.735352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22d0d3cd-923f-4703-9a50-9697b4b87891 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:24.736053 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22d0d3cd-923f-4703-9a50-9697b4b87891 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:25.290913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3455eec1-9d59-461f-858d-b777a668194d tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883b4a05f5447b78be3f72888ad8138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31adf654f25449ae87a16578bb7930a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:25.306578 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3455eec1-9d59-461f-858d-b777a668194d tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 200 len: 1466 microversion: 2.1 time: 0.671399 May 28 04:45:25.309155 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1498/2839] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:24 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 1466 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:45:25.318772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7fc5ba15-a8d9-4e72-8432-60ad4f7931f4 tempest-TenantUsagesTestJSON-532140495 tempest-TenantUsagesTestJSON-532140495-project-admin] Calling method '.version_select at 0x7f7700fe8e50>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:25.329339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fc5ba15-a8d9-4e72-8432-60ad4f7931f4 tempest-TenantUsagesTestJSON-532140495 tempest-TenantUsagesTestJSON-532140495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:25.329797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fc5ba15-a8d9-4e72-8432-60ad4f7931f4 tempest-TenantUsagesTestJSON-532140495 tempest-TenantUsagesTestJSON-532140495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:25.348745 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fc5ba15-a8d9-4e72-8432-60ad4f7931f4 tempest-TenantUsagesTestJSON-532140495 tempest-TenantUsagesTestJSON-532140495-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:25.349257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fc5ba15-a8d9-4e72-8432-60ad4f7931f4 tempest-TenantUsagesTestJSON-532140495 tempest-TenantUsagesTestJSON-532140495-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:25.446631 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-22d0d3cd-923f-4703-9a50-9697b4b87891 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec66a6c50340749edc115608c6eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d3282507f4edabcfe1c87e6a2186c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:25.455882 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-22d0d3cd-923f-4703-9a50-9697b4b87891 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d" status: 200 len: 1524 microversion: 2.1 time: 0.755972 May 28 04:45:25.463360 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1342/2840] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:24 2022] GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d => generated 1524 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:25.469926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-53641210-61cc-488a-9bd4-ba8a8d59d5e0 req-58266c03-22f7-4cba-bbd1-3a2208a166cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0459f5ac-8ba7-47a4-9c7b-808496f08d52", "tag": "6edc6b84-cf07-4f57-8cd5-e6e0f81dd2f8"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:25.472029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=9 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:45:25.476978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:45:25.491060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-53641210-61cc-488a-9bd4-ba8a8d59d5e0 req-58266c03-22f7-4cba-bbd1-3a2208a166cf service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:25.494852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-53641210-61cc-488a-9bd4-ba8a8d59d5e0 req-58266c03-22f7-4cba-bbd1-3a2208a166cf service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:25.515738 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-53641210-61cc-488a-9bd4-ba8a8d59d5e0 req-58266c03-22f7-4cba-bbd1-3a2208a166cf service nova] Creating event network-changed:6edc6b84-cf07-4f57-8cd5-e6e0f81dd2f8 for instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 on n-h1-843700-1 May 28 04:45:25.533914 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-53641210-61cc-488a-9bd4-ba8a8d59d5e0 req-58266c03-22f7-4cba-bbd1-3a2208a166cf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067451 May 28 04:45:25.535424 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1343/2841] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:25.549767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f9f86d2e-5a2e-4f73-9c60-767b5f40a6fb tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:25.550780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f9f86d2e-5a2e-4f73-9c60-767b5f40a6fb tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:25.557473 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7fc5ba15-a8d9-4e72-8432-60ad4f7931f4 tempest-TenantUsagesTestJSON-532140495 tempest-TenantUsagesTestJSON-532140495-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-27T04%3A45%3A24.266730&end=2022-05-29T04%3A45%3A24.266730&detailed=1" status: 200 len: 31578 microversion: 2.1 time: 0.243021 May 28 04:45:25.575857 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1499/2842] 10.222.0.58 () {58 vars in 1334 bytes} [Sat May 28 04:45:25 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-27T04%3A45%3A24.266730&end=2022-05-29T04%3A45%3A24.266730&detailed=1 => generated 31578 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:45:25.588895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c0baed40-8e7e-4e55-b8d8-ff978df7a294 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700e680d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:25.589508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9f86d2e-5a2e-4f73-9c60-767b5f40a6fb tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:25.594654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9f86d2e-5a2e-4f73-9c60-767b5f40a6fb tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:25.596108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9f86d2e-5a2e-4f73-9c60-767b5f40a6fb tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:25.596807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9f86d2e-5a2e-4f73-9c60-767b5f40a6fb tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:25.939103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f9f86d2e-5a2e-4f73-9c60-767b5f40a6fb tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:25.956399 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f9f86d2e-5a2e-4f73-9c60-767b5f40a6fb tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52" status: 200 len: 1365 microversion: 2.1 time: 0.419682 May 28 04:45:25.972828 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1344/2843] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:25 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52 => generated 1365 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:25.987968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a7b40aed-c8c2-40d1-81a5-8bc5bb55a0d4 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-794776886", "metadata": {"image_type": "test"}}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:25.989501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a7b40aed-c8c2-40d1-81a5-8bc5bb55a0d4 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:26.009975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a7b40aed-c8c2-40d1-81a5-8bc5bb55a0d4 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:26.013143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a7b40aed-c8c2-40d1-81a5-8bc5bb55a0d4 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:26.016306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a7b40aed-c8c2-40d1-81a5-8bc5bb55a0d4 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:26.018314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a7b40aed-c8c2-40d1-81a5-8bc5bb55a0d4 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:26.132519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-a7b40aed-c8c2-40d1-81a5-8bc5bb55a0d4 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Getting quotas for project 31adf654f25449ae87a16578bb7930a5. Resources: dict_keys(['metadata_items']) {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:45:26.153456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-a7b40aed-c8c2-40d1-81a5-8bc5bb55a0d4 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Getting quotas for user f883b4a05f5447b78be3f72888ad8138 and project 31adf654f25449ae87a16578bb7930a5. Resources: dict_keys(['metadata_items']) {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:45:33.426058 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c0baed40-8e7e-4e55-b8d8-ff978df7a294 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da" status: 200 len: 1412 microversion: 2.1 time: 7.849169 May 28 04:45:33.427647 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1500/2844] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:45:25 2022] GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da => generated 1412 bytes in 7851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:33.437494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bfe152bb-a4f8-436d-a96d-9dada5210d58 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:33.444176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bfe152bb-a4f8-436d-a96d-9dada5210d58 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] [instance: 0caacb3d-0cbd-4983-965a-859ba0d49bd9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:33.456705 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfe152bb-a4f8-436d-a96d-9dada5210d58 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:33.457557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfe152bb-a4f8-436d-a96d-9dada5210d58 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:33.464696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfe152bb-a4f8-436d-a96d-9dada5210d58 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:33.465391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfe152bb-a4f8-436d-a96d-9dada5210d58 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:33.492735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bfe152bb-a4f8-436d-a96d-9dada5210d58 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] [instance: 0caacb3d-0cbd-4983-965a-859ba0d49bd9] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:45:33.769439 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bfe152bb-a4f8-436d-a96d-9dada5210d58 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9" status: 204 len: 0 microversion: 2.1 time: 0.340189 May 28 04:45:33.770253 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1501/2845] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:45:33 2022] DELETE /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:45:33.776310 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-86c16ff2-725c-4943-886a-df2daf67fbcb req-483f773e-8f1c-46f6-9bfb-2a3b0df27f03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "tag": "5dc343f6-efc0-48aa-9ea2-32a0164b02a4"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:33.785868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-86c16ff2-725c-4943-886a-df2daf67fbcb req-483f773e-8f1c-46f6-9bfb-2a3b0df27f03 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:33.786320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-86c16ff2-725c-4943-886a-df2daf67fbcb req-483f773e-8f1c-46f6-9bfb-2a3b0df27f03 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:33.799914 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-86c16ff2-725c-4943-886a-df2daf67fbcb req-483f773e-8f1c-46f6-9bfb-2a3b0df27f03 service nova] Creating event network-changed:5dc343f6-efc0-48aa-9ea2-32a0164b02a4 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:45:33.810000 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-86c16ff2-725c-4943-886a-df2daf67fbcb req-483f773e-8f1c-46f6-9bfb-2a3b0df27f03 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038182 May 28 04:45:33.810969 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1502/2846] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:33.817571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1e2f0cd3-5313-48bc-b074-9095af880cd0 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:33.818453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1e2f0cd3-5313-48bc-b074-9095af880cd0 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] [instance: 73298cda-5cfb-45df-8914-2c76ac9cc70d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:33.827144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e2f0cd3-5313-48bc-b074-9095af880cd0 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:33.827606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e2f0cd3-5313-48bc-b074-9095af880cd0 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:33.829046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e2f0cd3-5313-48bc-b074-9095af880cd0 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:33.829569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e2f0cd3-5313-48bc-b074-9095af880cd0 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:33.851371 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-1e2f0cd3-5313-48bc-b074-9095af880cd0 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] HTTP exception thrown: Instance 73298cda-5cfb-45df-8914-2c76ac9cc70d could not be found. May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1e2f0cd3-5313-48bc-b074-9095af880cd0 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Request method failure captured: May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d HTTP/1.1 May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikah4eKvsiM5Xlel93oE0-8eEQSr_nk7XCjM6kjat7a7KKA2QGHB8CGECKg9ExbfcqycEhZmELsLoS96-NwkDSeuL3OWHioDenioYi3p12DHUnpBFDzNDeYKzvZjmQHHluS1qN5u22uAE3RCxZabV0Ipo8cnplkcQtmr4S8GxxKdTgyQ May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 3c8d3282507f4edabcfe1c87e6a2186c May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-568797371 May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3c8d3282507f4edabcfe1c87e6a2186c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3c8d3282507f4edabcfe1c87e6a2186c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3c8d3282507f4edabcfe1c87e6a2186c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3c8d3282507f4edabcfe1c87e6a2186c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-568797371 May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 3c8d3282507f4edabcfe1c87e6a2186c May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-568797371 May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-FloatingIPsAssociationTestJSON-568797371-project May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 6cec66a6c50340749edc115608c6eeaa May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-568797371-project May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 73298cda-5cfb-45df-8914-2c76ac9cc70d could not be found. May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '73298cda-5cfb-45df-8914-2c76ac9cc70d'} May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73298cda-5cfb-45df-8914-2c76ac9cc70d could not be found. May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73298cda-5cfb-45df-8914-2c76ac9cc70d could not be found. May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:45:33.853465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:45:33.857923 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:45:33.857923 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:45:33.857923 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:45:33.857923 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:45:33.857923 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:45:33.857923 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:45:33.857923 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73298cda-5cfb-45df-8914-2c76ac9cc70d could not be found. May 28 04:45:33.857923 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:45:33.857923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1e2f0cd3-5313-48bc-b074-9095af880cd0 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] Returning 404 to user: Instance 73298cda-5cfb-45df-8914-2c76ac9cc70d could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:45:33.857923 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1e2f0cd3-5313-48bc-b074-9095af880cd0 tempest-FloatingIPsAssociationTestJSON-568797371 tempest-FloatingIPsAssociationTestJSON-568797371-project] 10.222.0.58 "GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d" status: 404 len: 111 microversion: 2.1 time: 0.043012 May 28 04:45:33.857923 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1503/2847] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:33 2022] GET /compute/v2.1/servers/73298cda-5cfb-45df-8914-2c76ac9cc70d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:45:33.861458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d5154a98-3f6f-4e3b-9c55-725c3fe0cb8f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:33.862078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d5154a98-3f6f-4e3b-9c55-725c3fe0cb8f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:33.869377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5154a98-3f6f-4e3b-9c55-725c3fe0cb8f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:33.870098 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5154a98-3f6f-4e3b-9c55-725c3fe0cb8f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:33.870620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5154a98-3f6f-4e3b-9c55-725c3fe0cb8f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:33.871120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5154a98-3f6f-4e3b-9c55-725c3fe0cb8f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:34.535797 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a7b40aed-c8c2-40d1-81a5-8bc5bb55a0d4 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "POST /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100/action" status: 202 len: 0 microversion: 2.1 time: 8.560167 May 28 04:45:34.541836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d5154a98-3f6f-4e3b-9c55-725c3fe0cb8f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:34.543803 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1345/2848] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:45:25 2022] POST /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100/action => generated 0 bytes in 8570 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 04:45:34.557235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-dbffd711-ae6b-4c3d-8117-ca0cb4187ed8 req-71bcdfed-cbc4-4f00-ba33-4bdb785cc6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0459f5ac-8ba7-47a4-9c7b-808496f08d52", "name": "network-vif-plugged", "status": "completed", "tag": "6edc6b84-cf07-4f57-8cd5-e6e0f81dd2f8"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:34.564433 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d5154a98-3f6f-4e3b-9c55-725c3fe0cb8f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52" status: 200 len: 1365 microversion: 2.1 time: 0.700590 May 28 04:45:34.564433 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1504/2849] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:33 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52 => generated 1365 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:34.569095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-694ae875-38c3-405e-b0eb-45de7d54bf87 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:34.571655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-694ae875-38c3-405e-b0eb-45de7d54bf87 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:34.588395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-694ae875-38c3-405e-b0eb-45de7d54bf87 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:34.589204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-694ae875-38c3-405e-b0eb-45de7d54bf87 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:34.590220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-694ae875-38c3-405e-b0eb-45de7d54bf87 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:34.591784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-694ae875-38c3-405e-b0eb-45de7d54bf87 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:34.605728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-dbffd711-ae6b-4c3d-8117-ca0cb4187ed8 req-71bcdfed-cbc4-4f00-ba33-4bdb785cc6f6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:34.606350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-dbffd711-ae6b-4c3d-8117-ca0cb4187ed8 req-71bcdfed-cbc4-4f00-ba33-4bdb785cc6f6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:34.628226 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-dbffd711-ae6b-4c3d-8117-ca0cb4187ed8 req-71bcdfed-cbc4-4f00-ba33-4bdb785cc6f6 service nova] Creating event network-vif-plugged:6edc6b84-cf07-4f57-8cd5-e6e0f81dd2f8 for instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 on n-h1-843700-1 May 28 04:45:34.642588 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-dbffd711-ae6b-4c3d-8117-ca0cb4187ed8 req-71bcdfed-cbc4-4f00-ba33-4bdb785cc6f6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094069 May 28 04:45:34.644336 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1346/2850] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:34.653892 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-21024084-2003-491a-af86-d090dad24507 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:34.654898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-21024084-2003-491a-af86-d090dad24507 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] [instance: 0caacb3d-0cbd-4983-965a-859ba0d49bd9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:34.672820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:45:34.684680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21024084-2003-491a-af86-d090dad24507 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:34.685983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21024084-2003-491a-af86-d090dad24507 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:34.694049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21024084-2003-491a-af86-d090dad24507 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:34.694049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21024084-2003-491a-af86-d090dad24507 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:35.219186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-21024084-2003-491a-af86-d090dad24507 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df06b05648a41529c3c00cb6b37a77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db88d55696c44808cd30751011fed4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:35.238286 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-21024084-2003-491a-af86-d090dad24507 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] 10.222.0.58 "GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9" status: 200 len: 1469 microversion: 2.1 time: 0.592353 May 28 04:45:35.248413 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1347/2851] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:34 2022] GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9 => generated 1469 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:35.253940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0a39efb7-9a38-42e0-8997-ee1359be6c86 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f770198f0d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:35.286198 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-694ae875-38c3-405e-b0eb-45de7d54bf87 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:35.314487 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-694ae875-38c3-405e-b0eb-45de7d54bf87 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.748797 May 28 04:45:35.331333 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1505/2852] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:34 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:35.347953 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0a39efb7-9a38-42e0-8997-ee1359be6c86 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da" status: 200 len: 1412 microversion: 2.1 time: 0.098135 May 28 04:45:35.355885 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1348/2853] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:45:35 2022] GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:35.356566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0637c170-eacc-4720-bcb6-27b8d3cd3ce5 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7700ebc550>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:35.368409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-df7e9656-74ba-45aa-b52d-5967a9f9738e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-935747166"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:35.369960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:45:35.376434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-df7e9656-74ba-45aa-b52d-5967a9f9738e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:35.384191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df7e9656-74ba-45aa-b52d-5967a9f9738e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:35.388463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df7e9656-74ba-45aa-b52d-5967a9f9738e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:35.391190 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df7e9656-74ba-45aa-b52d-5967a9f9738e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:35.392140 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df7e9656-74ba-45aa-b52d-5967a9f9738e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:35.441372 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0637c170-eacc-4720-bcb6-27b8d3cd3ce5 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/259715a9-301f-43a4-9267-717ba5753778" status: 200 len: 1423 microversion: 2.1 time: 0.106011 May 28 04:45:35.442328 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1506/2854] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:45:35 2022] GET /compute/v2.1/images/259715a9-301f-43a4-9267-717ba5753778 => generated 1423 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:35.582804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c3e2fd17-2115-4902-a47a-07069e708a71 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:35.583462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c3e2fd17-2115-4902-a47a-07069e708a71 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:35.606675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3e2fd17-2115-4902-a47a-07069e708a71 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:35.610082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3e2fd17-2115-4902-a47a-07069e708a71 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:35.611024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3e2fd17-2115-4902-a47a-07069e708a71 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:35.611483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3e2fd17-2115-4902-a47a-07069e708a71 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:35.968143 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-df7e9656-74ba-45aa-b52d-5967a9f9738e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action" status: 202 len: 0 microversion: 2.1 time: 0.605526 May 28 04:45:35.976115 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1349/2855] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:45:35 2022] POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 28 04:45:35.995529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-14fb82a3-4344-41e6-b59e-97e457bd05db req-3bef80a0-f7ed-4fda-b9dc-bd15d126d9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73298cda-5cfb-45df-8914-2c76ac9cc70d", "name": "network-vif-deleted", "tag": "03b825a9-d5e4-41b3-b80b-08b10632a298"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:36.007128 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c3e2fd17-2115-4902-a47a-07069e708a71 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:36.017473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-14fb82a3-4344-41e6-b59e-97e457bd05db req-3bef80a0-f7ed-4fda-b9dc-bd15d126d9e1 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:36.020664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-14fb82a3-4344-41e6-b59e-97e457bd05db req-3bef80a0-f7ed-4fda-b9dc-bd15d126d9e1 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:36.039100 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c3e2fd17-2115-4902-a47a-07069e708a71 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52" status: 200 len: 1365 microversion: 2.1 time: 0.461923 May 28 04:45:36.052222 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1507/2856] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:35 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52 => generated 1365 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:36.060718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-086ce72f-354c-421b-93f8-fb39455e96a2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:36.063701 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-14fb82a3-4344-41e6-b59e-97e457bd05db req-3bef80a0-f7ed-4fda-b9dc-bd15d126d9e1 service nova] Creating event network-vif-deleted:03b825a9-d5e4-41b3-b80b-08b10632a298 for instance 73298cda-5cfb-45df-8914-2c76ac9cc70d on n-h2-843700-1 May 28 04:45:36.065147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-086ce72f-354c-421b-93f8-fb39455e96a2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:36.082349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-086ce72f-354c-421b-93f8-fb39455e96a2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:36.086260 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-14fb82a3-4344-41e6-b59e-97e457bd05db req-3bef80a0-f7ed-4fda-b9dc-bd15d126d9e1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113095 May 28 04:45:36.090695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-086ce72f-354c-421b-93f8-fb39455e96a2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:36.092898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-086ce72f-354c-421b-93f8-fb39455e96a2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:36.093135 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1350/2857] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:36.094015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-086ce72f-354c-421b-93f8-fb39455e96a2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:36.258763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0c82b3c4-4fcd-4abb-b56b-339a8054c305 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:36.259981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0c82b3c4-4fcd-4abb-b56b-339a8054c305 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] [instance: 0caacb3d-0cbd-4983-965a-859ba0d49bd9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:36.275018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c82b3c4-4fcd-4abb-b56b-339a8054c305 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:36.275586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c82b3c4-4fcd-4abb-b56b-339a8054c305 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:36.279233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c82b3c4-4fcd-4abb-b56b-339a8054c305 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:36.279823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c82b3c4-4fcd-4abb-b56b-339a8054c305 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:36.481926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-086ce72f-354c-421b-93f8-fb39455e96a2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:36.505453 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-086ce72f-354c-421b-93f8-fb39455e96a2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1680 microversion: 2.1 time: 0.451297 May 28 04:45:36.507321 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1508/2858] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:36 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1680 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:36.535278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1b96cd64-6348-4698-9712-48f4f059a410 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700edd430>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:36.585804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0c82b3c4-4fcd-4abb-b56b-339a8054c305 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df06b05648a41529c3c00cb6b37a77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db88d55696c44808cd30751011fed4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:36.605631 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0c82b3c4-4fcd-4abb-b56b-339a8054c305 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] 10.222.0.58 "GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9" status: 200 len: 1469 microversion: 2.1 time: 0.352809 May 28 04:45:36.608432 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1351/2859] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:36 2022] GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9 => generated 1469 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:45:36.627158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8345cfc1-2095-4b7c-9d15-562a9fbd6396 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7701806f70>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:36.652555 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1b96cd64-6348-4698-9712-48f4f059a410 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da" status: 200 len: 1412 microversion: 2.1 time: 0.141900 May 28 04:45:36.653684 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1509/2860] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:45:36 2022] GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da => generated 1412 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:36.674308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-8cc1a80a-49e0-40ad-8b76-b227d6306186 req-30285f63-feda-4f34-9bdb-12984a0f3ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "215a4357-1792-4f6e-ae11-f8574b806b73", "name": "network-vif-unplugged", "status": "completed", "tag": "f007cebf-d19d-420d-891d-de3291249844"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:36.695821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8cc1a80a-49e0-40ad-8b76-b227d6306186 req-30285f63-feda-4f34-9bdb-12984a0f3ddf service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:36.697734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8cc1a80a-49e0-40ad-8b76-b227d6306186 req-30285f63-feda-4f34-9bdb-12984a0f3ddf service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:36.738356 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-8cc1a80a-49e0-40ad-8b76-b227d6306186 req-30285f63-feda-4f34-9bdb-12984a0f3ddf service nova] Creating event network-vif-unplugged:f007cebf-d19d-420d-891d-de3291249844 for instance 215a4357-1792-4f6e-ae11-f8574b806b73 on n-h2-843700-1 May 28 04:45:36.742747 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8345cfc1-2095-4b7c-9d15-562a9fbd6396 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/259715a9-301f-43a4-9267-717ba5753778" status: 200 len: 1423 microversion: 2.1 time: 0.129913 May 28 04:45:36.744303 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1352/2861] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:45:36 2022] GET /compute/v2.1/images/259715a9-301f-43a4-9267-717ba5753778 => generated 1423 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:36.754674 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-8cc1a80a-49e0-40ad-8b76-b227d6306186 req-30285f63-feda-4f34-9bdb-12984a0f3ddf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097070 May 28 04:45:36.757088 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1510/2862] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:37.093614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-862bb517-daf3-47e5-b466-547aee4889a5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:37.093614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-862bb517-daf3-47e5-b466-547aee4889a5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:37.114427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-862bb517-daf3-47e5-b466-547aee4889a5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:37.115335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-862bb517-daf3-47e5-b466-547aee4889a5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:37.122566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-862bb517-daf3-47e5-b466-547aee4889a5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:37.123283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-862bb517-daf3-47e5-b466-547aee4889a5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:37.525739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2c1ba87f-4229-43a3-bffa-b1d63c8ed3d8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:37.526852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2c1ba87f-4229-43a3-bffa-b1d63c8ed3d8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:37.539932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c1ba87f-4229-43a3-bffa-b1d63c8ed3d8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:37.540382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c1ba87f-4229-43a3-bffa-b1d63c8ed3d8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:37.541170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c1ba87f-4229-43a3-bffa-b1d63c8ed3d8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:37.541611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c1ba87f-4229-43a3-bffa-b1d63c8ed3d8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:37.682810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-862bb517-daf3-47e5-b466-547aee4889a5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:37.695502 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-862bb517-daf3-47e5-b466-547aee4889a5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52" status: 200 len: 1554 microversion: 2.1 time: 0.631370 May 28 04:45:37.700061 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1353/2863] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:37 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52 => generated 1554 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:37.717965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9fb0d27b-3201-4e64-8ce2-1930144e4978 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:37.722156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9fb0d27b-3201-4e64-8ce2-1930144e4978 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] [instance: 0caacb3d-0cbd-4983-965a-859ba0d49bd9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:37.735599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fb0d27b-3201-4e64-8ce2-1930144e4978 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:37.736168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fb0d27b-3201-4e64-8ce2-1930144e4978 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:37.749671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fb0d27b-3201-4e64-8ce2-1930144e4978 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:37.750839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fb0d27b-3201-4e64-8ce2-1930144e4978 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:37.814338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fb0d27b-3201-4e64-8ce2-1930144e4978 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:37.814802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fb0d27b-3201-4e64-8ce2-1930144e4978 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:37.823309 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-9fb0d27b-3201-4e64-8ce2-1930144e4978 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lazy-loading 'fault' on Instance uuid 0caacb3d-0cbd-4983-965a-859ba0d49bd9 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:45:37.883770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9fb0d27b-3201-4e64-8ce2-1930144e4978 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df06b05648a41529c3c00cb6b37a77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db88d55696c44808cd30751011fed4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:37.895050 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9fb0d27b-3201-4e64-8ce2-1930144e4978 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] 10.222.0.58 "GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9" status: 200 len: 1304 microversion: 2.1 time: 0.193172 May 28 04:45:37.899572 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1354/2864] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:37 2022] GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9 => generated 1304 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:37.904600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f97514aa-c83c-4d35-8246-305ff57b30b4 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701c935e0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:37.954043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2c1ba87f-4229-43a3-bffa-b1d63c8ed3d8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:37.974349 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2c1ba87f-4229-43a3-bffa-b1d63c8ed3d8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1680 microversion: 2.1 time: 0.452903 May 28 04:45:37.985791 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1511/2865] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:37 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1680 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:37.988648 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f97514aa-c83c-4d35-8246-305ff57b30b4 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da" status: 200 len: 1412 microversion: 2.1 time: 0.087715 May 28 04:45:37.990247 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1355/2866] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:45:37 2022] GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da => generated 1412 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:37.997259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4ef7c00a-27fd-4c28-9f94-808ee94452c4 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7701c93dc0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:37.998175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a20b3d2b-e486-4dc8-9ef8-8d478c742c08 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:37.998874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a20b3d2b-e486-4dc8-9ef8-8d478c742c08 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:38.011814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a20b3d2b-e486-4dc8-9ef8-8d478c742c08 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:38.014977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a20b3d2b-e486-4dc8-9ef8-8d478c742c08 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:38.014977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a20b3d2b-e486-4dc8-9ef8-8d478c742c08 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:38.014977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a20b3d2b-e486-4dc8-9ef8-8d478c742c08 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:38.081979 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4ef7c00a-27fd-4c28-9f94-808ee94452c4 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/259715a9-301f-43a4-9267-717ba5753778" status: 200 len: 1423 microversion: 2.1 time: 0.088198 May 28 04:45:38.085044 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1356/2867] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:45:37 2022] GET /compute/v2.1/images/259715a9-301f-43a4-9267-717ba5753778 => generated 1423 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:38.136117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-ebd7c517-6f33-4b90-ab4d-61e169268d1f req-8b51046f-9f11-4908-b8f7-47a8017acf4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0caacb3d-0cbd-4983-965a-859ba0d49bd9", "name": "network-vif-deleted", "tag": "18189ca0-0e47-4e8c-aa80-6d03e35ec814"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:38.153986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ebd7c517-6f33-4b90-ab4d-61e169268d1f req-8b51046f-9f11-4908-b8f7-47a8017acf4d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:38.154899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ebd7c517-6f33-4b90-ab4d-61e169268d1f req-8b51046f-9f11-4908-b8f7-47a8017acf4d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:38.170525 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-ebd7c517-6f33-4b90-ab4d-61e169268d1f req-8b51046f-9f11-4908-b8f7-47a8017acf4d service nova] Creating event network-vif-deleted:18189ca0-0e47-4e8c-aa80-6d03e35ec814 for instance 0caacb3d-0cbd-4983-965a-859ba0d49bd9 on n-h2-843700-1 May 28 04:45:38.176640 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-ebd7c517-6f33-4b90-ab4d-61e169268d1f req-8b51046f-9f11-4908-b8f7-47a8017acf4d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044846 May 28 04:45:38.178285 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1357/2868] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:38.183355 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a20b3d2b-e486-4dc8-9ef8-8d478c742c08 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.196098 May 28 04:45:38.193776 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1512/2869] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 04:45:37 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-interface => generated 284 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:38.915449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ae77a5db-f0c1-4798-a2ec-11eea3bcc084 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:38.916260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ae77a5db-f0c1-4798-a2ec-11eea3bcc084 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] [instance: 0caacb3d-0cbd-4983-965a-859ba0d49bd9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:38.931818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae77a5db-f0c1-4798-a2ec-11eea3bcc084 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:38.932277 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae77a5db-f0c1-4798-a2ec-11eea3bcc084 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:38.939582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae77a5db-f0c1-4798-a2ec-11eea3bcc084 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:38.942080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae77a5db-f0c1-4798-a2ec-11eea3bcc084 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:38.999491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-58564d91-3e43-4bc4-98ab-eb6dea9808e4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:39.007815 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-ae77a5db-f0c1-4798-a2ec-11eea3bcc084 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] HTTP exception thrown: Instance 0caacb3d-0cbd-4983-965a-859ba0d49bd9 could not be found. May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ae77a5db-f0c1-4798-a2ec-11eea3bcc084 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Request method failure captured: May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9 HTTP/1.1 May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikajIQfelFOZZc7R7m4g2XptT9vIjHwq1JhTiJvYAGJ7AwmddZj3djMz1dzZfcmPMQPu_uhDFI0sNkapCCk8Hzmfr-8GHavCg99WZp3Ssen98KhT3mLZpSQ3veLzbh_HXsB7j9fB38kfVtKstwSunrJ_YmlQW5lYSKz6jfA4NCHxamGA May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2db88d55696c44808cd30751011fed4b May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TenantUsagesTestJSON-1337615272 May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2db88d55696c44808cd30751011fed4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2db88d55696c44808cd30751011fed4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2db88d55696c44808cd30751011fed4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2db88d55696c44808cd30751011fed4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TenantUsagesTestJSON-1337615272 May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2db88d55696c44808cd30751011fed4b May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1337615272 May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TenantUsagesTestJSON-1337615272-project May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 4df06b05648a41529c3c00cb6b37a77f May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TenantUsagesTestJSON-1337615272-project May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 0caacb3d-0cbd-4983-965a-859ba0d49bd9 could not be found. May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '0caacb3d-0cbd-4983-965a-859ba0d49bd9'} May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0caacb3d-0cbd-4983-965a-859ba0d49bd9 could not be found. May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0caacb3d-0cbd-4983-965a-859ba0d49bd9 could not be found. May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:45:39.013561 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:45:39.018119 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:45:39.018119 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:45:39.018119 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:45:39.018119 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:45:39.018119 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:45:39.018119 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0caacb3d-0cbd-4983-965a-859ba0d49bd9 could not be found. May 28 04:45:39.018119 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:45:39.018119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ae77a5db-f0c1-4798-a2ec-11eea3bcc084 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] Returning 404 to user: Instance 0caacb3d-0cbd-4983-965a-859ba0d49bd9 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:45:39.018119 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ae77a5db-f0c1-4798-a2ec-11eea3bcc084 tempest-TenantUsagesTestJSON-1337615272 tempest-TenantUsagesTestJSON-1337615272-project] 10.222.0.58 "GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9" status: 404 len: 111 microversion: 2.1 time: 0.104410 May 28 04:45:39.018831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-58564d91-3e43-4bc4-98ab-eb6dea9808e4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:39.031942 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1358/2870] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:38 2022] GET /compute/v2.1/servers/0caacb3d-0cbd-4983-965a-859ba0d49bd9 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:45:39.044004 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58564d91-3e43-4bc4-98ab-eb6dea9808e4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:39.048394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bd2bf32d-0c8b-47ae-a0e6-bdf261f6577e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700d6b820>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:39.052822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58564d91-3e43-4bc4-98ab-eb6dea9808e4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:39.062936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58564d91-3e43-4bc4-98ab-eb6dea9808e4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:39.064023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58564d91-3e43-4bc4-98ab-eb6dea9808e4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:39.360159 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bd2bf32d-0c8b-47ae-a0e6-bdf261f6577e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da" status: 200 len: 1412 microversion: 2.1 time: 0.325936 May 28 04:45:39.363745 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1359/2871] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:45:39 2022] GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da => generated 1412 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:39.396976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f18bbfa8-1291-416f-98d6-ce454196250a tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f770198f040>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:39.591519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-58564d91-3e43-4bc4-98ab-eb6dea9808e4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:39.600306 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-58564d91-3e43-4bc4-98ab-eb6dea9808e4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1688 microversion: 2.1 time: 0.611539 May 28 04:45:39.614054 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1513/2872] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:38 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1688 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:45:39.635225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-6ec77085-3d69-4fe7-a3b4-6452381c2c76 req-d5fbe1b6-a208-495d-a261-bf39852a8cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07f65390-23fd-4b9f-9777-14f296eb7100", "name": "network-vif-plugged", "status": "completed", "tag": "8d31a54d-2623-47d5-b060-1331005f3589"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:39.649567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-6ec77085-3d69-4fe7-a3b4-6452381c2c76 req-d5fbe1b6-a208-495d-a261-bf39852a8cce service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:39.650269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-6ec77085-3d69-4fe7-a3b4-6452381c2c76 req-d5fbe1b6-a208-495d-a261-bf39852a8cce service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:39.684373 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-6ec77085-3d69-4fe7-a3b4-6452381c2c76 req-d5fbe1b6-a208-495d-a261-bf39852a8cce service nova] Creating event network-vif-plugged:8d31a54d-2623-47d5-b060-1331005f3589 for instance 07f65390-23fd-4b9f-9777-14f296eb7100 on n-h1-843700-1 May 28 04:45:39.698705 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-6ec77085-3d69-4fe7-a3b4-6452381c2c76 req-d5fbe1b6-a208-495d-a261-bf39852a8cce service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080341 May 28 04:45:39.699646 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1514/2873] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:40.376119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-99e76919-7aca-47c4-8b96-e64364bc103a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700e7dc10>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:42.470020 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f18bbfa8-1291-416f-98d6-ce454196250a tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/259715a9-301f-43a4-9267-717ba5753778" status: 200 len: 1423 microversion: 2.1 time: 3.099934 May 28 04:45:42.471918 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1360/2874] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:45:39 2022] GET /compute/v2.1/images/259715a9-301f-43a4-9267-717ba5753778 => generated 1423 bytes in 3106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:42.485518 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-116deecb-b212-4287-a7ae-d37a88f0a465 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:42.487045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-116deecb-b212-4287-a7ae-d37a88f0a465 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:45:42.510816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-116deecb-b212-4287-a7ae-d37a88f0a465 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:42.510816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-116deecb-b212-4287-a7ae-d37a88f0a465 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:42.510816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-116deecb-b212-4287-a7ae-d37a88f0a465 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:42.515961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-116deecb-b212-4287-a7ae-d37a88f0a465 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:42.517461 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-99e76919-7aca-47c4-8b96-e64364bc103a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da" status: 200 len: 1421 microversion: 2.1 time: 2.146333 May 28 04:45:42.518065 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1515/2875] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:45:40 2022] GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da => generated 1421 bytes in 2148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:45:42.555011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-eaff485e-e754-4a87-8084-75f2106931b2 req-e95ed990-fc4c-47bb-bb80-fb5ea126a4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0459f5ac-8ba7-47a4-9c7b-808496f08d52", "tag": "6edc6b84-cf07-4f57-8cd5-e6e0f81dd2f8"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:42.589298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-eaff485e-e754-4a87-8084-75f2106931b2 req-e95ed990-fc4c-47bb-bb80-fb5ea126a4d4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:42.589971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-eaff485e-e754-4a87-8084-75f2106931b2 req-e95ed990-fc4c-47bb-bb80-fb5ea126a4d4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:42.618614 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-eaff485e-e754-4a87-8084-75f2106931b2 req-e95ed990-fc4c-47bb-bb80-fb5ea126a4d4 service nova] Creating event network-changed:6edc6b84-cf07-4f57-8cd5-e6e0f81dd2f8 for instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 on n-h1-843700-1 May 28 04:45:42.626570 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-eaff485e-e754-4a87-8084-75f2106931b2 req-e95ed990-fc4c-47bb-bb80-fb5ea126a4d4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094427 May 28 04:45:42.648613 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1516/2876] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:42.657213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-c2a0d172-fa65-4da6-a16f-b9b661d08022 req-42480dc1-794f-401a-8e3a-4f58e71c76ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "215a4357-1792-4f6e-ae11-f8574b806b73", "name": "network-vif-plugged", "status": "completed", "tag": "f007cebf-d19d-420d-891d-de3291249844"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:45:42.680367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c2a0d172-fa65-4da6-a16f-b9b661d08022 req-42480dc1-794f-401a-8e3a-4f58e71c76ca service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:45:42.692723 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c2a0d172-fa65-4da6-a16f-b9b661d08022 req-42480dc1-794f-401a-8e3a-4f58e71c76ca service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:45:42.742852 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-c2a0d172-fa65-4da6-a16f-b9b661d08022 req-42480dc1-794f-401a-8e3a-4f58e71c76ca service nova] Creating event network-vif-plugged:f007cebf-d19d-420d-891d-de3291249844 for instance 215a4357-1792-4f6e-ae11-f8574b806b73 on n-h2-843700-1 May 28 04:45:42.765110 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-c2a0d172-fa65-4da6-a16f-b9b661d08022 req-42480dc1-794f-401a-8e3a-4f58e71c76ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114605 May 28 04:45:42.773708 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1517/2877] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:45:42.804092 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b7d62e79-12f9-4a0a-9989-7dae21ceeee2 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f77015baca0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:43.016863 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b7d62e79-12f9-4a0a-9989-7dae21ceeee2 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da" status: 200 len: 1421 microversion: 2.1 time: 0.241740 May 28 04:45:43.018560 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1518/2878] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:45:42 2022] GET /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da => generated 1421 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:43.033316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-91c50512-0895-4ea5-82ae-3d41fb116147 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700edd430>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:43.115578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-116deecb-b212-4287-a7ae-d37a88f0a465 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:45:43.128035 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-116deecb-b212-4287-a7ae-d37a88f0a465 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1683 microversion: 2.1 time: 0.654568 May 28 04:45:43.129334 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1361/2879] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:42 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1683 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:45:43.485077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-46ed7f2c-ed09-4103-a478-f948ead43c51 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7701145c10>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:45:52.509073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=35 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:45:52.679481 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:45:52.700840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:45:53.121063 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:46:01.897955 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-46ed7f2c-ed09-4103-a478-f948ead43c51 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/259715a9-301f-43a4-9267-717ba5753778" status: 200 len: 1432 microversion: 2.1 time: 18.416798 May 28 04:46:01.900175 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1362/2880] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:45:43 2022] GET /compute/v2.1/images/259715a9-301f-43a4-9267-717ba5753778 => generated 1432 bytes in 18420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:01.905541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f980fec4-6cad-4dc0-a1a0-c1313510d4b5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:01.906363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f980fec4-6cad-4dc0-a1a0-c1313510d4b5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:01.923912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f980fec4-6cad-4dc0-a1a0-c1313510d4b5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:01.923912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f980fec4-6cad-4dc0-a1a0-c1313510d4b5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:01.923912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f980fec4-6cad-4dc0-a1a0-c1313510d4b5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:01.923912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f980fec4-6cad-4dc0-a1a0-c1313510d4b5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:02.172964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f980fec4-6cad-4dc0-a1a0-c1313510d4b5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:02.186839 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f980fec4-6cad-4dc0-a1a0-c1313510d4b5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1683 microversion: 2.1 time: 0.284926 May 28 04:46:02.192140 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1363/2881] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:01 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1683 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:02.206787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-6549a6a3-12ef-466f-ab51-2bfcdc7447a2 req-690ca8c9-5c3a-4596-af19-0283cbece004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265434ea-fb97-43f8-ab64-c1f65c9e42e7", "name": "network-vif-unplugged", "status": "completed", "tag": "afb98a08-89c9-4c0b-862a-2a876bc56852"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:02.228274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-6549a6a3-12ef-466f-ab51-2bfcdc7447a2 req-690ca8c9-5c3a-4596-af19-0283cbece004 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:02.229338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-6549a6a3-12ef-466f-ab51-2bfcdc7447a2 req-690ca8c9-5c3a-4596-af19-0283cbece004 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:02.242741 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-6549a6a3-12ef-466f-ab51-2bfcdc7447a2 req-690ca8c9-5c3a-4596-af19-0283cbece004 service nova] Creating event network-vif-unplugged:afb98a08-89c9-4c0b-862a-2a876bc56852 for instance 265434ea-fb97-43f8-ab64-c1f65c9e42e7 on n-h2-843700-1 May 28 04:46:02.251340 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-6549a6a3-12ef-466f-ab51-2bfcdc7447a2 req-690ca8c9-5c3a-4596-af19-0283cbece004 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057400 May 28 04:46:02.253697 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1364/2882] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:02.391016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-16c57e98-1324-4f0a-b056-5fa2af582627 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-818949366", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "c2eef7e3-8f1a-4bd2-b792-e004dc125925"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:02.460673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-16c57e98-1324-4f0a-b056-5fa2af582627 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] validate_networks() for [('c2eef7e3-8f1a-4bd2-b792-e004dc125925', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:46:02.511196 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-91c50512-0895-4ea5-82ae-3d41fb116147 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "DELETE /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da" status: 204 len: 0 microversion: 2.1 time: 19.483809 May 28 04:46:02.511196 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1519/2883] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:45:43 2022] DELETE /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da => generated 0 bytes in 19485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:46:02.590073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1970768b-e0ba-4bc8-b7bf-d850ba016d94 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-568542654", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "9a101fd9-ec3e-4f16-9e69-6c24d7cfb19e"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:02.685511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-1970768b-e0ba-4bc8-b7bf-d850ba016d94 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] validate_networks() for [('9a101fd9-ec3e-4f16-9e69-6c24d7cfb19e', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:46:04.013792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-1970768b-e0ba-4bc8-b7bf-d850ba016d94 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:46:04.014894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-1970768b-e0ba-4bc8-b7bf-d850ba016d94 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:46:04.015290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-1970768b-e0ba-4bc8-b7bf-d850ba016d94 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:46:04.015701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-1970768b-e0ba-4bc8-b7bf-d850ba016d94 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:46:04.016432 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-1970768b-e0ba-4bc8-b7bf-d850ba016d94 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:46:04.029425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1970768b-e0ba-4bc8-b7bf-d850ba016d94 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:04.030810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1970768b-e0ba-4bc8-b7bf-d850ba016d94 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:04.031812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1970768b-e0ba-4bc8-b7bf-d850ba016d94 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:04.032432 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1970768b-e0ba-4bc8-b7bf-d850ba016d94 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:04.034271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-16c57e98-1324-4f0a-b056-5fa2af582627 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:46:04.034900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-16c57e98-1324-4f0a-b056-5fa2af582627 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:46:04.035519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-16c57e98-1324-4f0a-b056-5fa2af582627 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:46:04.036030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-16c57e98-1324-4f0a-b056-5fa2af582627 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:46:04.036678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-16c57e98-1324-4f0a-b056-5fa2af582627 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:46:04.048044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16c57e98-1324-4f0a-b056-5fa2af582627 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:04.048995 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16c57e98-1324-4f0a-b056-5fa2af582627 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:04.049858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16c57e98-1324-4f0a-b056-5fa2af582627 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:04.050442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16c57e98-1324-4f0a-b056-5fa2af582627 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:04.058498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-1970768b-e0ba-4bc8-b7bf-d850ba016d94 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Getting quotas for project fe10db5df4ce4c78b040947d88450f51. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:46:04.064920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-1970768b-e0ba-4bc8-b7bf-d850ba016d94 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Getting quotas for user 43548e2fd4fe40799493092aaa4ab255 and project fe10db5df4ce4c78b040947d88450f51. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:46:04.073263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-16c57e98-1324-4f0a-b056-5fa2af582627 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Getting quotas for project 668db6c41d0d48c3abd9035dcc477e86. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:46:04.080392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-16c57e98-1324-4f0a-b056-5fa2af582627 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Getting quotas for user 4f3840ad6a4e4e8c961cc20ee2b5ab0c and project 668db6c41d0d48c3abd9035dcc477e86. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:46:04.082190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1970768b-e0ba-4bc8-b7bf-d850ba016d94 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:46:04.085851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1970768b-e0ba-4bc8-b7bf-d850ba016d94 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:46:04.100232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-16c57e98-1324-4f0a-b056-5fa2af582627 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:46:04.102828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-16c57e98-1324-4f0a-b056-5fa2af582627 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:46:04.249806 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-16c57e98-1324-4f0a-b056-5fa2af582627 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.993556 May 28 04:46:04.251204 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1365/2884] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:46:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:46:04.256483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-071a0f63-2409-495f-a44c-c7b08cadd63b tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7701c54790>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:04.303379 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1970768b-e0ba-4bc8-b7bf-d850ba016d94 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.792461 May 28 04:46:04.304398 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1520/2885] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:46:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:46:04.314680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a2df957c-fa60-455d-ad00-5fa6017f413b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:04.314680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a2df957c-fa60-455d-ad00-5fa6017f413b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 265434ea-fb97-43f8-ab64-c1f65c9e42e7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:04.321179 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-071a0f63-2409-495f-a44c-c7b08cadd63b tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/259715a9-301f-43a4-9267-717ba5753778" status: 200 len: 1432 microversion: 2.1 time: 0.068612 May 28 04:46:04.322122 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1366/2886] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:04 2022] GET /compute/v2.1/images/259715a9-301f-43a4-9267-717ba5753778 => generated 1432 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:04.333979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ea1a88d1-93f8-443e-9138-98741d68ea47 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:04.337718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ea1a88d1-93f8-443e-9138-98741d68ea47 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:04.338779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a2df957c-fa60-455d-ad00-5fa6017f413b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:04.338779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a2df957c-fa60-455d-ad00-5fa6017f413b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:04.338779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a2df957c-fa60-455d-ad00-5fa6017f413b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:04.350504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a2df957c-fa60-455d-ad00-5fa6017f413b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:04.363459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea1a88d1-93f8-443e-9138-98741d68ea47 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:04.365163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea1a88d1-93f8-443e-9138-98741d68ea47 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:04.370793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea1a88d1-93f8-443e-9138-98741d68ea47 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:04.371454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea1a88d1-93f8-443e-9138-98741d68ea47 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:04.403301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a2df957c-fa60-455d-ad00-5fa6017f413b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 265434ea-fb97-43f8-ab64-c1f65c9e42e7] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:46:04.652044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ea1a88d1-93f8-443e-9138-98741d68ea47 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:04.666569 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ea1a88d1-93f8-443e-9138-98741d68ea47 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.339472 May 28 04:46:04.666569 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1367/2887] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:04 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:04.669896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-081031f8-fdc4-41d7-a225-f669536e61e6 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:04.670822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-081031f8-fdc4-41d7-a225-f669536e61e6 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:04.770310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-081031f8-fdc4-41d7-a225-f669536e61e6 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3840ad6a4e4e8c961cc20ee2b5ab0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668db6c41d0d48c3abd9035dcc477e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:04.779786 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-081031f8-fdc4-41d7-a225-f669536e61e6 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 200 len: 1217 microversion: 2.1 time: 0.113255 May 28 04:46:04.795050 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1368/2888] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:04 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 1217 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:04.799468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d01112ea-4799-4912-82f8-8e88ec836e93 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:04.800584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d01112ea-4799-4912-82f8-8e88ec836e93 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:04.875864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d01112ea-4799-4912-82f8-8e88ec836e93 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43548e2fd4fe40799493092aaa4ab255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe10db5df4ce4c78b040947d88450f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:04.883908 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d01112ea-4799-4912-82f8-8e88ec836e93 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4" status: 200 len: 1231 microversion: 2.1 time: 0.091195 May 28 04:46:04.884821 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1369/2889] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:04 2022] GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4 => generated 1231 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:04.892040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53c69456-253a-473d-846f-0fe7a43e0efb tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:04.899814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-53c69456-253a-473d-846f-0fe7a43e0efb tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:04.899814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53c69456-253a-473d-846f-0fe7a43e0efb tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:04.899814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53c69456-253a-473d-846f-0fe7a43e0efb tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:04.900269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53c69456-253a-473d-846f-0fe7a43e0efb tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:04.901026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53c69456-253a-473d-846f-0fe7a43e0efb tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:04.924901 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a2df957c-fa60-455d-ad00-5fa6017f413b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7" status: 204 len: 0 microversion: 2.1 time: 0.616469 May 28 04:46:04.926894 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1521/2890] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:46:04 2022] DELETE /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:46:04.945471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-2ee6dffc-7ed6-4c37-ab4a-3daecf189d70 req-cf6f89fc-c990-4b1c-a738-c38b6f840c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "215a4357-1792-4f6e-ae11-f8574b806b73", "name": "network-vif-unplugged", "status": "completed", "tag": "f007cebf-d19d-420d-891d-de3291249844"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:04.991301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2ee6dffc-7ed6-4c37-ab4a-3daecf189d70 req-cf6f89fc-c990-4b1c-a738-c38b6f840c04 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:04.992326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2ee6dffc-7ed6-4c37-ab4a-3daecf189d70 req-cf6f89fc-c990-4b1c-a738-c38b6f840c04 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:05.045007 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-2ee6dffc-7ed6-4c37-ab4a-3daecf189d70 req-cf6f89fc-c990-4b1c-a738-c38b6f840c04 service nova] Creating event network-vif-unplugged:f007cebf-d19d-420d-891d-de3291249844 for instance 215a4357-1792-4f6e-ae11-f8574b806b73 on n-h2-843700-1 May 28 04:46:05.055018 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-2ee6dffc-7ed6-4c37-ab4a-3daecf189d70 req-cf6f89fc-c990-4b1c-a738-c38b6f840c04 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122626 May 28 04:46:05.059394 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1522/2891] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:05.074425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a2befd35-01a0-416b-9a09-d27c5e117c35 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:05.075535 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a2befd35-01a0-416b-9a09-d27c5e117c35 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:05.090119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a2befd35-01a0-416b-9a09-d27c5e117c35 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:05.090503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a2befd35-01a0-416b-9a09-d27c5e117c35 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:05.091336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a2befd35-01a0-416b-9a09-d27c5e117c35 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:05.091780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a2befd35-01a0-416b-9a09-d27c5e117c35 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:05.165641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-53c69456-253a-473d-846f-0fe7a43e0efb tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883b4a05f5447b78be3f72888ad8138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31adf654f25449ae87a16578bb7930a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:05.175781 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-53c69456-253a-473d-846f-0fe7a43e0efb tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 200 len: 1466 microversion: 2.1 time: 0.289889 May 28 04:46:05.187106 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1370/2892] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:04 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 1466 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:05.196917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-653434e3-3bb1-43af-a3be-cc74a622a0ae tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1256681907", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "aaf67aae-c4ff-4ac3-8e4e-a4156646067f"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:05.268106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-653434e3-3bb1-43af-a3be-cc74a622a0ae tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] validate_networks() for [('aaf67aae-c4ff-4ac3-8e4e-a4156646067f', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:46:05.312141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a2befd35-01a0-416b-9a09-d27c5e117c35 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:05.323147 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a2befd35-01a0-416b-9a09-d27c5e117c35 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.261586 May 28 04:46:05.324358 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1523/2893] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:05 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:05.335121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-65921932-fdbd-404e-bbba-396e84021d94 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7700ed9550>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:05.411180 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-65921932-fdbd-404e-bbba-396e84021d94 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/012b12af-263c-4753-8fad-4a4022b439aa" status: 200 len: 784 microversion: 2.1 time: 0.080522 May 28 04:46:05.421582 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1524/2894] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:05 2022] GET /compute/v2.1/images/012b12af-263c-4753-8fad-4a4022b439aa => generated 784 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:05.439906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-75e048a9-2e48-4119-91fa-e5a1acd3f706 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:05.467278 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-75e048a9-2e48-4119-91fa-e5a1acd3f706 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043130 May 28 04:46:05.475784 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1525/2895] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:46:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:05.490560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1a10debd-6818-4a66-9538-6ca9d1c94e8c tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7700e33430>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:05.866278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-653434e3-3bb1-43af-a3be-cc74a622a0ae tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:46:05.867223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-653434e3-3bb1-43af-a3be-cc74a622a0ae tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:46:05.871959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-653434e3-3bb1-43af-a3be-cc74a622a0ae tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:46:05.871959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-653434e3-3bb1-43af-a3be-cc74a622a0ae tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:46:05.871959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-653434e3-3bb1-43af-a3be-cc74a622a0ae tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:46:05.878560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-653434e3-3bb1-43af-a3be-cc74a622a0ae tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:05.879110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-653434e3-3bb1-43af-a3be-cc74a622a0ae tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:05.879968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-653434e3-3bb1-43af-a3be-cc74a622a0ae tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:05.880478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-653434e3-3bb1-43af-a3be-cc74a622a0ae tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:05.897858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-653434e3-3bb1-43af-a3be-cc74a622a0ae tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Getting quotas for project da841757a2094bad83e04816bb355969. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:46:05.903146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-653434e3-3bb1-43af-a3be-cc74a622a0ae tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Getting quotas for user c07b3b1388d24bae9e8834c8b9a4f3a9 and project da841757a2094bad83e04816bb355969. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:46:05.916088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-653434e3-3bb1-43af-a3be-cc74a622a0ae tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:46:05.918237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-653434e3-3bb1-43af-a3be-cc74a622a0ae tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:46:06.056542 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-653434e3-3bb1-43af-a3be-cc74a622a0ae tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.869799 May 28 04:46:06.057489 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1371/2896] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:46:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:46:06.064688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e1d875ba-0e86-4d28-a49d-73c20d05fcc7 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:06.064688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e1d875ba-0e86-4d28-a49d-73c20d05fcc7 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:06.071967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e1d875ba-0e86-4d28-a49d-73c20d05fcc7 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:06.072426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e1d875ba-0e86-4d28-a49d-73c20d05fcc7 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:06.073446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e1d875ba-0e86-4d28-a49d-73c20d05fcc7 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:06.073856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e1d875ba-0e86-4d28-a49d-73c20d05fcc7 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:06.156479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e1d875ba-0e86-4d28-a49d-73c20d05fcc7 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3840ad6a4e4e8c961cc20ee2b5ab0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668db6c41d0d48c3abd9035dcc477e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:06.163696 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e1d875ba-0e86-4d28-a49d-73c20d05fcc7 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 200 len: 1221 microversion: 2.1 time: 0.105145 May 28 04:46:06.164490 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1372/2897] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:06 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 1221 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:06.173053 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1642c18f-51ae-4867-b308-293d0acb0d72 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:06.173053 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1642c18f-51ae-4867-b308-293d0acb0d72 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:06.176638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1642c18f-51ae-4867-b308-293d0acb0d72 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:06.179525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1642c18f-51ae-4867-b308-293d0acb0d72 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:06.179525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1642c18f-51ae-4867-b308-293d0acb0d72 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:06.179525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1642c18f-51ae-4867-b308-293d0acb0d72 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:06.302941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1642c18f-51ae-4867-b308-293d0acb0d72 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43548e2fd4fe40799493092aaa4ab255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe10db5df4ce4c78b040947d88450f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:06.315872 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1642c18f-51ae-4867-b308-293d0acb0d72 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4" status: 200 len: 1235 microversion: 2.1 time: 0.150209 May 28 04:46:06.319279 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1373/2898] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:06 2022] GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4 => generated 1235 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:06.322410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-98b9bebb-d0f6-41a0-9d3d-e80d5aad57fc tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:06.323243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-98b9bebb-d0f6-41a0-9d3d-e80d5aad57fc tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:06.391329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-98b9bebb-d0f6-41a0-9d3d-e80d5aad57fc tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:06.398830 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-98b9bebb-d0f6-41a0-9d3d-e80d5aad57fc tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1208 microversion: 2.1 time: 0.079902 May 28 04:46:06.399446 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1374/2899] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:06 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1208 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:07.188573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d2ae76ac-039f-49d3-b14f-a57300a6cd5f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:07.191842 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d2ae76ac-039f-49d3-b14f-a57300a6cd5f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:07.202907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d2ae76ac-039f-49d3-b14f-a57300a6cd5f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:07.203702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d2ae76ac-039f-49d3-b14f-a57300a6cd5f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:07.208566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d2ae76ac-039f-49d3-b14f-a57300a6cd5f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:07.208566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d2ae76ac-039f-49d3-b14f-a57300a6cd5f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:07.301742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d2ae76ac-039f-49d3-b14f-a57300a6cd5f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3840ad6a4e4e8c961cc20ee2b5ab0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668db6c41d0d48c3abd9035dcc477e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:07.310414 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d2ae76ac-039f-49d3-b14f-a57300a6cd5f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 200 len: 1269 microversion: 2.1 time: 0.133584 May 28 04:46:07.311702 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1375/2900] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:07 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 1269 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:07.337084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6a0ba458-7f97-4b9e-b24e-089dc801473d tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:07.339276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6a0ba458-7f97-4b9e-b24e-089dc801473d tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:07.344532 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a0ba458-7f97-4b9e-b24e-089dc801473d tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:07.344989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a0ba458-7f97-4b9e-b24e-089dc801473d tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:07.345769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a0ba458-7f97-4b9e-b24e-089dc801473d tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:07.346215 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a0ba458-7f97-4b9e-b24e-089dc801473d tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:07.427163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6a0ba458-7f97-4b9e-b24e-089dc801473d tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43548e2fd4fe40799493092aaa4ab255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe10db5df4ce4c78b040947d88450f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:07.436647 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6a0ba458-7f97-4b9e-b24e-089dc801473d tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4" status: 200 len: 1283 microversion: 2.1 time: 0.103285 May 28 04:46:07.443457 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1376/2901] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:07 2022] GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4 => generated 1283 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:07.448507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-cb2a503f-1029-48e3-896f-8fc833274117 req-9b777bd3-6938-427d-887e-210c26216c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265434ea-fb97-43f8-ab64-c1f65c9e42e7", "name": "network-vif-deleted", "tag": "afb98a08-89c9-4c0b-862a-2a876bc56852"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:07.458308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-cb2a503f-1029-48e3-896f-8fc833274117 req-9b777bd3-6938-427d-887e-210c26216c8b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:07.459114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-cb2a503f-1029-48e3-896f-8fc833274117 req-9b777bd3-6938-427d-887e-210c26216c8b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:07.471497 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-cb2a503f-1029-48e3-896f-8fc833274117 req-9b777bd3-6938-427d-887e-210c26216c8b service nova] Creating event network-vif-deleted:afb98a08-89c9-4c0b-862a-2a876bc56852 for instance 265434ea-fb97-43f8-ab64-c1f65c9e42e7 on n-h2-843700-1 May 28 04:46:07.477689 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-cb2a503f-1029-48e3-896f-8fc833274117 req-9b777bd3-6938-427d-887e-210c26216c8b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032275 May 28 04:46:07.483376 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1377/2902] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:07.483482 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1a10debd-6818-4a66-9538-6ca9d1c94e8c tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "DELETE /compute/v2.1/images/259715a9-301f-43a4-9267-717ba5753778" status: 204 len: 0 microversion: 2.1 time: 2.006013 May 28 04:46:07.484721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-6562ce6c-4a06-4691-8211-005d51ebc9d1 req-f269f1b3-7a68-44ab-a6de-e3d9712e0f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07f65390-23fd-4b9f-9777-14f296eb7100", "name": "network-vif-unplugged", "status": "completed", "tag": "8d31a54d-2623-47d5-b060-1331005f3589"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:07.485134 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1526/2903] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:05 2022] DELETE /compute/v2.1/images/259715a9-301f-43a4-9267-717ba5753778 => generated 0 bytes in 2009 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:46:07.492886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-db76b706-9d31-42af-b89f-f1e1634874ab tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:07.493715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-db76b706-9d31-42af-b89f-f1e1634874ab tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:07.499483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-6562ce6c-4a06-4691-8211-005d51ebc9d1 req-f269f1b3-7a68-44ab-a6de-e3d9712e0f3b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:07.500027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-6562ce6c-4a06-4691-8211-005d51ebc9d1 req-f269f1b3-7a68-44ab-a6de-e3d9712e0f3b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:07.508300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db76b706-9d31-42af-b89f-f1e1634874ab tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:07.508847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db76b706-9d31-42af-b89f-f1e1634874ab tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:07.509811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db76b706-9d31-42af-b89f-f1e1634874ab tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:07.510332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db76b706-9d31-42af-b89f-f1e1634874ab tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:07.520284 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-6562ce6c-4a06-4691-8211-005d51ebc9d1 req-f269f1b3-7a68-44ab-a6de-e3d9712e0f3b service nova] Creating event network-vif-unplugged:8d31a54d-2623-47d5-b060-1331005f3589 for instance 07f65390-23fd-4b9f-9777-14f296eb7100 on n-h1-843700-1 May 28 04:46:07.534921 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-6562ce6c-4a06-4691-8211-005d51ebc9d1 req-f269f1b3-7a68-44ab-a6de-e3d9712e0f3b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055199 May 28 04:46:07.537087 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1378/2904] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:07.555954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-275eb388-47b0-4a99-8f47-97f3173563dd tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7701828dc0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:07.588418 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-275eb388-47b0-4a99-8f47-97f3173563dd tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] HTTP exception thrown: Image not found. May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-275eb388-47b0-4a99-8f47-97f3173563dd tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Request method failure captured: May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/images/259715a9-301f-43a4-9267-717ba5753778 HTTP/1.1 May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikajAiGw5QRZcLmV-2OZtQ8U0bq9L_Gmj4_Lyaj2JO3-3h335vF3r31IgnFsPHud2rpIqagVsCzc5-cHvVCVKTRUvxG-Pr6idaCyHoRGIvJ6hj6-nXK1ptAQXYXl2I1bR-4HZprIfzD5SWexOHf9N5BR-I3n2tcAHM5GDShb_XPetdOI May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 31adf654f25449ae87a16578bb7930a5 May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesOneServerTestJSON-1098276588 May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_31adf654f25449ae87a16578bb7930a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/31adf654f25449ae87a16578bb7930a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31adf654f25449ae87a16578bb7930a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31adf654f25449ae87a16578bb7930a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesOneServerTestJSON-1098276588 May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 31adf654f25449ae87a16578bb7930a5 May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1098276588 May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesOneServerTestJSON-1098276588-project May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: f883b4a05f5447b78be3f72888ad8138 May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesOneServerTestJSON-1098276588-project May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: exception: Image not found. May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '259715a9-301f-43a4-9267-717ba5753778'} May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 259715a9-301f-43a4-9267-717ba5753778 May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 28 04:46:07.597072 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 259715a9-301f-43a4-9267-717ba5753778 could not be found. May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-275eb388-47b0-4a99-8f47-97f3173563dd tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Returning 404 to user: Image not found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:46:07.601797 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-275eb388-47b0-4a99-8f47-97f3173563dd tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/259715a9-301f-43a4-9267-717ba5753778" status: 404 len: 62 microversion: 2.1 time: 0.060202 May 28 04:46:07.606859 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1379/2905] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:07 2022] GET /compute/v2.1/images/259715a9-301f-43a4-9267-717ba5753778 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:46:07.609656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-db76b706-9d31-42af-b89f-f1e1634874ab tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:07.612828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-700c9c8a-ca10-4ae4-82d9-3f45d2c07c0c tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-2120881200"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:07.614060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-700c9c8a-ca10-4ae4-82d9-3f45d2c07c0c tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:07.618629 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-db76b706-9d31-42af-b89f-f1e1634874ab tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1212 microversion: 2.1 time: 0.132464 May 28 04:46:07.620697 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1527/2906] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:07 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1212 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:07.621401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-700c9c8a-ca10-4ae4-82d9-3f45d2c07c0c tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:07.621867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-700c9c8a-ca10-4ae4-82d9-3f45d2c07c0c tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:07.622712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-700c9c8a-ca10-4ae4-82d9-3f45d2c07c0c tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:07.623211 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-700c9c8a-ca10-4ae4-82d9-3f45d2c07c0c tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:08.304942 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-700c9c8a-ca10-4ae4-82d9-3f45d2c07c0c tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "POST /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100/action" status: 202 len: 0 microversion: 2.1 time: 0.695400 May 28 04:46:08.315663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ebc921de-7b1b-4d69-8d65-b29edff5cbd7 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7700e7d0d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:08.326550 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1380/2907] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:46:07 2022] POST /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100/action => generated 0 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 04:46:08.333938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-496ac25c-c881-49e2-b565-c2b11b2ae5c4 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:08.334651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-496ac25c-c881-49e2-b565-c2b11b2ae5c4 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:08.343395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-496ac25c-c881-49e2-b565-c2b11b2ae5c4 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:08.344170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-496ac25c-c881-49e2-b565-c2b11b2ae5c4 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:08.345144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-496ac25c-c881-49e2-b565-c2b11b2ae5c4 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:08.347430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-496ac25c-c881-49e2-b565-c2b11b2ae5c4 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:08.372411 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ebc921de-7b1b-4d69-8d65-b29edff5cbd7 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9" status: 200 len: 1429 microversion: 2.1 time: 0.060958 May 28 04:46:08.373005 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1528/2908] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:08 2022] GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9 => generated 1429 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:08.456464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b821bbda-c6dd-4638-8980-43ed110c4a6b tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:08.457514 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b821bbda-c6dd-4638-8980-43ed110c4a6b tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:08.477790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-496ac25c-c881-49e2-b565-c2b11b2ae5c4 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3840ad6a4e4e8c961cc20ee2b5ab0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668db6c41d0d48c3abd9035dcc477e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:08.481300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b821bbda-c6dd-4638-8980-43ed110c4a6b tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:08.491944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b821bbda-c6dd-4638-8980-43ed110c4a6b tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:08.491944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b821bbda-c6dd-4638-8980-43ed110c4a6b tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:08.491944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b821bbda-c6dd-4638-8980-43ed110c4a6b tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:08.500923 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-496ac25c-c881-49e2-b565-c2b11b2ae5c4 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 200 len: 1277 microversion: 2.1 time: 0.176974 May 28 04:46:08.513679 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1381/2909] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:08 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 1277 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:08.627624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b821bbda-c6dd-4638-8980-43ed110c4a6b tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43548e2fd4fe40799493092aaa4ab255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe10db5df4ce4c78b040947d88450f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:08.635875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6644b486-927b-4ec2-9af3-55d0defb5bca tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:08.636560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6644b486-927b-4ec2-9af3-55d0defb5bca tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:08.640071 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b821bbda-c6dd-4638-8980-43ed110c4a6b tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4" status: 200 len: 1301 microversion: 2.1 time: 0.189394 May 28 04:46:08.641383 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1529/2910] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:08 2022] GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4 => generated 1301 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:08.645623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6644b486-927b-4ec2-9af3-55d0defb5bca tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:08.647418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6644b486-927b-4ec2-9af3-55d0defb5bca tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:08.649891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6644b486-927b-4ec2-9af3-55d0defb5bca tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:08.650350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6644b486-927b-4ec2-9af3-55d0defb5bca tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:08.742324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6644b486-927b-4ec2-9af3-55d0defb5bca tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:08.750767 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6644b486-927b-4ec2-9af3-55d0defb5bca tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1260 microversion: 2.1 time: 0.119219 May 28 04:46:08.760246 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1382/2911] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:08 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1260 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:08.980892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9a96381d-8517-4831-9524-b2cbc2ba882b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:08.981511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9a96381d-8517-4831-9524-b2cbc2ba882b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:08.987790 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a96381d-8517-4831-9524-b2cbc2ba882b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:08.988246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a96381d-8517-4831-9524-b2cbc2ba882b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:08.989011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a96381d-8517-4831-9524-b2cbc2ba882b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:08.989521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a96381d-8517-4831-9524-b2cbc2ba882b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:09.128830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9a96381d-8517-4831-9524-b2cbc2ba882b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:09.135622 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9a96381d-8517-4831-9524-b2cbc2ba882b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.159337 May 28 04:46:09.136228 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1530/2912] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:08 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:09.157124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8cf08372-0e34-4087-902b-a471504cdb5f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:09.160989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8cf08372-0e34-4087-902b-a471504cdb5f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:09.164660 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cf08372-0e34-4087-902b-a471504cdb5f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:09.165340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cf08372-0e34-4087-902b-a471504cdb5f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:09.166352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cf08372-0e34-4087-902b-a471504cdb5f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:09.167002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cf08372-0e34-4087-902b-a471504cdb5f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:09.324178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8cf08372-0e34-4087-902b-a471504cdb5f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:09.334229 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8cf08372-0e34-4087-902b-a471504cdb5f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.181304 May 28 04:46:09.334825 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1383/2913] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:09 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:09.350947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-13de84fd-6dfb-4a43-a143-fb77f6e89f38 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:09.351680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-13de84fd-6dfb-4a43-a143-fb77f6e89f38 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:09.362946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13de84fd-6dfb-4a43-a143-fb77f6e89f38 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:09.363444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13de84fd-6dfb-4a43-a143-fb77f6e89f38 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:09.364398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13de84fd-6dfb-4a43-a143-fb77f6e89f38 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:09.364862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13de84fd-6dfb-4a43-a143-fb77f6e89f38 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:09.390803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e2b21c82-5a8a-4a07-9e7e-190a410661ba tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f77011459d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:09.467258 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e2b21c82-5a8a-4a07-9e7e-190a410661ba tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9" status: 200 len: 1429 microversion: 2.1 time: 0.085112 May 28 04:46:09.473443 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:46:09.473443 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 04:46:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9 (ip 10.222.0.58) !!! May 28 04:46:09.474829 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1384/2914] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:09 2022] GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9 => generated 1429 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:09.530816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0967a199-72ac-445a-a3fd-caa2d4e545e9 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:09.532853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0967a199-72ac-445a-a3fd-caa2d4e545e9 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:09.541190 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0967a199-72ac-445a-a3fd-caa2d4e545e9 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:09.541849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0967a199-72ac-445a-a3fd-caa2d4e545e9 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:09.542674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0967a199-72ac-445a-a3fd-caa2d4e545e9 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:09.543163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0967a199-72ac-445a-a3fd-caa2d4e545e9 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:09.833930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0967a199-72ac-445a-a3fd-caa2d4e545e9 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3840ad6a4e4e8c961cc20ee2b5ab0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668db6c41d0d48c3abd9035dcc477e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:09.843689 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0967a199-72ac-445a-a3fd-caa2d4e545e9 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 200 len: 1275 microversion: 2.1 time: 0.316937 May 28 04:46:09.844361 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1385/2915] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:09 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 1275 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:09.849315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f4ac6855-b20b-4fe7-86ac-855b67572b92 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:09.850262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f4ac6855-b20b-4fe7-86ac-855b67572b92 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:09.857391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4ac6855-b20b-4fe7-86ac-855b67572b92 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:09.857993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4ac6855-b20b-4fe7-86ac-855b67572b92 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:09.859437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4ac6855-b20b-4fe7-86ac-855b67572b92 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:09.859931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4ac6855-b20b-4fe7-86ac-855b67572b92 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:09.912630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-13de84fd-6dfb-4a43-a143-fb77f6e89f38 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:09.921848 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-13de84fd-6dfb-4a43-a143-fb77f6e89f38 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.574884 May 28 04:46:09.922439 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1531/2916] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:09 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:09.927334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dd44841a-b82e-4531-bec7-3cda96f7ae39 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:09.927948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dd44841a-b82e-4531-bec7-3cda96f7ae39 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:09.935757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd44841a-b82e-4531-bec7-3cda96f7ae39 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:09.936765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd44841a-b82e-4531-bec7-3cda96f7ae39 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:09.938314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd44841a-b82e-4531-bec7-3cda96f7ae39 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:09.938784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd44841a-b82e-4531-bec7-3cda96f7ae39 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:10.016492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dd44841a-b82e-4531-bec7-3cda96f7ae39 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:10.027835 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dd44841a-b82e-4531-bec7-3cda96f7ae39 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1266 microversion: 2.1 time: 0.103952 May 28 04:46:10.028415 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1532/2917] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:09 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:10.033261 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-93d2f6ea-6477-4c10-8972-d8bac6cdd2d7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:10.034579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-93d2f6ea-6477-4c10-8972-d8bac6cdd2d7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:10.042353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93d2f6ea-6477-4c10-8972-d8bac6cdd2d7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:10.042804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93d2f6ea-6477-4c10-8972-d8bac6cdd2d7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:10.043604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93d2f6ea-6477-4c10-8972-d8bac6cdd2d7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:10.044041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93d2f6ea-6477-4c10-8972-d8bac6cdd2d7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:10.057001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f4ac6855-b20b-4fe7-86ac-855b67572b92 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43548e2fd4fe40799493092aaa4ab255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe10db5df4ce4c78b040947d88450f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:10.066956 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f4ac6855-b20b-4fe7-86ac-855b67572b92 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4" status: 200 len: 1331 microversion: 2.1 time: 0.221224 May 28 04:46:10.068527 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1386/2918] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:09 2022] GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4 => generated 1331 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:10.319322 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-93d2f6ea-6477-4c10-8972-d8bac6cdd2d7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action" status: 202 len: 0 microversion: 2.1 time: 0.289474 May 28 04:46:10.320016 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1533/2919] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:46:10 2022] POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:46:10.329704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-97248802-3fd9-4c05-a0eb-805235c4e2fe tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:10.330366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-97248802-3fd9-4c05-a0eb-805235c4e2fe tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:10.339800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97248802-3fd9-4c05-a0eb-805235c4e2fe tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:10.340312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97248802-3fd9-4c05-a0eb-805235c4e2fe tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:10.346836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97248802-3fd9-4c05-a0eb-805235c4e2fe tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:10.346836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97248802-3fd9-4c05-a0eb-805235c4e2fe tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:10.363697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:46:10.482532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ea3b51bc-209a-454a-bea8-f34d474bfabb tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7700e8c550>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:10.564440 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ea3b51bc-209a-454a-bea8-f34d474bfabb tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9" status: 200 len: 1429 microversion: 2.1 time: 0.086823 May 28 04:46:10.570252 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1534/2920] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:10 2022] GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9 => generated 1429 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:10.659910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-97248802-3fd9-4c05-a0eb-805235c4e2fe tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:10.668514 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-97248802-3fd9-4c05-a0eb-805235c4e2fe tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1672 microversion: 2.1 time: 0.344269 May 28 04:46:10.669111 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1387/2921] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:10 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1672 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:10.861246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-328e5ddd-3704-4522-93d7-1cbe205bd0e4 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:10.861987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-328e5ddd-3704-4522-93d7-1cbe205bd0e4 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:10.869274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-328e5ddd-3704-4522-93d7-1cbe205bd0e4 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:10.869923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-328e5ddd-3704-4522-93d7-1cbe205bd0e4 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:10.871062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-328e5ddd-3704-4522-93d7-1cbe205bd0e4 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:10.871682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-328e5ddd-3704-4522-93d7-1cbe205bd0e4 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:11.047881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-adb596c7-1cc1-4230-b29a-31ac13df8103 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:11.050903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-adb596c7-1cc1-4230-b29a-31ac13df8103 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:11.058670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-adb596c7-1cc1-4230-b29a-31ac13df8103 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:11.059326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-adb596c7-1cc1-4230-b29a-31ac13df8103 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:11.060305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-adb596c7-1cc1-4230-b29a-31ac13df8103 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:11.062124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-adb596c7-1cc1-4230-b29a-31ac13df8103 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:11.169544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-adb596c7-1cc1-4230-b29a-31ac13df8103 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:11.180664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-328e5ddd-3704-4522-93d7-1cbe205bd0e4 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3840ad6a4e4e8c961cc20ee2b5ab0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668db6c41d0d48c3abd9035dcc477e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:11.183362 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-adb596c7-1cc1-4230-b29a-31ac13df8103 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1266 microversion: 2.1 time: 0.141236 May 28 04:46:11.184965 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1388/2922] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:11 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:11.190340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5945a7a8-c532-44a7-a73a-06d32d56adf4 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:11.191298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5945a7a8-c532-44a7-a73a-06d32d56adf4 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:11.199632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5945a7a8-c532-44a7-a73a-06d32d56adf4 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:11.200762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5945a7a8-c532-44a7-a73a-06d32d56adf4 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:11.208281 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5945a7a8-c532-44a7-a73a-06d32d56adf4 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:11.208281 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5945a7a8-c532-44a7-a73a-06d32d56adf4 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:11.209435 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-328e5ddd-3704-4522-93d7-1cbe205bd0e4 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 200 len: 1317 microversion: 2.1 time: 0.342778 May 28 04:46:11.210122 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1535/2923] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:10 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:11.415480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5945a7a8-c532-44a7-a73a-06d32d56adf4 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43548e2fd4fe40799493092aaa4ab255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe10db5df4ce4c78b040947d88450f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:11.428942 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5945a7a8-c532-44a7-a73a-06d32d56adf4 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4" status: 200 len: 1331 microversion: 2.1 time: 0.242551 May 28 04:46:11.440191 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1389/2924] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:11 2022] GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4 => generated 1331 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:11.580247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6a24cded-d573-4601-8c52-acc6f28fee47 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7700e963a0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:11.641955 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6a24cded-d573-4601-8c52-acc6f28fee47 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9" status: 200 len: 1429 microversion: 2.1 time: 0.067909 May 28 04:46:11.643231 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1536/2925] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:11 2022] GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9 => generated 1429 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:11.686827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e3b9ca69-f41b-42e4-857f-2b523250bc33 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:11.687730 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e3b9ca69-f41b-42e4-857f-2b523250bc33 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:11.694453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3b9ca69-f41b-42e4-857f-2b523250bc33 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:11.695165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3b9ca69-f41b-42e4-857f-2b523250bc33 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:11.696145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3b9ca69-f41b-42e4-857f-2b523250bc33 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:11.696893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3b9ca69-f41b-42e4-857f-2b523250bc33 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:11.869622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e3b9ca69-f41b-42e4-857f-2b523250bc33 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:11.878543 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e3b9ca69-f41b-42e4-857f-2b523250bc33 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1672 microversion: 2.1 time: 0.196268 May 28 04:46:11.879312 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1390/2926] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:11 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1672 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:11.937506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-a6729105-a4ce-472e-8fee-257bc4500d68 req-e929ccc6-efa7-455d-8316-6344d640860b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f247217-093d-4c01-ac2e-77add0b653f4", "tag": "bf1c0ef6-b4cd-40c8-b540-143e43aaf957"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:11.947914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a6729105-a4ce-472e-8fee-257bc4500d68 req-e929ccc6-efa7-455d-8316-6344d640860b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:11.948370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a6729105-a4ce-472e-8fee-257bc4500d68 req-e929ccc6-efa7-455d-8316-6344d640860b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:11.972088 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-a6729105-a4ce-472e-8fee-257bc4500d68 req-e929ccc6-efa7-455d-8316-6344d640860b service nova] Creating event network-changed:bf1c0ef6-b4cd-40c8-b540-143e43aaf957 for instance 2f247217-093d-4c01-ac2e-77add0b653f4 on n-h2-843700-1 May 28 04:46:11.990284 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-a6729105-a4ce-472e-8fee-257bc4500d68 req-e929ccc6-efa7-455d-8316-6344d640860b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056443 May 28 04:46:11.991510 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1537/2927] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:12.203093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7131df22-b4e3-4333-bd5c-eb94c95dff91 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:12.204592 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7131df22-b4e3-4333-bd5c-eb94c95dff91 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:12.218625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7131df22-b4e3-4333-bd5c-eb94c95dff91 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:12.219084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7131df22-b4e3-4333-bd5c-eb94c95dff91 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:12.226661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-58961ac1-70a0-46ab-840c-ead9f4c24540 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:12.227409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-58961ac1-70a0-46ab-840c-ead9f4c24540 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:12.233923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7131df22-b4e3-4333-bd5c-eb94c95dff91 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:12.235267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7131df22-b4e3-4333-bd5c-eb94c95dff91 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:12.242223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58961ac1-70a0-46ab-840c-ead9f4c24540 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:12.242749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58961ac1-70a0-46ab-840c-ead9f4c24540 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:12.243702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58961ac1-70a0-46ab-840c-ead9f4c24540 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:12.244164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58961ac1-70a0-46ab-840c-ead9f4c24540 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:12.627547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-58961ac1-70a0-46ab-840c-ead9f4c24540 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3840ad6a4e4e8c961cc20ee2b5ab0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668db6c41d0d48c3abd9035dcc477e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:12.635817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7131df22-b4e3-4333-bd5c-eb94c95dff91 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:12.649402 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-58961ac1-70a0-46ab-840c-ead9f4c24540 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 200 len: 1317 microversion: 2.1 time: 0.427132 May 28 04:46:12.650261 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7131df22-b4e3-4333-bd5c-eb94c95dff91 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1308 microversion: 2.1 time: 0.449432 May 28 04:46:12.663004 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1391/2928] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:12 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1308 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:12.664293 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1538/2929] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:12 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:12.683692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a90892e6-b5ac-4b45-8805-28ba495e6afb tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7700f46940>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:12.684137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f66983a1-258d-4f97-9153-6fb643166690 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:12.684931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f66983a1-258d-4f97-9153-6fb643166690 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:12.710543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f66983a1-258d-4f97-9153-6fb643166690 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:12.712776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f66983a1-258d-4f97-9153-6fb643166690 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:12.713639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f66983a1-258d-4f97-9153-6fb643166690 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:12.714090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f66983a1-258d-4f97-9153-6fb643166690 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:12.761556 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a90892e6-b5ac-4b45-8805-28ba495e6afb tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9" status: 200 len: 1429 microversion: 2.1 time: 0.096032 May 28 04:46:12.762673 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1539/2930] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:12 2022] GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9 => generated 1429 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:12.895562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cba3b056-97d1-4ce2-b5f6-f03778e1c8b6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:12.896355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cba3b056-97d1-4ce2-b5f6-f03778e1c8b6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:12.903879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cba3b056-97d1-4ce2-b5f6-f03778e1c8b6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:12.904335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cba3b056-97d1-4ce2-b5f6-f03778e1c8b6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:12.905631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cba3b056-97d1-4ce2-b5f6-f03778e1c8b6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:12.906125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cba3b056-97d1-4ce2-b5f6-f03778e1c8b6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:13.069651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f66983a1-258d-4f97-9153-6fb643166690 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43548e2fd4fe40799493092aaa4ab255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe10db5df4ce4c78b040947d88450f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:13.083662 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f66983a1-258d-4f97-9153-6fb643166690 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4" status: 200 len: 1331 microversion: 2.1 time: 0.419182 May 28 04:46:13.095845 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1392/2931] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:12 2022] GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4 => generated 1331 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:13.459660 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-ea6a357e-359d-4308-9459-d582a79af8b9 req-ada758d1-5ac1-488b-9c79-a02e8fde0797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07f65390-23fd-4b9f-9777-14f296eb7100", "name": "network-vif-plugged", "status": "completed", "tag": "8d31a54d-2623-47d5-b060-1331005f3589"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:13.481788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ea6a357e-359d-4308-9459-d582a79af8b9 req-ada758d1-5ac1-488b-9c79-a02e8fde0797 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:13.482606 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ea6a357e-359d-4308-9459-d582a79af8b9 req-ada758d1-5ac1-488b-9c79-a02e8fde0797 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:13.513010 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-ea6a357e-359d-4308-9459-d582a79af8b9 req-ada758d1-5ac1-488b-9c79-a02e8fde0797 service nova] Creating event network-vif-plugged:8d31a54d-2623-47d5-b060-1331005f3589 for instance 07f65390-23fd-4b9f-9777-14f296eb7100 on n-h1-843700-1 May 28 04:46:13.521398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cba3b056-97d1-4ce2-b5f6-f03778e1c8b6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:13.536372 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cba3b056-97d1-4ce2-b5f6-f03778e1c8b6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.644678 May 28 04:46:13.551212 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1540/2932] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:12 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:13.558924 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-ea6a357e-359d-4308-9459-d582a79af8b9 req-ada758d1-5ac1-488b-9c79-a02e8fde0797 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099107 May 28 04:46:13.561893 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1393/2933] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:46:13.563854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9751eec2-619e-4c41-9675-3dffe12e3ec5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:13.565181 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9751eec2-619e-4c41-9675-3dffe12e3ec5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:13.592704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9751eec2-619e-4c41-9675-3dffe12e3ec5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:13.592936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9751eec2-619e-4c41-9675-3dffe12e3ec5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:13.595336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9751eec2-619e-4c41-9675-3dffe12e3ec5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:13.600168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9751eec2-619e-4c41-9675-3dffe12e3ec5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:13.670863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ba146025-4e33-4a5f-b364-e7953d1bd16a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:13.672314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ba146025-4e33-4a5f-b364-e7953d1bd16a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:13.684646 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9751eec2-619e-4c41-9675-3dffe12e3ec5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action" status: 200 len: 322 microversion: 2.1 time: 0.128632 May 28 04:46:13.692365 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1541/2934] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:46:13 2022] POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action => generated 322 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:46:13.704350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba146025-4e33-4a5f-b364-e7953d1bd16a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:13.704350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba146025-4e33-4a5f-b364-e7953d1bd16a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:13.704350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba146025-4e33-4a5f-b364-e7953d1bd16a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:13.704350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba146025-4e33-4a5f-b364-e7953d1bd16a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:13.707915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-020977f6-a8cb-458c-a91b-bf316bf4071a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:13.712010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-020977f6-a8cb-458c-a91b-bf316bf4071a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:13.730616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-020977f6-a8cb-458c-a91b-bf316bf4071a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:13.731916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-020977f6-a8cb-458c-a91b-bf316bf4071a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:13.740706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-020977f6-a8cb-458c-a91b-bf316bf4071a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:13.741756 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-020977f6-a8cb-458c-a91b-bf316bf4071a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:14.046637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:46:14.075800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:46:14.184350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ba146025-4e33-4a5f-b364-e7953d1bd16a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:14.202712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-020977f6-a8cb-458c-a91b-bf316bf4071a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3840ad6a4e4e8c961cc20ee2b5ab0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668db6c41d0d48c3abd9035dcc477e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:14.203945 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ba146025-4e33-4a5f-b364-e7953d1bd16a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1308 microversion: 2.1 time: 0.539124 May 28 04:46:14.204946 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1394/2935] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:13 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1308 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:14.214846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b6848d94-6a21-4750-a378-cba94ffdb8b8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:14.221156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b6848d94-6a21-4750-a378-cba94ffdb8b8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:14.221322 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-020977f6-a8cb-458c-a91b-bf316bf4071a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 200 len: 1317 microversion: 2.1 time: 0.520239 May 28 04:46:14.221322 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1542/2936] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:13 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:14.225698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3c6e61d0-3056-4bbd-b3a7-c6286eb588ce tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7700ea0d30>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:14.230426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6848d94-6a21-4750-a378-cba94ffdb8b8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:14.231024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6848d94-6a21-4750-a378-cba94ffdb8b8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:14.232220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6848d94-6a21-4750-a378-cba94ffdb8b8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:14.233136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6848d94-6a21-4750-a378-cba94ffdb8b8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:14.317700 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3c6e61d0-3056-4bbd-b3a7-c6286eb588ce tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9" status: 200 len: 1429 microversion: 2.1 time: 0.098026 May 28 04:46:14.324741 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1543/2937] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:14 2022] GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9 => generated 1429 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:14.337955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a6c94054-2865-4e72-98ba-74e889492441 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:14.340226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a6c94054-2865-4e72-98ba-74e889492441 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:14.352222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6c94054-2865-4e72-98ba-74e889492441 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:14.352895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6c94054-2865-4e72-98ba-74e889492441 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:14.355455 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6c94054-2865-4e72-98ba-74e889492441 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:14.358943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6c94054-2865-4e72-98ba-74e889492441 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:14.362941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:46:14.824317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b6848d94-6a21-4750-a378-cba94ffdb8b8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:14.848018 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b6848d94-6a21-4750-a378-cba94ffdb8b8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.641815 May 28 04:46:14.849031 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1395/2938] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:14 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:14.859870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-78edcb60-fccf-46cb-9697-cfd3e4bd70a9 req-3ba37481-1ecb-4c46-ba2a-66caa11633c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158d6dcc-16f5-4b5d-8260-3178a329effe", "tag": "6e7d28dc-9821-4d06-b223-29d62f51020f"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:14.882720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-78edcb60-fccf-46cb-9697-cfd3e4bd70a9 req-3ba37481-1ecb-4c46-ba2a-66caa11633c9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:14.883671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-78edcb60-fccf-46cb-9697-cfd3e4bd70a9 req-3ba37481-1ecb-4c46-ba2a-66caa11633c9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:14.903106 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-78edcb60-fccf-46cb-9697-cfd3e4bd70a9 req-3ba37481-1ecb-4c46-ba2a-66caa11633c9 service nova] Creating event network-changed:6e7d28dc-9821-4d06-b223-29d62f51020f for instance 158d6dcc-16f5-4b5d-8260-3178a329effe on n-h2-843700-1 May 28 04:46:14.911619 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-78edcb60-fccf-46cb-9697-cfd3e4bd70a9 req-3ba37481-1ecb-4c46-ba2a-66caa11633c9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059300 May 28 04:46:14.912835 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1396/2939] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:14.920238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9ca275e4-f165-4cdc-b759-3ad6dd6e886c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:14.921288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9ca275e4-f165-4cdc-b759-3ad6dd6e886c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:14.929033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ca275e4-f165-4cdc-b759-3ad6dd6e886c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:14.930610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ca275e4-f165-4cdc-b759-3ad6dd6e886c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:14.931967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ca275e4-f165-4cdc-b759-3ad6dd6e886c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:14.932665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ca275e4-f165-4cdc-b759-3ad6dd6e886c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:15.332666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a6c94054-2865-4e72-98ba-74e889492441 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43548e2fd4fe40799493092aaa4ab255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe10db5df4ce4c78b040947d88450f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:15.344468 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a6c94054-2865-4e72-98ba-74e889492441 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4" status: 200 len: 1331 microversion: 2.1 time: 1.017840 May 28 04:46:15.350342 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1544/2940] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:14 2022] GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4 => generated 1331 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:15.374935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7b38d3fd-6917-4c8a-8444-e23ae47d7817 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:15.375583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7b38d3fd-6917-4c8a-8444-e23ae47d7817 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:15.395339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b38d3fd-6917-4c8a-8444-e23ae47d7817 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:15.398257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b38d3fd-6917-4c8a-8444-e23ae47d7817 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:15.402038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b38d3fd-6917-4c8a-8444-e23ae47d7817 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:15.403711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b38d3fd-6917-4c8a-8444-e23ae47d7817 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:15.662454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9ca275e4-f165-4cdc-b759-3ad6dd6e886c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:15.673922 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9ca275e4-f165-4cdc-b759-3ad6dd6e886c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.756983 May 28 04:46:15.674897 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1397/2941] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:14 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:15.682247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0651200d-debe-46fc-b474-e33e53a739c0 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:15.682875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0651200d-debe-46fc-b474-e33e53a739c0 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:15.703062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:46:15.709938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0651200d-debe-46fc-b474-e33e53a739c0 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:15.710708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0651200d-debe-46fc-b474-e33e53a739c0 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:15.711774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0651200d-debe-46fc-b474-e33e53a739c0 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:15.712440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0651200d-debe-46fc-b474-e33e53a739c0 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:15.853938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7b38d3fd-6917-4c8a-8444-e23ae47d7817 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:15.866953 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7b38d3fd-6917-4c8a-8444-e23ae47d7817 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1308 microversion: 2.1 time: 0.507549 May 28 04:46:15.867528 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1545/2942] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:15 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1308 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:15.872194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-827794e9-0526-46e4-8dd6-2faf7b7947ef tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7700ea0dc0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:15.887737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:46:15.939709 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-827794e9-0526-46e4-8dd6-2faf7b7947ef tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9" status: 200 len: 1429 microversion: 2.1 time: 0.070346 May 28 04:46:15.940327 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1546/2943] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:15 2022] GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9 => generated 1429 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:15.964189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5d38dc0f-acd9-4dc3-b045-6b31573c01f3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:15.964841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5d38dc0f-acd9-4dc3-b045-6b31573c01f3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:15.973307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d38dc0f-acd9-4dc3-b045-6b31573c01f3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:15.973769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d38dc0f-acd9-4dc3-b045-6b31573c01f3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:15.974562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d38dc0f-acd9-4dc3-b045-6b31573c01f3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:15.975028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d38dc0f-acd9-4dc3-b045-6b31573c01f3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:16.064841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0651200d-debe-46fc-b474-e33e53a739c0 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3840ad6a4e4e8c961cc20ee2b5ab0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668db6c41d0d48c3abd9035dcc477e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:16.074407 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0651200d-debe-46fc-b474-e33e53a739c0 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 200 len: 1317 microversion: 2.1 time: 0.398388 May 28 04:46:16.076040 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1398/2944] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:15 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 1317 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:16.206832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5d38dc0f-acd9-4dc3-b045-6b31573c01f3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:16.218955 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5d38dc0f-acd9-4dc3-b045-6b31573c01f3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.271998 May 28 04:46:16.219886 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1547/2945] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:15 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:16.236804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fb0d4b8a-c048-42c9-b2ae-1993db7769be tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:16.237533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fb0d4b8a-c048-42c9-b2ae-1993db7769be tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:16.245195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fb0d4b8a-c048-42c9-b2ae-1993db7769be tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:16.246522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fb0d4b8a-c048-42c9-b2ae-1993db7769be tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:16.247482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fb0d4b8a-c048-42c9-b2ae-1993db7769be tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:16.247931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fb0d4b8a-c048-42c9-b2ae-1993db7769be tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:16.371749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c76f5289-c148-4651-b314-872ef8b97a48 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:16.371749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c76f5289-c148-4651-b314-872ef8b97a48 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:16.379637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c76f5289-c148-4651-b314-872ef8b97a48 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:16.386180 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c76f5289-c148-4651-b314-872ef8b97a48 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:16.387323 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c76f5289-c148-4651-b314-872ef8b97a48 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:16.388118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c76f5289-c148-4651-b314-872ef8b97a48 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:16.395453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=18 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:46:16.456672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fb0d4b8a-c048-42c9-b2ae-1993db7769be tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:16.468300 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fb0d4b8a-c048-42c9-b2ae-1993db7769be tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.234471 May 28 04:46:16.470334 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1399/2946] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:16 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:16.674069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c76f5289-c148-4651-b314-872ef8b97a48 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43548e2fd4fe40799493092aaa4ab255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe10db5df4ce4c78b040947d88450f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:16.683138 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c76f5289-c148-4651-b314-872ef8b97a48 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4" status: 200 len: 1331 microversion: 2.1 time: 0.317644 May 28 04:46:16.684361 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1548/2947] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:16 2022] GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4 => generated 1331 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:16.715983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fcf81bf9-cfb5-4914-8262-efd814bc985a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-660517908", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "fa4b7ae7-c4d1-4b2e-9365-36aea885e8cd"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:16.800208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-fcf81bf9-cfb5-4914-8262-efd814bc985a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] validate_networks() for [('fa4b7ae7-c4d1-4b2e-9365-36aea885e8cd', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:46:16.884264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-21243c0f-d9ef-4753-9781-3f9d7d39461d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:16.884898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-21243c0f-d9ef-4753-9781-3f9d7d39461d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:16.899133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21243c0f-d9ef-4753-9781-3f9d7d39461d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:16.907405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21243c0f-d9ef-4753-9781-3f9d7d39461d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:16.910352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21243c0f-d9ef-4753-9781-3f9d7d39461d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:16.920041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21243c0f-d9ef-4753-9781-3f9d7d39461d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:17.320156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-21243c0f-d9ef-4753-9781-3f9d7d39461d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:17.339163 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-21243c0f-d9ef-4753-9781-3f9d7d39461d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1308 microversion: 2.1 time: 0.455084 May 28 04:46:17.343911 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1549/2948] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:16 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1308 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:17.363610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6d3f2ce3-b072-4459-a10f-bdd8b43914ad tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7700e8cee0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:17.458846 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6d3f2ce3-b072-4459-a10f-bdd8b43914ad tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9" status: 200 len: 1429 microversion: 2.1 time: 0.112583 May 28 04:46:17.465509 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1550/2949] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:17 2022] GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9 => generated 1429 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:17.507298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-05c2662c-78ee-474b-b2f3-df34c3d0f7d7 req-150ee25f-aa20-425e-8eb7-dc9b9401ffea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bb4e9bd-e4d7-4119-963a-188a003df323", "tag": "e69aae4c-26bb-442b-9499-b01e81118939"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:17.519618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-fcf81bf9-cfb5-4914-8262-efd814bc985a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:46:17.520722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-fcf81bf9-cfb5-4914-8262-efd814bc985a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:46:17.521467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-fcf81bf9-cfb5-4914-8262-efd814bc985a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:46:17.522133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-fcf81bf9-cfb5-4914-8262-efd814bc985a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:46:17.523107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-fcf81bf9-cfb5-4914-8262-efd814bc985a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:46:17.533123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-05c2662c-78ee-474b-b2f3-df34c3d0f7d7 req-150ee25f-aa20-425e-8eb7-dc9b9401ffea service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:17.533596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-05c2662c-78ee-474b-b2f3-df34c3d0f7d7 req-150ee25f-aa20-425e-8eb7-dc9b9401ffea service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:17.538609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcf81bf9-cfb5-4914-8262-efd814bc985a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:17.539983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcf81bf9-cfb5-4914-8262-efd814bc985a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:17.541662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcf81bf9-cfb5-4914-8262-efd814bc985a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:17.542136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcf81bf9-cfb5-4914-8262-efd814bc985a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:17.561965 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-05c2662c-78ee-474b-b2f3-df34c3d0f7d7 req-150ee25f-aa20-425e-8eb7-dc9b9401ffea service nova] Creating event network-changed:e69aae4c-26bb-442b-9499-b01e81118939 for instance 3bb4e9bd-e4d7-4119-963a-188a003df323 on n-h2-843700-1 May 28 04:46:17.567454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-fcf81bf9-cfb5-4914-8262-efd814bc985a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Getting quotas for project b0c48bf20efd4291b37e616c658f96ff. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:46:17.577687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-fcf81bf9-cfb5-4914-8262-efd814bc985a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Getting quotas for user 6272045226334bcf8b49a0aa41a07b95 and project b0c48bf20efd4291b37e616c658f96ff. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:46:17.579025 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-05c2662c-78ee-474b-b2f3-df34c3d0f7d7 req-150ee25f-aa20-425e-8eb7-dc9b9401ffea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111664 May 28 04:46:17.580140 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1551/2950] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:17.585403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b7cb5e9f-a341-4359-8496-bba829b53764 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:17.594577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b7cb5e9f-a341-4359-8496-bba829b53764 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:17.614503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fcf81bf9-cfb5-4914-8262-efd814bc985a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:46:17.616290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b7cb5e9f-a341-4359-8496-bba829b53764 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:17.616744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b7cb5e9f-a341-4359-8496-bba829b53764 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:17.617613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b7cb5e9f-a341-4359-8496-bba829b53764 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:17.618040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b7cb5e9f-a341-4359-8496-bba829b53764 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:17.620725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fcf81bf9-cfb5-4914-8262-efd814bc985a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:46:17.801864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b7cb5e9f-a341-4359-8496-bba829b53764 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3840ad6a4e4e8c961cc20ee2b5ab0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668db6c41d0d48c3abd9035dcc477e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:17.810312 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b7cb5e9f-a341-4359-8496-bba829b53764 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 200 len: 1317 microversion: 2.1 time: 0.228830 May 28 04:46:17.812219 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1552/2951] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:17 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:17.826050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b4f4b32c-d701-4b47-898a-afb76e4b2913 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:17.827010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b4f4b32c-d701-4b47-898a-afb76e4b2913 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:17.833261 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4f4b32c-d701-4b47-898a-afb76e4b2913 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:17.834087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4f4b32c-d701-4b47-898a-afb76e4b2913 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:17.835058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4f4b32c-d701-4b47-898a-afb76e4b2913 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:17.835651 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4f4b32c-d701-4b47-898a-afb76e4b2913 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:17.961248 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fcf81bf9-cfb5-4914-8262-efd814bc985a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.258081 May 28 04:46:17.966870 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1400/2952] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:46:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:46:17.974821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9f6025d4-91ba-4e5b-baf8-51f223b09e4c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:17.975712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9f6025d4-91ba-4e5b-baf8-51f223b09e4c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:18.031358 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b4f4b32c-d701-4b47-898a-afb76e4b2913 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43548e2fd4fe40799493092aaa4ab255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe10db5df4ce4c78b040947d88450f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:18.058762 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b4f4b32c-d701-4b47-898a-afb76e4b2913 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4" status: 200 len: 1331 microversion: 2.1 time: 0.245274 May 28 04:46:18.059857 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1553/2953] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:17 2022] GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4 => generated 1331 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:18.111684 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9f6025d4-91ba-4e5b-baf8-51f223b09e4c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:18.121972 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9f6025d4-91ba-4e5b-baf8-51f223b09e4c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1214 microversion: 2.1 time: 0.152343 May 28 04:46:18.123011 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1401/2954] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:17 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1214 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:18.358630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-807bfae7-9a08-41aa-b2b2-07ae4d242b9e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:18.359378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-807bfae7-9a08-41aa-b2b2-07ae4d242b9e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:18.368048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-807bfae7-9a08-41aa-b2b2-07ae4d242b9e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:18.368726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-807bfae7-9a08-41aa-b2b2-07ae4d242b9e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:18.369729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-807bfae7-9a08-41aa-b2b2-07ae4d242b9e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:18.370420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-807bfae7-9a08-41aa-b2b2-07ae4d242b9e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:18.492600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c1592e94-d67f-456d-a596-8dc8d7f187b2 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7701828b80>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:18.581229 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c1592e94-d67f-456d-a596-8dc8d7f187b2 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9" status: 200 len: 1429 microversion: 2.1 time: 0.095246 May 28 04:46:18.582022 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1402/2955] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:18 2022] GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9 => generated 1429 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:18.621838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-807bfae7-9a08-41aa-b2b2-07ae4d242b9e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:18.639700 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-807bfae7-9a08-41aa-b2b2-07ae4d242b9e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1308 microversion: 2.1 time: 0.282729 May 28 04:46:18.640403 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1554/2956] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:18 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1308 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:18.829851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0e78f62a-1ba4-40c7-baf8-d6e5a00ef14c tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:18.830464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0e78f62a-1ba4-40c7-baf8-d6e5a00ef14c tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:18.837142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e78f62a-1ba4-40c7-baf8-d6e5a00ef14c tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:18.837862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e78f62a-1ba4-40c7-baf8-d6e5a00ef14c tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:18.838920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e78f62a-1ba4-40c7-baf8-d6e5a00ef14c tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:18.839668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e78f62a-1ba4-40c7-baf8-d6e5a00ef14c tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:19.077712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-720a5b57-e777-4657-b110-984b125e0f38 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:19.078294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-720a5b57-e777-4657-b110-984b125e0f38 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:19.092988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0e78f62a-1ba4-40c7-baf8-d6e5a00ef14c tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3840ad6a4e4e8c961cc20ee2b5ab0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668db6c41d0d48c3abd9035dcc477e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:19.099195 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0e78f62a-1ba4-40c7-baf8-d6e5a00ef14c tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 200 len: 1317 microversion: 2.1 time: 0.274847 May 28 04:46:19.100345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-720a5b57-e777-4657-b110-984b125e0f38 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:19.100868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-720a5b57-e777-4657-b110-984b125e0f38 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:19.101777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-720a5b57-e777-4657-b110-984b125e0f38 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:19.102218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-720a5b57-e777-4657-b110-984b125e0f38 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:19.117431 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1403/2957] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:18 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:19.142311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6a1b013a-06c1-47a1-a991-cd6d3dfe1673 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:19.143525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6a1b013a-06c1-47a1-a991-cd6d3dfe1673 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:19.165207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a1b013a-06c1-47a1-a991-cd6d3dfe1673 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:19.165207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a1b013a-06c1-47a1-a991-cd6d3dfe1673 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:19.165207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a1b013a-06c1-47a1-a991-cd6d3dfe1673 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:19.165207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a1b013a-06c1-47a1-a991-cd6d3dfe1673 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:19.391012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6a1b013a-06c1-47a1-a991-cd6d3dfe1673 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:19.403259 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6a1b013a-06c1-47a1-a991-cd6d3dfe1673 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1218 microversion: 2.1 time: 0.263978 May 28 04:46:19.405580 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1404/2958] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:19 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1218 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:19.421749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-840da677-e164-4f4b-b619-bbdc549ed6a4 req-197e8cd3-c67a-429e-9f4d-32d1d8a81411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f247217-093d-4c01-ac2e-77add0b653f4", "name": "network-vif-plugged", "status": "completed", "tag": "bf1c0ef6-b4cd-40c8-b540-143e43aaf957"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:19.446504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-840da677-e164-4f4b-b619-bbdc549ed6a4 req-197e8cd3-c67a-429e-9f4d-32d1d8a81411 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:19.447330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-840da677-e164-4f4b-b619-bbdc549ed6a4 req-197e8cd3-c67a-429e-9f4d-32d1d8a81411 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:19.466735 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-840da677-e164-4f4b-b619-bbdc549ed6a4 req-197e8cd3-c67a-429e-9f4d-32d1d8a81411 service nova] Creating event network-vif-plugged:bf1c0ef6-b4cd-40c8-b540-143e43aaf957 for instance 2f247217-093d-4c01-ac2e-77add0b653f4 on n-h2-843700-1 May 28 04:46:19.474311 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-840da677-e164-4f4b-b619-bbdc549ed6a4 req-197e8cd3-c67a-429e-9f4d-32d1d8a81411 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062783 May 28 04:46:19.474311 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1405/2959] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:19.564989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-720a5b57-e777-4657-b110-984b125e0f38 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43548e2fd4fe40799493092aaa4ab255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe10db5df4ce4c78b040947d88450f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:19.577664 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-720a5b57-e777-4657-b110-984b125e0f38 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4" status: 200 len: 1331 microversion: 2.1 time: 0.505390 May 28 04:46:19.579001 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1555/2960] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:19 2022] GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4 => generated 1331 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:19.597887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d6793684-7d31-4ab5-bd00-575b1bbfa835 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7701a2d820>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:19.655866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3f9b5951-596a-471a-8e66-1433be53329c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:19.656517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3f9b5951-596a-471a-8e66-1433be53329c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:19.671810 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d6793684-7d31-4ab5-bd00-575b1bbfa835 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9" status: 200 len: 1429 microversion: 2.1 time: 0.080060 May 28 04:46:19.674263 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1406/2961] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:19 2022] GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9 => generated 1429 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:19.683605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f9b5951-596a-471a-8e66-1433be53329c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:19.684071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f9b5951-596a-471a-8e66-1433be53329c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:19.684858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f9b5951-596a-471a-8e66-1433be53329c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:19.685298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f9b5951-596a-471a-8e66-1433be53329c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:19.864710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3f9b5951-596a-471a-8e66-1433be53329c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:19.879662 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3f9b5951-596a-471a-8e66-1433be53329c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1308 microversion: 2.1 time: 0.227314 May 28 04:46:19.881430 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1556/2962] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:19 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1308 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:20.127036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8162bb36-bc8f-4fa5-a6d8-70e48b57230c tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:20.127491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8162bb36-bc8f-4fa5-a6d8-70e48b57230c tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:20.148503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8162bb36-bc8f-4fa5-a6d8-70e48b57230c tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:20.152908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8162bb36-bc8f-4fa5-a6d8-70e48b57230c tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:20.154147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8162bb36-bc8f-4fa5-a6d8-70e48b57230c tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:20.154667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8162bb36-bc8f-4fa5-a6d8-70e48b57230c tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:20.395580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8162bb36-bc8f-4fa5-a6d8-70e48b57230c tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3840ad6a4e4e8c961cc20ee2b5ab0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668db6c41d0d48c3abd9035dcc477e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:20.407795 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8162bb36-bc8f-4fa5-a6d8-70e48b57230c tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 200 len: 1317 microversion: 2.1 time: 0.293016 May 28 04:46:20.409223 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1407/2963] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:20 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:20.424731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2abfb095-3cba-4da7-bdee-10267dea5b1a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:20.435690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2abfb095-3cba-4da7-bdee-10267dea5b1a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:20.435690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2abfb095-3cba-4da7-bdee-10267dea5b1a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:20.435690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2abfb095-3cba-4da7-bdee-10267dea5b1a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:20.436912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2abfb095-3cba-4da7-bdee-10267dea5b1a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:20.438344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2abfb095-3cba-4da7-bdee-10267dea5b1a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:20.510087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2abfb095-3cba-4da7-bdee-10267dea5b1a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:20.524686 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2abfb095-3cba-4da7-bdee-10267dea5b1a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1266 microversion: 2.1 time: 0.106394 May 28 04:46:20.525905 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1557/2964] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:20 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:20.604389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-43bcb9a2-86c3-4873-aa9e-92fe4c540066 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:20.605150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-43bcb9a2-86c3-4873-aa9e-92fe4c540066 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:20.620232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43bcb9a2-86c3-4873-aa9e-92fe4c540066 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:20.620699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43bcb9a2-86c3-4873-aa9e-92fe4c540066 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:20.621500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43bcb9a2-86c3-4873-aa9e-92fe4c540066 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:20.621943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43bcb9a2-86c3-4873-aa9e-92fe4c540066 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:20.687747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-299ab596-0740-4e49-95d3-b1bc4ebb5111 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7700e8cdc0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:20.756561 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-299ab596-0740-4e49-95d3-b1bc4ebb5111 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9" status: 200 len: 1429 microversion: 2.1 time: 0.073394 May 28 04:46:20.757147 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1558/2965] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:20 2022] GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9 => generated 1429 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:20.897368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8b6b3233-5fed-4574-8f36-59511b58806b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:20.897923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8b6b3233-5fed-4574-8f36-59511b58806b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:20.910155 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b6b3233-5fed-4574-8f36-59511b58806b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:20.910885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b6b3233-5fed-4574-8f36-59511b58806b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:20.911855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b6b3233-5fed-4574-8f36-59511b58806b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:20.912450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b6b3233-5fed-4574-8f36-59511b58806b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:20.985319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-43bcb9a2-86c3-4873-aa9e-92fe4c540066 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43548e2fd4fe40799493092aaa4ab255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe10db5df4ce4c78b040947d88450f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:20.995254 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-43bcb9a2-86c3-4873-aa9e-92fe4c540066 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4" status: 200 len: 1331 microversion: 2.1 time: 0.401767 May 28 04:46:20.995864 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1408/2966] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:20 2022] GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4 => generated 1331 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:21.244836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8b6b3233-5fed-4574-8f36-59511b58806b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:21.257090 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8b6b3233-5fed-4574-8f36-59511b58806b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1308 microversion: 2.1 time: 0.363613 May 28 04:46:21.259155 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1559/2967] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:20 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1308 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:21.426103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-675fd07e-1905-47cf-8df7-4d114b3c8310 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:21.426882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-675fd07e-1905-47cf-8df7-4d114b3c8310 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:21.472159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-675fd07e-1905-47cf-8df7-4d114b3c8310 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:21.472159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-675fd07e-1905-47cf-8df7-4d114b3c8310 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:21.472159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-675fd07e-1905-47cf-8df7-4d114b3c8310 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:21.476713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-675fd07e-1905-47cf-8df7-4d114b3c8310 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:21.541619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b6e59c0e-d35b-41da-ba68-f609de3ed1d7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:21.542531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b6e59c0e-d35b-41da-ba68-f609de3ed1d7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:21.561626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b6e59c0e-d35b-41da-ba68-f609de3ed1d7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:21.563285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b6e59c0e-d35b-41da-ba68-f609de3ed1d7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:21.565509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b6e59c0e-d35b-41da-ba68-f609de3ed1d7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:21.566162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b6e59c0e-d35b-41da-ba68-f609de3ed1d7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:21.719399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b6e59c0e-d35b-41da-ba68-f609de3ed1d7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:21.745973 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b6e59c0e-d35b-41da-ba68-f609de3ed1d7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1272 microversion: 2.1 time: 0.208166 May 28 04:46:21.751228 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1560/2968] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:21 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:21.771988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2216aae8-14b4-433b-98dc-cc10d3838bbd tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7700e96c10>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:21.838781 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2216aae8-14b4-433b-98dc-cc10d3838bbd tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9" status: 200 len: 1429 microversion: 2.1 time: 0.072799 May 28 04:46:21.840865 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1561/2969] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:21 2022] GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9 => generated 1429 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:21.876456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-675fd07e-1905-47cf-8df7-4d114b3c8310 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3840ad6a4e4e8c961cc20ee2b5ab0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668db6c41d0d48c3abd9035dcc477e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:21.882579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:46:21.889317 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-675fd07e-1905-47cf-8df7-4d114b3c8310 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 200 len: 1317 microversion: 2.1 time: 0.467649 May 28 04:46:21.891874 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1409/2970] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:21 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:22.018704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-14182336-f819-4b51-9a6d-5430279b5add tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:22.022235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-14182336-f819-4b51-9a6d-5430279b5add tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:22.037857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14182336-f819-4b51-9a6d-5430279b5add tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:22.038943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14182336-f819-4b51-9a6d-5430279b5add tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:22.039542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14182336-f819-4b51-9a6d-5430279b5add tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:22.044875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14182336-f819-4b51-9a6d-5430279b5add tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:22.279589 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-312d6e7f-442f-440b-825b-6636ad67a20c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:22.279589 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-312d6e7f-442f-440b-825b-6636ad67a20c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:22.285753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-312d6e7f-442f-440b-825b-6636ad67a20c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:22.286232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-312d6e7f-442f-440b-825b-6636ad67a20c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:22.287069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-312d6e7f-442f-440b-825b-6636ad67a20c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:22.287546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-312d6e7f-442f-440b-825b-6636ad67a20c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:22.331752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-14182336-f819-4b51-9a6d-5430279b5add tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43548e2fd4fe40799493092aaa4ab255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe10db5df4ce4c78b040947d88450f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:22.339885 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-14182336-f819-4b51-9a6d-5430279b5add tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4" status: 200 len: 1534 microversion: 2.1 time: 0.329076 May 28 04:46:22.350853 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1562/2971] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:22 2022] GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4 => generated 1534 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:22.357186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b3e48cac-d7b2-4ab1-b4c1-22b2bbd3f3a6 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Action: 'create', calling method: .version_select at 0x7f7700e33dc0>, body: {"pool": "edf1485f-0c2a-463d-b852-0c8f29141a31"} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:22.783519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-312d6e7f-442f-440b-825b-6636ad67a20c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:22.797767 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-312d6e7f-442f-440b-825b-6636ad67a20c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1308 microversion: 2.1 time: 0.525578 May 28 04:46:22.798879 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1410/2972] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:22 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1308 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:22.804964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7dd3d417-9849-4ee1-92b3-e33dd7781b1e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:22.805775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7dd3d417-9849-4ee1-92b3-e33dd7781b1e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:22.818390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7dd3d417-9849-4ee1-92b3-e33dd7781b1e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:22.819360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7dd3d417-9849-4ee1-92b3-e33dd7781b1e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:22.820353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7dd3d417-9849-4ee1-92b3-e33dd7781b1e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:22.820958 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7dd3d417-9849-4ee1-92b3-e33dd7781b1e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:23.069093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7dd3d417-9849-4ee1-92b3-e33dd7781b1e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:23.077785 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7dd3d417-9849-4ee1-92b3-e33dd7781b1e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1314 microversion: 2.1 time: 0.277271 May 28 04:46:23.078233 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1411/2973] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:22 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:23.082677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2e998fb4-1b2a-4daf-b29a-a7ed6f7ac30d tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7701c54550>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:23.124810 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2e998fb4-1b2a-4daf-b29a-a7ed6f7ac30d tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9" status: 200 len: 1429 microversion: 2.1 time: 0.045300 May 28 04:46:23.131481 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1412/2974] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:23 2022] GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9 => generated 1429 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:23.131481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-1c568fa5-4d33-44c1-b0ae-d7bc6f1f0b4a req-3ed648a9-7fcd-41f7-9b71-d213ca7013b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb4e9bd-e4d7-4119-963a-188a003df323", "name": "network-vif-plugged", "status": "completed", "tag": "e69aae4c-26bb-442b-9499-b01e81118939"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:23.138149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1c568fa5-4d33-44c1-b0ae-d7bc6f1f0b4a req-3ed648a9-7fcd-41f7-9b71-d213ca7013b9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:23.138617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1c568fa5-4d33-44c1-b0ae-d7bc6f1f0b4a req-3ed648a9-7fcd-41f7-9b71-d213ca7013b9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:23.150877 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-1c568fa5-4d33-44c1-b0ae-d7bc6f1f0b4a req-3ed648a9-7fcd-41f7-9b71-d213ca7013b9 service nova] Creating event network-vif-plugged:e69aae4c-26bb-442b-9499-b01e81118939 for instance 3bb4e9bd-e4d7-4119-963a-188a003df323 on n-h2-843700-1 May 28 04:46:23.157198 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-1c568fa5-4d33-44c1-b0ae-d7bc6f1f0b4a req-3ed648a9-7fcd-41f7-9b71-d213ca7013b9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030883 May 28 04:46:23.159983 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1413/2975] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:23.167771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-00ffef35-86b4-4ebb-8573-187c2ba3fe51 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:23.168869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-00ffef35-86b4-4ebb-8573-187c2ba3fe51 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:23.177359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-00ffef35-86b4-4ebb-8573-187c2ba3fe51 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:23.178038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-00ffef35-86b4-4ebb-8573-187c2ba3fe51 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:23.179020 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-00ffef35-86b4-4ebb-8573-187c2ba3fe51 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:23.180325 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-00ffef35-86b4-4ebb-8573-187c2ba3fe51 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:24.044474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-00ffef35-86b4-4ebb-8573-187c2ba3fe51 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3840ad6a4e4e8c961cc20ee2b5ab0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668db6c41d0d48c3abd9035dcc477e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:24.054019 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-00ffef35-86b4-4ebb-8573-187c2ba3fe51 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 200 len: 1317 microversion: 2.1 time: 0.892650 May 28 04:46:24.064185 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1414/2976] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:23 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 1317 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:24.069467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aabffeba-82ac-47bb-ad05-60a8a5f57b60 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:24.070830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-aabffeba-82ac-47bb-ad05-60a8a5f57b60 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:24.085032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aabffeba-82ac-47bb-ad05-60a8a5f57b60 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:24.086145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aabffeba-82ac-47bb-ad05-60a8a5f57b60 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:24.087304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aabffeba-82ac-47bb-ad05-60a8a5f57b60 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:24.087951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aabffeba-82ac-47bb-ad05-60a8a5f57b60 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:24.663830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-aabffeba-82ac-47bb-ad05-60a8a5f57b60 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:24.677381 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aabffeba-82ac-47bb-ad05-60a8a5f57b60 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1308 microversion: 2.1 time: 0.611588 May 28 04:46:24.678884 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1415/2977] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:24 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1308 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:24.712349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-10c82a9f-4352-408a-b684-54aa07283f72 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:24.716587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-10c82a9f-4352-408a-b684-54aa07283f72 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:24.739161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10c82a9f-4352-408a-b684-54aa07283f72 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:24.740172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10c82a9f-4352-408a-b684-54aa07283f72 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:24.741266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10c82a9f-4352-408a-b684-54aa07283f72 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:24.743061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10c82a9f-4352-408a-b684-54aa07283f72 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:25.252229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-10c82a9f-4352-408a-b684-54aa07283f72 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:25.270230 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-10c82a9f-4352-408a-b684-54aa07283f72 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1314 microversion: 2.1 time: 0.582906 May 28 04:46:25.272532 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1416/2978] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:24 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:25.285708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d9b7bd78-3ddd-450e-a451-9bf2636dbce1 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f770184b550>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:25.369401 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d9b7bd78-3ddd-450e-a451-9bf2636dbce1 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9" status: 200 len: 1429 microversion: 2.1 time: 0.095548 May 28 04:46:25.376571 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1417/2979] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:25 2022] GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9 => generated 1429 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:25.384716 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-218f105c-6c9e-4732-a7e2-ec3ef9ddf761 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:25.384716 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-218f105c-6c9e-4732-a7e2-ec3ef9ddf761 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:25.390822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-218f105c-6c9e-4732-a7e2-ec3ef9ddf761 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:25.391510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-218f105c-6c9e-4732-a7e2-ec3ef9ddf761 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:25.392523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-218f105c-6c9e-4732-a7e2-ec3ef9ddf761 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:25.393117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-218f105c-6c9e-4732-a7e2-ec3ef9ddf761 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:25.431375 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-218f105c-6c9e-4732-a7e2-ec3ef9ddf761 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/ips" status: 200 len: 149 microversion: 2.1 time: 0.053138 May 28 04:46:25.433252 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1418/2980] 10.222.0.58 () {58 vars in 1247 bytes} [Sat May 28 04:46:25 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/ips => generated 149 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:25.455714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-58f40980-4855-44df-8f51-9f7b3551467f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:25.463499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-58f40980-4855-44df-8f51-9f7b3551467f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:25.478051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-58f40980-4855-44df-8f51-9f7b3551467f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:25.482260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-58f40980-4855-44df-8f51-9f7b3551467f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:25.484872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-58f40980-4855-44df-8f51-9f7b3551467f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:25.488230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-58f40980-4855-44df-8f51-9f7b3551467f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:26.094077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-58f40980-4855-44df-8f51-9f7b3551467f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3840ad6a4e4e8c961cc20ee2b5ab0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668db6c41d0d48c3abd9035dcc477e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:26.105900 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-58f40980-4855-44df-8f51-9f7b3551467f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 200 len: 1317 microversion: 2.1 time: 0.671196 May 28 04:46:26.114007 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1419/2981] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:25 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 1317 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:26.127808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-d2846225-9432-4314-819a-0d2d39de9128 req-282533f1-3a7e-4225-bbaf-35b2af6c8e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158d6dcc-16f5-4b5d-8260-3178a329effe", "name": "network-vif-plugged", "status": "completed", "tag": "6e7d28dc-9821-4d06-b223-29d62f51020f"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:26.171280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d2846225-9432-4314-819a-0d2d39de9128 req-282533f1-3a7e-4225-bbaf-35b2af6c8e61 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:26.177596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d2846225-9432-4314-819a-0d2d39de9128 req-282533f1-3a7e-4225-bbaf-35b2af6c8e61 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:26.219337 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-d2846225-9432-4314-819a-0d2d39de9128 req-282533f1-3a7e-4225-bbaf-35b2af6c8e61 service nova] Creating event network-vif-plugged:6e7d28dc-9821-4d06-b223-29d62f51020f for instance 158d6dcc-16f5-4b5d-8260-3178a329effe on n-h2-843700-1 May 28 04:46:26.225131 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-d2846225-9432-4314-819a-0d2d39de9128 req-282533f1-3a7e-4225-bbaf-35b2af6c8e61 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109261 May 28 04:46:26.225775 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1420/2982] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:26.231665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f290b7cd-79b4-4f80-8241-60b5c225f4a6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:26.232569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f290b7cd-79b4-4f80-8241-60b5c225f4a6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:26.241259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f290b7cd-79b4-4f80-8241-60b5c225f4a6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:26.241730 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f290b7cd-79b4-4f80-8241-60b5c225f4a6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:26.242691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f290b7cd-79b4-4f80-8241-60b5c225f4a6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:26.243196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f290b7cd-79b4-4f80-8241-60b5c225f4a6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:27.088806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f290b7cd-79b4-4f80-8241-60b5c225f4a6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:27.129601 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f290b7cd-79b4-4f80-8241-60b5c225f4a6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1487 microversion: 2.1 time: 0.879282 May 28 04:46:27.129601 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1421/2983] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:26 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1487 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:27.129601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7d6e84f1-1ad1-441b-b255-dbfed8b5ebca tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:27.132885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7d6e84f1-1ad1-441b-b255-dbfed8b5ebca tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:27.154785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d6e84f1-1ad1-441b-b255-dbfed8b5ebca tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:27.155281 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d6e84f1-1ad1-441b-b255-dbfed8b5ebca tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:27.156080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d6e84f1-1ad1-441b-b255-dbfed8b5ebca tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:27.156525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d6e84f1-1ad1-441b-b255-dbfed8b5ebca tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:27.552287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:46:27.604468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7d6e84f1-1ad1-441b-b255-dbfed8b5ebca tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:27.628077 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7d6e84f1-1ad1-441b-b255-dbfed8b5ebca tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1314 microversion: 2.1 time: 0.519872 May 28 04:46:27.630734 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1422/2984] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:27 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:27.645730 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cec44c70-2ccb-4fd1-8edd-16bea5da2c0c tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7701c549d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:27.733728 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cec44c70-2ccb-4fd1-8edd-16bea5da2c0c tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9" status: 200 len: 1429 microversion: 2.1 time: 0.100951 May 28 04:46:27.734241 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1423/2985] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:27 2022] GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9 => generated 1429 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:27.739005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-8ff20935-85ef-42b4-bab1-b61f75a9c3c7 req-9b73ffd1-1fc4-4e0c-adf0-2e90fc6533a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a57aa6a-5fc6-496e-8363-83cc0600e0ee", "tag": "9d5b1efe-7693-4c10-a6a8-94203774e9f9"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:27.748866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8ff20935-85ef-42b4-bab1-b61f75a9c3c7 req-9b73ffd1-1fc4-4e0c-adf0-2e90fc6533a8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:27.749532 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8ff20935-85ef-42b4-bab1-b61f75a9c3c7 req-9b73ffd1-1fc4-4e0c-adf0-2e90fc6533a8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:27.763068 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-8ff20935-85ef-42b4-bab1-b61f75a9c3c7 req-9b73ffd1-1fc4-4e0c-adf0-2e90fc6533a8 service nova] Creating event network-changed:9d5b1efe-7693-4c10-a6a8-94203774e9f9 for instance 2a57aa6a-5fc6-496e-8363-83cc0600e0ee on n-h1-843700-1 May 28 04:46:27.768721 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-8ff20935-85ef-42b4-bab1-b61f75a9c3c7 req-9b73ffd1-1fc4-4e0c-adf0-2e90fc6533a8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033367 May 28 04:46:27.769496 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1424/2986] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:27.774872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-46ffdab5-7922-4324-85c6-490075a54486 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:27.775778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-46ffdab5-7922-4324-85c6-490075a54486 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:27.785057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46ffdab5-7922-4324-85c6-490075a54486 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:27.785673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46ffdab5-7922-4324-85c6-490075a54486 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:27.787437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46ffdab5-7922-4324-85c6-490075a54486 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:27.788050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46ffdab5-7922-4324-85c6-490075a54486 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:28.121667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=8 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:46:28.562572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-46ffdab5-7922-4324-85c6-490075a54486 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3840ad6a4e4e8c961cc20ee2b5ab0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668db6c41d0d48c3abd9035dcc477e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:28.574488 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-46ffdab5-7922-4324-85c6-490075a54486 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 200 len: 1317 microversion: 2.1 time: 0.803637 May 28 04:46:28.578132 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1425/2987] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:27 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 1317 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:28.582676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3c4e22c0-ee47-4fab-9a5a-0175da5ca435 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:28.597072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c4e22c0-ee47-4fab-9a5a-0175da5ca435 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:28.597859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c4e22c0-ee47-4fab-9a5a-0175da5ca435 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:28.680513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3c4e22c0-ee47-4fab-9a5a-0175da5ca435 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Going to try to stop instance {{(pid=126043) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 04:46:28.716362 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b3e48cac-d7b2-4ab1-b4c1-22b2bbd3f3a6 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.363682 May 28 04:46:28.730576 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1563/2988] 10.222.0.58 () {60 vars in 1169 bytes} [Sat May 28 04:46:22 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:46:28.741353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2b15575f-37be-4c9a-ab0a-575d97323768 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:28.743847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2b15575f-37be-4c9a-ab0a-575d97323768 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:28.761673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:46:28.769146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b15575f-37be-4c9a-ab0a-575d97323768 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:28.770044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b15575f-37be-4c9a-ab0a-575d97323768 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:28.773342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b15575f-37be-4c9a-ab0a-575d97323768 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:28.773821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b15575f-37be-4c9a-ab0a-575d97323768 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:28.929618 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3c4e22c0-ee47-4fab-9a5a-0175da5ca435 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "POST /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323/action" status: 202 len: 0 microversion: 2.1 time: 0.352133 May 28 04:46:28.931327 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1426/2989] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:46:28 2022] POST /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:46:28.938493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c95af300-ed2d-456d-9743-6193cf799c2f tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.54"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:28.939787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c95af300-ed2d-456d-9743-6193cf799c2f tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:28.947145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c95af300-ed2d-456d-9743-6193cf799c2f tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:28.947616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c95af300-ed2d-456d-9743-6193cf799c2f tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:28.948563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c95af300-ed2d-456d-9743-6193cf799c2f tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:28.948865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c95af300-ed2d-456d-9743-6193cf799c2f tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:29.008884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2b15575f-37be-4c9a-ab0a-575d97323768 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:29.019354 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2b15575f-37be-4c9a-ab0a-575d97323768 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1314 microversion: 2.1 time: 0.286119 May 28 04:46:29.020048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c95af300-ed2d-456d-9743-6193cf799c2f tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Acquired lock "refresh_cache-2f247217-093d-4c01-ac2e-77add0b653f4" {{(pid=126043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 04:46:29.020505 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1564/2990] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:28 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:29.029859 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-13c2a022-997d-4ade-9dd9-6c77e04427e9 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7700e33ee0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:29.105686 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-13c2a022-997d-4ade-9dd9-6c77e04427e9 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9" status: 200 len: 1429 microversion: 2.1 time: 0.083956 May 28 04:46:29.109430 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1565/2991] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:29 2022] GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9 => generated 1429 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:29.124300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ba133c3e-9c79-4ea1-a122-24050ccf9156 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:29.128572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ba133c3e-9c79-4ea1-a122-24050ccf9156 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:29.143981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba133c3e-9c79-4ea1-a122-24050ccf9156 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:29.144834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba133c3e-9c79-4ea1-a122-24050ccf9156 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:29.146370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba133c3e-9c79-4ea1-a122-24050ccf9156 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:29.146927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba133c3e-9c79-4ea1-a122-24050ccf9156 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:29.556714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ba133c3e-9c79-4ea1-a122-24050ccf9156 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:29.566772 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ba133c3e-9c79-4ea1-a122-24050ccf9156 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1497 microversion: 2.1 time: 0.450612 May 28 04:46:29.571704 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1566/2992] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:29 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1497 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:29.593791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c338a292-b040-4602-bb77-82f489fe95cd tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:29.594815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c338a292-b040-4602-bb77-82f489fe95cd tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:29.602448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c338a292-b040-4602-bb77-82f489fe95cd tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:29.619922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c338a292-b040-4602-bb77-82f489fe95cd tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:29.619922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c338a292-b040-4602-bb77-82f489fe95cd tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:29.619922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c338a292-b040-4602-bb77-82f489fe95cd tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:29.626651 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:46:30.125002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c338a292-b040-4602-bb77-82f489fe95cd tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3840ad6a4e4e8c961cc20ee2b5ab0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668db6c41d0d48c3abd9035dcc477e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:30.133783 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c338a292-b040-4602-bb77-82f489fe95cd tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 200 len: 1506 microversion: 2.1 time: 0.544544 May 28 04:46:30.134593 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1567/2993] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:29 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 1506 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:30.151364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-affecba1-2c20-4a3f-af48-4b4d8c5c225e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aec95bf2-d83c-4a61-bb37-c7cb89ebc076"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:30.153844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-affecba1-2c20-4a3f-af48-4b4d8c5c225e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:30.165599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-affecba1-2c20-4a3f-af48-4b4d8c5c225e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:30.166175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-affecba1-2c20-4a3f-af48-4b4d8c5c225e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:30.167108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-affecba1-2c20-4a3f-af48-4b4d8c5c225e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:30.167665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-affecba1-2c20-4a3f-af48-4b4d8c5c225e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:31.460558 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-affecba1-2c20-4a3f-af48-4b4d8c5c225e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "POST /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.324605 May 28 04:46:31.477089 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1568/2994] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 04:46:30 2022] POST /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments => generated 194 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:31.486374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-51ee548e-42db-4503-bf47-4f128732735d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:31.487389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-51ee548e-42db-4503-bf47-4f128732735d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:31.496224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51ee548e-42db-4503-bf47-4f128732735d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:31.496932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51ee548e-42db-4503-bf47-4f128732735d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:31.498390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51ee548e-42db-4503-bf47-4f128732735d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:31.499018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51ee548e-42db-4503-bf47-4f128732735d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:31.998798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-51ee548e-42db-4503-bf47-4f128732735d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:32.010441 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-51ee548e-42db-4503-bf47-4f128732735d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1314 microversion: 2.1 time: 0.531615 May 28 04:46:32.014164 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1569/2995] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:31 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:32.025049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4f24f6bf-d05c-4e3f-b462-6caf0065969c tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7700efcca0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:32.140208 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4f24f6bf-d05c-4e3f-b462-6caf0065969c tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9" status: 200 len: 1438 microversion: 2.1 time: 0.124867 May 28 04:46:32.141962 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1570/2996] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:32 2022] GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9 => generated 1438 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:32.153829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-33dc8cfc-a019-44ee-beb9-2c7e08eb63e1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:32.155173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-33dc8cfc-a019-44ee-beb9-2c7e08eb63e1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:32.168004 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-33dc8cfc-a019-44ee-beb9-2c7e08eb63e1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:32.168445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-33dc8cfc-a019-44ee-beb9-2c7e08eb63e1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:32.172830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-33dc8cfc-a019-44ee-beb9-2c7e08eb63e1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:32.173444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-33dc8cfc-a019-44ee-beb9-2c7e08eb63e1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:32.372386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-c95af300-ed2d-456d-9743-6193cf799c2f tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Building network info cache for instance {{(pid=126043) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 28 04:46:32.646176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-33dc8cfc-a019-44ee-beb9-2c7e08eb63e1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:32.658515 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-33dc8cfc-a019-44ee-beb9-2c7e08eb63e1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1497 microversion: 2.1 time: 0.515355 May 28 04:46:32.663645 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1571/2997] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:32 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1497 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:32.679655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-29c8df02-6052-46f3-ba94-12db1e735c2a tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7700e7d5e0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:32.760745 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-29c8df02-6052-46f3-ba94-12db1e735c2a tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9" status: 200 len: 1438 microversion: 2.1 time: 0.090535 May 28 04:46:32.761954 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1572/2998] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:46:32 2022] GET /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9 => generated 1438 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:32.769668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-76816efa-b38c-44a1-93b5-7bd5beefe989 req-03481277-afc4-4447-a61d-bff3c7d9ecd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f247217-093d-4c01-ac2e-77add0b653f4", "tag": "bf1c0ef6-b4cd-40c8-b540-143e43aaf957"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:32.795488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-76816efa-b38c-44a1-93b5-7bd5beefe989 req-03481277-afc4-4447-a61d-bff3c7d9ecd6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:32.795968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-76816efa-b38c-44a1-93b5-7bd5beefe989 req-03481277-afc4-4447-a61d-bff3c7d9ecd6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:32.834214 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-76816efa-b38c-44a1-93b5-7bd5beefe989 req-03481277-afc4-4447-a61d-bff3c7d9ecd6 service nova] Creating event network-changed:bf1c0ef6-b4cd-40c8-b540-143e43aaf957 for instance 2f247217-093d-4c01-ac2e-77add0b653f4 on n-h2-843700-1 May 28 04:46:32.839826 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-76816efa-b38c-44a1-93b5-7bd5beefe989 req-03481277-afc4-4447-a61d-bff3c7d9ecd6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076619 May 28 04:46:32.842360 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1573/2999] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:32.859277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eb070fb8-0380-45c3-bf21-651592f5808b tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:32.859277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-eb070fb8-0380-45c3-bf21-651592f5808b tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:32.874618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb070fb8-0380-45c3-bf21-651592f5808b tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:32.875084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb070fb8-0380-45c3-bf21-651592f5808b tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:32.875867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb070fb8-0380-45c3-bf21-651592f5808b tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:32.876303 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb070fb8-0380-45c3-bf21-651592f5808b tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:34.034901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-eb070fb8-0380-45c3-bf21-651592f5808b tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883b4a05f5447b78be3f72888ad8138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31adf654f25449ae87a16578bb7930a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:34.046640 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-eb070fb8-0380-45c3-bf21-651592f5808b tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 200 len: 1466 microversion: 2.1 time: 1.197024 May 28 04:46:34.048227 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1574/3000] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:32 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 1466 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:34.060805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7dbf73b2-a05f-48ee-87d3-934ee8623d54 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:34.072650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7dbf73b2-a05f-48ee-87d3-934ee8623d54 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:34.079455 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7dbf73b2-a05f-48ee-87d3-934ee8623d54 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:34.081275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7dbf73b2-a05f-48ee-87d3-934ee8623d54 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:34.083666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7dbf73b2-a05f-48ee-87d3-934ee8623d54 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:34.085976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7dbf73b2-a05f-48ee-87d3-934ee8623d54 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:34.463788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-c95af300-ed2d-456d-9743-6193cf799c2f tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Updating instance_info_cache with network_info: [{"id": "bf1c0ef6-b4cd-40c8-b540-143e43aaf957", "address": "fa:16:3e:1a:8b:9b", "network": {"id": "9a101fd9-ec3e-4f16-9e69-6c24d7cfb19e", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-576160656-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fe10db5df4ce4c78b040947d88450f51", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbf1c0ef6-b4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126043) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 04:46:34.475995 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c95af300-ed2d-456d-9743-6193cf799c2f tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Releasing lock "refresh_cache-2f247217-093d-4c01-ac2e-77add0b653f4" {{(pid=126043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 04:46:34.477458 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c95af300-ed2d-456d-9743-6193cf799c2f tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "POST /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4/action" status: 202 len: 0 microversion: 2.1 time: 5.544664 May 28 04:46:34.478688 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1427/3001] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:46:28 2022] POST /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4/action => generated 0 bytes in 5547 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 28 04:46:34.488567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ff385b72-945b-46eb-a572-64871701c020 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:34.493096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ff385b72-945b-46eb-a572-64871701c020 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:34.502275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff385b72-945b-46eb-a572-64871701c020 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:34.504540 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff385b72-945b-46eb-a572-64871701c020 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:34.505717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff385b72-945b-46eb-a572-64871701c020 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:34.506395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff385b72-945b-46eb-a572-64871701c020 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:34.513101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7dbf73b2-a05f-48ee-87d3-934ee8623d54 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:34.525117 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7dbf73b2-a05f-48ee-87d3-934ee8623d54 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1314 microversion: 2.1 time: 0.475778 May 28 04:46:34.527088 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1575/3002] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:34 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:34.540755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aac02757-2c38-415a-9f18-f1aceff0eb1b tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7700ea3b80>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:34.752553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ff385b72-945b-46eb-a572-64871701c020 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:34.760716 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ff385b72-945b-46eb-a572-64871701c020 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1497 microversion: 2.1 time: 0.280699 May 28 04:46:34.761434 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1428/3003] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:34 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1497 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:34.775247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c6667dfa-21a8-4d74-9632-18dec65b6adf tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Action: 'create', calling method: .version_select at 0x7f7701a2d9d0>, body: {"pool": "edf1485f-0c2a-463d-b852-0c8f29141a31"} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:36.082084 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aac02757-2c38-415a-9f18-f1aceff0eb1b tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "DELETE /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9" status: 204 len: 0 microversion: 2.1 time: 1.551931 May 28 04:46:36.082889 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1576/3004] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:34 2022] DELETE /compute/v2.1/images/313da2f3-7553-40c4-a370-43ab99f736b9 => generated 0 bytes in 1555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:46:36.091563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6a384908-36cb-4e89-b377-27321e42650e tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a53ccd47-2c01-47d2-9a3f-438cb0c10d60"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:36.092735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6a384908-36cb-4e89-b377-27321e42650e tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:36.100124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a384908-36cb-4e89-b377-27321e42650e tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:36.100559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a384908-36cb-4e89-b377-27321e42650e tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:36.101344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a384908-36cb-4e89-b377-27321e42650e tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:36.101794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a384908-36cb-4e89-b377-27321e42650e tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:37.217127 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6a384908-36cb-4e89-b377-27321e42650e tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "POST /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.129091 May 28 04:46:37.218265 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1577/3005] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 04:46:36 2022] POST /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments => generated 194 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:37.238859 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-078ec46a-e2d2-4b2d-bbe1-9c84449ef900 req-356f8f77-2ef5-4f78-ab0a-8c97108c7308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a57aa6a-5fc6-496e-8363-83cc0600e0ee", "name": "network-vif-plugged", "status": "completed", "tag": "9d5b1efe-7693-4c10-a6a8-94203774e9f9"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:37.250044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-078ec46a-e2d2-4b2d-bbe1-9c84449ef900 req-356f8f77-2ef5-4f78-ab0a-8c97108c7308 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:37.250683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-078ec46a-e2d2-4b2d-bbe1-9c84449ef900 req-356f8f77-2ef5-4f78-ab0a-8c97108c7308 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:37.267321 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-078ec46a-e2d2-4b2d-bbe1-9c84449ef900 req-356f8f77-2ef5-4f78-ab0a-8c97108c7308 service nova] Creating event network-vif-plugged:9d5b1efe-7693-4c10-a6a8-94203774e9f9 for instance 2a57aa6a-5fc6-496e-8363-83cc0600e0ee on n-h1-843700-1 May 28 04:46:37.272986 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-078ec46a-e2d2-4b2d-bbe1-9c84449ef900 req-356f8f77-2ef5-4f78-ab0a-8c97108c7308 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053132 May 28 04:46:37.274319 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1578/3006] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:37.282628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cf14086a-be73-4508-971e-9582d0a9da3d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:37.283576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cf14086a-be73-4508-971e-9582d0a9da3d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:37.292508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf14086a-be73-4508-971e-9582d0a9da3d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:37.293523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf14086a-be73-4508-971e-9582d0a9da3d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:37.296885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf14086a-be73-4508-971e-9582d0a9da3d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:37.296885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf14086a-be73-4508-971e-9582d0a9da3d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:37.802104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cf14086a-be73-4508-971e-9582d0a9da3d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:37.817694 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cf14086a-be73-4508-971e-9582d0a9da3d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1314 microversion: 2.1 time: 0.541264 May 28 04:46:37.832690 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c6667dfa-21a8-4d74-9632-18dec65b6adf tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.061654 May 28 04:46:37.835589 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1429/3007] 10.222.0.58 () {60 vars in 1169 bytes} [Sat May 28 04:46:34 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:37.842537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6c811949-a399-4484-9e2d-11e927f7d73d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:37.846697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6c811949-a399-4484-9e2d-11e927f7d73d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:37.846809 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1579/3008] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:37 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:37.853915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0fc1f050-550e-4d49-b742-fd6b7b9d1109 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '.version_select at 0x7f7700f06af0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:37.861344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c811949-a399-4484-9e2d-11e927f7d73d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:37.864969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c811949-a399-4484-9e2d-11e927f7d73d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:37.865944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c811949-a399-4484-9e2d-11e927f7d73d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:37.866541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c811949-a399-4484-9e2d-11e927f7d73d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:37.962332 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-0fc1f050-550e-4d49-b742-fd6b7b9d1109 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] HTTP exception thrown: Image not found. May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0fc1f050-550e-4d49-b742-fd6b7b9d1109 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Request method failure captured: May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/images/259715a9-301f-43a4-9267-717ba5753778 HTTP/1.1 May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikajAiGw5QRZcLmV-2OZtQ8U0bq9L_Gmj4_Lyaj2JO3-3h335vF3r31IgnFsPHud2rpIqagVsCzc5-cHvVCVKTRUvxG-Pr6idaCyHoRGIvJ6hj6-nXK1ptAQXYXl2I1bR-4HZprIfzD5SWexOHf9N5BR-I3n2tcAHM5GDShb_XPetdOI May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 31adf654f25449ae87a16578bb7930a5 May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ImagesOneServerTestJSON-1098276588 May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_31adf654f25449ae87a16578bb7930a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/31adf654f25449ae87a16578bb7930a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31adf654f25449ae87a16578bb7930a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31adf654f25449ae87a16578bb7930a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ImagesOneServerTestJSON-1098276588 May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 31adf654f25449ae87a16578bb7930a5 May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1098276588 May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ImagesOneServerTestJSON-1098276588-project May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: f883b4a05f5447b78be3f72888ad8138 May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ImagesOneServerTestJSON-1098276588-project May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: exception: Image not found. May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '259715a9-301f-43a4-9267-717ba5753778'} May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 259715a9-301f-43a4-9267-717ba5753778 to delete May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 259715a9-301f-43a4-9267-717ba5753778 could not be found. May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:37.966245 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0fc1f050-550e-4d49-b742-fd6b7b9d1109 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Returning 404 to user: Image not found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:46:37.970466 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0fc1f050-550e-4d49-b742-fd6b7b9d1109 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "DELETE /compute/v2.1/images/259715a9-301f-43a4-9267-717ba5753778" status: 404 len: 62 microversion: 2.1 time: 0.122800 May 28 04:46:37.972247 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1580/3009] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:37 2022] DELETE /compute/v2.1/images/259715a9-301f-43a4-9267-717ba5753778 => generated 62 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:46:37.978820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-13f31a4f-66ff-4cb5-8fb2-228cf68bcd44 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Action: 'action', calling method: .version_select at 0x7f77045174c0>, body: {"addFloatingIp": {"address": "172.25.2.137"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:37.983055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-13f31a4f-66ff-4cb5-8fb2-228cf68bcd44 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:37.996155 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13f31a4f-66ff-4cb5-8fb2-228cf68bcd44 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:37.997859 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13f31a4f-66ff-4cb5-8fb2-228cf68bcd44 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:37.999467 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13f31a4f-66ff-4cb5-8fb2-228cf68bcd44 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:38.000108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13f31a4f-66ff-4cb5-8fb2-228cf68bcd44 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:38.079318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6c811949-a399-4484-9e2d-11e927f7d73d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:38.088033 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6c811949-a399-4484-9e2d-11e927f7d73d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1497 microversion: 2.1 time: 0.250847 May 28 04:46:38.098070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13f31a4f-66ff-4cb5-8fb2-228cf68bcd44 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Acquired lock "refresh_cache-2f247217-093d-4c01-ac2e-77add0b653f4" {{(pid=126044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 04:46:38.100448 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1430/3010] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:37 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1497 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:38.105527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bd48988e-ba85-417e-8b19-937da1c45e6e tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:38.106238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bd48988e-ba85-417e-8b19-937da1c45e6e tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:38.113590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd48988e-ba85-417e-8b19-937da1c45e6e tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:38.114484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd48988e-ba85-417e-8b19-937da1c45e6e tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:38.115777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd48988e-ba85-417e-8b19-937da1c45e6e tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:38.116463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd48988e-ba85-417e-8b19-937da1c45e6e tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:38.122934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:46:38.148550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bd48988e-ba85-417e-8b19-937da1c45e6e tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:46:38.499821 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bd48988e-ba85-417e-8b19-937da1c45e6e tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "DELETE /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 204 len: 0 microversion: 2.1 time: 0.397804 May 28 04:46:38.504182 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1431/3011] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:46:38 2022] DELETE /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:46:38.509720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2c1a9fb4-8980-4fd4-bdb9-a329eb3fcd43 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:38.510701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2c1a9fb4-8980-4fd4-bdb9-a329eb3fcd43 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:38.518926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c1a9fb4-8980-4fd4-bdb9-a329eb3fcd43 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:38.519729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c1a9fb4-8980-4fd4-bdb9-a329eb3fcd43 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:38.520672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c1a9fb4-8980-4fd4-bdb9-a329eb3fcd43 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:38.521263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c1a9fb4-8980-4fd4-bdb9-a329eb3fcd43 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:38.891743 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2c1a9fb4-8980-4fd4-bdb9-a329eb3fcd43 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883b4a05f5447b78be3f72888ad8138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31adf654f25449ae87a16578bb7930a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:38.900551 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2c1a9fb4-8980-4fd4-bdb9-a329eb3fcd43 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 200 len: 1472 microversion: 2.1 time: 0.394927 May 28 04:46:38.901222 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1432/3012] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:38 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 1472 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:38.914908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d7a7d336-67df-4862-a0c6-a7eb07450e50 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:38.915779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d7a7d336-67df-4862-a0c6-a7eb07450e50 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:38.922527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d7a7d336-67df-4862-a0c6-a7eb07450e50 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:38.923090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d7a7d336-67df-4862-a0c6-a7eb07450e50 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:38.923981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d7a7d336-67df-4862-a0c6-a7eb07450e50 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:38.924534 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d7a7d336-67df-4862-a0c6-a7eb07450e50 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:38.953176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG neutronclient.v2_0.client [None req-13f31a4f-66ff-4cb5-8fb2-228cf68bcd44 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.137 (f4a67042-04b1-4359-b453-b4bea8ab733e) with port bf1c0ef6-b4cd-40c8-b540-143e43aaf957 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network edf1485f-0c2a-463d-b852-0c8f29141a31.", "detail": ""}} {{(pid=126044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:46:38.955084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13f31a4f-66ff-4cb5-8fb2-228cf68bcd44 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Releasing lock "refresh_cache-2f247217-093d-4c01-ac2e-77add0b653f4" {{(pid=126044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 04:46:38.957766 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-13f31a4f-66ff-4cb5-8fb2-228cf68bcd44 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.137 (f4a67042-04b1-4359-b453-b4bea8ab733e) with port bf1c0ef6-b4cd-40c8-b540-143e43aaf957 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network edf1485f-0c2a-463d-b852-0c8f29141a31. May 28 04:46:38.957766 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-23708035-9a54-43b3-ac65-e0a337c05ffb'] May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-13f31a4f-66ff-4cb5-8fb2-228cf68bcd44 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Request method failure captured: May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4/action HTTP/1.1 May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 46 May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikakIb1AbIe8RZ1QESkcN4f4Ei7LBP5duwF3Xbe4BJQrsQ8RC9BsNtHLNLxaDPYK3MaRvyUlagJHeZLfCVjTaNALuGG-V7Y9LSs9QVjoqmw15OhJzk9vT9a3yTvsYSBDQuRAZUbMRc9Wito6QwB7DSCk_taeWmkuyKhlr-Sr5iSW9b3U May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: fe10db5df4ce4c78b040947d88450f51 May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-232257043 May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fe10db5df4ce4c78b040947d88450f51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fe10db5df4ce4c78b040947d88450f51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe10db5df4ce4c78b040947d88450f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe10db5df4ce4c78b040947d88450f51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-232257043 May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: fe10db5df4ce4c78b040947d88450f51 May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-232257043 May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 43548e2fd4fe40799493092aaa4ab255 May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: {"addFloatingIp": {"address": "172.25.2.137"}} May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: exception: Cannot associate floating IP 172.25.2.137 (f4a67042-04b1-4359-b453-b4bea8ab733e) with port bf1c0ef6-b4cd-40c8-b540-143e43aaf957 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network edf1485f-0c2a-463d-b852-0c8f29141a31. May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-23708035-9a54-43b3-ac65-e0a337c05ffb'] May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '2f247217-093d-4c01-ac2e-77add0b653f4', 'body': {'addFloatingIp': {'address': '172.25.2.137'}}} May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2689, in associate_floating_ip May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:46:38.960534 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.137 (f4a67042-04b1-4359-b453-b4bea8ab733e) with port bf1c0ef6-b4cd-40c8-b540-143e43aaf957 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network edf1485f-0c2a-463d-b852-0c8f29141a31. May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23708035-9a54-43b3-ac65-e0a337c05ffb'] May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2691, in associate_floating_ip May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.137 (f4a67042-04b1-4359-b453-b4bea8ab733e) with port bf1c0ef6-b4cd-40c8-b540-143e43aaf957 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network edf1485f-0c2a-463d-b852-0c8f29141a31. May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23708035-9a54-43b3-ac65-e0a337c05ffb'] May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.137 (f4a67042-04b1-4359-b453-b4bea8ab733e) with port bf1c0ef6-b4cd-40c8-b540-143e43aaf957 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network edf1485f-0c2a-463d-b852-0c8f29141a31. May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23708035-9a54-43b3-ac65-e0a337c05ffb'] May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.137 (f4a67042-04b1-4359-b453-b4bea8ab733e) with port bf1c0ef6-b4cd-40c8-b540-143e43aaf957 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network edf1485f-0c2a-463d-b852-0c8f29141a31. May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23708035-9a54-43b3-ac65-e0a337c05ffb'] May 28 04:46:38.964781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:38.971151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-13f31a4f-66ff-4cb5-8fb2-228cf68bcd44 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Returning 400 to user: Cannot associate floating IP 172.25.2.137 (f4a67042-04b1-4359-b453-b4bea8ab733e) with port bf1c0ef6-b4cd-40c8-b540-143e43aaf957 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network edf1485f-0c2a-463d-b852-0c8f29141a31. May 28 04:46:38.971151 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-23708035-9a54-43b3-ac65-e0a337c05ffb'] {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:46:38.971151 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-13f31a4f-66ff-4cb5-8fb2-228cf68bcd44 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "POST /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4/action" status: 400 len: 381 microversion: 2.1 time: 0.988515 May 28 04:46:38.971151 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1581/3013] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:46:37 2022] POST /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4/action => generated 381 bytes in 990 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:46:38.973340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f9da2069-f378-43a9-b6b6-8a5ea211889d tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Calling method '.version_select at 0x7f7700ed91f0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:39.249320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d7a7d336-67df-4862-a0c6-a7eb07450e50 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:39.257989 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d7a7d336-67df-4862-a0c6-a7eb07450e50 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1314 microversion: 2.1 time: 0.355484 May 28 04:46:39.268048 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1433/3014] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:38 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:39.268048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-254c2f3e-a73c-46b0-8b6a-8914e59acfa1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:39.268048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-254c2f3e-a73c-46b0-8b6a-8914e59acfa1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:39.272661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-254c2f3e-a73c-46b0-8b6a-8914e59acfa1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:39.278221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-254c2f3e-a73c-46b0-8b6a-8914e59acfa1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:39.278221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-254c2f3e-a73c-46b0-8b6a-8914e59acfa1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:39.278221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-254c2f3e-a73c-46b0-8b6a-8914e59acfa1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:39.605195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-254c2f3e-a73c-46b0-8b6a-8914e59acfa1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:39.609447 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-254c2f3e-a73c-46b0-8b6a-8914e59acfa1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1497 microversion: 2.1 time: 0.349336 May 28 04:46:39.610418 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1434/3015] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:39 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1497 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:39.615963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-504cfe25-a13c-4d48-aefc-7db6ec81f7bc req-19d25a49-763d-4e53-8551-43e3ae10f296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07f65390-23fd-4b9f-9777-14f296eb7100", "name": "network-vif-unplugged", "status": "completed", "tag": "8d31a54d-2623-47d5-b060-1331005f3589"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:39.625938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-504cfe25-a13c-4d48-aefc-7db6ec81f7bc req-19d25a49-763d-4e53-8551-43e3ae10f296 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:39.628201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-504cfe25-a13c-4d48-aefc-7db6ec81f7bc req-19d25a49-763d-4e53-8551-43e3ae10f296 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:39.639897 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-504cfe25-a13c-4d48-aefc-7db6ec81f7bc req-19d25a49-763d-4e53-8551-43e3ae10f296 service nova] Creating event network-vif-unplugged:8d31a54d-2623-47d5-b060-1331005f3589 for instance 07f65390-23fd-4b9f-9777-14f296eb7100 on n-h1-843700-1 May 28 04:46:39.645175 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-504cfe25-a13c-4d48-aefc-7db6ec81f7bc req-19d25a49-763d-4e53-8551-43e3ae10f296 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033309 May 28 04:46:39.646080 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1435/3016] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:39.920722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e7207778-aa1c-4a49-a141-a5c047cb6c05 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:39.922276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e7207778-aa1c-4a49-a141-a5c047cb6c05 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:39.929410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e7207778-aa1c-4a49-a141-a5c047cb6c05 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:39.930077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e7207778-aa1c-4a49-a141-a5c047cb6c05 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:39.931227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e7207778-aa1c-4a49-a141-a5c047cb6c05 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:39.931865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e7207778-aa1c-4a49-a141-a5c047cb6c05 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:40.087335 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f9da2069-f378-43a9-b6b6-8a5ea211889d tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/f4a67042-04b1-4359-b453-b4bea8ab733e" status: 202 len: 0 microversion: 2.1 time: 1.118793 May 28 04:46:40.088905 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1582/3017] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 04:46:38 2022] DELETE /compute/v2.1/os-floating-ips/f4a67042-04b1-4359-b453-b4bea8ab733e => generated 0 bytes in 1122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:46:40.098579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-31eb599a-31c8-4211-9f55-2b5d9f0874a9 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Action: 'action', calling method: .version_select at 0x7f7704517550>, body: {"removeFloatingIp": {"address": "172.25.2.54"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:40.186343 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e7207778-aa1c-4a49-a141-a5c047cb6c05 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883b4a05f5447b78be3f72888ad8138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31adf654f25449ae87a16578bb7930a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:40.216260 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e7207778-aa1c-4a49-a141-a5c047cb6c05 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 200 len: 1472 microversion: 2.1 time: 0.298445 May 28 04:46:40.222074 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1436/3018] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:39 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 1472 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:40.262194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-31eb599a-31c8-4211-9f55-2b5d9f0874a9 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:40.269772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31eb599a-31c8-4211-9f55-2b5d9f0874a9 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:40.270832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31eb599a-31c8-4211-9f55-2b5d9f0874a9 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:40.271993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31eb599a-31c8-4211-9f55-2b5d9f0874a9 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:40.272829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31eb599a-31c8-4211-9f55-2b5d9f0874a9 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:40.279723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-be7490e5-dc90-4338-81f2-93e28c8837bd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:40.281322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-be7490e5-dc90-4338-81f2-93e28c8837bd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:40.290407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-be7490e5-dc90-4338-81f2-93e28c8837bd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:40.291017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-be7490e5-dc90-4338-81f2-93e28c8837bd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:40.292056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-be7490e5-dc90-4338-81f2-93e28c8837bd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:40.292742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-be7490e5-dc90-4338-81f2-93e28c8837bd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:40.999154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-be7490e5-dc90-4338-81f2-93e28c8837bd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:41.010888 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-be7490e5-dc90-4338-81f2-93e28c8837bd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1314 microversion: 2.1 time: 0.738871 May 28 04:46:41.012911 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1437/3019] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:40 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1314 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:41.019585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a0f7773a-7c6c-45da-b01c-8e12d5c85b5d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:41.025822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a0f7773a-7c6c-45da-b01c-8e12d5c85b5d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:41.038122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a0f7773a-7c6c-45da-b01c-8e12d5c85b5d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:41.040419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a0f7773a-7c6c-45da-b01c-8e12d5c85b5d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:41.041482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a0f7773a-7c6c-45da-b01c-8e12d5c85b5d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:41.042206 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a0f7773a-7c6c-45da-b01c-8e12d5c85b5d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:41.055032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31eb599a-31c8-4211-9f55-2b5d9f0874a9 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Acquired lock "refresh_cache-2f247217-093d-4c01-ac2e-77add0b653f4" {{(pid=126044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 04:46:41.452101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a0f7773a-7c6c-45da-b01c-8e12d5c85b5d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:41.465751 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a0f7773a-7c6c-45da-b01c-8e12d5c85b5d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1497 microversion: 2.1 time: 0.449627 May 28 04:46:41.467523 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1438/3020] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:41 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1497 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:41.474262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0df75e1e-68b6-4c63-9cea-46e48437932e tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:41.475267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0df75e1e-68b6-4c63-9cea-46e48437932e tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:41.484877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0df75e1e-68b6-4c63-9cea-46e48437932e tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:41.486710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0df75e1e-68b6-4c63-9cea-46e48437932e tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:41.489746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0df75e1e-68b6-4c63-9cea-46e48437932e tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:41.490367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0df75e1e-68b6-4c63-9cea-46e48437932e tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:41.717483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0df75e1e-68b6-4c63-9cea-46e48437932e tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883b4a05f5447b78be3f72888ad8138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31adf654f25449ae87a16578bb7930a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:41.725517 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0df75e1e-68b6-4c63-9cea-46e48437932e tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 200 len: 1472 microversion: 2.1 time: 0.256129 May 28 04:46:41.726097 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1439/3021] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:41 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 1472 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:41.979409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-cec98b8c-7f33-44db-a01a-c46b61a4b2c0 req-380b39ad-b0e0-4994-b3df-d916b47b9ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07f65390-23fd-4b9f-9777-14f296eb7100", "name": "network-vif-deleted", "tag": "8d31a54d-2623-47d5-b060-1331005f3589"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:41.988275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-cec98b8c-7f33-44db-a01a-c46b61a4b2c0 req-380b39ad-b0e0-4994-b3df-d916b47b9ee6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:41.989024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-cec98b8c-7f33-44db-a01a-c46b61a4b2c0 req-380b39ad-b0e0-4994-b3df-d916b47b9ee6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:42.002941 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-cec98b8c-7f33-44db-a01a-c46b61a4b2c0 req-380b39ad-b0e0-4994-b3df-d916b47b9ee6 service nova] Creating event network-vif-deleted:8d31a54d-2623-47d5-b060-1331005f3589 for instance 07f65390-23fd-4b9f-9777-14f296eb7100 on n-h1-843700-1 May 28 04:46:42.009184 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-cec98b8c-7f33-44db-a01a-c46b61a4b2c0 req-380b39ad-b0e0-4994-b3df-d916b47b9ee6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034639 May 28 04:46:42.010296 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1440/3022] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:46:42.035972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cc5c2cc1-c216-4ec9-9b36-b401dfa0612f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:42.036836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cc5c2cc1-c216-4ec9-9b36-b401dfa0612f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:42.046084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc5c2cc1-c216-4ec9-9b36-b401dfa0612f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:42.047522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc5c2cc1-c216-4ec9-9b36-b401dfa0612f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:42.048346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc5c2cc1-c216-4ec9-9b36-b401dfa0612f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:42.049638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc5c2cc1-c216-4ec9-9b36-b401dfa0612f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:42.291502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cc5c2cc1-c216-4ec9-9b36-b401dfa0612f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:42.310816 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cc5c2cc1-c216-4ec9-9b36-b401dfa0612f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1500 microversion: 2.1 time: 0.281790 May 28 04:46:42.311200 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1441/3023] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:42 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1500 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:42.331276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-67959aca-e4f2-4e34-9883-a7f1173a5eee tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:42.346346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-67959aca-e4f2-4e34-9883-a7f1173a5eee tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:42.346808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-67959aca-e4f2-4e34-9883-a7f1173a5eee tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:42.402518 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-67959aca-e4f2-4e34-9883-a7f1173a5eee tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Going to try to stop instance {{(pid=126043) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 04:46:42.434930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-31eb599a-31c8-4211-9f55-2b5d9f0874a9 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Building network info cache for instance {{(pid=126044) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 28 04:46:42.727609 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-67959aca-e4f2-4e34-9883-a7f1173a5eee tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee/action" status: 202 len: 0 microversion: 2.1 time: 0.398202 May 28 04:46:42.730467 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1442/3024] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:46:42 2022] POST /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:46:42.742297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6baf53fa-7b98-4676-976c-19fd210b36d7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:42.744386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6baf53fa-7b98-4676-976c-19fd210b36d7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:42.760792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:46:42.765580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6baf53fa-7b98-4676-976c-19fd210b36d7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:42.768400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6baf53fa-7b98-4676-976c-19fd210b36d7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:42.769748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6baf53fa-7b98-4676-976c-19fd210b36d7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:42.773654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6baf53fa-7b98-4676-976c-19fd210b36d7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:43.048836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6baf53fa-7b98-4676-976c-19fd210b36d7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:43.059207 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6baf53fa-7b98-4676-976c-19fd210b36d7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1497 microversion: 2.1 time: 0.325876 May 28 04:46:43.067160 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1443/3025] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:42 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1497 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:43.080754 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6c908769-3271-4599-8c3d-505761938e16 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:43.084837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6c908769-3271-4599-8c3d-505761938e16 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:43.105114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c908769-3271-4599-8c3d-505761938e16 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:43.106238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c908769-3271-4599-8c3d-505761938e16 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:43.107514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c908769-3271-4599-8c3d-505761938e16 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:43.113170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c908769-3271-4599-8c3d-505761938e16 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:43.517330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6c908769-3271-4599-8c3d-505761938e16 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:43.530813 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6c908769-3271-4599-8c3d-505761938e16 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.462192 May 28 04:46:43.541236 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1444/3026] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:43 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:43.541236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a5f4c6b6-3f52-4626-9727-6fffb0ec2078 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:43.541236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a5f4c6b6-3f52-4626-9727-6fffb0ec2078 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] [instance: 07f65390-23fd-4b9f-9777-14f296eb7100] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:43.547467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5f4c6b6-3f52-4626-9727-6fffb0ec2078 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:43.551807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5f4c6b6-3f52-4626-9727-6fffb0ec2078 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:43.551807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5f4c6b6-3f52-4626-9727-6fffb0ec2078 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:43.551807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5f4c6b6-3f52-4626-9727-6fffb0ec2078 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:43.563311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-31eb599a-31c8-4211-9f55-2b5d9f0874a9 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Updating instance_info_cache with network_info: [{"id": "bf1c0ef6-b4cd-40c8-b540-143e43aaf957", "address": "fa:16:3e:1a:8b:9b", "network": {"id": "9a101fd9-ec3e-4f16-9e69-6c24d7cfb19e", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-576160656-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fe10db5df4ce4c78b040947d88450f51", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbf1c0ef6-b4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126044) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 04:46:43.571615 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-a5f4c6b6-3f52-4626-9727-6fffb0ec2078 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] HTTP exception thrown: Instance 07f65390-23fd-4b9f-9777-14f296eb7100 could not be found. May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a5f4c6b6-3f52-4626-9727-6fffb0ec2078 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Request method failure captured: May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 HTTP/1.1 May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikajAiGw5QRZcLmV-2OZtQ8U0bq9L_Gmj4_Lyaj2JO3-3h335vF3r31IgnFsPHud2rpIqagVsCzc5-cHvVCVKTRUvxG-Pr6idaCyHoRGIvJ6hj6-nXK1ptAQXYXl2I1bR-4HZprIfzD5SWexOHf9N5BR-I3n2tcAHM5GDShb_XPetdOI May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 31adf654f25449ae87a16578bb7930a5 May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesOneServerTestJSON-1098276588 May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_31adf654f25449ae87a16578bb7930a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/31adf654f25449ae87a16578bb7930a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31adf654f25449ae87a16578bb7930a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31adf654f25449ae87a16578bb7930a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesOneServerTestJSON-1098276588 May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 31adf654f25449ae87a16578bb7930a5 May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1098276588 May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesOneServerTestJSON-1098276588-project May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: f883b4a05f5447b78be3f72888ad8138 May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesOneServerTestJSON-1098276588-project May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 07f65390-23fd-4b9f-9777-14f296eb7100 could not be found. May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '07f65390-23fd-4b9f-9777-14f296eb7100'} May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07f65390-23fd-4b9f-9777-14f296eb7100 could not be found. May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07f65390-23fd-4b9f-9777-14f296eb7100 could not be found. May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:43.594126 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:43.598123 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:43.598123 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:43.598123 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:43.598123 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:46:43.598123 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:46:43.598123 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07f65390-23fd-4b9f-9777-14f296eb7100 could not be found. May 28 04:46:43.598123 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:43.598123 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a5f4c6b6-3f52-4626-9727-6fffb0ec2078 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] Returning 404 to user: Instance 07f65390-23fd-4b9f-9777-14f296eb7100 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:46:43.598123 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a5f4c6b6-3f52-4626-9727-6fffb0ec2078 tempest-ImagesOneServerTestJSON-1098276588 tempest-ImagesOneServerTestJSON-1098276588-project] 10.222.0.58 "GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100" status: 404 len: 111 microversion: 2.1 time: 0.047552 May 28 04:46:43.598123 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1445/3027] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:43 2022] GET /compute/v2.1/servers/07f65390-23fd-4b9f-9777-14f296eb7100 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:46:43.694798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31eb599a-31c8-4211-9f55-2b5d9f0874a9 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Releasing lock "refresh_cache-2f247217-093d-4c01-ac2e-77add0b653f4" {{(pid=126044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 04:46:43.695237 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-31eb599a-31c8-4211-9f55-2b5d9f0874a9 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "POST /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4/action" status: 202 len: 0 microversion: 2.1 time: 3.599071 May 28 04:46:43.696806 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1583/3028] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:46:40 2022] POST /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4/action => generated 0 bytes in 3603 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 28 04:46:43.705416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a06a4d3f-ad9c-4469-a484-9a17746f7290 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Calling method '.version_select at 0x7f7701a8c310>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:44.084441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-56b2e28d-2263-4a7c-b9f8-c94cb60b96c9 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:44.086452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-56b2e28d-2263-4a7c-b9f8-c94cb60b96c9 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:44.097296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56b2e28d-2263-4a7c-b9f8-c94cb60b96c9 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:44.098014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56b2e28d-2263-4a7c-b9f8-c94cb60b96c9 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:44.100007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56b2e28d-2263-4a7c-b9f8-c94cb60b96c9 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:44.101201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56b2e28d-2263-4a7c-b9f8-c94cb60b96c9 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:44.354860 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-56b2e28d-2263-4a7c-b9f8-c94cb60b96c9 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:44.370484 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-56b2e28d-2263-4a7c-b9f8-c94cb60b96c9 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1497 microversion: 2.1 time: 0.288130 May 28 04:46:44.371685 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1584/3029] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:44 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1497 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:44.383118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-a10e01ad-3574-4de0-b620-e92de7c4761a req-69013b99-f1a2-471a-a2f0-babc03e64322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f247217-093d-4c01-ac2e-77add0b653f4", "tag": "bf1c0ef6-b4cd-40c8-b540-143e43aaf957"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:44.401250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a10e01ad-3574-4de0-b620-e92de7c4761a req-69013b99-f1a2-471a-a2f0-babc03e64322 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:44.403227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a10e01ad-3574-4de0-b620-e92de7c4761a req-69013b99-f1a2-471a-a2f0-babc03e64322 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:44.417185 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-a10e01ad-3574-4de0-b620-e92de7c4761a req-69013b99-f1a2-471a-a2f0-babc03e64322 service nova] Creating event network-changed:bf1c0ef6-b4cd-40c8-b540-143e43aaf957 for instance 2f247217-093d-4c01-ac2e-77add0b653f4 on n-h2-843700-1 May 28 04:46:44.424040 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-a10e01ad-3574-4de0-b620-e92de7c4761a req-69013b99-f1a2-471a-a2f0-babc03e64322 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050167 May 28 04:46:44.425171 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1585/3030] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:44.550316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-52f8bbbc-d026-49cf-a6d9-95db2589526d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:44.551390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-52f8bbbc-d026-49cf-a6d9-95db2589526d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:44.558541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52f8bbbc-d026-49cf-a6d9-95db2589526d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:44.559326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52f8bbbc-d026-49cf-a6d9-95db2589526d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:44.561177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52f8bbbc-d026-49cf-a6d9-95db2589526d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:44.565689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52f8bbbc-d026-49cf-a6d9-95db2589526d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:44.749729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-52f8bbbc-d026-49cf-a6d9-95db2589526d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:44.758521 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-52f8bbbc-d026-49cf-a6d9-95db2589526d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.212466 May 28 04:46:44.787825 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1586/3031] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:44 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:44.847837 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a06a4d3f-ad9c-4469-a484-9a17746f7290 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/8ad5d2a8-6006-4471-b8e1-0eb67630661a" status: 202 len: 0 microversion: 2.1 time: 1.146208 May 28 04:46:44.855698 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1446/3032] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 04:46:43 2022] DELETE /compute/v2.1/os-floating-ips/8ad5d2a8-6006-4471-b8e1-0eb67630661a => generated 0 bytes in 1155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:46:44.860884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-065cb30c-904c-46c1-b3e4-9f6e02f2b73a tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-065cb30c-904c-46c1-b3e4-9f6e02f2b73a tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Request method failure captured: May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4/action HTTP/1.1 May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 34 May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikakIb1AbIe8RZ1QESkcN4f4Ei7LBP5duwF3Xbe4BJQrsQ8RC9BsNtHLNLxaDPYK3MaRvyUlagJHeZLfCVjTaNALuGG-V7Y9LSs9QVjoqmw15OhJzk9vT9a3yTvsYSBDQuRAZUbMRc9Wito6QwB7DSCk_taeWmkuyKhlr-Sr5iSW9b3U May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: fe10db5df4ce4c78b040947d88450f51 May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-232257043 May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fe10db5df4ce4c78b040947d88450f51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fe10db5df4ce4c78b040947d88450f51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe10db5df4ce4c78b040947d88450f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe10db5df4ce4c78b040947d88450f51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-232257043 May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: fe10db5df4ce4c78b040947d88450f51 May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-232257043 May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 43548e2fd4fe40799493092aaa4ab255 May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: {"addFloatingIp": {"address": ""}} May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '2f247217-093d-4c01-ac2e-77add0b653f4', 'body': {'addFloatingIp': {'address': ''}}} May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise error May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi '' May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:46:44.863553 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:46:44.867294 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:46:44.867294 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 28 04:46:44.867294 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:44.867294 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:44.867294 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:44.867294 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:44.867294 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:44.867294 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:44.867294 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:46:44.867294 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:46:44.867294 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 28 04:46:44.867294 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:44.869339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-065cb30c-904c-46c1-b3e4-9f6e02f2b73a tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:46:44.870327 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-065cb30c-904c-46c1-b3e4-9f6e02f2b73a tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "POST /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4/action" status: 400 len: 142 microversion: 2.1 time: 0.013656 May 28 04:46:44.871274 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1587/3033] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:46:44 2022] POST /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4/action => generated 142 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:46:44.882971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-960bbee5-879b-430a-b7d6-c97514bbb044 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:44.884237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-960bbee5-879b-430a-b7d6-c97514bbb044 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:44.892212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-960bbee5-879b-430a-b7d6-c97514bbb044 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:44.892746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-960bbee5-879b-430a-b7d6-c97514bbb044 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:44.893593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-960bbee5-879b-430a-b7d6-c97514bbb044 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:44.894107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-960bbee5-879b-430a-b7d6-c97514bbb044 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:44.945088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-960bbee5-879b-430a-b7d6-c97514bbb044 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Acquired lock "refresh_cache-2f247217-093d-4c01-ac2e-77add0b653f4" {{(pid=126043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 04:46:45.070009 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-960bbee5-879b-430a-b7d6-c97514bbb044 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Releasing lock "refresh_cache-2f247217-093d-4c01-ac2e-77add0b653f4" {{(pid=126043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 04:46:45.070915 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-960bbee5-879b-430a-b7d6-c97514bbb044 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] HTTP exception thrown: floating IP not found May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-960bbee5-879b-430a-b7d6-c97514bbb044 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Request method failure captured: May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4/action HTTP/1.1 May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 41 May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikakIb1AbIe8RZ1QESkcN4f4Ei7LBP5duwF3Xbe4BJQrsQ8RC9BsNtHLNLxaDPYK3MaRvyUlagJHeZLfCVjTaNALuGG-V7Y9LSs9QVjoqmw15OhJzk9vT9a3yTvsYSBDQuRAZUbMRc9Wito6QwB7DSCk_taeWmkuyKhlr-Sr5iSW9b3U May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: fe10db5df4ce4c78b040947d88450f51 May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-232257043 May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fe10db5df4ce4c78b040947d88450f51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fe10db5df4ce4c78b040947d88450f51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe10db5df4ce4c78b040947d88450f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe10db5df4ce4c78b040947d88450f51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-232257043 May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: fe10db5df4ce4c78b040947d88450f51 May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-232257043 May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 43548e2fd4fe40799493092aaa4ab255 May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: {"addFloatingIp": {"address": "0.0.0.0"}} May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: exception: floating IP not found May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '2f247217-093d-4c01-ac2e-77add0b653f4', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2685, in associate_floating_ip May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2997, in _get_floating_ip_by_address May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found May 28 04:46:45.072857 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:45.077210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:45.077210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:45.077210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:45.077210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:45.077210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:45.077210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:46:45.077210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:46:45.077210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found May 28 04:46:45.077210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:45.079437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-960bbee5-879b-430a-b7d6-c97514bbb044 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Returning 404 to user: floating IP not found {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:46:45.080520 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-960bbee5-879b-430a-b7d6-c97514bbb044 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "POST /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4/action" status: 404 len: 67 microversion: 2.1 time: 0.201669 May 28 04:46:45.081655 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1447/3034] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:46:44 2022] POST /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4/action => generated 67 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:46:45.090977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-84be888f-ac6e-49b0-8c97-eb7b25138e12 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:45.139611 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-84be888f-ac6e-49b0-8c97-eb7b25138e12 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-84be888f-ac6e-49b0-8c97-eb7b25138e12 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Request method failure captured: May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4/action HTTP/1.1 May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 44 May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikakIb1AbIe8RZ1QESkcN4f4Ei7LBP5duwF3Xbe4BJQrsQ8RC9BsNtHLNLxaDPYK3MaRvyUlagJHeZLfCVjTaNALuGG-V7Y9LSs9QVjoqmw15OhJzk9vT9a3yTvsYSBDQuRAZUbMRc9Wito6QwB7DSCk_taeWmkuyKhlr-Sr5iSW9b3U May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: fe10db5df4ce4c78b040947d88450f51 May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-232257043 May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fe10db5df4ce4c78b040947d88450f51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fe10db5df4ce4c78b040947d88450f51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe10db5df4ce4c78b040947d88450f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe10db5df4ce4c78b040947d88450f51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-232257043 May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: fe10db5df4ce4c78b040947d88450f51 May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-232257043 May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 43548e2fd4fe40799493092aaa4ab255 May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: {"removeFloatingIp": {"address": "0.0.0.0"}} May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: exception: Floating IP not found for address 0.0.0.0. May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '2f247217-093d-4c01-ac2e-77add0b653f4', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2913, in get_instance_id_by_floating_address May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2997, in _get_floating_ip_by_address May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr May 28 04:46:45.141849 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) May 28 04:46:45.147186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. May 28 04:46:45.147186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:45.147186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:45.147186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:45.147186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:45.147186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:45.147186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:45.147186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:46:45.147186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:46:45.147186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. May 28 04:46:45.147186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:45.147186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-84be888f-ac6e-49b0-8c97-eb7b25138e12 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:46:45.148650 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-84be888f-ac6e-49b0-8c97-eb7b25138e12 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "POST /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4/action" status: 404 len: 88 microversion: 2.1 time: 0.056238 May 28 04:46:45.149763 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1588/3035] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:46:45 2022] POST /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4/action => generated 88 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:46:45.159434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-778e8324-9272-4eab-a436-e09ae738a079 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:45.160457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-778e8324-9272-4eab-a436-e09ae738a079 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:45.168212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-778e8324-9272-4eab-a436-e09ae738a079 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:45.169443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-778e8324-9272-4eab-a436-e09ae738a079 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:45.170694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-778e8324-9272-4eab-a436-e09ae738a079 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:45.171742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-778e8324-9272-4eab-a436-e09ae738a079 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:45.202425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:46:45.213157 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-778e8324-9272-4eab-a436-e09ae738a079 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:46:45.391486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6c204cf8-6cb8-4120-bbb5-8bac3e3ac7d6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:45.392942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6c204cf8-6cb8-4120-bbb5-8bac3e3ac7d6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:45.404219 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c204cf8-6cb8-4120-bbb5-8bac3e3ac7d6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:45.404712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c204cf8-6cb8-4120-bbb5-8bac3e3ac7d6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:45.405881 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c204cf8-6cb8-4120-bbb5-8bac3e3ac7d6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:45.405986 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c204cf8-6cb8-4120-bbb5-8bac3e3ac7d6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:45.558298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6c204cf8-6cb8-4120-bbb5-8bac3e3ac7d6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:45.566215 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6c204cf8-6cb8-4120-bbb5-8bac3e3ac7d6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1497 microversion: 2.1 time: 0.182414 May 28 04:46:45.568062 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1589/3036] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:45 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:45.620027 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-778e8324-9272-4eab-a436-e09ae738a079 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4" status: 204 len: 0 microversion: 2.1 time: 0.464576 May 28 04:46:45.620656 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1448/3037] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:46:45 2022] DELETE /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 04:46:45.637806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f993f134-9811-455e-aafe-3be07b3a22da tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:45.643020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f993f134-9811-455e-aafe-3be07b3a22da tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:45.652210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f993f134-9811-455e-aafe-3be07b3a22da tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:45.652687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f993f134-9811-455e-aafe-3be07b3a22da tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:45.653559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f993f134-9811-455e-aafe-3be07b3a22da tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:45.654501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f993f134-9811-455e-aafe-3be07b3a22da tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:45.665048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:46:45.776564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-648f64a8-3ba9-4b87-8ec3-11dec2930e63 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:45.777286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-648f64a8-3ba9-4b87-8ec3-11dec2930e63 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:45.796018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-648f64a8-3ba9-4b87-8ec3-11dec2930e63 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:45.796837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-648f64a8-3ba9-4b87-8ec3-11dec2930e63 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:45.797817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-648f64a8-3ba9-4b87-8ec3-11dec2930e63 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:45.798505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-648f64a8-3ba9-4b87-8ec3-11dec2930e63 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:45.829785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f993f134-9811-455e-aafe-3be07b3a22da tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43548e2fd4fe40799493092aaa4ab255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe10db5df4ce4c78b040947d88450f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:45.838020 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f993f134-9811-455e-aafe-3be07b3a22da tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4" status: 200 len: 1540 microversion: 2.1 time: 0.205304 May 28 04:46:45.843653 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1590/3038] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:45 2022] GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4 => generated 1540 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:45.938447 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-648f64a8-3ba9-4b87-8ec3-11dec2930e63 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:45.946803 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-648f64a8-3ba9-4b87-8ec3-11dec2930e63 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.174757 May 28 04:46:45.947582 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1449/3039] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:45 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:46.586676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a59dc4d2-e1df-4f88-b736-13ca05b22fe1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:46.587622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a59dc4d2-e1df-4f88-b736-13ca05b22fe1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:46.597791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a59dc4d2-e1df-4f88-b736-13ca05b22fe1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:46.598259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a59dc4d2-e1df-4f88-b736-13ca05b22fe1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:46.599252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a59dc4d2-e1df-4f88-b736-13ca05b22fe1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:46.599890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a59dc4d2-e1df-4f88-b736-13ca05b22fe1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:46.793059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a59dc4d2-e1df-4f88-b736-13ca05b22fe1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:46.801530 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a59dc4d2-e1df-4f88-b736-13ca05b22fe1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1497 microversion: 2.1 time: 0.219666 May 28 04:46:46.802050 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1591/3040] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:46 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1497 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:46.856966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4e138201-85d5-4153-a80a-131741266339 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:46.857720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4e138201-85d5-4153-a80a-131741266339 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:46.864780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e138201-85d5-4153-a80a-131741266339 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:46.865236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e138201-85d5-4153-a80a-131741266339 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:46.866026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e138201-85d5-4153-a80a-131741266339 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:46.866463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e138201-85d5-4153-a80a-131741266339 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:46.963765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-820f18b8-0f77-43fd-933a-cd5f7b3b6833 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:46.964404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-820f18b8-0f77-43fd-933a-cd5f7b3b6833 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:46.977270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-820f18b8-0f77-43fd-933a-cd5f7b3b6833 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:46.977732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-820f18b8-0f77-43fd-933a-cd5f7b3b6833 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:46.978704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-820f18b8-0f77-43fd-933a-cd5f7b3b6833 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:46.979221 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-820f18b8-0f77-43fd-933a-cd5f7b3b6833 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:47.043094 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4e138201-85d5-4153-a80a-131741266339 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43548e2fd4fe40799493092aaa4ab255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe10db5df4ce4c78b040947d88450f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:47.055075 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4e138201-85d5-4153-a80a-131741266339 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4" status: 200 len: 1540 microversion: 2.1 time: 0.202277 May 28 04:46:47.056476 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1450/3041] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:46 2022] GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4 => generated 1540 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:47.267777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-820f18b8-0f77-43fd-933a-cd5f7b3b6833 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:47.276025 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-820f18b8-0f77-43fd-933a-cd5f7b3b6833 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.315587 May 28 04:46:47.276276 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1592/3042] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:46 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:47.824716 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c5f0e8e6-7d95-479f-9888-ade3e68c4443 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:47.828433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c5f0e8e6-7d95-479f-9888-ade3e68c4443 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:47.839911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5f0e8e6-7d95-479f-9888-ade3e68c4443 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:47.840721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5f0e8e6-7d95-479f-9888-ade3e68c4443 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:47.841745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5f0e8e6-7d95-479f-9888-ade3e68c4443 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:47.842870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5f0e8e6-7d95-479f-9888-ade3e68c4443 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:48.009486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c5f0e8e6-7d95-479f-9888-ade3e68c4443 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:48.018064 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c5f0e8e6-7d95-479f-9888-ade3e68c4443 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1497 microversion: 2.1 time: 0.202297 May 28 04:46:48.019232 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1451/3043] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:47 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:48.076231 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-290d7146-30c5-4359-a62a-fe72b2f38e47 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:48.077053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-290d7146-30c5-4359-a62a-fe72b2f38e47 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:48.089612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-290d7146-30c5-4359-a62a-fe72b2f38e47 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:48.090535 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-290d7146-30c5-4359-a62a-fe72b2f38e47 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:48.095926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-290d7146-30c5-4359-a62a-fe72b2f38e47 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:48.095926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-290d7146-30c5-4359-a62a-fe72b2f38e47 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:48.292869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7bc015da-74c1-4cc7-9bb3-fae7ee0a785e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:48.293684 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7bc015da-74c1-4cc7-9bb3-fae7ee0a785e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:48.313250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7bc015da-74c1-4cc7-9bb3-fae7ee0a785e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:48.313866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7bc015da-74c1-4cc7-9bb3-fae7ee0a785e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:48.314778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7bc015da-74c1-4cc7-9bb3-fae7ee0a785e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:48.315356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7bc015da-74c1-4cc7-9bb3-fae7ee0a785e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:49.032599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7bc015da-74c1-4cc7-9bb3-fae7ee0a785e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:49.047413 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7bc015da-74c1-4cc7-9bb3-fae7ee0a785e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.753312 May 28 04:46:49.048885 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1452/3044] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:48 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:49.063583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-cbbd1406-527d-45cf-b7e3-71e46ee92538 req-64830e37-8208-4a4c-8a10-70a4469305a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f247217-093d-4c01-ac2e-77add0b653f4", "name": "network-vif-deleted", "tag": "bf1c0ef6-b4cd-40c8-b540-143e43aaf957"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:49.063756 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-290d7146-30c5-4359-a62a-fe72b2f38e47 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43548e2fd4fe40799493092aaa4ab255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe10db5df4ce4c78b040947d88450f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:49.072627 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-290d7146-30c5-4359-a62a-fe72b2f38e47 tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4" status: 200 len: 1540 microversion: 2.1 time: 1.002216 May 28 04:46:49.073584 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1593/3045] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:48 2022] GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4 => generated 1540 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:49.075724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-cbbd1406-527d-45cf-b7e3-71e46ee92538 req-64830e37-8208-4a4c-8a10-70a4469305a0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:49.076673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-cbbd1406-527d-45cf-b7e3-71e46ee92538 req-64830e37-8208-4a4c-8a10-70a4469305a0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:49.102093 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-cbbd1406-527d-45cf-b7e3-71e46ee92538 req-64830e37-8208-4a4c-8a10-70a4469305a0 service nova] Creating event network-vif-deleted:bf1c0ef6-b4cd-40c8-b540-143e43aaf957 for instance 2f247217-093d-4c01-ac2e-77add0b653f4 on n-h2-843700-1 May 28 04:46:49.113703 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-cbbd1406-527d-45cf-b7e3-71e46ee92538 req-64830e37-8208-4a4c-8a10-70a4469305a0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061237 May 28 04:46:49.124388 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1453/3046] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:49.130248 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-20b808db-e40a-426d-bd10-65ee9d398cd3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:49.134389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-20b808db-e40a-426d-bd10-65ee9d398cd3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:49.158136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20b808db-e40a-426d-bd10-65ee9d398cd3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:49.158518 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20b808db-e40a-426d-bd10-65ee9d398cd3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:49.159346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20b808db-e40a-426d-bd10-65ee9d398cd3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:49.159800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20b808db-e40a-426d-bd10-65ee9d398cd3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:49.245223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c663adb8-3cac-455d-bb51-ea34da3bbc73 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-302831986", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "b91e6aa7-72c1-4a13-ac33-917f89cda5b1"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:49.332107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-20b808db-e40a-426d-bd10-65ee9d398cd3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:49.353534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-c663adb8-3cac-455d-bb51-ea34da3bbc73 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] validate_networks() for [('b91e6aa7-72c1-4a13-ac33-917f89cda5b1', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:46:49.354498 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-20b808db-e40a-426d-bd10-65ee9d398cd3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1497 microversion: 2.1 time: 0.216625 May 28 04:46:49.354498 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1454/3047] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:49 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1497 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:49.847262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c663adb8-3cac-455d-bb51-ea34da3bbc73 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:46:49.847918 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c663adb8-3cac-455d-bb51-ea34da3bbc73 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:46:49.848865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c663adb8-3cac-455d-bb51-ea34da3bbc73 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:46:49.849508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c663adb8-3cac-455d-bb51-ea34da3bbc73 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:46:49.850095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c663adb8-3cac-455d-bb51-ea34da3bbc73 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:46:49.865657 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c663adb8-3cac-455d-bb51-ea34da3bbc73 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:49.866417 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c663adb8-3cac-455d-bb51-ea34da3bbc73 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:49.867451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c663adb8-3cac-455d-bb51-ea34da3bbc73 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:49.868075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c663adb8-3cac-455d-bb51-ea34da3bbc73 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:49.889701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-c663adb8-3cac-455d-bb51-ea34da3bbc73 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Getting quotas for project fb9b98186db746ae83181dd7db6d56e7. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:46:49.896588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-c663adb8-3cac-455d-bb51-ea34da3bbc73 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Getting quotas for user 6b37465157dd44a09cffbbe57322d264 and project fb9b98186db746ae83181dd7db6d56e7. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:46:49.931710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c663adb8-3cac-455d-bb51-ea34da3bbc73 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:46:49.934585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c663adb8-3cac-455d-bb51-ea34da3bbc73 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:46:50.065660 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ae6f4d5e-cca8-4c65-af9d-ddeaa8a403e7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:50.066290 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ae6f4d5e-cca8-4c65-af9d-ddeaa8a403e7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:50.079601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae6f4d5e-cca8-4c65-af9d-ddeaa8a403e7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:50.080318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae6f4d5e-cca8-4c65-af9d-ddeaa8a403e7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:50.081555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae6f4d5e-cca8-4c65-af9d-ddeaa8a403e7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:50.082157 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae6f4d5e-cca8-4c65-af9d-ddeaa8a403e7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:50.131853 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c663adb8-3cac-455d-bb51-ea34da3bbc73 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.050817 May 28 04:46:50.135954 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1594/3048] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:46:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:46:50.146163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4efb4af7-cc85-4cd2-88d3-845064fecb3d tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:50.158331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4efb4af7-cc85-4cd2-88d3-845064fecb3d tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] [instance: 2f247217-093d-4c01-ac2e-77add0b653f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:50.179915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4efb4af7-cc85-4cd2-88d3-845064fecb3d tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:50.196169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4efb4af7-cc85-4cd2-88d3-845064fecb3d tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:50.196169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4efb4af7-cc85-4cd2-88d3-845064fecb3d tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:50.196169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4efb4af7-cc85-4cd2-88d3-845064fecb3d tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:50.229906 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-4efb4af7-cc85-4cd2-88d3-845064fecb3d tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] HTTP exception thrown: Instance 2f247217-093d-4c01-ac2e-77add0b653f4 could not be found. May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4efb4af7-cc85-4cd2-88d3-845064fecb3d tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Request method failure captured: May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4 HTTP/1.1 May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikakIb1AbIe8RZ1QESkcN4f4Ei7LBP5duwF3Xbe4BJQrsQ8RC9BsNtHLNLxaDPYK3MaRvyUlagJHeZLfCVjTaNALuGG-V7Y9LSs9QVjoqmw15OhJzk9vT9a3yTvsYSBDQuRAZUbMRc9Wito6QwB7DSCk_taeWmkuyKhlr-Sr5iSW9b3U May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: fe10db5df4ce4c78b040947d88450f51 May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-232257043 May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fe10db5df4ce4c78b040947d88450f51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fe10db5df4ce4c78b040947d88450f51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe10db5df4ce4c78b040947d88450f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe10db5df4ce4c78b040947d88450f51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-232257043 May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: fe10db5df4ce4c78b040947d88450f51 May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-232257043 May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 43548e2fd4fe40799493092aaa4ab255 May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 2f247217-093d-4c01-ac2e-77add0b653f4 could not be found. May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '2f247217-093d-4c01-ac2e-77add0b653f4'} May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f247217-093d-4c01-ac2e-77add0b653f4 could not be found. May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f247217-093d-4c01-ac2e-77add0b653f4 could not be found. May 28 04:46:50.234719 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:50.239339 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:50.239339 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:50.239339 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:50.239339 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:50.239339 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:50.239339 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:46:50.239339 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:46:50.239339 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f247217-093d-4c01-ac2e-77add0b653f4 could not be found. May 28 04:46:50.239339 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:50.241324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4efb4af7-cc85-4cd2-88d3-845064fecb3d tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] Returning 404 to user: Instance 2f247217-093d-4c01-ac2e-77add0b653f4 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:46:50.245160 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4efb4af7-cc85-4cd2-88d3-845064fecb3d tempest-FloatingIPsAssociationNegativeTestJSON-232257043 tempest-FloatingIPsAssociationNegativeTestJSON-232257043-project] 10.222.0.58 "GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4" status: 404 len: 111 microversion: 2.1 time: 0.105703 May 28 04:46:50.245883 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1595/3049] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:50 2022] GET /compute/v2.1/servers/2f247217-093d-4c01-ac2e-77add0b653f4 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:46:50.255667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d3a2f8b2-b6de-45cb-ba49-8c548aa9ec56 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:50.256553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d3a2f8b2-b6de-45cb-ba49-8c548aa9ec56 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:50.451666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d3a2f8b2-b6de-45cb-ba49-8c548aa9ec56 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:50.461052 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d3a2f8b2-b6de-45cb-ba49-8c548aa9ec56 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1224 microversion: 2.1 time: 0.212454 May 28 04:46:50.463353 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1596/3050] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:50 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1224 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:50.479022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6f297ca9-8986-4088-adc1-4d3a93e98651 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:50.479848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6f297ca9-8986-4088-adc1-4d3a93e98651 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:50.489075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f297ca9-8986-4088-adc1-4d3a93e98651 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:50.497126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f297ca9-8986-4088-adc1-4d3a93e98651 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:50.497126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f297ca9-8986-4088-adc1-4d3a93e98651 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:50.497126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f297ca9-8986-4088-adc1-4d3a93e98651 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:50.578346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ae6f4d5e-cca8-4c65-af9d-ddeaa8a403e7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:50.593073 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ae6f4d5e-cca8-4c65-af9d-ddeaa8a403e7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.529465 May 28 04:46:50.593941 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1455/3051] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:50 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:50.871604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6f297ca9-8986-4088-adc1-4d3a93e98651 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:50.883351 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6f297ca9-8986-4088-adc1-4d3a93e98651 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1497 microversion: 2.1 time: 0.408293 May 28 04:46:50.883952 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1597/3052] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:50 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1497 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:51.480908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6b2b3642-47fb-4d9e-855e-3cf5c02f50bc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:51.484416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6b2b3642-47fb-4d9e-855e-3cf5c02f50bc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:51.558351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6b2b3642-47fb-4d9e-855e-3cf5c02f50bc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:51.566206 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6b2b3642-47fb-4d9e-855e-3cf5c02f50bc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1224 microversion: 2.1 time: 0.089242 May 28 04:46:51.566797 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1456/3053] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:51 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:51.613658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2b5eed32-1104-41cc-a206-ad7f670fe0cb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:51.614516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2b5eed32-1104-41cc-a206-ad7f670fe0cb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:51.631957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b5eed32-1104-41cc-a206-ad7f670fe0cb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:51.631957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b5eed32-1104-41cc-a206-ad7f670fe0cb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:51.632620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b5eed32-1104-41cc-a206-ad7f670fe0cb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:51.634813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b5eed32-1104-41cc-a206-ad7f670fe0cb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:51.858735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2b5eed32-1104-41cc-a206-ad7f670fe0cb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:51.874170 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2b5eed32-1104-41cc-a206-ad7f670fe0cb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.266954 May 28 04:46:51.893779 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1598/3054] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:51 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:51.901113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-602ac5f1-dcd9-4849-b71a-7da99709ee4a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:51.901779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-602ac5f1-dcd9-4849-b71a-7da99709ee4a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:51.909477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-602ac5f1-dcd9-4849-b71a-7da99709ee4a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:51.909966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-602ac5f1-dcd9-4849-b71a-7da99709ee4a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:51.911061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-602ac5f1-dcd9-4849-b71a-7da99709ee4a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:51.911506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-602ac5f1-dcd9-4849-b71a-7da99709ee4a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:52.296488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-602ac5f1-dcd9-4849-b71a-7da99709ee4a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:52.305313 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-602ac5f1-dcd9-4849-b71a-7da99709ee4a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1497 microversion: 2.1 time: 0.408529 May 28 04:46:52.305909 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1457/3055] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:51 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1497 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:52.583999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9489e1ef-dc3b-4f82-b734-c3e83d67f94e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:52.584627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9489e1ef-dc3b-4f82-b734-c3e83d67f94e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:52.603044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9489e1ef-dc3b-4f82-b734-c3e83d67f94e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:52.611872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9489e1ef-dc3b-4f82-b734-c3e83d67f94e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:52.611872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9489e1ef-dc3b-4f82-b734-c3e83d67f94e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:52.611872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9489e1ef-dc3b-4f82-b734-c3e83d67f94e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:52.706660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9489e1ef-dc3b-4f82-b734-c3e83d67f94e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:52.715155 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9489e1ef-dc3b-4f82-b734-c3e83d67f94e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1228 microversion: 2.1 time: 0.134967 May 28 04:46:52.716339 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1599/3056] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:52 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1228 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:52.901198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f4a71c6d-24e9-49d1-b317-e9fe8b697919 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:52.902830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f4a71c6d-24e9-49d1-b317-e9fe8b697919 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:52.910736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4a71c6d-24e9-49d1-b317-e9fe8b697919 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:52.911513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4a71c6d-24e9-49d1-b317-e9fe8b697919 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:52.917377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4a71c6d-24e9-49d1-b317-e9fe8b697919 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:52.917377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4a71c6d-24e9-49d1-b317-e9fe8b697919 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:53.091969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f4a71c6d-24e9-49d1-b317-e9fe8b697919 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:53.103429 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f4a71c6d-24e9-49d1-b317-e9fe8b697919 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.205996 May 28 04:46:53.104850 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1458/3057] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:52 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:53.321675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f4debb4e-2e3a-4ae9-9014-4544dde54406 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:53.322536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f4debb4e-2e3a-4ae9-9014-4544dde54406 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:53.334138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4debb4e-2e3a-4ae9-9014-4544dde54406 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:53.335827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4debb4e-2e3a-4ae9-9014-4544dde54406 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:53.338049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4debb4e-2e3a-4ae9-9014-4544dde54406 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:53.338769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4debb4e-2e3a-4ae9-9014-4544dde54406 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:53.551286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f4debb4e-2e3a-4ae9-9014-4544dde54406 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:53.559193 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f4debb4e-2e3a-4ae9-9014-4544dde54406 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1497 microversion: 2.1 time: 0.241363 May 28 04:46:53.559935 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1600/3058] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:53 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1497 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:53.733263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eb16d1a1-a409-4c83-8135-26078709f3d4 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:53.734882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eb16d1a1-a409-4c83-8135-26078709f3d4 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:53.740749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb16d1a1-a409-4c83-8135-26078709f3d4 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:53.741214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb16d1a1-a409-4c83-8135-26078709f3d4 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:53.742026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb16d1a1-a409-4c83-8135-26078709f3d4 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:53.742710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb16d1a1-a409-4c83-8135-26078709f3d4 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:53.823829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eb16d1a1-a409-4c83-8135-26078709f3d4 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:53.845085 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eb16d1a1-a409-4c83-8135-26078709f3d4 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1276 microversion: 2.1 time: 0.116721 May 28 04:46:53.846299 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1459/3059] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:53 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1276 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:54.126885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-02c3c6db-5175-47cc-8d5d-35ee892eb9ed tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:54.130776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-02c3c6db-5175-47cc-8d5d-35ee892eb9ed tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:54.141292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02c3c6db-5175-47cc-8d5d-35ee892eb9ed tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:54.142260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02c3c6db-5175-47cc-8d5d-35ee892eb9ed tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:54.143822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02c3c6db-5175-47cc-8d5d-35ee892eb9ed tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:54.147397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02c3c6db-5175-47cc-8d5d-35ee892eb9ed tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:54.474429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-02c3c6db-5175-47cc-8d5d-35ee892eb9ed tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:54.483683 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-02c3c6db-5175-47cc-8d5d-35ee892eb9ed tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.366568 May 28 04:46:54.484306 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1601/3060] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:54 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:54.577470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3d834e0e-6faa-4937-b50c-2693291e7d32 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:54.578100 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3d834e0e-6faa-4937-b50c-2693291e7d32 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:54.585118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3d834e0e-6faa-4937-b50c-2693291e7d32 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:54.585857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3d834e0e-6faa-4937-b50c-2693291e7d32 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:54.586646 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3d834e0e-6faa-4937-b50c-2693291e7d32 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:54.587284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3d834e0e-6faa-4937-b50c-2693291e7d32 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:54.812807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3d834e0e-6faa-4937-b50c-2693291e7d32 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:54.822752 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3d834e0e-6faa-4937-b50c-2693291e7d32 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1497 microversion: 2.1 time: 0.249907 May 28 04:46:54.834135 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1460/3061] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:54 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1497 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:54.864703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-70f41bdf-94c3-4c9c-96bd-d7750e0e0042 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:54.866248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-70f41bdf-94c3-4c9c-96bd-d7750e0e0042 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:54.882640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70f41bdf-94c3-4c9c-96bd-d7750e0e0042 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:54.883403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70f41bdf-94c3-4c9c-96bd-d7750e0e0042 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:54.884427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70f41bdf-94c3-4c9c-96bd-d7750e0e0042 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:54.885217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70f41bdf-94c3-4c9c-96bd-d7750e0e0042 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:55.026135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-70f41bdf-94c3-4c9c-96bd-d7750e0e0042 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:55.034202 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-70f41bdf-94c3-4c9c-96bd-d7750e0e0042 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1282 microversion: 2.1 time: 0.175070 May 28 04:46:55.038846 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1602/3062] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:54 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1282 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:55.501780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-435233c6-057e-4969-84db-da2e53b67253 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:55.508517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-435233c6-057e-4969-84db-da2e53b67253 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:55.515068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-435233c6-057e-4969-84db-da2e53b67253 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:55.515899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-435233c6-057e-4969-84db-da2e53b67253 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:55.516971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-435233c6-057e-4969-84db-da2e53b67253 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:55.517867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-435233c6-057e-4969-84db-da2e53b67253 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:55.781541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-435233c6-057e-4969-84db-da2e53b67253 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:55.790193 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-435233c6-057e-4969-84db-da2e53b67253 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.293297 May 28 04:46:55.791023 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1461/3063] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:55 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:55.844957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2723a15f-8cbb-42e5-96d0-517ad81df5b4 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:55.844957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2723a15f-8cbb-42e5-96d0-517ad81df5b4 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:55.854754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2723a15f-8cbb-42e5-96d0-517ad81df5b4 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:55.855683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2723a15f-8cbb-42e5-96d0-517ad81df5b4 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:55.859629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2723a15f-8cbb-42e5-96d0-517ad81df5b4 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:55.860319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2723a15f-8cbb-42e5-96d0-517ad81df5b4 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:56.053656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-29d58c86-37ad-414a-aeb2-02f8311023d6 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:56.054375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-29d58c86-37ad-414a-aeb2-02f8311023d6 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:56.066580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29d58c86-37ad-414a-aeb2-02f8311023d6 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:56.068703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29d58c86-37ad-414a-aeb2-02f8311023d6 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:56.070670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29d58c86-37ad-414a-aeb2-02f8311023d6 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:56.072216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29d58c86-37ad-414a-aeb2-02f8311023d6 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:56.076237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2723a15f-8cbb-42e5-96d0-517ad81df5b4 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:56.110605 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2723a15f-8cbb-42e5-96d0-517ad81df5b4 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1497 microversion: 2.1 time: 0.273928 May 28 04:46:56.111256 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1603/3064] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:55 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1497 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:56.280656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-29d58c86-37ad-414a-aeb2-02f8311023d6 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:56.288485 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-29d58c86-37ad-414a-aeb2-02f8311023d6 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1324 microversion: 2.1 time: 0.240453 May 28 04:46:56.289641 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1462/3065] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:56 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1324 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:56.816723 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9db63e4c-d48e-40ac-b7ce-1fd0b5d35959 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:56.821754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9db63e4c-d48e-40ac-b7ce-1fd0b5d35959 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:56.828406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9db63e4c-d48e-40ac-b7ce-1fd0b5d35959 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:56.828862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9db63e4c-d48e-40ac-b7ce-1fd0b5d35959 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:56.829646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9db63e4c-d48e-40ac-b7ce-1fd0b5d35959 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:56.830083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9db63e4c-d48e-40ac-b7ce-1fd0b5d35959 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:56.881291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-5cfb3e18-3af5-4239-83e9-fd72e26dfb33 req-799f7a88-0e76-432e-bf86-c56e5b6d876b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6245d7aa-7d05-4ab8-aa60-976fd2f6e217", "tag": "df00d343-ce05-461d-9323-30f8bf5fa6e6"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:56.902820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5cfb3e18-3af5-4239-83e9-fd72e26dfb33 req-799f7a88-0e76-432e-bf86-c56e5b6d876b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:56.907816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5cfb3e18-3af5-4239-83e9-fd72e26dfb33 req-799f7a88-0e76-432e-bf86-c56e5b6d876b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:56.938012 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-5cfb3e18-3af5-4239-83e9-fd72e26dfb33 req-799f7a88-0e76-432e-bf86-c56e5b6d876b service nova] Creating event network-changed:df00d343-ce05-461d-9323-30f8bf5fa6e6 for instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 on n-h1-843700-1 May 28 04:46:56.948214 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-5cfb3e18-3af5-4239-83e9-fd72e26dfb33 req-799f7a88-0e76-432e-bf86-c56e5b6d876b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070765 May 28 04:46:56.950267 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1463/3066] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:46:57.138618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3a1aee12-9661-4f01-88f0-0cbf8b1c490b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:57.144802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3a1aee12-9661-4f01-88f0-0cbf8b1c490b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:57.154097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a1aee12-9661-4f01-88f0-0cbf8b1c490b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:57.154538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a1aee12-9661-4f01-88f0-0cbf8b1c490b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:57.155373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a1aee12-9661-4f01-88f0-0cbf8b1c490b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:57.155809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a1aee12-9661-4f01-88f0-0cbf8b1c490b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:57.192728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9db63e4c-d48e-40ac-b7ce-1fd0b5d35959 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:57.209812 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9db63e4c-d48e-40ac-b7ce-1fd0b5d35959 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.396103 May 28 04:46:57.212228 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1604/3067] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:56 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:57.307987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7617f31a-ff72-474a-afab-ff64b5381b9b tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:57.308690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7617f31a-ff72-474a-afab-ff64b5381b9b tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:57.340024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7617f31a-ff72-474a-afab-ff64b5381b9b tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:57.340555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7617f31a-ff72-474a-afab-ff64b5381b9b tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:57.347277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7617f31a-ff72-474a-afab-ff64b5381b9b tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:57.347440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7617f31a-ff72-474a-afab-ff64b5381b9b tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:58.085321 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3a1aee12-9661-4f01-88f0-0cbf8b1c490b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:58.097439 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3a1aee12-9661-4f01-88f0-0cbf8b1c490b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1497 microversion: 2.1 time: 0.972306 May 28 04:46:58.100420 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1464/3068] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:57 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1497 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:58.112878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9119a328-7734-4722-8dca-89aa8ca2276a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Action: 'create', calling method: .version_select at 0x7f7701cd50d0>, body: {"keypair": {"name": "tempest-keypair-46439952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW7mP+k+uEMb7cConZZ6aCpKB0AOJ7VIOn+jSXmXboTw5sq1K6DvN+oBnxMWrdN0/tbAnPlR2qywKAvLKwQoJVVnOj4fUs+CmJ1YAOzSvt6rGZvOuVN4AG8phctpiOmCg=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:46:58.139901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7617f31a-ff72-474a-afab-ff64b5381b9b tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:58.155409 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7617f31a-ff72-474a-afab-ff64b5381b9b tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1324 microversion: 2.1 time: 0.848489 May 28 04:46:58.155409 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1605/3069] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:57 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1324 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:58.155836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-9119a328-7734-4722-8dca-89aa8ca2276a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Getting quotas for project d1e7c34036184ea8b80241695fdbf329. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:46:58.165243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-9119a328-7734-4722-8dca-89aa8ca2276a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Getting quotas for user 025cb09c79a147b3a648c950edcd1dc3 and project d1e7c34036184ea8b80241695fdbf329. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:46:58.230481 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-30f4b0b5-3e94-424e-9e3c-ce9da4cd6af9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:58.231372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-30f4b0b5-3e94-424e-9e3c-ce9da4cd6af9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:58.239406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30f4b0b5-3e94-424e-9e3c-ce9da4cd6af9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:58.240381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30f4b0b5-3e94-424e-9e3c-ce9da4cd6af9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:58.241446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30f4b0b5-3e94-424e-9e3c-ce9da4cd6af9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:58.243374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30f4b0b5-3e94-424e-9e3c-ce9da4cd6af9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:58.322673 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9119a328-7734-4722-8dca-89aa8ca2276a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.217186 May 28 04:46:58.323644 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1465/3070] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:46:58 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:46:58.535561 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0c9a6530-82ab-4520-9867-b611fc8fadee tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] 10.222.0.58 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.171543 May 28 04:46:58.541232 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1466/3071] 10.222.0.58 () {58 vars in 1127 bytes} [Sat May 28 04:46:58 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 28 04:46:58.547901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-30f4b0b5-3e94-424e-9e3c-ce9da4cd6af9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:58.548274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6a20b18c-cf43-490c-a4df-b5c2537ae680 tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] Calling method '.version_select at 0x7f7701d8b4c0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:58.562245 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-30f4b0b5-3e94-424e-9e3c-ce9da4cd6af9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.336862 May 28 04:46:58.563173 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1606/3072] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:58 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:58.605808 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-6a20b18c-cf43-490c-a4df-b5c2537ae680 tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] HTTP exception thrown: Image not found. May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6a20b18c-cf43-490c-a4df-b5c2537ae680 tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] Request method failure captured: May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikalCUlwmH_yeRdnM_Aw04XkkagtvTGLJkL7O_008AV9RIAOrBpDxP6MVxSmk2cEscAcf1wArGDHR4-1DMf4ip9RFe0aIbgWcqr-5dGj0ZXIf5PZFHuE-0d-hiARtS0qgSODB3eKAFim-ahn_OTSDrQ6XT9EJxBMSEnJ1LRIhTgAdaWw May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 4f867821b95d4c2a8439a56af3a5de90 May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-559228265 May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4f867821b95d4c2a8439a56af3a5de90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4f867821b95d4c2a8439a56af3a5de90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f867821b95d4c2a8439a56af3a5de90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f867821b95d4c2a8439a56af3a5de90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-559228265 May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 4f867821b95d4c2a8439a56af3a5de90 May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-559228265 May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesDeleteNegativeTestJSON-559228265-project May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: a7b1e862c8c44cbb9e2b54ea92a923c2 May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-559228265-project May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: exception: Image not found. May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '-1'} May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.611285 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6a20b18c-cf43-490c-a4df-b5c2537ae680 tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] Returning 404 to user: Image not found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6a20b18c-cf43-490c-a4df-b5c2537ae680 tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] 10.222.0.58 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.066790 May 28 04:46:58.622862 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1467/3073] 10.222.0.58 () {58 vars in 1133 bytes} [Sat May 28 04:46:58 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:46:58.626636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5af5415e-93ef-4224-8271-ff8481cbd65a tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] Calling method '.version_select at 0x7f7700ea3e50>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:58.664292 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-5af5415e-93ef-4224-8271-ff8481cbd65a tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] HTTP exception thrown: Image not found. May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5af5415e-93ef-4224-8271-ff8481cbd65a tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] Request method failure captured: May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/images/21891b84-4310-46f1-aa29-55da44abec0j HTTP/1.1 May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikalCUlwmH_yeRdnM_Aw04XkkagtvTGLJkL7O_008AV9RIAOrBpDxP6MVxSmk2cEscAcf1wArGDHR4-1DMf4ip9RFe0aIbgWcqr-5dGj0ZXIf5PZFHuE-0d-hiARtS0qgSODB3eKAFim-ahn_OTSDrQ6XT9EJxBMSEnJ1LRIhTgAdaWw May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 4f867821b95d4c2a8439a56af3a5de90 May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-559228265 May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4f867821b95d4c2a8439a56af3a5de90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4f867821b95d4c2a8439a56af3a5de90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f867821b95d4c2a8439a56af3a5de90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f867821b95d4c2a8439a56af3a5de90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-559228265 May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 4f867821b95d4c2a8439a56af3a5de90 May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-559228265 May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ImagesDeleteNegativeTestJSON-559228265-project May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: a7b1e862c8c44cbb9e2b54ea92a923c2 May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-559228265-project May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: exception: Image not found. May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '21891b84-4310-46f1-aa29-55da44abec0j'} May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 21891b84-4310-46f1-aa29-55da44abec0j to delete May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 21891b84-4310-46f1-aa29-55da44abec0j could not be found. May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:58.668220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5af5415e-93ef-4224-8271-ff8481cbd65a tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] Returning 404 to user: Image not found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:46:58.714897 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5af5415e-93ef-4224-8271-ff8481cbd65a tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] 10.222.0.58 "DELETE /compute/v2.1/images/21891b84-4310-46f1-aa29-55da44abec0j" status: 404 len: 62 microversion: 2.1 time: 0.054329 May 28 04:46:58.721348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5ed2b8d1-e467-4659-bb80-a75a149f332c tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] Calling method '.version_select at 0x7f7701b53040>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:58.722022 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1607/3074] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:58 2022] DELETE /compute/v2.1/images/21891b84-4310-46f1-aa29-55da44abec0j => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-5ed2b8d1-e467-4659-bb80-a75a149f332c tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] HTTP exception thrown: Image not found. May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5ed2b8d1-e467-4659-bb80-a75a149f332c tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] Request method failure captured: May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/images/603d6f0d-d6bb-4600-a05e-305606498cfc1 HTTP/1.1 May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikalCUlwmH_yeRdnM_Aw04XkkagtvTGLJkL7O_008AV9RIAOrBpDxP6MVxSmk2cEscAcf1wArGDHR4-1DMf4ip9RFe0aIbgWcqr-5dGj0ZXIf5PZFHuE-0d-hiARtS0qgSODB3eKAFim-ahn_OTSDrQ6XT9EJxBMSEnJ1LRIhTgAdaWw May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 4f867821b95d4c2a8439a56af3a5de90 May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-559228265 May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4f867821b95d4c2a8439a56af3a5de90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4f867821b95d4c2a8439a56af3a5de90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f867821b95d4c2a8439a56af3a5de90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f867821b95d4c2a8439a56af3a5de90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-559228265 May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 4f867821b95d4c2a8439a56af3a5de90 May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-559228265 May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesDeleteNegativeTestJSON-559228265-project May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: a7b1e862c8c44cbb9e2b54ea92a923c2 May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-559228265-project May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: exception: Image not found. May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '603d6f0d-d6bb-4600-a05e-305606498cfc1'} May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 603d6f0d-d6bb-4600-a05e-305606498cfc1 to delete May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 04:46:58.722234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 603d6f0d-d6bb-4600-a05e-305606498cfc1 could not be found. May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5ed2b8d1-e467-4659-bb80-a75a149f332c tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] Returning 404 to user: Image not found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5ed2b8d1-e467-4659-bb80-a75a149f332c tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] 10.222.0.58 "DELETE /compute/v2.1/images/603d6f0d-d6bb-4600-a05e-305606498cfc1" status: 404 len: 62 microversion: 2.1 time: 0.047242 May 28 04:46:58.741089 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1468/3075] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:46:58 2022] DELETE /compute/v2.1/images/603d6f0d-d6bb-4600-a05e-305606498cfc1 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 28 04:46:58.754625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c8fb279e-68ac-4dc8-b6bf-adb54d321348 tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] Calling method '.version_select at 0x7f7700f593a0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:58.771489 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-c8fb279e-68ac-4dc8-b6bf-adb54d321348 tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] HTTP exception thrown: Image not found. May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c8fb279e-68ac-4dc8-b6bf-adb54d321348 tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] Request method failure captured: May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/images/tempest-invalid-294225491 HTTP/1.1 May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikalCUlwmH_yeRdnM_Aw04XkkagtvTGLJkL7O_008AV9RIAOrBpDxP6MVxSmk2cEscAcf1wArGDHR4-1DMf4ip9RFe0aIbgWcqr-5dGj0ZXIf5PZFHuE-0d-hiARtS0qgSODB3eKAFim-ahn_OTSDrQ6XT9EJxBMSEnJ1LRIhTgAdaWw May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 4f867821b95d4c2a8439a56af3a5de90 May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-559228265 May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4f867821b95d4c2a8439a56af3a5de90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4f867821b95d4c2a8439a56af3a5de90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f867821b95d4c2a8439a56af3a5de90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f867821b95d4c2a8439a56af3a5de90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-559228265 May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 4f867821b95d4c2a8439a56af3a5de90 May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-559228265 May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ImagesDeleteNegativeTestJSON-559228265-project May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: a7b1e862c8c44cbb9e2b54ea92a923c2 May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-559228265-project May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: exception: Image not found. May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'tempest-invalid-294225491'} May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-294225491 to delete May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-294225491 could not be found. May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:58.771999 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c8fb279e-68ac-4dc8-b6bf-adb54d321348 tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] Returning 404 to user: Image not found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c8fb279e-68ac-4dc8-b6bf-adb54d321348 tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] 10.222.0.58 "DELETE /compute/v2.1/images/tempest-invalid-294225491" status: 404 len: 62 microversion: 2.1 time: 0.043858 May 28 04:46:58.781587 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1608/3076] 10.222.0.58 () {58 vars in 1202 bytes} [Sat May 28 04:46:58 2022] DELETE /compute/v2.1/images/tempest-invalid-294225491 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:46:58.787049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0bbfe5ae-224d-4804-9bd4-44166fc9474e tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] Calling method '.version_select at 0x7f7701a39c10>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:58.812841 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-0bbfe5ae-224d-4804-9bd4-44166fc9474e tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] HTTP exception thrown: Image not found. May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0bbfe5ae-224d-4804-9bd4-44166fc9474e tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] Request method failure captured: May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/images/fba370ef-8e17-418e-b3ae-d29b271cd00f HTTP/1.1 May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikalCUlwmH_yeRdnM_Aw04XkkagtvTGLJkL7O_008AV9RIAOrBpDxP6MVxSmk2cEscAcf1wArGDHR4-1DMf4ip9RFe0aIbgWcqr-5dGj0ZXIf5PZFHuE-0d-hiARtS0qgSODB3eKAFim-ahn_OTSDrQ6XT9EJxBMSEnJ1LRIhTgAdaWw May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 4f867821b95d4c2a8439a56af3a5de90 May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-559228265 May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4f867821b95d4c2a8439a56af3a5de90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4f867821b95d4c2a8439a56af3a5de90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f867821b95d4c2a8439a56af3a5de90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f867821b95d4c2a8439a56af3a5de90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-559228265 May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 4f867821b95d4c2a8439a56af3a5de90 May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-559228265 May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesDeleteNegativeTestJSON-559228265-project May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: a7b1e862c8c44cbb9e2b54ea92a923c2 May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-559228265-project May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: exception: Image not found. May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'fba370ef-8e17-418e-b3ae-d29b271cd00f'} May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fba370ef-8e17-418e-b3ae-d29b271cd00f to delete May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fba370ef-8e17-418e-b3ae-d29b271cd00f could not be found. May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:58.814965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0bbfe5ae-224d-4804-9bd4-44166fc9474e tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] Returning 404 to user: Image not found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0bbfe5ae-224d-4804-9bd4-44166fc9474e tempest-ImagesDeleteNegativeTestJSON-559228265 tempest-ImagesDeleteNegativeTestJSON-559228265-project] 10.222.0.58 "DELETE /compute/v2.1/images/fba370ef-8e17-418e-b3ae-d29b271cd00f" status: 404 len: 62 microversion: 2.1 time: 0.035639 May 28 04:46:58.828784 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1469/3077] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:58 2022] DELETE /compute/v2.1/images/fba370ef-8e17-418e-b3ae-d29b271cd00f => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:46:59.126826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a663c5a7-64eb-4c9f-9d7e-793f915b0168 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:59.127486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a663c5a7-64eb-4c9f-9d7e-793f915b0168 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:59.147687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a663c5a7-64eb-4c9f-9d7e-793f915b0168 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:59.147687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a663c5a7-64eb-4c9f-9d7e-793f915b0168 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:59.147687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a663c5a7-64eb-4c9f-9d7e-793f915b0168 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:59.147687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a663c5a7-64eb-4c9f-9d7e-793f915b0168 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:59.171675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f1d6e902-cce3-4401-bba9-650855c2554e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:59.173529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f1d6e902-cce3-4401-bba9-650855c2554e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:59.183307 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1d6e902-cce3-4401-bba9-650855c2554e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:59.183971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1d6e902-cce3-4401-bba9-650855c2554e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:59.185710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1d6e902-cce3-4401-bba9-650855c2554e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:59.186963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1d6e902-cce3-4401-bba9-650855c2554e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:59.409461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a663c5a7-64eb-4c9f-9d7e-793f915b0168 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:59.414797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f1d6e902-cce3-4401-bba9-650855c2554e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:59.421161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:46:59.428588 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a663c5a7-64eb-4c9f-9d7e-793f915b0168 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1497 microversion: 2.1 time: 0.314042 May 28 04:46:59.429945 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f1d6e902-cce3-4401-bba9-650855c2554e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1324 microversion: 2.1 time: 0.265251 May 28 04:46:59.431513 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1470/3078] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:59 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1324 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:46:59.446859 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1609/3079] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:59 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1497 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:46:59.594664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1bf3ebe3-0ba0-40c7-9cd6-7a2f668c7ed1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:46:59.595549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1bf3ebe3-0ba0-40c7-9cd6-7a2f668c7ed1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:46:59.603317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1bf3ebe3-0ba0-40c7-9cd6-7a2f668c7ed1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:59.603971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1bf3ebe3-0ba0-40c7-9cd6-7a2f668c7ed1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:59.605150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1bf3ebe3-0ba0-40c7-9cd6-7a2f668c7ed1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:46:59.605660 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1bf3ebe3-0ba0-40c7-9cd6-7a2f668c7ed1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:46:59.879322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1bf3ebe3-0ba0-40c7-9cd6-7a2f668c7ed1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:46:59.887001 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1bf3ebe3-0ba0-40c7-9cd6-7a2f668c7ed1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.298573 May 28 04:46:59.888251 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1471/3080] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:46:59 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:00.448385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4e3e1458-acb7-4e45-9e8d-5eaa5a5d4a1f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:00.449271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4e3e1458-acb7-4e45-9e8d-5eaa5a5d4a1f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:00.452772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ec5c7d32-088c-40dc-817e-388e8099f231 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:00.453400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ec5c7d32-088c-40dc-817e-388e8099f231 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:00.457455 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:00.462112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:00.465259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=8 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:00.469821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec5c7d32-088c-40dc-817e-388e8099f231 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:00.470287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec5c7d32-088c-40dc-817e-388e8099f231 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:00.471112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec5c7d32-088c-40dc-817e-388e8099f231 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:00.471560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec5c7d32-088c-40dc-817e-388e8099f231 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:00.473732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e3e1458-acb7-4e45-9e8d-5eaa5a5d4a1f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:00.474213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e3e1458-acb7-4e45-9e8d-5eaa5a5d4a1f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:00.475345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e3e1458-acb7-4e45-9e8d-5eaa5a5d4a1f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:00.475798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e3e1458-acb7-4e45-9e8d-5eaa5a5d4a1f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:00.782483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4e3e1458-acb7-4e45-9e8d-5eaa5a5d4a1f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:00.793068 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4e3e1458-acb7-4e45-9e8d-5eaa5a5d4a1f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 200 len: 1474 microversion: 2.1 time: 0.351129 May 28 04:47:00.795253 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1610/3081] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:00 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 1474 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:00.808994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ec5c7d32-088c-40dc-817e-388e8099f231 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:00.820880 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ec5c7d32-088c-40dc-817e-388e8099f231 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1324 microversion: 2.1 time: 0.377262 May 28 04:47:00.822904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3ad3eae6-a939-4808-a71a-5ec912bd0fcb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-715971233"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:00.824771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3ad3eae6-a939-4808-a71a-5ec912bd0fcb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:00.826085 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1472/3082] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:00 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1324 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:00.833175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ad3eae6-a939-4808-a71a-5ec912bd0fcb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:00.833938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ad3eae6-a939-4808-a71a-5ec912bd0fcb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:00.834977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ad3eae6-a939-4808-a71a-5ec912bd0fcb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:00.835903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ad3eae6-a939-4808-a71a-5ec912bd0fcb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:00.861938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:00.906150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1a4aaf2a-8fa6-443d-af61-adc51463ea71 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:00.907133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1a4aaf2a-8fa6-443d-af61-adc51463ea71 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:00.924558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a4aaf2a-8fa6-443d-af61-adc51463ea71 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:00.925307 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a4aaf2a-8fa6-443d-af61-adc51463ea71 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:00.926323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a4aaf2a-8fa6-443d-af61-adc51463ea71 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:00.927047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a4aaf2a-8fa6-443d-af61-adc51463ea71 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:01.154453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1a4aaf2a-8fa6-443d-af61-adc51463ea71 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:01.164256 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1a4aaf2a-8fa6-443d-af61-adc51463ea71 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.262408 May 28 04:47:01.165237 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1473/3083] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:00 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:01.574572 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3ad3eae6-a939-4808-a71a-5ec912bd0fcb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "POST /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323/action" status: 202 len: 0 microversion: 2.1 time: 0.761597 May 28 04:47:01.575994 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1611/3084] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:00 2022] POST /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323/action => generated 0 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 04:47:01.587992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2e739b2b-c3ef-4921-b3ba-b53d1df296a6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701dd61f0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:01.652466 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2e739b2b-c3ef-4921-b3ba-b53d1df296a6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1411 microversion: 2.1 time: 0.070269 May 28 04:47:01.653221 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1474/3085] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:01 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1411 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:01.842154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bef8d28b-3806-47af-82ac-5cd24dd9d825 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:01.843323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bef8d28b-3806-47af-82ac-5cd24dd9d825 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:01.853526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bef8d28b-3806-47af-82ac-5cd24dd9d825 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:01.854378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bef8d28b-3806-47af-82ac-5cd24dd9d825 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:01.855478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bef8d28b-3806-47af-82ac-5cd24dd9d825 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:01.856860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bef8d28b-3806-47af-82ac-5cd24dd9d825 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:01.952439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-133d71e7-928e-419f-bbf7-3a946075d4f5 tempest-VolumesAdminNegativeTest-2046188861 tempest-VolumesAdminNegativeTest-2046188861-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "029cff4e-53d2-4080-b3b6-d31afcb19369"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:01.955445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-133d71e7-928e-419f-bbf7-3a946075d4f5 tempest-VolumesAdminNegativeTest-2046188861 tempest-VolumesAdminNegativeTest-2046188861-project-admin] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:01.964895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-133d71e7-928e-419f-bbf7-3a946075d4f5 tempest-VolumesAdminNegativeTest-2046188861 tempest-VolumesAdminNegativeTest-2046188861-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:01.964895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-133d71e7-928e-419f-bbf7-3a946075d4f5 tempest-VolumesAdminNegativeTest-2046188861 tempest-VolumesAdminNegativeTest-2046188861-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:01.967581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-133d71e7-928e-419f-bbf7-3a946075d4f5 tempest-VolumesAdminNegativeTest-2046188861 tempest-VolumesAdminNegativeTest-2046188861-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:01.968623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-133d71e7-928e-419f-bbf7-3a946075d4f5 tempest-VolumesAdminNegativeTest-2046188861 tempest-VolumesAdminNegativeTest-2046188861-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:02.097760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bef8d28b-3806-47af-82ac-5cd24dd9d825 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:02.107342 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bef8d28b-3806-47af-82ac-5cd24dd9d825 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1324 microversion: 2.1 time: 0.269182 May 28 04:47:02.117510 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1475/3086] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:01 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1324 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:02.126032 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-133d71e7-928e-419f-bbf7-3a946075d4f5 tempest-VolumesAdminNegativeTest-2046188861 tempest-VolumesAdminNegativeTest-2046188861-project-admin] HTTP exception thrown: Volume 029cff4e-53d2-4080-b3b6-d31afcb19369 could not be found. May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-133d71e7-928e-419f-bbf7-3a946075d4f5 tempest-VolumesAdminNegativeTest-2046188861 tempest-VolumesAdminNegativeTest-2046188861-project-admin] Request method failure captured: May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: request: PUT /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments/a53ccd47-2c01-47d2-9a3f-438cb0c10d60 HTTP/1.1 May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 74 May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikakEio4ZjK20eYsedz9jVoDc6hvYu2Bdi87qBMhwp2eRMQDnM8qrFEG_xSOP9erTLG0pYvLXNRQiFIScY2MZz2oaKQvNx4LNH4nzql76LGafcquvVxQoJV2iH_VkmB0FV_P7-G3tvOFbP3_mqLtdvzwkDPf27IqIiO17MDGkc7H7mmI May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: cdc2ff6141d144a69bce99736cfb5bfc May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-VolumesAdminNegativeTest-2046188861 May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cdc2ff6141d144a69bce99736cfb5bfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cdc2ff6141d144a69bce99736cfb5bfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cdc2ff6141d144a69bce99736cfb5bfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cdc2ff6141d144a69bce99736cfb5bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-VolumesAdminNegativeTest-2046188861 May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: cdc2ff6141d144a69bce99736cfb5bfc May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2046188861 May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-VolumesAdminNegativeTest-2046188861-project-admin May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 44437969f06f422e9ac8d1c6fab2962e May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-VolumesAdminNegativeTest-2046188861-project-admin May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: {"volumeAttachment": {"volumeId": "029cff4e-53d2-4080-b3b6-d31afcb19369"}} May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: exception: Volume 029cff4e-53d2-4080-b3b6-d31afcb19369 could not be found. May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'server_id': '158d6dcc-16f5-4b5d-8260-3178a329effe', 'id': 'a53ccd47-2c01-47d2-9a3f-438cb0c10d60', 'body': {'volumeAttachment': {'volumeId': '029cff4e-53d2-4080-b3b6-d31afcb19369'}}} May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 029cff4e-53d2-4080-b3b6-d31afcb19369 could not be found. (HTTP 404) (Request-ID: req-e335104d-ff6a-4867-9992-85986b18d125) May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 04:47:02.160402 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 029cff4e-53d2-4080-b3b6-d31afcb19369 could not be found. May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 029cff4e-53d2-4080-b3b6-d31afcb19369 could not be found. May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 029cff4e-53d2-4080-b3b6-d31afcb19369 could not be found. May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-133d71e7-928e-419f-bbf7-3a946075d4f5 tempest-VolumesAdminNegativeTest-2046188861 tempest-VolumesAdminNegativeTest-2046188861-project-admin] Returning 400 to user: Volume 029cff4e-53d2-4080-b3b6-d31afcb19369 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-133d71e7-928e-419f-bbf7-3a946075d4f5 tempest-VolumesAdminNegativeTest-2046188861 tempest-VolumesAdminNegativeTest-2046188861-project-admin] 10.222.0.58 "PUT /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments/a53ccd47-2c01-47d2-9a3f-438cb0c10d60" status: 400 len: 107 microversion: 2.1 time: 0.462070 May 28 04:47:02.164198 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1612/3087] 10.222.0.58 () {60 vars in 1432 bytes} [Sat May 28 04:47:01 2022] PUT /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments/a53ccd47-2c01-47d2-9a3f-438cb0c10d60 => generated 107 bytes in 464 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:47:02.181789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e2b7da98-acf6-4d43-aa6b-419d749d54e6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:02.182895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e2b7da98-acf6-4d43-aa6b-419d749d54e6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:02.189817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2b7da98-acf6-4d43-aa6b-419d749d54e6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:02.190602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2b7da98-acf6-4d43-aa6b-419d749d54e6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:02.193573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2b7da98-acf6-4d43-aa6b-419d749d54e6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:02.193573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2b7da98-acf6-4d43-aa6b-419d749d54e6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:02.239580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c58e9cdd-2454-4a53-95a1-040f10f21424 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:02.240443 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c58e9cdd-2454-4a53-95a1-040f10f21424 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:02.249968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c58e9cdd-2454-4a53-95a1-040f10f21424 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:02.250773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c58e9cdd-2454-4a53-95a1-040f10f21424 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:02.251830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c58e9cdd-2454-4a53-95a1-040f10f21424 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:02.252498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c58e9cdd-2454-4a53-95a1-040f10f21424 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:02.348831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-c58e9cdd-2454-4a53-95a1-040f10f21424 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lazy-loading 'services' on Instance uuid 158d6dcc-16f5-4b5d-8260-3178a329effe {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:47:02.372226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e2b7da98-acf6-4d43-aa6b-419d749d54e6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:02.384694 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e2b7da98-acf6-4d43-aa6b-419d749d54e6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.203472 May 28 04:47:02.384694 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1476/3088] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:02 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:02.389997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e11efee2-1162-42af-943c-266f5f38f58e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1559574732", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c0754133-921a-4aba-8b6d-6a18d70e57ec"}], "security_groups": [{"name": "tempest-securitygroup--157702079"}], "key_name": "tempest-keypair-46439952", "user_data": "}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:02.498172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-e11efee2-1162-42af-943c-266f5f38f58e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] validate_networks() for [('c0754133-921a-4aba-8b6d-6a18d70e57ec', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:47:02.645957 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c58e9cdd-2454-4a53-95a1-040f10f21424 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "DELETE /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments/a53ccd47-2c01-47d2-9a3f-438cb0c10d60" status: 202 len: 0 microversion: 2.1 time: 0.420581 May 28 04:47:02.653041 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1613/3089] 10.222.0.58 () {58 vars in 1415 bytes} [Sat May 28 04:47:02 2022] DELETE /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments/a53ccd47-2c01-47d2-9a3f-438cb0c10d60 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:47:02.656115 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4befe7dd-1ce3-438e-b478-d4b792d5b083 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:02.657572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4befe7dd-1ce3-438e-b478-d4b792d5b083 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:02.664331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4befe7dd-1ce3-438e-b478-d4b792d5b083 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:02.664889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4befe7dd-1ce3-438e-b478-d4b792d5b083 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:02.665928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4befe7dd-1ce3-438e-b478-d4b792d5b083 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:02.666452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4befe7dd-1ce3-438e-b478-d4b792d5b083 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:02.697907 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4befe7dd-1ce3-438e-b478-d4b792d5b083 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046664 May 28 04:47:02.698581 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1614/3090] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:47:02 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:47:02.703303 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-04f19e61-b785-4fe0-b801-38019f9c38d9 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700f76dc0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:02.756962 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-04f19e61-b785-4fe0-b801-38019f9c38d9 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1411 microversion: 2.1 time: 0.057017 May 28 04:47:02.758423 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1615/3091] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:02 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1411 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:02.935879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-e11efee2-1162-42af-943c-266f5f38f58e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:47:02.936559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-e11efee2-1162-42af-943c-266f5f38f58e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:47:02.937109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-e11efee2-1162-42af-943c-266f5f38f58e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:47:02.937586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-e11efee2-1162-42af-943c-266f5f38f58e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:47:02.939630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-e11efee2-1162-42af-943c-266f5f38f58e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:47:02.949316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e11efee2-1162-42af-943c-266f5f38f58e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:02.949884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e11efee2-1162-42af-943c-266f5f38f58e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:02.950691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e11efee2-1162-42af-943c-266f5f38f58e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:02.951156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e11efee2-1162-42af-943c-266f5f38f58e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:02.969484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-e11efee2-1162-42af-943c-266f5f38f58e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Getting quotas for project d1e7c34036184ea8b80241695fdbf329. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:47:02.976767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-e11efee2-1162-42af-943c-266f5f38f58e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Getting quotas for user 025cb09c79a147b3a648c950edcd1dc3 and project d1e7c34036184ea8b80241695fdbf329. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:47:02.990486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e11efee2-1162-42af-943c-266f5f38f58e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:47:02.992813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e11efee2-1162-42af-943c-266f5f38f58e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:47:03.093880 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e11efee2-1162-42af-943c-266f5f38f58e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.709165 May 28 04:47:03.094535 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1477/3092] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:47:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 04:47:03.105383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-964147c2-5417-44c4-9059-e4be72566b10 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:03.106676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-964147c2-5417-44c4-9059-e4be72566b10 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:03.125796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-78d7be69-e6b4-485e-bafa-63aff7dcd688 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:03.126419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-78d7be69-e6b4-485e-bafa-63aff7dcd688 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:03.134128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78d7be69-e6b4-485e-bafa-63aff7dcd688 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:03.134583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78d7be69-e6b4-485e-bafa-63aff7dcd688 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:03.135389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78d7be69-e6b4-485e-bafa-63aff7dcd688 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:03.136016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78d7be69-e6b4-485e-bafa-63aff7dcd688 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:03.228396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-964147c2-5417-44c4-9059-e4be72566b10 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:03.237822 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-964147c2-5417-44c4-9059-e4be72566b10 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69" status: 200 len: 1240 microversion: 2.1 time: 0.136326 May 28 04:47:03.238747 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1616/3093] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:03 2022] GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 => generated 1240 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:03.344031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-78d7be69-e6b4-485e-bafa-63aff7dcd688 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:03.352542 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-78d7be69-e6b4-485e-bafa-63aff7dcd688 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1324 microversion: 2.1 time: 0.230946 May 28 04:47:03.353485 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1478/3094] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:03 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1324 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:03.400895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2612b2cc-0c3d-4a33-b448-515f02d9f153 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:03.400895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2612b2cc-0c3d-4a33-b448-515f02d9f153 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:03.412660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2612b2cc-0c3d-4a33-b448-515f02d9f153 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:03.414195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2612b2cc-0c3d-4a33-b448-515f02d9f153 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:03.416887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2612b2cc-0c3d-4a33-b448-515f02d9f153 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:03.417462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2612b2cc-0c3d-4a33-b448-515f02d9f153 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:03.644378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2612b2cc-0c3d-4a33-b448-515f02d9f153 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:03.664624 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2612b2cc-0c3d-4a33-b448-515f02d9f153 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.270238 May 28 04:47:03.671901 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1617/3095] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:03 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:03.709794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5a0aa143-fb32-4faf-9334-8f193b3b0f1f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:03.711073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5a0aa143-fb32-4faf-9334-8f193b3b0f1f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:03.718920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a0aa143-fb32-4faf-9334-8f193b3b0f1f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:03.726475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a0aa143-fb32-4faf-9334-8f193b3b0f1f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:03.726475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a0aa143-fb32-4faf-9334-8f193b3b0f1f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:03.726475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a0aa143-fb32-4faf-9334-8f193b3b0f1f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:03.770946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ae16df25-4803-47b7-8af9-0b5659ba8c4f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700f46d30>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:03.777948 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5a0aa143-fb32-4faf-9334-8f193b3b0f1f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072018 May 28 04:47:03.795726 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1479/3096] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:47:03 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:03.852242 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ae16df25-4803-47b7-8af9-0b5659ba8c4f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1411 microversion: 2.1 time: 0.085038 May 28 04:47:03.853373 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1618/3097] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:03 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1411 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:04.094257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f0f6f264-16ae-4db2-9195-619ea85d32f3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-746721622", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "a8281942-a396-45af-8f70-1c317acec565"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:04.160328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-f0f6f264-16ae-4db2-9195-619ea85d32f3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] validate_networks() for [('a8281942-a396-45af-8f70-1c317acec565', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:47:04.254744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5d3a0a03-9bbe-4948-8c14-28a8355cf502 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:04.255396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5d3a0a03-9bbe-4948-8c14-28a8355cf502 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:04.264137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d3a0a03-9bbe-4948-8c14-28a8355cf502 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:04.268032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d3a0a03-9bbe-4948-8c14-28a8355cf502 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:04.268032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d3a0a03-9bbe-4948-8c14-28a8355cf502 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:04.268032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d3a0a03-9bbe-4948-8c14-28a8355cf502 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:04.359477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5d3a0a03-9bbe-4948-8c14-28a8355cf502 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:04.371548 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5d3a0a03-9bbe-4948-8c14-28a8355cf502 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69" status: 200 len: 1244 microversion: 2.1 time: 0.120475 May 28 04:47:04.385853 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1619/3098] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:04 2022] GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 => generated 1244 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:04.385853 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a6a0afd1-d88a-4782-bb46-50c3e33373a6 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:04.385853 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a6a0afd1-d88a-4782-bb46-50c3e33373a6 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:04.391600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6a0afd1-d88a-4782-bb46-50c3e33373a6 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:04.392266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6a0afd1-d88a-4782-bb46-50c3e33373a6 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:04.393329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6a0afd1-d88a-4782-bb46-50c3e33373a6 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:04.393930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6a0afd1-d88a-4782-bb46-50c3e33373a6 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:04.661218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a6a0afd1-d88a-4782-bb46-50c3e33373a6 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:04.676605 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a6a0afd1-d88a-4782-bb46-50c3e33373a6 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1324 microversion: 2.1 time: 0.296515 May 28 04:47:04.680586 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1620/3099] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:04 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1324 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:04.689514 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8bc04744-8339-49e8-8770-255abac6e281 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:04.690139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8bc04744-8339-49e8-8770-255abac6e281 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:04.711025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8bc04744-8339-49e8-8770-255abac6e281 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:04.729164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8bc04744-8339-49e8-8770-255abac6e281 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:04.732480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8bc04744-8339-49e8-8770-255abac6e281 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:04.733183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8bc04744-8339-49e8-8770-255abac6e281 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:04.942969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f0f6f264-16ae-4db2-9195-619ea85d32f3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:47:04.943448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f0f6f264-16ae-4db2-9195-619ea85d32f3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:47:04.943934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f0f6f264-16ae-4db2-9195-619ea85d32f3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:47:04.944397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f0f6f264-16ae-4db2-9195-619ea85d32f3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:47:04.944904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f0f6f264-16ae-4db2-9195-619ea85d32f3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:47:04.966494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0f6f264-16ae-4db2-9195-619ea85d32f3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:04.966947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0f6f264-16ae-4db2-9195-619ea85d32f3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:04.968017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0f6f264-16ae-4db2-9195-619ea85d32f3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:04.968736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0f6f264-16ae-4db2-9195-619ea85d32f3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:04.983309 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:04.990804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-f0f6f264-16ae-4db2-9195-619ea85d32f3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Getting quotas for project a310496bcde7409a8338f64e444f6dea. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:47:04.996484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-f0f6f264-16ae-4db2-9195-619ea85d32f3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Getting quotas for user 11042f256135447b907df76bcce1e3aa and project a310496bcde7409a8338f64e444f6dea. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:47:05.013442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f0f6f264-16ae-4db2-9195-619ea85d32f3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:47:05.015887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f0f6f264-16ae-4db2-9195-619ea85d32f3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:47:05.122284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8bc04744-8339-49e8-8770-255abac6e281 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:05.131385 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8bc04744-8339-49e8-8770-255abac6e281 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.445729 May 28 04:47:05.144654 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1621/3100] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:04 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:05.150017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9000aa2e-598c-4f44-8e9d-ffa59a120859 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:05.151057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9000aa2e-598c-4f44-8e9d-ffa59a120859 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:05.166336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9000aa2e-598c-4f44-8e9d-ffa59a120859 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:05.166794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9000aa2e-598c-4f44-8e9d-ffa59a120859 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:05.172018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9000aa2e-598c-4f44-8e9d-ffa59a120859 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:05.172476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9000aa2e-598c-4f44-8e9d-ffa59a120859 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:05.238800 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9000aa2e-598c-4f44-8e9d-ffa59a120859 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092721 May 28 04:47:05.239811 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1622/3101] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:47:05 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:05.246381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-110b8784-d135-4ea4-bdbb-0c6500453a14 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700f59670>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:05.247558 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f0f6f264-16ae-4db2-9195-619ea85d32f3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.287285 May 28 04:47:05.249051 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1480/3102] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:47:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:47:05.281654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0685e3e6-b482-48f9-9370-2f9b52343105 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:05.282960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0685e3e6-b482-48f9-9370-2f9b52343105 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:05.336559 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-110b8784-d135-4ea4-bdbb-0c6500453a14 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1411 microversion: 2.1 time: 0.095531 May 28 04:47:05.337264 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1623/3103] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:05 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:05.389969 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1743394b-d3bf-4b53-99a1-1df1a75b0031 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:05.390974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1743394b-d3bf-4b53-99a1-1df1a75b0031 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:05.401001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1743394b-d3bf-4b53-99a1-1df1a75b0031 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:05.404419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1743394b-d3bf-4b53-99a1-1df1a75b0031 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:05.404614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0685e3e6-b482-48f9-9370-2f9b52343105 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11042f256135447b907df76bcce1e3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a310496bcde7409a8338f64e444f6dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:05.406095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1743394b-d3bf-4b53-99a1-1df1a75b0031 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:05.408272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1743394b-d3bf-4b53-99a1-1df1a75b0031 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:05.416176 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0685e3e6-b482-48f9-9370-2f9b52343105 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 200 len: 1224 microversion: 2.1 time: 0.161322 May 28 04:47:05.425235 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1481/3104] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:05 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 1224 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:05.526463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1743394b-d3bf-4b53-99a1-1df1a75b0031 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:05.536302 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1743394b-d3bf-4b53-99a1-1df1a75b0031 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69" status: 200 len: 1292 microversion: 2.1 time: 0.151314 May 28 04:47:05.560728 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1624/3105] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:05 2022] GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 => generated 1292 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:05.704255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8f4a7b28-b905-461a-b886-d8031661177f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:05.704255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8f4a7b28-b905-461a-b886-d8031661177f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:05.727736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f4a7b28-b905-461a-b886-d8031661177f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:05.732594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f4a7b28-b905-461a-b886-d8031661177f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:05.733609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f4a7b28-b905-461a-b886-d8031661177f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:05.736261 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f4a7b28-b905-461a-b886-d8031661177f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:05.965104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-7f09f1e5-57b5-426f-9de3-448a875f62bb req-49636bd4-bd24-44cc-a4d8-579193aa9e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6245d7aa-7d05-4ab8-aa60-976fd2f6e217", "name": "network-vif-plugged", "status": "completed", "tag": "df00d343-ce05-461d-9323-30f8bf5fa6e6"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:05.979519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-7f09f1e5-57b5-426f-9de3-448a875f62bb req-49636bd4-bd24-44cc-a4d8-579193aa9e5d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:05.981703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-7f09f1e5-57b5-426f-9de3-448a875f62bb req-49636bd4-bd24-44cc-a4d8-579193aa9e5d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:06.006014 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-7f09f1e5-57b5-426f-9de3-448a875f62bb req-49636bd4-bd24-44cc-a4d8-579193aa9e5d service nova] Creating event network-vif-plugged:df00d343-ce05-461d-9323-30f8bf5fa6e6 for instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 on n-h1-843700-1 May 28 04:47:06.035544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8f4a7b28-b905-461a-b886-d8031661177f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:06.036866 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-7f09f1e5-57b5-426f-9de3-448a875f62bb req-49636bd4-bd24-44cc-a4d8-579193aa9e5d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075297 May 28 04:47:06.041428 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1625/3106] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:06.080892 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8f4a7b28-b905-461a-b886-d8031661177f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1324 microversion: 2.1 time: 0.386449 May 28 04:47:06.093456 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1482/3107] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:05 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1324 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:06.152424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b44a079f-5207-487d-b566-9c707c1bd376 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:06.153910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b44a079f-5207-487d-b566-9c707c1bd376 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:06.169578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b44a079f-5207-487d-b566-9c707c1bd376 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:06.173382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b44a079f-5207-487d-b566-9c707c1bd376 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:06.175941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b44a079f-5207-487d-b566-9c707c1bd376 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:06.181653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b44a079f-5207-487d-b566-9c707c1bd376 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:06.250267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-628c2b61-c313-4abd-a2b5-37007a3f7543 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:06.251207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-628c2b61-c313-4abd-a2b5-37007a3f7543 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:06.275296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-628c2b61-c313-4abd-a2b5-37007a3f7543 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:06.275792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-628c2b61-c313-4abd-a2b5-37007a3f7543 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:06.276617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-628c2b61-c313-4abd-a2b5-37007a3f7543 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:06.277060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-628c2b61-c313-4abd-a2b5-37007a3f7543 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:06.349454 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-628c2b61-c313-4abd-a2b5-37007a3f7543 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103390 May 28 04:47:06.353741 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1483/3108] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:47:06 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:47:06.363785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6758b15b-ef87-4605-a558-77c5f1ee3569 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701dced30>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:06.451567 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6758b15b-ef87-4605-a558-77c5f1ee3569 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1411 microversion: 2.1 time: 0.094285 May 28 04:47:06.455460 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1484/3109] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:06 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:06.458859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ec2ee189-9781-4927-a615-0b4dd6ec2bf0 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:06.463671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ec2ee189-9781-4927-a615-0b4dd6ec2bf0 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:06.545578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b44a079f-5207-487d-b566-9c707c1bd376 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:06.565023 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b44a079f-5207-487d-b566-9c707c1bd376 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.416737 May 28 04:47:06.567956 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1626/3110] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:06 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:06.585625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f736689c-e0cc-40b3-877f-02f6eb95643f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:06.586521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f736689c-e0cc-40b3-877f-02f6eb95643f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:06.594418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ec2ee189-9781-4927-a615-0b4dd6ec2bf0 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11042f256135447b907df76bcce1e3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a310496bcde7409a8338f64e444f6dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:06.597131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f736689c-e0cc-40b3-877f-02f6eb95643f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:06.598934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f736689c-e0cc-40b3-877f-02f6eb95643f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:06.600639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f736689c-e0cc-40b3-877f-02f6eb95643f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:06.602715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f736689c-e0cc-40b3-877f-02f6eb95643f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:06.604193 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ec2ee189-9781-4927-a615-0b4dd6ec2bf0 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 200 len: 1224 microversion: 2.1 time: 0.148844 May 28 04:47:06.607977 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1485/3111] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:06 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 1224 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:06.744426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f736689c-e0cc-40b3-877f-02f6eb95643f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:06.753387 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f736689c-e0cc-40b3-877f-02f6eb95643f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69" status: 200 len: 1298 microversion: 2.1 time: 0.171415 May 28 04:47:06.754580 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1627/3112] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:06 2022] GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 => generated 1298 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:07.098199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e4d80198-1aba-4ffb-864c-52efe91cbf07 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:07.098821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e4d80198-1aba-4ffb-864c-52efe91cbf07 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:07.120856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4d80198-1aba-4ffb-864c-52efe91cbf07 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:07.122947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4d80198-1aba-4ffb-864c-52efe91cbf07 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:07.128449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4d80198-1aba-4ffb-864c-52efe91cbf07 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:07.129197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4d80198-1aba-4ffb-864c-52efe91cbf07 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:07.363371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e2f71bd1-108f-4515-ae0c-ee5639d9c593 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:07.365223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e2f71bd1-108f-4515-ae0c-ee5639d9c593 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:07.384647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2f71bd1-108f-4515-ae0c-ee5639d9c593 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:07.384647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2f71bd1-108f-4515-ae0c-ee5639d9c593 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:07.385813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2f71bd1-108f-4515-ae0c-ee5639d9c593 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:07.386337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2f71bd1-108f-4515-ae0c-ee5639d9c593 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:07.465633 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e2f71bd1-108f-4515-ae0c-ee5639d9c593 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108024 May 28 04:47:07.470284 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1628/3113] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:47:07 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:07.478221 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2abcc808-95aa-4b25-9830-19263cc67536 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700f5d9d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:07.524807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e4d80198-1aba-4ffb-864c-52efe91cbf07 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:07.538254 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e4d80198-1aba-4ffb-864c-52efe91cbf07 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1324 microversion: 2.1 time: 0.444038 May 28 04:47:07.542607 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1486/3114] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:07 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1324 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:07.559493 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2abcc808-95aa-4b25-9830-19263cc67536 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1411 microversion: 2.1 time: 0.085974 May 28 04:47:07.561275 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1629/3115] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:07 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1411 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:07.588476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4a09e59c-079d-4f81-b06f-389efe335ac5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:07.589355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4a09e59c-079d-4f81-b06f-389efe335ac5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:07.610426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4a09e59c-079d-4f81-b06f-389efe335ac5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:07.615109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4a09e59c-079d-4f81-b06f-389efe335ac5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:07.626236 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5baf913f-7475-4000-9853-d14e7879200d tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:07.627088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5baf913f-7475-4000-9853-d14e7879200d tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:07.634126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4a09e59c-079d-4f81-b06f-389efe335ac5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:07.634605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4a09e59c-079d-4f81-b06f-389efe335ac5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:07.645219 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5baf913f-7475-4000-9853-d14e7879200d tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:07.649726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5baf913f-7475-4000-9853-d14e7879200d tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:07.656745 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5baf913f-7475-4000-9853-d14e7879200d tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:07.659613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5baf913f-7475-4000-9853-d14e7879200d tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:07.941511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5baf913f-7475-4000-9853-d14e7879200d tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11042f256135447b907df76bcce1e3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a310496bcde7409a8338f64e444f6dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:07.964914 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5baf913f-7475-4000-9853-d14e7879200d tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 200 len: 1220 microversion: 2.1 time: 0.340908 May 28 04:47:07.981376 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1630/3116] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:07 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 1220 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:07.987880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e8713000-8864-4e20-8e8d-5901892e3f7a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:07.988922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e8713000-8864-4e20-8e8d-5901892e3f7a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:07.996361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e8713000-8864-4e20-8e8d-5901892e3f7a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:07.997148 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e8713000-8864-4e20-8e8d-5901892e3f7a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:07.998146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e8713000-8864-4e20-8e8d-5901892e3f7a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:07.998851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e8713000-8864-4e20-8e8d-5901892e3f7a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:08.294277 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4a09e59c-079d-4f81-b06f-389efe335ac5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:08.307448 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4a09e59c-079d-4f81-b06f-389efe335ac5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.723175 May 28 04:47:08.308057 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1487/3117] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:07 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:08.333986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-66da23af-dccd-4cc4-8356-70c59563e218 req-271e984a-5553-43c2-ac04-926bcfdc71b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb4e9bd-e4d7-4119-963a-188a003df323", "name": "network-vif-plugged", "status": "completed", "tag": "e69aae4c-26bb-442b-9499-b01e81118939"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:08.378641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-66da23af-dccd-4cc4-8356-70c59563e218 req-271e984a-5553-43c2-ac04-926bcfdc71b1 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:08.379382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-66da23af-dccd-4cc4-8356-70c59563e218 req-271e984a-5553-43c2-ac04-926bcfdc71b1 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:08.394434 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-66da23af-dccd-4cc4-8356-70c59563e218 req-271e984a-5553-43c2-ac04-926bcfdc71b1 service nova] Creating event network-vif-plugged:e69aae4c-26bb-442b-9499-b01e81118939 for instance 3bb4e9bd-e4d7-4119-963a-188a003df323 on n-h2-843700-1 May 28 04:47:08.402935 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-66da23af-dccd-4cc4-8356-70c59563e218 req-271e984a-5553-43c2-ac04-926bcfdc71b1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082724 May 28 04:47:08.404690 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1488/3118] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:08.476764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e8713000-8864-4e20-8e8d-5901892e3f7a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:08.479359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:08.480644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7023206c-d2f1-4b6e-834d-493a2fe94fdd tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:08.483375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7023206c-d2f1-4b6e-834d-493a2fe94fdd tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:08.494367 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e8713000-8864-4e20-8e8d-5901892e3f7a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69" status: 200 len: 1365 microversion: 2.1 time: 0.511327 May 28 04:47:08.495278 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1631/3119] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:07 2022] GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 => generated 1365 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:08.506836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7023206c-d2f1-4b6e-834d-493a2fe94fdd tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:08.516247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7023206c-d2f1-4b6e-834d-493a2fe94fdd tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:08.517387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7023206c-d2f1-4b6e-834d-493a2fe94fdd tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:08.518327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7023206c-d2f1-4b6e-834d-493a2fe94fdd tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:08.562177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-99ab84b9-beb5-41f4-902a-4524c219e136 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:08.562804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-99ab84b9-beb5-41f4-902a-4524c219e136 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:08.586486 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7023206c-d2f1-4b6e-834d-493a2fe94fdd tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112473 May 28 04:47:08.587942 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1489/3120] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:47:08 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:47:08.597037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d579cdf1-b0b3-4924-9424-a455767f685a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701dd6820>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:08.602632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-99ab84b9-beb5-41f4-902a-4524c219e136 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:08.603124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-99ab84b9-beb5-41f4-902a-4524c219e136 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:08.603911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-99ab84b9-beb5-41f4-902a-4524c219e136 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:08.604357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-99ab84b9-beb5-41f4-902a-4524c219e136 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:08.801249 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d579cdf1-b0b3-4924-9424-a455767f685a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1411 microversion: 2.1 time: 0.210912 May 28 04:47:08.806821 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1490/3121] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:08 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1411 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:08.988432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-70961d0e-b3df-4bc1-9a8c-c758280103c7 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:08.997113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-70961d0e-b3df-4bc1-9a8c-c758280103c7 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:09.020153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70961d0e-b3df-4bc1-9a8c-c758280103c7 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:09.020974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70961d0e-b3df-4bc1-9a8c-c758280103c7 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:09.022201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70961d0e-b3df-4bc1-9a8c-c758280103c7 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:09.022870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70961d0e-b3df-4bc1-9a8c-c758280103c7 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:09.179332 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-70961d0e-b3df-4bc1-9a8c-c758280103c7 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11042f256135447b907df76bcce1e3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a310496bcde7409a8338f64e444f6dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:09.188456 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-70961d0e-b3df-4bc1-9a8c-c758280103c7 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 200 len: 1284 microversion: 2.1 time: 0.205822 May 28 04:47:09.189907 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1491/3122] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:08 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 1284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:09.325203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-78d43522-0930-41bb-b21e-41a400a89372 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:09.326466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-78d43522-0930-41bb-b21e-41a400a89372 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:09.338078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78d43522-0930-41bb-b21e-41a400a89372 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:09.341363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78d43522-0930-41bb-b21e-41a400a89372 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:09.342547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78d43522-0930-41bb-b21e-41a400a89372 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:09.347334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78d43522-0930-41bb-b21e-41a400a89372 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:09.417218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-99ab84b9-beb5-41f4-902a-4524c219e136 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:09.431496 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-99ab84b9-beb5-41f4-902a-4524c219e136 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1521 microversion: 2.1 time: 0.875152 May 28 04:47:09.434223 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1632/3123] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:08 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1521 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:09.450504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e66b3d83-af64-4374-89b2-9655a84ac0bd tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:09.451158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e66b3d83-af64-4374-89b2-9655a84ac0bd tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:09.461067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e66b3d83-af64-4374-89b2-9655a84ac0bd tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:09.461522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e66b3d83-af64-4374-89b2-9655a84ac0bd tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:09.462494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e66b3d83-af64-4374-89b2-9655a84ac0bd tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:09.463614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e66b3d83-af64-4374-89b2-9655a84ac0bd tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:09.933160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-78d43522-0930-41bb-b21e-41a400a89372 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:09.947861 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-78d43522-0930-41bb-b21e-41a400a89372 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.627561 May 28 04:47:09.948462 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1492/3124] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:09 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:09.962502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e3f2a407-74ca-4e7e-978a-de90ae306e33 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:09.963220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e3f2a407-74ca-4e7e-978a-de90ae306e33 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:09.974205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3f2a407-74ca-4e7e-978a-de90ae306e33 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:09.974205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3f2a407-74ca-4e7e-978a-de90ae306e33 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:09.975784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3f2a407-74ca-4e7e-978a-de90ae306e33 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:09.976499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3f2a407-74ca-4e7e-978a-de90ae306e33 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:10.159309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e66b3d83-af64-4374-89b2-9655a84ac0bd tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:10.168667 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e66b3d83-af64-4374-89b2-9655a84ac0bd tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1521 microversion: 2.1 time: 0.722786 May 28 04:47:10.169267 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1633/3125] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:09 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1521 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:10.189536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-26210598-cf54-4885-bb38-3cecc860a296 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:10.200082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-26210598-cf54-4885-bb38-3cecc860a296 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:10.221694 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26210598-cf54-4885-bb38-3cecc860a296 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:10.221694 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26210598-cf54-4885-bb38-3cecc860a296 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:10.233459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26210598-cf54-4885-bb38-3cecc860a296 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:10.236450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26210598-cf54-4885-bb38-3cecc860a296 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:10.350961 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-26210598-cf54-4885-bb38-3cecc860a296 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171736 May 28 04:47:10.356695 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1634/3126] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:47:10 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:10.366247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d7e7a4c2-02d8-4c29-a4fb-47d2929d25fa tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701053dc0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:10.481385 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d7e7a4c2-02d8-4c29-a4fb-47d2929d25fa tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1411 microversion: 2.1 time: 0.123060 May 28 04:47:10.485494 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1635/3127] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:10 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1411 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:10.490838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2052376b-a11f-4c7c-8aa5-b1b43e67e314 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1502787884", "metadata": {"": ""}}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2052376b-a11f-4c7c-8aa5-b1b43e67e314 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Request method failure captured: May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217/action HTTP/1.1 May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 107 May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikak47QAs5K06QhfhkIquusTq5B930GK2qX0_12di_Rh32YDa0oiawwGAqeo88DT65woz1MmOY2wmnqGoSlDi_TB5nkwOW_jtkf8bwl1MIAPkkOt7hgVlVdmgC8btNyj4GvAvNekqk5WajXo3d43lpqxKK68oDpAyv5Nz9V4rMhAcq7c May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 6b37465157dd44a09cffbbe57322d264 May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1502787884", "metadata": {"": ""}}} May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '6245d7aa-7d05-4ab8-aa60-976fd2f6e217', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1502787884', 'metadata': {'': ''}}}} May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise error May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi {'': ''} May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:47:10.519901 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:47:10.525062 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:47:10.525062 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:47:10.525062 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:47:10.525062 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:47:10.525062 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:47:10.525062 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:47:10.525062 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:10.525062 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:10.525062 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:10.525062 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:10.525062 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:10.525062 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:10.525062 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:47:10.525062 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:47:10.525062 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:47:10.525062 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:10.532222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2052376b-a11f-4c7c-8aa5-b1b43e67e314 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:47:10.535442 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2052376b-a11f-4c7c-8aa5-b1b43e67e314 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "POST /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217/action" status: 400 len: 170 microversion: 2.1 time: 0.050458 May 28 04:47:10.539939 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1636/3128] 10.222.0.58 () {60 vars in 1278 bytes} [Sat May 28 04:47:10 2022] POST /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217/action => generated 170 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:47:10.577517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e3f2a407-74ca-4e7e-978a-de90ae306e33 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:10.586166 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e3f2a407-74ca-4e7e-978a-de90ae306e33 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69" status: 200 len: 1365 microversion: 2.1 time: 0.636196 May 28 04:47:10.591194 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1493/3129] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:09 2022] GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 => generated 1365 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:10.605744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fac49eac-eb9c-404b-adad-9a70adc09cc0 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:10.605744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fac49eac-eb9c-404b-adad-9a70adc09cc0 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:10.616245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fac49eac-eb9c-404b-adad-9a70adc09cc0 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:10.619314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fac49eac-eb9c-404b-adad-9a70adc09cc0 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:10.620386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fac49eac-eb9c-404b-adad-9a70adc09cc0 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:10.623027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fac49eac-eb9c-404b-adad-9a70adc09cc0 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:10.665721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:10.741953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fac49eac-eb9c-404b-adad-9a70adc09cc0 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11042f256135447b907df76bcce1e3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a310496bcde7409a8338f64e444f6dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:10.751380 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fac49eac-eb9c-404b-adad-9a70adc09cc0 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 200 len: 1282 microversion: 2.1 time: 0.158602 May 28 04:47:10.766333 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1494/3130] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:10 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 1282 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:10.776325 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-16fa7b12-f4e8-4f7a-b012-2280a2c3bffd req-c86e43a5-d89f-4159-9724-f4602f457a29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06f67b96-191c-4c64-96bf-e1e61c33ee69", "tag": "f4cd01a7-d341-4b8b-8d12-fb2902de6c05"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:10.799516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-16fa7b12-f4e8-4f7a-b012-2280a2c3bffd req-c86e43a5-d89f-4159-9724-f4602f457a29 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:10.802100 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-16fa7b12-f4e8-4f7a-b012-2280a2c3bffd req-c86e43a5-d89f-4159-9724-f4602f457a29 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:10.828474 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-16fa7b12-f4e8-4f7a-b012-2280a2c3bffd req-c86e43a5-d89f-4159-9724-f4602f457a29 service nova] Creating event network-changed:f4cd01a7-d341-4b8b-8d12-fb2902de6c05 for instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 on n-h2-843700-1 May 28 04:47:10.837355 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-16fa7b12-f4e8-4f7a-b012-2280a2c3bffd req-c86e43a5-d89f-4159-9724-f4602f457a29 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069328 May 28 04:47:10.838924 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1495/3131] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:10.852394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b97ac729-82e1-4627-9d29-769b782d0c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:10.855247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b97ac729-82e1-4627-9d29-769b782d0c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:10.871919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b97ac729-82e1-4627-9d29-769b782d0c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:10.873909 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b97ac729-82e1-4627-9d29-769b782d0c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:10.875926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b97ac729-82e1-4627-9d29-769b782d0c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:10.878357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b97ac729-82e1-4627-9d29-769b782d0c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:10.935581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b8a1c98b-a88b-4d88-abb5-953fa944e91f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:10.936628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b8a1c98b-a88b-4d88-abb5-953fa944e91f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:10.965850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8a1c98b-a88b-4d88-abb5-953fa944e91f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:10.966356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8a1c98b-a88b-4d88-abb5-953fa944e91f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:10.967270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8a1c98b-a88b-4d88-abb5-953fa944e91f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:10.980025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8a1c98b-a88b-4d88-abb5-953fa944e91f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:11.908988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b97ac729-82e1-4627-9d29-769b782d0c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:11.917407 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b97ac729-82e1-4627-9d29-769b782d0c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1521 microversion: 2.1 time: 1.075249 May 28 04:47:11.918167 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1496/3132] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:10 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1521 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:11.944755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7f0173bf-6fb1-450a-83b2-4de6787a7f25 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:11.945680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7f0173bf-6fb1-450a-83b2-4de6787a7f25 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:11.962843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f0173bf-6fb1-450a-83b2-4de6787a7f25 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:11.963657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f0173bf-6fb1-450a-83b2-4de6787a7f25 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:11.964638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f0173bf-6fb1-450a-83b2-4de6787a7f25 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:11.965318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f0173bf-6fb1-450a-83b2-4de6787a7f25 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:12.193336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b8a1c98b-a88b-4d88-abb5-953fa944e91f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:12.225794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b8a1c98b-a88b-4d88-abb5-953fa944e91f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:12.230267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b8a1c98b-a88b-4d88-abb5-953fa944e91f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:12.236694 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b8a1c98b-a88b-4d88-abb5-953fa944e91f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 2947 microversion: 2.42 time: 1.693499 May 28 04:47:12.240349 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1637/3133] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:47:10 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 2947 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:47:12.254890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0a2593a1-5d41-4274-95bb-96a542019e2a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:12.257866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0a2593a1-5d41-4274-95bb-96a542019e2a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:12.271204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7f0173bf-6fb1-450a-83b2-4de6787a7f25 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:12.282276 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0a2593a1-5d41-4274-95bb-96a542019e2a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:12.283306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0a2593a1-5d41-4274-95bb-96a542019e2a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:12.286497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0a2593a1-5d41-4274-95bb-96a542019e2a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:12.286977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0a2593a1-5d41-4274-95bb-96a542019e2a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:12.287391 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7f0173bf-6fb1-450a-83b2-4de6787a7f25 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1510 microversion: 2.1 time: 0.346967 May 28 04:47:12.287999 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1497/3134] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:11 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1510 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:12.305825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2699eaf5-5f1f-4752-89f9-59d6b7b131fc tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701e0f0d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:12.374740 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2699eaf5-5f1f-4752-89f9-59d6b7b131fc tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1411 microversion: 2.1 time: 0.072683 May 28 04:47:12.376046 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1498/3135] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:12 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1411 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:12.392813 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0a2593a1-5d41-4274-95bb-96a542019e2a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150958 May 28 04:47:12.395596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-377d726e-51c4-4b59-ad1e-aefd2603f68b tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:12.396515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-377d726e-51c4-4b59-ad1e-aefd2603f68b tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:12.397368 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1638/3136] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:47:12 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:12.408597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1d362845-3602-43ad-a77f-f331ebcff1e6 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:12.413309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1d362845-3602-43ad-a77f-f331ebcff1e6 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:12.415103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-377d726e-51c4-4b59-ad1e-aefd2603f68b tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:12.421096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-377d726e-51c4-4b59-ad1e-aefd2603f68b tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:12.422291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-377d726e-51c4-4b59-ad1e-aefd2603f68b tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:12.424260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-377d726e-51c4-4b59-ad1e-aefd2603f68b tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:12.436547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d362845-3602-43ad-a77f-f331ebcff1e6 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:12.447229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d362845-3602-43ad-a77f-f331ebcff1e6 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:12.451832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d362845-3602-43ad-a77f-f331ebcff1e6 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:12.452829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d362845-3602-43ad-a77f-f331ebcff1e6 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:13.195006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1d362845-3602-43ad-a77f-f331ebcff1e6 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11042f256135447b907df76bcce1e3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a310496bcde7409a8338f64e444f6dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:13.204430 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1d362845-3602-43ad-a77f-f331ebcff1e6 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 200 len: 1324 microversion: 2.1 time: 0.804956 May 28 04:47:13.205036 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1639/3137] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:12 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 1324 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:13.241926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-72bf61c2-a12d-441f-a928-5e6aa760e21a tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:13.243019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-72bf61c2-a12d-441f-a928-5e6aa760e21a tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:13.245271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:13.268603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72bf61c2-a12d-441f-a928-5e6aa760e21a tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:13.271475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72bf61c2-a12d-441f-a928-5e6aa760e21a tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:13.278916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72bf61c2-a12d-441f-a928-5e6aa760e21a tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:13.278916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72bf61c2-a12d-441f-a928-5e6aa760e21a tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:13.373570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-377d726e-51c4-4b59-ad1e-aefd2603f68b tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:13.383316 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-377d726e-51c4-4b59-ad1e-aefd2603f68b tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69" status: 200 len: 1365 microversion: 2.1 time: 1.005963 May 28 04:47:13.385392 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1499/3138] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:12 2022] GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 => generated 1365 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:13.391752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eafc44fd-7b55-45ea-b1a3-9e5df5cbab1a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:13.392442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eafc44fd-7b55-45ea-b1a3-9e5df5cbab1a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:13.400861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eafc44fd-7b55-45ea-b1a3-9e5df5cbab1a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:13.406389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eafc44fd-7b55-45ea-b1a3-9e5df5cbab1a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:13.406389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eafc44fd-7b55-45ea-b1a3-9e5df5cbab1a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:13.406389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eafc44fd-7b55-45ea-b1a3-9e5df5cbab1a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:13.640158 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eafc44fd-7b55-45ea-b1a3-9e5df5cbab1a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.252179 May 28 04:47:13.640771 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1500/3139] 10.222.0.58 () {60 vars in 1315 bytes} [Sat May 28 04:47:13 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26/os-interface => generated 1830 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:47:13.645956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-135b65d6-6b1d-4beb-ba52-a6627da4d480 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:13.646966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-135b65d6-6b1d-4beb-ba52-a6627da4d480 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:13.662830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-135b65d6-6b1d-4beb-ba52-a6627da4d480 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:13.665425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-135b65d6-6b1d-4beb-ba52-a6627da4d480 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:13.666859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-135b65d6-6b1d-4beb-ba52-a6627da4d480 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:13.669442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-135b65d6-6b1d-4beb-ba52-a6627da4d480 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:13.734752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-72bf61c2-a12d-441f-a928-5e6aa760e21a tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:13.746955 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-72bf61c2-a12d-441f-a928-5e6aa760e21a tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1521 microversion: 2.1 time: 0.537264 May 28 04:47:13.765276 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1640/3140] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:13 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1521 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:13.789228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dbe241c0-18fa-4b76-a5ae-05cd96aeab8a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700fe6670>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:13.858348 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dbe241c0-18fa-4b76-a5ae-05cd96aeab8a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1411 microversion: 2.1 time: 0.091560 May 28 04:47:13.869370 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1641/3141] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:13 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:13.875272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-965588ec-72d2-4d26-b040-a140aa107b45 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:13.876552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-965588ec-72d2-4d26-b040-a140aa107b45 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:13.886306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-965588ec-72d2-4d26-b040-a140aa107b45 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:13.894832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-965588ec-72d2-4d26-b040-a140aa107b45 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:13.896121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-965588ec-72d2-4d26-b040-a140aa107b45 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:13.896748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-965588ec-72d2-4d26-b040-a140aa107b45 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:13.941138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-135b65d6-6b1d-4beb-ba52-a6627da4d480 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:13.944310 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-965588ec-72d2-4d26-b040-a140aa107b45 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073584 May 28 04:47:13.945257 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1642/3142] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:47:13 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:13.952928 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-135b65d6-6b1d-4beb-ba52-a6627da4d480 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1487 microversion: 2.1 time: 0.311089 May 28 04:47:13.958509 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1501/3143] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:13 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1487 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:13.970113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-65b25c3d-caa7-4611-9275-f9d4c4b95906 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-343160271", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:13.974814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-565e642b-5bb9-44d7-a762-5cbcc4449f6e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-65b25c3d-caa7-4611-9275-f9d4c4b95906 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Request method failure captured: May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217/action HTTP/1.1 May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 618 May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikak47QAs5K06QhfhkIquusTq5B930GK2qX0_12di_Rh32YDa0oiawwGAqeo88DT65woz1MmOY2wmnqGoSlDi_TB5nkwOW_jtkf8bwl1MIAPkkOt7hgVlVdmgC8btNyj4GvAvNekqk5WajXo3d43lpqxKK68oDpAyv5Nz9V4rMhAcq7c May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 6b37465157dd44a09cffbbe57322d264 May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-343160271", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '6245d7aa-7d05-4ab8-aa60-976fd2f6e217', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-343160271', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:47:13.976431 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise error May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 04:47:13.979350 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:13.991237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-65b25c3d-caa7-4611-9275-f9d4c4b95906 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:47:13.991237 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-65b25c3d-caa7-4611-9275-f9d4c4b95906 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "POST /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217/action" status: 400 len: 938 microversion: 2.1 time: 0.026703 May 28 04:47:13.991237 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1643/3144] 10.222.0.58 () {60 vars in 1278 bytes} [Sat May 28 04:47:13 2022] POST /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217/action => generated 938 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:47:13.991521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-565e642b-5bb9-44d7-a762-5cbcc4449f6e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:13.997804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1a6d71fc-2e89-4e4a-b8f0-ac3af1ece861 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:13.998430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1a6d71fc-2e89-4e4a-b8f0-ac3af1ece861 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:14.010855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a6d71fc-2e89-4e4a-b8f0-ac3af1ece861 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:14.017043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a6d71fc-2e89-4e4a-b8f0-ac3af1ece861 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:14.017043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a6d71fc-2e89-4e4a-b8f0-ac3af1ece861 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:14.017043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a6d71fc-2e89-4e4a-b8f0-ac3af1ece861 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:14.029809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-565e642b-5bb9-44d7-a762-5cbcc4449f6e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:14.035634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-565e642b-5bb9-44d7-a762-5cbcc4449f6e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:14.037138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-565e642b-5bb9-44d7-a762-5cbcc4449f6e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:14.040025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-565e642b-5bb9-44d7-a762-5cbcc4449f6e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:14.123437 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-565e642b-5bb9-44d7-a762-5cbcc4449f6e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action" status: 200 len: 155 microversion: 2.1 time: 0.153276 May 28 04:47:14.124166 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1502/3145] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:13 2022] POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action => generated 155 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:47:14.135160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c5cbd2b1-ebc7-4cc4-87d2-ae9cdb0d7376 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:14.136420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c5cbd2b1-ebc7-4cc4-87d2-ae9cdb0d7376 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:14.175802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5cbd2b1-ebc7-4cc4-87d2-ae9cdb0d7376 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:14.185000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5cbd2b1-ebc7-4cc4-87d2-ae9cdb0d7376 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:14.188567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5cbd2b1-ebc7-4cc4-87d2-ae9cdb0d7376 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:14.191770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5cbd2b1-ebc7-4cc4-87d2-ae9cdb0d7376 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:14.459538 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1a6d71fc-2e89-4e4a-b8f0-ac3af1ece861 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:14.482613 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1a6d71fc-2e89-4e4a-b8f0-ac3af1ece861 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1521 microversion: 2.1 time: 0.491050 May 28 04:47:14.495023 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1644/3146] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:13 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1521 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:14.497992 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5cede530-0428-47df-a6d4-f7457621975f tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:14.500993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5cede530-0428-47df-a6d4-f7457621975f tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:14.516783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5cede530-0428-47df-a6d4-f7457621975f tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:14.517522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5cede530-0428-47df-a6d4-f7457621975f tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:14.523182 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5cede530-0428-47df-a6d4-f7457621975f tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:14.525030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5cede530-0428-47df-a6d4-f7457621975f tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:14.864237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c5cbd2b1-ebc7-4cc4-87d2-ae9cdb0d7376 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:14.878800 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c5cbd2b1-ebc7-4cc4-87d2-ae9cdb0d7376 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.748828 May 28 04:47:14.882805 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1503/3147] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:14 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:14.894153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8931ac36-02b2-4db2-a6f7-ec605aedd425 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:14.896631 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8931ac36-02b2-4db2-a6f7-ec605aedd425 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:14.909535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8931ac36-02b2-4db2-a6f7-ec605aedd425 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:14.912940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8931ac36-02b2-4db2-a6f7-ec605aedd425 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:14.914806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8931ac36-02b2-4db2-a6f7-ec605aedd425 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:14.918295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8931ac36-02b2-4db2-a6f7-ec605aedd425 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:14.995702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:15.003197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5cede530-0428-47df-a6d4-f7457621975f tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11042f256135447b907df76bcce1e3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a310496bcde7409a8338f64e444f6dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:15.012930 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5cede530-0428-47df-a6d4-f7457621975f tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 200 len: 1324 microversion: 2.1 time: 0.523048 May 28 04:47:15.030576 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1645/3148] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:14 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 1324 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:15.057051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-291f3c2a-2e05-4874-8bb6-c912ffc6a29b tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:15.057692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-291f3c2a-2e05-4874-8bb6-c912ffc6a29b tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:15.084991 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-291f3c2a-2e05-4874-8bb6-c912ffc6a29b tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:15.085668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-291f3c2a-2e05-4874-8bb6-c912ffc6a29b tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:15.090945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-291f3c2a-2e05-4874-8bb6-c912ffc6a29b tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:15.091345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-291f3c2a-2e05-4874-8bb6-c912ffc6a29b tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:15.729023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8931ac36-02b2-4db2-a6f7-ec605aedd425 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:15.742063 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8931ac36-02b2-4db2-a6f7-ec605aedd425 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69" status: 200 len: 1365 microversion: 2.1 time: 0.857644 May 28 04:47:15.745448 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1504/3149] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:14 2022] GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 => generated 1365 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:15.754709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4c24b53d-3c45-460d-9e9d-94093581b4fd tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701dfb430>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:15.776774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-291f3c2a-2e05-4874-8bb6-c912ffc6a29b tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:15.787602 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-291f3c2a-2e05-4874-8bb6-c912ffc6a29b tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1521 microversion: 2.1 time: 0.753589 May 28 04:47:15.792404 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1646/3150] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:15 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1521 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:15.812852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-33479221-1964-44b3-9dec-07dc687e8567 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:15.813679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-33479221-1964-44b3-9dec-07dc687e8567 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:15.820684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-33479221-1964-44b3-9dec-07dc687e8567 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:15.823169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-33479221-1964-44b3-9dec-07dc687e8567 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:15.824619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-33479221-1964-44b3-9dec-07dc687e8567 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:15.825270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-33479221-1964-44b3-9dec-07dc687e8567 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:15.832774 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4c24b53d-3c45-460d-9e9d-94093581b4fd tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1411 microversion: 2.1 time: 0.085207 May 28 04:47:15.839084 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1505/3151] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:15 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1411 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:15.849530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-73c04444-3c93-428d-9f6a-4b4e7b523ffb tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:15.856768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-73c04444-3c93-428d-9f6a-4b4e7b523ffb tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:15.866857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73c04444-3c93-428d-9f6a-4b4e7b523ffb tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:15.867580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73c04444-3c93-428d-9f6a-4b4e7b523ffb tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:15.869062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73c04444-3c93-428d-9f6a-4b4e7b523ffb tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:15.870227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73c04444-3c93-428d-9f6a-4b4e7b523ffb tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:15.916585 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-73c04444-3c93-428d-9f6a-4b4e7b523ffb tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082227 May 28 04:47:15.917475 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1506/3152] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:47:15 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:15.924994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ed7eae9a-caf5-4cdc-ab7b-c595af21a60c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ed7eae9a-caf5-4cdc-ab7b-c595af21a60c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Request method failure captured: May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217/action HTTP/1.1 May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 285 May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikak47QAs5K06QhfhkIquusTq5B930GK2qX0_12di_Rh32YDa0oiawwGAqeo88DT65woz1MmOY2wmnqGoSlDi_TB5nkwOW_jtkf8bwl1MIAPkkOt7hgVlVdmgC8btNyj4GvAvNekqk5WajXo3d43lpqxKK68oDpAyv5Nz9V4rMhAcq7c May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 6b37465157dd44a09cffbbe57322d264 May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '6245d7aa-7d05-4ab8-aa60-976fd2f6e217', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:47:15.927985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 04:47:15.931670 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:47:15.935327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ed7eae9a-caf5-4cdc-ab7b-c595af21a60c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:47:15.936409 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ed7eae9a-caf5-4cdc-ab7b-c595af21a60c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "POST /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217/action" status: 400 len: 619 microversion: 2.1 time: 0.017737 May 28 04:47:15.937689 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1507/3153] 10.222.0.58 () {60 vars in 1278 bytes} [Sat May 28 04:47:15 2022] POST /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217/action => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:47:15.952370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8e62bbfe-a3f7-43db-ada7-000f69dfdffe tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:15.967950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8e62bbfe-a3f7-43db-ada7-000f69dfdffe tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:16.012893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e62bbfe-a3f7-43db-ada7-000f69dfdffe tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:16.014071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e62bbfe-a3f7-43db-ada7-000f69dfdffe tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:16.015121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e62bbfe-a3f7-43db-ada7-000f69dfdffe tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:16.020918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e62bbfe-a3f7-43db-ada7-000f69dfdffe tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:16.231604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-33479221-1964-44b3-9dec-07dc687e8567 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:16.270942 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-33479221-1964-44b3-9dec-07dc687e8567 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.462599 May 28 04:47:16.281668 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1647/3154] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:15 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:16.294634 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aef4fc15-1f6d-4781-896d-89a07439eb2d tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:16.303029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aef4fc15-1f6d-4781-896d-89a07439eb2d tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:16.317256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aef4fc15-1f6d-4781-896d-89a07439eb2d tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:16.319583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aef4fc15-1f6d-4781-896d-89a07439eb2d tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:16.322404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aef4fc15-1f6d-4781-896d-89a07439eb2d tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:16.323148 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aef4fc15-1f6d-4781-896d-89a07439eb2d tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:16.564793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8e62bbfe-a3f7-43db-ada7-000f69dfdffe tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:16.573000 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8e62bbfe-a3f7-43db-ada7-000f69dfdffe tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1521 microversion: 2.1 time: 0.630383 May 28 04:47:16.573845 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1508/3155] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:15 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1521 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:16.593838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bc356e2d-41e0-424d-95f7-4a31a5ada57a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:16.594498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bc356e2d-41e0-424d-95f7-4a31a5ada57a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:16.623507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=22 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:16.625148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc356e2d-41e0-424d-95f7-4a31a5ada57a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:16.625607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc356e2d-41e0-424d-95f7-4a31a5ada57a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:16.626404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc356e2d-41e0-424d-95f7-4a31a5ada57a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:16.626973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc356e2d-41e0-424d-95f7-4a31a5ada57a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:16.697778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aef4fc15-1f6d-4781-896d-89a07439eb2d tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11042f256135447b907df76bcce1e3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a310496bcde7409a8338f64e444f6dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:16.707289 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aef4fc15-1f6d-4781-896d-89a07439eb2d tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 200 len: 1324 microversion: 2.1 time: 0.424124 May 28 04:47:16.717182 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1648/3156] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:16 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 1324 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:16.724610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f5fd56ca-bbd8-400e-bf83-7c6ea146a701 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:16.744348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f5fd56ca-bbd8-400e-bf83-7c6ea146a701 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:16.765428 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5fd56ca-bbd8-400e-bf83-7c6ea146a701 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:16.776168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5fd56ca-bbd8-400e-bf83-7c6ea146a701 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:16.782741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5fd56ca-bbd8-400e-bf83-7c6ea146a701 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:16.783331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5fd56ca-bbd8-400e-bf83-7c6ea146a701 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:17.220546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bc356e2d-41e0-424d-95f7-4a31a5ada57a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:17.230010 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bc356e2d-41e0-424d-95f7-4a31a5ada57a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.648086 May 28 04:47:17.242460 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1509/3157] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:16 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:17.249424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d0ca5b3d-5128-40f2-9bac-3214dca1cf2f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:17.257638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d0ca5b3d-5128-40f2-9bac-3214dca1cf2f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:17.285282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0ca5b3d-5128-40f2-9bac-3214dca1cf2f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:17.289353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0ca5b3d-5128-40f2-9bac-3214dca1cf2f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:17.290502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0ca5b3d-5128-40f2-9bac-3214dca1cf2f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:17.291147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0ca5b3d-5128-40f2-9bac-3214dca1cf2f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:17.793576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f5fd56ca-bbd8-400e-bf83-7c6ea146a701 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:17.817411 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f5fd56ca-bbd8-400e-bf83-7c6ea146a701 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1521 microversion: 2.1 time: 1.100251 May 28 04:47:17.818545 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1649/3158] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:16 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1521 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:17.830934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d0ca5b3d-5128-40f2-9bac-3214dca1cf2f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:17.837729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-23d29298-af08-405a-bfc2-97b241abcb55 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700f8d5e0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:17.845689 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d0ca5b3d-5128-40f2-9bac-3214dca1cf2f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69" status: 200 len: 1365 microversion: 2.1 time: 0.598892 May 28 04:47:17.846627 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1510/3159] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:17 2022] GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 => generated 1365 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:17.852517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5db55211-d2ef-490d-a204-f9daa8441914 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:17.853749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5db55211-d2ef-490d-a204-f9daa8441914 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:17.885707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5db55211-d2ef-490d-a204-f9daa8441914 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:17.891441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5db55211-d2ef-490d-a204-f9daa8441914 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:17.896554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5db55211-d2ef-490d-a204-f9daa8441914 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:17.896554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5db55211-d2ef-490d-a204-f9daa8441914 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:17.923383 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-23d29298-af08-405a-bfc2-97b241abcb55 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1411 microversion: 2.1 time: 0.103559 May 28 04:47:17.924200 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1650/3160] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:17 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1411 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:17.930651 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1b79bce8-2982-425c-944b-b19a9dc3f812 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:17.939453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1b79bce8-2982-425c-944b-b19a9dc3f812 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:17.954477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b79bce8-2982-425c-944b-b19a9dc3f812 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:17.961313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b79bce8-2982-425c-944b-b19a9dc3f812 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:17.962374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b79bce8-2982-425c-944b-b19a9dc3f812 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:17.963152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b79bce8-2982-425c-944b-b19a9dc3f812 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:17.968078 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5db55211-d2ef-490d-a204-f9daa8441914 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116800 May 28 04:47:17.973043 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1511/3161] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:47:17 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:17.980198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-926103bc-723d-443a-8f59-ade7a126e0a4 req-aaa5b63a-ede1-4d05-a8d5-05a16050a5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7423a142-b3c2-4e4e-93db-3fa6da736961", "tag": "58d91d6f-cd9b-42a7-a75e-af85f19157c6"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:17.990734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-926103bc-723d-443a-8f59-ade7a126e0a4 req-aaa5b63a-ede1-4d05-a8d5-05a16050a5b1 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:17.991692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-926103bc-723d-443a-8f59-ade7a126e0a4 req-aaa5b63a-ede1-4d05-a8d5-05a16050a5b1 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:18.007760 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-926103bc-723d-443a-8f59-ade7a126e0a4 req-aaa5b63a-ede1-4d05-a8d5-05a16050a5b1 service nova] Creating event network-changed:58d91d6f-cd9b-42a7-a75e-af85f19157c6 for instance 7423a142-b3c2-4e4e-93db-3fa6da736961 on n-h1-843700-1 May 28 04:47:18.017639 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-926103bc-723d-443a-8f59-ade7a126e0a4 req-aaa5b63a-ede1-4d05-a8d5-05a16050a5b1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042794 May 28 04:47:18.019733 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1512/3162] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:18.026724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-85f5ed8e-f533-40f2-85d5-56522fc24f2e tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:18.029594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-85f5ed8e-f533-40f2-85d5-56522fc24f2e tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:18.039098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85f5ed8e-f533-40f2-85d5-56522fc24f2e tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:18.049287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85f5ed8e-f533-40f2-85d5-56522fc24f2e tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:18.050536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85f5ed8e-f533-40f2-85d5-56522fc24f2e tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:18.051063 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85f5ed8e-f533-40f2-85d5-56522fc24f2e tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:18.682023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1b79bce8-2982-425c-944b-b19a9dc3f812 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:18.694574 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1b79bce8-2982-425c-944b-b19a9dc3f812 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.769169 May 28 04:47:18.700861 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1651/3163] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:17 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:18.708864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5df24915-e985-428e-bf5a-e1b07ccec327 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-843276560"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:18.712318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5df24915-e985-428e-bf5a-e1b07ccec327 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:18.754422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5df24915-e985-428e-bf5a-e1b07ccec327 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:18.755441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5df24915-e985-428e-bf5a-e1b07ccec327 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:18.757492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5df24915-e985-428e-bf5a-e1b07ccec327 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:18.760461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5df24915-e985-428e-bf5a-e1b07ccec327 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:18.948348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-85f5ed8e-f533-40f2-85d5-56522fc24f2e tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11042f256135447b907df76bcce1e3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a310496bcde7409a8338f64e444f6dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:18.956694 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-85f5ed8e-f533-40f2-85d5-56522fc24f2e tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 200 len: 1324 microversion: 2.1 time: 0.935480 May 28 04:47:18.961484 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1513/3164] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:18 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 1324 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:18.973655 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-14f0ffee-22a1-42ff-a29e-abad1477432a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:18.977704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-14f0ffee-22a1-42ff-a29e-abad1477432a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:18.989739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-14f0ffee-22a1-42ff-a29e-abad1477432a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:18.998865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-14f0ffee-22a1-42ff-a29e-abad1477432a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:19.001105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-14f0ffee-22a1-42ff-a29e-abad1477432a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:19.001882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-14f0ffee-22a1-42ff-a29e-abad1477432a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:19.439352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-14f0ffee-22a1-42ff-a29e-abad1477432a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:19.448464 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-14f0ffee-22a1-42ff-a29e-abad1477432a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69" status: 200 len: 1365 microversion: 2.1 time: 0.485550 May 28 04:47:19.458325 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1514/3165] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:18 2022] GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 => generated 1365 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:19.468190 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6b82fdf3-5483-4bc0-a8cd-8b51194b0313 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701dcea60>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:19.875870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:19.917642 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6b82fdf3-5483-4bc0-a8cd-8b51194b0313 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1411 microversion: 2.1 time: 0.457315 May 28 04:47:19.918700 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1515/3166] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:19 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1411 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:19.927285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b42495ab-030b-4ca5-a0a7-fc0d7d5efda9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1797918174", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "fa4b7ae7-c4d1-4b2e-9365-36aea885e8cd"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:20.025357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-b42495ab-030b-4ca5-a0a7-fc0d7d5efda9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] validate_networks() for [('fa4b7ae7-c4d1-4b2e-9365-36aea885e8cd', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:47:20.157562 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5df24915-e985-428e-bf5a-e1b07ccec327 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "POST /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217/action" status: 202 len: 0 microversion: 2.1 time: 1.455017 May 28 04:47:20.162176 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1652/3167] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:18 2022] POST /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217/action => generated 0 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 04:47:20.176527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c71650bb-2fb5-4e34-99f2-713a19f87155 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:20.183944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c71650bb-2fb5-4e34-99f2-713a19f87155 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:20.208022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c71650bb-2fb5-4e34-99f2-713a19f87155 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:20.209798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c71650bb-2fb5-4e34-99f2-713a19f87155 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:20.210630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c71650bb-2fb5-4e34-99f2-713a19f87155 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:20.211134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c71650bb-2fb5-4e34-99f2-713a19f87155 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:20.260477 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c71650bb-2fb5-4e34-99f2-713a19f87155 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095288 May 28 04:47:20.261192 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1653/3168] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:47:20 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:20.268129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fac2be0a-bd00-4152-a64d-b7700c990fa3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:20.269051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fac2be0a-bd00-4152-a64d-b7700c990fa3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:20.291811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fac2be0a-bd00-4152-a64d-b7700c990fa3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:20.291811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fac2be0a-bd00-4152-a64d-b7700c990fa3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:20.292833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fac2be0a-bd00-4152-a64d-b7700c990fa3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:20.293946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fac2be0a-bd00-4152-a64d-b7700c990fa3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:21.223600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fac2be0a-bd00-4152-a64d-b7700c990fa3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11042f256135447b907df76bcce1e3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a310496bcde7409a8338f64e444f6dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:21.231862 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fac2be0a-bd00-4152-a64d-b7700c990fa3 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 200 len: 1324 microversion: 2.1 time: 0.969044 May 28 04:47:21.232671 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1654/3169] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:20 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 1324 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:21.237385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-368e7b38-467a-4ee8-886c-9c7681ba6a7d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1490594898"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:21.238604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-368e7b38-467a-4ee8-886c-9c7681ba6a7d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:21.245512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-368e7b38-467a-4ee8-886c-9c7681ba6a7d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:21.246211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-368e7b38-467a-4ee8-886c-9c7681ba6a7d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:21.249758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-368e7b38-467a-4ee8-886c-9c7681ba6a7d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:21.249758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-368e7b38-467a-4ee8-886c-9c7681ba6a7d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:21.302563 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-368e7b38-467a-4ee8-886c-9c7681ba6a7d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] HTTP exception thrown: Cannot 'createImage' instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 while it is in task_state image_snapshot May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-368e7b38-467a-4ee8-886c-9c7681ba6a7d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Request method failure captured: May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217/action HTTP/1.1 May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 85 May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikak47QAs5K06QhfhkIquusTq5B930GK2qX0_12di_Rh32YDa0oiawwGAqeo88DT65woz1MmOY2wmnqGoSlDi_TB5nkwOW_jtkf8bwl1MIAPkkOt7hgVlVdmgC8btNyj4GvAvNekqk5WajXo3d43lpqxKK68oDpAyv5Nz9V4rMhAcq7c May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 6b37465157dd44a09cffbbe57322d264 May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1490594898"}} May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: exception: Cannot 'createImage' instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 while it is in task_state image_snapshot May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '6245d7aa-7d05-4ab8-aa60-976fd2f6e217', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1490594898'}}} May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 in task_state image_snapshot. Cannot snapshot while the instance is in this state. May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 04:47:21.304912 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 while it is in task_state image_snapshot May 28 04:47:21.310519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:21.310519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:21.310519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:21.310519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:21.310519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:21.310519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:21.310519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:47:21.310519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:47:21.310519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 while it is in task_state image_snapshot May 28 04:47:21.310519 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:21.310519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-368e7b38-467a-4ee8-886c-9c7681ba6a7d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Returning 409 to user: Cannot 'createImage' instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 while it is in task_state image_snapshot {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:47:21.310519 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-368e7b38-467a-4ee8-886c-9c7681ba6a7d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "POST /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217/action" status: 409 len: 159 microversion: 2.1 time: 0.072591 May 28 04:47:21.310519 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1655/3170] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:21 2022] POST /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217/action => generated 159 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 04:47:21.312806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-d5679891-dd46-4561-a740-4078f04f356f req-bb5a31cf-9de1-4998-9f7f-cfe70feb62f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06f67b96-191c-4c64-96bf-e1e61c33ee69", "name": "network-vif-plugged", "status": "completed", "tag": "f4cd01a7-d341-4b8b-8d12-fb2902de6c05"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:21.321172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d5679891-dd46-4561-a740-4078f04f356f req-bb5a31cf-9de1-4998-9f7f-cfe70feb62f7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:21.321622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d5679891-dd46-4561-a740-4078f04f356f req-bb5a31cf-9de1-4998-9f7f-cfe70feb62f7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:21.333657 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-d5679891-dd46-4561-a740-4078f04f356f req-bb5a31cf-9de1-4998-9f7f-cfe70feb62f7 service nova] Creating event network-vif-plugged:f4cd01a7-d341-4b8b-8d12-fb2902de6c05 for instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 on n-h2-843700-1 May 28 04:47:21.339079 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-d5679891-dd46-4561-a740-4078f04f356f req-bb5a31cf-9de1-4998-9f7f-cfe70feb62f7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030546 May 28 04:47:21.342109 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1656/3171] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:21.347122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ce4e8cf4-5c2e-46a0-a091-3bacaf9aa5b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:21.347122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ce4e8cf4-5c2e-46a0-a091-3bacaf9aa5b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:21.353693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce4e8cf4-5c2e-46a0-a091-3bacaf9aa5b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:21.354158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce4e8cf4-5c2e-46a0-a091-3bacaf9aa5b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:21.355630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce4e8cf4-5c2e-46a0-a091-3bacaf9aa5b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:21.356281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce4e8cf4-5c2e-46a0-a091-3bacaf9aa5b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:21.674517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-b42495ab-030b-4ca5-a0a7-fc0d7d5efda9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:47:21.675660 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-b42495ab-030b-4ca5-a0a7-fc0d7d5efda9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:47:21.676321 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-b42495ab-030b-4ca5-a0a7-fc0d7d5efda9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:47:21.676721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ce4e8cf4-5c2e-46a0-a091-3bacaf9aa5b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:21.676903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-b42495ab-030b-4ca5-a0a7-fc0d7d5efda9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:47:21.677405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-b42495ab-030b-4ca5-a0a7-fc0d7d5efda9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:47:21.687528 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ce4e8cf4-5c2e-46a0-a091-3bacaf9aa5b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69" status: 200 len: 1365 microversion: 2.1 time: 0.345748 May 28 04:47:21.695835 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1657/3172] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:21 2022] GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 => generated 1365 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:21.702464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-940447cc-4d1c-48dd-b503-7517c0b54fed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700f764c0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:21.704819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b42495ab-030b-4ca5-a0a7-fc0d7d5efda9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:21.705285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b42495ab-030b-4ca5-a0a7-fc0d7d5efda9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:21.707076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b42495ab-030b-4ca5-a0a7-fc0d7d5efda9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:21.707991 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b42495ab-030b-4ca5-a0a7-fc0d7d5efda9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:21.738896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-b42495ab-030b-4ca5-a0a7-fc0d7d5efda9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Getting quotas for project b0c48bf20efd4291b37e616c658f96ff. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:47:21.752856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-b42495ab-030b-4ca5-a0a7-fc0d7d5efda9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Getting quotas for user 6272045226334bcf8b49a0aa41a07b95 and project b0c48bf20efd4291b37e616c658f96ff. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:47:21.764838 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-940447cc-4d1c-48dd-b503-7517c0b54fed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1411 microversion: 2.1 time: 0.067673 May 28 04:47:21.765677 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1658/3173] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:21 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1411 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:21.779752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-479de996-e402-4efa-832f-b2bf9ab264c1 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:21.779752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-479de996-e402-4efa-832f-b2bf9ab264c1 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:21.779988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b42495ab-030b-4ca5-a0a7-fc0d7d5efda9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:47:21.786274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-479de996-e402-4efa-832f-b2bf9ab264c1 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:21.786918 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-479de996-e402-4efa-832f-b2bf9ab264c1 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:21.787192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b42495ab-030b-4ca5-a0a7-fc0d7d5efda9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:47:21.788742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-479de996-e402-4efa-832f-b2bf9ab264c1 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:21.789347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-479de996-e402-4efa-832f-b2bf9ab264c1 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:21.848460 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-479de996-e402-4efa-832f-b2bf9ab264c1 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076269 May 28 04:47:21.849053 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1659/3174] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:47:21 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:47:21.853543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-364659c7-0b9a-4c71-8dcc-e96f32acb237 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '.version_select at 0x7f7700fe6790>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:21.975245 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b42495ab-030b-4ca5-a0a7-fc0d7d5efda9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.055264 May 28 04:47:21.978598 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1516/3175] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:47:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:47:21.989994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-24365554-328b-4bf8-b178-62173503b712 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:21.993460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-24365554-328b-4bf8-b178-62173503b712 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:22.167482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-24365554-328b-4bf8-b178-62173503b712 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:22.185396 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-24365554-328b-4bf8-b178-62173503b712 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88" status: 200 len: 1215 microversion: 2.1 time: 0.202209 May 28 04:47:22.188222 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1517/3176] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:21 2022] GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88 => generated 1215 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:22.254387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b68205ec-d9f3-40b0-9c9f-9531b01aa84b tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:22.255043 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b68205ec-d9f3-40b0-9c9f-9531b01aa84b tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:22.265089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b68205ec-d9f3-40b0-9c9f-9531b01aa84b tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:22.265584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b68205ec-d9f3-40b0-9c9f-9531b01aa84b tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:22.266374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b68205ec-d9f3-40b0-9c9f-9531b01aa84b tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:22.267018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b68205ec-d9f3-40b0-9c9f-9531b01aa84b tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:22.350217 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-364659c7-0b9a-4c71-8dcc-e96f32acb237 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "DELETE /compute/v2.1/images/261643cd-90e3-4d85-8c9c-ed75a9684763" status: 204 len: 0 microversion: 2.1 time: 0.500039 May 28 04:47:22.360911 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1660/3177] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:21 2022] DELETE /compute/v2.1/images/261643cd-90e3-4d85-8c9c-ed75a9684763 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:47:22.360911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-41316fd1-b73f-43a6-9886-fedac0e2e46e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:22.368655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-41316fd1-b73f-43a6-9886-fedac0e2e46e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:22.385508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41316fd1-b73f-43a6-9886-fedac0e2e46e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:22.387206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41316fd1-b73f-43a6-9886-fedac0e2e46e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:22.388253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41316fd1-b73f-43a6-9886-fedac0e2e46e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:22.389378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41316fd1-b73f-43a6-9886-fedac0e2e46e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:22.639131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-41316fd1-b73f-43a6-9886-fedac0e2e46e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:22.650394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b68205ec-d9f3-40b0-9c9f-9531b01aa84b tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11042f256135447b907df76bcce1e3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a310496bcde7409a8338f64e444f6dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:22.654860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:22.661655 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-41316fd1-b73f-43a6-9886-fedac0e2e46e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1533 microversion: 2.1 time: 0.304935 May 28 04:47:22.662692 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b68205ec-d9f3-40b0-9c9f-9531b01aa84b tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 200 len: 1324 microversion: 2.1 time: 0.417597 May 28 04:47:22.672489 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1518/3178] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:22 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 1324 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:22.672868 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1661/3179] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:22 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1533 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:22.713577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8060243e-7bf0-492a-afb2-606db2018ca7 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:22.714203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8060243e-7bf0-492a-afb2-606db2018ca7 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:22.724010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8060243e-7bf0-492a-afb2-606db2018ca7 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:22.731601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8060243e-7bf0-492a-afb2-606db2018ca7 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:22.732921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8060243e-7bf0-492a-afb2-606db2018ca7 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:22.733531 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8060243e-7bf0-492a-afb2-606db2018ca7 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:22.783562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bc0cbde9-3dc6-4ecc-926e-c68397b95c3b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700f5d9d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:22.836078 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bc0cbde9-3dc6-4ecc-926e-c68397b95c3b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1411 microversion: 2.1 time: 0.062185 May 28 04:47:22.842940 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1662/3180] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:22 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1411 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:22.973027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8060243e-7bf0-492a-afb2-606db2018ca7 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:22.997765 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8060243e-7bf0-492a-afb2-606db2018ca7 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69" status: 200 len: 1365 microversion: 2.1 time: 0.288164 May 28 04:47:23.007589 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1519/3181] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:22 2022] GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 => generated 1365 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:23.204896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6e04cf7a-1b83-49b0-80a5-0733c5048a22 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:23.205521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6e04cf7a-1b83-49b0-80a5-0733c5048a22 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:23.338930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6e04cf7a-1b83-49b0-80a5-0733c5048a22 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:23.351933 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6e04cf7a-1b83-49b0-80a5-0733c5048a22 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88" status: 200 len: 1215 microversion: 2.1 time: 0.151819 May 28 04:47:23.369058 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1663/3182] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:23 2022] GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88 => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:23.690527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3450dc49-4447-4b9d-94a3-f8367ba512c9 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:23.691535 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3450dc49-4447-4b9d-94a3-f8367ba512c9 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:23.691912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f0b02987-88e3-4b9b-9d8d-fc8741c7fc83 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:23.692769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f0b02987-88e3-4b9b-9d8d-fc8741c7fc83 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:23.722795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3450dc49-4447-4b9d-94a3-f8367ba512c9 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:23.723901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3450dc49-4447-4b9d-94a3-f8367ba512c9 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:23.729143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3450dc49-4447-4b9d-94a3-f8367ba512c9 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:23.729987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3450dc49-4447-4b9d-94a3-f8367ba512c9 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:23.734502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0b02987-88e3-4b9b-9d8d-fc8741c7fc83 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:23.738411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0b02987-88e3-4b9b-9d8d-fc8741c7fc83 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:23.740377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0b02987-88e3-4b9b-9d8d-fc8741c7fc83 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:23.743922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0b02987-88e3-4b9b-9d8d-fc8741c7fc83 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:24.270147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f0b02987-88e3-4b9b-9d8d-fc8741c7fc83 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:24.278569 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f0b02987-88e3-4b9b-9d8d-fc8741c7fc83 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1539 microversion: 2.1 time: 0.602810 May 28 04:47:24.287953 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1520/3183] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:23 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1539 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:24.293443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d08d155a-ece8-45cc-9316-5eee7a4f8170 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701a39160>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:24.300127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3450dc49-4447-4b9d-94a3-f8367ba512c9 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11042f256135447b907df76bcce1e3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a310496bcde7409a8338f64e444f6dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:24.306796 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3450dc49-4447-4b9d-94a3-f8367ba512c9 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 200 len: 1324 microversion: 2.1 time: 0.628229 May 28 04:47:24.323233 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1664/3184] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:23 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 1324 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:24.338447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dd979aa8-9b5d-4851-82e0-22614dcae93f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:24.339102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dd979aa8-9b5d-4851-82e0-22614dcae93f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:24.361602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd979aa8-9b5d-4851-82e0-22614dcae93f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:24.361602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd979aa8-9b5d-4851-82e0-22614dcae93f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:24.362320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd979aa8-9b5d-4851-82e0-22614dcae93f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:24.362406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd979aa8-9b5d-4851-82e0-22614dcae93f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:24.395721 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d08d155a-ece8-45cc-9316-5eee7a4f8170 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1411 microversion: 2.1 time: 0.101047 May 28 04:47:24.396002 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1521/3185] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:24 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1411 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:24.404601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0252e57a-acdc-462c-8360-cac103c4fc49 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:24.405228 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0252e57a-acdc-462c-8360-cac103c4fc49 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:24.421295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:24.421295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0252e57a-acdc-462c-8360-cac103c4fc49 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:24.421729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0252e57a-acdc-462c-8360-cac103c4fc49 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:24.424878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0252e57a-acdc-462c-8360-cac103c4fc49 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:24.425639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0252e57a-acdc-462c-8360-cac103c4fc49 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:24.809879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0252e57a-acdc-462c-8360-cac103c4fc49 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:24.820854 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0252e57a-acdc-462c-8360-cac103c4fc49 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88" status: 200 len: 1267 microversion: 2.1 time: 0.423813 May 28 04:47:24.831291 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1522/3186] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:24 2022] GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88 => generated 1267 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:25.138273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dd979aa8-9b5d-4851-82e0-22614dcae93f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:25.153354 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dd979aa8-9b5d-4851-82e0-22614dcae93f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69" status: 200 len: 1554 microversion: 2.1 time: 0.818785 May 28 04:47:25.164773 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1665/3187] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:24 2022] GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 => generated 1554 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:25.173372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ab3573db-e582-43a7-9aa9-86135da4f9d8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:25.174286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ab3573db-e582-43a7-9aa9-86135da4f9d8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:25.191573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ab3573db-e582-43a7-9aa9-86135da4f9d8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:25.199499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ab3573db-e582-43a7-9aa9-86135da4f9d8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:25.199499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ab3573db-e582-43a7-9aa9-86135da4f9d8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:25.199499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ab3573db-e582-43a7-9aa9-86135da4f9d8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:25.295271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3b9816a8-bdb6-4922-820e-fd9e9610369d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:25.295900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3b9816a8-bdb6-4922-820e-fd9e9610369d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:25.307519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b9816a8-bdb6-4922-820e-fd9e9610369d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:25.307983 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b9816a8-bdb6-4922-820e-fd9e9610369d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:25.309384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b9816a8-bdb6-4922-820e-fd9e9610369d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:25.309836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b9816a8-bdb6-4922-820e-fd9e9610369d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:25.372288 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ab3573db-e582-43a7-9aa9-86135da4f9d8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.202942 May 28 04:47:25.373264 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1523/3188] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 04:47:25 2022] GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69/os-interface => generated 284 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:25.378219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c8e32d8e-ea0f-418e-9466-a065747ce844 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:25.378933 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c8e32d8e-ea0f-418e-9466-a065747ce844 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:25.392621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c8e32d8e-ea0f-418e-9466-a065747ce844 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:25.400229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c8e32d8e-ea0f-418e-9466-a065747ce844 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:25.400229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c8e32d8e-ea0f-418e-9466-a065747ce844 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:25.400229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c8e32d8e-ea0f-418e-9466-a065747ce844 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:25.946008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3b9816a8-bdb6-4922-820e-fd9e9610369d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:25.961012 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3b9816a8-bdb6-4922-820e-fd9e9610369d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1521 microversion: 2.1 time: 0.669808 May 28 04:47:25.963945 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1666/3189] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:25 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1521 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:25.981167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2fca5f26-f1c9-4838-8d8d-6fd7ebe9ffe8 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f77015ba4c0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:26.026672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c8e32d8e-ea0f-418e-9466-a065747ce844 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11042f256135447b907df76bcce1e3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a310496bcde7409a8338f64e444f6dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:26.042575 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c8e32d8e-ea0f-418e-9466-a065747ce844 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 200 len: 1324 microversion: 2.1 time: 0.667740 May 28 04:47:26.044361 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1524/3190] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:25 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 1324 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:26.051963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3e9de9c9-0821-4adc-89c7-402f002b8f64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:26.072398 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2fca5f26-f1c9-4838-8d8d-6fd7ebe9ffe8 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1411 microversion: 2.1 time: 0.102905 May 28 04:47:26.073285 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1667/3191] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:25 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1411 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:26.075643 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3e9de9c9-0821-4adc-89c7-402f002b8f64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:26.080913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b0906aa5-3fea-40bb-ad69-45547c55f6af tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:26.081644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b0906aa5-3fea-40bb-ad69-45547c55f6af tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:26.086317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e9de9c9-0821-4adc-89c7-402f002b8f64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:26.086776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e9de9c9-0821-4adc-89c7-402f002b8f64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:26.087591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e9de9c9-0821-4adc-89c7-402f002b8f64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:26.091156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0906aa5-3fea-40bb-ad69-45547c55f6af tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:26.092330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0906aa5-3fea-40bb-ad69-45547c55f6af tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:26.093325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0906aa5-3fea-40bb-ad69-45547c55f6af tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:26.094356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0906aa5-3fea-40bb-ad69-45547c55f6af tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:26.101247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e9de9c9-0821-4adc-89c7-402f002b8f64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:26.151292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b0906aa5-3fea-40bb-ad69-45547c55f6af tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:47:26.461296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:26.576611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3e9de9c9-0821-4adc-89c7-402f002b8f64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:26.584106 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b0906aa5-3fea-40bb-ad69-45547c55f6af tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 204 len: 0 microversion: 2.1 time: 0.507051 May 28 04:47:26.584718 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1668/3192] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:47:26 2022] DELETE /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:47:26.594406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e487e6d7-cc26-4010-8d52-076c09df01c8 tempest-VolumesAdminNegativeTest-2046188861 tempest-VolumesAdminNegativeTest-2046188861-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "b1f0cecc-82e4-4e7a-9bbf-226c956ab832"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:26.601461 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3e9de9c9-0821-4adc-89c7-402f002b8f64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88" status: 200 len: 1273 microversion: 2.1 time: 0.555541 May 28 04:47:26.603132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e487e6d7-cc26-4010-8d52-076c09df01c8 tempest-VolumesAdminNegativeTest-2046188861 tempest-VolumesAdminNegativeTest-2046188861-project-admin] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:26.608159 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1525/3193] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:26 2022] GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88 => generated 1273 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:26.620479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e487e6d7-cc26-4010-8d52-076c09df01c8 tempest-VolumesAdminNegativeTest-2046188861 tempest-VolumesAdminNegativeTest-2046188861-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:26.621612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e487e6d7-cc26-4010-8d52-076c09df01c8 tempest-VolumesAdminNegativeTest-2046188861 tempest-VolumesAdminNegativeTest-2046188861-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:26.622407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e487e6d7-cc26-4010-8d52-076c09df01c8 tempest-VolumesAdminNegativeTest-2046188861 tempest-VolumesAdminNegativeTest-2046188861-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:26.622852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e487e6d7-cc26-4010-8d52-076c09df01c8 tempest-VolumesAdminNegativeTest-2046188861 tempest-VolumesAdminNegativeTest-2046188861-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:26.629243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-3253c4d4-17ee-4d84-9156-101eb2cecb18 req-b5e0bc22-89d7-4f7f-b2c4-f3a3d451ccc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7423a142-b3c2-4e4e-93db-3fa6da736961", "name": "network-vif-plugged", "status": "completed", "tag": "58d91d6f-cd9b-42a7-a75e-af85f19157c6"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:26.659351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3253c4d4-17ee-4d84-9156-101eb2cecb18 req-b5e0bc22-89d7-4f7f-b2c4-f3a3d451ccc4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:26.659806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3253c4d4-17ee-4d84-9156-101eb2cecb18 req-b5e0bc22-89d7-4f7f-b2c4-f3a3d451ccc4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:26.709193 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-3253c4d4-17ee-4d84-9156-101eb2cecb18 req-b5e0bc22-89d7-4f7f-b2c4-f3a3d451ccc4 service nova] Creating event network-vif-plugged:58d91d6f-cd9b-42a7-a75e-af85f19157c6 for instance 7423a142-b3c2-4e4e-93db-3fa6da736961 on n-h1-843700-1 May 28 04:47:26.742853 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-3253c4d4-17ee-4d84-9156-101eb2cecb18 req-b5e0bc22-89d7-4f7f-b2c4-f3a3d451ccc4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132588 May 28 04:47:26.745960 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1526/3194] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:26.757522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-37d424ed-000e-4c47-a2d6-e524744080a2 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:26.759287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-37d424ed-000e-4c47-a2d6-e524744080a2 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:26.778927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-37d424ed-000e-4c47-a2d6-e524744080a2 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:26.779804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-37d424ed-000e-4c47-a2d6-e524744080a2 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:26.782404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-37d424ed-000e-4c47-a2d6-e524744080a2 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:26.785719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-37d424ed-000e-4c47-a2d6-e524744080a2 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:26.801472 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-e487e6d7-cc26-4010-8d52-076c09df01c8 tempest-VolumesAdminNegativeTest-2046188861 tempest-VolumesAdminNegativeTest-2046188861-project-admin] HTTP exception thrown: Volume 630c9b2c-07aa-4aec-bea5-14dd934feb8b could not be found. May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e487e6d7-cc26-4010-8d52-076c09df01c8 tempest-VolumesAdminNegativeTest-2046188861 tempest-VolumesAdminNegativeTest-2046188861-project-admin] Request method failure captured: May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: request: PUT /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments/630c9b2c-07aa-4aec-bea5-14dd934feb8b HTTP/1.1 May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 74 May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikakEio4ZjK20eYsedz9jVoDc6hvYu2Bdi87qBMhwp2eRMQDnM8qrFEG_xSOP9erTLG0pYvLXNRQiFIScY2MZz2oaKQvNx4LNH4nzql76LGafcquvVxQoJV2iH_VkmB0FV_P7-G3tvOFbP3_mqLtdvzwkDPf27IqIiO17MDGkc7H7mmI May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: cdc2ff6141d144a69bce99736cfb5bfc May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-VolumesAdminNegativeTest-2046188861 May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cdc2ff6141d144a69bce99736cfb5bfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cdc2ff6141d144a69bce99736cfb5bfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cdc2ff6141d144a69bce99736cfb5bfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cdc2ff6141d144a69bce99736cfb5bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-VolumesAdminNegativeTest-2046188861 May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: cdc2ff6141d144a69bce99736cfb5bfc May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2046188861 May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-VolumesAdminNegativeTest-2046188861-project-admin May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 44437969f06f422e9ac8d1c6fab2962e May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-VolumesAdminNegativeTest-2046188861-project-admin May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: {"volumeAttachment": {"volumeId": "b1f0cecc-82e4-4e7a-9bbf-226c956ab832"}} May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: exception: Volume 630c9b2c-07aa-4aec-bea5-14dd934feb8b could not be found. May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'server_id': '158d6dcc-16f5-4b5d-8260-3178a329effe', 'id': '630c9b2c-07aa-4aec-bea5-14dd934feb8b', 'body': {'volumeAttachment': {'volumeId': 'b1f0cecc-82e4-4e7a-9bbf-226c956ab832'}}} May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 630c9b2c-07aa-4aec-bea5-14dd934feb8b could not be found. (HTTP 404) (Request-ID: req-6dc197b8-e5dc-4a4d-a90b-dd978e6e1445) May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 04:47:26.803761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 630c9b2c-07aa-4aec-bea5-14dd934feb8b could not be found. May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 630c9b2c-07aa-4aec-bea5-14dd934feb8b could not be found. May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 630c9b2c-07aa-4aec-bea5-14dd934feb8b could not be found. May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e487e6d7-cc26-4010-8d52-076c09df01c8 tempest-VolumesAdminNegativeTest-2046188861 tempest-VolumesAdminNegativeTest-2046188861-project-admin] Returning 404 to user: Volume 630c9b2c-07aa-4aec-bea5-14dd934feb8b could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e487e6d7-cc26-4010-8d52-076c09df01c8 tempest-VolumesAdminNegativeTest-2046188861 tempest-VolumesAdminNegativeTest-2046188861-project-admin] 10.222.0.58 "PUT /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments/630c9b2c-07aa-4aec-bea5-14dd934feb8b" status: 404 len: 109 microversion: 2.1 time: 0.215766 May 28 04:47:26.807391 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1669/3195] 10.222.0.58 () {60 vars in 1432 bytes} [Sat May 28 04:47:26 2022] PUT /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe/os-volume_attachments/630c9b2c-07aa-4aec-bea5-14dd934feb8b => generated 109 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:47:27.060344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0c7ae0cc-27ea-4898-942b-5f34ed40ed18 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:27.061087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0c7ae0cc-27ea-4898-942b-5f34ed40ed18 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:27.076891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c7ae0cc-27ea-4898-942b-5f34ed40ed18 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:27.082296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c7ae0cc-27ea-4898-942b-5f34ed40ed18 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:27.083437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c7ae0cc-27ea-4898-942b-5f34ed40ed18 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:27.084046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c7ae0cc-27ea-4898-942b-5f34ed40ed18 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:27.361847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-37d424ed-000e-4c47-a2d6-e524744080a2 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:27.374270 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-37d424ed-000e-4c47-a2d6-e524744080a2 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1527 microversion: 2.1 time: 0.626888 May 28 04:47:27.375260 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1527/3196] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:26 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1527 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:27.388071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0c7ae0cc-27ea-4898-942b-5f34ed40ed18 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11042f256135447b907df76bcce1e3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a310496bcde7409a8338f64e444f6dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:27.392025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6118db8f-f4da-4734-b233-b0027c077b02 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f77021a0820>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:27.397780 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0c7ae0cc-27ea-4898-942b-5f34ed40ed18 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 200 len: 1324 microversion: 2.1 time: 0.341328 May 28 04:47:27.400738 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1670/3197] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:27 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 1324 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:27.447383 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6118db8f-f4da-4734-b233-b0027c077b02 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1411 microversion: 2.1 time: 0.069759 May 28 04:47:27.447989 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1528/3198] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:27 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1411 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:27.631074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-99232171-7c77-4317-b9bc-f43e37bb7b4c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:27.633854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-99232171-7c77-4317-b9bc-f43e37bb7b4c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:27.657869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-99232171-7c77-4317-b9bc-f43e37bb7b4c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:27.661384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-99232171-7c77-4317-b9bc-f43e37bb7b4c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:27.662864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-99232171-7c77-4317-b9bc-f43e37bb7b4c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:27.663855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-99232171-7c77-4317-b9bc-f43e37bb7b4c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:28.244599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-abaa999c-e16b-4f5a-9c30-922a3b2249fa req-040db808-ca61-4b77-9144-19687c69a221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06f67b96-191c-4c64-96bf-e1e61c33ee69", "tag": "f4cd01a7-d341-4b8b-8d12-fb2902de6c05"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:28.278743 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-abaa999c-e16b-4f5a-9c30-922a3b2249fa req-040db808-ca61-4b77-9144-19687c69a221 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:28.279243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-abaa999c-e16b-4f5a-9c30-922a3b2249fa req-040db808-ca61-4b77-9144-19687c69a221 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:28.331056 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-abaa999c-e16b-4f5a-9c30-922a3b2249fa req-040db808-ca61-4b77-9144-19687c69a221 service nova] Creating event network-changed:f4cd01a7-d341-4b8b-8d12-fb2902de6c05 for instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 on n-h2-843700-1 May 28 04:47:28.351920 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-abaa999c-e16b-4f5a-9c30-922a3b2249fa req-040db808-ca61-4b77-9144-19687c69a221 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106719 May 28 04:47:28.353266 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1529/3199] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:47:28.398931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7d379fa5-13b7-492b-8e0f-8716e7cfd9a1 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:28.402603 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7d379fa5-13b7-492b-8e0f-8716e7cfd9a1 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:28.413063 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d379fa5-13b7-492b-8e0f-8716e7cfd9a1 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:28.419379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d379fa5-13b7-492b-8e0f-8716e7cfd9a1 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:28.420705 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d379fa5-13b7-492b-8e0f-8716e7cfd9a1 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:28.421561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d379fa5-13b7-492b-8e0f-8716e7cfd9a1 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:29.318483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7d379fa5-13b7-492b-8e0f-8716e7cfd9a1 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:29.327620 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7d379fa5-13b7-492b-8e0f-8716e7cfd9a1 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1527 microversion: 2.1 time: 0.933433 May 28 04:47:29.341304 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1530/3200] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:28 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1527 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:29.359613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c20dd772-5760-47cc-baf4-17c5141242c7 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:29.360352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c20dd772-5760-47cc-baf4-17c5141242c7 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:29.367247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c20dd772-5760-47cc-baf4-17c5141242c7 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:29.367432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c20dd772-5760-47cc-baf4-17c5141242c7 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:29.368379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c20dd772-5760-47cc-baf4-17c5141242c7 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:29.374880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c20dd772-5760-47cc-baf4-17c5141242c7 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:29.377650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-99232171-7c77-4317-b9bc-f43e37bb7b4c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:29.393692 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-99232171-7c77-4317-b9bc-f43e37bb7b4c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88" status: 200 len: 1315 microversion: 2.1 time: 1.777962 May 28 04:47:29.410848 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1671/3201] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:27 2022] GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88 => generated 1315 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:29.421220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e98f6885-d4b9-4574-865a-c2ee6edf01a0 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700f59af0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:29.499106 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e98f6885-d4b9-4574-865a-c2ee6edf01a0 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1411 microversion: 2.1 time: 0.086574 May 28 04:47:29.499865 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1672/3202] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:29 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1411 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:29.512367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-5d6a166a-1c72-4594-97f0-30aa46aa19f7 req-363228ca-918c-4f4f-9d27-28250bce2807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6245d7aa-7d05-4ab8-aa60-976fd2f6e217", "name": "network-vif-plugged", "status": "completed", "tag": "df00d343-ce05-461d-9323-30f8bf5fa6e6"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:29.528921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5d6a166a-1c72-4594-97f0-30aa46aa19f7 req-363228ca-918c-4f4f-9d27-28250bce2807 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:29.530407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5d6a166a-1c72-4594-97f0-30aa46aa19f7 req-363228ca-918c-4f4f-9d27-28250bce2807 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:29.552291 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-5d6a166a-1c72-4594-97f0-30aa46aa19f7 req-363228ca-918c-4f4f-9d27-28250bce2807 service nova] Creating event network-vif-plugged:df00d343-ce05-461d-9323-30f8bf5fa6e6 for instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 on n-h1-843700-1 May 28 04:47:29.557539 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-5d6a166a-1c72-4594-97f0-30aa46aa19f7 req-363228ca-918c-4f4f-9d27-28250bce2807 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056732 May 28 04:47:29.558590 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1673/3203] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:29.986574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c20dd772-5760-47cc-baf4-17c5141242c7 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11042f256135447b907df76bcce1e3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a310496bcde7409a8338f64e444f6dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:30.014075 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c20dd772-5760-47cc-baf4-17c5141242c7 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 200 len: 1324 microversion: 2.1 time: 0.662364 May 28 04:47:30.027531 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1531/3204] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:29 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 1324 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:30.351634 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1cc0fc2b-ad26-41bc-a40d-cb220a3f49c7 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:30.352593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1cc0fc2b-ad26-41bc-a40d-cb220a3f49c7 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:30.361179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1cc0fc2b-ad26-41bc-a40d-cb220a3f49c7 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:30.361903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1cc0fc2b-ad26-41bc-a40d-cb220a3f49c7 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:30.362882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1cc0fc2b-ad26-41bc-a40d-cb220a3f49c7 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:30.363646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1cc0fc2b-ad26-41bc-a40d-cb220a3f49c7 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:30.417177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e354fbc7-82e0-410e-bf99-a125ec8cf16e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:30.418624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e354fbc7-82e0-410e-bf99-a125ec8cf16e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:30.432496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e354fbc7-82e0-410e-bf99-a125ec8cf16e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:30.432496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e354fbc7-82e0-410e-bf99-a125ec8cf16e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:30.437046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e354fbc7-82e0-410e-bf99-a125ec8cf16e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:30.437775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e354fbc7-82e0-410e-bf99-a125ec8cf16e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:30.948888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e354fbc7-82e0-410e-bf99-a125ec8cf16e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:30.956243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1cc0fc2b-ad26-41bc-a40d-cb220a3f49c7 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:30.960130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:30.963499 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e354fbc7-82e0-410e-bf99-a125ec8cf16e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88" status: 200 len: 1315 microversion: 2.1 time: 0.547939 May 28 04:47:30.964786 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1532/3205] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:30 2022] GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88 => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:30.974407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-5b82d127-f453-401a-a7ef-f29029a77cdf req-2dde4abf-2726-4efe-9797-892169bab8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41a1a34d-7c00-4e39-810d-7d17b6cc8a88", "tag": "2ba3b775-f9f0-4585-8139-4120860e4fbf"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:30.978496 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1cc0fc2b-ad26-41bc-a40d-cb220a3f49c7 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1527 microversion: 2.1 time: 0.626880 May 28 04:47:30.978496 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1674/3206] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:30 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1527 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:30.992999 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5b82d127-f453-401a-a7ef-f29029a77cdf req-2dde4abf-2726-4efe-9797-892169bab8a9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:30.994409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5b82d127-f453-401a-a7ef-f29029a77cdf req-2dde4abf-2726-4efe-9797-892169bab8a9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:31.009474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f6b218a6-400e-4d99-b61f-ab6154a0ab98 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f77015ba040>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:31.010415 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-5b82d127-f453-401a-a7ef-f29029a77cdf req-2dde4abf-2726-4efe-9797-892169bab8a9 service nova] Creating event network-changed:2ba3b775-f9f0-4585-8139-4120860e4fbf for instance 41a1a34d-7c00-4e39-810d-7d17b6cc8a88 on n-h2-843700-1 May 28 04:47:31.016087 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-5b82d127-f453-401a-a7ef-f29029a77cdf req-2dde4abf-2726-4efe-9797-892169bab8a9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049706 May 28 04:47:31.017294 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1533/3207] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:31.025440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-9d111bc2-4187-41eb-b259-580243456b46 req-67120b9e-aad0-4878-bb20-ad350ef2e768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6245d7aa-7d05-4ab8-aa60-976fd2f6e217", "name": "network-vif-deleted", "tag": "df00d343-ce05-461d-9323-30f8bf5fa6e6"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:31.036832 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9d111bc2-4187-41eb-b259-580243456b46 req-67120b9e-aad0-4878-bb20-ad350ef2e768 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:31.037524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9d111bc2-4187-41eb-b259-580243456b46 req-67120b9e-aad0-4878-bb20-ad350ef2e768 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:31.055186 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-9d111bc2-4187-41eb-b259-580243456b46 req-67120b9e-aad0-4878-bb20-ad350ef2e768 service nova] Creating event network-vif-deleted:df00d343-ce05-461d-9323-30f8bf5fa6e6 for instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 on n-h1-843700-1 May 28 04:47:31.063375 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-9d111bc2-4187-41eb-b259-580243456b46 req-67120b9e-aad0-4878-bb20-ad350ef2e768 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044408 May 28 04:47:31.067542 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1534/3208] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:31.073487 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f6b218a6-400e-4d99-b61f-ab6154a0ab98 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1420 microversion: 2.1 time: 0.091610 May 28 04:47:31.074748 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1675/3209] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:30 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:31.077472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7202f601-4978-4dad-a1e8-9ddc75b6ba36 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:31.078371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7202f601-4978-4dad-a1e8-9ddc75b6ba36 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:31.091049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7202f601-4978-4dad-a1e8-9ddc75b6ba36 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:31.091919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7202f601-4978-4dad-a1e8-9ddc75b6ba36 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:31.097511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3f56df61-8922-4d48-bdd4-a8fb6212bca0 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f77074230d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:31.116883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7202f601-4978-4dad-a1e8-9ddc75b6ba36 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:31.118154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7202f601-4978-4dad-a1e8-9ddc75b6ba36 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:31.170154 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3f56df61-8922-4d48-bdd4-a8fb6212bca0 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 200 len: 1420 microversion: 2.1 time: 0.087729 May 28 04:47:31.171323 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1676/3210] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:31 2022] GET /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:31.183221 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ed5b2c07-d583-495b-97f3-23951a720831 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f77074e0670>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:31.458829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7202f601-4978-4dad-a1e8-9ddc75b6ba36 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11042f256135447b907df76bcce1e3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a310496bcde7409a8338f64e444f6dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:31.468079 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7202f601-4978-4dad-a1e8-9ddc75b6ba36 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 200 len: 1521 microversion: 2.1 time: 0.397843 May 28 04:47:31.468696 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1535/3211] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:31 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:31.486463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-75ca8b48-6bbe-4a15-a5b7-3bbf3f3accaf tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:31.487455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-75ca8b48-6bbe-4a15-a5b7-3bbf3f3accaf tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:31.507046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75ca8b48-6bbe-4a15-a5b7-3bbf3f3accaf tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:31.512872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75ca8b48-6bbe-4a15-a5b7-3bbf3f3accaf tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:31.512872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75ca8b48-6bbe-4a15-a5b7-3bbf3f3accaf tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:31.512872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75ca8b48-6bbe-4a15-a5b7-3bbf3f3accaf tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:31.560072 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-75ca8b48-6bbe-4a15-a5b7-3bbf3f3accaf tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] HTTP exception thrown: Action 999 not found May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-75ca8b48-6bbe-4a15-a5b7-3bbf3f3accaf tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Request method failure captured: May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961/os-instance-actions/999 HTTP/1.1 May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikalH7F5noLiXj19EO_5I4Wa20hVXPemUGSQEVZqvgkO58V4ExsfPIjdnNk3Je96e3-T9jix9gSmcu0p6ELBCua8XxdFrAG-oOGvJAPfVmNUo-MKF35pkjb0a6gg6je9DgniutpRZNwSJM9PO1JEn3wq-cQV26Xi4C29iDup9Mcpz28c May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: a310496bcde7409a8338f64e444f6dea May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-115131062 May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a310496bcde7409a8338f64e444f6dea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a310496bcde7409a8338f64e444f6dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a310496bcde7409a8338f64e444f6dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a310496bcde7409a8338f64e444f6dea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-115131062 May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: a310496bcde7409a8338f64e444f6dea May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-115131062 May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-InstanceActionsNegativeTestJSON-115131062-project May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 11042f256135447b907df76bcce1e3aa May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-115131062-project May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: exception: Action 999 not found May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'server_id': '7423a142-b3c2-4e4e-93db-3fa6da736961', 'id': '999'} May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found May 28 04:47:31.571963 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:47:31.578602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-75ca8b48-6bbe-4a15-a5b7-3bbf3f3accaf tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Returning 404 to user: Action 999 not found {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:47:31.579863 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-75ca8b48-6bbe-4a15-a5b7-3bbf3f3accaf tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.097700 May 28 04:47:31.583043 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1536/3212] 10.222.0.58 () {58 vars in 1307 bytes} [Sat May 28 04:47:31 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961/os-instance-actions/999 => generated 66 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:47:31.594272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c64f1695-15a7-424b-bb15-1cf0d447bb46 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '.version_select at 0x7f7701e0f160>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:31.595201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c64f1695-15a7-424b-bb15-1cf0d447bb46 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 69e7d432-9820-44de-ac68-5b4d6ece1865] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:31.604756 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-c64f1695-15a7-424b-bb15-1cf0d447bb46 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] HTTP exception thrown: Instance 69e7d432-9820-44de-ac68-5b4d6ece1865 could not be found. May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c64f1695-15a7-424b-bb15-1cf0d447bb46 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Request method failure captured: May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/69e7d432-9820-44de-ac68-5b4d6ece1865/os-instance-actions HTTP/1.1 May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikalH7F5noLiXj19EO_5I4Wa20hVXPemUGSQEVZqvgkO58V4ExsfPIjdnNk3Je96e3-T9jix9gSmcu0p6ELBCua8XxdFrAG-oOGvJAPfVmNUo-MKF35pkjb0a6gg6je9DgniutpRZNwSJM9PO1JEn3wq-cQV26Xi4C29iDup9Mcpz28c May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: a310496bcde7409a8338f64e444f6dea May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-115131062 May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a310496bcde7409a8338f64e444f6dea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a310496bcde7409a8338f64e444f6dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a310496bcde7409a8338f64e444f6dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a310496bcde7409a8338f64e444f6dea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-115131062 May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: a310496bcde7409a8338f64e444f6dea May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-115131062 May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-InstanceActionsNegativeTestJSON-115131062-project May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 11042f256135447b907df76bcce1e3aa May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-115131062-project May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 69e7d432-9820-44de-ac68-5b4d6ece1865 could not be found. May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'server_id': '69e7d432-9820-44de-ac68-5b4d6ece1865'} May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e7d432-9820-44de-ac68-5b4d6ece1865 could not be found. May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:47:31.607151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:47:31.617081 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e7d432-9820-44de-ac68-5b4d6ece1865 could not be found. May 28 04:47:31.617081 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:47:31.617081 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:31.617081 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:47:31.617081 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:31.617081 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:31.617081 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:31.617081 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:47:31.617081 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:47:31.617081 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e7d432-9820-44de-ac68-5b4d6ece1865 could not be found. May 28 04:47:31.617081 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:47:31.617081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c64f1695-15a7-424b-bb15-1cf0d447bb46 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Returning 404 to user: Instance 69e7d432-9820-44de-ac68-5b4d6ece1865 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:47:31.619045 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c64f1695-15a7-424b-bb15-1cf0d447bb46 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/69e7d432-9820-44de-ac68-5b4d6ece1865/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.030336 May 28 04:47:31.620244 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1537/3213] 10.222.0.58 () {58 vars in 1295 bytes} [Sat May 28 04:47:31 2022] GET /compute/v2.1/servers/69e7d432-9820-44de-ac68-5b4d6ece1865/os-instance-actions => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:47:31.630549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0bbc27fb-bf0a-4767-b8cb-a42f5b7e7038 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:31.631348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0bbc27fb-bf0a-4767-b8cb-a42f5b7e7038 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:31.644730 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0bbc27fb-bf0a-4767-b8cb-a42f5b7e7038 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:31.645571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0bbc27fb-bf0a-4767-b8cb-a42f5b7e7038 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:31.647070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0bbc27fb-bf0a-4767-b8cb-a42f5b7e7038 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:31.648065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0bbc27fb-bf0a-4767-b8cb-a42f5b7e7038 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:31.679935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0bbc27fb-bf0a-4767-b8cb-a42f5b7e7038 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:47:31.724616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:32.069916 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0bbc27fb-bf0a-4767-b8cb-a42f5b7e7038 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 204 len: 0 microversion: 2.1 time: 0.444130 May 28 04:47:32.070731 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1538/3214] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:47:31 2022] DELETE /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:47:32.077444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a385c4aa-f957-48f6-86f0-2ea32cc5dd22 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:32.078430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a385c4aa-f957-48f6-86f0-2ea32cc5dd22 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:32.085018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a385c4aa-f957-48f6-86f0-2ea32cc5dd22 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:32.085593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a385c4aa-f957-48f6-86f0-2ea32cc5dd22 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:32.086612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a385c4aa-f957-48f6-86f0-2ea32cc5dd22 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:32.087192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a385c4aa-f957-48f6-86f0-2ea32cc5dd22 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:32.176066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=8 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:32.264109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a385c4aa-f957-48f6-86f0-2ea32cc5dd22 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:32.268635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:32.274829 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a385c4aa-f957-48f6-86f0-2ea32cc5dd22 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88" status: 200 len: 1315 microversion: 2.1 time: 0.202502 May 28 04:47:32.276090 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1539/3215] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:32 2022] GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:32.283790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b45bd34c-c53b-4b31-beaa-f2d1874461ac tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:32.285407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b45bd34c-c53b-4b31-beaa-f2d1874461ac tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:32.299473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b45bd34c-c53b-4b31-beaa-f2d1874461ac tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:32.300474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b45bd34c-c53b-4b31-beaa-f2d1874461ac tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:32.302016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b45bd34c-c53b-4b31-beaa-f2d1874461ac tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:32.302967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b45bd34c-c53b-4b31-beaa-f2d1874461ac tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:32.354008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b45bd34c-c53b-4b31-beaa-f2d1874461ac tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:32.354935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b45bd34c-c53b-4b31-beaa-f2d1874461ac tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:32.355668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-b45bd34c-c53b-4b31-beaa-f2d1874461ac tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lazy-loading 'fault' on Instance uuid 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:47:32.401037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b45bd34c-c53b-4b31-beaa-f2d1874461ac tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:32.409398 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b45bd34c-c53b-4b31-beaa-f2d1874461ac tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 200 len: 1314 microversion: 2.1 time: 0.131688 May 28 04:47:32.410268 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1540/3216] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:32 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 1314 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:32.416285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f3f285c1-b478-4624-870a-3faafb279edb tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:32.417112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f3f285c1-b478-4624-870a-3faafb279edb tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:32.425646 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3f285c1-b478-4624-870a-3faafb279edb tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:32.426387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3f285c1-b478-4624-870a-3faafb279edb tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:32.429843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3f285c1-b478-4624-870a-3faafb279edb tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:32.429843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3f285c1-b478-4624-870a-3faafb279edb tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:32.569022 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ed5b2c07-d583-495b-97f3-23951a720831 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "DELETE /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 204 len: 0 microversion: 2.1 time: 1.390290 May 28 04:47:32.569997 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1677/3217] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:31 2022] DELETE /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 0 bytes in 1392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 04:47:32.578781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9d3dec61-df1c-4927-84a9-32cc31b49e9a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:32.579590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9d3dec61-df1c-4927-84a9-32cc31b49e9a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:32.586702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d3dec61-df1c-4927-84a9-32cc31b49e9a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:32.587360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d3dec61-df1c-4927-84a9-32cc31b49e9a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:32.588490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d3dec61-df1c-4927-84a9-32cc31b49e9a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:32.589131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d3dec61-df1c-4927-84a9-32cc31b49e9a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:32.601740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f3f285c1-b478-4624-870a-3faafb279edb tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11042f256135447b907df76bcce1e3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a310496bcde7409a8338f64e444f6dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:32.610836 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f3f285c1-b478-4624-870a-3faafb279edb tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 200 len: 1527 microversion: 2.1 time: 0.198708 May 28 04:47:32.612194 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1541/3218] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:32 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 1527 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:32.631454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9d3dec61-df1c-4927-84a9-32cc31b49e9a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:47:32.976471 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9d3dec61-df1c-4927-84a9-32cc31b49e9a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 204 len: 0 microversion: 2.1 time: 0.401316 May 28 04:47:32.977088 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1678/3219] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:47:32 2022] DELETE /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:47:33.086889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5f3e4d27-6ffc-45dc-af02-dca987587142 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2013434410", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "aaf67aae-c4ff-4ac3-8e4e-a4156646067f"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:33.173211 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-5f3e4d27-6ffc-45dc-af02-dca987587142 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] validate_networks() for [('aaf67aae-c4ff-4ac3-8e4e-a4156646067f', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:47:33.293621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-31038f0d-1670-484e-8fc0-8cf799fdfda2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:33.294710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-31038f0d-1670-484e-8fc0-8cf799fdfda2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:33.303333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31038f0d-1670-484e-8fc0-8cf799fdfda2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:33.304020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31038f0d-1670-484e-8fc0-8cf799fdfda2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:33.305050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31038f0d-1670-484e-8fc0-8cf799fdfda2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:33.305718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31038f0d-1670-484e-8fc0-8cf799fdfda2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:33.365162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:34.091031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-31038f0d-1670-484e-8fc0-8cf799fdfda2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:34.100210 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-31038f0d-1670-484e-8fc0-8cf799fdfda2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88" status: 200 len: 1315 microversion: 2.1 time: 0.811474 May 28 04:47:34.100801 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1679/3220] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:33 2022] GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88 => generated 1315 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:34.117804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-40630fba-cecb-4a93-b8ba-749199ab0fdc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:34.118452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-40630fba-cecb-4a93-b8ba-749199ab0fdc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:34.129286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40630fba-cecb-4a93-b8ba-749199ab0fdc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:34.131449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40630fba-cecb-4a93-b8ba-749199ab0fdc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:34.132441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40630fba-cecb-4a93-b8ba-749199ab0fdc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:34.138917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40630fba-cecb-4a93-b8ba-749199ab0fdc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:34.177397 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-40630fba-cecb-4a93-b8ba-749199ab0fdc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] HTTP exception thrown: Instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 could not be found. May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-40630fba-cecb-4a93-b8ba-749199ab0fdc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Request method failure captured: May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 HTTP/1.1 May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikak47QAs5K06QhfhkIquusTq5B930GK2qX0_12di_Rh32YDa0oiawwGAqeo88DT65woz1MmOY2wmnqGoSlDi_TB5nkwOW_jtkf8bwl1MIAPkkOt7hgVlVdmgC8btNyj4GvAvNekqk5WajXo3d43lpqxKK68oDpAyv5Nz9V4rMhAcq7c May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 6b37465157dd44a09cffbbe57322d264 May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 could not be found. May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '6245d7aa-7d05-4ab8-aa60-976fd2f6e217'} May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 could not be found. May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 could not be found. May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:34.180409 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:34.185441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:34.185441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:34.185441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:34.185441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:34.185441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:47:34.185441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:47:34.185441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 could not be found. May 28 04:47:34.185441 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:34.202352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-40630fba-cecb-4a93-b8ba-749199ab0fdc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Returning 404 to user: Instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:47:34.205347 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-40630fba-cecb-4a93-b8ba-749199ab0fdc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 404 len: 111 microversion: 2.1 time: 0.098496 May 28 04:47:34.207402 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1680/3221] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:34 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:47:34.217422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-0efe9db5-e182-4d28-bd71-cbcd4e5ae6d1 req-c8b12754-d8bc-4035-8c3d-72d1b01faa96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb4e9bd-e4d7-4119-963a-188a003df323", "name": "network-vif-unplugged", "status": "completed", "tag": "e69aae4c-26bb-442b-9499-b01e81118939"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:34.240352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-0efe9db5-e182-4d28-bd71-cbcd4e5ae6d1 req-c8b12754-d8bc-4035-8c3d-72d1b01faa96 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:34.243787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-0efe9db5-e182-4d28-bd71-cbcd4e5ae6d1 req-c8b12754-d8bc-4035-8c3d-72d1b01faa96 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:34.258115 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-0efe9db5-e182-4d28-bd71-cbcd4e5ae6d1 req-c8b12754-d8bc-4035-8c3d-72d1b01faa96 service nova] Creating event network-vif-unplugged:e69aae4c-26bb-442b-9499-b01e81118939 for instance 3bb4e9bd-e4d7-4119-963a-188a003df323 on n-h2-843700-1 May 28 04:47:34.268717 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-0efe9db5-e182-4d28-bd71-cbcd4e5ae6d1 req-c8b12754-d8bc-4035-8c3d-72d1b01faa96 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059744 May 28 04:47:34.270035 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1681/3222] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:34.278021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a0db79ae-22b9-4868-8810-6d49c6534f54 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:34.279003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a0db79ae-22b9-4868-8810-6d49c6534f54 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:34.286168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0db79ae-22b9-4868-8810-6d49c6534f54 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:34.286930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0db79ae-22b9-4868-8810-6d49c6534f54 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:34.287906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0db79ae-22b9-4868-8810-6d49c6534f54 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:34.289108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0db79ae-22b9-4868-8810-6d49c6534f54 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:34.316808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-5f3e4d27-6ffc-45dc-af02-dca987587142 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:47:34.317339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-5f3e4d27-6ffc-45dc-af02-dca987587142 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:47:34.317943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-5f3e4d27-6ffc-45dc-af02-dca987587142 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:47:34.318465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-5f3e4d27-6ffc-45dc-af02-dca987587142 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:47:34.319033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-5f3e4d27-6ffc-45dc-af02-dca987587142 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:47:34.346733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5f3e4d27-6ffc-45dc-af02-dca987587142 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:34.347360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5f3e4d27-6ffc-45dc-af02-dca987587142 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:34.348281 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5f3e4d27-6ffc-45dc-af02-dca987587142 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:34.348847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5f3e4d27-6ffc-45dc-af02-dca987587142 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:34.390951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-5f3e4d27-6ffc-45dc-af02-dca987587142 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Getting quotas for project da841757a2094bad83e04816bb355969. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:47:34.397445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-5f3e4d27-6ffc-45dc-af02-dca987587142 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Getting quotas for user c07b3b1388d24bae9e8834c8b9a4f3a9 and project da841757a2094bad83e04816bb355969. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:47:34.413605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5f3e4d27-6ffc-45dc-af02-dca987587142 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:47:34.417886 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5f3e4d27-6ffc-45dc-af02-dca987587142 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:47:34.615081 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5f3e4d27-6ffc-45dc-af02-dca987587142 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.532372 May 28 04:47:34.620137 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1542/3223] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:47:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:47:34.634711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-61b5dda4-fccd-4b7a-b5c2-795546171849 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Action: 'create', calling method: .version_select at 0x7f7701de9d30>, body: {"keypair": {"name": "tempest-keypair-2090990271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIV6eKPqSiN/TuKpIwtK5jzGMl2DnCzPlCdmsTLoqk3LSc3/0dhTB+PWZ7rYPN44zU7LpJuPt2Ydg7nxImd0muEUUZwII+fkcqL00Tqdg43Py+U/uzFcHt9iddb9L0DdUw=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:34.700237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-61b5dda4-fccd-4b7a-b5c2-795546171849 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Getting quotas for project fb9b98186db746ae83181dd7db6d56e7. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:47:34.717806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-61b5dda4-fccd-4b7a-b5c2-795546171849 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Getting quotas for user 6b37465157dd44a09cffbbe57322d264 and project fb9b98186db746ae83181dd7db6d56e7. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:47:34.876105 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-61b5dda4-fccd-4b7a-b5c2-795546171849 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.253585 May 28 04:47:34.877213 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1543/3224] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:47:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:34.885020 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3360b099-e369-4a65-b69f-f76ea4eeb2a6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:34.888155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3360b099-e369-4a65-b69f-f76ea4eeb2a6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:34.941461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a0db79ae-22b9-4868-8810-6d49c6534f54 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11042f256135447b907df76bcce1e3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a310496bcde7409a8338f64e444f6dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:34.956872 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a0db79ae-22b9-4868-8810-6d49c6534f54 tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 200 len: 1527 microversion: 2.1 time: 0.678617 May 28 04:47:34.960695 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1682/3225] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:34 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 1527 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:35.048809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3360b099-e369-4a65-b69f-f76ea4eeb2a6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:35.061937 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3360b099-e369-4a65-b69f-f76ea4eeb2a6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4" status: 200 len: 1208 microversion: 2.1 time: 0.180237 May 28 04:47:35.064231 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1544/3226] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:34 2022] GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4 => generated 1208 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:35.121473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-78dc35d4-4fe9-433e-a354-8cd404d1f2cf tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:35.122426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-78dc35d4-4fe9-433e-a354-8cd404d1f2cf tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:35.135364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78dc35d4-4fe9-433e-a354-8cd404d1f2cf tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:35.136417 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78dc35d4-4fe9-433e-a354-8cd404d1f2cf tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:35.137533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78dc35d4-4fe9-433e-a354-8cd404d1f2cf tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:35.138143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78dc35d4-4fe9-433e-a354-8cd404d1f2cf tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:35.450642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-3b11e76d-a248-4fc3-be2a-01b83e9c7c15 req-52249af7-ddf0-4e93-a338-f75ca5beb22f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7423a142-b3c2-4e4e-93db-3fa6da736961", "name": "network-vif-deleted", "tag": "58d91d6f-cd9b-42a7-a75e-af85f19157c6"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:35.468511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3b11e76d-a248-4fc3-be2a-01b83e9c7c15 req-52249af7-ddf0-4e93-a338-f75ca5beb22f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:35.470575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3b11e76d-a248-4fc3-be2a-01b83e9c7c15 req-52249af7-ddf0-4e93-a338-f75ca5beb22f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:35.499507 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-3b11e76d-a248-4fc3-be2a-01b83e9c7c15 req-52249af7-ddf0-4e93-a338-f75ca5beb22f service nova] Creating event network-vif-deleted:58d91d6f-cd9b-42a7-a75e-af85f19157c6 for instance 7423a142-b3c2-4e4e-93db-3fa6da736961 on n-h1-843700-1 May 28 04:47:35.513508 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-3b11e76d-a248-4fc3-be2a-01b83e9c7c15 req-52249af7-ddf0-4e93-a338-f75ca5beb22f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063807 May 28 04:47:35.517489 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1545/3227] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:35.623688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-78dc35d4-4fe9-433e-a354-8cd404d1f2cf tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:35.634833 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-78dc35d4-4fe9-433e-a354-8cd404d1f2cf tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88" status: 200 len: 1315 microversion: 2.1 time: 0.521286 May 28 04:47:35.652173 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1683/3228] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:35 2022] GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88 => generated 1315 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:35.864541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-e26da209-4812-49f3-bd94-8ef93210ca8c req-7060b78d-716f-470c-b229-85ac0592c582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb4e9bd-e4d7-4119-963a-188a003df323", "name": "network-vif-deleted", "tag": "e69aae4c-26bb-442b-9499-b01e81118939"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:35.890237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-e26da209-4812-49f3-bd94-8ef93210ca8c req-7060b78d-716f-470c-b229-85ac0592c582 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:35.890490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-e26da209-4812-49f3-bd94-8ef93210ca8c req-7060b78d-716f-470c-b229-85ac0592c582 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:35.953735 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-e26da209-4812-49f3-bd94-8ef93210ca8c req-7060b78d-716f-470c-b229-85ac0592c582 service nova] Creating event network-vif-deleted:e69aae4c-26bb-442b-9499-b01e81118939 for instance 3bb4e9bd-e4d7-4119-963a-188a003df323 on n-h2-843700-1 May 28 04:47:35.972572 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-e26da209-4812-49f3-bd94-8ef93210ca8c req-7060b78d-716f-470c-b229-85ac0592c582 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114778 May 28 04:47:35.973198 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1546/3229] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:35.974250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-67ecea63-185a-466a-a8f8-97f81c8d208b tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:35.974823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-67ecea63-185a-466a-a8f8-97f81c8d208b tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:35.984944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67ecea63-185a-466a-a8f8-97f81c8d208b tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:35.995248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67ecea63-185a-466a-a8f8-97f81c8d208b tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:35.996241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67ecea63-185a-466a-a8f8-97f81c8d208b tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:35.996701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67ecea63-185a-466a-a8f8-97f81c8d208b tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:36.058250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67ecea63-185a-466a-a8f8-97f81c8d208b tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:36.060972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67ecea63-185a-466a-a8f8-97f81c8d208b tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:36.061535 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-67ecea63-185a-466a-a8f8-97f81c8d208b tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lazy-loading 'fault' on Instance uuid 7423a142-b3c2-4e4e-93db-3fa6da736961 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:47:36.086810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-79592d60-7137-4226-a7aa-24d578d0da8e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:36.089676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-79592d60-7137-4226-a7aa-24d578d0da8e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:36.109326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-79592d60-7137-4226-a7aa-24d578d0da8e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:36.110019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-79592d60-7137-4226-a7aa-24d578d0da8e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:36.113730 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-79592d60-7137-4226-a7aa-24d578d0da8e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:36.114256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-79592d60-7137-4226-a7aa-24d578d0da8e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:36.196281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-67ecea63-185a-466a-a8f8-97f81c8d208b tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11042f256135447b907df76bcce1e3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a310496bcde7409a8338f64e444f6dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:36.206073 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-67ecea63-185a-466a-a8f8-97f81c8d208b tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 200 len: 1314 microversion: 2.1 time: 0.236137 May 28 04:47:36.219473 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1684/3230] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:35 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:36.337676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-79592d60-7137-4226-a7aa-24d578d0da8e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:36.353073 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-79592d60-7137-4226-a7aa-24d578d0da8e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4" status: 200 len: 1212 microversion: 2.1 time: 0.276602 May 28 04:47:36.355318 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1547/3231] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:36 2022] GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4 => generated 1212 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:36.529688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e6cf4c93-27bd-40ee-8722-e985d5ea51d4 req-4f2917de-c139-453e-a07c-a7fc4025bebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a1a34d-7c00-4e39-810d-7d17b6cc8a88", "name": "network-vif-plugged", "status": "completed", "tag": "2ba3b775-f9f0-4585-8139-4120860e4fbf"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:36.547301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e6cf4c93-27bd-40ee-8722-e985d5ea51d4 req-4f2917de-c139-453e-a07c-a7fc4025bebc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:36.547755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e6cf4c93-27bd-40ee-8722-e985d5ea51d4 req-4f2917de-c139-453e-a07c-a7fc4025bebc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:36.575835 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e6cf4c93-27bd-40ee-8722-e985d5ea51d4 req-4f2917de-c139-453e-a07c-a7fc4025bebc service nova] Creating event network-vif-plugged:2ba3b775-f9f0-4585-8139-4120860e4fbf for instance 41a1a34d-7c00-4e39-810d-7d17b6cc8a88 on n-h2-843700-1 May 28 04:47:36.585982 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e6cf4c93-27bd-40ee-8722-e985d5ea51d4 req-4f2917de-c139-453e-a07c-a7fc4025bebc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059964 May 28 04:47:36.588986 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1685/3232] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:36.658430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-973858ee-3b04-46bc-ae50-2c92d1c2844d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:36.660128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-973858ee-3b04-46bc-ae50-2c92d1c2844d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:36.669995 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-973858ee-3b04-46bc-ae50-2c92d1c2844d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:36.676672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-973858ee-3b04-46bc-ae50-2c92d1c2844d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:36.677803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-973858ee-3b04-46bc-ae50-2c92d1c2844d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:36.679090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-973858ee-3b04-46bc-ae50-2c92d1c2844d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:36.938627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-973858ee-3b04-46bc-ae50-2c92d1c2844d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:36.949483 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-973858ee-3b04-46bc-ae50-2c92d1c2844d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88" status: 200 len: 1315 microversion: 2.1 time: 0.295034 May 28 04:47:36.959142 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1548/3233] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:36 2022] GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:37.228138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1a4fd78c-0c93-4c65-91ab-7a3e016ce06c tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:37.229704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1a4fd78c-0c93-4c65-91ab-7a3e016ce06c tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] [instance: 7423a142-b3c2-4e4e-93db-3fa6da736961] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:37.236869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a4fd78c-0c93-4c65-91ab-7a3e016ce06c tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:37.237678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a4fd78c-0c93-4c65-91ab-7a3e016ce06c tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:37.238637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a4fd78c-0c93-4c65-91ab-7a3e016ce06c tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:37.239270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a4fd78c-0c93-4c65-91ab-7a3e016ce06c tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:37.256434 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-1a4fd78c-0c93-4c65-91ab-7a3e016ce06c tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] HTTP exception thrown: Instance 7423a142-b3c2-4e4e-93db-3fa6da736961 could not be found. May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1a4fd78c-0c93-4c65-91ab-7a3e016ce06c tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Request method failure captured: May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 HTTP/1.1 May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikalH7F5noLiXj19EO_5I4Wa20hVXPemUGSQEVZqvgkO58V4ExsfPIjdnNk3Je96e3-T9jix9gSmcu0p6ELBCua8XxdFrAG-oOGvJAPfVmNUo-MKF35pkjb0a6gg6je9DgniutpRZNwSJM9PO1JEn3wq-cQV26Xi4C29iDup9Mcpz28c May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: a310496bcde7409a8338f64e444f6dea May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-115131062 May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a310496bcde7409a8338f64e444f6dea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a310496bcde7409a8338f64e444f6dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a310496bcde7409a8338f64e444f6dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a310496bcde7409a8338f64e444f6dea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-115131062 May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: a310496bcde7409a8338f64e444f6dea May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-115131062 May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-InstanceActionsNegativeTestJSON-115131062-project May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 11042f256135447b907df76bcce1e3aa May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-115131062-project May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 7423a142-b3c2-4e4e-93db-3fa6da736961 could not be found. May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '7423a142-b3c2-4e4e-93db-3fa6da736961'} May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7423a142-b3c2-4e4e-93db-3fa6da736961 could not be found. May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7423a142-b3c2-4e4e-93db-3fa6da736961 could not be found. May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:37.258333 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:37.263008 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:37.263008 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:37.263008 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:37.263008 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:37.263008 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:47:37.263008 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:47:37.263008 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7423a142-b3c2-4e4e-93db-3fa6da736961 could not be found. May 28 04:47:37.263008 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:37.264386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1a4fd78c-0c93-4c65-91ab-7a3e016ce06c tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] Returning 404 to user: Instance 7423a142-b3c2-4e4e-93db-3fa6da736961 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:47:37.265445 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1a4fd78c-0c93-4c65-91ab-7a3e016ce06c tempest-InstanceActionsNegativeTestJSON-115131062 tempest-InstanceActionsNegativeTestJSON-115131062-project] 10.222.0.58 "GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961" status: 404 len: 111 microversion: 2.1 time: 0.042348 May 28 04:47:37.269735 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1686/3234] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:37 2022] GET /compute/v2.1/servers/7423a142-b3c2-4e4e-93db-3fa6da736961 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:47:37.378977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8da5c936-ccb0-4ace-9dea-93e796c298b3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:37.381980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8da5c936-ccb0-4ace-9dea-93e796c298b3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:37.390006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8da5c936-ccb0-4ace-9dea-93e796c298b3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:37.390689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8da5c936-ccb0-4ace-9dea-93e796c298b3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:37.392124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8da5c936-ccb0-4ace-9dea-93e796c298b3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:37.392901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8da5c936-ccb0-4ace-9dea-93e796c298b3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:37.559137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8da5c936-ccb0-4ace-9dea-93e796c298b3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:37.569430 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8da5c936-ccb0-4ace-9dea-93e796c298b3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4" status: 200 len: 1260 microversion: 2.1 time: 0.196415 May 28 04:47:37.571300 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1549/3235] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:37 2022] GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4 => generated 1260 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:37.969100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5d287af3-6d6c-4d28-9067-4e7f591cac74 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:37.969711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5d287af3-6d6c-4d28-9067-4e7f591cac74 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:37.984590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d287af3-6d6c-4d28-9067-4e7f591cac74 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:37.985941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d287af3-6d6c-4d28-9067-4e7f591cac74 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:37.986149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d287af3-6d6c-4d28-9067-4e7f591cac74 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:37.986603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d287af3-6d6c-4d28-9067-4e7f591cac74 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:38.350013 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5d287af3-6d6c-4d28-9067-4e7f591cac74 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:38.359657 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5d287af3-6d6c-4d28-9067-4e7f591cac74 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88" status: 200 len: 1315 microversion: 2.1 time: 0.397363 May 28 04:47:38.370221 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1687/3236] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:37 2022] GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:38.593484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f18aeea8-532f-470a-82f9-b43f1e163f4f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:38.601978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f18aeea8-532f-470a-82f9-b43f1e163f4f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:38.615114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f18aeea8-532f-470a-82f9-b43f1e163f4f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:38.615571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f18aeea8-532f-470a-82f9-b43f1e163f4f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:38.616748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f18aeea8-532f-470a-82f9-b43f1e163f4f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:38.617189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f18aeea8-532f-470a-82f9-b43f1e163f4f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:38.704439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f18aeea8-532f-470a-82f9-b43f1e163f4f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:38.731699 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f18aeea8-532f-470a-82f9-b43f1e163f4f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4" status: 200 len: 1266 microversion: 2.1 time: 0.148215 May 28 04:47:38.734780 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1550/3237] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:38 2022] GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:39.379467 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dc654c29-c34c-4c89-8654-1d2792475c64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:39.380502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dc654c29-c34c-4c89-8654-1d2792475c64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:39.403389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc654c29-c34c-4c89-8654-1d2792475c64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:39.411765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc654c29-c34c-4c89-8654-1d2792475c64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:39.412630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc654c29-c34c-4c89-8654-1d2792475c64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:39.413086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc654c29-c34c-4c89-8654-1d2792475c64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:39.758025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dbe42cfe-9c40-4c53-9363-2d00c78e7a42 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:39.759694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dbe42cfe-9c40-4c53-9363-2d00c78e7a42 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:39.776041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dbe42cfe-9c40-4c53-9363-2d00c78e7a42 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:39.777244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dbe42cfe-9c40-4c53-9363-2d00c78e7a42 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:39.778764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dbe42cfe-9c40-4c53-9363-2d00c78e7a42 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:39.785577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dbe42cfe-9c40-4c53-9363-2d00c78e7a42 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:40.153607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dc654c29-c34c-4c89-8654-1d2792475c64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:40.161885 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dc654c29-c34c-4c89-8654-1d2792475c64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88" status: 200 len: 1502 microversion: 2.1 time: 0.787725 May 28 04:47:40.162785 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1688/3238] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:39 2022] GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88 => generated 1502 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:40.168703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5eca753f-292e-4bac-be5a-6eb36cf0c03f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-423954795", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:40.240734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-5eca753f-292e-4bac-be5a-6eb36cf0c03f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] validate_networks() for [('b91e6aa7-72c1-4a13-ac33-917f89cda5b1', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:47:40.285174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dbe42cfe-9c40-4c53-9363-2d00c78e7a42 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:40.293211 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dbe42cfe-9c40-4c53-9363-2d00c78e7a42 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4" status: 200 len: 1308 microversion: 2.1 time: 0.545147 May 28 04:47:40.293792 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1551/3239] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:39 2022] GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4 => generated 1308 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:40.308730 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-689c9ce6-0a96-4228-b801-0bfb9e4d8cf8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:40.310440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-689c9ce6-0a96-4228-b801-0bfb9e4d8cf8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:40.320031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-689c9ce6-0a96-4228-b801-0bfb9e4d8cf8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:40.320654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-689c9ce6-0a96-4228-b801-0bfb9e4d8cf8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:40.321598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-689c9ce6-0a96-4228-b801-0bfb9e4d8cf8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:40.322154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-689c9ce6-0a96-4228-b801-0bfb9e4d8cf8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:40.375643 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-689c9ce6-0a96-4228-b801-0bfb9e4d8cf8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action" status: 200 len: 14 microversion: 2.1 time: 0.076864 May 28 04:47:40.376542 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1552/3240] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:40 2022] POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:47:40.976721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-5eca753f-292e-4bac-be5a-6eb36cf0c03f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:47:40.977211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-5eca753f-292e-4bac-be5a-6eb36cf0c03f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:47:40.977620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-5eca753f-292e-4bac-be5a-6eb36cf0c03f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:47:40.978222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-5eca753f-292e-4bac-be5a-6eb36cf0c03f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:47:40.978798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-5eca753f-292e-4bac-be5a-6eb36cf0c03f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:47:40.993465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5eca753f-292e-4bac-be5a-6eb36cf0c03f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:40.994213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5eca753f-292e-4bac-be5a-6eb36cf0c03f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:40.995283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5eca753f-292e-4bac-be5a-6eb36cf0c03f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:40.996024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5eca753f-292e-4bac-be5a-6eb36cf0c03f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:41.019272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-5eca753f-292e-4bac-be5a-6eb36cf0c03f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Getting quotas for project fb9b98186db746ae83181dd7db6d56e7. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:47:41.026148 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-5eca753f-292e-4bac-be5a-6eb36cf0c03f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Getting quotas for user 6b37465157dd44a09cffbbe57322d264 and project fb9b98186db746ae83181dd7db6d56e7. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:47:41.046175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5eca753f-292e-4bac-be5a-6eb36cf0c03f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:47:41.048855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5eca753f-292e-4bac-be5a-6eb36cf0c03f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:47:41.168727 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5eca753f-292e-4bac-be5a-6eb36cf0c03f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.004029 May 28 04:47:41.176316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-67c76fd6-56e6-4355-85bb-1b8160faf7b8 req-04778736-b829-4ca4-967b-9169f1401b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7dda089-96b9-4547-b637-d2caa776a3d4", "tag": "2aba3595-8739-4d74-a7db-3baf89b855be"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:41.181428 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1689/3241] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:47:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:47:41.192326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-45d30629-048c-4da2-9c33-d8b6e1b0db6d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:41.192959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-45d30629-048c-4da2-9c33-d8b6e1b0db6d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:41.197103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-67c76fd6-56e6-4355-85bb-1b8160faf7b8 req-04778736-b829-4ca4-967b-9169f1401b88 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:41.197751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-67c76fd6-56e6-4355-85bb-1b8160faf7b8 req-04778736-b829-4ca4-967b-9169f1401b88 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:41.246162 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-67c76fd6-56e6-4355-85bb-1b8160faf7b8 req-04778736-b829-4ca4-967b-9169f1401b88 service nova] Creating event network-changed:2aba3595-8739-4d74-a7db-3baf89b855be for instance b7dda089-96b9-4547-b637-d2caa776a3d4 on n-h1-843700-1 May 28 04:47:41.253449 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-67c76fd6-56e6-4355-85bb-1b8160faf7b8 req-04778736-b829-4ca4-967b-9169f1401b88 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082505 May 28 04:47:41.254426 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1553/3242] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:47:41.311110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-871b809a-d3a4-4018-8968-af956dd2b130 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:41.311823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-871b809a-d3a4-4018-8968-af956dd2b130 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:41.319351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-871b809a-d3a4-4018-8968-af956dd2b130 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:41.320023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-871b809a-d3a4-4018-8968-af956dd2b130 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:41.321035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-871b809a-d3a4-4018-8968-af956dd2b130 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:41.321759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-871b809a-d3a4-4018-8968-af956dd2b130 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:41.336235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-45d30629-048c-4da2-9c33-d8b6e1b0db6d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:41.356950 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-45d30629-048c-4da2-9c33-d8b6e1b0db6d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1224 microversion: 2.1 time: 0.161503 May 28 04:47:41.357965 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1690/3243] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:41 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1224 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:41.387518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-228bbc67-0692-4a7d-87f2-9f8d7acfbc35 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:41.388862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-228bbc67-0692-4a7d-87f2-9f8d7acfbc35 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:41.397594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-228bbc67-0692-4a7d-87f2-9f8d7acfbc35 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:41.398133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-228bbc67-0692-4a7d-87f2-9f8d7acfbc35 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:41.399280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-228bbc67-0692-4a7d-87f2-9f8d7acfbc35 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:41.399932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-228bbc67-0692-4a7d-87f2-9f8d7acfbc35 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:41.473981 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-228bbc67-0692-4a7d-87f2-9f8d7acfbc35 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action" status: 200 len: 14 microversion: 2.1 time: 0.090092 May 28 04:47:41.475807 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1691/3244] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:41 2022] POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:47:41.595036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-871b809a-d3a4-4018-8968-af956dd2b130 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:41.603303 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-871b809a-d3a4-4018-8968-af956dd2b130 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4" status: 200 len: 1308 microversion: 2.1 time: 0.296397 May 28 04:47:41.613483 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1554/3245] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:41 2022] GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4 => generated 1308 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:42.376901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8e4c81b6-0577-4d1c-9c16-16416987fbed tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:42.377704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8e4c81b6-0577-4d1c-9c16-16416987fbed tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:42.442778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8e4c81b6-0577-4d1c-9c16-16416987fbed tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:42.462937 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8e4c81b6-0577-4d1c-9c16-16416987fbed tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1224 microversion: 2.1 time: 0.090398 May 28 04:47:42.467132 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1692/3246] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:42 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:42.486488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d5c1296f-88bb-4e8d-8ccc-21974cf4d262 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:42.487449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d5c1296f-88bb-4e8d-8ccc-21974cf4d262 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:42.508560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5c1296f-88bb-4e8d-8ccc-21974cf4d262 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:42.509021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5c1296f-88bb-4e8d-8ccc-21974cf4d262 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:42.509806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5c1296f-88bb-4e8d-8ccc-21974cf4d262 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:42.510244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5c1296f-88bb-4e8d-8ccc-21974cf4d262 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:42.549509 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d5c1296f-88bb-4e8d-8ccc-21974cf4d262 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action" status: 200 len: 14 microversion: 2.1 time: 0.066920 May 28 04:47:42.550806 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1555/3247] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:42 2022] POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:47:42.621180 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5b6ed818-95d2-426e-b81f-c04c9f0aec0c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:42.621808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5b6ed818-95d2-426e-b81f-c04c9f0aec0c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:42.628633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b6ed818-95d2-426e-b81f-c04c9f0aec0c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:42.629096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b6ed818-95d2-426e-b81f-c04c9f0aec0c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:42.629878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b6ed818-95d2-426e-b81f-c04c9f0aec0c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:42.630324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b6ed818-95d2-426e-b81f-c04c9f0aec0c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:42.732660 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5f5d72f1-7829-4fc8-b6df-aca65311aa8f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:42.732660 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5f5d72f1-7829-4fc8-b6df-aca65311aa8f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:42.750130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:42.762908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5f5d72f1-7829-4fc8-b6df-aca65311aa8f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:42.764456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5f5d72f1-7829-4fc8-b6df-aca65311aa8f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:42.766172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5f5d72f1-7829-4fc8-b6df-aca65311aa8f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:42.767530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5f5d72f1-7829-4fc8-b6df-aca65311aa8f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:42.802075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5b6ed818-95d2-426e-b81f-c04c9f0aec0c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:42.812519 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5b6ed818-95d2-426e-b81f-c04c9f0aec0c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4" status: 200 len: 1308 microversion: 2.1 time: 0.195981 May 28 04:47:42.813429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5f5d72f1-7829-4fc8-b6df-aca65311aa8f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:47:42.826678 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1693/3248] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:42 2022] GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4 => generated 1308 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:43.193061 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5f5d72f1-7829-4fc8-b6df-aca65311aa8f tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "DELETE /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 204 len: 0 microversion: 2.1 time: 0.468548 May 28 04:47:43.193885 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1556/3249] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:47:42 2022] DELETE /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:47:43.203547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fcae340e-d6c2-4a31-9300-e2f519ef0152 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:43.204144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fcae340e-d6c2-4a31-9300-e2f519ef0152 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:43.213608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fcae340e-d6c2-4a31-9300-e2f519ef0152 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:43.216374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fcae340e-d6c2-4a31-9300-e2f519ef0152 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:43.218307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fcae340e-d6c2-4a31-9300-e2f519ef0152 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:43.231554 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fcae340e-d6c2-4a31-9300-e2f519ef0152 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:43.500897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c0442a1d-0fc1-45d4-a132-0b5526eb71db tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1578368574", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "213f4061-475e-48b7-a772-6f3e65cf6a8d"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:43.506383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fcae340e-d6c2-4a31-9300-e2f519ef0152 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3840ad6a4e4e8c961cc20ee2b5ab0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668db6c41d0d48c3abd9035dcc477e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:43.531902 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fcae340e-d6c2-4a31-9300-e2f519ef0152 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 200 len: 1512 microversion: 2.1 time: 0.333808 May 28 04:47:43.546071 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1694/3250] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:43 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 1512 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:43.558885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-402ae009-acd4-492d-a6be-15ca11755425 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:43.567635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-402ae009-acd4-492d-a6be-15ca11755425 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:43.581637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-402ae009-acd4-492d-a6be-15ca11755425 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:43.582282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-402ae009-acd4-492d-a6be-15ca11755425 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:43.588308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-402ae009-acd4-492d-a6be-15ca11755425 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:43.589108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-402ae009-acd4-492d-a6be-15ca11755425 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:43.599031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-c0442a1d-0fc1-45d4-a132-0b5526eb71db tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] validate_networks() for [('213f4061-475e-48b7-a772-6f3e65cf6a8d', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:47:43.730547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-402ae009-acd4-492d-a6be-15ca11755425 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:43.767785 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-402ae009-acd4-492d-a6be-15ca11755425 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1276 microversion: 2.1 time: 0.212816 May 28 04:47:43.767785 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1695/3251] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:43 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1276 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:43.783075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6e735178-a05e-4486-8add-ee6256d4226b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:43.790002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6e735178-a05e-4486-8add-ee6256d4226b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:43.802608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e735178-a05e-4486-8add-ee6256d4226b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:43.807285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e735178-a05e-4486-8add-ee6256d4226b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:43.809039 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e735178-a05e-4486-8add-ee6256d4226b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:43.812507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e735178-a05e-4486-8add-ee6256d4226b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:44.356230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:44.515771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-c0442a1d-0fc1-45d4-a132-0b5526eb71db tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:47:44.516386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-c0442a1d-0fc1-45d4-a132-0b5526eb71db tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:47:44.517045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-c0442a1d-0fc1-45d4-a132-0b5526eb71db tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:47:44.517554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-c0442a1d-0fc1-45d4-a132-0b5526eb71db tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:47:44.518745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-c0442a1d-0fc1-45d4-a132-0b5526eb71db tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:47:44.530169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c0442a1d-0fc1-45d4-a132-0b5526eb71db tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:44.530670 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6e735178-a05e-4486-8add-ee6256d4226b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action" status: 200 len: 14 microversion: 2.1 time: 0.763077 May 28 04:47:44.531179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c0442a1d-0fc1-45d4-a132-0b5526eb71db tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:44.531841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c0442a1d-0fc1-45d4-a132-0b5526eb71db tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:44.532374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c0442a1d-0fc1-45d4-a132-0b5526eb71db tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:44.535623 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1696/3252] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:43 2022] POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action => generated 14 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:47:44.539614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-73168259-a3cf-46c6-bc25-f95ef8291e32 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:44.540492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-73168259-a3cf-46c6-bc25-f95ef8291e32 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:44.552464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73168259-a3cf-46c6-bc25-f95ef8291e32 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:44.552961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73168259-a3cf-46c6-bc25-f95ef8291e32 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:44.553760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73168259-a3cf-46c6-bc25-f95ef8291e32 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:44.554281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73168259-a3cf-46c6-bc25-f95ef8291e32 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:44.593404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-c0442a1d-0fc1-45d4-a132-0b5526eb71db tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Getting quotas for project e912d921d9dd4406ab8279c483b17da0. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:47:44.599301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-c0442a1d-0fc1-45d4-a132-0b5526eb71db tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Getting quotas for user 3cd50f0dcc4b486fafdce740e661abdd and project e912d921d9dd4406ab8279c483b17da0. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:47:44.613621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c0442a1d-0fc1-45d4-a132-0b5526eb71db tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Going to run 3 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:47:44.616116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c0442a1d-0fc1-45d4-a132-0b5526eb71db tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: b2a2e64b-2bf0-4d17-b81e-f9f79e81db22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:47:44.725135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c0442a1d-0fc1-45d4-a132-0b5526eb71db tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: a70f5df3-aa9d-4a76-bf08-d7d3074061c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=b2a2e64b-2bf0-4d17-b81e-f9f79e81db22,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:47:44.755483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-73168259-a3cf-46c6-bc25-f95ef8291e32 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:44.763376 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-73168259-a3cf-46c6-bc25-f95ef8291e32 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4" status: 200 len: 1308 microversion: 2.1 time: 0.228944 May 28 04:47:44.763950 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1697/3253] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:44 2022] GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4 => generated 1308 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:44.768537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9a07caeb-9df9-425d-9938-fd860cafcbe2 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:44.769153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9a07caeb-9df9-425d-9938-fd860cafcbe2 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:44.775142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a07caeb-9df9-425d-9938-fd860cafcbe2 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:44.775600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a07caeb-9df9-425d-9938-fd860cafcbe2 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:44.776396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a07caeb-9df9-425d-9938-fd860cafcbe2 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:44.776836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a07caeb-9df9-425d-9938-fd860cafcbe2 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:44.792554 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:44.834191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c0442a1d-0fc1-45d4-a132-0b5526eb71db tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: e484efaa-4e49-47b4-a969-1135ed7ac02e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=a70f5df3-aa9d-4a76-bf08-d7d3074061c1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:47:45.018604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9a07caeb-9df9-425d-9938-fd860cafcbe2 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3840ad6a4e4e8c961cc20ee2b5ab0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668db6c41d0d48c3abd9035dcc477e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:45.050319 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9a07caeb-9df9-425d-9938-fd860cafcbe2 tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 200 len: 1512 microversion: 2.1 time: 0.285306 May 28 04:47:45.055289 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1698/3254] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:44 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 1512 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:45.065266 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c0442a1d-0fc1-45d4-a132-0b5526eb71db tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.806248 May 28 04:47:45.067022 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1557/3255] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:47:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:47:45.071407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-af1f9436-60fc-4a91-8856-8a3a6f3d4fc4 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:45.071407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-af1f9436-60fc-4a91-8856-8a3a6f3d4fc4 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:45.084684 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c5aba8c7-f4c3-4fbd-be31-4d48f205cc68 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:45.085689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-af1f9436-60fc-4a91-8856-8a3a6f3d4fc4 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:45.086407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-af1f9436-60fc-4a91-8856-8a3a6f3d4fc4 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:45.087488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-af1f9436-60fc-4a91-8856-8a3a6f3d4fc4 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:45.088150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-af1f9436-60fc-4a91-8856-8a3a6f3d4fc4 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:45.089946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c5aba8c7-f4c3-4fbd-be31-4d48f205cc68 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:45.090900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c5aba8c7-f4c3-4fbd-be31-4d48f205cc68 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Searching by: {'deleted': False, 'project_id': 'e912d921d9dd4406ab8279c483b17da0'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:47:45.115775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5aba8c7-f4c3-4fbd-be31-4d48f205cc68 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:45.116627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5aba8c7-f4c3-4fbd-be31-4d48f205cc68 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:45.117796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5aba8c7-f4c3-4fbd-be31-4d48f205cc68 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:45.118578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5aba8c7-f4c3-4fbd-be31-4d48f205cc68 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:45.147382 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c5aba8c7-f4c3-4fbd-be31-4d48f205cc68 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.070457 May 28 04:47:45.148332 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1558/3256] 10.222.0.58 () {58 vars in 1124 bytes} [Sat May 28 04:47:45 2022] GET /compute/v2.1/servers => generated 1018 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:45.161032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1b52c876-dd78-4388-ad80-55f0b2910a38 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:45.163913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1b52c876-dd78-4388-ad80-55f0b2910a38 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: e484efaa-4e49-47b4-a969-1135ed7ac02e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:45.281168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-af1f9436-60fc-4a91-8856-8a3a6f3d4fc4 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:45.290285 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-af1f9436-60fc-4a91-8856-8a3a6f3d4fc4 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1282 microversion: 2.1 time: 0.232429 May 28 04:47:45.304149 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1699/3257] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:45 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1282 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:45.313165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1b52c876-dd78-4388-ad80-55f0b2910a38 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:45.340091 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1b52c876-dd78-4388-ad80-55f0b2910a38 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e" status: 200 len: 1223 microversion: 2.1 time: 0.174078 May 28 04:47:45.341325 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1559/3258] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:45 2022] GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e => generated 1223 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:45.500950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-5e8d2d24-162c-4329-9dee-e1d7261e0107 req-03853dd8-946c-4b2d-b4d1-d34b0e877860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158d6dcc-16f5-4b5d-8260-3178a329effe", "name": "network-vif-deleted", "tag": "6e7d28dc-9821-4d06-b223-29d62f51020f"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:45.509927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5e8d2d24-162c-4329-9dee-e1d7261e0107 req-03853dd8-946c-4b2d-b4d1-d34b0e877860 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:45.510376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5e8d2d24-162c-4329-9dee-e1d7261e0107 req-03853dd8-946c-4b2d-b4d1-d34b0e877860 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:45.527725 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-5e8d2d24-162c-4329-9dee-e1d7261e0107 req-03853dd8-946c-4b2d-b4d1-d34b0e877860 service nova] Creating event network-vif-deleted:6e7d28dc-9821-4d06-b223-29d62f51020f for instance 158d6dcc-16f5-4b5d-8260-3178a329effe on n-h2-843700-1 May 28 04:47:45.533185 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-5e8d2d24-162c-4329-9dee-e1d7261e0107 req-03853dd8-946c-4b2d-b4d1-d34b0e877860 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036253 May 28 04:47:45.537963 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1700/3259] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:45.544598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7a9ca938-1e32-4169-a995-aed85652387f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:45.545813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7a9ca938-1e32-4169-a995-aed85652387f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:45.553645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a9ca938-1e32-4169-a995-aed85652387f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:45.554044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a9ca938-1e32-4169-a995-aed85652387f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:45.554830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a9ca938-1e32-4169-a995-aed85652387f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:45.555305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a9ca938-1e32-4169-a995-aed85652387f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:45.605695 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7a9ca938-1e32-4169-a995-aed85652387f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action" status: 200 len: 14 microversion: 2.1 time: 0.066324 May 28 04:47:45.607818 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1560/3260] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:45 2022] POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 04:47:45.788920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6a180abc-22db-44e4-9c85-233bfdab074f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:45.791640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6a180abc-22db-44e4-9c85-233bfdab074f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:45.813831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a180abc-22db-44e4-9c85-233bfdab074f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:45.815198 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a180abc-22db-44e4-9c85-233bfdab074f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:45.817746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a180abc-22db-44e4-9c85-233bfdab074f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:45.818621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a180abc-22db-44e4-9c85-233bfdab074f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:46.070397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cdc132ad-bf89-4894-aa2d-2484ca2b2c0e tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:46.071437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cdc132ad-bf89-4894-aa2d-2484ca2b2c0e tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:46.080483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdc132ad-bf89-4894-aa2d-2484ca2b2c0e tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:46.081173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdc132ad-bf89-4894-aa2d-2484ca2b2c0e tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:46.082042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdc132ad-bf89-4894-aa2d-2484ca2b2c0e tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:46.082454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdc132ad-bf89-4894-aa2d-2484ca2b2c0e tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:46.094515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6a180abc-22db-44e4-9c85-233bfdab074f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:46.106499 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6a180abc-22db-44e4-9c85-233bfdab074f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4" status: 200 len: 1308 microversion: 2.1 time: 0.329161 May 28 04:47:46.107365 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1701/3261] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:45 2022] GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4 => generated 1308 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:46.131538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdc132ad-bf89-4894-aa2d-2484ca2b2c0e tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:46.131998 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdc132ad-bf89-4894-aa2d-2484ca2b2c0e tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:46.132461 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-cdc132ad-bf89-4894-aa2d-2484ca2b2c0e tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lazy-loading 'fault' on Instance uuid 158d6dcc-16f5-4b5d-8260-3178a329effe {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:47:46.190738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cdc132ad-bf89-4894-aa2d-2484ca2b2c0e tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3840ad6a4e4e8c961cc20ee2b5ab0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668db6c41d0d48c3abd9035dcc477e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:46.199399 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cdc132ad-bf89-4894-aa2d-2484ca2b2c0e tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 200 len: 1307 microversion: 2.1 time: 0.133420 May 28 04:47:46.199976 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1561/3262] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:46 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 1307 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:46.316113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d697d3c7-d8fd-433b-a05f-ff757117ae83 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:46.316823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d697d3c7-d8fd-433b-a05f-ff757117ae83 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:46.324945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d697d3c7-d8fd-433b-a05f-ff757117ae83 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:46.325406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d697d3c7-d8fd-433b-a05f-ff757117ae83 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:46.327179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d697d3c7-d8fd-433b-a05f-ff757117ae83 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:46.327179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d697d3c7-d8fd-433b-a05f-ff757117ae83 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:46.355584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f533c966-994e-4f6a-b0b9-082c6f248095 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:46.356650 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f533c966-994e-4f6a-b0b9-082c6f248095 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: e484efaa-4e49-47b4-a969-1135ed7ac02e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:46.485566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f533c966-994e-4f6a-b0b9-082c6f248095 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:46.503361 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f533c966-994e-4f6a-b0b9-082c6f248095 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e" status: 200 len: 1223 microversion: 2.1 time: 0.156961 May 28 04:47:46.504466 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1562/3263] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:46 2022] GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e => generated 1223 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:46.611364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d697d3c7-d8fd-433b-a05f-ff757117ae83 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:46.617328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-411306b2-39bd-4fbf-8123-8395f3c98a76 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:46.618556 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-411306b2-39bd-4fbf-8123-8395f3c98a76 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:46.621365 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d697d3c7-d8fd-433b-a05f-ff757117ae83 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1324 microversion: 2.1 time: 0.314403 May 28 04:47:46.631066 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1702/3264] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:46 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1324 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:46.631794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-411306b2-39bd-4fbf-8123-8395f3c98a76 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:46.631794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-411306b2-39bd-4fbf-8123-8395f3c98a76 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:46.631794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-411306b2-39bd-4fbf-8123-8395f3c98a76 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:46.631794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-411306b2-39bd-4fbf-8123-8395f3c98a76 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:46.633429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:46.670543 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-411306b2-39bd-4fbf-8123-8395f3c98a76 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action" status: 200 len: 14 microversion: 2.1 time: 0.057355 May 28 04:47:46.674250 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1563/3265] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:46 2022] POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action => generated 14 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 04:47:46.843913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e3c12549-260b-422d-b119-d3e108191a5e req-3494816a-3c85-47bb-9ab3-3e493a589c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e34a513-f606-4109-942e-e8ddd9145ea5", "tag": "283cc1e0-d886-4407-8227-a9d9bcad50e6"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:46.855455 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e3c12549-260b-422d-b119-d3e108191a5e req-3494816a-3c85-47bb-9ab3-3e493a589c4a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:46.856397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e3c12549-260b-422d-b119-d3e108191a5e req-3494816a-3c85-47bb-9ab3-3e493a589c4a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:46.871600 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e3c12549-260b-422d-b119-d3e108191a5e req-3494816a-3c85-47bb-9ab3-3e493a589c4a service nova] Creating event network-changed:283cc1e0-d886-4407-8227-a9d9bcad50e6 for instance 7e34a513-f606-4109-942e-e8ddd9145ea5 on n-h1-843700-1 May 28 04:47:46.877090 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e3c12549-260b-422d-b119-d3e108191a5e req-3494816a-3c85-47bb-9ab3-3e493a589c4a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038769 May 28 04:47:46.877694 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1703/3266] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:47.124988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fab1a714-2cb3-4754-9feb-950ec729f710 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:47.125923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fab1a714-2cb3-4754-9feb-950ec729f710 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:47.134092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fab1a714-2cb3-4754-9feb-950ec729f710 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:47.134678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fab1a714-2cb3-4754-9feb-950ec729f710 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:47.137065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fab1a714-2cb3-4754-9feb-950ec729f710 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:47.137521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fab1a714-2cb3-4754-9feb-950ec729f710 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:47.217484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7328c6ec-aaee-4026-9f9f-c77b3934082a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:47.218202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7328c6ec-aaee-4026-9f9f-c77b3934082a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] [instance: 158d6dcc-16f5-4b5d-8260-3178a329effe] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:47.228719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7328c6ec-aaee-4026-9f9f-c77b3934082a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:47.229199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7328c6ec-aaee-4026-9f9f-c77b3934082a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:47.229995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7328c6ec-aaee-4026-9f9f-c77b3934082a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:47.230459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7328c6ec-aaee-4026-9f9f-c77b3934082a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:47.244426 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-7328c6ec-aaee-4026-9f9f-c77b3934082a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] HTTP exception thrown: Instance 158d6dcc-16f5-4b5d-8260-3178a329effe could not be found. May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7328c6ec-aaee-4026-9f9f-c77b3934082a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Request method failure captured: May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe HTTP/1.1 May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaj9RE6jd5A9gdl1co5B0XXOctAOYG58ouK8D23nnggsc5DABx9tkTmi0CBTiVYh3_1OBzO79tt2BKXt2IdUsSXyiAxHubNhS5E-PdxfRf1N5dc8bCJRBJ1Sy_C6QW0LyKX0c_Tt3p96p4c_l5hedacC8nHso4aCybujgoVZz0d8ggU May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 668db6c41d0d48c3abd9035dcc477e86 May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-VolumesAdminNegativeTest-653647536 May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_668db6c41d0d48c3abd9035dcc477e86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/668db6c41d0d48c3abd9035dcc477e86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/668db6c41d0d48c3abd9035dcc477e86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/668db6c41d0d48c3abd9035dcc477e86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-VolumesAdminNegativeTest-653647536 May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 668db6c41d0d48c3abd9035dcc477e86 May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-653647536 May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-VolumesAdminNegativeTest-653647536-project May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 4f3840ad6a4e4e8c961cc20ee2b5ab0c May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-VolumesAdminNegativeTest-653647536-project May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 158d6dcc-16f5-4b5d-8260-3178a329effe could not be found. May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '158d6dcc-16f5-4b5d-8260-3178a329effe'} May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158d6dcc-16f5-4b5d-8260-3178a329effe could not be found. May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158d6dcc-16f5-4b5d-8260-3178a329effe could not be found. May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:47.248316 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:47.253665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:47.253665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:47.253665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:47.253665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:47:47.253665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:47:47.253665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158d6dcc-16f5-4b5d-8260-3178a329effe could not be found. May 28 04:47:47.253665 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:47.253665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7328c6ec-aaee-4026-9f9f-c77b3934082a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] Returning 404 to user: Instance 158d6dcc-16f5-4b5d-8260-3178a329effe could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:47:47.253665 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7328c6ec-aaee-4026-9f9f-c77b3934082a tempest-VolumesAdminNegativeTest-653647536 tempest-VolumesAdminNegativeTest-653647536-project] 10.222.0.58 "GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe" status: 404 len: 111 microversion: 2.1 time: 0.037045 May 28 04:47:47.253665 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1704/3267] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:47 2022] GET /compute/v2.1/servers/158d6dcc-16f5-4b5d-8260-3178a329effe => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:47:47.384807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fab1a714-2cb3-4754-9feb-950ec729f710 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:47.393667 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fab1a714-2cb3-4754-9feb-950ec729f710 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4" status: 200 len: 1308 microversion: 2.1 time: 0.274254 May 28 04:47:47.394352 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1564/3268] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:47 2022] GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4 => generated 1308 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:47.522025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-027d372d-e7c3-45e5-aeee-46215cc0a22c tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:47.522654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-027d372d-e7c3-45e5-aeee-46215cc0a22c tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: e484efaa-4e49-47b4-a969-1135ed7ac02e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:47.616543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-027d372d-e7c3-45e5-aeee-46215cc0a22c tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:47.624983 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-027d372d-e7c3-45e5-aeee-46215cc0a22c tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e" status: 200 len: 1223 microversion: 2.1 time: 0.107762 May 28 04:47:47.626181 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1705/3269] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:47 2022] GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e => generated 1223 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:47.643957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8e4abb98-3c35-4086-b55b-c0f0a34c8cfe tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:47.645357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8e4abb98-3c35-4086-b55b-c0f0a34c8cfe tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:47.673867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e4abb98-3c35-4086-b55b-c0f0a34c8cfe tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:47.674395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e4abb98-3c35-4086-b55b-c0f0a34c8cfe tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:47.678329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e4abb98-3c35-4086-b55b-c0f0a34c8cfe tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:47.682158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e5e797db-c16b-409b-b112-f3936dd14c40 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:47.684536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e5e797db-c16b-409b-b112-f3936dd14c40 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:47.689241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e4abb98-3c35-4086-b55b-c0f0a34c8cfe tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:47.710746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5e797db-c16b-409b-b112-f3936dd14c40 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:47.712845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5e797db-c16b-409b-b112-f3936dd14c40 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:47.713702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5e797db-c16b-409b-b112-f3936dd14c40 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:47.717045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5e797db-c16b-409b-b112-f3936dd14c40 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:47.786058 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e5e797db-c16b-409b-b112-f3936dd14c40 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action" status: 200 len: 14 microversion: 2.1 time: 0.108040 May 28 04:47:47.786708 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1706/3270] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:47 2022] POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 04:47:47.894670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8e4abb98-3c35-4086-b55b-c0f0a34c8cfe tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:47.909346 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8e4abb98-3c35-4086-b55b-c0f0a34c8cfe tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1324 microversion: 2.1 time: 0.272151 May 28 04:47:47.910457 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1565/3271] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:47 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1324 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:48.005567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-35360799-0878-4928-9aed-3803983c4d4e req-44c6a24e-6e5c-4b19-b421-bd1c8ca51a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7dda089-96b9-4547-b637-d2caa776a3d4", "name": "network-vif-plugged", "status": "completed", "tag": "2aba3595-8739-4d74-a7db-3baf89b855be"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:48.014701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-35360799-0878-4928-9aed-3803983c4d4e req-44c6a24e-6e5c-4b19-b421-bd1c8ca51a7b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:48.015183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-35360799-0878-4928-9aed-3803983c4d4e req-44c6a24e-6e5c-4b19-b421-bd1c8ca51a7b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:48.025865 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-35360799-0878-4928-9aed-3803983c4d4e req-44c6a24e-6e5c-4b19-b421-bd1c8ca51a7b service nova] Creating event network-vif-plugged:2aba3595-8739-4d74-a7db-3baf89b855be for instance b7dda089-96b9-4547-b637-d2caa776a3d4 on n-h1-843700-1 May 28 04:47:48.031258 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-35360799-0878-4928-9aed-3803983c4d4e req-44c6a24e-6e5c-4b19-b421-bd1c8ca51a7b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029955 May 28 04:47:48.031841 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1707/3272] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:48.413610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fe47c264-76b3-43a1-a701-a0391437c04e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:48.414367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fe47c264-76b3-43a1-a701-a0391437c04e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:48.425401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe47c264-76b3-43a1-a701-a0391437c04e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:48.427333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe47c264-76b3-43a1-a701-a0391437c04e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:48.428314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe47c264-76b3-43a1-a701-a0391437c04e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:48.429059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe47c264-76b3-43a1-a701-a0391437c04e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:48.632732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fe47c264-76b3-43a1-a701-a0391437c04e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:48.644513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dc6e9eb1-3300-4cca-b77c-8bde9b22ee41 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:48.645829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dc6e9eb1-3300-4cca-b77c-8bde9b22ee41 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: e484efaa-4e49-47b4-a969-1135ed7ac02e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:48.648233 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:48.654162 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fe47c264-76b3-43a1-a701-a0391437c04e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4" status: 200 len: 1308 microversion: 2.1 time: 0.245020 May 28 04:47:48.654780 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1566/3273] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:48 2022] GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4 => generated 1308 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:48.656250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc6e9eb1-3300-4cca-b77c-8bde9b22ee41 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:48.656773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc6e9eb1-3300-4cca-b77c-8bde9b22ee41 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:48.657581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc6e9eb1-3300-4cca-b77c-8bde9b22ee41 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:48.658032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc6e9eb1-3300-4cca-b77c-8bde9b22ee41 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:48.746831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dc6e9eb1-3300-4cca-b77c-8bde9b22ee41 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:48.760094 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dc6e9eb1-3300-4cca-b77c-8bde9b22ee41 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e" status: 200 len: 1227 microversion: 2.1 time: 0.121496 May 28 04:47:48.761689 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1708/3274] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:48 2022] GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e => generated 1227 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:48.798383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b4e5ec01-489a-4c35-8008-b49a4e3343dc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:48.799454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b4e5ec01-489a-4c35-8008-b49a4e3343dc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:48.811110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b4e5ec01-489a-4c35-8008-b49a4e3343dc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:48.822607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b4e5ec01-489a-4c35-8008-b49a4e3343dc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:48.822607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b4e5ec01-489a-4c35-8008-b49a4e3343dc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:48.822607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b4e5ec01-489a-4c35-8008-b49a4e3343dc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:48.859089 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b4e5ec01-489a-4c35-8008-b49a4e3343dc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action" status: 200 len: 14 microversion: 2.1 time: 0.063551 May 28 04:47:48.859836 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1567/3275] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:48 2022] POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:47:48.928276 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-03ce8161-9620-4942-b090-61b290d9ea94 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:48.929026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-03ce8161-9620-4942-b090-61b290d9ea94 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:48.939578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03ce8161-9620-4942-b090-61b290d9ea94 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:48.942456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03ce8161-9620-4942-b090-61b290d9ea94 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:48.944921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03ce8161-9620-4942-b090-61b290d9ea94 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:48.945555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03ce8161-9620-4942-b090-61b290d9ea94 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:49.169963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-03ce8161-9620-4942-b090-61b290d9ea94 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:49.177870 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-03ce8161-9620-4942-b090-61b290d9ea94 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1324 microversion: 2.1 time: 0.253871 May 28 04:47:49.178792 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1709/3276] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:48 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1324 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:49.671810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-54635246-337d-4f2e-b9f6-e759cc69d2c3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:49.673218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-54635246-337d-4f2e-b9f6-e759cc69d2c3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:49.683397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54635246-337d-4f2e-b9f6-e759cc69d2c3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:49.684256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54635246-337d-4f2e-b9f6-e759cc69d2c3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:49.685319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54635246-337d-4f2e-b9f6-e759cc69d2c3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:49.685981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54635246-337d-4f2e-b9f6-e759cc69d2c3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:49.779403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1ed95197-bded-41d0-adca-2afc83c06fde tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:49.780710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1ed95197-bded-41d0-adca-2afc83c06fde tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: e484efaa-4e49-47b4-a969-1135ed7ac02e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:49.788249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ed95197-bded-41d0-adca-2afc83c06fde tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:49.788854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ed95197-bded-41d0-adca-2afc83c06fde tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:49.790073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ed95197-bded-41d0-adca-2afc83c06fde tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:49.790668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ed95197-bded-41d0-adca-2afc83c06fde tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:49.880663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1ed95197-bded-41d0-adca-2afc83c06fde tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:49.906558 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1ed95197-bded-41d0-adca-2afc83c06fde tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e" status: 200 len: 1275 microversion: 2.1 time: 0.127973 May 28 04:47:49.918058 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1710/3277] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:49 2022] GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e => generated 1275 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:49.933883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0e7a0043-3772-45bb-9f9f-931d239de867 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:49.934751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0e7a0043-3772-45bb-9f9f-931d239de867 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:49.962596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0e7a0043-3772-45bb-9f9f-931d239de867 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:49.964848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0e7a0043-3772-45bb-9f9f-931d239de867 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:49.966216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0e7a0043-3772-45bb-9f9f-931d239de867 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:49.967988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0e7a0043-3772-45bb-9f9f-931d239de867 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:49.982563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-54635246-337d-4f2e-b9f6-e759cc69d2c3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:49.995204 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-54635246-337d-4f2e-b9f6-e759cc69d2c3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4" status: 200 len: 1308 microversion: 2.1 time: 0.327490 May 28 04:47:50.005268 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1568/3278] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:49 2022] GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4 => generated 1308 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:50.059419 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0e7a0043-3772-45bb-9f9f-931d239de867 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action" status: 200 len: 14 microversion: 2.1 time: 0.138324 May 28 04:47:50.061909 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1711/3279] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:49 2022] POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:47:50.196007 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-502b5a5b-dda4-4820-a42a-d5e050bc1063 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:50.196809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-502b5a5b-dda4-4820-a42a-d5e050bc1063 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:50.204632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-502b5a5b-dda4-4820-a42a-d5e050bc1063 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:50.205163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-502b5a5b-dda4-4820-a42a-d5e050bc1063 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:50.206254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-502b5a5b-dda4-4820-a42a-d5e050bc1063 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:50.206785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-502b5a5b-dda4-4820-a42a-d5e050bc1063 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:50.478778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-502b5a5b-dda4-4820-a42a-d5e050bc1063 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:50.478778 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-502b5a5b-dda4-4820-a42a-d5e050bc1063 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1324 microversion: 2.1 time: 0.274305 May 28 04:47:50.478778 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1569/3280] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:50 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1324 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:50.927904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-85118128-e0b7-4467-b70b-a690f1114831 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:50.928632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-85118128-e0b7-4467-b70b-a690f1114831 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: e484efaa-4e49-47b4-a969-1135ed7ac02e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:50.936631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-85118128-e0b7-4467-b70b-a690f1114831 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:50.937722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-85118128-e0b7-4467-b70b-a690f1114831 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:50.938825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-85118128-e0b7-4467-b70b-a690f1114831 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:50.939747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-85118128-e0b7-4467-b70b-a690f1114831 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:51.008270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:51.020789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3c819b02-462c-47ef-b394-7a2e59017206 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:51.022206 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3c819b02-462c-47ef-b394-7a2e59017206 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:51.032941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-85118128-e0b7-4467-b70b-a690f1114831 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:51.046215 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c819b02-462c-47ef-b394-7a2e59017206 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:51.046601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c819b02-462c-47ef-b394-7a2e59017206 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:51.048156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c819b02-462c-47ef-b394-7a2e59017206 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:51.051922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c819b02-462c-47ef-b394-7a2e59017206 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:51.059485 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-85118128-e0b7-4467-b70b-a690f1114831 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e" status: 200 len: 1281 microversion: 2.1 time: 0.126312 May 28 04:47:51.061726 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1712/3281] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:50 2022] GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e => generated 1281 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:51.074029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5243b01f-c5a0-4736-a8d6-d72c2590e2d3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:51.079283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5243b01f-c5a0-4736-a8d6-d72c2590e2d3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:51.093626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5243b01f-c5a0-4736-a8d6-d72c2590e2d3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:51.094964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5243b01f-c5a0-4736-a8d6-d72c2590e2d3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:51.096625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5243b01f-c5a0-4736-a8d6-d72c2590e2d3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:51.101945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5243b01f-c5a0-4736-a8d6-d72c2590e2d3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:51.180327 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5243b01f-c5a0-4736-a8d6-d72c2590e2d3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action" status: 200 len: 14 microversion: 2.1 time: 0.114366 May 28 04:47:51.181174 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1713/3282] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:51 2022] POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:47:51.259469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3c819b02-462c-47ef-b394-7a2e59017206 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:51.275570 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3c819b02-462c-47ef-b394-7a2e59017206 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4" status: 200 len: 1487 microversion: 2.1 time: 0.265527 May 28 04:47:51.280575 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1570/3283] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:51 2022] GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4 => generated 1487 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:51.301134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1500c759-52be-47fa-9b2b-c4c7b9d8e9c2 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:51.301820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1500c759-52be-47fa-9b2b-c4c7b9d8e9c2 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:51.311147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1500c759-52be-47fa-9b2b-c4c7b9d8e9c2 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:51.314544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1500c759-52be-47fa-9b2b-c4c7b9d8e9c2 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:51.315404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1500c759-52be-47fa-9b2b-c4c7b9d8e9c2 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:51.316497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1500c759-52be-47fa-9b2b-c4c7b9d8e9c2 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:51.349370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-1500c759-52be-47fa-9b2b-c4c7b9d8e9c2 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lazy-loading 'flavor' on Instance uuid b7dda089-96b9-4547-b637-d2caa776a3d4 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:47:51.489066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d96e6b00-32a2-4d14-a3f3-7da53309d061 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:51.490123 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d96e6b00-32a2-4d14-a3f3-7da53309d061 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:51.496997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d96e6b00-32a2-4d14-a3f3-7da53309d061 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:51.497461 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d96e6b00-32a2-4d14-a3f3-7da53309d061 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:51.498552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d96e6b00-32a2-4d14-a3f3-7da53309d061 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:51.498962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d96e6b00-32a2-4d14-a3f3-7da53309d061 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:51.725212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d96e6b00-32a2-4d14-a3f3-7da53309d061 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:51.740179 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d96e6b00-32a2-4d14-a3f3-7da53309d061 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1324 microversion: 2.1 time: 0.255026 May 28 04:47:51.749817 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1571/3284] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:51 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:51.823748 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1500c759-52be-47fa-9b2b-c4c7b9d8e9c2 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "POST /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4/action" status: 202 len: 0 microversion: 2.1 time: 0.527322 May 28 04:47:51.825637 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1714/3285] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:51 2022] POST /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:47:51.832765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-586f7666-9ec3-499e-8d52-916368379a1d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:51.833637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-586f7666-9ec3-499e-8d52-916368379a1d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:51.842229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-586f7666-9ec3-499e-8d52-916368379a1d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:51.846812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-586f7666-9ec3-499e-8d52-916368379a1d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:51.847810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-586f7666-9ec3-499e-8d52-916368379a1d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:51.848451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-586f7666-9ec3-499e-8d52-916368379a1d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:52.037810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-586f7666-9ec3-499e-8d52-916368379a1d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:52.045693 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-586f7666-9ec3-499e-8d52-916368379a1d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4" status: 200 len: 1495 microversion: 2.1 time: 0.216779 May 28 04:47:52.055890 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1572/3286] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:51 2022] GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4 => generated 1495 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:52.079840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9de5da43-666b-4af9-81e2-c8354f20f90a tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:52.089487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9de5da43-666b-4af9-81e2-c8354f20f90a tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: e484efaa-4e49-47b4-a969-1135ed7ac02e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:52.089487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9de5da43-666b-4af9-81e2-c8354f20f90a tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:52.089487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9de5da43-666b-4af9-81e2-c8354f20f90a tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:52.089487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9de5da43-666b-4af9-81e2-c8354f20f90a tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:52.089788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9de5da43-666b-4af9-81e2-c8354f20f90a tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:52.191478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0395f6cd-a94d-44c0-95ee-4eb50c5a1efd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:52.192703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0395f6cd-a94d-44c0-95ee-4eb50c5a1efd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:52.200926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0395f6cd-a94d-44c0-95ee-4eb50c5a1efd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:52.203219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0395f6cd-a94d-44c0-95ee-4eb50c5a1efd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:52.208198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0395f6cd-a94d-44c0-95ee-4eb50c5a1efd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:52.208903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0395f6cd-a94d-44c0-95ee-4eb50c5a1efd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:52.299969 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0395f6cd-a94d-44c0-95ee-4eb50c5a1efd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action" status: 200 len: 8203 microversion: 2.1 time: 0.112156 May 28 04:47:52.307216 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1573/3287] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:52 2022] POST /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88/action => generated 8203 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:52.316926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6b0d5589-8a3d-4006-ba43-c2053d993836 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:52.318056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6b0d5589-8a3d-4006-ba43-c2053d993836 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:52.327855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b0d5589-8a3d-4006-ba43-c2053d993836 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:52.328598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b0d5589-8a3d-4006-ba43-c2053d993836 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:52.329710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b0d5589-8a3d-4006-ba43-c2053d993836 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:52.330334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b0d5589-8a3d-4006-ba43-c2053d993836 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:52.433672 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:47:52.433930 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 04:47:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e (ip 10.222.0.58) !!! May 28 04:47:52.772576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9de5da43-666b-4af9-81e2-c8354f20f90a tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:52.781450 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9de5da43-666b-4af9-81e2-c8354f20f90a tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e" status: 200 len: 1323 microversion: 2.1 time: 0.706810 May 28 04:47:52.781888 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1715/3288] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:52 2022] GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e => generated 1323 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:52.786729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-21d780fe-6ef9-4bdb-bee9-110fd9cfee44 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:52.787684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-21d780fe-6ef9-4bdb-bee9-110fd9cfee44 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:52.798520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21d780fe-6ef9-4bdb-bee9-110fd9cfee44 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:52.798888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21d780fe-6ef9-4bdb-bee9-110fd9cfee44 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:52.799916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21d780fe-6ef9-4bdb-bee9-110fd9cfee44 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:52.800368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21d780fe-6ef9-4bdb-bee9-110fd9cfee44 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:52.839562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6b0d5589-8a3d-4006-ba43-c2053d993836 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:52.848884 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6b0d5589-8a3d-4006-ba43-c2053d993836 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.542225 May 28 04:47:52.850103 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1574/3289] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:52 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:52.875407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f90a29ca-f70e-4b19-b79f-636f8cddb328 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:52.876018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f90a29ca-f70e-4b19-b79f-636f8cddb328 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:52.887055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f90a29ca-f70e-4b19-b79f-636f8cddb328 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:52.887659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f90a29ca-f70e-4b19-b79f-636f8cddb328 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:52.888552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f90a29ca-f70e-4b19-b79f-636f8cddb328 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:52.889117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f90a29ca-f70e-4b19-b79f-636f8cddb328 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:53.063103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-21d780fe-6ef9-4bdb-bee9-110fd9cfee44 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:53.071207 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-21d780fe-6ef9-4bdb-bee9-110fd9cfee44 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1324 microversion: 2.1 time: 0.288307 May 28 04:47:53.071788 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1716/3290] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:52 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:53.076498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-95b151ef-3cba-4729-9435-88711031bd78 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:53.077102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-95b151ef-3cba-4729-9435-88711031bd78 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:53.083695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-95b151ef-3cba-4729-9435-88711031bd78 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:53.086304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-95b151ef-3cba-4729-9435-88711031bd78 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:53.086304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-95b151ef-3cba-4729-9435-88711031bd78 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:53.086304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-95b151ef-3cba-4729-9435-88711031bd78 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:53.258779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f90a29ca-f70e-4b19-b79f-636f8cddb328 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:53.270340 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f90a29ca-f70e-4b19-b79f-636f8cddb328 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.398443 May 28 04:47:53.274296 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1575/3291] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:52 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:53.287071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-58d08eea-5e1a-4509-b695-396532b81cf7 req-a7b1fdd9-7d21-4df4-b2f7-a70a102aa55c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a2e64b-2bf0-4d17-b81e-f9f79e81db22", "tag": "6ae6c5f3-0e9e-40e2-b604-fda1641b7b5c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:53.310494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-58d08eea-5e1a-4509-b695-396532b81cf7 req-a7b1fdd9-7d21-4df4-b2f7-a70a102aa55c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:53.310973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-58d08eea-5e1a-4509-b695-396532b81cf7 req-a7b1fdd9-7d21-4df4-b2f7-a70a102aa55c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:53.333494 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-58d08eea-5e1a-4509-b695-396532b81cf7 req-a7b1fdd9-7d21-4df4-b2f7-a70a102aa55c service nova] Creating event network-changed:6ae6c5f3-0e9e-40e2-b604-fda1641b7b5c for instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 on n-h2-843700-1 May 28 04:47:53.349206 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-58d08eea-5e1a-4509-b695-396532b81cf7 req-a7b1fdd9-7d21-4df4-b2f7-a70a102aa55c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072759 May 28 04:47:53.352389 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1576/3292] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:53.359579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a2d86792-020e-4ce7-a796-6593ff245741 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:53.366746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a2d86792-020e-4ce7-a796-6593ff245741 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:53.382266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2d86792-020e-4ce7-a796-6593ff245741 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:53.383609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2d86792-020e-4ce7-a796-6593ff245741 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:53.388061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2d86792-020e-4ce7-a796-6593ff245741 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:53.388525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2d86792-020e-4ce7-a796-6593ff245741 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:53.417992 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-95b151ef-3cba-4729-9435-88711031bd78 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:53.429324 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-95b151ef-3cba-4729-9435-88711031bd78 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4" status: 200 len: 1478 microversion: 2.1 time: 0.356497 May 28 04:47:53.430240 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1717/3293] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:53 2022] GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4 => generated 1478 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:53.449105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2b8adc60-9ae5-426f-bec4-33ec43e5dc2a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1060840657"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:53.450699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2b8adc60-9ae5-426f-bec4-33ec43e5dc2a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:53.458330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b8adc60-9ae5-426f-bec4-33ec43e5dc2a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:53.465066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b8adc60-9ae5-426f-bec4-33ec43e5dc2a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:53.465066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b8adc60-9ae5-426f-bec4-33ec43e5dc2a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:53.465066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b8adc60-9ae5-426f-bec4-33ec43e5dc2a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:53.498885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:53.677437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a2d86792-020e-4ce7-a796-6593ff245741 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:53.703414 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a2d86792-020e-4ce7-a796-6593ff245741 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.347852 May 28 04:47:53.708746 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1577/3294] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:53 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:53.726302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d22cade2-8dc4-48c0-9f0d-9ba630b1ed46 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:53.727350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d22cade2-8dc4-48c0-9f0d-9ba630b1ed46 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:53.738278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d22cade2-8dc4-48c0-9f0d-9ba630b1ed46 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:53.742531 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d22cade2-8dc4-48c0-9f0d-9ba630b1ed46 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:53.743905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d22cade2-8dc4-48c0-9f0d-9ba630b1ed46 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:53.745383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d22cade2-8dc4-48c0-9f0d-9ba630b1ed46 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:53.942285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d22cade2-8dc4-48c0-9f0d-9ba630b1ed46 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:53.951292 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d22cade2-8dc4-48c0-9f0d-9ba630b1ed46 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.229307 May 28 04:47:53.962396 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1578/3295] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:53 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:53.973503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eeb9d23b-4cd3-4b7b-8252-f688729193cb tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:53.974136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eeb9d23b-4cd3-4b7b-8252-f688729193cb tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: e484efaa-4e49-47b4-a969-1135ed7ac02e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:53.988898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eeb9d23b-4cd3-4b7b-8252-f688729193cb tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:53.989357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eeb9d23b-4cd3-4b7b-8252-f688729193cb tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:53.990153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eeb9d23b-4cd3-4b7b-8252-f688729193cb tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:53.995853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eeb9d23b-4cd3-4b7b-8252-f688729193cb tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:54.204399 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2b8adc60-9ae5-426f-bec4-33ec43e5dc2a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "POST /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4/action" status: 202 len: 0 microversion: 2.1 time: 0.760446 May 28 04:47:54.206048 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1718/3296] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:53 2022] POST /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4/action => generated 0 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 04:47:54.214860 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-92ce478f-730c-4e92-bf83-0c74a3a0c5f3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:54.216623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-92ce478f-730c-4e92-bf83-0c74a3a0c5f3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:54.225006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-92ce478f-730c-4e92-bf83-0c74a3a0c5f3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:54.225535 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-92ce478f-730c-4e92-bf83-0c74a3a0c5f3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:54.226572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-92ce478f-730c-4e92-bf83-0c74a3a0c5f3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:54.227274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-92ce478f-730c-4e92-bf83-0c74a3a0c5f3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:54.293076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eeb9d23b-4cd3-4b7b-8252-f688729193cb tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:54.306896 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eeb9d23b-4cd3-4b7b-8252-f688729193cb tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e" status: 200 len: 1323 microversion: 2.1 time: 0.341724 May 28 04:47:54.318013 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1579/3297] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:53 2022] GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e => generated 1323 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:54.325371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-0f605879-b2c1-425f-bb91-80159f4cde78 req-85b72070-fc70-4878-bfd5-24f4ef1c9e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e34a513-f606-4109-942e-e8ddd9145ea5", "name": "network-vif-plugged", "status": "completed", "tag": "283cc1e0-d886-4407-8227-a9d9bcad50e6"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:54.341433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0f605879-b2c1-425f-bb91-80159f4cde78 req-85b72070-fc70-4878-bfd5-24f4ef1c9e5a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:54.342619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0f605879-b2c1-425f-bb91-80159f4cde78 req-85b72070-fc70-4878-bfd5-24f4ef1c9e5a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:54.360688 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-0f605879-b2c1-425f-bb91-80159f4cde78 req-85b72070-fc70-4878-bfd5-24f4ef1c9e5a service nova] Creating event network-vif-plugged:283cc1e0-d886-4407-8227-a9d9bcad50e6 for instance 7e34a513-f606-4109-942e-e8ddd9145ea5 on n-h1-843700-1 May 28 04:47:54.366676 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-0f605879-b2c1-425f-bb91-80159f4cde78 req-85b72070-fc70-4878-bfd5-24f4ef1c9e5a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055707 May 28 04:47:54.367867 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1580/3298] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:54.377497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eb08b2cb-66db-49a0-a481-82955fd3ce3e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:54.380566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eb08b2cb-66db-49a0-a481-82955fd3ce3e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:54.389460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb08b2cb-66db-49a0-a481-82955fd3ce3e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:54.392009 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb08b2cb-66db-49a0-a481-82955fd3ce3e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:54.392972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb08b2cb-66db-49a0-a481-82955fd3ce3e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:54.393538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb08b2cb-66db-49a0-a481-82955fd3ce3e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:54.491798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-92ce478f-730c-4e92-bf83-0c74a3a0c5f3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Locking {{(pid=126044) lock /opt/stack/nova/nova/compute/api.py:4700}} May 28 04:47:54.675047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eb08b2cb-66db-49a0-a481-82955fd3ce3e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:54.683140 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eb08b2cb-66db-49a0-a481-82955fd3ce3e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1324 microversion: 2.1 time: 0.313460 May 28 04:47:54.683735 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1581/3299] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:54 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1324 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:54.688941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2ece9ddb-c2a6-470b-a10e-737d2c611c98 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7707507160>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:54.720235 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-92ce478f-730c-4e92-bf83-0c74a3a0c5f3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action" status: 202 len: 0 microversion: 2.1 time: 0.512189 May 28 04:47:54.721028 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1719/3300] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:54 2022] POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:47:54.731422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-dfc012a5-4b91-4183-8d75-4ddc7a275028 req-88b35736-482d-4d83-81c9-936b181b9d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70f5df3-aa9d-4a76-bf08-d7d3074061c1", "tag": "c17b7d12-ad1e-4b36-a7bb-01c82a4c12ab"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:54.740199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-dfc012a5-4b91-4183-8d75-4ddc7a275028 req-88b35736-482d-4d83-81c9-936b181b9d65 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:54.741007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-dfc012a5-4b91-4183-8d75-4ddc7a275028 req-88b35736-482d-4d83-81c9-936b181b9d65 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:54.741952 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2ece9ddb-c2a6-470b-a10e-737d2c611c98 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 200 len: 1438 microversion: 2.1 time: 0.057098 May 28 04:47:54.748237 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1582/3301] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:54 2022] GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 1438 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:54.753111 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-dfc012a5-4b91-4183-8d75-4ddc7a275028 req-88b35736-482d-4d83-81c9-936b181b9d65 service nova] Creating event network-changed:c17b7d12-ad1e-4b36-a7bb-01c82a4c12ab for instance a70f5df3-aa9d-4a76-bf08-d7d3074061c1 on n-h1-843700-1 May 28 04:47:54.753302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f21eef77-cc0b-4008-8c8f-d3723ed8242b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:54.753954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f21eef77-cc0b-4008-8c8f-d3723ed8242b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:54.758500 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-dfc012a5-4b91-4183-8d75-4ddc7a275028 req-88b35736-482d-4d83-81c9-936b181b9d65 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036112 May 28 04:47:54.759641 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1720/3302] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:54.765190 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f21eef77-cc0b-4008-8c8f-d3723ed8242b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:54.765659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f21eef77-cc0b-4008-8c8f-d3723ed8242b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:54.766460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f21eef77-cc0b-4008-8c8f-d3723ed8242b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:54.766908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f21eef77-cc0b-4008-8c8f-d3723ed8242b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:54.771604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:54.904921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f21eef77-cc0b-4008-8c8f-d3723ed8242b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:54.921173 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f21eef77-cc0b-4008-8c8f-d3723ed8242b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.165517 May 28 04:47:54.921173 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1583/3303] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:54 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:54.932592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4f2c6dbc-92b9-4958-a811-b06c9e2e8ab8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:54.939019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f2c6dbc-92b9-4958-a811-b06c9e2e8ab8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:54.939512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f2c6dbc-92b9-4958-a811-b06c9e2e8ab8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:55.011020 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-4f2c6dbc-92b9-4958-a811-b06c9e2e8ab8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] HTTP exception thrown: Instance 215a4357-1792-4f6e-ae11-f8574b806b73 is locked May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4f2c6dbc-92b9-4958-a811-b06c9e2e8ab8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Request method failure captured: May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action HTTP/1.1 May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 15 May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaiOBPq9qQrr95jSEOmRbogZ9t59pbtlXtSw81aS7-xhKzdjgN5RN9WIUU9s438FP46672OAQzJO5i-wir1g5z9E4w9mqkNRxgW8mIzqzjgGHh1XhcA4EQFEapFLU_4K_QXm_DQQpav1ycUA8keSbjSO649hYoTB4xij7c04YtdKQ_4 May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: b0c48bf20efd4291b37e616c658f96ff May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerActionsTestJSON-1958751992 May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerActionsTestJSON-1958751992 May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: b0c48bf20efd4291b37e616c658f96ff May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1958751992 May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerActionsTestJSON-1958751992-project May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 6272045226334bcf8b49a0aa41a07b95 May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerActionsTestJSON-1958751992-project May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: {"os-stop": {}} May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 215a4357-1792-4f6e-ae11-f8574b806b73 is locked May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '215a4357-1792-4f6e-ae11-f8574b806b73', 'body': {'os-stop': {}}} May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 215a4357-1792-4f6e-ae11-f8574b806b73 is locked May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 215a4357-1792-4f6e-ae11-f8574b806b73 is locked May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 215a4357-1792-4f6e-ae11-f8574b806b73 is locked May 28 04:47:55.012678 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:55.026865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4f2c6dbc-92b9-4958-a811-b06c9e2e8ab8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Returning 409 to user: Instance 215a4357-1792-4f6e-ae11-f8574b806b73 is locked {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:47:55.026865 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4f2c6dbc-92b9-4958-a811-b06c9e2e8ab8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action" status: 409 len: 107 microversion: 2.1 time: 0.086265 May 28 04:47:55.026865 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1721/3304] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:54 2022] POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action => generated 107 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 04:47:55.027096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f1085182-ec37-426e-b77f-8e2568846477 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:55.027096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f1085182-ec37-426e-b77f-8e2568846477 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:55.031488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1085182-ec37-426e-b77f-8e2568846477 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:55.031488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1085182-ec37-426e-b77f-8e2568846477 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:55.032282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1085182-ec37-426e-b77f-8e2568846477 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:55.032723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1085182-ec37-426e-b77f-8e2568846477 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:55.136264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:55.260874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f1085182-ec37-426e-b77f-8e2568846477 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Unlocking {{(pid=126043) unlock /opt/stack/nova/nova/compute/api.py:4729}} May 28 04:47:55.326097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2844586e-f41d-437d-80e9-42dcd1033216 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:55.327593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2844586e-f41d-437d-80e9-42dcd1033216 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: e484efaa-4e49-47b4-a969-1135ed7ac02e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:55.336288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2844586e-f41d-437d-80e9-42dcd1033216 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:55.337291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2844586e-f41d-437d-80e9-42dcd1033216 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:55.338243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2844586e-f41d-437d-80e9-42dcd1033216 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:55.339400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2844586e-f41d-437d-80e9-42dcd1033216 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:55.449378 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f1085182-ec37-426e-b77f-8e2568846477 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action" status: 202 len: 0 microversion: 2.1 time: 0.427735 May 28 04:47:55.455033 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1584/3305] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:55 2022] POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:47:55.463073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-c33dca6d-add7-4081-93ec-87996cfa63c2 req-36a66977-0282-47a9-8fbd-b0fd0fcfecb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e484efaa-4e49-47b4-a969-1135ed7ac02e", "tag": "ebb15e41-1f07-47a6-81d5-2a1bf4ab992b"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:55.481685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c33dca6d-add7-4081-93ec-87996cfa63c2 req-36a66977-0282-47a9-8fbd-b0fd0fcfecb6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:55.482149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c33dca6d-add7-4081-93ec-87996cfa63c2 req-36a66977-0282-47a9-8fbd-b0fd0fcfecb6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:55.513317 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-c33dca6d-add7-4081-93ec-87996cfa63c2 req-36a66977-0282-47a9-8fbd-b0fd0fcfecb6 service nova] Creating event network-changed:ebb15e41-1f07-47a6-81d5-2a1bf4ab992b for instance e484efaa-4e49-47b4-a969-1135ed7ac02e on n-h2-843700-1 May 28 04:47:55.518456 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-c33dca6d-add7-4081-93ec-87996cfa63c2 req-36a66977-0282-47a9-8fbd-b0fd0fcfecb6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063637 May 28 04:47:55.519470 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1585/3306] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:55.526471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b50239cf-38b5-48b6-851f-9d5c8773bf8b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:55.542054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b50239cf-38b5-48b6-851f-9d5c8773bf8b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:55.542918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b50239cf-38b5-48b6-851f-9d5c8773bf8b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:55.595502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b50239cf-38b5-48b6-851f-9d5c8773bf8b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Going to try to stop instance {{(pid=126043) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 04:47:55.605638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2844586e-f41d-437d-80e9-42dcd1033216 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:55.616835 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2844586e-f41d-437d-80e9-42dcd1033216 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e" status: 200 len: 1323 microversion: 2.1 time: 0.293721 May 28 04:47:55.627893 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1722/3307] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:55 2022] GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e => generated 1323 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:55.714612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8e681ef3-f08d-4902-aac3-2c6f80fb7794 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:55.714612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8e681ef3-f08d-4902-aac3-2c6f80fb7794 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:55.714612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8e681ef3-f08d-4902-aac3-2c6f80fb7794 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:55.714612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8e681ef3-f08d-4902-aac3-2c6f80fb7794 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:55.714612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8e681ef3-f08d-4902-aac3-2c6f80fb7794 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:55.714612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8e681ef3-f08d-4902-aac3-2c6f80fb7794 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:55.861349 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b50239cf-38b5-48b6-851f-9d5c8773bf8b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action" status: 202 len: 0 microversion: 2.1 time: 0.340127 May 28 04:47:55.862360 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1586/3308] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:55 2022] POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:47:55.869374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-326b4de3-354d-4e10-815d-4338ad09e31e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f77075075e0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:55.921398 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-326b4de3-354d-4e10-815d-4338ad09e31e tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 200 len: 1438 microversion: 2.1 time: 0.057406 May 28 04:47:55.922316 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1587/3309] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:55 2022] GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 1438 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:55.927013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ca77c825-e57a-4d00-bc97-e3022d2c3f8c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:55.927749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ca77c825-e57a-4d00-bc97-e3022d2c3f8c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:55.935088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca77c825-e57a-4d00-bc97-e3022d2c3f8c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:55.935557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca77c825-e57a-4d00-bc97-e3022d2c3f8c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:55.937081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca77c825-e57a-4d00-bc97-e3022d2c3f8c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:55.937547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca77c825-e57a-4d00-bc97-e3022d2c3f8c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:56.122716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8e681ef3-f08d-4902-aac3-2c6f80fb7794 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:56.132071 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8e681ef3-f08d-4902-aac3-2c6f80fb7794 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1324 microversion: 2.1 time: 0.435741 May 28 04:47:56.146013 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1723/3310] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:55 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1324 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:56.214316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ca77c825-e57a-4d00-bc97-e3022d2c3f8c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:56.221644 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ca77c825-e57a-4d00-bc97-e3022d2c3f8c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1680 microversion: 2.1 time: 0.297372 May 28 04:47:56.225569 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1588/3311] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:55 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1680 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:56.636878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f386cba3-8364-4ce5-9a38-1602a945119d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:56.638142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f386cba3-8364-4ce5-9a38-1602a945119d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: e484efaa-4e49-47b4-a969-1135ed7ac02e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:56.646380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f386cba3-8364-4ce5-9a38-1602a945119d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:56.646921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f386cba3-8364-4ce5-9a38-1602a945119d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:56.647981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f386cba3-8364-4ce5-9a38-1602a945119d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:56.648497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f386cba3-8364-4ce5-9a38-1602a945119d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:56.796167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f386cba3-8364-4ce5-9a38-1602a945119d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:56.804399 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f386cba3-8364-4ce5-9a38-1602a945119d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e" status: 200 len: 1323 microversion: 2.1 time: 0.173737 May 28 04:47:56.805278 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1724/3312] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:56 2022] GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e => generated 1323 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:56.941024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-387669f6-ee41-4b4e-a164-f75dbb036e57 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7707507ca0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:56.960664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=22 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:57.011193 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-387669f6-ee41-4b4e-a164-f75dbb036e57 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 200 len: 1438 microversion: 2.1 time: 0.080661 May 28 04:47:57.020042 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1589/3313] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:56 2022] GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 1438 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:57.157306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b1303ae7-f778-4e80-a1a8-d3e7ae9edae9 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:57.157923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b1303ae7-f778-4e80-a1a8-d3e7ae9edae9 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:57.164598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1303ae7-f778-4e80-a1a8-d3e7ae9edae9 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:57.165057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1303ae7-f778-4e80-a1a8-d3e7ae9edae9 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:57.165822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1303ae7-f778-4e80-a1a8-d3e7ae9edae9 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:57.166366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1303ae7-f778-4e80-a1a8-d3e7ae9edae9 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:57.242630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-12bb338c-4276-455f-8bc3-ee6c54135a44 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:57.243897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-12bb338c-4276-455f-8bc3-ee6c54135a44 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:57.258120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-12bb338c-4276-455f-8bc3-ee6c54135a44 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:57.258579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-12bb338c-4276-455f-8bc3-ee6c54135a44 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:57.259403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-12bb338c-4276-455f-8bc3-ee6c54135a44 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:57.259848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-12bb338c-4276-455f-8bc3-ee6c54135a44 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:57.539654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b1303ae7-f778-4e80-a1a8-d3e7ae9edae9 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:57.550406 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b1303ae7-f778-4e80-a1a8-d3e7ae9edae9 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1521 microversion: 2.1 time: 0.396888 May 28 04:47:57.551033 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1725/3314] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:57 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:57.583540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9ff89251-afaa-4c82-a064-922cd8869c88 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:57.586137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9ff89251-afaa-4c82-a064-922cd8869c88 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:57.595585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ff89251-afaa-4c82-a064-922cd8869c88 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:57.596277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ff89251-afaa-4c82-a064-922cd8869c88 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:57.597259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ff89251-afaa-4c82-a064-922cd8869c88 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:57.597869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ff89251-afaa-4c82-a064-922cd8869c88 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:57.625375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=12 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:57.693396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-12bb338c-4276-455f-8bc3-ee6c54135a44 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:57.702500 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-12bb338c-4276-455f-8bc3-ee6c54135a44 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1680 microversion: 2.1 time: 0.464775 May 28 04:47:57.703327 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1590/3315] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:57 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1680 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:57.825343 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-01261a9d-4fc3-4517-a52c-d0d9782842cf tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:57.826373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-01261a9d-4fc3-4517-a52c-d0d9782842cf tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: e484efaa-4e49-47b4-a969-1135ed7ac02e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:57.834409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-01261a9d-4fc3-4517-a52c-d0d9782842cf tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:57.835374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-01261a9d-4fc3-4517-a52c-d0d9782842cf tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:57.836565 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-01261a9d-4fc3-4517-a52c-d0d9782842cf tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:57.837216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-01261a9d-4fc3-4517-a52c-d0d9782842cf tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:57.917437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9ff89251-afaa-4c82-a064-922cd8869c88 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:57.934109 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9ff89251-afaa-4c82-a064-922cd8869c88 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1521 microversion: 2.1 time: 0.355772 May 28 04:47:57.934109 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1726/3316] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:57 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:57.955780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fd74bc2d-e335-43e9-bb39-3be2befe950d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-653141604"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:57.957202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fd74bc2d-e335-43e9-bb39-3be2befe950d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:57.966054 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd74bc2d-e335-43e9-bb39-3be2befe950d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:57.971459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd74bc2d-e335-43e9-bb39-3be2befe950d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:57.979778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd74bc2d-e335-43e9-bb39-3be2befe950d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:57.979778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd74bc2d-e335-43e9-bb39-3be2befe950d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:58.177992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-01261a9d-4fc3-4517-a52c-d0d9782842cf tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:58.186866 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-01261a9d-4fc3-4517-a52c-d0d9782842cf tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e" status: 200 len: 1323 microversion: 2.1 time: 0.368504 May 28 04:47:58.196444 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1591/3317] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:57 2022] GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e => generated 1323 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:47:58.205173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9963e95d-15aa-4b24-b4f3-901a72b638fb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701a91160>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:58.422515 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9963e95d-15aa-4b24-b4f3-901a72b638fb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 200 len: 1438 microversion: 2.1 time: 0.225520 May 28 04:47:58.435515 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1592/3318] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:58 2022] GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 1438 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:58.445768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-444df8eb-3ab7-4cb1-b683-4072211ff1b4 req-20aa01d2-4812-4de7-8af0-7f89d25d672e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a2e64b-2bf0-4d17-b81e-f9f79e81db22", "name": "network-vif-plugged", "status": "completed", "tag": "6ae6c5f3-0e9e-40e2-b604-fda1641b7b5c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:47:58.453066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:47:58.460445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-444df8eb-3ab7-4cb1-b683-4072211ff1b4 req-20aa01d2-4812-4de7-8af0-7f89d25d672e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:58.461176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-444df8eb-3ab7-4cb1-b683-4072211ff1b4 req-20aa01d2-4812-4de7-8af0-7f89d25d672e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:58.479525 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-444df8eb-3ab7-4cb1-b683-4072211ff1b4 req-20aa01d2-4812-4de7-8af0-7f89d25d672e service nova] Creating event network-vif-plugged:6ae6c5f3-0e9e-40e2-b604-fda1641b7b5c for instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 on n-h2-843700-1 May 28 04:47:58.504649 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-444df8eb-3ab7-4cb1-b683-4072211ff1b4 req-20aa01d2-4812-4de7-8af0-7f89d25d672e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058049 May 28 04:47:58.506789 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1593/3319] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:47:58.643474 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fd74bc2d-e335-43e9-bb39-3be2befe950d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "POST /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5/action" status: 202 len: 0 microversion: 2.1 time: 0.691391 May 28 04:47:58.663854 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1727/3320] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:47:57 2022] POST /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5/action => generated 0 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 04:47:58.671974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cdac12a0-2985-4bd7-8fcb-82947cdf77f5 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '.version_select at 0x7f77074618b0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:58.722102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3bb06f4e-d3f5-42dc-8f2d-125e5ddef872 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:58.723237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3bb06f4e-d3f5-42dc-8f2d-125e5ddef872 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:58.745196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3bb06f4e-d3f5-42dc-8f2d-125e5ddef872 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:58.746505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3bb06f4e-d3f5-42dc-8f2d-125e5ddef872 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:58.748517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3bb06f4e-d3f5-42dc-8f2d-125e5ddef872 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:58.750553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3bb06f4e-d3f5-42dc-8f2d-125e5ddef872 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:59.010873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3bb06f4e-d3f5-42dc-8f2d-125e5ddef872 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:59.019343 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3bb06f4e-d3f5-42dc-8f2d-125e5ddef872 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1680 microversion: 2.1 time: 0.302913 May 28 04:47:59.019922 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1728/3321] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:58 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1680 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:59.096218 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cdac12a0-2985-4bd7-8fcb-82947cdf77f5 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "DELETE /compute/v2.1/images/04c7af5f-3b1a-467f-8847-c4256f82abf7" status: 204 len: 0 microversion: 2.1 time: 0.430125 May 28 04:47:59.098232 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1594/3322] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:58 2022] DELETE /compute/v2.1/images/04c7af5f-3b1a-467f-8847-c4256f82abf7 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:47:59.106314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-96c9e6f7-c1dd-4de1-8b7f-097221ab2bae tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '.version_select at 0x7f77074e91f0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-96c9e6f7-c1dd-4de1-8b7f-097221ab2bae tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] HTTP exception thrown: Image not found. May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-96c9e6f7-c1dd-4de1-8b7f-097221ab2bae tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Request method failure captured: May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/images/04c7af5f-3b1a-467f-8847-c4256f82abf7 HTTP/1.1 May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikak47QAs5K06QhfhkIquusTq5B930GK2qX0_12di_Rh32YDa0oiawwGAqeo88DT65woz1MmOY2wmnqGoSlDi_TB5nkwOW_jtkf8bwl1MIAPkkOt7hgVlVdmgC8btNyj4GvAvNekqk5WajXo3d43lpqxKK68oDpAyv5Nz9V4rMhAcq7c May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 6b37465157dd44a09cffbbe57322d264 May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: exception: Image not found. May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '04c7af5f-3b1a-467f-8847-c4256f82abf7'} May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 04c7af5f-3b1a-467f-8847-c4256f82abf7 May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 28 04:47:59.134456 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 04c7af5f-3b1a-467f-8847-c4256f82abf7 could not be found. May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-96c9e6f7-c1dd-4de1-8b7f-097221ab2bae tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Returning 404 to user: Image not found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:47:59.139774 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-96c9e6f7-c1dd-4de1-8b7f-097221ab2bae tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/images/04c7af5f-3b1a-467f-8847-c4256f82abf7" status: 404 len: 62 microversion: 2.1 time: 0.033843 May 28 04:47:59.146355 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1729/3323] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:59 2022] GET /compute/v2.1/images/04c7af5f-3b1a-467f-8847-c4256f82abf7 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:47:59.146437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f01e9cbe-023b-4ecb-a4e9-f01356ed138c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:59.146437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f01e9cbe-023b-4ecb-a4e9-f01356ed138c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:59.156497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f01e9cbe-023b-4ecb-a4e9-f01356ed138c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:59.156959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f01e9cbe-023b-4ecb-a4e9-f01356ed138c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:59.157754 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f01e9cbe-023b-4ecb-a4e9-f01356ed138c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:59.158695 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f01e9cbe-023b-4ecb-a4e9-f01356ed138c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:59.206040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3bfe3a41-d68e-4949-bfa6-c3faf98957dc tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:59.206547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3bfe3a41-d68e-4949-bfa6-c3faf98957dc tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: e484efaa-4e49-47b4-a969-1135ed7ac02e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:47:59.221053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3bfe3a41-d68e-4949-bfa6-c3faf98957dc tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:59.221542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3bfe3a41-d68e-4949-bfa6-c3faf98957dc tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:59.222301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3bfe3a41-d68e-4949-bfa6-c3faf98957dc tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:47:59.222748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3bfe3a41-d68e-4949-bfa6-c3faf98957dc tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:47:59.500006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f01e9cbe-023b-4ecb-a4e9-f01356ed138c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:59.511215 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f01e9cbe-023b-4ecb-a4e9-f01356ed138c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1533 microversion: 2.1 time: 0.367563 May 28 04:47:59.514216 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1595/3324] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:59 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1533 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:59.528914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e0d58e29-479e-46b9-b460-aa5279640685 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f77010684c0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:47:59.618756 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e0d58e29-479e-46b9-b460-aa5279640685 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 200 len: 1438 microversion: 2.1 time: 0.103234 May 28 04:47:59.625025 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1596/3325] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:47:59 2022] GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 1438 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:47:59.667808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3bfe3a41-d68e-4949-bfa6-c3faf98957dc tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:47:59.685340 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3bfe3a41-d68e-4949-bfa6-c3faf98957dc tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e" status: 200 len: 1323 microversion: 2.1 time: 0.482798 May 28 04:47:59.697895 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1730/3326] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:47:59 2022] GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e => generated 1323 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:48:00.037820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bbf00422-03bc-4d0e-9a50-bc06b6604159 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:00.040026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bbf00422-03bc-4d0e-9a50-bc06b6604159 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:00.052198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bbf00422-03bc-4d0e-9a50-bc06b6604159 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:00.052663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bbf00422-03bc-4d0e-9a50-bc06b6604159 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:00.054361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bbf00422-03bc-4d0e-9a50-bc06b6604159 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:00.054816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bbf00422-03bc-4d0e-9a50-bc06b6604159 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:00.529060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-581881d3-d042-4729-977f-71dd21070dd7 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:00.530295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-581881d3-d042-4729-977f-71dd21070dd7 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:00.542117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-581881d3-d042-4729-977f-71dd21070dd7 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:00.545313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-581881d3-d042-4729-977f-71dd21070dd7 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:00.550787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-581881d3-d042-4729-977f-71dd21070dd7 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:00.552406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-581881d3-d042-4729-977f-71dd21070dd7 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:00.594237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:00.973698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bbf00422-03bc-4d0e-9a50-bc06b6604159 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:00.986583 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bbf00422-03bc-4d0e-9a50-bc06b6604159 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1680 microversion: 2.1 time: 0.953527 May 28 04:48:00.987665 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1597/3327] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:00 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1680 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:00.997830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-09f26752-8d27-4bf5-9a2b-1d4472227fe3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701068700>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:01.019044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-581881d3-d042-4729-977f-71dd21070dd7 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:01.056513 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-581881d3-d042-4729-977f-71dd21070dd7 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1539 microversion: 2.1 time: 0.532325 May 28 04:48:01.062017 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1731/3328] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:00 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1539 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:01.077547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8ab18f7a-9e91-477e-856b-19fa9efbba7b tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:01.082623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8ab18f7a-9e91-477e-856b-19fa9efbba7b tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: e484efaa-4e49-47b4-a969-1135ed7ac02e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:01.100800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ab18f7a-9e91-477e-856b-19fa9efbba7b tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:01.101509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ab18f7a-9e91-477e-856b-19fa9efbba7b tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:01.102523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ab18f7a-9e91-477e-856b-19fa9efbba7b tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:01.103356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ab18f7a-9e91-477e-856b-19fa9efbba7b tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:01.106093 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-09f26752-8d27-4bf5-9a2b-1d4472227fe3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 200 len: 1438 microversion: 2.1 time: 0.112765 May 28 04:48:01.107457 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1598/3329] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:48:00 2022] GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 1438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:01.404844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8ab18f7a-9e91-477e-856b-19fa9efbba7b tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:01.417922 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8ab18f7a-9e91-477e-856b-19fa9efbba7b tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e" status: 200 len: 1323 microversion: 2.1 time: 0.354268 May 28 04:48:01.420040 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1732/3330] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:01 2022] GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e => generated 1323 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:01.895809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-5308afac-94de-4732-a14e-904d79d8875f req-48b9a52b-7788-4ddd-b47a-776f00e0521e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e484efaa-4e49-47b4-a969-1135ed7ac02e", "name": "network-vif-plugged", "status": "completed", "tag": "ebb15e41-1f07-47a6-81d5-2a1bf4ab992b"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:01.919353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5308afac-94de-4732-a14e-904d79d8875f req-48b9a52b-7788-4ddd-b47a-776f00e0521e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:01.919353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5308afac-94de-4732-a14e-904d79d8875f req-48b9a52b-7788-4ddd-b47a-776f00e0521e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:01.957581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8e5bf80e-bc13-4cad-a322-89caedb0504f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:01.958280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8e5bf80e-bc13-4cad-a322-89caedb0504f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:01.977109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8e5bf80e-bc13-4cad-a322-89caedb0504f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:01.978421 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-5308afac-94de-4732-a14e-904d79d8875f req-48b9a52b-7788-4ddd-b47a-776f00e0521e service nova] Creating event network-vif-plugged:ebb15e41-1f07-47a6-81d5-2a1bf4ab992b for instance e484efaa-4e49-47b4-a969-1135ed7ac02e on n-h2-843700-1 May 28 04:48:01.980914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8e5bf80e-bc13-4cad-a322-89caedb0504f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:01.984951 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8e5bf80e-bc13-4cad-a322-89caedb0504f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:01.987158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8e5bf80e-bc13-4cad-a322-89caedb0504f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:01.987377 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-5308afac-94de-4732-a14e-904d79d8875f req-48b9a52b-7788-4ddd-b47a-776f00e0521e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094939 May 28 04:48:01.988217 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1599/3331] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:02.017454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b955d3db-e238-40a3-a4b7-7afd6b435382 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:02.021176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b955d3db-e238-40a3-a4b7-7afd6b435382 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:02.038583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b955d3db-e238-40a3-a4b7-7afd6b435382 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:02.040615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b955d3db-e238-40a3-a4b7-7afd6b435382 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:02.041680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b955d3db-e238-40a3-a4b7-7afd6b435382 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:02.044209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b955d3db-e238-40a3-a4b7-7afd6b435382 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:02.104083 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8e5bf80e-bc13-4cad-a322-89caedb0504f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69/ips" status: 200 len: 149 microversion: 2.1 time: 0.150435 May 28 04:48:02.111135 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1733/3332] 10.222.0.58 () {58 vars in 1247 bytes} [Sat May 28 04:48:01 2022] GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69/ips => generated 149 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:02.122249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2c404fe5-f746-4aad-8121-6b685406797c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:02.126974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2c404fe5-f746-4aad-8121-6b685406797c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:02.149293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c404fe5-f746-4aad-8121-6b685406797c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:02.149293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c404fe5-f746-4aad-8121-6b685406797c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:02.149293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c404fe5-f746-4aad-8121-6b685406797c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:02.149293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c404fe5-f746-4aad-8121-6b685406797c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:02.439463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b955d3db-e238-40a3-a4b7-7afd6b435382 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:02.439463 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b955d3db-e238-40a3-a4b7-7afd6b435382 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1680 microversion: 2.1 time: 0.419168 May 28 04:48:02.439463 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1600/3333] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:02 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1680 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:02.439463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b24ae412-63ab-4f59-ba34-d5c80826bfaa tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aec95bf2-d83c-4a61-bb37-c7cb89ebc076"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:02.439463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b24ae412-63ab-4f59-ba34-d5c80826bfaa tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:02.446758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b24ae412-63ab-4f59-ba34-d5c80826bfaa tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:02.447468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b24ae412-63ab-4f59-ba34-d5c80826bfaa tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:02.448748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b24ae412-63ab-4f59-ba34-d5c80826bfaa tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:02.449406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b24ae412-63ab-4f59-ba34-d5c80826bfaa tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:02.459376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2c404fe5-f746-4aad-8121-6b685406797c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:02.493229 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2c404fe5-f746-4aad-8121-6b685406797c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1539 microversion: 2.1 time: 0.380506 May 28 04:48:02.493842 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1734/3334] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:02 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1539 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:02.514091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a504bb2f-922a-4b95-9b09-2d2f4f011f2a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701b84af0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:02.701581 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-b24ae412-63ab-4f59-ba34-d5c80826bfaa tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] HTTP exception thrown: Invalid volume: volume aec95bf2-d83c-4a61-bb37-c7cb89ebc076 is already attached to instances: 0459f5ac-8ba7-47a4-9c7b-808496f08d52 May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b24ae412-63ab-4f59-ba34-d5c80826bfaa tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Request method failure captured: May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69/os-volume_attachments HTTP/1.1 May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 74 May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikajS0ZZaXFlax6A342ymJ-aQoGJlvna1xZy9bO84b3D9OriaYICvIupIZdjiNLcHyTC7V-bCXuJxYAHanDCccz0wxij-I7blA2wa6CB5mbuJxMVXKjiUcQwy4f7KRJtSQW8-6D6CRl3EsAa-9i5aRJ6Odwpn_PfoRh6K409eAlefhoM May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 025cb09c79a147b3a648c950edcd1dc3 May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: {"volumeAttachment": {"volumeId": "aec95bf2-d83c-4a61-bb37-c7cb89ebc076"}} May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid volume: volume aec95bf2-d83c-4a61-bb37-c7cb89ebc076 is already attached to instances: 0459f5ac-8ba7-47a4-9c7b-808496f08d52 May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'server_id': '06f67b96-191c-4c64-96bf-e1e61c33ee69', 'body': {'volumeAttachment': {'volumeId': 'aec95bf2-d83c-4a61-bb37-c7cb89ebc076'}}} May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume aec95bf2-d83c-4a61-bb37-c7cb89ebc076 is already attached to instances: 0459f5ac-8ba7-47a4-9c7b-808496f08d52 May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:48:02.712248 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:48:02.719446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:48:02.719446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:48:02.719446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 28 04:48:02.719446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 28 04:48:02.719446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume aec95bf2-d83c-4a61-bb37-c7cb89ebc076 is already attached to instances: 0459f5ac-8ba7-47a4-9c7b-808496f08d52 May 28 04:48:02.719446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:02.719446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:02.719446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:02.719446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:02.719446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:02.719446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:02.719446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:02.719446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:02.719446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume aec95bf2-d83c-4a61-bb37-c7cb89ebc076 is already attached to instances: 0459f5ac-8ba7-47a4-9c7b-808496f08d52 May 28 04:48:02.719446 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:02.720763 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a504bb2f-922a-4b95-9b09-2d2f4f011f2a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 200 len: 1438 microversion: 2.1 time: 0.219686 May 28 04:48:02.721470 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1735/3335] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:48:02 2022] GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 1438 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:02.748899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b24ae412-63ab-4f59-ba34-d5c80826bfaa tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Returning 400 to user: Invalid volume: volume aec95bf2-d83c-4a61-bb37-c7cb89ebc076 is already attached to instances: 0459f5ac-8ba7-47a4-9c7b-808496f08d52 {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:02.762490 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b24ae412-63ab-4f59-ba34-d5c80826bfaa tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "POST /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.339354 May 28 04:48:02.767358 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1601/3336] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 04:48:02 2022] POST /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69/os-volume_attachments => generated 174 bytes in 345 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:48:02.788380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5b36cfd9-5517-447a-9048-ec964f81b638 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:02.802921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5b36cfd9-5517-447a-9048-ec964f81b638 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: e484efaa-4e49-47b4-a969-1135ed7ac02e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:02.846915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-17a5d28e-e052-4946-ac2f-0debfc84c8b4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:02.864758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-17a5d28e-e052-4946-ac2f-0debfc84c8b4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:02.877463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b36cfd9-5517-447a-9048-ec964f81b638 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:02.881140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b36cfd9-5517-447a-9048-ec964f81b638 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:02.888439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b36cfd9-5517-447a-9048-ec964f81b638 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:02.892358 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b36cfd9-5517-447a-9048-ec964f81b638 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:02.917572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17a5d28e-e052-4946-ac2f-0debfc84c8b4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:02.917572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17a5d28e-e052-4946-ac2f-0debfc84c8b4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:02.917572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17a5d28e-e052-4946-ac2f-0debfc84c8b4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:02.917572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17a5d28e-e052-4946-ac2f-0debfc84c8b4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:03.033714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-17a5d28e-e052-4946-ac2f-0debfc84c8b4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:48:03.326298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:03.401894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5b36cfd9-5517-447a-9048-ec964f81b638 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:03.457004 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5b36cfd9-5517-447a-9048-ec964f81b638 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e" status: 200 len: 1323 microversion: 2.1 time: 0.711076 May 28 04:48:03.457986 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1736/3337] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:02 2022] GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e => generated 1323 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:03.477235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-12ee1771-dc0a-4e6e-8756-f6f203ede194 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:03.481003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-12ee1771-dc0a-4e6e-8756-f6f203ede194 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:03.495929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-12ee1771-dc0a-4e6e-8756-f6f203ede194 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:03.500168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-12ee1771-dc0a-4e6e-8756-f6f203ede194 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:03.501552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-12ee1771-dc0a-4e6e-8756-f6f203ede194 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:03.502571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-12ee1771-dc0a-4e6e-8756-f6f203ede194 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:03.616721 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-17a5d28e-e052-4946-ac2f-0debfc84c8b4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "DELETE /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69" status: 204 len: 0 microversion: 2.1 time: 0.843227 May 28 04:48:03.617651 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1602/3338] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:48:02 2022] DELETE /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:48:03.629565 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b4e010de-1014-42d1-a456-ca9d4561d4ca tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:03.631185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b4e010de-1014-42d1-a456-ca9d4561d4ca tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:03.660052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b4e010de-1014-42d1-a456-ca9d4561d4ca tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:03.661032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b4e010de-1014-42d1-a456-ca9d4561d4ca tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:03.663187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b4e010de-1014-42d1-a456-ca9d4561d4ca tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:03.664182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b4e010de-1014-42d1-a456-ca9d4561d4ca tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:03.687684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-12ee1771-dc0a-4e6e-8756-f6f203ede194 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:03.696529 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-12ee1771-dc0a-4e6e-8756-f6f203ede194 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1680 microversion: 2.1 time: 0.234229 May 28 04:48:03.700290 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1737/3339] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:03 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1680 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:03.706667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-194cb887-54fe-4773-9752-be98f8debd9a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:03.714224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-194cb887-54fe-4773-9752-be98f8debd9a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:03.724724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-194cb887-54fe-4773-9752-be98f8debd9a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:03.730444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-194cb887-54fe-4773-9752-be98f8debd9a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:03.732264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-194cb887-54fe-4773-9752-be98f8debd9a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:03.738204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-194cb887-54fe-4773-9752-be98f8debd9a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:04.019236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b4e010de-1014-42d1-a456-ca9d4561d4ca tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:04.028909 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b4e010de-1014-42d1-a456-ca9d4561d4ca tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1521 microversion: 2.1 time: 0.407685 May 28 04:48:04.032047 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1603/3340] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:03 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1521 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:04.036878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-585a0cdb-5120-43ee-a85b-46e41463585b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f770108c040>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:04.135530 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-585a0cdb-5120-43ee-a85b-46e41463585b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 200 len: 1438 microversion: 2.1 time: 0.100559 May 28 04:48:04.136340 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1604/3341] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:48:04 2022] GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 1438 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:04.143435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-d9ebb8c1-7ae9-4b8a-9416-77ec27260941 req-b93eb6ca-16e4-4173-83af-4d1601e04644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7dda089-96b9-4547-b637-d2caa776a3d4", "name": "network-vif-plugged", "status": "completed", "tag": "2aba3595-8739-4d74-a7db-3baf89b855be"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:04.154421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-194cb887-54fe-4773-9752-be98f8debd9a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:04.162870 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-194cb887-54fe-4773-9752-be98f8debd9a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69" status: 200 len: 1679 microversion: 2.1 time: 0.461150 May 28 04:48:04.163505 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1738/3342] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:03 2022] GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 => generated 1679 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:04.168847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d9ebb8c1-7ae9-4b8a-9416-77ec27260941 req-b93eb6ca-16e4-4173-83af-4d1601e04644 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:04.170037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d9ebb8c1-7ae9-4b8a-9416-77ec27260941 req-b93eb6ca-16e4-4173-83af-4d1601e04644 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:04.178319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-269d7449-eab9-40bc-9cf5-170ef8220d1c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:04.179120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-269d7449-eab9-40bc-9cf5-170ef8220d1c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:04.190496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-269d7449-eab9-40bc-9cf5-170ef8220d1c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:04.197047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-269d7449-eab9-40bc-9cf5-170ef8220d1c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:04.197047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-269d7449-eab9-40bc-9cf5-170ef8220d1c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:04.197047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-269d7449-eab9-40bc-9cf5-170ef8220d1c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:04.232655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-269d7449-eab9-40bc-9cf5-170ef8220d1c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:48:04.233745 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-d9ebb8c1-7ae9-4b8a-9416-77ec27260941 req-b93eb6ca-16e4-4173-83af-4d1601e04644 service nova] Creating event network-vif-plugged:2aba3595-8739-4d74-a7db-3baf89b855be for instance b7dda089-96b9-4547-b637-d2caa776a3d4 on n-h1-843700-1 May 28 04:48:04.249372 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-d9ebb8c1-7ae9-4b8a-9416-77ec27260941 req-b93eb6ca-16e4-4173-83af-4d1601e04644 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110210 May 28 04:48:04.251300 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1605/3343] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:04.482533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f965fe09-e1a3-476e-9e0b-c3f6ed25124c tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:04.483374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f965fe09-e1a3-476e-9e0b-c3f6ed25124c tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: e484efaa-4e49-47b4-a969-1135ed7ac02e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:04.507324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f965fe09-e1a3-476e-9e0b-c3f6ed25124c tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:04.507796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f965fe09-e1a3-476e-9e0b-c3f6ed25124c tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:04.508591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f965fe09-e1a3-476e-9e0b-c3f6ed25124c tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:04.512934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f965fe09-e1a3-476e-9e0b-c3f6ed25124c tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:04.595265 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-269d7449-eab9-40bc-9cf5-170ef8220d1c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 204 len: 0 microversion: 2.1 time: 0.420752 May 28 04:48:04.596527 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1739/3344] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:48:04 2022] DELETE /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:48:04.606103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dc736c29-7365-45fc-aa4a-8c05da381d63 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:04.607362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dc736c29-7365-45fc-aa4a-8c05da381d63 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:04.620760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc736c29-7365-45fc-aa4a-8c05da381d63 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:04.624268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc736c29-7365-45fc-aa4a-8c05da381d63 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:04.624268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc736c29-7365-45fc-aa4a-8c05da381d63 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:04.624268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc736c29-7365-45fc-aa4a-8c05da381d63 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:05.099904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dc736c29-7365-45fc-aa4a-8c05da381d63 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:05.110077 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dc736c29-7365-45fc-aa4a-8c05da381d63 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1527 microversion: 2.1 time: 0.508483 May 28 04:48:05.110826 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1740/3345] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:04 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1527 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:05.135870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dc51ca82-fb2a-4ff0-91f7-056bfca8544b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:05.153840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dc51ca82-fb2a-4ff0-91f7-056bfca8544b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:05.167621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc51ca82-fb2a-4ff0-91f7-056bfca8544b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:05.187290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc51ca82-fb2a-4ff0-91f7-056bfca8544b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:05.188401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc51ca82-fb2a-4ff0-91f7-056bfca8544b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:05.189053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc51ca82-fb2a-4ff0-91f7-056bfca8544b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:05.243169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f965fe09-e1a3-476e-9e0b-c3f6ed25124c tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:05.254702 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f965fe09-e1a3-476e-9e0b-c3f6ed25124c tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e" status: 200 len: 1515 microversion: 2.1 time: 0.781353 May 28 04:48:05.255428 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1606/3346] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:04 2022] GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e => generated 1515 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:48:05.274205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d5095037-d69c-49bb-9bb2-e0333e69f569 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701e0f430>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:05.333061 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d5095037-d69c-49bb-9bb2-e0333e69f569 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 200 len: 1438 microversion: 2.1 time: 0.071373 May 28 04:48:05.334181 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1607/3347] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:48:05 2022] GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 1438 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:05.340601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-497f1763-63b3-42dc-b4cf-e40580fef0a6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:05.341445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-497f1763-63b3-42dc-b4cf-e40580fef0a6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:05.347988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-497f1763-63b3-42dc-b4cf-e40580fef0a6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:05.348740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-497f1763-63b3-42dc-b4cf-e40580fef0a6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:05.350037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-497f1763-63b3-42dc-b4cf-e40580fef0a6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:05.350936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-497f1763-63b3-42dc-b4cf-e40580fef0a6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:05.691611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dc51ca82-fb2a-4ff0-91f7-056bfca8544b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:05.709508 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dc51ca82-fb2a-4ff0-91f7-056bfca8544b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1680 microversion: 2.1 time: 0.585018 May 28 04:48:05.712686 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1741/3348] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:05 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1680 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:05.724887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f7d6856b-9c1c-4cc8-936a-d1f8244c6a6d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:05.730188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f7d6856b-9c1c-4cc8-936a-d1f8244c6a6d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: a70f5df3-aa9d-4a76-bf08-d7d3074061c1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:05.740999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7d6856b-9c1c-4cc8-936a-d1f8244c6a6d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:05.741468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7d6856b-9c1c-4cc8-936a-d1f8244c6a6d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:05.742559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7d6856b-9c1c-4cc8-936a-d1f8244c6a6d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:05.743024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7d6856b-9c1c-4cc8-936a-d1f8244c6a6d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:05.754905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-497f1763-63b3-42dc-b4cf-e40580fef0a6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:05.766407 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-497f1763-63b3-42dc-b4cf-e40580fef0a6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69" status: 200 len: 1679 microversion: 2.1 time: 0.430659 May 28 04:48:05.767512 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1608/3349] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:05 2022] GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 => generated 1679 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:05.949919 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f7d6856b-9c1c-4cc8-936a-d1f8244c6a6d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:05.958088 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f7d6856b-9c1c-4cc8-936a-d1f8244c6a6d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1" status: 200 len: 1323 microversion: 2.1 time: 0.243970 May 28 04:48:05.958968 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1742/3350] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:05 2022] GET /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1 => generated 1323 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:06.004453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-492bef65-cf5f-47a7-bf63-7e25dfc54af6 tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] Action: 'create', calling method: .version_select at 0x7f770108c280>, body: {"pool": null} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:06.134549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a7257144-164f-4ed9-ab10-45b78f3a8f7f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:06.135291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a7257144-164f-4ed9-ab10-45b78f3a8f7f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:06.142856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7257144-164f-4ed9-ab10-45b78f3a8f7f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:06.143766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7257144-164f-4ed9-ab10-45b78f3a8f7f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:06.146529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7257144-164f-4ed9-ab10-45b78f3a8f7f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:06.146529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7257144-164f-4ed9-ab10-45b78f3a8f7f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:07.452622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a7257144-164f-4ed9-ab10-45b78f3a8f7f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:07.463656 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a7257144-164f-4ed9-ab10-45b78f3a8f7f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1527 microversion: 2.1 time: 1.339630 May 28 04:48:07.466824 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1743/3351] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:06 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1527 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:48:07.480670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-5a758303-255b-44a2-82bd-daec48a8aa4d req-2c0b0168-a410-4f3c-aee3-3e2b4b0df5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70f5df3-aa9d-4a76-bf08-d7d3074061c1", "name": "network-vif-plugged", "status": "completed", "tag": "c17b7d12-ad1e-4b36-a7bb-01c82a4c12ab"}, {"server_uuid": "7e34a513-f606-4109-942e-e8ddd9145ea5", "name": "network-vif-plugged", "status": "completed", "tag": "283cc1e0-d886-4407-8227-a9d9bcad50e6"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:07.500418 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5a758303-255b-44a2-82bd-daec48a8aa4d req-2c0b0168-a410-4f3c-aee3-3e2b4b0df5f0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:07.500871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5a758303-255b-44a2-82bd-daec48a8aa4d req-2c0b0168-a410-4f3c-aee3-3e2b4b0df5f0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:07.529904 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-5a758303-255b-44a2-82bd-daec48a8aa4d req-2c0b0168-a410-4f3c-aee3-3e2b4b0df5f0 service nova] Creating event network-vif-plugged:c17b7d12-ad1e-4b36-a7bb-01c82a4c12ab for instance a70f5df3-aa9d-4a76-bf08-d7d3074061c1 on n-h1-843700-1 May 28 04:48:07.543023 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-5a758303-255b-44a2-82bd-daec48a8aa4d req-2c0b0168-a410-4f3c-aee3-3e2b4b0df5f0 service nova] Creating event network-vif-plugged:283cc1e0-d886-4407-8227-a9d9bcad50e6 for instance 7e34a513-f606-4109-942e-e8ddd9145ea5 on n-h1-843700-1 May 28 04:48:07.555990 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-5a758303-255b-44a2-82bd-daec48a8aa4d req-2c0b0168-a410-4f3c-aee3-3e2b4b0df5f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.087038 May 28 04:48:07.560904 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1744/3352] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:07.565418 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0b66d2fd-bfa2-49c5-acf2-5333a1ca3124 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701b30f70>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:07.667752 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0b66d2fd-bfa2-49c5-acf2-5333a1ca3124 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 200 len: 1438 microversion: 2.1 time: 0.109573 May 28 04:48:07.668662 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1745/3353] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:48:07 2022] GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 1438 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:07.676178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5024ef95-6b77-458f-aa18-1e0ff294c4d2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:07.676928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5024ef95-6b77-458f-aa18-1e0ff294c4d2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:07.699121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5024ef95-6b77-458f-aa18-1e0ff294c4d2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:07.699843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5024ef95-6b77-458f-aa18-1e0ff294c4d2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:07.700878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5024ef95-6b77-458f-aa18-1e0ff294c4d2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:07.702110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5024ef95-6b77-458f-aa18-1e0ff294c4d2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:08.705661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5024ef95-6b77-458f-aa18-1e0ff294c4d2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:08.727715 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5024ef95-6b77-458f-aa18-1e0ff294c4d2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1657 microversion: 2.1 time: 1.057987 May 28 04:48:08.729183 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1746/3354] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:07 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1657 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:08.739947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ead78a91-d9e7-4ef3-857c-0c3dbbd0eea5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:08.741425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ead78a91-d9e7-4ef3-857c-0c3dbbd0eea5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:08.750293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ead78a91-d9e7-4ef3-857c-0c3dbbd0eea5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:08.751213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ead78a91-d9e7-4ef3-857c-0c3dbbd0eea5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:08.752162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ead78a91-d9e7-4ef3-857c-0c3dbbd0eea5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:08.753527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ead78a91-d9e7-4ef3-857c-0c3dbbd0eea5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:08.784158 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-ead78a91-d9e7-4ef3-857c-0c3dbbd0eea5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] HTTP exception thrown: Instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 could not be found. May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ead78a91-d9e7-4ef3-857c-0c3dbbd0eea5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Request method failure captured: May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 HTTP/1.1 May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikajS0ZZaXFlax6A342ymJ-aQoGJlvna1xZy9bO84b3D9OriaYICvIupIZdjiNLcHyTC7V-bCXuJxYAHanDCccz0wxij-I7blA2wa6CB5mbuJxMVXKjiUcQwy4f7KRJtSQW8-6D6CRl3EsAa-9i5aRJ6Odwpn_PfoRh6K409eAlefhoM May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 025cb09c79a147b3a648c950edcd1dc3 May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 could not be found. May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '06f67b96-191c-4c64-96bf-e1e61c33ee69'} May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 could not be found. May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 could not be found. May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:08.787681 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:08.793457 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:08.793457 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:08.793457 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:08.793457 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:08.793457 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:08.793457 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 could not be found. May 28 04:48:08.793457 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:08.793457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ead78a91-d9e7-4ef3-857c-0c3dbbd0eea5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Returning 404 to user: Instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:08.795916 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ead78a91-d9e7-4ef3-857c-0c3dbbd0eea5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69" status: 404 len: 111 microversion: 2.1 time: 0.064797 May 28 04:48:08.796763 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1747/3355] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:08 2022] GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:08.821200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a0553a2c-9570-4e92-b739-738836142b1a tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:08.833488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a0553a2c-9570-4e92-b739-738836142b1a tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: a70f5df3-aa9d-4a76-bf08-d7d3074061c1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:08.862765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0553a2c-9570-4e92-b739-738836142b1a tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:08.866731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0553a2c-9570-4e92-b739-738836142b1a tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:08.870327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0553a2c-9570-4e92-b739-738836142b1a tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:08.871731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0553a2c-9570-4e92-b739-738836142b1a tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:09.121664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a0553a2c-9570-4e92-b739-738836142b1a tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:09.137902 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a0553a2c-9570-4e92-b739-738836142b1a tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1" status: 200 len: 1323 microversion: 2.1 time: 0.338139 May 28 04:48:09.138505 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1748/3356] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:08 2022] GET /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1 => generated 1323 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:09.160281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-4b1cc649-1a24-476c-b57b-558deaf9c6b2 req-7be4377b-e41c-4551-be1b-b2e85b1b850f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06f67b96-191c-4c64-96bf-e1e61c33ee69", "name": "network-vif-deleted", "tag": "f4cd01a7-d341-4b8b-8d12-fb2902de6c05"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:09.197799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-4b1cc649-1a24-476c-b57b-558deaf9c6b2 req-7be4377b-e41c-4551-be1b-b2e85b1b850f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:09.198636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-4b1cc649-1a24-476c-b57b-558deaf9c6b2 req-7be4377b-e41c-4551-be1b-b2e85b1b850f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:09.217591 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-4b1cc649-1a24-476c-b57b-558deaf9c6b2 req-7be4377b-e41c-4551-be1b-b2e85b1b850f service nova] Creating event network-vif-deleted:f4cd01a7-d341-4b8b-8d12-fb2902de6c05 for instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 on n-h2-843700-1 May 28 04:48:09.236640 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-4b1cc649-1a24-476c-b57b-558deaf9c6b2 req-7be4377b-e41c-4551-be1b-b2e85b1b850f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081643 May 28 04:48:09.242673 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1749/3357] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:09.250749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-51962676-0e84-4dbe-a07d-ddc6d041df5c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:09.251772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-51962676-0e84-4dbe-a07d-ddc6d041df5c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:09.260431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51962676-0e84-4dbe-a07d-ddc6d041df5c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:09.261583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51962676-0e84-4dbe-a07d-ddc6d041df5c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:09.262615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51962676-0e84-4dbe-a07d-ddc6d041df5c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:09.263566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51962676-0e84-4dbe-a07d-ddc6d041df5c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:09.377095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-51962676-0e84-4dbe-a07d-ddc6d041df5c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:09.384377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:09.397830 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-51962676-0e84-4dbe-a07d-ddc6d041df5c tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 200 len: 1309 microversion: 2.1 time: 0.152141 May 28 04:48:09.399332 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1750/3358] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:09 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 1309 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:09.406658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-de944756-70e8-4555-9ce7-cb6cc5ec88d3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701b84af0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:09.515855 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-de944756-70e8-4555-9ce7-cb6cc5ec88d3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 200 len: 1438 microversion: 2.1 time: 0.115190 May 28 04:48:09.516477 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1751/3359] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:48:09 2022] GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 1438 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:09.528344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-b4857cdb-2e5a-4940-b204-5fa5c9414133 req-46ce352b-109e-4b53-b768-f66c4c092da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e34a513-f606-4109-942e-e8ddd9145ea5", "name": "network-vif-deleted", "tag": "283cc1e0-d886-4407-8227-a9d9bcad50e6"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:09.590421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b4857cdb-2e5a-4940-b204-5fa5c9414133 req-46ce352b-109e-4b53-b768-f66c4c092da0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:09.590869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b4857cdb-2e5a-4940-b204-5fa5c9414133 req-46ce352b-109e-4b53-b768-f66c4c092da0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:09.616096 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-b4857cdb-2e5a-4940-b204-5fa5c9414133 req-46ce352b-109e-4b53-b768-f66c4c092da0 service nova] Creating event network-vif-deleted:283cc1e0-d886-4407-8227-a9d9bcad50e6 for instance 7e34a513-f606-4109-942e-e8ddd9145ea5 on n-h1-843700-1 May 28 04:48:09.640890 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-b4857cdb-2e5a-4940-b204-5fa5c9414133 req-46ce352b-109e-4b53-b768-f66c4c092da0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116669 May 28 04:48:09.641517 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1752/3360] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:09.653791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e6a29569-e9df-4233-ab48-263b753c746d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:09.666021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e6a29569-e9df-4233-ab48-263b753c746d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:09.666489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e6a29569-e9df-4233-ab48-263b753c746d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:09.713088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e6a29569-e9df-4233-ab48-263b753c746d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Going to try to start instance {{(pid=126044) start /opt/stack/nova/nova/compute/api.py:2730}} May 28 04:48:09.969533 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e6a29569-e9df-4233-ab48-263b753c746d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action" status: 202 len: 0 microversion: 2.1 time: 0.326473 May 28 04:48:09.970785 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1753/3361] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:48:09 2022] POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:09.980238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-47cf4a95-c5c0-4ef5-a9d5-bcc8691d60f4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '.version_select at 0x7f7701be29d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:10.188409 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-47cf4a95-c5c0-4ef5-a9d5-bcc8691d60f4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-46439952" status: 202 len: 0 microversion: 2.1 time: 0.216106 May 28 04:48:10.189231 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1754/3362] 10.222.0.58 () {58 vars in 1214 bytes} [Sat May 28 04:48:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-46439952 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:10.195057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-00535e5f-0715-4fbf-a052-89fade4b7334 req-6273db94-af6e-4b4a-9e11-02430180af7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e34a513-f606-4109-942e-e8ddd9145ea5", "name": "network-vif-unplugged", "status": "completed", "tag": "283cc1e0-d886-4407-8227-a9d9bcad50e6"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:10.217781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-00535e5f-0715-4fbf-a052-89fade4b7334 req-6273db94-af6e-4b4a-9e11-02430180af7f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:10.220598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-00535e5f-0715-4fbf-a052-89fade4b7334 req-6273db94-af6e-4b4a-9e11-02430180af7f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:10.249242 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-00535e5f-0715-4fbf-a052-89fade4b7334 req-6273db94-af6e-4b4a-9e11-02430180af7f service nova] Creating event network-vif-unplugged:283cc1e0-d886-4407-8227-a9d9bcad50e6 for instance 7e34a513-f606-4109-942e-e8ddd9145ea5 on n-h1-843700-1 May 28 04:48:10.278226 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-00535e5f-0715-4fbf-a052-89fade4b7334 req-6273db94-af6e-4b4a-9e11-02430180af7f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087586 May 28 04:48:10.280666 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1755/3363] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:10.298456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-01c61b82-3ee1-46ba-8778-0d530cae04a9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:10.300069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-01c61b82-3ee1-46ba-8778-0d530cae04a9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:10.315502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01c61b82-3ee1-46ba-8778-0d530cae04a9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:10.316468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01c61b82-3ee1-46ba-8778-0d530cae04a9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:10.322889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01c61b82-3ee1-46ba-8778-0d530cae04a9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:10.323804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01c61b82-3ee1-46ba-8778-0d530cae04a9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:10.666030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-01c61b82-3ee1-46ba-8778-0d530cae04a9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:10.674055 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-01c61b82-3ee1-46ba-8778-0d530cae04a9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1666 microversion: 2.1 time: 0.391520 May 28 04:48:10.679585 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1756/3364] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:10 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1666 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:10.686523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-458b7f0c-9a2c-4c15-8c59-77b314286156 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:10.691840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-458b7f0c-9a2c-4c15-8c59-77b314286156 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: a70f5df3-aa9d-4a76-bf08-d7d3074061c1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:10.706427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-458b7f0c-9a2c-4c15-8c59-77b314286156 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:10.710170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-458b7f0c-9a2c-4c15-8c59-77b314286156 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:10.712727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-458b7f0c-9a2c-4c15-8c59-77b314286156 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:10.715828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-458b7f0c-9a2c-4c15-8c59-77b314286156 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:10.730779 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-492bef65-cf5f-47a7-bf63-7e25dfc54af6 tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.961543 May 28 04:48:10.731981 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1609/3365] 10.222.0.58 () {60 vars in 1169 bytes} [Sat May 28 04:48:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:10.736742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8b9e3948-55dc-441a-8420-b07453c9e5bb tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:10.737538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8b9e3948-55dc-441a-8420-b07453c9e5bb tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:10.755307 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b9e3948-55dc-441a-8420-b07453c9e5bb tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:10.755580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b9e3948-55dc-441a-8420-b07453c9e5bb tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:10.756741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b9e3948-55dc-441a-8420-b07453c9e5bb tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:10.757340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b9e3948-55dc-441a-8420-b07453c9e5bb tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:10.821944 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-8b9e3948-55dc-441a-8420-b07453c9e5bb tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] HTTP exception thrown: Instance 7e34a513-f606-4109-942e-e8ddd9145ea5 could not be found. May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8b9e3948-55dc-441a-8420-b07453c9e5bb tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Request method failure captured: May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 HTTP/1.1 May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikak47QAs5K06QhfhkIquusTq5B930GK2qX0_12di_Rh32YDa0oiawwGAqeo88DT65woz1MmOY2wmnqGoSlDi_TB5nkwOW_jtkf8bwl1MIAPkkOt7hgVlVdmgC8btNyj4GvAvNekqk5WajXo3d43lpqxKK68oDpAyv5Nz9V4rMhAcq7c May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 6b37465157dd44a09cffbbe57322d264 May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 7e34a513-f606-4109-942e-e8ddd9145ea5 could not be found. May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '7e34a513-f606-4109-942e-e8ddd9145ea5'} May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e34a513-f606-4109-942e-e8ddd9145ea5 could not be found. May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e34a513-f606-4109-942e-e8ddd9145ea5 could not be found. May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:10.842240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:10.846973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:10.846973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:10.846973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:10.846973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:10.846973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:10.846973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:10.846973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e34a513-f606-4109-942e-e8ddd9145ea5 could not be found. May 28 04:48:10.846973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:10.850129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8b9e3948-55dc-441a-8420-b07453c9e5bb tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Returning 404 to user: Instance 7e34a513-f606-4109-942e-e8ddd9145ea5 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:10.852041 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8b9e3948-55dc-441a-8420-b07453c9e5bb tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 404 len: 111 microversion: 2.1 time: 0.118981 May 28 04:48:10.853936 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1610/3366] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:10 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:10.894703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a7630843-9598-4102-99bf-2a28982aafa6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701108af0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:11.032198 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a7630843-9598-4102-99bf-2a28982aafa6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 200 len: 1438 microversion: 2.1 time: 0.153708 May 28 04:48:11.032767 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1611/3367] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:48:10 2022] GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 1438 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:11.062372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-06a75359-96b2-4953-9f59-86b8a4520938 tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] Calling method '.version_select at 0x7f770108c0d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:11.313954 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-458b7f0c-9a2c-4c15-8c59-77b314286156 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:11.330835 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-458b7f0c-9a2c-4c15-8c59-77b314286156 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1" status: 200 len: 1516 microversion: 2.1 time: 0.645935 May 28 04:48:11.331451 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1757/3368] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:10 2022] GET /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1 => generated 1516 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:11.344491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-56958633-38ff-4414-a434-51b877643c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-713489605", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:11.356584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:11.411284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-56958633-38ff-4414-a434-51b877643c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] validate_networks() for [('b91e6aa7-72c1-4a13-ac33-917f89cda5b1', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:48:11.481982 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-06a75359-96b2-4953-9f59-86b8a4520938 tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/8a197c76-b092-45e1-9e11-bf1b6d19eb3f" status: 200 len: 142 microversion: 2.1 time: 0.448144 May 28 04:48:11.483350 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1612/3369] 10.222.0.58 () {58 vars in 1259 bytes} [Sat May 28 04:48:11 2022] GET /compute/v2.1/os-floating-ips/8a197c76-b092-45e1-9e11-bf1b6d19eb3f => generated 142 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:11.488379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3c7d6416-c83b-429e-aaeb-dacbcbfc94a4 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:11.489169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3c7d6416-c83b-429e-aaeb-dacbcbfc94a4 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: b2a2e64b-2bf0-4d17-b81e-f9f79e81db22] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:11.505023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c7d6416-c83b-429e-aaeb-dacbcbfc94a4 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:11.505472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c7d6416-c83b-429e-aaeb-dacbcbfc94a4 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:11.506300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c7d6416-c83b-429e-aaeb-dacbcbfc94a4 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:11.507677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c7d6416-c83b-429e-aaeb-dacbcbfc94a4 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:11.871689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3c7d6416-c83b-429e-aaeb-dacbcbfc94a4 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:11.905452 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3c7d6416-c83b-429e-aaeb-dacbcbfc94a4 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/b2a2e64b-2bf0-4d17-b81e-f9f79e81db22" status: 200 len: 1515 microversion: 2.1 time: 0.420738 May 28 04:48:11.906045 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1613/3370] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:11 2022] GET /compute/v2.1/servers/b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 => generated 1515 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:11.920516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6e6c6f9b-a448-4504-a0cb-3f138abadfeb tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] Calling method '.version_select at 0x7f7701e0f430>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:12.271237 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6e6c6f9b-a448-4504-a0cb-3f138abadfeb tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.358492 May 28 04:48:12.271237 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1614/3371] 10.222.0.58 () {58 vars in 1148 bytes} [Sat May 28 04:48:11 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:12.275903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-345519c2-a66c-4b56-96e6-15fc30d7b027 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:12.276682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-345519c2-a66c-4b56-96e6-15fc30d7b027 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:12.289699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-345519c2-a66c-4b56-96e6-15fc30d7b027 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:12.292978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-345519c2-a66c-4b56-96e6-15fc30d7b027 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:12.294932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-345519c2-a66c-4b56-96e6-15fc30d7b027 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:12.295836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-345519c2-a66c-4b56-96e6-15fc30d7b027 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:12.297136 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-56958633-38ff-4414-a434-51b877643c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:48:12.298083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-56958633-38ff-4414-a434-51b877643c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:48:12.298726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-56958633-38ff-4414-a434-51b877643c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:48:12.299570 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-56958633-38ff-4414-a434-51b877643c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:48:12.300173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-56958633-38ff-4414-a434-51b877643c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:48:12.327016 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56958633-38ff-4414-a434-51b877643c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:12.327743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56958633-38ff-4414-a434-51b877643c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:12.328759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56958633-38ff-4414-a434-51b877643c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:12.329365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56958633-38ff-4414-a434-51b877643c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:12.351025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-56958633-38ff-4414-a434-51b877643c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Getting quotas for project fb9b98186db746ae83181dd7db6d56e7. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:48:12.356898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-56958633-38ff-4414-a434-51b877643c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Getting quotas for user 6b37465157dd44a09cffbbe57322d264 and project fb9b98186db746ae83181dd7db6d56e7. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:48:12.372095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-56958633-38ff-4414-a434-51b877643c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:48:12.374393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-56958633-38ff-4414-a434-51b877643c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: f4b052c1-5cd4-4931-b963-51075812ef15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:48:12.484227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-345519c2-a66c-4b56-96e6-15fc30d7b027 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:12.494102 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-345519c2-a66c-4b56-96e6-15fc30d7b027 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1666 microversion: 2.1 time: 0.223129 May 28 04:48:12.495319 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1615/3372] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:12 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1666 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:12.501553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9dc38c29-d92b-4555-b429-dd9a1599004e tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:12.502334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9dc38c29-d92b-4555-b429-dd9a1599004e tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: b2a2e64b-2bf0-4d17-b81e-f9f79e81db22] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:12.511427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9dc38c29-d92b-4555-b429-dd9a1599004e tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:12.512074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9dc38c29-d92b-4555-b429-dd9a1599004e tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:12.513040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9dc38c29-d92b-4555-b429-dd9a1599004e tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:12.513667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9dc38c29-d92b-4555-b429-dd9a1599004e tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:12.546168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9dc38c29-d92b-4555-b429-dd9a1599004e tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: b2a2e64b-2bf0-4d17-b81e-f9f79e81db22] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:48:12.558036 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-56958633-38ff-4414-a434-51b877643c6f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.225084 May 28 04:48:12.558751 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1758/3373] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:48:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:48:12.563759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2e975edc-14b2-4a05-b8a3-d88685fcd6f3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f770207dc10>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:12.620298 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2e975edc-14b2-4a05-b8a3-d88685fcd6f3 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 200 len: 1438 microversion: 2.1 time: 0.060301 May 28 04:48:12.621903 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1759/3374] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:48:12 2022] GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 1438 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:12.628553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ad566516-6dfa-45ff-bb38-8bd4ce012510 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:12.629289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ad566516-6dfa-45ff-bb38-8bd4ce012510 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:12.638176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad566516-6dfa-45ff-bb38-8bd4ce012510 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:12.638860 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad566516-6dfa-45ff-bb38-8bd4ce012510 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:12.639897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad566516-6dfa-45ff-bb38-8bd4ce012510 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:12.640668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad566516-6dfa-45ff-bb38-8bd4ce012510 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:12.800846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-ad566516-6dfa-45ff-bb38-8bd4ce012510 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lazy-loading 'services' on Instance uuid 0459f5ac-8ba7-47a4-9c7b-808496f08d52 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:48:13.262187 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9dc38c29-d92b-4555-b429-dd9a1599004e tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b2a2e64b-2bf0-4d17-b81e-f9f79e81db22" status: 204 len: 0 microversion: 2.1 time: 0.764917 May 28 04:48:13.264284 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1616/3375] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:48:12 2022] DELETE /compute/v2.1/servers/b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:48:13.277981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-722e0a26-a0b3-4dfb-ba4a-bca902016a03 tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] Calling method '.version_select at 0x7f77023f2700>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:13.360008 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ad566516-6dfa-45ff-bb38-8bd4ce012510 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments/aec95bf2-d83c-4a61-bb37-c7cb89ebc076" status: 202 len: 0 microversion: 2.1 time: 0.735227 May 28 04:48:13.361738 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1760/3376] 10.222.0.58 () {58 vars in 1415 bytes} [Sat May 28 04:48:12 2022] DELETE /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments/aec95bf2-d83c-4a61-bb37-c7cb89ebc076 => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:13.397306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d0ca914d-13e6-4997-a5a2-f9011045eec7 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:13.399612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d0ca914d-13e6-4997-a5a2-f9011045eec7 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: f4b052c1-5cd4-4931-b963-51075812ef15] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:13.537492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d0ca914d-13e6-4997-a5a2-f9011045eec7 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:13.553354 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d0ca914d-13e6-4997-a5a2-f9011045eec7 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15" status: 200 len: 1224 microversion: 2.1 time: 0.189883 May 28 04:48:13.563392 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1761/3377] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:13 2022] GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15 => generated 1224 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:13.563392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2e39d659-eda7-42b2-a762-8d27fb7ba815 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:13.563392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2e39d659-eda7-42b2-a762-8d27fb7ba815 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: b2a2e64b-2bf0-4d17-b81e-f9f79e81db22] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:13.625613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e39d659-eda7-42b2-a762-8d27fb7ba815 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:13.626350 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e39d659-eda7-42b2-a762-8d27fb7ba815 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:13.627638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e39d659-eda7-42b2-a762-8d27fb7ba815 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:13.628616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e39d659-eda7-42b2-a762-8d27fb7ba815 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:14.255363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2e39d659-eda7-42b2-a762-8d27fb7ba815 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:14.272020 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2e39d659-eda7-42b2-a762-8d27fb7ba815 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/b2a2e64b-2bf0-4d17-b81e-f9f79e81db22" status: 200 len: 1521 microversion: 2.1 time: 0.714184 May 28 04:48:14.272682 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1762/3378] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:13 2022] GET /compute/v2.1/servers/b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 => generated 1521 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:14.287245 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4f0d168c-0d06-4332-91a3-f18e2c4513bb tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:14.291385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4f0d168c-0d06-4332-91a3-f18e2c4513bb tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:14.306091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f0d168c-0d06-4332-91a3-f18e2c4513bb tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:14.306592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f0d168c-0d06-4332-91a3-f18e2c4513bb tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:14.312937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f0d168c-0d06-4332-91a3-f18e2c4513bb tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:14.313437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f0d168c-0d06-4332-91a3-f18e2c4513bb tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:14.376979 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4f0d168c-0d06-4332-91a3-f18e2c4513bb tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093645 May 28 04:48:14.383301 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1763/3379] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:48:14 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:14.397479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-380f969d-0e36-49a6-b81e-3eb240a78688 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:14.399061 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-380f969d-0e36-49a6-b81e-3eb240a78688 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:14.407044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-380f969d-0e36-49a6-b81e-3eb240a78688 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:14.411845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-380f969d-0e36-49a6-b81e-3eb240a78688 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:14.412824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-380f969d-0e36-49a6-b81e-3eb240a78688 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:14.413430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-380f969d-0e36-49a6-b81e-3eb240a78688 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:14.721539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-380f969d-0e36-49a6-b81e-3eb240a78688 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:14.732628 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-380f969d-0e36-49a6-b81e-3eb240a78688 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.348008 May 28 04:48:14.735576 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1764/3380] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:14 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:14.749318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8df99d49-322d-427d-9171-89c554853008 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f77015bad30>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:14.827959 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8df99d49-322d-427d-9171-89c554853008 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 200 len: 1438 microversion: 2.1 time: 0.091182 May 28 04:48:14.829032 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1765/3381] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:48:14 2022] GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 1438 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:14.836800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1c8982c3-1eb1-4501-b6e2-2c5cb9e5830e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:14.839929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1c8982c3-1eb1-4501-b6e2-2c5cb9e5830e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: f4b052c1-5cd4-4931-b963-51075812ef15] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:14.875056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1c8982c3-1eb1-4501-b6e2-2c5cb9e5830e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:14.875056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1c8982c3-1eb1-4501-b6e2-2c5cb9e5830e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:14.875056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1c8982c3-1eb1-4501-b6e2-2c5cb9e5830e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:14.875056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1c8982c3-1eb1-4501-b6e2-2c5cb9e5830e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:15.043438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1c8982c3-1eb1-4501-b6e2-2c5cb9e5830e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:15.051325 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1c8982c3-1eb1-4501-b6e2-2c5cb9e5830e tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15" status: 200 len: 1220 microversion: 2.1 time: 0.221068 May 28 04:48:15.052208 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1766/3382] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:14 2022] GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15 => generated 1220 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:15.068122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d047f6e7-7503-4f17-baeb-fc77e4634b30 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:15.068811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d047f6e7-7503-4f17-baeb-fc77e4634b30 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:15.083850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d047f6e7-7503-4f17-baeb-fc77e4634b30 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:15.084317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d047f6e7-7503-4f17-baeb-fc77e4634b30 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:15.087699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d047f6e7-7503-4f17-baeb-fc77e4634b30 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:15.087699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d047f6e7-7503-4f17-baeb-fc77e4634b30 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:15.466421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d047f6e7-7503-4f17-baeb-fc77e4634b30 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:15.483738 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d047f6e7-7503-4f17-baeb-fc77e4634b30 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.430743 May 28 04:48:15.484545 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1767/3383] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:15 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:15.495599 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-722e0a26-a0b3-4dfb-ba4a-bca902016a03 tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/8a197c76-b092-45e1-9e11-bf1b6d19eb3f" status: 202 len: 0 microversion: 2.1 time: 2.222495 May 28 04:48:15.496509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8912541a-b869-425c-afab-1d9ab8fdb528 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:15.497707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8912541a-b869-425c-afab-1d9ab8fdb528 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: b2a2e64b-2bf0-4d17-b81e-f9f79e81db22] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:15.506014 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1617/3384] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 04:48:13 2022] DELETE /compute/v2.1/os-floating-ips/8a197c76-b092-45e1-9e11-bf1b6d19eb3f => generated 0 bytes in 2241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:15.512779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-92691091-3c71-4348-9402-3ad3904d3b72 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:15.514030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8912541a-b869-425c-afab-1d9ab8fdb528 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:15.514526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8912541a-b869-425c-afab-1d9ab8fdb528 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:15.515320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8912541a-b869-425c-afab-1d9ab8fdb528 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:15.517194 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-92691091-3c71-4348-9402-3ad3904d3b72 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:15.519770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8912541a-b869-425c-afab-1d9ab8fdb528 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:15.535778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-92691091-3c71-4348-9402-3ad3904d3b72 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:15.536636 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-92691091-3c71-4348-9402-3ad3904d3b72 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:15.537652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-92691091-3c71-4348-9402-3ad3904d3b72 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:15.538862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-92691091-3c71-4348-9402-3ad3904d3b72 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:15.590734 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-92691091-3c71-4348-9402-3ad3904d3b72 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082412 May 28 04:48:15.606713 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1618/3385] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:48:15 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:15.610732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d6352b8b-a3be-47a4-ac65-41a72c0956f9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:15.611540 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d6352b8b-a3be-47a4-ac65-41a72c0956f9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:15.620548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6352b8b-a3be-47a4-ac65-41a72c0956f9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:15.621293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6352b8b-a3be-47a4-ac65-41a72c0956f9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:15.626595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6352b8b-a3be-47a4-ac65-41a72c0956f9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:15.627697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6352b8b-a3be-47a4-ac65-41a72c0956f9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:15.892507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d6352b8b-a3be-47a4-ac65-41a72c0956f9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Unlocking {{(pid=126043) unlock /opt/stack/nova/nova/compute/api.py:4729}} May 28 04:48:16.032074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8912541a-b869-425c-afab-1d9ab8fdb528 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:16.043591 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8912541a-b869-425c-afab-1d9ab8fdb528 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/b2a2e64b-2bf0-4d17-b81e-f9f79e81db22" status: 200 len: 1521 microversion: 2.1 time: 0.557336 May 28 04:48:16.044212 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1768/3386] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:15 2022] GET /compute/v2.1/servers/b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 => generated 1521 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:16.078804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5a11b151-1022-4af8-b2b2-57dbd4a95b41 tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] Action: 'create', calling method: .version_select at 0x7f7701f11430>, body: {"pool": null} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:16.266295 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d6352b8b-a3be-47a4-ac65-41a72c0956f9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action" status: 202 len: 0 microversion: 2.1 time: 0.661429 May 28 04:48:16.267565 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1619/3387] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:48:15 2022] POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action => generated 0 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:16.274564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9e801969-fc90-414d-a88b-c37f3b181587 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701a91310>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:16.379665 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9e801969-fc90-414d-a88b-c37f3b181587 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 200 len: 1438 microversion: 2.1 time: 0.110509 May 28 04:48:16.380404 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1620/3388] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:48:16 2022] GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 1438 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:16.385786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-a8c49979-d476-4b4b-b123-e6c371fe8502 req-7e2900e0-c0ca-4222-b808-00f8fa131b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a2e64b-2bf0-4d17-b81e-f9f79e81db22", "name": "network-vif-deleted", "tag": "6ae6c5f3-0e9e-40e2-b604-fda1641b7b5c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:16.419336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a8c49979-d476-4b4b-b123-e6c371fe8502 req-7e2900e0-c0ca-4222-b808-00f8fa131b74 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:16.424744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a8c49979-d476-4b4b-b123-e6c371fe8502 req-7e2900e0-c0ca-4222-b808-00f8fa131b74 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:16.435408 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-a8c49979-d476-4b4b-b123-e6c371fe8502 req-7e2900e0-c0ca-4222-b808-00f8fa131b74 service nova] Creating event network-vif-deleted:6ae6c5f3-0e9e-40e2-b604-fda1641b7b5c for instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 on n-h2-843700-1 May 28 04:48:16.441208 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-a8c49979-d476-4b4b-b123-e6c371fe8502 req-7e2900e0-c0ca-4222-b808-00f8fa131b74 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059269 May 28 04:48:16.453401 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1621/3389] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:16.460391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cb3486c2-d746-41c2-8591-4aae91f1dad1 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:16.461516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cb3486c2-d746-41c2-8591-4aae91f1dad1 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: f4b052c1-5cd4-4931-b963-51075812ef15] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:16.470105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb3486c2-d746-41c2-8591-4aae91f1dad1 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:16.470829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb3486c2-d746-41c2-8591-4aae91f1dad1 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:16.471848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb3486c2-d746-41c2-8591-4aae91f1dad1 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:16.472441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb3486c2-d746-41c2-8591-4aae91f1dad1 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:16.545330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cb3486c2-d746-41c2-8591-4aae91f1dad1 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:16.569387 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cb3486c2-d746-41c2-8591-4aae91f1dad1 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15" status: 200 len: 1282 microversion: 2.1 time: 0.114153 May 28 04:48:16.570880 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1622/3390] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:16 2022] GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15 => generated 1282 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:16.578340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c83e2e47-8b69-4f78-87a9-b6a68b436300 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:16.579296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c83e2e47-8b69-4f78-87a9-b6a68b436300 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:16.589087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c83e2e47-8b69-4f78-87a9-b6a68b436300 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:16.589727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c83e2e47-8b69-4f78-87a9-b6a68b436300 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:16.590850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c83e2e47-8b69-4f78-87a9-b6a68b436300 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:16.591541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c83e2e47-8b69-4f78-87a9-b6a68b436300 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:17.132992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c83e2e47-8b69-4f78-87a9-b6a68b436300 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:17.151424 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c83e2e47-8b69-4f78-87a9-b6a68b436300 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.579202 May 28 04:48:17.158158 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1623/3391] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:16 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:17.168624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-19d5d6cc-766b-4f2f-8a40-e07155e00630 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:17.169675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-19d5d6cc-766b-4f2f-8a40-e07155e00630 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:17.183977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-19d5d6cc-766b-4f2f-8a40-e07155e00630 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:17.184440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-19d5d6cc-766b-4f2f-8a40-e07155e00630 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:17.185441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-19d5d6cc-766b-4f2f-8a40-e07155e00630 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:17.185995 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-19d5d6cc-766b-4f2f-8a40-e07155e00630 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:17.261550 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-19d5d6cc-766b-4f2f-8a40-e07155e00630 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100450 May 28 04:48:17.262665 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1624/3392] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:48:17 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:17.269502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bda4a3e6-1d2a-44b9-ac37-93f7275e8a50 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:17.270457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bda4a3e6-1d2a-44b9-ac37-93f7275e8a50 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: b2a2e64b-2bf0-4d17-b81e-f9f79e81db22] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:17.279419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bda4a3e6-1d2a-44b9-ac37-93f7275e8a50 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:17.280288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bda4a3e6-1d2a-44b9-ac37-93f7275e8a50 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:17.281298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bda4a3e6-1d2a-44b9-ac37-93f7275e8a50 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:17.281961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bda4a3e6-1d2a-44b9-ac37-93f7275e8a50 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:17.300695 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=91,nova_cell1:UPDATE=5 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:17.302409 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-bda4a3e6-1d2a-44b9-ac37-93f7275e8a50 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] HTTP exception thrown: Instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 could not be found. May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bda4a3e6-1d2a-44b9-ac37-93f7275e8a50 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Request method failure captured: May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 HTTP/1.1 May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikalu-RpVONPFe-uKaOLImh6DXtGyJ308PebiAzTwwQLOCFkmKKpMqgCCkUDGmG3Q77Dcd-0LoHqTVpQZkUvbzYcUlvo2uzgnyebK3NwEd-0xKb2cX-I1blXURqO50R3AFLPhHrKUJB7ImJ5hHAxur-a-hHRkgX2EMNSxY6V_Kf5wYVI May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: e912d921d9dd4406ab8279c483b17da0 May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: e912d921d9dd4406ab8279c483b17da0 May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ListServersNegativeTestJSON-123958158-project May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 3cd50f0dcc4b486fafdce740e661abdd May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ListServersNegativeTestJSON-123958158-project May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 could not be found. May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'b2a2e64b-2bf0-4d17-b81e-f9f79e81db22'} May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 could not be found. May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 could not be found. May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:17.304776 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:17.312965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:17.312965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:17.312965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:17.312965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:17.312965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:17.312965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 could not be found. May 28 04:48:17.312965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:17.312965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bda4a3e6-1d2a-44b9-ac37-93f7275e8a50 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Returning 404 to user: Instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:17.312965 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bda4a3e6-1d2a-44b9-ac37-93f7275e8a50 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/b2a2e64b-2bf0-4d17-b81e-f9f79e81db22" status: 404 len: 111 microversion: 2.1 time: 0.042954 May 28 04:48:17.312965 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1625/3393] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:17 2022] GET /compute/v2.1/servers/b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:17.329360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9fee721c-501e-4eda-86bf-23538bffb01d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:17.331710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9fee721c-501e-4eda-86bf-23538bffb01d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:17.340841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fee721c-501e-4eda-86bf-23538bffb01d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:17.341611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fee721c-501e-4eda-86bf-23538bffb01d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:17.342638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fee721c-501e-4eda-86bf-23538bffb01d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:17.343588 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fee721c-501e-4eda-86bf-23538bffb01d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:17.659222 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9fee721c-501e-4eda-86bf-23538bffb01d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:17.670890 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9fee721c-501e-4eda-86bf-23538bffb01d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.354440 May 28 04:48:17.683017 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1626/3394] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:17 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:17.685014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8defd2ab-8784-4ca4-b407-549dc0c100d8 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:17.688884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8defd2ab-8784-4ca4-b407-549dc0c100d8 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:17.689867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8defd2ab-8784-4ca4-b407-549dc0c100d8 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'e912d921d9dd4406ab8279c483b17da0'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:48:17.696112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8defd2ab-8784-4ca4-b407-549dc0c100d8 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:17.696564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8defd2ab-8784-4ca4-b407-549dc0c100d8 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:17.697659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8defd2ab-8784-4ca4-b407-549dc0c100d8 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:17.698095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8defd2ab-8784-4ca4-b407-549dc0c100d8 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:17.834614 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8defd2ab-8784-4ca4-b407-549dc0c100d8 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.155058 May 28 04:48:17.843297 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1627/3395] 10.222.0.58 () {58 vars in 1229 bytes} [Sat May 28 04:48:17 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:48:17.843297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f5d6885b-18a2-4d28-b358-06fc3b4173b0 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701dce040>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:17.900331 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f5d6885b-18a2-4d28-b358-06fc3b4173b0 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 200 len: 1438 microversion: 2.1 time: 0.063124 May 28 04:48:17.901510 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1628/3396] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:48:17 2022] GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 1438 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:17.908637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-36042b91-62dd-4737-9592-08fc8e007a66 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:17.910258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-36042b91-62dd-4737-9592-08fc8e007a66 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: f4b052c1-5cd4-4931-b963-51075812ef15] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:17.917523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-36042b91-62dd-4737-9592-08fc8e007a66 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:17.918343 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-36042b91-62dd-4737-9592-08fc8e007a66 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:17.919410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-36042b91-62dd-4737-9592-08fc8e007a66 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:17.920076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-36042b91-62dd-4737-9592-08fc8e007a66 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:18.268227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-36042b91-62dd-4737-9592-08fc8e007a66 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:18.280738 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-36042b91-62dd-4737-9592-08fc8e007a66 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15" status: 200 len: 1324 microversion: 2.1 time: 0.377710 May 28 04:48:18.290390 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1629/3397] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:17 2022] GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15 => generated 1324 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:18.294093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-443b8dc5-8cb2-4035-8f0e-2f1fd2f6c08a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:18.294093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-443b8dc5-8cb2-4035-8f0e-2f1fd2f6c08a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:18.305036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-443b8dc5-8cb2-4035-8f0e-2f1fd2f6c08a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:18.307830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-443b8dc5-8cb2-4035-8f0e-2f1fd2f6c08a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:18.310705 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-443b8dc5-8cb2-4035-8f0e-2f1fd2f6c08a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:18.311345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-443b8dc5-8cb2-4035-8f0e-2f1fd2f6c08a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:18.791575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-443b8dc5-8cb2-4035-8f0e-2f1fd2f6c08a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:18.802440 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-443b8dc5-8cb2-4035-8f0e-2f1fd2f6c08a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.519523 May 28 04:48:18.803492 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1630/3398] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:18 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:18.818136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-926776bd-5330-4646-9c3a-d94cac3fa2b9 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-926776bd-5330-4646-9c3a-d94cac3fa2b9 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Request method failure captured: May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikalu-RpVONPFe-uKaOLImh6DXtGyJ308PebiAzTwwQLOCFkmKKpMqgCCkUDGmG3Q77Dcd-0LoHqTVpQZkUvbzYcUlvo2uzgnyebK3NwEd-0xKb2cX-I1blXURqO50R3AFLPhHrKUJB7ImJ5hHAxur-a-hHRkgX2EMNSxY6V_Kf5wYVI May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: e912d921d9dd4406ab8279c483b17da0 May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: e912d921d9dd4406ab8279c483b17da0 May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ListServersNegativeTestJSON-123958158-project May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 3cd50f0dcc4b486fafdce740e661abdd May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ListServersNegativeTestJSON-123958158-project May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: action_args: {} May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance[0]: May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi '2011/01/01' May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 28 04:48:18.822738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:48:18.829078 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:48:18.829078 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:48:18.829078 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:48:18.829078 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 28 04:48:18.829078 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:18.829078 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:18.829078 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:18.829078 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:18.829078 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:18.829078 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:18.829078 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:48:18.829078 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:48:18.829078 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 28 04:48:18.829078 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:18.831456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-926776bd-5330-4646-9c3a-d94cac3fa2b9 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:18.832864 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-926776bd-5330-4646-9c3a-d94cac3fa2b9 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.024598 May 28 04:48:18.833857 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1631/3399] 10.222.0.58 () {58 vars in 1181 bytes} [Sat May 28 04:48:18 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:48:18.841172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c617449f-fac6-42d0-90c6-dc12784ebf6c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:18.842643 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c617449f-fac6-42d0-90c6-dc12784ebf6c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:18.852599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c617449f-fac6-42d0-90c6-dc12784ebf6c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:18.854818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c617449f-fac6-42d0-90c6-dc12784ebf6c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:18.856118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c617449f-fac6-42d0-90c6-dc12784ebf6c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:18.856892 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c617449f-fac6-42d0-90c6-dc12784ebf6c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:18.926115 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c617449f-fac6-42d0-90c6-dc12784ebf6c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090615 May 28 04:48:18.927349 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1632/3400] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:48:18 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:18.931884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f076726f-0476-4968-a14f-c3ca2823eddf tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:18.932415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f076726f-0476-4968-a14f-c3ca2823eddf tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:18.939553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f076726f-0476-4968-a14f-c3ca2823eddf tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:18.940035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f076726f-0476-4968-a14f-c3ca2823eddf tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:18.940828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f076726f-0476-4968-a14f-c3ca2823eddf tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:18.941319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f076726f-0476-4968-a14f-c3ca2823eddf tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:19.221562 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f076726f-0476-4968-a14f-c3ca2823eddf tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action" status: 202 len: 0 microversion: 2.1 time: 0.293331 May 28 04:48:19.222366 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1633/3401] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:48:18 2022] POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:19.236793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1446cfe1-0c54-461b-858a-2d636fdd9b48 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:19.246513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1446cfe1-0c54-461b-858a-2d636fdd9b48 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:19.247585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1446cfe1-0c54-461b-858a-2d636fdd9b48 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Searching by: {'deleted': False, 'project_id': 'e912d921d9dd4406ab8279c483b17da0'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:48:19.267216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1446cfe1-0c54-461b-858a-2d636fdd9b48 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:19.267216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1446cfe1-0c54-461b-858a-2d636fdd9b48 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:19.267216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1446cfe1-0c54-461b-858a-2d636fdd9b48 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:19.267216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1446cfe1-0c54-461b-858a-2d636fdd9b48 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:19.311597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-1446cfe1-0c54-461b-858a-2d636fdd9b48 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:48:19.366166 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1446cfe1-0c54-461b-858a-2d636fdd9b48 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.142306 May 28 04:48:19.367156 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1634/3402] 10.222.0.58 () {58 vars in 1124 bytes} [Sat May 28 04:48:19 2022] GET /compute/v2.1/servers => generated 683 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:19.372249 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-42f380b6-81a5-40d6-9031-ce308b1f5300 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7707486790>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:19.429719 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-42f380b6-81a5-40d6-9031-ce308b1f5300 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 200 len: 1438 microversion: 2.1 time: 0.061337 May 28 04:48:19.431621 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1635/3403] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:48:19 2022] GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 1438 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:19.437492 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-314163fd-f7ec-4ed1-b3ca-fca042e77fa0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:19.438581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-314163fd-f7ec-4ed1-b3ca-fca042e77fa0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:19.449720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-314163fd-f7ec-4ed1-b3ca-fca042e77fa0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:19.450733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-314163fd-f7ec-4ed1-b3ca-fca042e77fa0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:19.451752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-314163fd-f7ec-4ed1-b3ca-fca042e77fa0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:19.452343 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-314163fd-f7ec-4ed1-b3ca-fca042e77fa0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:19.841321 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-314163fd-f7ec-4ed1-b3ca-fca042e77fa0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:19.854365 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-314163fd-f7ec-4ed1-b3ca-fca042e77fa0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1675 microversion: 2.1 time: 0.420971 May 28 04:48:19.867163 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1636/3404] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:19 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1675 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:19.882413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4079f2a6-c6a6-4740-accc-782ec26dd910 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:19.883581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4079f2a6-c6a6-4740-accc-782ec26dd910 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: f4b052c1-5cd4-4931-b963-51075812ef15] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:19.907722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4079f2a6-c6a6-4740-accc-782ec26dd910 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:19.909446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4079f2a6-c6a6-4740-accc-782ec26dd910 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:19.919345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4079f2a6-c6a6-4740-accc-782ec26dd910 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:19.919806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4079f2a6-c6a6-4740-accc-782ec26dd910 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:20.284166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4079f2a6-c6a6-4740-accc-782ec26dd910 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:20.300120 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4079f2a6-c6a6-4740-accc-782ec26dd910 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15" status: 200 len: 1324 microversion: 2.1 time: 0.429579 May 28 04:48:20.300727 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1637/3405] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:19 2022] GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15 => generated 1324 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:20.311649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-63f24d80-2985-4c2e-8b67-ff5b8e6905d5 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:20.336517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-63f24d80-2985-4c2e-8b67-ff5b8e6905d5 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:20.344230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.compute.servers [None req-63f24d80-2985-4c2e-8b67-ff5b8e6905d5 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Removing options 'limit' from query {{(pid=126043) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 28 04:48:20.345547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-63f24d80-2985-4c2e-8b67-ff5b8e6905d5 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Searching by: {'deleted': False, 'project_id': 'e912d921d9dd4406ab8279c483b17da0'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:48:20.370007 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5a11b151-1022-4af8-b2b2-57dbd4a95b41 tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.323011 May 28 04:48:20.373294 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1769/3406] 10.222.0.58 () {60 vars in 1169 bytes} [Sat May 28 04:48:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:20.376111 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63f24d80-2985-4c2e-8b67-ff5b8e6905d5 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:20.377651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63f24d80-2985-4c2e-8b67-ff5b8e6905d5 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:20.380370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63f24d80-2985-4c2e-8b67-ff5b8e6905d5 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:20.380871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-524b60fe-6c92-4fb4-afb9-c4af30dcf2b8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:20.382207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63f24d80-2985-4c2e-8b67-ff5b8e6905d5 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:20.384898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-524b60fe-6c92-4fb4-afb9-c4af30dcf2b8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:20.408985 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-524b60fe-6c92-4fb4-afb9-c4af30dcf2b8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:20.409440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-524b60fe-6c92-4fb4-afb9-c4af30dcf2b8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:20.410231 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-524b60fe-6c92-4fb4-afb9-c4af30dcf2b8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:20.410676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-524b60fe-6c92-4fb4-afb9-c4af30dcf2b8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:20.425371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-63f24d80-2985-4c2e-8b67-ff5b8e6905d5 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:48:20.460553 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-524b60fe-6c92-4fb4-afb9-c4af30dcf2b8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085884 May 28 04:48:20.466191 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1770/3407] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:48:20 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:20.471406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-80d8aa2f-3b9c-47b1-9696-8599d3711cfc tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] Calling method '.version_select at 0x7f77015ba790>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:20.473957 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-63f24d80-2985-4c2e-8b67-ff5b8e6905d5 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.169583 May 28 04:48:20.475660 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1638/3408] 10.222.0.58 () {58 vars in 1143 bytes} [Sat May 28 04:48:20 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:20.484024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-18d62465-c46d-4678-afd3-0ff948e6faea tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701f9b0d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:20.544133 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-18d62465-c46d-4678-afd3-0ff948e6faea tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 200 len: 1438 microversion: 2.1 time: 0.064010 May 28 04:48:20.551635 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1639/3409] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:48:20 2022] GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 1438 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:20.557579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-65952caf-1be3-4f7e-bbac-44c378963adb tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-65952caf-1be3-4f7e-bbac-44c378963adb tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Request method failure captured: May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikalu-RpVONPFe-uKaOLImh6DXtGyJ308PebiAzTwwQLOCFkmKKpMqgCCkUDGmG3Q77Dcd-0LoHqTVpQZkUvbzYcUlvo2uzgnyebK3NwEd-0xKb2cX-I1blXURqO50R3AFLPhHrKUJB7ImJ5hHAxur-a-hHRkgX2EMNSxY6V_Kf5wYVI May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: e912d921d9dd4406ab8279c483b17da0 May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: e912d921d9dd4406ab8279c483b17da0 May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ListServersNegativeTestJSON-123958158-project May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 3cd50f0dcc4b486fafdce740e661abdd May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ListServersNegativeTestJSON-123958158-project May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: action_args: {} May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'minimum': 0, May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance[0]: May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi '-1' May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 28 04:48:20.561528 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 28 04:48:20.566612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:48:20.566612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:48:20.566612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:48:20.566612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:48:20.566612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 28 04:48:20.566612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:20.566612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:20.566612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:20.566612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:20.566612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:20.566612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:20.566612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:48:20.566612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:48:20.566612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 28 04:48:20.566612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:20.568468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-65952caf-1be3-4f7e-bbac-44c378963adb tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:20.569488 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-65952caf-1be3-4f7e-bbac-44c378963adb tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.016704 May 28 04:48:20.572590 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1640/3410] 10.222.0.58 () {58 vars in 1141 bytes} [Sat May 28 04:48:20 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:48:20.580191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53dc4aa5-cd60-4d4a-b631-ac41aa5a6aea tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53dc4aa5-cd60-4d4a-b631-ac41aa5a6aea tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Request method failure captured: May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikalu-RpVONPFe-uKaOLImh6DXtGyJ308PebiAzTwwQLOCFkmKKpMqgCCkUDGmG3Q77Dcd-0LoHqTVpQZkUvbzYcUlvo2uzgnyebK3NwEd-0xKb2cX-I1blXURqO50R3AFLPhHrKUJB7ImJ5hHAxur-a-hHRkgX2EMNSxY6V_Kf5wYVI May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: e912d921d9dd4406ab8279c483b17da0 May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: e912d921d9dd4406ab8279c483b17da0 May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ListServersNegativeTestJSON-123958158-project May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 3cd50f0dcc4b486fafdce740e661abdd May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ListServersNegativeTestJSON-123958158-project May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: action_args: {} May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'minimum': 0, May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance[0]: May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'testing' May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 28 04:48:20.584901 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 28 04:48:20.593654 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:48:20.593654 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:48:20.593654 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:48:20.593654 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:48:20.593654 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 28 04:48:20.593654 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:20.593654 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:20.593654 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:20.593654 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:20.593654 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:20.593654 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:20.593654 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:48:20.593654 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:48:20.593654 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 28 04:48:20.593654 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:20.593654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53dc4aa5-cd60-4d4a-b631-ac41aa5a6aea tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:20.593654 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-53dc4aa5-cd60-4d4a-b631-ac41aa5a6aea tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.010247 May 28 04:48:20.593654 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1641/3411] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:48:20 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:48:20.619971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eba2e8ec-ef66-434d-97f6-f62071455b88 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:20.628024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eba2e8ec-ef66-434d-97f6-f62071455b88 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:20.630391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eba2e8ec-ef66-434d-97f6-f62071455b88 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'e912d921d9dd4406ab8279c483b17da0'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:48:20.641411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.compute.servers [None req-eba2e8ec-ef66-434d-97f6-f62071455b88 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Flavor 'non_existing_flavor' could not be found {{(pid=126043) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} May 28 04:48:20.642638 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eba2e8ec-ef66-434d-97f6-f62071455b88 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.033894 May 28 04:48:20.643780 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1642/3412] 10.222.0.58 () {58 vars in 1177 bytes} [Sat May 28 04:48:20 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:48:20.658345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-77ddf6c6-51ca-47db-81d7-cf947385f1f3 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:20.661941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-77ddf6c6-51ca-47db-81d7-cf947385f1f3 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:20.662785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-77ddf6c6-51ca-47db-81d7-cf947385f1f3 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'e912d921d9dd4406ab8279c483b17da0'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:48:20.669725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77ddf6c6-51ca-47db-81d7-cf947385f1f3 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:20.670459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77ddf6c6-51ca-47db-81d7-cf947385f1f3 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:20.671466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77ddf6c6-51ca-47db-81d7-cf947385f1f3 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:20.672080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77ddf6c6-51ca-47db-81d7-cf947385f1f3 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:20.821196 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-77ddf6c6-51ca-47db-81d7-cf947385f1f3 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.167804 May 28 04:48:20.822102 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1643/3413] 10.222.0.58 () {58 vars in 1173 bytes} [Sat May 28 04:48:20 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 04:48:20.852287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e39d6cfe-9b59-443c-bc6c-a3ef4df2b8a0 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:20.865245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e39d6cfe-9b59-443c-bc6c-a3ef4df2b8a0 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:20.866927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e39d6cfe-9b59-443c-bc6c-a3ef4df2b8a0 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'e912d921d9dd4406ab8279c483b17da0'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:48:20.888653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e39d6cfe-9b59-443c-bc6c-a3ef4df2b8a0 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:20.895944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e39d6cfe-9b59-443c-bc6c-a3ef4df2b8a0 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:20.899423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e39d6cfe-9b59-443c-bc6c-a3ef4df2b8a0 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:20.903367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e39d6cfe-9b59-443c-bc6c-a3ef4df2b8a0 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:21.101410 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e39d6cfe-9b59-443c-bc6c-a3ef4df2b8a0 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.270640 May 28 04:48:21.111665 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1644/3414] 10.222.0.58 () {58 vars in 1183 bytes} [Sat May 28 04:48:20 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:48:21.117547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0f7a404f-51cf-4589-82bc-2bab35abe2cb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:21.121022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0f7a404f-51cf-4589-82bc-2bab35abe2cb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:21.131505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f7a404f-51cf-4589-82bc-2bab35abe2cb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:21.132107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f7a404f-51cf-4589-82bc-2bab35abe2cb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:21.133002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f7a404f-51cf-4589-82bc-2bab35abe2cb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:21.133572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f7a404f-51cf-4589-82bc-2bab35abe2cb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:21.604455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0f7a404f-51cf-4589-82bc-2bab35abe2cb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:21.613111 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0f7a404f-51cf-4589-82bc-2bab35abe2cb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1655 microversion: 2.1 time: 0.500010 May 28 04:48:21.638125 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1645/3415] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:21 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1655 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:21.643975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e8c6fc4f-be5e-48c9-8cda-633fa9bb2b70 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:21.648992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e8c6fc4f-be5e-48c9-8cda-633fa9bb2b70 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:21.650584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e8c6fc4f-be5e-48c9-8cda-633fa9bb2b70 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Searching by: {'deleted': False, 'project_id': 'e912d921d9dd4406ab8279c483b17da0'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:48:21.664081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e8c6fc4f-be5e-48c9-8cda-633fa9bb2b70 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:21.664824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e8c6fc4f-be5e-48c9-8cda-633fa9bb2b70 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:21.665850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e8c6fc4f-be5e-48c9-8cda-633fa9bb2b70 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:21.666465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e8c6fc4f-be5e-48c9-8cda-633fa9bb2b70 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:21.701596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-e8c6fc4f-be5e-48c9-8cda-633fa9bb2b70 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:48:21.747527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e8c6fc4f-be5e-48c9-8cda-633fa9bb2b70 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:21.756562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e8c6fc4f-be5e-48c9-8cda-633fa9bb2b70 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:21.757059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e8c6fc4f-be5e-48c9-8cda-633fa9bb2b70 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:22.058312 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e8c6fc4f-be5e-48c9-8cda-633fa9bb2b70 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.418813 May 28 04:48:22.060895 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1646/3416] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:48:21 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:22.070745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-78b0835b-92ec-4193-a4c3-4f2bc33d5d4a req-78908ca5-019c-4df2-9bcf-050bd298ce16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4b052c1-5cd4-4931-b963-51075812ef15", "tag": "8ff44ef8-4b7e-4b51-a41b-3fd81eac7250"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:22.090572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-78b0835b-92ec-4193-a4c3-4f2bc33d5d4a req-78908ca5-019c-4df2-9bcf-050bd298ce16 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:22.091204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-78b0835b-92ec-4193-a4c3-4f2bc33d5d4a req-78908ca5-019c-4df2-9bcf-050bd298ce16 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:22.106684 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-78b0835b-92ec-4193-a4c3-4f2bc33d5d4a req-78908ca5-019c-4df2-9bcf-050bd298ce16 service nova] Creating event network-changed:8ff44ef8-4b7e-4b51-a41b-3fd81eac7250 for instance f4b052c1-5cd4-4931-b963-51075812ef15 on n-h1-843700-1 May 28 04:48:22.113398 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-78b0835b-92ec-4193-a4c3-4f2bc33d5d4a req-78908ca5-019c-4df2-9bcf-050bd298ce16 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048374 May 28 04:48:22.113398 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1647/3417] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:22.118870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-63d41f5f-57b7-44ae-96d9-e21ae7aa0d62 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:22.119484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-63d41f5f-57b7-44ae-96d9-e21ae7aa0d62 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: f4b052c1-5cd4-4931-b963-51075812ef15] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:22.127702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63d41f5f-57b7-44ae-96d9-e21ae7aa0d62 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:22.128417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63d41f5f-57b7-44ae-96d9-e21ae7aa0d62 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:22.129440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63d41f5f-57b7-44ae-96d9-e21ae7aa0d62 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:22.130200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63d41f5f-57b7-44ae-96d9-e21ae7aa0d62 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:22.305831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-63d41f5f-57b7-44ae-96d9-e21ae7aa0d62 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:22.313468 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-63d41f5f-57b7-44ae-96d9-e21ae7aa0d62 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15" status: 200 len: 1324 microversion: 2.1 time: 0.199516 May 28 04:48:22.314077 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1648/3418] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:22 2022] GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15 => generated 1324 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:22.328687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2dbf5325-99d1-4e07-8676-0d3d65439592 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:22.329621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2dbf5325-99d1-4e07-8676-0d3d65439592 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:22.335821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2dbf5325-99d1-4e07-8676-0d3d65439592 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:22.336922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2dbf5325-99d1-4e07-8676-0d3d65439592 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:22.337112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2dbf5325-99d1-4e07-8676-0d3d65439592 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:22.338502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2dbf5325-99d1-4e07-8676-0d3d65439592 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:22.347762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:22.376574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:22.386039 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2dbf5325-99d1-4e07-8676-0d3d65439592 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061217 May 28 04:48:22.386839 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1649/3419] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:48:22 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:22.395265 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-255e0b0e-a2cd-4ebd-9adf-245e415182cb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701f26310>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:22.410424 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-80d8aa2f-3b9c-47b1-9696-8599d3711cfc tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/2676bf61-38cc-47e8-9ef5-666faa0b36e0" status: 202 len: 0 microversion: 2.1 time: 1.942685 May 28 04:48:22.411820 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1771/3420] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 04:48:20 2022] DELETE /compute/v2.1/os-floating-ips/2676bf61-38cc-47e8-9ef5-666faa0b36e0 => generated 0 bytes in 1945 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:22.417369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a793ddfd-6c75-47fd-acf7-b7b371f8e506 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:22.417995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a793ddfd-6c75-47fd-acf7-b7b371f8e506 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:22.426357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a793ddfd-6c75-47fd-acf7-b7b371f8e506 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:22.427128 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a793ddfd-6c75-47fd-acf7-b7b371f8e506 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:22.428144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a793ddfd-6c75-47fd-acf7-b7b371f8e506 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:22.428782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a793ddfd-6c75-47fd-acf7-b7b371f8e506 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:22.452013 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-255e0b0e-a2cd-4ebd-9adf-245e415182cb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 200 len: 1447 microversion: 2.1 time: 0.064185 May 28 04:48:22.455026 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1650/3421] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:48:22 2022] GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 1447 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:22.457266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-27fe4b39-1a7e-4717-a391-7f5db2396618 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:22.460787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-27fe4b39-1a7e-4717-a391-7f5db2396618 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:22.461901 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-27fe4b39-1a7e-4717-a391-7f5db2396618 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.008107 May 28 04:48:22.462504 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1651/3422] 10.222.0.58 () {58 vars in 1177 bytes} [Sat May 28 04:48:22 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:48:22.466859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b16032ef-5430-4694-b7e6-960cb5b1cee1 tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] Calling method '.version_select at 0x7f7701e00310>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:22.513766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG neutronclient.v2_0.client [None req-b16032ef-5430-4694-b7e6-960cb5b1cee1 tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2676bf61-38cc-47e8-9ef5-666faa0b36e0 could not be found", "detail": ""}} {{(pid=126043) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:48:22.514548 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-b16032ef-5430-4694-b7e6-960cb5b1cee1 tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] HTTP exception thrown: Floating IP not found for ID 2676bf61-38cc-47e8-9ef5-666faa0b36e0 May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b16032ef-5430-4694-b7e6-960cb5b1cee1 tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] Request method failure captured: May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/os-floating-ips/2676bf61-38cc-47e8-9ef5-666faa0b36e0 HTTP/1.1 May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikamFxDphIW0Kb-26_yoBZaBPuJDWPmZ37adIys6wuUfIslIDATEio3w8h4RYeEQMwFyZV9fy44A6LViNpJUhquVADiQBgwAf8S3mAUVhh7nOsnLofAph-lNEMTG6dzfX2mfcnzq8wZSp16RXtOIs--swevwZ9XfqAAn4g_B6fT06GNs May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 31d0c09f0c3644d38f21db30d229251e May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-FloatingIPsTestJSON-974463460 May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_31d0c09f0c3644d38f21db30d229251e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/31d0c09f0c3644d38f21db30d229251e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31d0c09f0c3644d38f21db30d229251e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31d0c09f0c3644d38f21db30d229251e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-FloatingIPsTestJSON-974463460 May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 31d0c09f0c3644d38f21db30d229251e May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-FloatingIPsTestJSON-974463460 May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-FloatingIPsTestJSON-974463460-project May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: f410b9e578a8401fb9fa22974c2adf48 May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-FloatingIPsTestJSON-974463460-project May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: exception: Floating IP not found for ID 2676bf61-38cc-47e8-9ef5-666faa0b36e0 May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '2676bf61-38cc-47e8-9ef5-666faa0b36e0'} May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2676bf61-38cc-47e8-9ef5-666faa0b36e0 could not be found May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1b178a9-73cc-492c-8592-69d00e571132'] May 28 04:48:22.516558 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2676bf61-38cc-47e8-9ef5-666faa0b36e0. May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2676bf61-38cc-47e8-9ef5-666faa0b36e0 May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2676bf61-38cc-47e8-9ef5-666faa0b36e0 May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b16032ef-5430-4694-b7e6-960cb5b1cee1 tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] Returning 404 to user: Floating IP not found for ID 2676bf61-38cc-47e8-9ef5-666faa0b36e0 {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b16032ef-5430-4694-b7e6-960cb5b1cee1 tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/2676bf61-38cc-47e8-9ef5-666faa0b36e0" status: 404 len: 111 microversion: 2.1 time: 0.054357 May 28 04:48:22.520981 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1652/3423] 10.222.0.58 () {58 vars in 1259 bytes} [Sat May 28 04:48:22 2022] GET /compute/v2.1/os-floating-ips/2676bf61-38cc-47e8-9ef5-666faa0b36e0 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:22.527314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b348aa3d-0012-4200-86e7-2620386e175a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701e00310>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:22.573996 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b348aa3d-0012-4200-86e7-2620386e175a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 200 len: 1447 microversion: 2.1 time: 0.053914 May 28 04:48:22.574623 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1653/3424] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:48:22 2022] GET /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 1447 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:22.579148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fe0cff7c-1bb1-4d02-a2d6-2df3e8690275 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:22.582480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fe0cff7c-1bb1-4d02-a2d6-2df3e8690275 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:22.583310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fe0cff7c-1bb1-4d02-a2d6-2df3e8690275 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Searching by: {'deleted': False, 'project_id': 'e912d921d9dd4406ab8279c483b17da0'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:48:22.589672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe0cff7c-1bb1-4d02-a2d6-2df3e8690275 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:22.590483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe0cff7c-1bb1-4d02-a2d6-2df3e8690275 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:22.591022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe0cff7c-1bb1-4d02-a2d6-2df3e8690275 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:22.591457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe0cff7c-1bb1-4d02-a2d6-2df3e8690275 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:22.617210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-fe0cff7c-1bb1-4d02-a2d6-2df3e8690275 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:48:22.644977 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fe0cff7c-1bb1-4d02-a2d6-2df3e8690275 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.069335 May 28 04:48:22.645566 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1654/3425] 10.222.0.58 () {58 vars in 1124 bytes} [Sat May 28 04:48:22 2022] GET /compute/v2.1/servers => generated 683 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:22.651090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-91bf6d56-b623-4837-9a6e-393bdf7d9b95 tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] Calling method '.version_select at 0x7f7700c740d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:22.675553 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a793ddfd-6c75-47fd-acf7-b7b371f8e506 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action" status: 202 len: 0 microversion: 2.1 time: 0.262040 May 28 04:48:22.677257 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1772/3426] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:48:22 2022] POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:22.684370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b9176e6e-e619-498b-95ac-0b816efe6d26 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701e45820>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:22.693347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG neutronclient.v2_0.client [None req-91bf6d56-b623-4837-9a6e-393bdf7d9b95 tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2676bf61-38cc-47e8-9ef5-666faa0b36e0 could not be found", "detail": ""}} {{(pid=126043) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:48:22.694035 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-91bf6d56-b623-4837-9a6e-393bdf7d9b95 tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] HTTP exception thrown: Floating IP not found for ID 2676bf61-38cc-47e8-9ef5-666faa0b36e0 May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-91bf6d56-b623-4837-9a6e-393bdf7d9b95 tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] Request method failure captured: May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/os-floating-ips/2676bf61-38cc-47e8-9ef5-666faa0b36e0 HTTP/1.1 May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikamFxDphIW0Kb-26_yoBZaBPuJDWPmZ37adIys6wuUfIslIDATEio3w8h4RYeEQMwFyZV9fy44A6LViNpJUhquVADiQBgwAf8S3mAUVhh7nOsnLofAph-lNEMTG6dzfX2mfcnzq8wZSp16RXtOIs--swevwZ9XfqAAn4g_B6fT06GNs May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 31d0c09f0c3644d38f21db30d229251e May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-FloatingIPsTestJSON-974463460 May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_31d0c09f0c3644d38f21db30d229251e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/31d0c09f0c3644d38f21db30d229251e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31d0c09f0c3644d38f21db30d229251e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31d0c09f0c3644d38f21db30d229251e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-FloatingIPsTestJSON-974463460 May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 31d0c09f0c3644d38f21db30d229251e May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-FloatingIPsTestJSON-974463460 May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-FloatingIPsTestJSON-974463460-project May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: f410b9e578a8401fb9fa22974c2adf48 May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-FloatingIPsTestJSON-974463460-project May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: exception: Floating IP not found for ID 2676bf61-38cc-47e8-9ef5-666faa0b36e0 May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '2676bf61-38cc-47e8-9ef5-666faa0b36e0'} May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2676bf61-38cc-47e8-9ef5-666faa0b36e0 could not be found May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8eae3cbd-a2ec-42c5-8aea-fdb139c32f89'] May 28 04:48:22.696211 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2676bf61-38cc-47e8-9ef5-666faa0b36e0. May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2676bf61-38cc-47e8-9ef5-666faa0b36e0 May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2676bf61-38cc-47e8-9ef5-666faa0b36e0 May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-91bf6d56-b623-4837-9a6e-393bdf7d9b95 tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] Returning 404 to user: Floating IP not found for ID 2676bf61-38cc-47e8-9ef5-666faa0b36e0 {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-91bf6d56-b623-4837-9a6e-393bdf7d9b95 tempest-FloatingIPsTestJSON-974463460 tempest-FloatingIPsTestJSON-974463460-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/2676bf61-38cc-47e8-9ef5-666faa0b36e0" status: 404 len: 111 microversion: 2.1 time: 0.052207 May 28 04:48:22.701238 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1655/3427] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 04:48:22 2022] DELETE /compute/v2.1/os-floating-ips/2676bf61-38cc-47e8-9ef5-666faa0b36e0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:22.708986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e9ecbeef-1cdd-47c6-ad28-95f0885f4297 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:22.709578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e9ecbeef-1cdd-47c6-ad28-95f0885f4297 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: b2a2e64b-2bf0-4d17-b81e-f9f79e81db22] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:22.732279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9ecbeef-1cdd-47c6-ad28-95f0885f4297 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:22.732905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9ecbeef-1cdd-47c6-ad28-95f0885f4297 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:22.744696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9ecbeef-1cdd-47c6-ad28-95f0885f4297 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:22.744696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9ecbeef-1cdd-47c6-ad28-95f0885f4297 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:22.758621 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-e9ecbeef-1cdd-47c6-ad28-95f0885f4297 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] HTTP exception thrown: Instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 could not be found. May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e9ecbeef-1cdd-47c6-ad28-95f0885f4297 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Request method failure captured: May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 HTTP/1.1 May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikalu-RpVONPFe-uKaOLImh6DXtGyJ308PebiAzTwwQLOCFkmKKpMqgCCkUDGmG3Q77Dcd-0LoHqTVpQZkUvbzYcUlvo2uzgnyebK3NwEd-0xKb2cX-I1blXURqO50R3AFLPhHrKUJB7ImJ5hHAxur-a-hHRkgX2EMNSxY6V_Kf5wYVI May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: e912d921d9dd4406ab8279c483b17da0 May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: e912d921d9dd4406ab8279c483b17da0 May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ListServersNegativeTestJSON-123958158-project May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 3cd50f0dcc4b486fafdce740e661abdd May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ListServersNegativeTestJSON-123958158-project May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 could not be found. May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'b2a2e64b-2bf0-4d17-b81e-f9f79e81db22'} May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 could not be found. May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:22.761563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:22.766312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 could not be found. May 28 04:48:22.766312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:22.766312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:22.766312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:22.766312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:22.766312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:22.766312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:22.766312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:22.766312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:22.766312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 could not be found. May 28 04:48:22.766312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:22.766312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e9ecbeef-1cdd-47c6-ad28-95f0885f4297 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Returning 404 to user: Instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:22.766312 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e9ecbeef-1cdd-47c6-ad28-95f0885f4297 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b2a2e64b-2bf0-4d17-b81e-f9f79e81db22" status: 404 len: 111 microversion: 2.1 time: 0.063061 May 28 04:48:22.766312 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1656/3428] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:48:22 2022] DELETE /compute/v2.1/servers/b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:22.773216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d5f18b04-1ba3-4bb8-8ca6-bc9ac897b1f4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:22.773852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d5f18b04-1ba3-4bb8-8ca6-bc9ac897b1f4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:22.781567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5f18b04-1ba3-4bb8-8ca6-bc9ac897b1f4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:22.782111 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5f18b04-1ba3-4bb8-8ca6-bc9ac897b1f4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:22.784515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5f18b04-1ba3-4bb8-8ca6-bc9ac897b1f4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:22.785050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5f18b04-1ba3-4bb8-8ca6-bc9ac897b1f4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:22.967942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d5f18b04-1ba3-4bb8-8ca6-bc9ac897b1f4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:22.989366 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d5f18b04-1ba3-4bb8-8ca6-bc9ac897b1f4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1662 microversion: 2.1 time: 0.209408 May 28 04:48:22.994319 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1657/3429] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:22 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1662 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:23.003844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b82bd4f2-cd73-4e6e-9029-740b20256d0d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:23.004375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b82bd4f2-cd73-4e6e-9029-740b20256d0d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: a70f5df3-aa9d-4a76-bf08-d7d3074061c1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:23.011420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:23.021419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b82bd4f2-cd73-4e6e-9029-740b20256d0d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:23.021419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b82bd4f2-cd73-4e6e-9029-740b20256d0d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:23.021419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b82bd4f2-cd73-4e6e-9029-740b20256d0d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:23.021419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b82bd4f2-cd73-4e6e-9029-740b20256d0d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:23.090108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b82bd4f2-cd73-4e6e-9029-740b20256d0d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: a70f5df3-aa9d-4a76-bf08-d7d3074061c1] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:48:23.537720 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b82bd4f2-cd73-4e6e-9029-740b20256d0d tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1" status: 204 len: 0 microversion: 2.1 time: 0.541733 May 28 04:48:23.542527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=8 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:23.543400 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1658/3430] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:48:22 2022] DELETE /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:48:23.551119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-08539540-0252-4a72-8ba1-ec25071fa230 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:23.552082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-08539540-0252-4a72-8ba1-ec25071fa230 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: f4b052c1-5cd4-4931-b963-51075812ef15] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:23.560351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-08539540-0252-4a72-8ba1-ec25071fa230 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:23.561008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-08539540-0252-4a72-8ba1-ec25071fa230 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:23.561948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-08539540-0252-4a72-8ba1-ec25071fa230 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:23.562591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-08539540-0252-4a72-8ba1-ec25071fa230 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:23.777835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-08539540-0252-4a72-8ba1-ec25071fa230 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:23.791811 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-08539540-0252-4a72-8ba1-ec25071fa230 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15" status: 200 len: 1324 microversion: 2.1 time: 0.246374 May 28 04:48:23.793089 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1659/3431] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:23 2022] GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15 => generated 1324 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:23.799425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6a5b5e3f-2710-4891-a81a-5f54b2f5a054 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:23.800710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6a5b5e3f-2710-4891-a81a-5f54b2f5a054 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:23.808295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a5b5e3f-2710-4891-a81a-5f54b2f5a054 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:23.809079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a5b5e3f-2710-4891-a81a-5f54b2f5a054 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:23.810116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a5b5e3f-2710-4891-a81a-5f54b2f5a054 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:23.810751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a5b5e3f-2710-4891-a81a-5f54b2f5a054 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:23.848793 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6a5b5e3f-2710-4891-a81a-5f54b2f5a054 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053575 May 28 04:48:23.856105 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1660/3432] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:48:23 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:23.856105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e508e1a4-b28d-4006-9e72-50ce3547ffb4 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:23.856105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e508e1a4-b28d-4006-9e72-50ce3547ffb4 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: e484efaa-4e49-47b4-a969-1135ed7ac02e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:23.864576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e508e1a4-b28d-4006-9e72-50ce3547ffb4 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:23.865268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e508e1a4-b28d-4006-9e72-50ce3547ffb4 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:23.866409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e508e1a4-b28d-4006-9e72-50ce3547ffb4 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:23.867062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e508e1a4-b28d-4006-9e72-50ce3547ffb4 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:23.898193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e508e1a4-b28d-4006-9e72-50ce3547ffb4 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: e484efaa-4e49-47b4-a969-1135ed7ac02e] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:48:24.130570 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b9176e6e-e619-498b-95ac-0b816efe6d26 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "DELETE /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 204 len: 0 microversion: 2.1 time: 1.451961 May 28 04:48:24.131672 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1773/3433] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:22 2022] DELETE /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 0 bytes in 1454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:48:24.140866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6abd9962-8487-46a3-a870-3544d8a6bedc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:24.151635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6abd9962-8487-46a3-a870-3544d8a6bedc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:24.169078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6abd9962-8487-46a3-a870-3544d8a6bedc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:24.171774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6abd9962-8487-46a3-a870-3544d8a6bedc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:24.172776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6abd9962-8487-46a3-a870-3544d8a6bedc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:24.173463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6abd9962-8487-46a3-a870-3544d8a6bedc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:24.251920 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e508e1a4-b28d-4006-9e72-50ce3547ffb4 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e" status: 204 len: 0 microversion: 2.1 time: 0.400519 May 28 04:48:24.257037 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1661/3434] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:48:23 2022] DELETE /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:48:24.261878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c8753f96-f207-44e0-b177-5e805090cd9b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:24.262845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c8753f96-f207-44e0-b177-5e805090cd9b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:24.270186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c8753f96-f207-44e0-b177-5e805090cd9b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:24.271021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c8753f96-f207-44e0-b177-5e805090cd9b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:24.271646 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c8753f96-f207-44e0-b177-5e805090cd9b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:24.272098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c8753f96-f207-44e0-b177-5e805090cd9b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:24.302595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c8753f96-f207-44e0-b177-5e805090cd9b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:48:24.393647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6abd9962-8487-46a3-a870-3544d8a6bedc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:24.403697 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:24.407280 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6abd9962-8487-46a3-a870-3544d8a6bedc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.274331 May 28 04:48:24.410681 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1774/3435] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:24 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:24.421365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ddfbdf2d-b8fe-4e08-b58c-09912fd85df2 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:24.423103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ddfbdf2d-b8fe-4e08-b58c-09912fd85df2 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: b2a2e64b-2bf0-4d17-b81e-f9f79e81db22] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:24.434037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddfbdf2d-b8fe-4e08-b58c-09912fd85df2 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:24.434514 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddfbdf2d-b8fe-4e08-b58c-09912fd85df2 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:24.435786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddfbdf2d-b8fe-4e08-b58c-09912fd85df2 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:24.436658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddfbdf2d-b8fe-4e08-b58c-09912fd85df2 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:24.457461 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-ddfbdf2d-b8fe-4e08-b58c-09912fd85df2 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] HTTP exception thrown: Instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 could not be found. May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ddfbdf2d-b8fe-4e08-b58c-09912fd85df2 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Request method failure captured: May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 HTTP/1.1 May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikalu-RpVONPFe-uKaOLImh6DXtGyJ308PebiAzTwwQLOCFkmKKpMqgCCkUDGmG3Q77Dcd-0LoHqTVpQZkUvbzYcUlvo2uzgnyebK3NwEd-0xKb2cX-I1blXURqO50R3AFLPhHrKUJB7ImJ5hHAxur-a-hHRkgX2EMNSxY6V_Kf5wYVI May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: e912d921d9dd4406ab8279c483b17da0 May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: e912d921d9dd4406ab8279c483b17da0 May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ListServersNegativeTestJSON-123958158-project May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 3cd50f0dcc4b486fafdce740e661abdd May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ListServersNegativeTestJSON-123958158-project May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 could not be found. May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'b2a2e64b-2bf0-4d17-b81e-f9f79e81db22'} May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 could not be found. May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 could not be found. May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:24.459973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:24.465327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:24.465327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:24.465327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:24.465327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:24.465327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:24.465327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 could not be found. May 28 04:48:24.465327 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:24.468814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ddfbdf2d-b8fe-4e08-b58c-09912fd85df2 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Returning 404 to user: Instance b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:24.470160 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ddfbdf2d-b8fe-4e08-b58c-09912fd85df2 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/b2a2e64b-2bf0-4d17-b81e-f9f79e81db22" status: 404 len: 111 microversion: 2.1 time: 0.058256 May 28 04:48:24.475031 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1775/3436] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:24 2022] GET /compute/v2.1/servers/b2a2e64b-2bf0-4d17-b81e-f9f79e81db22 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:24.483877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bbe7c9ec-5a8c-4a62-ae8a-96e02564c145 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:24.484706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bbe7c9ec-5a8c-4a62-ae8a-96e02564c145 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:24.492237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bbe7c9ec-5a8c-4a62-ae8a-96e02564c145 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:24.492943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bbe7c9ec-5a8c-4a62-ae8a-96e02564c145 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:24.493975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bbe7c9ec-5a8c-4a62-ae8a-96e02564c145 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:24.494614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bbe7c9ec-5a8c-4a62-ae8a-96e02564c145 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:24.699245 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c8753f96-f207-44e0-b177-5e805090cd9b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4" status: 204 len: 0 microversion: 2.1 time: 0.442834 May 28 04:48:24.700383 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1662/3437] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:48:24 2022] DELETE /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:48:24.710105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5296801a-2f6f-431f-bbf0-8149bb0cd301 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:24.712011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5296801a-2f6f-431f-bbf0-8149bb0cd301 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: a70f5df3-aa9d-4a76-bf08-d7d3074061c1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:24.731259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5296801a-2f6f-431f-bbf0-8149bb0cd301 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:24.731727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5296801a-2f6f-431f-bbf0-8149bb0cd301 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:24.737013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5296801a-2f6f-431f-bbf0-8149bb0cd301 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:24.737501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5296801a-2f6f-431f-bbf0-8149bb0cd301 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:24.912292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bbe7c9ec-5a8c-4a62-ae8a-96e02564c145 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:24.926421 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bbe7c9ec-5a8c-4a62-ae8a-96e02564c145 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.449930 May 28 04:48:24.928652 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1776/3438] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:24 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:24.937285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-52233a4e-0aa1-4ce1-b8ab-80d64ee54cef tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:24.944052 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-52233a4e-0aa1-4ce1-b8ab-80d64ee54cef tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: f4b052c1-5cd4-4931-b963-51075812ef15] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:24.961041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52233a4e-0aa1-4ce1-b8ab-80d64ee54cef tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:24.963851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52233a4e-0aa1-4ce1-b8ab-80d64ee54cef tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:24.967015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52233a4e-0aa1-4ce1-b8ab-80d64ee54cef tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:24.967627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52233a4e-0aa1-4ce1-b8ab-80d64ee54cef tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:25.261088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5296801a-2f6f-431f-bbf0-8149bb0cd301 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:25.278357 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5296801a-2f6f-431f-bbf0-8149bb0cd301 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1" status: 200 len: 1522 microversion: 2.1 time: 0.574906 May 28 04:48:25.282736 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1663/3439] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:24 2022] GET /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1 => generated 1522 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:25.303026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0ea2962f-66c0-4864-8a31-daeac67dda54 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:25.309030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0ea2962f-66c0-4864-8a31-daeac67dda54 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:25.328187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ea2962f-66c0-4864-8a31-daeac67dda54 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:25.340596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ea2962f-66c0-4864-8a31-daeac67dda54 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:25.341696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ea2962f-66c0-4864-8a31-daeac67dda54 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:25.342307 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ea2962f-66c0-4864-8a31-daeac67dda54 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:25.385156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-52233a4e-0aa1-4ce1-b8ab-80d64ee54cef tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:25.395549 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-52233a4e-0aa1-4ce1-b8ab-80d64ee54cef tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15" status: 200 len: 1324 microversion: 2.1 time: 0.464416 May 28 04:48:25.405817 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0ea2962f-66c0-4864-8a31-daeac67dda54 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107949 May 28 04:48:25.405817 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1664/3440] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:48:25 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:25.406553 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1777/3441] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:24 2022] GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15 => generated 1324 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:25.411783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-14960806-9826-4ad6-9465-97acf2485d96 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:25.412664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-14960806-9826-4ad6-9465-97acf2485d96 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:25.416142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2bc1a5f5-effc-40dc-8a69-edb1217febed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1833766714", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "aaf67aae-c4ff-4ac3-8e4e-a4156646067f"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:25.424840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14960806-9826-4ad6-9465-97acf2485d96 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:25.425600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14960806-9826-4ad6-9465-97acf2485d96 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:25.428933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14960806-9826-4ad6-9465-97acf2485d96 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:25.431028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14960806-9826-4ad6-9465-97acf2485d96 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:25.529505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-2bc1a5f5-effc-40dc-8a69-edb1217febed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] validate_networks() for [('aaf67aae-c4ff-4ac3-8e4e-a4156646067f', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:48:26.010740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-14960806-9826-4ad6-9465-97acf2485d96 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:26.021622 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-14960806-9826-4ad6-9465-97acf2485d96 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.613701 May 28 04:48:26.026085 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1778/3442] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:25 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:26.062306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-95b41ed6-7879-4ca0-97bc-7f7b9fdd378c req-66e5f71e-f66e-4dbf-852d-8df33b6029ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7dda089-96b9-4547-b637-d2caa776a3d4", "name": "network-vif-unplugged", "status": "completed", "tag": "2aba3595-8739-4d74-a7db-3baf89b855be"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:26.110982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-95b41ed6-7879-4ca0-97bc-7f7b9fdd378c req-66e5f71e-f66e-4dbf-852d-8df33b6029ba service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:26.125027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-95b41ed6-7879-4ca0-97bc-7f7b9fdd378c req-66e5f71e-f66e-4dbf-852d-8df33b6029ba service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:26.182468 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-95b41ed6-7879-4ca0-97bc-7f7b9fdd378c req-66e5f71e-f66e-4dbf-852d-8df33b6029ba service nova] Creating event network-vif-unplugged:2aba3595-8739-4d74-a7db-3baf89b855be for instance b7dda089-96b9-4547-b637-d2caa776a3d4 on n-h1-843700-1 May 28 04:48:26.214039 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-95b41ed6-7879-4ca0-97bc-7f7b9fdd378c req-66e5f71e-f66e-4dbf-852d-8df33b6029ba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.180686 May 28 04:48:26.214713 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1779/3443] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:26.237903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eacc81d2-2b5e-4120-afd9-74ee6373b7f0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:26.238628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-eacc81d2-2b5e-4120-afd9-74ee6373b7f0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:26.270697 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eacc81d2-2b5e-4120-afd9-74ee6373b7f0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:26.271248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eacc81d2-2b5e-4120-afd9-74ee6373b7f0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:26.273286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eacc81d2-2b5e-4120-afd9-74ee6373b7f0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:26.273764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eacc81d2-2b5e-4120-afd9-74ee6373b7f0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:27.264281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-eacc81d2-2b5e-4120-afd9-74ee6373b7f0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:27.280203 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-eacc81d2-2b5e-4120-afd9-74ee6373b7f0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 1.058540 May 28 04:48:27.283112 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1780/3444] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:26 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:27.297359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e3ff9eda-b5af-4b82-a3af-3e2c92860a23 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:27.299968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e3ff9eda-b5af-4b82-a3af-3e2c92860a23 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: a70f5df3-aa9d-4a76-bf08-d7d3074061c1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:27.324774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3ff9eda-b5af-4b82-a3af-3e2c92860a23 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:27.325115 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3ff9eda-b5af-4b82-a3af-3e2c92860a23 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:27.326407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3ff9eda-b5af-4b82-a3af-3e2c92860a23 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:27.339688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3ff9eda-b5af-4b82-a3af-3e2c92860a23 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:27.750916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-2bc1a5f5-effc-40dc-8a69-edb1217febed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:48:27.752787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-2bc1a5f5-effc-40dc-8a69-edb1217febed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:48:27.753519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-2bc1a5f5-effc-40dc-8a69-edb1217febed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:48:27.757428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-2bc1a5f5-effc-40dc-8a69-edb1217febed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:48:27.757428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-2bc1a5f5-effc-40dc-8a69-edb1217febed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:48:27.769660 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2bc1a5f5-effc-40dc-8a69-edb1217febed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:27.770817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2bc1a5f5-effc-40dc-8a69-edb1217febed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:27.771948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2bc1a5f5-effc-40dc-8a69-edb1217febed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:27.772571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2bc1a5f5-effc-40dc-8a69-edb1217febed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:27.796415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-2bc1a5f5-effc-40dc-8a69-edb1217febed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Getting quotas for project da841757a2094bad83e04816bb355969. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:48:27.803683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-2bc1a5f5-effc-40dc-8a69-edb1217febed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Getting quotas for user c07b3b1388d24bae9e8834c8b9a4f3a9 and project da841757a2094bad83e04816bb355969. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:48:27.838558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2bc1a5f5-effc-40dc-8a69-edb1217febed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:48:27.842381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2bc1a5f5-effc-40dc-8a69-edb1217febed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:48:27.908494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e3ff9eda-b5af-4b82-a3af-3e2c92860a23 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:27.923507 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e3ff9eda-b5af-4b82-a3af-3e2c92860a23 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1" status: 200 len: 1522 microversion: 2.1 time: 0.639090 May 28 04:48:27.924398 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1781/3445] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:27 2022] GET /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1 => generated 1522 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:27.930236 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a2302723-5551-4360-8aac-0c06492fbd94 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:27.937528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a2302723-5551-4360-8aac-0c06492fbd94 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: f4b052c1-5cd4-4931-b963-51075812ef15] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:27.940228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a2302723-5551-4360-8aac-0c06492fbd94 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:27.940818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a2302723-5551-4360-8aac-0c06492fbd94 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:27.941730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a2302723-5551-4360-8aac-0c06492fbd94 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:27.942239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a2302723-5551-4360-8aac-0c06492fbd94 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:28.060680 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2bc1a5f5-effc-40dc-8a69-edb1217febed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.651176 May 28 04:48:28.065167 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1665/3446] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:48:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:48:28.073962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c218c964-502d-4d3b-a5c9-842ad462cae3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:28.096000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c218c964-502d-4d3b-a5c9-842ad462cae3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:28.115109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c218c964-502d-4d3b-a5c9-842ad462cae3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:28.115578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c218c964-502d-4d3b-a5c9-842ad462cae3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:28.116371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c218c964-502d-4d3b-a5c9-842ad462cae3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:28.116815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c218c964-502d-4d3b-a5c9-842ad462cae3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:28.201340 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c218c964-502d-4d3b-a5c9-842ad462cae3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.133625 May 28 04:48:28.203886 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1666/3447] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:48:28 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52/os-volume_attachments => generated 25 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:48:28.215790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-40acb34c-c0ae-41a5-a65d-50898eb62c30 req-bcd81f08-c73d-49e3-b5c4-697ad647d6fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e484efaa-4e49-47b4-a969-1135ed7ac02e", "name": "network-vif-deleted", "tag": "ebb15e41-1f07-47a6-81d5-2a1bf4ab992b"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:28.224396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-40acb34c-c0ae-41a5-a65d-50898eb62c30 req-bcd81f08-c73d-49e3-b5c4-697ad647d6fa service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:28.225093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-40acb34c-c0ae-41a5-a65d-50898eb62c30 req-bcd81f08-c73d-49e3-b5c4-697ad647d6fa service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:28.241477 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-40acb34c-c0ae-41a5-a65d-50898eb62c30 req-bcd81f08-c73d-49e3-b5c4-697ad647d6fa service nova] Creating event network-vif-deleted:ebb15e41-1f07-47a6-81d5-2a1bf4ab992b for instance e484efaa-4e49-47b4-a969-1135ed7ac02e on n-h2-843700-1 May 28 04:48:28.247179 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-40acb34c-c0ae-41a5-a65d-50898eb62c30 req-bcd81f08-c73d-49e3-b5c4-697ad647d6fa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041689 May 28 04:48:28.249299 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1667/3448] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:28.254153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-454085f3-bc53-4048-bdec-14cc0c32a33e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:28.255192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-454085f3-bc53-4048-bdec-14cc0c32a33e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:28.263686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-454085f3-bc53-4048-bdec-14cc0c32a33e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:28.264310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-454085f3-bc53-4048-bdec-14cc0c32a33e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:28.265276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-454085f3-bc53-4048-bdec-14cc0c32a33e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:28.265913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-454085f3-bc53-4048-bdec-14cc0c32a33e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:28.278795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:28.343742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a2302723-5551-4360-8aac-0c06492fbd94 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:28.353628 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a2302723-5551-4360-8aac-0c06492fbd94 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15" status: 200 len: 1324 microversion: 2.1 time: 0.427280 May 28 04:48:28.365120 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1782/3449] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:27 2022] GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15 => generated 1324 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:28.373088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6033ee3f-4874-46fe-b2ae-b184af10feb7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:28.374080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6033ee3f-4874-46fe-b2ae-b184af10feb7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:28.507105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6033ee3f-4874-46fe-b2ae-b184af10feb7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:28.521786 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6033ee3f-4874-46fe-b2ae-b184af10feb7 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 200 len: 1208 microversion: 2.1 time: 0.155160 May 28 04:48:28.522363 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1783/3450] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:28 2022] GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 1208 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:28.535291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-f3ef8d85-ca1b-480f-87fa-d5c0640c6c00 req-fb4fcdd1-835f-44eb-89ba-312ad1bc2042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b052c1-5cd4-4931-b963-51075812ef15", "name": "network-vif-plugged", "status": "completed", "tag": "8ff44ef8-4b7e-4b51-a41b-3fd81eac7250"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:28.548864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f3ef8d85-ca1b-480f-87fa-d5c0640c6c00 req-fb4fcdd1-835f-44eb-89ba-312ad1bc2042 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:28.549425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f3ef8d85-ca1b-480f-87fa-d5c0640c6c00 req-fb4fcdd1-835f-44eb-89ba-312ad1bc2042 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:28.565234 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-f3ef8d85-ca1b-480f-87fa-d5c0640c6c00 req-fb4fcdd1-835f-44eb-89ba-312ad1bc2042 service nova] Creating event network-vif-plugged:8ff44ef8-4b7e-4b51-a41b-3fd81eac7250 for instance f4b052c1-5cd4-4931-b963-51075812ef15 on n-h1-843700-1 May 28 04:48:28.578381 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-f3ef8d85-ca1b-480f-87fa-d5c0640c6c00 req-fb4fcdd1-835f-44eb-89ba-312ad1bc2042 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054471 May 28 04:48:28.580048 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1784/3451] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:28.593888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-057e8b49-65b7-47c6-9185-6eac303ff2fc tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:28.593888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-057e8b49-65b7-47c6-9185-6eac303ff2fc tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:28.596394 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-057e8b49-65b7-47c6-9185-6eac303ff2fc tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:28.597096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-057e8b49-65b7-47c6-9185-6eac303ff2fc tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:28.598142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-057e8b49-65b7-47c6-9185-6eac303ff2fc tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:28.598822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-057e8b49-65b7-47c6-9185-6eac303ff2fc tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:28.655550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-057e8b49-65b7-47c6-9185-6eac303ff2fc tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:48:29.061485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-454085f3-bc53-4048-bdec-14cc0c32a33e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:29.074777 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-454085f3-bc53-4048-bdec-14cc0c32a33e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.821039 May 28 04:48:29.075639 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1668/3452] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:28 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:29.085067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6b69fa0e-6813-4e27-8eff-d4c855969f50 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:29.085898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6b69fa0e-6813-4e27-8eff-d4c855969f50 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: a70f5df3-aa9d-4a76-bf08-d7d3074061c1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:29.095933 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b69fa0e-6813-4e27-8eff-d4c855969f50 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:29.096540 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b69fa0e-6813-4e27-8eff-d4c855969f50 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:29.097483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b69fa0e-6813-4e27-8eff-d4c855969f50 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:29.098107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b69fa0e-6813-4e27-8eff-d4c855969f50 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:29.104608 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-057e8b49-65b7-47c6-9185-6eac303ff2fc tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52" status: 204 len: 0 microversion: 2.1 time: 0.522856 May 28 04:48:29.109061 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1785/3453] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:48:28 2022] DELETE /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:48:29.117077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-11bfbb79-45ea-4b51-b194-d541ca10791d req-7f2407ab-becf-4087-bd95-5fd6f06a1c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70f5df3-aa9d-4a76-bf08-d7d3074061c1", "name": "network-vif-deleted", "tag": "c17b7d12-ad1e-4b36-a7bb-01c82a4c12ab"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:29.151293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-11bfbb79-45ea-4b51-b194-d541ca10791d req-7f2407ab-becf-4087-bd95-5fd6f06a1c4a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:29.154183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-11bfbb79-45ea-4b51-b194-d541ca10791d req-7f2407ab-becf-4087-bd95-5fd6f06a1c4a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:29.182598 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-11bfbb79-45ea-4b51-b194-d541ca10791d req-7f2407ab-becf-4087-bd95-5fd6f06a1c4a service nova] Creating event network-vif-deleted:c17b7d12-ad1e-4b36-a7bb-01c82a4c12ab for instance a70f5df3-aa9d-4a76-bf08-d7d3074061c1 on n-h1-843700-1 May 28 04:48:29.192216 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-11bfbb79-45ea-4b51-b194-d541ca10791d req-7f2407ab-becf-4087-bd95-5fd6f06a1c4a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081663 May 28 04:48:29.194753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6b69fa0e-6813-4e27-8eff-d4c855969f50 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:29.197269 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1786/3454] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:29.208412 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6b69fa0e-6813-4e27-8eff-d4c855969f50 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1" status: 200 len: 1480 microversion: 2.1 time: 0.131518 May 28 04:48:29.213161 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1669/3455] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:29 2022] GET /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1 => generated 1480 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:29.220041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-41a2bf0b-efc3-4618-b4a8-dcf0bf268755 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:29.221157 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-41a2bf0b-efc3-4618-b4a8-dcf0bf268755 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:29.223844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9b20eaf0-1b07-440e-aebc-83b0d4007842 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:29.228804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9b20eaf0-1b07-440e-aebc-83b0d4007842 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:29.231669 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41a2bf0b-efc3-4618-b4a8-dcf0bf268755 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:29.232402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41a2bf0b-efc3-4618-b4a8-dcf0bf268755 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:29.234191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41a2bf0b-efc3-4618-b4a8-dcf0bf268755 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:29.235843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41a2bf0b-efc3-4618-b4a8-dcf0bf268755 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:29.239801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b20eaf0-1b07-440e-aebc-83b0d4007842 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:29.244856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b20eaf0-1b07-440e-aebc-83b0d4007842 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:29.246448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b20eaf0-1b07-440e-aebc-83b0d4007842 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:29.248529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9b20eaf0-1b07-440e-aebc-83b0d4007842 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:29.510459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9b20eaf0-1b07-440e-aebc-83b0d4007842 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:29.512917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-41a2bf0b-efc3-4618-b4a8-dcf0bf268755 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:29.521085 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-41a2bf0b-efc3-4618-b4a8-dcf0bf268755 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52" status: 200 len: 1679 microversion: 2.1 time: 0.306132 May 28 04:48:29.532221 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1670/3456] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:29 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52 => generated 1679 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:29.532221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f934a033-f16d-4721-852f-341a53b2888f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:29.532221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f934a033-f16d-4721-852f-341a53b2888f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: f4b052c1-5cd4-4931-b963-51075812ef15] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:29.535720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f934a033-f16d-4721-852f-341a53b2888f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:29.536151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f934a033-f16d-4721-852f-341a53b2888f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:29.536960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f934a033-f16d-4721-852f-341a53b2888f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:29.537353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f934a033-f16d-4721-852f-341a53b2888f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:29.539043 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9b20eaf0-1b07-440e-aebc-83b0d4007842 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.338203 May 28 04:48:29.540407 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1787/3457] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:29 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:29.548571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-028866c4-7117-4797-afc3-352ab6602747 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:29.549421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-028866c4-7117-4797-afc3-352ab6602747 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:29.627978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-028866c4-7117-4797-afc3-352ab6602747 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:29.638020 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-028866c4-7117-4797-afc3-352ab6602747 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 200 len: 1208 microversion: 2.1 time: 0.095911 May 28 04:48:29.647774 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1788/3458] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:29 2022] GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 1208 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:29.729380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f934a033-f16d-4721-852f-341a53b2888f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:29.746704 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f934a033-f16d-4721-852f-341a53b2888f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15" status: 200 len: 1324 microversion: 2.1 time: 0.223622 May 28 04:48:29.748036 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1671/3459] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:29 2022] GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15 => generated 1324 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:30.229136 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bb8404aa-1d04-42c0-b19a-570d1b247c34 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:30.229677 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bb8404aa-1d04-42c0-b19a-570d1b247c34 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: a70f5df3-aa9d-4a76-bf08-d7d3074061c1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:30.237948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb8404aa-1d04-42c0-b19a-570d1b247c34 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:30.246582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb8404aa-1d04-42c0-b19a-570d1b247c34 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:30.246582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb8404aa-1d04-42c0-b19a-570d1b247c34 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:30.246582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb8404aa-1d04-42c0-b19a-570d1b247c34 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:30.317654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bb8404aa-1d04-42c0-b19a-570d1b247c34 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:30.327082 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bb8404aa-1d04-42c0-b19a-570d1b247c34 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1" status: 200 len: 1308 microversion: 2.1 time: 0.102729 May 28 04:48:30.327768 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1789/3460] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:30 2022] GET /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1 => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:48:30.541917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a4ebd8ee-4476-4287-b1cb-5f16f79f2982 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:30.542522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a4ebd8ee-4476-4287-b1cb-5f16f79f2982 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:30.549507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4ebd8ee-4476-4287-b1cb-5f16f79f2982 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:30.554280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4ebd8ee-4476-4287-b1cb-5f16f79f2982 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:30.554280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4ebd8ee-4476-4287-b1cb-5f16f79f2982 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:30.554280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4ebd8ee-4476-4287-b1cb-5f16f79f2982 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:30.657816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9507228e-4ef7-4439-bbd6-911cf65ab901 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:30.659174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9507228e-4ef7-4439-bbd6-911cf65ab901 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:30.679765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9507228e-4ef7-4439-bbd6-911cf65ab901 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:30.680238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9507228e-4ef7-4439-bbd6-911cf65ab901 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:30.682520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9507228e-4ef7-4439-bbd6-911cf65ab901 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:30.686175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9507228e-4ef7-4439-bbd6-911cf65ab901 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:30.718518 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a4ebd8ee-4476-4287-b1cb-5f16f79f2982 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:30.728211 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a4ebd8ee-4476-4287-b1cb-5f16f79f2982 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52" status: 200 len: 1679 microversion: 2.1 time: 0.190121 May 28 04:48:30.728813 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1672/3461] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:30 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52 => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:48:30.767765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c06ea13c-4b2d-4f8b-bb37-5bae153f8450 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:30.768706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c06ea13c-4b2d-4f8b-bb37-5bae153f8450 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: f4b052c1-5cd4-4931-b963-51075812ef15] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:30.778456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c06ea13c-4b2d-4f8b-bb37-5bae153f8450 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:30.780606 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c06ea13c-4b2d-4f8b-bb37-5bae153f8450 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:30.786052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c06ea13c-4b2d-4f8b-bb37-5bae153f8450 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:30.786052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c06ea13c-4b2d-4f8b-bb37-5bae153f8450 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:30.799362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9507228e-4ef7-4439-bbd6-911cf65ab901 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:30.810674 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9507228e-4ef7-4439-bbd6-911cf65ab901 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 200 len: 1260 microversion: 2.1 time: 0.155482 May 28 04:48:30.819209 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1790/3462] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:30 2022] GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:48:30.938287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c06ea13c-4b2d-4f8b-bb37-5bae153f8450 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:30.955530 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c06ea13c-4b2d-4f8b-bb37-5bae153f8450 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15" status: 200 len: 1324 microversion: 2.1 time: 0.193116 May 28 04:48:30.971939 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1673/3463] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:30 2022] GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15 => generated 1324 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:31.253074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-0963d8ce-79d3-4007-8532-83a9cb56edd9 req-c0cceb61-1034-4487-abdd-529fc8a5f529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7dda089-96b9-4547-b637-d2caa776a3d4", "name": "network-vif-deleted", "tag": "2aba3595-8739-4d74-a7db-3baf89b855be"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:31.268386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-0963d8ce-79d3-4007-8532-83a9cb56edd9 req-c0cceb61-1034-4487-abdd-529fc8a5f529 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:31.269485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-0963d8ce-79d3-4007-8532-83a9cb56edd9 req-c0cceb61-1034-4487-abdd-529fc8a5f529 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:31.299318 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-0963d8ce-79d3-4007-8532-83a9cb56edd9 req-c0cceb61-1034-4487-abdd-529fc8a5f529 service nova] Creating event network-vif-deleted:2aba3595-8739-4d74-a7db-3baf89b855be for instance b7dda089-96b9-4547-b637-d2caa776a3d4 on n-h1-843700-1 May 28 04:48:31.313913 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-0963d8ce-79d3-4007-8532-83a9cb56edd9 req-c0cceb61-1034-4487-abdd-529fc8a5f529 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066225 May 28 04:48:31.321308 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1791/3464] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:31.344354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-feb83910-0793-4f21-81a2-671b20512acc tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:31.345227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-feb83910-0793-4f21-81a2-671b20512acc tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: a70f5df3-aa9d-4a76-bf08-d7d3074061c1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:31.356744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-feb83910-0793-4f21-81a2-671b20512acc tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:31.359366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-feb83910-0793-4f21-81a2-671b20512acc tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:31.359366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-feb83910-0793-4f21-81a2-671b20512acc tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:31.359366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-feb83910-0793-4f21-81a2-671b20512acc tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:31.472109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-feb83910-0793-4f21-81a2-671b20512acc tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:31.472446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-feb83910-0793-4f21-81a2-671b20512acc tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:31.475083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-feb83910-0793-4f21-81a2-671b20512acc tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lazy-loading 'fault' on Instance uuid a70f5df3-aa9d-4a76-bf08-d7d3074061c1 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:48:31.655182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-feb83910-0793-4f21-81a2-671b20512acc tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd50f0dcc4b486fafdce740e661abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e912d921d9dd4406ab8279c483b17da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:31.663345 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-feb83910-0793-4f21-81a2-671b20512acc tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1" status: 200 len: 1313 microversion: 2.1 time: 0.323389 May 28 04:48:31.664251 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1674/3465] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:31 2022] GET /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1 => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:31.747020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c7d8744c-0d30-4a6c-bbee-b8d7701ab669 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:31.747819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c7d8744c-0d30-4a6c-bbee-b8d7701ab669 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:31.764867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c7d8744c-0d30-4a6c-bbee-b8d7701ab669 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:31.765389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c7d8744c-0d30-4a6c-bbee-b8d7701ab669 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:31.766178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c7d8744c-0d30-4a6c-bbee-b8d7701ab669 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:31.766666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c7d8744c-0d30-4a6c-bbee-b8d7701ab669 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:31.829925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d6db15f6-af91-4651-b65c-90c467e1aa63 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:31.830563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d6db15f6-af91-4651-b65c-90c467e1aa63 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:31.848165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6db15f6-af91-4651-b65c-90c467e1aa63 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:31.848726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6db15f6-af91-4651-b65c-90c467e1aa63 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:31.849760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6db15f6-af91-4651-b65c-90c467e1aa63 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:31.850440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6db15f6-af91-4651-b65c-90c467e1aa63 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:31.980208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d6db15f6-af91-4651-b65c-90c467e1aa63 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:31.991144 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d6db15f6-af91-4651-b65c-90c467e1aa63 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 200 len: 1266 microversion: 2.1 time: 0.169705 May 28 04:48:31.992129 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1675/3466] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:31 2022] GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:32.005471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-661db8ff-82ba-4747-9be4-79b324a56b56 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:32.006192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-661db8ff-82ba-4747-9be4-79b324a56b56 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: f4b052c1-5cd4-4931-b963-51075812ef15] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:32.013436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-661db8ff-82ba-4747-9be4-79b324a56b56 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:32.013828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-661db8ff-82ba-4747-9be4-79b324a56b56 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:32.014618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-661db8ff-82ba-4747-9be4-79b324a56b56 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:32.015089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-661db8ff-82ba-4747-9be4-79b324a56b56 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:32.167476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c7d8744c-0d30-4a6c-bbee-b8d7701ab669 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:32.179566 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c7d8744c-0d30-4a6c-bbee-b8d7701ab669 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52" status: 200 len: 1679 microversion: 2.1 time: 0.437495 May 28 04:48:32.180182 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1792/3467] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:31 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52 => generated 1679 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:32.313834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-661db8ff-82ba-4747-9be4-79b324a56b56 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:32.323299 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-661db8ff-82ba-4747-9be4-79b324a56b56 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15" status: 200 len: 1520 microversion: 2.1 time: 0.329735 May 28 04:48:32.329992 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1676/3468] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:31 2022] GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15 => generated 1520 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:32.346487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-df8c3778-f4f9-43d9-82dc-94a2c9655ab3 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:32.347282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-df8c3778-f4f9-43d9-82dc-94a2c9655ab3 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: f4b052c1-5cd4-4931-b963-51075812ef15] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:32.354402 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df8c3778-f4f9-43d9-82dc-94a2c9655ab3 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:32.373961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df8c3778-f4f9-43d9-82dc-94a2c9655ab3 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:32.377610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df8c3778-f4f9-43d9-82dc-94a2c9655ab3 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:32.379580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df8c3778-f4f9-43d9-82dc-94a2c9655ab3 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:32.428621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-df8c3778-f4f9-43d9-82dc-94a2c9655ab3 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: f4b052c1-5cd4-4931-b963-51075812ef15] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:48:32.561471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:32.682340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1a677761-f960-43a0-b3ca-5e1064901d38 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:32.682965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1a677761-f960-43a0-b3ca-5e1064901d38 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: a70f5df3-aa9d-4a76-bf08-d7d3074061c1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:32.690232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a677761-f960-43a0-b3ca-5e1064901d38 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:32.690693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a677761-f960-43a0-b3ca-5e1064901d38 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:32.691886 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a677761-f960-43a0-b3ca-5e1064901d38 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:32.692338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a677761-f960-43a0-b3ca-5e1064901d38 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:32.713087 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-1a677761-f960-43a0-b3ca-5e1064901d38 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] HTTP exception thrown: Instance a70f5df3-aa9d-4a76-bf08-d7d3074061c1 could not be found. May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1a677761-f960-43a0-b3ca-5e1064901d38 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Request method failure captured: May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1 HTTP/1.1 May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikalu-RpVONPFe-uKaOLImh6DXtGyJ308PebiAzTwwQLOCFkmKKpMqgCCkUDGmG3Q77Dcd-0LoHqTVpQZkUvbzYcUlvo2uzgnyebK3NwEd-0xKb2cX-I1blXURqO50R3AFLPhHrKUJB7ImJ5hHAxur-a-hHRkgX2EMNSxY6V_Kf5wYVI May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: e912d921d9dd4406ab8279c483b17da0 May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: e912d921d9dd4406ab8279c483b17da0 May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ListServersNegativeTestJSON-123958158-project May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 3cd50f0dcc4b486fafdce740e661abdd May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ListServersNegativeTestJSON-123958158-project May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance a70f5df3-aa9d-4a76-bf08-d7d3074061c1 could not be found. May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'a70f5df3-aa9d-4a76-bf08-d7d3074061c1'} May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a70f5df3-aa9d-4a76-bf08-d7d3074061c1 could not be found. May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a70f5df3-aa9d-4a76-bf08-d7d3074061c1 could not be found. May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:32.715594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:32.720661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:32.720661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:32.720661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:32.720661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:32.720661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:32.720661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a70f5df3-aa9d-4a76-bf08-d7d3074061c1 could not be found. May 28 04:48:32.720661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:32.722451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1a677761-f960-43a0-b3ca-5e1064901d38 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Returning 404 to user: Instance a70f5df3-aa9d-4a76-bf08-d7d3074061c1 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:32.724896 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1a677761-f960-43a0-b3ca-5e1064901d38 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1" status: 404 len: 111 microversion: 2.1 time: 0.047416 May 28 04:48:32.734373 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1677/3469] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:32 2022] GET /compute/v2.1/servers/a70f5df3-aa9d-4a76-bf08-d7d3074061c1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:32.743729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1219b6e5-c749-46ee-98e5-799a80ac0759 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:32.744371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1219b6e5-c749-46ee-98e5-799a80ac0759 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] [instance: e484efaa-4e49-47b4-a969-1135ed7ac02e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:32.751189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1219b6e5-c749-46ee-98e5-799a80ac0759 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:32.751649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1219b6e5-c749-46ee-98e5-799a80ac0759 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:32.752514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1219b6e5-c749-46ee-98e5-799a80ac0759 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:32.753474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1219b6e5-c749-46ee-98e5-799a80ac0759 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:32.780145 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-1219b6e5-c749-46ee-98e5-799a80ac0759 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] HTTP exception thrown: Instance e484efaa-4e49-47b4-a969-1135ed7ac02e could not be found. May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1219b6e5-c749-46ee-98e5-799a80ac0759 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Request method failure captured: May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e HTTP/1.1 May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikalu-RpVONPFe-uKaOLImh6DXtGyJ308PebiAzTwwQLOCFkmKKpMqgCCkUDGmG3Q77Dcd-0LoHqTVpQZkUvbzYcUlvo2uzgnyebK3NwEd-0xKb2cX-I1blXURqO50R3AFLPhHrKUJB7ImJ5hHAxur-a-hHRkgX2EMNSxY6V_Kf5wYVI May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: e912d921d9dd4406ab8279c483b17da0 May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e912d921d9dd4406ab8279c483b17da0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: e912d921d9dd4406ab8279c483b17da0 May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-123958158 May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ListServersNegativeTestJSON-123958158-project May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 3cd50f0dcc4b486fafdce740e661abdd May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ListServersNegativeTestJSON-123958158-project May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance e484efaa-4e49-47b4-a969-1135ed7ac02e could not be found. May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'e484efaa-4e49-47b4-a969-1135ed7ac02e'} May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e484efaa-4e49-47b4-a969-1135ed7ac02e could not be found. May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e484efaa-4e49-47b4-a969-1135ed7ac02e could not be found. May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:32.781706 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:32.788194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:32.788194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:32.788194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:32.788194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:32.788194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:32.788194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e484efaa-4e49-47b4-a969-1135ed7ac02e could not be found. May 28 04:48:32.788194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:32.788194 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1219b6e5-c749-46ee-98e5-799a80ac0759 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] Returning 404 to user: Instance e484efaa-4e49-47b4-a969-1135ed7ac02e could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:32.788194 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1219b6e5-c749-46ee-98e5-799a80ac0759 tempest-ListServersNegativeTestJSON-123958158 tempest-ListServersNegativeTestJSON-123958158-project] 10.222.0.58 "GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e" status: 404 len: 111 microversion: 2.1 time: 0.045700 May 28 04:48:32.788194 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1678/3470] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:32 2022] GET /compute/v2.1/servers/e484efaa-4e49-47b4-a969-1135ed7ac02e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:32.911935 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-df8c3778-f4f9-43d9-82dc-94a2c9655ab3 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15" status: 204 len: 0 microversion: 2.1 time: 0.569834 May 28 04:48:32.914022 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1793/3471] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:48:32 2022] DELETE /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:48:32.925402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3766be5f-2eca-46ef-90e6-76497663f2d9 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:32.926252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3766be5f-2eca-46ef-90e6-76497663f2d9 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: f4b052c1-5cd4-4931-b963-51075812ef15] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:32.940106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3766be5f-2eca-46ef-90e6-76497663f2d9 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:32.940959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3766be5f-2eca-46ef-90e6-76497663f2d9 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:32.942203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3766be5f-2eca-46ef-90e6-76497663f2d9 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:32.943734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3766be5f-2eca-46ef-90e6-76497663f2d9 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:33.010490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ca82f56a-89ab-46e6-bd28-9b85096433a5 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:33.011017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ca82f56a-89ab-46e6-bd28-9b85096433a5 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:33.018374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca82f56a-89ab-46e6-bd28-9b85096433a5 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:33.018813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca82f56a-89ab-46e6-bd28-9b85096433a5 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:33.019629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca82f56a-89ab-46e6-bd28-9b85096433a5 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:33.020181 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca82f56a-89ab-46e6-bd28-9b85096433a5 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:33.345088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3766be5f-2eca-46ef-90e6-76497663f2d9 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:33.354126 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3766be5f-2eca-46ef-90e6-76497663f2d9 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15" status: 200 len: 1526 microversion: 2.1 time: 0.435447 May 28 04:48:33.366479 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1679/3472] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:32 2022] GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15 => generated 1526 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:33.371838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6fd9b76a-dfed-45e2-a99f-012b447b8d2d tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:33.378511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ca82f56a-89ab-46e6-bd28-9b85096433a5 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:33.386752 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ca82f56a-89ab-46e6-bd28-9b85096433a5 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 200 len: 1308 microversion: 2.1 time: 0.381057 May 28 04:48:33.390855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6fd9b76a-dfed-45e2-a99f-012b447b8d2d tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:33.400551 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1794/3473] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:33 2022] GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 1308 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:48:33.405584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-25806947-03c4-46c4-9d59-d981d6f14aa4 req-ad753b62-bad0-43ca-9efb-86b71fbfcb06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0459f5ac-8ba7-47a4-9c7b-808496f08d52", "name": "network-vif-deleted", "tag": "6edc6b84-cf07-4f57-8cd5-e6e0f81dd2f8"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:33.416687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6fd9b76a-dfed-45e2-a99f-012b447b8d2d tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:33.418807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6fd9b76a-dfed-45e2-a99f-012b447b8d2d tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:33.420949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6fd9b76a-dfed-45e2-a99f-012b447b8d2d tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:33.421413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6fd9b76a-dfed-45e2-a99f-012b447b8d2d tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:33.430508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-25806947-03c4-46c4-9d59-d981d6f14aa4 req-ad753b62-bad0-43ca-9efb-86b71fbfcb06 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:33.431239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-25806947-03c4-46c4-9d59-d981d6f14aa4 req-ad753b62-bad0-43ca-9efb-86b71fbfcb06 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:33.459702 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-25806947-03c4-46c4-9d59-d981d6f14aa4 req-ad753b62-bad0-43ca-9efb-86b71fbfcb06 service nova] Creating event network-vif-deleted:6edc6b84-cf07-4f57-8cd5-e6e0f81dd2f8 for instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 on n-h1-843700-1 May 28 04:48:33.465866 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-25806947-03c4-46c4-9d59-d981d6f14aa4 req-ad753b62-bad0-43ca-9efb-86b71fbfcb06 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063837 May 28 04:48:33.466655 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1795/3474] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:33.520779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6fd9b76a-dfed-45e2-a99f-012b447b8d2d tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:33.530149 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6fd9b76a-dfed-45e2-a99f-012b447b8d2d tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52" status: 200 len: 1613 microversion: 2.1 time: 0.162218 May 28 04:48:33.540268 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1680/3475] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:33 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52 => generated 1613 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:34.379188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c2387222-883f-4dc7-b17d-9c2f5a461ebc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:34.379949 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c2387222-883f-4dc7-b17d-9c2f5a461ebc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: f4b052c1-5cd4-4931-b963-51075812ef15] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:34.400993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2387222-883f-4dc7-b17d-9c2f5a461ebc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:34.404909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2387222-883f-4dc7-b17d-9c2f5a461ebc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:34.405100 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53985241-05ff-48fc-92ad-e98a25ebaf03 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:34.405748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-53985241-05ff-48fc-92ad-e98a25ebaf03 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:34.405983 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2387222-883f-4dc7-b17d-9c2f5a461ebc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:34.406441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2387222-883f-4dc7-b17d-9c2f5a461ebc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:34.417536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53985241-05ff-48fc-92ad-e98a25ebaf03 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:34.423885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53985241-05ff-48fc-92ad-e98a25ebaf03 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:34.424939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53985241-05ff-48fc-92ad-e98a25ebaf03 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:34.425468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53985241-05ff-48fc-92ad-e98a25ebaf03 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:35.044199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c2387222-883f-4dc7-b17d-9c2f5a461ebc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:35.046235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-53985241-05ff-48fc-92ad-e98a25ebaf03 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:35.073692 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c2387222-883f-4dc7-b17d-9c2f5a461ebc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15" status: 200 len: 1526 microversion: 2.1 time: 0.702631 May 28 04:48:35.074866 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-53985241-05ff-48fc-92ad-e98a25ebaf03 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 200 len: 1308 microversion: 2.1 time: 0.675160 May 28 04:48:35.076703 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1796/3476] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:34 2022] GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15 => generated 1526 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:35.077694 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1681/3477] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:34 2022] GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 1308 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:35.085526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b8e6f4de-b384-468a-871d-f02c54b078f5 req-6aa44c5e-5020-4121-83f7-efe2fe31645b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad996d0-08a2-4d1e-b434-342b5b209db0", "tag": "050fba79-1eec-49ec-b04a-05ff6a5d53e6"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:35.115647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-90353268-a186-4de5-9076-9e3a7f99e1b8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:35.116744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-90353268-a186-4de5-9076-9e3a7f99e1b8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:35.134787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:35.137738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b8e6f4de-b384-468a-871d-f02c54b078f5 req-6aa44c5e-5020-4121-83f7-efe2fe31645b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:35.141937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90353268-a186-4de5-9076-9e3a7f99e1b8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:35.142706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b8e6f4de-b384-468a-871d-f02c54b078f5 req-6aa44c5e-5020-4121-83f7-efe2fe31645b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:35.145255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90353268-a186-4de5-9076-9e3a7f99e1b8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:35.147371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90353268-a186-4de5-9076-9e3a7f99e1b8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:35.150733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90353268-a186-4de5-9076-9e3a7f99e1b8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:35.173848 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b8e6f4de-b384-468a-871d-f02c54b078f5 req-6aa44c5e-5020-4121-83f7-efe2fe31645b service nova] Creating event network-changed:050fba79-1eec-49ec-b04a-05ff6a5d53e6 for instance bad996d0-08a2-4d1e-b434-342b5b209db0 on n-h2-843700-1 May 28 04:48:35.186230 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b8e6f4de-b384-468a-871d-f02c54b078f5 req-6aa44c5e-5020-4121-83f7-efe2fe31645b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106232 May 28 04:48:35.187356 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1682/3478] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:35.204443 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90353268-a186-4de5-9076-9e3a7f99e1b8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:35.205403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90353268-a186-4de5-9076-9e3a7f99e1b8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:35.206119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-90353268-a186-4de5-9076-9e3a7f99e1b8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lazy-loading 'fault' on Instance uuid 0459f5ac-8ba7-47a4-9c7b-808496f08d52 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:48:35.292644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-90353268-a186-4de5-9076-9e3a7f99e1b8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:35.309076 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-90353268-a186-4de5-9076-9e3a7f99e1b8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52" status: 200 len: 1331 microversion: 2.1 time: 0.226874 May 28 04:48:35.310084 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1797/3479] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:35 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52 => generated 1331 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:35.383960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-82b34230-0f36-4afd-b8f7-6e9845f6fa5c req-a4a90856-5398-48f7-bd60-154332867530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b052c1-5cd4-4931-b963-51075812ef15", "name": "network-vif-unplugged", "status": "completed", "tag": "8ff44ef8-4b7e-4b51-a41b-3fd81eac7250"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:35.393845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-82b34230-0f36-4afd-b8f7-6e9845f6fa5c req-a4a90856-5398-48f7-bd60-154332867530 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:35.394257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-82b34230-0f36-4afd-b8f7-6e9845f6fa5c req-a4a90856-5398-48f7-bd60-154332867530 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:35.406866 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-82b34230-0f36-4afd-b8f7-6e9845f6fa5c req-a4a90856-5398-48f7-bd60-154332867530 service nova] Creating event network-vif-unplugged:8ff44ef8-4b7e-4b51-a41b-3fd81eac7250 for instance f4b052c1-5cd4-4931-b963-51075812ef15 on n-h1-843700-1 May 28 04:48:35.412979 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-82b34230-0f36-4afd-b8f7-6e9845f6fa5c req-a4a90856-5398-48f7-bd60-154332867530 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034277 May 28 04:48:35.414159 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1683/3480] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:35.965460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-c223b399-cc40-4b64-9c96-164fa9da0115 req-174758aa-8522-4ee2-8f4b-f52928668e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b052c1-5cd4-4931-b963-51075812ef15", "name": "network-vif-deleted", "tag": "8ff44ef8-4b7e-4b51-a41b-3fd81eac7250"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:35.977415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c223b399-cc40-4b64-9c96-164fa9da0115 req-174758aa-8522-4ee2-8f4b-f52928668e5d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:35.978551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c223b399-cc40-4b64-9c96-164fa9da0115 req-174758aa-8522-4ee2-8f4b-f52928668e5d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:35.993281 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-c223b399-cc40-4b64-9c96-164fa9da0115 req-174758aa-8522-4ee2-8f4b-f52928668e5d service nova] Creating event network-vif-deleted:8ff44ef8-4b7e-4b51-a41b-3fd81eac7250 for instance f4b052c1-5cd4-4931-b963-51075812ef15 on n-h1-843700-1 May 28 04:48:36.000815 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-c223b399-cc40-4b64-9c96-164fa9da0115 req-174758aa-8522-4ee2-8f4b-f52928668e5d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041412 May 28 04:48:36.002736 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1798/3481] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:36.097967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-249c9c42-b382-485e-b99a-dfe8d063ec91 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:36.100842 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-534df582-ee4b-40b6-8344-dcca2fd950c8 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:36.101926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-249c9c42-b382-485e-b99a-dfe8d063ec91 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:36.104060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-534df582-ee4b-40b6-8344-dcca2fd950c8 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: f4b052c1-5cd4-4931-b963-51075812ef15] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:36.133388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-534df582-ee4b-40b6-8344-dcca2fd950c8 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:36.136081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-534df582-ee4b-40b6-8344-dcca2fd950c8 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:36.139653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-534df582-ee4b-40b6-8344-dcca2fd950c8 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:36.139653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-534df582-ee4b-40b6-8344-dcca2fd950c8 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:36.140672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-249c9c42-b382-485e-b99a-dfe8d063ec91 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:36.141217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-249c9c42-b382-485e-b99a-dfe8d063ec91 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:36.142398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-249c9c42-b382-485e-b99a-dfe8d063ec91 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:36.142936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-249c9c42-b382-485e-b99a-dfe8d063ec91 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:36.265859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-534df582-ee4b-40b6-8344-dcca2fd950c8 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:36.274790 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-534df582-ee4b-40b6-8344-dcca2fd950c8 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15" status: 200 len: 1484 microversion: 2.1 time: 0.184803 May 28 04:48:36.282124 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1684/3482] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:36 2022] GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15 => generated 1484 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:36.328021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-02ba3baa-85bb-45e9-ba9e-249f70455344 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:36.328763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-02ba3baa-85bb-45e9-ba9e-249f70455344 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:36.338260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02ba3baa-85bb-45e9-ba9e-249f70455344 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:36.344316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02ba3baa-85bb-45e9-ba9e-249f70455344 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:36.345169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02ba3baa-85bb-45e9-ba9e-249f70455344 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:36.345618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02ba3baa-85bb-45e9-ba9e-249f70455344 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:36.385742 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-02ba3baa-85bb-45e9-ba9e-249f70455344 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] HTTP exception thrown: Instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 could not be found. May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-02ba3baa-85bb-45e9-ba9e-249f70455344 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Request method failure captured: May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52 HTTP/1.1 May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikajS0ZZaXFlax6A342ymJ-aQoGJlvna1xZy9bO84b3D9OriaYICvIupIZdjiNLcHyTC7V-bCXuJxYAHanDCccz0wxij-I7blA2wa6CB5mbuJxMVXKjiUcQwy4f7KRJtSQW8-6D6CRl3EsAa-9i5aRJ6Odwpn_PfoRh6K409eAlefhoM May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 025cb09c79a147b3a648c950edcd1dc3 May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 could not be found. May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '0459f5ac-8ba7-47a4-9c7b-808496f08d52'} May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 could not be found. May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 could not be found. May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:36.389189 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:36.394541 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:36.394541 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:36.394541 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:36.394541 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:36.394541 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:36.394541 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 could not be found. May 28 04:48:36.394541 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:36.394541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-02ba3baa-85bb-45e9-ba9e-249f70455344 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Returning 404 to user: Instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:36.394541 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-02ba3baa-85bb-45e9-ba9e-249f70455344 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52" status: 404 len: 111 microversion: 2.1 time: 0.066745 May 28 04:48:36.394541 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1685/3483] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:36 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:48:36.432372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-249c9c42-b382-485e-b99a-dfe8d063ec91 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:36.448638 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-249c9c42-b382-485e-b99a-dfe8d063ec91 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 200 len: 1308 microversion: 2.1 time: 0.351585 May 28 04:48:36.452347 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1799/3484] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:36 2022] GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 1308 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:36.465082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-61a285e9-81c0-4576-9211-c967f1bd63e1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '.version_select at 0x7f7701d29c10>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:36.542080 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-61a285e9-81c0-4576-9211-c967f1bd63e1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1066120182" status: 202 len: 0 microversion: 2.1 time: 0.087572 May 28 04:48:36.546261 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1800/3485] 10.222.0.58 () {58 vars in 1220 bytes} [Sat May 28 04:48:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1066120182 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:36.581601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-97e71ef0-fe4e-46a2-ac2b-9208ae7bb825 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Action: 'create', calling method: .version_select at 0x7f7700d3adc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-540716395", "description": "tempest-description-332207646"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:37.172963 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-97e71ef0-fe4e-46a2-ac2b-9208ae7bb825 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.779074 May 28 04:48:37.173997 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1686/3486] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:48:36 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:37.187009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-27ee47c0-2a21-4e95-9e47-f9c9e5cf5ae0 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Action: 'create', calling method: .version_select at 0x7f7701e969d0>, body: {"security_group_rule": {"parent_group_id": "70c32b8f-c5f8-48e6-af1b-d47bf4051169", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:37.298420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-793b3452-06cf-479e-890f-de3048b5ba51 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:37.299378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-793b3452-06cf-479e-890f-de3048b5ba51 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: f4b052c1-5cd4-4931-b963-51075812ef15] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:37.307468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-793b3452-06cf-479e-890f-de3048b5ba51 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:37.308201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-793b3452-06cf-479e-890f-de3048b5ba51 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:37.309183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-793b3452-06cf-479e-890f-de3048b5ba51 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:37.309791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-793b3452-06cf-479e-890f-de3048b5ba51 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:37.372384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-793b3452-06cf-479e-890f-de3048b5ba51 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:37.372842 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-793b3452-06cf-479e-890f-de3048b5ba51 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:37.373416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-793b3452-06cf-479e-890f-de3048b5ba51 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lazy-loading 'fault' on Instance uuid f4b052c1-5cd4-4931-b963-51075812ef15 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:48:37.449167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-793b3452-06cf-479e-890f-de3048b5ba51 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b37465157dd44a09cffbbe57322d264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9b98186db746ae83181dd7db6d56e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:37.459295 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-793b3452-06cf-479e-890f-de3048b5ba51 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15" status: 200 len: 1314 microversion: 2.1 time: 0.164695 May 28 04:48:37.459887 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1687/3487] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:37 2022] GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:37.475102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8b8fcfa7-e48f-4351-9edb-0cdaf73fdaef tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:37.475723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8b8fcfa7-e48f-4351-9edb-0cdaf73fdaef tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:37.482912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b8fcfa7-e48f-4351-9edb-0cdaf73fdaef tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:37.483533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b8fcfa7-e48f-4351-9edb-0cdaf73fdaef tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:37.484523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b8fcfa7-e48f-4351-9edb-0cdaf73fdaef tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:37.485251 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b8fcfa7-e48f-4351-9edb-0cdaf73fdaef tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:37.512617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:37.739841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8b8fcfa7-e48f-4351-9edb-0cdaf73fdaef tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:37.748398 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8b8fcfa7-e48f-4351-9edb-0cdaf73fdaef tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 200 len: 1308 microversion: 2.1 time: 0.277639 May 28 04:48:37.748970 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1688/3488] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:37 2022] GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 1308 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:37.754041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ecf1c323-274b-4d33-a82b-5463c19b97e2 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Action: 'create', calling method: .version_select at 0x7f77009fe0d0>, body: {"keypair": {"name": "tempest-keypair-687473329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfdoUe1DzXPgtWGiPLBV+HCj4pXkIHLTAlL73YgvD3T1Jk8E8C5mBMKfxsawF5EZ8cLTNMoxH2Q/t2HU02Py4SUMuEhv7yw8kynan28qcTvatrjYtimtR3eAp5nCbxw5Q=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:37.768308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-ecf1c323-274b-4d33-a82b-5463c19b97e2 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Getting quotas for project d1e7c34036184ea8b80241695fdbf329. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:48:37.770714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:37.774275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-ecf1c323-274b-4d33-a82b-5463c19b97e2 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Getting quotas for user 025cb09c79a147b3a648c950edcd1dc3 and project d1e7c34036184ea8b80241695fdbf329. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:48:37.783414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=16 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:37.842256 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-27ee47c0-2a21-4e95-9e47-f9c9e5cf5ae0 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.659665 May 28 04:48:37.842398 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1801/3489] 10.222.0.58 () {60 vars in 1194 bytes} [Sat May 28 04:48:37 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:37.853890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a6890690-76df-457f-ad5e-07a3b85fe00b tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Action: 'create', calling method: .version_select at 0x7f7701f49820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-696818194", "description": "tempest-description-1142075879"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:37.867737 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ecf1c323-274b-4d33-a82b-5463c19b97e2 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.117557 May 28 04:48:37.869132 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1689/3490] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:48:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:38.479424 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a6890690-76df-457f-ad5e-07a3b85fe00b tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.629277 May 28 04:48:38.489668 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1802/3491] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:48:37 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:48:38.490784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d71ed0b2-fd37-41b3-a777-1ec878e1724a tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:38.491517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d71ed0b2-fd37-41b3-a777-1ec878e1724a tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: f4b052c1-5cd4-4931-b963-51075812ef15] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:38.501276 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-098109bb-640e-4f01-9aa8-4a1453d0f7a9 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Action: 'create', calling method: .version_select at 0x7f7701e969d0>, body: {"security_group_rule": {"parent_group_id": "985e3e03-9a06-4a57-ab0a-f541296557b0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:38.514728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d71ed0b2-fd37-41b3-a777-1ec878e1724a tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:38.515664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d71ed0b2-fd37-41b3-a777-1ec878e1724a tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:38.516920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d71ed0b2-fd37-41b3-a777-1ec878e1724a tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:38.517718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d71ed0b2-fd37-41b3-a777-1ec878e1724a tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:38.536169 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-d71ed0b2-fd37-41b3-a777-1ec878e1724a tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] HTTP exception thrown: Instance f4b052c1-5cd4-4931-b963-51075812ef15 could not be found. May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d71ed0b2-fd37-41b3-a777-1ec878e1724a tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Request method failure captured: May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15 HTTP/1.1 May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikak47QAs5K06QhfhkIquusTq5B930GK2qX0_12di_Rh32YDa0oiawwGAqeo88DT65woz1MmOY2wmnqGoSlDi_TB5nkwOW_jtkf8bwl1MIAPkkOt7hgVlVdmgC8btNyj4GvAvNekqk5WajXo3d43lpqxKK68oDpAyv5Nz9V4rMhAcq7c May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 6b37465157dd44a09cffbbe57322d264 May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance f4b052c1-5cd4-4931-b963-51075812ef15 could not be found. May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'f4b052c1-5cd4-4931-b963-51075812ef15'} May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4b052c1-5cd4-4931-b963-51075812ef15 could not be found. May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4b052c1-5cd4-4931-b963-51075812ef15 could not be found. May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.543443 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:38.547348 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.547348 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:38.547348 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:38.547348 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:38.547348 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:38.547348 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:38.547348 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4b052c1-5cd4-4931-b963-51075812ef15 could not be found. May 28 04:48:38.547348 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.547348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d71ed0b2-fd37-41b3-a777-1ec878e1724a tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Returning 404 to user: Instance f4b052c1-5cd4-4931-b963-51075812ef15 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:38.547348 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d71ed0b2-fd37-41b3-a777-1ec878e1724a tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15" status: 404 len: 111 microversion: 2.1 time: 0.063374 May 28 04:48:38.549224 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1690/3492] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:38 2022] GET /compute/v2.1/servers/f4b052c1-5cd4-4931-b963-51075812ef15 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:38.554319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-08220317-3ab7-4a8c-9de8-be0ad461f0fc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '.version_select at 0x7f7700a4b550>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:38.585495 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-08220317-3ab7-4a8c-9de8-be0ad461f0fc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] HTTP exception thrown: Image not found. May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-08220317-3ab7-4a8c-9de8-be0ad461f0fc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Request method failure captured: May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/images/04c7af5f-3b1a-467f-8847-c4256f82abf7 HTTP/1.1 May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikak47QAs5K06QhfhkIquusTq5B930GK2qX0_12di_Rh32YDa0oiawwGAqeo88DT65woz1MmOY2wmnqGoSlDi_TB5nkwOW_jtkf8bwl1MIAPkkOt7hgVlVdmgC8btNyj4GvAvNekqk5WajXo3d43lpqxKK68oDpAyv5Nz9V4rMhAcq7c May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 6b37465157dd44a09cffbbe57322d264 May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: exception: Image not found. May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '04c7af5f-3b1a-467f-8847-c4256f82abf7'} May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 04c7af5f-3b1a-467f-8847-c4256f82abf7 to delete May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 04c7af5f-3b1a-467f-8847-c4256f82abf7 could not be found. May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:38.591438 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-08220317-3ab7-4a8c-9de8-be0ad461f0fc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Returning 404 to user: Image not found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-08220317-3ab7-4a8c-9de8-be0ad461f0fc tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "DELETE /compute/v2.1/images/04c7af5f-3b1a-467f-8847-c4256f82abf7" status: 404 len: 62 microversion: 2.1 time: 0.043174 May 28 04:48:38.603269 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1691/3493] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:38 2022] DELETE /compute/v2.1/images/04c7af5f-3b1a-467f-8847-c4256f82abf7 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:48:38.609057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3f49353e-5e70-4b0f-b139-e05f5c9077e5 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:38.615187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3f49353e-5e70-4b0f-b139-e05f5c9077e5 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:38.626643 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f49353e-5e70-4b0f-b139-e05f5c9077e5 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:38.628073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f49353e-5e70-4b0f-b139-e05f5c9077e5 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:38.629075 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f49353e-5e70-4b0f-b139-e05f5c9077e5 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:38.629750 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f49353e-5e70-4b0f-b139-e05f5c9077e5 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:38.646884 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-3f49353e-5e70-4b0f-b139-e05f5c9077e5 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] HTTP exception thrown: Instance 7e34a513-f606-4109-942e-e8ddd9145ea5 could not be found. May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3f49353e-5e70-4b0f-b139-e05f5c9077e5 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Request method failure captured: May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 HTTP/1.1 May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikak47QAs5K06QhfhkIquusTq5B930GK2qX0_12di_Rh32YDa0oiawwGAqeo88DT65woz1MmOY2wmnqGoSlDi_TB5nkwOW_jtkf8bwl1MIAPkkOt7hgVlVdmgC8btNyj4GvAvNekqk5WajXo3d43lpqxKK68oDpAyv5Nz9V4rMhAcq7c May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 6b37465157dd44a09cffbbe57322d264 May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 7e34a513-f606-4109-942e-e8ddd9145ea5 could not be found. May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '7e34a513-f606-4109-942e-e8ddd9145ea5'} May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e34a513-f606-4109-942e-e8ddd9145ea5 could not be found. May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:38.651244 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:38.655695 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e34a513-f606-4109-942e-e8ddd9145ea5 could not be found. May 28 04:48:38.655695 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.655695 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:38.655695 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.655695 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:38.655695 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:38.655695 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:38.655695 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:38.655695 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:38.655695 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e34a513-f606-4109-942e-e8ddd9145ea5 could not be found. May 28 04:48:38.655695 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.655695 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3f49353e-5e70-4b0f-b139-e05f5c9077e5 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Returning 404 to user: Instance 7e34a513-f606-4109-942e-e8ddd9145ea5 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:38.655695 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3f49353e-5e70-4b0f-b139-e05f5c9077e5 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 404 len: 111 microversion: 2.1 time: 0.048903 May 28 04:48:38.660813 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1692/3494] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:48:38 2022] DELETE /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:38.666886 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3176700e-86b5-45d6-9999-c9728879269f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:38.667851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3176700e-86b5-45d6-9999-c9728879269f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 7e34a513-f606-4109-942e-e8ddd9145ea5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:38.674258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3176700e-86b5-45d6-9999-c9728879269f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:38.674719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3176700e-86b5-45d6-9999-c9728879269f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:38.675518 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3176700e-86b5-45d6-9999-c9728879269f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:38.675958 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3176700e-86b5-45d6-9999-c9728879269f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:38.690480 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-3176700e-86b5-45d6-9999-c9728879269f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] HTTP exception thrown: Instance 7e34a513-f606-4109-942e-e8ddd9145ea5 could not be found. May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3176700e-86b5-45d6-9999-c9728879269f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Request method failure captured: May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 HTTP/1.1 May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikak47QAs5K06QhfhkIquusTq5B930GK2qX0_12di_Rh32YDa0oiawwGAqeo88DT65woz1MmOY2wmnqGoSlDi_TB5nkwOW_jtkf8bwl1MIAPkkOt7hgVlVdmgC8btNyj4GvAvNekqk5WajXo3d43lpqxKK68oDpAyv5Nz9V4rMhAcq7c May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 6b37465157dd44a09cffbbe57322d264 May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 7e34a513-f606-4109-942e-e8ddd9145ea5 could not be found. May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '7e34a513-f606-4109-942e-e8ddd9145ea5'} May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e34a513-f606-4109-942e-e8ddd9145ea5 could not be found. May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e34a513-f606-4109-942e-e8ddd9145ea5 could not be found. May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.692208 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:38.696604 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.696604 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:38.696604 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:38.696604 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:38.696604 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:38.696604 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:38.696604 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e34a513-f606-4109-942e-e8ddd9145ea5 could not be found. May 28 04:48:38.696604 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:38.696604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3176700e-86b5-45d6-9999-c9728879269f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Returning 404 to user: Instance 7e34a513-f606-4109-942e-e8ddd9145ea5 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:38.696604 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3176700e-86b5-45d6-9999-c9728879269f tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5" status: 404 len: 111 microversion: 2.1 time: 0.031437 May 28 04:48:38.696604 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1693/3495] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:38 2022] GET /compute/v2.1/servers/7e34a513-f606-4109-942e-e8ddd9145ea5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:38.702183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-55f7e016-7a38-4bcf-b3a0-15e4f96ae5d9 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '.version_select at 0x7f77009e81f0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:38.834050 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-55f7e016-7a38-4bcf-b3a0-15e4f96ae5d9 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090990271" status: 202 len: 0 microversion: 2.1 time: 0.134542 May 28 04:48:38.837384 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1694/3496] 10.222.0.58 () {58 vars in 1220 bytes} [Sat May 28 04:48:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090990271 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:38.843899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3904d8a9-8d40-4c9f-b7eb-2829f1f3fba1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:38.844779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3904d8a9-8d40-4c9f-b7eb-2829f1f3fba1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:38.852164 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3904d8a9-8d40-4c9f-b7eb-2829f1f3fba1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:38.852883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3904d8a9-8d40-4c9f-b7eb-2829f1f3fba1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:38.854155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3904d8a9-8d40-4c9f-b7eb-2829f1f3fba1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:38.854919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3904d8a9-8d40-4c9f-b7eb-2829f1f3fba1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:39.057833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3904d8a9-8d40-4c9f-b7eb-2829f1f3fba1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:39.066430 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3904d8a9-8d40-4c9f-b7eb-2829f1f3fba1 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 200 len: 1308 microversion: 2.1 time: 0.226887 May 28 04:48:39.067460 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1695/3497] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:38 2022] GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 1308 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:39.205682 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-098109bb-640e-4f01-9aa8-4a1453d0f7a9 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.707576 May 28 04:48:39.206574 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1803/3498] 10.222.0.58 () {60 vars in 1194 bytes} [Sat May 28 04:48:38 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:39.218123 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ccad2daf-09bd-4b86-812f-1854285728d0 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Action: 'create', calling method: .version_select at 0x7f7701dd63a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-752359218", "description": "tempest-description-2117541345"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:39.729930 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ccad2daf-09bd-4b86-812f-1854285728d0 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.515501 May 28 04:48:39.731555 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1696/3499] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:48:39 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:39.739450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:39.746907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-54b5cd15-f386-4961-a57c-fa23574fefab tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Action: 'create', calling method: .version_select at 0x7f77013be280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-153696792", "description": "tempest-description-1929658"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:40.086177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-46ad84f0-e27e-4788-b8fd-5dd8565237a5 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:40.088880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-46ad84f0-e27e-4788-b8fd-5dd8565237a5 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:40.111124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46ad84f0-e27e-4788-b8fd-5dd8565237a5 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:40.113594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46ad84f0-e27e-4788-b8fd-5dd8565237a5 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:40.116278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46ad84f0-e27e-4788-b8fd-5dd8565237a5 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:40.118767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46ad84f0-e27e-4788-b8fd-5dd8565237a5 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:40.448593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-46ad84f0-e27e-4788-b8fd-5dd8565237a5 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:40.465794 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-46ad84f0-e27e-4788-b8fd-5dd8565237a5 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 200 len: 1308 microversion: 2.1 time: 0.385011 May 28 04:48:40.487698 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1697/3500] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:40 2022] GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 1308 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:40.487698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-c458f32c-ada3-473b-a2fb-b7702a942aab req-c21b1ee6-b786-40b7-9a32-9d24a401f16c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad996d0-08a2-4d1e-b434-342b5b209db0", "name": "network-vif-plugged", "status": "completed", "tag": "050fba79-1eec-49ec-b04a-05ff6a5d53e6"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:40.493954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c458f32c-ada3-473b-a2fb-b7702a942aab req-c21b1ee6-b786-40b7-9a32-9d24a401f16c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:40.494923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c458f32c-ada3-473b-a2fb-b7702a942aab req-c21b1ee6-b786-40b7-9a32-9d24a401f16c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:40.505586 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-c458f32c-ada3-473b-a2fb-b7702a942aab req-c21b1ee6-b786-40b7-9a32-9d24a401f16c service nova] Creating event network-vif-plugged:050fba79-1eec-49ec-b04a-05ff6a5d53e6 for instance bad996d0-08a2-4d1e-b434-342b5b209db0 on n-h2-843700-1 May 28 04:48:40.512930 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-c458f32c-ada3-473b-a2fb-b7702a942aab req-c21b1ee6-b786-40b7-9a32-9d24a401f16c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030730 May 28 04:48:40.513441 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-54b5cd15-f386-4961-a57c-fa23574fefab tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.774830 May 28 04:48:40.514119 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1804/3501] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:48:39 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:40.515129 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1698/3502] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:40.519513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bb112ab5-56da-4c3f-ad15-359b8b618c33 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '.version_select at 0x7f7701426940>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:40.548015 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-bb112ab5-56da-4c3f-ad15-359b8b618c33 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] HTTP exception thrown: Image not found. May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bb112ab5-56da-4c3f-ad15-359b8b618c33 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Request method failure captured: May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/images/261643cd-90e3-4d85-8c9c-ed75a9684763 HTTP/1.1 May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikak47QAs5K06QhfhkIquusTq5B930GK2qX0_12di_Rh32YDa0oiawwGAqeo88DT65woz1MmOY2wmnqGoSlDi_TB5nkwOW_jtkf8bwl1MIAPkkOt7hgVlVdmgC8btNyj4GvAvNekqk5WajXo3d43lpqxKK68oDpAyv5Nz9V4rMhAcq7c May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 6b37465157dd44a09cffbbe57322d264 May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: exception: Image not found. May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '261643cd-90e3-4d85-8c9c-ed75a9684763'} May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 261643cd-90e3-4d85-8c9c-ed75a9684763 to delete May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 261643cd-90e3-4d85-8c9c-ed75a9684763 could not be found. May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:40.549972 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bb112ab5-56da-4c3f-ad15-359b8b618c33 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Returning 404 to user: Image not found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bb112ab5-56da-4c3f-ad15-359b8b618c33 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "DELETE /compute/v2.1/images/261643cd-90e3-4d85-8c9c-ed75a9684763" status: 404 len: 62 microversion: 2.1 time: 0.036273 May 28 04:48:40.553944 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1805/3503] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:40 2022] DELETE /compute/v2.1/images/261643cd-90e3-4d85-8c9c-ed75a9684763 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:48:40.558345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8fce2a84-b773-47ff-93fc-099a0214b650 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Action: 'create', calling method: .version_select at 0x7f77013beb80>, body: {"security_group_rule": {"parent_group_id": "ed099bd5-5d0e-44e2-9945-2858bb63eb73", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "68bfbc64-3e9f-4e3f-8a11-6bef81fd727a"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:40.682693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a9a66b28-9f76-42ab-a5f5-cd2cd04ba76f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1944228892", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "d9d73af1-0273-4cbe-a25a-b2579fc97d08"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:40.746831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-a9a66b28-9f76-42ab-a5f5-cd2cd04ba76f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] validate_networks() for [('d9d73af1-0273-4cbe-a25a-b2579fc97d08', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:48:41.432681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a9a66b28-9f76-42ab-a5f5-cd2cd04ba76f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:48:41.433387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a9a66b28-9f76-42ab-a5f5-cd2cd04ba76f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:48:41.433588 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a9a66b28-9f76-42ab-a5f5-cd2cd04ba76f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:48:41.434006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a9a66b28-9f76-42ab-a5f5-cd2cd04ba76f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:48:41.434427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a9a66b28-9f76-42ab-a5f5-cd2cd04ba76f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:48:41.443594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a9a66b28-9f76-42ab-a5f5-cd2cd04ba76f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:41.444050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a9a66b28-9f76-42ab-a5f5-cd2cd04ba76f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:41.444910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a9a66b28-9f76-42ab-a5f5-cd2cd04ba76f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:41.445357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a9a66b28-9f76-42ab-a5f5-cd2cd04ba76f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:41.462269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-a9a66b28-9f76-42ab-a5f5-cd2cd04ba76f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Getting quotas for project e28a7ab68e42409e96472af2f4d14c34. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:48:41.468287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-a9a66b28-9f76-42ab-a5f5-cd2cd04ba76f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Getting quotas for user fe4609ffbc52454490fa05cd74d1ee6f and project e28a7ab68e42409e96472af2f4d14c34. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:48:41.481591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a9a66b28-9f76-42ab-a5f5-cd2cd04ba76f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:48:41.483966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a9a66b28-9f76-42ab-a5f5-cd2cd04ba76f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] [instance: 23c5c1ac-00ef-409b-ba6b-6d8574930e90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:48:41.611722 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a9a66b28-9f76-42ab-a5f5-cd2cd04ba76f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.094164 May 28 04:48:41.617619 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1699/3504] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:48:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:48:41.623834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-84fc421f-b120-4db5-8b8e-154a596753f2 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:41.624330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-84fc421f-b120-4db5-8b8e-154a596753f2 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:41.630572 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8fce2a84-b773-47ff-93fc-099a0214b650 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.076602 May 28 04:48:41.631859 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1806/3505] 10.222.0.58 () {60 vars in 1194 bytes} [Sat May 28 04:48:40 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:41.632212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84fc421f-b120-4db5-8b8e-154a596753f2 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:41.632671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84fc421f-b120-4db5-8b8e-154a596753f2 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:41.633600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84fc421f-b120-4db5-8b8e-154a596753f2 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:41.633867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84fc421f-b120-4db5-8b8e-154a596753f2 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:41.639375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2aaa2af7-cb16-4b6a-a6bd-9d1b1bca9341 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:41.640269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2aaa2af7-cb16-4b6a-a6bd-9d1b1bca9341 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:41.648749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2aaa2af7-cb16-4b6a-a6bd-9d1b1bca9341 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:41.649215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2aaa2af7-cb16-4b6a-a6bd-9d1b1bca9341 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:41.649459 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-84fc421f-b120-4db5-8b8e-154a596753f2 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] HTTP exception thrown: Instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 could not be found. May 28 04:48:41.650148 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2aaa2af7-cb16-4b6a-a6bd-9d1b1bca9341 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:41.650890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2aaa2af7-cb16-4b6a-a6bd-9d1b1bca9341 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-84fc421f-b120-4db5-8b8e-154a596753f2 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Request method failure captured: May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 HTTP/1.1 May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikak47QAs5K06QhfhkIquusTq5B930GK2qX0_12di_Rh32YDa0oiawwGAqeo88DT65woz1MmOY2wmnqGoSlDi_TB5nkwOW_jtkf8bwl1MIAPkkOt7hgVlVdmgC8btNyj4GvAvNekqk5WajXo3d43lpqxKK68oDpAyv5Nz9V4rMhAcq7c May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 6b37465157dd44a09cffbbe57322d264 May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 could not be found. May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '6245d7aa-7d05-4ab8-aa60-976fd2f6e217'} May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 could not be found. May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:41.651254 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:41.656796 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 could not be found. May 28 04:48:41.656796 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:41.656796 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:41.656796 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:41.656796 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:41.656796 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:41.656796 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:41.656796 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:41.656796 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:41.656796 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 could not be found. May 28 04:48:41.656796 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:41.656796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-84fc421f-b120-4db5-8b8e-154a596753f2 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Returning 404 to user: Instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:41.656796 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-84fc421f-b120-4db5-8b8e-154a596753f2 tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 404 len: 111 microversion: 2.1 time: 0.033964 May 28 04:48:41.656796 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1700/3506] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:48:41 2022] DELETE /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:41.658359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-15f4e0c5-e527-4262-8782-57708c7afb02 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:41.658453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-15f4e0c5-e527-4262-8782-57708c7afb02 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] [instance: 23c5c1ac-00ef-409b-ba6b-6d8574930e90] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:41.740371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-15f4e0c5-e527-4262-8782-57708c7afb02 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4609ffbc52454490fa05cd74d1ee6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a7ab68e42409e96472af2f4d14c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:41.759212 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-15f4e0c5-e527-4262-8782-57708c7afb02 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90" status: 200 len: 1225 microversion: 2.1 time: 0.097674 May 28 04:48:41.773270 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1701/3507] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:41 2022] GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90 => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:41.781023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4e924516-0213-496f-9a93-09c875987005 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Action: 'create', calling method: .version_select at 0x7f7701f26ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-445612616", "description": "tempest-description-1600988550"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:41.864487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2aaa2af7-cb16-4b6a-a6bd-9d1b1bca9341 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:41.872816 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2aaa2af7-cb16-4b6a-a6bd-9d1b1bca9341 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 200 len: 1308 microversion: 2.1 time: 0.239370 May 28 04:48:41.873383 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1807/3508] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:41 2022] GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 1308 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:41.882436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-45818356-a304-470d-81ff-0bb1026cef1d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:41.883100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-45818356-a304-470d-81ff-0bb1026cef1d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] [instance: 6245d7aa-7d05-4ab8-aa60-976fd2f6e217] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:41.889784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45818356-a304-470d-81ff-0bb1026cef1d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:41.890242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45818356-a304-470d-81ff-0bb1026cef1d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:41.891049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45818356-a304-470d-81ff-0bb1026cef1d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:41.891503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45818356-a304-470d-81ff-0bb1026cef1d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:41.905605 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-45818356-a304-470d-81ff-0bb1026cef1d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] HTTP exception thrown: Instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 could not be found. May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-45818356-a304-470d-81ff-0bb1026cef1d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Request method failure captured: May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 HTTP/1.1 May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikak47QAs5K06QhfhkIquusTq5B930GK2qX0_12di_Rh32YDa0oiawwGAqeo88DT65woz1MmOY2wmnqGoSlDi_TB5nkwOW_jtkf8bwl1MIAPkkOt7hgVlVdmgC8btNyj4GvAvNekqk5WajXo3d43lpqxKK68oDpAyv5Nz9V4rMhAcq7c May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb9b98186db746ae83181dd7db6d56e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: fb9b98186db746ae83181dd7db6d56e7 May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480 May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 6b37465157dd44a09cffbbe57322d264 May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2140786480-project May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 could not be found. May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '6245d7aa-7d05-4ab8-aa60-976fd2f6e217'} May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 could not be found. May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 could not be found. May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:41.907200 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:41.911926 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:41.911926 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:41.911926 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:41.911926 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:41.911926 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:41.911926 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:41.911926 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 could not be found. May 28 04:48:41.911926 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:41.911926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-45818356-a304-470d-81ff-0bb1026cef1d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] Returning 404 to user: Instance 6245d7aa-7d05-4ab8-aa60-976fd2f6e217 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:41.911926 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-45818356-a304-470d-81ff-0bb1026cef1d tempest-ImagesOneServerNegativeTestJSON-2140786480 tempest-ImagesOneServerNegativeTestJSON-2140786480-project] 10.222.0.58 "GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217" status: 404 len: 111 microversion: 2.1 time: 0.034296 May 28 04:48:41.911926 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1808/3509] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:41 2022] GET /compute/v2.1/servers/6245d7aa-7d05-4ab8-aa60-976fd2f6e217 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:41.916237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6225afce-2c45-49e5-a5d0-a4a85ab2c4a9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1927422866", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c0754133-921a-4aba-8b6d-6a18d70e57ec"}], "security_groups": [{"name": "tempest-securitygroup--397154875"}], "key_name": "tempest-keypair-687473329", "user_data": "}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:42.105207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-6225afce-2c45-49e5-a5d0-a4a85ab2c4a9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] validate_networks() for [('c0754133-921a-4aba-8b6d-6a18d70e57ec', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:48:42.691432 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4e924516-0213-496f-9a93-09c875987005 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.918493 May 28 04:48:42.695672 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1702/3510] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:48:41 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:42.705478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-212d2509-231c-4a54-aac6-4c8655fc43c9 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Action: 'create', calling method: .version_select at 0x7f77009a09d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-270391248", "description": "tempest-description-1559819251"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:42.909890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-6225afce-2c45-49e5-a5d0-a4a85ab2c4a9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:48:42.909890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-6225afce-2c45-49e5-a5d0-a4a85ab2c4a9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:48:42.910440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-6225afce-2c45-49e5-a5d0-a4a85ab2c4a9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:48:42.910963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-6225afce-2c45-49e5-a5d0-a4a85ab2c4a9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:48:42.911605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-6225afce-2c45-49e5-a5d0-a4a85ab2c4a9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:48:42.923929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6225afce-2c45-49e5-a5d0-a4a85ab2c4a9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:42.924505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6225afce-2c45-49e5-a5d0-a4a85ab2c4a9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:42.925526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6225afce-2c45-49e5-a5d0-a4a85ab2c4a9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:42.926052 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6225afce-2c45-49e5-a5d0-a4a85ab2c4a9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:42.948385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-6225afce-2c45-49e5-a5d0-a4a85ab2c4a9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Getting quotas for project d1e7c34036184ea8b80241695fdbf329. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:48:42.955071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-6225afce-2c45-49e5-a5d0-a4a85ab2c4a9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Getting quotas for user 025cb09c79a147b3a648c950edcd1dc3 and project d1e7c34036184ea8b80241695fdbf329. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:48:42.970965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6225afce-2c45-49e5-a5d0-a4a85ab2c4a9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:48:42.973306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6225afce-2c45-49e5-a5d0-a4a85ab2c4a9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:48:43.200891 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6225afce-2c45-49e5-a5d0-a4a85ab2c4a9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.290722 May 28 04:48:43.201777 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1809/3511] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:48:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:48:43.207328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-df94b326-58f3-44af-befe-f455b4bc9ef9 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:43.208134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-df94b326-58f3-44af-befe-f455b4bc9ef9 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] [instance: 23c5c1ac-00ef-409b-ba6b-6d8574930e90] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:43.216532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df94b326-58f3-44af-befe-f455b4bc9ef9 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:43.217284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df94b326-58f3-44af-befe-f455b4bc9ef9 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:43.233766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df94b326-58f3-44af-befe-f455b4bc9ef9 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:43.235071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df94b326-58f3-44af-befe-f455b4bc9ef9 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:43.333590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-df94b326-58f3-44af-befe-f455b4bc9ef9 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4609ffbc52454490fa05cd74d1ee6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a7ab68e42409e96472af2f4d14c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:43.342630 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-df94b326-58f3-44af-befe-f455b4bc9ef9 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90" status: 200 len: 1229 microversion: 2.1 time: 0.139726 May 28 04:48:43.343323 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1810/3512] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:43 2022] GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90 => generated 1229 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:43.353064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3a3a65f6-e5d6-457c-a650-f391e7946645 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:43.354083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3a3a65f6-e5d6-457c-a650-f391e7946645 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:43.364920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a3a65f6-e5d6-457c-a650-f391e7946645 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:43.364920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a3a65f6-e5d6-457c-a650-f391e7946645 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:43.365328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a3a65f6-e5d6-457c-a650-f391e7946645 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:43.365679 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-212d2509-231c-4a54-aac6-4c8655fc43c9 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.663192 May 28 04:48:43.365801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a3a65f6-e5d6-457c-a650-f391e7946645 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:43.366600 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1703/3513] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:48:42 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:43.380297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-87d807d7-75c7-4838-8ea6-835ec014f0dd tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:43.381141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-87d807d7-75c7-4838-8ea6-835ec014f0dd tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:43.482945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-87d807d7-75c7-4838-8ea6-835ec014f0dd tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:43.492567 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-87d807d7-75c7-4838-8ea6-835ec014f0dd tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8" status: 200 len: 1241 microversion: 2.1 time: 0.118281 May 28 04:48:43.504665 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1704/3514] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:43 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 => generated 1241 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:43.504665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4a00a41a-172b-4411-a73a-34ee5f023685 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Action: 'create', calling method: .version_select at 0x7f77009e89d0>, body: {"security_group_rule": {"parent_group_id": "4355301c-25dd-43e6-aab4-13219c4785f9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "e3dab518-bd44-4a0d-a659-ac5fe4c52698"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:43.594565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3a3a65f6-e5d6-457c-a650-f391e7946645 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:43.609379 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3a3a65f6-e5d6-457c-a650-f391e7946645 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 200 len: 1488 microversion: 2.1 time: 0.264834 May 28 04:48:43.610601 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1811/3515] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:43 2022] GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 1488 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:43.627767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d5ddff97-4eaa-4c74-97c3-94b3ecc784dc tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-609204266"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:43.629167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d5ddff97-4eaa-4c74-97c3-94b3ecc784dc tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:43.637201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5ddff97-4eaa-4c74-97c3-94b3ecc784dc tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:43.638082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5ddff97-4eaa-4c74-97c3-94b3ecc784dc tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:43.639065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5ddff97-4eaa-4c74-97c3-94b3ecc784dc tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:43.639928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5ddff97-4eaa-4c74-97c3-94b3ecc784dc tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:44.205451 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4a00a41a-172b-4411-a73a-34ee5f023685 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.708091 May 28 04:48:44.206956 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1705/3516] 10.222.0.58 () {60 vars in 1194 bytes} [Sat May 28 04:48:43 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:44.216811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a8b7fc92-8bfe-40d0-89ba-c08e0b7cd36f tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Calling method '.version_select at 0x7f77009b60d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:44.297328 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d5ddff97-4eaa-4c74-97c3-94b3ecc784dc tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "POST /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0/action" status: 202 len: 0 microversion: 2.1 time: 0.674169 May 28 04:48:44.298156 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1812/3517] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:48:43 2022] POST /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0/action => generated 0 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) May 28 04:48:44.323985 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f4a0da7a-bb8f-46b0-9807-5daadece4120 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7701ec9ee0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:44.411070 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f4a0da7a-bb8f-46b0-9807-5daadece4120 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/0dda347a-3f0e-4240-b122-cf0e3e15a958" status: 200 len: 1411 microversion: 2.1 time: 0.093415 May 28 04:48:44.412968 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1813/3518] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:48:44 2022] GET /compute/v2.1/images/0dda347a-3f0e-4240-b122-cf0e3e15a958 => generated 1411 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:44.462421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5d9d038a-a9dc-4f0d-8663-114756638588 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:44.462421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5d9d038a-a9dc-4f0d-8663-114756638588 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] [instance: 23c5c1ac-00ef-409b-ba6b-6d8574930e90] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:44.470953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d9d038a-a9dc-4f0d-8663-114756638588 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:44.471444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d9d038a-a9dc-4f0d-8663-114756638588 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:44.472230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d9d038a-a9dc-4f0d-8663-114756638588 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:44.472675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d9d038a-a9dc-4f0d-8663-114756638588 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:44.595787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5d9d038a-a9dc-4f0d-8663-114756638588 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4609ffbc52454490fa05cd74d1ee6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a7ab68e42409e96472af2f4d14c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:44.623848 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5d9d038a-a9dc-4f0d-8663-114756638588 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90" status: 200 len: 1285 microversion: 2.1 time: 0.208197 May 28 04:48:44.625303 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1814/3519] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:44 2022] GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90 => generated 1285 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:44.634471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a2f9c3cc-d4e0-4b08-9d40-79215be4e72d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f770159d0d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:44.712813 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a2f9c3cc-d4e0-4b08-9d40-79215be4e72d tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/0dda347a-3f0e-4240-b122-cf0e3e15a958" status: 200 len: 1411 microversion: 2.1 time: 0.086360 May 28 04:48:44.719567 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1815/3520] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:48:44 2022] GET /compute/v2.1/images/0dda347a-3f0e-4240-b122-cf0e3e15a958 => generated 1411 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:44.726757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a33965c5-df7b-4234-991a-5fd8c9a27e17 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:44.727623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a33965c5-df7b-4234-991a-5fd8c9a27e17 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:44.735930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a33965c5-df7b-4234-991a-5fd8c9a27e17 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:44.736628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a33965c5-df7b-4234-991a-5fd8c9a27e17 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:44.737708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a33965c5-df7b-4234-991a-5fd8c9a27e17 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:44.738387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a33965c5-df7b-4234-991a-5fd8c9a27e17 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:44.773039 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a8b7fc92-8bfe-40d0-89ba-c08e0b7cd36f tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/e3dab518-bd44-4a0d-a659-ac5fe4c52698" status: 202 len: 0 microversion: 2.1 time: 0.559978 May 28 04:48:44.773848 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1706/3521] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:48:44 2022] DELETE /compute/v2.1/os-security-groups/e3dab518-bd44-4a0d-a659-ac5fe4c52698 => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:48:44.786075 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f9401645-19e7-4401-94bd-54a676433bbf tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f77010680d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:44.865632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a33965c5-df7b-4234-991a-5fd8c9a27e17 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:44.905487 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a33965c5-df7b-4234-991a-5fd8c9a27e17 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8" status: 200 len: 1245 microversion: 2.1 time: 0.181651 May 28 04:48:44.906776 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1816/3522] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:44 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 => generated 1245 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:44.912800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ba539d07-bef4-4b53-b305-e562b17dc3e9 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Calling method '.version_select at 0x7f770203c8b0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:45.024346 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ba539d07-bef4-4b53-b305-e562b17dc3e9 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/4355301c-25dd-43e6-aab4-13219c4785f9" status: 200 len: 247 microversion: 2.1 time: 0.114742 May 28 04:48:45.025613 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1817/3523] 10.222.0.58 () {58 vars in 1268 bytes} [Sat May 28 04:48:44 2022] GET /compute/v2.1/os-security-groups/4355301c-25dd-43e6-aab4-13219c4785f9 => generated 247 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:45.037857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-85c649d1-06b5-4524-a7b0-d598149dfc63 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Action: 'create', calling method: .version_select at 0x7f770159d4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1615239681", "description": "tempest-description-207937790"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:45.224081 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f9401645-19e7-4401-94bd-54a676433bbf tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "DELETE /compute/v2.1/images/0dda347a-3f0e-4240-b122-cf0e3e15a958" status: 204 len: 0 microversion: 2.1 time: 0.448962 May 28 04:48:45.224673 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1707/3524] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:44 2022] DELETE /compute/v2.1/images/0dda347a-3f0e-4240-b122-cf0e3e15a958 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:48:45.234587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a3328933-5889-4130-bd0b-eb6c89969570 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700d61670>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:45.268044 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-a3328933-5889-4130-bd0b-eb6c89969570 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] HTTP exception thrown: Image not found. May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a3328933-5889-4130-bd0b-eb6c89969570 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Request method failure captured: May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/images/0dda347a-3f0e-4240-b122-cf0e3e15a958 HTTP/1.1 May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikai9kh34KInZIUT2KThwy2DbChsoF1megpewDIdMfqmjztKlkvPzYOl6FMQjvpvji4tDdGTwS8jFJHOILJ82zzQxsl90JOuVmj1cqmxNTFMCLo04o1Za5HKv_FEj1BneXgIJTJqpa-MyMJg9tjoiqpHHeUyTaMKawg5Hk_Y2S1Xx1Sk May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: da841757a2094bad83e04816bb355969 May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_da841757a2094bad83e04816bb355969"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/da841757a2094bad83e04816bb355969"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesTestJSON-190539400 May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: da841757a2094bad83e04816bb355969 May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesTestJSON-190539400-project May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c07b3b1388d24bae9e8834c8b9a4f3a9 May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesTestJSON-190539400-project May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: exception: Image not found. May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '0dda347a-3f0e-4240-b122-cf0e3e15a958'} May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0dda347a-3f0e-4240-b122-cf0e3e15a958 May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 28 04:48:45.271513 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0dda347a-3f0e-4240-b122-cf0e3e15a958 could not be found. May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:48:45.275626 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:45.280037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a3328933-5889-4130-bd0b-eb6c89969570 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Returning 404 to user: Image not found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:45.281833 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a3328933-5889-4130-bd0b-eb6c89969570 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/images/0dda347a-3f0e-4240-b122-cf0e3e15a958" status: 404 len: 62 microversion: 2.1 time: 0.051491 May 28 04:48:45.286201 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1708/3525] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:48:45 2022] GET /compute/v2.1/images/0dda347a-3f0e-4240-b122-cf0e3e15a958 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:48:45.293933 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a82c94ed-d195-48bf-a9e5-049215cb39aa tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:45.294864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a82c94ed-d195-48bf-a9e5-049215cb39aa tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:45.307174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a82c94ed-d195-48bf-a9e5-049215cb39aa tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:45.308843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a82c94ed-d195-48bf-a9e5-049215cb39aa tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:45.309851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a82c94ed-d195-48bf-a9e5-049215cb39aa tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:45.310935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a82c94ed-d195-48bf-a9e5-049215cb39aa tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:45.503613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a82c94ed-d195-48bf-a9e5-049215cb39aa tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:45.513943 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a82c94ed-d195-48bf-a9e5-049215cb39aa tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 200 len: 1500 microversion: 2.1 time: 0.226151 May 28 04:48:45.518541 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1709/3526] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:45 2022] GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 1500 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:45.538352 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-85c649d1-06b5-4524-a7b0-d598149dfc63 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.504847 May 28 04:48:45.538974 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1818/3527] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:48:45 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:45.555255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-87cb82aa-0ef6-4ae3-b6d1-9a71844f550a tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Action: 'create', calling method: .version_select at 0x7f7700d613a0>, body: {"security_group_rule": {"parent_group_id": "352bf2b8-a8af-48d8-9a0b-9c7f98b9c412", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:45.727786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d864c7fd-a30b-4af4-a3d5-80ad84585dca tempest-ListImageFiltersNegativeTestJSON-161581247 tempest-ListImageFiltersNegativeTestJSON-161581247-project] Calling method '.version_select at 0x7f77075b3d30>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:45.754256 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-d864c7fd-a30b-4af4-a3d5-80ad84585dca tempest-ListImageFiltersNegativeTestJSON-161581247 tempest-ListImageFiltersNegativeTestJSON-161581247-project] HTTP exception thrown: Image not found. May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d864c7fd-a30b-4af4-a3d5-80ad84585dca tempest-ListImageFiltersNegativeTestJSON-161581247 tempest-ListImageFiltersNegativeTestJSON-161581247-project] Request method failure captured: May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/images/a0d5aa26-a6f1-4316-a1ae-c5bbdb833d9c HTTP/1.1 May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikamt1EGjpw8yiakN6ytrvVdkPm510B8axZm9cymr5OP-FkhTi66CskHObKgVQ4gKegeJi1Zf9bf3NhltmzRBYivUikVTAVhJ8cs4VnkbWo-hM2rMCjgxvFuxG6TGqVlZXlxJzyiinsefZ7PmmW4uFOCjxnSKqQudhchvx_vAXa1cBEg May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 76be849ba7884ab3a1599bc5a86e5564 May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-161581247 May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_76be849ba7884ab3a1599bc5a86e5564"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/76be849ba7884ab3a1599bc5a86e5564"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76be849ba7884ab3a1599bc5a86e5564"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76be849ba7884ab3a1599bc5a86e5564"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-161581247 May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 76be849ba7884ab3a1599bc5a86e5564 May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-161581247 May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ListImageFiltersNegativeTestJSON-161581247-project May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 802e1c96bf1b43ca8404f39c16f38aa0 May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-161581247-project May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: exception: Image not found. May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'a0d5aa26-a6f1-4316-a1ae-c5bbdb833d9c'} May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a0d5aa26-a6f1-4316-a1ae-c5bbdb833d9c May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 28 04:48:45.759899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a0d5aa26-a6f1-4316-a1ae-c5bbdb833d9c could not be found. May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d864c7fd-a30b-4af4-a3d5-80ad84585dca tempest-ListImageFiltersNegativeTestJSON-161581247 tempest-ListImageFiltersNegativeTestJSON-161581247-project] Returning 404 to user: Image not found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d864c7fd-a30b-4af4-a3d5-80ad84585dca tempest-ListImageFiltersNegativeTestJSON-161581247 tempest-ListImageFiltersNegativeTestJSON-161581247-project] 10.222.0.58 "GET /compute/v2.1/images/a0d5aa26-a6f1-4316-a1ae-c5bbdb833d9c" status: 404 len: 62 microversion: 2.1 time: 0.161654 May 28 04:48:45.764677 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1819/3528] 10.222.0.58 () {58 vars in 1232 bytes} [Sat May 28 04:48:45 2022] GET /compute/v2.1/images/a0d5aa26-a6f1-4316-a1ae-c5bbdb833d9c => generated 62 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 28 04:48:45.770228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3151bf7a-244b-46c8-aa42-f85bfff10f95 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:45.771200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3151bf7a-244b-46c8-aa42-f85bfff10f95 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] [instance: 23c5c1ac-00ef-409b-ba6b-6d8574930e90] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:45.780865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3151bf7a-244b-46c8-aa42-f85bfff10f95 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:45.781553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3151bf7a-244b-46c8-aa42-f85bfff10f95 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:45.782551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3151bf7a-244b-46c8-aa42-f85bfff10f95 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:45.783185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3151bf7a-244b-46c8-aa42-f85bfff10f95 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:46.068920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3151bf7a-244b-46c8-aa42-f85bfff10f95 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4609ffbc52454490fa05cd74d1ee6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a7ab68e42409e96472af2f4d14c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:46.077504 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3151bf7a-244b-46c8-aa42-f85bfff10f95 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90" status: 200 len: 1325 microversion: 2.1 time: 0.314669 May 28 04:48:46.079921 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1820/3529] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:45 2022] GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90 => generated 1325 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:46.082611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4a666351-3ece-4943-b42f-c76eaa0f886a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:46.083676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4a666351-3ece-4943-b42f-c76eaa0f886a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:46.090403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a666351-3ece-4943-b42f-c76eaa0f886a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:46.090857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a666351-3ece-4943-b42f-c76eaa0f886a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:46.091655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a666351-3ece-4943-b42f-c76eaa0f886a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:46.092090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a666351-3ece-4943-b42f-c76eaa0f886a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:46.180598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4a666351-3ece-4943-b42f-c76eaa0f886a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:46.188758 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4a666351-3ece-4943-b42f-c76eaa0f886a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8" status: 200 len: 1301 microversion: 2.1 time: 0.109681 May 28 04:48:46.189385 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1821/3530] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:46 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 => generated 1301 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:46.333955 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-87cb82aa-0ef6-4ae3-b6d1-9a71844f550a tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.782727 May 28 04:48:46.334960 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1710/3531] 10.222.0.58 () {60 vars in 1194 bytes} [Sat May 28 04:48:45 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:46.347253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a7048952-62dd-45e0-9fdf-bd79b1c35a9d tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Action: 'create', calling method: .version_select at 0x7f77021aa1f0>, body: {"security_group_rule": {"parent_group_id": "352bf2b8-a8af-48d8-9a0b-9c7f98b9c412", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:46.532685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-52faa567-308b-424f-aae6-886c1f8869db tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:46.533311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-52faa567-308b-424f-aae6-886c1f8869db tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:46.541939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52faa567-308b-424f-aae6-886c1f8869db tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:46.545843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52faa567-308b-424f-aae6-886c1f8869db tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:46.547551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52faa567-308b-424f-aae6-886c1f8869db tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:46.553513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52faa567-308b-424f-aae6-886c1f8869db tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:46.858089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-52faa567-308b-424f-aae6-886c1f8869db tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:46.867939 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-52faa567-308b-424f-aae6-886c1f8869db tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 200 len: 1506 microversion: 2.1 time: 0.339411 May 28 04:48:46.870793 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1711/3532] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:46 2022] GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:46.884174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-0a41e4d5-b134-495b-9c79-bd09612d0047 req-4719b4b5-06a7-4d19-b76b-88e9afb0b905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23c5c1ac-00ef-409b-ba6b-6d8574930e90", "tag": "0089d937-84b7-4f38-a876-99374c83a293"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:46.893847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0a41e4d5-b134-495b-9c79-bd09612d0047 req-4719b4b5-06a7-4d19-b76b-88e9afb0b905 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:46.894296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0a41e4d5-b134-495b-9c79-bd09612d0047 req-4719b4b5-06a7-4d19-b76b-88e9afb0b905 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:46.910423 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-0a41e4d5-b134-495b-9c79-bd09612d0047 req-4719b4b5-06a7-4d19-b76b-88e9afb0b905 service nova] Creating event network-changed:0089d937-84b7-4f38-a876-99374c83a293 for instance 23c5c1ac-00ef-409b-ba6b-6d8574930e90 on n-h1-843700-1 May 28 04:48:46.916370 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-0a41e4d5-b134-495b-9c79-bd09612d0047 req-4719b4b5-06a7-4d19-b76b-88e9afb0b905 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043639 May 28 04:48:46.916970 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1712/3533] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:47.060392 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a7048952-62dd-45e0-9fdf-bd79b1c35a9d tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.714539 May 28 04:48:47.060392 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1822/3534] 10.222.0.58 () {60 vars in 1194 bytes} [Sat May 28 04:48:46 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:47.069930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fda253cd-94cc-4f6d-ae35-5db6a1cc1bf6 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Calling method '.version_select at 0x7f7700a061f0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:47.100966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7dd13979-85ed-417d-a8b6-4c716f0f31d2 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:47.100966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7dd13979-85ed-417d-a8b6-4c716f0f31d2 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] [instance: 23c5c1ac-00ef-409b-ba6b-6d8574930e90] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:47.106557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7dd13979-85ed-417d-a8b6-4c716f0f31d2 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:47.107284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7dd13979-85ed-417d-a8b6-4c716f0f31d2 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:47.108390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7dd13979-85ed-417d-a8b6-4c716f0f31d2 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:47.109304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7dd13979-85ed-417d-a8b6-4c716f0f31d2 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:47.231841 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fda253cd-94cc-4f6d-ae35-5db6a1cc1bf6 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/352bf2b8-a8af-48d8-9a0b-9c7f98b9c412" status: 200 len: 664 microversion: 2.1 time: 0.165965 May 28 04:48:47.232707 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1713/3535] 10.222.0.58 () {58 vars in 1268 bytes} [Sat May 28 04:48:47 2022] GET /compute/v2.1/os-security-groups/352bf2b8-a8af-48d8-9a0b-9c7f98b9c412 => generated 664 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:47.242779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-af39c06e-c70a-452a-8f25-68583347c615 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:47.249735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-af39c06e-c70a-452a-8f25-68583347c615 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:47.257557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af39c06e-c70a-452a-8f25-68583347c615 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:47.258689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af39c06e-c70a-452a-8f25-68583347c615 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:47.260415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af39c06e-c70a-452a-8f25-68583347c615 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:47.260930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af39c06e-c70a-452a-8f25-68583347c615 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:47.437187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7dd13979-85ed-417d-a8b6-4c716f0f31d2 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4609ffbc52454490fa05cd74d1ee6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a7ab68e42409e96472af2f4d14c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:47.447250 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7dd13979-85ed-417d-a8b6-4c716f0f31d2 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90" status: 200 len: 1325 microversion: 2.1 time: 0.355521 May 28 04:48:47.450125 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1823/3536] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:47 2022] GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90 => generated 1325 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:47.465763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-77d85c45-b91b-492c-b4ca-481087228761 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Calling method '.version_select at 0x7f7701ec9d30>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:47.502938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-af39c06e-c70a-452a-8f25-68583347c615 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:47.512557 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-af39c06e-c70a-452a-8f25-68583347c615 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8" status: 200 len: 1366 microversion: 2.1 time: 0.278582 May 28 04:48:47.513906 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1714/3537] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:47 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:47.797247 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-77d85c45-b91b-492c-b4ca-481087228761 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-group-rules/c4e5536e-decf-4d8b-a457-a6a932b777fc" status: 202 len: 0 microversion: 2.1 time: 0.345780 May 28 04:48:47.797852 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1824/3538] 10.222.0.58 () {58 vars in 1286 bytes} [Sat May 28 04:48:47 2022] DELETE /compute/v2.1/os-security-group-rules/c4e5536e-decf-4d8b-a457-a6a932b777fc => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:47.811025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f7755f69-974b-4269-9def-2ed78316f02b tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Calling method '.version_select at 0x7f7701dce040>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:47.892220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1d100356-ed86-4fcc-9146-027918b09d2a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:47.892793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1d100356-ed86-4fcc-9146-027918b09d2a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:47.908075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d100356-ed86-4fcc-9146-027918b09d2a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:47.909989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d100356-ed86-4fcc-9146-027918b09d2a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:47.912472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d100356-ed86-4fcc-9146-027918b09d2a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:47.912948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d100356-ed86-4fcc-9146-027918b09d2a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:47.922645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:48.195150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1d100356-ed86-4fcc-9146-027918b09d2a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:48.206661 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1d100356-ed86-4fcc-9146-027918b09d2a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 200 len: 1501 microversion: 2.1 time: 0.317547 May 28 04:48:48.207620 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1825/3539] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:47 2022] GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 1501 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:48.467266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-999dc712-3f71-457b-bcfe-2f7374135f4a tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:48.467977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-999dc712-3f71-457b-bcfe-2f7374135f4a tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] [instance: 23c5c1ac-00ef-409b-ba6b-6d8574930e90] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:48.480516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-999dc712-3f71-457b-bcfe-2f7374135f4a tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:48.482221 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-999dc712-3f71-457b-bcfe-2f7374135f4a tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:48.483727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-999dc712-3f71-457b-bcfe-2f7374135f4a tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:48.484999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-999dc712-3f71-457b-bcfe-2f7374135f4a tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:48.650187 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f7755f69-974b-4269-9def-2ed78316f02b tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/352bf2b8-a8af-48d8-9a0b-9c7f98b9c412" status: 202 len: 0 microversion: 2.1 time: 0.846716 May 28 04:48:48.651608 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1715/3540] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:48:47 2022] DELETE /compute/v2.1/os-security-groups/352bf2b8-a8af-48d8-9a0b-9c7f98b9c412 => generated 0 bytes in 849 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:48.660237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d9a00f2c-3ab6-4328-9c2f-17803139000a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:48.661703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d9a00f2c-3ab6-4328-9c2f-17803139000a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:48.676609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d9a00f2c-3ab6-4328-9c2f-17803139000a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:48.678507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d9a00f2c-3ab6-4328-9c2f-17803139000a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:48.679497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d9a00f2c-3ab6-4328-9c2f-17803139000a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:48.680825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d9a00f2c-3ab6-4328-9c2f-17803139000a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:48.979203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-999dc712-3f71-457b-bcfe-2f7374135f4a tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4609ffbc52454490fa05cd74d1ee6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a7ab68e42409e96472af2f4d14c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:48.990444 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-999dc712-3f71-457b-bcfe-2f7374135f4a tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90" status: 200 len: 1325 microversion: 2.1 time: 0.524932 May 28 04:48:48.993408 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1826/3541] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:48 2022] GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90 => generated 1325 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:49.006542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9c2bfa19-f3e8-4473-9b59-8f87027d9307 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Calling method '.version_select at 0x7f77074705e0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:49.059947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG neutronclient.v2_0.client [None req-9c2bfa19-f3e8-4473-9b59-8f87027d9307 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e3dab518-bd44-4a0d-a659-ac5fe4c52698 does not exist", "detail": ""}} {{(pid=126044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:48:49.060760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.security_group_api [None req-9c2bfa19-f3e8-4473-9b59-8f87027d9307 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Neutron security group e3dab518-bd44-4a0d-a659-ac5fe4c52698 not found {{(pid=126044) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 04:48:49.061443 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-9c2bfa19-f3e8-4473-9b59-8f87027d9307 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] HTTP exception thrown: Security group e3dab518-bd44-4a0d-a659-ac5fe4c52698 does not exist May 28 04:48:49.061443 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-c5240186-b9c4-406f-9f42-fe8052a39868'] May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9c2bfa19-f3e8-4473-9b59-8f87027d9307 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Request method failure captured: May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/os-security-groups/e3dab518-bd44-4a0d-a659-ac5fe4c52698 HTTP/1.1 May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikamktzvAZGDVkYzXlUV1v197b8dtjaT_r6SjJKfhQobh6pNwM5Zt-7Juqtxg61Moa_1uxZjpxY8qzzuCbw5JX4yFRZIebfuUq-0r_gh8gUgjdllY75mb4Lue7YL0hV3xxQrQOKDcItsqYNLohxsxxad72pSBqIRyLGCu23YOTFET-ag May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 0228a670264a4f4b9d9b10edbe4c1a20 May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-316511996 May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0228a670264a4f4b9d9b10edbe4c1a20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0228a670264a4f4b9d9b10edbe4c1a20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0228a670264a4f4b9d9b10edbe4c1a20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0228a670264a4f4b9d9b10edbe4c1a20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-SecurityGroupRulesTestJSON-316511996 May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 0228a670264a4f4b9d9b10edbe4c1a20 May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-316511996 May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-SecurityGroupRulesTestJSON-316511996-project May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: b95422d35b2848f88c44af93a94c4cfe May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-SecurityGroupRulesTestJSON-316511996-project May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: exception: Security group e3dab518-bd44-4a0d-a659-ac5fe4c52698 does not exist May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-c5240186-b9c4-406f-9f42-fe8052a39868'] May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'e3dab518-bd44-4a0d-a659-ac5fe4c52698'} May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:48:49.063979 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e3dab518-bd44-4a0d-a659-ac5fe4c52698 does not exist May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5240186-b9c4-406f-9f42-fe8052a39868'] May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e3dab518-bd44-4a0d-a659-ac5fe4c52698 does not exist May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5240186-b9c4-406f-9f42-fe8052a39868'] May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e3dab518-bd44-4a0d-a659-ac5fe4c52698 does not exist May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5240186-b9c4-406f-9f42-fe8052a39868'] May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e3dab518-bd44-4a0d-a659-ac5fe4c52698 does not exist May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5240186-b9c4-406f-9f42-fe8052a39868'] May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9c2bfa19-f3e8-4473-9b59-8f87027d9307 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Returning 404 to user: Security group e3dab518-bd44-4a0d-a659-ac5fe4c52698 does not exist May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-c5240186-b9c4-406f-9f42-fe8052a39868'] {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9c2bfa19-f3e8-4473-9b59-8f87027d9307 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/e3dab518-bd44-4a0d-a659-ac5fe4c52698" status: 404 len: 194 microversion: 2.1 time: 0.069020 May 28 04:48:49.072630 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1827/3542] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:48:48 2022] DELETE /compute/v2.1/os-security-groups/e3dab518-bd44-4a0d-a659-ac5fe4c52698 => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:49.082710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-01e76292-cc37-499f-bb4c-891182751367 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Calling method '.version_select at 0x7f7701426430>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:49.174167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d9a00f2c-3ab6-4328-9c2f-17803139000a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:49.188763 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d9a00f2c-3ab6-4328-9c2f-17803139000a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8" status: 200 len: 1366 microversion: 2.1 time: 0.535791 May 28 04:48:49.189699 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1716/3543] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:48 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 => generated 1366 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:49.357778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a4f0db03-e83f-41d8-b01f-fd55b8f24315 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Action: 'create', calling method: .version_select at 0x7f7700d3aee0>, body: {"keypair": {"name": "tempest-keypair-1642468731", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMT087tDK2oaFR2y9VZ7nJsKPT+D+Pe78tfD4mKCc3k8jUnqKdLPmS/FYc72FijObglmPQ2+yJG9hyn9QGug2YUVw59mz08AQ3MlzOMkayI09r8vGsAllaf2eezJIyxBlw=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:49.375457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=23 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:49.376970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-a4f0db03-e83f-41d8-b01f-fd55b8f24315 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Getting quotas for project 8aaaf03ddec0408696243def1a638e72. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:48:49.384740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-a4f0db03-e83f-41d8-b01f-fd55b8f24315 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Getting quotas for user 1f13cf64e09c4009b9f8cd60bcb7f829 and project 8aaaf03ddec0408696243def1a638e72. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:48:49.480311 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a4f0db03-e83f-41d8-b01f-fd55b8f24315 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.289267 May 28 04:48:49.483088 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1717/3544] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:48:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:49.489180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-732eece4-4dcc-40cb-a59e-d8ff0c6ec00a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:49.490098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-732eece4-4dcc-40cb-a59e-d8ff0c6ec00a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:49.498268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-732eece4-4dcc-40cb-a59e-d8ff0c6ec00a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:49.505026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-732eece4-4dcc-40cb-a59e-d8ff0c6ec00a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:49.505026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-732eece4-4dcc-40cb-a59e-d8ff0c6ec00a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:49.505026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-732eece4-4dcc-40cb-a59e-d8ff0c6ec00a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:49.757755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-732eece4-4dcc-40cb-a59e-d8ff0c6ec00a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:49.776954 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-732eece4-4dcc-40cb-a59e-d8ff0c6ec00a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 200 len: 1488 microversion: 2.1 time: 0.289114 May 28 04:48:49.778434 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1718/3545] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:49 2022] GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 1488 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:49.790070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7a0a1c02-5662-4e21-878c-d8f159d2138a tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Calling method '.version_select at 0x7f77009b79d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:49.803624 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7a0a1c02-5662-4e21-878c-d8f159d2138a tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-1642468731" status: 200 len: 498 microversion: 2.1 time: 0.022641 May 28 04:48:49.805214 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1719/3546] 10.222.0.58 () {58 vars in 1217 bytes} [Sat May 28 04:48:49 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1642468731 => generated 498 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:49.811152 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7be719e6-3109-4a16-8b89-a3c8b14e6c62 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:49.813028 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7be719e6-3109-4a16-8b89-a3c8b14e6c62 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:49.819402 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-01e76292-cc37-499f-bb4c-891182751367 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/4355301c-25dd-43e6-aab4-13219c4785f9" status: 202 len: 0 microversion: 2.1 time: 0.745254 May 28 04:48:49.824270 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1828/3547] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:48:49 2022] DELETE /compute/v2.1/os-security-groups/4355301c-25dd-43e6-aab4-13219c4785f9 => generated 0 bytes in 751 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:49.835051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b89129ac-e3a8-4c0c-9185-1a5a2677e4b5 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Calling method '.version_select at 0x7f770159d160>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:49.852821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7be719e6-3109-4a16-8b89-a3c8b14e6c62 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:49.853693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7be719e6-3109-4a16-8b89-a3c8b14e6c62 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:49.857775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7be719e6-3109-4a16-8b89-a3c8b14e6c62 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:49.862269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7be719e6-3109-4a16-8b89-a3c8b14e6c62 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:49.905895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7be719e6-3109-4a16-8b89-a3c8b14e6c62 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:48:49.953440 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b89129ac-e3a8-4c0c-9185-1a5a2677e4b5 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1642468731" status: 202 len: 0 microversion: 2.1 time: 0.123330 May 28 04:48:49.954728 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1829/3548] 10.222.0.58 () {58 vars in 1220 bytes} [Sat May 28 04:48:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1642468731 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:49.968539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4dff85f2-fa6a-4e27-98da-c853050d60f6 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Calling method '.version_select at 0x7f77013be4c0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:50.361238 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7be719e6-3109-4a16-8b89-a3c8b14e6c62 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 204 len: 0 microversion: 2.1 time: 0.554297 May 28 04:48:50.361865 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1720/3549] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:48:49 2022] DELETE /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:48:50.373624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7ede764d-9b3f-4cc4-92c5-aaf0b15f8315 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Action: 'create', calling method: .version_select at 0x7f7701dce040>, body: {"keypair": {"name": "tempest-keypair-1273684199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINQAy6kFNJXYcWx01lbzPbsw+b7IIWQ1pAYXOcbdkKtVsKvKMnTro70irY+yQNkRSg+Qo5VjrC7tJa7OD0BMYFfJXFe/BBI1e5c9Y6heR9RH+I+hkE0K0VF5YPgUeU6XQ=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:50.400569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-7ede764d-9b3f-4cc4-92c5-aaf0b15f8315 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Getting quotas for project 8aaaf03ddec0408696243def1a638e72. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:48:50.413046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-7ede764d-9b3f-4cc4-92c5-aaf0b15f8315 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Getting quotas for user 1f13cf64e09c4009b9f8cd60bcb7f829 and project 8aaaf03ddec0408696243def1a638e72. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:48:50.513719 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7ede764d-9b3f-4cc4-92c5-aaf0b15f8315 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.150502 May 28 04:48:50.514683 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1721/3550] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:48:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:50.522083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-baaf4066-cb69-410c-a14c-4dd0191a16b6 req-0b3d4367-66bf-48ac-8e37-2ceb15468394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "711037c4-54ef-4071-a370-fd39338dccf8", "tag": "95fcb5b1-c23a-4821-b27d-fffaf4a019eb"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:50.534374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-baaf4066-cb69-410c-a14c-4dd0191a16b6 req-0b3d4367-66bf-48ac-8e37-2ceb15468394 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:50.539887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-baaf4066-cb69-410c-a14c-4dd0191a16b6 req-0b3d4367-66bf-48ac-8e37-2ceb15468394 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:50.552190 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-baaf4066-cb69-410c-a14c-4dd0191a16b6 req-0b3d4367-66bf-48ac-8e37-2ceb15468394 service nova] Creating event network-changed:95fcb5b1-c23a-4821-b27d-fffaf4a019eb for instance 711037c4-54ef-4071-a370-fd39338dccf8 on n-h1-843700-1 May 28 04:48:50.557420 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-baaf4066-cb69-410c-a14c-4dd0191a16b6 req-0b3d4367-66bf-48ac-8e37-2ceb15468394 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040443 May 28 04:48:50.558051 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1722/3551] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:50.563657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6daafe53-ed4e-43b3-ab5a-18372bb97347 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:50.564374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6daafe53-ed4e-43b3-ab5a-18372bb97347 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] [instance: 23c5c1ac-00ef-409b-ba6b-6d8574930e90] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:50.571364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6daafe53-ed4e-43b3-ab5a-18372bb97347 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:50.572781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6daafe53-ed4e-43b3-ab5a-18372bb97347 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:50.573547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6daafe53-ed4e-43b3-ab5a-18372bb97347 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:50.573989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6daafe53-ed4e-43b3-ab5a-18372bb97347 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:50.765415 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4dff85f2-fa6a-4e27-98da-c853050d60f6 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/68bfbc64-3e9f-4e3f-8a11-6bef81fd727a" status: 202 len: 0 microversion: 2.1 time: 0.808830 May 28 04:48:50.766290 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1830/3552] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:48:49 2022] DELETE /compute/v2.1/os-security-groups/68bfbc64-3e9f-4e3f-8a11-6bef81fd727a => generated 0 bytes in 810 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:50.771720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-41b092db-7171-45b5-9309-0f4f0e86f707 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:50.776117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-41b092db-7171-45b5-9309-0f4f0e86f707 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:50.779592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41b092db-7171-45b5-9309-0f4f0e86f707 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:50.780216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41b092db-7171-45b5-9309-0f4f0e86f707 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:50.781250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41b092db-7171-45b5-9309-0f4f0e86f707 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:50.781873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41b092db-7171-45b5-9309-0f4f0e86f707 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:50.831121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6daafe53-ed4e-43b3-ab5a-18372bb97347 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4609ffbc52454490fa05cd74d1ee6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a7ab68e42409e96472af2f4d14c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:50.841010 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6daafe53-ed4e-43b3-ab5a-18372bb97347 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90" status: 200 len: 1325 microversion: 2.1 time: 0.281351 May 28 04:48:50.841886 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1723/3553] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:50 2022] GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90 => generated 1325 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:50.855257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aed7ee36-6349-4003-9b30-63e52f2eea3c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f77009fe940>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:50.879280 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-aed7ee36-6349-4003-9b30-63e52f2eea3c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] HTTP exception thrown: Image not found. May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aed7ee36-6349-4003-9b30-63e52f2eea3c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Request method failure captured: May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/images/0dda347a-3f0e-4240-b122-cf0e3e15a958 HTTP/1.1 May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikai9kh34KInZIUT2KThwy2DbChsoF1megpewDIdMfqmjztKlkvPzYOl6FMQjvpvji4tDdGTwS8jFJHOILJ82zzQxsl90JOuVmj1cqmxNTFMCLo04o1Za5HKv_FEj1BneXgIJTJqpa-MyMJg9tjoiqpHHeUyTaMKawg5Hk_Y2S1Xx1Sk May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: da841757a2094bad83e04816bb355969 May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_da841757a2094bad83e04816bb355969"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/da841757a2094bad83e04816bb355969"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesTestJSON-190539400 May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: da841757a2094bad83e04816bb355969 May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesTestJSON-190539400-project May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c07b3b1388d24bae9e8834c8b9a4f3a9 May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesTestJSON-190539400-project May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: exception: Image not found. May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '0dda347a-3f0e-4240-b122-cf0e3e15a958'} May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0dda347a-3f0e-4240-b122-cf0e3e15a958 to delete May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0dda347a-3f0e-4240-b122-cf0e3e15a958 could not be found. May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:50.882817 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aed7ee36-6349-4003-9b30-63e52f2eea3c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Returning 404 to user: Image not found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aed7ee36-6349-4003-9b30-63e52f2eea3c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "DELETE /compute/v2.1/images/0dda347a-3f0e-4240-b122-cf0e3e15a958" status: 404 len: 62 microversion: 2.1 time: 0.039673 May 28 04:48:50.888758 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1724/3554] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:50 2022] DELETE /compute/v2.1/images/0dda347a-3f0e-4240-b122-cf0e3e15a958 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:48:50.892829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-86de8f98-1b39-455a-95b4-e7d1cef93fe3 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Calling method '.version_select at 0x7f77009b6e50>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:50.904091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:50.950965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-41b092db-7171-45b5-9309-0f4f0e86f707 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:50.960173 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-41b092db-7171-45b5-9309-0f4f0e86f707 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8" status: 200 len: 1366 microversion: 2.1 time: 0.191990 May 28 04:48:50.960825 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1831/3555] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:50 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:50.974720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-54c5e41f-5057-4541-8ec6-4d7231f76670 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Calling method '.version_select at 0x7f77013beca0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:51.020970 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-86de8f98-1b39-455a-95b4-e7d1cef93fe3 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1273684199" status: 202 len: 0 microversion: 2.1 time: 0.136166 May 28 04:48:51.021811 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1725/3556] 10.222.0.58 () {58 vars in 1220 bytes} [Sat May 28 04:48:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1273684199 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:51.027144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c728827c-36e3-49f0-a9db-f75c9bf2deca tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:51.032725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c728827c-36e3-49f0-a9db-f75c9bf2deca tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:51.033882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c728827c-36e3-49f0-a9db-f75c9bf2deca tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:51.034510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c728827c-36e3-49f0-a9db-f75c9bf2deca tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:51.035489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c728827c-36e3-49f0-a9db-f75c9bf2deca tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:51.036088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c728827c-36e3-49f0-a9db-f75c9bf2deca tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:51.066284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c728827c-36e3-49f0-a9db-f75c9bf2deca tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:48:51.236817 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.compute.api [None req-c728827c-36e3-49f0-a9db-f75c9bf2deca tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Instance is already in deleting state, ignoring this request May 28 04:48:51.237802 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c728827c-36e3-49f0-a9db-f75c9bf2deca tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 204 len: 0 microversion: 2.1 time: 0.214799 May 28 04:48:51.241412 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1726/3557] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:48:51 2022] DELETE /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:48:51.248744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9f549a69-b2fa-4509-a4d1-137cc956ca71 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Action: 'create', calling method: .version_select at 0x7f77009b7d30>, body: {"keypair": {"name": "tempest-keypair-523092005", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:51.274246 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-9f549a69-b2fa-4509-a4d1-137cc956ca71 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Getting quotas for project 8aaaf03ddec0408696243def1a638e72. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:48:51.280548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-9f549a69-b2fa-4509-a4d1-137cc956ca71 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Getting quotas for user 1f13cf64e09c4009b9f8cd60bcb7f829 and project 8aaaf03ddec0408696243def1a638e72. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:48:51.390245 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9f549a69-b2fa-4509-a4d1-137cc956ca71 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.150450 May 28 04:48:51.391195 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1727/3558] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:48:51 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:51.398244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d5896f45-9b54-46d3-a9ae-b17753739c3a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:51.398869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d5896f45-9b54-46d3-a9ae-b17753739c3a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:51.408719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5896f45-9b54-46d3-a9ae-b17753739c3a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:51.410255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5896f45-9b54-46d3-a9ae-b17753739c3a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:51.410255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5896f45-9b54-46d3-a9ae-b17753739c3a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:51.410510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5896f45-9b54-46d3-a9ae-b17753739c3a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:51.431177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:51.452625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:51.545481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d5896f45-9b54-46d3-a9ae-b17753739c3a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:51.552990 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d5896f45-9b54-46d3-a9ae-b17753739c3a tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 200 len: 1494 microversion: 2.1 time: 0.160698 May 28 04:48:51.553560 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1728/3559] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:51 2022] GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 1494 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:51.558013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5f86d2fe-b946-4282-9439-103465039f61 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Calling method '.version_select at 0x7f77009fe940>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:51.570819 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-54c5e41f-5057-4541-8ec6-4d7231f76670 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/ed099bd5-5d0e-44e2-9945-2858bb63eb73" status: 202 len: 0 microversion: 2.1 time: 0.599533 May 28 04:48:51.572552 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1832/3560] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:48:50 2022] DELETE /compute/v2.1/os-security-groups/ed099bd5-5d0e-44e2-9945-2858bb63eb73 => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:51.590266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-1d4eae07-5f2e-4152-9b4b-fb06c23e560d req-34c39f87-dec4-4cb1-ac79-255837ef9611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c5c1ac-00ef-409b-ba6b-6d8574930e90", "name": "network-vif-plugged", "status": "completed", "tag": "0089d937-84b7-4f38-a876-99374c83a293"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:51.599381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-1d4eae07-5f2e-4152-9b4b-fb06c23e560d req-34c39f87-dec4-4cb1-ac79-255837ef9611 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:51.604927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-1d4eae07-5f2e-4152-9b4b-fb06c23e560d req-34c39f87-dec4-4cb1-ac79-255837ef9611 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:51.612180 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-1d4eae07-5f2e-4152-9b4b-fb06c23e560d req-34c39f87-dec4-4cb1-ac79-255837ef9611 service nova] Creating event network-vif-plugged:0089d937-84b7-4f38-a876-99374c83a293 for instance 23c5c1ac-00ef-409b-ba6b-6d8574930e90 on n-h1-843700-1 May 28 04:48:51.617661 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-1d4eae07-5f2e-4152-9b4b-fb06c23e560d req-34c39f87-dec4-4cb1-ac79-255837ef9611 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042406 May 28 04:48:51.618291 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1833/3561] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:51.624100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d82b5be1-cc40-4881-a669-68047e970db9 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Calling method '.version_select at 0x7f7701dfcaf0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:51.684416 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5f86d2fe-b946-4282-9439-103465039f61 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-523092005" status: 202 len: 0 microversion: 2.1 time: 0.129811 May 28 04:48:51.685102 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1729/3562] 10.222.0.58 () {58 vars in 1217 bytes} [Sat May 28 04:48:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-523092005 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:51.696449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-003b45ce-33ab-469b-8234-d7aa2c7a65ed tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Action: 'create', calling method: .version_select at 0x7f77009b7af0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1407776764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO45Zo0BuuJKHQ/6gkr5MgV2Y5zGDVE0lh026RUSEF/tus00ovG5NdQxntvfXi6ztKGkWJU7t5r10aTmA9NVFQRpb12kfNM9y0CZ4WgyFRd2v4sjUUUoe+MMVuKXZ8FWMg=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:51.711552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-003b45ce-33ab-469b-8234-d7aa2c7a65ed tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Getting quotas for project 8aaaf03ddec0408696243def1a638e72. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:48:51.720168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-003b45ce-33ab-469b-8234-d7aa2c7a65ed tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Getting quotas for user 1f13cf64e09c4009b9f8cd60bcb7f829 and project 8aaaf03ddec0408696243def1a638e72. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:48:51.816999 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-003b45ce-33ab-469b-8234-d7aa2c7a65ed tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.123092 May 28 04:48:51.816999 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1730/3563] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:48:51 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:48:51.832015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e48e299e-d1bc-4b03-bc43-626c426b3f97 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Action: 'create', calling method: .version_select at 0x7f7700d61670>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1907870539", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL41P70/hy2hEWX0CIOh2rJ29kyj54O2Z7ruLTFLPeLAOxcXlHowHg3C4t/MHmmGkn/A/CxEcgVORaLWiGQ8ZroikyRwLh4cDycBdWL81rseMWcvap8xzlCwsIbewpfrw=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:51.850682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-e48e299e-d1bc-4b03-bc43-626c426b3f97 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Getting quotas for project 8aaaf03ddec0408696243def1a638e72. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:48:51.858407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-e48e299e-d1bc-4b03-bc43-626c426b3f97 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Getting quotas for user 1f13cf64e09c4009b9f8cd60bcb7f829 and project 8aaaf03ddec0408696243def1a638e72. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:48:51.910349 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d82b5be1-cc40-4881-a669-68047e970db9 tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/985e3e03-9a06-4a57-ab0a-f541296557b0" status: 202 len: 0 microversion: 2.1 time: 0.290026 May 28 04:48:51.911307 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1834/3564] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:48:51 2022] DELETE /compute/v2.1/os-security-groups/985e3e03-9a06-4a57-ab0a-f541296557b0 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:51.920211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ac542834-000b-48ee-a52b-463006a17039 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:51.920972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ac542834-000b-48ee-a52b-463006a17039 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] [instance: 23c5c1ac-00ef-409b-ba6b-6d8574930e90] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:51.929304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac542834-000b-48ee-a52b-463006a17039 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:51.930008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac542834-000b-48ee-a52b-463006a17039 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:51.930793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac542834-000b-48ee-a52b-463006a17039 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:51.931266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac542834-000b-48ee-a52b-463006a17039 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:51.998144 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e48e299e-d1bc-4b03-bc43-626c426b3f97 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.172521 May 28 04:48:51.998744 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1731/3565] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:48:51 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:48:52.010364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d8dad578-87c5-40b3-80e7-50081c70c23d tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] Calling method '.version_select at 0x7f77009b75e0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:52.161162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ac542834-000b-48ee-a52b-463006a17039 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4609ffbc52454490fa05cd74d1ee6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a7ab68e42409e96472af2f4d14c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:52.175911 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ac542834-000b-48ee-a52b-463006a17039 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90" status: 200 len: 1325 microversion: 2.1 time: 0.260597 May 28 04:48:52.185553 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1835/3566] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:51 2022] GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90 => generated 1325 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:52.185553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-350fafcd-9e7e-4d3c-b9ed-0b669250b2b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:52.186201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-350fafcd-9e7e-4d3c-b9ed-0b669250b2b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:52.199565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-350fafcd-9e7e-4d3c-b9ed-0b669250b2b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:52.200215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-350fafcd-9e7e-4d3c-b9ed-0b669250b2b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:52.201435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-350fafcd-9e7e-4d3c-b9ed-0b669250b2b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:52.202200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-350fafcd-9e7e-4d3c-b9ed-0b669250b2b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:52.424345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-350fafcd-9e7e-4d3c-b9ed-0b669250b2b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:52.432610 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-350fafcd-9e7e-4d3c-b9ed-0b669250b2b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8" status: 200 len: 1366 microversion: 2.1 time: 0.253204 May 28 04:48:52.433195 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1836/3567] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:52 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:52.447523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4445b184-a63b-49db-8325-2150373699c2 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Action: 'create', calling method: .version_select at 0x7f7701dfc940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1856151231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyWnYrKrfdvUk6T0d15IavCmx2UqxcSzXol+pnHXtEmZs4ST8FYVmJDGMFetr0QBpngGiI3hunQikBfdEPgU2m1wKSTxTxwdYSETWb+qNwmjywCbv8BUNTGE+gaMq5Umw=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:52.461611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-4445b184-a63b-49db-8325-2150373699c2 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Getting quotas for project 8aaaf03ddec0408696243def1a638e72. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:48:52.468107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-4445b184-a63b-49db-8325-2150373699c2 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Getting quotas for user 1f13cf64e09c4009b9f8cd60bcb7f829 and project 8aaaf03ddec0408696243def1a638e72. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:48:52.501385 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d8dad578-87c5-40b3-80e7-50081c70c23d tempest-SecurityGroupRulesTestJSON-316511996 tempest-SecurityGroupRulesTestJSON-316511996-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/70c32b8f-c5f8-48e6-af1b-d47bf4051169" status: 202 len: 0 microversion: 2.1 time: 0.497765 May 28 04:48:52.502263 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1732/3568] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:48:51 2022] DELETE /compute/v2.1/os-security-groups/70c32b8f-c5f8-48e6-af1b-d47bf4051169 => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:52.570455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-479fb6f5-ee6f-4ab2-9797-f5522be60bcb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:52.571313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-479fb6f5-ee6f-4ab2-9797-f5522be60bcb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:52.579101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-479fb6f5-ee6f-4ab2-9797-f5522be60bcb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:52.579659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-479fb6f5-ee6f-4ab2-9797-f5522be60bcb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:52.580529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-479fb6f5-ee6f-4ab2-9797-f5522be60bcb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:52.582160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-479fb6f5-ee6f-4ab2-9797-f5522be60bcb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:52.583068 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4445b184-a63b-49db-8325-2150373699c2 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.139946 May 28 04:48:52.588530 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1837/3569] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:48:52 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:52.598365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5661351b-927d-4015-967e-f610cd598edd tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Calling method '.version_select at 0x7f770159d0d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:52.602479 n-d-843700-1 devstack@n-api.service[126044]: WARNING oslo_db.sqlalchemy.utils [None req-5661351b-927d-4015-967e-f610cd598edd tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Unique keys not in sort_keys. The sorting order may be unstable. May 28 04:48:52.625635 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5661351b-927d-4015-967e-f610cd598edd tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.031382 May 28 04:48:52.627653 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1838/3570] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:48:52 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:52.639639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c12d2187-913d-4a96-93fb-05b69c664419 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Calling method '.version_select at 0x7f770203c8b0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:52.699637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-479fb6f5-ee6f-4ab2-9797-f5522be60bcb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:52.708911 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-479fb6f5-ee6f-4ab2-9797-f5522be60bcb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 200 len: 1452 microversion: 2.1 time: 0.142739 May 28 04:48:52.719693 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1733/3571] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:52 2022] GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:48:52.727041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b949296c-3bec-469f-8450-154e036865a0 req-32358d0d-7e4d-4a37-b259-454be9c9cc85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad996d0-08a2-4d1e-b434-342b5b209db0", "name": "network-vif-deleted", "tag": "050fba79-1eec-49ec-b04a-05ff6a5d53e6"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:52.736580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b949296c-3bec-469f-8450-154e036865a0 req-32358d0d-7e4d-4a37-b259-454be9c9cc85 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:52.737234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b949296c-3bec-469f-8450-154e036865a0 req-32358d0d-7e4d-4a37-b259-454be9c9cc85 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:52.750121 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b949296c-3bec-469f-8450-154e036865a0 req-32358d0d-7e4d-4a37-b259-454be9c9cc85 service nova] Creating event network-vif-deleted:050fba79-1eec-49ec-b04a-05ff6a5d53e6 for instance bad996d0-08a2-4d1e-b434-342b5b209db0 on n-h2-843700-1 May 28 04:48:52.756190 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b949296c-3bec-469f-8450-154e036865a0 req-32358d0d-7e4d-4a37-b259-454be9c9cc85 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034775 May 28 04:48:52.757818 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1734/3572] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:52.781206 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c12d2187-913d-4a96-93fb-05b69c664419 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1856151231" status: 202 len: 0 microversion: 2.1 time: 0.147487 May 28 04:48:52.785237 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1839/3573] 10.222.0.58 () {58 vars in 1277 bytes} [Sat May 28 04:48:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1856151231 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:52.792272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d8e22330-cb24-4d39-984a-ae3c28fbb381 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Calling method '.version_select at 0x7f77009ad700>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:52.898675 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d8e22330-cb24-4d39-984a-ae3c28fbb381 tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1907870539" status: 202 len: 0 microversion: 2.1 time: 0.111817 May 28 04:48:52.903741 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1735/3574] 10.222.0.58 () {58 vars in 1277 bytes} [Sat May 28 04:48:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1907870539 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:52.914480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-317fd88e-d892-4cd3-8976-33374c732feb tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] Calling method '.version_select at 0x7f7701426790>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:52.936588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:53.021282 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-317fd88e-d892-4cd3-8976-33374c732feb tempest-KeyPairsV2TestJSON-478404988 tempest-KeyPairsV2TestJSON-478404988-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1407776764" status: 202 len: 0 microversion: 2.1 time: 0.116254 May 28 04:48:53.026384 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1840/3575] 10.222.0.58 () {58 vars in 1277 bytes} [Sat May 28 04:48:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1407776764 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:48:53.196784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fd08b6e6-22cd-4fc0-80ee-a70803500b35 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:53.196784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fd08b6e6-22cd-4fc0-80ee-a70803500b35 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] [instance: 23c5c1ac-00ef-409b-ba6b-6d8574930e90] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:53.203124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fd08b6e6-22cd-4fc0-80ee-a70803500b35 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:53.203801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fd08b6e6-22cd-4fc0-80ee-a70803500b35 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:53.204577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fd08b6e6-22cd-4fc0-80ee-a70803500b35 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:53.205202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fd08b6e6-22cd-4fc0-80ee-a70803500b35 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:53.435519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fd08b6e6-22cd-4fc0-80ee-a70803500b35 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4609ffbc52454490fa05cd74d1ee6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a7ab68e42409e96472af2f4d14c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:53.450427 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fd08b6e6-22cd-4fc0-80ee-a70803500b35 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90" status: 200 len: 1325 microversion: 2.1 time: 0.259576 May 28 04:48:53.450736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fb8e2a91-bc92-4281-9c7b-2a486c261de9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:53.452161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fb8e2a91-bc92-4281-9c7b-2a486c261de9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:53.461008 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1736/3576] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:53 2022] GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90 => generated 1325 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:53.475752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fb8e2a91-bc92-4281-9c7b-2a486c261de9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:53.476218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fb8e2a91-bc92-4281-9c7b-2a486c261de9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:53.477001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fb8e2a91-bc92-4281-9c7b-2a486c261de9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:53.477944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fb8e2a91-bc92-4281-9c7b-2a486c261de9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:53.642698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fb8e2a91-bc92-4281-9c7b-2a486c261de9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:53.659767 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fb8e2a91-bc92-4281-9c7b-2a486c261de9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8" status: 200 len: 1366 microversion: 2.1 time: 0.214548 May 28 04:48:53.669573 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1841/3577] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:53 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:53.726600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7f2207f2-3511-4e89-bc72-2f5c148f2b36 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:53.727398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7f2207f2-3511-4e89-bc72-2f5c148f2b36 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:53.733922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f2207f2-3511-4e89-bc72-2f5c148f2b36 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:53.734513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f2207f2-3511-4e89-bc72-2f5c148f2b36 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:53.735416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f2207f2-3511-4e89-bc72-2f5c148f2b36 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:53.735923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f2207f2-3511-4e89-bc72-2f5c148f2b36 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:53.785289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f2207f2-3511-4e89-bc72-2f5c148f2b36 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:53.786193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f2207f2-3511-4e89-bc72-2f5c148f2b36 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:53.786878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-7f2207f2-3511-4e89-bc72-2f5c148f2b36 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lazy-loading 'fault' on Instance uuid bad996d0-08a2-4d1e-b434-342b5b209db0 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:48:53.832973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7f2207f2-3511-4e89-bc72-2f5c148f2b36 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07b3b1388d24bae9e8834c8b9a4f3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da841757a2094bad83e04816bb355969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:53.840751 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7f2207f2-3511-4e89-bc72-2f5c148f2b36 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 200 len: 1298 microversion: 2.1 time: 0.118353 May 28 04:48:53.843641 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1737/3578] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:53 2022] GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 1298 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:48:54.060194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ec3b0b4b-9118-48d3-83a7-b14489bfc384 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:54.061161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ec3b0b4b-9118-48d3-83a7-b14489bfc384 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:54.067787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec3b0b4b-9118-48d3-83a7-b14489bfc384 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:54.068427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec3b0b4b-9118-48d3-83a7-b14489bfc384 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:54.069533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec3b0b4b-9118-48d3-83a7-b14489bfc384 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:54.070051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec3b0b4b-9118-48d3-83a7-b14489bfc384 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:54.284400 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ec3b0b4b-9118-48d3-83a7-b14489bfc384 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action" status: 202 len: 0 microversion: 2.1 time: 0.227994 May 28 04:48:54.287893 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1842/3579] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:48:54 2022] POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:48:54.297708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dcb5600c-d6e8-493a-9966-9b9b35806898 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:54.301721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dcb5600c-d6e8-493a-9966-9b9b35806898 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:54.307419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dcb5600c-d6e8-493a-9966-9b9b35806898 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:54.309435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dcb5600c-d6e8-493a-9966-9b9b35806898 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:54.310514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dcb5600c-d6e8-493a-9966-9b9b35806898 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:54.311287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dcb5600c-d6e8-493a-9966-9b9b35806898 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:54.469741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-18f4c3c7-b7cc-4e03-8170-4681a86dcb4f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:54.471017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-18f4c3c7-b7cc-4e03-8170-4681a86dcb4f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] [instance: 23c5c1ac-00ef-409b-ba6b-6d8574930e90] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:54.485832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-18f4c3c7-b7cc-4e03-8170-4681a86dcb4f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:54.486316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-18f4c3c7-b7cc-4e03-8170-4681a86dcb4f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:54.491867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-18f4c3c7-b7cc-4e03-8170-4681a86dcb4f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:54.496912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-18f4c3c7-b7cc-4e03-8170-4681a86dcb4f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:54.500739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dcb5600c-d6e8-493a-9966-9b9b35806898 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:54.511486 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dcb5600c-d6e8-493a-9966-9b9b35806898 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1672 microversion: 2.1 time: 0.219798 May 28 04:48:54.513063 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1738/3580] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:54 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1672 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:54.667657 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-18f4c3c7-b7cc-4e03-8170-4681a86dcb4f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4609ffbc52454490fa05cd74d1ee6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a7ab68e42409e96472af2f4d14c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:54.676985 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-18f4c3c7-b7cc-4e03-8170-4681a86dcb4f tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90" status: 200 len: 1523 microversion: 2.1 time: 0.211403 May 28 04:48:54.677637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cdc7a447-f13e-445b-a42e-bc2c5421d0ee tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:54.678341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cdc7a447-f13e-445b-a42e-bc2c5421d0ee tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:54.678723 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1843/3581] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:54 2022] GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:54.686908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdc7a447-f13e-445b-a42e-bc2c5421d0ee tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:54.688711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdc7a447-f13e-445b-a42e-bc2c5421d0ee tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:54.691683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdc7a447-f13e-445b-a42e-bc2c5421d0ee tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:54.692148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdc7a447-f13e-445b-a42e-bc2c5421d0ee tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:54.697371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5647e1e0-2e3e-4022-a36d-7462e9ac64cb tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:54.698070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5647e1e0-2e3e-4022-a36d-7462e9ac64cb tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] [instance: 23c5c1ac-00ef-409b-ba6b-6d8574930e90] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:54.705971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5647e1e0-2e3e-4022-a36d-7462e9ac64cb tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:54.706629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5647e1e0-2e3e-4022-a36d-7462e9ac64cb tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:54.707585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5647e1e0-2e3e-4022-a36d-7462e9ac64cb tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:54.708284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5647e1e0-2e3e-4022-a36d-7462e9ac64cb tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:54.737359 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-5647e1e0-2e3e-4022-a36d-7462e9ac64cb tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] HTTP exception thrown: Instance is not a member of specified network May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5647e1e0-2e3e-4022-a36d-7462e9ac64cb tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Request method failure captured: May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90/ips/invalid HTTP/1.1 May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikamolxL_Xu7Nio3QHMmvwnFFU7xNOOzZa18JpTZwkd5WjGR8a-AYH1PWaaVsxVMHWZxXh7fqwrWot2CWbMcNGOcgMSa5CqfhUBlvv_Rn9Ym5Q7jAEgkbJ6QUfrWizHjeJ3rnPDRtjCFcBi-Ue8jaoV4Ers5XWjTyslDopnPV1LuP-SM May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: e28a7ab68e42409e96472af2f4d14c34 May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1474335272 May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e28a7ab68e42409e96472af2f4d14c34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e28a7ab68e42409e96472af2f4d14c34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e28a7ab68e42409e96472af2f4d14c34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e28a7ab68e42409e96472af2f4d14c34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1474335272 May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: e28a7ab68e42409e96472af2f4d14c34 May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1474335272 May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerAddressesNegativeTestJSON-1474335272-project May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: fe4609ffbc52454490fa05cd74d1ee6f May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1474335272-project May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance is not a member of specified network May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'server_id': '23c5c1ac-00ef-409b-ba6b-6d8574930e90', 'id': 'invalid'} May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network May 28 04:48:54.747646 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:54.751339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5647e1e0-2e3e-4022-a36d-7462e9ac64cb tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Returning 404 to user: Instance is not a member of specified network {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:54.751339 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5647e1e0-2e3e-4022-a36d-7462e9ac64cb tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.060305 May 28 04:48:54.752419 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1844/3582] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:48:54 2022] GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90/ips/invalid => generated 91 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:48:54.762502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7d54ff40-cef4-4d3c-95bc-f24737fc8be4 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7d54ff40-cef4-4d3c-95bc-f24737fc8be4 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Failed to fetch instance by id 999 {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2926}} May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-7d54ff40-cef4-4d3c-95bc-f24737fc8be4 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] HTTP exception thrown: Instance 999 could not be found. May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7d54ff40-cef4-4d3c-95bc-f24737fc8be4 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Request method failure captured: May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikamolxL_Xu7Nio3QHMmvwnFFU7xNOOzZa18JpTZwkd5WjGR8a-AYH1PWaaVsxVMHWZxXh7fqwrWot2CWbMcNGOcgMSa5CqfhUBlvv_Rn9Ym5Q7jAEgkbJ6QUfrWizHjeJ3rnPDRtjCFcBi-Ue8jaoV4Ers5XWjTyslDopnPV1LuP-SM May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: e28a7ab68e42409e96472af2f4d14c34 May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1474335272 May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e28a7ab68e42409e96472af2f4d14c34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e28a7ab68e42409e96472af2f4d14c34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e28a7ab68e42409e96472af2f4d14c34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e28a7ab68e42409e96472af2f4d14c34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1474335272 May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: e28a7ab68e42409e96472af2f4d14c34 May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1474335272 May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerAddressesNegativeTestJSON-1474335272-project May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: fe4609ffbc52454490fa05cd74d1ee6f May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1474335272-project May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 999 could not be found. May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'server_id': '999'} May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:54.771628 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:54.776903 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:54.776903 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:54.776903 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:54.776903 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:54.776903 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. May 28 04:48:54.776903 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:54.776903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7d54ff40-cef4-4d3c-95bc-f24737fc8be4 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Returning 404 to user: Instance 999 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:54.776903 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7d54ff40-cef4-4d3c-95bc-f24737fc8be4 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] 10.222.0.58 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.008185 May 28 04:48:54.776903 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1845/3583] 10.222.0.58 () {58 vars in 1148 bytes} [Sat May 28 04:48:54 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:48:54.782306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ad6e6d15-422c-454f-a813-1ac969b8ff58 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:54.782933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ad6e6d15-422c-454f-a813-1ac969b8ff58 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] [instance: 23c5c1ac-00ef-409b-ba6b-6d8574930e90] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:54.791817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad6e6d15-422c-454f-a813-1ac969b8ff58 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:54.792615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad6e6d15-422c-454f-a813-1ac969b8ff58 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:54.793662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad6e6d15-422c-454f-a813-1ac969b8ff58 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:54.794552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad6e6d15-422c-454f-a813-1ac969b8ff58 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:54.823366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ad6e6d15-422c-454f-a813-1ac969b8ff58 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] [instance: 23c5c1ac-00ef-409b-ba6b-6d8574930e90] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:48:54.882727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cdc7a447-f13e-445b-a42e-bc2c5421d0ee tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:54.895863 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cdc7a447-f13e-445b-a42e-bc2c5421d0ee tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8" status: 200 len: 1366 microversion: 2.1 time: 0.223334 May 28 04:48:54.898147 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1739/3584] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:54 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:48:54.911525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-12c305e5-dd2e-44d5-b53f-90f9535d2bc6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:54.912644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-12c305e5-dd2e-44d5-b53f-90f9535d2bc6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: bad996d0-08a2-4d1e-b434-342b5b209db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:54.921626 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-12c305e5-dd2e-44d5-b53f-90f9535d2bc6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:54.926012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-12c305e5-dd2e-44d5-b53f-90f9535d2bc6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:54.926012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-12c305e5-dd2e-44d5-b53f-90f9535d2bc6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:54.926012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-12c305e5-dd2e-44d5-b53f-90f9535d2bc6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:54.952850 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-12c305e5-dd2e-44d5-b53f-90f9535d2bc6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] HTTP exception thrown: Instance bad996d0-08a2-4d1e-b434-342b5b209db0 could not be found. May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-12c305e5-dd2e-44d5-b53f-90f9535d2bc6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Request method failure captured: May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 HTTP/1.1 May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikai9kh34KInZIUT2KThwy2DbChsoF1megpewDIdMfqmjztKlkvPzYOl6FMQjvpvji4tDdGTwS8jFJHOILJ82zzQxsl90JOuVmj1cqmxNTFMCLo04o1Za5HKv_FEj1BneXgIJTJqpa-MyMJg9tjoiqpHHeUyTaMKawg5Hk_Y2S1Xx1Sk May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: da841757a2094bad83e04816bb355969 May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_da841757a2094bad83e04816bb355969"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/da841757a2094bad83e04816bb355969"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesTestJSON-190539400 May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: da841757a2094bad83e04816bb355969 May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesTestJSON-190539400-project May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c07b3b1388d24bae9e8834c8b9a4f3a9 May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesTestJSON-190539400-project May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance bad996d0-08a2-4d1e-b434-342b5b209db0 could not be found. May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'bad996d0-08a2-4d1e-b434-342b5b209db0'} May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bad996d0-08a2-4d1e-b434-342b5b209db0 could not be found. May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bad996d0-08a2-4d1e-b434-342b5b209db0 could not be found. May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:54.963486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:54.968371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:54.968371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:54.968371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:54.968371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:54.968371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bad996d0-08a2-4d1e-b434-342b5b209db0 could not be found. May 28 04:48:54.968371 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:54.968371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-12c305e5-dd2e-44d5-b53f-90f9535d2bc6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Returning 404 to user: Instance bad996d0-08a2-4d1e-b434-342b5b209db0 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:54.968371 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-12c305e5-dd2e-44d5-b53f-90f9535d2bc6 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0" status: 404 len: 111 microversion: 2.1 time: 0.058357 May 28 04:48:54.968371 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1740/3585] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:54 2022] GET /compute/v2.1/servers/bad996d0-08a2-4d1e-b434-342b5b209db0 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:54.975227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4d64ad6b-2a69-4401-b54a-fd206316dc89 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f77009b7e50>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:55.004698 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-4d64ad6b-2a69-4401-b54a-fd206316dc89 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] HTTP exception thrown: Image not found. May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4d64ad6b-2a69-4401-b54a-fd206316dc89 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Request method failure captured: May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 HTTP/1.1 May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikai9kh34KInZIUT2KThwy2DbChsoF1megpewDIdMfqmjztKlkvPzYOl6FMQjvpvji4tDdGTwS8jFJHOILJ82zzQxsl90JOuVmj1cqmxNTFMCLo04o1Za5HKv_FEj1BneXgIJTJqpa-MyMJg9tjoiqpHHeUyTaMKawg5Hk_Y2S1Xx1Sk May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: da841757a2094bad83e04816bb355969 May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_da841757a2094bad83e04816bb355969"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/da841757a2094bad83e04816bb355969"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesTestJSON-190539400 May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: da841757a2094bad83e04816bb355969 May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesTestJSON-190539400-project May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c07b3b1388d24bae9e8834c8b9a4f3a9 May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesTestJSON-190539400-project May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: exception: Image not found. May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'c3742806-f01e-4228-ac2c-9ea9df28eb92'} May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c3742806-f01e-4228-ac2c-9ea9df28eb92 to delete May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c3742806-f01e-4228-ac2c-9ea9df28eb92 could not be found. May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.006693 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:48:55.012330 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.019983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4d64ad6b-2a69-4401-b54a-fd206316dc89 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Returning 404 to user: Image not found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:55.019983 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4d64ad6b-2a69-4401-b54a-fd206316dc89 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "DELETE /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92" status: 404 len: 62 microversion: 2.1 time: 0.044763 May 28 04:48:55.019983 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1741/3586] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:54 2022] DELETE /compute/v2.1/images/c3742806-f01e-4228-ac2c-9ea9df28eb92 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 28 04:48:55.026777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-41ee1ec9-c550-4cfc-9354-a8aab1acc10c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:55.027457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-41ee1ec9-c550-4cfc-9354-a8aab1acc10c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:55.036168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41ee1ec9-c550-4cfc-9354-a8aab1acc10c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:55.036762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41ee1ec9-c550-4cfc-9354-a8aab1acc10c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:55.037652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41ee1ec9-c550-4cfc-9354-a8aab1acc10c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:55.038725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41ee1ec9-c550-4cfc-9354-a8aab1acc10c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:55.058734 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-41ee1ec9-c550-4cfc-9354-a8aab1acc10c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] HTTP exception thrown: Instance b7dda089-96b9-4547-b637-d2caa776a3d4 could not be found. May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-41ee1ec9-c550-4cfc-9354-a8aab1acc10c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Request method failure captured: May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4 HTTP/1.1 May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikai9kh34KInZIUT2KThwy2DbChsoF1megpewDIdMfqmjztKlkvPzYOl6FMQjvpvji4tDdGTwS8jFJHOILJ82zzQxsl90JOuVmj1cqmxNTFMCLo04o1Za5HKv_FEj1BneXgIJTJqpa-MyMJg9tjoiqpHHeUyTaMKawg5Hk_Y2S1Xx1Sk May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: da841757a2094bad83e04816bb355969 May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_da841757a2094bad83e04816bb355969"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/da841757a2094bad83e04816bb355969"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesTestJSON-190539400 May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: da841757a2094bad83e04816bb355969 May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesTestJSON-190539400-project May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c07b3b1388d24bae9e8834c8b9a4f3a9 May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesTestJSON-190539400-project May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance b7dda089-96b9-4547-b637-d2caa776a3d4 could not be found. May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'b7dda089-96b9-4547-b637-d2caa776a3d4'} May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7dda089-96b9-4547-b637-d2caa776a3d4 could not be found. May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:55.060755 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7dda089-96b9-4547-b637-d2caa776a3d4 could not be found. May 28 04:48:55.065563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.065563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.065563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.065563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.065563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:55.065563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:55.065563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:55.065563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:55.065563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7dda089-96b9-4547-b637-d2caa776a3d4 could not be found. May 28 04:48:55.065563 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.067938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-41ee1ec9-c550-4cfc-9354-a8aab1acc10c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Returning 404 to user: Instance b7dda089-96b9-4547-b637-d2caa776a3d4 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:55.069689 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-41ee1ec9-c550-4cfc-9354-a8aab1acc10c tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4" status: 404 len: 111 microversion: 2.1 time: 0.047553 May 28 04:48:55.072320 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1742/3587] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:48:55 2022] DELETE /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:55.079933 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-00b81d43-1e3b-4c4b-9bdf-d37c7586c857 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:55.081351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-00b81d43-1e3b-4c4b-9bdf-d37c7586c857 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: b7dda089-96b9-4547-b637-d2caa776a3d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:55.101577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-00b81d43-1e3b-4c4b-9bdf-d37c7586c857 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:55.102169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-00b81d43-1e3b-4c4b-9bdf-d37c7586c857 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:55.103434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-00b81d43-1e3b-4c4b-9bdf-d37c7586c857 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:55.105288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-00b81d43-1e3b-4c4b-9bdf-d37c7586c857 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:55.122853 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-00b81d43-1e3b-4c4b-9bdf-d37c7586c857 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] HTTP exception thrown: Instance b7dda089-96b9-4547-b637-d2caa776a3d4 could not be found. May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-00b81d43-1e3b-4c4b-9bdf-d37c7586c857 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Request method failure captured: May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4 HTTP/1.1 May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikai9kh34KInZIUT2KThwy2DbChsoF1megpewDIdMfqmjztKlkvPzYOl6FMQjvpvji4tDdGTwS8jFJHOILJ82zzQxsl90JOuVmj1cqmxNTFMCLo04o1Za5HKv_FEj1BneXgIJTJqpa-MyMJg9tjoiqpHHeUyTaMKawg5Hk_Y2S1Xx1Sk May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: da841757a2094bad83e04816bb355969 May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_da841757a2094bad83e04816bb355969"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/da841757a2094bad83e04816bb355969"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesTestJSON-190539400 May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: da841757a2094bad83e04816bb355969 May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesTestJSON-190539400-project May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c07b3b1388d24bae9e8834c8b9a4f3a9 May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesTestJSON-190539400-project May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance b7dda089-96b9-4547-b637-d2caa776a3d4 could not be found. May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'b7dda089-96b9-4547-b637-d2caa776a3d4'} May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7dda089-96b9-4547-b637-d2caa776a3d4 could not be found. May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7dda089-96b9-4547-b637-d2caa776a3d4 could not be found. May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.125372 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.131151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:55.131151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:55.131151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:55.131151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:55.131151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7dda089-96b9-4547-b637-d2caa776a3d4 could not be found. May 28 04:48:55.131151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.133456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-00b81d43-1e3b-4c4b-9bdf-d37c7586c857 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Returning 404 to user: Instance b7dda089-96b9-4547-b637-d2caa776a3d4 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:55.135134 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-00b81d43-1e3b-4c4b-9bdf-d37c7586c857 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4" status: 404 len: 111 microversion: 2.1 time: 0.059379 May 28 04:48:55.136264 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1743/3588] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:55 2022] GET /compute/v2.1/servers/b7dda089-96b9-4547-b637-d2caa776a3d4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:55.141420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:INSERT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:55.144764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e3d442a9-3d24-41e2-aab9-c84501caf144 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700d3ae50>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:55.169637 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-e3d442a9-3d24-41e2-aab9-c84501caf144 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] HTTP exception thrown: Image not found. May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e3d442a9-3d24-41e2-aab9-c84501caf144 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Request method failure captured: May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba HTTP/1.1 May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikai9kh34KInZIUT2KThwy2DbChsoF1megpewDIdMfqmjztKlkvPzYOl6FMQjvpvji4tDdGTwS8jFJHOILJ82zzQxsl90JOuVmj1cqmxNTFMCLo04o1Za5HKv_FEj1BneXgIJTJqpa-MyMJg9tjoiqpHHeUyTaMKawg5Hk_Y2S1Xx1Sk May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: da841757a2094bad83e04816bb355969 May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_da841757a2094bad83e04816bb355969"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/da841757a2094bad83e04816bb355969"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesTestJSON-190539400 May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: da841757a2094bad83e04816bb355969 May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesTestJSON-190539400-project May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c07b3b1388d24bae9e8834c8b9a4f3a9 May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesTestJSON-190539400-project May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: exception: Image not found. May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '486d8e5a-0c4d-4ea1-bc04-ed8450d468ba'} May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 486d8e5a-0c4d-4ea1-bc04-ed8450d468ba to delete May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 486d8e5a-0c4d-4ea1-bc04-ed8450d468ba could not be found. May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.177867 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e3d442a9-3d24-41e2-aab9-c84501caf144 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Returning 404 to user: Image not found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e3d442a9-3d24-41e2-aab9-c84501caf144 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "DELETE /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba" status: 404 len: 62 microversion: 2.1 time: 0.033123 May 28 04:48:55.181919 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1744/3589] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:55 2022] DELETE /compute/v2.1/images/486d8e5a-0c4d-4ea1-bc04-ed8450d468ba => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 28 04:48:55.183406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ae3c4ee7-4a9d-462d-a943-4f112fefbd1b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:55.184680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ae3c4ee7-4a9d-462d-a943-4f112fefbd1b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:55.204147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae3c4ee7-4a9d-462d-a943-4f112fefbd1b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:55.204781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae3c4ee7-4a9d-462d-a943-4f112fefbd1b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:55.209761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae3c4ee7-4a9d-462d-a943-4f112fefbd1b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:55.209761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae3c4ee7-4a9d-462d-a943-4f112fefbd1b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:55.223213 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-ae3c4ee7-4a9d-462d-a943-4f112fefbd1b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] HTTP exception thrown: Instance 3bb4e9bd-e4d7-4119-963a-188a003df323 could not be found. May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ae3c4ee7-4a9d-462d-a943-4f112fefbd1b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Request method failure captured: May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 HTTP/1.1 May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikai9kh34KInZIUT2KThwy2DbChsoF1megpewDIdMfqmjztKlkvPzYOl6FMQjvpvji4tDdGTwS8jFJHOILJ82zzQxsl90JOuVmj1cqmxNTFMCLo04o1Za5HKv_FEj1BneXgIJTJqpa-MyMJg9tjoiqpHHeUyTaMKawg5Hk_Y2S1Xx1Sk May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: da841757a2094bad83e04816bb355969 May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_da841757a2094bad83e04816bb355969"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/da841757a2094bad83e04816bb355969"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesTestJSON-190539400 May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: da841757a2094bad83e04816bb355969 May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesTestJSON-190539400-project May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c07b3b1388d24bae9e8834c8b9a4f3a9 May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesTestJSON-190539400-project May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 3bb4e9bd-e4d7-4119-963a-188a003df323 could not be found. May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '3bb4e9bd-e4d7-4119-963a-188a003df323'} May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb4e9bd-e4d7-4119-963a-188a003df323 could not be found. May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:55.225039 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb4e9bd-e4d7-4119-963a-188a003df323 could not be found. May 28 04:48:55.229246 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.229246 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.229246 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.229246 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.229246 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:55.229246 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:55.229246 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:55.229246 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:55.229246 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb4e9bd-e4d7-4119-963a-188a003df323 could not be found. May 28 04:48:55.229246 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.229246 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ae3c4ee7-4a9d-462d-a943-4f112fefbd1b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Returning 404 to user: Instance 3bb4e9bd-e4d7-4119-963a-188a003df323 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:55.229246 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ae3c4ee7-4a9d-462d-a943-4f112fefbd1b tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 404 len: 111 microversion: 2.1 time: 0.048035 May 28 04:48:55.229246 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1745/3590] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:48:55 2022] DELETE /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:55.245459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b061b397-b06e-4c98-be54-590c51ec73ed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:55.246108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b061b397-b06e-4c98-be54-590c51ec73ed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 3bb4e9bd-e4d7-4119-963a-188a003df323] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:55.252116 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ad6e6d15-422c-454f-a813-1ac969b8ff58 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] 10.222.0.58 "DELETE /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90" status: 204 len: 0 microversion: 2.1 time: 0.473483 May 28 04:48:55.252717 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1846/3591] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:48:54 2022] DELETE /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:48:55.256412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b061b397-b06e-4c98-be54-590c51ec73ed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:55.257088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b061b397-b06e-4c98-be54-590c51ec73ed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:55.259699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b061b397-b06e-4c98-be54-590c51ec73ed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:55.259699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b061b397-b06e-4c98-be54-590c51ec73ed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:55.267961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d7fc15b6-c9b6-40d0-b4b9-5eeef09b908c tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:55.269477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d7fc15b6-c9b6-40d0-b4b9-5eeef09b908c tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] [instance: 23c5c1ac-00ef-409b-ba6b-6d8574930e90] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:55.278605 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-b061b397-b06e-4c98-be54-590c51ec73ed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] HTTP exception thrown: Instance 3bb4e9bd-e4d7-4119-963a-188a003df323 could not be found. May 28 04:48:55.279996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7fc15b6-c9b6-40d0-b4b9-5eeef09b908c tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b061b397-b06e-4c98-be54-590c51ec73ed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Request method failure captured: May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 HTTP/1.1 May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikai9kh34KInZIUT2KThwy2DbChsoF1megpewDIdMfqmjztKlkvPzYOl6FMQjvpvji4tDdGTwS8jFJHOILJ82zzQxsl90JOuVmj1cqmxNTFMCLo04o1Za5HKv_FEj1BneXgIJTJqpa-MyMJg9tjoiqpHHeUyTaMKawg5Hk_Y2S1Xx1Sk May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: da841757a2094bad83e04816bb355969 May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_da841757a2094bad83e04816bb355969"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/da841757a2094bad83e04816bb355969"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesTestJSON-190539400 May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: da841757a2094bad83e04816bb355969 May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesTestJSON-190539400-project May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c07b3b1388d24bae9e8834c8b9a4f3a9 May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesTestJSON-190539400-project May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 3bb4e9bd-e4d7-4119-963a-188a003df323 could not be found. May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '3bb4e9bd-e4d7-4119-963a-188a003df323'} May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb4e9bd-e4d7-4119-963a-188a003df323 could not be found. May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb4e9bd-e4d7-4119-963a-188a003df323 could not be found. May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.281834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.285860 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:55.285860 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:55.285860 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:55.285860 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:55.285860 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb4e9bd-e4d7-4119-963a-188a003df323 could not be found. May 28 04:48:55.285860 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.285860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b061b397-b06e-4c98-be54-590c51ec73ed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Returning 404 to user: Instance 3bb4e9bd-e4d7-4119-963a-188a003df323 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:55.285860 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b061b397-b06e-4c98-be54-590c51ec73ed tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323" status: 404 len: 111 microversion: 2.1 time: 0.046302 May 28 04:48:55.286368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7fc15b6-c9b6-40d0-b4b9-5eeef09b908c tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:55.286456 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1746/3592] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:55 2022] GET /compute/v2.1/servers/3bb4e9bd-e4d7-4119-963a-188a003df323 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:48:55.286530 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7fc15b6-c9b6-40d0-b4b9-5eeef09b908c tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:55.286530 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7fc15b6-c9b6-40d0-b4b9-5eeef09b908c tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:55.293624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-78488a75-9996-4549-a95c-6f618439896f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '.version_select at 0x7f7700a06550>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:55.331803 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-78488a75-9996-4549-a95c-6f618439896f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] HTTP exception thrown: Image not found. May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-78488a75-9996-4549-a95c-6f618439896f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Request method failure captured: May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da HTTP/1.1 May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikai9kh34KInZIUT2KThwy2DbChsoF1megpewDIdMfqmjztKlkvPzYOl6FMQjvpvji4tDdGTwS8jFJHOILJ82zzQxsl90JOuVmj1cqmxNTFMCLo04o1Za5HKv_FEj1BneXgIJTJqpa-MyMJg9tjoiqpHHeUyTaMKawg5Hk_Y2S1Xx1Sk May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: da841757a2094bad83e04816bb355969 May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_da841757a2094bad83e04816bb355969"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/da841757a2094bad83e04816bb355969"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesTestJSON-190539400 May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: da841757a2094bad83e04816bb355969 May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesTestJSON-190539400-project May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c07b3b1388d24bae9e8834c8b9a4f3a9 May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesTestJSON-190539400-project May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: exception: Image not found. May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '53b00776-fdfe-4b28-9646-9b7afa7877da'} May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 53b00776-fdfe-4b28-9646-9b7afa7877da to delete May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 53b00776-fdfe-4b28-9646-9b7afa7877da could not be found. May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.334179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 04:48:55.339166 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.342726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-78488a75-9996-4549-a95c-6f618439896f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Returning 404 to user: Image not found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:55.342726 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-78488a75-9996-4549-a95c-6f618439896f tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "DELETE /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da" status: 404 len: 62 microversion: 2.1 time: 0.052788 May 28 04:48:55.346770 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1747/3593] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:55 2022] DELETE /compute/v2.1/images/53b00776-fdfe-4b28-9646-9b7afa7877da => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:48:55.353174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-60c1f032-1f47-4855-8c62-798bc3fda4eb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:55.353685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-60c1f032-1f47-4855-8c62-798bc3fda4eb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 265434ea-fb97-43f8-ab64-c1f65c9e42e7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:55.361106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60c1f032-1f47-4855-8c62-798bc3fda4eb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:55.361728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60c1f032-1f47-4855-8c62-798bc3fda4eb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:55.362407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60c1f032-1f47-4855-8c62-798bc3fda4eb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:55.362860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60c1f032-1f47-4855-8c62-798bc3fda4eb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:55.378971 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-60c1f032-1f47-4855-8c62-798bc3fda4eb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] HTTP exception thrown: Instance 265434ea-fb97-43f8-ab64-c1f65c9e42e7 could not be found. May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-60c1f032-1f47-4855-8c62-798bc3fda4eb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Request method failure captured: May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7 HTTP/1.1 May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikai9kh34KInZIUT2KThwy2DbChsoF1megpewDIdMfqmjztKlkvPzYOl6FMQjvpvji4tDdGTwS8jFJHOILJ82zzQxsl90JOuVmj1cqmxNTFMCLo04o1Za5HKv_FEj1BneXgIJTJqpa-MyMJg9tjoiqpHHeUyTaMKawg5Hk_Y2S1Xx1Sk May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: da841757a2094bad83e04816bb355969 May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_da841757a2094bad83e04816bb355969"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/da841757a2094bad83e04816bb355969"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesTestJSON-190539400 May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: da841757a2094bad83e04816bb355969 May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesTestJSON-190539400-project May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c07b3b1388d24bae9e8834c8b9a4f3a9 May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesTestJSON-190539400-project May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 265434ea-fb97-43f8-ab64-c1f65c9e42e7 could not be found. May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '265434ea-fb97-43f8-ab64-c1f65c9e42e7'} May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 265434ea-fb97-43f8-ab64-c1f65c9e42e7 could not be found. May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:55.380885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 265434ea-fb97-43f8-ab64-c1f65c9e42e7 could not be found. May 28 04:48:55.386921 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.386921 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.386921 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.386921 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.386921 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:55.386921 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:55.386921 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:55.386921 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:55.386921 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 265434ea-fb97-43f8-ab64-c1f65c9e42e7 could not be found. May 28 04:48:55.386921 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.394058 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-60c1f032-1f47-4855-8c62-798bc3fda4eb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Returning 404 to user: Instance 265434ea-fb97-43f8-ab64-c1f65c9e42e7 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:55.394058 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-60c1f032-1f47-4855-8c62-798bc3fda4eb tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7" status: 404 len: 111 microversion: 2.1 time: 0.042107 May 28 04:48:55.394058 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1748/3594] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:48:55 2022] DELETE /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:55.401505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-684b0361-5b46-4036-9f63-1dd402399785 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:55.401505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-684b0361-5b46-4036-9f63-1dd402399785 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] [instance: 265434ea-fb97-43f8-ab64-c1f65c9e42e7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:55.405800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-684b0361-5b46-4036-9f63-1dd402399785 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:55.406262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-684b0361-5b46-4036-9f63-1dd402399785 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:55.407072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-684b0361-5b46-4036-9f63-1dd402399785 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:55.410328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-684b0361-5b46-4036-9f63-1dd402399785 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:55.433588 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-684b0361-5b46-4036-9f63-1dd402399785 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] HTTP exception thrown: Instance 265434ea-fb97-43f8-ab64-c1f65c9e42e7 could not be found. May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-684b0361-5b46-4036-9f63-1dd402399785 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Request method failure captured: May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7 HTTP/1.1 May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikai9kh34KInZIUT2KThwy2DbChsoF1megpewDIdMfqmjztKlkvPzYOl6FMQjvpvji4tDdGTwS8jFJHOILJ82zzQxsl90JOuVmj1cqmxNTFMCLo04o1Za5HKv_FEj1BneXgIJTJqpa-MyMJg9tjoiqpHHeUyTaMKawg5Hk_Y2S1Xx1Sk May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: da841757a2094bad83e04816bb355969 May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_da841757a2094bad83e04816bb355969"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/da841757a2094bad83e04816bb355969"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da841757a2094bad83e04816bb355969"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesTestJSON-190539400 May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: da841757a2094bad83e04816bb355969 May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesTestJSON-190539400 May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesTestJSON-190539400-project May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c07b3b1388d24bae9e8834c8b9a4f3a9 May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesTestJSON-190539400-project May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 265434ea-fb97-43f8-ab64-c1f65c9e42e7 could not be found. May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '265434ea-fb97-43f8-ab64-c1f65c9e42e7'} May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 265434ea-fb97-43f8-ab64-c1f65c9e42e7 could not be found. May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 265434ea-fb97-43f8-ab64-c1f65c9e42e7 could not be found. May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.435822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:55.444798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:55.444798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:55.444798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:55.444798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:55.444798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 265434ea-fb97-43f8-ab64-c1f65c9e42e7 could not be found. May 28 04:48:55.444798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:48:55.444798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-684b0361-5b46-4036-9f63-1dd402399785 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] Returning 404 to user: Instance 265434ea-fb97-43f8-ab64-c1f65c9e42e7 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:55.444798 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-684b0361-5b46-4036-9f63-1dd402399785 tempest-ImagesTestJSON-190539400 tempest-ImagesTestJSON-190539400-project] 10.222.0.58 "GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7" status: 404 len: 111 microversion: 2.1 time: 0.041672 May 28 04:48:55.444798 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1749/3595] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:55 2022] GET /compute/v2.1/servers/265434ea-fb97-43f8-ab64-c1f65c9e42e7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:48:55.529363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6238e173-3cfb-4a1f-9ad7-a32a48ad3cb7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:55.529990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6238e173-3cfb-4a1f-9ad7-a32a48ad3cb7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:55.538172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6238e173-3cfb-4a1f-9ad7-a32a48ad3cb7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:55.539047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6238e173-3cfb-4a1f-9ad7-a32a48ad3cb7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:55.541622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6238e173-3cfb-4a1f-9ad7-a32a48ad3cb7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:55.542081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6238e173-3cfb-4a1f-9ad7-a32a48ad3cb7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:55.610197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d7fc15b6-c9b6-40d0-b4b9-5eeef09b908c tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4609ffbc52454490fa05cd74d1ee6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a7ab68e42409e96472af2f4d14c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:55.624194 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d7fc15b6-c9b6-40d0-b4b9-5eeef09b908c tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90" status: 200 len: 1529 microversion: 2.1 time: 0.360997 May 28 04:48:55.624795 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1847/3596] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:55 2022] GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90 => generated 1529 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:48:55.641030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-a387b8de-74a1-426e-a2cd-34e144b91995 req-2b8dc788-dff5-48b0-aefc-9880f0adb8ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "711037c4-54ef-4071-a370-fd39338dccf8", "name": "network-vif-plugged", "status": "completed", "tag": "95fcb5b1-c23a-4821-b27d-fffaf4a019eb"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:55.653808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a387b8de-74a1-426e-a2cd-34e144b91995 req-2b8dc788-dff5-48b0-aefc-9880f0adb8ce service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:55.654526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a387b8de-74a1-426e-a2cd-34e144b91995 req-2b8dc788-dff5-48b0-aefc-9880f0adb8ce service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:55.666494 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-a387b8de-74a1-426e-a2cd-34e144b91995 req-2b8dc788-dff5-48b0-aefc-9880f0adb8ce service nova] Creating event network-vif-plugged:95fcb5b1-c23a-4821-b27d-fffaf4a019eb for instance 711037c4-54ef-4071-a370-fd39338dccf8 on n-h1-843700-1 May 28 04:48:55.685980 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-a387b8de-74a1-426e-a2cd-34e144b91995 req-2b8dc788-dff5-48b0-aefc-9880f0adb8ce service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056567 May 28 04:48:55.690523 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1848/3597] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:48:55.846390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6238e173-3cfb-4a1f-9ad7-a32a48ad3cb7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:55.859186 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6238e173-3cfb-4a1f-9ad7-a32a48ad3cb7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1677 microversion: 2.1 time: 0.333653 May 28 04:48:55.860627 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1750/3598] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:55 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1677 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:48:55.921412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-80e5d331-19e5-4d7b-a3f0-57190bea3ece tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:55.922126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-80e5d331-19e5-4d7b-a3f0-57190bea3ece tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:55.928346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80e5d331-19e5-4d7b-a3f0-57190bea3ece tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:55.928809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80e5d331-19e5-4d7b-a3f0-57190bea3ece tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:55.929928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80e5d331-19e5-4d7b-a3f0-57190bea3ece tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:55.930353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80e5d331-19e5-4d7b-a3f0-57190bea3ece tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:56.276243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-80e5d331-19e5-4d7b-a3f0-57190bea3ece tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:56.286736 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-80e5d331-19e5-4d7b-a3f0-57190bea3ece tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8" status: 200 len: 1366 microversion: 2.1 time: 0.369590 May 28 04:48:56.288800 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1849/3599] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:55 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:56.310422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-db2158d1-b75e-44e8-90f1-27f95658c73a tempest-AbsoluteLimitsNegativeTestJSON-1618364155 tempest-AbsoluteLimitsNegativeTestJSON-1618364155-project] Calling method '.version_select at 0x7f77009b6790>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:56.329188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db2158d1-b75e-44e8-90f1-27f95658c73a tempest-AbsoluteLimitsNegativeTestJSON-1618364155 tempest-AbsoluteLimitsNegativeTestJSON-1618364155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:56.329952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db2158d1-b75e-44e8-90f1-27f95658c73a tempest-AbsoluteLimitsNegativeTestJSON-1618364155 tempest-AbsoluteLimitsNegativeTestJSON-1618364155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:56.334897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db2158d1-b75e-44e8-90f1-27f95658c73a tempest-AbsoluteLimitsNegativeTestJSON-1618364155 tempest-AbsoluteLimitsNegativeTestJSON-1618364155-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:56.334897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db2158d1-b75e-44e8-90f1-27f95658c73a tempest-AbsoluteLimitsNegativeTestJSON-1618364155 tempest-AbsoluteLimitsNegativeTestJSON-1618364155-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:56.356009 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-db2158d1-b75e-44e8-90f1-27f95658c73a tempest-AbsoluteLimitsNegativeTestJSON-1618364155 tempest-AbsoluteLimitsNegativeTestJSON-1618364155-project] 10.222.0.58 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.204251 May 28 04:48:56.356822 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1751/3600] 10.222.0.58 () {58 vars in 1121 bytes} [Sat May 28 04:48:56 2022] GET /compute/v2.1/limits => generated 511 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:48:56.414804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9523a65a-7e6f-4e32-b285-eedf6a6c03b2 tempest-AbsoluteLimitsNegativeTestJSON-1618364155 tempest-AbsoluteLimitsNegativeTestJSON-1618364155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-342168954", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:56.479304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-9523a65a-7e6f-4e32-b285-eedf6a6c03b2 tempest-AbsoluteLimitsNegativeTestJSON-1618364155 tempest-AbsoluteLimitsNegativeTestJSON-1618364155-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:48:56.651336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-df1d25a5-e8e9-4316-95aa-277a1ab7c64d tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:56.652104 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-df1d25a5-e8e9-4316-95aa-277a1ab7c64d tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] [instance: 23c5c1ac-00ef-409b-ba6b-6d8574930e90] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:56.661468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df1d25a5-e8e9-4316-95aa-277a1ab7c64d tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:56.666404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df1d25a5-e8e9-4316-95aa-277a1ab7c64d tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:56.671452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df1d25a5-e8e9-4316-95aa-277a1ab7c64d tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:56.672034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df1d25a5-e8e9-4316-95aa-277a1ab7c64d tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:56.924692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-9523a65a-7e6f-4e32-b285-eedf6a6c03b2 tempest-AbsoluteLimitsNegativeTestJSON-1618364155 tempest-AbsoluteLimitsNegativeTestJSON-1618364155-project] Getting quotas for project be5c2a8652334befa837871a68288cc0. Resources: dict_keys(['metadata_items']) {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:48:56.935861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-9523a65a-7e6f-4e32-b285-eedf6a6c03b2 tempest-AbsoluteLimitsNegativeTestJSON-1618364155 tempest-AbsoluteLimitsNegativeTestJSON-1618364155-project] Getting quotas for user ed748f16f06040dbbf1572ac8f5ca130 and project be5c2a8652334befa837871a68288cc0. Resources: dict_keys(['metadata_items']) {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:48:56.937505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-df1d25a5-e8e9-4316-95aa-277a1ab7c64d tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4609ffbc52454490fa05cd74d1ee6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a7ab68e42409e96472af2f4d14c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:56.949258 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-df1d25a5-e8e9-4316-95aa-277a1ab7c64d tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90" status: 200 len: 1529 microversion: 2.1 time: 0.302762 May 28 04:48:56.950787 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-9523a65a-7e6f-4e32-b285-eedf6a6c03b2 tempest-AbsoluteLimitsNegativeTestJSON-1618364155 tempest-AbsoluteLimitsNegativeTestJSON-1618364155-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9523a65a-7e6f-4e32-b285-eedf6a6c03b2 tempest-AbsoluteLimitsNegativeTestJSON-1618364155 tempest-AbsoluteLimitsNegativeTestJSON-1618364155-project] Request method failure captured: May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 1751 May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikam46fEfGytSgsSMUqnp3SrkpJQhimKGDqvvzieocovP5gWtmCl4ZNGkitpdmCN6u_yYVVm-J2Lq7hQLbE4FRPjapPHjiBtflLJwCBSgo7ThF3LT0KVZbSglE6FQ8lyZ7_MaTAhGbDv5NBtcxZXuj6Yq_gPjKaY_k1tIbjySXOg_lj8 May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: be5c2a8652334befa837871a68288cc0 May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1618364155 May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_be5c2a8652334befa837871a68288cc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/be5c2a8652334befa837871a68288cc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be5c2a8652334befa837871a68288cc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be5c2a8652334befa837871a68288cc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1618364155 May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: be5c2a8652334befa837871a68288cc0 May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1618364155 May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1618364155-project May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: ed748f16f06040dbbf1572ac8f5ca130 May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1618364155-project May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-342168954", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:48:56.953212 n-d-843700-1 devstack@n-api.service[126044]: exception: Maximum number of metadata items exceeds 128 May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-342168954', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._create_instance( May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:48:56.955505 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:48:56.958282 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:48:56.958282 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 04:48:56.958282 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 28 04:48:56.958282 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 28 04:48:56.958282 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 May 28 04:48:56.958282 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:56.958282 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:56.958282 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:56.958282 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:56.958282 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:56.958282 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:56.958282 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:56.958282 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:56.958282 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 May 28 04:48:56.958282 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:56.959987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9523a65a-7e6f-4e32-b285-eedf6a6c03b2 tempest-AbsoluteLimitsNegativeTestJSON-1618364155 tempest-AbsoluteLimitsNegativeTestJSON-1618364155-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:56.960994 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9523a65a-7e6f-4e32-b285-eedf6a6c03b2 tempest-AbsoluteLimitsNegativeTestJSON-1618364155 tempest-AbsoluteLimitsNegativeTestJSON-1618364155-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.550465 May 28 04:48:56.961620 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1752/3601] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:56 2022] GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90 => generated 1529 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:56.966623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7f4da241-ef1c-4e0a-830c-93a0c3c374dc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:56.968012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7f4da241-ef1c-4e0a-830c-93a0c3c374dc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:56.972739 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1850/3602] 10.222.0.58 () {60 vars in 1147 bytes} [Sat May 28 04:48:56 2022] POST /compute/v2.1/servers => generated 87 bytes in 562 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) May 28 04:48:56.976817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f4da241-ef1c-4e0a-830c-93a0c3c374dc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:56.977805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f4da241-ef1c-4e0a-830c-93a0c3c374dc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:56.978661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f4da241-ef1c-4e0a-830c-93a0c3c374dc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:56.979263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f4da241-ef1c-4e0a-830c-93a0c3c374dc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:57.243819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7f4da241-ef1c-4e0a-830c-93a0c3c374dc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:57.243819 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7f4da241-ef1c-4e0a-830c-93a0c3c374dc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.280725 May 28 04:48:57.244286 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1753/3603] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:56 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:57.305384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9bdf7ef1-2c22-4f48-a445-a3a6836fe6c0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:57.309424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9bdf7ef1-2c22-4f48-a445-a3a6836fe6c0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:57.312438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9bdf7ef1-2c22-4f48-a445-a3a6836fe6c0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:57.312907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9bdf7ef1-2c22-4f48-a445-a3a6836fe6c0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:57.313864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9bdf7ef1-2c22-4f48-a445-a3a6836fe6c0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:57.314673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9bdf7ef1-2c22-4f48-a445-a3a6836fe6c0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:57.348936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-324ddd4c-c26b-4d80-b25c-7b8a96505181 req-a313a7bf-4881-463b-ac4d-d6e2c4f9b879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c5c1ac-00ef-409b-ba6b-6d8574930e90", "name": "network-vif-deleted", "tag": "0089d937-84b7-4f38-a876-99374c83a293"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:48:57.366052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-324ddd4c-c26b-4d80-b25c-7b8a96505181 req-a313a7bf-4881-463b-ac4d-d6e2c4f9b879 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:57.366780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-324ddd4c-c26b-4d80-b25c-7b8a96505181 req-a313a7bf-4881-463b-ac4d-d6e2c4f9b879 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:57.385478 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-324ddd4c-c26b-4d80-b25c-7b8a96505181 req-a313a7bf-4881-463b-ac4d-d6e2c4f9b879 service nova] Creating event network-vif-deleted:0089d937-84b7-4f38-a876-99374c83a293 for instance 23c5c1ac-00ef-409b-ba6b-6d8574930e90 on n-h1-843700-1 May 28 04:48:57.395878 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-324ddd4c-c26b-4d80-b25c-7b8a96505181 req-a313a7bf-4881-463b-ac4d-d6e2c4f9b879 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052766 May 28 04:48:57.397830 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1754/3604] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:48:57.653467 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9bdf7ef1-2c22-4f48-a445-a3a6836fe6c0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:57.663858 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9bdf7ef1-2c22-4f48-a445-a3a6836fe6c0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8" status: 200 len: 1366 microversion: 2.1 time: 0.361856 May 28 04:48:57.689258 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1851/3605] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:57 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 => generated 1366 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:57.969614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-29eb18e6-6f0b-4ab7-aca7-a6615354ca03 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:57.971044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-29eb18e6-6f0b-4ab7-aca7-a6615354ca03 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] [instance: 23c5c1ac-00ef-409b-ba6b-6d8574930e90] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:57.980762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29eb18e6-6f0b-4ab7-aca7-a6615354ca03 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:57.984485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29eb18e6-6f0b-4ab7-aca7-a6615354ca03 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:57.984485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29eb18e6-6f0b-4ab7-aca7-a6615354ca03 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:57.984485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29eb18e6-6f0b-4ab7-aca7-a6615354ca03 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:58.042783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29eb18e6-6f0b-4ab7-aca7-a6615354ca03 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:58.043473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29eb18e6-6f0b-4ab7-aca7-a6615354ca03 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:58.044085 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-29eb18e6-6f0b-4ab7-aca7-a6615354ca03 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lazy-loading 'fault' on Instance uuid 23c5c1ac-00ef-409b-ba6b-6d8574930e90 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:48:58.105150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-29eb18e6-6f0b-4ab7-aca7-a6615354ca03 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4609ffbc52454490fa05cd74d1ee6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a7ab68e42409e96472af2f4d14c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:58.123695 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-29eb18e6-6f0b-4ab7-aca7-a6615354ca03 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90" status: 200 len: 1315 microversion: 2.1 time: 0.159569 May 28 04:48:58.124784 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1755/3606] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:57 2022] GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:58.682056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4fc2875c-17f6-4d58-bf39-921688b40f25 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:58.682796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4fc2875c-17f6-4d58-bf39-921688b40f25 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:58.698335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fc2875c-17f6-4d58-bf39-921688b40f25 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:58.698806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fc2875c-17f6-4d58-bf39-921688b40f25 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:58.700411 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fc2875c-17f6-4d58-bf39-921688b40f25 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:58.704427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fc2875c-17f6-4d58-bf39-921688b40f25 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:59.005478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4fc2875c-17f6-4d58-bf39-921688b40f25 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:48:59.009870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:48:59.017261 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4fc2875c-17f6-4d58-bf39-921688b40f25 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8" status: 200 len: 1555 microversion: 2.1 time: 0.340169 May 28 04:48:59.019280 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1852/3607] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:58 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 => generated 1555 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:48:59.040043 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c14d2447-894e-4b97-bfad-0568757560ec tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:59.041418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c14d2447-894e-4b97-bfad-0568757560ec tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:59.057690 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c14d2447-894e-4b97-bfad-0568757560ec tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:59.058402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c14d2447-894e-4b97-bfad-0568757560ec tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:59.060495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c14d2447-894e-4b97-bfad-0568757560ec tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:59.064772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c14d2447-894e-4b97-bfad-0568757560ec tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:59.144827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-57599b1d-9eb9-4b9d-b869-a8b5240f9c40 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:48:59.145862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-57599b1d-9eb9-4b9d-b869-a8b5240f9c40 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] [instance: 23c5c1ac-00ef-409b-ba6b-6d8574930e90] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:48:59.154157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57599b1d-9eb9-4b9d-b869-a8b5240f9c40 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:59.154863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57599b1d-9eb9-4b9d-b869-a8b5240f9c40 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:59.156124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57599b1d-9eb9-4b9d-b869-a8b5240f9c40 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:48:59.157104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57599b1d-9eb9-4b9d-b869-a8b5240f9c40 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:48:59.190948 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-57599b1d-9eb9-4b9d-b869-a8b5240f9c40 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] HTTP exception thrown: Instance 23c5c1ac-00ef-409b-ba6b-6d8574930e90 could not be found. May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-57599b1d-9eb9-4b9d-b869-a8b5240f9c40 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Request method failure captured: May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90 HTTP/1.1 May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikamolxL_Xu7Nio3QHMmvwnFFU7xNOOzZa18JpTZwkd5WjGR8a-AYH1PWaaVsxVMHWZxXh7fqwrWot2CWbMcNGOcgMSa5CqfhUBlvv_Rn9Ym5Q7jAEgkbJ6QUfrWizHjeJ3rnPDRtjCFcBi-Ue8jaoV4Ers5XWjTyslDopnPV1LuP-SM May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: e28a7ab68e42409e96472af2f4d14c34 May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1474335272 May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e28a7ab68e42409e96472af2f4d14c34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e28a7ab68e42409e96472af2f4d14c34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e28a7ab68e42409e96472af2f4d14c34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e28a7ab68e42409e96472af2f4d14c34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1474335272 May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: e28a7ab68e42409e96472af2f4d14c34 May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1474335272 May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerAddressesNegativeTestJSON-1474335272-project May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: fe4609ffbc52454490fa05cd74d1ee6f May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1474335272-project May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 23c5c1ac-00ef-409b-ba6b-6d8574930e90 could not be found. May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '23c5c1ac-00ef-409b-ba6b-6d8574930e90'} May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23c5c1ac-00ef-409b-ba6b-6d8574930e90 could not be found. May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23c5c1ac-00ef-409b-ba6b-6d8574930e90 could not be found. May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:59.193289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:48:59.201197 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:59.201197 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:48:59.201197 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:48:59.201197 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:48:59.201197 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:48:59.201197 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:48:59.201197 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23c5c1ac-00ef-409b-ba6b-6d8574930e90 could not be found. May 28 04:48:59.201197 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:48:59.201197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-57599b1d-9eb9-4b9d-b869-a8b5240f9c40 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] Returning 404 to user: Instance 23c5c1ac-00ef-409b-ba6b-6d8574930e90 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:48:59.201197 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-57599b1d-9eb9-4b9d-b869-a8b5240f9c40 tempest-ServerAddressesNegativeTestJSON-1474335272 tempest-ServerAddressesNegativeTestJSON-1474335272-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90" status: 404 len: 111 microversion: 2.1 time: 0.057816 May 28 04:48:59.201197 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1853/3608] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:48:59 2022] GET /compute/v2.1/servers/23c5c1ac-00ef-409b-ba6b-6d8574930e90 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:48:59.219720 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c14d2447-894e-4b97-bfad-0568757560ec tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.184185 May 28 04:48:59.221351 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1756/3609] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 04:48:59 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-interface => generated 284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:00.162363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cab5ff7b-b369-4f44-86bf-12b586c93fab tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1361543045", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:00.237491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-cab5ff7b-b369-4f44-86bf-12b586c93fab tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:49:00.776706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-cab5ff7b-b369-4f44-86bf-12b586c93fab tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:49:00.780295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-cab5ff7b-b369-4f44-86bf-12b586c93fab tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:49:00.781018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-cab5ff7b-b369-4f44-86bf-12b586c93fab tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:49:00.783692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-cab5ff7b-b369-4f44-86bf-12b586c93fab tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:49:00.784369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-cab5ff7b-b369-4f44-86bf-12b586c93fab tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:49:00.813650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cab5ff7b-b369-4f44-86bf-12b586c93fab tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:00.814107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cab5ff7b-b369-4f44-86bf-12b586c93fab tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:00.817681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cab5ff7b-b369-4f44-86bf-12b586c93fab tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:00.818431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cab5ff7b-b369-4f44-86bf-12b586c93fab tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:00.891529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-cab5ff7b-b369-4f44-86bf-12b586c93fab tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Getting quotas for project 38b09d6ee6aa4482b2b0f5f8deba5191. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:49:00.907385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-cab5ff7b-b369-4f44-86bf-12b586c93fab tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Getting quotas for user 098ecff622ca4dcbb9207d847a8b67ab and project 38b09d6ee6aa4482b2b0f5f8deba5191. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:49:00.942919 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cab5ff7b-b369-4f44-86bf-12b586c93fab tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:49:00.948035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cab5ff7b-b369-4f44-86bf-12b586c93fab tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:49:01.143754 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cab5ff7b-b369-4f44-86bf-12b586c93fab tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.234029 May 28 04:49:01.144465 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1854/3610] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:48:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:49:01.156764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-008b427a-1279-4c2f-87d6-dfe5d33e0a8c tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:01.157637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-008b427a-1279-4c2f-87d6-dfe5d33e0a8c tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:01.166552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:01.312085 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-008b427a-1279-4c2f-87d6-dfe5d33e0a8c tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098ecff622ca4dcbb9207d847a8b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b09d6ee6aa4482b2b0f5f8deba5191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:01.330326 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-008b427a-1279-4c2f-87d6-dfe5d33e0a8c tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8" status: 200 len: 1216 microversion: 2.1 time: 0.175692 May 28 04:49:01.330326 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1757/3611] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:01 2022] GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 => generated 1216 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:01.473058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-2ed2cfda-9489-4432-86e5-56a069a2873e req-ca1a5961-c822-4415-a6f0-f1d418bb3d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "711037c4-54ef-4071-a370-fd39338dccf8", "tag": "95fcb5b1-c23a-4821-b27d-fffaf4a019eb"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:01.490271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2ed2cfda-9489-4432-86e5-56a069a2873e req-ca1a5961-c822-4415-a6f0-f1d418bb3d0e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:01.490924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2ed2cfda-9489-4432-86e5-56a069a2873e req-ca1a5961-c822-4415-a6f0-f1d418bb3d0e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:01.505395 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-2ed2cfda-9489-4432-86e5-56a069a2873e req-ca1a5961-c822-4415-a6f0-f1d418bb3d0e service nova] Creating event network-changed:95fcb5b1-c23a-4821-b27d-fffaf4a019eb for instance 711037c4-54ef-4071-a370-fd39338dccf8 on n-h1-843700-1 May 28 04:49:01.513841 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-2ed2cfda-9489-4432-86e5-56a069a2873e req-ca1a5961-c822-4415-a6f0-f1d418bb3d0e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044725 May 28 04:49:01.514600 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1855/3612] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:49:02.347608 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-08a9db35-d76f-41e7-bfbf-8af7b4a8a0d1 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:02.348228 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-08a9db35-d76f-41e7-bfbf-8af7b4a8a0d1 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:02.530768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-08a9db35-d76f-41e7-bfbf-8af7b4a8a0d1 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098ecff622ca4dcbb9207d847a8b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b09d6ee6aa4482b2b0f5f8deba5191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:02.538308 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-08a9db35-d76f-41e7-bfbf-8af7b4a8a0d1 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8" status: 200 len: 1216 microversion: 2.1 time: 0.196653 May 28 04:49:02.552578 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1758/3613] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:02 2022] GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 => generated 1216 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:03.557666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a766b386-bf45-4d1c-8e09-a777e26f0875 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:03.559023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a766b386-bf45-4d1c-8e09-a777e26f0875 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:03.581442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a766b386-bf45-4d1c-8e09-a777e26f0875 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:03.584775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a766b386-bf45-4d1c-8e09-a777e26f0875 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:03.585805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a766b386-bf45-4d1c-8e09-a777e26f0875 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:03.586466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a766b386-bf45-4d1c-8e09-a777e26f0875 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:03.691344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a766b386-bf45-4d1c-8e09-a777e26f0875 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098ecff622ca4dcbb9207d847a8b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b09d6ee6aa4482b2b0f5f8deba5191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:03.700911 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a766b386-bf45-4d1c-8e09-a777e26f0875 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8" status: 200 len: 1268 microversion: 2.1 time: 0.148324 May 28 04:49:03.712545 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1856/3614] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:03 2022] GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:03.867625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2394d946-a3eb-41a2-ae15-506c163a41a0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1098524090", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "0182d04c-0e67-4514-a25b-8c708f03394c"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:03.950745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-2394d946-a3eb-41a2-ae15-506c163a41a0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] validate_networks() for [('0182d04c-0e67-4514-a25b-8c708f03394c', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:49:04.495530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-2394d946-a3eb-41a2-ae15-506c163a41a0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:49:04.496172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-2394d946-a3eb-41a2-ae15-506c163a41a0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:49:04.496922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-2394d946-a3eb-41a2-ae15-506c163a41a0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:49:04.497496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-2394d946-a3eb-41a2-ae15-506c163a41a0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:49:04.498074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-2394d946-a3eb-41a2-ae15-506c163a41a0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:49:04.507760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2394d946-a3eb-41a2-ae15-506c163a41a0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:04.508744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2394d946-a3eb-41a2-ae15-506c163a41a0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:04.510176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2394d946-a3eb-41a2-ae15-506c163a41a0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:04.510794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2394d946-a3eb-41a2-ae15-506c163a41a0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:04.530647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-2394d946-a3eb-41a2-ae15-506c163a41a0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Getting quotas for project 75310386a8674319a847876503f7b3f9. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:49:04.536406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-2394d946-a3eb-41a2-ae15-506c163a41a0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Getting quotas for user 22a55ccce3d94656ba57bb9b8bd1a6e6 and project 75310386a8674319a847876503f7b3f9. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:49:04.551665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2394d946-a3eb-41a2-ae15-506c163a41a0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:49:04.556548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2394d946-a3eb-41a2-ae15-506c163a41a0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:49:04.720968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c9724855-aea8-41fb-8061-9c95b52828e3 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:04.723508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c9724855-aea8-41fb-8061-9c95b52828e3 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:04.766213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9724855-aea8-41fb-8061-9c95b52828e3 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:04.768372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9724855-aea8-41fb-8061-9c95b52828e3 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:04.772103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9724855-aea8-41fb-8061-9c95b52828e3 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:04.773277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9724855-aea8-41fb-8061-9c95b52828e3 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:04.788469 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2394d946-a3eb-41a2-ae15-506c163a41a0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.159798 May 28 04:49:04.792305 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1759/3615] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:49:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:49:04.803554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3faa6b73-6931-4b3f-b2f5-3bd83ed4566e tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:04.804186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3faa6b73-6931-4b3f-b2f5-3bd83ed4566e tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:04.909572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3faa6b73-6931-4b3f-b2f5-3bd83ed4566e tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:04.919635 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3faa6b73-6931-4b3f-b2f5-3bd83ed4566e tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 200 len: 1217 microversion: 2.1 time: 0.120822 May 28 04:49:04.936896 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1760/3616] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:04 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 1217 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:04.948157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c9724855-aea8-41fb-8061-9c95b52828e3 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098ecff622ca4dcbb9207d847a8b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b09d6ee6aa4482b2b0f5f8deba5191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:04.972245 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c9724855-aea8-41fb-8061-9c95b52828e3 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8" status: 200 len: 1286 microversion: 2.1 time: 0.254519 May 28 04:49:04.975529 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1857/3617] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:04 2022] GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 => generated 1286 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:05.942391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1daf31c8-a674-478d-aaf3-030cd50877f4 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:05.943569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1daf31c8-a674-478d-aaf3-030cd50877f4 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:05.995090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-49faf5ed-9d12-4f40-bb6a-36b511972634 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:05.997109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-49faf5ed-9d12-4f40-bb6a-36b511972634 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:06.018567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49faf5ed-9d12-4f40-bb6a-36b511972634 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:06.018567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49faf5ed-9d12-4f40-bb6a-36b511972634 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:06.019829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49faf5ed-9d12-4f40-bb6a-36b511972634 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:06.020289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49faf5ed-9d12-4f40-bb6a-36b511972634 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:06.160204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1daf31c8-a674-478d-aaf3-030cd50877f4 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:06.173270 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1daf31c8-a674-478d-aaf3-030cd50877f4 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 200 len: 1217 microversion: 2.1 time: 0.235374 May 28 04:49:06.181446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-49faf5ed-9d12-4f40-bb6a-36b511972634 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098ecff622ca4dcbb9207d847a8b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b09d6ee6aa4482b2b0f5f8deba5191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:06.182164 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1761/3618] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:05 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 1217 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:06.197951 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-49faf5ed-9d12-4f40-bb6a-36b511972634 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8" status: 200 len: 1274 microversion: 2.1 time: 0.208408 May 28 04:49:06.198688 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1858/3619] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:05 2022] GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 => generated 1274 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:06.685663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6a91bd4a-9ef0-4efe-9508-352d039864dd tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Action: 'create', calling method: .version_select at 0x7f7700966ca0>, body: {"keypair": {"name": "tempest-keypair-1030427461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD62ggWXiRjuMOnsOP2vSW7tpVXEy3ZJ/ZDw6A5tfflyzOFl+JtWoa2hgXbFxd53vk1nmjBfPSJ00Z8IxNKESkOedkHJOGSYyELCVkEbskJc+r+zgJvfUX+wu2ifssi5Iw=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:06.704439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-6a91bd4a-9ef0-4efe-9508-352d039864dd tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Getting quotas for project 584749eada5c4f9281286bc6145c7b85. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:49:06.712003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-6a91bd4a-9ef0-4efe-9508-352d039864dd tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Getting quotas for user f19a7c36dbc14147bd823c8e1681f8e3 and project 584749eada5c4f9281286bc6145c7b85. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:49:06.878311 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6a91bd4a-9ef0-4efe-9508-352d039864dd tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.446309 May 28 04:49:06.878463 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1762/3620] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:49:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:07.198898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-84c3dcdd-3132-40f2-99a6-93178f28f48d tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:07.199600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-84c3dcdd-3132-40f2-99a6-93178f28f48d tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:07.222682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84c3dcdd-3132-40f2-99a6-93178f28f48d tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:07.223286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84c3dcdd-3132-40f2-99a6-93178f28f48d tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:07.240099 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84c3dcdd-3132-40f2-99a6-93178f28f48d tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:07.240564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84c3dcdd-3132-40f2-99a6-93178f28f48d tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:07.330004 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5b353745-4911-4039-bede-dcc791a10c6e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1633862789", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "fd0d7eb0-eb78-443c-941c-e203b5533601"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:07.418617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-5b353745-4911-4039-bede-dcc791a10c6e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] validate_networks() for [('fd0d7eb0-eb78-443c-941c-e203b5533601', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:49:07.425691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-84c3dcdd-3132-40f2-99a6-93178f28f48d tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:07.439315 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-84c3dcdd-3132-40f2-99a6-93178f28f48d tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 200 len: 1269 microversion: 2.1 time: 0.245108 May 28 04:49:07.443425 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1763/3621] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:07 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 1269 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:07.462372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1baa3060-5505-4d19-990c-779beb45b623 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:07.464451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1baa3060-5505-4d19-990c-779beb45b623 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:07.481050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1baa3060-5505-4d19-990c-779beb45b623 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:07.482174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1baa3060-5505-4d19-990c-779beb45b623 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:07.483875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1baa3060-5505-4d19-990c-779beb45b623 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:07.484915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1baa3060-5505-4d19-990c-779beb45b623 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:07.747620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1baa3060-5505-4d19-990c-779beb45b623 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098ecff622ca4dcbb9207d847a8b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b09d6ee6aa4482b2b0f5f8deba5191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:07.767848 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1baa3060-5505-4d19-990c-779beb45b623 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8" status: 200 len: 1316 microversion: 2.1 time: 0.322150 May 28 04:49:07.770866 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1764/3622] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:07 2022] GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:08.451860 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-5b353745-4911-4039-bede-dcc791a10c6e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:49:08.465220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ad8be2b7-58d5-4399-a207-e312f7acb208 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:08.465700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-5b353745-4911-4039-bede-dcc791a10c6e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:49:08.465838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-5b353745-4911-4039-bede-dcc791a10c6e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:49:08.466492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-5b353745-4911-4039-bede-dcc791a10c6e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:49:08.467236 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-5b353745-4911-4039-bede-dcc791a10c6e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:49:08.469801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ad8be2b7-58d5-4399-a207-e312f7acb208 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:08.495690 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ad8be2b7-58d5-4399-a207-e312f7acb208 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:08.497903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b353745-4911-4039-bede-dcc791a10c6e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:08.498363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b353745-4911-4039-bede-dcc791a10c6e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:08.499200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b353745-4911-4039-bede-dcc791a10c6e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:08.499643 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b353745-4911-4039-bede-dcc791a10c6e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:08.501312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ad8be2b7-58d5-4399-a207-e312f7acb208 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:08.502319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ad8be2b7-58d5-4399-a207-e312f7acb208 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:08.503303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ad8be2b7-58d5-4399-a207-e312f7acb208 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:08.543566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-5b353745-4911-4039-bede-dcc791a10c6e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Getting quotas for project 724a5513bc2c42eabbefa450e207453e. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:49:08.550693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-5b353745-4911-4039-bede-dcc791a10c6e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Getting quotas for user 71b6b3ac5a4249fd8f76fb2e7e2b6c18 and project 724a5513bc2c42eabbefa450e207453e. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:49:08.572762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5b353745-4911-4039-bede-dcc791a10c6e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:49:08.576156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5b353745-4911-4039-bede-dcc791a10c6e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 09a578bc-f131-4126-8426-6e97ab6178ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:49:08.577750 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:08.654774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ad8be2b7-58d5-4399-a207-e312f7acb208 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:08.663644 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ad8be2b7-58d5-4399-a207-e312f7acb208 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 200 len: 1275 microversion: 2.1 time: 0.207768 May 28 04:49:08.669609 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1765/3623] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:08 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 1275 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:08.670455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-025ac462-0a35-47a5-85a2-2d39d48c412d req-ac59ad0a-7fb4-4eee-b594-48202d052a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ded807fc-f5a6-43d7-a853-6ce1896141e8", "tag": "a64e0abb-754b-456d-9850-1f579d035510"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:08.679446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-025ac462-0a35-47a5-85a2-2d39d48c412d req-ac59ad0a-7fb4-4eee-b594-48202d052a3d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:08.679899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-025ac462-0a35-47a5-85a2-2d39d48c412d req-ac59ad0a-7fb4-4eee-b594-48202d052a3d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:08.710007 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-025ac462-0a35-47a5-85a2-2d39d48c412d req-ac59ad0a-7fb4-4eee-b594-48202d052a3d service nova] Creating event network-changed:a64e0abb-754b-456d-9850-1f579d035510 for instance ded807fc-f5a6-43d7-a853-6ce1896141e8 on n-h2-843700-1 May 28 04:49:08.716525 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-025ac462-0a35-47a5-85a2-2d39d48c412d req-ac59ad0a-7fb4-4eee-b594-48202d052a3d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050584 May 28 04:49:08.717390 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1766/3624] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:08.740590 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5b353745-4911-4039-bede-dcc791a10c6e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.550816 May 28 04:49:08.741848 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1859/3625] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:49:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 04:49:08.753450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ff9dc711-4717-4e31-8bf2-5316246d0e8f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:08.754524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ff9dc711-4717-4e31-8bf2-5316246d0e8f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 09a578bc-f131-4126-8426-6e97ab6178ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:08.788319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-770bbad0-f9b7-4081-9fb8-cfac3c92bd13 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:08.788997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-770bbad0-f9b7-4081-9fb8-cfac3c92bd13 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:08.818532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-770bbad0-f9b7-4081-9fb8-cfac3c92bd13 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:08.818949 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-770bbad0-f9b7-4081-9fb8-cfac3c92bd13 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:08.822688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-770bbad0-f9b7-4081-9fb8-cfac3c92bd13 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:08.822688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-770bbad0-f9b7-4081-9fb8-cfac3c92bd13 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:08.931721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ff9dc711-4717-4e31-8bf2-5316246d0e8f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:08.939411 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ff9dc711-4717-4e31-8bf2-5316246d0e8f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba" status: 200 len: 1193 microversion: 2.1 time: 0.191260 May 28 04:49:08.944314 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1767/3626] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:08 2022] GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba => generated 1193 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:09.235617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-770bbad0-f9b7-4081-9fb8-cfac3c92bd13 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098ecff622ca4dcbb9207d847a8b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b09d6ee6aa4482b2b0f5f8deba5191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:09.248590 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-770bbad0-f9b7-4081-9fb8-cfac3c92bd13 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8" status: 200 len: 1316 microversion: 2.1 time: 0.465086 May 28 04:49:09.252503 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1860/3627] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:08 2022] GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 => generated 1316 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:09.681298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5e24f7ba-127f-4860-a1b5-920d024925e3 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:09.684826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5e24f7ba-127f-4860-a1b5-920d024925e3 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:09.696593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e24f7ba-127f-4860-a1b5-920d024925e3 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:09.697070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e24f7ba-127f-4860-a1b5-920d024925e3 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:09.698536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e24f7ba-127f-4860-a1b5-920d024925e3 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:09.699630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e24f7ba-127f-4860-a1b5-920d024925e3 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:09.826177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5e24f7ba-127f-4860-a1b5-920d024925e3 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:09.840414 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5e24f7ba-127f-4860-a1b5-920d024925e3 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 200 len: 1275 microversion: 2.1 time: 0.162332 May 28 04:49:09.845947 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1768/3628] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:09 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 1275 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:09.957799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0d0a3be3-9fe3-4755-a7bb-df6859c1dde7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:09.958457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0d0a3be3-9fe3-4755-a7bb-df6859c1dde7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 09a578bc-f131-4126-8426-6e97ab6178ba] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:10.014806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0d0a3be3-9fe3-4755-a7bb-df6859c1dde7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:10.022494 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0d0a3be3-9fe3-4755-a7bb-df6859c1dde7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba" status: 200 len: 1193 microversion: 2.1 time: 0.068941 May 28 04:49:10.023110 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1861/3629] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:09 2022] GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba => generated 1193 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:10.269932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7f0c0e69-8c6d-4344-8695-a60329bce8df tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:10.270780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7f0c0e69-8c6d-4344-8695-a60329bce8df tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:10.277810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f0c0e69-8c6d-4344-8695-a60329bce8df tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:10.278390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f0c0e69-8c6d-4344-8695-a60329bce8df tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:10.280150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f0c0e69-8c6d-4344-8695-a60329bce8df tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:10.283281 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f0c0e69-8c6d-4344-8695-a60329bce8df tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:10.560044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7f0c0e69-8c6d-4344-8695-a60329bce8df tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098ecff622ca4dcbb9207d847a8b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b09d6ee6aa4482b2b0f5f8deba5191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:10.576729 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7f0c0e69-8c6d-4344-8695-a60329bce8df tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8" status: 200 len: 1316 microversion: 2.1 time: 0.310999 May 28 04:49:10.588015 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1769/3630] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:10 2022] GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:10.858444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3f7c6a50-10d9-4632-b6e2-aec61c998a40 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:10.859323 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3f7c6a50-10d9-4632-b6e2-aec61c998a40 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:10.874050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f7c6a50-10d9-4632-b6e2-aec61c998a40 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:10.874817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f7c6a50-10d9-4632-b6e2-aec61c998a40 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:10.875843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f7c6a50-10d9-4632-b6e2-aec61c998a40 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:10.876506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f7c6a50-10d9-4632-b6e2-aec61c998a40 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:11.035100 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-466e4830-4b1a-4cd0-9820-58cf58521c60 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "5c3dfefe-bc63-45f2-8340-c793a0cd7844"}], "security_groups": [{"name": "tempest-securitygroup--1405308642"}], "key_name": "tempest-keypair-1030427461", "user_data": "}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:11.143968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3f7c6a50-10d9-4632-b6e2-aec61c998a40 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:11.158283 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3f7c6a50-10d9-4632-b6e2-aec61c998a40 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 200 len: 1317 microversion: 2.1 time: 0.303382 May 28 04:49:11.159273 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1862/3631] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:10 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:11.167646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a49f9540-7555-4658-8253-f9cf2922f66e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:11.173179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a49f9540-7555-4658-8253-f9cf2922f66e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 09a578bc-f131-4126-8426-6e97ab6178ba] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:11.182965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a49f9540-7555-4658-8253-f9cf2922f66e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:11.183443 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a49f9540-7555-4658-8253-f9cf2922f66e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:11.184225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a49f9540-7555-4658-8253-f9cf2922f66e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:11.184668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a49f9540-7555-4658-8253-f9cf2922f66e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:11.239292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-466e4830-4b1a-4cd0-9820-58cf58521c60 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] validate_networks() for [('5c3dfefe-bc63-45f2-8340-c793a0cd7844', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:49:11.277247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a49f9540-7555-4658-8253-f9cf2922f66e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:11.287993 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a49f9540-7555-4658-8253-f9cf2922f66e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba" status: 200 len: 1197 microversion: 2.1 time: 0.124993 May 28 04:49:11.289189 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1863/3632] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:11 2022] GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba => generated 1197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:11.294025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-5115b08a-45eb-4ce0-b3f5-ed0b51669118 req-b2b8c5c3-5be9-49dc-a607-279bd32a70df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d88814f-f669-4de5-8886-9065023b6e9c", "tag": "c4ce9d3f-8889-4d3b-81c8-52f1f73cd237"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:11.304346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5115b08a-45eb-4ce0-b3f5-ed0b51669118 req-b2b8c5c3-5be9-49dc-a607-279bd32a70df service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:11.304794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5115b08a-45eb-4ce0-b3f5-ed0b51669118 req-b2b8c5c3-5be9-49dc-a607-279bd32a70df service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:11.319415 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-5115b08a-45eb-4ce0-b3f5-ed0b51669118 req-b2b8c5c3-5be9-49dc-a607-279bd32a70df service nova] Creating event network-changed:c4ce9d3f-8889-4d3b-81c8-52f1f73cd237 for instance 8d88814f-f669-4de5-8886-9065023b6e9c on n-h1-843700-1 May 28 04:49:11.325087 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-5115b08a-45eb-4ce0-b3f5-ed0b51669118 req-b2b8c5c3-5be9-49dc-a607-279bd32a70df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034479 May 28 04:49:11.325903 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1864/3633] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:11.597702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7195ab20-6eb9-47d4-a8fe-93172a9c1978 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:11.598715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7195ab20-6eb9-47d4-a8fe-93172a9c1978 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:11.616928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7195ab20-6eb9-47d4-a8fe-93172a9c1978 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:11.617673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7195ab20-6eb9-47d4-a8fe-93172a9c1978 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:11.619781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7195ab20-6eb9-47d4-a8fe-93172a9c1978 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:11.621696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7195ab20-6eb9-47d4-a8fe-93172a9c1978 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:11.787640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-466e4830-4b1a-4cd0-9820-58cf58521c60 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:49:11.788093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-466e4830-4b1a-4cd0-9820-58cf58521c60 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:49:11.788663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-466e4830-4b1a-4cd0-9820-58cf58521c60 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:49:11.789155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-466e4830-4b1a-4cd0-9820-58cf58521c60 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:49:11.790168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-466e4830-4b1a-4cd0-9820-58cf58521c60 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:49:11.800049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-466e4830-4b1a-4cd0-9820-58cf58521c60 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:11.804441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-466e4830-4b1a-4cd0-9820-58cf58521c60 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:11.804441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-466e4830-4b1a-4cd0-9820-58cf58521c60 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:11.804441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-466e4830-4b1a-4cd0-9820-58cf58521c60 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:11.821823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-466e4830-4b1a-4cd0-9820-58cf58521c60 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Getting quotas for project 584749eada5c4f9281286bc6145c7b85. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:49:11.828183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-466e4830-4b1a-4cd0-9820-58cf58521c60 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Getting quotas for user f19a7c36dbc14147bd823c8e1681f8e3 and project 584749eada5c4f9281286bc6145c7b85. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:49:11.842431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-466e4830-4b1a-4cd0-9820-58cf58521c60 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:49:11.859917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-466e4830-4b1a-4cd0-9820-58cf58521c60 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:49:11.866670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7195ab20-6eb9-47d4-a8fe-93172a9c1978 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098ecff622ca4dcbb9207d847a8b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b09d6ee6aa4482b2b0f5f8deba5191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:11.880117 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7195ab20-6eb9-47d4-a8fe-93172a9c1978 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8" status: 200 len: 1316 microversion: 2.1 time: 0.289359 May 28 04:49:11.881287 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1865/3634] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:11 2022] GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 => generated 1316 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:12.133321 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-466e4830-4b1a-4cd0-9820-58cf58521c60 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.105029 May 28 04:49:12.139061 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1770/3635] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:49:11 2022] POST /compute/v2.1/servers => generated 409 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:49:12.153836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c0d15d14-c44f-4dc1-a41d-74fdcebee0ef tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:12.156763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c0d15d14-c44f-4dc1-a41d-74fdcebee0ef tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:12.176407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2245a40d-8a8a-4955-a3cc-e478ab288823 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:12.177208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2245a40d-8a8a-4955-a3cc-e478ab288823 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:12.189390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2245a40d-8a8a-4955-a3cc-e478ab288823 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:12.191258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2245a40d-8a8a-4955-a3cc-e478ab288823 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:12.192293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2245a40d-8a8a-4955-a3cc-e478ab288823 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:12.192959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2245a40d-8a8a-4955-a3cc-e478ab288823 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:12.257701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c0d15d14-c44f-4dc1-a41d-74fdcebee0ef tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19a7c36dbc14147bd823c8e1681f8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584749eada5c4f9281286bc6145c7b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:12.268643 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=29 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:12.270542 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c0d15d14-c44f-4dc1-a41d-74fdcebee0ef tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7" status: 200 len: 1226 microversion: 2.1 time: 0.124074 May 28 04:49:12.281867 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1866/3636] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:12 2022] GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7 => generated 1226 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:12.305117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8c13e2bb-e80b-4bfe-a6bf-091a208299a0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:12.305842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8c13e2bb-e80b-4bfe-a6bf-091a208299a0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 09a578bc-f131-4126-8426-6e97ab6178ba] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:12.315265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8c13e2bb-e80b-4bfe-a6bf-091a208299a0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:12.316139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8c13e2bb-e80b-4bfe-a6bf-091a208299a0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:12.319112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8c13e2bb-e80b-4bfe-a6bf-091a208299a0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:12.319858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8c13e2bb-e80b-4bfe-a6bf-091a208299a0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:12.418097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2245a40d-8a8a-4955-a3cc-e478ab288823 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:12.430580 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2245a40d-8a8a-4955-a3cc-e478ab288823 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 200 len: 1317 microversion: 2.1 time: 0.255917 May 28 04:49:12.445458 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1771/3637] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:12 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:12.465885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8c13e2bb-e80b-4bfe-a6bf-091a208299a0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:12.474376 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8c13e2bb-e80b-4bfe-a6bf-091a208299a0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba" status: 200 len: 1253 microversion: 2.1 time: 0.173341 May 28 04:49:12.474962 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1867/3638] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:12 2022] GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba => generated 1253 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:12.897752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dfbfe923-25c0-4440-b6ff-3a08c5fb5fbf tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:12.898764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dfbfe923-25c0-4440-b6ff-3a08c5fb5fbf tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:12.905940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfbfe923-25c0-4440-b6ff-3a08c5fb5fbf tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:12.907815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfbfe923-25c0-4440-b6ff-3a08c5fb5fbf tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:12.911875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfbfe923-25c0-4440-b6ff-3a08c5fb5fbf tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:12.912497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfbfe923-25c0-4440-b6ff-3a08c5fb5fbf tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:13.067369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dfbfe923-25c0-4440-b6ff-3a08c5fb5fbf tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098ecff622ca4dcbb9207d847a8b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b09d6ee6aa4482b2b0f5f8deba5191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:13.076081 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dfbfe923-25c0-4440-b6ff-3a08c5fb5fbf tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8" status: 200 len: 1316 microversion: 2.1 time: 0.182219 May 28 04:49:13.079176 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1772/3639] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:12 2022] GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:13.288579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2d992354-314e-403a-99f0-e92988fb2f11 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:13.289213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2d992354-314e-403a-99f0-e92988fb2f11 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:13.346333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2d992354-314e-403a-99f0-e92988fb2f11 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19a7c36dbc14147bd823c8e1681f8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584749eada5c4f9281286bc6145c7b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:13.353595 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2d992354-314e-403a-99f0-e92988fb2f11 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7" status: 200 len: 1226 microversion: 2.1 time: 0.069330 May 28 04:49:13.355217 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1868/3640] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:13 2022] GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7 => generated 1226 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:13.448793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1d929b6a-bb94-4752-9c6f-f337960bf023 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:13.449583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1d929b6a-bb94-4752-9c6f-f337960bf023 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:13.455896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d929b6a-bb94-4752-9c6f-f337960bf023 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:13.456486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d929b6a-bb94-4752-9c6f-f337960bf023 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:13.457342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d929b6a-bb94-4752-9c6f-f337960bf023 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:13.457940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d929b6a-bb94-4752-9c6f-f337960bf023 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:13.491958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-25129622-ef15-4f14-a488-c6e95602e215 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:13.492567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-25129622-ef15-4f14-a488-c6e95602e215 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 09a578bc-f131-4126-8426-6e97ab6178ba] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:13.505830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25129622-ef15-4f14-a488-c6e95602e215 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:13.506738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25129622-ef15-4f14-a488-c6e95602e215 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:13.508353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25129622-ef15-4f14-a488-c6e95602e215 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:13.509934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25129622-ef15-4f14-a488-c6e95602e215 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:13.708295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1d929b6a-bb94-4752-9c6f-f337960bf023 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:13.717851 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1d929b6a-bb94-4752-9c6f-f337960bf023 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 200 len: 1317 microversion: 2.1 time: 0.274575 May 28 04:49:13.718574 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1773/3641] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:13 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:13.732955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-25129622-ef15-4f14-a488-c6e95602e215 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:13.741463 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-25129622-ef15-4f14-a488-c6e95602e215 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba" status: 200 len: 1293 microversion: 2.1 time: 0.253841 May 28 04:49:13.742088 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1869/3642] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:13 2022] GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba => generated 1293 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:14.093764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a58bee95-8b62-46c3-bdb1-e71f711300c3 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:14.094884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a58bee95-8b62-46c3-bdb1-e71f711300c3 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:14.102584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a58bee95-8b62-46c3-bdb1-e71f711300c3 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:14.105581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a58bee95-8b62-46c3-bdb1-e71f711300c3 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:14.105581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a58bee95-8b62-46c3-bdb1-e71f711300c3 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:14.105581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a58bee95-8b62-46c3-bdb1-e71f711300c3 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:14.186764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-9fb5be61-a904-48b5-9006-0f68dee33cca req-bb0c020c-2b86-4275-91ff-8edef60ba069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09a578bc-f131-4126-8426-6e97ab6178ba", "tag": "3355de16-9985-4732-975a-4a210f1700b2"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:14.205658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-9fb5be61-a904-48b5-9006-0f68dee33cca req-bb0c020c-2b86-4275-91ff-8edef60ba069 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:14.207349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-9fb5be61-a904-48b5-9006-0f68dee33cca req-bb0c020c-2b86-4275-91ff-8edef60ba069 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:14.221350 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-9fb5be61-a904-48b5-9006-0f68dee33cca req-bb0c020c-2b86-4275-91ff-8edef60ba069 service nova] Creating event network-changed:3355de16-9985-4732-975a-4a210f1700b2 for instance 09a578bc-f131-4126-8426-6e97ab6178ba on n-h2-843700-1 May 28 04:49:14.226849 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-9fb5be61-a904-48b5-9006-0f68dee33cca req-bb0c020c-2b86-4275-91ff-8edef60ba069 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044769 May 28 04:49:14.228199 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1870/3643] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:14.333117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-5d937d68-aadf-4425-8f33-4ac9c181c9d7 req-da32f9db-c29f-49e1-aa28-d6e2a83a7cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded807fc-f5a6-43d7-a853-6ce1896141e8", "name": "network-vif-plugged", "status": "completed", "tag": "a64e0abb-754b-456d-9850-1f579d035510"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:14.333702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a58bee95-8b62-46c3-bdb1-e71f711300c3 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098ecff622ca4dcbb9207d847a8b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b09d6ee6aa4482b2b0f5f8deba5191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:14.343024 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a58bee95-8b62-46c3-bdb1-e71f711300c3 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8" status: 200 len: 1316 microversion: 2.1 time: 0.253077 May 28 04:49:14.349460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5d937d68-aadf-4425-8f33-4ac9c181c9d7 req-da32f9db-c29f-49e1-aa28-d6e2a83a7cc1 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:14.349918 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5d937d68-aadf-4425-8f33-4ac9c181c9d7 req-da32f9db-c29f-49e1-aa28-d6e2a83a7cc1 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:14.364513 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-5d937d68-aadf-4425-8f33-4ac9c181c9d7 req-da32f9db-c29f-49e1-aa28-d6e2a83a7cc1 service nova] Creating event network-vif-plugged:a64e0abb-754b-456d-9850-1f579d035510 for instance ded807fc-f5a6-43d7-a853-6ce1896141e8 on n-h2-843700-1 May 28 04:49:14.365259 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1774/3644] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:14 2022] GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 => generated 1316 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:14.371456 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-5d937d68-aadf-4425-8f33-4ac9c181c9d7 req-da32f9db-c29f-49e1-aa28-d6e2a83a7cc1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041973 May 28 04:49:14.372083 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1871/3645] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:14.373229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ed759705-2ded-4d91-ac0e-199342ee5a62 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:14.374022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ed759705-2ded-4d91-ac0e-199342ee5a62 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:14.387622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ed759705-2ded-4d91-ac0e-199342ee5a62 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:14.394360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ed759705-2ded-4d91-ac0e-199342ee5a62 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:14.394360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ed759705-2ded-4d91-ac0e-199342ee5a62 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:14.394360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ed759705-2ded-4d91-ac0e-199342ee5a62 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:14.471183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ed759705-2ded-4d91-ac0e-199342ee5a62 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19a7c36dbc14147bd823c8e1681f8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584749eada5c4f9281286bc6145c7b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:14.480542 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ed759705-2ded-4d91-ac0e-199342ee5a62 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7" status: 200 len: 1278 microversion: 2.1 time: 0.113766 May 28 04:49:14.483143 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1775/3646] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:14 2022] GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7 => generated 1278 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:14.736686 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-36743455-57b1-4361-bd96-0b8e61de3dbb tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:14.738101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-36743455-57b1-4361-bd96-0b8e61de3dbb tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:14.747352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36743455-57b1-4361-bd96-0b8e61de3dbb tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:14.747871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36743455-57b1-4361-bd96-0b8e61de3dbb tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:14.748836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36743455-57b1-4361-bd96-0b8e61de3dbb tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:14.749789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36743455-57b1-4361-bd96-0b8e61de3dbb tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:14.759305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3c100331-a491-491b-942e-f24bf9e91d51 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:14.759922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3c100331-a491-491b-942e-f24bf9e91d51 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 09a578bc-f131-4126-8426-6e97ab6178ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:14.767238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c100331-a491-491b-942e-f24bf9e91d51 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:14.768389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c100331-a491-491b-942e-f24bf9e91d51 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:14.769284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c100331-a491-491b-942e-f24bf9e91d51 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:14.769725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c100331-a491-491b-942e-f24bf9e91d51 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:14.976008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-36743455-57b1-4361-bd96-0b8e61de3dbb tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:14.985045 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-36743455-57b1-4361-bd96-0b8e61de3dbb tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 200 len: 1317 microversion: 2.1 time: 0.252964 May 28 04:49:14.985898 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1872/3647] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:14 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:15.001150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3c100331-a491-491b-942e-f24bf9e91d51 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:15.012917 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3c100331-a491-491b-942e-f24bf9e91d51 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba" status: 200 len: 1293 microversion: 2.1 time: 0.258354 May 28 04:49:15.013604 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1776/3648] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:14 2022] GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba => generated 1293 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:15.361212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8b057fc7-cc9f-4203-8de6-c8321fd98503 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:15.362451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8b057fc7-cc9f-4203-8de6-c8321fd98503 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:15.369689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b057fc7-cc9f-4203-8de6-c8321fd98503 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:15.370338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b057fc7-cc9f-4203-8de6-c8321fd98503 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:15.371334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b057fc7-cc9f-4203-8de6-c8321fd98503 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:15.371933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b057fc7-cc9f-4203-8de6-c8321fd98503 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:15.497611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6f2420c7-d5dc-4b0d-8733-ead2e897011f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:15.498415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6f2420c7-d5dc-4b0d-8733-ead2e897011f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:15.513575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f2420c7-d5dc-4b0d-8733-ead2e897011f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:15.516216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f2420c7-d5dc-4b0d-8733-ead2e897011f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:15.516216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f2420c7-d5dc-4b0d-8733-ead2e897011f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:15.516216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f2420c7-d5dc-4b0d-8733-ead2e897011f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:15.531765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8b057fc7-cc9f-4203-8de6-c8321fd98503 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098ecff622ca4dcbb9207d847a8b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b09d6ee6aa4482b2b0f5f8deba5191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:15.541155 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8b057fc7-cc9f-4203-8de6-c8321fd98503 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8" status: 200 len: 1316 microversion: 2.1 time: 0.183729 May 28 04:49:15.542065 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1873/3649] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:15 2022] GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 => generated 1316 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:15.604950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6f2420c7-d5dc-4b0d-8733-ead2e897011f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19a7c36dbc14147bd823c8e1681f8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584749eada5c4f9281286bc6145c7b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:15.613188 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6f2420c7-d5dc-4b0d-8733-ead2e897011f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7" status: 200 len: 1284 microversion: 2.1 time: 0.119399 May 28 04:49:15.623358 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1777/3650] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:15 2022] GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7 => generated 1284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:16.002371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a42d0c8a-d0f5-4de3-be96-5828f25301e7 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:16.002572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a42d0c8a-d0f5-4de3-be96-5828f25301e7 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:16.004891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:16.019141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a42d0c8a-d0f5-4de3-be96-5828f25301e7 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:16.019642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a42d0c8a-d0f5-4de3-be96-5828f25301e7 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:16.021106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a42d0c8a-d0f5-4de3-be96-5828f25301e7 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:16.023018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a42d0c8a-d0f5-4de3-be96-5828f25301e7 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:16.029655 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c8cf6ff4-51ef-45e2-b6d1-5c1eb0e85dcd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:16.030659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c8cf6ff4-51ef-45e2-b6d1-5c1eb0e85dcd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 09a578bc-f131-4126-8426-6e97ab6178ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:16.037636 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c8cf6ff4-51ef-45e2-b6d1-5c1eb0e85dcd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:16.038346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c8cf6ff4-51ef-45e2-b6d1-5c1eb0e85dcd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:16.040105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c8cf6ff4-51ef-45e2-b6d1-5c1eb0e85dcd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:16.040788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c8cf6ff4-51ef-45e2-b6d1-5c1eb0e85dcd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:16.293887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a42d0c8a-d0f5-4de3-be96-5828f25301e7 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:16.310178 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a42d0c8a-d0f5-4de3-be96-5828f25301e7 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 200 len: 1317 microversion: 2.1 time: 0.312289 May 28 04:49:16.311404 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1874/3651] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:15 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:16.314591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c8cf6ff4-51ef-45e2-b6d1-5c1eb0e85dcd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:16.335792 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c8cf6ff4-51ef-45e2-b6d1-5c1eb0e85dcd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba" status: 200 len: 1293 microversion: 2.1 time: 0.300527 May 28 04:49:16.335792 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1778/3652] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:16 2022] GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba => generated 1293 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:16.558490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b35b7be6-41e6-4fd5-b362-1393f2d23677 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:16.559777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b35b7be6-41e6-4fd5-b362-1393f2d23677 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:16.568609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b35b7be6-41e6-4fd5-b362-1393f2d23677 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:16.579237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b35b7be6-41e6-4fd5-b362-1393f2d23677 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:16.580616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b35b7be6-41e6-4fd5-b362-1393f2d23677 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:16.581172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b35b7be6-41e6-4fd5-b362-1393f2d23677 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:16.631713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e87d99cf-e08a-45b7-8ef2-921efe2062aa tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:16.633073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e87d99cf-e08a-45b7-8ef2-921efe2062aa tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:16.646857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e87d99cf-e08a-45b7-8ef2-921efe2062aa tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:16.647361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e87d99cf-e08a-45b7-8ef2-921efe2062aa tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:16.648286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e87d99cf-e08a-45b7-8ef2-921efe2062aa tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:16.648729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e87d99cf-e08a-45b7-8ef2-921efe2062aa tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:16.878227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b35b7be6-41e6-4fd5-b362-1393f2d23677 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098ecff622ca4dcbb9207d847a8b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b09d6ee6aa4482b2b0f5f8deba5191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:16.888501 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b35b7be6-41e6-4fd5-b362-1393f2d23677 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8" status: 200 len: 1466 microversion: 2.1 time: 0.334501 May 28 04:49:16.900515 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1875/3653] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:16 2022] GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 => generated 1466 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:16.907818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f6c8906d-b882-4734-9bc5-7824df8946ca tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:16.908582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f6c8906d-b882-4734-9bc5-7824df8946ca tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:16.916793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6c8906d-b882-4734-9bc5-7824df8946ca tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:16.917511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6c8906d-b882-4734-9bc5-7824df8946ca tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:16.918465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6c8906d-b882-4734-9bc5-7824df8946ca tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:16.919501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6c8906d-b882-4734-9bc5-7824df8946ca tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:16.957699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f6c8906d-b882-4734-9bc5-7824df8946ca tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:49:17.015732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:17.021578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e87d99cf-e08a-45b7-8ef2-921efe2062aa tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19a7c36dbc14147bd823c8e1681f8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584749eada5c4f9281286bc6145c7b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:17.032328 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e87d99cf-e08a-45b7-8ef2-921efe2062aa tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7" status: 200 len: 1352 microversion: 2.1 time: 0.404748 May 28 04:49:17.033868 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1779/3654] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:16 2022] GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7 => generated 1352 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:17.328025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-02ef4253-38d3-4846-898d-333fdfd39889 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:17.328638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-02ef4253-38d3-4846-898d-333fdfd39889 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:17.342044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02ef4253-38d3-4846-898d-333fdfd39889 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:17.343913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02ef4253-38d3-4846-898d-333fdfd39889 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:17.343913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02ef4253-38d3-4846-898d-333fdfd39889 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:17.355526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02ef4253-38d3-4846-898d-333fdfd39889 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:17.405867 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f6c8906d-b882-4734-9bc5-7824df8946ca tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8" status: 204 len: 0 microversion: 2.1 time: 0.501842 May 28 04:49:17.406962 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1876/3655] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:49:16 2022] DELETE /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:49:17.414672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c82007dc-3b6b-459e-8f9e-072a469d9e23 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:17.415560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c82007dc-3b6b-459e-8f9e-072a469d9e23 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 09a578bc-f131-4126-8426-6e97ab6178ba] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:17.425229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c82007dc-3b6b-459e-8f9e-072a469d9e23 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:17.425229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c82007dc-3b6b-459e-8f9e-072a469d9e23 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:17.425229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c82007dc-3b6b-459e-8f9e-072a469d9e23 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:17.425229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c82007dc-3b6b-459e-8f9e-072a469d9e23 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:17.569124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-02ef4253-38d3-4846-898d-333fdfd39889 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:17.580917 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-02ef4253-38d3-4846-898d-333fdfd39889 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 200 len: 1317 microversion: 2.1 time: 0.256835 May 28 04:49:17.581517 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1780/3656] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:17 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:17.594142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-9bf94024-9683-44f5-a2c7-39a41132c47d req-38869812-a04d-4687-b49f-4ab9863ff95f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab9b09ff-7dc9-42e7-878b-fdc6906445c7", "tag": "3ce87754-f8f4-4b4b-ba77-4a7108a51a9c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:17.611426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9bf94024-9683-44f5-a2c7-39a41132c47d req-38869812-a04d-4687-b49f-4ab9863ff95f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:17.611885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9bf94024-9683-44f5-a2c7-39a41132c47d req-38869812-a04d-4687-b49f-4ab9863ff95f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:17.629496 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-9bf94024-9683-44f5-a2c7-39a41132c47d req-38869812-a04d-4687-b49f-4ab9863ff95f service nova] Creating event network-changed:3ce87754-f8f4-4b4b-ba77-4a7108a51a9c for instance ab9b09ff-7dc9-42e7-878b-fdc6906445c7 on n-h1-843700-1 May 28 04:49:17.639987 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-9bf94024-9683-44f5-a2c7-39a41132c47d req-38869812-a04d-4687-b49f-4ab9863ff95f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054030 May 28 04:49:17.639987 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1781/3657] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:17.645980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ce18cef1-3162-4600-a1c8-6564d94ec06d tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:17.646700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ce18cef1-3162-4600-a1c8-6564d94ec06d tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:17.646832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c82007dc-3b6b-459e-8f9e-072a469d9e23 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:17.657913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:17.662847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce18cef1-3162-4600-a1c8-6564d94ec06d tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:17.663480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce18cef1-3162-4600-a1c8-6564d94ec06d tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:17.664954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce18cef1-3162-4600-a1c8-6564d94ec06d tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:17.666449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce18cef1-3162-4600-a1c8-6564d94ec06d tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:17.669474 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c82007dc-3b6b-459e-8f9e-072a469d9e23 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba" status: 200 len: 1293 microversion: 2.1 time: 0.258207 May 28 04:49:17.673425 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1877/3658] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:17 2022] GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba => generated 1293 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:17.700141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-5c3d74a6-1fd3-4666-9faf-99418007a324 req-10e53d03-f8e6-4a2e-bb8e-22f71503b093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d88814f-f669-4de5-8886-9065023b6e9c", "name": "network-vif-plugged", "status": "completed", "tag": "c4ce9d3f-8889-4d3b-81c8-52f1f73cd237"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:17.724014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5c3d74a6-1fd3-4666-9faf-99418007a324 req-10e53d03-f8e6-4a2e-bb8e-22f71503b093 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:17.724486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5c3d74a6-1fd3-4666-9faf-99418007a324 req-10e53d03-f8e6-4a2e-bb8e-22f71503b093 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:17.751070 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-5c3d74a6-1fd3-4666-9faf-99418007a324 req-10e53d03-f8e6-4a2e-bb8e-22f71503b093 service nova] Creating event network-vif-plugged:c4ce9d3f-8889-4d3b-81c8-52f1f73cd237 for instance 8d88814f-f669-4de5-8886-9065023b6e9c on n-h1-843700-1 May 28 04:49:17.756874 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-5c3d74a6-1fd3-4666-9faf-99418007a324 req-10e53d03-f8e6-4a2e-bb8e-22f71503b093 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061351 May 28 04:49:17.757708 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1878/3659] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:49:17.900147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ce18cef1-3162-4600-a1c8-6564d94ec06d tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098ecff622ca4dcbb9207d847a8b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b09d6ee6aa4482b2b0f5f8deba5191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:17.913871 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ce18cef1-3162-4600-a1c8-6564d94ec06d tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8" status: 200 len: 1472 microversion: 2.1 time: 0.272825 May 28 04:49:17.914605 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1782/3660] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:17 2022] GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 => generated 1472 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:18.050002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8ce03024-78d7-4abe-a79f-0d4c84980c09 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:18.050953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8ce03024-78d7-4abe-a79f-0d4c84980c09 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:18.057892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ce03024-78d7-4abe-a79f-0d4c84980c09 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:18.058354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ce03024-78d7-4abe-a79f-0d4c84980c09 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:18.059168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ce03024-78d7-4abe-a79f-0d4c84980c09 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:18.059657 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ce03024-78d7-4abe-a79f-0d4c84980c09 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:18.197532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8ce03024-78d7-4abe-a79f-0d4c84980c09 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19a7c36dbc14147bd823c8e1681f8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584749eada5c4f9281286bc6145c7b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:18.205496 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8ce03024-78d7-4abe-a79f-0d4c84980c09 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7" status: 200 len: 1352 microversion: 2.1 time: 0.159402 May 28 04:49:18.206814 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1879/3661] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:18 2022] GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7 => generated 1352 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:18.597839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-23a887a1-df5a-4d1e-9bce-246cee729f94 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:18.598464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-23a887a1-df5a-4d1e-9bce-246cee729f94 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:18.605737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23a887a1-df5a-4d1e-9bce-246cee729f94 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:18.606197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23a887a1-df5a-4d1e-9bce-246cee729f94 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:18.606968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23a887a1-df5a-4d1e-9bce-246cee729f94 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:18.607438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23a887a1-df5a-4d1e-9bce-246cee729f94 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:18.685684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2d653ccf-b23b-430f-98e0-593e17c468a2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:18.686656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2d653ccf-b23b-430f-98e0-593e17c468a2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 09a578bc-f131-4126-8426-6e97ab6178ba] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:18.688291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:18.694203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d653ccf-b23b-430f-98e0-593e17c468a2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:18.694657 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d653ccf-b23b-430f-98e0-593e17c468a2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:18.695463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d653ccf-b23b-430f-98e0-593e17c468a2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:18.696162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d653ccf-b23b-430f-98e0-593e17c468a2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:18.752770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-23a887a1-df5a-4d1e-9bce-246cee729f94 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:18.768484 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-23a887a1-df5a-4d1e-9bce-246cee729f94 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 200 len: 1317 microversion: 2.1 time: 0.174568 May 28 04:49:18.783529 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1783/3662] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:18 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:18.847012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2d653ccf-b23b-430f-98e0-593e17c468a2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:18.855128 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2d653ccf-b23b-430f-98e0-593e17c468a2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba" status: 200 len: 1293 microversion: 2.1 time: 0.173375 May 28 04:49:18.855752 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1880/3663] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:18 2022] GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba => generated 1293 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:18.932087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eecb62d3-5a22-422a-b216-37636c1bbcdb tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:18.933567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eecb62d3-5a22-422a-b216-37636c1bbcdb tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:18.939366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eecb62d3-5a22-422a-b216-37636c1bbcdb tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:18.939959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eecb62d3-5a22-422a-b216-37636c1bbcdb tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:18.940742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eecb62d3-5a22-422a-b216-37636c1bbcdb tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:18.941187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eecb62d3-5a22-422a-b216-37636c1bbcdb tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:19.084565 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eecb62d3-5a22-422a-b216-37636c1bbcdb tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098ecff622ca4dcbb9207d847a8b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b09d6ee6aa4482b2b0f5f8deba5191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:19.088687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:19.093263 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eecb62d3-5a22-422a-b216-37636c1bbcdb tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8" status: 200 len: 1472 microversion: 2.1 time: 0.165326 May 28 04:49:19.093787 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1784/3664] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:18 2022] GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 => generated 1472 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:19.223464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-22514f30-6664-4896-8234-16e95115145f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:19.224111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-22514f30-6664-4896-8234-16e95115145f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:19.231942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22514f30-6664-4896-8234-16e95115145f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:19.232379 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22514f30-6664-4896-8234-16e95115145f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:19.233155 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22514f30-6664-4896-8234-16e95115145f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:19.233594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22514f30-6664-4896-8234-16e95115145f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:19.417447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-22514f30-6664-4896-8234-16e95115145f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19a7c36dbc14147bd823c8e1681f8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584749eada5c4f9281286bc6145c7b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:19.425381 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-22514f30-6664-4896-8234-16e95115145f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7" status: 200 len: 1352 microversion: 2.1 time: 0.205722 May 28 04:49:19.425978 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1881/3665] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:19 2022] GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7 => generated 1352 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:19.663895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-d3f56ea6-19e8-4daa-bf65-d712735cb4d3 req-ca5a74e6-294a-4301-adc2-a1e6b123347a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded807fc-f5a6-43d7-a853-6ce1896141e8", "name": "network-vif-deleted", "tag": "a64e0abb-754b-456d-9850-1f579d035510"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:19.674753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d3f56ea6-19e8-4daa-bf65-d712735cb4d3 req-ca5a74e6-294a-4301-adc2-a1e6b123347a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:19.675232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d3f56ea6-19e8-4daa-bf65-d712735cb4d3 req-ca5a74e6-294a-4301-adc2-a1e6b123347a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:19.687333 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-d3f56ea6-19e8-4daa-bf65-d712735cb4d3 req-ca5a74e6-294a-4301-adc2-a1e6b123347a service nova] Creating event network-vif-deleted:a64e0abb-754b-456d-9850-1f579d035510 for instance ded807fc-f5a6-43d7-a853-6ce1896141e8 on n-h2-843700-1 May 28 04:49:19.692751 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-d3f56ea6-19e8-4daa-bf65-d712735cb4d3 req-ca5a74e6-294a-4301-adc2-a1e6b123347a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034325 May 28 04:49:19.693395 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1785/3666] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:19.790744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7534d6a9-d0c8-498a-8617-7ceb6fac647b tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:19.791811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7534d6a9-d0c8-498a-8617-7ceb6fac647b tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:19.799615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7534d6a9-d0c8-498a-8617-7ceb6fac647b tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:19.802667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7534d6a9-d0c8-498a-8617-7ceb6fac647b tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:19.802667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7534d6a9-d0c8-498a-8617-7ceb6fac647b tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:19.802667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7534d6a9-d0c8-498a-8617-7ceb6fac647b tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:19.873257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-57c5605a-d79e-4968-8bf0-0471c32ced12 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:19.873882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-57c5605a-d79e-4968-8bf0-0471c32ced12 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 09a578bc-f131-4126-8426-6e97ab6178ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:19.885251 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-57c5605a-d79e-4968-8bf0-0471c32ced12 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:19.886023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-57c5605a-d79e-4968-8bf0-0471c32ced12 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:19.892711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-57c5605a-d79e-4968-8bf0-0471c32ced12 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:19.892711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-57c5605a-d79e-4968-8bf0-0471c32ced12 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:19.991196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7534d6a9-d0c8-498a-8617-7ceb6fac647b tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:20.004149 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7534d6a9-d0c8-498a-8617-7ceb6fac647b tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 200 len: 1317 microversion: 2.1 time: 0.217484 May 28 04:49:20.005743 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1882/3667] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:19 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:20.109662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9f847c05-c8f6-49ee-96c7-0c81ae31eb54 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:20.110491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9f847c05-c8f6-49ee-96c7-0c81ae31eb54 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:20.119015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f847c05-c8f6-49ee-96c7-0c81ae31eb54 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:20.119783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f847c05-c8f6-49ee-96c7-0c81ae31eb54 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:20.121020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f847c05-c8f6-49ee-96c7-0c81ae31eb54 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:20.121668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f847c05-c8f6-49ee-96c7-0c81ae31eb54 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:20.125451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-57c5605a-d79e-4968-8bf0-0471c32ced12 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:20.134000 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-57c5605a-d79e-4968-8bf0-0471c32ced12 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba" status: 200 len: 1293 microversion: 2.1 time: 0.264727 May 28 04:49:20.135638 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1786/3668] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:19 2022] GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba => generated 1293 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:20.173619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f847c05-c8f6-49ee-96c7-0c81ae31eb54 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:20.176690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f847c05-c8f6-49ee-96c7-0c81ae31eb54 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:20.177772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-9f847c05-c8f6-49ee-96c7-0c81ae31eb54 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lazy-loading 'fault' on Instance uuid ded807fc-f5a6-43d7-a853-6ce1896141e8 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:49:20.231076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9f847c05-c8f6-49ee-96c7-0c81ae31eb54 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098ecff622ca4dcbb9207d847a8b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b09d6ee6aa4482b2b0f5f8deba5191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:20.241954 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9f847c05-c8f6-49ee-96c7-0c81ae31eb54 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8" status: 200 len: 1306 microversion: 2.1 time: 0.135822 May 28 04:49:20.243465 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1883/3669] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:20 2022] GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 => generated 1306 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:20.292003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-667278f7-b587-407b-961a-4c8ea0190bfa req-f3c4e017-2f34-4088-969d-86b99eefab1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a578bc-f131-4126-8426-6e97ab6178ba", "name": "network-vif-plugged", "status": "completed", "tag": "3355de16-9985-4732-975a-4a210f1700b2"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:20.305523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-667278f7-b587-407b-961a-4c8ea0190bfa req-f3c4e017-2f34-4088-969d-86b99eefab1a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:20.307463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-667278f7-b587-407b-961a-4c8ea0190bfa req-f3c4e017-2f34-4088-969d-86b99eefab1a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:20.332183 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-667278f7-b587-407b-961a-4c8ea0190bfa req-f3c4e017-2f34-4088-969d-86b99eefab1a service nova] Creating event network-vif-plugged:3355de16-9985-4732-975a-4a210f1700b2 for instance 09a578bc-f131-4126-8426-6e97ab6178ba on n-h2-843700-1 May 28 04:49:20.337488 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-667278f7-b587-407b-961a-4c8ea0190bfa req-f3c4e017-2f34-4088-969d-86b99eefab1a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049941 May 28 04:49:20.338477 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1787/3670] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:20.454832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9da4fa92-99d0-42a1-9d3f-b44a391554cc tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:20.455562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9da4fa92-99d0-42a1-9d3f-b44a391554cc tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:20.463580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9da4fa92-99d0-42a1-9d3f-b44a391554cc tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:20.464038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9da4fa92-99d0-42a1-9d3f-b44a391554cc tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:20.464817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9da4fa92-99d0-42a1-9d3f-b44a391554cc tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:20.465260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9da4fa92-99d0-42a1-9d3f-b44a391554cc tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:20.642735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9da4fa92-99d0-42a1-9d3f-b44a391554cc tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19a7c36dbc14147bd823c8e1681f8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584749eada5c4f9281286bc6145c7b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:20.642735 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9da4fa92-99d0-42a1-9d3f-b44a391554cc tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7" status: 200 len: 1352 microversion: 2.1 time: 0.183506 May 28 04:49:20.642735 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1884/3671] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:20 2022] GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7 => generated 1352 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:20.808956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5a1931e7-636a-4e08-adae-77493221293b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:20.808956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5a1931e7-636a-4e08-adae-77493221293b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:20.809628 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a1931e7-636a-4e08-adae-77493221293b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:20.810083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a1931e7-636a-4e08-adae-77493221293b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:20.810848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a1931e7-636a-4e08-adae-77493221293b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:20.811319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a1931e7-636a-4e08-adae-77493221293b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:20.836554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5a1931e7-636a-4e08-adae-77493221293b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:49:21.024526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-45616323-5b12-4192-9958-688fc7969592 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:21.025280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-45616323-5b12-4192-9958-688fc7969592 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:21.040988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45616323-5b12-4192-9958-688fc7969592 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.041538 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45616323-5b12-4192-9958-688fc7969592 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.042404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45616323-5b12-4192-9958-688fc7969592 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.043117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45616323-5b12-4192-9958-688fc7969592 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.144306 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5a1931e7-636a-4e08-adae-77493221293b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 204 len: 0 microversion: 2.42 time: 0.346545 May 28 04:49:21.151176 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1788/3672] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:49:20 2022] DELETE /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:49:21.152927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eecd8436-4287-4eb9-aa84-2d4a4966743a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:21.153835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eecd8436-4287-4eb9-aa84-2d4a4966743a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 09a578bc-f131-4126-8426-6e97ab6178ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:21.163574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eecd8436-4287-4eb9-aa84-2d4a4966743a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.164032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eecd8436-4287-4eb9-aa84-2d4a4966743a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.165345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eecd8436-4287-4eb9-aa84-2d4a4966743a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.165785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eecd8436-4287-4eb9-aa84-2d4a4966743a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.197719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-45616323-5b12-4192-9958-688fc7969592 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:21.205647 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-45616323-5b12-4192-9958-688fc7969592 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 200 len: 1506 microversion: 2.1 time: 0.186910 May 28 04:49:21.206679 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1885/3673] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:21 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:21.213925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ca95e032-47ce-43cb-a470-91987a0004bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:21.213925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ca95e032-47ce-43cb-a470-91987a0004bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:21.218933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca95e032-47ce-43cb-a470-91987a0004bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.219696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca95e032-47ce-43cb-a470-91987a0004bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.220650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca95e032-47ce-43cb-a470-91987a0004bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.221275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca95e032-47ce-43cb-a470-91987a0004bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.403139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eecd8436-4287-4eb9-aa84-2d4a4966743a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:21.410278 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eecd8436-4287-4eb9-aa84-2d4a4966743a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba" status: 200 len: 1293 microversion: 2.1 time: 0.261792 May 28 04:49:21.411094 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1789/3674] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:21 2022] GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba => generated 1293 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:21.416748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d3d50522-938e-4d6d-a7d4-326ff7c01ae3 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:21.417490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d3d50522-938e-4d6d-a7d4-326ff7c01ae3 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:21.436721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3d50522-938e-4d6d-a7d4-326ff7c01ae3 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.442715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3d50522-938e-4d6d-a7d4-326ff7c01ae3 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.442715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3d50522-938e-4d6d-a7d4-326ff7c01ae3 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.442715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3d50522-938e-4d6d-a7d4-326ff7c01ae3 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.449511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ca95e032-47ce-43cb-a470-91987a0004bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:21.460448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ca95e032-47ce-43cb-a470-91987a0004bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:21.463343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ca95e032-47ce-43cb-a470-91987a0004bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:21.464800 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ca95e032-47ce-43cb-a470-91987a0004bd tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 2953 microversion: 2.42 time: 0.257070 May 28 04:49:21.471268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d3d50522-938e-4d6d-a7d4-326ff7c01ae3 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:21.479160 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d3d50522-938e-4d6d-a7d4-326ff7c01ae3 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c/os-instance-actions/req-2394d946-a3eb-41a2-ae15-506c163a41a0" status: 200 len: 313 microversion: 2.1 time: 0.060000 May 28 04:49:21.479160 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1790/3675] 10.222.0.58 () {58 vars in 1418 bytes} [Sat May 28 04:49:21 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c/os-instance-actions/req-2394d946-a3eb-41a2-ae15-506c163a41a0 => generated 313 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:21.479160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-77ae5477-73e7-4998-a2de-b43cbc5306ef tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:21.479420 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1886/3676] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:21 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 2953 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:21.479509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-77ae5477-73e7-4998-a2de-b43cbc5306ef tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:21.484987 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77ae5477-73e7-4998-a2de-b43cbc5306ef tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.485439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77ae5477-73e7-4998-a2de-b43cbc5306ef tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.486200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77ae5477-73e7-4998-a2de-b43cbc5306ef tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.486631 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77ae5477-73e7-4998-a2de-b43cbc5306ef tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.488463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e87b7d3e-6983-4de7-a089-e29888ffb405 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:21.489541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e87b7d3e-6983-4de7-a089-e29888ffb405 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:21.496286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e87b7d3e-6983-4de7-a089-e29888ffb405 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.497163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e87b7d3e-6983-4de7-a089-e29888ffb405 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.497953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e87b7d3e-6983-4de7-a089-e29888ffb405 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.498585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e87b7d3e-6983-4de7-a089-e29888ffb405 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.502350 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-77ae5477-73e7-4998-a2de-b43cbc5306ef tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] HTTP exception thrown: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-77ae5477-73e7-4998-a2de-b43cbc5306ef tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Request method failure captured: May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 HTTP/1.1 May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikam7m-Hgs-h_5mUjEgNYYbwNwJeOngs4RPw559Hr64wYc8XOwpHWbt8HIESoc9cY2TwPGCp8FqAmgDKwgMIG-iDQXmz4XsApQJmQ_LH-PgvB4zFzkw7B7gK7ciZGoR1yGvPAmArSy5s7zpqaeFa_HIpd2GxzvlzJsOiOxJlYHNXaG3Y May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 38b09d6ee6aa4482b2b0f5f8deba5191 May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 38b09d6ee6aa4482b2b0f5f8deba5191 May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesNegativeTestJSON-1972827638-project May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 098ecff622ca4dcbb9207d847a8b67ab May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesNegativeTestJSON-1972827638-project May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'ded807fc-f5a6-43d7-a853-6ce1896141e8'} May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:21.504688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.508985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.508985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:21.508985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:21.508985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:49:21.508985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:49:21.508985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. May 28 04:49:21.508985 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.508985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-77ae5477-73e7-4998-a2de-b43cbc5306ef tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Returning 404 to user: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:49:21.508985 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-77ae5477-73e7-4998-a2de-b43cbc5306ef tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8" status: 404 len: 111 microversion: 2.1 time: 0.032367 May 28 04:49:21.508985 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1791/3677] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:21 2022] GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:49:21.516821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-af9b163f-1613-40fb-83fd-7876dee6cc3a tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1072393781", "metadata": {"image_type": "test"}}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:21.518024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-af9b163f-1613-40fb-83fd-7876dee6cc3a tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:21.525554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af9b163f-1613-40fb-83fd-7876dee6cc3a tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.526237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af9b163f-1613-40fb-83fd-7876dee6cc3a tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.527027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af9b163f-1613-40fb-83fd-7876dee6cc3a tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.527469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af9b163f-1613-40fb-83fd-7876dee6cc3a tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.542445 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-af9b163f-1613-40fb-83fd-7876dee6cc3a tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] HTTP exception thrown: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-af9b163f-1613-40fb-83fd-7876dee6cc3a tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Request method failure captured: May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8/action HTTP/1.1 May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 112 May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikam7m-Hgs-h_5mUjEgNYYbwNwJeOngs4RPw559Hr64wYc8XOwpHWbt8HIESoc9cY2TwPGCp8FqAmgDKwgMIG-iDQXmz4XsApQJmQ_LH-PgvB4zFzkw7B7gK7ciZGoR1yGvPAmArSy5s7zpqaeFa_HIpd2GxzvlzJsOiOxJlYHNXaG3Y May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 38b09d6ee6aa4482b2b0f5f8deba5191 May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 38b09d6ee6aa4482b2b0f5f8deba5191 May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesNegativeTestJSON-1972827638-project May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 098ecff622ca4dcbb9207d847a8b67ab May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesNegativeTestJSON-1972827638-project May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1072393781", "metadata": {"image_type": "test"}}} May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'ded807fc-f5a6-43d7-a853-6ce1896141e8', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1072393781', 'metadata': {'image_type': 'test'}}}} May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 28 04:49:21.551230 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:49:21.556409 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:49:21.556409 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:49:21.556409 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:49:21.556409 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. May 28 04:49:21.556409 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.556409 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:21.556409 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.556409 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.556409 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:21.556409 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:21.556409 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:49:21.556409 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:49:21.556409 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. May 28 04:49:21.556409 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.556409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-af9b163f-1613-40fb-83fd-7876dee6cc3a tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Returning 404 to user: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:49:21.556409 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-af9b163f-1613-40fb-83fd-7876dee6cc3a tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "POST /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8/action" status: 404 len: 111 microversion: 2.1 time: 0.033731 May 28 04:49:21.556409 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1792/3678] 10.222.0.58 () {60 vars in 1278 bytes} [Sat May 28 04:49:21 2022] POST /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:49:21.564239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2dfc679d-d1de-4630-a897-41d1761048d9 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1776554040", "metadata": {"image_type": "test"}}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:21.566211 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2dfc679d-d1de-4630-a897-41d1761048d9 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Failed to fetch instance by id tempest-invalid-344029569 {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2926}} May 28 04:49:21.566211 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-2dfc679d-d1de-4630-a897-41d1761048d9 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] HTTP exception thrown: Instance tempest-invalid-344029569 could not be found. May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2dfc679d-d1de-4630-a897-41d1761048d9 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Request method failure captured: May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/tempest-invalid-344029569/action HTTP/1.1 May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 112 May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikam7m-Hgs-h_5mUjEgNYYbwNwJeOngs4RPw559Hr64wYc8XOwpHWbt8HIESoc9cY2TwPGCp8FqAmgDKwgMIG-iDQXmz4XsApQJmQ_LH-PgvB4zFzkw7B7gK7ciZGoR1yGvPAmArSy5s7zpqaeFa_HIpd2GxzvlzJsOiOxJlYHNXaG3Y May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 38b09d6ee6aa4482b2b0f5f8deba5191 May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 38b09d6ee6aa4482b2b0f5f8deba5191 May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesNegativeTestJSON-1972827638-project May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 098ecff622ca4dcbb9207d847a8b67ab May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesNegativeTestJSON-1972827638-project May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1776554040", "metadata": {"image_type": "test"}}} May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance tempest-invalid-344029569 could not be found. May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'tempest-invalid-344029569', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1776554040', 'metadata': {'image_type': 'test'}}}} May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-344029569 could not be found. May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:49:21.567421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-344029569 could not be found. May 28 04:49:21.579469 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.579469 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:21.579469 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.579469 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.579469 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:21.579469 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:21.579469 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:49:21.579469 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:49:21.579469 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-344029569 could not be found. May 28 04:49:21.579469 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.579469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2dfc679d-d1de-4630-a897-41d1761048d9 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Returning 404 to user: Instance tempest-invalid-344029569 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:49:21.579469 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2dfc679d-d1de-4630-a897-41d1761048d9 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "POST /compute/v2.1/servers/tempest-invalid-344029569/action" status: 404 len: 100 microversion: 2.1 time: 0.008843 May 28 04:49:21.579469 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1793/3679] 10.222.0.58 () {60 vars in 1245 bytes} [Sat May 28 04:49:21 2022] POST /compute/v2.1/servers/tempest-invalid-344029569/action => generated 100 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:49:21.579469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-01782a25-c069-4a6f-bb9e-8aae4e942a30 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1396146450"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:21.579469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-01782a25-c069-4a6f-bb9e-8aae4e942a30 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2926}} May 28 04:49:21.581266 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-01782a25-c069-4a6f-bb9e-8aae4e942a30 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-01782a25-c069-4a6f-bb9e-8aae4e942a30 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Request method failure captured: May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 57 May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikam7m-Hgs-h_5mUjEgNYYbwNwJeOngs4RPw559Hr64wYc8XOwpHWbt8HIESoc9cY2TwPGCp8FqAmgDKwgMIG-iDQXmz4XsApQJmQ_LH-PgvB4zFzkw7B7gK7ciZGoR1yGvPAmArSy5s7zpqaeFa_HIpd2GxzvlzJsOiOxJlYHNXaG3Y May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 38b09d6ee6aa4482b2b0f5f8deba5191 May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 38b09d6ee6aa4482b2b0f5f8deba5191 May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesNegativeTestJSON-1972827638-project May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 098ecff622ca4dcbb9207d847a8b67ab May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesNegativeTestJSON-1972827638-project May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: {"createImage": {"name": "tempest-test-snap-1396146450"}} May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1396146450'}}} May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 28 04:49:21.581381 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.586096 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:21.586096 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.586096 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.586096 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:21.586096 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:21.586096 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:49:21.586096 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:49:21.586096 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 28 04:49:21.586096 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.586096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-01782a25-c069-4a6f-bb9e-8aae4e942a30 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:49:21.586096 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-01782a25-c069-4a6f-bb9e-8aae4e942a30 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.007941 May 28 04:49:21.586096 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1794/3680] 10.222.0.58 () {60 vars in 1274 bytes} [Sat May 28 04:49:21 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:49:21.592770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5d814030-1576-460e-a6d7-17ff898d128e tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1049929957"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:21.593781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5d814030-1576-460e-a6d7-17ff898d128e tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2926}} May 28 04:49:21.594276 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-5d814030-1576-460e-a6d7-17ff898d128e tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5d814030-1576-460e-a6d7-17ff898d128e tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Request method failure captured: May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 57 May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikam7m-Hgs-h_5mUjEgNYYbwNwJeOngs4RPw559Hr64wYc8XOwpHWbt8HIESoc9cY2TwPGCp8FqAmgDKwgMIG-iDQXmz4XsApQJmQ_LH-PgvB4zFzkw7B7gK7ciZGoR1yGvPAmArSy5s7zpqaeFa_HIpd2GxzvlzJsOiOxJlYHNXaG3Y May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 38b09d6ee6aa4482b2b0f5f8deba5191 May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 38b09d6ee6aa4482b2b0f5f8deba5191 May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesNegativeTestJSON-1972827638-project May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 098ecff622ca4dcbb9207d847a8b67ab May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesNegativeTestJSON-1972827638-project May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: {"createImage": {"name": "tempest-test-snap-1049929957"}} May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1049929957'}}} May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 28 04:49:21.595802 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.609306 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:21.609306 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.609306 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.609306 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:21.609306 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:21.609306 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:49:21.609306 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:49:21.609306 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 28 04:49:21.609306 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.609306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5d814030-1576-460e-a6d7-17ff898d128e tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:49:21.609306 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5d814030-1576-460e-a6d7-17ff898d128e tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.008126 May 28 04:49:21.609306 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1795/3681] 10.222.0.58 () {60 vars in 1280 bytes} [Sat May 28 04:49:21 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:49:21.609306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-11e9334d-74c0-4cf0-8927-c11c09e66912 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:21.609306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-11e9334d-74c0-4cf0-8927-c11c09e66912 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:21.614093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11e9334d-74c0-4cf0-8927-c11c09e66912 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.614541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11e9334d-74c0-4cf0-8927-c11c09e66912 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.615324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11e9334d-74c0-4cf0-8927-c11c09e66912 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.615759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11e9334d-74c0-4cf0-8927-c11c09e66912 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.629745 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-11e9334d-74c0-4cf0-8927-c11c09e66912 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] HTTP exception thrown: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-11e9334d-74c0-4cf0-8927-c11c09e66912 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Request method failure captured: May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 HTTP/1.1 May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikam7m-Hgs-h_5mUjEgNYYbwNwJeOngs4RPw559Hr64wYc8XOwpHWbt8HIESoc9cY2TwPGCp8FqAmgDKwgMIG-iDQXmz4XsApQJmQ_LH-PgvB4zFzkw7B7gK7ciZGoR1yGvPAmArSy5s7zpqaeFa_HIpd2GxzvlzJsOiOxJlYHNXaG3Y May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 38b09d6ee6aa4482b2b0f5f8deba5191 May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 38b09d6ee6aa4482b2b0f5f8deba5191 May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesNegativeTestJSON-1972827638-project May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 098ecff622ca4dcbb9207d847a8b67ab May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesNegativeTestJSON-1972827638-project May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'ded807fc-f5a6-43d7-a853-6ce1896141e8'} May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:49:21.631480 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:49:21.643319 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. May 28 04:49:21.643319 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.643319 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:21.643319 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.643319 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.643319 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:21.643319 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:21.643319 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:49:21.643319 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:49:21.643319 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. May 28 04:49:21.643319 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.643319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-11e9334d-74c0-4cf0-8927-c11c09e66912 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Returning 404 to user: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:49:21.643319 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-11e9334d-74c0-4cf0-8927-c11c09e66912 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8" status: 404 len: 111 microversion: 2.1 time: 0.030070 May 28 04:49:21.643319 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1796/3682] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:49:21 2022] DELETE /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:49:21.643319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-98f7defa-22ce-457d-bec7-a2c60b004093 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:21.643319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-98f7defa-22ce-457d-bec7-a2c60b004093 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] [instance: ded807fc-f5a6-43d7-a853-6ce1896141e8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:21.648081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98f7defa-22ce-457d-bec7-a2c60b004093 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.649168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98f7defa-22ce-457d-bec7-a2c60b004093 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.650022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98f7defa-22ce-457d-bec7-a2c60b004093 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.650670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98f7defa-22ce-457d-bec7-a2c60b004093 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.670789 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-98f7defa-22ce-457d-bec7-a2c60b004093 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] HTTP exception thrown: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-98f7defa-22ce-457d-bec7-a2c60b004093 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Request method failure captured: May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 HTTP/1.1 May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikam7m-Hgs-h_5mUjEgNYYbwNwJeOngs4RPw559Hr64wYc8XOwpHWbt8HIESoc9cY2TwPGCp8FqAmgDKwgMIG-iDQXmz4XsApQJmQ_LH-PgvB4zFzkw7B7gK7ciZGoR1yGvPAmArSy5s7zpqaeFa_HIpd2GxzvlzJsOiOxJlYHNXaG3Y May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 38b09d6ee6aa4482b2b0f5f8deba5191 May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/38b09d6ee6aa4482b2b0f5f8deba5191"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 38b09d6ee6aa4482b2b0f5f8deba5191 May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1972827638 May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ImagesNegativeTestJSON-1972827638-project May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 098ecff622ca4dcbb9207d847a8b67ab May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ImagesNegativeTestJSON-1972827638-project May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'ded807fc-f5a6-43d7-a853-6ce1896141e8'} May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:21.672379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.686859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:21.686859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:21.686859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:21.686859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:49:21.686859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:49:21.686859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. May 28 04:49:21.686859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:21.686859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-98f7defa-22ce-457d-bec7-a2c60b004093 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] Returning 404 to user: Instance ded807fc-f5a6-43d7-a853-6ce1896141e8 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:49:21.686859 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-98f7defa-22ce-457d-bec7-a2c60b004093 tempest-ImagesNegativeTestJSON-1972827638 tempest-ImagesNegativeTestJSON-1972827638-project] 10.222.0.58 "GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8" status: 404 len: 111 microversion: 2.1 time: 0.036278 May 28 04:49:21.686859 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1797/3683] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:21 2022] GET /compute/v2.1/servers/ded807fc-f5a6-43d7-a853-6ce1896141e8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:49:21.686859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2c34a584-bbfb-4760-b42f-a29bbc1744f2 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:21.686859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2c34a584-bbfb-4760-b42f-a29bbc1744f2 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:21.694360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c34a584-bbfb-4760-b42f-a29bbc1744f2 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.694827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c34a584-bbfb-4760-b42f-a29bbc1744f2 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.696226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c34a584-bbfb-4760-b42f-a29bbc1744f2 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.696680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c34a584-bbfb-4760-b42f-a29bbc1744f2 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.812120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:21.838869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=47 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:21.845510 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e87b7d3e-6983-4de7-a089-e29888ffb405 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "POST /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c/action" status: 202 len: 0 microversion: 2.1 time: 0.361854 May 28 04:49:21.846608 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1887/3684] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:49:21 2022] POST /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:49:21.860727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b3ab721e-c9de-44f2-857d-36aad127c6fa tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:21.864416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2c34a584-bbfb-4760-b42f-a29bbc1744f2 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19a7c36dbc14147bd823c8e1681f8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584749eada5c4f9281286bc6145c7b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:21.867884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b3ab721e-c9de-44f2-857d-36aad127c6fa tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:21.873042 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2c34a584-bbfb-4760-b42f-a29bbc1744f2 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7" status: 200 len: 1352 microversion: 2.1 time: 0.197690 May 28 04:49:21.874163 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1798/3685] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:21 2022] GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7 => generated 1352 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:21.884906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b3ab721e-c9de-44f2-857d-36aad127c6fa tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.886796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b3ab721e-c9de-44f2-857d-36aad127c6fa tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:21.887636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b3ab721e-c9de-44f2-857d-36aad127c6fa tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:21.888080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b3ab721e-c9de-44f2-857d-36aad127c6fa tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:22.031024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b3ab721e-c9de-44f2-857d-36aad127c6fa tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:22.041419 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b3ab721e-c9de-44f2-857d-36aad127c6fa tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 200 len: 1508 microversion: 2.1 time: 0.190455 May 28 04:49:22.045618 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1888/3686] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:21 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:22.428128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-840dd2a6-6b9c-4ea8-91e5-3dca6095989d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:22.429416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-840dd2a6-6b9c-4ea8-91e5-3dca6095989d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 09a578bc-f131-4126-8426-6e97ab6178ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:22.438855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-840dd2a6-6b9c-4ea8-91e5-3dca6095989d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:22.439437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-840dd2a6-6b9c-4ea8-91e5-3dca6095989d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:22.440455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-840dd2a6-6b9c-4ea8-91e5-3dca6095989d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:22.441171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-840dd2a6-6b9c-4ea8-91e5-3dca6095989d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:22.485867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1de8ae81-a9f6-41cf-8291-aa8aec56de97 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:22.486800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1de8ae81-a9f6-41cf-8291-aa8aec56de97 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:22.493683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1de8ae81-a9f6-41cf-8291-aa8aec56de97 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:22.494605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1de8ae81-a9f6-41cf-8291-aa8aec56de97 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:22.495606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1de8ae81-a9f6-41cf-8291-aa8aec56de97 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:22.496200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1de8ae81-a9f6-41cf-8291-aa8aec56de97 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:22.700788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-840dd2a6-6b9c-4ea8-91e5-3dca6095989d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:22.708664 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-840dd2a6-6b9c-4ea8-91e5-3dca6095989d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba" status: 200 len: 1473 microversion: 2.1 time: 0.284518 May 28 04:49:22.709241 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1799/3687] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:22 2022] GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba => generated 1473 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:22.738335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1de8ae81-a9f6-41cf-8291-aa8aec56de97 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:22.749389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1de8ae81-a9f6-41cf-8291-aa8aec56de97 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:22.750899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1de8ae81-a9f6-41cf-8291-aa8aec56de97 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:22.752226 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1de8ae81-a9f6-41cf-8291-aa8aec56de97 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 2953 microversion: 2.42 time: 0.270972 May 28 04:49:22.752807 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1889/3688] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:22 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 2953 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:49:22.869082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dd0d54d3-bc42-45c4-8577-976a4a069027 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1017921633", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:22.892894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a0366511-fc4f-4a83-96c2-0956f330bdd6 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:22.893509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a0366511-fc4f-4a83-96c2-0956f330bdd6 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:22.900712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0366511-fc4f-4a83-96c2-0956f330bdd6 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:22.901426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0366511-fc4f-4a83-96c2-0956f330bdd6 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:22.902749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0366511-fc4f-4a83-96c2-0956f330bdd6 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:22.903258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0366511-fc4f-4a83-96c2-0956f330bdd6 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:22.933628 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-dd0d54d3-bc42-45c4-8577-976a4a069027 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] validate_networks() for [('fd0d7eb0-eb78-443c-941c-e203b5533601', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:49:23.147132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a0366511-fc4f-4a83-96c2-0956f330bdd6 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19a7c36dbc14147bd823c8e1681f8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584749eada5c4f9281286bc6145c7b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:23.156792 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a0366511-fc4f-4a83-96c2-0956f330bdd6 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7" status: 200 len: 1352 microversion: 2.1 time: 0.270257 May 28 04:49:23.167031 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1890/3689] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:22 2022] GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7 => generated 1352 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:23.172255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-36322d12-06e7-48df-a885-0865512b19d9 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:23.173106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-36322d12-06e7-48df-a885-0865512b19d9 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:23.181144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36322d12-06e7-48df-a885-0865512b19d9 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:23.183046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36322d12-06e7-48df-a885-0865512b19d9 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:23.183046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36322d12-06e7-48df-a885-0865512b19d9 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:23.183046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36322d12-06e7-48df-a885-0865512b19d9 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:23.202781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:23.353240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:23.416850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-36322d12-06e7-48df-a885-0865512b19d9 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:23.423290 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-36322d12-06e7-48df-a885-0865512b19d9 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 200 len: 1508 microversion: 2.1 time: 0.254711 May 28 04:49:23.423876 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1891/3690] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:23 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:23.500450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-dd0d54d3-bc42-45c4-8577-976a4a069027 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:49:23.501044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-dd0d54d3-bc42-45c4-8577-976a4a069027 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:49:23.501503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-dd0d54d3-bc42-45c4-8577-976a4a069027 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:49:23.502103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-dd0d54d3-bc42-45c4-8577-976a4a069027 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:49:23.502620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-dd0d54d3-bc42-45c4-8577-976a4a069027 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:49:23.514382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd0d54d3-bc42-45c4-8577-976a4a069027 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:23.514847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd0d54d3-bc42-45c4-8577-976a4a069027 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:23.515697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd0d54d3-bc42-45c4-8577-976a4a069027 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:23.516213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd0d54d3-bc42-45c4-8577-976a4a069027 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:23.534749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-dd0d54d3-bc42-45c4-8577-976a4a069027 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Getting quotas for project 724a5513bc2c42eabbefa450e207453e. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:49:23.544577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-dd0d54d3-bc42-45c4-8577-976a4a069027 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Getting quotas for user 71b6b3ac5a4249fd8f76fb2e7e2b6c18 and project 724a5513bc2c42eabbefa450e207453e. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:49:23.568964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dd0d54d3-bc42-45c4-8577-976a4a069027 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:49:23.572170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dd0d54d3-bc42-45c4-8577-976a4a069027 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 2cba10b0-cc7c-4961-b56a-70f0eccf0333] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:49:23.644197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-d198fa33-dc32-4f36-b35a-f3d84da7d866 req-1b65f1bb-8987-4528-96aa-9c3cd2094f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab9b09ff-7dc9-42e7-878b-fdc6906445c7", "name": "network-vif-plugged", "status": "completed", "tag": "3ce87754-f8f4-4b4b-ba77-4a7108a51a9c"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:23.654840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d198fa33-dc32-4f36-b35a-f3d84da7d866 req-1b65f1bb-8987-4528-96aa-9c3cd2094f70 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:23.655339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d198fa33-dc32-4f36-b35a-f3d84da7d866 req-1b65f1bb-8987-4528-96aa-9c3cd2094f70 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:23.673255 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-d198fa33-dc32-4f36-b35a-f3d84da7d866 req-1b65f1bb-8987-4528-96aa-9c3cd2094f70 service nova] Creating event network-vif-plugged:3ce87754-f8f4-4b4b-ba77-4a7108a51a9c for instance ab9b09ff-7dc9-42e7-878b-fdc6906445c7 on n-h1-843700-1 May 28 04:49:23.678373 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-d198fa33-dc32-4f36-b35a-f3d84da7d866 req-1b65f1bb-8987-4528-96aa-9c3cd2094f70 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037936 May 28 04:49:23.679731 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1892/3691] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:23.728441 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dd0d54d3-bc42-45c4-8577-976a4a069027 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.864052 May 28 04:49:23.734081 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1800/3692] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:49:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:49:23.741401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8269f546-7e53-4d20-896c-e9fd7d6a7e86 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:23.742338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8269f546-7e53-4d20-896c-e9fd7d6a7e86 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 2cba10b0-cc7c-4961-b56a-70f0eccf0333] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:23.776534 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-54481023-facb-4022-a8a8-8e43c922756f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:23.778311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-54481023-facb-4022-a8a8-8e43c922756f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:23.803846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8269f546-7e53-4d20-896c-e9fd7d6a7e86 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 2cba10b0-cc7c-4961-b56a-70f0eccf0333] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:49:23.804673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54481023-facb-4022-a8a8-8e43c922756f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:23.808214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54481023-facb-4022-a8a8-8e43c922756f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:23.813157 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54481023-facb-4022-a8a8-8e43c922756f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:23.814652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54481023-facb-4022-a8a8-8e43c922756f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:24.080165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-54481023-facb-4022-a8a8-8e43c922756f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:24.094719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-54481023-facb-4022-a8a8-8e43c922756f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:24.097363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-54481023-facb-4022-a8a8-8e43c922756f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:24.105216 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-54481023-facb-4022-a8a8-8e43c922756f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 2953 microversion: 2.42 time: 0.334332 May 28 04:49:24.112149 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1801/3693] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:23 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 2953 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:24.173578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d12f1e6e-3cd3-4ab3-85f1-a7bc9c0c451f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:24.175975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d12f1e6e-3cd3-4ab3-85f1-a7bc9c0c451f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:24.183092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d12f1e6e-3cd3-4ab3-85f1-a7bc9c0c451f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:24.183792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d12f1e6e-3cd3-4ab3-85f1-a7bc9c0c451f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:24.184746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d12f1e6e-3cd3-4ab3-85f1-a7bc9c0c451f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:24.185345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d12f1e6e-3cd3-4ab3-85f1-a7bc9c0c451f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:24.403852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d12f1e6e-3cd3-4ab3-85f1-a7bc9c0c451f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19a7c36dbc14147bd823c8e1681f8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584749eada5c4f9281286bc6145c7b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:24.411556 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d12f1e6e-3cd3-4ab3-85f1-a7bc9c0c451f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7" status: 200 len: 1352 microversion: 2.1 time: 0.241804 May 28 04:49:24.412130 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1802/3694] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:24 2022] GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7 => generated 1352 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:24.450103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f10a1dce-f156-48cf-aed7-35121e074694 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:24.450103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f10a1dce-f156-48cf-aed7-35121e074694 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:24.455681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f10a1dce-f156-48cf-aed7-35121e074694 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:24.456403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f10a1dce-f156-48cf-aed7-35121e074694 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:24.457390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f10a1dce-f156-48cf-aed7-35121e074694 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:24.457996 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f10a1dce-f156-48cf-aed7-35121e074694 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:24.510878 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.scheduler.client.report [None req-8269f546-7e53-4d20-896c-e9fd7d6a7e86 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Deleted allocations for instance 2cba10b0-cc7c-4961-b56a-70f0eccf0333 May 28 04:49:24.517059 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.compute.api [None req-8269f546-7e53-4d20-896c-e9fd7d6a7e86 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 2cba10b0-cc7c-4961-b56a-70f0eccf0333] Instance Mapping does not exist while attempting local delete cleanup. May 28 04:49:24.517993 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8269f546-7e53-4d20-896c-e9fd7d6a7e86 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2cba10b0-cc7c-4961-b56a-70f0eccf0333" status: 204 len: 0 microversion: 2.1 time: 0.781171 May 28 04:49:24.518594 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1893/3695] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:49:23 2022] DELETE /compute/v2.1/servers/2cba10b0-cc7c-4961-b56a-70f0eccf0333 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:49:24.531440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a67fe3d7-7923-40ef-b5d8-dc9a033ccd17 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:24.532365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a67fe3d7-7923-40ef-b5d8-dc9a033ccd17 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 2cba10b0-cc7c-4961-b56a-70f0eccf0333] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:24.543773 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-a67fe3d7-7923-40ef-b5d8-dc9a033ccd17 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance 2cba10b0-cc7c-4961-b56a-70f0eccf0333 could not be found. May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a67fe3d7-7923-40ef-b5d8-dc9a033ccd17 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/2cba10b0-cc7c-4961-b56a-70f0eccf0333 HTTP/1.1 May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 2cba10b0-cc7c-4961-b56a-70f0eccf0333 could not be found. May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '2cba10b0-cc7c-4961-b56a-70f0eccf0333'} May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cba10b0-cc7c-4961-b56a-70f0eccf0333 could not be found. May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cba10b0-cc7c-4961-b56a-70f0eccf0333 could not be found. May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:24.545639 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:24.549659 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:49:24.549659 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:49:24.549659 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cba10b0-cc7c-4961-b56a-70f0eccf0333 could not be found. May 28 04:49:24.549659 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:49:24.551419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a67fe3d7-7923-40ef-b5d8-dc9a033ccd17 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance 2cba10b0-cc7c-4961-b56a-70f0eccf0333 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:49:24.552507 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a67fe3d7-7923-40ef-b5d8-dc9a033ccd17 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/2cba10b0-cc7c-4961-b56a-70f0eccf0333" status: 404 len: 111 microversion: 2.1 time: 0.026997 May 28 04:49:24.553284 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1894/3696] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:24 2022] GET /compute/v2.1/servers/2cba10b0-cc7c-4961-b56a-70f0eccf0333 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:49:24.665043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-726d8b5c-2010-4d79-a6bc-e259fc932eb8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1123475556", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "fd0d7eb0-eb78-443c-941c-e203b5533601"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:24.725069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-726d8b5c-2010-4d79-a6bc-e259fc932eb8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] validate_networks() for [('fd0d7eb0-eb78-443c-941c-e203b5533601', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:49:25.148260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f10a1dce-f156-48cf-aed7-35121e074694 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:25.156200 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f10a1dce-f156-48cf-aed7-35121e074694 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 200 len: 1508 microversion: 2.1 time: 0.715039 May 28 04:49:25.165912 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1803/3697] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:24 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 1508 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:25.171125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6d7c8680-8662-4607-86f4-083328ddd7b1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:25.184428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6d7c8680-8662-4607-86f4-083328ddd7b1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:25.184428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6d7c8680-8662-4607-86f4-083328ddd7b1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:25.184428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6d7c8680-8662-4607-86f4-083328ddd7b1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:25.184428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6d7c8680-8662-4607-86f4-083328ddd7b1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:25.184428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6d7c8680-8662-4607-86f4-083328ddd7b1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:25.635873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6d7c8680-8662-4607-86f4-083328ddd7b1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:25.645397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6d7c8680-8662-4607-86f4-083328ddd7b1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:25.647081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6d7c8680-8662-4607-86f4-083328ddd7b1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:25.648334 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6d7c8680-8662-4607-86f4-083328ddd7b1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 2953 microversion: 2.42 time: 0.481217 May 28 04:49:25.648937 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1804/3698] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:25 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 2953 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:25.666474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6b304b7d-0642-4a4d-8434-dd304a070c7d tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:25.667125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6b304b7d-0642-4a4d-8434-dd304a070c7d tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:25.678226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b304b7d-0642-4a4d-8434-dd304a070c7d tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:25.678226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b304b7d-0642-4a4d-8434-dd304a070c7d tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:25.678226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b304b7d-0642-4a4d-8434-dd304a070c7d tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:25.678226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b304b7d-0642-4a4d-8434-dd304a070c7d tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:25.862823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-726d8b5c-2010-4d79-a6bc-e259fc932eb8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:49:25.864085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-726d8b5c-2010-4d79-a6bc-e259fc932eb8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:49:25.865153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-726d8b5c-2010-4d79-a6bc-e259fc932eb8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:49:25.865787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-726d8b5c-2010-4d79-a6bc-e259fc932eb8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:49:25.866613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-726d8b5c-2010-4d79-a6bc-e259fc932eb8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:49:25.880972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-726d8b5c-2010-4d79-a6bc-e259fc932eb8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:25.881966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-726d8b5c-2010-4d79-a6bc-e259fc932eb8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:25.884226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-726d8b5c-2010-4d79-a6bc-e259fc932eb8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:25.884965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-726d8b5c-2010-4d79-a6bc-e259fc932eb8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:25.922465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-726d8b5c-2010-4d79-a6bc-e259fc932eb8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Getting quotas for project 724a5513bc2c42eabbefa450e207453e. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:49:25.932798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-726d8b5c-2010-4d79-a6bc-e259fc932eb8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Getting quotas for user 71b6b3ac5a4249fd8f76fb2e7e2b6c18 and project 724a5513bc2c42eabbefa450e207453e. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:49:25.950369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-726d8b5c-2010-4d79-a6bc-e259fc932eb8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:49:25.953849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-726d8b5c-2010-4d79-a6bc-e259fc932eb8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:49:25.966570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6b304b7d-0642-4a4d-8434-dd304a070c7d tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19a7c36dbc14147bd823c8e1681f8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584749eada5c4f9281286bc6145c7b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:25.978796 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6b304b7d-0642-4a4d-8434-dd304a070c7d tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7" status: 200 len: 1352 microversion: 2.1 time: 0.316083 May 28 04:49:25.981150 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1805/3699] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:25 2022] GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7 => generated 1352 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:26.091284 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-726d8b5c-2010-4d79-a6bc-e259fc932eb8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.431147 May 28 04:49:26.101978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a3b96e6e-e40c-47f9-8fb3-cb660b3a3886 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:26.102597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a3b96e6e-e40c-47f9-8fb3-cb660b3a3886 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:26.105515 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1895/3700] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:49:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 04:49:26.177154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5f4b27d2-06c7-4d2a-a387-7ead4d4a74d7 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:26.178680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5f4b27d2-06c7-4d2a-a387-7ead4d4a74d7 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:26.190421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f4b27d2-06c7-4d2a-a387-7ead4d4a74d7 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:26.191155 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f4b27d2-06c7-4d2a-a387-7ead4d4a74d7 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:26.192186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f4b27d2-06c7-4d2a-a387-7ead4d4a74d7 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:26.193006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f4b27d2-06c7-4d2a-a387-7ead4d4a74d7 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:26.231108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a3b96e6e-e40c-47f9-8fb3-cb660b3a3886 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:26.238556 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a3b96e6e-e40c-47f9-8fb3-cb660b3a3886 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 200 len: 1221 microversion: 2.1 time: 0.140551 May 28 04:49:26.239149 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1806/3701] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:26 2022] GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 1221 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:26.466344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5f4b27d2-06c7-4d2a-a387-7ead4d4a74d7 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:26.474700 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5f4b27d2-06c7-4d2a-a387-7ead4d4a74d7 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 200 len: 1506 microversion: 2.1 time: 0.304015 May 28 04:49:26.479565 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1896/3702] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:26 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:26.494733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0ebfd094-4509-40a8-bd8f-624625b32ef0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '.version_select at 0x7f770098f790>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:26.503238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0ebfd094-4509-40a8-bd8f-624625b32ef0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:26.511864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ebfd094-4509-40a8-bd8f-624625b32ef0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:26.512328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ebfd094-4509-40a8-bd8f-624625b32ef0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:26.513148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ebfd094-4509-40a8-bd8f-624625b32ef0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:26.513742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ebfd094-4509-40a8-bd8f-624625b32ef0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:26.546505 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0ebfd094-4509-40a8-bd8f-624625b32ef0 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.058911 May 28 04:49:26.547128 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1807/3703] 10.222.0.58 () {58 vars in 1295 bytes} [Sat May 28 04:49:26 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c/os-instance-actions => generated 611 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:26.559312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4d123d49-3d71-4677-85cb-7ee8a61d6bf4 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:26.559936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4d123d49-3d71-4677-85cb-7ee8a61d6bf4 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:26.566580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d123d49-3d71-4677-85cb-7ee8a61d6bf4 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:26.567169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d123d49-3d71-4677-85cb-7ee8a61d6bf4 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:26.568031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d123d49-3d71-4677-85cb-7ee8a61d6bf4 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:26.568692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d123d49-3d71-4677-85cb-7ee8a61d6bf4 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:26.613104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4d123d49-3d71-4677-85cb-7ee8a61d6bf4 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:49:26.669955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c3cb6746-7cda-4e34-8da5-49b9c891de0f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:26.671691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c3cb6746-7cda-4e34-8da5-49b9c891de0f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:26.680924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3cb6746-7cda-4e34-8da5-49b9c891de0f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:26.684849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3cb6746-7cda-4e34-8da5-49b9c891de0f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:26.684849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3cb6746-7cda-4e34-8da5-49b9c891de0f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:26.684849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3cb6746-7cda-4e34-8da5-49b9c891de0f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:26.746680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:27.076121 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4d123d49-3d71-4677-85cb-7ee8a61d6bf4 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 204 len: 0 microversion: 2.1 time: 0.521330 May 28 04:49:27.076795 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1897/3704] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:49:26 2022] DELETE /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:49:27.087062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0ac73604-e650-4c39-a53d-6ff9e791d067 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:27.089322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0ac73604-e650-4c39-a53d-6ff9e791d067 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:27.119464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ac73604-e650-4c39-a53d-6ff9e791d067 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:27.128520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ac73604-e650-4c39-a53d-6ff9e791d067 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:27.130492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ac73604-e650-4c39-a53d-6ff9e791d067 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:27.130950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ac73604-e650-4c39-a53d-6ff9e791d067 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:27.189966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c3cb6746-7cda-4e34-8da5-49b9c891de0f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:27.199928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c3cb6746-7cda-4e34-8da5-49b9c891de0f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:27.201691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c3cb6746-7cda-4e34-8da5-49b9c891de0f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:27.203212 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c3cb6746-7cda-4e34-8da5-49b9c891de0f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 2932 microversion: 2.42 time: 0.537791 May 28 04:49:27.216344 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1808/3705] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:26 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 2932 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:49:27.231080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-560f9dbd-2be3-4b79-8334-ff482a93ca90 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:27.231775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-560f9dbd-2be3-4b79-8334-ff482a93ca90 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:27.246256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-560f9dbd-2be3-4b79-8334-ff482a93ca90 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:27.246794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-560f9dbd-2be3-4b79-8334-ff482a93ca90 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:27.247649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-560f9dbd-2be3-4b79-8334-ff482a93ca90 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:27.248472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-560f9dbd-2be3-4b79-8334-ff482a93ca90 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:27.394574 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0ac73604-e650-4c39-a53d-6ff9e791d067 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19a7c36dbc14147bd823c8e1681f8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584749eada5c4f9281286bc6145c7b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:27.405560 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0ac73604-e650-4c39-a53d-6ff9e791d067 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7" status: 200 len: 1542 microversion: 2.1 time: 0.326453 May 28 04:49:27.407462 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1898/3706] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:27 2022] GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7 => generated 1542 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:27.643897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3df35df6-3d48-44b8-a78d-21d6e5286418 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] Calling method '.version_select at 0x7f770129d310>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:27.668223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-560f9dbd-2be3-4b79-8334-ff482a93ca90 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:27.684033 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-560f9dbd-2be3-4b79-8334-ff482a93ca90 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 200 len: 1512 microversion: 2.1 time: 0.466082 May 28 04:49:27.686757 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1809/3707] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:27 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 1512 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:27.690972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG neutronclient.v2_0.client [None req-3df35df6-3d48-44b8-a78d-21d6e5286418 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 49b01eb8-9b84-420a-8511-92cee8b6fa52 does not exist", "detail": ""}} {{(pid=126044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:49:27.690972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.security_group_api [None req-3df35df6-3d48-44b8-a78d-21d6e5286418 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] Neutron security group 49b01eb8-9b84-420a-8511-92cee8b6fa52 not found {{(pid=126044) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 04:49:27.690972 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-3df35df6-3d48-44b8-a78d-21d6e5286418 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] HTTP exception thrown: Security group 49b01eb8-9b84-420a-8511-92cee8b6fa52 does not exist May 28 04:49:27.690972 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-504cc697-65ae-4b0e-882c-b643f054ec7b'] May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3df35df6-3d48-44b8-a78d-21d6e5286418 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] Request method failure captured: May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/os-security-groups/49b01eb8-9b84-420a-8511-92cee8b6fa52 HTTP/1.1 May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanWeVrlvia8oe-Abcl5MSTeQEmLWAE5EcreoYgBbw9CQvbVaL8lj91pxHfVwoff-LKUcJLdkRfDSPYmALfie7ZKfFmnkiC-zxfCor7f8eZ9g4nh9E17z9vSQO57xBdbuk1jCowkPMiqwLVL1dRh4bWCD2nVEw_245qiAuBXtXpaFeE May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 168d660ee157451aa0a01c57fa2f0c8c May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-631217032 May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_168d660ee157451aa0a01c57fa2f0c8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/168d660ee157451aa0a01c57fa2f0c8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/168d660ee157451aa0a01c57fa2f0c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/168d660ee157451aa0a01c57fa2f0c8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-631217032 May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 168d660ee157451aa0a01c57fa2f0c8c May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-631217032 May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-SecurityGroupsNegativeTestJSON-631217032-project May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 855959ce18d54d36b20dbd93b389f5f6 May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-631217032-project May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: exception: Security group 49b01eb8-9b84-420a-8511-92cee8b6fa52 does not exist May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-504cc697-65ae-4b0e-882c-b643f054ec7b'] May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '49b01eb8-9b84-420a-8511-92cee8b6fa52'} May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:49:27.691490 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 49b01eb8-9b84-420a-8511-92cee8b6fa52 does not exist May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-504cc697-65ae-4b0e-882c-b643f054ec7b'] May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 49b01eb8-9b84-420a-8511-92cee8b6fa52 does not exist May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-504cc697-65ae-4b0e-882c-b643f054ec7b'] May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 49b01eb8-9b84-420a-8511-92cee8b6fa52 does not exist May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-504cc697-65ae-4b0e-882c-b643f054ec7b'] May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 49b01eb8-9b84-420a-8511-92cee8b6fa52 does not exist May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-504cc697-65ae-4b0e-882c-b643f054ec7b'] May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3df35df6-3d48-44b8-a78d-21d6e5286418 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] Returning 404 to user: Security group 49b01eb8-9b84-420a-8511-92cee8b6fa52 does not exist May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: Neutron server returns request_ids: ['req-504cc697-65ae-4b0e-882c-b643f054ec7b'] {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3df35df6-3d48-44b8-a78d-21d6e5286418 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/49b01eb8-9b84-420a-8511-92cee8b6fa52" status: 404 len: 194 microversion: 2.1 time: 0.285742 May 28 04:49:27.697617 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1899/3708] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:49:27 2022] DELETE /compute/v2.1/os-security-groups/49b01eb8-9b84-420a-8511-92cee8b6fa52 => generated 194 bytes in 287 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:49:27.705224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-374301b9-50a5-4c16-b49b-140ef55ba64f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:27.705729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-374301b9-50a5-4c16-b49b-140ef55ba64f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:27.707443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-06b62dd3-2739-4044-99e1-9fb02a1e5afd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:27.709999 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-06b62dd3-2739-4044-99e1-9fb02a1e5afd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:27.717775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-374301b9-50a5-4c16-b49b-140ef55ba64f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:27.717775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-374301b9-50a5-4c16-b49b-140ef55ba64f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:27.718146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-374301b9-50a5-4c16-b49b-140ef55ba64f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:27.718656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-374301b9-50a5-4c16-b49b-140ef55ba64f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:27.727792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06b62dd3-2739-4044-99e1-9fb02a1e5afd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:27.728424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06b62dd3-2739-4044-99e1-9fb02a1e5afd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:27.729331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06b62dd3-2739-4044-99e1-9fb02a1e5afd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:27.730338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06b62dd3-2739-4044-99e1-9fb02a1e5afd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:27.872723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-06b62dd3-2739-4044-99e1-9fb02a1e5afd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:27.892068 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-06b62dd3-2739-4044-99e1-9fb02a1e5afd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 200 len: 1225 microversion: 2.1 time: 0.202247 May 28 04:49:27.893336 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1810/3709] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:27 2022] GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 1225 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:27.896307 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-374301b9-50a5-4c16-b49b-140ef55ba64f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.198683 May 28 04:49:27.900600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-c4930383-f065-406e-acca-67cf937b93a4 req-91d8ede5-7597-417d-b63d-ab0d598c9394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "name": "network-vif-unplugged", "status": "completed", "tag": "50e6b87b-0119-4477-a5c5-db24e4c2100a"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:27.905742 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1900/3710] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 04:49:27 2022] GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7/os-interface => generated 284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:27.908290 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a18e4c15-f361-4a8b-aeba-439dbb873e66 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003765 May 28 04:49:27.913554 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1901/3711] 10.222.0.58 () {58 vars in 1163 bytes} [Sat May 28 04:49:27 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 28 04:49:27.919800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a16b2373-2368-43d9-a1d9-6681adf91751 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] Calling method '.version_select at 0x7f7700e8ce50>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:27.929645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c4930383-f065-406e-acca-67cf937b93a4 req-91d8ede5-7597-417d-b63d-ab0d598c9394 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:27.933543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c4930383-f065-406e-acca-67cf937b93a4 req-91d8ede5-7597-417d-b63d-ab0d598c9394 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:27.952257 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-c4930383-f065-406e-acca-67cf937b93a4 req-91d8ede5-7597-417d-b63d-ab0d598c9394 service nova] Creating event network-vif-unplugged:50e6b87b-0119-4477-a5c5-db24e4c2100a for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:49:27.958931 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-c4930383-f065-406e-acca-67cf937b93a4 req-91d8ede5-7597-417d-b63d-ab0d598c9394 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063796 May 28 04:49:27.963685 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1811/3712] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:28.158666 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a16b2373-2368-43d9-a1d9-6681adf91751 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.243237 May 28 04:49:28.159333 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1902/3713] 10.222.0.58 () {58 vars in 1157 bytes} [Sat May 28 04:49:27 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:28.173973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-535738ae-99e4-4277-b2dc-0a83dc4ee646 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] Calling method '.version_select at 0x7f77009974c0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:28.225973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ad5d73bd-e4a1-48bd-bc25-0876f4bd2379 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:28.226936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ad5d73bd-e4a1-48bd-bc25-0876f4bd2379 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:28.237935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad5d73bd-e4a1-48bd-bc25-0876f4bd2379 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:28.238670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad5d73bd-e4a1-48bd-bc25-0876f4bd2379 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:28.239688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad5d73bd-e4a1-48bd-bc25-0876f4bd2379 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:28.243775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad5d73bd-e4a1-48bd-bc25-0876f4bd2379 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:28.759459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ad5d73bd-e4a1-48bd-bc25-0876f4bd2379 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:28.774660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ad5d73bd-e4a1-48bd-bc25-0876f4bd2379 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:28.803840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ad5d73bd-e4a1-48bd-bc25-0876f4bd2379 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:28.805282 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ad5d73bd-e4a1-48bd-bc25-0876f4bd2379 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 2911 microversion: 2.42 time: 0.585651 May 28 04:49:28.818492 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1903/3714] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:28 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 2911 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:28.828748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-193a73bf-97bb-4005-9eee-0a22bc7287b5 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:28.829387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-193a73bf-97bb-4005-9eee-0a22bc7287b5 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:28.860394 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-193a73bf-97bb-4005-9eee-0a22bc7287b5 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:28.860975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-193a73bf-97bb-4005-9eee-0a22bc7287b5 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:28.862647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG neutronclient.v2_0.client [None req-535738ae-99e4-4277-b2dc-0a83dc4ee646 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=126043) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:49:28.863536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-193a73bf-97bb-4005-9eee-0a22bc7287b5 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:28.864002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-193a73bf-97bb-4005-9eee-0a22bc7287b5 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:28.864363 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-535738ae-99e4-4277-b2dc-0a83dc4ee646 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] HTTP exception thrown: Insufficient rights for removing default security group. May 28 04:49:28.864363 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-279d19f2-1883-4320-937e-ddb209db3680'] May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-535738ae-99e4-4277-b2dc-0a83dc4ee646 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] Request method failure captured: May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/os-security-groups/ca2d4518-4620-4a8d-8876-c5e60d90510e HTTP/1.1 May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikanWeVrlvia8oe-Abcl5MSTeQEmLWAE5EcreoYgBbw9CQvbVaL8lj91pxHfVwoff-LKUcJLdkRfDSPYmALfie7ZKfFmnkiC-zxfCor7f8eZ9g4nh9E17z9vSQO57xBdbuk1jCowkPMiqwLVL1dRh4bWCD2nVEw_245qiAuBXtXpaFeE May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 168d660ee157451aa0a01c57fa2f0c8c May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-631217032 May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_168d660ee157451aa0a01c57fa2f0c8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/168d660ee157451aa0a01c57fa2f0c8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/168d660ee157451aa0a01c57fa2f0c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/168d660ee157451aa0a01c57fa2f0c8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-631217032 May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 168d660ee157451aa0a01c57fa2f0c8c May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-631217032 May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-SecurityGroupsNegativeTestJSON-631217032-project May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 855959ce18d54d36b20dbd93b389f5f6 May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-631217032-project May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: exception: Insufficient rights for removing default security group. May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-279d19f2-1883-4320-937e-ddb209db3680'] May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'ca2d4518-4620-4a8d-8876-c5e60d90510e'} May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:49:28.866591 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-279d19f2-1883-4320-937e-ddb209db3680'] May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-279d19f2-1883-4320-937e-ddb209db3680'] May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-279d19f2-1883-4320-937e-ddb209db3680'] May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-279d19f2-1883-4320-937e-ddb209db3680'] May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-535738ae-99e4-4277-b2dc-0a83dc4ee646 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] Returning 400 to user: Insufficient rights for removing default security group. May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-279d19f2-1883-4320-937e-ddb209db3680'] {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-535738ae-99e4-4277-b2dc-0a83dc4ee646 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/ca2d4518-4620-4a8d-8876-c5e60d90510e" status: 400 len: 182 microversion: 2.1 time: 0.702091 May 28 04:49:28.876057 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1812/3715] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:49:28 2022] DELETE /compute/v2.1/os-security-groups/ca2d4518-4620-4a8d-8876-c5e60d90510e => generated 182 bytes in 704 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 04:49:28.890809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c377b49d-45f1-449e-8944-84ac0294d080 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] Calling method '.version_select at 0x7f7700928820>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:28.951707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG neutronclient.v2_0.client [None req-c377b49d-45f1-449e-8944-84ac0294d080 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 17b616e3-c767-491a-8eac-652d2125d0d6 does not exist", "detail": ""}} {{(pid=126043) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:49:28.952536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.security_group_api [None req-c377b49d-45f1-449e-8944-84ac0294d080 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] Neutron security group 17b616e3-c767-491a-8eac-652d2125d0d6 not found {{(pid=126043) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 04:49:28.953230 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-c377b49d-45f1-449e-8944-84ac0294d080 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] HTTP exception thrown: Security group 17b616e3-c767-491a-8eac-652d2125d0d6 does not exist May 28 04:49:28.953230 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-ddbcae9c-c46c-4a22-ba82-d1c269320227'] May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c377b49d-45f1-449e-8944-84ac0294d080 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] Request method failure captured: May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/os-security-groups/17b616e3-c767-491a-8eac-652d2125d0d6 HTTP/1.1 May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikanWeVrlvia8oe-Abcl5MSTeQEmLWAE5EcreoYgBbw9CQvbVaL8lj91pxHfVwoff-LKUcJLdkRfDSPYmALfie7ZKfFmnkiC-zxfCor7f8eZ9g4nh9E17z9vSQO57xBdbuk1jCowkPMiqwLVL1dRh4bWCD2nVEw_245qiAuBXtXpaFeE May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 168d660ee157451aa0a01c57fa2f0c8c May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-631217032 May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_168d660ee157451aa0a01c57fa2f0c8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/168d660ee157451aa0a01c57fa2f0c8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/168d660ee157451aa0a01c57fa2f0c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/168d660ee157451aa0a01c57fa2f0c8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-631217032 May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 168d660ee157451aa0a01c57fa2f0c8c May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-631217032 May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-SecurityGroupsNegativeTestJSON-631217032-project May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 855959ce18d54d36b20dbd93b389f5f6 May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-631217032-project May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: exception: Security group 17b616e3-c767-491a-8eac-652d2125d0d6 does not exist May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-ddbcae9c-c46c-4a22-ba82-d1c269320227'] May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '17b616e3-c767-491a-8eac-652d2125d0d6'} May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:49:28.955361 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 17b616e3-c767-491a-8eac-652d2125d0d6 does not exist May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ddbcae9c-c46c-4a22-ba82-d1c269320227'] May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 17b616e3-c767-491a-8eac-652d2125d0d6 does not exist May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ddbcae9c-c46c-4a22-ba82-d1c269320227'] May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 17b616e3-c767-491a-8eac-652d2125d0d6 does not exist May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ddbcae9c-c46c-4a22-ba82-d1c269320227'] May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 17b616e3-c767-491a-8eac-652d2125d0d6 does not exist May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ddbcae9c-c46c-4a22-ba82-d1c269320227'] May 28 04:49:28.960140 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:28.964863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c377b49d-45f1-449e-8944-84ac0294d080 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] Returning 404 to user: Security group 17b616e3-c767-491a-8eac-652d2125d0d6 does not exist May 28 04:49:28.964863 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-ddbcae9c-c46c-4a22-ba82-d1c269320227'] {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:49:28.965999 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c377b49d-45f1-449e-8944-84ac0294d080 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/17b616e3-c767-491a-8eac-652d2125d0d6" status: 404 len: 194 microversion: 2.1 time: 0.083558 May 28 04:49:28.967058 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1813/3716] 10.222.0.58 () {58 vars in 1268 bytes} [Sat May 28 04:49:28 2022] GET /compute/v2.1/os-security-groups/17b616e3-c767-491a-8eac-652d2125d0d6 => generated 194 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:49:28.976816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d5b8a8aa-925f-4643-86e7-e5bb86f818a4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:28.981969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d5b8a8aa-925f-4643-86e7-e5bb86f818a4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:29.002885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5b8a8aa-925f-4643-86e7-e5bb86f818a4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:29.003595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5b8a8aa-925f-4643-86e7-e5bb86f818a4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:29.004746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5b8a8aa-925f-4643-86e7-e5bb86f818a4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:29.005495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5b8a8aa-925f-4643-86e7-e5bb86f818a4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:29.177523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d5b8a8aa-925f-4643-86e7-e5bb86f818a4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:29.192190 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d5b8a8aa-925f-4643-86e7-e5bb86f818a4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 200 len: 1273 microversion: 2.1 time: 0.223783 May 28 04:49:29.195261 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1814/3717] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:28 2022] GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 1273 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:29.206445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-24838054-282f-4f89-b085-1e73b64a8e56 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] Action: 'update', calling method: .version_select at 0x7f7700997d30>, body: {"security_group": {"name": "tempest-sg-472752326", "description": "tempest-description-536703838"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:29.323550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG neutronclient.v2_0.client [None req-24838054-282f-4f89-b085-1e73b64a8e56 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0815ddac-50a6-4116-a390-d6a57fec56b7 does not exist", "detail": ""}} {{(pid=126043) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 04:49:29.324167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.security_group_api [None req-24838054-282f-4f89-b085-1e73b64a8e56 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] Neutron security group 0815ddac-50a6-4116-a390-d6a57fec56b7 not found {{(pid=126043) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 04:49:29.324698 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-24838054-282f-4f89-b085-1e73b64a8e56 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] HTTP exception thrown: Security group 0815ddac-50a6-4116-a390-d6a57fec56b7 does not exist May 28 04:49:29.324698 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-8da7a987-00ca-4611-96ea-71526bb59d09'] May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-24838054-282f-4f89-b085-1e73b64a8e56 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] Request method failure captured: May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: request: PUT /compute/v2.1/os-security-groups/0815ddac-50a6-4116-a390-d6a57fec56b7 HTTP/1.1 May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 100 May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikanWeVrlvia8oe-Abcl5MSTeQEmLWAE5EcreoYgBbw9CQvbVaL8lj91pxHfVwoff-LKUcJLdkRfDSPYmALfie7ZKfFmnkiC-zxfCor7f8eZ9g4nh9E17z9vSQO57xBdbuk1jCowkPMiqwLVL1dRh4bWCD2nVEw_245qiAuBXtXpaFeE May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 168d660ee157451aa0a01c57fa2f0c8c May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-631217032 May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_168d660ee157451aa0a01c57fa2f0c8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/168d660ee157451aa0a01c57fa2f0c8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/168d660ee157451aa0a01c57fa2f0c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/168d660ee157451aa0a01c57fa2f0c8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-631217032 May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 168d660ee157451aa0a01c57fa2f0c8c May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-631217032 May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-SecurityGroupsNegativeTestJSON-631217032-project May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 855959ce18d54d36b20dbd93b389f5f6 May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-631217032-project May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: {"security_group": {"name": "tempest-sg-472752326", "description": "tempest-description-536703838"}} May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: exception: Security group 0815ddac-50a6-4116-a390-d6a57fec56b7 does not exist May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-8da7a987-00ca-4611-96ea-71526bb59d09'] May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '0815ddac-50a6-4116-a390-d6a57fec56b7', 'body': {'security_group': {'name': 'tempest-sg-472752326', 'description': 'tempest-description-536703838'}}} May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 04:49:29.326616 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0815ddac-50a6-4116-a390-d6a57fec56b7 does not exist May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8da7a987-00ca-4611-96ea-71526bb59d09'] May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0815ddac-50a6-4116-a390-d6a57fec56b7 does not exist May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8da7a987-00ca-4611-96ea-71526bb59d09'] May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0815ddac-50a6-4116-a390-d6a57fec56b7 does not exist May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8da7a987-00ca-4611-96ea-71526bb59d09'] May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0815ddac-50a6-4116-a390-d6a57fec56b7 does not exist May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8da7a987-00ca-4611-96ea-71526bb59d09'] May 28 04:49:29.330862 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:29.335195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-24838054-282f-4f89-b085-1e73b64a8e56 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] Returning 404 to user: Security group 0815ddac-50a6-4116-a390-d6a57fec56b7 does not exist May 28 04:49:29.335195 n-d-843700-1 devstack@n-api.service[126043]: Neutron server returns request_ids: ['req-8da7a987-00ca-4611-96ea-71526bb59d09'] {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:49:29.336621 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-24838054-282f-4f89-b085-1e73b64a8e56 tempest-SecurityGroupsNegativeTestJSON-631217032 tempest-SecurityGroupsNegativeTestJSON-631217032-project] 10.222.0.58 "PUT /compute/v2.1/os-security-groups/0815ddac-50a6-4116-a390-d6a57fec56b7" status: 404 len: 194 microversion: 2.1 time: 0.138984 May 28 04:49:29.337387 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1815/3718] 10.222.0.58 () {60 vars in 1289 bytes} [Sat May 28 04:49:29 2022] PUT /compute/v2.1/os-security-groups/0815ddac-50a6-4116-a390-d6a57fec56b7 => generated 194 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:49:29.540778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-82296938-223b-4730-9455-139e7b76699d req-0063f637-100a-4b57-b2f2-124d2f7e23c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d88814f-f669-4de5-8886-9065023b6e9c", "name": "network-vif-deleted", "tag": "c4ce9d3f-8889-4d3b-81c8-52f1f73cd237"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:29.564353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-82296938-223b-4730-9455-139e7b76699d req-0063f637-100a-4b57-b2f2-124d2f7e23c7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:29.564808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-82296938-223b-4730-9455-139e7b76699d req-0063f637-100a-4b57-b2f2-124d2f7e23c7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:29.607336 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-82296938-223b-4730-9455-139e7b76699d req-0063f637-100a-4b57-b2f2-124d2f7e23c7 service nova] Creating event network-vif-deleted:c4ce9d3f-8889-4d3b-81c8-52f1f73cd237 for instance 8d88814f-f669-4de5-8886-9065023b6e9c on n-h1-843700-1 May 28 04:49:29.629777 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-82296938-223b-4730-9455-139e7b76699d req-0063f637-100a-4b57-b2f2-124d2f7e23c7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089932 May 28 04:49:29.635062 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1816/3719] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:49:29.895748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-193a73bf-97bb-4005-9eee-0a22bc7287b5 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a55ccce3d94656ba57bb9b8bd1a6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75310386a8674319a847876503f7b3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:29.914265 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-193a73bf-97bb-4005-9eee-0a22bc7287b5 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 200 len: 1512 microversion: 2.1 time: 1.106650 May 28 04:49:29.929233 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1904/3720] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:28 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 1512 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:29.935993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-306afa6e-136c-4091-bdb3-7f0ce574f2c0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:29.936616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-306afa6e-136c-4091-bdb3-7f0ce574f2c0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:29.965260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-306afa6e-136c-4091-bdb3-7f0ce574f2c0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:29.968288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-306afa6e-136c-4091-bdb3-7f0ce574f2c0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:29.969507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-306afa6e-136c-4091-bdb3-7f0ce574f2c0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:29.982388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-306afa6e-136c-4091-bdb3-7f0ce574f2c0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:30.091285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e546811d-b01b-43c5-a044-0f7956228727 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:30.092692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e546811d-b01b-43c5-a044-0f7956228727 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:30.099763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e546811d-b01b-43c5-a044-0f7956228727 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:30.100878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e546811d-b01b-43c5-a044-0f7956228727 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:30.102196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e546811d-b01b-43c5-a044-0f7956228727 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:30.102941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e546811d-b01b-43c5-a044-0f7956228727 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:30.660079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-306afa6e-136c-4091-bdb3-7f0ce574f2c0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:30.677443 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-306afa6e-136c-4091-bdb3-7f0ce574f2c0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:30.684629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-306afa6e-136c-4091-bdb3-7f0ce574f2c0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:30.685982 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-306afa6e-136c-4091-bdb3-7f0ce574f2c0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 2911 microversion: 2.42 time: 0.759048 May 28 04:49:30.688252 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1905/3721] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:29 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 2911 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:30.699640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-19024a10-52da-45b0-8c8d-2bc6ca3a143e req-1303b7d9-24dd-4c3f-a05b-00bcf10049a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "name": "network-vif-unplugged", "status": "completed", "tag": "b1d39698-47fc-43c1-928b-c95c094c9118"}, {"server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "name": "network-vif-unplugged", "status": "completed", "tag": "6afb08ab-967d-491b-a721-74903258c9b2"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:30.726911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-19024a10-52da-45b0-8c8d-2bc6ca3a143e req-1303b7d9-24dd-4c3f-a05b-00bcf10049a8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:30.731964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-19024a10-52da-45b0-8c8d-2bc6ca3a143e req-1303b7d9-24dd-4c3f-a05b-00bcf10049a8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:30.761392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e546811d-b01b-43c5-a044-0f7956228727 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:30.780303 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e546811d-b01b-43c5-a044-0f7956228727 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 1.035821 May 28 04:49:30.782097 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1817/3722] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:29 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:30.794480 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-19024a10-52da-45b0-8c8d-2bc6ca3a143e req-1303b7d9-24dd-4c3f-a05b-00bcf10049a8 service nova] Creating event network-vif-unplugged:b1d39698-47fc-43c1-928b-c95c094c9118 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:49:30.795051 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-19024a10-52da-45b0-8c8d-2bc6ca3a143e req-1303b7d9-24dd-4c3f-a05b-00bcf10049a8 service nova] Creating event network-vif-unplugged:6afb08ab-967d-491b-a721-74903258c9b2 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:49:30.801794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1b2b4266-5d2f-461a-993b-94a25fbf938a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:30.801794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1b2b4266-5d2f-461a-993b-94a25fbf938a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:30.823850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b2b4266-5d2f-461a-993b-94a25fbf938a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:30.824306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b2b4266-5d2f-461a-993b-94a25fbf938a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:30.825101 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-19024a10-52da-45b0-8c8d-2bc6ca3a143e req-1303b7d9-24dd-4c3f-a05b-00bcf10049a8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.132533 May 28 04:49:30.826908 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1906/3723] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:30.830680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b2b4266-5d2f-461a-993b-94a25fbf938a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:30.835034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b2b4266-5d2f-461a-993b-94a25fbf938a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:30.845394 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-79c606b6-9df2-4b07-a229-e360f5c13037 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:30.846503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-79c606b6-9df2-4b07-a229-e360f5c13037 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:30.866092 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-79c606b6-9df2-4b07-a229-e360f5c13037 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:30.866583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-79c606b6-9df2-4b07-a229-e360f5c13037 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:30.872076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-79c606b6-9df2-4b07-a229-e360f5c13037 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:30.874647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-79c606b6-9df2-4b07-a229-e360f5c13037 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:31.025721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1b2b4266-5d2f-461a-993b-94a25fbf938a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:31.041783 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1b2b4266-5d2f-461a-993b-94a25fbf938a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 200 len: 1279 microversion: 2.1 time: 0.258381 May 28 04:49:31.042699 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1818/3724] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:30 2022] GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 1279 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:31.049587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-7f53d7fb-f2ee-4fe3-b46b-52186ee4a040 req-f6b0f2f7-6736-4950-979c-94b90f4509af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "name": "network-vif-deleted", "tag": "50e6b87b-0119-4477-a5c5-db24e4c2100a"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:31.069915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-7f53d7fb-f2ee-4fe3-b46b-52186ee4a040 req-f6b0f2f7-6736-4950-979c-94b90f4509af service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:31.071674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-7f53d7fb-f2ee-4fe3-b46b-52186ee4a040 req-f6b0f2f7-6736-4950-979c-94b90f4509af service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:31.097779 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-7f53d7fb-f2ee-4fe3-b46b-52186ee4a040 req-f6b0f2f7-6736-4950-979c-94b90f4509af service nova] Creating event network-vif-deleted:50e6b87b-0119-4477-a5c5-db24e4c2100a for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:49:31.104979 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-7f53d7fb-f2ee-4fe3-b46b-52186ee4a040 req-f6b0f2f7-6736-4950-979c-94b90f4509af service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061011 May 28 04:49:31.107136 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1819/3725] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:31.114262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4b302186-7105-4d50-80a7-c706ff0205b1 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:31.115225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4b302186-7105-4d50-80a7-c706ff0205b1 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] [instance: 8d88814f-f669-4de5-8886-9065023b6e9c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:31.128704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b302186-7105-4d50-80a7-c706ff0205b1 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:31.129514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b302186-7105-4d50-80a7-c706ff0205b1 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:31.130513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b302186-7105-4d50-80a7-c706ff0205b1 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:31.131237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b302186-7105-4d50-80a7-c706ff0205b1 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:31.156286 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-4b302186-7105-4d50-80a7-c706ff0205b1 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] HTTP exception thrown: Instance 8d88814f-f669-4de5-8886-9065023b6e9c could not be found. May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4b302186-7105-4d50-80a7-c706ff0205b1 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Request method failure captured: May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c HTTP/1.1 May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikam_CPXXBU2jTlbVOfYSrax-U9HRhZF1CjxNNX_zYMYEu-445SZgsCZ4ZLqz_f2Q6tfVfWdDwa3LUSoI_G6HnzUYN7UJQqcvDmKuCgSiDJ4qxUVlhQ57CAlTFP7aUVxmSquVjaRvU1p0XDRKVNZEYqUyeTczf6V8RD377FdQXyU5jN0 May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 75310386a8674319a847876503f7b3f9 May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-InstanceActionsTestJSON-1052534783 May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_75310386a8674319a847876503f7b3f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/75310386a8674319a847876503f7b3f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/75310386a8674319a847876503f7b3f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/75310386a8674319a847876503f7b3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-InstanceActionsTestJSON-1052534783 May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 75310386a8674319a847876503f7b3f9 May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1052534783 May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-InstanceActionsTestJSON-1052534783-project May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 22a55ccce3d94656ba57bb9b8bd1a6e6 May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-InstanceActionsTestJSON-1052534783-project May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 8d88814f-f669-4de5-8886-9065023b6e9c could not be found. May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '8d88814f-f669-4de5-8886-9065023b6e9c'} May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d88814f-f669-4de5-8886-9065023b6e9c could not be found. May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d88814f-f669-4de5-8886-9065023b6e9c could not be found. May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:31.158808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:31.162875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:31.162875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:31.162875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:31.162875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:49:31.162875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:49:31.162875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d88814f-f669-4de5-8886-9065023b6e9c could not be found. May 28 04:49:31.162875 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:31.168659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4b302186-7105-4d50-80a7-c706ff0205b1 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] Returning 404 to user: Instance 8d88814f-f669-4de5-8886-9065023b6e9c could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:49:31.168659 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4b302186-7105-4d50-80a7-c706ff0205b1 tempest-InstanceActionsTestJSON-1052534783 tempest-InstanceActionsTestJSON-1052534783-project] 10.222.0.58 "GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c" status: 404 len: 111 microversion: 2.1 time: 0.059720 May 28 04:49:31.169952 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1820/3726] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:31 2022] GET /compute/v2.1/servers/8d88814f-f669-4de5-8886-9065023b6e9c => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:49:31.383845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-79c606b6-9df2-4b07-a229-e360f5c13037 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:31.396036 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-79c606b6-9df2-4b07-a229-e360f5c13037 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.566194 May 28 04:49:31.399062 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1907/3727] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:30 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:31.416813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3a6496dd-ba79-483f-a0ad-cc6dbd4c4644 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:31.417881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3a6496dd-ba79-483f-a0ad-cc6dbd4c4644 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:31.436813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a6496dd-ba79-483f-a0ad-cc6dbd4c4644 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:31.437484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a6496dd-ba79-483f-a0ad-cc6dbd4c4644 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:31.442749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a6496dd-ba79-483f-a0ad-cc6dbd4c4644 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:31.442749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a6496dd-ba79-483f-a0ad-cc6dbd4c4644 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:31.670869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3a6496dd-ba79-483f-a0ad-cc6dbd4c4644 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:31.683378 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3a6496dd-ba79-483f-a0ad-cc6dbd4c4644 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.273409 May 28 04:49:31.684404 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1821/3728] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:31 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:31.701028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ba611b79-6378-4edd-8137-f8f51523f026 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:31.702319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ba611b79-6378-4edd-8137-f8f51523f026 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:31.704973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:31.711195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9a417ba0-6470-42be-864b-8bfaaf5f509e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:31.711767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9a417ba0-6470-42be-864b-8bfaaf5f509e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:31.713785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba611b79-6378-4edd-8137-f8f51523f026 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:31.714245 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba611b79-6378-4edd-8137-f8f51523f026 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:31.715063 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba611b79-6378-4edd-8137-f8f51523f026 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:31.715508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba611b79-6378-4edd-8137-f8f51523f026 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:31.719322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9a417ba0-6470-42be-864b-8bfaaf5f509e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:31.719878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9a417ba0-6470-42be-864b-8bfaaf5f509e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:31.721561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9a417ba0-6470-42be-864b-8bfaaf5f509e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:31.721561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9a417ba0-6470-42be-864b-8bfaaf5f509e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:32.364185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9a417ba0-6470-42be-864b-8bfaaf5f509e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:32.372864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9a417ba0-6470-42be-864b-8bfaaf5f509e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:32.374822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9a417ba0-6470-42be-864b-8bfaaf5f509e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:32.377694 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9a417ba0-6470-42be-864b-8bfaaf5f509e tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 2706 microversion: 2.42 time: 0.672021 May 28 04:49:32.379344 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1822/3729] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:31 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 2706 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:32.392641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-184f93cc-da33-4ee8-a6b1-6a5e311a09b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:32.394353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-184f93cc-da33-4ee8-a6b1-6a5e311a09b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:32.409465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ba611b79-6378-4edd-8137-f8f51523f026 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:32.423947 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ba611b79-6378-4edd-8137-f8f51523f026 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.726789 May 28 04:49:32.424273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-184f93cc-da33-4ee8-a6b1-6a5e311a09b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:32.424737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-184f93cc-da33-4ee8-a6b1-6a5e311a09b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:32.425517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-184f93cc-da33-4ee8-a6b1-6a5e311a09b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:32.425723 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1908/3730] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:31 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:32.434800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-184f93cc-da33-4ee8-a6b1-6a5e311a09b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:32.448892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e65a6c58-608c-4838-88c8-6bfed65003c6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:32.460382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e65a6c58-608c-4838-88c8-6bfed65003c6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:32.489505 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-184f93cc-da33-4ee8-a6b1-6a5e311a09b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/ips" status: 200 len: 149 microversion: 2.1 time: 0.107318 May 28 04:49:32.491202 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1823/3731] 10.222.0.58 () {58 vars in 1247 bytes} [Sat May 28 04:49:32 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/ips => generated 149 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:32.503478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-d8363a8f-4d84-4ec1-a554-df1c1047103c req-026d48da-08c7-4288-80ae-42fd9eb321fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab9b09ff-7dc9-42e7-878b-fdc6906445c7", "tag": "3ce87754-f8f4-4b4b-ba77-4a7108a51a9c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:32.505608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e65a6c58-608c-4838-88c8-6bfed65003c6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:32.511544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e65a6c58-608c-4838-88c8-6bfed65003c6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:32.514033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e65a6c58-608c-4838-88c8-6bfed65003c6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:32.519749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e65a6c58-608c-4838-88c8-6bfed65003c6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:32.547126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d8363a8f-4d84-4ec1-a554-df1c1047103c req-026d48da-08c7-4288-80ae-42fd9eb321fa service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:32.555206 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d8363a8f-4d84-4ec1-a554-df1c1047103c req-026d48da-08c7-4288-80ae-42fd9eb321fa service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:32.602309 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-d8363a8f-4d84-4ec1-a554-df1c1047103c req-026d48da-08c7-4288-80ae-42fd9eb321fa service nova] Creating event network-changed:3ce87754-f8f4-4b4b-ba77-4a7108a51a9c for instance ab9b09ff-7dc9-42e7-878b-fdc6906445c7 on n-h1-843700-1 May 28 04:49:32.614081 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-d8363a8f-4d84-4ec1-a554-df1c1047103c req-026d48da-08c7-4288-80ae-42fd9eb321fa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120771 May 28 04:49:32.614697 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1824/3732] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:32.624828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-718830d3-e855-4179-b168-6b5a84ffb6c6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2071121110", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "fa4b7ae7-c4d1-4b2e-9365-36aea885e8cd"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:32.736876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-718830d3-e855-4179-b168-6b5a84ffb6c6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] validate_networks() for [('fa4b7ae7-c4d1-4b2e-9365-36aea885e8cd', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:49:33.279848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e65a6c58-608c-4838-88c8-6bfed65003c6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:33.288894 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e65a6c58-608c-4838-88c8-6bfed65003c6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 200 len: 1321 microversion: 2.1 time: 0.861989 May 28 04:49:33.298027 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1909/3733] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:32 2022] GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 1321 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:33.314134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-093163cc-da67-44c3-a47f-0c510313721f req-782b5526-4625-40f2-bef2-60e01d83f36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "name": "network-vif-unplugged", "status": "completed", "tag": "5dc343f6-efc0-48aa-9ea2-32a0164b02a4"}, {"server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "name": "network-vif-unplugged", "status": "completed", "tag": "1643fa1a-bc92-4b3e-9108-5707b60a8b27"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:33.332185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-093163cc-da67-44c3-a47f-0c510313721f req-782b5526-4625-40f2-bef2-60e01d83f36a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:33.333460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-093163cc-da67-44c3-a47f-0c510313721f req-782b5526-4625-40f2-bef2-60e01d83f36a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:33.352921 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-093163cc-da67-44c3-a47f-0c510313721f req-782b5526-4625-40f2-bef2-60e01d83f36a service nova] Creating event network-vif-unplugged:5dc343f6-efc0-48aa-9ea2-32a0164b02a4 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:49:33.353620 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-093163cc-da67-44c3-a47f-0c510313721f req-782b5526-4625-40f2-bef2-60e01d83f36a service nova] Creating event network-vif-unplugged:1643fa1a-bc92-4b3e-9108-5707b60a8b27 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:49:33.361238 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-093163cc-da67-44c3-a47f-0c510313721f req-782b5526-4625-40f2-bef2-60e01d83f36a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.061692 May 28 04:49:33.362124 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1910/3734] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:33.369000 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-8f538033-86b1-4b37-b793-2e20de05e239 req-bcbaede2-bbea-45fe-ae31-2f0032f5eca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "name": "network-vif-deleted", "tag": "1643fa1a-bc92-4b3e-9108-5707b60a8b27"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:33.378673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8f538033-86b1-4b37-b793-2e20de05e239 req-bcbaede2-bbea-45fe-ae31-2f0032f5eca4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:33.379576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8f538033-86b1-4b37-b793-2e20de05e239 req-bcbaede2-bbea-45fe-ae31-2f0032f5eca4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:33.395936 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-8f538033-86b1-4b37-b793-2e20de05e239 req-bcbaede2-bbea-45fe-ae31-2f0032f5eca4 service nova] Creating event network-vif-deleted:1643fa1a-bc92-4b3e-9108-5707b60a8b27 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:49:33.402446 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-8f538033-86b1-4b37-b793-2e20de05e239 req-bcbaede2-bbea-45fe-ae31-2f0032f5eca4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038792 May 28 04:49:33.403469 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1911/3735] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:33.409097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-22e812e6-1c60-4c30-8165-8e1e10027b19 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:33.410064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-22e812e6-1c60-4c30-8165-8e1e10027b19 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:33.426749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22e812e6-1c60-4c30-8165-8e1e10027b19 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:33.426749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22e812e6-1c60-4c30-8165-8e1e10027b19 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:33.426749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22e812e6-1c60-4c30-8165-8e1e10027b19 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:33.426749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22e812e6-1c60-4c30-8165-8e1e10027b19 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:33.524515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:34.469988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-22e812e6-1c60-4c30-8165-8e1e10027b19 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:34.484008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-22e812e6-1c60-4c30-8165-8e1e10027b19 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:34.488843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-22e812e6-1c60-4c30-8165-8e1e10027b19 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:34.492165 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-22e812e6-1c60-4c30-8165-8e1e10027b19 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 2660 microversion: 2.42 time: 1.087367 May 28 04:49:34.503765 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1912/3736] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:33 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 2660 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:34.508994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-89924115-3745-421b-9f2a-63293bdc94fc tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:34.509858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-89924115-3745-421b-9f2a-63293bdc94fc tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:34.524398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89924115-3745-421b-9f2a-63293bdc94fc tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:34.525215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89924115-3745-421b-9f2a-63293bdc94fc tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:34.526220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89924115-3745-421b-9f2a-63293bdc94fc tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:34.526873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89924115-3745-421b-9f2a-63293bdc94fc tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:35.897523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-718830d3-e855-4179-b168-6b5a84ffb6c6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:49:35.898654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-718830d3-e855-4179-b168-6b5a84ffb6c6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:49:35.899720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-718830d3-e855-4179-b168-6b5a84ffb6c6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:49:35.900633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-718830d3-e855-4179-b168-6b5a84ffb6c6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:49:35.901067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-718830d3-e855-4179-b168-6b5a84ffb6c6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:49:35.910211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:35.913358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-718830d3-e855-4179-b168-6b5a84ffb6c6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:35.914686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-718830d3-e855-4179-b168-6b5a84ffb6c6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:35.925984 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-718830d3-e855-4179-b168-6b5a84ffb6c6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:35.925984 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-718830d3-e855-4179-b168-6b5a84ffb6c6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:35.936204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:35.943434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-718830d3-e855-4179-b168-6b5a84ffb6c6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Getting quotas for project b0c48bf20efd4291b37e616c658f96ff. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:49:35.944155 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=8 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:35.952641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-718830d3-e855-4179-b168-6b5a84ffb6c6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Getting quotas for user 6272045226334bcf8b49a0aa41a07b95 and project b0c48bf20efd4291b37e616c658f96ff. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:49:35.970466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-718830d3-e855-4179-b168-6b5a84ffb6c6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:49:35.974753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-718830d3-e855-4179-b168-6b5a84ffb6c6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:49:36.021793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-89924115-3745-421b-9f2a-63293bdc94fc tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:36.043129 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-89924115-3745-421b-9f2a-63293bdc94fc tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 200 len: 1321 microversion: 2.1 time: 1.536344 May 28 04:49:36.043129 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1913/3737] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:34 2022] GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 1321 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:36.047589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-25dd0161-25b5-4f99-a7bb-a27d1f15a15c req-915a81b6-ef62-4190-a9b7-338e774d379d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0341fb99-a637-4739-b319-b6b0b39b71b0", "tag": "f0590ddd-1efd-477d-8e28-4ad8189f96d5"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:36.058011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-25dd0161-25b5-4f99-a7bb-a27d1f15a15c req-915a81b6-ef62-4190-a9b7-338e774d379d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:36.058752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-25dd0161-25b5-4f99-a7bb-a27d1f15a15c req-915a81b6-ef62-4190-a9b7-338e774d379d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:36.072138 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-25dd0161-25b5-4f99-a7bb-a27d1f15a15c req-915a81b6-ef62-4190-a9b7-338e774d379d service nova] Creating event network-changed:f0590ddd-1efd-477d-8e28-4ad8189f96d5 for instance 0341fb99-a637-4739-b319-b6b0b39b71b0 on n-h2-843700-1 May 28 04:49:36.077543 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-25dd0161-25b5-4f99-a7bb-a27d1f15a15c req-915a81b6-ef62-4190-a9b7-338e774d379d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034196 May 28 04:49:36.078236 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1914/3738] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:36.089897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-83af19fa-3963-48ce-bef8-416796f2f5b4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:36.095124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-83af19fa-3963-48ce-bef8-416796f2f5b4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:36.098262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83af19fa-3963-48ce-bef8-416796f2f5b4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:36.098963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83af19fa-3963-48ce-bef8-416796f2f5b4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:36.100045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83af19fa-3963-48ce-bef8-416796f2f5b4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:36.100655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83af19fa-3963-48ce-bef8-416796f2f5b4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:36.150915 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-718830d3-e855-4179-b168-6b5a84ffb6c6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.530162 May 28 04:49:36.154777 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1825/3739] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:49:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:49:36.174432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-bd9a0aa7-395e-4a3c-bfa0-96dcf0b97220 req-ac587c20-3a1e-4f2b-8432-334d18f0a403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "name": "network-vif-deleted", "tag": "6afb08ab-967d-491b-a721-74903258c9b2"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:36.195847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-bd9a0aa7-395e-4a3c-bfa0-96dcf0b97220 req-ac587c20-3a1e-4f2b-8432-334d18f0a403 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:36.198619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-bd9a0aa7-395e-4a3c-bfa0-96dcf0b97220 req-ac587c20-3a1e-4f2b-8432-334d18f0a403 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:36.218244 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-bd9a0aa7-395e-4a3c-bfa0-96dcf0b97220 req-ac587c20-3a1e-4f2b-8432-334d18f0a403 service nova] Creating event network-vif-deleted:6afb08ab-967d-491b-a721-74903258c9b2 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:49:36.224068 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-bd9a0aa7-395e-4a3c-bfa0-96dcf0b97220 req-ac587c20-3a1e-4f2b-8432-334d18f0a403 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062324 May 28 04:49:36.225060 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1826/3740] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:36.234466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eb43063d-87b4-44f4-ade3-d2a4c08a72d6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:36.235443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eb43063d-87b4-44f4-ade3-d2a4c08a72d6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:36.330000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eb43063d-87b4-44f4-ade3-d2a4c08a72d6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:36.343267 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eb43063d-87b4-44f4-ade3-d2a4c08a72d6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 200 len: 1215 microversion: 2.1 time: 0.115473 May 28 04:49:36.361796 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1827/3741] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:36 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 1215 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:36.827545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-83af19fa-3963-48ce-bef8-416796f2f5b4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:36.829809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:36.846702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-83af19fa-3963-48ce-bef8-416796f2f5b4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:36.850764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-83af19fa-3963-48ce-bef8-416796f2f5b4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:36.854328 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-83af19fa-3963-48ce-bef8-416796f2f5b4 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 2500 microversion: 2.42 time: 0.773592 May 28 04:49:36.855273 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1915/3742] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:36 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 2500 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:37.011537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-399f0919-73cc-497d-99fb-63c20aa02f28 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73cb9eb7-67b0-47b6-9110-14b24603d86f"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:37.016688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-399f0919-73cc-497d-99fb-63c20aa02f28 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:37.037392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-399f0919-73cc-497d-99fb-63c20aa02f28 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:37.039721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-399f0919-73cc-497d-99fb-63c20aa02f28 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:37.042372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-399f0919-73cc-497d-99fb-63c20aa02f28 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:37.043751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-399f0919-73cc-497d-99fb-63c20aa02f28 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:37.059540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-087dc409-66f1-47da-8ae9-fb43c1178c2c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:37.061643 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-087dc409-66f1-47da-8ae9-fb43c1178c2c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:37.080273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-087dc409-66f1-47da-8ae9-fb43c1178c2c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:37.080734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-087dc409-66f1-47da-8ae9-fb43c1178c2c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:37.081536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-087dc409-66f1-47da-8ae9-fb43c1178c2c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:37.092926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-087dc409-66f1-47da-8ae9-fb43c1178c2c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:37.517838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-087dc409-66f1-47da-8ae9-fb43c1178c2c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:37.528009 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-087dc409-66f1-47da-8ae9-fb43c1178c2c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 200 len: 1321 microversion: 2.1 time: 0.471067 May 28 04:49:37.529332 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1916/3743] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:37 2022] GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 1321 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:37.537587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2d64f9a6-688b-4108-9244-0ab25c7dcaf8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:37.538223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2d64f9a6-688b-4108-9244-0ab25c7dcaf8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:37.617945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2d64f9a6-688b-4108-9244-0ab25c7dcaf8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:37.626748 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2d64f9a6-688b-4108-9244-0ab25c7dcaf8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 200 len: 1215 microversion: 2.1 time: 0.096317 May 28 04:49:37.631179 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1917/3744] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:37 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:37.874176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c11651c4-a624-4d90-8156-0bd80f658096 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:37.874802 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c11651c4-a624-4d90-8156-0bd80f658096 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:37.881973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c11651c4-a624-4d90-8156-0bd80f658096 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:37.883290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c11651c4-a624-4d90-8156-0bd80f658096 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:37.884413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c11651c4-a624-4d90-8156-0bd80f658096 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:37.885062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c11651c4-a624-4d90-8156-0bd80f658096 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:37.976038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c11651c4-a624-4d90-8156-0bd80f658096 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:37.990577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c11651c4-a624-4d90-8156-0bd80f658096 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:37.992241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c11651c4-a624-4d90-8156-0bd80f658096 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:37.994071 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c11651c4-a624-4d90-8156-0bd80f658096 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 2276 microversion: 2.42 time: 0.123646 May 28 04:49:37.995204 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1918/3745] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:37 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 2276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:38.219362 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-399f0919-73cc-497d-99fb-63c20aa02f28 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "POST /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.212989 May 28 04:49:38.220940 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1828/3746] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 04:49:37 2022] POST /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments => generated 194 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:38.253150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-3e8de8a4-2345-4032-ab8f-189e78931468 req-9fb69113-28f3-4e5d-b944-d1b117d01935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "name": "network-vif-deleted", "tag": "5dc343f6-efc0-48aa-9ea2-32a0164b02a4"}, {"server_uuid": "ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26", "name": "network-vif-deleted", "tag": "b1d39698-47fc-43c1-928b-c95c094c9118"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:38.291737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-3e8de8a4-2345-4032-ab8f-189e78931468 req-9fb69113-28f3-4e5d-b944-d1b117d01935 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:38.293076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-3e8de8a4-2345-4032-ab8f-189e78931468 req-9fb69113-28f3-4e5d-b944-d1b117d01935 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:38.330720 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-3e8de8a4-2345-4032-ab8f-189e78931468 req-9fb69113-28f3-4e5d-b944-d1b117d01935 service nova] Creating event network-vif-deleted:5dc343f6-efc0-48aa-9ea2-32a0164b02a4 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:49:38.331271 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-3e8de8a4-2345-4032-ab8f-189e78931468 req-9fb69113-28f3-4e5d-b944-d1b117d01935 service nova] Creating event network-vif-deleted:b1d39698-47fc-43c1-928b-c95c094c9118 for instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 on n-h1-843700-1 May 28 04:49:38.350938 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-3e8de8a4-2345-4032-ab8f-189e78931468 req-9fb69113-28f3-4e5d-b944-d1b117d01935 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.102595 May 28 04:49:38.354413 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1919/3747] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:38.546754 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-25cf410a-9500-48d5-af3e-f340e695afa5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:38.548699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-25cf410a-9500-48d5-af3e-f340e695afa5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:38.568638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25cf410a-9500-48d5-af3e-f340e695afa5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:38.569112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25cf410a-9500-48d5-af3e-f340e695afa5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:38.580509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25cf410a-9500-48d5-af3e-f340e695afa5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:38.581422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25cf410a-9500-48d5-af3e-f340e695afa5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:38.648968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fd04c406-20b4-4a43-91eb-eb5e519e4a55 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:38.649981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fd04c406-20b4-4a43-91eb-eb5e519e4a55 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:38.661187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd04c406-20b4-4a43-91eb-eb5e519e4a55 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:38.666495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd04c406-20b4-4a43-91eb-eb5e519e4a55 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:38.667843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd04c406-20b4-4a43-91eb-eb5e519e4a55 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:38.668467 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd04c406-20b4-4a43-91eb-eb5e519e4a55 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:38.949071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fd04c406-20b4-4a43-91eb-eb5e519e4a55 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:38.963200 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fd04c406-20b4-4a43-91eb-eb5e519e4a55 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 200 len: 1267 microversion: 2.1 time: 0.312902 May 28 04:49:38.977427 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1920/3748] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:38 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 1267 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:39.013040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7b8d63eb-6601-49be-811e-10c5666249cf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:39.014022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7b8d63eb-6601-49be-811e-10c5666249cf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:39.024675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b8d63eb-6601-49be-811e-10c5666249cf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:39.025663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b8d63eb-6601-49be-811e-10c5666249cf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:39.031775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b8d63eb-6601-49be-811e-10c5666249cf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:39.031917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b8d63eb-6601-49be-811e-10c5666249cf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:39.299656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7b8d63eb-6601-49be-811e-10c5666249cf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:39.312792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7b8d63eb-6601-49be-811e-10c5666249cf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:39.316967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7b8d63eb-6601-49be-811e-10c5666249cf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:39.327088 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7b8d63eb-6601-49be-811e-10c5666249cf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.317815 May 28 04:49:39.328694 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1921/3749] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:39 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:39.595517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-25cf410a-9500-48d5-af3e-f340e695afa5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:39.604638 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-25cf410a-9500-48d5-af3e-f340e695afa5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 200 len: 1321 microversion: 2.1 time: 1.063480 May 28 04:49:39.605303 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1829/3750] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:38 2022] GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 1321 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:39.984281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1ee8fb8e-4784-4dc3-a4ef-ffd5ddf5d9c5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:39.985236 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1ee8fb8e-4784-4dc3-a4ef-ffd5ddf5d9c5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:39.997712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ee8fb8e-4784-4dc3-a4ef-ffd5ddf5d9c5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:40.002563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ee8fb8e-4784-4dc3-a4ef-ffd5ddf5d9c5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:40.003758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ee8fb8e-4784-4dc3-a4ef-ffd5ddf5d9c5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:40.004398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ee8fb8e-4784-4dc3-a4ef-ffd5ddf5d9c5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:40.135227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1ee8fb8e-4784-4dc3-a4ef-ffd5ddf5d9c5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:40.146849 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1ee8fb8e-4784-4dc3-a4ef-ffd5ddf5d9c5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 200 len: 1273 microversion: 2.1 time: 0.166756 May 28 04:49:40.150129 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1922/3751] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:39 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 1273 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:40.348040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f9407291-227c-4f1d-ac15-b4bda13d6a03 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:40.348865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f9407291-227c-4f1d-ac15-b4bda13d6a03 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:40.360406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9407291-227c-4f1d-ac15-b4bda13d6a03 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:40.362671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9407291-227c-4f1d-ac15-b4bda13d6a03 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:40.363711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9407291-227c-4f1d-ac15-b4bda13d6a03 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:40.366309 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9407291-227c-4f1d-ac15-b4bda13d6a03 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:40.623053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7001a9c8-5049-40a4-98cc-fcd83af895a0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:40.624139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7001a9c8-5049-40a4-98cc-fcd83af895a0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:40.631319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f9407291-227c-4f1d-ac15-b4bda13d6a03 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:40.644790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f9407291-227c-4f1d-ac15-b4bda13d6a03 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:40.646312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f9407291-227c-4f1d-ac15-b4bda13d6a03 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:40.648143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7001a9c8-5049-40a4-98cc-fcd83af895a0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:40.649777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7001a9c8-5049-40a4-98cc-fcd83af895a0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:40.652106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7001a9c8-5049-40a4-98cc-fcd83af895a0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:40.654076 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f9407291-227c-4f1d-ac15-b4bda13d6a03 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.311753 May 28 04:49:40.654736 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1830/3752] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:40 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:40.655760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7001a9c8-5049-40a4-98cc-fcd83af895a0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:41.123453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-209cc585-e51b-4fb2-a8d5-aa43cd23f63b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1221901744", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "bf9e6f8c-93ed-41a1-82b5-2fb183078c33"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:41.215438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-209cc585-e51b-4fb2-a8d5-aa43cd23f63b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] validate_networks() for [('bf9e6f8c-93ed-41a1-82b5-2fb183078c33', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:49:41.266807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7001a9c8-5049-40a4-98cc-fcd83af895a0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:41.284854 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7001a9c8-5049-40a4-98cc-fcd83af895a0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 200 len: 1321 microversion: 2.1 time: 0.666597 May 28 04:49:41.287614 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1923/3753] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:40 2022] GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 1321 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:41.300668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-691ff1ad-cc45-457d-b82c-900e83c860eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:41.303311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-691ff1ad-cc45-457d-b82c-900e83c860eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:41.325408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-691ff1ad-cc45-457d-b82c-900e83c860eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:41.325929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-691ff1ad-cc45-457d-b82c-900e83c860eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:41.327010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-691ff1ad-cc45-457d-b82c-900e83c860eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:41.327679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-691ff1ad-cc45-457d-b82c-900e83c860eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:41.644987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-691ff1ad-cc45-457d-b82c-900e83c860eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:41.657861 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-691ff1ad-cc45-457d-b82c-900e83c860eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 200 len: 1315 microversion: 2.1 time: 0.367466 May 28 04:49:41.661176 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1924/3754] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:41 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:41.675984 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d6812cbb-5b1c-4ca2-a335-7d8df217b9ad tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:41.677069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d6812cbb-5b1c-4ca2-a335-7d8df217b9ad tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:41.690380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d6812cbb-5b1c-4ca2-a335-7d8df217b9ad tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:41.698152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d6812cbb-5b1c-4ca2-a335-7d8df217b9ad tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:41.699444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d6812cbb-5b1c-4ca2-a335-7d8df217b9ad tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:41.700345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d6812cbb-5b1c-4ca2-a335-7d8df217b9ad tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:41.889440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d6812cbb-5b1c-4ca2-a335-7d8df217b9ad tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:41.905581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d6812cbb-5b1c-4ca2-a335-7d8df217b9ad tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:41.911482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d6812cbb-5b1c-4ca2-a335-7d8df217b9ad tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:41.912826 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d6812cbb-5b1c-4ca2-a335-7d8df217b9ad tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.242986 May 28 04:49:41.914688 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1925/3755] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:41 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:49:42.207164 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-209cc585-e51b-4fb2-a8d5-aa43cd23f63b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:49:42.208669 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-209cc585-e51b-4fb2-a8d5-aa43cd23f63b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:49:42.209392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-209cc585-e51b-4fb2-a8d5-aa43cd23f63b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:49:42.210030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-209cc585-e51b-4fb2-a8d5-aa43cd23f63b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:49:42.213068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-209cc585-e51b-4fb2-a8d5-aa43cd23f63b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:49:42.233169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-209cc585-e51b-4fb2-a8d5-aa43cd23f63b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:42.233853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-209cc585-e51b-4fb2-a8d5-aa43cd23f63b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:42.235108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-209cc585-e51b-4fb2-a8d5-aa43cd23f63b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:42.235798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-209cc585-e51b-4fb2-a8d5-aa43cd23f63b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:42.282451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-209cc585-e51b-4fb2-a8d5-aa43cd23f63b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Getting quotas for project 666dc141a00a4376893f7244fc10c61b. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:49:42.293033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-209cc585-e51b-4fb2-a8d5-aa43cd23f63b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Getting quotas for user 16dbd63fc217411493fc6f2f337949c1 and project 666dc141a00a4376893f7244fc10c61b. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:49:42.304847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f452e25e-0fc9-4f5b-8467-780bdf389fcf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:42.305465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f452e25e-0fc9-4f5b-8467-780bdf389fcf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:42.317159 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f452e25e-0fc9-4f5b-8467-780bdf389fcf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:42.317794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f452e25e-0fc9-4f5b-8467-780bdf389fcf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:42.318765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f452e25e-0fc9-4f5b-8467-780bdf389fcf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:42.325206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f452e25e-0fc9-4f5b-8467-780bdf389fcf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:42.326367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-209cc585-e51b-4fb2-a8d5-aa43cd23f63b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:49:42.337866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-209cc585-e51b-4fb2-a8d5-aa43cd23f63b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:49:42.530849 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-209cc585-e51b-4fb2-a8d5-aa43cd23f63b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.525242 May 28 04:49:42.532360 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1831/3756] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:49:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:49:42.618359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-34064dd2-1ba8-4409-b0d0-5043a655c443 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1983415464", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "bf9e6f8c-93ed-41a1-82b5-2fb183078c33"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:42.711057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-34064dd2-1ba8-4409-b0d0-5043a655c443 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] validate_networks() for [('bf9e6f8c-93ed-41a1-82b5-2fb183078c33', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:49:42.897669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f452e25e-0fc9-4f5b-8467-780bdf389fcf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:42.906027 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f452e25e-0fc9-4f5b-8467-780bdf389fcf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 200 len: 1321 microversion: 2.1 time: 0.605247 May 28 04:49:42.936484 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1926/3757] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:42 2022] GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 1321 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:42.941484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b5930af3-906d-4cd3-b110-a734c8e983f0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:42.942108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b5930af3-906d-4cd3-b110-a734c8e983f0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:42.981714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b5930af3-906d-4cd3-b110-a734c8e983f0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:42.996119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b5930af3-906d-4cd3-b110-a734c8e983f0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:42.999425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b5930af3-906d-4cd3-b110-a734c8e983f0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:42.999880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b5930af3-906d-4cd3-b110-a734c8e983f0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:44.053703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-34064dd2-1ba8-4409-b0d0-5043a655c443 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:49:44.056921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-34064dd2-1ba8-4409-b0d0-5043a655c443 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:49:44.056921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-34064dd2-1ba8-4409-b0d0-5043a655c443 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:49:44.056921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-34064dd2-1ba8-4409-b0d0-5043a655c443 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:49:44.056921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-34064dd2-1ba8-4409-b0d0-5043a655c443 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:49:44.068946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34064dd2-1ba8-4409-b0d0-5043a655c443 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:44.073857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34064dd2-1ba8-4409-b0d0-5043a655c443 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:44.075167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34064dd2-1ba8-4409-b0d0-5043a655c443 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:44.075782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34064dd2-1ba8-4409-b0d0-5043a655c443 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:44.138532 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-34064dd2-1ba8-4409-b0d0-5043a655c443 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Getting quotas for project 666dc141a00a4376893f7244fc10c61b. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:49:44.152589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b5930af3-906d-4cd3-b110-a734c8e983f0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:44.158847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-34064dd2-1ba8-4409-b0d0-5043a655c443 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Getting quotas for user 16dbd63fc217411493fc6f2f337949c1 and project 666dc141a00a4376893f7244fc10c61b. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:49:44.174770 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b5930af3-906d-4cd3-b110-a734c8e983f0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 200 len: 1315 microversion: 2.1 time: 1.234546 May 28 04:49:44.178150 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1927/3758] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:42 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 1315 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:44.211674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-34064dd2-1ba8-4409-b0d0-5043a655c443 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:49:44.216311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fe6efbc2-68fb-46dc-891f-8b8c8ee8a31c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:44.216975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fe6efbc2-68fb-46dc-891f-8b8c8ee8a31c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:44.217717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-34064dd2-1ba8-4409-b0d0-5043a655c443 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:49:44.252889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe6efbc2-68fb-46dc-891f-8b8c8ee8a31c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:44.253563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe6efbc2-68fb-46dc-891f-8b8c8ee8a31c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:44.259368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe6efbc2-68fb-46dc-891f-8b8c8ee8a31c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:44.260174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe6efbc2-68fb-46dc-891f-8b8c8ee8a31c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:44.501556 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-34064dd2-1ba8-4409-b0d0-5043a655c443 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.871153 May 28 04:49:44.516481 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1832/3759] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:49:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 04:49:44.541089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-2b265557-fe64-419b-9181-da7452f7a6c6 req-14443e13-44e2-412e-becc-adaa5da48035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0341fb99-a637-4739-b319-b6b0b39b71b0", "name": "network-vif-plugged", "status": "completed", "tag": "f0590ddd-1efd-477d-8e28-4ad8189f96d5"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:44.576198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2b265557-fe64-419b-9181-da7452f7a6c6 req-14443e13-44e2-412e-becc-adaa5da48035 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:44.577643 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fe6efbc2-68fb-46dc-891f-8b8c8ee8a31c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:44.577994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2b265557-fe64-419b-9181-da7452f7a6c6 req-14443e13-44e2-412e-becc-adaa5da48035 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:44.608016 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fe6efbc2-68fb-46dc-891f-8b8c8ee8a31c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:44.611133 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-2b265557-fe64-419b-9181-da7452f7a6c6 req-14443e13-44e2-412e-becc-adaa5da48035 service nova] Creating event network-vif-plugged:f0590ddd-1efd-477d-8e28-4ad8189f96d5 for instance 0341fb99-a637-4739-b319-b6b0b39b71b0 on n-h2-843700-1 May 28 04:49:44.613804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fe6efbc2-68fb-46dc-891f-8b8c8ee8a31c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:44.629360 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-2b265557-fe64-419b-9181-da7452f7a6c6 req-14443e13-44e2-412e-becc-adaa5da48035 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110877 May 28 04:49:44.641032 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1833/3760] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:44.648331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-da5781eb-400d-4696-867a-c7d58bc0d827 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:44.651774 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fe6efbc2-68fb-46dc-891f-8b8c8ee8a31c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.439430 May 28 04:49:44.652507 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1928/3761] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:44 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:44.660538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-da5781eb-400d-4696-867a-c7d58bc0d827 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:44.697396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-86d7f135-fcfb-4189-9e86-1163b04ec77b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-132876294", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "451", "networks": [{"uuid": "bf9e6f8c-93ed-41a1-82b5-2fb183078c33"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:44.706376 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-da5781eb-400d-4696-867a-c7d58bc0d827 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:44.714074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-da5781eb-400d-4696-867a-c7d58bc0d827 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:44.716627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-da5781eb-400d-4696-867a-c7d58bc0d827 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:44.725497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-da5781eb-400d-4696-867a-c7d58bc0d827 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:44.799938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-86d7f135-fcfb-4189-9e86-1163b04ec77b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] validate_networks() for [('bf9e6f8c-93ed-41a1-82b5-2fb183078c33', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:49:45.635635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-da5781eb-400d-4696-867a-c7d58bc0d827 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:45.642423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:45.650387 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-da5781eb-400d-4696-867a-c7d58bc0d827 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 200 len: 1321 microversion: 2.1 time: 1.007766 May 28 04:49:45.651019 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1834/3762] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:44 2022] GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 1321 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:45.667813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3e8603f0-ef44-41aa-afeb-501167582628 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:45.668683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3e8603f0-ef44-41aa-afeb-501167582628 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:45.696559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e8603f0-ef44-41aa-afeb-501167582628 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:45.697466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e8603f0-ef44-41aa-afeb-501167582628 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:45.698648 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e8603f0-ef44-41aa-afeb-501167582628 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:45.699271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e8603f0-ef44-41aa-afeb-501167582628 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:46.279792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-86d7f135-fcfb-4189-9e86-1163b04ec77b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:49:46.280742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-86d7f135-fcfb-4189-9e86-1163b04ec77b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:49:46.281509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-86d7f135-fcfb-4189-9e86-1163b04ec77b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:49:46.282170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-86d7f135-fcfb-4189-9e86-1163b04ec77b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:49:46.282736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-86d7f135-fcfb-4189-9e86-1163b04ec77b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:49:46.307820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-86d7f135-fcfb-4189-9e86-1163b04ec77b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:46.310076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-86d7f135-fcfb-4189-9e86-1163b04ec77b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:46.313286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-86d7f135-fcfb-4189-9e86-1163b04ec77b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:46.316757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-86d7f135-fcfb-4189-9e86-1163b04ec77b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:46.425148 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-86d7f135-fcfb-4189-9e86-1163b04ec77b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Getting quotas for project 666dc141a00a4376893f7244fc10c61b. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:49:46.452675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-86d7f135-fcfb-4189-9e86-1163b04ec77b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Getting quotas for user 16dbd63fc217411493fc6f2f337949c1 and project 666dc141a00a4376893f7244fc10c61b. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:49:46.461259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3e8603f0-ef44-41aa-afeb-501167582628 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:46.475991 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3e8603f0-ef44-41aa-afeb-501167582628 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 200 len: 1315 microversion: 2.1 time: 0.816308 May 28 04:49:46.478105 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1835/3763] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:45 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 1315 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:46.489229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-86d7f135-fcfb-4189-9e86-1163b04ec77b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:49:46.497275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c25d9981-b11b-4472-b5cd-b233df3e63c5 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:46.504831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-86d7f135-fcfb-4189-9e86-1163b04ec77b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:49:46.505031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c25d9981-b11b-4472-b5cd-b233df3e63c5 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:46.530379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c25d9981-b11b-4472-b5cd-b233df3e63c5 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:46.534187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c25d9981-b11b-4472-b5cd-b233df3e63c5 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:46.535044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c25d9981-b11b-4472-b5cd-b233df3e63c5 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:46.535416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c25d9981-b11b-4472-b5cd-b233df3e63c5 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:46.660554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c25d9981-b11b-4472-b5cd-b233df3e63c5 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:46.676754 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c25d9981-b11b-4472-b5cd-b233df3e63c5 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:46.682093 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-86d7f135-fcfb-4189-9e86-1163b04ec77b tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.988403 May 28 04:49:46.684789 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1929/3764] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:49:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:49:46.689964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c25d9981-b11b-4472-b5cd-b233df3e63c5 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:46.697684 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c25d9981-b11b-4472-b5cd-b233df3e63c5 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.210833 May 28 04:49:46.713139 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1836/3765] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:46 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:46.714343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e99ec0fb-3268-478a-aad0-4ebbd60351a9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:46.715364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e99ec0fb-3268-478a-aad0-4ebbd60351a9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:46.719779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-635bfd5f-4ee0-45d2-a89d-9f6c91a25196 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:46.722779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-635bfd5f-4ee0-45d2-a89d-9f6c91a25196 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:46.740873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e99ec0fb-3268-478a-aad0-4ebbd60351a9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:46.742101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e99ec0fb-3268-478a-aad0-4ebbd60351a9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:46.749527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e99ec0fb-3268-478a-aad0-4ebbd60351a9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:46.750355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e99ec0fb-3268-478a-aad0-4ebbd60351a9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:47.069266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-635bfd5f-4ee0-45d2-a89d-9f6c91a25196 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:47.093767 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-635bfd5f-4ee0-45d2-a89d-9f6c91a25196 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 200 len: 1220 microversion: 2.1 time: 0.378902 May 28 04:49:47.094385 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1837/3766] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:46 2022] GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 1220 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:47.115759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-7a7a64bd-3066-4e1a-8e46-d55630cdf006 req-781426af-49a8-4d0c-8cdd-22b000cf5626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde949cb-a966-4689-b421-e8f1c21b58e4", "tag": "86fc4516-0fd0-4b05-9b84-709e24cafb31"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:47.161619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-7a7a64bd-3066-4e1a-8e46-d55630cdf006 req-781426af-49a8-4d0c-8cdd-22b000cf5626 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:47.162080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-7a7a64bd-3066-4e1a-8e46-d55630cdf006 req-781426af-49a8-4d0c-8cdd-22b000cf5626 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:47.217077 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-7a7a64bd-3066-4e1a-8e46-d55630cdf006 req-781426af-49a8-4d0c-8cdd-22b000cf5626 service nova] Creating event network-changed:86fc4516-0fd0-4b05-9b84-709e24cafb31 for instance dde949cb-a966-4689-b421-e8f1c21b58e4 on n-h1-843700-1 May 28 04:49:47.250023 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-7a7a64bd-3066-4e1a-8e46-d55630cdf006 req-781426af-49a8-4d0c-8cdd-22b000cf5626 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146986 May 28 04:49:47.250668 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1838/3767] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:47.494477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-daf0024f-8df9-4792-858b-58de06b30c17 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:47.495214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-daf0024f-8df9-4792-858b-58de06b30c17 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:47.509985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-daf0024f-8df9-4792-858b-58de06b30c17 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:47.510681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-daf0024f-8df9-4792-858b-58de06b30c17 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:47.511654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-daf0024f-8df9-4792-858b-58de06b30c17 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:47.512246 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-daf0024f-8df9-4792-858b-58de06b30c17 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:47.790469 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e99ec0fb-3268-478a-aad0-4ebbd60351a9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:47.801522 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e99ec0fb-3268-478a-aad0-4ebbd60351a9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 200 len: 1321 microversion: 2.1 time: 1.113936 May 28 04:49:47.802173 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1930/3768] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:46 2022] GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 1321 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:47.812217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-092fd1a1-c30a-471e-9d09-9b777278d20a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:47.812854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-092fd1a1-c30a-471e-9d09-9b777278d20a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:47.842774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-092fd1a1-c30a-471e-9d09-9b777278d20a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:47.847674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-092fd1a1-c30a-471e-9d09-9b777278d20a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:47.849214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-092fd1a1-c30a-471e-9d09-9b777278d20a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:47.850110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-092fd1a1-c30a-471e-9d09-9b777278d20a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:48.082430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-daf0024f-8df9-4792-858b-58de06b30c17 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:48.090585 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-daf0024f-8df9-4792-858b-58de06b30c17 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 200 len: 1315 microversion: 2.1 time: 0.600465 May 28 04:49:48.091226 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1839/3769] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:47 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:48.103957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-092fd1a1-c30a-471e-9d09-9b777278d20a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:48.116653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-092fd1a1-c30a-471e-9d09-9b777278d20a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:48.119723 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-092fd1a1-c30a-471e-9d09-9b777278d20a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:48.123420 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-092fd1a1-c30a-471e-9d09-9b777278d20a tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.316121 May 28 04:49:48.128245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4bc882a0-0339-4a15-be58-c6753e8e34f2 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:48.128858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4bc882a0-0339-4a15-be58-c6753e8e34f2 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:48.141033 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1931/3770] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:47 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:48.290671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4bc882a0-0339-4a15-be58-c6753e8e34f2 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:48.300400 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4bc882a0-0339-4a15-be58-c6753e8e34f2 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 200 len: 1220 microversion: 2.1 time: 0.176182 May 28 04:49:48.304643 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1840/3771] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:48 2022] GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 1220 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:48.821323 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a5741921-7a3e-4485-b5d6-2ee16a00152e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:48.822710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a5741921-7a3e-4485-b5d6-2ee16a00152e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:48.858829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5741921-7a3e-4485-b5d6-2ee16a00152e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:48.859401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5741921-7a3e-4485-b5d6-2ee16a00152e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:48.860269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5741921-7a3e-4485-b5d6-2ee16a00152e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:48.860654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5741921-7a3e-4485-b5d6-2ee16a00152e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:49.107771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-22a86a8d-61a4-402c-95e1-73456d052872 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:49.108464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-22a86a8d-61a4-402c-95e1-73456d052872 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:49.124786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22a86a8d-61a4-402c-95e1-73456d052872 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:49.126158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22a86a8d-61a4-402c-95e1-73456d052872 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:49.127021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22a86a8d-61a4-402c-95e1-73456d052872 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:49.127467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22a86a8d-61a4-402c-95e1-73456d052872 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:49.188161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a5741921-7a3e-4485-b5d6-2ee16a00152e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:49.201726 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a5741921-7a3e-4485-b5d6-2ee16a00152e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 200 len: 1502 microversion: 2.1 time: 0.384272 May 28 04:49:49.219192 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1932/3772] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:48 2022] GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 1502 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:49.233712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7436b35b-d805-4e94-922c-174bb2e8cde0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:49.234339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7436b35b-d805-4e94-922c-174bb2e8cde0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:49.242128 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7436b35b-d805-4e94-922c-174bb2e8cde0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:49.243126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7436b35b-d805-4e94-922c-174bb2e8cde0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:49.244065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7436b35b-d805-4e94-922c-174bb2e8cde0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:49.244661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7436b35b-d805-4e94-922c-174bb2e8cde0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:49.370052 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7436b35b-d805-4e94-922c-174bb2e8cde0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:49.386449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7436b35b-d805-4e94-922c-174bb2e8cde0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:49.389666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7436b35b-d805-4e94-922c-174bb2e8cde0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:49.394094 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7436b35b-d805-4e94-922c-174bb2e8cde0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.173827 May 28 04:49:49.397237 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1933/3773] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:49 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:49.424353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d9efea4d-7d5e-4f60-b63f-83c6e3ae5cf8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:49.427646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d9efea4d-7d5e-4f60-b63f-83c6e3ae5cf8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:49.443922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9efea4d-7d5e-4f60-b63f-83c6e3ae5cf8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:49.449587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-22a86a8d-61a4-402c-95e1-73456d052872 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:49.468517 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-22a86a8d-61a4-402c-95e1-73456d052872 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 200 len: 1315 microversion: 2.1 time: 0.365240 May 28 04:49:49.480150 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1841/3774] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:49 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:49:49.482959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9efea4d-7d5e-4f60-b63f-83c6e3ae5cf8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:49.487286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a8439c0a-b7f5-41b8-bd19-48e000ed4e52 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:49.487808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9efea4d-7d5e-4f60-b63f-83c6e3ae5cf8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:49.488271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9efea4d-7d5e-4f60-b63f-83c6e3ae5cf8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:49.488735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a8439c0a-b7f5-41b8-bd19-48e000ed4e52 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:49.533544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a8439c0a-b7f5-41b8-bd19-48e000ed4e52 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:49.540893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a8439c0a-b7f5-41b8-bd19-48e000ed4e52 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:49.542881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a8439c0a-b7f5-41b8-bd19-48e000ed4e52 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:49.548398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a8439c0a-b7f5-41b8-bd19-48e000ed4e52 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:49.712850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a8439c0a-b7f5-41b8-bd19-48e000ed4e52 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:49.723896 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a8439c0a-b7f5-41b8-bd19-48e000ed4e52 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 200 len: 1216 microversion: 2.1 time: 0.240071 May 28 04:49:49.725100 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1842/3775] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:49 2022] GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 1216 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:49.835255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d9efea4d-7d5e-4f60-b63f-83c6e3ae5cf8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:49.842773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:49.848694 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d9efea4d-7d5e-4f60-b63f-83c6e3ae5cf8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 200 len: 1502 microversion: 2.1 time: 0.437590 May 28 04:49:49.851978 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1934/3776] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:49 2022] GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 1502 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:49.868211 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9e566c16-e167-436e-9fb2-7ff575008b77 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:49.868727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9e566c16-e167-436e-9fb2-7ff575008b77 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:49.885816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e566c16-e167-436e-9fb2-7ff575008b77 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:49.886549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e566c16-e167-436e-9fb2-7ff575008b77 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:49.890317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e566c16-e167-436e-9fb2-7ff575008b77 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:49.890983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e566c16-e167-436e-9fb2-7ff575008b77 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:49.938868 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9e566c16-e167-436e-9fb2-7ff575008b77 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:49:50.417070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-212b974b-f950-4a0d-9544-a075917fba96 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:50.418083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-212b974b-f950-4a0d-9544-a075917fba96 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:50.430831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-212b974b-f950-4a0d-9544-a075917fba96 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:50.431604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-212b974b-f950-4a0d-9544-a075917fba96 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:50.432875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-212b974b-f950-4a0d-9544-a075917fba96 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:50.438846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-212b974b-f950-4a0d-9544-a075917fba96 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:50.568711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-212b974b-f950-4a0d-9544-a075917fba96 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:50.589886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-212b974b-f950-4a0d-9544-a075917fba96 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:50.591727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-212b974b-f950-4a0d-9544-a075917fba96 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:50.594126 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-212b974b-f950-4a0d-9544-a075917fba96 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.182783 May 28 04:49:50.595792 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1935/3777] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:50 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:50.601794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c3b9a675-74b3-432d-9aac-cfaec2728a64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:50.602416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c3b9a675-74b3-432d-9aac-cfaec2728a64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:50.615962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3b9a675-74b3-432d-9aac-cfaec2728a64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:50.617041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3b9a675-74b3-432d-9aac-cfaec2728a64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:50.619734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3b9a675-74b3-432d-9aac-cfaec2728a64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:50.620194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3b9a675-74b3-432d-9aac-cfaec2728a64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:50.705375 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9e566c16-e167-436e-9fb2-7ff575008b77 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 204 len: 0 microversion: 2.1 time: 0.841120 May 28 04:49:50.708328 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1843/3778] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:49:49 2022] DELETE /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 0 bytes in 845 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:49:50.726259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f812e608-f613-45a7-b39b-9fd9b77f60b2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:50.727375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f812e608-f613-45a7-b39b-9fd9b77f60b2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:50.799891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f812e608-f613-45a7-b39b-9fd9b77f60b2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:50.803268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f812e608-f613-45a7-b39b-9fd9b77f60b2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:50.808402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f812e608-f613-45a7-b39b-9fd9b77f60b2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:50.808402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f812e608-f613-45a7-b39b-9fd9b77f60b2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:51.438290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c3b9a675-74b3-432d-9aac-cfaec2728a64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:51.449600 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c3b9a675-74b3-432d-9aac-cfaec2728a64 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 200 len: 1315 microversion: 2.1 time: 0.852777 May 28 04:49:51.461824 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1936/3779] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:50 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 1315 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:51.478604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9a2f2612-0056-4e8c-95df-906097052180 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:51.479518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9a2f2612-0056-4e8c-95df-906097052180 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:51.490747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a2f2612-0056-4e8c-95df-906097052180 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:51.492977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a2f2612-0056-4e8c-95df-906097052180 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:51.496866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a2f2612-0056-4e8c-95df-906097052180 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:51.499243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a2f2612-0056-4e8c-95df-906097052180 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:51.566010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f812e608-f613-45a7-b39b-9fd9b77f60b2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:51.575819 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f812e608-f613-45a7-b39b-9fd9b77f60b2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 200 len: 1508 microversion: 2.1 time: 0.860397 May 28 04:49:51.576718 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1844/3780] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:50 2022] GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 1508 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:51.614544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e3c27707-0c82-49b4-93b4-5080259b375d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:51.615794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e3c27707-0c82-49b4-93b4-5080259b375d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:51.627513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3c27707-0c82-49b4-93b4-5080259b375d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:51.802058 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3c27707-0c82-49b4-93b4-5080259b375d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:51.802058 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3c27707-0c82-49b4-93b4-5080259b375d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:51.802058 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3c27707-0c82-49b4-93b4-5080259b375d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:51.803016 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9a2f2612-0056-4e8c-95df-906097052180 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:51.803016 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9a2f2612-0056-4e8c-95df-906097052180 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 200 len: 1290 microversion: 2.1 time: 0.239987 May 28 04:49:51.803016 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1937/3781] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:51 2022] GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 1290 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:51.803368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e3c27707-0c82-49b4-93b4-5080259b375d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:51.803368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e3c27707-0c82-49b4-93b4-5080259b375d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:51.803368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e3c27707-0c82-49b4-93b4-5080259b375d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:51.803368 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e3c27707-0c82-49b4-93b4-5080259b375d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.182622 May 28 04:49:51.812642 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1845/3782] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:51 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:52.473607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ebb14785-65a6-40a1-86fb-9548914f0eec tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:52.479869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ebb14785-65a6-40a1-86fb-9548914f0eec tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:52.496740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ebb14785-65a6-40a1-86fb-9548914f0eec tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:52.497652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ebb14785-65a6-40a1-86fb-9548914f0eec tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:52.501981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ebb14785-65a6-40a1-86fb-9548914f0eec tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:52.508986 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ebb14785-65a6-40a1-86fb-9548914f0eec tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:52.596205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-341097fe-dac7-4386-8792-5b7ec8e57aaf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:52.602011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-341097fe-dac7-4386-8792-5b7ec8e57aaf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:52.609924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-341097fe-dac7-4386-8792-5b7ec8e57aaf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:52.611792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-341097fe-dac7-4386-8792-5b7ec8e57aaf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:52.612779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-341097fe-dac7-4386-8792-5b7ec8e57aaf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:52.614163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-341097fe-dac7-4386-8792-5b7ec8e57aaf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:53.153496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ebb14785-65a6-40a1-86fb-9548914f0eec tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:53.162117 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ebb14785-65a6-40a1-86fb-9548914f0eec tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 200 len: 1315 microversion: 2.1 time: 0.697208 May 28 04:49:53.168085 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1938/3783] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:52 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 1315 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:53.175400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-30f51476-3b5c-41bc-81e1-5fd385448012 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:53.178580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-30f51476-3b5c-41bc-81e1-5fd385448012 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:53.183361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-341097fe-dac7-4386-8792-5b7ec8e57aaf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:53.190672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30f51476-3b5c-41bc-81e1-5fd385448012 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:53.191461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30f51476-3b5c-41bc-81e1-5fd385448012 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:53.192865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30f51476-3b5c-41bc-81e1-5fd385448012 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:53.193592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30f51476-3b5c-41bc-81e1-5fd385448012 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:53.198683 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-341097fe-dac7-4386-8792-5b7ec8e57aaf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 200 len: 1508 microversion: 2.1 time: 0.606277 May 28 04:49:53.215466 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1846/3784] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:52 2022] GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 1508 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:53.221455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-15f8c6a5-8aa4-49e5-92a1-3ee8c7a1429c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:53.229253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-15f8c6a5-8aa4-49e5-92a1-3ee8c7a1429c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:53.240434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15f8c6a5-8aa4-49e5-92a1-3ee8c7a1429c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:53.241916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15f8c6a5-8aa4-49e5-92a1-3ee8c7a1429c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:53.248196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15f8c6a5-8aa4-49e5-92a1-3ee8c7a1429c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:53.249027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15f8c6a5-8aa4-49e5-92a1-3ee8c7a1429c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:53.280178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-30f51476-3b5c-41bc-81e1-5fd385448012 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:53.292365 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-30f51476-3b5c-41bc-81e1-5fd385448012 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 200 len: 1278 microversion: 2.1 time: 0.122904 May 28 04:49:53.294352 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1939/3785] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:53 2022] GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 1278 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:53.881740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-15f8c6a5-8aa4-49e5-92a1-3ee8c7a1429c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:53.897422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-15f8c6a5-8aa4-49e5-92a1-3ee8c7a1429c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:53.899466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-15f8c6a5-8aa4-49e5-92a1-3ee8c7a1429c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:53.900695 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-15f8c6a5-8aa4-49e5-92a1-3ee8c7a1429c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.683883 May 28 04:49:53.919369 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1847/3786] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:53 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:54.186680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ab1379ac-d980-45bb-93a5-a9cf2ce1789e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:54.188068 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ab1379ac-d980-45bb-93a5-a9cf2ce1789e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:54.223157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab1379ac-d980-45bb-93a5-a9cf2ce1789e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:54.223157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab1379ac-d980-45bb-93a5-a9cf2ce1789e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:54.223573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a4867395-e6b0-46da-9f25-10f838a37598 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:54.224085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab1379ac-d980-45bb-93a5-a9cf2ce1789e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:54.224176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a4867395-e6b0-46da-9f25-10f838a37598 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:54.224262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab1379ac-d980-45bb-93a5-a9cf2ce1789e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:54.224357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:54.238271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4867395-e6b0-46da-9f25-10f838a37598 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:54.238732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4867395-e6b0-46da-9f25-10f838a37598 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:54.254549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4867395-e6b0-46da-9f25-10f838a37598 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:54.254693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4867395-e6b0-46da-9f25-10f838a37598 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:54.744335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ab1379ac-d980-45bb-93a5-a9cf2ce1789e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:54.773659 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ab1379ac-d980-45bb-93a5-a9cf2ce1789e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 200 len: 1315 microversion: 2.1 time: 0.586791 May 28 04:49:54.776214 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1940/3787] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:54 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 1315 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:54.783595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-402cf6ff-9943-4894-96de-7c4d11fa96a2 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:54.810284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-402cf6ff-9943-4894-96de-7c4d11fa96a2 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:54.830540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-402cf6ff-9943-4894-96de-7c4d11fa96a2 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:54.831014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-402cf6ff-9943-4894-96de-7c4d11fa96a2 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:54.839899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-402cf6ff-9943-4894-96de-7c4d11fa96a2 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:54.840359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-402cf6ff-9943-4894-96de-7c4d11fa96a2 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:54.929997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a4867395-e6b0-46da-9f25-10f838a37598 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:54.952252 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a4867395-e6b0-46da-9f25-10f838a37598 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 200 len: 1508 microversion: 2.1 time: 0.736240 May 28 04:49:54.953830 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1848/3788] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:54 2022] GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 1508 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:54.968948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-56cd19f6-872a-4e0a-ba64-b9cf0f6f4aa0 req-08cf782e-ec57-453e-aa4a-da71ed9c17d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde949cb-a966-4689-b421-e8f1c21b58e4", "name": "network-vif-plugged", "status": "completed", "tag": "86fc4516-0fd0-4b05-9b84-709e24cafb31"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:55.001336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-56cd19f6-872a-4e0a-ba64-b9cf0f6f4aa0 req-08cf782e-ec57-453e-aa4a-da71ed9c17d7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:55.002882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-56cd19f6-872a-4e0a-ba64-b9cf0f6f4aa0 req-08cf782e-ec57-453e-aa4a-da71ed9c17d7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:55.048425 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-56cd19f6-872a-4e0a-ba64-b9cf0f6f4aa0 req-08cf782e-ec57-453e-aa4a-da71ed9c17d7 service nova] Creating event network-vif-plugged:86fc4516-0fd0-4b05-9b84-709e24cafb31 for instance dde949cb-a966-4689-b421-e8f1c21b58e4 on n-h1-843700-1 May 28 04:49:55.071490 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-56cd19f6-872a-4e0a-ba64-b9cf0f6f4aa0 req-08cf782e-ec57-453e-aa4a-da71ed9c17d7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101824 May 28 04:49:55.079295 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1849/3789] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:55.098393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1e6d7d77-564b-4cb0-b1ff-ff9bc6042ece tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:55.099332 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1e6d7d77-564b-4cb0-b1ff-ff9bc6042ece tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:55.111692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:55.113634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e6d7d77-564b-4cb0-b1ff-ff9bc6042ece tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:55.114234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e6d7d77-564b-4cb0-b1ff-ff9bc6042ece tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:55.122141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e6d7d77-564b-4cb0-b1ff-ff9bc6042ece tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:55.128121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e6d7d77-564b-4cb0-b1ff-ff9bc6042ece tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:55.342262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1e6d7d77-564b-4cb0-b1ff-ff9bc6042ece tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:55.368819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1e6d7d77-564b-4cb0-b1ff-ff9bc6042ece tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:55.370397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1e6d7d77-564b-4cb0-b1ff-ff9bc6042ece tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:55.371857 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1e6d7d77-564b-4cb0-b1ff-ff9bc6042ece tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.290894 May 28 04:49:55.395251 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1850/3790] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:55 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:55.448903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-402cf6ff-9943-4894-96de-7c4d11fa96a2 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:55.461012 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-402cf6ff-9943-4894-96de-7c4d11fa96a2 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 200 len: 1320 microversion: 2.1 time: 0.681365 May 28 04:49:55.462269 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1941/3791] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:54 2022] GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 1320 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:55.790529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-70a0dc3e-a896-4cae-a39b-0b3ea6443d00 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:55.797258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-70a0dc3e-a896-4cae-a39b-0b3ea6443d00 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:55.808516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-3c0269a1-c1ad-4f86-bbc7-0330c02dcff2 req-cbf67044-f3d7-409f-88b1-e9cb806cc5ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0341fb99-a637-4739-b319-b6b0b39b71b0", "name": "network-vif-deleted", "tag": "f0590ddd-1efd-477d-8e28-4ad8189f96d5"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:55.825303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70a0dc3e-a896-4cae-a39b-0b3ea6443d00 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:55.825903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-3c0269a1-c1ad-4f86-bbc7-0330c02dcff2 req-cbf67044-f3d7-409f-88b1-e9cb806cc5ea service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:55.827530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70a0dc3e-a896-4cae-a39b-0b3ea6443d00 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:55.827910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-3c0269a1-c1ad-4f86-bbc7-0330c02dcff2 req-cbf67044-f3d7-409f-88b1-e9cb806cc5ea service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:55.828922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70a0dc3e-a896-4cae-a39b-0b3ea6443d00 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:55.831986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70a0dc3e-a896-4cae-a39b-0b3ea6443d00 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:55.858241 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-3c0269a1-c1ad-4f86-bbc7-0330c02dcff2 req-cbf67044-f3d7-409f-88b1-e9cb806cc5ea service nova] Creating event network-vif-deleted:f0590ddd-1efd-477d-8e28-4ad8189f96d5 for instance 0341fb99-a637-4739-b319-b6b0b39b71b0 on n-h2-843700-1 May 28 04:49:55.873810 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-3c0269a1-c1ad-4f86-bbc7-0330c02dcff2 req-cbf67044-f3d7-409f-88b1-e9cb806cc5ea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067795 May 28 04:49:55.875614 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1942/3792] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:49:55.970831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-35ef72a8-21d0-4e86-93ff-7996ddeb7fe0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:55.971731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-35ef72a8-21d0-4e86-93ff-7996ddeb7fe0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:55.988925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35ef72a8-21d0-4e86-93ff-7996ddeb7fe0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:55.994026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35ef72a8-21d0-4e86-93ff-7996ddeb7fe0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:55.995371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35ef72a8-21d0-4e86-93ff-7996ddeb7fe0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:55.997500 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35ef72a8-21d0-4e86-93ff-7996ddeb7fe0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:56.204747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-35ef72a8-21d0-4e86-93ff-7996ddeb7fe0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:56.216126 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-35ef72a8-21d0-4e86-93ff-7996ddeb7fe0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 200 len: 1306 microversion: 2.1 time: 0.249119 May 28 04:49:56.220652 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1943/3793] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:55 2022] GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 1306 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:56.232654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-741c1887-7867-4006-8874-c2bbab159576 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2006887536", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "ab9f6027-e911-40b5-9b5f-2d9406163b57"}, {"uuid": "2b4cf6fb-388e-4f0b-9060-71f94bafb7f1"}, {"uuid": "ab9f6027-e911-40b5-9b5f-2d9406163b57"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:56.352049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:56.363345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-741c1887-7867-4006-8874-c2bbab159576 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] validate_networks() for [('ab9f6027-e911-40b5-9b5f-2d9406163b57', None, None, None, None, None), ('2b4cf6fb-388e-4f0b-9060-71f94bafb7f1', None, None, None, None, None), ('ab9f6027-e911-40b5-9b5f-2d9406163b57', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:49:56.474864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=8 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:56.485402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-70a0dc3e-a896-4cae-a39b-0b3ea6443d00 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:56.494757 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-70a0dc3e-a896-4cae-a39b-0b3ea6443d00 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 200 len: 1315 microversion: 2.1 time: 0.709535 May 28 04:49:56.503756 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1851/3794] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:55 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 1315 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:56.509624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6c8f8ab0-e673-45d3-97bc-68cd209888ca tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:56.510373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6c8f8ab0-e673-45d3-97bc-68cd209888ca tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:56.534901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c8f8ab0-e673-45d3-97bc-68cd209888ca tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:56.542825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c8f8ab0-e673-45d3-97bc-68cd209888ca tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:56.542825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c8f8ab0-e673-45d3-97bc-68cd209888ca tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:56.542825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c8f8ab0-e673-45d3-97bc-68cd209888ca tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:56.694042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6c8f8ab0-e673-45d3-97bc-68cd209888ca tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:56.764977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6c8f8ab0-e673-45d3-97bc-68cd209888ca tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:56.766568 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6c8f8ab0-e673-45d3-97bc-68cd209888ca tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:56.767858 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6c8f8ab0-e673-45d3-97bc-68cd209888ca tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.262855 May 28 04:49:56.787873 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1852/3795] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:56 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:56.792731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-73953bc3-9d73-4b12-a56a-1f84c7ad6a15 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:56.795494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-73953bc3-9d73-4b12-a56a-1f84c7ad6a15 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:56.814295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73953bc3-9d73-4b12-a56a-1f84c7ad6a15 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:56.815775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73953bc3-9d73-4b12-a56a-1f84c7ad6a15 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:56.819811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73953bc3-9d73-4b12-a56a-1f84c7ad6a15 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:56.822554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73953bc3-9d73-4b12-a56a-1f84c7ad6a15 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:56.837448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:57.433708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-73953bc3-9d73-4b12-a56a-1f84c7ad6a15 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:57.451493 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-73953bc3-9d73-4b12-a56a-1f84c7ad6a15 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 200 len: 1320 microversion: 2.1 time: 0.662540 May 28 04:49:57.461437 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1853/3796] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:56 2022] GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 1320 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:57.466958 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f8d0ecb1-eae9-40a9-ba68-5e0c50f91f6f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:57.467659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f8d0ecb1-eae9-40a9-ba68-5e0c50f91f6f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:57.480398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8d0ecb1-eae9-40a9-ba68-5e0c50f91f6f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:57.486488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8d0ecb1-eae9-40a9-ba68-5e0c50f91f6f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:57.487647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8d0ecb1-eae9-40a9-ba68-5e0c50f91f6f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:57.488109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8d0ecb1-eae9-40a9-ba68-5e0c50f91f6f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:57.523158 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-f8d0ecb1-eae9-40a9-ba68-5e0c50f91f6f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance 0341fb99-a637-4739-b319-b6b0b39b71b0 could not be found. May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f8d0ecb1-eae9-40a9-ba68-5e0c50f91f6f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 HTTP/1.1 May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 0341fb99-a637-4739-b319-b6b0b39b71b0 could not be found. May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '0341fb99-a637-4739-b319-b6b0b39b71b0'} May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0341fb99-a637-4739-b319-b6b0b39b71b0 could not be found. May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0341fb99-a637-4739-b319-b6b0b39b71b0 could not be found. May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:57.532547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:49:57.537263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:49:57.537263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:49:57.537263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:49:57.537263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:49:57.537263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0341fb99-a637-4739-b319-b6b0b39b71b0 could not be found. May 28 04:49:57.537263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:49:57.537263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f8d0ecb1-eae9-40a9-ba68-5e0c50f91f6f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance 0341fb99-a637-4739-b319-b6b0b39b71b0 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:49:57.537263 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f8d0ecb1-eae9-40a9-ba68-5e0c50f91f6f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 404 len: 111 microversion: 2.1 time: 0.079937 May 28 04:49:57.537263 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1854/3797] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:57 2022] GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:49:57.560822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ebb8d8b0-34b7-4baf-ab84-d4876a74e18a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:57.561462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ebb8d8b0-34b7-4baf-ab84-d4876a74e18a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:57.577168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebb8d8b0-34b7-4baf-ab84-d4876a74e18a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:57.577596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebb8d8b0-34b7-4baf-ab84-d4876a74e18a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:57.579028 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebb8d8b0-34b7-4baf-ab84-d4876a74e18a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:57.579487 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebb8d8b0-34b7-4baf-ab84-d4876a74e18a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:58.041730 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ebb8d8b0-34b7-4baf-ab84-d4876a74e18a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:58.058803 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ebb8d8b0-34b7-4baf-ab84-d4876a74e18a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 200 len: 1502 microversion: 2.1 time: 0.502818 May 28 04:49:58.062434 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1855/3798] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:57 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 1502 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:58.076090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-25c54472-12a8-46ca-836c-055a28eabb60 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Action: 'create', calling method: .version_select at 0x7f7700976280>, body: {"keypair": {"name": "tempest-key-1976251185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKREcAcHtfW017gOIgD5YzBLAIB0v818zwg4/iiy1zAJm1Yebo0GsQhgLaSUi8qmDVsj+VEPGLSAZg4/f2QQaWMSUCodDHeUN/N+voDfPzhzd093zG8fky84RpqymcxjxA=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:58.117112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=33 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:58.122627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-25c54472-12a8-46ca-836c-055a28eabb60 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Getting quotas for project 724a5513bc2c42eabbefa450e207453e. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:49:58.128729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-25c54472-12a8-46ca-836c-055a28eabb60 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Getting quotas for user 71b6b3ac5a4249fd8f76fb2e7e2b6c18 and project 724a5513bc2c42eabbefa450e207453e. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:49:58.282781 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-25c54472-12a8-46ca-836c-055a28eabb60 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.217754 May 28 04:49:58.284515 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1856/3799] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:49:58 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:58.290410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a437c1e8-3e7c-41c9-bfbf-8188e689d52d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:58.295919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a437c1e8-3e7c-41c9-bfbf-8188e689d52d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:58.315275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a437c1e8-3e7c-41c9-bfbf-8188e689d52d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:58.319902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a437c1e8-3e7c-41c9-bfbf-8188e689d52d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:58.321188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a437c1e8-3e7c-41c9-bfbf-8188e689d52d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:58.331792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a437c1e8-3e7c-41c9-bfbf-8188e689d52d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:58.426925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a437c1e8-3e7c-41c9-bfbf-8188e689d52d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:58.436304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a437c1e8-3e7c-41c9-bfbf-8188e689d52d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:58.437817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a437c1e8-3e7c-41c9-bfbf-8188e689d52d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:58.441622 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a437c1e8-3e7c-41c9-bfbf-8188e689d52d tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.155799 May 28 04:49:58.442219 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1857/3800] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:58 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:49:58.464656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-5d062cfd-a0a1-49ef-bad1-87d63f00f636 req-1d8142fa-41a0-41d9-b8b4-621e6a1bf9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77", "tag": "d4a489f1-c611-4635-8c85-3f52355d1a3b"}, {"name": "network-changed", "server_uuid": "56c93f52-dc2a-43c2-a82d-43cfee1b58d5", "tag": "119f2bb6-0470-4ce3-99b9-75bc2c9be087"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:58.480892 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5d062cfd-a0a1-49ef-bad1-87d63f00f636 req-1d8142fa-41a0-41d9-b8b4-621e6a1bf9c0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:58.485400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5d062cfd-a0a1-49ef-bad1-87d63f00f636 req-1d8142fa-41a0-41d9-b8b4-621e6a1bf9c0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:58.512652 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-5d062cfd-a0a1-49ef-bad1-87d63f00f636 req-1d8142fa-41a0-41d9-b8b4-621e6a1bf9c0 service nova] Creating event network-changed:d4a489f1-c611-4635-8c85-3f52355d1a3b for instance ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77 on n-h2-843700-1 May 28 04:49:58.513851 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-5d062cfd-a0a1-49ef-bad1-87d63f00f636 req-1d8142fa-41a0-41d9-b8b4-621e6a1bf9c0 service nova] Creating event network-changed:119f2bb6-0470-4ce3-99b9-75bc2c9be087 for instance 56c93f52-dc2a-43c2-a82d-43cfee1b58d5 on n-h2-843700-1 May 28 04:49:58.521537 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-5d062cfd-a0a1-49ef-bad1-87d63f00f636 req-1d8142fa-41a0-41d9-b8b4-621e6a1bf9c0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.061712 May 28 04:49:58.522164 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1858/3801] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:58.537153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7d7fc4d9-812b-4d3f-a2f9-519d3f95f83e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:58.537793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7d7fc4d9-812b-4d3f-a2f9-519d3f95f83e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:58.551416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d7fc4d9-812b-4d3f-a2f9-519d3f95f83e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:58.551877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d7fc4d9-812b-4d3f-a2f9-519d3f95f83e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:58.552669 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d7fc4d9-812b-4d3f-a2f9-519d3f95f83e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:58.553114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d7fc4d9-812b-4d3f-a2f9-519d3f95f83e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:58.896556 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.network.security_group_api [None req-7d7fc4d9-812b-4d3f-a2f9-519d3f95f83e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Removing security group 66f9674d-3a1e-4f61-a8bf-b9c3916c16ec from port 86fc4516-0fd0-4b05-9b84-709e24cafb31 May 28 04:49:58.910504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-741c1887-7867-4006-8874-c2bbab159576 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:49:58.911028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-741c1887-7867-4006-8874-c2bbab159576 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:49:58.915742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-741c1887-7867-4006-8874-c2bbab159576 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:49:58.915742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-741c1887-7867-4006-8874-c2bbab159576 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:49:58.915742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-741c1887-7867-4006-8874-c2bbab159576 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:49:58.922681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-741c1887-7867-4006-8874-c2bbab159576 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:58.923272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-741c1887-7867-4006-8874-c2bbab159576 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:58.924167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-741c1887-7867-4006-8874-c2bbab159576 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:58.924685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-741c1887-7867-4006-8874-c2bbab159576 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:58.996402 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-741c1887-7867-4006-8874-c2bbab159576 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Getting quotas for project 8f07539e283643c6b7bdc2c90ffa2ce1. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:49:59.011496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-741c1887-7867-4006-8874-c2bbab159576 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Getting quotas for user 9dd8bc74fda8476692c24f7c8b8f4b1c and project 8f07539e283643c6b7bdc2c90ffa2ce1. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:49:59.044450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-741c1887-7867-4006-8874-c2bbab159576 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:49:59.046764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-741c1887-7867-4006-8874-c2bbab159576 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:49:59.093037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:49:59.231354 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-741c1887-7867-4006-8874-c2bbab159576 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.008879 May 28 04:49:59.232897 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1944/3802] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:49:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:49:59.238564 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a439943b-e3f9-4b25-9023-90f9a9c1b2e9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '.version_select at 0x7f7700de85e0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:59.243004 n-d-843700-1 devstack@n-api.service[126044]: WARNING oslo_db.sqlalchemy.utils [None req-a439943b-e3f9-4b25-9023-90f9a9c1b2e9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Unique keys not in sort_keys. The sorting order may be unstable. May 28 04:49:59.249753 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a439943b-e3f9-4b25-9023-90f9a9c1b2e9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.015355 May 28 04:49:59.261272 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1945/3803] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:49:59 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:59.265926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-65fe8160-e57d-4c8c-b70c-f355c7507f0b req-2364e7cc-e9cd-4f8c-b4d2-5e9cec99c2ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af250cc0-2e14-4c5b-8de6-91fa9b9356b5", "tag": "e57ffcf5-6a04-4477-9413-a2c6603b8aeb"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:59.304517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-65fe8160-e57d-4c8c-b70c-f355c7507f0b req-2364e7cc-e9cd-4f8c-b4d2-5e9cec99c2ee service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:59.306307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-65fe8160-e57d-4c8c-b70c-f355c7507f0b req-2364e7cc-e9cd-4f8c-b4d2-5e9cec99c2ee service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:59.337871 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-65fe8160-e57d-4c8c-b70c-f355c7507f0b req-2364e7cc-e9cd-4f8c-b4d2-5e9cec99c2ee service nova] Creating event network-changed:e57ffcf5-6a04-4477-9413-a2c6603b8aeb for instance af250cc0-2e14-4c5b-8de6-91fa9b9356b5 on n-h1-843700-1 May 28 04:49:59.347258 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-65fe8160-e57d-4c8c-b70c-f355c7507f0b req-2364e7cc-e9cd-4f8c-b4d2-5e9cec99c2ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091785 May 28 04:49:59.351813 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1946/3804] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:49:59.378361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cf584da2-f127-4140-b631-144cf39e94a0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:59.380557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cf584da2-f127-4140-b631-144cf39e94a0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:59.399382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf584da2-f127-4140-b631-144cf39e94a0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:59.403552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf584da2-f127-4140-b631-144cf39e94a0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:59.403552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf584da2-f127-4140-b631-144cf39e94a0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:59.406508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf584da2-f127-4140-b631-144cf39e94a0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:59.762613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cf584da2-f127-4140-b631-144cf39e94a0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:59.773421 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cf584da2-f127-4140-b631-144cf39e94a0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 200 len: 1320 microversion: 2.1 time: 0.419537 May 28 04:49:59.774088 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1947/3805] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:59 2022] GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 1320 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:59.788196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ace16bbe-6b74-4e8b-9bc5-41a93ecb5265 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:59.788810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ace16bbe-6b74-4e8b-9bc5-41a93ecb5265 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:59.847820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ace16bbe-6b74-4e8b-9bc5-41a93ecb5265 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:49:59.865361 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ace16bbe-6b74-4e8b-9bc5-41a93ecb5265 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1213 microversion: 2.1 time: 0.080823 May 28 04:49:59.867119 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1948/3806] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:49:59 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:49:59.872210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-415f9c97-73a4-41d1-86c4-3d09b616e99a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-192563350", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "key_name": "tempest-key-1976251185", "networks": [{"uuid": "fd0d7eb0-eb78-443c-941c-e203b5533601"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:49:59.936002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-415f9c97-73a4-41d1-86c4-3d09b616e99a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] validate_networks() for [('fd0d7eb0-eb78-443c-941c-e203b5533601', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:49:59.981039 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7d7fc4d9-812b-4d3f-a2f9-519d3f95f83e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4/action" status: 202 len: 0 microversion: 2.1 time: 1.449917 May 28 04:49:59.981039 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1859/3807] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:49:58 2022] POST /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4/action => generated 0 bytes in 1456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:49:59.985035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b180f44c-d0fa-4f76-8688-0baff4421b2f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:49:59.985724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b180f44c-d0fa-4f76-8688-0baff4421b2f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:49:59.997222 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b180f44c-d0fa-4f76-8688-0baff4421b2f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:49:59.998096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b180f44c-d0fa-4f76-8688-0baff4421b2f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:49:59.999437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b180f44c-d0fa-4f76-8688-0baff4421b2f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:00.000220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b180f44c-d0fa-4f76-8688-0baff4421b2f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:00.155869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b180f44c-d0fa-4f76-8688-0baff4421b2f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:00.204260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b180f44c-d0fa-4f76-8688-0baff4421b2f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:00.204260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b180f44c-d0fa-4f76-8688-0baff4421b2f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:00.204260 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b180f44c-d0fa-4f76-8688-0baff4421b2f tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.223112 May 28 04:50:00.205063 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1860/3808] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:49:59 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:00.210892 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8e80d5fb-ab83-4370-8cdb-167299cd305b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:00.212531 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8e80d5fb-ab83-4370-8cdb-167299cd305b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:00.219782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e80d5fb-ab83-4370-8cdb-167299cd305b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:00.220600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e80d5fb-ab83-4370-8cdb-167299cd305b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:00.222027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e80d5fb-ab83-4370-8cdb-167299cd305b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:00.222855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e80d5fb-ab83-4370-8cdb-167299cd305b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:00.396136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8e80d5fb-ab83-4370-8cdb-167299cd305b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:00.412513 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8e80d5fb-ab83-4370-8cdb-167299cd305b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 200 len: 1460 microversion: 2.1 time: 0.206001 May 28 04:50:00.413840 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1861/3809] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:00 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 1460 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:00.429537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-31a3a118-c562-4802-b8f6-1b7c10ac0ad5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:00.431532 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-31a3a118-c562-4802-b8f6-1b7c10ac0ad5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:00.438203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31a3a118-c562-4802-b8f6-1b7c10ac0ad5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:00.438750 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31a3a118-c562-4802-b8f6-1b7c10ac0ad5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:00.439681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31a3a118-c562-4802-b8f6-1b7c10ac0ad5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:00.440695 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31a3a118-c562-4802-b8f6-1b7c10ac0ad5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:01.062391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-31a3a118-c562-4802-b8f6-1b7c10ac0ad5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:01.076656 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-31a3a118-c562-4802-b8f6-1b7c10ac0ad5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.648431 May 28 04:50:01.088659 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1862/3810] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:00 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:01.104400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9fc9ab25-c983-46a3-8973-161ef70979e4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:01.105362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9fc9ab25-c983-46a3-8973-161ef70979e4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:01.124668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fc9ab25-c983-46a3-8973-161ef70979e4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:01.133388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fc9ab25-c983-46a3-8973-161ef70979e4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:01.134739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fc9ab25-c983-46a3-8973-161ef70979e4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:01.135552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fc9ab25-c983-46a3-8973-161ef70979e4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:01.465351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-415f9c97-73a4-41d1-86c4-3d09b616e99a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:50:01.466562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-415f9c97-73a4-41d1-86c4-3d09b616e99a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:50:01.467306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-415f9c97-73a4-41d1-86c4-3d09b616e99a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:50:01.467938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-415f9c97-73a4-41d1-86c4-3d09b616e99a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:50:01.468605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-415f9c97-73a4-41d1-86c4-3d09b616e99a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:50:01.486319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-415f9c97-73a4-41d1-86c4-3d09b616e99a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:01.492878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-415f9c97-73a4-41d1-86c4-3d09b616e99a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:01.492878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-415f9c97-73a4-41d1-86c4-3d09b616e99a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:01.492878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-415f9c97-73a4-41d1-86c4-3d09b616e99a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:01.500028 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9fc9ab25-c983-46a3-8973-161ef70979e4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:01.509074 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9fc9ab25-c983-46a3-8973-161ef70979e4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 200 len: 1320 microversion: 2.1 time: 0.419201 May 28 04:50:01.515422 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1863/3811] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:01 2022] GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 1320 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:01.525086 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-623f245c-3eba-44bf-a778-0f5f1fc79e4b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:01.526067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-623f245c-3eba-44bf-a778-0f5f1fc79e4b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:01.546502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-623f245c-3eba-44bf-a778-0f5f1fc79e4b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:01.551154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-623f245c-3eba-44bf-a778-0f5f1fc79e4b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:01.551154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-623f245c-3eba-44bf-a778-0f5f1fc79e4b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:01.551154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-623f245c-3eba-44bf-a778-0f5f1fc79e4b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:01.553086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-415f9c97-73a4-41d1-86c4-3d09b616e99a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Getting quotas for project 724a5513bc2c42eabbefa450e207453e. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:50:01.563537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-415f9c97-73a4-41d1-86c4-3d09b616e99a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Getting quotas for user 71b6b3ac5a4249fd8f76fb2e7e2b6c18 and project 724a5513bc2c42eabbefa450e207453e. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:50:01.602447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-415f9c97-73a4-41d1-86c4-3d09b616e99a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:50:01.609310 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-415f9c97-73a4-41d1-86c4-3d09b616e99a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:50:01.700818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-623f245c-3eba-44bf-a778-0f5f1fc79e4b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:01.709171 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-623f245c-3eba-44bf-a778-0f5f1fc79e4b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1209 microversion: 2.1 time: 0.192413 May 28 04:50:01.719611 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1864/3812] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:01 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1209 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:01.724839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5adb7757-41a6-4aa2-a926-8c3a2e7516cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:01.726212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5adb7757-41a6-4aa2-a926-8c3a2e7516cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:01.732754 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5adb7757-41a6-4aa2-a926-8c3a2e7516cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:01.733459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5adb7757-41a6-4aa2-a926-8c3a2e7516cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:01.734430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5adb7757-41a6-4aa2-a926-8c3a2e7516cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:01.735097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5adb7757-41a6-4aa2-a926-8c3a2e7516cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:01.816165 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-415f9c97-73a4-41d1-86c4-3d09b616e99a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.940136 May 28 04:50:01.825947 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1949/3813] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:49:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:50:01.842813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a665e758-9fd8-48d3-8709-d17f3ed0eff0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:01.848227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a665e758-9fd8-48d3-8709-d17f3ed0eff0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:01.862808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a665e758-9fd8-48d3-8709-d17f3ed0eff0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:01.865552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a665e758-9fd8-48d3-8709-d17f3ed0eff0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:01.867776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a665e758-9fd8-48d3-8709-d17f3ed0eff0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:01.868304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a665e758-9fd8-48d3-8709-d17f3ed0eff0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:02.054135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a665e758-9fd8-48d3-8709-d17f3ed0eff0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:02.068451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5adb7757-41a6-4aa2-a926-8c3a2e7516cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:02.078974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a665e758-9fd8-48d3-8709-d17f3ed0eff0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:02.087178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a665e758-9fd8-48d3-8709-d17f3ed0eff0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:02.092970 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a665e758-9fd8-48d3-8709-d17f3ed0eff0 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.262408 May 28 04:50:02.095125 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1950/3814] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:01 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:02.100165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-f92719e8-786f-4131-8f1b-7a341cf0a545 req-0343bb8b-8f48-47af-9338-e7036a3b9a19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde949cb-a966-4689-b421-e8f1c21b58e4", "tag": "86fc4516-0fd0-4b05-9b84-709e24cafb31"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:02.102167 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5adb7757-41a6-4aa2-a926-8c3a2e7516cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.381284 May 28 04:50:02.104661 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1865/3815] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:01 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:02.136444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f92719e8-786f-4131-8f1b-7a341cf0a545 req-0343bb8b-8f48-47af-9338-e7036a3b9a19 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:02.136905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f92719e8-786f-4131-8f1b-7a341cf0a545 req-0343bb8b-8f48-47af-9338-e7036a3b9a19 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:02.142903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ceba3cf2-2fc6-45f5-98e0-f91a066252ae tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:02.145068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ceba3cf2-2fc6-45f5-98e0-f91a066252ae tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:02.164785 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-f92719e8-786f-4131-8f1b-7a341cf0a545 req-0343bb8b-8f48-47af-9338-e7036a3b9a19 service nova] Creating event network-changed:86fc4516-0fd0-4b05-9b84-709e24cafb31 for instance dde949cb-a966-4689-b421-e8f1c21b58e4 on n-h1-843700-1 May 28 04:50:02.181943 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-f92719e8-786f-4131-8f1b-7a341cf0a545 req-0343bb8b-8f48-47af-9338-e7036a3b9a19 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085005 May 28 04:50:02.183298 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1951/3816] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:02.188602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-64be967c-0806-4990-825d-2d177289fae9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:02.193424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-64be967c-0806-4990-825d-2d177289fae9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:02.211106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64be967c-0806-4990-825d-2d177289fae9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:02.212422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64be967c-0806-4990-825d-2d177289fae9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:02.213291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64be967c-0806-4990-825d-2d177289fae9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:02.213737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64be967c-0806-4990-825d-2d177289fae9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:02.312830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ceba3cf2-2fc6-45f5-98e0-f91a066252ae tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:02.324253 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ceba3cf2-2fc6-45f5-98e0-f91a066252ae tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d" status: 200 len: 1228 microversion: 2.1 time: 0.217803 May 28 04:50:02.327516 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1866/3817] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:02 2022] GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d => generated 1228 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:02.532858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53bf206a-b824-4a60-9373-0200d3b45317 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:02.533499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-53bf206a-b824-4a60-9373-0200d3b45317 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:02.575751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-64be967c-0806-4990-825d-2d177289fae9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:02.581816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53bf206a-b824-4a60-9373-0200d3b45317 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:02.586670 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-64be967c-0806-4990-825d-2d177289fae9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.401957 May 28 04:50:02.587258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53bf206a-b824-4a60-9373-0200d3b45317 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:02.597843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53bf206a-b824-4a60-9373-0200d3b45317 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:02.598001 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1952/3818] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:02 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:02.598105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53bf206a-b824-4a60-9373-0200d3b45317 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:02.604194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-653b5648-1ef4-4895-836d-ca4ae698ba9a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:02.604822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-653b5648-1ef4-4895-836d-ca4ae698ba9a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:02.617616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-653b5648-1ef4-4895-836d-ca4ae698ba9a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:02.618074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-653b5648-1ef4-4895-836d-ca4ae698ba9a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:02.618853 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-653b5648-1ef4-4895-836d-ca4ae698ba9a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:02.619331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-653b5648-1ef4-4895-836d-ca4ae698ba9a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:02.994635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-53bf206a-b824-4a60-9373-0200d3b45317 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:02.997328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-653b5648-1ef4-4895-836d-ca4ae698ba9a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:03.007727 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-53bf206a-b824-4a60-9373-0200d3b45317 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 200 len: 1320 microversion: 2.1 time: 0.481902 May 28 04:50:03.007863 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-653b5648-1ef4-4895-836d-ca4ae698ba9a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.409321 May 28 04:50:03.010078 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1867/3819] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:02 2022] GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 1320 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:03.027715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-624e25b0-9223-43f1-bc4d-7f55d1bf4e41 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:03.030082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-624e25b0-9223-43f1-bc4d-7f55d1bf4e41 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:03.034080 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1953/3820] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:02 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:03.042278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-a89524a3-942a-463b-8f1e-00a933eb3d32 req-a6b3f8d2-7187-4794-85a9-56a28cc3ea1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77", "name": "network-vif-plugged", "status": "completed", "tag": "d4a489f1-c611-4635-8c85-3f52355d1a3b"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:03.052654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-624e25b0-9223-43f1-bc4d-7f55d1bf4e41 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:03.054296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-624e25b0-9223-43f1-bc4d-7f55d1bf4e41 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:03.055518 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-624e25b0-9223-43f1-bc4d-7f55d1bf4e41 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:03.056632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-624e25b0-9223-43f1-bc4d-7f55d1bf4e41 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:03.066605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a89524a3-942a-463b-8f1e-00a933eb3d32 req-a6b3f8d2-7187-4794-85a9-56a28cc3ea1b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:03.067081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a89524a3-942a-463b-8f1e-00a933eb3d32 req-a6b3f8d2-7187-4794-85a9-56a28cc3ea1b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:03.113699 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-a89524a3-942a-463b-8f1e-00a933eb3d32 req-a6b3f8d2-7187-4794-85a9-56a28cc3ea1b service nova] Creating event network-vif-plugged:d4a489f1-c611-4635-8c85-3f52355d1a3b for instance ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77 on n-h2-843700-1 May 28 04:50:03.125465 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-a89524a3-942a-463b-8f1e-00a933eb3d32 req-a6b3f8d2-7187-4794-85a9-56a28cc3ea1b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086927 May 28 04:50:03.127295 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1954/3821] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:03.138935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3beea092-3a91-4de7-96c3-15b0b9e9f8c1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:03.140067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3beea092-3a91-4de7-96c3-15b0b9e9f8c1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:03.150324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3beea092-3a91-4de7-96c3-15b0b9e9f8c1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:03.151012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3beea092-3a91-4de7-96c3-15b0b9e9f8c1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:03.154042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3beea092-3a91-4de7-96c3-15b0b9e9f8c1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:03.154692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3beea092-3a91-4de7-96c3-15b0b9e9f8c1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:03.282641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-624e25b0-9223-43f1-bc4d-7f55d1bf4e41 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:03.286029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3beea092-3a91-4de7-96c3-15b0b9e9f8c1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:03.299010 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-624e25b0-9223-43f1-bc4d-7f55d1bf4e41 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1271 microversion: 2.1 time: 0.286748 May 28 04:50:03.299603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3beea092-3a91-4de7-96c3-15b0b9e9f8c1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:03.310056 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1868/3822] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:03 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1271 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:03.313330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3beea092-3a91-4de7-96c3-15b0b9e9f8c1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:03.313505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8a7a920b-986f-4d8d-9370-62464c5ef6cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1805636753", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "fa4b7ae7-c4d1-4b2e-9365-36aea885e8cd"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:03.318781 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3beea092-3a91-4de7-96c3-15b0b9e9f8c1 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.188925 May 28 04:50:03.322549 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1955/3823] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:03 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:03.343622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b9d9d00b-d757-48fe-8166-f7baff3e83fe tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:03.344557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b9d9d00b-d757-48fe-8166-f7baff3e83fe tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:03.360220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b9d9d00b-d757-48fe-8166-f7baff3e83fe tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:03.360934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b9d9d00b-d757-48fe-8166-f7baff3e83fe tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:03.361918 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b9d9d00b-d757-48fe-8166-f7baff3e83fe tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:03.363560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b9d9d00b-d757-48fe-8166-f7baff3e83fe tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:03.414862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-8a7a920b-986f-4d8d-9370-62464c5ef6cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] validate_networks() for [('fa4b7ae7-c4d1-4b2e-9365-36aea885e8cd', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:50:03.509760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b9d9d00b-d757-48fe-8166-f7baff3e83fe tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:03.527973 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b9d9d00b-d757-48fe-8166-f7baff3e83fe tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d" status: 200 len: 1232 microversion: 2.1 time: 0.186952 May 28 04:50:03.531496 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1956/3824] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:03 2022] GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d => generated 1232 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:03.862205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2699a58f-18e9-48d4-be38-bdf34b8079ae tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:03.865485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2699a58f-18e9-48d4-be38-bdf34b8079ae tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:03.884147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2699a58f-18e9-48d4-be38-bdf34b8079ae tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:03.887386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2699a58f-18e9-48d4-be38-bdf34b8079ae tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:03.888279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2699a58f-18e9-48d4-be38-bdf34b8079ae tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:03.889997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2699a58f-18e9-48d4-be38-bdf34b8079ae tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:03.918133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:03.927838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2699a58f-18e9-48d4-be38-bdf34b8079ae tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:50:04.082977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-8a7a920b-986f-4d8d-9370-62464c5ef6cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:50:04.084044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-8a7a920b-986f-4d8d-9370-62464c5ef6cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:50:04.085383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-8a7a920b-986f-4d8d-9370-62464c5ef6cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:50:04.085967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-8a7a920b-986f-4d8d-9370-62464c5ef6cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:50:04.086601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-8a7a920b-986f-4d8d-9370-62464c5ef6cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:50:04.096727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a7a920b-986f-4d8d-9370-62464c5ef6cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:04.097427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a7a920b-986f-4d8d-9370-62464c5ef6cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:04.098408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a7a920b-986f-4d8d-9370-62464c5ef6cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:04.099256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a7a920b-986f-4d8d-9370-62464c5ef6cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:04.118671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-8a7a920b-986f-4d8d-9370-62464c5ef6cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Getting quotas for project b0c48bf20efd4291b37e616c658f96ff. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:50:04.130255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-8a7a920b-986f-4d8d-9370-62464c5ef6cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Getting quotas for user 6272045226334bcf8b49a0aa41a07b95 and project b0c48bf20efd4291b37e616c658f96ff. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:50:04.146958 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8a7a920b-986f-4d8d-9370-62464c5ef6cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:50:04.150072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8a7a920b-986f-4d8d-9370-62464c5ef6cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:50:04.246440 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2699a58f-18e9-48d4-be38-bdf34b8079ae tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7" status: 204 len: 0 microversion: 2.1 time: 0.388747 May 28 04:50:04.247396 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1957/3825] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:50:03 2022] DELETE /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 04:50:04.252988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a176ee3e-a5a5-488e-b72d-73142a13d278 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:04.253801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a176ee3e-a5a5-488e-b72d-73142a13d278 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:04.260729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a176ee3e-a5a5-488e-b72d-73142a13d278 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:04.261243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a176ee3e-a5a5-488e-b72d-73142a13d278 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:04.262091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a176ee3e-a5a5-488e-b72d-73142a13d278 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:04.262604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a176ee3e-a5a5-488e-b72d-73142a13d278 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:04.300091 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8a7a920b-986f-4d8d-9370-62464c5ef6cc tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996684 May 28 04:50:04.306916 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1869/3826] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:50:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:50:04.312800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4496e7e8-8481-43b5-b06b-c659b1aadcb9 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:04.313695 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4496e7e8-8481-43b5-b06b-c659b1aadcb9 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:04.325913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4496e7e8-8481-43b5-b06b-c659b1aadcb9 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:04.326619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4496e7e8-8481-43b5-b06b-c659b1aadcb9 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:04.327934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4496e7e8-8481-43b5-b06b-c659b1aadcb9 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:04.362332 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4496e7e8-8481-43b5-b06b-c659b1aadcb9 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:04.501613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a176ee3e-a5a5-488e-b72d-73142a13d278 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:04.513959 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a176ee3e-a5a5-488e-b72d-73142a13d278 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 200 len: 1320 microversion: 2.1 time: 0.261761 May 28 04:50:04.514808 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1958/3827] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:04 2022] GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 1320 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:04.527869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-71c5bdd1-2b05-4858-a971-8e80f935eab5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:04.530504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-71c5bdd1-2b05-4858-a971-8e80f935eab5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:04.612302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4496e7e8-8481-43b5-b06b-c659b1aadcb9 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19a7c36dbc14147bd823c8e1681f8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584749eada5c4f9281286bc6145c7b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:04.625814 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4496e7e8-8481-43b5-b06b-c659b1aadcb9 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7" status: 200 len: 1667 microversion: 2.1 time: 0.317001 May 28 04:50:04.631249 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1870/3828] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:04 2022] GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7 => generated 1667 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:04.643727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-71c5bdd1-2b05-4858-a971-8e80f935eab5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:04.654597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-64ce5f49-73db-4adc-ab03-66e68ea1f988 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:04.656562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-64ce5f49-73db-4adc-ab03-66e68ea1f988 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:04.656716 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-71c5bdd1-2b05-4858-a971-8e80f935eab5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1215 microversion: 2.1 time: 0.138580 May 28 04:50:04.657735 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1959/3829] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:04 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1215 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:04.663817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-21f6e062-bc15-46fb-a1d0-5c176e30b65b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:04.674569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-21f6e062-bc15-46fb-a1d0-5c176e30b65b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:04.674569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21f6e062-bc15-46fb-a1d0-5c176e30b65b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:04.674569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21f6e062-bc15-46fb-a1d0-5c176e30b65b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:04.674569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21f6e062-bc15-46fb-a1d0-5c176e30b65b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:04.674569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21f6e062-bc15-46fb-a1d0-5c176e30b65b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:04.685677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-64ce5f49-73db-4adc-ab03-66e68ea1f988 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:04.686153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-64ce5f49-73db-4adc-ab03-66e68ea1f988 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:04.686971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-64ce5f49-73db-4adc-ab03-66e68ea1f988 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:04.687448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-64ce5f49-73db-4adc-ab03-66e68ea1f988 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:04.769988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-21f6e062-bc15-46fb-a1d0-5c176e30b65b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:04.780401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-21f6e062-bc15-46fb-a1d0-5c176e30b65b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:04.793001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-21f6e062-bc15-46fb-a1d0-5c176e30b65b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:04.794550 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-21f6e062-bc15-46fb-a1d0-5c176e30b65b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.135599 May 28 04:50:04.795712 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1960/3830] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:04 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:04.800477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-de6d3e2b-67ec-4063-aaa8-380bb44ce897 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:04.803360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-de6d3e2b-67ec-4063-aaa8-380bb44ce897 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:04.815992 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de6d3e2b-67ec-4063-aaa8-380bb44ce897 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:04.817894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de6d3e2b-67ec-4063-aaa8-380bb44ce897 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:04.818943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de6d3e2b-67ec-4063-aaa8-380bb44ce897 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:04.822246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de6d3e2b-67ec-4063-aaa8-380bb44ce897 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:04.951095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-de6d3e2b-67ec-4063-aaa8-380bb44ce897 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:04.961979 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-de6d3e2b-67ec-4063-aaa8-380bb44ce897 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d" status: 200 len: 1288 microversion: 2.1 time: 0.164946 May 28 04:50:04.972873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-64ce5f49-73db-4adc-ab03-66e68ea1f988 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:04.973843 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1961/3831] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:04 2022] GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d => generated 1288 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:04.985356 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-64ce5f49-73db-4adc-ab03-66e68ea1f988 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1313 microversion: 2.1 time: 0.351862 May 28 04:50:04.986229 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1871/3832] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:04 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:05.179729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-ca682092-708a-42d0-98b6-ffd4ceff73f4 req-0981ddf8-f590-4481-9701-a397bec410d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af250cc0-2e14-4c5b-8de6-91fa9b9356b5", "name": "network-vif-plugged", "status": "completed", "tag": "e57ffcf5-6a04-4477-9413-a2c6603b8aeb"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:05.188183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ca682092-708a-42d0-98b6-ffd4ceff73f4 req-0981ddf8-f590-4481-9701-a397bec410d1 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:05.188621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ca682092-708a-42d0-98b6-ffd4ceff73f4 req-0981ddf8-f590-4481-9701-a397bec410d1 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:05.201792 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-ca682092-708a-42d0-98b6-ffd4ceff73f4 req-0981ddf8-f590-4481-9701-a397bec410d1 service nova] Creating event network-vif-plugged:e57ffcf5-6a04-4477-9413-a2c6603b8aeb for instance af250cc0-2e14-4c5b-8de6-91fa9b9356b5 on n-h1-843700-1 May 28 04:50:05.207584 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-ca682092-708a-42d0-98b6-ffd4ceff73f4 req-0981ddf8-f590-4481-9701-a397bec410d1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031717 May 28 04:50:05.208817 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1962/3833] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:05.531215 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-75f205f4-acff-4301-a052-17c48f21c9b5 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:05.531993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-75f205f4-acff-4301-a052-17c48f21c9b5 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:05.542168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75f205f4-acff-4301-a052-17c48f21c9b5 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:05.542681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75f205f4-acff-4301-a052-17c48f21c9b5 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:05.543843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75f205f4-acff-4301-a052-17c48f21c9b5 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:05.544652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75f205f4-acff-4301-a052-17c48f21c9b5 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:05.648195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3e9a944b-65e5-4d08-a8d1-d48a163a1c46 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:05.648965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3e9a944b-65e5-4d08-a8d1-d48a163a1c46 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:05.663102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3e9a944b-65e5-4d08-a8d1-d48a163a1c46 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:05.663562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3e9a944b-65e5-4d08-a8d1-d48a163a1c46 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:05.664541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3e9a944b-65e5-4d08-a8d1-d48a163a1c46 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:05.665301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3e9a944b-65e5-4d08-a8d1-d48a163a1c46 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:05.919680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-75f205f4-acff-4301-a052-17c48f21c9b5 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:05.934460 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-75f205f4-acff-4301-a052-17c48f21c9b5 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 200 len: 1320 microversion: 2.1 time: 0.406394 May 28 04:50:05.936281 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1872/3834] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:05 2022] GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 1320 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:05.954077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9315d25b-20f7-4239-aa46-75765fcfc5d1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:05.954918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9315d25b-20f7-4239-aa46-75765fcfc5d1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:05.966623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9315d25b-20f7-4239-aa46-75765fcfc5d1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:05.968581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9315d25b-20f7-4239-aa46-75765fcfc5d1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:05.970073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9315d25b-20f7-4239-aa46-75765fcfc5d1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:05.971377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9315d25b-20f7-4239-aa46-75765fcfc5d1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:05.998717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3e9a944b-65e5-4d08-a8d1-d48a163a1c46 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19a7c36dbc14147bd823c8e1681f8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584749eada5c4f9281286bc6145c7b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:06.008760 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3e9a944b-65e5-4d08-a8d1-d48a163a1c46 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7" status: 200 len: 1667 microversion: 2.1 time: 0.365828 May 28 04:50:06.022147 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1963/3835] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:05 2022] GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7 => generated 1667 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:06.024216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8144cb1e-e96d-496f-acb5-4fe84c95e2d6 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:06.024833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8144cb1e-e96d-496f-acb5-4fe84c95e2d6 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:06.036896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8144cb1e-e96d-496f-acb5-4fe84c95e2d6 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:06.037533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8144cb1e-e96d-496f-acb5-4fe84c95e2d6 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:06.040741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8144cb1e-e96d-496f-acb5-4fe84c95e2d6 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:06.041600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8144cb1e-e96d-496f-acb5-4fe84c95e2d6 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:06.065874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9315d25b-20f7-4239-aa46-75765fcfc5d1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:06.075373 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9315d25b-20f7-4239-aa46-75765fcfc5d1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1219 microversion: 2.1 time: 0.137540 May 28 04:50:06.100468 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1873/3836] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:05 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1219 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:06.106689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aba58d89-2397-4c21-8701-6aaf60f76555 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:06.107350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-aba58d89-2397-4c21-8701-6aaf60f76555 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:06.121093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aba58d89-2397-4c21-8701-6aaf60f76555 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:06.121678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aba58d89-2397-4c21-8701-6aaf60f76555 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:06.128914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aba58d89-2397-4c21-8701-6aaf60f76555 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:06.128914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aba58d89-2397-4c21-8701-6aaf60f76555 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:06.142921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8144cb1e-e96d-496f-acb5-4fe84c95e2d6 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:06.156210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8144cb1e-e96d-496f-acb5-4fe84c95e2d6 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:06.157778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8144cb1e-e96d-496f-acb5-4fe84c95e2d6 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:06.169100 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8144cb1e-e96d-496f-acb5-4fe84c95e2d6 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.138776 May 28 04:50:06.169100 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1964/3837] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:06 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:06.169100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-493c890a-5021-4fb9-b318-7f17ca2e4d54 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:06.169100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-493c890a-5021-4fb9-b318-7f17ca2e4d54 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:06.177368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-493c890a-5021-4fb9-b318-7f17ca2e4d54 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:06.178680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-493c890a-5021-4fb9-b318-7f17ca2e4d54 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:06.183223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:06.184516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-493c890a-5021-4fb9-b318-7f17ca2e4d54 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:06.185198 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-493c890a-5021-4fb9-b318-7f17ca2e4d54 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:06.371268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-aba58d89-2397-4c21-8701-6aaf60f76555 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:06.378922 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aba58d89-2397-4c21-8701-6aaf60f76555 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d" status: 200 len: 1298 microversion: 2.1 time: 0.276824 May 28 04:50:06.379527 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1874/3838] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:06 2022] GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d => generated 1298 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:06.491234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-493c890a-5021-4fb9-b318-7f17ca2e4d54 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:06.511444 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-493c890a-5021-4fb9-b318-7f17ca2e4d54 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1334 microversion: 2.1 time: 0.350423 May 28 04:50:06.516123 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1965/3839] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:06 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1334 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:06.953934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f21f6de9-d7bf-4921-89cf-ba85fd77970f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:06.957087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f21f6de9-d7bf-4921-89cf-ba85fd77970f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:06.963994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f21f6de9-d7bf-4921-89cf-ba85fd77970f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:06.964468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f21f6de9-d7bf-4921-89cf-ba85fd77970f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:06.965269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f21f6de9-d7bf-4921-89cf-ba85fd77970f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:06.965713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f21f6de9-d7bf-4921-89cf-ba85fd77970f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:07.026448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-804eac4f-fda9-4b36-9343-172b3da5f2a0 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:07.027767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-804eac4f-fda9-4b36-9343-172b3da5f2a0 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:07.050313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-804eac4f-fda9-4b36-9343-172b3da5f2a0 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:07.050809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-804eac4f-fda9-4b36-9343-172b3da5f2a0 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:07.054721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-804eac4f-fda9-4b36-9343-172b3da5f2a0 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:07.055211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-804eac4f-fda9-4b36-9343-172b3da5f2a0 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:07.252749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-804eac4f-fda9-4b36-9343-172b3da5f2a0 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19a7c36dbc14147bd823c8e1681f8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584749eada5c4f9281286bc6145c7b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:07.264176 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-804eac4f-fda9-4b36-9343-172b3da5f2a0 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7" status: 200 len: 1599 microversion: 2.1 time: 0.242320 May 28 04:50:07.265087 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1966/3840] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:07 2022] GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7 => generated 1599 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:07.272761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1f91c687-ddd6-40f2-b875-273f5b3961b0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:07.286062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1f91c687-ddd6-40f2-b875-273f5b3961b0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:07.297436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f91c687-ddd6-40f2-b875-273f5b3961b0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:07.298144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f91c687-ddd6-40f2-b875-273f5b3961b0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:07.301721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f91c687-ddd6-40f2-b875-273f5b3961b0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:07.301721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f91c687-ddd6-40f2-b875-273f5b3961b0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:07.471683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1f91c687-ddd6-40f2-b875-273f5b3961b0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:07.487798 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1f91c687-ddd6-40f2-b875-273f5b3961b0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1275 microversion: 2.1 time: 0.220751 May 28 04:50:07.488660 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1967/3841] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:07 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1275 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:07.498627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-275ebd06-1236-4428-b10b-aa808f7df827 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:07.499551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-275ebd06-1236-4428-b10b-aa808f7df827 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:07.519201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-275ebd06-1236-4428-b10b-aa808f7df827 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:07.519984 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-275ebd06-1236-4428-b10b-aa808f7df827 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:07.520933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-275ebd06-1236-4428-b10b-aa808f7df827 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:07.521531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-275ebd06-1236-4428-b10b-aa808f7df827 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:07.564029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f21f6de9-d7bf-4921-89cf-ba85fd77970f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:07.579117 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f21f6de9-d7bf-4921-89cf-ba85fd77970f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 200 len: 1320 microversion: 2.1 time: 0.629747 May 28 04:50:07.580410 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1875/3842] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:06 2022] GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 1320 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:07.586962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-e8a103e9-1310-4d9a-a8e3-1544eaa0963b req-b88627d6-c2f5-47ab-b0e3-3dbe70f30964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c93f52-dc2a-43c2-a82d-43cfee1b58d5", "name": "network-vif-plugged", "status": "completed", "tag": "119f2bb6-0470-4ce3-99b9-75bc2c9be087"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:07.597763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-e8a103e9-1310-4d9a-a8e3-1544eaa0963b req-b88627d6-c2f5-47ab-b0e3-3dbe70f30964 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:07.598457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-e8a103e9-1310-4d9a-a8e3-1544eaa0963b req-b88627d6-c2f5-47ab-b0e3-3dbe70f30964 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:07.613174 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-e8a103e9-1310-4d9a-a8e3-1544eaa0963b req-b88627d6-c2f5-47ab-b0e3-3dbe70f30964 service nova] Creating event network-vif-plugged:119f2bb6-0470-4ce3-99b9-75bc2c9be087 for instance 56c93f52-dc2a-43c2-a82d-43cfee1b58d5 on n-h2-843700-1 May 28 04:50:07.621084 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-e8a103e9-1310-4d9a-a8e3-1544eaa0963b req-b88627d6-c2f5-47ab-b0e3-3dbe70f30964 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038482 May 28 04:50:07.630073 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1876/3843] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:07.638683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1d07228d-47cb-4fbf-9b61-444e2a22ae70 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:07.639849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1d07228d-47cb-4fbf-9b61-444e2a22ae70 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:07.658090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d07228d-47cb-4fbf-9b61-444e2a22ae70 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:07.666292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d07228d-47cb-4fbf-9b61-444e2a22ae70 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:07.667524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d07228d-47cb-4fbf-9b61-444e2a22ae70 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:07.668339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d07228d-47cb-4fbf-9b61-444e2a22ae70 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:07.920683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-275ebd06-1236-4428-b10b-aa808f7df827 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:07.935610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-275ebd06-1236-4428-b10b-aa808f7df827 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:07.938652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-275ebd06-1236-4428-b10b-aa808f7df827 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:07.941761 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-275ebd06-1236-4428-b10b-aa808f7df827 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.446519 May 28 04:50:07.943104 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1968/3844] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:07 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:07.949584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-93b8180b-c8a8-4cde-ab25-bbb76225e033 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:07.952106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-93b8180b-c8a8-4cde-ab25-bbb76225e033 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:07.962113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93b8180b-c8a8-4cde-ab25-bbb76225e033 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:07.964294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93b8180b-c8a8-4cde-ab25-bbb76225e033 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:07.965363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93b8180b-c8a8-4cde-ab25-bbb76225e033 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:07.966024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93b8180b-c8a8-4cde-ab25-bbb76225e033 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:08.171537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1d07228d-47cb-4fbf-9b61-444e2a22ae70 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:08.195890 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1d07228d-47cb-4fbf-9b61-444e2a22ae70 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d" status: 200 len: 1328 microversion: 2.1 time: 0.563757 May 28 04:50:08.196781 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1877/3845] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:07 2022] GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d => generated 1328 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:08.282654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bfffc29c-6c5c-4b48-ad0e-b15f59ebcc43 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:08.284176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bfffc29c-6c5c-4b48-ad0e-b15f59ebcc43 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:08.296516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bfffc29c-6c5c-4b48-ad0e-b15f59ebcc43 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:08.297092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bfffc29c-6c5c-4b48-ad0e-b15f59ebcc43 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:08.302001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bfffc29c-6c5c-4b48-ad0e-b15f59ebcc43 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:08.302785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bfffc29c-6c5c-4b48-ad0e-b15f59ebcc43 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:08.545257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-93b8180b-c8a8-4cde-ab25-bbb76225e033 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:08.558529 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-93b8180b-c8a8-4cde-ab25-bbb76225e033 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1355 microversion: 2.1 time: 0.609815 May 28 04:50:08.568143 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1969/3846] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:07 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1355 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:08.568372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bfffc29c-6c5c-4b48-ad0e-b15f59ebcc43 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19a7c36dbc14147bd823c8e1681f8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584749eada5c4f9281286bc6145c7b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:08.575055 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bfffc29c-6c5c-4b48-ad0e-b15f59ebcc43 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7" status: 200 len: 1599 microversion: 2.1 time: 0.296882 May 28 04:50:08.580396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-a1bb57ec-f001-4f66-8bef-3252f2c000ec req-fb58c2b7-1432-4c66-87d3-7aa5f8dfeb17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab9b09ff-7dc9-42e7-878b-fdc6906445c7", "name": "network-vif-deleted", "tag": "3ce87754-f8f4-4b4b-ba77-4a7108a51a9c"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:08.582037 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1878/3847] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:08 2022] GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7 => generated 1599 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:08.602668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-087b7d0f-9f25-4eae-b443-ccb2dd3aefa2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:08.604153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-087b7d0f-9f25-4eae-b443-ccb2dd3aefa2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:08.616893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a1bb57ec-f001-4f66-8bef-3252f2c000ec req-fb58c2b7-1432-4c66-87d3-7aa5f8dfeb17 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:08.617606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a1bb57ec-f001-4f66-8bef-3252f2c000ec req-fb58c2b7-1432-4c66-87d3-7aa5f8dfeb17 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:08.620461 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-087b7d0f-9f25-4eae-b443-ccb2dd3aefa2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:08.623286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-087b7d0f-9f25-4eae-b443-ccb2dd3aefa2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:08.625511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-087b7d0f-9f25-4eae-b443-ccb2dd3aefa2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:08.626087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-087b7d0f-9f25-4eae-b443-ccb2dd3aefa2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:08.639276 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-a1bb57ec-f001-4f66-8bef-3252f2c000ec req-fb58c2b7-1432-4c66-87d3-7aa5f8dfeb17 service nova] Creating event network-vif-deleted:3ce87754-f8f4-4b4b-ba77-4a7108a51a9c for instance ab9b09ff-7dc9-42e7-878b-fdc6906445c7 on n-h1-843700-1 May 28 04:50:08.645444 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-a1bb57ec-f001-4f66-8bef-3252f2c000ec req-fb58c2b7-1432-4c66-87d3-7aa5f8dfeb17 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083842 May 28 04:50:08.646583 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1970/3848] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:08.652807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ad1ef325-c060-4644-a8ad-feec5d6ddd5c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:08.654037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ad1ef325-c060-4644-a8ad-feec5d6ddd5c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:08.661428 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad1ef325-c060-4644-a8ad-feec5d6ddd5c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:08.662071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad1ef325-c060-4644-a8ad-feec5d6ddd5c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:08.664289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad1ef325-c060-4644-a8ad-feec5d6ddd5c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:08.664900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad1ef325-c060-4644-a8ad-feec5d6ddd5c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:08.832678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-087b7d0f-9f25-4eae-b443-ccb2dd3aefa2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:08.848643 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-087b7d0f-9f25-4eae-b443-ccb2dd3aefa2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1273 microversion: 2.1 time: 0.254638 May 28 04:50:08.851011 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1879/3849] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:08 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1273 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:08.965289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f4108339-e3da-441e-8e5c-64b14d85b8d9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:08.971269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f4108339-e3da-441e-8e5c-64b14d85b8d9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:08.982568 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4108339-e3da-441e-8e5c-64b14d85b8d9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:08.983336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4108339-e3da-441e-8e5c-64b14d85b8d9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:08.985142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4108339-e3da-441e-8e5c-64b14d85b8d9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:08.986871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4108339-e3da-441e-8e5c-64b14d85b8d9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:09.022472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ad1ef325-c060-4644-a8ad-feec5d6ddd5c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:09.031368 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ad1ef325-c060-4644-a8ad-feec5d6ddd5c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 200 len: 1511 microversion: 2.1 time: 0.382805 May 28 04:50:09.047782 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1971/3850] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:08 2022] GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 1511 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:09.068191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6bba7cf3-9eac-4e06-ade9-ab03d3a88163 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:09.071327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6bba7cf3-9eac-4e06-ade9-ab03d3a88163 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:09.089061 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6bba7cf3-9eac-4e06-ade9-ab03d3a88163 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:09.090102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6bba7cf3-9eac-4e06-ade9-ab03d3a88163 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:09.091112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6bba7cf3-9eac-4e06-ade9-ab03d3a88163 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:09.091731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6bba7cf3-9eac-4e06-ade9-ab03d3a88163 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:09.129365 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f4108339-e3da-441e-8e5c-64b14d85b8d9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:09.140828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f4108339-e3da-441e-8e5c-64b14d85b8d9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:09.142549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f4108339-e3da-441e-8e5c-64b14d85b8d9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:09.143394 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f4108339-e3da-441e-8e5c-64b14d85b8d9 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.185573 May 28 04:50:09.144332 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1880/3851] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:08 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:09.213908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c934e6c0-b38d-4111-93a4-4b7543800c6c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:09.215396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c934e6c0-b38d-4111-93a4-4b7543800c6c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:09.227409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c934e6c0-b38d-4111-93a4-4b7543800c6c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:09.228200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c934e6c0-b38d-4111-93a4-4b7543800c6c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:09.229311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c934e6c0-b38d-4111-93a4-4b7543800c6c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:09.233866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c934e6c0-b38d-4111-93a4-4b7543800c6c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:09.502384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6bba7cf3-9eac-4e06-ade9-ab03d3a88163 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:09.512727 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6bba7cf3-9eac-4e06-ade9-ab03d3a88163 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1321 microversion: 2.1 time: 0.463563 May 28 04:50:09.523372 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1972/3852] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:09 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1321 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:09.576775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-246f0434-8ed3-4e1e-85a1-b07f9d63c53a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:09.577411 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-246f0434-8ed3-4e1e-85a1-b07f9d63c53a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:09.588972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-246f0434-8ed3-4e1e-85a1-b07f9d63c53a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:09.589442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-246f0434-8ed3-4e1e-85a1-b07f9d63c53a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:09.590789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-246f0434-8ed3-4e1e-85a1-b07f9d63c53a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:09.591282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-246f0434-8ed3-4e1e-85a1-b07f9d63c53a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:09.602692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c934e6c0-b38d-4111-93a4-4b7543800c6c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:09.614787 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c934e6c0-b38d-4111-93a4-4b7543800c6c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d" status: 200 len: 1328 microversion: 2.1 time: 0.405181 May 28 04:50:09.621177 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1881/3853] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:09 2022] GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d => generated 1328 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:09.759977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-c7b206c3-4e3a-4f74-95d1-42b2591b7816 req-a2e56344-77af-4261-8b0a-f9f228d7552d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "048721a7-0662-4ac7-b56f-03d3a623391d", "tag": "f158ad40-53aa-41b8-8e7c-9202bda1a7f8"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:09.781938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c7b206c3-4e3a-4f74-95d1-42b2591b7816 req-a2e56344-77af-4261-8b0a-f9f228d7552d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:09.782450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c7b206c3-4e3a-4f74-95d1-42b2591b7816 req-a2e56344-77af-4261-8b0a-f9f228d7552d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:09.821131 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-c7b206c3-4e3a-4f74-95d1-42b2591b7816 req-a2e56344-77af-4261-8b0a-f9f228d7552d service nova] Creating event network-changed:f158ad40-53aa-41b8-8e7c-9202bda1a7f8 for instance 048721a7-0662-4ac7-b56f-03d3a623391d on n-h1-843700-1 May 28 04:50:09.836347 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-c7b206c3-4e3a-4f74-95d1-42b2591b7816 req-a2e56344-77af-4261-8b0a-f9f228d7552d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213501 May 28 04:50:09.837347 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1882/3854] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:09.846661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6afed0da-9d75-4fc3-a330-0f6ac11d067f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:09.847719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6afed0da-9d75-4fc3-a330-0f6ac11d067f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] [instance: ab9b09ff-7dc9-42e7-878b-fdc6906445c7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:09.857176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6afed0da-9d75-4fc3-a330-0f6ac11d067f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:09.857624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6afed0da-9d75-4fc3-a330-0f6ac11d067f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:09.862766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6afed0da-9d75-4fc3-a330-0f6ac11d067f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:09.866039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6afed0da-9d75-4fc3-a330-0f6ac11d067f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:09.917205 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-6afed0da-9d75-4fc3-a330-0f6ac11d067f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] HTTP exception thrown: Instance ab9b09ff-7dc9-42e7-878b-fdc6906445c7 could not be found. May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6afed0da-9d75-4fc3-a330-0f6ac11d067f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Request method failure captured: May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7 HTTP/1.1 May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikanCMZfoLgLwL3L4oNECjPkhn18uonCSiJKPQmBu4u8jbfAp1gBkZBwIDUcso42i0f86FO0X433JRTrNO5EhAOZchcGmI3cFTVOvd0_N60OC-yuUtZRislmL2pt8cjCTmR_zTm2jre278BE3Fdb6Gy79OVR0Br9_JjjBUBs4ZXhsNl0 May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 584749eada5c4f9281286bc6145c7b85 May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersTestFqdnHostnames-1923238419 May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_584749eada5c4f9281286bc6145c7b85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/584749eada5c4f9281286bc6145c7b85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/584749eada5c4f9281286bc6145c7b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/584749eada5c4f9281286bc6145c7b85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersTestFqdnHostnames-1923238419 May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 584749eada5c4f9281286bc6145c7b85 May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1923238419 May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersTestFqdnHostnames-1923238419-project May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: f19a7c36dbc14147bd823c8e1681f8e3 May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersTestFqdnHostnames-1923238419-project May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance ab9b09ff-7dc9-42e7-878b-fdc6906445c7 could not be found. May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'ab9b09ff-7dc9-42e7-878b-fdc6906445c7'} May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab9b09ff-7dc9-42e7-878b-fdc6906445c7 could not be found. May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab9b09ff-7dc9-42e7-878b-fdc6906445c7 could not be found. May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:50:09.919215 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:09.926652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:09.926652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:50:09.926652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:50:09.926652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:50:09.926652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:50:09.926652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab9b09ff-7dc9-42e7-878b-fdc6906445c7 could not be found. May 28 04:50:09.926652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:09.926652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6afed0da-9d75-4fc3-a330-0f6ac11d067f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Returning 404 to user: Instance ab9b09ff-7dc9-42e7-878b-fdc6906445c7 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:50:09.926652 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6afed0da-9d75-4fc3-a330-0f6ac11d067f tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7" status: 404 len: 111 microversion: 2.1 time: 0.082981 May 28 04:50:09.926652 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1883/3855] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:09 2022] GET /compute/v2.1/servers/ab9b09ff-7dc9-42e7-878b-fdc6906445c7 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:50:09.941555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5aaf3d80-137b-4ae4-8053-870d4429fb6c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:09.946551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5aaf3d80-137b-4ae4-8053-870d4429fb6c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:09.962219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5aaf3d80-137b-4ae4-8053-870d4429fb6c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:09.962798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5aaf3d80-137b-4ae4-8053-870d4429fb6c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:09.965978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5aaf3d80-137b-4ae4-8053-870d4429fb6c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:09.966439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5aaf3d80-137b-4ae4-8053-870d4429fb6c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:10.246060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-246f0434-8ed3-4e1e-85a1-b07f9d63c53a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:10.255075 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-246f0434-8ed3-4e1e-85a1-b07f9d63c53a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1355 microversion: 2.1 time: 0.682386 May 28 04:50:10.257809 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1973/3856] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:09 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1355 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:10.266415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c9d2e51a-fea1-4c52-ac77-4693b4771708 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] Calling method '.version_select at 0x7f770119cd30>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:10.368428 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c9d2e51a-fea1-4c52-ac77-4693b4771708 tempest-ServersTestFqdnHostnames-1923238419 tempest-ServersTestFqdnHostnames-1923238419-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1030427461" status: 202 len: 0 microversion: 2.1 time: 0.105703 May 28 04:50:10.369187 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1974/3857] 10.222.0.58 () {58 vars in 1220 bytes} [Sat May 28 04:50:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1030427461 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:50:10.377666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4a12cf21-6c1a-4f02-b757-11170a256914 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:10.380986 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4a12cf21-6c1a-4f02-b757-11170a256914 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:10.394094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a12cf21-6c1a-4f02-b757-11170a256914 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:10.398852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a12cf21-6c1a-4f02-b757-11170a256914 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:10.399777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a12cf21-6c1a-4f02-b757-11170a256914 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:10.400297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a12cf21-6c1a-4f02-b757-11170a256914 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:10.511820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4a12cf21-6c1a-4f02-b757-11170a256914 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:10.518475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:10.529329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5aaf3d80-137b-4ae4-8053-870d4429fb6c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:10.535888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4a12cf21-6c1a-4f02-b757-11170a256914 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:10.538167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4a12cf21-6c1a-4f02-b757-11170a256914 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:10.539287 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5aaf3d80-137b-4ae4-8053-870d4429fb6c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1315 microversion: 2.1 time: 0.611821 May 28 04:50:10.540807 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1884/3858] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:09 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1315 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:10.541341 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4a12cf21-6c1a-4f02-b757-11170a256914 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.166980 May 28 04:50:10.542131 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1975/3859] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:10 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:10.548369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b14bbd46-d741-4d59-8254-7e6c2ba87b00 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:10.549870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b14bbd46-d741-4d59-8254-7e6c2ba87b00 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:10.566396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b14bbd46-d741-4d59-8254-7e6c2ba87b00 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:10.567238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b14bbd46-d741-4d59-8254-7e6c2ba87b00 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:10.568444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b14bbd46-d741-4d59-8254-7e6c2ba87b00 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:10.569991 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b14bbd46-d741-4d59-8254-7e6c2ba87b00 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:10.638323 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-49cf9e69-62a3-435a-9573-5a245d57020c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:10.640075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-49cf9e69-62a3-435a-9573-5a245d57020c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:10.646572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49cf9e69-62a3-435a-9573-5a245d57020c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:10.647649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49cf9e69-62a3-435a-9573-5a245d57020c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:10.648807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49cf9e69-62a3-435a-9573-5a245d57020c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:10.649486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49cf9e69-62a3-435a-9573-5a245d57020c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:10.882884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b14bbd46-d741-4d59-8254-7e6c2ba87b00 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:10.895792 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b14bbd46-d741-4d59-8254-7e6c2ba87b00 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1512 microversion: 2.1 time: 0.352260 May 28 04:50:10.909270 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1885/3860] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:10 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1512 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:10.957355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-49cf9e69-62a3-435a-9573-5a245d57020c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:10.985722 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-49cf9e69-62a3-435a-9573-5a245d57020c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d" status: 200 len: 1328 microversion: 2.1 time: 0.351956 May 28 04:50:10.987817 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1976/3861] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:10 2022] GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d => generated 1328 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:10.997902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0f51be1b-6f95-469c-9241-4ed62a07a3a3 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:10.998748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0f51be1b-6f95-469c-9241-4ed62a07a3a3 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:11.010123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f51be1b-6f95-469c-9241-4ed62a07a3a3 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:11.011391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f51be1b-6f95-469c-9241-4ed62a07a3a3 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:11.013068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-662d60e0-e0b3-4717-a4b1-33d63624e7fa req-71ab2b26-d8da-4fb6-8b85-7e925cdb68cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "831f1333-b707-473c-a6a5-f2ef08552976", "tag": "b609dde5-aef8-42ba-a770-6da9844b04c0"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:11.013488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f51be1b-6f95-469c-9241-4ed62a07a3a3 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:11.014140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f51be1b-6f95-469c-9241-4ed62a07a3a3 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:11.024078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-662d60e0-e0b3-4717-a4b1-33d63624e7fa req-71ab2b26-d8da-4fb6-8b85-7e925cdb68cc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:11.024890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-662d60e0-e0b3-4717-a4b1-33d63624e7fa req-71ab2b26-d8da-4fb6-8b85-7e925cdb68cc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:11.038327 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-662d60e0-e0b3-4717-a4b1-33d63624e7fa req-71ab2b26-d8da-4fb6-8b85-7e925cdb68cc service nova] Creating event network-changed:b609dde5-aef8-42ba-a770-6da9844b04c0 for instance 831f1333-b707-473c-a6a5-f2ef08552976 on n-h2-843700-1 May 28 04:50:11.044785 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-662d60e0-e0b3-4717-a4b1-33d63624e7fa req-71ab2b26-d8da-4fb6-8b85-7e925cdb68cc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133072 May 28 04:50:11.046174 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1886/3862] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:11.243255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0f51be1b-6f95-469c-9241-4ed62a07a3a3 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:11.252362 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0f51be1b-6f95-469c-9241-4ed62a07a3a3 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77" status: 200 len: 1513 microversion: 2.1 time: 0.261012 May 28 04:50:11.254967 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1977/3863] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:10 2022] GET /compute/v2.1/servers/ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77 => generated 1513 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:11.279337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dd3fcf13-9330-4d59-b6e4-25f8084df7a4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:11.285458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7d3017ac-995e-4673-a6ed-823ee2f3c697 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:11.288703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7d3017ac-995e-4673-a6ed-823ee2f3c697 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:11.288842 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dd3fcf13-9330-4d59-b6e4-25f8084df7a4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:11.290505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dd3fcf13-9330-4d59-b6e4-25f8084df7a4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '666dc141a00a4376893f7244fc10c61b'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:50:11.298723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:11.301133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d3017ac-995e-4673-a6ed-823ee2f3c697 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:11.302308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d3017ac-995e-4673-a6ed-823ee2f3c697 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:11.305360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d3017ac-995e-4673-a6ed-823ee2f3c697 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:11.307358 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d3017ac-995e-4673-a6ed-823ee2f3c697 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:11.332598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd3fcf13-9330-4d59-b6e4-25f8084df7a4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:11.333314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd3fcf13-9330-4d59-b6e4-25f8084df7a4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:11.335006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd3fcf13-9330-4d59-b6e4-25f8084df7a4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:11.335613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd3fcf13-9330-4d59-b6e4-25f8084df7a4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:11.481581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-dd3fcf13-9330-4d59-b6e4-25f8084df7a4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:50:11.520006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:11.602024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dd3fcf13-9330-4d59-b6e4-25f8084df7a4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:11.619287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd3fcf13-9330-4d59-b6e4-25f8084df7a4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:11.619993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd3fcf13-9330-4d59-b6e4-25f8084df7a4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:11.757026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7d3017ac-995e-4673-a6ed-823ee2f3c697 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:11.767376 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7d3017ac-995e-4673-a6ed-823ee2f3c697 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1355 microversion: 2.1 time: 0.493717 May 28 04:50:11.769839 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1978/3864] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:11 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1355 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:11.781037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-46225620-d252-41c6-b58e-2c3eff7af4db tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:11.784279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-46225620-d252-41c6-b58e-2c3eff7af4db tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:11.794970 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:11.806340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-46225620-d252-41c6-b58e-2c3eff7af4db tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:11.806934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-46225620-d252-41c6-b58e-2c3eff7af4db tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:11.808908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-46225620-d252-41c6-b58e-2c3eff7af4db tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:11.810242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-46225620-d252-41c6-b58e-2c3eff7af4db tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:11.981584 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dd3fcf13-9330-4d59-b6e4-25f8084df7a4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.712657 May 28 04:50:11.982400 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1887/3865] 10.222.0.58 () {58 vars in 1166 bytes} [Sat May 28 04:50:11 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:11.989326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4f48ee06-49d8-4e84-865e-6afbb0125a16 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:11.990291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4f48ee06-49d8-4e84-865e-6afbb0125a16 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:12.001543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4f48ee06-49d8-4e84-865e-6afbb0125a16 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:12.002010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4f48ee06-49d8-4e84-865e-6afbb0125a16 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:12.002835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4f48ee06-49d8-4e84-865e-6afbb0125a16 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:12.003313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4f48ee06-49d8-4e84-865e-6afbb0125a16 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:12.167030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4f48ee06-49d8-4e84-865e-6afbb0125a16 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:12.184421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4f48ee06-49d8-4e84-865e-6afbb0125a16 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:12.186118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4f48ee06-49d8-4e84-865e-6afbb0125a16 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:12.197428 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4f48ee06-49d8-4e84-865e-6afbb0125a16 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.208501 May 28 04:50:12.199333 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1888/3866] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:11 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:12.210703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2d2ca690-161b-45db-96cf-d0d15b95b3fc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:12.223309 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2d2ca690-161b-45db-96cf-d0d15b95b3fc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:12.227425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2d2ca690-161b-45db-96cf-d0d15b95b3fc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1221901744', 'deleted': False, 'project_id': '666dc141a00a4376893f7244fc10c61b'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:50:12.256241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d2ca690-161b-45db-96cf-d0d15b95b3fc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:12.257216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d2ca690-161b-45db-96cf-d0d15b95b3fc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:12.258244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d2ca690-161b-45db-96cf-d0d15b95b3fc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:12.263388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d2ca690-161b-45db-96cf-d0d15b95b3fc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:12.438481 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-46225620-d252-41c6-b58e-2c3eff7af4db tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:12.451630 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-46225620-d252-41c6-b58e-2c3eff7af4db tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1315 microversion: 2.1 time: 0.678215 May 28 04:50:12.452437 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1979/3867] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:11 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:12.463423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-831bf7a6-86a3-4a1a-a5dd-af6f37635dc6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:12.464427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-831bf7a6-86a3-4a1a-a5dd-af6f37635dc6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:12.476863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-2d2ca690-161b-45db-96cf-d0d15b95b3fc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:50:12.479450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-831bf7a6-86a3-4a1a-a5dd-af6f37635dc6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:12.479937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-831bf7a6-86a3-4a1a-a5dd-af6f37635dc6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:12.484380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-831bf7a6-86a3-4a1a-a5dd-af6f37635dc6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:12.484959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-831bf7a6-86a3-4a1a-a5dd-af6f37635dc6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:12.591365 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2d2ca690-161b-45db-96cf-d0d15b95b3fc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:12.598651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d2ca690-161b-45db-96cf-d0d15b95b3fc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:12.599081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d2ca690-161b-45db-96cf-d0d15b95b3fc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:12.926178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-831bf7a6-86a3-4a1a-a5dd-af6f37635dc6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:12.938614 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-831bf7a6-86a3-4a1a-a5dd-af6f37635dc6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d" status: 200 len: 1328 microversion: 2.1 time: 0.483444 May 28 04:50:12.940076 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1980/3868] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:12 2022] GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d => generated 1328 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:12.965698 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2d2ca690-161b-45db-96cf-d0d15b95b3fc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1221901744" status: 200 len: 1515 microversion: 2.1 time: 0.765154 May 28 04:50:12.966318 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1889/3869] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 04:50:12 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1221901744 => generated 1515 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:12.983201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e2345691-8cde-4c30-b7f0-4a9560351fd3 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:12.985526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8dfe10dd-4bf7-4d68-9e25-bea106023dda tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:12.986512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8dfe10dd-4bf7-4d68-9e25-bea106023dda tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:12.986641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e2345691-8cde-4c30-b7f0-4a9560351fd3 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:12.989802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e2345691-8cde-4c30-b7f0-4a9560351fd3 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '666dc141a00a4376893f7244fc10c61b'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:50:12.993797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2345691-8cde-4c30-b7f0-4a9560351fd3 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:12.994258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2345691-8cde-4c30-b7f0-4a9560351fd3 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:13.000948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8dfe10dd-4bf7-4d68-9e25-bea106023dda tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:13.003303 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8dfe10dd-4bf7-4d68-9e25-bea106023dda tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:13.004342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2345691-8cde-4c30-b7f0-4a9560351fd3 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:13.004834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2345691-8cde-4c30-b7f0-4a9560351fd3 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:13.006868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8dfe10dd-4bf7-4d68-9e25-bea106023dda tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:13.007552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8dfe10dd-4bf7-4d68-9e25-bea106023dda tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:13.178726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-e2345691-8cde-4c30-b7f0-4a9560351fd3 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:50:13.266073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e2345691-8cde-4c30-b7f0-4a9560351fd3 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:13.276487 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2345691-8cde-4c30-b7f0-4a9560351fd3 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:13.277299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2345691-8cde-4c30-b7f0-4a9560351fd3 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:13.290281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8dfe10dd-4bf7-4d68-9e25-bea106023dda tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:13.303634 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8dfe10dd-4bf7-4d68-9e25-bea106023dda tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1355 microversion: 2.1 time: 0.350136 May 28 04:50:13.319326 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1981/3870] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:12 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1355 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:13.325565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-dd2f08da-3060-4e7e-a9ed-a710f653a72a req-8036ac86-60d2-4f81-9342-aa468b25fa33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "831f1333-b707-473c-a6a5-f2ef08552976", "tag": "17551bec-4be6-4f43-896e-15ec7cbf52ff"}, {"name": "network-changed", "server_uuid": "0a940c92-8dca-4cf5-90a9-d7d617ec9ece", "tag": "d4489fa6-501f-4301-b268-2dded14654a8"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:13.339043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-dd2f08da-3060-4e7e-a9ed-a710f653a72a req-8036ac86-60d2-4f81-9342-aa468b25fa33 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:13.339987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-dd2f08da-3060-4e7e-a9ed-a710f653a72a req-8036ac86-60d2-4f81-9342-aa468b25fa33 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:13.362632 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-dd2f08da-3060-4e7e-a9ed-a710f653a72a req-8036ac86-60d2-4f81-9342-aa468b25fa33 service nova] Creating event network-changed:17551bec-4be6-4f43-896e-15ec7cbf52ff for instance 831f1333-b707-473c-a6a5-f2ef08552976 on n-h2-843700-1 May 28 04:50:13.362632 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-dd2f08da-3060-4e7e-a9ed-a710f653a72a req-8036ac86-60d2-4f81-9342-aa468b25fa33 service nova] Creating event network-changed:d4489fa6-501f-4301-b268-2dded14654a8 for instance 0a940c92-8dca-4cf5-90a9-d7d617ec9ece on n-h2-843700-1 May 28 04:50:13.368750 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-dd2f08da-3060-4e7e-a9ed-a710f653a72a req-8036ac86-60d2-4f81-9342-aa468b25fa33 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047349 May 28 04:50:13.369519 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1982/3871] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:13.375123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3bd3ebda-6f38-4a30-a6ac-aaf4563c5879 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:13.376037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3bd3ebda-6f38-4a30-a6ac-aaf4563c5879 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:13.382528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3bd3ebda-6f38-4a30-a6ac-aaf4563c5879 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:13.383248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3bd3ebda-6f38-4a30-a6ac-aaf4563c5879 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:13.384181 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3bd3ebda-6f38-4a30-a6ac-aaf4563c5879 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:13.384766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3bd3ebda-6f38-4a30-a6ac-aaf4563c5879 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:13.477094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3bd3ebda-6f38-4a30-a6ac-aaf4563c5879 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:13.488491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3bd3ebda-6f38-4a30-a6ac-aaf4563c5879 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:13.490013 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3bd3ebda-6f38-4a30-a6ac-aaf4563c5879 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:13.491446 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3bd3ebda-6f38-4a30-a6ac-aaf4563c5879 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.120993 May 28 04:50:13.492336 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1983/3872] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:13 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:13.508655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3c4dec64-9e96-4c3e-990c-ef9b8fdbb853 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:13.509480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3c4dec64-9e96-4c3e-990c-ef9b8fdbb853 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:13.517304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c4dec64-9e96-4c3e-990c-ef9b8fdbb853 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:13.518096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c4dec64-9e96-4c3e-990c-ef9b8fdbb853 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:13.519088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c4dec64-9e96-4c3e-990c-ef9b8fdbb853 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:13.519686 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c4dec64-9e96-4c3e-990c-ef9b8fdbb853 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:13.520815 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e2345691-8cde-4c30-b7f0-4a9560351fd3 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.541359 May 28 04:50:13.521524 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1890/3873] 10.222.0.58 () {58 vars in 1172 bytes} [Sat May 28 04:50:12 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:13.544874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ca31d64f-200d-4dd3-b79a-055aea9a76ed tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:13.548727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ca31d64f-200d-4dd3-b79a-055aea9a76ed tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:13.549329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.compute.servers [None req-ca31d64f-200d-4dd3-b79a-055aea9a76ed tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Removing options 'limit' from query {{(pid=126043) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 28 04:50:13.550098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ca31d64f-200d-4dd3-b79a-055aea9a76ed tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Searching by: {'deleted': False, 'project_id': '666dc141a00a4376893f7244fc10c61b'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:50:13.580237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca31d64f-200d-4dd3-b79a-055aea9a76ed tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:13.580858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca31d64f-200d-4dd3-b79a-055aea9a76ed tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:13.585792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca31d64f-200d-4dd3-b79a-055aea9a76ed tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:13.585792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca31d64f-200d-4dd3-b79a-055aea9a76ed tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:13.656352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ca31d64f-200d-4dd3-b79a-055aea9a76ed tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:13.664352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca31d64f-200d-4dd3-b79a-055aea9a76ed tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:13.665952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca31d64f-200d-4dd3-b79a-055aea9a76ed tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:13.669973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:13.789914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3c4dec64-9e96-4c3e-990c-ef9b8fdbb853 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:13.804019 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3c4dec64-9e96-4c3e-990c-ef9b8fdbb853 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1315 microversion: 2.1 time: 0.299278 May 28 04:50:13.808571 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1984/3874] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:13 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:13.886286 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ca31d64f-200d-4dd3-b79a-055aea9a76ed tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.347729 May 28 04:50:13.887559 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1891/3875] 10.222.0.58 () {58 vars in 1160 bytes} [Sat May 28 04:50:13 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:13.911823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-239cc3d5-32ec-48cd-a3fe-eff6326bbcff tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:13.916283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-239cc3d5-32ec-48cd-a3fe-eff6326bbcff tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:13.917434 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-239cc3d5-32ec-48cd-a3fe-eff6326bbcff tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '666dc141a00a4376893f7244fc10c61b'} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:50:13.923810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-239cc3d5-32ec-48cd-a3fe-eff6326bbcff tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:13.924614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-239cc3d5-32ec-48cd-a3fe-eff6326bbcff tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:13.925627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-239cc3d5-32ec-48cd-a3fe-eff6326bbcff tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:13.926240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-239cc3d5-32ec-48cd-a3fe-eff6326bbcff tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:13.957829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dd36f4e4-4c6c-4ee3-83e0-d8d90075aa99 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:13.958785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dd36f4e4-4c6c-4ee3-83e0-d8d90075aa99 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:13.972812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd36f4e4-4c6c-4ee3-83e0-d8d90075aa99 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:13.975629 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd36f4e4-4c6c-4ee3-83e0-d8d90075aa99 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:13.976692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd36f4e4-4c6c-4ee3-83e0-d8d90075aa99 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:13.983324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd36f4e4-4c6c-4ee3-83e0-d8d90075aa99 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:13.995532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.multi_cell_list [None req-239cc3d5-32ec-48cd-a3fe-eff6326bbcff tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:50:14.058416 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-239cc3d5-32ec-48cd-a3fe-eff6326bbcff tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.151087 May 28 04:50:14.059241 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1985/3876] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:50:13 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:14.074827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eb32bfdd-e954-4a4b-91e3-4a6e3bafd0cf tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:14.078372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-eb32bfdd-e954-4a4b-91e3-4a6e3bafd0cf tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:14.079577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.compute.servers [None req-eb32bfdd-e954-4a4b-91e3-4a6e3bafd0cf tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Removing options 'limit' from query {{(pid=126044) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 28 04:50:14.080383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-eb32bfdd-e954-4a4b-91e3-4a6e3bafd0cf tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Searching by: {'deleted': False, 'project_id': '666dc141a00a4376893f7244fc10c61b'} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:50:14.087922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb32bfdd-e954-4a4b-91e3-4a6e3bafd0cf tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:14.088392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb32bfdd-e954-4a4b-91e3-4a6e3bafd0cf tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:14.089218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb32bfdd-e954-4a4b-91e3-4a6e3bafd0cf tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:14.089959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb32bfdd-e954-4a4b-91e3-4a6e3bafd0cf tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:14.122778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.multi_cell_list [None req-eb32bfdd-e954-4a4b-91e3-4a6e3bafd0cf tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:50:14.156297 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-eb32bfdd-e954-4a4b-91e3-4a6e3bafd0cf tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.087153 May 28 04:50:14.162311 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1986/3877] 10.222.0.58 () {58 vars in 1149 bytes} [Sat May 28 04:50:14 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:14.167219 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-88b2186b-3b7c-4abe-9d8d-bbe8c3c35f32 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:14.170516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-88b2186b-3b7c-4abe-9d8d-bbe8c3c35f32 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:14.171204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-88b2186b-3b7c-4abe-9d8d-bbe8c3c35f32 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Searching by: {'deleted': False, 'project_id': '666dc141a00a4376893f7244fc10c61b'} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:50:14.176914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-88b2186b-3b7c-4abe-9d8d-bbe8c3c35f32 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:14.177359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-88b2186b-3b7c-4abe-9d8d-bbe8c3c35f32 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:14.178771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-88b2186b-3b7c-4abe-9d8d-bbe8c3c35f32 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:14.179282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-88b2186b-3b7c-4abe-9d8d-bbe8c3c35f32 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:14.212513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.multi_cell_list [None req-88b2186b-3b7c-4abe-9d8d-bbe8c3c35f32 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:50:14.224481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dd36f4e4-4c6c-4ee3-83e0-d8d90075aa99 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:14.247708 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dd36f4e4-4c6c-4ee3-83e0-d8d90075aa99 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d" status: 200 len: 1328 microversion: 2.1 time: 0.293686 May 28 04:50:14.250370 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1892/3878] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:13 2022] GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d => generated 1328 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:14.250636 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-88b2186b-3b7c-4abe-9d8d-bbe8c3c35f32 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.086708 May 28 04:50:14.251678 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1987/3879] 10.222.0.58 () {58 vars in 1124 bytes} [Sat May 28 04:50:14 2022] GET /compute/v2.1/servers => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:14.264853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-694bca0f-2cc8-4343-b597-eb5afd80833d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:14.269991 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-694bca0f-2cc8-4343-b597-eb5afd80833d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:14.269991 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-694bca0f-2cc8-4343-b597-eb5afd80833d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '666dc141a00a4376893f7244fc10c61b'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:50:14.281537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-694bca0f-2cc8-4343-b597-eb5afd80833d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:14.281994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-694bca0f-2cc8-4343-b597-eb5afd80833d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:14.282805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-694bca0f-2cc8-4343-b597-eb5afd80833d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:14.283282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-694bca0f-2cc8-4343-b597-eb5afd80833d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:14.321879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c053e283-2512-4458-8f26-10defc720e26 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:14.322503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c053e283-2512-4458-8f26-10defc720e26 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:14.329385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c053e283-2512-4458-8f26-10defc720e26 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:14.329846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c053e283-2512-4458-8f26-10defc720e26 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:14.330630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c053e283-2512-4458-8f26-10defc720e26 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:14.331097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c053e283-2512-4458-8f26-10defc720e26 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:14.399696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-694bca0f-2cc8-4343-b597-eb5afd80833d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:50:14.465887 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-694bca0f-2cc8-4343-b597-eb5afd80833d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.204881 May 28 04:50:14.467271 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1893/3880] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:50:14 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:14.495487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c053e283-2512-4458-8f26-10defc720e26 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:14.498201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e18b12d6-2718-42a2-8f9b-3b4f0b49d389 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:14.503753 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c053e283-2512-4458-8f26-10defc720e26 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1355 microversion: 2.1 time: 0.186558 May 28 04:50:14.505353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e18b12d6-2718-42a2-8f9b-3b4f0b49d389 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:14.505814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.compute.servers [None req-e18b12d6-2718-42a2-8f9b-3b4f0b49d389 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Removing options 'limit' from query {{(pid=126043) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 28 04:50:14.513583 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1988/3881] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:14 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1355 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:14.513756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e18b12d6-2718-42a2-8f9b-3b4f0b49d389 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Searching by: {'deleted': False, 'project_id': '666dc141a00a4376893f7244fc10c61b'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:50:14.518907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0360f1fa-ff19-494d-afc1-59ee22fb5422 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:14.519644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0360f1fa-ff19-494d-afc1-59ee22fb5422 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:14.523258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e18b12d6-2718-42a2-8f9b-3b4f0b49d389 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:14.523990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e18b12d6-2718-42a2-8f9b-3b4f0b49d389 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:14.525656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e18b12d6-2718-42a2-8f9b-3b4f0b49d389 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:14.526454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e18b12d6-2718-42a2-8f9b-3b4f0b49d389 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:14.538011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0360f1fa-ff19-494d-afc1-59ee22fb5422 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:14.538553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0360f1fa-ff19-494d-afc1-59ee22fb5422 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:14.539426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0360f1fa-ff19-494d-afc1-59ee22fb5422 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:14.539990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0360f1fa-ff19-494d-afc1-59ee22fb5422 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:14.562852 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e18b12d6-2718-42a2-8f9b-3b4f0b49d389 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.073672 May 28 04:50:14.564971 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1894/3882] 10.222.0.58 () {58 vars in 1139 bytes} [Sat May 28 04:50:14 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:14.584932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-09f87871-5d7f-46d6-876b-4e96f5bf8e14 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:14.601969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-09f87871-5d7f-46d6-876b-4e96f5bf8e14 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:14.602876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-09f87871-5d7f-46d6-876b-4e96f5bf8e14 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1221901744', 'deleted': False, 'project_id': '666dc141a00a4376893f7244fc10c61b'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:50:14.618771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09f87871-5d7f-46d6-876b-4e96f5bf8e14 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:14.619343 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09f87871-5d7f-46d6-876b-4e96f5bf8e14 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:14.620355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09f87871-5d7f-46d6-876b-4e96f5bf8e14 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:14.620809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09f87871-5d7f-46d6-876b-4e96f5bf8e14 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:14.625186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0360f1fa-ff19-494d-afc1-59ee22fb5422 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:14.635540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0360f1fa-ff19-494d-afc1-59ee22fb5422 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:14.638465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0360f1fa-ff19-494d-afc1-59ee22fb5422 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:14.640226 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0360f1fa-ff19-494d-afc1-59ee22fb5422 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.125339 May 28 04:50:14.641337 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1989/3883] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:14 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:14.714254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-09f87871-5d7f-46d6-876b-4e96f5bf8e14 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:50:14.778688 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-09f87871-5d7f-46d6-876b-4e96f5bf8e14 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1221901744" status: 200 len: 346 microversion: 2.1 time: 0.200785 May 28 04:50:14.788056 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1895/3884] 10.222.0.58 () {58 vars in 1241 bytes} [Sat May 28 04:50:14 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1221901744 => generated 346 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:14.792997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0f9219de-cebd-4dcf-b82c-cbb2ec0b8b91 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:14.800530 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=16 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:14.800975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f9219de-cebd-4dcf-b82c-cbb2ec0b8b91 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:14.801755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f9219de-cebd-4dcf-b82c-cbb2ec0b8b91 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:14.827689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2b8b851c-ac77-46ef-ac30-bd763dec12b3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:14.828321 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2b8b851c-ac77-46ef-ac30-bd763dec12b3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:14.837536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0f9219de-cebd-4dcf-b82c-cbb2ec0b8b91 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Going to try to stop instance {{(pid=126044) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 04:50:14.845452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b8b851c-ac77-46ef-ac30-bd763dec12b3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:14.846476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b8b851c-ac77-46ef-ac30-bd763dec12b3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:14.847642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b8b851c-ac77-46ef-ac30-bd763dec12b3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:14.848321 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b8b851c-ac77-46ef-ac30-bd763dec12b3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:15.059737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2b8b851c-ac77-46ef-ac30-bd763dec12b3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:15.069388 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2b8b851c-ac77-46ef-ac30-bd763dec12b3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1315 microversion: 2.1 time: 0.247350 May 28 04:50:15.070477 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1896/3885] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:14 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:15.110289 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0f9219de-cebd-4dcf-b82c-cbb2ec0b8b91 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "POST /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5/action" status: 202 len: 0 microversion: 2.1 time: 0.320863 May 28 04:50:15.112356 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1990/3886] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:50:14 2022] POST /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:50:15.139753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-62a4984e-2b57-49c2-9ba3-c8351ad43b24 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:15.140828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-62a4984e-2b57-49c2-9ba3-c8351ad43b24 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:15.151243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-62a4984e-2b57-49c2-9ba3-c8351ad43b24 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:15.151710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-62a4984e-2b57-49c2-9ba3-c8351ad43b24 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:15.153027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-62a4984e-2b57-49c2-9ba3-c8351ad43b24 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:15.153488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-62a4984e-2b57-49c2-9ba3-c8351ad43b24 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:15.267882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e4962ca5-4124-4c9e-b8fb-d3de51204858 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:15.268651 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e4962ca5-4124-4c9e-b8fb-d3de51204858 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:15.276499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e4962ca5-4124-4c9e-b8fb-d3de51204858 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:15.276871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e4962ca5-4124-4c9e-b8fb-d3de51204858 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:15.277688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e4962ca5-4124-4c9e-b8fb-d3de51204858 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:15.278228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e4962ca5-4124-4c9e-b8fb-d3de51204858 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:15.282647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:15.343737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-62a4984e-2b57-49c2-9ba3-c8351ad43b24 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:15.356215 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-62a4984e-2b57-49c2-9ba3-c8351ad43b24 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1522 microversion: 2.1 time: 0.232285 May 28 04:50:15.357448 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1897/3887] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:15 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:15.420651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-a799c73f-37f0-4356-83b5-0828517fbd2e req-e702a581-c052-4593-a38d-6b26a0e42c7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "831f1333-b707-473c-a6a5-f2ef08552976", "tag": "09ec63fd-1a6d-4123-a858-83f57185a42c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:15.439021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a799c73f-37f0-4356-83b5-0828517fbd2e req-e702a581-c052-4593-a38d-6b26a0e42c7e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:15.439604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a799c73f-37f0-4356-83b5-0828517fbd2e req-e702a581-c052-4593-a38d-6b26a0e42c7e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:15.463616 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-a799c73f-37f0-4356-83b5-0828517fbd2e req-e702a581-c052-4593-a38d-6b26a0e42c7e service nova] Creating event network-changed:09ec63fd-1a6d-4123-a858-83f57185a42c for instance 831f1333-b707-473c-a6a5-f2ef08552976 on n-h2-843700-1 May 28 04:50:15.477146 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-a799c73f-37f0-4356-83b5-0828517fbd2e req-e702a581-c052-4593-a38d-6b26a0e42c7e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056742 May 28 04:50:15.478521 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1898/3888] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:15.483523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e4962ca5-4124-4c9e-b8fb-d3de51204858 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:15.496306 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e4962ca5-4124-4c9e-b8fb-d3de51204858 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d" status: 200 len: 1328 microversion: 2.1 time: 0.232900 May 28 04:50:15.497524 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1991/3889] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:15 2022] GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d => generated 1328 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:15.523235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2b1a8589-564d-4fce-93dc-a927ce086804 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:15.524339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2b1a8589-564d-4fce-93dc-a927ce086804 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:15.544904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b1a8589-564d-4fce-93dc-a927ce086804 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:15.545368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b1a8589-564d-4fce-93dc-a927ce086804 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:15.546165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b1a8589-564d-4fce-93dc-a927ce086804 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:15.546651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b1a8589-564d-4fce-93dc-a927ce086804 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:15.658584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-623062be-3519-4bcb-94e8-698f9dad3c8b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:15.659230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-623062be-3519-4bcb-94e8-698f9dad3c8b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:15.677118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-623062be-3519-4bcb-94e8-698f9dad3c8b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:15.679393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-623062be-3519-4bcb-94e8-698f9dad3c8b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:15.680489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-623062be-3519-4bcb-94e8-698f9dad3c8b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:15.683513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-623062be-3519-4bcb-94e8-698f9dad3c8b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:15.732513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2b1a8589-564d-4fce-93dc-a927ce086804 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:15.745918 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2b1a8589-564d-4fce-93dc-a927ce086804 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1355 microversion: 2.1 time: 0.227142 May 28 04:50:15.755239 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1899/3890] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:15 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1355 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:15.792838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-623062be-3519-4bcb-94e8-698f9dad3c8b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:15.802031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-623062be-3519-4bcb-94e8-698f9dad3c8b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:15.810117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-623062be-3519-4bcb-94e8-698f9dad3c8b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:15.811618 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-623062be-3519-4bcb-94e8-698f9dad3c8b tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.156931 May 28 04:50:15.814348 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1992/3891] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:15 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:50:15.910271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-2ac3a06c-4f03-48ed-b85e-f47a3ccd4dba req-34f9d53b-aa72-4796-bbb5-044ce7242c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "048721a7-0662-4ac7-b56f-03d3a623391d", "name": "network-vif-plugged", "status": "completed", "tag": "f158ad40-53aa-41b8-8e7c-9202bda1a7f8"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:15.919604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2ac3a06c-4f03-48ed-b85e-f47a3ccd4dba req-34f9d53b-aa72-4796-bbb5-044ce7242c04 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:15.920084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2ac3a06c-4f03-48ed-b85e-f47a3ccd4dba req-34f9d53b-aa72-4796-bbb5-044ce7242c04 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:15.948758 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-2ac3a06c-4f03-48ed-b85e-f47a3ccd4dba req-34f9d53b-aa72-4796-bbb5-044ce7242c04 service nova] Creating event network-vif-plugged:f158ad40-53aa-41b8-8e7c-9202bda1a7f8 for instance 048721a7-0662-4ac7-b56f-03d3a623391d on n-h1-843700-1 May 28 04:50:15.961650 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-2ac3a06c-4f03-48ed-b85e-f47a3ccd4dba req-34f9d53b-aa72-4796-bbb5-044ce7242c04 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121020 May 28 04:50:15.963461 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1900/3892] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:16.088885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-31236a12-1b12-4074-9df2-f5356fa383d9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:16.090520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-31236a12-1b12-4074-9df2-f5356fa383d9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:16.102361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31236a12-1b12-4074-9df2-f5356fa383d9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:16.103142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31236a12-1b12-4074-9df2-f5356fa383d9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:16.104600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31236a12-1b12-4074-9df2-f5356fa383d9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:16.105331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31236a12-1b12-4074-9df2-f5356fa383d9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:16.266000 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-31236a12-1b12-4074-9df2-f5356fa383d9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:16.275232 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-31236a12-1b12-4074-9df2-f5356fa383d9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1315 microversion: 2.1 time: 0.192150 May 28 04:50:16.279572 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1993/3893] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:16 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:16.376089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-11443a45-271b-4b9c-ac5a-5382b61cd49d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:16.377626 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-11443a45-271b-4b9c-ac5a-5382b61cd49d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:16.386153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11443a45-271b-4b9c-ac5a-5382b61cd49d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:16.387565 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11443a45-271b-4b9c-ac5a-5382b61cd49d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:16.388464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11443a45-271b-4b9c-ac5a-5382b61cd49d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:16.388802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11443a45-271b-4b9c-ac5a-5382b61cd49d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:16.514070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c77d3f8b-7095-4e7d-96bd-8902bfdfab3e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:16.515194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c77d3f8b-7095-4e7d-96bd-8902bfdfab3e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:16.525649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c77d3f8b-7095-4e7d-96bd-8902bfdfab3e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:16.529240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c77d3f8b-7095-4e7d-96bd-8902bfdfab3e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:16.529240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c77d3f8b-7095-4e7d-96bd-8902bfdfab3e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:16.529240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c77d3f8b-7095-4e7d-96bd-8902bfdfab3e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:16.582741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-11443a45-271b-4b9c-ac5a-5382b61cd49d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:16.601032 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-11443a45-271b-4b9c-ac5a-5382b61cd49d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1522 microversion: 2.1 time: 0.229309 May 28 04:50:16.602196 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1901/3894] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:16 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:16.764547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-928fe507-26cd-4a6a-b5f3-bf44a5d108bf tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:16.765479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-928fe507-26cd-4a6a-b5f3-bf44a5d108bf tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:16.779447 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-928fe507-26cd-4a6a-b5f3-bf44a5d108bf tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:16.780340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-928fe507-26cd-4a6a-b5f3-bf44a5d108bf tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:16.781618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-928fe507-26cd-4a6a-b5f3-bf44a5d108bf tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:16.782852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-928fe507-26cd-4a6a-b5f3-bf44a5d108bf tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:17.082946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c77d3f8b-7095-4e7d-96bd-8902bfdfab3e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:17.094886 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c77d3f8b-7095-4e7d-96bd-8902bfdfab3e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d" status: 200 len: 1328 microversion: 2.1 time: 0.585045 May 28 04:50:17.108372 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1994/3895] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:16 2022] GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d => generated 1328 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:17.122334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f37e4f33-b736-4f17-b102-2bad0f6a98ba tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:17.123885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f37e4f33-b736-4f17-b102-2bad0f6a98ba tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:17.148667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f37e4f33-b736-4f17-b102-2bad0f6a98ba tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:17.148667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f37e4f33-b736-4f17-b102-2bad0f6a98ba tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:17.148667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f37e4f33-b736-4f17-b102-2bad0f6a98ba tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:17.148667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f37e4f33-b736-4f17-b102-2bad0f6a98ba tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:17.300828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f37e4f33-b736-4f17-b102-2bad0f6a98ba tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:17.317114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f37e4f33-b736-4f17-b102-2bad0f6a98ba tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:17.321128 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f37e4f33-b736-4f17-b102-2bad0f6a98ba tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:17.321302 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f37e4f33-b736-4f17-b102-2bad0f6a98ba tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.211684 May 28 04:50:17.332198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-928fe507-26cd-4a6a-b5f3-bf44a5d108bf tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:17.335074 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-928fe507-26cd-4a6a-b5f3-bf44a5d108bf tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1355 microversion: 2.1 time: 0.575813 May 28 04:50:17.335669 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1902/3896] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:16 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1355 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:17.339861 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1995/3897] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:17 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:17.341222 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f88d2df6-20a2-462d-a3ad-f8623da1a07d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:17.341840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f88d2df6-20a2-462d-a3ad-f8623da1a07d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:17.347902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f88d2df6-20a2-462d-a3ad-f8623da1a07d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:17.348364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f88d2df6-20a2-462d-a3ad-f8623da1a07d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:17.349144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f88d2df6-20a2-462d-a3ad-f8623da1a07d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:17.349588 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f88d2df6-20a2-462d-a3ad-f8623da1a07d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:17.535539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f88d2df6-20a2-462d-a3ad-f8623da1a07d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:17.545398 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f88d2df6-20a2-462d-a3ad-f8623da1a07d tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1315 microversion: 2.1 time: 0.208710 May 28 04:50:17.546540 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1903/3898] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:17 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:17.618661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2cc85cd5-353b-4129-a25f-635201c703e7 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:17.619314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2cc85cd5-353b-4129-a25f-635201c703e7 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:17.631915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2cc85cd5-353b-4129-a25f-635201c703e7 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:17.639729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2cc85cd5-353b-4129-a25f-635201c703e7 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:17.641460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2cc85cd5-353b-4129-a25f-635201c703e7 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:17.641460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2cc85cd5-353b-4129-a25f-635201c703e7 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:17.878189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2cc85cd5-353b-4129-a25f-635201c703e7 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:17.890882 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2cc85cd5-353b-4129-a25f-635201c703e7 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1522 microversion: 2.1 time: 0.276577 May 28 04:50:17.904374 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1996/3899] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:17 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:18.123077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8223d241-5aef-4153-af0a-2bb68ca2cf8c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:18.124051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8223d241-5aef-4153-af0a-2bb68ca2cf8c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:18.131722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8223d241-5aef-4153-af0a-2bb68ca2cf8c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:18.132483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8223d241-5aef-4153-af0a-2bb68ca2cf8c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:18.133329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8223d241-5aef-4153-af0a-2bb68ca2cf8c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:18.134032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8223d241-5aef-4153-af0a-2bb68ca2cf8c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:18.312311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8223d241-5aef-4153-af0a-2bb68ca2cf8c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:18.325111 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8223d241-5aef-4153-af0a-2bb68ca2cf8c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d" status: 200 len: 1508 microversion: 2.1 time: 0.206485 May 28 04:50:18.326826 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1904/3900] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:18 2022] GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d => generated 1508 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:18.340572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-716ae076-fba8-4bac-b797-800e4b547c71 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:18.341785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-716ae076-fba8-4bac-b797-800e4b547c71 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:18.355508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-539e9122-14f4-4174-a4bd-9cd7b943fc8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:18.358854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-716ae076-fba8-4bac-b797-800e4b547c71 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:18.359563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-716ae076-fba8-4bac-b797-800e4b547c71 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:18.360517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-716ae076-fba8-4bac-b797-800e4b547c71 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:18.363337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-716ae076-fba8-4bac-b797-800e4b547c71 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:18.364402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-539e9122-14f4-4174-a4bd-9cd7b943fc8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:18.376158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-539e9122-14f4-4174-a4bd-9cd7b943fc8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:18.377015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-539e9122-14f4-4174-a4bd-9cd7b943fc8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:18.388335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-539e9122-14f4-4174-a4bd-9cd7b943fc8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:18.396236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-539e9122-14f4-4174-a4bd-9cd7b943fc8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:18.477351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-716ae076-fba8-4bac-b797-800e4b547c71 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:18.490021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-716ae076-fba8-4bac-b797-800e4b547c71 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:18.493693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-716ae076-fba8-4bac-b797-800e4b547c71 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:18.494807 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-716ae076-fba8-4bac-b797-800e4b547c71 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.158278 May 28 04:50:18.510006 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1997/3901] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:18 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:18.517176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-43c83f43-791a-4cdb-9b21-2fd8a7d23d9d tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:18.517778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-43c83f43-791a-4cdb-9b21-2fd8a7d23d9d tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:18.529130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43c83f43-791a-4cdb-9b21-2fd8a7d23d9d tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:18.529589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43c83f43-791a-4cdb-9b21-2fd8a7d23d9d tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:18.530353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43c83f43-791a-4cdb-9b21-2fd8a7d23d9d tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:18.530789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43c83f43-791a-4cdb-9b21-2fd8a7d23d9d tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:18.738405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-539e9122-14f4-4174-a4bd-9cd7b943fc8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:18.752788 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-539e9122-14f4-4174-a4bd-9cd7b943fc8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d" status: 200 len: 1508 microversion: 2.1 time: 0.400739 May 28 04:50:18.754042 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1905/3902] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:18 2022] GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d => generated 1508 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:18.761390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e26ce411-992c-440c-9f41-b6528d798759 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:18.762353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e26ce411-992c-440c-9f41-b6528d798759 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:18.774572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e26ce411-992c-440c-9f41-b6528d798759 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:18.775873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e26ce411-992c-440c-9f41-b6528d798759 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:18.777452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e26ce411-992c-440c-9f41-b6528d798759 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:18.778095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e26ce411-992c-440c-9f41-b6528d798759 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:18.793534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-43c83f43-791a-4cdb-9b21-2fd8a7d23d9d tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:18.810201 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-43c83f43-791a-4cdb-9b21-2fd8a7d23d9d tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1355 microversion: 2.1 time: 0.298932 May 28 04:50:18.812982 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1998/3903] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:18 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1355 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:18.826408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ca7f1a75-4076-4cea-afe9-2b07de28c423 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:18.827793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ca7f1a75-4076-4cea-afe9-2b07de28c423 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:18.834912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca7f1a75-4076-4cea-afe9-2b07de28c423 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:18.836364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca7f1a75-4076-4cea-afe9-2b07de28c423 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:18.837510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca7f1a75-4076-4cea-afe9-2b07de28c423 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:18.838193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca7f1a75-4076-4cea-afe9-2b07de28c423 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:18.868615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ca7f1a75-4076-4cea-afe9-2b07de28c423 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:50:19.136968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e26ce411-992c-440c-9f41-b6528d798759 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:19.149597 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e26ce411-992c-440c-9f41-b6528d798759 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1315 microversion: 2.1 time: 0.394179 May 28 04:50:19.150426 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1906/3904] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:18 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:19.160677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b7e86227-da3f-4cb4-bec4-19f0ecf8f594 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:19.161477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b7e86227-da3f-4cb4-bec4-19f0ecf8f594 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:19.164374 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ca7f1a75-4076-4cea-afe9-2b07de28c423 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "DELETE /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d" status: 204 len: 0 microversion: 2.1 time: 0.349963 May 28 04:50:19.169165 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 1999/3905] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:50:18 2022] DELETE /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:50:19.179700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1232541c-b5a2-4452-b385-fae1cc553c35 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:19.180423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1232541c-b5a2-4452-b385-fae1cc553c35 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:19.180768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7e86227-da3f-4cb4-bec4-19f0ecf8f594 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:19.181242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7e86227-da3f-4cb4-bec4-19f0ecf8f594 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:19.182040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7e86227-da3f-4cb4-bec4-19f0ecf8f594 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:19.182486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7e86227-da3f-4cb4-bec4-19f0ecf8f594 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:19.196242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1232541c-b5a2-4452-b385-fae1cc553c35 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:19.196462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1232541c-b5a2-4452-b385-fae1cc553c35 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:19.197376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1232541c-b5a2-4452-b385-fae1cc553c35 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:19.197758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1232541c-b5a2-4452-b385-fae1cc553c35 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:19.579894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1232541c-b5a2-4452-b385-fae1cc553c35 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:19.592700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b7e86227-da3f-4cb4-bec4-19f0ecf8f594 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:19.593325 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1232541c-b5a2-4452-b385-fae1cc553c35 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d" status: 200 len: 1514 microversion: 2.1 time: 0.419099 May 28 04:50:19.594331 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2000/3906] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:19 2022] GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d => generated 1514 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:19.603144 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b7e86227-da3f-4cb4-bec4-19f0ecf8f594 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1522 microversion: 2.1 time: 0.451829 May 28 04:50:19.604096 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1907/3907] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:19 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:19.611376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-2857a35c-f627-4086-b85c-659c169d5de3 req-2ffe903a-5b73-4094-a64c-6eb54990b704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a940c92-8dca-4cf5-90a9-d7d617ec9ece", "name": "network-vif-plugged", "status": "completed", "tag": "d4489fa6-501f-4301-b268-2dded14654a8"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:19.617286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c94049a6-7729-4ff1-91de-3fbdcf0257fa tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:19.617940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c94049a6-7729-4ff1-91de-3fbdcf0257fa tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:19.623578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2857a35c-f627-4086-b85c-659c169d5de3 req-2ffe903a-5b73-4094-a64c-6eb54990b704 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:19.625079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2857a35c-f627-4086-b85c-659c169d5de3 req-2ffe903a-5b73-4094-a64c-6eb54990b704 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:19.625196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c94049a6-7729-4ff1-91de-3fbdcf0257fa tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:19.625196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c94049a6-7729-4ff1-91de-3fbdcf0257fa tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:19.626091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c94049a6-7729-4ff1-91de-3fbdcf0257fa tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:19.626713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c94049a6-7729-4ff1-91de-3fbdcf0257fa tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:19.640477 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-2857a35c-f627-4086-b85c-659c169d5de3 req-2ffe903a-5b73-4094-a64c-6eb54990b704 service nova] Creating event network-vif-plugged:d4489fa6-501f-4301-b268-2dded14654a8 for instance 0a940c92-8dca-4cf5-90a9-d7d617ec9ece on n-h2-843700-1 May 28 04:50:19.646077 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-2857a35c-f627-4086-b85c-659c169d5de3 req-2ffe903a-5b73-4094-a64c-6eb54990b704 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043727 May 28 04:50:19.653421 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2001/3908] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:19.712448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c94049a6-7729-4ff1-91de-3fbdcf0257fa tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:19.722569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c94049a6-7729-4ff1-91de-3fbdcf0257fa tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:19.736098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c94049a6-7729-4ff1-91de-3fbdcf0257fa tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:19.739830 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c94049a6-7729-4ff1-91de-3fbdcf0257fa tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.133245 May 28 04:50:19.741735 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1908/3909] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:19 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:19.834679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7f3671d6-b653-4fcb-a8f6-7b93b0268d9c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:19.835654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7f3671d6-b653-4fcb-a8f6-7b93b0268d9c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:19.846024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f3671d6-b653-4fcb-a8f6-7b93b0268d9c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:19.850205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f3671d6-b653-4fcb-a8f6-7b93b0268d9c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:19.854323 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f3671d6-b653-4fcb-a8f6-7b93b0268d9c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:19.855028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f3671d6-b653-4fcb-a8f6-7b93b0268d9c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:20.167904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cc4762ee-0c91-47b0-b1ba-13966d917528 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:20.169131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cc4762ee-0c91-47b0-b1ba-13966d917528 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:20.176302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc4762ee-0c91-47b0-b1ba-13966d917528 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:20.177105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc4762ee-0c91-47b0-b1ba-13966d917528 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:20.178159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc4762ee-0c91-47b0-b1ba-13966d917528 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:20.178812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc4762ee-0c91-47b0-b1ba-13966d917528 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:20.201017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:20.304972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7f3671d6-b653-4fcb-a8f6-7b93b0268d9c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:20.313946 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7f3671d6-b653-4fcb-a8f6-7b93b0268d9c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1355 microversion: 2.1 time: 0.483767 May 28 04:50:20.326294 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2002/3910] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:19 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1355 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:20.411293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cc4762ee-0c91-47b0-b1ba-13966d917528 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:20.426104 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cc4762ee-0c91-47b0-b1ba-13966d917528 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1315 microversion: 2.1 time: 0.262378 May 28 04:50:20.427836 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1909/3911] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:20 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:20.612659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6d6b53b6-b44b-4929-99a7-b1130bb8271d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:20.613300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6d6b53b6-b44b-4929-99a7-b1130bb8271d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:20.623417 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d6b53b6-b44b-4929-99a7-b1130bb8271d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:20.624107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d6b53b6-b44b-4929-99a7-b1130bb8271d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:20.625091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d6b53b6-b44b-4929-99a7-b1130bb8271d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:20.625402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2a7bd58c-bd01-4961-8f66-b5fe6e82c2db tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:20.625965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d6b53b6-b44b-4929-99a7-b1130bb8271d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:20.626084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2a7bd58c-bd01-4961-8f66-b5fe6e82c2db tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:20.641262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a7bd58c-bd01-4961-8f66-b5fe6e82c2db tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:20.643630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a7bd58c-bd01-4961-8f66-b5fe6e82c2db tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:20.644443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a7bd58c-bd01-4961-8f66-b5fe6e82c2db tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:20.644897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a7bd58c-bd01-4961-8f66-b5fe6e82c2db tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:21.114178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6d6b53b6-b44b-4929-99a7-b1130bb8271d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:21.136722 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6d6b53b6-b44b-4929-99a7-b1130bb8271d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d" status: 200 len: 1514 microversion: 2.1 time: 0.522719 May 28 04:50:21.148802 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2003/3912] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:20 2022] GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d => generated 1514 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:21.156182 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e2694080-ef0c-42bd-ae6d-0526427a26ca tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:21.159812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e2694080-ef0c-42bd-ae6d-0526427a26ca tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:21.174884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2694080-ef0c-42bd-ae6d-0526427a26ca tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:21.176982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2694080-ef0c-42bd-ae6d-0526427a26ca tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:21.180581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2694080-ef0c-42bd-ae6d-0526427a26ca tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:21.182317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2694080-ef0c-42bd-ae6d-0526427a26ca tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:21.284577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e2694080-ef0c-42bd-ae6d-0526427a26ca tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:21.289665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2a7bd58c-bd01-4961-8f66-b5fe6e82c2db tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:21.298163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e2694080-ef0c-42bd-ae6d-0526427a26ca tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:21.300838 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2a7bd58c-bd01-4961-8f66-b5fe6e82c2db tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1522 microversion: 2.1 time: 0.679909 May 28 04:50:21.301995 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1910/3913] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:20 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1522 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:21.317496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e2694080-ef0c-42bd-ae6d-0526427a26ca tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:21.320458 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e2694080-ef0c-42bd-ae6d-0526427a26ca tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.169285 May 28 04:50:21.322482 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2004/3914] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:21 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:21.338695 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-073e6328-8587-4503-a1eb-543cb71d1e24 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:21.339615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-073e6328-8587-4503-a1eb-543cb71d1e24 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:21.357775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-073e6328-8587-4503-a1eb-543cb71d1e24 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:21.359940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-073e6328-8587-4503-a1eb-543cb71d1e24 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:21.360745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-073e6328-8587-4503-a1eb-543cb71d1e24 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:21.361193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-073e6328-8587-4503-a1eb-543cb71d1e24 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:21.443961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-376cf29a-0516-460a-bab0-96a3a3dff453 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:21.444914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-376cf29a-0516-460a-bab0-96a3a3dff453 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:21.451614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-376cf29a-0516-460a-bab0-96a3a3dff453 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:21.452582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-376cf29a-0516-460a-bab0-96a3a3dff453 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:21.453615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-376cf29a-0516-460a-bab0-96a3a3dff453 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:21.454288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-376cf29a-0516-460a-bab0-96a3a3dff453 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:21.725988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-073e6328-8587-4503-a1eb-543cb71d1e24 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:21.738871 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-073e6328-8587-4503-a1eb-543cb71d1e24 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1355 microversion: 2.1 time: 0.404062 May 28 04:50:21.740834 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1911/3915] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:21 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1355 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:21.821347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-376cf29a-0516-460a-bab0-96a3a3dff453 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:21.830709 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-376cf29a-0516-460a-bab0-96a3a3dff453 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1315 microversion: 2.1 time: 0.391232 May 28 04:50:21.831337 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2005/3916] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:21 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:22.033015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-152f1bd9-b36d-4069-a5ea-555c8814a574 req-25574b14-4274-4f39-a4a6-9dba612d7daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "048721a7-0662-4ac7-b56f-03d3a623391d", "name": "network-vif-deleted", "tag": "f158ad40-53aa-41b8-8e7c-9202bda1a7f8"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:22.051590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-152f1bd9-b36d-4069-a5ea-555c8814a574 req-25574b14-4274-4f39-a4a6-9dba612d7daa service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:22.052096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-152f1bd9-b36d-4069-a5ea-555c8814a574 req-25574b14-4274-4f39-a4a6-9dba612d7daa service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:22.070341 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-152f1bd9-b36d-4069-a5ea-555c8814a574 req-25574b14-4274-4f39-a4a6-9dba612d7daa service nova] Creating event network-vif-deleted:f158ad40-53aa-41b8-8e7c-9202bda1a7f8 for instance 048721a7-0662-4ac7-b56f-03d3a623391d on n-h1-843700-1 May 28 04:50:22.077323 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-152f1bd9-b36d-4069-a5ea-555c8814a574 req-25574b14-4274-4f39-a4a6-9dba612d7daa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053307 May 28 04:50:22.079689 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1912/3917] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:22.151112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-01046cae-ead2-4229-907a-7f14062297f8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:22.157396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-01046cae-ead2-4229-907a-7f14062297f8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:22.181201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01046cae-ead2-4229-907a-7f14062297f8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:22.182256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01046cae-ead2-4229-907a-7f14062297f8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:22.192188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01046cae-ead2-4229-907a-7f14062297f8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:22.193749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01046cae-ead2-4229-907a-7f14062297f8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:22.322371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eac1e0ea-5262-421f-b10c-a626ae11883d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:22.324889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eac1e0ea-5262-421f-b10c-a626ae11883d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:22.336962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eac1e0ea-5262-421f-b10c-a626ae11883d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:22.337860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eac1e0ea-5262-421f-b10c-a626ae11883d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:22.341487 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eac1e0ea-5262-421f-b10c-a626ae11883d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:22.342229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eac1e0ea-5262-421f-b10c-a626ae11883d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:22.376706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-01046cae-ead2-4229-907a-7f14062297f8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:22.398599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:22.411688 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-01046cae-ead2-4229-907a-7f14062297f8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d" status: 200 len: 1313 microversion: 2.1 time: 0.265627 May 28 04:50:22.413450 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2006/3918] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:22 2022] GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:22.419204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bd25e296-3ea7-4846-95ab-7705bae88b81 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:22.420010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bd25e296-3ea7-4846-95ab-7705bae88b81 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:22.442054 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd25e296-3ea7-4846-95ab-7705bae88b81 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:22.443065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd25e296-3ea7-4846-95ab-7705bae88b81 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:22.444116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd25e296-3ea7-4846-95ab-7705bae88b81 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:22.444964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd25e296-3ea7-4846-95ab-7705bae88b81 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:22.554239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bd25e296-3ea7-4846-95ab-7705bae88b81 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:22.594654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eac1e0ea-5262-421f-b10c-a626ae11883d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:22.595119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bd25e296-3ea7-4846-95ab-7705bae88b81 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:22.596892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bd25e296-3ea7-4846-95ab-7705bae88b81 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:22.598419 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bd25e296-3ea7-4846-95ab-7705bae88b81 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.183641 May 28 04:50:22.599193 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2007/3919] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:22 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:22.607075 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eac1e0ea-5262-421f-b10c-a626ae11883d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1522 microversion: 2.1 time: 0.292153 May 28 04:50:22.610356 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1913/3920] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:22 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:22.758516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1071fac1-1622-4b12-8e1b-da59b802edc5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:22.759296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1071fac1-1622-4b12-8e1b-da59b802edc5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:22.767631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1071fac1-1622-4b12-8e1b-da59b802edc5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:22.768169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1071fac1-1622-4b12-8e1b-da59b802edc5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:22.769023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1071fac1-1622-4b12-8e1b-da59b802edc5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:22.769799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1071fac1-1622-4b12-8e1b-da59b802edc5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:22.848514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9c10b996-2b00-4540-866d-ee57b76a5da6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:22.850512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9c10b996-2b00-4540-866d-ee57b76a5da6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:22.869671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9c10b996-2b00-4540-866d-ee57b76a5da6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:22.869671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9c10b996-2b00-4540-866d-ee57b76a5da6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:22.869671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9c10b996-2b00-4540-866d-ee57b76a5da6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:22.869671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9c10b996-2b00-4540-866d-ee57b76a5da6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:23.045609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1071fac1-1622-4b12-8e1b-da59b802edc5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:23.053307 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1071fac1-1622-4b12-8e1b-da59b802edc5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1355 microversion: 2.1 time: 0.300626 May 28 04:50:23.057692 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2008/3921] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:22 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1355 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:23.073083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9c10b996-2b00-4540-866d-ee57b76a5da6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:23.085550 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9c10b996-2b00-4540-866d-ee57b76a5da6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1501 microversion: 2.1 time: 0.241174 May 28 04:50:23.087428 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1914/3922] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:22 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1501 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:23.104299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-51b81f2a-c280-4008-9989-e67af043ad9b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:23.105586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-51b81f2a-c280-4008-9989-e67af043ad9b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:23.147579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51b81f2a-c280-4008-9989-e67af043ad9b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:23.148038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51b81f2a-c280-4008-9989-e67af043ad9b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:23.150789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51b81f2a-c280-4008-9989-e67af043ad9b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:23.151274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51b81f2a-c280-4008-9989-e67af043ad9b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:23.429719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1b19dfbb-8749-4879-85a3-89e442b736e4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:23.430968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1b19dfbb-8749-4879-85a3-89e442b736e4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:23.443415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b19dfbb-8749-4879-85a3-89e442b736e4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:23.444090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b19dfbb-8749-4879-85a3-89e442b736e4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:23.445315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b19dfbb-8749-4879-85a3-89e442b736e4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:23.452719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b19dfbb-8749-4879-85a3-89e442b736e4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:23.482901 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-1b19dfbb-8749-4879-85a3-89e442b736e4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance 048721a7-0662-4ac7-b56f-03d3a623391d could not be found. May 28 04:50:23.483145 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-51b81f2a-c280-4008-9989-e67af043ad9b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece/action" status: 202 len: 0 microversion: 2.1 time: 0.383121 May 28 04:50:23.484312 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2009/3923] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:50:23 2022] POST /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1b19dfbb-8749-4879-85a3-89e442b736e4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d HTTP/1.1 May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 048721a7-0662-4ac7-b56f-03d3a623391d could not be found. May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '048721a7-0662-4ac7-b56f-03d3a623391d'} May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 048721a7-0662-4ac7-b56f-03d3a623391d could not be found. May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 048721a7-0662-4ac7-b56f-03d3a623391d could not be found. May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:23.484784 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:23.495509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:50:23.495509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:50:23.495509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:50:23.495509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:50:23.495509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 048721a7-0662-4ac7-b56f-03d3a623391d could not be found. May 28 04:50:23.495509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:23.495509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1b19dfbb-8749-4879-85a3-89e442b736e4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance 048721a7-0662-4ac7-b56f-03d3a623391d could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:50:23.498049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9e2da0b7-9519-4664-9b93-f8aa0988baf2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:23.498717 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1b19dfbb-8749-4879-85a3-89e442b736e4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d" status: 404 len: 111 microversion: 2.1 time: 0.064880 May 28 04:50:23.499539 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1915/3924] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:23 2022] GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:50:23.500444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9e2da0b7-9519-4664-9b93-f8aa0988baf2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:23.509184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1d01a68a-3ee0-4572-8583-1327c7a8da9e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '.version_select at 0x7f7701df13a0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:23.514746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e2da0b7-9519-4664-9b93-f8aa0988baf2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:23.516599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e2da0b7-9519-4664-9b93-f8aa0988baf2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:23.517582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e2da0b7-9519-4664-9b93-f8aa0988baf2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:23.520057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e2da0b7-9519-4664-9b93-f8aa0988baf2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:23.615052 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1d01a68a-3ee0-4572-8583-1327c7a8da9e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-key-1976251185" status: 202 len: 0 microversion: 2.1 time: 0.110271 May 28 04:50:23.616554 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1916/3925] 10.222.0.58 () {58 vars in 1208 bytes} [Sat May 28 04:50:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1976251185 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:50:23.623134 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-97ab4a77-0707-4d9e-a77d-8f424a1a3dee tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:23.624060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-97ab4a77-0707-4d9e-a77d-8f424a1a3dee tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:23.634541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97ab4a77-0707-4d9e-a77d-8f424a1a3dee tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:23.636133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97ab4a77-0707-4d9e-a77d-8f424a1a3dee tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:23.637389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97ab4a77-0707-4d9e-a77d-8f424a1a3dee tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:23.639271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97ab4a77-0707-4d9e-a77d-8f424a1a3dee tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:23.660024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=19 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:23.707273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9e2da0b7-9519-4664-9b93-f8aa0988baf2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:23.718501 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9e2da0b7-9519-4664-9b93-f8aa0988baf2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1506 microversion: 2.1 time: 0.229288 May 28 04:50:23.728094 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2010/3926] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:23 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1506 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:23.728094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5496910b-0571-4a08-859a-226eb65aa637 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:23.728094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5496910b-0571-4a08-859a-226eb65aa637 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:23.742806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5496910b-0571-4a08-859a-226eb65aa637 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:23.745767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5496910b-0571-4a08-859a-226eb65aa637 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:23.752606 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-97ab4a77-0707-4d9e-a77d-8f424a1a3dee tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:23.762913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-97ab4a77-0707-4d9e-a77d-8f424a1a3dee tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:23.764387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-97ab4a77-0707-4d9e-a77d-8f424a1a3dee tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:23.765366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5496910b-0571-4a08-859a-226eb65aa637 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:23.765973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5496910b-0571-4a08-859a-226eb65aa637 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:23.773158 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-97ab4a77-0707-4d9e-a77d-8f424a1a3dee tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.155456 May 28 04:50:23.775691 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1917/3927] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:23 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:23.816472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-52a911bc-73d5-4a69-88d2-f510d2e175e0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1845866300", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "fd0d7eb0-eb78-443c-941c-e203b5533601"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:23.880752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-52a911bc-73d5-4a69-88d2-f510d2e175e0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] validate_networks() for [('fd0d7eb0-eb78-443c-941c-e203b5533601', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:50:24.058528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5496910b-0571-4a08-859a-226eb65aa637 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:24.085727 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5496910b-0571-4a08-859a-226eb65aa637 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1522 microversion: 2.1 time: 0.363445 May 28 04:50:24.088458 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2011/3928] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:23 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:24.101582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c659f79c-c3d7-45d0-874e-99c9157ebc99 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:24.102210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c659f79c-c3d7-45d0-874e-99c9157ebc99 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:24.123372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c659f79c-c3d7-45d0-874e-99c9157ebc99 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:24.123372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c659f79c-c3d7-45d0-874e-99c9157ebc99 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:24.126879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c659f79c-c3d7-45d0-874e-99c9157ebc99 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:24.127359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c659f79c-c3d7-45d0-874e-99c9157ebc99 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:24.192073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:24.414115 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c659f79c-c3d7-45d0-874e-99c9157ebc99 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:24.422159 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c659f79c-c3d7-45d0-874e-99c9157ebc99 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1355 microversion: 2.1 time: 0.332586 May 28 04:50:24.432199 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2012/3929] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:24 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1355 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:24.501797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-52a911bc-73d5-4a69-88d2-f510d2e175e0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:50:24.502306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-52a911bc-73d5-4a69-88d2-f510d2e175e0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:50:24.502870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-52a911bc-73d5-4a69-88d2-f510d2e175e0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:50:24.503403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-52a911bc-73d5-4a69-88d2-f510d2e175e0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:50:24.503942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-52a911bc-73d5-4a69-88d2-f510d2e175e0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:50:24.518899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52a911bc-73d5-4a69-88d2-f510d2e175e0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:24.519759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52a911bc-73d5-4a69-88d2-f510d2e175e0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:24.520910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52a911bc-73d5-4a69-88d2-f510d2e175e0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:24.521791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52a911bc-73d5-4a69-88d2-f510d2e175e0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:24.547618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-52a911bc-73d5-4a69-88d2-f510d2e175e0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Getting quotas for project 724a5513bc2c42eabbefa450e207453e. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:50:24.554911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-52a911bc-73d5-4a69-88d2-f510d2e175e0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Getting quotas for user 71b6b3ac5a4249fd8f76fb2e7e2b6c18 and project 724a5513bc2c42eabbefa450e207453e. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:50:24.594706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-52a911bc-73d5-4a69-88d2-f510d2e175e0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:50:24.597147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-52a911bc-73d5-4a69-88d2-f510d2e175e0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:50:24.735745 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a30d8e8f-5ef3-43be-bbcb-9ee532262f94 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:24.739281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a30d8e8f-5ef3-43be-bbcb-9ee532262f94 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:24.749753 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a30d8e8f-5ef3-43be-bbcb-9ee532262f94 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:24.750889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a30d8e8f-5ef3-43be-bbcb-9ee532262f94 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:24.754280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a30d8e8f-5ef3-43be-bbcb-9ee532262f94 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:24.754963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a30d8e8f-5ef3-43be-bbcb-9ee532262f94 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:24.763358 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-52a911bc-73d5-4a69-88d2-f510d2e175e0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.951677 May 28 04:50:24.775375 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1918/3930] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:50:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 04:50:24.783982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9b447898-8cff-4781-91ee-d321e9bf36b5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:24.784623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9b447898-8cff-4781-91ee-d321e9bf36b5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:24.966752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9b447898-8cff-4781-91ee-d321e9bf36b5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:24.981069 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9b447898-8cff-4781-91ee-d321e9bf36b5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d" status: 200 len: 1209 microversion: 2.1 time: 0.205655 May 28 04:50:24.982121 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1919/3931] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:24 2022] GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d => generated 1209 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:24.988927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4518b33d-42ed-491d-89c7-04099dcfd1cc tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:24.990084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4518b33d-42ed-491d-89c7-04099dcfd1cc tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:25.007186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4518b33d-42ed-491d-89c7-04099dcfd1cc tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:25.007186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4518b33d-42ed-491d-89c7-04099dcfd1cc tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:25.007186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4518b33d-42ed-491d-89c7-04099dcfd1cc tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:25.007186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4518b33d-42ed-491d-89c7-04099dcfd1cc tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:25.074177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a30d8e8f-5ef3-43be-bbcb-9ee532262f94 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:25.088923 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a30d8e8f-5ef3-43be-bbcb-9ee532262f94 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1486 microversion: 2.1 time: 0.356911 May 28 04:50:25.090647 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2013/3932] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:24 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1486 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:25.102351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e50f4315-270b-430a-a7b0-fbdc2fd6b302 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:25.110479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e50f4315-270b-430a-a7b0-fbdc2fd6b302 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:25.111762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e50f4315-270b-430a-a7b0-fbdc2fd6b302 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:25.112539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e50f4315-270b-430a-a7b0-fbdc2fd6b302 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:25.120088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4518b33d-42ed-491d-89c7-04099dcfd1cc tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:25.124312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e50f4315-270b-430a-a7b0-fbdc2fd6b302 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:25.124763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e50f4315-270b-430a-a7b0-fbdc2fd6b302 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:25.131186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4518b33d-42ed-491d-89c7-04099dcfd1cc tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:25.133418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4518b33d-42ed-491d-89c7-04099dcfd1cc tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:25.134786 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4518b33d-42ed-491d-89c7-04099dcfd1cc tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.150448 May 28 04:50:25.136777 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1920/3933] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:24 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:25.144431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5d145440-5960-4077-a22e-8062f2e1a5ba tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:25.145610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5d145440-5960-4077-a22e-8062f2e1a5ba tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:25.153087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d145440-5960-4077-a22e-8062f2e1a5ba tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:25.153710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d145440-5960-4077-a22e-8062f2e1a5ba tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:25.154889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d145440-5960-4077-a22e-8062f2e1a5ba tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:25.155515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d145440-5960-4077-a22e-8062f2e1a5ba tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:25.184268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-5d145440-5960-4077-a22e-8062f2e1a5ba tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lazy-loading 'flavor' on Instance uuid 0a940c92-8dca-4cf5-90a9-d7d617ec9ece {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:50:25.409093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e50f4315-270b-430a-a7b0-fbdc2fd6b302 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:25.417958 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e50f4315-270b-430a-a7b0-fbdc2fd6b302 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1522 microversion: 2.1 time: 0.319405 May 28 04:50:25.418729 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2014/3934] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:25 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:25.450485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-00871ffc-e430-4d89-9ed9-e6859654f30b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:25.451437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-00871ffc-e430-4d89-9ed9-e6859654f30b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:25.460146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00871ffc-e430-4d89-9ed9-e6859654f30b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:25.460815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00871ffc-e430-4d89-9ed9-e6859654f30b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:25.461901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00871ffc-e430-4d89-9ed9-e6859654f30b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:25.462505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00871ffc-e430-4d89-9ed9-e6859654f30b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:25.629889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-00871ffc-e430-4d89-9ed9-e6859654f30b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:25.648301 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-00871ffc-e430-4d89-9ed9-e6859654f30b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1355 microversion: 2.1 time: 0.212472 May 28 04:50:25.663111 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2015/3935] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:25 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1355 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:25.904743 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5d145440-5960-4077-a22e-8062f2e1a5ba tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece/action" status: 202 len: 0 microversion: 2.1 time: 0.765238 May 28 04:50:25.906669 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1921/3936] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:50:25 2022] POST /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece/action => generated 0 bytes in 769 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:50:25.916011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3beb4567-b8bd-4869-b7ff-1739cd2dbdab tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:25.916948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3beb4567-b8bd-4869-b7ff-1739cd2dbdab tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:25.922734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:25.925157 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3beb4567-b8bd-4869-b7ff-1739cd2dbdab tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:25.925793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3beb4567-b8bd-4869-b7ff-1739cd2dbdab tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:25.926742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3beb4567-b8bd-4869-b7ff-1739cd2dbdab tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:25.927407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3beb4567-b8bd-4869-b7ff-1739cd2dbdab tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:26.040634 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a47dbcc0-d2c6-4da9-98b9-000f607b6d12 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'create', calling method: .version_select at 0x7f7700c033a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2090468210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnedSZ8INUsjU0VihBto4M9Zy834TkZecz2nkWuaNKNruXwaVJSKpNGSFw8OB8ngU+/RWUEM6kKS7wlTE0/wyq90+VL9ZYAi6Ue5b7s8uVH/Y2PsL+5K1FdX02KnpBu1g=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:26.086525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-a47dbcc0-d2c6-4da9-98b9-000f607b6d12 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Getting quotas for project d14e7de3a28f42a79197e1c06c4676dd. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:50:26.092893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-a47dbcc0-d2c6-4da9-98b9-000f607b6d12 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Getting quotas for user 82b17444b87742e1b45409810cbe06d2 and project d14e7de3a28f42a79197e1c06c4676dd. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:50:26.159708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3beb4567-b8bd-4869-b7ff-1739cd2dbdab tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:26.170954 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3beb4567-b8bd-4869-b7ff-1739cd2dbdab tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1492 microversion: 2.1 time: 0.259684 May 28 04:50:26.172260 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1922/3937] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:25 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1492 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:26.210050 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a47dbcc0-d2c6-4da9-98b9-000f607b6d12 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.483366 May 28 04:50:26.215421 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2016/3938] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:50:25 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:26.221360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e54aff31-3358-4aaa-a6cc-ca29da5b6d8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:26.222687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e54aff31-3358-4aaa-a6cc-ca29da5b6d8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:26.234096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e54aff31-3358-4aaa-a6cc-ca29da5b6d8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:26.235216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e54aff31-3358-4aaa-a6cc-ca29da5b6d8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:26.236571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e54aff31-3358-4aaa-a6cc-ca29da5b6d8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:26.237281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e54aff31-3358-4aaa-a6cc-ca29da5b6d8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:26.255421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a2b03c11-8806-4c8c-9fcb-88ec765d5cfb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1700202227", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "807b877d-73e2-4031-b4ab-972d86c6cc59"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:26.315197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e54aff31-3358-4aaa-a6cc-ca29da5b6d8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:26.320734 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e54aff31-3358-4aaa-a6cc-ca29da5b6d8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d" status: 200 len: 1213 microversion: 2.1 time: 0.102239 May 28 04:50:26.321075 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-a2b03c11-8806-4c8c-9fcb-88ec765d5cfb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] validate_networks() for [('807b877d-73e2-4031-b4ab-972d86c6cc59', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:50:26.321346 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2017/3939] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:26 2022] GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:26.331937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0799c9da-9e70-4bb8-92a0-8d45d23e1967 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:26.332851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0799c9da-9e70-4bb8-92a0-8d45d23e1967 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:26.347921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0799c9da-9e70-4bb8-92a0-8d45d23e1967 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:26.347921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0799c9da-9e70-4bb8-92a0-8d45d23e1967 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:26.347921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0799c9da-9e70-4bb8-92a0-8d45d23e1967 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:26.347921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0799c9da-9e70-4bb8-92a0-8d45d23e1967 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:26.482494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0799c9da-9e70-4bb8-92a0-8d45d23e1967 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:26.502560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0799c9da-9e70-4bb8-92a0-8d45d23e1967 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:26.505010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0799c9da-9e70-4bb8-92a0-8d45d23e1967 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:26.510380 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0799c9da-9e70-4bb8-92a0-8d45d23e1967 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.187019 May 28 04:50:26.511240 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2018/3940] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:26 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:26.525131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e27b9f8d-b95e-498e-b246-243719eab2b1 req-ad740c73-2147-4784-8b6a-3c4ba804eaa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831f1333-b707-473c-a6a5-f2ef08552976", "name": "network-vif-plugged", "status": "completed", "tag": "09ec63fd-1a6d-4123-a858-83f57185a42c"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:26.562265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e27b9f8d-b95e-498e-b246-243719eab2b1 req-ad740c73-2147-4784-8b6a-3c4ba804eaa0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:26.564780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e27b9f8d-b95e-498e-b246-243719eab2b1 req-ad740c73-2147-4784-8b6a-3c4ba804eaa0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:26.596816 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e27b9f8d-b95e-498e-b246-243719eab2b1 req-ad740c73-2147-4784-8b6a-3c4ba804eaa0 service nova] Creating event network-vif-plugged:09ec63fd-1a6d-4123-a858-83f57185a42c for instance 831f1333-b707-473c-a6a5-f2ef08552976 on n-h2-843700-1 May 28 04:50:26.608012 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e27b9f8d-b95e-498e-b246-243719eab2b1 req-ad740c73-2147-4784-8b6a-3c4ba804eaa0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092268 May 28 04:50:26.610124 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2019/3941] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:26.624855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-66ec7689-d0a5-478b-bb6c-3a05d7c5e016 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:26.625571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-66ec7689-d0a5-478b-bb6c-3a05d7c5e016 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:26.632548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66ec7689-d0a5-478b-bb6c-3a05d7c5e016 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:26.633255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66ec7689-d0a5-478b-bb6c-3a05d7c5e016 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:26.637506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66ec7689-d0a5-478b-bb6c-3a05d7c5e016 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:26.637506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66ec7689-d0a5-478b-bb6c-3a05d7c5e016 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:27.246751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-66ec7689-d0a5-478b-bb6c-3a05d7c5e016 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:27.256709 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-66ec7689-d0a5-478b-bb6c-3a05d7c5e016 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1522 microversion: 2.1 time: 0.641947 May 28 04:50:27.266762 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2020/3942] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:26 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1522 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:27.271905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-83dffbd3-0f5e-48da-ad14-082d05624493 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:27.272639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-83dffbd3-0f5e-48da-ad14-082d05624493 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:27.274715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:27.279828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83dffbd3-0f5e-48da-ad14-082d05624493 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:27.280483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83dffbd3-0f5e-48da-ad14-082d05624493 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:27.283877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a2b03c11-8806-4c8c-9fcb-88ec765d5cfb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:50:27.284352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a2b03c11-8806-4c8c-9fcb-88ec765d5cfb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:50:27.292120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a2b03c11-8806-4c8c-9fcb-88ec765d5cfb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:50:27.292542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a2b03c11-8806-4c8c-9fcb-88ec765d5cfb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:50:27.294754 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a2b03c11-8806-4c8c-9fcb-88ec765d5cfb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:50:27.298029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83dffbd3-0f5e-48da-ad14-082d05624493 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:27.298484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83dffbd3-0f5e-48da-ad14-082d05624493 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:27.309851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2b03c11-8806-4c8c-9fcb-88ec765d5cfb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:27.310451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2b03c11-8806-4c8c-9fcb-88ec765d5cfb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:27.311404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2b03c11-8806-4c8c-9fcb-88ec765d5cfb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:27.311912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2b03c11-8806-4c8c-9fcb-88ec765d5cfb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:27.318742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=19 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:27.331747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-a2b03c11-8806-4c8c-9fcb-88ec765d5cfb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Getting quotas for project dd598ce55f9b43d38530dae05fa1bda1. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:50:27.337539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-a2b03c11-8806-4c8c-9fcb-88ec765d5cfb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Getting quotas for user b05e9b7e95074a91bc984338593c6c84 and project dd598ce55f9b43d38530dae05fa1bda1. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:50:27.351763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a2b03c11-8806-4c8c-9fcb-88ec765d5cfb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:50:27.354173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a2b03c11-8806-4c8c-9fcb-88ec765d5cfb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:50:27.485105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-83dffbd3-0f5e-48da-ad14-082d05624493 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:27.493896 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-83dffbd3-0f5e-48da-ad14-082d05624493 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1355 microversion: 2.1 time: 0.225914 May 28 04:50:27.494725 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2021/3943] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:27 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1355 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:27.499533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5dd4125b-98c2-4f4b-830e-d081ef334114 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:27.500295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5dd4125b-98c2-4f4b-830e-d081ef334114 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:27.506798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5dd4125b-98c2-4f4b-830e-d081ef334114 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:27.507491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5dd4125b-98c2-4f4b-830e-d081ef334114 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:27.508609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5dd4125b-98c2-4f4b-830e-d081ef334114 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:27.509220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5dd4125b-98c2-4f4b-830e-d081ef334114 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:27.511790 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a2b03c11-8806-4c8c-9fcb-88ec765d5cfb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.338018 May 28 04:50:27.515498 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1923/3944] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:50:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:50:27.532409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-95028675-df89-450e-be7f-1c6bf98bc739 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:27.533363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-95028675-df89-450e-be7f-1c6bf98bc739 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:27.546312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-95028675-df89-450e-be7f-1c6bf98bc739 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:27.547859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-95028675-df89-450e-be7f-1c6bf98bc739 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:27.548942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-95028675-df89-450e-be7f-1c6bf98bc739 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:27.550701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-95028675-df89-450e-be7f-1c6bf98bc739 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:27.713898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-95028675-df89-450e-be7f-1c6bf98bc739 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:27.725018 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-95028675-df89-450e-be7f-1c6bf98bc739 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d" status: 200 len: 1269 microversion: 2.1 time: 0.205795 May 28 04:50:27.725450 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1924/3945] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:27 2022] GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d => generated 1269 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:27.740230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3c4a52b7-45ca-4bb0-b5a5-c68aa2d4b580 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:27.740880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3c4a52b7-45ca-4bb0-b5a5-c68aa2d4b580 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:27.888361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3c4a52b7-45ca-4bb0-b5a5-c68aa2d4b580 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:27.897690 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3c4a52b7-45ca-4bb0-b5a5-c68aa2d4b580 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 200 len: 1215 microversion: 2.1 time: 0.161471 May 28 04:50:27.903757 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1925/3946] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:27 2022] GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 1215 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:27.909125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-de6ed0e6-397b-40bc-a1df-c57b6b3a8838 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:27.909787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-de6ed0e6-397b-40bc-a1df-c57b6b3a8838 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:27.917039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de6ed0e6-397b-40bc-a1df-c57b6b3a8838 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:27.917710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de6ed0e6-397b-40bc-a1df-c57b6b3a8838 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:27.918668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de6ed0e6-397b-40bc-a1df-c57b6b3a8838 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:27.919362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de6ed0e6-397b-40bc-a1df-c57b6b3a8838 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:27.920996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5dd4125b-98c2-4f4b-830e-d081ef334114 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:27.933078 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5dd4125b-98c2-4f4b-830e-d081ef334114 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1513 microversion: 2.1 time: 0.436905 May 28 04:50:27.945352 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2022/3947] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:27 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1513 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:28.027887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-de6ed0e6-397b-40bc-a1df-c57b6b3a8838 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:28.063802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-de6ed0e6-397b-40bc-a1df-c57b6b3a8838 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:28.076350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-de6ed0e6-397b-40bc-a1df-c57b6b3a8838 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:28.083925 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-de6ed0e6-397b-40bc-a1df-c57b6b3a8838 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.172891 May 28 04:50:28.083925 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1926/3948] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:27 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:28.274713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a4c347b0-cdb1-444d-afb0-effb3a617b1e tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:28.276046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a4c347b0-cdb1-444d-afb0-effb3a617b1e tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:28.286615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4c347b0-cdb1-444d-afb0-effb3a617b1e tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:28.287394 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4c347b0-cdb1-444d-afb0-effb3a617b1e tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:28.292392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4c347b0-cdb1-444d-afb0-effb3a617b1e tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:28.292392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4c347b0-cdb1-444d-afb0-effb3a617b1e tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:28.514097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c607be0a-79c8-4dfe-946b-31ad4d0c6552 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:28.516496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c607be0a-79c8-4dfe-946b-31ad4d0c6552 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:28.527900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c607be0a-79c8-4dfe-946b-31ad4d0c6552 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:28.529018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c607be0a-79c8-4dfe-946b-31ad4d0c6552 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:28.530134 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c607be0a-79c8-4dfe-946b-31ad4d0c6552 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:28.531208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c607be0a-79c8-4dfe-946b-31ad4d0c6552 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:28.621642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a4c347b0-cdb1-444d-afb0-effb3a617b1e tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:28.654071 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a4c347b0-cdb1-444d-afb0-effb3a617b1e tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1522 microversion: 2.1 time: 0.383964 May 28 04:50:28.655516 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2023/3949] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:28 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:28.660928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-d0309cfe-5333-4772-b3cc-110c481b5658 req-a09cc34e-72e6-4850-926e-bea3dc2c04fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831f1333-b707-473c-a6a5-f2ef08552976", "name": "network-vif-plugged", "status": "completed", "tag": "b609dde5-aef8-42ba-a770-6da9844b04c0"}, {"server_uuid": "831f1333-b707-473c-a6a5-f2ef08552976", "name": "network-vif-plugged", "status": "completed", "tag": "17551bec-4be6-4f43-896e-15ec7cbf52ff"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:28.688760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d0309cfe-5333-4772-b3cc-110c481b5658 req-a09cc34e-72e6-4850-926e-bea3dc2c04fc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:28.691408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d0309cfe-5333-4772-b3cc-110c481b5658 req-a09cc34e-72e6-4850-926e-bea3dc2c04fc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:28.717658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:28.722457 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-d0309cfe-5333-4772-b3cc-110c481b5658 req-a09cc34e-72e6-4850-926e-bea3dc2c04fc service nova] Creating event network-vif-plugged:b609dde5-aef8-42ba-a770-6da9844b04c0 for instance 831f1333-b707-473c-a6a5-f2ef08552976 on n-h2-843700-1 May 28 04:50:28.729011 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-d0309cfe-5333-4772-b3cc-110c481b5658 req-a09cc34e-72e6-4850-926e-bea3dc2c04fc service nova] Creating event network-vif-plugged:17551bec-4be6-4f43-896e-15ec7cbf52ff for instance 831f1333-b707-473c-a6a5-f2ef08552976 on n-h2-843700-1 May 28 04:50:28.744028 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-d0309cfe-5333-4772-b3cc-110c481b5658 req-a09cc34e-72e6-4850-926e-bea3dc2c04fc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086406 May 28 04:50:28.750497 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2024/3950] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:28.756866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5142d9aa-870f-4dab-878d-f0011f23119d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:28.758211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5142d9aa-870f-4dab-878d-f0011f23119d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:28.767144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5142d9aa-870f-4dab-878d-f0011f23119d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:28.768301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5142d9aa-870f-4dab-878d-f0011f23119d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:28.769374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5142d9aa-870f-4dab-878d-f0011f23119d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:28.770034 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5142d9aa-870f-4dab-878d-f0011f23119d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:28.870509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c607be0a-79c8-4dfe-946b-31ad4d0c6552 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:28.878888 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c607be0a-79c8-4dfe-946b-31ad4d0c6552 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1355 microversion: 2.1 time: 0.370501 May 28 04:50:28.879524 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1927/3951] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:28 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1355 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:28.891107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e64835d5-046e-422f-ae90-a0602ec144f6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73cb9eb7-67b0-47b6-9110-14b24603d86f"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:28.892253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e64835d5-046e-422f-ae90-a0602ec144f6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:28.899337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5142d9aa-870f-4dab-878d-f0011f23119d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:28.907771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e64835d5-046e-422f-ae90-a0602ec144f6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:28.909357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e64835d5-046e-422f-ae90-a0602ec144f6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:28.909357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e64835d5-046e-422f-ae90-a0602ec144f6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:28.912607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e64835d5-046e-422f-ae90-a0602ec144f6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:28.914626 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5142d9aa-870f-4dab-878d-f0011f23119d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d" status: 200 len: 1267 microversion: 2.1 time: 0.162448 May 28 04:50:28.915562 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2025/3952] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:28 2022] GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:28.921853 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-adb1da55-1b26-4d74-9725-b44cb57f1ede tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:28.923137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-adb1da55-1b26-4d74-9725-b44cb57f1ede tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:29.009771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-adb1da55-1b26-4d74-9725-b44cb57f1ede tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:29.017632 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-adb1da55-1b26-4d74-9725-b44cb57f1ede tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 200 len: 1215 microversion: 2.1 time: 0.100702 May 28 04:50:29.028278 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2026/3953] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:28 2022] GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 1215 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:29.033906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-264049c9-8b1e-408e-9453-f0d687aaff02 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:29.034867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-264049c9-8b1e-408e-9453-f0d687aaff02 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:29.041505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-264049c9-8b1e-408e-9453-f0d687aaff02 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:29.042243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-264049c9-8b1e-408e-9453-f0d687aaff02 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:29.042727 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-e64835d5-046e-422f-ae90-a0602ec144f6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] HTTP exception thrown: Invalid volume: volume 73cb9eb7-67b0-47b6-9110-14b24603d86f is already attached to instances: 711037c4-54ef-4071-a370-fd39338dccf8 May 28 04:50:29.043406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-264049c9-8b1e-408e-9453-f0d687aaff02 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:29.044007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-264049c9-8b1e-408e-9453-f0d687aaff02 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e64835d5-046e-422f-ae90-a0602ec144f6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Request method failure captured: May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments HTTP/1.1 May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 74 May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikajS0ZZaXFlax6A342ymJ-aQoGJlvna1xZy9bO84b3D9OriaYICvIupIZdjiNLcHyTC7V-bCXuJxYAHanDCccz0wxij-I7blA2wa6CB5mbuJxMVXKjiUcQwy4f7KRJtSQW8-6D6CRl3EsAa-9i5aRJ6Odwpn_PfoRh6K409eAlefhoM May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 025cb09c79a147b3a648c950edcd1dc3 May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: {"volumeAttachment": {"volumeId": "73cb9eb7-67b0-47b6-9110-14b24603d86f"}} May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid volume: volume 73cb9eb7-67b0-47b6-9110-14b24603d86f is already attached to instances: 711037c4-54ef-4071-a370-fd39338dccf8 May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'server_id': '711037c4-54ef-4071-a370-fd39338dccf8', 'body': {'volumeAttachment': {'volumeId': '73cb9eb7-67b0-47b6-9110-14b24603d86f'}}} May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 73cb9eb7-67b0-47b6-9110-14b24603d86f is already attached to instances: 711037c4-54ef-4071-a370-fd39338dccf8 May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:50:29.044914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:50:29.049656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:50:29.049656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:50:29.049656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 28 04:50:29.049656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 28 04:50:29.049656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 73cb9eb7-67b0-47b6-9110-14b24603d86f is already attached to instances: 711037c4-54ef-4071-a370-fd39338dccf8 May 28 04:50:29.049656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:29.049656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:50:29.049656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:29.049656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:29.049656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:50:29.049656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:50:29.049656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:50:29.049656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:50:29.049656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 73cb9eb7-67b0-47b6-9110-14b24603d86f is already attached to instances: 711037c4-54ef-4071-a370-fd39338dccf8 May 28 04:50:29.049656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:29.049656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e64835d5-046e-422f-ae90-a0602ec144f6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Returning 400 to user: Invalid volume: volume 73cb9eb7-67b0-47b6-9110-14b24603d86f is already attached to instances: 711037c4-54ef-4071-a370-fd39338dccf8 {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:50:29.049656 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e64835d5-046e-422f-ae90-a0602ec144f6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "POST /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.165939 May 28 04:50:29.049656 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1928/3954] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 04:50:28 2022] POST /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments => generated 174 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:50:29.097349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0a69e594-573e-4565-9867-04ac309146fa tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:29.098189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0a69e594-573e-4565-9867-04ac309146fa tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:29.120465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a69e594-573e-4565-9867-04ac309146fa tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:29.120927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a69e594-573e-4565-9867-04ac309146fa tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:29.121830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a69e594-573e-4565-9867-04ac309146fa tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:29.122354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a69e594-573e-4565-9867-04ac309146fa tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:29.271688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0a69e594-573e-4565-9867-04ac309146fa tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:29.281216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:29.301293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0a69e594-573e-4565-9867-04ac309146fa tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:29.305950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0a69e594-573e-4565-9867-04ac309146fa tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:29.307564 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0a69e594-573e-4565-9867-04ac309146fa tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.214731 May 28 04:50:29.322762 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1929/3955] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:29 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:50:29.344572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3638ab38-339a-4998-ab68-95c3e1875c02 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:29.347382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3638ab38-339a-4998-ab68-95c3e1875c02 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:29.362231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3638ab38-339a-4998-ab68-95c3e1875c02 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:29.370180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3638ab38-339a-4998-ab68-95c3e1875c02 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:29.377580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3638ab38-339a-4998-ab68-95c3e1875c02 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:29.378287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3638ab38-339a-4998-ab68-95c3e1875c02 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:29.457878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-264049c9-8b1e-408e-9453-f0d687aaff02 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:29.469436 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-264049c9-8b1e-408e-9453-f0d687aaff02 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1513 microversion: 2.1 time: 0.439731 May 28 04:50:29.479241 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2027/3956] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:29 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1513 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:29.535319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-3638ab38-339a-4998-ab68-95c3e1875c02 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lazy-loading 'services' on Instance uuid 711037c4-54ef-4071-a370-fd39338dccf8 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:50:29.674146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9dbffc57-4387-4c2b-a7a5-23c3be1f2d77 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:29.674879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9dbffc57-4387-4c2b-a7a5-23c3be1f2d77 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:29.681436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9dbffc57-4387-4c2b-a7a5-23c3be1f2d77 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:29.683727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9dbffc57-4387-4c2b-a7a5-23c3be1f2d77 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:29.700596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9dbffc57-4387-4c2b-a7a5-23c3be1f2d77 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:29.702504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9dbffc57-4387-4c2b-a7a5-23c3be1f2d77 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:29.820302 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3638ab38-339a-4998-ab68-95c3e1875c02 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "DELETE /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments/73cb9eb7-67b0-47b6-9110-14b24603d86f" status: 202 len: 0 microversion: 2.1 time: 0.493556 May 28 04:50:29.822375 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1930/3957] 10.222.0.58 () {58 vars in 1415 bytes} [Sat May 28 04:50:29 2022] DELETE /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments/73cb9eb7-67b0-47b6-9110-14b24603d86f => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:50:29.852621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7820c3db-8019-4d84-865b-ccc14aaf4a81 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:29.854781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7820c3db-8019-4d84-865b-ccc14aaf4a81 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:29.880934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7820c3db-8019-4d84-865b-ccc14aaf4a81 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:29.881403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7820c3db-8019-4d84-865b-ccc14aaf4a81 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:29.883405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7820c3db-8019-4d84-865b-ccc14aaf4a81 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:29.883854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7820c3db-8019-4d84-865b-ccc14aaf4a81 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:30.011680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9dbffc57-4387-4c2b-a7a5-23c3be1f2d77 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:30.023228 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7820c3db-8019-4d84-865b-ccc14aaf4a81 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187990 May 28 04:50:30.032500 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9dbffc57-4387-4c2b-a7a5-23c3be1f2d77 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1522 microversion: 2.1 time: 0.359737 May 28 04:50:30.034372 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1931/3958] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:50:29 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:30.044621 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2028/3959] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:29 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:30.051677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-81d4bb3f-e07a-4ed1-8c22-f250ef5dff21 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:30.056990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c23a4f86-9924-4202-8acd-9d2cd967aa49 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:30.057339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-81d4bb3f-e07a-4ed1-8c22-f250ef5dff21 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:30.057438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c23a4f86-9924-4202-8acd-9d2cd967aa49 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:30.060971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c23a4f86-9924-4202-8acd-9d2cd967aa49 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:30.061664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c23a4f86-9924-4202-8acd-9d2cd967aa49 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:30.062661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c23a4f86-9924-4202-8acd-9d2cd967aa49 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:30.063343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c23a4f86-9924-4202-8acd-9d2cd967aa49 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:30.074896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81d4bb3f-e07a-4ed1-8c22-f250ef5dff21 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:30.089463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81d4bb3f-e07a-4ed1-8c22-f250ef5dff21 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:30.089463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81d4bb3f-e07a-4ed1-8c22-f250ef5dff21 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:30.089463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81d4bb3f-e07a-4ed1-8c22-f250ef5dff21 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:30.370267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-81d4bb3f-e07a-4ed1-8c22-f250ef5dff21 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:30.378798 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-81d4bb3f-e07a-4ed1-8c22-f250ef5dff21 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1355 microversion: 2.1 time: 0.342610 May 28 04:50:30.388563 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1932/3960] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:30 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1355 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:30.401508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fdc2dfe0-e1db-4505-8ee9-ae4547c776ba tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:30.407969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fdc2dfe0-e1db-4505-8ee9-ae4547c776ba tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:30.418747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdc2dfe0-e1db-4505-8ee9-ae4547c776ba tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:30.419262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdc2dfe0-e1db-4505-8ee9-ae4547c776ba tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:30.420073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdc2dfe0-e1db-4505-8ee9-ae4547c776ba tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:30.420503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdc2dfe0-e1db-4505-8ee9-ae4547c776ba tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:30.452899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c23a4f86-9924-4202-8acd-9d2cd967aa49 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:30.465572 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c23a4f86-9924-4202-8acd-9d2cd967aa49 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d" status: 200 len: 1309 microversion: 2.1 time: 0.419049 May 28 04:50:30.469064 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2029/3961] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:30 2022] GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d => generated 1309 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:30.481501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a76e9c6e-341c-47e9-9108-40fc93601169 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:30.482133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a76e9c6e-341c-47e9-9108-40fc93601169 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:30.519796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a76e9c6e-341c-47e9-9108-40fc93601169 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:30.520667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a76e9c6e-341c-47e9-9108-40fc93601169 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:30.529898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a76e9c6e-341c-47e9-9108-40fc93601169 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:30.529898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a76e9c6e-341c-47e9-9108-40fc93601169 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:30.609486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fdc2dfe0-e1db-4505-8ee9-ae4547c776ba tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:30.622828 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fdc2dfe0-e1db-4505-8ee9-ae4547c776ba tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 200 len: 1267 microversion: 2.1 time: 0.239341 May 28 04:50:30.631743 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1933/3962] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:30 2022] GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 1267 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:30.652567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b1574473-93d5-4f81-8e9c-2b2254884ba3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:30.652567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b1574473-93d5-4f81-8e9c-2b2254884ba3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:30.676745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b1574473-93d5-4f81-8e9c-2b2254884ba3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:30.677952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b1574473-93d5-4f81-8e9c-2b2254884ba3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:30.679354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b1574473-93d5-4f81-8e9c-2b2254884ba3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:30.679354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b1574473-93d5-4f81-8e9c-2b2254884ba3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:30.691224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a76e9c6e-341c-47e9-9108-40fc93601169 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:30.704439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a76e9c6e-341c-47e9-9108-40fc93601169 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:30.713653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a76e9c6e-341c-47e9-9108-40fc93601169 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:30.717543 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a76e9c6e-341c-47e9-9108-40fc93601169 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.245184 May 28 04:50:30.719916 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2030/3963] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:30 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:30.993995 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b1574473-93d5-4f81-8e9c-2b2254884ba3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:31.003097 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b1574473-93d5-4f81-8e9c-2b2254884ba3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1508 microversion: 2.1 time: 0.369913 May 28 04:50:31.003700 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1934/3964] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:30 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1508 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:31.034341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ba4b2c6c-803f-4ee1-9034-7a7ef4c5ac79 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:31.035932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ba4b2c6c-803f-4ee1-9034-7a7ef4c5ac79 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:31.048499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba4b2c6c-803f-4ee1-9034-7a7ef4c5ac79 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:31.050897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e0356500-fdb4-48e4-a0c1-ab7129784784 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:31.051799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e0356500-fdb4-48e4-a0c1-ab7129784784 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:31.053001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba4b2c6c-803f-4ee1-9034-7a7ef4c5ac79 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:31.053823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba4b2c6c-803f-4ee1-9034-7a7ef4c5ac79 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:31.056352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba4b2c6c-803f-4ee1-9034-7a7ef4c5ac79 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:31.063557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0356500-fdb4-48e4-a0c1-ab7129784784 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:31.064130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0356500-fdb4-48e4-a0c1-ab7129784784 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:31.064903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0356500-fdb4-48e4-a0c1-ab7129784784 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:31.065364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0356500-fdb4-48e4-a0c1-ab7129784784 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:31.146901 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ba4b2c6c-803f-4ee1-9034-7a7ef4c5ac79 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116002 May 28 04:50:31.157403 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2031/3965] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:50:31 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:31.347552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e0356500-fdb4-48e4-a0c1-ab7129784784 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:31.358406 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e0356500-fdb4-48e4-a0c1-ab7129784784 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1522 microversion: 2.1 time: 0.309386 May 28 04:50:31.375899 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1935/3966] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:31 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:31.397180 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f8855703-3c51-46c1-b594-c1870538b32f tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:31.398059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f8855703-3c51-46c1-b594-c1870538b32f tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:31.408828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8855703-3c51-46c1-b594-c1870538b32f tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:31.412704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8855703-3c51-46c1-b594-c1870538b32f tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:31.413692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8855703-3c51-46c1-b594-c1870538b32f tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:31.416088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8855703-3c51-46c1-b594-c1870538b32f tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:31.482874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-47bbceda-2e7c-4448-9f61-f04d2117948f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:31.483694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-47bbceda-2e7c-4448-9f61-f04d2117948f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:31.500829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47bbceda-2e7c-4448-9f61-f04d2117948f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:31.501538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47bbceda-2e7c-4448-9f61-f04d2117948f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:31.502448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47bbceda-2e7c-4448-9f61-f04d2117948f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:31.503012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47bbceda-2e7c-4448-9f61-f04d2117948f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:31.856328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f8855703-3c51-46c1-b594-c1870538b32f tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:31.867773 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f8855703-3c51-46c1-b594-c1870538b32f tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1804 microversion: 2.1 time: 0.475242 May 28 04:50:31.869275 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2032/3967] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:31 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1804 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:31.893073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-59ddfe77-a92f-4075-a2b5-120c6a4943fd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:31.895768 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-59ddfe77-a92f-4075-a2b5-120c6a4943fd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:31.916541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-59ddfe77-a92f-4075-a2b5-120c6a4943fd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:31.917363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-59ddfe77-a92f-4075-a2b5-120c6a4943fd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:31.918543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-59ddfe77-a92f-4075-a2b5-120c6a4943fd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:31.919978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-59ddfe77-a92f-4075-a2b5-120c6a4943fd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:32.147875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-59ddfe77-a92f-4075-a2b5-120c6a4943fd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:32.158907 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-59ddfe77-a92f-4075-a2b5-120c6a4943fd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 200 len: 1273 microversion: 2.1 time: 0.274998 May 28 04:50:32.164139 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2033/3968] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:31 2022] GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 1273 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:32.173122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-2d112900-6145-4cb7-b53e-db3b163e5e81 req-f1fa5381-7839-4c70-9c39-78ebb5c02bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "393747a2-794a-4b7a-8c05-a1e99fd68d0d", "tag": "1b26226c-e43f-47fe-8c11-13195d33ece3"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:32.195243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2d112900-6145-4cb7-b53e-db3b163e5e81 req-f1fa5381-7839-4c70-9c39-78ebb5c02bcf service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:32.196084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2d112900-6145-4cb7-b53e-db3b163e5e81 req-f1fa5381-7839-4c70-9c39-78ebb5c02bcf service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:32.210672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-47bbceda-2e7c-4448-9f61-f04d2117948f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:32.219501 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-47bbceda-2e7c-4448-9f61-f04d2117948f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d" status: 200 len: 1309 microversion: 2.1 time: 0.741280 May 28 04:50:32.227828 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1936/3969] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:31 2022] GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d => generated 1309 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:32.242273 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-2d112900-6145-4cb7-b53e-db3b163e5e81 req-f1fa5381-7839-4c70-9c39-78ebb5c02bcf service nova] Creating event network-changed:1b26226c-e43f-47fe-8c11-13195d33ece3 for instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d on n-h1-843700-1 May 28 04:50:32.244192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a7537cb9-fa07-46f0-b2be-ea46f14fae5c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:32.245904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a7537cb9-fa07-46f0-b2be-ea46f14fae5c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:32.257873 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-2d112900-6145-4cb7-b53e-db3b163e5e81 req-f1fa5381-7839-4c70-9c39-78ebb5c02bcf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092166 May 28 04:50:32.266558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a7537cb9-fa07-46f0-b2be-ea46f14fae5c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:32.267208 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2034/3970] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:32.278798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a7537cb9-fa07-46f0-b2be-ea46f14fae5c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:32.278798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a7537cb9-fa07-46f0-b2be-ea46f14fae5c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:32.278798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a7537cb9-fa07-46f0-b2be-ea46f14fae5c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:32.288635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-02e645b1-2ae6-4fa8-9b9a-71b086265fd1 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:32.289564 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-02e645b1-2ae6-4fa8-9b9a-71b086265fd1 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:32.318036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02e645b1-2ae6-4fa8-9b9a-71b086265fd1 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:32.318906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02e645b1-2ae6-4fa8-9b9a-71b086265fd1 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:32.320201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02e645b1-2ae6-4fa8-9b9a-71b086265fd1 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:32.320861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02e645b1-2ae6-4fa8-9b9a-71b086265fd1 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:32.350120 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-02e645b1-2ae6-4fa8-9b9a-71b086265fd1 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976/ips" status: 200 len: 217 microversion: 2.1 time: 0.081320 May 28 04:50:32.358799 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2035/3971] 10.222.0.58 () {58 vars in 1247 bytes} [Sat May 28 04:50:32 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976/ips => generated 217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:32.365287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5f34100c-cbe7-4b60-b57d-1adb077aec49 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:32.366156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5f34100c-cbe7-4b60-b57d-1adb077aec49 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:32.374787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f34100c-cbe7-4b60-b57d-1adb077aec49 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:32.378754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f34100c-cbe7-4b60-b57d-1adb077aec49 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:32.378754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f34100c-cbe7-4b60-b57d-1adb077aec49 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:32.378754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f34100c-cbe7-4b60-b57d-1adb077aec49 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:32.465032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a7537cb9-fa07-46f0-b2be-ea46f14fae5c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:32.475713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a7537cb9-fa07-46f0-b2be-ea46f14fae5c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:32.477218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a7537cb9-fa07-46f0-b2be-ea46f14fae5c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:32.498670 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a7537cb9-fa07-46f0-b2be-ea46f14fae5c tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.249373 May 28 04:50:32.501682 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1937/3972] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:32 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:32.535773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-856e1539-7d39-4948-8fd8-324a6af231cb req-55195501-1673-45a0-9e3f-24d04d2567d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a940c92-8dca-4cf5-90a9-d7d617ec9ece", "name": "network-vif-plugged", "status": "completed", "tag": "d4489fa6-501f-4301-b268-2dded14654a8"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:32.566741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-856e1539-7d39-4948-8fd8-324a6af231cb req-55195501-1673-45a0-9e3f-24d04d2567d6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:32.571293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-856e1539-7d39-4948-8fd8-324a6af231cb req-55195501-1673-45a0-9e3f-24d04d2567d6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:32.600072 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-856e1539-7d39-4948-8fd8-324a6af231cb req-55195501-1673-45a0-9e3f-24d04d2567d6 service nova] Creating event network-vif-plugged:d4489fa6-501f-4301-b268-2dded14654a8 for instance 0a940c92-8dca-4cf5-90a9-d7d617ec9ece on n-h2-843700-1 May 28 04:50:32.611784 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-856e1539-7d39-4948-8fd8-324a6af231cb req-55195501-1673-45a0-9e3f-24d04d2567d6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097117 May 28 04:50:32.613373 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1938/3973] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:32.631251 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0949237d-e422-4223-b191-4e7ddd09ebe4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:32.634189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0949237d-e422-4223-b191-4e7ddd09ebe4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:32.651066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0949237d-e422-4223-b191-4e7ddd09ebe4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:32.653005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0949237d-e422-4223-b191-4e7ddd09ebe4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:32.656015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0949237d-e422-4223-b191-4e7ddd09ebe4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:32.656559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0949237d-e422-4223-b191-4e7ddd09ebe4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:32.724660 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0949237d-e422-4223-b191-4e7ddd09ebe4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107804 May 28 04:50:32.732833 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1939/3974] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:50:32 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:32.740948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-11ade767-d4a5-4066-9eb8-2336c2ed84a1 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:32.741462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-11ade767-d4a5-4066-9eb8-2336c2ed84a1 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:32.759934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11ade767-d4a5-4066-9eb8-2336c2ed84a1 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:32.764890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11ade767-d4a5-4066-9eb8-2336c2ed84a1 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:32.766067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11ade767-d4a5-4066-9eb8-2336c2ed84a1 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:32.766725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11ade767-d4a5-4066-9eb8-2336c2ed84a1 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:32.820215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5f34100c-cbe7-4b60-b57d-1adb077aec49 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:32.822254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-11ade767-d4a5-4066-9eb8-2336c2ed84a1 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:50:32.835505 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5f34100c-cbe7-4b60-b57d-1adb077aec49 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1508 microversion: 2.1 time: 0.475190 May 28 04:50:32.854311 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2036/3975] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:32 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1508 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:32.884500 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a6f2e5e6-ab8f-4513-bf43-143572519580 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:32.889366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a6f2e5e6-ab8f-4513-bf43-143572519580 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:32.915513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6f2e5e6-ab8f-4513-bf43-143572519580 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:32.919256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6f2e5e6-ab8f-4513-bf43-143572519580 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:32.920121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6f2e5e6-ab8f-4513-bf43-143572519580 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:32.920573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6f2e5e6-ab8f-4513-bf43-143572519580 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:33.257192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a6f2e5e6-ab8f-4513-bf43-143572519580 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:33.269899 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a6f2e5e6-ab8f-4513-bf43-143572519580 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1522 microversion: 2.1 time: 0.402911 May 28 04:50:33.270110 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-11ade767-d4a5-4066-9eb8-2336c2ed84a1 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "DELETE /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 204 len: 0 microversion: 2.1 time: 0.536769 May 28 04:50:33.270563 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2037/3976] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:32 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:33.270665 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1940/3977] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:50:32 2022] DELETE /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:50:33.283831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-71946d72-2b84-49be-a655-bd55b740170f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:33.288446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c35c2259-58d5-4fed-8aaa-4db92861689a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:33.288605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-71946d72-2b84-49be-a655-bd55b740170f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:33.288708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c35c2259-58d5-4fed-8aaa-4db92861689a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:33.294484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c35c2259-58d5-4fed-8aaa-4db92861689a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:33.295105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c35c2259-58d5-4fed-8aaa-4db92861689a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:33.295898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c35c2259-58d5-4fed-8aaa-4db92861689a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:33.296407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c35c2259-58d5-4fed-8aaa-4db92861689a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:33.299643 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71946d72-2b84-49be-a655-bd55b740170f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:33.300195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71946d72-2b84-49be-a655-bd55b740170f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:33.308252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71946d72-2b84-49be-a655-bd55b740170f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:33.308766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71946d72-2b84-49be-a655-bd55b740170f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:33.662723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c35c2259-58d5-4fed-8aaa-4db92861689a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:33.675650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-71946d72-2b84-49be-a655-bd55b740170f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:33.683338 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c35c2259-58d5-4fed-8aaa-4db92861689a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d" status: 200 len: 1309 microversion: 2.1 time: 0.411300 May 28 04:50:33.694707 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1941/3978] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:33 2022] GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d => generated 1309 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:33.696145 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-71946d72-2b84-49be-a655-bd55b740170f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 200 len: 1315 microversion: 2.1 time: 0.424200 May 28 04:50:33.697198 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2038/3979] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:33 2022] GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:33.702752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a79b6280-887e-42f3-ba27-918e39178677 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:33.703405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a79b6280-887e-42f3-ba27-918e39178677 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:33.703707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-23d0862f-7a8e-4c8c-8c47-874b546aea67 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:33.704551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-23d0862f-7a8e-4c8c-8c47-874b546aea67 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:33.721526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a79b6280-887e-42f3-ba27-918e39178677 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:33.722014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a79b6280-887e-42f3-ba27-918e39178677 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:33.722806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a79b6280-887e-42f3-ba27-918e39178677 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:33.723328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a79b6280-887e-42f3-ba27-918e39178677 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:33.725370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23d0862f-7a8e-4c8c-8c47-874b546aea67 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:33.726975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23d0862f-7a8e-4c8c-8c47-874b546aea67 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:33.732012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23d0862f-7a8e-4c8c-8c47-874b546aea67 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:33.733289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23d0862f-7a8e-4c8c-8c47-874b546aea67 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:33.904487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a79b6280-887e-42f3-ba27-918e39178677 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:33.922315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a79b6280-887e-42f3-ba27-918e39178677 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:33.924386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a79b6280-887e-42f3-ba27-918e39178677 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed73a7e876d24e18b3b9add257169512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b585dc62744008c3cbba9f6cbb827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:33.925862 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a79b6280-887e-42f3-ba27-918e39178677 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 200 len: 1603 microversion: 2.42 time: 0.227309 May 28 04:50:33.937733 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2039/3980] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:33 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 1603 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:50:33.943509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-72f02594-4af3-4e97-a8db-08b4b9eafd55 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:33.945028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-72f02594-4af3-4e97-a8db-08b4b9eafd55 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:33.951816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72f02594-4af3-4e97-a8db-08b4b9eafd55 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:33.953122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72f02594-4af3-4e97-a8db-08b4b9eafd55 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:33.954255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72f02594-4af3-4e97-a8db-08b4b9eafd55 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:33.954895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72f02594-4af3-4e97-a8db-08b4b9eafd55 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:33.987437 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-72f02594-4af3-4e97-a8db-08b4b9eafd55 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048309 May 28 04:50:33.988653 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2040/3981] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:50:33 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:33.995086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-baa20f55-bb7b-45cd-a720-c1d54d61f430 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:33.995917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-baa20f55-bb7b-45cd-a720-c1d54d61f430 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:34.006787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-baa20f55-bb7b-45cd-a720-c1d54d61f430 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:34.007283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-baa20f55-bb7b-45cd-a720-c1d54d61f430 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:34.008072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-baa20f55-bb7b-45cd-a720-c1d54d61f430 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:34.008890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-baa20f55-bb7b-45cd-a720-c1d54d61f430 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:34.109745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-23d0862f-7a8e-4c8c-8c47-874b546aea67 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:34.123493 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-23d0862f-7a8e-4c8c-8c47-874b546aea67 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1810 microversion: 2.1 time: 0.438462 May 28 04:50:34.124436 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1942/3982] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:33 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1810 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:34.287058 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-faf6e00a-3e2e-4c9b-bf2e-2eaa63aef033 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:34.288455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-faf6e00a-3e2e-4c9b-bf2e-2eaa63aef033 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:34.308159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-faf6e00a-3e2e-4c9b-bf2e-2eaa63aef033 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:34.309076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-faf6e00a-3e2e-4c9b-bf2e-2eaa63aef033 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:34.310214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-faf6e00a-3e2e-4c9b-bf2e-2eaa63aef033 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:34.310882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-faf6e00a-3e2e-4c9b-bf2e-2eaa63aef033 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:34.764630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-baa20f55-bb7b-45cd-a720-c1d54d61f430 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:34.773636 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-baa20f55-bb7b-45cd-a720-c1d54d61f430 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1508 microversion: 2.1 time: 0.783688 May 28 04:50:34.787758 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2041/3983] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:33 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1508 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:34.792902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7fc309b4-799d-4309-8368-596041fa2128 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:34.793759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7fc309b4-799d-4309-8368-596041fa2128 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:34.800558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fc309b4-799d-4309-8368-596041fa2128 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:34.804953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fc309b4-799d-4309-8368-596041fa2128 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:34.806165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fc309b4-799d-4309-8368-596041fa2128 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:34.806795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fc309b4-799d-4309-8368-596041fa2128 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:35.283971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-faf6e00a-3e2e-4c9b-bf2e-2eaa63aef033 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:35.301384 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-faf6e00a-3e2e-4c9b-bf2e-2eaa63aef033 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1522 microversion: 2.1 time: 1.017960 May 28 04:50:35.311238 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1943/3984] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:34 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1522 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:35.316524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1ca34d87-6d32-479c-8504-6e6fb6209df9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:35.317284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1ca34d87-6d32-479c-8504-6e6fb6209df9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:35.324883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ca34d87-6d32-479c-8504-6e6fb6209df9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:35.326364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ca34d87-6d32-479c-8504-6e6fb6209df9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:35.327328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ca34d87-6d32-479c-8504-6e6fb6209df9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:35.328387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ca34d87-6d32-479c-8504-6e6fb6209df9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:35.413046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7fc309b4-799d-4309-8368-596041fa2128 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:35.423893 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7fc309b4-799d-4309-8368-596041fa2128 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d" status: 200 len: 1309 microversion: 2.1 time: 0.634725 May 28 04:50:35.427344 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2042/3985] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:34 2022] GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d => generated 1309 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:35.436891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-75970020-ddb7-43c5-89b2-6958900cbdcf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:35.438657 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-75970020-ddb7-43c5-89b2-6958900cbdcf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:35.452183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75970020-ddb7-43c5-89b2-6958900cbdcf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:35.456189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75970020-ddb7-43c5-89b2-6958900cbdcf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:35.463431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75970020-ddb7-43c5-89b2-6958900cbdcf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:35.464210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75970020-ddb7-43c5-89b2-6958900cbdcf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:35.498070 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-75970020-ddb7-43c5-89b2-6958900cbdcf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] HTTP exception thrown: Instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 could not be found. May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-75970020-ddb7-43c5-89b2-6958900cbdcf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Request method failure captured: May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 HTTP/1.1 May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikagIrsq0cNO6m4ZmUnNcb8b9zpHSaS1g2Qn2AUomdYPw32ywyVbaK1Aeby4lY963JTst2bTUk-BHZXu85KL9xp856Y3_aDdFRGEbrnrq_e2J03RBA1OY7bbE7ubcxIosg4-hFPkbVpWFYKBi7hOMKTa5WLzV2afi4yMytDKKs7cn2Q4 May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-Openstack-Nova-Api-Version: 2.42 May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 998b585dc62744008c3cbba9f6cbb827 May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-178993853 May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_998b585dc62744008c3cbba9f6cbb827"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/998b585dc62744008c3cbba9f6cbb827"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/998b585dc62744008c3cbba9f6cbb827"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/998b585dc62744008c3cbba9f6cbb827"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TaggedBootDevicesTest_v242-178993853 May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 998b585dc62744008c3cbba9f6cbb827 May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-178993853 May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TaggedBootDevicesTest_v242-178993853-project May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: ed73a7e876d24e18b3b9add257169512 May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TaggedBootDevicesTest_v242-178993853-project May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 could not be found. May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26'} May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 could not be found. May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 could not be found. May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:50:35.500011 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:50:35.504964 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:50:35.504964 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:35.504964 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:50:35.504964 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:50:35.504964 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:50:35.504964 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:50:35.504964 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 could not be found. May 28 04:50:35.504964 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:50:35.504964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-75970020-ddb7-43c5-89b2-6958900cbdcf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Returning 404 to user: Instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:50:35.509018 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-75970020-ddb7-43c5-89b2-6958900cbdcf tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 404 len: 111 microversion: 2.42 time: 0.080342 May 28 04:50:35.513206 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2043/3986] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:35 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 04:50:35.519903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c99239b3-d4b1-4feb-bc3a-5ad0e779af9a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:35.523922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c99239b3-d4b1-4feb-bc3a-5ad0e779af9a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:35.535995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c99239b3-d4b1-4feb-bc3a-5ad0e779af9a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:35.543826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c99239b3-d4b1-4feb-bc3a-5ad0e779af9a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:35.543826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c99239b3-d4b1-4feb-bc3a-5ad0e779af9a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:35.543826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c99239b3-d4b1-4feb-bc3a-5ad0e779af9a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:35.565943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:35.604252 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c99239b3-d4b1-4feb-bc3a-5ad0e779af9a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093499 May 28 04:50:35.604841 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2044/3987] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:50:35 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:35.609419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5b5a5d1b-8ea1-494e-bc9b-568c6f58aaac tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:35.610032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5b5a5d1b-8ea1-494e-bc9b-568c6f58aaac tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:35.625533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b5a5d1b-8ea1-494e-bc9b-568c6f58aaac tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:35.627256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b5a5d1b-8ea1-494e-bc9b-568c6f58aaac tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:35.628936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b5a5d1b-8ea1-494e-bc9b-568c6f58aaac tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:35.632622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b5a5d1b-8ea1-494e-bc9b-568c6f58aaac tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:36.090368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1ca34d87-6d32-479c-8504-6e6fb6209df9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:36.094377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:36.103347 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1ca34d87-6d32-479c-8504-6e6fb6209df9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 200 len: 1315 microversion: 2.1 time: 0.790787 May 28 04:50:36.105982 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1944/3988] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:35 2022] GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 1315 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:36.111035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8fec7217-7878-4cf8-82ac-e026f267d3b2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '.version_select at 0x7f7701dfb160>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:36.242373 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8fec7217-7878-4cf8-82ac-e026f267d3b2 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-152914391" status: 204 len: 0 microversion: 2.42 time: 0.135069 May 28 04:50:36.247775 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1945/3989] 10.222.0.58 () {60 vars in 1258 bytes} [Sat May 28 04:50:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-152914391 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:50:36.248272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-2436d436-d729-4ca3-852a-56bd524d1528 req-88da1977-1d12-4ea8-acc0-510304e754f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25437109-2e1e-48a8-97ad-af5014923c55", "tag": "6da7cc8f-f361-4837-b479-6ce4ee61d06d"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:36.267713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2436d436-d729-4ca3-852a-56bd524d1528 req-88da1977-1d12-4ea8-acc0-510304e754f6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:36.268177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2436d436-d729-4ca3-852a-56bd524d1528 req-88da1977-1d12-4ea8-acc0-510304e754f6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:36.294414 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-2436d436-d729-4ca3-852a-56bd524d1528 req-88da1977-1d12-4ea8-acc0-510304e754f6 service nova] Creating event network-changed:6da7cc8f-f361-4837-b479-6ce4ee61d06d for instance 25437109-2e1e-48a8-97ad-af5014923c55 on n-h1-843700-1 May 28 04:50:36.304460 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-2436d436-d729-4ca3-852a-56bd524d1528 req-88da1977-1d12-4ea8-acc0-510304e754f6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059884 May 28 04:50:36.305547 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1946/3990] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:36.325094 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4fa69bd2-edbd-4e52-8593-21910c65db81 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:36.325853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4fa69bd2-edbd-4e52-8593-21910c65db81 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:36.351890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4fa69bd2-edbd-4e52-8593-21910c65db81 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:36.351890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4fa69bd2-edbd-4e52-8593-21910c65db81 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:36.351890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4fa69bd2-edbd-4e52-8593-21910c65db81 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:36.351890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4fa69bd2-edbd-4e52-8593-21910c65db81 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:36.463962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5b5a5d1b-8ea1-494e-bc9b-568c6f58aaac tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:36.495605 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5b5a5d1b-8ea1-494e-bc9b-568c6f58aaac tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1810 microversion: 2.1 time: 0.886698 May 28 04:50:36.500465 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2045/3991] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:35 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1810 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:36.528345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2ac32494-90a3-4a86-8be0-f074d05d986d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:36.530194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2ac32494-90a3-4a86-8be0-f074d05d986d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:36.544616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2ac32494-90a3-4a86-8be0-f074d05d986d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:36.549223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2ac32494-90a3-4a86-8be0-f074d05d986d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:36.550176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2ac32494-90a3-4a86-8be0-f074d05d986d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:36.550850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2ac32494-90a3-4a86-8be0-f074d05d986d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:37.071394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4fa69bd2-edbd-4e52-8593-21910c65db81 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:37.086203 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4fa69bd2-edbd-4e52-8593-21910c65db81 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1508 microversion: 2.1 time: 0.774409 May 28 04:50:37.087445 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1947/3992] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:36 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1508 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:37.093703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f8f3a006-d6ca-4910-be01-387599039a52 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:37.099814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f8f3a006-d6ca-4910-be01-387599039a52 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:37.141212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8f3a006-d6ca-4910-be01-387599039a52 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:37.141939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8f3a006-d6ca-4910-be01-387599039a52 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:37.142909 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8f3a006-d6ca-4910-be01-387599039a52 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:37.143569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8f3a006-d6ca-4910-be01-387599039a52 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:37.370886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2ac32494-90a3-4a86-8be0-f074d05d986d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:37.385242 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2ac32494-90a3-4a86-8be0-f074d05d986d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1522 microversion: 2.1 time: 0.882766 May 28 04:50:37.389684 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2046/3993] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:36 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1522 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:37.397116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7ff12d54-09a8-4d8c-a94f-d2e8c90bd549 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:37.399694 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7ff12d54-09a8-4d8c-a94f-d2e8c90bd549 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:37.417585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ff12d54-09a8-4d8c-a94f-d2e8c90bd549 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:37.419168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ff12d54-09a8-4d8c-a94f-d2e8c90bd549 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:37.426635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ff12d54-09a8-4d8c-a94f-d2e8c90bd549 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:37.427758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ff12d54-09a8-4d8c-a94f-d2e8c90bd549 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:37.484533 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7ff12d54-09a8-4d8c-a94f-d2e8c90bd549 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092224 May 28 04:50:37.489986 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2047/3994] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:50:37 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:37.497224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3cfec5a3-2806-4293-84e2-63faf6c508db tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:37.498307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3cfec5a3-2806-4293-84e2-63faf6c508db tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:37.505485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3cfec5a3-2806-4293-84e2-63faf6c508db tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:37.506758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3cfec5a3-2806-4293-84e2-63faf6c508db tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:37.507872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3cfec5a3-2806-4293-84e2-63faf6c508db tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:37.508834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3cfec5a3-2806-4293-84e2-63faf6c508db tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:37.723317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:37.765864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f8f3a006-d6ca-4910-be01-387599039a52 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:37.776833 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f8f3a006-d6ca-4910-be01-387599039a52 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d" status: 200 len: 1309 microversion: 2.1 time: 0.687765 May 28 04:50:37.778169 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1948/3995] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:37 2022] GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d => generated 1309 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:37.784673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ce0a8317-4f97-43e2-bee2-34496358c318 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:37.785745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ce0a8317-4f97-43e2-bee2-34496358c318 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:37.795148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce0a8317-4f97-43e2-bee2-34496358c318 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:37.796093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce0a8317-4f97-43e2-bee2-34496358c318 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:37.797208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce0a8317-4f97-43e2-bee2-34496358c318 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:37.797945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce0a8317-4f97-43e2-bee2-34496358c318 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:37.899276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=16 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:37.928977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3cfec5a3-2806-4293-84e2-63faf6c508db tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:37.936980 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3cfec5a3-2806-4293-84e2-63faf6c508db tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 200 len: 1315 microversion: 2.1 time: 0.444594 May 28 04:50:37.937769 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2048/3996] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:37 2022] GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:38.105627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ac94bf8d-d997-47c9-befa-194b8e7f8df0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:38.113442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ac94bf8d-d997-47c9-befa-194b8e7f8df0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:38.125060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac94bf8d-d997-47c9-befa-194b8e7f8df0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:38.125517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac94bf8d-d997-47c9-befa-194b8e7f8df0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:38.126510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac94bf8d-d997-47c9-befa-194b8e7f8df0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:38.127138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac94bf8d-d997-47c9-befa-194b8e7f8df0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:38.483966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ce0a8317-4f97-43e2-bee2-34496358c318 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:38.497455 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ce0a8317-4f97-43e2-bee2-34496358c318 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1789 microversion: 2.1 time: 0.717693 May 28 04:50:38.499731 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1949/3997] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:37 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1789 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:38.512162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-e9323c98-1b35-485c-a37a-3f557022e0c3 req-670341e9-fb9a-41ad-880b-8ecd0a176d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "393747a2-794a-4b7a-8c05-a1e99fd68d0d", "name": "network-vif-plugged", "status": "completed", "tag": "1b26226c-e43f-47fe-8c11-13195d33ece3"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:38.529902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-e9323c98-1b35-485c-a37a-3f557022e0c3 req-670341e9-fb9a-41ad-880b-8ecd0a176d54 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:38.536792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-e9323c98-1b35-485c-a37a-3f557022e0c3 req-670341e9-fb9a-41ad-880b-8ecd0a176d54 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:38.560139 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-e9323c98-1b35-485c-a37a-3f557022e0c3 req-670341e9-fb9a-41ad-880b-8ecd0a176d54 service nova] Creating event network-vif-plugged:1b26226c-e43f-47fe-8c11-13195d33ece3 for instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d on n-h1-843700-1 May 28 04:50:38.571473 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-e9323c98-1b35-485c-a37a-3f557022e0c3 req-670341e9-fb9a-41ad-880b-8ecd0a176d54 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070210 May 28 04:50:38.575425 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1950/3998] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:38.581301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-dfc1a7d3-f370-43f3-a6b0-610ff5973e1b req-928d7274-cc9a-46c8-ad2a-86bbdf6cc2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831f1333-b707-473c-a6a5-f2ef08552976", "name": "network-vif-deleted", "tag": "b609dde5-aef8-42ba-a770-6da9844b04c0"}, {"server_uuid": "831f1333-b707-473c-a6a5-f2ef08552976", "name": "network-vif-deleted", "tag": "17551bec-4be6-4f43-896e-15ec7cbf52ff"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:38.638928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-dfc1a7d3-f370-43f3-a6b0-610ff5973e1b req-928d7274-cc9a-46c8-ad2a-86bbdf6cc2a6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:38.639795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-dfc1a7d3-f370-43f3-a6b0-610ff5973e1b req-928d7274-cc9a-46c8-ad2a-86bbdf6cc2a6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:38.653712 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-dfc1a7d3-f370-43f3-a6b0-610ff5973e1b req-928d7274-cc9a-46c8-ad2a-86bbdf6cc2a6 service nova] Creating event network-vif-deleted:b609dde5-aef8-42ba-a770-6da9844b04c0 for instance 831f1333-b707-473c-a6a5-f2ef08552976 on n-h2-843700-1 May 28 04:50:38.654576 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-dfc1a7d3-f370-43f3-a6b0-610ff5973e1b req-928d7274-cc9a-46c8-ad2a-86bbdf6cc2a6 service nova] Creating event network-vif-deleted:17551bec-4be6-4f43-896e-15ec7cbf52ff for instance 831f1333-b707-473c-a6a5-f2ef08552976 on n-h2-843700-1 May 28 04:50:38.660740 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-dfc1a7d3-f370-43f3-a6b0-610ff5973e1b req-928d7274-cc9a-46c8-ad2a-86bbdf6cc2a6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083701 May 28 04:50:38.663016 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1951/3999] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:38.670678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-672bff62-cbd6-4b5b-8f09-1d760449ea8d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:38.671989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-672bff62-cbd6-4b5b-8f09-1d760449ea8d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:38.680119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-672bff62-cbd6-4b5b-8f09-1d760449ea8d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:38.680871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-672bff62-cbd6-4b5b-8f09-1d760449ea8d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:38.682036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-672bff62-cbd6-4b5b-8f09-1d760449ea8d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:38.682739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-672bff62-cbd6-4b5b-8f09-1d760449ea8d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:39.017574 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:39.170531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ac94bf8d-d997-47c9-befa-194b8e7f8df0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:39.179195 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ac94bf8d-d997-47c9-befa-194b8e7f8df0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1508 microversion: 2.1 time: 1.078750 May 28 04:50:39.179787 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2049/4000] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:38 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1508 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:39.190419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-315514a8-b96c-466a-9f69-5f9696db842a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:39.204380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-315514a8-b96c-466a-9f69-5f9696db842a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:39.212039 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-315514a8-b96c-466a-9f69-5f9696db842a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:39.212496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-315514a8-b96c-466a-9f69-5f9696db842a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:39.213273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-315514a8-b96c-466a-9f69-5f9696db842a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:39.219667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-315514a8-b96c-466a-9f69-5f9696db842a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:39.292854 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-315514a8-b96c-466a-9f69-5f9696db842a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106160 May 28 04:50:39.296858 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2050/4001] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:50:39 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:39.301889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-02531241-e3f5-4711-872a-fd8582589cd2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:39.311377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-02531241-e3f5-4711-872a-fd8582589cd2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:39.334107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02531241-e3f5-4711-872a-fd8582589cd2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:39.339300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02531241-e3f5-4711-872a-fd8582589cd2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:39.340447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02531241-e3f5-4711-872a-fd8582589cd2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:39.343709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02531241-e3f5-4711-872a-fd8582589cd2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:39.695577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-672bff62-cbd6-4b5b-8f09-1d760449ea8d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:39.710624 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-672bff62-cbd6-4b5b-8f09-1d760449ea8d tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1522 microversion: 2.1 time: 1.045487 May 28 04:50:39.713389 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1952/4002] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:38 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1522 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:39.718538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7c0ffbfc-c400-480a-8aa5-92a4fc8073ce tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:39.735529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7c0ffbfc-c400-480a-8aa5-92a4fc8073ce tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:39.754813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c0ffbfc-c400-480a-8aa5-92a4fc8073ce tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:39.755394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c0ffbfc-c400-480a-8aa5-92a4fc8073ce tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:39.756108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c0ffbfc-c400-480a-8aa5-92a4fc8073ce tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:39.756555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c0ffbfc-c400-480a-8aa5-92a4fc8073ce tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:40.070380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-02531241-e3f5-4711-872a-fd8582589cd2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:40.085188 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-02531241-e3f5-4711-872a-fd8582589cd2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d" status: 200 len: 1309 microversion: 2.1 time: 0.786994 May 28 04:50:40.086031 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2051/4003] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:39 2022] GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d => generated 1309 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:40.094625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4be11b71-f4ce-4174-91c5-12cb11a59769 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:40.103228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4be11b71-f4ce-4174-91c5-12cb11a59769 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:40.110579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4be11b71-f4ce-4174-91c5-12cb11a59769 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:40.115809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4be11b71-f4ce-4174-91c5-12cb11a59769 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:40.115809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4be11b71-f4ce-4174-91c5-12cb11a59769 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:40.115809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4be11b71-f4ce-4174-91c5-12cb11a59769 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:40.163180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7c0ffbfc-c400-480a-8aa5-92a4fc8073ce tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:40.171423 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7c0ffbfc-c400-480a-8aa5-92a4fc8073ce tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 200 len: 1315 microversion: 2.1 time: 0.456733 May 28 04:50:40.179781 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1953/4004] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:39 2022] GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:40.180986 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4be11b71-f4ce-4174-91c5-12cb11a59769 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:40.181591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4be11b71-f4ce-4174-91c5-12cb11a59769 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:40.182575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-4be11b71-f4ce-4174-91c5-12cb11a59769 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lazy-loading 'fault' on Instance uuid 831f1333-b707-473c-a6a5-f2ef08552976 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:50:40.197069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ff53cf7c-446a-400e-9542-d84ca8a81ca9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:40.198922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ff53cf7c-446a-400e-9542-d84ca8a81ca9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:40.213025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff53cf7c-446a-400e-9542-d84ca8a81ca9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:40.213736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff53cf7c-446a-400e-9542-d84ca8a81ca9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:40.214738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff53cf7c-446a-400e-9542-d84ca8a81ca9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:40.215449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff53cf7c-446a-400e-9542-d84ca8a81ca9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:40.592320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4be11b71-f4ce-4174-91c5-12cb11a59769 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:40.603664 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4be11b71-f4ce-4174-91c5-12cb11a59769 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 200 len: 1303 microversion: 2.1 time: 0.515658 May 28 04:50:40.607349 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2052/4005] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:40 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 1303 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:40.617653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-42d00bc6-a61b-4030-91f7-cb88a60f0669 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:40.621424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-42d00bc6-a61b-4030-91f7-cb88a60f0669 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:40.647961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42d00bc6-a61b-4030-91f7-cb88a60f0669 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:40.648466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42d00bc6-a61b-4030-91f7-cb88a60f0669 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:40.649308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42d00bc6-a61b-4030-91f7-cb88a60f0669 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:40.656415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42d00bc6-a61b-4030-91f7-cb88a60f0669 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:40.757314 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-42d00bc6-a61b-4030-91f7-cb88a60f0669 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148549 May 28 04:50:40.770856 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2053/4006] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:50:40 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:40.775835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2f6b2a0d-8a8d-4c8b-97e7-a255f409f9d0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:40.776450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2f6b2a0d-8a8d-4c8b-97e7-a255f409f9d0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:40.793000 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f6b2a0d-8a8d-4c8b-97e7-a255f409f9d0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:40.795553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f6b2a0d-8a8d-4c8b-97e7-a255f409f9d0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:40.796400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f6b2a0d-8a8d-4c8b-97e7-a255f409f9d0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:40.796849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f6b2a0d-8a8d-4c8b-97e7-a255f409f9d0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:40.833510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ff53cf7c-446a-400e-9542-d84ca8a81ca9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:40.850293 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ff53cf7c-446a-400e-9542-d84ca8a81ca9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1508 microversion: 2.1 time: 0.652898 May 28 04:50:40.853847 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1954/4007] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:40 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1508 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:40.873924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-7ee95674-e4b3-4f6a-a731-cf92668a70a9 req-a5889cde-9894-48bf-9a89-7bffddf654e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831f1333-b707-473c-a6a5-f2ef08552976", "name": "network-vif-deleted", "tag": "09ec63fd-1a6d-4123-a858-83f57185a42c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:40.892065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-7ee95674-e4b3-4f6a-a731-cf92668a70a9 req-a5889cde-9894-48bf-9a89-7bffddf654e7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:40.894478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-7ee95674-e4b3-4f6a-a731-cf92668a70a9 req-a5889cde-9894-48bf-9a89-7bffddf654e7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:40.926595 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-7ee95674-e4b3-4f6a-a731-cf92668a70a9 req-a5889cde-9894-48bf-9a89-7bffddf654e7 service nova] Creating event network-vif-deleted:09ec63fd-1a6d-4123-a858-83f57185a42c for instance 831f1333-b707-473c-a6a5-f2ef08552976 on n-h2-843700-1 May 28 04:50:40.932950 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-7ee95674-e4b3-4f6a-a731-cf92668a70a9 req-a5889cde-9894-48bf-9a89-7bffddf654e7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077747 May 28 04:50:40.941509 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1955/4008] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:41.103157 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-17031042-b5d4-4762-9895-eef1c262dc5e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:41.107726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-17031042-b5d4-4762-9895-eef1c262dc5e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:41.115912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17031042-b5d4-4762-9895-eef1c262dc5e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:41.120335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2f6b2a0d-8a8d-4c8b-97e7-a255f409f9d0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:41.121480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17031042-b5d4-4762-9895-eef1c262dc5e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:41.127243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17031042-b5d4-4762-9895-eef1c262dc5e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:41.127730 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17031042-b5d4-4762-9895-eef1c262dc5e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:41.136338 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2f6b2a0d-8a8d-4c8b-97e7-a255f409f9d0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1522 microversion: 2.1 time: 0.364125 May 28 04:50:41.142201 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2054/4009] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:40 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:41.200438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-de7dcd98-cf6b-44a9-99f4-15504d84962f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:41.201496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-de7dcd98-cf6b-44a9-99f4-15504d84962f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:41.222782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de7dcd98-cf6b-44a9-99f4-15504d84962f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:41.231533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de7dcd98-cf6b-44a9-99f4-15504d84962f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:41.238926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de7dcd98-cf6b-44a9-99f4-15504d84962f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:41.241728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de7dcd98-cf6b-44a9-99f4-15504d84962f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:41.825509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-17031042-b5d4-4762-9895-eef1c262dc5e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:41.833777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-de7dcd98-cf6b-44a9-99f4-15504d84962f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:41.837868 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-17031042-b5d4-4762-9895-eef1c262dc5e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d" status: 200 len: 1490 microversion: 2.1 time: 0.738917 May 28 04:50:41.842242 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1956/4010] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:41 2022] GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d => generated 1490 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:41.845154 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-de7dcd98-cf6b-44a9-99f4-15504d84962f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 200 len: 1315 microversion: 2.1 time: 0.652333 May 28 04:50:41.850207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f661c8f8-0f5e-4e33-ab7a-4452a1bb0caa tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:41.855540 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f661c8f8-0f5e-4e33-ab7a-4452a1bb0caa tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:41.867334 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2055/4011] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:41 2022] GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:41.870694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f661c8f8-0f5e-4e33-ab7a-4452a1bb0caa tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:41.872533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f661c8f8-0f5e-4e33-ab7a-4452a1bb0caa tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:41.878013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f661c8f8-0f5e-4e33-ab7a-4452a1bb0caa tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:41.878561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f661c8f8-0f5e-4e33-ab7a-4452a1bb0caa tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:41.882612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aaa9f646-29ef-4e3e-8000-62342e082b64 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:41.888858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aaa9f646-29ef-4e3e-8000-62342e082b64 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:41.903710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aaa9f646-29ef-4e3e-8000-62342e082b64 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:41.904163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aaa9f646-29ef-4e3e-8000-62342e082b64 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:41.904933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aaa9f646-29ef-4e3e-8000-62342e082b64 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:41.905371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aaa9f646-29ef-4e3e-8000-62342e082b64 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:41.909027 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-f661c8f8-0f5e-4e33-ab7a-4452a1bb0caa tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] HTTP exception thrown: Instance 831f1333-b707-473c-a6a5-f2ef08552976 could not be found. May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f661c8f8-0f5e-4e33-ab7a-4452a1bb0caa tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Request method failure captured: May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 HTTP/1.1 May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikanrBR36wNuSduDsTIaCyoOxADcAoT4oILDgO2xMip3ZXY_fh9pAVfjMmuj1IzabigD9ryk48_M9GQQZjPvLvQ90RP4Y62U3rFzJ4OrOlMakdw0pdo-FGPEWnLlnyvgrT6eMUr4sP71nawMUp6ladI-t3msnIDNOVFI9zpjh1nmzsdM May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 8f07539e283643c6b7bdc2c90ffa2ce1 May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersTestMultiNic-2040190249 May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersTestMultiNic-2040190249 May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 8f07539e283643c6b7bdc2c90ffa2ce1 May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersTestMultiNic-2040190249 May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersTestMultiNic-2040190249-project May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 9dd8bc74fda8476692c24f7c8b8f4b1c May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersTestMultiNic-2040190249-project May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 831f1333-b707-473c-a6a5-f2ef08552976 could not be found. May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '831f1333-b707-473c-a6a5-f2ef08552976'} May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 831f1333-b707-473c-a6a5-f2ef08552976 could not be found. May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 831f1333-b707-473c-a6a5-f2ef08552976 could not be found. May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:50:41.913421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:41.922006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:41.922006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:50:41.922006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:50:41.922006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:50:41.922006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:50:41.922006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 831f1333-b707-473c-a6a5-f2ef08552976 could not be found. May 28 04:50:41.922006 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:41.924175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f661c8f8-0f5e-4e33-ab7a-4452a1bb0caa tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Returning 404 to user: Instance 831f1333-b707-473c-a6a5-f2ef08552976 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:50:41.925294 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f661c8f8-0f5e-4e33-ab7a-4452a1bb0caa tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 404 len: 111 microversion: 2.1 time: 0.081776 May 28 04:50:41.926088 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1957/4012] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:41 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:50:41.934404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e6243626-194d-4c52-8ffe-267c19b27cd2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:41.938708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e6243626-194d-4c52-8ffe-267c19b27cd2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:41.949961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6243626-194d-4c52-8ffe-267c19b27cd2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:41.954526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6243626-194d-4c52-8ffe-267c19b27cd2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:41.955642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6243626-194d-4c52-8ffe-267c19b27cd2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:41.956290 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6243626-194d-4c52-8ffe-267c19b27cd2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:41.985849 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aaa9f646-29ef-4e3e-8000-62342e082b64 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107123 May 28 04:50:41.993376 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2056/4013] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:50:41 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:42.055661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-24ab442e-a078-4af4-b5d3-78488a943394 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1845866300", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "fd0d7eb0-eb78-443c-941c-e203b5533601"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:42.162460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-24ab442e-a078-4af4-b5d3-78488a943394 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] validate_networks() for [('fd0d7eb0-eb78-443c-941c-e203b5533601', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:50:42.589715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e6243626-194d-4c52-8ffe-267c19b27cd2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:42.599505 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e6243626-194d-4c52-8ffe-267c19b27cd2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1508 microversion: 2.1 time: 0.671489 May 28 04:50:42.612884 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1958/4014] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:41 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1508 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:42.623724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f3116537-0ecb-4d86-a6bd-2adfb2796c89 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:42.624399 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f3116537-0ecb-4d86-a6bd-2adfb2796c89 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:42.645015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3116537-0ecb-4d86-a6bd-2adfb2796c89 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:42.646002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3116537-0ecb-4d86-a6bd-2adfb2796c89 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:42.646830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3116537-0ecb-4d86-a6bd-2adfb2796c89 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:42.647317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3116537-0ecb-4d86-a6bd-2adfb2796c89 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:43.208763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f3116537-0ecb-4d86-a6bd-2adfb2796c89 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:43.216397 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f3116537-0ecb-4d86-a6bd-2adfb2796c89 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1522 microversion: 2.1 time: 0.602353 May 28 04:50:43.219267 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1959/4015] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:42 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1522 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:43.241106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-51c579c0-a079-47ce-af75-c60038ea88e5 req-47507855-1d15-4d92-adb9-fcafeba53de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25437109-2e1e-48a8-97ad-af5014923c55", "name": "network-vif-plugged", "status": "completed", "tag": "6da7cc8f-f361-4837-b479-6ce4ee61d06d"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:43.275438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:43.301523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-51c579c0-a079-47ce-af75-c60038ea88e5 req-47507855-1d15-4d92-adb9-fcafeba53de8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:43.312459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-51c579c0-a079-47ce-af75-c60038ea88e5 req-47507855-1d15-4d92-adb9-fcafeba53de8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:43.330675 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-51c579c0-a079-47ce-af75-c60038ea88e5 req-47507855-1d15-4d92-adb9-fcafeba53de8 service nova] Creating event network-vif-plugged:6da7cc8f-f361-4837-b479-6ce4ee61d06d for instance 25437109-2e1e-48a8-97ad-af5014923c55 on n-h1-843700-1 May 28 04:50:43.337791 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-51c579c0-a079-47ce-af75-c60038ea88e5 req-47507855-1d15-4d92-adb9-fcafeba53de8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099952 May 28 04:50:43.342164 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1960/4016] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:43.385643 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cefbb169-ad50-4dca-a8ed-425abd86dc47 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:43.387059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cefbb169-ad50-4dca-a8ed-425abd86dc47 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:43.411807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cefbb169-ad50-4dca-a8ed-425abd86dc47 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:43.412311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cefbb169-ad50-4dca-a8ed-425abd86dc47 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:43.418544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cefbb169-ad50-4dca-a8ed-425abd86dc47 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:43.418914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cefbb169-ad50-4dca-a8ed-425abd86dc47 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:43.789270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-24ab442e-a078-4af4-b5d3-78488a943394 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:50:43.791023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-24ab442e-a078-4af4-b5d3-78488a943394 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:50:43.791706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-24ab442e-a078-4af4-b5d3-78488a943394 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:50:43.793206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-24ab442e-a078-4af4-b5d3-78488a943394 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:50:43.793800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-24ab442e-a078-4af4-b5d3-78488a943394 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:50:43.819766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24ab442e-a078-4af4-b5d3-78488a943394 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:43.820512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24ab442e-a078-4af4-b5d3-78488a943394 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:43.826078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24ab442e-a078-4af4-b5d3-78488a943394 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:43.827366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24ab442e-a078-4af4-b5d3-78488a943394 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:43.860836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cefbb169-ad50-4dca-a8ed-425abd86dc47 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:43.901091 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cefbb169-ad50-4dca-a8ed-425abd86dc47 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 200 len: 1315 microversion: 2.1 time: 0.551014 May 28 04:50:43.902052 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1961/4017] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:43 2022] GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:43.920135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-24ab442e-a078-4af4-b5d3-78488a943394 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Getting quotas for project 724a5513bc2c42eabbefa450e207453e. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:50:43.929854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-24ab442e-a078-4af4-b5d3-78488a943394 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Getting quotas for user 71b6b3ac5a4249fd8f76fb2e7e2b6c18 and project 724a5513bc2c42eabbefa450e207453e. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:50:43.932081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-27695163-16df-41c6-af8c-f2277d512661 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:43.937235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-27695163-16df-41c6-af8c-f2277d512661 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:43.961761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-27695163-16df-41c6-af8c-f2277d512661 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:43.968298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-27695163-16df-41c6-af8c-f2277d512661 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:43.973289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-24ab442e-a078-4af4-b5d3-78488a943394 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:50:43.977662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-24ab442e-a078-4af4-b5d3-78488a943394 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:50:43.978813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-27695163-16df-41c6-af8c-f2277d512661 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:43.979371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-27695163-16df-41c6-af8c-f2277d512661 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:44.075841 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-27695163-16df-41c6-af8c-f2277d512661 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171784 May 28 04:50:44.084847 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1962/4018] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:50:43 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:44.113038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-21e0ed36-be04-4657-b0f6-84e89c1ef20c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:44.128501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-21e0ed36-be04-4657-b0f6-84e89c1ef20c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:44.147947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21e0ed36-be04-4657-b0f6-84e89c1ef20c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:44.148368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21e0ed36-be04-4657-b0f6-84e89c1ef20c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:44.149170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21e0ed36-be04-4657-b0f6-84e89c1ef20c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:44.149613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21e0ed36-be04-4657-b0f6-84e89c1ef20c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:44.229306 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-24ab442e-a078-4af4-b5d3-78488a943394 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.179493 May 28 04:50:44.235767 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2057/4019] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:50:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 04:50:44.245962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-49b36684-4b9a-4bb6-abf5-7c372857a7f6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:44.251554 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-49b36684-4b9a-4bb6-abf5-7c372857a7f6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:44.278766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49b36684-4b9a-4bb6-abf5-7c372857a7f6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:44.288243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49b36684-4b9a-4bb6-abf5-7c372857a7f6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:44.289890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49b36684-4b9a-4bb6-abf5-7c372857a7f6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:44.295637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49b36684-4b9a-4bb6-abf5-7c372857a7f6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:44.762780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-21e0ed36-be04-4657-b0f6-84e89c1ef20c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:44.777640 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-21e0ed36-be04-4657-b0f6-84e89c1ef20c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1508 microversion: 2.1 time: 0.691401 May 28 04:50:44.790504 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1963/4020] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:44 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1508 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:44.802693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-75f28120-67e0-4e81-8082-3b57eade70f8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:44.803714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-75f28120-67e0-4e81-8082-3b57eade70f8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:45.203920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-75f28120-67e0-4e81-8082-3b57eade70f8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:45.214226 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-75f28120-67e0-4e81-8082-3b57eade70f8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 200 len: 1209 microversion: 2.1 time: 0.422515 May 28 04:50:45.236894 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1964/4021] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:44 2022] GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 1209 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:45.291701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9171ea79-2aa2-4c62-933d-a9ca180520fa tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:45.292461 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9171ea79-2aa2-4c62-933d-a9ca180520fa tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:45.311428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9171ea79-2aa2-4c62-933d-a9ca180520fa tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:45.314766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9171ea79-2aa2-4c62-933d-a9ca180520fa tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:45.315971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9171ea79-2aa2-4c62-933d-a9ca180520fa tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:45.321140 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9171ea79-2aa2-4c62-933d-a9ca180520fa tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:45.571568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-49b36684-4b9a-4bb6-abf5-7c372857a7f6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:45.588135 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-49b36684-4b9a-4bb6-abf5-7c372857a7f6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1522 microversion: 2.1 time: 1.350905 May 28 04:50:45.588734 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2058/4022] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:44 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1522 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:45.593612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8d9d5c49-476a-42a6-86c5-9b900f48d254 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:45.620641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8d9d5c49-476a-42a6-86c5-9b900f48d254 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:45.627388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d9d5c49-476a-42a6-86c5-9b900f48d254 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:45.635402 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d9d5c49-476a-42a6-86c5-9b900f48d254 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:45.636524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d9d5c49-476a-42a6-86c5-9b900f48d254 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:45.637125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d9d5c49-476a-42a6-86c5-9b900f48d254 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:45.717642 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8d9d5c49-476a-42a6-86c5-9b900f48d254 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127521 May 28 04:50:45.718644 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2059/4023] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:50:45 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:45.807346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5ac20f04-4843-4b74-a063-f586c25810eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:45.808247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5ac20f04-4843-4b74-a063-f586c25810eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:45.831973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ac20f04-4843-4b74-a063-f586c25810eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:45.832444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ac20f04-4843-4b74-a063-f586c25810eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:45.840808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ac20f04-4843-4b74-a063-f586c25810eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:45.841227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ac20f04-4843-4b74-a063-f586c25810eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:46.169170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9171ea79-2aa2-4c62-933d-a9ca180520fa tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:46.189539 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9171ea79-2aa2-4c62-933d-a9ca180520fa tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 200 len: 1315 microversion: 2.1 time: 0.930004 May 28 04:50:46.189868 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1965/4024] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:45 2022] GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 1315 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:46.237793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-74667c75-7521-4a1d-9cb4-f931c0f64941 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:46.238706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-74667c75-7521-4a1d-9cb4-f931c0f64941 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:47.060081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-74667c75-7521-4a1d-9cb4-f931c0f64941 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:47.069896 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-74667c75-7521-4a1d-9cb4-f931c0f64941 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 200 len: 1209 microversion: 2.1 time: 0.836029 May 28 04:50:47.077193 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1966/4025] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:46 2022] GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 1209 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:47.091186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-099a9be2-9c29-4d23-b310-e4e9dd9d8d00 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:47.092426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-099a9be2-9c29-4d23-b310-e4e9dd9d8d00 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:47.111283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-099a9be2-9c29-4d23-b310-e4e9dd9d8d00 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:47.112121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-099a9be2-9c29-4d23-b310-e4e9dd9d8d00 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:47.113401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-099a9be2-9c29-4d23-b310-e4e9dd9d8d00 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:47.113908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-099a9be2-9c29-4d23-b310-e4e9dd9d8d00 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:47.152825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5ac20f04-4843-4b74-a063-f586c25810eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:47.171557 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5ac20f04-4843-4b74-a063-f586c25810eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1508 microversion: 2.1 time: 1.364116 May 28 04:50:47.175731 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2060/4026] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:45 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1508 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:47.202417 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-50c421fd-f118-41dd-b693-31b289cfcbe7 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:47.205363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-50c421fd-f118-41dd-b693-31b289cfcbe7 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:47.240519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50c421fd-f118-41dd-b693-31b289cfcbe7 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:47.241916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50c421fd-f118-41dd-b693-31b289cfcbe7 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:47.242770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50c421fd-f118-41dd-b693-31b289cfcbe7 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:47.250726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50c421fd-f118-41dd-b693-31b289cfcbe7 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:47.275214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:47.395428 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-50c421fd-f118-41dd-b693-31b289cfcbe7 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.216481 May 28 04:50:47.399643 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2061/4027] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:50:47 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments => generated 197 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:47.404391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c6acccc1-8a25-4637-bdb3-038c41048f1b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:47.405015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c6acccc1-8a25-4637-bdb3-038c41048f1b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:47.427154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:47.435450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c6acccc1-8a25-4637-bdb3-038c41048f1b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:47.435450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c6acccc1-8a25-4637-bdb3-038c41048f1b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:47.435450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c6acccc1-8a25-4637-bdb3-038c41048f1b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:47.435450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c6acccc1-8a25-4637-bdb3-038c41048f1b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:47.859773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-099a9be2-9c29-4d23-b310-e4e9dd9d8d00 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:47.906761 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-099a9be2-9c29-4d23-b310-e4e9dd9d8d00 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1499 microversion: 2.1 time: 0.828023 May 28 04:50:47.910285 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1967/4028] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:47 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1499 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:47.992643 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7133fe8a-a2b1-47ec-9067-688e13f697f4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:48.021289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7133fe8a-a2b1-47ec-9067-688e13f697f4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:48.027960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7133fe8a-a2b1-47ec-9067-688e13f697f4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '666dc141a00a4376893f7244fc10c61b'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:50:48.037243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c6acccc1-8a25-4637-bdb3-038c41048f1b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:48.050974 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c6acccc1-8a25-4637-bdb3-038c41048f1b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 200 len: 1502 microversion: 2.1 time: 0.646692 May 28 04:50:48.052212 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2062/4029] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:47 2022] GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 1502 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:48.060473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7133fe8a-a2b1-47ec-9067-688e13f697f4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:48.061065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7133fe8a-a2b1-47ec-9067-688e13f697f4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:48.069691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7133fe8a-a2b1-47ec-9067-688e13f697f4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:48.070950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7133fe8a-a2b1-47ec-9067-688e13f697f4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:48.072274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1bc362d3-01f1-4139-b7f9-780666588368 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:48.083950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1bc362d3-01f1-4139-b7f9-780666588368 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:48.109121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1bc362d3-01f1-4139-b7f9-780666588368 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:48.109862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1bc362d3-01f1-4139-b7f9-780666588368 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:48.110838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1bc362d3-01f1-4139-b7f9-780666588368 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:48.142321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1bc362d3-01f1-4139-b7f9-780666588368 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:48.236510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-7133fe8a-a2b1-47ec-9067-688e13f697f4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:50:48.245645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1bc362d3-01f1-4139-b7f9-780666588368 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:50:48.310264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:48.412783 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7133fe8a-a2b1-47ec-9067-688e13f697f4 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.487020 May 28 04:50:48.414203 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1968/4030] 10.222.0.58 () {58 vars in 1153 bytes} [Sat May 28 04:50:47 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:48.419592 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-315d7acd-b07a-4c06-a4d7-95ec57c058a5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:48.420482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-315d7acd-b07a-4c06-a4d7-95ec57c058a5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:48.463649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-315d7acd-b07a-4c06-a4d7-95ec57c058a5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:48.464327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-315d7acd-b07a-4c06-a4d7-95ec57c058a5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:48.466484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-315d7acd-b07a-4c06-a4d7-95ec57c058a5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:48.468449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-315d7acd-b07a-4c06-a4d7-95ec57c058a5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:48.667352 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1bc362d3-01f1-4139-b7f9-780666588368 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "DELETE /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 204 len: 0 microversion: 2.1 time: 0.599718 May 28 04:50:48.668221 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2063/4031] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:50:48 2022] DELETE /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 04:50:48.675196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4dba5999-871f-47fa-b9a0-fcc6daf24866 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:48.677535 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4dba5999-871f-47fa-b9a0-fcc6daf24866 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:48.694957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4dba5999-871f-47fa-b9a0-fcc6daf24866 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:48.703336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4dba5999-871f-47fa-b9a0-fcc6daf24866 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:48.703336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4dba5999-871f-47fa-b9a0-fcc6daf24866 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:48.703336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4dba5999-871f-47fa-b9a0-fcc6daf24866 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:48.768012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-315d7acd-b07a-4c06-a4d7-95ec57c058a5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:48.782949 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-315d7acd-b07a-4c06-a4d7-95ec57c058a5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 200 len: 1269 microversion: 2.1 time: 0.367191 May 28 04:50:48.793572 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1969/4032] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:48 2022] GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 1269 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:48.811616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7ef120ba-1086-49f7-85db-129a6ed42465 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:48.815619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7ef120ba-1086-49f7-85db-129a6ed42465 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:48.837061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7ef120ba-1086-49f7-85db-129a6ed42465 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:48.839263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7ef120ba-1086-49f7-85db-129a6ed42465 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:48.842021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7ef120ba-1086-49f7-85db-129a6ed42465 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:48.843795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7ef120ba-1086-49f7-85db-129a6ed42465 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:48.931357 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7ef120ba-1086-49f7-85db-129a6ed42465 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135224 May 28 04:50:48.942867 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1970/4033] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:50:48 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:48.952741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3b1eed3f-0f51-469e-9392-b44d16be17d2 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:48.972576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b1eed3f-0f51-469e-9392-b44d16be17d2 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:48.974472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b1eed3f-0f51-469e-9392-b44d16be17d2 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:49.030153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3b1eed3f-0f51-469e-9392-b44d16be17d2 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Going to try to start instance {{(pid=126043) start /opt/stack/nova/nova/compute/api.py:2730}} May 28 04:50:49.335567 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3b1eed3f-0f51-469e-9392-b44d16be17d2 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "POST /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5/action" status: 202 len: 0 microversion: 2.1 time: 0.396915 May 28 04:50:49.346227 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1971/4034] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:50:48 2022] POST /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:50:49.346227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-34e1f280-1e18-4b9e-88ad-1a8e54097f48 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:49.346227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-34e1f280-1e18-4b9e-88ad-1a8e54097f48 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:49.359506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4dba5999-871f-47fa-b9a0-fcc6daf24866 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:49.388302 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4dba5999-871f-47fa-b9a0-fcc6daf24866 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1508 microversion: 2.1 time: 0.718539 May 28 04:50:49.389215 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2064/4035] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:48 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1508 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:49.396680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34e1f280-1e18-4b9e-88ad-1a8e54097f48 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:49.397319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34e1f280-1e18-4b9e-88ad-1a8e54097f48 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:49.401570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34e1f280-1e18-4b9e-88ad-1a8e54097f48 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:49.414435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34e1f280-1e18-4b9e-88ad-1a8e54097f48 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:49.414558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0319ac2a-f2a4-4bf4-9b03-7b4c3b21ccf6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:49.414558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0319ac2a-f2a4-4bf4-9b03-7b4c3b21ccf6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:49.428814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0319ac2a-f2a4-4bf4-9b03-7b4c3b21ccf6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:49.429586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0319ac2a-f2a4-4bf4-9b03-7b4c3b21ccf6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:49.438194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0319ac2a-f2a4-4bf4-9b03-7b4c3b21ccf6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:49.452267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0319ac2a-f2a4-4bf4-9b03-7b4c3b21ccf6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:50.068131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-34e1f280-1e18-4b9e-88ad-1a8e54097f48 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:50.081986 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-34e1f280-1e18-4b9e-88ad-1a8e54097f48 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 200 len: 1508 microversion: 2.1 time: 0.741796 May 28 04:50:50.083653 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1972/4036] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:49 2022] GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 1508 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:50.091952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0b2bafaf-83a4-4d04-ac99-9d225344768f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:50.092954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0b2bafaf-83a4-4d04-ac99-9d225344768f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:50.112810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b2bafaf-83a4-4d04-ac99-9d225344768f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:50.117087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b2bafaf-83a4-4d04-ac99-9d225344768f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:50.118836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b2bafaf-83a4-4d04-ac99-9d225344768f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:50.121499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b2bafaf-83a4-4d04-ac99-9d225344768f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:50.129409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0319ac2a-f2a4-4bf4-9b03-7b4c3b21ccf6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:50.138821 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0319ac2a-f2a4-4bf4-9b03-7b4c3b21ccf6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1508 microversion: 2.1 time: 0.746331 May 28 04:50:50.144683 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2065/4037] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:49 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1508 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:50.150454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f93bd281-75c5-4af5-8865-a285063d54b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:50.156907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f93bd281-75c5-4af5-8865-a285063d54b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:50.171563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f93bd281-75c5-4af5-8865-a285063d54b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:50.172302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f93bd281-75c5-4af5-8865-a285063d54b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:50.175292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f93bd281-75c5-4af5-8865-a285063d54b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:50.175913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f93bd281-75c5-4af5-8865-a285063d54b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:50.203765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0b2bafaf-83a4-4d04-ac99-9d225344768f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:50.212847 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0b2bafaf-83a4-4d04-ac99-9d225344768f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 200 len: 1267 microversion: 2.1 time: 0.128021 May 28 04:50:50.215959 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1973/4038] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:50 2022] GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 1267 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:50.221870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-43b841bd-377d-4448-86f5-37e33f141e57 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:50.222687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-43b841bd-377d-4448-86f5-37e33f141e57 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:50.231550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43b841bd-377d-4448-86f5-37e33f141e57 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:50.232282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43b841bd-377d-4448-86f5-37e33f141e57 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:50.233249 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43b841bd-377d-4448-86f5-37e33f141e57 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:50.234156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43b841bd-377d-4448-86f5-37e33f141e57 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:50.247223 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f93bd281-75c5-4af5-8865-a285063d54b6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100457 May 28 04:50:50.252768 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2066/4039] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:50:50 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:50.252959 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-43b841bd-377d-4448-86f5-37e33f141e57 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] HTTP exception thrown: Instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 could not be found. May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-43b841bd-377d-4448-86f5-37e33f141e57 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Request method failure captured: May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 HTTP/1.1 May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikagIrsq0cNO6m4ZmUnNcb8b9zpHSaS1g2Qn2AUomdYPw32ywyVbaK1Aeby4lY963JTst2bTUk-BHZXu85KL9xp856Y3_aDdFRGEbrnrq_e2J03RBA1OY7bbE7ubcxIosg4-hFPkbVpWFYKBi7hOMKTa5WLzV2afi4yMytDKKs7cn2Q4 May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-Openstack-Nova-Api-Version: 2.42 May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 998b585dc62744008c3cbba9f6cbb827 May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-178993853 May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_998b585dc62744008c3cbba9f6cbb827"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/998b585dc62744008c3cbba9f6cbb827"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/998b585dc62744008c3cbba9f6cbb827"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/998b585dc62744008c3cbba9f6cbb827"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TaggedBootDevicesTest_v242-178993853 May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 998b585dc62744008c3cbba9f6cbb827 May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-178993853 May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TaggedBootDevicesTest_v242-178993853-project May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: ed73a7e876d24e18b3b9add257169512 May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TaggedBootDevicesTest_v242-178993853-project May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 could not be found. May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26'} May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 could not be found. May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:50:50.261511 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:50:50.266662 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 could not be found. May 28 04:50:50.266662 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:50.266662 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:50:50.266662 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:50.266662 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:50.266662 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:50:50.266662 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:50:50.266662 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:50:50.266662 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:50:50.266662 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 could not be found. May 28 04:50:50.266662 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:50:50.270974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-43b841bd-377d-4448-86f5-37e33f141e57 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Returning 404 to user: Instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:50:50.272427 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-43b841bd-377d-4448-86f5-37e33f141e57 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 404 len: 111 microversion: 2.42 time: 0.054243 May 28 04:50:50.273508 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1974/4040] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:50:50 2022] DELETE /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 04:50:50.281854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-734f9d66-ef5a-463e-aeec-6765cad477f6 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:50.282460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-734f9d66-ef5a-463e-aeec-6765cad477f6 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] [instance: ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:50.292970 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-734f9d66-ef5a-463e-aeec-6765cad477f6 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:50.300645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-734f9d66-ef5a-463e-aeec-6765cad477f6 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:50.301703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-734f9d66-ef5a-463e-aeec-6765cad477f6 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:50.302371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-734f9d66-ef5a-463e-aeec-6765cad477f6 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:50.332473 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-734f9d66-ef5a-463e-aeec-6765cad477f6 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] HTTP exception thrown: Instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 could not be found. May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-734f9d66-ef5a-463e-aeec-6765cad477f6 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Request method failure captured: May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 HTTP/1.1 May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikagIrsq0cNO6m4ZmUnNcb8b9zpHSaS1g2Qn2AUomdYPw32ywyVbaK1Aeby4lY963JTst2bTUk-BHZXu85KL9xp856Y3_aDdFRGEbrnrq_e2J03RBA1OY7bbE7ubcxIosg4-hFPkbVpWFYKBi7hOMKTa5WLzV2afi4yMytDKKs7cn2Q4 May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-Openstack-Nova-Api-Version: 2.42 May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 998b585dc62744008c3cbba9f6cbb827 May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-178993853 May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_998b585dc62744008c3cbba9f6cbb827"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/998b585dc62744008c3cbba9f6cbb827"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/998b585dc62744008c3cbba9f6cbb827"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/998b585dc62744008c3cbba9f6cbb827"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TaggedBootDevicesTest_v242-178993853 May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 998b585dc62744008c3cbba9f6cbb827 May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-178993853 May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TaggedBootDevicesTest_v242-178993853-project May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: ed73a7e876d24e18b3b9add257169512 May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TaggedBootDevicesTest_v242-178993853-project May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 could not be found. May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26'} May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 could not be found. May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 could not be found. May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:50:50.341518 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:50:50.346392 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:50:50.346392 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:50.346392 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:50:50.346392 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:50:50.346392 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:50:50.346392 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:50:50.346392 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 could not be found. May 28 04:50:50.346392 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:50:50.347789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-734f9d66-ef5a-463e-aeec-6765cad477f6 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] Returning 404 to user: Instance ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:50:50.349508 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-734f9d66-ef5a-463e-aeec-6765cad477f6 tempest-TaggedBootDevicesTest_v242-178993853 tempest-TaggedBootDevicesTest_v242-178993853-project] 10.222.0.58 "GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26" status: 404 len: 111 microversion: 2.42 time: 0.072160 May 28 04:50:50.354418 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2067/4041] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:50:50 2022] GET /compute/v2.1/servers/ff3af1a6-ec9d-4e29-b2fa-bf6eb27dfe26 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 04:50:50.406426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f933e687-e85b-42f1-944b-0ef660437c92 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:50.410983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f933e687-e85b-42f1-944b-0ef660437c92 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:50.419312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f933e687-e85b-42f1-944b-0ef660437c92 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:50.423853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f933e687-e85b-42f1-944b-0ef660437c92 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:50.425032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f933e687-e85b-42f1-944b-0ef660437c92 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:50.425726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f933e687-e85b-42f1-944b-0ef660437c92 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:50.851227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f933e687-e85b-42f1-944b-0ef660437c92 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:50.866075 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f933e687-e85b-42f1-944b-0ef660437c92 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1508 microversion: 2.1 time: 0.463701 May 28 04:50:50.871767 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1975/4042] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:50 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1508 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:51.101865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dd484435-65ba-4b7c-9100-16347412e471 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:51.108227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dd484435-65ba-4b7c-9100-16347412e471 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:51.116005 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd484435-65ba-4b7c-9100-16347412e471 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:51.122470 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd484435-65ba-4b7c-9100-16347412e471 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:51.126386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd484435-65ba-4b7c-9100-16347412e471 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:51.126850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd484435-65ba-4b7c-9100-16347412e471 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:51.156911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-28ed650f-ffdf-4906-8c00-f2d56e5f8dfd tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:51.157599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-28ed650f-ffdf-4906-8c00-f2d56e5f8dfd tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:51.180838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-28ed650f-ffdf-4906-8c00-f2d56e5f8dfd tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:51.188504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-28ed650f-ffdf-4906-8c00-f2d56e5f8dfd tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:51.188504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-28ed650f-ffdf-4906-8c00-f2d56e5f8dfd tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:51.188504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-28ed650f-ffdf-4906-8c00-f2d56e5f8dfd tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:51.502675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dd484435-65ba-4b7c-9100-16347412e471 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:51.515611 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dd484435-65ba-4b7c-9100-16347412e471 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 200 len: 1508 microversion: 2.1 time: 0.419170 May 28 04:50:51.516406 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2068/4043] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:51 2022] GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 1508 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:51.525129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5a9ab7a0-d25f-47b7-95e2-3a017daeb24b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:51.525954 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5a9ab7a0-d25f-47b7-95e2-3a017daeb24b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:51.542037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a9ab7a0-d25f-47b7-95e2-3a017daeb24b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:51.542762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a9ab7a0-d25f-47b7-95e2-3a017daeb24b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:51.543779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a9ab7a0-d25f-47b7-95e2-3a017daeb24b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:51.544373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a9ab7a0-d25f-47b7-95e2-3a017daeb24b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:51.552817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-28ed650f-ffdf-4906-8c00-f2d56e5f8dfd tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:51.563418 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-28ed650f-ffdf-4906-8c00-f2d56e5f8dfd tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1508 microversion: 2.1 time: 0.410629 May 28 04:50:51.564288 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1976/4044] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:51 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1508 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:51.587214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-13de5bb9-2901-458b-b2e1-b9c2c159029e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:51.600335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-13de5bb9-2901-458b-b2e1-b9c2c159029e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:51.612978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13de5bb9-2901-458b-b2e1-b9c2c159029e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:51.618701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13de5bb9-2901-458b-b2e1-b9c2c159029e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:51.621593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13de5bb9-2901-458b-b2e1-b9c2c159029e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:51.624319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13de5bb9-2901-458b-b2e1-b9c2c159029e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:51.707881 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-13de5bb9-2901-458b-b2e1-b9c2c159029e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127527 May 28 04:50:51.708474 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1977/4045] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:50:51 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:50:51.839967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5a9ab7a0-d25f-47b7-95e2-3a017daeb24b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:51.865991 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5a9ab7a0-d25f-47b7-95e2-3a017daeb24b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 200 len: 1267 microversion: 2.1 time: 0.346878 May 28 04:50:51.874977 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2069/4046] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:51 2022] GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 1267 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:51.885808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b9e640d8-186d-4c4e-9b31-d3d000c399eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:51.887318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b9e640d8-186d-4c4e-9b31-d3d000c399eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:51.898687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9e640d8-186d-4c4e-9b31-d3d000c399eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:51.899540 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9e640d8-186d-4c4e-9b31-d3d000c399eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:51.900810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9e640d8-186d-4c4e-9b31-d3d000c399eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:51.906196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9e640d8-186d-4c4e-9b31-d3d000c399eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:52.360067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b9e640d8-186d-4c4e-9b31-d3d000c399eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:52.374731 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b9e640d8-186d-4c4e-9b31-d3d000c399eb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1508 microversion: 2.1 time: 0.492575 May 28 04:50:52.377195 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1978/4047] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:51 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1508 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:52.533522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-04085ebe-37e0-4a49-bded-19e5a72c9838 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:52.534141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-04085ebe-37e0-4a49-bded-19e5a72c9838 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:52.547234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-04085ebe-37e0-4a49-bded-19e5a72c9838 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:52.552708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-04085ebe-37e0-4a49-bded-19e5a72c9838 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:52.553716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-04085ebe-37e0-4a49-bded-19e5a72c9838 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:52.554316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-04085ebe-37e0-4a49-bded-19e5a72c9838 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:52.581259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a8c62fa2-de0c-41c7-83f9-b9a267d85a22 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:52.581885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a8c62fa2-de0c-41c7-83f9-b9a267d85a22 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:52.591525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a8c62fa2-de0c-41c7-83f9-b9a267d85a22 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:52.591981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a8c62fa2-de0c-41c7-83f9-b9a267d85a22 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:52.595555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a8c62fa2-de0c-41c7-83f9-b9a267d85a22 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:52.596525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a8c62fa2-de0c-41c7-83f9-b9a267d85a22 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:52.922076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-04085ebe-37e0-4a49-bded-19e5a72c9838 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:52.926829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a8c62fa2-de0c-41c7-83f9-b9a267d85a22 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:52.930266 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-04085ebe-37e0-4a49-bded-19e5a72c9838 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 200 len: 1508 microversion: 2.1 time: 0.401065 May 28 04:50:52.935676 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a8c62fa2-de0c-41c7-83f9-b9a267d85a22 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1508 microversion: 2.1 time: 0.357979 May 28 04:50:52.935859 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2070/4048] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:52 2022] GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 1508 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:52.942719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cc599184-a5f4-4bf3-96ee-bf509099dda6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:52.945582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cc599184-a5f4-4bf3-96ee-bf509099dda6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:52.947467 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1979/4049] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:52 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1508 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:52.953896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-26a3ddd5-7f17-4b92-b418-ceea665998e2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:52.954796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-26a3ddd5-7f17-4b92-b418-ceea665998e2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:52.968737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc599184-a5f4-4bf3-96ee-bf509099dda6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:52.970518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc599184-a5f4-4bf3-96ee-bf509099dda6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:52.970518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc599184-a5f4-4bf3-96ee-bf509099dda6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:52.970518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc599184-a5f4-4bf3-96ee-bf509099dda6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:52.976543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-26a3ddd5-7f17-4b92-b418-ceea665998e2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:52.979605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-26a3ddd5-7f17-4b92-b418-ceea665998e2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:52.984878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-26a3ddd5-7f17-4b92-b418-ceea665998e2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:52.985575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-26a3ddd5-7f17-4b92-b418-ceea665998e2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:53.022197 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cc599184-a5f4-4bf3-96ee-bf509099dda6 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085209 May 28 04:50:53.023126 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2071/4050] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:50:52 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:50:53.150518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fd7723cf-8493-4c59-8067-04736c7b9f4e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:53.150759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fd7723cf-8493-4c59-8067-04736c7b9f4e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:53.160304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd7723cf-8493-4c59-8067-04736c7b9f4e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:53.160812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd7723cf-8493-4c59-8067-04736c7b9f4e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:53.165132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd7723cf-8493-4c59-8067-04736c7b9f4e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:53.166747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd7723cf-8493-4c59-8067-04736c7b9f4e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:53.213722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fd7723cf-8493-4c59-8067-04736c7b9f4e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:50:53.313276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-26a3ddd5-7f17-4b92-b418-ceea665998e2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:53.327539 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-26a3ddd5-7f17-4b92-b418-ceea665998e2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 200 len: 1309 microversion: 2.1 time: 0.374167 May 28 04:50:53.328431 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1980/4051] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:52 2022] GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 1309 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:53.397415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b8933f10-3370-4c20-8fd1-5eb210e689e8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:53.397415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b8933f10-3370-4c20-8fd1-5eb210e689e8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:53.407591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8933f10-3370-4c20-8fd1-5eb210e689e8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:53.408508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8933f10-3370-4c20-8fd1-5eb210e689e8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:53.409358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8933f10-3370-4c20-8fd1-5eb210e689e8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:53.409910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8933f10-3370-4c20-8fd1-5eb210e689e8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:53.611324 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fd7723cf-8493-4c59-8067-04736c7b9f4e tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "DELETE /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8" status: 204 len: 0 microversion: 2.1 time: 0.464603 May 28 04:50:53.615817 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2072/4052] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:50:53 2022] DELETE /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:50:53.625126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-108152a2-bbaa-4d20-88db-0c36d758c4b4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:53.626073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-108152a2-bbaa-4d20-88db-0c36d758c4b4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:53.638280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-108152a2-bbaa-4d20-88db-0c36d758c4b4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:53.639012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-108152a2-bbaa-4d20-88db-0c36d758c4b4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:53.639982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-108152a2-bbaa-4d20-88db-0c36d758c4b4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:53.641065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-108152a2-bbaa-4d20-88db-0c36d758c4b4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:53.812343 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b8933f10-3370-4c20-8fd1-5eb210e689e8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:53.826692 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b8933f10-3370-4c20-8fd1-5eb210e689e8 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1508 microversion: 2.1 time: 0.436734 May 28 04:50:53.839515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:53.839803 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1981/4053] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:53 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1508 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:53.951927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3deed8a9-8bfd-4c93-b042-6019a0d1205a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:53.952904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3deed8a9-8bfd-4c93-b042-6019a0d1205a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:53.962819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:53.984759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3deed8a9-8bfd-4c93-b042-6019a0d1205a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:53.986046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3deed8a9-8bfd-4c93-b042-6019a0d1205a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:53.990474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3deed8a9-8bfd-4c93-b042-6019a0d1205a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:53.991136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3deed8a9-8bfd-4c93-b042-6019a0d1205a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:54.013238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-108152a2-bbaa-4d20-88db-0c36d758c4b4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:54.026430 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-108152a2-bbaa-4d20-88db-0c36d758c4b4 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8" status: 200 len: 1680 microversion: 2.1 time: 0.407861 May 28 04:50:54.029679 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2073/4054] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:53 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 => generated 1680 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:54.042834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-31153ffe-9661-4501-b86f-8f0a79ab9002 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:54.043502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-31153ffe-9661-4501-b86f-8f0a79ab9002 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:54.057322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31153ffe-9661-4501-b86f-8f0a79ab9002 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:54.057770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31153ffe-9661-4501-b86f-8f0a79ab9002 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:54.058568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31153ffe-9661-4501-b86f-8f0a79ab9002 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:54.059014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31153ffe-9661-4501-b86f-8f0a79ab9002 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:54.125050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3deed8a9-8bfd-4c93-b042-6019a0d1205a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:54.137290 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3deed8a9-8bfd-4c93-b042-6019a0d1205a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 200 len: 1466 microversion: 2.1 time: 0.191357 May 28 04:50:54.140273 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1982/4055] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:53 2022] GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 1466 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:50:54.292354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-aeb3cadc-eb5d-4d47-9307-0ef2e9ec9bca req-75b107fd-cc51-4d4d-87f6-d2b1603301f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25437109-2e1e-48a8-97ad-af5014923c55", "name": "network-vif-deleted", "tag": "6da7cc8f-f361-4837-b479-6ce4ee61d06d"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:54.307526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-aeb3cadc-eb5d-4d47-9307-0ef2e9ec9bca req-75b107fd-cc51-4d4d-87f6-d2b1603301f3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:54.308720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-aeb3cadc-eb5d-4d47-9307-0ef2e9ec9bca req-75b107fd-cc51-4d4d-87f6-d2b1603301f3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:54.337628 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-aeb3cadc-eb5d-4d47-9307-0ef2e9ec9bca req-75b107fd-cc51-4d4d-87f6-d2b1603301f3 service nova] Creating event network-vif-deleted:6da7cc8f-f361-4837-b479-6ce4ee61d06d for instance 25437109-2e1e-48a8-97ad-af5014923c55 on n-h1-843700-1 May 28 04:50:54.350912 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-aeb3cadc-eb5d-4d47-9307-0ef2e9ec9bca req-75b107fd-cc51-4d4d-87f6-d2b1603301f3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062334 May 28 04:50:54.351560 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1983/4056] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:50:54.361167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-76b4004e-6764-4829-b786-9841006b4245 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:54.361872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-76b4004e-6764-4829-b786-9841006b4245 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:54.378935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76b4004e-6764-4829-b786-9841006b4245 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:54.380036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76b4004e-6764-4829-b786-9841006b4245 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:54.381405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76b4004e-6764-4829-b786-9841006b4245 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:54.389532 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76b4004e-6764-4829-b786-9841006b4245 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:54.772607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-31153ffe-9661-4501-b86f-8f0a79ab9002 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:54.782901 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-31153ffe-9661-4501-b86f-8f0a79ab9002 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1508 microversion: 2.1 time: 0.752117 May 28 04:50:54.783538 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2074/4057] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:54 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1508 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:54.848035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-49b18763-ea28-4bb9-a24f-7619b114ea76 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:54.849275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-49b18763-ea28-4bb9-a24f-7619b114ea76 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:54.865634 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49b18763-ea28-4bb9-a24f-7619b114ea76 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:54.866463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49b18763-ea28-4bb9-a24f-7619b114ea76 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:54.867547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49b18763-ea28-4bb9-a24f-7619b114ea76 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:54.868193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49b18763-ea28-4bb9-a24f-7619b114ea76 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:54.928224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-76b4004e-6764-4829-b786-9841006b4245 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:54.937020 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-76b4004e-6764-4829-b786-9841006b4245 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 200 len: 1309 microversion: 2.1 time: 0.584233 May 28 04:50:54.944437 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1984/4058] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:54 2022] GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 1309 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:54.945882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:55.045588 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-09f1e9f9-39bc-4870-883f-fc82f845a3b0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:55.046623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-09f1e9f9-39bc-4870-883f-fc82f845a3b0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:55.058024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09f1e9f9-39bc-4870-883f-fc82f845a3b0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:55.064468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09f1e9f9-39bc-4870-883f-fc82f845a3b0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:55.065649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09f1e9f9-39bc-4870-883f-fc82f845a3b0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:55.066358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09f1e9f9-39bc-4870-883f-fc82f845a3b0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:55.071820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:55.374902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-49b18763-ea28-4bb9-a24f-7619b114ea76 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:55.395992 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-49b18763-ea28-4bb9-a24f-7619b114ea76 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1508 microversion: 2.1 time: 0.542776 May 28 04:50:55.406584 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2075/4059] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:54 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1508 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:55.413278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c72e21d2-0fba-4c64-a4eb-d240aae2456a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:55.414307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c72e21d2-0fba-4c64-a4eb-d240aae2456a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:55.431504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c72e21d2-0fba-4c64-a4eb-d240aae2456a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:55.432278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c72e21d2-0fba-4c64-a4eb-d240aae2456a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:55.433296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c72e21d2-0fba-4c64-a4eb-d240aae2456a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:55.433979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c72e21d2-0fba-4c64-a4eb-d240aae2456a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:55.506083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c72e21d2-0fba-4c64-a4eb-d240aae2456a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:55.507023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c72e21d2-0fba-4c64-a4eb-d240aae2456a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:55.507744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-c72e21d2-0fba-4c64-a4eb-d240aae2456a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lazy-loading 'fault' on Instance uuid 25437109-2e1e-48a8-97ad-af5014923c55 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:50:55.591907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c72e21d2-0fba-4c64-a4eb-d240aae2456a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:55.600836 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c72e21d2-0fba-4c64-a4eb-d240aae2456a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 200 len: 1305 microversion: 2.1 time: 0.192623 May 28 04:50:55.613012 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2076/4060] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:55 2022] GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 1305 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:55.613386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-09f1e9f9-39bc-4870-883f-fc82f845a3b0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:55.622307 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-09f1e9f9-39bc-4870-883f-fc82f845a3b0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8" status: 200 len: 1680 microversion: 2.1 time: 0.580980 May 28 04:50:55.627791 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1985/4061] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:55 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 => generated 1680 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:55.802171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ddccb718-3621-424c-8777-c886bf29061f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:55.806784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ddccb718-3621-424c-8777-c886bf29061f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:55.821613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddccb718-3621-424c-8777-c886bf29061f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:55.822411 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddccb718-3621-424c-8777-c886bf29061f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:55.826264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddccb718-3621-424c-8777-c886bf29061f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:55.827015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddccb718-3621-424c-8777-c886bf29061f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:55.960925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-21853a2f-fd3a-4f27-9cd8-6844686056b7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:55.961538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-21853a2f-fd3a-4f27-9cd8-6844686056b7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:55.972891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21853a2f-fd3a-4f27-9cd8-6844686056b7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:55.974252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21853a2f-fd3a-4f27-9cd8-6844686056b7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:55.979497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21853a2f-fd3a-4f27-9cd8-6844686056b7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:55.980250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21853a2f-fd3a-4f27-9cd8-6844686056b7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:56.310621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ddccb718-3621-424c-8777-c886bf29061f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:56.327399 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ddccb718-3621-424c-8777-c886bf29061f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1512 microversion: 2.1 time: 0.531245 May 28 04:50:56.329272 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2077/4062] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:55 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1512 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:56.333774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-21853a2f-fd3a-4f27-9cd8-6844686056b7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:56.352850 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-21853a2f-fd3a-4f27-9cd8-6844686056b7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 200 len: 1309 microversion: 2.1 time: 0.395912 May 28 04:50:56.353460 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1986/4063] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:55 2022] GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 1309 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:56.365100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-064fd9ae-60aa-4230-a1b3-f61944f1d423 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:56.375322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-064fd9ae-60aa-4230-a1b3-f61944f1d423 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:56.375702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.compute.servers [None req-064fd9ae-60aa-4230-a1b3-f61944f1d423 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Removing options 'limit' from query {{(pid=126044) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 28 04:50:56.376523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-064fd9ae-60aa-4230-a1b3-f61944f1d423 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Searching by: {'deleted': False, 'project_id': '666dc141a00a4376893f7244fc10c61b'} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:50:56.377861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-064fd9ae-60aa-4230-a1b3-f61944f1d423 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:56.378216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-064fd9ae-60aa-4230-a1b3-f61944f1d423 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:56.379046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-064fd9ae-60aa-4230-a1b3-f61944f1d423 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:56.379529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-064fd9ae-60aa-4230-a1b3-f61944f1d423 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:56.380962 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-064fd9ae-60aa-4230-a1b3-f61944f1d423 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.020139 May 28 04:50:56.381554 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2078/4064] 10.222.0.58 () {58 vars in 1139 bytes} [Sat May 28 04:50:56 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:50:56.394745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3a146f94-a59c-424b-86b1-1dc5bdf5274a tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:56.395957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3a146f94-a59c-424b-86b1-1dc5bdf5274a tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:56.415949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a146f94-a59c-424b-86b1-1dc5bdf5274a tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:56.416555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a146f94-a59c-424b-86b1-1dc5bdf5274a tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:56.417659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a146f94-a59c-424b-86b1-1dc5bdf5274a tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:56.417965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2442dbe0-7485-4cb0-adf6-e02a94171cb5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:56.418124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a146f94-a59c-424b-86b1-1dc5bdf5274a tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:56.418591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2442dbe0-7485-4cb0-adf6-e02a94171cb5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:56.434377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2442dbe0-7485-4cb0-adf6-e02a94171cb5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:56.435886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2442dbe0-7485-4cb0-adf6-e02a94171cb5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:56.443088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2442dbe0-7485-4cb0-adf6-e02a94171cb5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:56.444052 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2442dbe0-7485-4cb0-adf6-e02a94171cb5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:56.893148 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2442dbe0-7485-4cb0-adf6-e02a94171cb5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:56.907673 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2442dbe0-7485-4cb0-adf6-e02a94171cb5 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1508 microversion: 2.1 time: 0.493388 May 28 04:50:56.914502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3a146f94-a59c-424b-86b1-1dc5bdf5274a tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:56.918218 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2079/4065] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:56 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1508 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:56.924140 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3a146f94-a59c-424b-86b1-1dc5bdf5274a tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1512 microversion: 2.1 time: 0.533890 May 28 04:50:56.931437 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1987/4066] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:56 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1512 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:56.946181 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a5dedc6d-51f6-4311-b76c-e4534ce50ffd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:56.946873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a5dedc6d-51f6-4311-b76c-e4534ce50ffd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:56.961098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-15a507b5-35e0-49c9-b1fe-9c03c1f442cc tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:56.962389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-15a507b5-35e0-49c9-b1fe-9c03c1f442cc tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:56.972510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5dedc6d-51f6-4311-b76c-e4534ce50ffd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:56.975485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5dedc6d-51f6-4311-b76c-e4534ce50ffd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:56.976335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5dedc6d-51f6-4311-b76c-e4534ce50ffd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:56.976791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5dedc6d-51f6-4311-b76c-e4534ce50ffd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:56.979882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15a507b5-35e0-49c9-b1fe-9c03c1f442cc tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:56.980344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15a507b5-35e0-49c9-b1fe-9c03c1f442cc tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:56.981135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15a507b5-35e0-49c9-b1fe-9c03c1f442cc tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:56.981574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15a507b5-35e0-49c9-b1fe-9c03c1f442cc tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:57.016710 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-a5dedc6d-51f6-4311-b76c-e4534ce50ffd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance 25437109-2e1e-48a8-97ad-af5014923c55 could not be found. May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a5dedc6d-51f6-4311-b76c-e4534ce50ffd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 HTTP/1.1 May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 25437109-2e1e-48a8-97ad-af5014923c55 could not be found. May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '25437109-2e1e-48a8-97ad-af5014923c55'} May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25437109-2e1e-48a8-97ad-af5014923c55 could not be found. May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25437109-2e1e-48a8-97ad-af5014923c55 could not be found. May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:50:57.018723 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:50:57.026084 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:50:57.026084 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:50:57.026084 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:50:57.026084 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:50:57.026084 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:50:57.026084 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25437109-2e1e-48a8-97ad-af5014923c55 could not be found. May 28 04:50:57.026084 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:50:57.026084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a5dedc6d-51f6-4311-b76c-e4534ce50ffd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance 25437109-2e1e-48a8-97ad-af5014923c55 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:50:57.026084 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a5dedc6d-51f6-4311-b76c-e4534ce50ffd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 404 len: 111 microversion: 2.1 time: 0.100778 May 28 04:50:57.026084 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2080/4067] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:56 2022] GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:50:57.044610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ea8ac7bc-26d5-4b9d-bff0-2a15371e8f78 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2018507039", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "fedc2077-d23c-4b44-9ef4-fcdc7454ebda"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2090468210", "security_groups": [{"name": "tempest-secgroup-smoke-1090474580"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:57.072726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:57.282238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-ea8ac7bc-26d5-4b9d-bff0-2a15371e8f78 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] validate_networks() for [('fedc2077-d23c-4b44-9ef4-fcdc7454ebda', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:50:57.480722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-15a507b5-35e0-49c9-b1fe-9c03c1f442cc tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:57.498398 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-15a507b5-35e0-49c9-b1fe-9c03c1f442cc tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8" status: 200 len: 1680 microversion: 2.1 time: 0.546072 May 28 04:50:57.511587 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1988/4068] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:56 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 => generated 1680 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:57.524896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-da483665-ec04-412a-aa1d-85260168198c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:50:57.527998 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-da483665-ec04-412a-aa1d-85260168198c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:50:57.569979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-da483665-ec04-412a-aa1d-85260168198c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:57.571291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-da483665-ec04-412a-aa1d-85260168198c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:57.579413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-da483665-ec04-412a-aa1d-85260168198c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:57.579413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-da483665-ec04-412a-aa1d-85260168198c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:58.057261 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-da483665-ec04-412a-aa1d-85260168198c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:50:58.074963 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-da483665-ec04-412a-aa1d-85260168198c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77" status: 200 len: 1513 microversion: 2.1 time: 0.561914 May 28 04:50:58.089301 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1989/4069] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:50:57 2022] GET /compute/v2.1/servers/ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77 => generated 1513 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:50:58.100814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a38ba447-67bf-470d-b3e3-38fc49604ae0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1780772935", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "f9ad98fb-1793-4663-bcc3-60866c50d7c5"}, {"uuid": "44f0d263-7ade-4053-a21a-1ef1e8cec845"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:58.133812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:50:58.176910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-a38ba447-67bf-470d-b3e3-38fc49604ae0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] validate_networks() for [('f9ad98fb-1793-4663-bcc3-60866c50d7c5', None, None, None, None, None), ('44f0d263-7ade-4053-a21a-1ef1e8cec845', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:50:58.236431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-ea8ac7bc-26d5-4b9d-bff0-2a15371e8f78 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:50:58.237080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-ea8ac7bc-26d5-4b9d-bff0-2a15371e8f78 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:50:58.237682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-ea8ac7bc-26d5-4b9d-bff0-2a15371e8f78 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:50:58.238213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-ea8ac7bc-26d5-4b9d-bff0-2a15371e8f78 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:50:58.239068 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-ea8ac7bc-26d5-4b9d-bff0-2a15371e8f78 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:50:58.266284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea8ac7bc-26d5-4b9d-bff0-2a15371e8f78 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:58.268733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea8ac7bc-26d5-4b9d-bff0-2a15371e8f78 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:58.271539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea8ac7bc-26d5-4b9d-bff0-2a15371e8f78 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:50:58.275754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea8ac7bc-26d5-4b9d-bff0-2a15371e8f78 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:50:58.365930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-ea8ac7bc-26d5-4b9d-bff0-2a15371e8f78 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Getting quotas for project d14e7de3a28f42a79197e1c06c4676dd. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:50:58.404927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-ea8ac7bc-26d5-4b9d-bff0-2a15371e8f78 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Getting quotas for user 82b17444b87742e1b45409810cbe06d2 and project d14e7de3a28f42a79197e1c06c4676dd. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:50:58.430484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ea8ac7bc-26d5-4b9d-bff0-2a15371e8f78 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:50:58.437193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ea8ac7bc-26d5-4b9d-bff0-2a15371e8f78 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:50:58.644059 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ea8ac7bc-26d5-4b9d-bff0-2a15371e8f78 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.621355 May 28 04:50:58.657150 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2081/4070] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:50:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:50:58.680613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-681b62f7-e957-4c90-bb2f-a203927fe914 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-324450277", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "807b877d-73e2-4031-b4ab-972d86c6cc59"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:50:58.829972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-681b62f7-e957-4c90-bb2f-a203927fe914 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] validate_networks() for [('807b877d-73e2-4031-b4ab-972d86c6cc59', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:51:00.258245 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-681b62f7-e957-4c90-bb2f-a203927fe914 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:51:00.259397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-681b62f7-e957-4c90-bb2f-a203927fe914 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:51:00.260065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-681b62f7-e957-4c90-bb2f-a203927fe914 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:51:00.260842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-681b62f7-e957-4c90-bb2f-a203927fe914 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:51:00.261654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-681b62f7-e957-4c90-bb2f-a203927fe914 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:51:00.280306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-681b62f7-e957-4c90-bb2f-a203927fe914 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:00.284021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-681b62f7-e957-4c90-bb2f-a203927fe914 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:00.285111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-681b62f7-e957-4c90-bb2f-a203927fe914 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:00.285791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-681b62f7-e957-4c90-bb2f-a203927fe914 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:00.298750 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a38ba447-67bf-470d-b3e3-38fc49604ae0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:51:00.299403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a38ba447-67bf-470d-b3e3-38fc49604ae0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:51:00.300129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a38ba447-67bf-470d-b3e3-38fc49604ae0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:51:00.300733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a38ba447-67bf-470d-b3e3-38fc49604ae0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:51:00.302124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a38ba447-67bf-470d-b3e3-38fc49604ae0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:51:00.327067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a38ba447-67bf-470d-b3e3-38fc49604ae0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:00.327668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a38ba447-67bf-470d-b3e3-38fc49604ae0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:00.328718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a38ba447-67bf-470d-b3e3-38fc49604ae0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:00.329783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a38ba447-67bf-470d-b3e3-38fc49604ae0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:00.343946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-681b62f7-e957-4c90-bb2f-a203927fe914 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Getting quotas for project dd598ce55f9b43d38530dae05fa1bda1. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:00.354820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-a38ba447-67bf-470d-b3e3-38fc49604ae0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Getting quotas for project 8f07539e283643c6b7bdc2c90ffa2ce1. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:00.358707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-681b62f7-e957-4c90-bb2f-a203927fe914 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Getting quotas for user b05e9b7e95074a91bc984338593c6c84 and project dd598ce55f9b43d38530dae05fa1bda1. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:00.363744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-a38ba447-67bf-470d-b3e3-38fc49604ae0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Getting quotas for user 9dd8bc74fda8476692c24f7c8b8f4b1c and project 8f07539e283643c6b7bdc2c90ffa2ce1. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:00.377892 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a38ba447-67bf-470d-b3e3-38fc49604ae0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:51:00.384848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-681b62f7-e957-4c90-bb2f-a203927fe914 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:51:00.388259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a38ba447-67bf-470d-b3e3-38fc49604ae0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:51:00.390788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-681b62f7-e957-4c90-bb2f-a203927fe914 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:51:00.608389 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-681b62f7-e957-4c90-bb2f-a203927fe914 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.945406 May 28 04:51:00.612903 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2082/4071] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:50:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:51:00.626051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-38263d9a-ee24-46b1-9dea-527b3dffe1a7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:00.627185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-38263d9a-ee24-46b1-9dea-527b3dffe1a7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:00.639862 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a38ba447-67bf-470d-b3e3-38fc49604ae0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.556972 May 28 04:51:00.645399 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1990/4072] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:50:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:51:00.646467 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-38263d9a-ee24-46b1-9dea-527b3dffe1a7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:00.647166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-38263d9a-ee24-46b1-9dea-527b3dffe1a7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:00.649383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-38263d9a-ee24-46b1-9dea-527b3dffe1a7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:00.650024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-38263d9a-ee24-46b1-9dea-527b3dffe1a7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:00.686371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2e6e3e58-d330-4689-aa4e-9bdce098f394 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:00.714116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2e6e3e58-d330-4689-aa4e-9bdce098f394 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:00.731018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2e6e3e58-d330-4689-aa4e-9bdce098f394 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:00.731694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2e6e3e58-d330-4689-aa4e-9bdce098f394 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:00.733019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2e6e3e58-d330-4689-aa4e-9bdce098f394 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:00.734579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2e6e3e58-d330-4689-aa4e-9bdce098f394 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:01.343349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2e6e3e58-d330-4689-aa4e-9bdce098f394 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:01.353800 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2e6e3e58-d330-4689-aa4e-9bdce098f394 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1505 microversion: 2.1 time: 0.710050 May 28 04:51:01.363237 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1991/4073] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:00 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1505 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:01.365087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-38263d9a-ee24-46b1-9dea-527b3dffe1a7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:01.376542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3bbdd7a8-c7e3-450a-ba97-a5a509ba29a6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:01.378898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3bbdd7a8-c7e3-450a-ba97-a5a509ba29a6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:01.382449 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-38263d9a-ee24-46b1-9dea-527b3dffe1a7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 200 len: 1309 microversion: 2.1 time: 0.766798 May 28 04:51:01.383876 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2083/4074] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:00 2022] GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 1309 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:01.390812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d79d5eb1-7d6e-4c93-b002-7121cbbce9e0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:01.391849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d79d5eb1-7d6e-4c93-b002-7121cbbce9e0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:01.394102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3bbdd7a8-c7e3-450a-ba97-a5a509ba29a6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:01.398226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3bbdd7a8-c7e3-450a-ba97-a5a509ba29a6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:01.399236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3bbdd7a8-c7e3-450a-ba97-a5a509ba29a6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:01.404221 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d79d5eb1-7d6e-4c93-b002-7121cbbce9e0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:01.404892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d79d5eb1-7d6e-4c93-b002-7121cbbce9e0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:01.407497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d79d5eb1-7d6e-4c93-b002-7121cbbce9e0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:01.407497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d79d5eb1-7d6e-4c93-b002-7121cbbce9e0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:01.413042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3bbdd7a8-c7e3-450a-ba97-a5a509ba29a6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:01.431384 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-d79d5eb1-7d6e-4c93-b002-7121cbbce9e0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] HTTP exception thrown: Instance 711037c4-54ef-4071-a370-fd39338dccf8 could not be found. May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d79d5eb1-7d6e-4c93-b002-7121cbbce9e0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Request method failure captured: May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 HTTP/1.1 May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikajS0ZZaXFlax6A342ymJ-aQoGJlvna1xZy9bO84b3D9OriaYICvIupIZdjiNLcHyTC7V-bCXuJxYAHanDCccz0wxij-I7blA2wa6CB5mbuJxMVXKjiUcQwy4f7KRJtSQW8-6D6CRl3EsAa-9i5aRJ6Odwpn_PfoRh6K409eAlefhoM May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 025cb09c79a147b3a648c950edcd1dc3 May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 711037c4-54ef-4071-a370-fd39338dccf8 could not be found. May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '711037c4-54ef-4071-a370-fd39338dccf8'} May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 711037c4-54ef-4071-a370-fd39338dccf8 could not be found. May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 711037c4-54ef-4071-a370-fd39338dccf8 could not be found. May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:01.448083 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:01.454615 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:01.454615 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:01.454615 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:01.454615 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:51:01.454615 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:51:01.454615 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 711037c4-54ef-4071-a370-fd39338dccf8 could not be found. May 28 04:51:01.454615 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:01.461561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d79d5eb1-7d6e-4c93-b002-7121cbbce9e0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Returning 404 to user: Instance 711037c4-54ef-4071-a370-fd39338dccf8 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:01.464293 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d79d5eb1-7d6e-4c93-b002-7121cbbce9e0 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8" status: 404 len: 111 microversion: 2.1 time: 0.078759 May 28 04:51:01.472556 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2084/4075] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:01 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:51:01.482041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-121396ec-252b-4b36-92de-70d1464b4914 req-8db4d234-1d9b-49e4-8e86-bc318c2129dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a73d352-1b6c-4221-872a-aee269b8c1ae", "tag": "de690259-a435-405f-856e-39cd4d32a239"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:01.496619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-121396ec-252b-4b36-92de-70d1464b4914 req-8db4d234-1d9b-49e4-8e86-bc318c2129dc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:01.497332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-121396ec-252b-4b36-92de-70d1464b4914 req-8db4d234-1d9b-49e4-8e86-bc318c2129dc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:01.541937 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-121396ec-252b-4b36-92de-70d1464b4914 req-8db4d234-1d9b-49e4-8e86-bc318c2129dc service nova] Creating event network-changed:de690259-a435-405f-856e-39cd4d32a239 for instance 4a73d352-1b6c-4221-872a-aee269b8c1ae on n-h2-843700-1 May 28 04:51:01.557977 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-121396ec-252b-4b36-92de-70d1464b4914 req-8db4d234-1d9b-49e4-8e86-bc318c2129dc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082309 May 28 04:51:01.558858 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2085/4076] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:01.569646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-34a56eb1-2375-4f2e-87fb-c706ada53090 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:01.577485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-34a56eb1-2375-4f2e-87fb-c706ada53090 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:01.597387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-34a56eb1-2375-4f2e-87fb-c706ada53090 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:01.598664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-34a56eb1-2375-4f2e-87fb-c706ada53090 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:01.599543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-34a56eb1-2375-4f2e-87fb-c706ada53090 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:01.599996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-34a56eb1-2375-4f2e-87fb-c706ada53090 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:01.710338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3bbdd7a8-c7e3-450a-ba97-a5a509ba29a6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:01.719689 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3bbdd7a8-c7e3-450a-ba97-a5a509ba29a6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 200 len: 1511 microversion: 2.1 time: 0.353479 May 28 04:51:01.728907 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1992/4077] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:01 2022] GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 1511 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:01.743067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c4b68623-19a8-4856-82dd-fc9797fe164b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:01.748887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c4b68623-19a8-4856-82dd-fc9797fe164b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:01.767490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-34a56eb1-2375-4f2e-87fb-c706ada53090 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:01.778728 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-34a56eb1-2375-4f2e-87fb-c706ada53090 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1319 microversion: 2.1 time: 0.217314 May 28 04:51:01.789386 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2086/4078] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:01 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:01.795470 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-078643c3-7a72-4496-b586-a4aaf017a67c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:01.796344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-078643c3-7a72-4496-b586-a4aaf017a67c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:01.990424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-078643c3-7a72-4496-b586-a4aaf017a67c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:01.993284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c4b68623-19a8-4856-82dd-fc9797fe164b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:02.003114 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-078643c3-7a72-4496-b586-a4aaf017a67c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1213 microversion: 2.1 time: 0.212174 May 28 04:51:02.006404 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c4b68623-19a8-4856-82dd-fc9797fe164b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1214 microversion: 2.1 time: 0.276297 May 28 04:51:02.012314 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1993/4079] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:01 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1214 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:02.021635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a06e853a-45a6-41d6-94c8-b7b7f92bc298 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '.version_select at 0x7f7701cb5310>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:02.036617 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2087/4080] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:01 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1213 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:02.036617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fdbaaf37-ff1b-4ae8-8621-94d25364017f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:02.040050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fdbaaf37-ff1b-4ae8-8621-94d25364017f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:02.041100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fdbaaf37-ff1b-4ae8-8621-94d25364017f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': '666dc141a00a4376893f7244fc10c61b'} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:51:02.174270 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a06e853a-45a6-41d6-94c8-b7b7f92bc298 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-687473329" status: 202 len: 0 microversion: 2.1 time: 0.160825 May 28 04:51:02.180396 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1994/4081] 10.222.0.58 () {58 vars in 1217 bytes} [Sat May 28 04:51:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-687473329 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:51:02.197265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fdbaaf37-ff1b-4ae8-8621-94d25364017f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:02.197773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fdbaaf37-ff1b-4ae8-8621-94d25364017f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:02.198640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fdbaaf37-ff1b-4ae8-8621-94d25364017f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:02.203626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fdbaaf37-ff1b-4ae8-8621-94d25364017f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:02.371979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d1823b3d-b430-4bdd-b7bb-150785f1c60e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:02.372784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d1823b3d-b430-4bdd-b7bb-150785f1c60e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:02.383557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d1823b3d-b430-4bdd-b7bb-150785f1c60e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:02.384460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d1823b3d-b430-4bdd-b7bb-150785f1c60e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:02.385004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d1823b3d-b430-4bdd-b7bb-150785f1c60e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:02.385687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d1823b3d-b430-4bdd-b7bb-150785f1c60e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:02.389843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.multi_cell_list [None req-fdbaaf37-ff1b-4ae8-8621-94d25364017f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:51:02.492437 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fdbaaf37-ff1b-4ae8-8621-94d25364017f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 346 microversion: 2.1 time: 0.458944 May 28 04:51:02.492437 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2088/4082] 10.222.0.58 () {58 vars in 1153 bytes} [Sat May 28 04:51:02 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 346 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:02.496499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5931e24f-abbd-4bc3-b969-6d284ccb4dd2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:02.497292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5931e24f-abbd-4bc3-b969-6d284ccb4dd2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:02.510618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5931e24f-abbd-4bc3-b969-6d284ccb4dd2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:02.511665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5931e24f-abbd-4bc3-b969-6d284ccb4dd2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:02.512618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5931e24f-abbd-4bc3-b969-6d284ccb4dd2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:02.513228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5931e24f-abbd-4bc3-b969-6d284ccb4dd2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:02.690226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d1823b3d-b430-4bdd-b7bb-150785f1c60e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:02.699115 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d1823b3d-b430-4bdd-b7bb-150785f1c60e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1505 microversion: 2.1 time: 0.331028 May 28 04:51:02.711431 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1995/4083] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:02 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:02.717005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-944d4e52-8a6a-4953-a610-cd733cf88509 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:02.717946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-944d4e52-8a6a-4953-a610-cd733cf88509 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:02.734807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-944d4e52-8a6a-4953-a610-cd733cf88509 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:02.735593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-944d4e52-8a6a-4953-a610-cd733cf88509 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:02.736623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-944d4e52-8a6a-4953-a610-cd733cf88509 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:02.737373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-944d4e52-8a6a-4953-a610-cd733cf88509 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:03.352425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-944d4e52-8a6a-4953-a610-cd733cf88509 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:03.364837 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-944d4e52-8a6a-4953-a610-cd733cf88509 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1512 microversion: 2.1 time: 0.651951 May 28 04:51:03.370413 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1996/4084] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:02 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1512 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:03.379559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7691c80f-2e99-4e50-bc19-f92956c45e9b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:03.383874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7691c80f-2e99-4e50-bc19-f92956c45e9b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:03.400814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7691c80f-2e99-4e50-bc19-f92956c45e9b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:03.405128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7691c80f-2e99-4e50-bc19-f92956c45e9b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:03.407473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7691c80f-2e99-4e50-bc19-f92956c45e9b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:03.409581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7691c80f-2e99-4e50-bc19-f92956c45e9b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:03.436976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5931e24f-abbd-4bc3-b969-6d284ccb4dd2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:03.457020 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5931e24f-abbd-4bc3-b969-6d284ccb4dd2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 200 len: 1309 microversion: 2.1 time: 0.964193 May 28 04:51:03.458791 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2089/4085] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:02 2022] GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 1309 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:03.478424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ac85f624-ce75-4f37-821b-5436cd9226c8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:03.478424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ac85f624-ce75-4f37-821b-5436cd9226c8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:03.480168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac85f624-ce75-4f37-821b-5436cd9226c8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:03.481877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac85f624-ce75-4f37-821b-5436cd9226c8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:03.483355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac85f624-ce75-4f37-821b-5436cd9226c8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:03.484735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac85f624-ce75-4f37-821b-5436cd9226c8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:03.562607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7691c80f-2e99-4e50-bc19-f92956c45e9b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:03.571329 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7691c80f-2e99-4e50-bc19-f92956c45e9b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1325 microversion: 2.1 time: 0.198348 May 28 04:51:03.583365 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1997/4086] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:03 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1325 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:03.588909 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8629089a-5d97-4aa1-8b69-2858575be4ca tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:03.595384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8629089a-5d97-4aa1-8b69-2858575be4ca tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:03.608665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8629089a-5d97-4aa1-8b69-2858575be4ca tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:03.609215 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8629089a-5d97-4aa1-8b69-2858575be4ca tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:03.610038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8629089a-5d97-4aa1-8b69-2858575be4ca tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:03.610484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8629089a-5d97-4aa1-8b69-2858575be4ca tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:03.644288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ac85f624-ce75-4f37-821b-5436cd9226c8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:03.655182 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ac85f624-ce75-4f37-821b-5436cd9226c8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1266 microversion: 2.1 time: 0.193407 May 28 04:51:03.658191 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2090/4087] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:03 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:03.666741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e9705b67-1217-48f1-922e-06d232351160 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:03.667673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e9705b67-1217-48f1-922e-06d232351160 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:03.669988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:03.689488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9705b67-1217-48f1-922e-06d232351160 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:03.690232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9705b67-1217-48f1-922e-06d232351160 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:03.693374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9705b67-1217-48f1-922e-06d232351160 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:03.700382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9705b67-1217-48f1-922e-06d232351160 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:03.759229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8629089a-5d97-4aa1-8b69-2858575be4ca tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:03.768815 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8629089a-5d97-4aa1-8b69-2858575be4ca tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1265 microversion: 2.1 time: 0.183888 May 28 04:51:03.773940 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1998/4088] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:03 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:03.785696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-86389d5e-f18c-49bc-964c-0fbe19df78ed req-74f543bd-a8e1-47b5-a569-f796803dca3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "711037c4-54ef-4071-a370-fd39338dccf8", "name": "network-vif-deleted", "tag": "95fcb5b1-c23a-4821-b27d-fffaf4a019eb"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:03.806681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:03.817313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-86389d5e-f18c-49bc-964c-0fbe19df78ed req-74f543bd-a8e1-47b5-a569-f796803dca3b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:03.823297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-86389d5e-f18c-49bc-964c-0fbe19df78ed req-74f543bd-a8e1-47b5-a569-f796803dca3b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:03.852175 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-86389d5e-f18c-49bc-964c-0fbe19df78ed req-74f543bd-a8e1-47b5-a569-f796803dca3b service nova] Creating event network-vif-deleted:95fcb5b1-c23a-4821-b27d-fffaf4a019eb for instance 711037c4-54ef-4071-a370-fd39338dccf8 on n-h1-843700-1 May 28 04:51:03.870272 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-86389d5e-f18c-49bc-964c-0fbe19df78ed req-74f543bd-a8e1-47b5-a569-f796803dca3b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091753 May 28 04:51:03.873272 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 1999/4089] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:03.909061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8c622145-8422-4436-8f3f-35180c169197 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:03.912947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8c622145-8422-4436-8f3f-35180c169197 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:03.961621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c622145-8422-4436-8f3f-35180c169197 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:03.963795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c622145-8422-4436-8f3f-35180c169197 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:03.971224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c622145-8422-4436-8f3f-35180c169197 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:03.974050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c622145-8422-4436-8f3f-35180c169197 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:04.220732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e9705b67-1217-48f1-922e-06d232351160 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:04.236966 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e9705b67-1217-48f1-922e-06d232351160 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77" status: 200 len: 1513 microversion: 2.1 time: 0.577405 May 28 04:51:04.260557 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2091/4090] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:03 2022] GET /compute/v2.1/servers/ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77 => generated 1513 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:04.276447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a0677fb5-1cae-41a6-997a-95574cbecdc6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:04.277396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a0677fb5-1cae-41a6-997a-95574cbecdc6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:04.294781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0677fb5-1cae-41a6-997a-95574cbecdc6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:04.297085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0677fb5-1cae-41a6-997a-95574cbecdc6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:04.298146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0677fb5-1cae-41a6-997a-95574cbecdc6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:04.298765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0677fb5-1cae-41a6-997a-95574cbecdc6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:04.959934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8c622145-8422-4436-8f3f-35180c169197 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:04.969542 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8c622145-8422-4436-8f3f-35180c169197 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1505 microversion: 2.1 time: 1.092317 May 28 04:51:04.982166 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2000/4091] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:03 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1505 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:04.995229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-882e4b51-adb5-4489-bf05-68d635f28c42 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:04.995572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-882e4b51-adb5-4489-bf05-68d635f28c42 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:05.052859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-882e4b51-adb5-4489-bf05-68d635f28c42 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:05.053732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-882e4b51-adb5-4489-bf05-68d635f28c42 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:05.063793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-882e4b51-adb5-4489-bf05-68d635f28c42 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:05.064558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-882e4b51-adb5-4489-bf05-68d635f28c42 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:05.654442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a0677fb5-1cae-41a6-997a-95574cbecdc6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:05.672093 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a0677fb5-1cae-41a6-997a-95574cbecdc6 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 200 len: 1511 microversion: 2.1 time: 1.411064 May 28 04:51:05.672680 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2092/4092] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:04 2022] GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 1511 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:05.688149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-c0ebdb35-2542-4f5e-9383-daa56105b2eb req-9a53dcbb-6465-4cac-a4c8-7855346d9641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a940c92-8dca-4cf5-90a9-d7d617ec9ece", "name": "network-vif-unplugged", "status": "completed", "tag": "d4489fa6-501f-4301-b268-2dded14654a8"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:05.704357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c0ebdb35-2542-4f5e-9383-daa56105b2eb req-9a53dcbb-6465-4cac-a4c8-7855346d9641 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:05.704357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c0ebdb35-2542-4f5e-9383-daa56105b2eb req-9a53dcbb-6465-4cac-a4c8-7855346d9641 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:05.731904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.compute.server_external_events [req-c0ebdb35-2542-4f5e-9383-daa56105b2eb req-9a53dcbb-6465-4cac-a4c8-7855346d9641 service nova] Unable to find a host for instance 0a940c92-8dca-4cf5-90a9-d7d617ec9ece. Dropping event network-vif-unplugged {{(pid=126044) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 28 04:51:05.733198 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-c0ebdb35-2542-4f5e-9383-daa56105b2eb req-9a53dcbb-6465-4cac-a4c8-7855346d9641 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.059527 May 28 04:51:05.737187 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2093/4093] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 61 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 28 04:51:05.750098 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6c642986-8101-474c-90bf-f3c3b89fcf88 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:05.751850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6c642986-8101-474c-90bf-f3c3b89fcf88 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:05.765430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c642986-8101-474c-90bf-f3c3b89fcf88 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:05.769073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c642986-8101-474c-90bf-f3c3b89fcf88 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:05.772609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c642986-8101-474c-90bf-f3c3b89fcf88 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:05.772609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c642986-8101-474c-90bf-f3c3b89fcf88 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:05.887341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-882e4b51-adb5-4489-bf05-68d635f28c42 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:05.912673 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-882e4b51-adb5-4489-bf05-68d635f28c42 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 200 len: 1309 microversion: 2.1 time: 0.926993 May 28 04:51:05.925841 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2001/4094] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:04 2022] GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 1309 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:05.937789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-640f8591-e9f3-4494-8590-b27ac50ace48 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:05.941321 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-640f8591-e9f3-4494-8590-b27ac50ace48 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:05.960607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-640f8591-e9f3-4494-8590-b27ac50ace48 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:05.963792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-640f8591-e9f3-4494-8590-b27ac50ace48 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:05.965672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-640f8591-e9f3-4494-8590-b27ac50ace48 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:05.966348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-640f8591-e9f3-4494-8590-b27ac50ace48 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:06.068116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6c642986-8101-474c-90bf-f3c3b89fcf88 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:06.078275 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6c642986-8101-474c-90bf-f3c3b89fcf88 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1393 microversion: 2.1 time: 0.339614 May 28 04:51:06.080130 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2094/4095] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:05 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1393 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:06.092143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f397ad70-c579-4c3f-9648-ad6d08d09cca tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Action: 'create', calling method: .version_select at 0x7f7700c170d0>, body: {"keypair": {"name": "tempest-keypair-1160742859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbTXR1Jj/8NKbB8gCPQv0bObW+qejjeicsJBsuDroXE7Fiy2tDjI4DAivtzWoWGAODJhYG2nkrFfP90cGGpMWdKc8h5AeTP/xoalD1N7uroxSnkGnw2lLq1stYB6y9URQ=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:06.123913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-f397ad70-c579-4c3f-9648-ad6d08d09cca tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Getting quotas for project d1e7c34036184ea8b80241695fdbf329. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:06.134053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-f397ad70-c579-4c3f-9648-ad6d08d09cca tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Getting quotas for user 025cb09c79a147b3a648c950edcd1dc3 and project d1e7c34036184ea8b80241695fdbf329. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:06.172432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-640f8591-e9f3-4494-8590-b27ac50ace48 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:06.184439 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-640f8591-e9f3-4494-8590-b27ac50ace48 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1272 microversion: 2.1 time: 0.264151 May 28 04:51:06.196166 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2002/4096] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:05 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1272 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:06.206445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-febdcf2a-0d31-4cc2-be08-1af849e74dda tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:06.209842 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-febdcf2a-0d31-4cc2-be08-1af849e74dda tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:06.224178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-febdcf2a-0d31-4cc2-be08-1af849e74dda tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:06.225977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-febdcf2a-0d31-4cc2-be08-1af849e74dda tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:06.227536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-febdcf2a-0d31-4cc2-be08-1af849e74dda tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:06.228615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-febdcf2a-0d31-4cc2-be08-1af849e74dda tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:06.263599 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f397ad70-c579-4c3f-9648-ad6d08d09cca tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.182245 May 28 04:51:06.264539 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2095/4097] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:51:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:06.269577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-620ac192-6613-4c33-8c5d-91e8b997c4b7 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:06.273759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-620ac192-6613-4c33-8c5d-91e8b997c4b7 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:06.280171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-620ac192-6613-4c33-8c5d-91e8b997c4b7 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Searching by: {'deleted': False, 'project_id': '666dc141a00a4376893f7244fc10c61b'} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:51:06.296845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-620ac192-6613-4c33-8c5d-91e8b997c4b7 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:06.297713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-620ac192-6613-4c33-8c5d-91e8b997c4b7 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:06.298795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-620ac192-6613-4c33-8c5d-91e8b997c4b7 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:06.302051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-620ac192-6613-4c33-8c5d-91e8b997c4b7 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:06.372257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.multi_cell_list [None req-620ac192-6613-4c33-8c5d-91e8b997c4b7 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:51:06.458715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-620ac192-6613-4c33-8c5d-91e8b997c4b7 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:06.482826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-620ac192-6613-4c33-8c5d-91e8b997c4b7 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:06.483405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-620ac192-6613-4c33-8c5d-91e8b997c4b7 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:06.703530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-febdcf2a-0d31-4cc2-be08-1af849e74dda tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:06.717125 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-febdcf2a-0d31-4cc2-be08-1af849e74dda tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1271 microversion: 2.1 time: 0.517813 May 28 04:51:06.717865 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2003/4098] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:06 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1271 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:06.743011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-390897a1-0f08-40bc-87f6-b3189f0e1936 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:06.749286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-390897a1-0f08-40bc-87f6-b3189f0e1936 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:06.762966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-390897a1-0f08-40bc-87f6-b3189f0e1936 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:06.766278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-390897a1-0f08-40bc-87f6-b3189f0e1936 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:06.771741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-390897a1-0f08-40bc-87f6-b3189f0e1936 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:06.773585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-390897a1-0f08-40bc-87f6-b3189f0e1936 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:07.141563 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-620ac192-6613-4c33-8c5d-91e8b997c4b7 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.872015 May 28 04:51:07.141563 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2096/4099] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:51:06 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:07.150317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-390897a1-0f08-40bc-87f6-b3189f0e1936 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:07.162743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4cab10a0-cdab-4b26-a058-b7da8a822f22 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:07.164415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4cab10a0-cdab-4b26-a058-b7da8a822f22 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:07.165752 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-390897a1-0f08-40bc-87f6-b3189f0e1936 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 200 len: 1448 microversion: 2.1 time: 0.425941 May 28 04:51:07.168049 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2004/4100] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:06 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 1448 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:07.174571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4cab10a0-cdab-4b26-a058-b7da8a822f22 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:07.175344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4cab10a0-cdab-4b26-a058-b7da8a822f22 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:07.176354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4cab10a0-cdab-4b26-a058-b7da8a822f22 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:07.177119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4cab10a0-cdab-4b26-a058-b7da8a822f22 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:07.181038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-afb68db6-0e0a-453a-82ae-fe7e58c5bdd3 req-bc55edf2-eb3d-471b-974c-f57cebee7a54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c89850-7792-485a-a6ba-79c3b19b5405", "tag": "281843f9-caf9-43ff-9ade-dc1bd3a73fd1"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:07.209525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-afb68db6-0e0a-453a-82ae-fe7e58c5bdd3 req-bc55edf2-eb3d-471b-974c-f57cebee7a54 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:07.209753 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:07.212692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-afb68db6-0e0a-453a-82ae-fe7e58c5bdd3 req-bc55edf2-eb3d-471b-974c-f57cebee7a54 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:07.227416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:07.239449 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-afb68db6-0e0a-453a-82ae-fe7e58c5bdd3 req-bc55edf2-eb3d-471b-974c-f57cebee7a54 service nova] Creating event network-changed:281843f9-caf9-43ff-9ade-dc1bd3a73fd1 for instance 99c89850-7792-485a-a6ba-79c3b19b5405 on n-h1-843700-1 May 28 04:51:07.247317 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-afb68db6-0e0a-453a-82ae-fe7e58c5bdd3 req-bc55edf2-eb3d-471b-974c-f57cebee7a54 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076563 May 28 04:51:07.249016 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2005/4101] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:07.260262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f79286e6-4b88-4d7c-a3c6-98ce275a201f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:07.265748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f79286e6-4b88-4d7c-a3c6-98ce275a201f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:07.270501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f79286e6-4b88-4d7c-a3c6-98ce275a201f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:07.271240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f79286e6-4b88-4d7c-a3c6-98ce275a201f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:07.272268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f79286e6-4b88-4d7c-a3c6-98ce275a201f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:07.272882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f79286e6-4b88-4d7c-a3c6-98ce275a201f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:07.617271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4cab10a0-cdab-4b26-a058-b7da8a822f22 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:07.636011 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4cab10a0-cdab-4b26-a058-b7da8a822f22 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 200 len: 1309 microversion: 2.1 time: 0.477686 May 28 04:51:07.636979 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2097/4102] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:07 2022] GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 1309 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:07.642453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f040edf7-74c0-4c21-8017-4aff4a31b324 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:07.647378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f040edf7-74c0-4c21-8017-4aff4a31b324 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:07.649533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f040edf7-74c0-4c21-8017-4aff4a31b324 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '666dc141a00a4376893f7244fc10c61b'} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:51:07.753553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f79286e6-4b88-4d7c-a3c6-98ce275a201f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:07.778539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f040edf7-74c0-4c21-8017-4aff4a31b324 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:07.779341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f040edf7-74c0-4c21-8017-4aff4a31b324 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:07.780377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f040edf7-74c0-4c21-8017-4aff4a31b324 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:07.781042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f040edf7-74c0-4c21-8017-4aff4a31b324 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:07.784067 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f79286e6-4b88-4d7c-a3c6-98ce275a201f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1393 microversion: 2.1 time: 0.532679 May 28 04:51:07.785764 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2006/4103] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:07 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1393 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:07.793012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7c304396-c900-47bc-8b80-3cd56285255a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:07.793867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7c304396-c900-47bc-8b80-3cd56285255a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:07.803957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c304396-c900-47bc-8b80-3cd56285255a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:07.804930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c304396-c900-47bc-8b80-3cd56285255a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:07.805946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c304396-c900-47bc-8b80-3cd56285255a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:07.808231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c304396-c900-47bc-8b80-3cd56285255a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:07.814591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.multi_cell_list [None req-f040edf7-74c0-4c21-8017-4aff4a31b324 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:51:07.869883 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f040edf7-74c0-4c21-8017-4aff4a31b324 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.231568 May 28 04:51:07.878533 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2098/4104] 10.222.0.58 () {58 vars in 1149 bytes} [Sat May 28 04:51:07 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:07.878533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-48ba1dc4-8cf5-40f4-bd31-267efbd5999a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:07.880011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-48ba1dc4-8cf5-40f4-bd31-267efbd5999a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:07.887620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48ba1dc4-8cf5-40f4-bd31-267efbd5999a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:07.888203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48ba1dc4-8cf5-40f4-bd31-267efbd5999a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:07.889073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48ba1dc4-8cf5-40f4-bd31-267efbd5999a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:07.889966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48ba1dc4-8cf5-40f4-bd31-267efbd5999a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:08.292998 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7c304396-c900-47bc-8b80-3cd56285255a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:08.300937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-48ba1dc4-8cf5-40f4-bd31-267efbd5999a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:08.310494 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7c304396-c900-47bc-8b80-3cd56285255a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.520979 May 28 04:51:08.311574 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-48ba1dc4-8cf5-40f4-bd31-267efbd5999a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1314 microversion: 2.1 time: 0.438926 May 28 04:51:08.312389 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2099/4105] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:07 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:08.323949 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2007/4106] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:07 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:08.323949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7635b7e4-47a0-4d62-9e9a-d038763156aa tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:08.334964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7635b7e4-47a0-4d62-9e9a-d038763156aa tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:08.335924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7635b7e4-47a0-4d62-9e9a-d038763156aa tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '666dc141a00a4376893f7244fc10c61b'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:51:08.338223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0c0166d8-64b5-4cd4-88fc-ec06ec7cfb2e tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:08.341782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0c0166d8-64b5-4cd4-88fc-ec06ec7cfb2e tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:08.352120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7635b7e4-47a0-4d62-9e9a-d038763156aa tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:08.353201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7635b7e4-47a0-4d62-9e9a-d038763156aa tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:08.354392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c0166d8-64b5-4cd4-88fc-ec06ec7cfb2e tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:08.356007 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7635b7e4-47a0-4d62-9e9a-d038763156aa tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:08.362713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c0166d8-64b5-4cd4-88fc-ec06ec7cfb2e tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:08.362713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c0166d8-64b5-4cd4-88fc-ec06ec7cfb2e tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:08.362713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c0166d8-64b5-4cd4-88fc-ec06ec7cfb2e tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:08.363265 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7635b7e4-47a0-4d62-9e9a-d038763156aa tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:08.518501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-7635b7e4-47a0-4d62-9e9a-d038763156aa tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:51:08.595883 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7635b7e4-47a0-4d62-9e9a-d038763156aa tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.279794 May 28 04:51:08.596824 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2008/4107] 10.222.0.58 () {58 vars in 1211 bytes} [Sat May 28 04:51:08 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:08.602733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-9c9fbc86-5ba9-4ea2-9a9b-ed4bd06ee9e5 req-32bb2577-5a31-4090-a262-9183aa83128d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a73d352-1b6c-4221-872a-aee269b8c1ae", "name": "network-vif-plugged", "status": "completed", "tag": "de690259-a435-405f-856e-39cd4d32a239"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:08.613134 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9c9fbc86-5ba9-4ea2-9a9b-ed4bd06ee9e5 req-32bb2577-5a31-4090-a262-9183aa83128d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:08.614157 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9c9fbc86-5ba9-4ea2-9a9b-ed4bd06ee9e5 req-32bb2577-5a31-4090-a262-9183aa83128d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:08.628101 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-9c9fbc86-5ba9-4ea2-9a9b-ed4bd06ee9e5 req-32bb2577-5a31-4090-a262-9183aa83128d service nova] Creating event network-vif-plugged:de690259-a435-405f-856e-39cd4d32a239 for instance 4a73d352-1b6c-4221-872a-aee269b8c1ae on n-h2-843700-1 May 28 04:51:08.633981 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-9c9fbc86-5ba9-4ea2-9a9b-ed4bd06ee9e5 req-32bb2577-5a31-4090-a262-9183aa83128d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035903 May 28 04:51:08.634943 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2009/4108] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:08.640470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-885ea89a-f6aa-4b8f-a8c5-85cab18f45c9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:08.641193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-885ea89a-f6aa-4b8f-a8c5-85cab18f45c9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:08.659993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-885ea89a-f6aa-4b8f-a8c5-85cab18f45c9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:08.660988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-885ea89a-f6aa-4b8f-a8c5-85cab18f45c9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:08.661770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-885ea89a-f6aa-4b8f-a8c5-85cab18f45c9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:08.662209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-885ea89a-f6aa-4b8f-a8c5-85cab18f45c9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:09.156078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0c0166d8-64b5-4cd4-88fc-ec06ec7cfb2e tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:09.168638 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0c0166d8-64b5-4cd4-88fc-ec06ec7cfb2e tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1313 microversion: 2.1 time: 0.843182 May 28 04:51:09.180221 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2100/4109] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:08 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1313 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:09.186757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5fae0a83-6f0d-46ec-8f6b-5f6b8ffa971f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:09.190056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-885ea89a-f6aa-4b8f-a8c5-85cab18f45c9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:09.194309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5fae0a83-6f0d-46ec-8f6b-5f6b8ffa971f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:09.195381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5fae0a83-6f0d-46ec-8f6b-5f6b8ffa971f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '666dc141a00a4376893f7244fc10c61b'} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:51:09.199030 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-885ea89a-f6aa-4b8f-a8c5-85cab18f45c9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.562793 May 28 04:51:09.207651 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5fae0a83-6f0d-46ec-8f6b-5f6b8ffa971f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:09.208538 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2010/4110] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:08 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:09.208893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5fae0a83-6f0d-46ec-8f6b-5f6b8ffa971f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:09.211437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5fae0a83-6f0d-46ec-8f6b-5f6b8ffa971f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:09.212259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5fae0a83-6f0d-46ec-8f6b-5f6b8ffa971f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:09.213596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f52f4391-b3b5-4ac5-ba50-fed2d228dbf6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:09.214324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f52f4391-b3b5-4ac5-ba50-fed2d228dbf6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:09.235006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f52f4391-b3b5-4ac5-ba50-fed2d228dbf6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:09.235600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f52f4391-b3b5-4ac5-ba50-fed2d228dbf6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:09.236504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f52f4391-b3b5-4ac5-ba50-fed2d228dbf6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:09.237049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f52f4391-b3b5-4ac5-ba50-fed2d228dbf6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:09.353022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.multi_cell_list [None req-5fae0a83-6f0d-46ec-8f6b-5f6b8ffa971f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:51:09.446980 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5fae0a83-6f0d-46ec-8f6b-5f6b8ffa971f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.264235 May 28 04:51:09.448669 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2101/4111] 10.222.0.58 () {58 vars in 1195 bytes} [Sat May 28 04:51:09 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:09.456257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eda59041-b317-42d6-9214-00ead01e0614 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:09.459044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-eda59041-b317-42d6-9214-00ead01e0614 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:09.470586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eda59041-b317-42d6-9214-00ead01e0614 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:09.470586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eda59041-b317-42d6-9214-00ead01e0614 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:09.471556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eda59041-b317-42d6-9214-00ead01e0614 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:09.472175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eda59041-b317-42d6-9214-00ead01e0614 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:09.473172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f52f4391-b3b5-4ac5-ba50-fed2d228dbf6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:09.482264 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f52f4391-b3b5-4ac5-ba50-fed2d228dbf6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 200 len: 1309 microversion: 2.1 time: 0.272586 May 28 04:51:09.488086 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2011/4112] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:09 2022] GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 1309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:09.493980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9762918d-3dc1-4986-bd9b-4a9505fd5161 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:09.498364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9762918d-3dc1-4986-bd9b-4a9505fd5161 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:09.513551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9762918d-3dc1-4986-bd9b-4a9505fd5161 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:09.518539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9762918d-3dc1-4986-bd9b-4a9505fd5161 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:09.520502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9762918d-3dc1-4986-bd9b-4a9505fd5161 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:09.521178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9762918d-3dc1-4986-bd9b-4a9505fd5161 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:09.981817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9762918d-3dc1-4986-bd9b-4a9505fd5161 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:10.001030 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9762918d-3dc1-4986-bd9b-4a9505fd5161 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.510804 May 28 04:51:10.004124 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2012/4113] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:09 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:10.016228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-eda59041-b317-42d6-9214-00ead01e0614 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:10.046897 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-eda59041-b317-42d6-9214-00ead01e0614 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1393 microversion: 2.1 time: 0.596503 May 28 04:51:10.050578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-63042e6c-6b0c-400d-8da6-1517fef2a184 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:10.051801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-63042e6c-6b0c-400d-8da6-1517fef2a184 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:10.073577 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2102/4114] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:09 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1393 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:10.084481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63042e6c-6b0c-400d-8da6-1517fef2a184 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:10.084789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e73711aa-3499-4c9c-8e91-13400e7fd4ac tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:10.087521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63042e6c-6b0c-400d-8da6-1517fef2a184 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:10.088528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e73711aa-3499-4c9c-8e91-13400e7fd4ac tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:10.088793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63042e6c-6b0c-400d-8da6-1517fef2a184 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:10.089340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e73711aa-3499-4c9c-8e91-13400e7fd4ac tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Searching by: {'name': '1221901744', 'deleted': False, 'project_id': '666dc141a00a4376893f7244fc10c61b'} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:51:10.089671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63042e6c-6b0c-400d-8da6-1517fef2a184 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:10.095544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e73711aa-3499-4c9c-8e91-13400e7fd4ac tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:10.098047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e73711aa-3499-4c9c-8e91-13400e7fd4ac tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:10.098921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e73711aa-3499-4c9c-8e91-13400e7fd4ac tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:10.099405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e73711aa-3499-4c9c-8e91-13400e7fd4ac tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:10.212867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.multi_cell_list [None req-e73711aa-3499-4c9c-8e91-13400e7fd4ac tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:51:10.291365 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e73711aa-3499-4c9c-8e91-13400e7fd4ac tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers?name=1221901744" status: 200 len: 346 microversion: 2.1 time: 0.215829 May 28 04:51:10.298562 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2103/4115] 10.222.0.58 () {58 vars in 1155 bytes} [Sat May 28 04:51:10 2022] GET /compute/v2.1/servers?name=1221901744 => generated 346 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:10.306139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-abdc0a5e-d68e-4a0b-b3c4-a9abdf637370 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:10.306766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-abdc0a5e-d68e-4a0b-b3c4-a9abdf637370 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:10.313081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abdc0a5e-d68e-4a0b-b3c4-a9abdf637370 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:10.313719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abdc0a5e-d68e-4a0b-b3c4-a9abdf637370 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:10.314473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abdc0a5e-d68e-4a0b-b3c4-a9abdf637370 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:10.315143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abdc0a5e-d68e-4a0b-b3c4-a9abdf637370 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:10.713764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-63042e6c-6b0c-400d-8da6-1517fef2a184 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:10.724817 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-63042e6c-6b0c-400d-8da6-1517fef2a184 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1314 microversion: 2.1 time: 0.719175 May 28 04:51:10.726022 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2013/4116] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:10 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1314 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:10.726622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-abdc0a5e-d68e-4a0b-b3c4-a9abdf637370 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:10.733980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ab233ca4-2f13-43f0-abbf-e1634a1809ed tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:10.751844 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-abdc0a5e-d68e-4a0b-b3c4-a9abdf637370 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.441274 May 28 04:51:10.751844 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2104/4117] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:10 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:10.752241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ab233ca4-2f13-43f0-abbf-e1634a1809ed tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:10.752339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8956de1b-a30f-481e-a011-23d713b765d1 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:10.752339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8956de1b-a30f-481e-a011-23d713b765d1 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:10.752339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8956de1b-a30f-481e-a011-23d713b765d1 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '666dc141a00a4376893f7244fc10c61b'} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:51:10.758644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ab233ca4-2f13-43f0-abbf-e1634a1809ed tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:10.759316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ab233ca4-2f13-43f0-abbf-e1634a1809ed tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:10.759852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8956de1b-a30f-481e-a011-23d713b765d1 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:10.760353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8956de1b-a30f-481e-a011-23d713b765d1 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:10.760799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ab233ca4-2f13-43f0-abbf-e1634a1809ed tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:10.761202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8956de1b-a30f-481e-a011-23d713b765d1 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:10.761565 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ab233ca4-2f13-43f0-abbf-e1634a1809ed tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:10.761690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8956de1b-a30f-481e-a011-23d713b765d1 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:10.897779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.multi_cell_list [None req-8956de1b-a30f-481e-a011-23d713b765d1 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:51:10.977328 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8956de1b-a30f-481e-a011-23d713b765d1 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.240926 May 28 04:51:10.977841 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2105/4118] 10.222.0.58 () {58 vars in 1153 bytes} [Sat May 28 04:51:10 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:10.982469 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-66604598-c075-4932-89cf-0b6f8db1a1da tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:10.983278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-66604598-c075-4932-89cf-0b6f8db1a1da tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:10.989458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66604598-c075-4932-89cf-0b6f8db1a1da tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:10.989904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66604598-c075-4932-89cf-0b6f8db1a1da tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:10.990669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66604598-c075-4932-89cf-0b6f8db1a1da tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:10.991428 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66604598-c075-4932-89cf-0b6f8db1a1da tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:11.134342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ab233ca4-2f13-43f0-abbf-e1634a1809ed tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:11.143711 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ab233ca4-2f13-43f0-abbf-e1634a1809ed tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1334 microversion: 2.1 time: 0.415786 May 28 04:51:11.144387 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2014/4119] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:10 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1334 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:11.150486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9cc1e224-1485-4502-927a-4773aa9ef816 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-192910709", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c0754133-921a-4aba-8b6d-6a18d70e57ec"}], "security_groups": [{"name": "tempest-securitygroup--1866099695"}], "key_name": "tempest-keypair-1160742859", "user_data": "}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:11.431659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-66604598-c075-4932-89cf-0b6f8db1a1da tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:11.439687 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-66604598-c075-4932-89cf-0b6f8db1a1da tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 200 len: 1489 microversion: 2.1 time: 0.460656 May 28 04:51:11.449222 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2106/4120] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:10 2022] GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 1489 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:11.449603 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-9cc1e224-1485-4502-927a-4773aa9ef816 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] validate_networks() for [('c0754133-921a-4aba-8b6d-6a18d70e57ec', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:51:11.449722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9e930f46-7326-42d0-ac20-3c1d7f5e5c95 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:11.455450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e930f46-7326-42d0-ac20-3c1d7f5e5c95 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:11.456119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e930f46-7326-42d0-ac20-3c1d7f5e5c95 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:11.480972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9e930f46-7326-42d0-ac20-3c1d7f5e5c95 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Going to try to stop instance {{(pid=126044) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 04:51:11.673230 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9e930f46-7326-42d0-ac20-3c1d7f5e5c95 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action" status: 202 len: 0 microversion: 2.1 time: 0.230388 May 28 04:51:11.673873 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2107/4121] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:51:11 2022] POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:51:11.680817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-1ba579a1-3721-495a-9b15-4700f96506e3 req-18799fd7-9e03-4df3-aef6-16378c3c08a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2acbf858-4bd9-4004-ba98-569c9fe52f55", "tag": "44741e68-238d-4ad5-be11-243269dd0ecd"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:11.692124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-1ba579a1-3721-495a-9b15-4700f96506e3 req-18799fd7-9e03-4df3-aef6-16378c3c08a4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:11.692584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-1ba579a1-3721-495a-9b15-4700f96506e3 req-18799fd7-9e03-4df3-aef6-16378c3c08a4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:11.704824 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-1ba579a1-3721-495a-9b15-4700f96506e3 req-18799fd7-9e03-4df3-aef6-16378c3c08a4 service nova] Creating event network-changed:44741e68-238d-4ad5-be11-243269dd0ecd for instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 on n-h1-843700-1 May 28 04:51:11.710361 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-1ba579a1-3721-495a-9b15-4700f96506e3 req-18799fd7-9e03-4df3-aef6-16378c3c08a4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034741 May 28 04:51:11.711055 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2108/4122] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:11.716574 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1ed46446-5218-4fe6-b36a-3a7db2e533b9 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:11.720414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1ed46446-5218-4fe6-b36a-3a7db2e533b9 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:11.721389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1ed46446-5218-4fe6-b36a-3a7db2e533b9 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-122190174', 'deleted': False, 'project_id': '666dc141a00a4376893f7244fc10c61b'} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:51:11.727742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ed46446-5218-4fe6-b36a-3a7db2e533b9 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:11.728893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ed46446-5218-4fe6-b36a-3a7db2e533b9 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:11.729782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ed46446-5218-4fe6-b36a-3a7db2e533b9 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:11.730146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ed46446-5218-4fe6-b36a-3a7db2e533b9 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:11.828824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.multi_cell_list [None req-1ed46446-5218-4fe6-b36a-3a7db2e533b9 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:51:11.906152 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1ed46446-5218-4fe6-b36a-3a7db2e533b9 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-122190174" status: 200 len: 346 microversion: 2.1 time: 0.193566 May 28 04:51:11.906932 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2109/4123] 10.222.0.58 () {58 vars in 1227 bytes} [Sat May 28 04:51:11 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-122190174 => generated 346 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:11.918828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-18fc3504-2ff1-472b-8f29-29f5d58f34cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:11.919815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-18fc3504-2ff1-472b-8f29-29f5d58f34cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:11.930726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-18fc3504-2ff1-472b-8f29-29f5d58f34cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:11.931453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-18fc3504-2ff1-472b-8f29-29f5d58f34cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:11.932437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-18fc3504-2ff1-472b-8f29-29f5d58f34cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:11.932888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-18fc3504-2ff1-472b-8f29-29f5d58f34cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:12.000850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=8 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:12.326823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-18fc3504-2ff1-472b-8f29-29f5d58f34cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:12.336166 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-18fc3504-2ff1-472b-8f29-29f5d58f34cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1393 microversion: 2.1 time: 0.427682 May 28 04:51:12.337249 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2110/4124] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:11 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1393 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:12.343428 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-65681d1d-24a7-4189-ab2b-4b74ddaf0eb0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:12.344278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-65681d1d-24a7-4189-ab2b-4b74ddaf0eb0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:12.351740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-65681d1d-24a7-4189-ab2b-4b74ddaf0eb0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:12.352338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-65681d1d-24a7-4189-ab2b-4b74ddaf0eb0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:12.353199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-65681d1d-24a7-4189-ab2b-4b74ddaf0eb0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:12.353872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-65681d1d-24a7-4189-ab2b-4b74ddaf0eb0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:12.505445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-9cc1e224-1485-4502-927a-4773aa9ef816 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:51:12.506227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-9cc1e224-1485-4502-927a-4773aa9ef816 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:51:12.506971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-9cc1e224-1485-4502-927a-4773aa9ef816 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:51:12.507804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-9cc1e224-1485-4502-927a-4773aa9ef816 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:51:12.508584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-9cc1e224-1485-4502-927a-4773aa9ef816 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:51:12.520855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9cc1e224-1485-4502-927a-4773aa9ef816 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:12.521297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9cc1e224-1485-4502-927a-4773aa9ef816 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:12.522096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9cc1e224-1485-4502-927a-4773aa9ef816 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:12.522534 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9cc1e224-1485-4502-927a-4773aa9ef816 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:12.549094 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-9cc1e224-1485-4502-927a-4773aa9ef816 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Getting quotas for project d1e7c34036184ea8b80241695fdbf329. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:12.557427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-9cc1e224-1485-4502-927a-4773aa9ef816 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Getting quotas for user 025cb09c79a147b3a648c950edcd1dc3 and project d1e7c34036184ea8b80241695fdbf329. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:12.581691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9cc1e224-1485-4502-927a-4773aa9ef816 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:51:12.584112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9cc1e224-1485-4502-927a-4773aa9ef816 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:51:12.615075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-65681d1d-24a7-4189-ab2b-4b74ddaf0eb0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:12.623147 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-65681d1d-24a7-4189-ab2b-4b74ddaf0eb0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d" status: 200 len: 1490 microversion: 2.1 time: 0.284546 May 28 04:51:12.623917 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2111/4125] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:12 2022] GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d => generated 1490 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:12.639726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-39d7e7de-2fb2-405e-b2dc-b81d7804a589 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:12.640792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-39d7e7de-2fb2-405e-b2dc-b81d7804a589 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:12.647588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39d7e7de-2fb2-405e-b2dc-b81d7804a589 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:12.648289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39d7e7de-2fb2-405e-b2dc-b81d7804a589 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:12.649206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39d7e7de-2fb2-405e-b2dc-b81d7804a589 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:12.650111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39d7e7de-2fb2-405e-b2dc-b81d7804a589 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:12.655175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:12.835019 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9cc1e224-1485-4502-927a-4773aa9ef816 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.689214 May 28 04:51:12.838714 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2015/4126] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:51:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:51:12.852009 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3e737d23-4ec4-45a1-b63c-fef71b573806 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:12.853130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3e737d23-4ec4-45a1-b63c-fef71b573806 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:12.864787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e737d23-4ec4-45a1-b63c-fef71b573806 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:12.865494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e737d23-4ec4-45a1-b63c-fef71b573806 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:12.871351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e737d23-4ec4-45a1-b63c-fef71b573806 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:12.871351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e737d23-4ec4-45a1-b63c-fef71b573806 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:12.873701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-39d7e7de-2fb2-405e-b2dc-b81d7804a589 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:12.883728 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-39d7e7de-2fb2-405e-b2dc-b81d7804a589 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1680 microversion: 2.1 time: 0.247586 May 28 04:51:12.886008 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2112/4127] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:12 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1680 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:12.892110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-98487071-9728-4180-9dd6-416168775b5c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:12.892597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-98487071-9728-4180-9dd6-416168775b5c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:12.904104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-98487071-9728-4180-9dd6-416168775b5c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:12.904819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-98487071-9728-4180-9dd6-416168775b5c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:12.911495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-98487071-9728-4180-9dd6-416168775b5c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:12.911495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-98487071-9728-4180-9dd6-416168775b5c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:12.944210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-98487071-9728-4180-9dd6-416168775b5c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:51:13.383454 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-98487071-9728-4180-9dd6-416168775b5c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "DELETE /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 204 len: 0 microversion: 2.1 time: 0.495594 May 28 04:51:13.388342 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2113/4128] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:51:12 2022] DELETE /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:51:13.399087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-bbbe8f65-0c30-4e01-9a76-1f370d115863 req-be34cd57-ff48-44d8-a98a-554f38bff1e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c89850-7792-485a-a6ba-79c3b19b5405", "name": "network-vif-plugged", "status": "completed", "tag": "281843f9-caf9-43ff-9ade-dc1bd3a73fd1"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:13.432464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-bbbe8f65-0c30-4e01-9a76-1f370d115863 req-be34cd57-ff48-44d8-a98a-554f38bff1e1 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:13.444204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-bbbe8f65-0c30-4e01-9a76-1f370d115863 req-be34cd57-ff48-44d8-a98a-554f38bff1e1 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:13.467323 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-bbbe8f65-0c30-4e01-9a76-1f370d115863 req-be34cd57-ff48-44d8-a98a-554f38bff1e1 service nova] Creating event network-vif-plugged:281843f9-caf9-43ff-9ade-dc1bd3a73fd1 for instance 99c89850-7792-485a-a6ba-79c3b19b5405 on n-h1-843700-1 May 28 04:51:13.484979 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-bbbe8f65-0c30-4e01-9a76-1f370d115863 req-be34cd57-ff48-44d8-a98a-554f38bff1e1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094829 May 28 04:51:13.489112 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2114/4129] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:13.494736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7f10e572-daff-4bb6-9e94-0dc6623c860f tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:13.505785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7f10e572-daff-4bb6-9e94-0dc6623c860f tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:13.515420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f10e572-daff-4bb6-9e94-0dc6623c860f tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:13.521134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f10e572-daff-4bb6-9e94-0dc6623c860f tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:13.522465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f10e572-daff-4bb6-9e94-0dc6623c860f tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:13.523183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f10e572-daff-4bb6-9e94-0dc6623c860f tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:13.673412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3e737d23-4ec4-45a1-b63c-fef71b573806 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:13.681483 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3e737d23-4ec4-45a1-b63c-fef71b573806 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1314 microversion: 2.1 time: 0.841201 May 28 04:51:13.682092 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2016/4130] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:12 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1314 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:13.700038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e96744d9-e4eb-4604-988a-dfd4aa82642e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:13.700931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e96744d9-e4eb-4604-988a-dfd4aa82642e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:13.707778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e96744d9-e4eb-4604-988a-dfd4aa82642e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:13.708452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e96744d9-e4eb-4604-988a-dfd4aa82642e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:13.709401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e96744d9-e4eb-4604-988a-dfd4aa82642e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:13.710035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e96744d9-e4eb-4604-988a-dfd4aa82642e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:13.934691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e96744d9-e4eb-4604-988a-dfd4aa82642e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:13.947503 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e96744d9-e4eb-4604-988a-dfd4aa82642e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 200 len: 1489 microversion: 2.1 time: 0.251166 May 28 04:51:13.950410 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2017/4131] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:13 2022] GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 1489 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:13.965868 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9b4336af-2386-4bd7-916e-204a0cacd4fe tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:13.966500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9b4336af-2386-4bd7-916e-204a0cacd4fe tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:13.979696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b4336af-2386-4bd7-916e-204a0cacd4fe tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:13.982716 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b4336af-2386-4bd7-916e-204a0cacd4fe tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:13.983575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b4336af-2386-4bd7-916e-204a0cacd4fe tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:13.984022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b4336af-2386-4bd7-916e-204a0cacd4fe tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:14.090047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7f10e572-daff-4bb6-9e94-0dc6623c860f tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:14.097642 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7f10e572-daff-4bb6-9e94-0dc6623c860f tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1334 microversion: 2.1 time: 0.606980 May 28 04:51:14.107201 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2115/4132] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:13 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1334 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:14.117891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0b5ea526-a380-4329-984d-46a9a04983e4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:14.118517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0b5ea526-a380-4329-984d-46a9a04983e4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:14.127710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9b4336af-2386-4bd7-916e-204a0cacd4fe tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:14.139392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b5ea526-a380-4329-984d-46a9a04983e4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:14.139857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b5ea526-a380-4329-984d-46a9a04983e4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:14.140659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b5ea526-a380-4329-984d-46a9a04983e4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:14.141112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b5ea526-a380-4329-984d-46a9a04983e4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:14.141235 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9b4336af-2386-4bd7-916e-204a0cacd4fe tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 200 len: 1245 microversion: 2.1 time: 0.189700 May 28 04:51:14.142108 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2018/4133] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:13 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 1245 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:14.154157 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-faeb9da4-8b70-4729-972f-e83d64ae8465 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:14.155055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-faeb9da4-8b70-4729-972f-e83d64ae8465 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:14.179528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-faeb9da4-8b70-4729-972f-e83d64ae8465 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:14.188051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-faeb9da4-8b70-4729-972f-e83d64ae8465 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:14.188927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-faeb9da4-8b70-4729-972f-e83d64ae8465 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:14.189377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-faeb9da4-8b70-4729-972f-e83d64ae8465 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:14.598142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0b5ea526-a380-4329-984d-46a9a04983e4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:14.606701 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0b5ea526-a380-4329-984d-46a9a04983e4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1393 microversion: 2.1 time: 0.507345 May 28 04:51:14.607827 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2116/4134] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:14 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1393 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:14.623697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-faeb9da4-8b70-4729-972f-e83d64ae8465 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:14.623936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-26ca9db9-dbf3-448f-90d5-e054741de87d req-783421a0-43c9-4d0d-be77-bdbdb1278f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4", "tag": "f90a2baf-c4c2-4dc5-ade8-ffd48f97158c"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:14.635776 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-faeb9da4-8b70-4729-972f-e83d64ae8465 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 200 len: 1517 microversion: 2.1 time: 0.491929 May 28 04:51:14.639255 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2019/4135] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:14 2022] GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 1517 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:14.644119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d2b0f79f-d9c3-4252-88e9-eb3d248660a6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:14.645373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d2b0f79f-d9c3-4252-88e9-eb3d248660a6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:14.650899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-26ca9db9-dbf3-448f-90d5-e054741de87d req-783421a0-43c9-4d0d-be77-bdbdb1278f0f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:14.651572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-26ca9db9-dbf3-448f-90d5-e054741de87d req-783421a0-43c9-4d0d-be77-bdbdb1278f0f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:14.653015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d2b0f79f-d9c3-4252-88e9-eb3d248660a6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:14.653649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d2b0f79f-d9c3-4252-88e9-eb3d248660a6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:14.654947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d2b0f79f-d9c3-4252-88e9-eb3d248660a6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:14.655704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d2b0f79f-d9c3-4252-88e9-eb3d248660a6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:14.674294 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-26ca9db9-dbf3-448f-90d5-e054741de87d req-783421a0-43c9-4d0d-be77-bdbdb1278f0f service nova] Creating event network-changed:f90a2baf-c4c2-4dc5-ade8-ffd48f97158c for instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 on n-h1-843700-1 May 28 04:51:14.686460 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-26ca9db9-dbf3-448f-90d5-e054741de87d req-783421a0-43c9-4d0d-be77-bdbdb1278f0f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077050 May 28 04:51:14.687119 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2117/4136] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:14.702341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-86a415eb-85ac-4d62-bbb7-018abd8f51c8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:14.702971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-86a415eb-85ac-4d62-bbb7-018abd8f51c8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:14.711451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-86a415eb-85ac-4d62-bbb7-018abd8f51c8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:14.711914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-86a415eb-85ac-4d62-bbb7-018abd8f51c8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:14.713195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-86a415eb-85ac-4d62-bbb7-018abd8f51c8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:14.713857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-86a415eb-85ac-4d62-bbb7-018abd8f51c8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:14.751250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-86a415eb-85ac-4d62-bbb7-018abd8f51c8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:51:14.972454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d2b0f79f-d9c3-4252-88e9-eb3d248660a6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:14.980929 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d2b0f79f-d9c3-4252-88e9-eb3d248660a6 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1680 microversion: 2.1 time: 0.343035 May 28 04:51:14.981843 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2020/4137] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:14 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1680 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:14.986797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-61cf8268-67e5-4f52-a6cf-fead2d0a4f4c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:14.987637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-61cf8268-67e5-4f52-a6cf-fead2d0a4f4c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:14.994699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-61cf8268-67e5-4f52-a6cf-fead2d0a4f4c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:14.995098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-61cf8268-67e5-4f52-a6cf-fead2d0a4f4c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:14.995924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-61cf8268-67e5-4f52-a6cf-fead2d0a4f4c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:15.007171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-61cf8268-67e5-4f52-a6cf-fead2d0a4f4c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:15.149411 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-86a415eb-85ac-4d62-bbb7-018abd8f51c8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 204 len: 0 microversion: 2.1 time: 0.456234 May 28 04:51:15.150907 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2118/4138] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:51:14 2022] DELETE /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:51:15.165587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4906ad29-c4d4-4a82-a583-0a1828975b0c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:15.166295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4906ad29-c4d4-4a82-a583-0a1828975b0c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:15.184779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4906ad29-c4d4-4a82-a583-0a1828975b0c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:15.185237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4906ad29-c4d4-4a82-a583-0a1828975b0c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:15.186003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4906ad29-c4d4-4a82-a583-0a1828975b0c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:15.186439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4906ad29-c4d4-4a82-a583-0a1828975b0c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:15.554087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-61cf8268-67e5-4f52-a6cf-fead2d0a4f4c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:15.562203 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-61cf8268-67e5-4f52-a6cf-fead2d0a4f4c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1314 microversion: 2.1 time: 0.579119 May 28 04:51:15.563577 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2021/4139] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:14 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:15.569338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e64a7e11-fe52-4b9c-bae4-a5eeac288293 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:15.569948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e64a7e11-fe52-4b9c-bae4-a5eeac288293 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:15.576122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e64a7e11-fe52-4b9c-bae4-a5eeac288293 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:15.576792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e64a7e11-fe52-4b9c-bae4-a5eeac288293 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:15.577748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e64a7e11-fe52-4b9c-bae4-a5eeac288293 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:15.578383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e64a7e11-fe52-4b9c-bae4-a5eeac288293 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:15.725810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4906ad29-c4d4-4a82-a583-0a1828975b0c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:15.734722 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4906ad29-c4d4-4a82-a583-0a1828975b0c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1334 microversion: 2.1 time: 0.582413 May 28 04:51:15.737025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e64a7e11-fe52-4b9c-bae4-a5eeac288293 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:15.748795 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2119/4140] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:15 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1334 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:15.749060 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e64a7e11-fe52-4b9c-bae4-a5eeac288293 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 200 len: 1301 microversion: 2.1 time: 0.183749 May 28 04:51:15.751532 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2022/4141] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:15 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 1301 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:15.760089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-82832150-74f6-4896-b233-d75f5891f4bd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:15.762348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-82832150-74f6-4896-b233-d75f5891f4bd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:15.766209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3f6fe5d6-051d-4528-807d-db9d1be6a3d2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:15.766841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3f6fe5d6-051d-4528-807d-db9d1be6a3d2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:15.776871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f6fe5d6-051d-4528-807d-db9d1be6a3d2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:15.779136 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82832150-74f6-4896-b233-d75f5891f4bd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:15.779933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82832150-74f6-4896-b233-d75f5891f4bd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:15.780914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82832150-74f6-4896-b233-d75f5891f4bd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:15.781601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f6fe5d6-051d-4528-807d-db9d1be6a3d2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:15.782213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82832150-74f6-4896-b233-d75f5891f4bd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:15.788146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f6fe5d6-051d-4528-807d-db9d1be6a3d2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:15.789251 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f6fe5d6-051d-4528-807d-db9d1be6a3d2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:15.836344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:16.191524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-82832150-74f6-4896-b233-d75f5891f4bd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:16.210177 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-82832150-74f6-4896-b233-d75f5891f4bd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 200 len: 1495 microversion: 2.1 time: 0.459795 May 28 04:51:16.210885 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2120/4142] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:15 2022] GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 1495 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:16.223628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b3b67e55-5960-4b8b-a162-55ccf2f77877 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:16.224611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b3b67e55-5960-4b8b-a162-55ccf2f77877 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:16.246211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b3b67e55-5960-4b8b-a162-55ccf2f77877 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:16.263460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b3b67e55-5960-4b8b-a162-55ccf2f77877 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:16.263460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b3b67e55-5960-4b8b-a162-55ccf2f77877 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:16.263460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b3b67e55-5960-4b8b-a162-55ccf2f77877 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:16.373172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3f6fe5d6-051d-4528-807d-db9d1be6a3d2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:16.382522 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3f6fe5d6-051d-4528-807d-db9d1be6a3d2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1393 microversion: 2.1 time: 0.629541 May 28 04:51:16.383830 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2023/4143] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:15 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1393 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:16.388844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-260f263b-fa38-405d-8a19-befe12966aaa tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:16.390582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-260f263b-fa38-405d-8a19-befe12966aaa tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:16.397657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-260f263b-fa38-405d-8a19-befe12966aaa tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:16.401925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-260f263b-fa38-405d-8a19-befe12966aaa tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:16.401925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-260f263b-fa38-405d-8a19-befe12966aaa tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:16.401925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-260f263b-fa38-405d-8a19-befe12966aaa tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:16.454692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=20 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:16.551329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b3b67e55-5960-4b8b-a162-55ccf2f77877 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:16.559463 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b3b67e55-5960-4b8b-a162-55ccf2f77877 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 200 len: 1517 microversion: 2.1 time: 0.347282 May 28 04:51:16.562359 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2121/4144] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:16 2022] GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 1517 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:16.575894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-1d3af262-41ca-4e66-b252-72a83928b42b req-fe23ba7f-f30d-4301-b820-f0900eab3651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2acbf858-4bd9-4004-ba98-569c9fe52f55", "name": "network-vif-plugged", "status": "completed", "tag": "44741e68-238d-4ad5-be11-243269dd0ecd"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:16.610058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-1d3af262-41ca-4e66-b252-72a83928b42b req-fe23ba7f-f30d-4301-b820-f0900eab3651 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:16.612359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-1d3af262-41ca-4e66-b252-72a83928b42b req-fe23ba7f-f30d-4301-b820-f0900eab3651 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:16.636257 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-1d3af262-41ca-4e66-b252-72a83928b42b req-fe23ba7f-f30d-4301-b820-f0900eab3651 service nova] Creating event network-vif-plugged:44741e68-238d-4ad5-be11-243269dd0ecd for instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 on n-h1-843700-1 May 28 04:51:16.648752 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-1d3af262-41ca-4e66-b252-72a83928b42b req-fe23ba7f-f30d-4301-b820-f0900eab3651 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080575 May 28 04:51:16.649671 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2122/4145] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:16.662031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8738845e-e782-4e7b-ad40-a9008bb1b5d7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:16.662848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8738845e-e782-4e7b-ad40-a9008bb1b5d7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:16.681522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8738845e-e782-4e7b-ad40-a9008bb1b5d7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:16.682096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8738845e-e782-4e7b-ad40-a9008bb1b5d7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:16.683024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8738845e-e782-4e7b-ad40-a9008bb1b5d7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:16.683592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8738845e-e782-4e7b-ad40-a9008bb1b5d7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:17.085311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-260f263b-fa38-405d-8a19-befe12966aaa tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:17.094711 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-260f263b-fa38-405d-8a19-befe12966aaa tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1680 microversion: 2.1 time: 0.709548 May 28 04:51:17.099751 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2024/4146] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:16 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1680 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:17.112519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2094fca9-f44b-4ac3-82a8-115801465081 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:17.113901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2094fca9-f44b-4ac3-82a8-115801465081 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:17.129798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2094fca9-f44b-4ac3-82a8-115801465081 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:17.130677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2094fca9-f44b-4ac3-82a8-115801465081 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:17.131940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2094fca9-f44b-4ac3-82a8-115801465081 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:17.133214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2094fca9-f44b-4ac3-82a8-115801465081 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:17.227717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8738845e-e782-4e7b-ad40-a9008bb1b5d7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:17.240657 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8738845e-e782-4e7b-ad40-a9008bb1b5d7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1314 microversion: 2.1 time: 0.589310 May 28 04:51:17.244754 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2123/4147] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:16 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:17.252356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-fd001d16-1ac7-4d4f-8d23-908b8866d91d req-6d8b22e2-fabf-4e48-bbda-50038e3ad0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4", "tag": "9d31f80f-af27-489a-a4e6-accae90d0644"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:17.264322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-fd001d16-1ac7-4d4f-8d23-908b8866d91d req-6d8b22e2-fabf-4e48-bbda-50038e3ad0d2 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:17.265331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-fd001d16-1ac7-4d4f-8d23-908b8866d91d req-6d8b22e2-fabf-4e48-bbda-50038e3ad0d2 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:17.282696 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-fd001d16-1ac7-4d4f-8d23-908b8866d91d req-6d8b22e2-fabf-4e48-bbda-50038e3ad0d2 service nova] Creating event network-changed:9d31f80f-af27-489a-a4e6-accae90d0644 for instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 on n-h1-843700-1 May 28 04:51:17.289432 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-fd001d16-1ac7-4d4f-8d23-908b8866d91d req-6d8b22e2-fabf-4e48-bbda-50038e3ad0d2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042737 May 28 04:51:17.290856 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2124/4148] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:17.298426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fb3fda58-d8bc-4268-a5bc-54e5bd086ec3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:17.300890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fb3fda58-d8bc-4268-a5bc-54e5bd086ec3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:17.309014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fb3fda58-d8bc-4268-a5bc-54e5bd086ec3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:17.310056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fb3fda58-d8bc-4268-a5bc-54e5bd086ec3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:17.311109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fb3fda58-d8bc-4268-a5bc-54e5bd086ec3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:17.311627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fb3fda58-d8bc-4268-a5bc-54e5bd086ec3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:17.407772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fb3fda58-d8bc-4268-a5bc-54e5bd086ec3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:17.419443 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fb3fda58-d8bc-4268-a5bc-54e5bd086ec3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 200 len: 1299 microversion: 2.1 time: 0.126255 May 28 04:51:17.430816 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2125/4149] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:17 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 1299 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:17.436954 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-713a9227-d542-42e9-9746-ca66ce73637a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:17.438171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-713a9227-d542-42e9-9746-ca66ce73637a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:17.451361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-713a9227-d542-42e9-9746-ca66ce73637a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:17.457389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-713a9227-d542-42e9-9746-ca66ce73637a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:17.457389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-713a9227-d542-42e9-9746-ca66ce73637a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:17.457389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-713a9227-d542-42e9-9746-ca66ce73637a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:17.481057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2094fca9-f44b-4ac3-82a8-115801465081 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:17.499819 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2094fca9-f44b-4ac3-82a8-115801465081 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1334 microversion: 2.1 time: 0.397614 May 28 04:51:17.503182 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2025/4150] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:17 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1334 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:17.514369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-404b249f-a1d6-48be-b58a-71c480a7b4ad tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:17.515031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-404b249f-a1d6-48be-b58a-71c480a7b4ad tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:17.521861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-404b249f-a1d6-48be-b58a-71c480a7b4ad tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:17.522572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-404b249f-a1d6-48be-b58a-71c480a7b4ad tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:17.523589 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-404b249f-a1d6-48be-b58a-71c480a7b4ad tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:17.524207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-404b249f-a1d6-48be-b58a-71c480a7b4ad tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:18.105034 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-713a9227-d542-42e9-9746-ca66ce73637a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:18.140177 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-713a9227-d542-42e9-9746-ca66ce73637a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 200 len: 1495 microversion: 2.1 time: 0.706758 May 28 04:51:18.149658 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2126/4151] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:17 2022] GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 1495 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:18.162657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-404b249f-a1d6-48be-b58a-71c480a7b4ad tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:18.178177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-50d44320-a28f-4ec4-a582-ba299ceff5dc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:18.180914 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-404b249f-a1d6-48be-b58a-71c480a7b4ad tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1566 microversion: 2.1 time: 0.669362 May 28 04:51:18.181036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-50d44320-a28f-4ec4-a582-ba299ceff5dc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:18.183840 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2026/4152] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:17 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1566 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:18.188921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-7e38a283-d891-4c16-840c-6fce6fef5f1f req-c092f700-13c6-4a88-8f61-346aad6f0207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a73d352-1b6c-4221-872a-aee269b8c1ae", "name": "network-vif-deleted", "tag": "de690259-a435-405f-856e-39cd4d32a239"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:18.199021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50d44320-a28f-4ec4-a582-ba299ceff5dc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:18.199492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50d44320-a28f-4ec4-a582-ba299ceff5dc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:18.200333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50d44320-a28f-4ec4-a582-ba299ceff5dc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:18.200777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50d44320-a28f-4ec4-a582-ba299ceff5dc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:18.201811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-7e38a283-d891-4c16-840c-6fce6fef5f1f req-c092f700-13c6-4a88-8f61-346aad6f0207 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:18.203206 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-7e38a283-d891-4c16-840c-6fce6fef5f1f req-c092f700-13c6-4a88-8f61-346aad6f0207 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:18.217787 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-7e38a283-d891-4c16-840c-6fce6fef5f1f req-c092f700-13c6-4a88-8f61-346aad6f0207 service nova] Creating event network-vif-deleted:de690259-a435-405f-856e-39cd4d32a239 for instance 4a73d352-1b6c-4221-872a-aee269b8c1ae on n-h2-843700-1 May 28 04:51:18.226100 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-7e38a283-d891-4c16-840c-6fce6fef5f1f req-c092f700-13c6-4a88-8f61-346aad6f0207 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040720 May 28 04:51:18.228404 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2027/4153] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:18.236626 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2797f83e-7f0d-4a77-8913-26d45ce8b3b9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:18.237018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50d44320-a28f-4ec4-a582-ba299ceff5dc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:18.237493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50d44320-a28f-4ec4-a582-ba299ceff5dc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:18.237996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-50d44320-a28f-4ec4-a582-ba299ceff5dc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lazy-loading 'fault' on Instance uuid af250cc0-2e14-4c5b-8de6-91fa9b9356b5 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:51:18.239798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2797f83e-7f0d-4a77-8913-26d45ce8b3b9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:18.248682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2797f83e-7f0d-4a77-8913-26d45ce8b3b9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:18.249575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2797f83e-7f0d-4a77-8913-26d45ce8b3b9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:18.250675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2797f83e-7f0d-4a77-8913-26d45ce8b3b9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:18.251541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2797f83e-7f0d-4a77-8913-26d45ce8b3b9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:18.325282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-50d44320-a28f-4ec4-a582-ba299ceff5dc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:18.332474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:18.335028 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-50d44320-a28f-4ec4-a582-ba299ceff5dc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 200 len: 1310 microversion: 2.1 time: 0.192406 May 28 04:51:18.335620 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2127/4154] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:18 2022] GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 1310 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:18.355143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-62c78f1f-3769-4673-ae2c-e23b9bdf3514 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:18.360702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-62c78f1f-3769-4673-ae2c-e23b9bdf3514 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:18.366215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-62c78f1f-3769-4673-ae2c-e23b9bdf3514 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:18.366568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-62c78f1f-3769-4673-ae2c-e23b9bdf3514 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:18.367387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-62c78f1f-3769-4673-ae2c-e23b9bdf3514 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:18.367828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-62c78f1f-3769-4673-ae2c-e23b9bdf3514 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:18.630380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2797f83e-7f0d-4a77-8913-26d45ce8b3b9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:18.638780 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2797f83e-7f0d-4a77-8913-26d45ce8b3b9 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1680 microversion: 2.1 time: 0.408895 May 28 04:51:18.639398 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2028/4155] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:18 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1680 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:18.644224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b0f94382-4cc8-4024-a519-b59d5dca3b74 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:18.645046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b0f94382-4cc8-4024-a519-b59d5dca3b74 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:18.651883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0f94382-4cc8-4024-a519-b59d5dca3b74 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:18.652503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0f94382-4cc8-4024-a519-b59d5dca3b74 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:18.653928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0f94382-4cc8-4024-a519-b59d5dca3b74 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:18.654527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0f94382-4cc8-4024-a519-b59d5dca3b74 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:18.680730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-62c78f1f-3769-4673-ae2c-e23b9bdf3514 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:18.701116 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-62c78f1f-3769-4673-ae2c-e23b9bdf3514 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1566 microversion: 2.1 time: 0.356128 May 28 04:51:18.701116 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2128/4156] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:18 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1566 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:18.702297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-edd42db8-564d-43ed-a7a9-7144f0dbe924 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:18.702912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-edd42db8-564d-43ed-a7a9-7144f0dbe924 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:18.704795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:18.719614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-edd42db8-564d-43ed-a7a9-7144f0dbe924 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:18.720157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-edd42db8-564d-43ed-a7a9-7144f0dbe924 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:18.720962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-edd42db8-564d-43ed-a7a9-7144f0dbe924 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:18.721397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-edd42db8-564d-43ed-a7a9-7144f0dbe924 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:18.992361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b0f94382-4cc8-4024-a519-b59d5dca3b74 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:19.000721 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b0f94382-4cc8-4024-a519-b59d5dca3b74 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1502 microversion: 2.1 time: 0.359932 May 28 04:51:19.001598 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2029/4157] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:18 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1502 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:19.007562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-642de232-60ba-46f4-b65b-dc649d7feb4a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:19.008539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-642de232-60ba-46f4-b65b-dc649d7feb4a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:19.015694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-642de232-60ba-46f4-b65b-dc649d7feb4a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:19.016571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-642de232-60ba-46f4-b65b-dc649d7feb4a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:19.018087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-642de232-60ba-46f4-b65b-dc649d7feb4a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:19.018818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-642de232-60ba-46f4-b65b-dc649d7feb4a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:19.229454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-edd42db8-564d-43ed-a7a9-7144f0dbe924 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:19.240849 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-edd42db8-564d-43ed-a7a9-7144f0dbe924 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 200 len: 1367 microversion: 2.1 time: 0.540230 May 28 04:51:19.241498 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2129/4158] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:18 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 1367 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:19.255245 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8f2ae958-fddb-4c44-8977-1e60fb285f34 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:19.256087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8f2ae958-fddb-4c44-8977-1e60fb285f34 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:19.268805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f2ae958-fddb-4c44-8977-1e60fb285f34 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:19.268805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f2ae958-fddb-4c44-8977-1e60fb285f34 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:19.268805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f2ae958-fddb-4c44-8977-1e60fb285f34 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:19.268805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f2ae958-fddb-4c44-8977-1e60fb285f34 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:19.325809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f2ae958-fddb-4c44-8977-1e60fb285f34 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:19.326411 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f2ae958-fddb-4c44-8977-1e60fb285f34 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:19.327072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-8f2ae958-fddb-4c44-8977-1e60fb285f34 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lazy-loading 'fault' on Instance uuid 4a73d352-1b6c-4221-872a-aee269b8c1ae {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:51:19.435338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8f2ae958-fddb-4c44-8977-1e60fb285f34 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:19.445409 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8f2ae958-fddb-4c44-8977-1e60fb285f34 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 200 len: 1299 microversion: 2.1 time: 0.201608 May 28 04:51:19.446566 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2130/4159] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:19 2022] GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 1299 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:19.451566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-efc780b6-b95f-4958-afc3-a309640bb25a req-7082ce1d-fdae-41d2-9207-537d6149dbe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af250cc0-2e14-4c5b-8de6-91fa9b9356b5", "name": "network-vif-deleted", "tag": "e57ffcf5-6a04-4477-9413-a2c6603b8aeb"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:19.464785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-efc780b6-b95f-4958-afc3-a309640bb25a req-7082ce1d-fdae-41d2-9207-537d6149dbe5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:19.468476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-efc780b6-b95f-4958-afc3-a309640bb25a req-7082ce1d-fdae-41d2-9207-537d6149dbe5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:19.480456 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-efc780b6-b95f-4958-afc3-a309640bb25a req-7082ce1d-fdae-41d2-9207-537d6149dbe5 service nova] Creating event network-vif-deleted:e57ffcf5-6a04-4477-9413-a2c6603b8aeb for instance af250cc0-2e14-4c5b-8de6-91fa9b9356b5 on n-h1-843700-1 May 28 04:51:19.481104 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-642de232-60ba-46f4-b65b-dc649d7feb4a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:19.486361 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-efc780b6-b95f-4958-afc3-a309640bb25a req-7082ce1d-fdae-41d2-9207-537d6149dbe5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037955 May 28 04:51:19.487257 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2131/4160] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:19.497466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a3340ee0-4b7b-4844-83fc-14e03b2c62cc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:19.498627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a3340ee0-4b7b-4844-83fc-14e03b2c62cc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: af250cc0-2e14-4c5b-8de6-91fa9b9356b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:19.502926 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-642de232-60ba-46f4-b65b-dc649d7feb4a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1334 microversion: 2.1 time: 0.499916 May 28 04:51:19.513325 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2030/4161] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:19 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1334 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:19.516863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3340ee0-4b7b-4844-83fc-14e03b2c62cc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:19.517439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3340ee0-4b7b-4844-83fc-14e03b2c62cc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:19.518771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3340ee0-4b7b-4844-83fc-14e03b2c62cc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:19.519947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3340ee0-4b7b-4844-83fc-14e03b2c62cc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:19.547931 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-a3340ee0-4b7b-4844-83fc-14e03b2c62cc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] HTTP exception thrown: Instance af250cc0-2e14-4c5b-8de6-91fa9b9356b5 could not be found. May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a3340ee0-4b7b-4844-83fc-14e03b2c62cc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Request method failure captured: May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 HTTP/1.1 May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikank67WGxvFpThyyPuU6Gg9B40uK6p1dohOu1BqRnujQJp8a-vDMfh14Ne8j-f8qaamJV7xcW1s0YyTiMiRYJjum5Ruw0czjq5YnAAYXdXVYEaetgU84kn2NbDQc3fGxBt225bisrwLtFsU3Qk1Zo7e3tvQxH-XPpeDxyfCWtqgN9Q4 May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 666dc141a00a4376893f7244fc10c61b May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ListServerFiltersTestJSON-819229249 May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_666dc141a00a4376893f7244fc10c61b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/666dc141a00a4376893f7244fc10c61b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/666dc141a00a4376893f7244fc10c61b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/666dc141a00a4376893f7244fc10c61b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ListServerFiltersTestJSON-819229249 May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 666dc141a00a4376893f7244fc10c61b May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-819229249 May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ListServerFiltersTestJSON-819229249-project May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 16dbd63fc217411493fc6f2f337949c1 May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ListServerFiltersTestJSON-819229249-project May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance af250cc0-2e14-4c5b-8de6-91fa9b9356b5 could not be found. May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'af250cc0-2e14-4c5b-8de6-91fa9b9356b5'} May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af250cc0-2e14-4c5b-8de6-91fa9b9356b5 could not be found. May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af250cc0-2e14-4c5b-8de6-91fa9b9356b5 could not be found. May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:19.551787 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:19.557243 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:19.557243 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:19.557243 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:19.557243 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:51:19.557243 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:51:19.557243 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af250cc0-2e14-4c5b-8de6-91fa9b9356b5 could not be found. May 28 04:51:19.557243 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:19.557243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a3340ee0-4b7b-4844-83fc-14e03b2c62cc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Returning 404 to user: Instance af250cc0-2e14-4c5b-8de6-91fa9b9356b5 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:19.557243 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a3340ee0-4b7b-4844-83fc-14e03b2c62cc tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5" status: 404 len: 111 microversion: 2.1 time: 0.064512 May 28 04:51:19.557243 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2132/4162] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:19 2022] GET /compute/v2.1/servers/af250cc0-2e14-4c5b-8de6-91fa9b9356b5 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:51:19.562490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-815fa98e-0cd0-4c94-931b-154fd96c7009 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:19.563026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-815fa98e-0cd0-4c94-931b-154fd96c7009 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:19.570347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-815fa98e-0cd0-4c94-931b-154fd96c7009 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:19.570978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-815fa98e-0cd0-4c94-931b-154fd96c7009 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:19.572010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-815fa98e-0cd0-4c94-931b-154fd96c7009 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:19.572619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-815fa98e-0cd0-4c94-931b-154fd96c7009 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:19.611162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-815fa98e-0cd0-4c94-931b-154fd96c7009 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:51:19.656673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ab762cc1-512f-4340-ac86-3e6191e4b2ec tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:19.657589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ab762cc1-512f-4340-ac86-3e6191e4b2ec tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:19.667702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab762cc1-512f-4340-ac86-3e6191e4b2ec tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:19.669972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab762cc1-512f-4340-ac86-3e6191e4b2ec tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:19.671901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab762cc1-512f-4340-ac86-3e6191e4b2ec tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:19.672903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab762cc1-512f-4340-ac86-3e6191e4b2ec tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:19.918298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ab762cc1-512f-4340-ac86-3e6191e4b2ec tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:19.938745 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ab762cc1-512f-4340-ac86-3e6191e4b2ec tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1680 microversion: 2.1 time: 0.286564 May 28 04:51:19.943863 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2133/4163] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:19 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1680 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:20.092218 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-815fa98e-0cd0-4c94-931b-154fd96c7009 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77" status: 204 len: 0 microversion: 2.1 time: 0.533299 May 28 04:51:20.095148 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2031/4164] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:51:19 2022] DELETE /compute/v2.1/servers/ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:51:20.104318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f6c815f5-8694-4b27-b475-d883c9d4b1a9 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:20.104946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f6c815f5-8694-4b27-b475-d883c9d4b1a9 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:20.122783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6c815f5-8694-4b27-b475-d883c9d4b1a9 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:20.123488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6c815f5-8694-4b27-b475-d883c9d4b1a9 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:20.124464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6c815f5-8694-4b27-b475-d883c9d4b1a9 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:20.125074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6c815f5-8694-4b27-b475-d883c9d4b1a9 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:20.258963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-871b72e5-5c48-4616-b265-773a8c2928b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:20.259631 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-871b72e5-5c48-4616-b265-773a8c2928b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:20.270362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-871b72e5-5c48-4616-b265-773a8c2928b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:20.271070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-871b72e5-5c48-4616-b265-773a8c2928b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:20.272041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-871b72e5-5c48-4616-b265-773a8c2928b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:20.272647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-871b72e5-5c48-4616-b265-773a8c2928b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:20.945503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f6c815f5-8694-4b27-b475-d883c9d4b1a9 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:20.959127 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f6c815f5-8694-4b27-b475-d883c9d4b1a9 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77" status: 200 len: 1519 microversion: 2.1 time: 0.859800 May 28 04:51:20.959740 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2134/4165] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:20 2022] GET /compute/v2.1/servers/ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77 => generated 1519 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:20.971397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-64c94708-8a68-479d-a64c-c3bb74b64a7b req-364a8fd3-4275-401b-be6b-6fd657aeeb56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50d15725-d599-410b-8d4d-d4460a1d96b6", "tag": "1ff2e3fd-f7ce-4fff-a4eb-cb1552874f44"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:20.987267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-64c94708-8a68-479d-a64c-c3bb74b64a7b req-364a8fd3-4275-401b-be6b-6fd657aeeb56 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:20.988258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-64c94708-8a68-479d-a64c-c3bb74b64a7b req-364a8fd3-4275-401b-be6b-6fd657aeeb56 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:21.002563 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-64c94708-8a68-479d-a64c-c3bb74b64a7b req-364a8fd3-4275-401b-be6b-6fd657aeeb56 service nova] Creating event network-changed:1ff2e3fd-f7ce-4fff-a4eb-cb1552874f44 for instance 50d15725-d599-410b-8d4d-d4460a1d96b6 on n-h2-843700-1 May 28 04:51:21.026730 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-64c94708-8a68-479d-a64c-c3bb74b64a7b req-364a8fd3-4275-401b-be6b-6fd657aeeb56 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065190 May 28 04:51:21.027256 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2135/4166] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:21.033040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a45ba05d-d0e1-4b95-a300-af56b5abc597 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:21.033744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a45ba05d-d0e1-4b95-a300-af56b5abc597 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:21.041639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-871b72e5-5c48-4616-b265-773a8c2928b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:21.053661 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-871b72e5-5c48-4616-b265-773a8c2928b1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 200 len: 1367 microversion: 2.1 time: 0.798920 May 28 04:51:21.056250 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2032/4167] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:20 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 1367 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:51:21.066656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-72f023df-c67f-4d32-a459-0f39902ed18b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:21.068048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a45ba05d-d0e1-4b95-a300-af56b5abc597 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:21.068780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a45ba05d-d0e1-4b95-a300-af56b5abc597 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:21.069571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a45ba05d-d0e1-4b95-a300-af56b5abc597 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:21.070214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a45ba05d-d0e1-4b95-a300-af56b5abc597 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:21.073827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-72f023df-c67f-4d32-a459-0f39902ed18b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:21.089129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-72f023df-c67f-4d32-a459-0f39902ed18b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:21.089903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-72f023df-c67f-4d32-a459-0f39902ed18b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:21.091993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-72f023df-c67f-4d32-a459-0f39902ed18b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:21.092449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-72f023df-c67f-4d32-a459-0f39902ed18b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:21.104019 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-a45ba05d-d0e1-4b95-a300-af56b5abc597 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance 4a73d352-1b6c-4221-872a-aee269b8c1ae could not be found. May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a45ba05d-d0e1-4b95-a300-af56b5abc597 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae HTTP/1.1 May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 4a73d352-1b6c-4221-872a-aee269b8c1ae could not be found. May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '4a73d352-1b6c-4221-872a-aee269b8c1ae'} May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a73d352-1b6c-4221-872a-aee269b8c1ae could not be found. May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a73d352-1b6c-4221-872a-aee269b8c1ae could not be found. May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:21.111304 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:21.116183 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:21.116183 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:21.116183 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:51:21.116183 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:51:21.116183 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a73d352-1b6c-4221-872a-aee269b8c1ae could not be found. May 28 04:51:21.116183 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:21.116183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a45ba05d-d0e1-4b95-a300-af56b5abc597 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance 4a73d352-1b6c-4221-872a-aee269b8c1ae could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:21.116183 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a45ba05d-d0e1-4b95-a300-af56b5abc597 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 404 len: 111 microversion: 2.1 time: 0.084342 May 28 04:51:21.134513 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2136/4168] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:21 2022] GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:51:21.139059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-74c5955c-392e-4f73-9b36-d4cf4d6cae02 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:21.139897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-74c5955c-392e-4f73-9b36-d4cf4d6cae02 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:21.147340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74c5955c-392e-4f73-9b36-d4cf4d6cae02 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:21.148013 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74c5955c-392e-4f73-9b36-d4cf4d6cae02 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:21.148807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74c5955c-392e-4f73-9b36-d4cf4d6cae02 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:21.149255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74c5955c-392e-4f73-9b36-d4cf4d6cae02 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:21.759167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=18 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:22.141315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-74c5955c-392e-4f73-9b36-d4cf4d6cae02 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:22.167159 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-74c5955c-392e-4f73-9b36-d4cf4d6cae02 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1680 microversion: 2.1 time: 1.030188 May 28 04:51:22.167159 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2137/4169] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:21 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1680 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:22.181886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4428c769-4313-4d5c-b892-5e8ab8bcea8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:22.182424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4428c769-4313-4d5c-b892-5e8ab8bcea8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:22.201344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4428c769-4313-4d5c-b892-5e8ab8bcea8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:22.206145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4428c769-4313-4d5c-b892-5e8ab8bcea8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:22.208355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4428c769-4313-4d5c-b892-5e8ab8bcea8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:22.209063 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4428c769-4313-4d5c-b892-5e8ab8bcea8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:22.258260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4428c769-4313-4d5c-b892-5e8ab8bcea8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:51:22.394323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-72f023df-c67f-4d32-a459-0f39902ed18b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:22.403528 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-72f023df-c67f-4d32-a459-0f39902ed18b tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1334 microversion: 2.1 time: 1.345870 May 28 04:51:22.404495 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2033/4170] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:21 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1334 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:22.410041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d84b195c-cf1f-4eac-baf4-428c68c3f987 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:22.410854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d84b195c-cf1f-4eac-baf4-428c68c3f987 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:22.418438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d84b195c-cf1f-4eac-baf4-428c68c3f987 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:22.419756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d84b195c-cf1f-4eac-baf4-428c68c3f987 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:22.420826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d84b195c-cf1f-4eac-baf4-428c68c3f987 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:22.421613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d84b195c-cf1f-4eac-baf4-428c68c3f987 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:22.531536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:22.577587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:22.723228 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4428c769-4313-4d5c-b892-5e8ab8bcea8d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "DELETE /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d" status: 204 len: 0 microversion: 2.1 time: 0.545776 May 28 04:51:22.723228 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2138/4171] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:51:22 2022] DELETE /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:51:22.739336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-75152c4d-a4d2-4215-993a-4e3050bdac06 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:22.743439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-75152c4d-a4d2-4215-993a-4e3050bdac06 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:22.757706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75152c4d-a4d2-4215-993a-4e3050bdac06 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:22.760150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75152c4d-a4d2-4215-993a-4e3050bdac06 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:22.760150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75152c4d-a4d2-4215-993a-4e3050bdac06 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:22.760677 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75152c4d-a4d2-4215-993a-4e3050bdac06 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:22.820641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d84b195c-cf1f-4eac-baf4-428c68c3f987 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:22.834811 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d84b195c-cf1f-4eac-baf4-428c68c3f987 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77" status: 200 len: 1519 microversion: 2.1 time: 0.424768 May 28 04:51:22.836859 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2034/4172] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:22 2022] GET /compute/v2.1/servers/ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77 => generated 1519 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:22.842420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6a6f2d64-0430-4311-b4fc-fb0a45e2f5d2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:22.843429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6a6f2d64-0430-4311-b4fc-fb0a45e2f5d2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:22.864401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a6f2d64-0430-4311-b4fc-fb0a45e2f5d2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:22.864881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a6f2d64-0430-4311-b4fc-fb0a45e2f5d2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:22.865763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a6f2d64-0430-4311-b4fc-fb0a45e2f5d2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:22.866207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a6f2d64-0430-4311-b4fc-fb0a45e2f5d2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:23.209825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-75152c4d-a4d2-4215-993a-4e3050bdac06 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:23.227668 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-75152c4d-a4d2-4215-993a-4e3050bdac06 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 200 len: 1367 microversion: 2.1 time: 0.498452 May 28 04:51:23.228557 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2139/4173] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:22 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 1367 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:23.233623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6c6bdd98-66b4-4bc6-818e-b3a1cd19b404 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:23.234858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6c6bdd98-66b4-4bc6-818e-b3a1cd19b404 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:23.255601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c6bdd98-66b4-4bc6-818e-b3a1cd19b404 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:23.256277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c6bdd98-66b4-4bc6-818e-b3a1cd19b404 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:23.261488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c6bdd98-66b4-4bc6-818e-b3a1cd19b404 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:23.261488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c6bdd98-66b4-4bc6-818e-b3a1cd19b404 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:23.272672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6a6f2d64-0430-4311-b4fc-fb0a45e2f5d2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:23.290730 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6a6f2d64-0430-4311-b4fc-fb0a45e2f5d2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d" status: 200 len: 1496 microversion: 2.1 time: 0.452635 May 28 04:51:23.296131 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2035/4174] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:22 2022] GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d => generated 1496 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:23.307446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-760a6ad9-ea91-4678-b331-11f985d9e6db req-c90bdc9a-2626-4464-9dfd-901124940c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77", "name": "network-vif-deleted", "tag": "d4a489f1-c611-4635-8c85-3f52355d1a3b"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:23.328567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-760a6ad9-ea91-4678-b331-11f985d9e6db req-c90bdc9a-2626-4464-9dfd-901124940c27 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:23.330001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-760a6ad9-ea91-4678-b331-11f985d9e6db req-c90bdc9a-2626-4464-9dfd-901124940c27 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:23.354520 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-760a6ad9-ea91-4678-b331-11f985d9e6db req-c90bdc9a-2626-4464-9dfd-901124940c27 service nova] Creating event network-vif-deleted:d4a489f1-c611-4635-8c85-3f52355d1a3b for instance ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77 on n-h2-843700-1 May 28 04:51:23.374741 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-760a6ad9-ea91-4678-b331-11f985d9e6db req-c90bdc9a-2626-4464-9dfd-901124940c27 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077835 May 28 04:51:23.375714 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2036/4175] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:23.384202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bc806cbc-a8f1-4411-ad94-82d16405bcbf tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "baffab73-2e41-4cb8-b25d-2d0adfb80293"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:23.385883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bc806cbc-a8f1-4411-ad94-82d16405bcbf tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:23.394783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc806cbc-a8f1-4411-ad94-82d16405bcbf tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:23.396585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc806cbc-a8f1-4411-ad94-82d16405bcbf tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:23.397759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc806cbc-a8f1-4411-ad94-82d16405bcbf tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:23.398369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc806cbc-a8f1-4411-ad94-82d16405bcbf tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:23.483962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6c6bdd98-66b4-4bc6-818e-b3a1cd19b404 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:23.496042 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6c6bdd98-66b4-4bc6-818e-b3a1cd19b404 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1657 microversion: 2.1 time: 0.266146 May 28 04:51:23.496869 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2140/4176] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:23 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1657 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:23.501876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6edaed61-09e5-4232-8afb-9c8cba2619d0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:23.505914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6edaed61-09e5-4232-8afb-9c8cba2619d0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:23.529531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6edaed61-09e5-4232-8afb-9c8cba2619d0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:23.530413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6edaed61-09e5-4232-8afb-9c8cba2619d0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:23.531494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6edaed61-09e5-4232-8afb-9c8cba2619d0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:23.532091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6edaed61-09e5-4232-8afb-9c8cba2619d0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:23.872129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6edaed61-09e5-4232-8afb-9c8cba2619d0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:23.880795 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6edaed61-09e5-4232-8afb-9c8cba2619d0 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1334 microversion: 2.1 time: 0.382625 May 28 04:51:23.891519 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2141/4177] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:23 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1334 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:23.898738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-77dff9c9-67a4-446f-9a10-0958b4d445fa tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:23.906185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77dff9c9-67a4-446f-9a10-0958b4d445fa tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:23.906913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77dff9c9-67a4-446f-9a10-0958b4d445fa tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:23.984501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-77dff9c9-67a4-446f-9a10-0958b4d445fa tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Going to try to start instance {{(pid=126044) start /opt/stack/nova/nova/compute/api.py:2730}} May 28 04:51:24.219712 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-77dff9c9-67a4-446f-9a10-0958b4d445fa tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action" status: 202 len: 0 microversion: 2.1 time: 0.326379 May 28 04:51:24.223563 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2142/4178] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:51:23 2022] POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:51:24.233022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7af45c53-fa11-401f-8109-c0cc0ff91658 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:24.234724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7af45c53-fa11-401f-8109-c0cc0ff91658 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:24.242848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7af45c53-fa11-401f-8109-c0cc0ff91658 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:24.243785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7af45c53-fa11-401f-8109-c0cc0ff91658 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:24.244804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7af45c53-fa11-401f-8109-c0cc0ff91658 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:24.245472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7af45c53-fa11-401f-8109-c0cc0ff91658 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:24.281617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7af45c53-fa11-401f-8109-c0cc0ff91658 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:24.282420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7af45c53-fa11-401f-8109-c0cc0ff91658 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:24.283130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-7af45c53-fa11-401f-8109-c0cc0ff91658 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lazy-loading 'fault' on Instance uuid ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:51:24.361458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7af45c53-fa11-401f-8109-c0cc0ff91658 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:24.369806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:24.372835 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7af45c53-fa11-401f-8109-c0cc0ff91658 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77" status: 200 len: 1311 microversion: 2.1 time: 0.146568 May 28 04:51:24.375605 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2143/4179] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:24 2022] GET /compute/v2.1/servers/ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77 => generated 1311 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:24.380099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-517fa563-1adf-48b8-aad0-6f8e59f9cae6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:24.381059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-517fa563-1adf-48b8-aad0-6f8e59f9cae6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:24.388205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-517fa563-1adf-48b8-aad0-6f8e59f9cae6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:24.388975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-517fa563-1adf-48b8-aad0-6f8e59f9cae6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:24.389928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-517fa563-1adf-48b8-aad0-6f8e59f9cae6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:24.390671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-517fa563-1adf-48b8-aad0-6f8e59f9cae6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:24.596028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-517fa563-1adf-48b8-aad0-6f8e59f9cae6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:24.605406 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-517fa563-1adf-48b8-aad0-6f8e59f9cae6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1566 microversion: 2.1 time: 0.230160 May 28 04:51:24.607017 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2144/4180] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:24 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1566 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:24.611625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e8424413-7565-42c9-b661-2928530af7a2 req-6556711a-b491-4acc-8ff6-cd4eb6d0747e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c89850-7792-485a-a6ba-79c3b19b5405", "tag": "281843f9-caf9-43ff-9ade-dc1bd3a73fd1"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:24.642575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e8424413-7565-42c9-b661-2928530af7a2 req-6556711a-b491-4acc-8ff6-cd4eb6d0747e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:24.643057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e8424413-7565-42c9-b661-2928530af7a2 req-6556711a-b491-4acc-8ff6-cd4eb6d0747e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:24.673630 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bc806cbc-a8f1-4411-ad94-82d16405bcbf tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "POST /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.295945 May 28 04:51:24.674394 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e8424413-7565-42c9-b661-2928530af7a2 req-6556711a-b491-4acc-8ff6-cd4eb6d0747e service nova] Creating event network-changed:281843f9-caf9-43ff-9ade-dc1bd3a73fd1 for instance 99c89850-7792-485a-a6ba-79c3b19b5405 on n-h1-843700-1 May 28 04:51:24.678329 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2037/4181] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 04:51:23 2022] POST /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55/os-volume_attachments => generated 194 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:24.696349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-95a3c9b2-698f-4473-9341-32558df7a943 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:24.697334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-95a3c9b2-698f-4473-9341-32558df7a943 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:24.699608 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e8424413-7565-42c9-b661-2928530af7a2 req-6556711a-b491-4acc-8ff6-cd4eb6d0747e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091291 May 28 04:51:24.709684 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2145/4182] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:24.720326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:24.731298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a53d6021-8567-4061-8766-ca87feadd446 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:24.732217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-95a3c9b2-698f-4473-9341-32558df7a943 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:24.732382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a53d6021-8567-4061-8766-ca87feadd446 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:24.734541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-95a3c9b2-698f-4473-9341-32558df7a943 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:24.736372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-95a3c9b2-698f-4473-9341-32558df7a943 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:24.743873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-95a3c9b2-698f-4473-9341-32558df7a943 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:24.759814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a53d6021-8567-4061-8766-ca87feadd446 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:24.760298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a53d6021-8567-4061-8766-ca87feadd446 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:24.761334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a53d6021-8567-4061-8766-ca87feadd446 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:24.764127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a53d6021-8567-4061-8766-ca87feadd446 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:24.810147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:25.257868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a53d6021-8567-4061-8766-ca87feadd446 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:25.275623 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a53d6021-8567-4061-8766-ca87feadd446 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 200 len: 1367 microversion: 2.1 time: 0.564403 May 28 04:51:25.285174 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2146/4183] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:24 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 1367 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:25.285174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-37b0e231-b53b-48a6-936e-28fc87d534f5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:25.285174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-37b0e231-b53b-48a6-936e-28fc87d534f5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:25.303116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-37b0e231-b53b-48a6-936e-28fc87d534f5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:25.303503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-37b0e231-b53b-48a6-936e-28fc87d534f5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:25.304284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-37b0e231-b53b-48a6-936e-28fc87d534f5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:25.304905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-37b0e231-b53b-48a6-936e-28fc87d534f5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:25.374912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-95a3c9b2-698f-4473-9341-32558df7a943 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:25.389357 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-95a3c9b2-698f-4473-9341-32558df7a943 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1666 microversion: 2.1 time: 0.707111 May 28 04:51:25.390412 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2038/4184] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:24 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1666 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:25.413058 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-64de602f-8353-46b6-a733-7db17c34dff4 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:25.417040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-64de602f-8353-46b6-a733-7db17c34dff4 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:25.424447 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-64de602f-8353-46b6-a733-7db17c34dff4 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:25.425351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-64de602f-8353-46b6-a733-7db17c34dff4 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:25.426919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-64de602f-8353-46b6-a733-7db17c34dff4 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:25.427829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-64de602f-8353-46b6-a733-7db17c34dff4 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:25.438409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-37b0e231-b53b-48a6-936e-28fc87d534f5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:25.447085 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-37b0e231-b53b-48a6-936e-28fc87d534f5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d" status: 200 len: 1454 microversion: 2.1 time: 0.169374 May 28 04:51:25.447608 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2147/4185] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:25 2022] GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:25.470820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9682bed6-046a-4efc-b28e-9a3ab9c8620c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:25.471479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9682bed6-046a-4efc-b28e-9a3ab9c8620c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:25.496473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9682bed6-046a-4efc-b28e-9a3ab9c8620c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:25.497442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9682bed6-046a-4efc-b28e-9a3ab9c8620c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:25.498364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9682bed6-046a-4efc-b28e-9a3ab9c8620c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:25.498965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9682bed6-046a-4efc-b28e-9a3ab9c8620c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:25.514705 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-9682bed6-046a-4efc-b28e-9a3ab9c8620c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] HTTP exception thrown: Instance ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77 could not be found. May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9682bed6-046a-4efc-b28e-9a3ab9c8620c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Request method failure captured: May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77 HTTP/1.1 May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikank67WGxvFpThyyPuU6Gg9B40uK6p1dohOu1BqRnujQJp8a-vDMfh14Ne8j-f8qaamJV7xcW1s0YyTiMiRYJjum5Ruw0czjq5YnAAYXdXVYEaetgU84kn2NbDQc3fGxBt225bisrwLtFsU3Qk1Zo7e3tvQxH-XPpeDxyfCWtqgN9Q4 May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 666dc141a00a4376893f7244fc10c61b May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ListServerFiltersTestJSON-819229249 May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_666dc141a00a4376893f7244fc10c61b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/666dc141a00a4376893f7244fc10c61b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/666dc141a00a4376893f7244fc10c61b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/666dc141a00a4376893f7244fc10c61b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ListServerFiltersTestJSON-819229249 May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 666dc141a00a4376893f7244fc10c61b May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-819229249 May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ListServerFiltersTestJSON-819229249-project May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 16dbd63fc217411493fc6f2f337949c1 May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ListServerFiltersTestJSON-819229249-project May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77 could not be found. May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77'} May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77 could not be found. May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77 could not be found. May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:25.523789 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:25.527880 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:25.527880 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:25.527880 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:25.527880 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:51:25.527880 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:51:25.527880 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77 could not be found. May 28 04:51:25.527880 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:25.530504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9682bed6-046a-4efc-b28e-9a3ab9c8620c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Returning 404 to user: Instance ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:25.532081 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9682bed6-046a-4efc-b28e-9a3ab9c8620c tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77" status: 404 len: 111 microversion: 2.1 time: 0.065188 May 28 04:51:25.533470 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2148/4186] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:25 2022] GET /compute/v2.1/servers/ddc3d0c3-3ccf-4ec4-a4ba-9bc262db8c77 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:51:25.546862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6d4f93cf-e419-417d-bd48-78615938b860 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:25.549137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6d4f93cf-e419-417d-bd48-78615938b860 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:25.562749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d4f93cf-e419-417d-bd48-78615938b860 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:25.563834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d4f93cf-e419-417d-bd48-78615938b860 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:25.564876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d4f93cf-e419-417d-bd48-78615938b860 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:25.566449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d4f93cf-e419-417d-bd48-78615938b860 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:25.620765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6d4f93cf-e419-417d-bd48-78615938b860 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:51:26.172437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-64de602f-8353-46b6-a733-7db17c34dff4 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:26.188204 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-64de602f-8353-46b6-a733-7db17c34dff4 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1334 microversion: 2.1 time: 0.786221 May 28 04:51:26.188827 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2039/4187] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:25 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1334 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:26.297562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5c3bb97a-645d-40ce-985a-e89cb2851473 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:26.298455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5c3bb97a-645d-40ce-985a-e89cb2851473 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:26.314800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c3bb97a-645d-40ce-985a-e89cb2851473 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:26.321380 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6d4f93cf-e419-417d-bd48-78615938b860 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "DELETE /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 204 len: 0 microversion: 2.1 time: 0.779394 May 28 04:51:26.329494 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2149/4188] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:51:25 2022] DELETE /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:51:26.339159 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-59455142-4590-4bdd-8a9e-3d99ea7e0d84 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:26.339869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c3bb97a-645d-40ce-985a-e89cb2851473 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:26.343267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-59455142-4590-4bdd-8a9e-3d99ea7e0d84 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:26.346447 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c3bb97a-645d-40ce-985a-e89cb2851473 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:26.349931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c3bb97a-645d-40ce-985a-e89cb2851473 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:26.384512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-59455142-4590-4bdd-8a9e-3d99ea7e0d84 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:26.389073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-59455142-4590-4bdd-8a9e-3d99ea7e0d84 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:26.390552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-59455142-4590-4bdd-8a9e-3d99ea7e0d84 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:26.392350 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-59455142-4590-4bdd-8a9e-3d99ea7e0d84 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:26.734495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5c3bb97a-645d-40ce-985a-e89cb2851473 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:26.750173 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5c3bb97a-645d-40ce-985a-e89cb2851473 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 200 len: 1367 microversion: 2.1 time: 0.460080 May 28 04:51:26.751577 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2040/4189] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:26 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 1367 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:51:26.759830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-545399d3-e5eb-4d6b-ab8a-857f7b7a05d0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:26.763071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-545399d3-e5eb-4d6b-ab8a-857f7b7a05d0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:26.776923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-59455142-4590-4bdd-8a9e-3d99ea7e0d84 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:26.778820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-545399d3-e5eb-4d6b-ab8a-857f7b7a05d0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:26.779407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-545399d3-e5eb-4d6b-ab8a-857f7b7a05d0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:26.782558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-545399d3-e5eb-4d6b-ab8a-857f7b7a05d0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:26.783663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-545399d3-e5eb-4d6b-ab8a-857f7b7a05d0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:26.787727 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-59455142-4590-4bdd-8a9e-3d99ea7e0d84 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1518 microversion: 2.1 time: 0.454130 May 28 04:51:26.794624 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2150/4190] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:26 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1518 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:51:26.822007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a0f94716-d16e-4a73-9900-dda60918c6b4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:26.826303 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a0f94716-d16e-4a73-9900-dda60918c6b4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:26.845737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0f94716-d16e-4a73-9900-dda60918c6b4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:26.846688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0f94716-d16e-4a73-9900-dda60918c6b4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:26.848478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0f94716-d16e-4a73-9900-dda60918c6b4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:26.849357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0f94716-d16e-4a73-9900-dda60918c6b4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:26.953538 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0f94716-d16e-4a73-9900-dda60918c6b4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:26.973956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0f94716-d16e-4a73-9900-dda60918c6b4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:26.973956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-a0f94716-d16e-4a73-9900-dda60918c6b4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lazy-loading 'fault' on Instance uuid 393747a2-794a-4b7a-8c05-a1e99fd68d0d {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:51:27.139123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a0f94716-d16e-4a73-9900-dda60918c6b4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:27.149144 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a0f94716-d16e-4a73-9900-dda60918c6b4 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d" status: 200 len: 1299 microversion: 2.1 time: 0.352286 May 28 04:51:27.162357 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2151/4191] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:26 2022] GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d => generated 1299 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:27.165763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-13424af3-7fe0-4f3f-9415-8977916e4e05 req-3620be68-5a1d-48ca-83c0-2c8de312d3f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "393747a2-794a-4b7a-8c05-a1e99fd68d0d", "name": "network-vif-deleted", "tag": "1b26226c-e43f-47fe-8c11-13195d33ece3"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:27.174879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-13424af3-7fe0-4f3f-9415-8977916e4e05 req-3620be68-5a1d-48ca-83c0-2c8de312d3f1 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:27.175602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-13424af3-7fe0-4f3f-9415-8977916e4e05 req-3620be68-5a1d-48ca-83c0-2c8de312d3f1 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:27.190019 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-13424af3-7fe0-4f3f-9415-8977916e4e05 req-3620be68-5a1d-48ca-83c0-2c8de312d3f1 service nova] Creating event network-vif-deleted:1b26226c-e43f-47fe-8c11-13195d33ece3 for instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d on n-h1-843700-1 May 28 04:51:27.197023 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-13424af3-7fe0-4f3f-9415-8977916e4e05 req-3620be68-5a1d-48ca-83c0-2c8de312d3f1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034728 May 28 04:51:27.197931 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2152/4192] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:27.205197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-59322432-7e72-4d35-acf4-c4d36fd46a15 req-edf0828d-74f8-4b17-8bc1-e0d8639962df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4", "name": "network-vif-plugged", "status": "completed", "tag": "9d31f80f-af27-489a-a4e6-accae90d0644"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:27.234494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-59322432-7e72-4d35-acf4-c4d36fd46a15 req-edf0828d-74f8-4b17-8bc1-e0d8639962df service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:27.236283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-59322432-7e72-4d35-acf4-c4d36fd46a15 req-edf0828d-74f8-4b17-8bc1-e0d8639962df service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:27.263759 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-59322432-7e72-4d35-acf4-c4d36fd46a15 req-edf0828d-74f8-4b17-8bc1-e0d8639962df service nova] Creating event network-vif-plugged:9d31f80f-af27-489a-a4e6-accae90d0644 for instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 on n-h1-843700-1 May 28 04:51:27.275310 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-59322432-7e72-4d35-acf4-c4d36fd46a15 req-edf0828d-74f8-4b17-8bc1-e0d8639962df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075863 May 28 04:51:27.279673 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2153/4193] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:27.291711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d8aef56f-6ef8-4b68-b9d8-afa1fd6aa2c9 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:27.292614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d8aef56f-6ef8-4b68-b9d8-afa1fd6aa2c9 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:27.307652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8aef56f-6ef8-4b68-b9d8-afa1fd6aa2c9 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:27.308232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8aef56f-6ef8-4b68-b9d8-afa1fd6aa2c9 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:27.309781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8aef56f-6ef8-4b68-b9d8-afa1fd6aa2c9 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:27.313184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8aef56f-6ef8-4b68-b9d8-afa1fd6aa2c9 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:27.826349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-545399d3-e5eb-4d6b-ab8a-857f7b7a05d0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:27.837081 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-545399d3-e5eb-4d6b-ab8a-857f7b7a05d0 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1666 microversion: 2.1 time: 1.084061 May 28 04:51:27.838037 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2041/4194] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:26 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1666 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:27.844201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-abb789ee-fc36-49fe-a47c-6e2fb9b54d00 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:27.845154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-abb789ee-fc36-49fe-a47c-6e2fb9b54d00 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:27.855283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abb789ee-fc36-49fe-a47c-6e2fb9b54d00 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:27.856119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abb789ee-fc36-49fe-a47c-6e2fb9b54d00 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:27.857162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abb789ee-fc36-49fe-a47c-6e2fb9b54d00 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:27.857827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abb789ee-fc36-49fe-a47c-6e2fb9b54d00 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:28.012212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d8aef56f-6ef8-4b68-b9d8-afa1fd6aa2c9 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:28.020869 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d8aef56f-6ef8-4b68-b9d8-afa1fd6aa2c9 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1334 microversion: 2.1 time: 0.739769 May 28 04:51:28.030614 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2154/4195] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:27 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1334 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:28.037176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-21d49f95-494a-45d3-b724-d937ae176d36 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:28.038682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-21d49f95-494a-45d3-b724-d937ae176d36 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:28.045938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21d49f95-494a-45d3-b724-d937ae176d36 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:28.047342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21d49f95-494a-45d3-b724-d937ae176d36 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:28.048438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21d49f95-494a-45d3-b724-d937ae176d36 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:28.049133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21d49f95-494a-45d3-b724-d937ae176d36 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:28.067599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-abb789ee-fc36-49fe-a47c-6e2fb9b54d00 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:28.078278 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-abb789ee-fc36-49fe-a47c-6e2fb9b54d00 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 200 len: 1367 microversion: 2.1 time: 0.238594 May 28 04:51:28.091404 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2042/4196] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:27 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:28.169905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-92bc51da-6147-47fe-a695-f8120d978648 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:28.170856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-92bc51da-6147-47fe-a695-f8120d978648 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:28.178408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-92bc51da-6147-47fe-a695-f8120d978648 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:28.179196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-92bc51da-6147-47fe-a695-f8120d978648 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:28.180168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-92bc51da-6147-47fe-a695-f8120d978648 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:28.181088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-92bc51da-6147-47fe-a695-f8120d978648 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:28.202042 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-92bc51da-6147-47fe-a695-f8120d978648 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d could not be found. May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-92bc51da-6147-47fe-a695-f8120d978648 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d HTTP/1.1 May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d could not be found. May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '393747a2-794a-4b7a-8c05-a1e99fd68d0d'} May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d could not be found. May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d could not be found. May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:28.207779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:28.212369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:28.212369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:28.212369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:51:28.212369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:51:28.212369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d could not be found. May 28 04:51:28.212369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:28.212369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-92bc51da-6147-47fe-a695-f8120d978648 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:28.212369 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-92bc51da-6147-47fe-a695-f8120d978648 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d" status: 404 len: 111 microversion: 2.1 time: 0.039688 May 28 04:51:28.212369 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2043/4197] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:28 2022] GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:51:28.249651 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-21d49f95-494a-45d3-b724-d937ae176d36 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:28.259202 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-21d49f95-494a-45d3-b724-d937ae176d36 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1518 microversion: 2.1 time: 0.226805 May 28 04:51:28.260203 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2155/4198] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:28 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1518 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:28.286345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0bd3af81-8cae-4fbe-ab2e-a3ece612471d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-796447317", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "fd0d7eb0-eb78-443c-941c-e203b5533601"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:28.340985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-0bd3af81-8cae-4fbe-ab2e-a3ece612471d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] validate_networks() for [('fd0d7eb0-eb78-443c-941c-e203b5533601', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:51:28.784031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0bd3af81-8cae-4fbe-ab2e-a3ece612471d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:51:28.785112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0bd3af81-8cae-4fbe-ab2e-a3ece612471d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:51:28.785679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0bd3af81-8cae-4fbe-ab2e-a3ece612471d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:51:28.786414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0bd3af81-8cae-4fbe-ab2e-a3ece612471d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:51:28.786914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0bd3af81-8cae-4fbe-ab2e-a3ece612471d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:51:28.798355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0bd3af81-8cae-4fbe-ab2e-a3ece612471d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:28.799154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0bd3af81-8cae-4fbe-ab2e-a3ece612471d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:28.800994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0bd3af81-8cae-4fbe-ab2e-a3ece612471d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:28.801464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0bd3af81-8cae-4fbe-ab2e-a3ece612471d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:28.822545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0bd3af81-8cae-4fbe-ab2e-a3ece612471d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Getting quotas for project 724a5513bc2c42eabbefa450e207453e. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:28.829558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0bd3af81-8cae-4fbe-ab2e-a3ece612471d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Getting quotas for user 71b6b3ac5a4249fd8f76fb2e7e2b6c18 and project 724a5513bc2c42eabbefa450e207453e. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:28.845369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0bd3af81-8cae-4fbe-ab2e-a3ece612471d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:51:28.851067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0bd3af81-8cae-4fbe-ab2e-a3ece612471d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:51:28.855255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1b601b82-bea4-4f35-b9a2-b2ae0fa20591 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:28.855900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1b601b82-bea4-4f35-b9a2-b2ae0fa20591 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:28.865857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b601b82-bea4-4f35-b9a2-b2ae0fa20591 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:28.866426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b601b82-bea4-4f35-b9a2-b2ae0fa20591 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:28.879454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b601b82-bea4-4f35-b9a2-b2ae0fa20591 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:28.880187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b601b82-bea4-4f35-b9a2-b2ae0fa20591 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:29.024204 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0bd3af81-8cae-4fbe-ab2e-a3ece612471d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742703 May 28 04:51:29.026909 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2044/4199] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:51:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 04:51:29.044336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d38faa2b-1f7b-4b6d-b4f8-abb35b533db4 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:29.044995 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d38faa2b-1f7b-4b6d-b4f8-abb35b533db4 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:29.059042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d38faa2b-1f7b-4b6d-b4f8-abb35b533db4 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:29.062380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d38faa2b-1f7b-4b6d-b4f8-abb35b533db4 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:29.063477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d38faa2b-1f7b-4b6d-b4f8-abb35b533db4 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:29.076555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d38faa2b-1f7b-4b6d-b4f8-abb35b533db4 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:29.111764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1b601b82-bea4-4f35-b9a2-b2ae0fa20591 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:29.122849 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1b601b82-bea4-4f35-b9a2-b2ae0fa20591 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.271366 May 28 04:51:29.126206 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2156/4200] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:28 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:51:29.137781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7c22ebc0-d11c-4d22-a384-73191def8324 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:29.139967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7c22ebc0-d11c-4d22-a384-73191def8324 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:29.255373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7c22ebc0-d11c-4d22-a384-73191def8324 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:29.281685 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7c22ebc0-d11c-4d22-a384-73191def8324 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 200 len: 1208 microversion: 2.1 time: 0.146153 May 28 04:51:29.282631 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2157/4201] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:29 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 1208 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:29.307128 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3dcd84be-4561-4273-8ffc-9c62a3a4f873 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:29.308029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3dcd84be-4561-4273-8ffc-9c62a3a4f873 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:29.321524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3dcd84be-4561-4273-8ffc-9c62a3a4f873 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:29.321995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3dcd84be-4561-4273-8ffc-9c62a3a4f873 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:29.322784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3dcd84be-4561-4273-8ffc-9c62a3a4f873 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:29.323267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3dcd84be-4561-4273-8ffc-9c62a3a4f873 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:29.484002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d38faa2b-1f7b-4b6d-b4f8-abb35b533db4 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:29.496523 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d38faa2b-1f7b-4b6d-b4f8-abb35b533db4 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1334 microversion: 2.1 time: 0.462493 May 28 04:51:29.497054 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2045/4202] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:29 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1334 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:51:29.506069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6f067c1b-5663-4094-a194-0cf6be290ba1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:29.506712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6f067c1b-5663-4094-a194-0cf6be290ba1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:29.521651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f067c1b-5663-4094-a194-0cf6be290ba1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:29.522118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f067c1b-5663-4094-a194-0cf6be290ba1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:29.522914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f067c1b-5663-4094-a194-0cf6be290ba1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:29.527638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f067c1b-5663-4094-a194-0cf6be290ba1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:29.784679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3dcd84be-4561-4273-8ffc-9c62a3a4f873 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:29.812617 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3dcd84be-4561-4273-8ffc-9c62a3a4f873 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 200 len: 1367 microversion: 2.1 time: 0.505496 May 28 04:51:29.823371 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2158/4203] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:29 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 1367 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:29.842877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3ed2a703-90c8-41e4-9bee-a6f9ba0d5d9f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:29.843775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3ed2a703-90c8-41e4-9bee-a6f9ba0d5d9f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:29.852074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ed2a703-90c8-41e4-9bee-a6f9ba0d5d9f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:29.852572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ed2a703-90c8-41e4-9bee-a6f9ba0d5d9f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:29.853933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ed2a703-90c8-41e4-9bee-a6f9ba0d5d9f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:29.855656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ed2a703-90c8-41e4-9bee-a6f9ba0d5d9f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:29.895435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6f067c1b-5663-4094-a194-0cf6be290ba1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:29.907589 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6f067c1b-5663-4094-a194-0cf6be290ba1 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.409328 May 28 04:51:29.908198 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2046/4204] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:29 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:29.916753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-42130337-b1bf-4d42-8c6a-e1eac1497800 req-7cbc7a1c-e42d-41a2-b5fc-97cd9c6e5598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4", "name": "network-vif-plugged", "status": "completed", "tag": "f90a2baf-c4c2-4dc5-ade8-ffd48f97158c"}, {"server_uuid": "50d15725-d599-410b-8d4d-d4460a1d96b6", "name": "network-vif-plugged", "status": "completed", "tag": "1ff2e3fd-f7ce-4fff-a4eb-cb1552874f44"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:29.947220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-42130337-b1bf-4d42-8c6a-e1eac1497800 req-7cbc7a1c-e42d-41a2-b5fc-97cd9c6e5598 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:29.948196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-42130337-b1bf-4d42-8c6a-e1eac1497800 req-7cbc7a1c-e42d-41a2-b5fc-97cd9c6e5598 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:29.967468 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-42130337-b1bf-4d42-8c6a-e1eac1497800 req-7cbc7a1c-e42d-41a2-b5fc-97cd9c6e5598 service nova] Creating event network-vif-plugged:f90a2baf-c4c2-4dc5-ade8-ffd48f97158c for instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 on n-h1-843700-1 May 28 04:51:29.968261 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-42130337-b1bf-4d42-8c6a-e1eac1497800 req-7cbc7a1c-e42d-41a2-b5fc-97cd9c6e5598 service nova] Creating event network-vif-plugged:1ff2e3fd-f7ce-4fff-a4eb-cb1552874f44 for instance 50d15725-d599-410b-8d4d-d4460a1d96b6 on n-h2-843700-1 May 28 04:51:29.974085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3ed2a703-90c8-41e4-9bee-a6f9ba0d5d9f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:29.980680 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3ed2a703-90c8-41e4-9bee-a6f9ba0d5d9f tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1476 microversion: 2.1 time: 0.155951 May 28 04:51:29.981288 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2159/4205] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:29 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1476 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:29.997692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1035e29a-555d-4fe1-93cf-495457d194b4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:29.998349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1035e29a-555d-4fe1-93cf-495457d194b4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:30.005601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1035e29a-555d-4fe1-93cf-495457d194b4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:30.013386 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-42130337-b1bf-4d42-8c6a-e1eac1497800 req-7cbc7a1c-e42d-41a2-b5fc-97cd9c6e5598 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.098525 May 28 04:51:30.015140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1035e29a-555d-4fe1-93cf-495457d194b4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:30.016505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1035e29a-555d-4fe1-93cf-495457d194b4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:30.016917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1035e29a-555d-4fe1-93cf-495457d194b4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:30.020718 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2047/4206] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:30.046779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-708e7c6c-3c79-4865-ac04-1fa5c93c7c26 req-facf28ce-0446-440d-afe8-8c7b5608071b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c93f52-dc2a-43c2-a82d-43cfee1b58d5", "name": "network-vif-deleted", "tag": "119f2bb6-0470-4ce3-99b9-75bc2c9be087"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:30.077536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-708e7c6c-3c79-4865-ac04-1fa5c93c7c26 req-facf28ce-0446-440d-afe8-8c7b5608071b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:30.078666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-708e7c6c-3c79-4865-ac04-1fa5c93c7c26 req-facf28ce-0446-440d-afe8-8c7b5608071b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:30.101339 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-708e7c6c-3c79-4865-ac04-1fa5c93c7c26 req-facf28ce-0446-440d-afe8-8c7b5608071b service nova] Creating event network-vif-deleted:119f2bb6-0470-4ce3-99b9-75bc2c9be087 for instance 56c93f52-dc2a-43c2-a82d-43cfee1b58d5 on n-h2-843700-1 May 28 04:51:30.106924 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-708e7c6c-3c79-4865-ac04-1fa5c93c7c26 req-facf28ce-0446-440d-afe8-8c7b5608071b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081515 May 28 04:51:30.107767 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2048/4207] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:30.301824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-06dceaae-d0eb-485d-9aa5-42d21fcc1434 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:30.302855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-06dceaae-d0eb-485d-9aa5-42d21fcc1434 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:30.328097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06dceaae-d0eb-485d-9aa5-42d21fcc1434 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:30.328615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06dceaae-d0eb-485d-9aa5-42d21fcc1434 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:30.329739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06dceaae-d0eb-485d-9aa5-42d21fcc1434 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:30.329917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06dceaae-d0eb-485d-9aa5-42d21fcc1434 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:30.491581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-06dceaae-d0eb-485d-9aa5-42d21fcc1434 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:30.501295 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-06dceaae-d0eb-485d-9aa5-42d21fcc1434 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 200 len: 1212 microversion: 2.1 time: 0.204908 May 28 04:51:30.515248 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2049/4208] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:30 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 1212 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:30.528180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d25edb09-fdc7-4153-aa55-76db75383d2a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:30.537249 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d25edb09-fdc7-4153-aa55-76db75383d2a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:30.543688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d25edb09-fdc7-4153-aa55-76db75383d2a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:30.545804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d25edb09-fdc7-4153-aa55-76db75383d2a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:30.546981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d25edb09-fdc7-4153-aa55-76db75383d2a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:30.551213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d25edb09-fdc7-4153-aa55-76db75383d2a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:30.557611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1035e29a-555d-4fe1-93cf-495457d194b4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:30.571179 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1035e29a-555d-4fe1-93cf-495457d194b4 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.576249 May 28 04:51:30.583958 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2160/4209] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:29 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:30.591788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-014c892a-ecee-4aef-9775-8efbd6453004 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:30.602770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-014c892a-ecee-4aef-9775-8efbd6453004 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:30.610346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-014c892a-ecee-4aef-9775-8efbd6453004 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:30.611280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-014c892a-ecee-4aef-9775-8efbd6453004 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:30.612079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-014c892a-ecee-4aef-9775-8efbd6453004 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:30.613055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-014c892a-ecee-4aef-9775-8efbd6453004 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:30.955589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-014c892a-ecee-4aef-9775-8efbd6453004 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:30.969573 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-014c892a-ecee-4aef-9775-8efbd6453004 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.383895 May 28 04:51:30.970206 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2161/4210] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:30 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:30.979917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d25edb09-fdc7-4153-aa55-76db75383d2a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:30.988151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-03decbef-a102-4a6d-9c6e-813178c3a232 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:30.988777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-03decbef-a102-4a6d-9c6e-813178c3a232 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:30.998776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03decbef-a102-4a6d-9c6e-813178c3a232 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:30.999360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03decbef-a102-4a6d-9c6e-813178c3a232 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:30.999475 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d25edb09-fdc7-4153-aa55-76db75383d2a tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1334 microversion: 2.1 time: 0.481430 May 28 04:51:31.000043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03decbef-a102-4a6d-9c6e-813178c3a232 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:31.000490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03decbef-a102-4a6d-9c6e-813178c3a232 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:31.001097 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2050/4211] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:30 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1334 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:31.015680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:31.021025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7889f609-1db0-42c6-82ba-7ca340131589 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:31.022680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7889f609-1db0-42c6-82ba-7ca340131589 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:31.038145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7889f609-1db0-42c6-82ba-7ca340131589 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:31.039004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7889f609-1db0-42c6-82ba-7ca340131589 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:31.041673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7889f609-1db0-42c6-82ba-7ca340131589 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:31.044697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7889f609-1db0-42c6-82ba-7ca340131589 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:31.335443 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-03decbef-a102-4a6d-9c6e-813178c3a232 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:31.350764 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-03decbef-a102-4a6d-9c6e-813178c3a232 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 200 len: 1367 microversion: 2.1 time: 0.371011 May 28 04:51:31.351489 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2162/4212] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:30 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:31.368085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cc2bbfbf-cae4-4444-9c49-8e93d8573fd0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:31.369994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cc2bbfbf-cae4-4444-9c49-8e93d8573fd0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:31.379543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7889f609-1db0-42c6-82ba-7ca340131589 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:31.384345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc2bbfbf-cae4-4444-9c49-8e93d8573fd0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:31.385375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc2bbfbf-cae4-4444-9c49-8e93d8573fd0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:31.386409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc2bbfbf-cae4-4444-9c49-8e93d8573fd0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:31.387382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc2bbfbf-cae4-4444-9c49-8e93d8573fd0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:31.391358 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7889f609-1db0-42c6-82ba-7ca340131589 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.382277 May 28 04:51:31.392350 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2051/4213] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:31 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:31.413554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c7dee4c9-cdaf-4c65-9563-870344671a8f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:31.413554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c7dee4c9-cdaf-4c65-9563-870344671a8f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:31.422153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7dee4c9-cdaf-4c65-9563-870344671a8f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:31.422612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7dee4c9-cdaf-4c65-9563-870344671a8f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:31.423447 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7dee4c9-cdaf-4c65-9563-870344671a8f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:31.423891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7dee4c9-cdaf-4c65-9563-870344671a8f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:31.457522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc2bbfbf-cae4-4444-9c49-8e93d8573fd0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:31.460619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc2bbfbf-cae4-4444-9c49-8e93d8573fd0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:31.471523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-cc2bbfbf-cae4-4444-9c49-8e93d8573fd0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lazy-loading 'fault' on Instance uuid 56c93f52-dc2a-43c2-a82d-43cfee1b58d5 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:51:31.473554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-c7dee4c9-cdaf-4c65-9563-870344671a8f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lazy-loading 'flavor' on Instance uuid 215a4357-1792-4f6e-ae11-f8574b806b73 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:51:31.560342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cc2bbfbf-cae4-4444-9c49-8e93d8573fd0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dbd63fc217411493fc6f2f337949c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666dc141a00a4376893f7244fc10c61b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:31.572099 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cc2bbfbf-cae4-4444-9c49-8e93d8573fd0 tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 200 len: 1311 microversion: 2.1 time: 0.217884 May 28 04:51:31.572945 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2163/4214] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:31 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 1311 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:31.577996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-88b5a4b0-452c-4a00-b4d8-181b31c1c97d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:31.578663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-88b5a4b0-452c-4a00-b4d8-181b31c1c97d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:31.585959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-88b5a4b0-452c-4a00-b4d8-181b31c1c97d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:31.586492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-88b5a4b0-452c-4a00-b4d8-181b31c1c97d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:31.587656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-88b5a4b0-452c-4a00-b4d8-181b31c1c97d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:31.588620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-88b5a4b0-452c-4a00-b4d8-181b31c1c97d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:31.690191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-88b5a4b0-452c-4a00-b4d8-181b31c1c97d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:31.699271 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-88b5a4b0-452c-4a00-b4d8-181b31c1c97d tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 200 len: 1260 microversion: 2.1 time: 0.125060 May 28 04:51:31.700151 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2164/4215] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:31 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 1260 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:31.872875 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c7dee4c9-cdaf-4c65-9563-870344671a8f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action" status: 202 len: 0 microversion: 2.1 time: 0.463854 May 28 04:51:31.876362 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2052/4216] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:51:31 2022] POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:51:31.882724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d7bd02d1-d60d-446e-8ac0-ae0e22079a3c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:31.883483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d7bd02d1-d60d-446e-8ac0-ae0e22079a3c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:31.891125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7bd02d1-d60d-446e-8ac0-ae0e22079a3c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:31.891531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7bd02d1-d60d-446e-8ac0-ae0e22079a3c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:31.895462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7bd02d1-d60d-446e-8ac0-ae0e22079a3c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:31.895932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7bd02d1-d60d-446e-8ac0-ae0e22079a3c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:32.027502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8620904c-1c30-4c01-a677-40a536874afc tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:32.029398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8620904c-1c30-4c01-a677-40a536874afc tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:32.041611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8620904c-1c30-4c01-a677-40a536874afc tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:32.043613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8620904c-1c30-4c01-a677-40a536874afc tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:32.047960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8620904c-1c30-4c01-a677-40a536874afc tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:32.052602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8620904c-1c30-4c01-a677-40a536874afc tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:32.149463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d7bd02d1-d60d-446e-8ac0-ae0e22079a3c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:32.161645 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d7bd02d1-d60d-446e-8ac0-ae0e22079a3c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1678 microversion: 2.1 time: 0.283695 May 28 04:51:32.162699 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2165/4217] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:31 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1678 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:32.295784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8620904c-1c30-4c01-a677-40a536874afc tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:32.304193 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8620904c-1c30-4c01-a677-40a536874afc tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1669 microversion: 2.1 time: 0.283982 May 28 04:51:32.305773 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2053/4218] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:32 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1669 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:32.322427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-48bc5e77-497b-47f1-85b3-5bfeaf7bc944 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:32.323242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-48bc5e77-497b-47f1-85b3-5bfeaf7bc944 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:32.329735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48bc5e77-497b-47f1-85b3-5bfeaf7bc944 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:32.330426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48bc5e77-497b-47f1-85b3-5bfeaf7bc944 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:32.335089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48bc5e77-497b-47f1-85b3-5bfeaf7bc944 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:32.335089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48bc5e77-497b-47f1-85b3-5bfeaf7bc944 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:32.373683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f8a8023f-fa3d-449c-bb98-41437c360c2c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:32.374324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f8a8023f-fa3d-449c-bb98-41437c360c2c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:32.387786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8a8023f-fa3d-449c-bb98-41437c360c2c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:32.388557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8a8023f-fa3d-449c-bb98-41437c360c2c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:32.390070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8a8023f-fa3d-449c-bb98-41437c360c2c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:32.390677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8a8023f-fa3d-449c-bb98-41437c360c2c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:32.401984 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-48bc5e77-497b-47f1-85b3-5bfeaf7bc944 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4/ips" status: 200 len: 179 microversion: 2.1 time: 0.084269 May 28 04:51:32.403093 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2166/4219] 10.222.0.58 () {58 vars in 1247 bytes} [Sat May 28 04:51:32 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4/ips => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:32.417027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2c235c92-b6af-41cf-8359-f21077703939 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:32.419956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2c235c92-b6af-41cf-8359-f21077703939 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:32.436651 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c235c92-b6af-41cf-8359-f21077703939 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:32.437391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c235c92-b6af-41cf-8359-f21077703939 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:32.438408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c235c92-b6af-41cf-8359-f21077703939 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:32.442719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c235c92-b6af-41cf-8359-f21077703939 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:32.493585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2c235c92-b6af-41cf-8359-f21077703939 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:51:32.787723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f8a8023f-fa3d-449c-bb98-41437c360c2c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:32.797365 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f8a8023f-fa3d-449c-bb98-41437c360c2c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 200 len: 1556 microversion: 2.1 time: 0.429434 May 28 04:51:32.808772 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2054/4220] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:32 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 1556 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:32.816523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6f99b80e-9db8-4cca-8d49-5eac6692bc7e tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:32.817425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6f99b80e-9db8-4cca-8d49-5eac6692bc7e tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] [instance: 56c93f52-dc2a-43c2-a82d-43cfee1b58d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:32.825981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f99b80e-9db8-4cca-8d49-5eac6692bc7e tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:32.826940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f99b80e-9db8-4cca-8d49-5eac6692bc7e tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:32.828083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f99b80e-9db8-4cca-8d49-5eac6692bc7e tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:32.829275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f99b80e-9db8-4cca-8d49-5eac6692bc7e tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:32.846394 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:32.870350 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-6f99b80e-9db8-4cca-8d49-5eac6692bc7e tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] HTTP exception thrown: Instance 56c93f52-dc2a-43c2-a82d-43cfee1b58d5 could not be found. May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6f99b80e-9db8-4cca-8d49-5eac6692bc7e tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Request method failure captured: May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 HTTP/1.1 May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikank67WGxvFpThyyPuU6Gg9B40uK6p1dohOu1BqRnujQJp8a-vDMfh14Ne8j-f8qaamJV7xcW1s0YyTiMiRYJjum5Ruw0czjq5YnAAYXdXVYEaetgU84kn2NbDQc3fGxBt225bisrwLtFsU3Qk1Zo7e3tvQxH-XPpeDxyfCWtqgN9Q4 May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 666dc141a00a4376893f7244fc10c61b May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ListServerFiltersTestJSON-819229249 May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_666dc141a00a4376893f7244fc10c61b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/666dc141a00a4376893f7244fc10c61b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/666dc141a00a4376893f7244fc10c61b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/666dc141a00a4376893f7244fc10c61b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ListServerFiltersTestJSON-819229249 May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 666dc141a00a4376893f7244fc10c61b May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-819229249 May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ListServerFiltersTestJSON-819229249-project May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 16dbd63fc217411493fc6f2f337949c1 May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ListServerFiltersTestJSON-819229249-project May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 56c93f52-dc2a-43c2-a82d-43cfee1b58d5 could not be found. May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '56c93f52-dc2a-43c2-a82d-43cfee1b58d5'} May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56c93f52-dc2a-43c2-a82d-43cfee1b58d5 could not be found. May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56c93f52-dc2a-43c2-a82d-43cfee1b58d5 could not be found. May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:32.872544 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:32.883272 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:32.883272 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:32.883272 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:32.883272 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:51:32.883272 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:51:32.883272 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56c93f52-dc2a-43c2-a82d-43cfee1b58d5 could not be found. May 28 04:51:32.883272 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:32.883272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6f99b80e-9db8-4cca-8d49-5eac6692bc7e tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] Returning 404 to user: Instance 56c93f52-dc2a-43c2-a82d-43cfee1b58d5 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:32.883272 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6f99b80e-9db8-4cca-8d49-5eac6692bc7e tempest-ListServerFiltersTestJSON-819229249 tempest-ListServerFiltersTestJSON-819229249-project] 10.222.0.58 "GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5" status: 404 len: 111 microversion: 2.1 time: 0.064121 May 28 04:51:32.883272 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2055/4221] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:32 2022] GET /compute/v2.1/servers/56c93f52-dc2a-43c2-a82d-43cfee1b58d5 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:51:32.889365 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d314f2be-b425-459d-aa0b-93cc8bb7a334 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:32.890143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d314f2be-b425-459d-aa0b-93cc8bb7a334 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:32.898890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d314f2be-b425-459d-aa0b-93cc8bb7a334 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:32.900459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d314f2be-b425-459d-aa0b-93cc8bb7a334 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:32.902070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d314f2be-b425-459d-aa0b-93cc8bb7a334 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:32.902775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d314f2be-b425-459d-aa0b-93cc8bb7a334 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:33.018069 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2c235c92-b6af-41cf-8359-f21077703939 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 204 len: 0 microversion: 2.1 time: 0.604685 May 28 04:51:33.018708 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2167/4222] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:51:32 2022] DELETE /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:51:33.024921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f772a2ae-6de4-4c5b-b314-c58ce98cf178 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:33.025576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f772a2ae-6de4-4c5b-b314-c58ce98cf178 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:33.042674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f772a2ae-6de4-4c5b-b314-c58ce98cf178 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:33.043643 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f772a2ae-6de4-4c5b-b314-c58ce98cf178 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:33.044496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f772a2ae-6de4-4c5b-b314-c58ce98cf178 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:33.044949 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f772a2ae-6de4-4c5b-b314-c58ce98cf178 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:33.079110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d314f2be-b425-459d-aa0b-93cc8bb7a334 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:33.085188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:33.090514 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d314f2be-b425-459d-aa0b-93cc8bb7a334 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 200 len: 1266 microversion: 2.1 time: 0.205409 May 28 04:51:33.098568 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2056/4223] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:32 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:33.104120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-de72fa16-20fe-4288-855e-8233db759ae5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:33.108083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-de72fa16-20fe-4288-855e-8233db759ae5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:33.117893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de72fa16-20fe-4288-855e-8233db759ae5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:33.118786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de72fa16-20fe-4288-855e-8233db759ae5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:33.120093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de72fa16-20fe-4288-855e-8233db759ae5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:33.121318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de72fa16-20fe-4288-855e-8233db759ae5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:33.384371 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f772a2ae-6de4-4c5b-b314-c58ce98cf178 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.363549 May 28 04:51:33.384990 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2168/4224] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 04:51:33 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-interface => generated 284 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:33.403723 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-300832ad-0f9a-44ad-a27e-8fbc067592b7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:33.404639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-300832ad-0f9a-44ad-a27e-8fbc067592b7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:33.411317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-300832ad-0f9a-44ad-a27e-8fbc067592b7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:33.415805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-300832ad-0f9a-44ad-a27e-8fbc067592b7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:33.416903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-300832ad-0f9a-44ad-a27e-8fbc067592b7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:33.417746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-300832ad-0f9a-44ad-a27e-8fbc067592b7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:33.786087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-de72fa16-20fe-4288-855e-8233db759ae5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:33.794369 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-de72fa16-20fe-4288-855e-8233db759ae5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1675 microversion: 2.1 time: 0.694209 May 28 04:51:33.795697 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2057/4225] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:33 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1675 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:34.118364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dbe97688-fbf2-4b8c-891b-d75d0b3ed79a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:34.119716 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dbe97688-fbf2-4b8c-891b-d75d0b3ed79a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:34.135880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dbe97688-fbf2-4b8c-891b-d75d0b3ed79a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:34.136858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dbe97688-fbf2-4b8c-891b-d75d0b3ed79a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:34.139317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dbe97688-fbf2-4b8c-891b-d75d0b3ed79a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:34.139760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dbe97688-fbf2-4b8c-891b-d75d0b3ed79a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:34.595143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dbe97688-fbf2-4b8c-891b-d75d0b3ed79a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:34.610224 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dbe97688-fbf2-4b8c-891b-d75d0b3ed79a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 200 len: 1266 microversion: 2.1 time: 0.496861 May 28 04:51:34.620266 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2058/4226] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:34 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 1266 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:34.687576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-300832ad-0f9a-44ad-a27e-8fbc067592b7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:34.703762 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-300832ad-0f9a-44ad-a27e-8fbc067592b7 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1661 microversion: 2.1 time: 1.316181 May 28 04:51:34.706582 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2169/4227] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:33 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1661 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:34.725219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b979dfe5-367b-47f0-91d3-88e45c474cb3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:34.725772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b979dfe5-367b-47f0-91d3-88e45c474cb3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:34.742810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b979dfe5-367b-47f0-91d3-88e45c474cb3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:34.743315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b979dfe5-367b-47f0-91d3-88e45c474cb3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:34.744310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b979dfe5-367b-47f0-91d3-88e45c474cb3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:34.744916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b979dfe5-367b-47f0-91d3-88e45c474cb3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:34.812071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fbbfa1cc-127a-4d4a-93b3-b3a48bb6bf10 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:34.826949 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fbbfa1cc-127a-4d4a-93b3-b3a48bb6bf10 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:34.831467 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fbbfa1cc-127a-4d4a-93b3-b3a48bb6bf10 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:34.832041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fbbfa1cc-127a-4d4a-93b3-b3a48bb6bf10 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:34.832958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fbbfa1cc-127a-4d4a-93b3-b3a48bb6bf10 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:34.833589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fbbfa1cc-127a-4d4a-93b3-b3a48bb6bf10 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:35.110659 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b979dfe5-367b-47f0-91d3-88e45c474cb3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action" status: 202 len: 0 microversion: 2.1 time: 0.389729 May 28 04:51:35.126050 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2059/4228] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:51:34 2022] POST /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:51:35.135171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dab7536c-c8b9-407c-b8e2-b700cb830c9e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:35.139624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dab7536c-c8b9-407c-b8e2-b700cb830c9e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:35.147098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dab7536c-c8b9-407c-b8e2-b700cb830c9e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:35.147557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dab7536c-c8b9-407c-b8e2-b700cb830c9e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:35.148330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dab7536c-c8b9-407c-b8e2-b700cb830c9e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:35.148941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dab7536c-c8b9-407c-b8e2-b700cb830c9e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:35.547459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fbbfa1cc-127a-4d4a-93b3-b3a48bb6bf10 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:35.576751 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fbbfa1cc-127a-4d4a-93b3-b3a48bb6bf10 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1675 microversion: 2.1 time: 0.766683 May 28 04:51:35.587892 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2170/4229] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:34 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1675 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:35.627558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9e00a73c-605f-4c8f-be3a-6700bf730800 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:35.628746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9e00a73c-605f-4c8f-be3a-6700bf730800 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:35.644112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e00a73c-605f-4c8f-be3a-6700bf730800 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:35.652045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e00a73c-605f-4c8f-be3a-6700bf730800 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:35.652045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e00a73c-605f-4c8f-be3a-6700bf730800 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:35.652045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e00a73c-605f-4c8f-be3a-6700bf730800 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:36.244446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dab7536c-c8b9-407c-b8e2-b700cb830c9e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:36.254916 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dab7536c-c8b9-407c-b8e2-b700cb830c9e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1667 microversion: 2.1 time: 1.125479 May 28 04:51:36.260056 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2060/4230] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:35 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1667 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:36.384905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9e00a73c-605f-4c8f-be3a-6700bf730800 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:36.406190 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9e00a73c-605f-4c8f-be3a-6700bf730800 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 200 len: 1308 microversion: 2.1 time: 0.782533 May 28 04:51:36.422680 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2171/4231] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:35 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 1308 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:51:36.601264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a6193a58-e946-4026-8641-950c42926ea9 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:36.608169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a6193a58-e946-4026-8641-950c42926ea9 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:36.628625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6193a58-e946-4026-8641-950c42926ea9 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:36.629089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6193a58-e946-4026-8641-950c42926ea9 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:36.629907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6193a58-e946-4026-8641-950c42926ea9 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:36.640510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6193a58-e946-4026-8641-950c42926ea9 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:36.957215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-67d30bb3-1c25-44ea-9305-032286f786f9 req-15c00e1a-3069-4d0e-8440-9288fc50500d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50d15725-d599-410b-8d4d-d4460a1d96b6", "tag": "1ff2e3fd-f7ce-4fff-a4eb-cb1552874f44"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:36.968728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-67d30bb3-1c25-44ea-9305-032286f786f9 req-15c00e1a-3069-4d0e-8440-9288fc50500d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:36.969490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-67d30bb3-1c25-44ea-9305-032286f786f9 req-15c00e1a-3069-4d0e-8440-9288fc50500d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:36.984303 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-67d30bb3-1c25-44ea-9305-032286f786f9 req-15c00e1a-3069-4d0e-8440-9288fc50500d service nova] Creating event network-changed:1ff2e3fd-f7ce-4fff-a4eb-cb1552874f44 for instance 50d15725-d599-410b-8d4d-d4460a1d96b6 on n-h2-843700-1 May 28 04:51:36.989956 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-67d30bb3-1c25-44ea-9305-032286f786f9 req-15c00e1a-3069-4d0e-8440-9288fc50500d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038956 May 28 04:51:36.991184 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2172/4232] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:51:37.032548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a6193a58-e946-4026-8641-950c42926ea9 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:37.047768 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a6193a58-e946-4026-8641-950c42926ea9 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1675 microversion: 2.1 time: 0.455184 May 28 04:51:37.051360 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2061/4233] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:36 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1675 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:37.274867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cef2266e-c4b3-4872-bbd3-3c24e221a105 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:37.275993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cef2266e-c4b3-4872-bbd3-3c24e221a105 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:37.289613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cef2266e-c4b3-4872-bbd3-3c24e221a105 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:37.292682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cef2266e-c4b3-4872-bbd3-3c24e221a105 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:37.296121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cef2266e-c4b3-4872-bbd3-3c24e221a105 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:37.296705 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cef2266e-c4b3-4872-bbd3-3c24e221a105 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:37.426844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-49c39f4c-689f-4e87-9ec3-47f41d837287 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:37.428644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-49c39f4c-689f-4e87-9ec3-47f41d837287 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:37.438729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49c39f4c-689f-4e87-9ec3-47f41d837287 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:37.439403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49c39f4c-689f-4e87-9ec3-47f41d837287 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:37.440676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49c39f4c-689f-4e87-9ec3-47f41d837287 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:37.442320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49c39f4c-689f-4e87-9ec3-47f41d837287 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:37.836869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cef2266e-c4b3-4872-bbd3-3c24e221a105 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:37.846976 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cef2266e-c4b3-4872-bbd3-3c24e221a105 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.577621 May 28 04:51:37.864738 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2173/4234] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:37 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:37.878808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c707b1ae-7974-42ec-a4ac-163418ad591e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:37.879972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c707b1ae-7974-42ec-a4ac-163418ad591e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:37.897764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c707b1ae-7974-42ec-a4ac-163418ad591e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:37.898579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c707b1ae-7974-42ec-a4ac-163418ad591e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:37.899628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c707b1ae-7974-42ec-a4ac-163418ad591e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:37.901928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c707b1ae-7974-42ec-a4ac-163418ad591e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:38.510412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-49c39f4c-689f-4e87-9ec3-47f41d837287 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:38.519334 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-49c39f4c-689f-4e87-9ec3-47f41d837287 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 200 len: 1308 microversion: 2.1 time: 1.097351 May 28 04:51:38.520202 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2062/4235] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:37 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 1308 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:51:38.535179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d8fcb5fe-4341-49be-b7c1-3255a49bb8c3 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:38.536026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d8fcb5fe-4341-49be-b7c1-3255a49bb8c3 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:38.542608 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8fcb5fe-4341-49be-b7c1-3255a49bb8c3 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:38.543302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8fcb5fe-4341-49be-b7c1-3255a49bb8c3 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:38.544248 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8fcb5fe-4341-49be-b7c1-3255a49bb8c3 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:38.544851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8fcb5fe-4341-49be-b7c1-3255a49bb8c3 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:38.660687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c707b1ae-7974-42ec-a4ac-163418ad591e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:38.667201 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c707b1ae-7974-42ec-a4ac-163418ad591e tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1670 microversion: 2.1 time: 0.796600 May 28 04:51:38.669105 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2174/4236] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:37 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1670 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:38.692526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fa5f18bf-9433-4f23-ba6b-62ffc348306b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:38.693681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fa5f18bf-9433-4f23-ba6b-62ffc348306b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:38.701311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa5f18bf-9433-4f23-ba6b-62ffc348306b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:38.702368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa5f18bf-9433-4f23-ba6b-62ffc348306b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:38.705335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa5f18bf-9433-4f23-ba6b-62ffc348306b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:38.707094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa5f18bf-9433-4f23-ba6b-62ffc348306b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:38.747912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fa5f18bf-9433-4f23-ba6b-62ffc348306b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:51:38.757358 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.compute.api [None req-fa5f18bf-9433-4f23-ba6b-62ffc348306b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Working on deleting snapshot 1b493fa8-7ca7-4408-8996-bac50e13c609 from shelved instance... May 28 04:51:38.810888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:38.828733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d8fcb5fe-4341-49be-b7c1-3255a49bb8c3 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:38.841167 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d8fcb5fe-4341-49be-b7c1-3255a49bb8c3 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1654 microversion: 2.1 time: 0.310247 May 28 04:51:38.842051 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2063/4237] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:38 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1654 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:39.030330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-a4f0351a-90d0-4fd3-9475-b8c591933124 req-44ed7954-2732-4c8b-8e5e-4e85a4093648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4", "name": "network-vif-deleted", "tag": "f90a2baf-c4c2-4dc5-ade8-ffd48f97158c"}, {"name": "network-changed", "server_uuid": "7698dfa6-fcc6-4aa9-869b-8772a97b29ff", "tag": "15aefd5c-55f0-4099-b383-523379318b22"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:39.034550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:39.043203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a4f0351a-90d0-4fd3-9475-b8c591933124 req-44ed7954-2732-4c8b-8e5e-4e85a4093648 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:39.051284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a4f0351a-90d0-4fd3-9475-b8c591933124 req-44ed7954-2732-4c8b-8e5e-4e85a4093648 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:39.059521 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-a4f0351a-90d0-4fd3-9475-b8c591933124 req-44ed7954-2732-4c8b-8e5e-4e85a4093648 service nova] Creating event network-vif-deleted:f90a2baf-c4c2-4dc5-ade8-ffd48f97158c for instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 on n-h1-843700-1 May 28 04:51:39.060304 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-a4f0351a-90d0-4fd3-9475-b8c591933124 req-44ed7954-2732-4c8b-8e5e-4e85a4093648 service nova] Creating event network-changed:15aefd5c-55f0-4099-b383-523379318b22 for instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff on n-h1-843700-1 May 28 04:51:39.070887 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-a4f0351a-90d0-4fd3-9475-b8c591933124 req-44ed7954-2732-4c8b-8e5e-4e85a4093648 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.048629 May 28 04:51:39.071545 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2064/4238] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:51:39.260441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:39.649310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-950f9971-9f75-4f2d-98f5-896550a6db6e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-980310574", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "aa00a74f-7361-4532-a5cc-72e0389ed51f"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:39.703095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-950f9971-9f75-4f2d-98f5-896550a6db6e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] validate_networks() for [('aa00a74f-7361-4532-a5cc-72e0389ed51f', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:51:40.077027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-950f9971-9f75-4f2d-98f5-896550a6db6e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:51:40.077477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-950f9971-9f75-4f2d-98f5-896550a6db6e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:51:40.077968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-950f9971-9f75-4f2d-98f5-896550a6db6e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:51:40.078363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-950f9971-9f75-4f2d-98f5-896550a6db6e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:51:40.078787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-950f9971-9f75-4f2d-98f5-896550a6db6e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:51:40.087822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-950f9971-9f75-4f2d-98f5-896550a6db6e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:40.088416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-950f9971-9f75-4f2d-98f5-896550a6db6e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:40.089220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-950f9971-9f75-4f2d-98f5-896550a6db6e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:40.089661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-950f9971-9f75-4f2d-98f5-896550a6db6e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:40.108077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-950f9971-9f75-4f2d-98f5-896550a6db6e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Getting quotas for project 9ac87488ec1b4944a056d28d154eede5. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:40.120010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-950f9971-9f75-4f2d-98f5-896550a6db6e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Getting quotas for user 6c1ff365f86047dcb5ba2ad991a29e81 and project 9ac87488ec1b4944a056d28d154eede5. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:40.135382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-950f9971-9f75-4f2d-98f5-896550a6db6e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Going to run 2 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:51:40.137803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-950f9971-9f75-4f2d-98f5-896550a6db6e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 4401f4bf-a185-4bf8-b99c-30104fd8e26e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:51:40.274704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-950f9971-9f75-4f2d-98f5-896550a6db6e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=4401f4bf-a185-4bf8-b99c-30104fd8e26e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:51:40.311599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fa5f18bf-9433-4f23-ba6b-62ffc348306b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Doing local delete in cell 8c12a9b9-d304-4763-b71f-4058d5ce2ded(cell1) {{(pid=126044) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 28 04:51:40.312520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa5f18bf-9433-4f23-ba6b-62ffc348306b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:40.312982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa5f18bf-9433-4f23-ba6b-62ffc348306b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:40.316262 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.compute.api [None req-fa5f18bf-9433-4f23-ba6b-62ffc348306b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 28 04:51:40.318900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-fa5f18bf-9433-4f23-ba6b-62ffc348306b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] deallocate_for_instance() {{(pid=126044) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} May 28 04:51:40.439457 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-950f9971-9f75-4f2d-98f5-896550a6db6e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.925855 May 28 04:51:40.440428 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2065/4239] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:51:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:51:40.445474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-238e13bf-e53e-48e1-bdf6-e8d206506576 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:40.446092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-238e13bf-e53e-48e1-bdf6-e8d206506576 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:40.454686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-238e13bf-e53e-48e1-bdf6-e8d206506576 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:40.455176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-238e13bf-e53e-48e1-bdf6-e8d206506576 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:40.457027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-238e13bf-e53e-48e1-bdf6-e8d206506576 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:40.457509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-238e13bf-e53e-48e1-bdf6-e8d206506576 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:40.695105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-238e13bf-e53e-48e1-bdf6-e8d206506576 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:40.702577 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-238e13bf-e53e-48e1-bdf6-e8d206506576 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 200 len: 1308 microversion: 2.1 time: 0.261178 May 28 04:51:40.703186 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2066/4240] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:40 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 1308 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:40.707613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e4748be3-8f48-4f7b-b379-09cfcb0f7bd5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:40.708220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e4748be3-8f48-4f7b-b379-09cfcb0f7bd5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:40.714034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4748be3-8f48-4f7b-b379-09cfcb0f7bd5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:40.714484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4748be3-8f48-4f7b-b379-09cfcb0f7bd5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:40.715271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4748be3-8f48-4f7b-b379-09cfcb0f7bd5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:40.715709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4748be3-8f48-4f7b-b379-09cfcb0f7bd5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:40.747415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4748be3-8f48-4f7b-b379-09cfcb0f7bd5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:40.747869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4748be3-8f48-4f7b-b379-09cfcb0f7bd5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:40.748320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-e4748be3-8f48-4f7b-b379-09cfcb0f7bd5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lazy-loading 'fault' on Instance uuid 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:51:40.814279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e4748be3-8f48-4f7b-b379-09cfcb0f7bd5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd8bc74fda8476692c24f7c8b8f4b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07539e283643c6b7bdc2c90ffa2ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:40.822710 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e4748be3-8f48-4f7b-b379-09cfcb0f7bd5 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 200 len: 1303 microversion: 2.1 time: 0.118528 May 28 04:51:40.823340 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2067/4241] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:40 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 1303 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:40.828605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7bdc0e5d-32b8-4ddf-a49f-869a7483a4db tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:40.831965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7bdc0e5d-32b8-4ddf-a49f-869a7483a4db tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:40.835904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7bdc0e5d-32b8-4ddf-a49f-869a7483a4db tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Searching by: {'deleted': False, 'project_id': '9ac87488ec1b4944a056d28d154eede5'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:51:40.849817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7bdc0e5d-32b8-4ddf-a49f-869a7483a4db tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:40.850273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7bdc0e5d-32b8-4ddf-a49f-869a7483a4db tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:40.851127 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7bdc0e5d-32b8-4ddf-a49f-869a7483a4db tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:40.851854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7bdc0e5d-32b8-4ddf-a49f-869a7483a4db tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:40.887173 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7bdc0e5d-32b8-4ddf-a49f-869a7483a4db tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.062547 May 28 04:51:40.887774 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2068/4242] 10.222.0.58 () {58 vars in 1124 bytes} [Sat May 28 04:51:40 2022] GET /compute/v2.1/servers => generated 675 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:41.010103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-47155581-18eb-4190-b6a2-c71206b0dc48 tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-632466335", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:41.010240 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-47155581-18eb-4190-b6a2-c71206b0dc48 tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] HTTP exception thrown: min_count must be <= max_count May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-47155581-18eb-4190-b6a2-c71206b0dc48 tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] Request method failure captured: May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 183 May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikapcnceLuB5ZSDFijgKQZnu3kyaxhSp8ELHnwhfuHgczHKVv7vGO14ZrEbpI_5vA8VVQVxjCNtWSEcYALEU_1KMlDpHoKKwXI9jX93nZ8vI3I4bu_M5P9vbZDUMeB-4a05IABTUaT5EJsF18uMnbn3ksKs0Tw7uzoHSumtqZ_jNdpvk May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: ab03d00d1b8647f28defee3a856124fe May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1287634747 May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ab03d00d1b8647f28defee3a856124fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ab03d00d1b8647f28defee3a856124fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab03d00d1b8647f28defee3a856124fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab03d00d1b8647f28defee3a856124fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1287634747 May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: ab03d00d1b8647f28defee3a856124fe May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1287634747 May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-MultipleCreateNegativeTestJSON-1287634747-project May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 67367b93de414381a877ea83c7b865f1 May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1287634747-project May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-632466335", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "min_count": 3, "max_count": 2}} May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: exception: min_count must be <= max_count May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-632466335', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count May 28 04:51:41.011792 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.017460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-47155581-18eb-4190-b6a2-c71206b0dc48 tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] Returning 400 to user: min_count must be <= max_count {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:41.019377 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-47155581-18eb-4190-b6a2-c71206b0dc48 tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.130639 May 28 04:51:41.030517 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2069/4243] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:51:40 2022] POST /compute/v2.1/servers => generated 74 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 04:51:41.036590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f21ac1b5-4ba1-4755-8c91-074ef59dfb79 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:41.038900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f21ac1b5-4ba1-4755-8c91-074ef59dfb79 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:41.232004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f21ac1b5-4ba1-4755-8c91-074ef59dfb79 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:41.242600 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f21ac1b5-4ba1-4755-8c91-074ef59dfb79 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0" status: 200 len: 1219 microversion: 2.1 time: 0.209752 May 28 04:51:41.243818 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2070/4244] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:41 2022] GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0 => generated 1219 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:41.255749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e5441446-15c9-48fa-8465-6abd49beac88 tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1812655418", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "max_count": 0}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e5441446-15c9-48fa-8465-6abd49beac88 tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] Request method failure captured: May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 168 May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikapcnceLuB5ZSDFijgKQZnu3kyaxhSp8ELHnwhfuHgczHKVv7vGO14ZrEbpI_5vA8VVQVxjCNtWSEcYALEU_1KMlDpHoKKwXI9jX93nZ8vI3I4bu_M5P9vbZDUMeB-4a05IABTUaT5EJsF18uMnbn3ksKs0Tw7uzoHSumtqZ_jNdpvk May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: ab03d00d1b8647f28defee3a856124fe May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1287634747 May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ab03d00d1b8647f28defee3a856124fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ab03d00d1b8647f28defee3a856124fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab03d00d1b8647f28defee3a856124fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab03d00d1b8647f28defee3a856124fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1287634747 May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: ab03d00d1b8647f28defee3a856124fe May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1287634747 May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-MultipleCreateNegativeTestJSON-1287634747-project May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 67367b93de414381a877ea83c7b865f1 May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1287634747-project May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1812655418", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "max_count": 0}} May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1812655418', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'max_count': 0}}} May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 0 May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:51:41.262627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:51:41.272887 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:51:41.272887 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:51:41.272887 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:51:41.272887 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:51:41.272887 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 28 04:51:41.272887 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.272887 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:41.272887 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.272887 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:41.272887 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:41.272887 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:41.272887 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:51:41.272887 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:51:41.272887 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 28 04:51:41.272887 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.272887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e5441446-15c9-48fa-8465-6abd49beac88 tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:41.272887 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e5441446-15c9-48fa-8465-6abd49beac88 tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.019646 May 28 04:51:41.272887 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2071/4245] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:51:41 2022] POST /compute/v2.1/servers => generated 130 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:51:41.274103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-263b218e-b7ed-40c3-98f7-0d54b19dc83c req-d0be5937-9a98-40ea-8c2f-06eeddb660f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4", "name": "network-vif-deleted", "tag": "9d31f80f-af27-489a-a4e6-accae90d0644"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:41.281194 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:41.286874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-263b218e-b7ed-40c3-98f7-0d54b19dc83c req-d0be5937-9a98-40ea-8c2f-06eeddb660f0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:41.287433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-263b218e-b7ed-40c3-98f7-0d54b19dc83c req-d0be5937-9a98-40ea-8c2f-06eeddb660f0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:41.299674 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-263b218e-b7ed-40c3-98f7-0d54b19dc83c req-d0be5937-9a98-40ea-8c2f-06eeddb660f0 service nova] Creating event network-vif-deleted:9d31f80f-af27-489a-a4e6-accae90d0644 for instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 on n-h1-843700-1 May 28 04:51:41.300205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-fa5f18bf-9433-4f23-ba6b-62ffc348306b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Updating instance_info_cache with network_info: [] {{(pid=126044) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 04:51:41.312165 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-263b218e-b7ed-40c3-98f7-0d54b19dc83c req-d0be5937-9a98-40ea-8c2f-06eeddb660f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044954 May 28 04:51:41.313258 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2072/4246] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:41.344059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0b8645db-a6d3-4391-984f-348c0645fdb6 tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-721259490", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "max_count": 2.5}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0b8645db-a6d3-4391-984f-348c0645fdb6 tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] Request method failure captured: May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 169 May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikapcnceLuB5ZSDFijgKQZnu3kyaxhSp8ELHnwhfuHgczHKVv7vGO14ZrEbpI_5vA8VVQVxjCNtWSEcYALEU_1KMlDpHoKKwXI9jX93nZ8vI3I4bu_M5P9vbZDUMeB-4a05IABTUaT5EJsF18uMnbn3ksKs0Tw7uzoHSumtqZ_jNdpvk May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: ab03d00d1b8647f28defee3a856124fe May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1287634747 May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ab03d00d1b8647f28defee3a856124fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ab03d00d1b8647f28defee3a856124fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab03d00d1b8647f28defee3a856124fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab03d00d1b8647f28defee3a856124fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1287634747 May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: ab03d00d1b8647f28defee3a856124fe May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1287634747 May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-MultipleCreateNegativeTestJSON-1287634747-project May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 67367b93de414381a877ea83c7b865f1 May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1287634747-project May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-721259490", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "max_count": 2.5}} May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-721259490', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'max_count': 2.5}}} May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 2.5 May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:51:41.349214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:51:41.364659 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:51:41.364659 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:51:41.364659 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:51:41.364659 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:51:41.364659 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 28 04:51:41.364659 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.364659 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:41.364659 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.364659 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:41.364659 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:41.364659 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:41.364659 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:51:41.364659 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:51:41.364659 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 28 04:51:41.364659 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.364659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0b8645db-a6d3-4391-984f-348c0645fdb6 tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:41.364659 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0b8645db-a6d3-4391-984f-348c0645fdb6 tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.016941 May 28 04:51:41.364659 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2073/4247] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:51:41 2022] POST /compute/v2.1/servers => generated 139 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 04:51:41.396831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:41.417516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5f13299b-5140-43f7-aae6-0e91a6408555 tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-734360291", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "min_count": 0}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5f13299b-5140-43f7-aae6-0e91a6408555 tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] Request method failure captured: May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 167 May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikapcnceLuB5ZSDFijgKQZnu3kyaxhSp8ELHnwhfuHgczHKVv7vGO14ZrEbpI_5vA8VVQVxjCNtWSEcYALEU_1KMlDpHoKKwXI9jX93nZ8vI3I4bu_M5P9vbZDUMeB-4a05IABTUaT5EJsF18uMnbn3ksKs0Tw7uzoHSumtqZ_jNdpvk May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: ab03d00d1b8647f28defee3a856124fe May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1287634747 May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ab03d00d1b8647f28defee3a856124fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ab03d00d1b8647f28defee3a856124fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab03d00d1b8647f28defee3a856124fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab03d00d1b8647f28defee3a856124fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1287634747 May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: ab03d00d1b8647f28defee3a856124fe May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1287634747 May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-MultipleCreateNegativeTestJSON-1287634747-project May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 67367b93de414381a877ea83c7b865f1 May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1287634747-project May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-734360291", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "min_count": 0}} May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-734360291', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'min_count': 0}}} May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 0 May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:51:41.420180 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:51:41.425568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:51:41.425568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:51:41.425568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:51:41.425568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 28 04:51:41.425568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.425568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:41.425568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.425568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:41.425568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:41.425568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:41.425568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:51:41.425568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:51:41.425568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 28 04:51:41.425568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.425568 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5f13299b-5140-43f7-aae6-0e91a6408555 tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:41.425568 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5f13299b-5140-43f7-aae6-0e91a6408555 tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.008154 May 28 04:51:41.425568 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2074/4248] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:51:41 2022] POST /compute/v2.1/servers => generated 130 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:51:41.477264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c4e4eea7-9344-4086-8078-ec76c8354ffc tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1666581222", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "min_count": 2.5}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c4e4eea7-9344-4086-8078-ec76c8354ffc tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] Request method failure captured: May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 170 May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikapcnceLuB5ZSDFijgKQZnu3kyaxhSp8ELHnwhfuHgczHKVv7vGO14ZrEbpI_5vA8VVQVxjCNtWSEcYALEU_1KMlDpHoKKwXI9jX93nZ8vI3I4bu_M5P9vbZDUMeB-4a05IABTUaT5EJsF18uMnbn3ksKs0Tw7uzoHSumtqZ_jNdpvk May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: ab03d00d1b8647f28defee3a856124fe May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1287634747 May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ab03d00d1b8647f28defee3a856124fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ab03d00d1b8647f28defee3a856124fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab03d00d1b8647f28defee3a856124fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab03d00d1b8647f28defee3a856124fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1287634747 May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: ab03d00d1b8647f28defee3a856124fe May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1287634747 May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-MultipleCreateNegativeTestJSON-1287634747-project May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 67367b93de414381a877ea83c7b865f1 May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1287634747-project May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1666581222", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "min_count": 2.5}} May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1666581222', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'min_count': 2.5}}} May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 2.5 May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:51:41.488472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:51:41.494826 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:51:41.494826 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:51:41.494826 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:51:41.494826 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:51:41.494826 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 28 04:51:41.494826 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.494826 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:41.494826 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.494826 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:41.494826 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:41.494826 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:41.494826 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:51:41.494826 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:51:41.494826 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 28 04:51:41.494826 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.494826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c4e4eea7-9344-4086-8078-ec76c8354ffc tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:41.494826 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c4e4eea7-9344-4086-8078-ec76c8354ffc tempest-MultipleCreateNegativeTestJSON-1287634747 tempest-MultipleCreateNegativeTestJSON-1287634747-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011338 May 28 04:51:41.504104 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2075/4249] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:51:41 2022] POST /compute/v2.1/servers => generated 139 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 04:51:41.720431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aca96a61-d3a7-4932-8e7b-058c383e5fb2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:41.721172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-aca96a61-d3a7-4932-8e7b-058c383e5fb2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:41.727819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aca96a61-d3a7-4932-8e7b-058c383e5fb2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:41.728276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aca96a61-d3a7-4932-8e7b-058c383e5fb2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:41.729040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aca96a61-d3a7-4932-8e7b-058c383e5fb2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:41.729479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aca96a61-d3a7-4932-8e7b-058c383e5fb2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:41.874274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-aca96a61-d3a7-4932-8e7b-058c383e5fb2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:41.882418 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aca96a61-d3a7-4932-8e7b-058c383e5fb2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 200 len: 1308 microversion: 2.1 time: 0.166644 May 28 04:51:41.883024 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2076/4250] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:41 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 1308 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:51:41.887640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fce95ede-4df0-427d-a892-fe7d5be15b62 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:41.888247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fce95ede-4df0-427d-a892-fe7d5be15b62 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:41.894956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fce95ede-4df0-427d-a892-fe7d5be15b62 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:41.895444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fce95ede-4df0-427d-a892-fe7d5be15b62 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:41.898280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fce95ede-4df0-427d-a892-fe7d5be15b62 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:41.898280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fce95ede-4df0-427d-a892-fe7d5be15b62 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:41.910762 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-fce95ede-4df0-427d-a892-fe7d5be15b62 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] HTTP exception thrown: Instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 could not be found. May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fce95ede-4df0-427d-a892-fe7d5be15b62 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Request method failure captured: May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 HTTP/1.1 May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikanrBR36wNuSduDsTIaCyoOxADcAoT4oILDgO2xMip3ZXY_fh9pAVfjMmuj1IzabigD9ryk48_M9GQQZjPvLvQ90RP4Y62U3rFzJ4OrOlMakdw0pdo-FGPEWnLlnyvgrT6eMUr4sP71nawMUp6ladI-t3msnIDNOVFI9zpjh1nmzsdM May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 8f07539e283643c6b7bdc2c90ffa2ce1 May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersTestMultiNic-2040190249 May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersTestMultiNic-2040190249 May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 8f07539e283643c6b7bdc2c90ffa2ce1 May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersTestMultiNic-2040190249 May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersTestMultiNic-2040190249-project May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 9dd8bc74fda8476692c24f7c8b8f4b1c May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersTestMultiNic-2040190249-project May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 could not be found. May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4'} May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 could not be found. May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 could not be found. May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:41.912382 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.916721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:41.916721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:41.916721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:41.916721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:51:41.916721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:51:41.916721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 could not be found. May 28 04:51:41.916721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:41.916721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fce95ede-4df0-427d-a892-fe7d5be15b62 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Returning 404 to user: Instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:41.916721 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fce95ede-4df0-427d-a892-fe7d5be15b62 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 404 len: 111 microversion: 2.1 time: 0.029809 May 28 04:51:41.916721 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2077/4251] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:41 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:51:42.003717 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fa5f18bf-9433-4f23-ba6b-62ffc348306b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 204 len: 0 microversion: 2.1 time: 3.315683 May 28 04:51:42.004332 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2175/4252] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:51:38 2022] DELETE /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 0 bytes in 3318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:51:42.012366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-43104557-ea0c-4220-8b06-a72f67f9fe30 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:42.013084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-43104557-ea0c-4220-8b06-a72f67f9fe30 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 0a940c92-8dca-4cf5-90a9-d7d617ec9ece] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:42.021065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43104557-ea0c-4220-8b06-a72f67f9fe30 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:42.021805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43104557-ea0c-4220-8b06-a72f67f9fe30 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:42.023618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43104557-ea0c-4220-8b06-a72f67f9fe30 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:42.024330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43104557-ea0c-4220-8b06-a72f67f9fe30 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:42.050938 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-43104557-ea0c-4220-8b06-a72f67f9fe30 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] HTTP exception thrown: Instance 0a940c92-8dca-4cf5-90a9-d7d617ec9ece could not be found. May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-43104557-ea0c-4220-8b06-a72f67f9fe30 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Request method failure captured: May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece HTTP/1.1 May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaiOBPq9qQrr95jSEOmRbogZ9t59pbtlXtSw81aS7-xhKzdjgN5RN9WIUU9s438FP46672OAQzJO5i-wir1g5z9E4w9mqkNRxgW8mIzqzjgGHh1XhcA4EQFEapFLU_4K_QXm_DQQpav1ycUA8keSbjSO649hYoTB4xij7c04YtdKQ_4 May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: b0c48bf20efd4291b37e616c658f96ff May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerActionsTestJSON-1958751992 May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerActionsTestJSON-1958751992 May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: b0c48bf20efd4291b37e616c658f96ff May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1958751992 May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerActionsTestJSON-1958751992-project May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 6272045226334bcf8b49a0aa41a07b95 May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerActionsTestJSON-1958751992-project May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 0a940c92-8dca-4cf5-90a9-d7d617ec9ece could not be found. May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '0a940c92-8dca-4cf5-90a9-d7d617ec9ece'} May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a940c92-8dca-4cf5-90a9-d7d617ec9ece could not be found. May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a940c92-8dca-4cf5-90a9-d7d617ec9ece could not be found. May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:42.053587 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:42.058504 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:42.058504 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:42.058504 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:42.058504 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:51:42.058504 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:51:42.058504 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a940c92-8dca-4cf5-90a9-d7d617ec9ece could not be found. May 28 04:51:42.058504 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:42.058504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-43104557-ea0c-4220-8b06-a72f67f9fe30 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Returning 404 to user: Instance 0a940c92-8dca-4cf5-90a9-d7d617ec9ece could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:42.058504 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-43104557-ea0c-4220-8b06-a72f67f9fe30 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece" status: 404 len: 111 microversion: 2.1 time: 0.046562 May 28 04:51:42.069816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-239139aa-461b-47b5-a6d7-f28eaae8355f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:42.070354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-239139aa-461b-47b5-a6d7-f28eaae8355f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:42.075631 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2078/4253] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:42 2022] GET /compute/v2.1/servers/0a940c92-8dca-4cf5-90a9-d7d617ec9ece => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:51:42.079269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-239139aa-461b-47b5-a6d7-f28eaae8355f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:42.079977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-239139aa-461b-47b5-a6d7-f28eaae8355f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:42.082238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-239139aa-461b-47b5-a6d7-f28eaae8355f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:42.082839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-239139aa-461b-47b5-a6d7-f28eaae8355f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:42.113331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-239139aa-461b-47b5-a6d7-f28eaae8355f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:51:42.259646 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-86f85ada-cf17-489d-b951-31d714c0ec26 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:42.260265 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-86f85ada-cf17-489d-b951-31d714c0ec26 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:42.325327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-86f85ada-cf17-489d-b951-31d714c0ec26 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:42.337986 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-86f85ada-cf17-489d-b951-31d714c0ec26 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0" status: 200 len: 1219 microversion: 2.1 time: 0.082132 May 28 04:51:42.370023 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2079/4254] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:42 2022] GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0 => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:51:42.420493 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-239139aa-461b-47b5-a6d7-f28eaae8355f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 204 len: 0 microversion: 2.1 time: 0.360158 May 28 04:51:42.425240 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2176/4255] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:51:42 2022] DELETE /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:51:42.444566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a14401ad-0f8c-48be-96d0-bbcf7a9e75bb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:42.447669 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a14401ad-0f8c-48be-96d0-bbcf7a9e75bb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:42.461144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a14401ad-0f8c-48be-96d0-bbcf7a9e75bb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:42.461611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a14401ad-0f8c-48be-96d0-bbcf7a9e75bb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:42.463148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a14401ad-0f8c-48be-96d0-bbcf7a9e75bb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:42.463815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a14401ad-0f8c-48be-96d0-bbcf7a9e75bb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:42.655691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a14401ad-0f8c-48be-96d0-bbcf7a9e75bb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:42.667204 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a14401ad-0f8c-48be-96d0-bbcf7a9e75bb tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 200 len: 1466 microversion: 2.1 time: 0.231943 May 28 04:51:42.677148 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2080/4256] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:42 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 1466 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:42.905727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f1da320d-b11a-4274-91da-27408aedc603 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:42.906917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f1da320d-b11a-4274-91da-27408aedc603 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:42.928516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f1da320d-b11a-4274-91da-27408aedc603 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:42.928980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f1da320d-b11a-4274-91da-27408aedc603 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:42.929779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f1da320d-b11a-4274-91da-27408aedc603 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:42.936704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f1da320d-b11a-4274-91da-27408aedc603 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:43.114451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f1da320d-b11a-4274-91da-27408aedc603 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:43.136434 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f1da320d-b11a-4274-91da-27408aedc603 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 200 len: 1308 microversion: 2.1 time: 0.240066 May 28 04:51:43.137207 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2177/4257] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:42 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 1308 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:43.335093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b61dcc2e-9652-43c7-9a8e-bbef810c0679 req-b66a6eeb-75a0-4581-b5a5-b26676d4f2bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a940c92-8dca-4cf5-90a9-d7d617ec9ece", "name": "network-vif-deleted", "tag": "d4489fa6-501f-4301-b268-2dded14654a8"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:43.344607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b61dcc2e-9652-43c7-9a8e-bbef810c0679 req-b66a6eeb-75a0-4581-b5a5-b26676d4f2bb service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:43.345237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b61dcc2e-9652-43c7-9a8e-bbef810c0679 req-b66a6eeb-75a0-4581-b5a5-b26676d4f2bb service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:43.358259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.compute.server_external_events [req-b61dcc2e-9652-43c7-9a8e-bbef810c0679 req-b66a6eeb-75a0-4581-b5a5-b26676d4f2bb service nova] Unable to find a host for instance 0a940c92-8dca-4cf5-90a9-d7d617ec9ece. Dropping event network-vif-deleted {{(pid=126043) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 28 04:51:43.359553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3d888c22-41b6-409b-86f8-0531c7546d40 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:43.359553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3d888c22-41b6-409b-86f8-0531c7546d40 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:43.359868 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b61dcc2e-9652-43c7-9a8e-bbef810c0679 req-b66a6eeb-75a0-4581-b5a5-b26676d4f2bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.030366 May 28 04:51:43.360666 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2081/4258] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 28 04:51:43.374360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d888c22-41b6-409b-86f8-0531c7546d40 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:43.374837 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d888c22-41b6-409b-86f8-0531c7546d40 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:43.375652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d888c22-41b6-409b-86f8-0531c7546d40 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:43.376451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d888c22-41b6-409b-86f8-0531c7546d40 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:43.443616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3d888c22-41b6-409b-86f8-0531c7546d40 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:43.452077 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3d888c22-41b6-409b-86f8-0531c7546d40 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0" status: 200 len: 1223 microversion: 2.1 time: 0.099646 May 28 04:51:43.452664 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2178/4259] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:43 2022] GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0 => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:43.684128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f3c7017b-8f94-472f-b316-b066faa9f68b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:43.684769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f3c7017b-8f94-472f-b316-b066faa9f68b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:43.694267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3c7017b-8f94-472f-b316-b066faa9f68b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:43.694267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3c7017b-8f94-472f-b316-b066faa9f68b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:43.694267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3c7017b-8f94-472f-b316-b066faa9f68b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:43.694267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3c7017b-8f94-472f-b316-b066faa9f68b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:43.811344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f3c7017b-8f94-472f-b316-b066faa9f68b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:43.831178 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f3c7017b-8f94-472f-b316-b066faa9f68b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 200 len: 1466 microversion: 2.1 time: 0.150021 May 28 04:51:43.832755 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2082/4260] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:43 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 1466 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:43.938778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-52d2605c-4925-4b7c-9f46-2947fede531a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:43.940293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-52d2605c-4925-4b7c-9f46-2947fede531a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:43.957030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52d2605c-4925-4b7c-9f46-2947fede531a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:43.959279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52d2605c-4925-4b7c-9f46-2947fede531a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:43.963062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52d2605c-4925-4b7c-9f46-2947fede531a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:43.964333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52d2605c-4925-4b7c-9f46-2947fede531a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:44.155821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d5b11f05-77d5-4cee-a136-cb0afdc718ea tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:44.156947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d5b11f05-77d5-4cee-a136-cb0afdc718ea tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:44.167240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5b11f05-77d5-4cee-a136-cb0afdc718ea tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:44.168178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5b11f05-77d5-4cee-a136-cb0afdc718ea tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:44.170146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5b11f05-77d5-4cee-a136-cb0afdc718ea tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:44.170824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5b11f05-77d5-4cee-a136-cb0afdc718ea tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:44.239158 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-52d2605c-4925-4b7c-9f46-2947fede531a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405/action" status: 200 len: 24576 microversion: 2.1 time: 0.305621 May 28 04:51:44.240016 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2179/4261] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:51:43 2022] POST /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405/action => generated 24576 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:51:44.362078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-26599311-6801-46a9-bef4-3673d92d9cc4 req-3c370c46-b58f-465c-8404-c600e5612f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7698dfa6-fcc6-4aa9-869b-8772a97b29ff", "name": "network-vif-plugged", "status": "completed", "tag": "15aefd5c-55f0-4099-b383-523379318b22"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:44.395444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-26599311-6801-46a9-bef4-3673d92d9cc4 req-3c370c46-b58f-465c-8404-c600e5612f37 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:44.396010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-26599311-6801-46a9-bef4-3673d92d9cc4 req-3c370c46-b58f-465c-8404-c600e5612f37 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:44.410593 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-26599311-6801-46a9-bef4-3673d92d9cc4 req-3c370c46-b58f-465c-8404-c600e5612f37 service nova] Creating event network-vif-plugged:15aefd5c-55f0-4099-b383-523379318b22 for instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff on n-h1-843700-1 May 28 04:51:44.416030 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-26599311-6801-46a9-bef4-3673d92d9cc4 req-3c370c46-b58f-465c-8404-c600e5612f37 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058097 May 28 04:51:44.420607 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2180/4262] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:44.470036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d5b11f05-77d5-4cee-a136-cb0afdc718ea tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:44.478006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:44.485841 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d5b11f05-77d5-4cee-a136-cb0afdc718ea tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 200 len: 1308 microversion: 2.1 time: 0.335882 May 28 04:51:44.490314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4616154b-36a8-416a-87e5-2f402eedb785 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:44.491689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4616154b-36a8-416a-87e5-2f402eedb785 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:44.498459 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2083/4263] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:44 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 1308 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:44.505656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4616154b-36a8-416a-87e5-2f402eedb785 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:44.506438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4616154b-36a8-416a-87e5-2f402eedb785 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:44.511077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4616154b-36a8-416a-87e5-2f402eedb785 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:44.511593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4616154b-36a8-416a-87e5-2f402eedb785 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:44.702078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4616154b-36a8-416a-87e5-2f402eedb785 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:44.710249 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4616154b-36a8-416a-87e5-2f402eedb785 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0" status: 200 len: 1223 microversion: 2.1 time: 0.224155 May 28 04:51:44.710888 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2181/4264] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:44 2022] GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0 => generated 1223 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:44.783018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-de45a051-f432-40fc-a0e9-13b99e16703a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:44.783803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-de45a051-f432-40fc-a0e9-13b99e16703a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:44.804445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de45a051-f432-40fc-a0e9-13b99e16703a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:44.808856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de45a051-f432-40fc-a0e9-13b99e16703a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:44.809696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de45a051-f432-40fc-a0e9-13b99e16703a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:44.810304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de45a051-f432-40fc-a0e9-13b99e16703a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:44.853233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-de45a051-f432-40fc-a0e9-13b99e16703a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:51:44.856615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b43fdd51-8f84-494a-a8db-0eca9ea13188 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:44.856764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b43fdd51-8f84-494a-a8db-0eca9ea13188 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:44.872128 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b43fdd51-8f84-494a-a8db-0eca9ea13188 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:44.872795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b43fdd51-8f84-494a-a8db-0eca9ea13188 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:44.875639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b43fdd51-8f84-494a-a8db-0eca9ea13188 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:44.876325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b43fdd51-8f84-494a-a8db-0eca9ea13188 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:45.037609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b43fdd51-8f84-494a-a8db-0eca9ea13188 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:45.046426 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b43fdd51-8f84-494a-a8db-0eca9ea13188 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 200 len: 1466 microversion: 2.1 time: 0.202334 May 28 04:51:45.047417 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2182/4265] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:44 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 1466 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:45.245183 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-de45a051-f432-40fc-a0e9-13b99e16703a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 204 len: 0 microversion: 2.1 time: 0.465394 May 28 04:51:45.249616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-56052f94-4da5-4759-a944-6a00d53a2d23 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:45.249616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-56052f94-4da5-4759-a944-6a00d53a2d23 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:45.249813 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2084/4266] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:51:44 2022] DELETE /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:51:45.256347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56052f94-4da5-4759-a944-6a00d53a2d23 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:45.256862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56052f94-4da5-4759-a944-6a00d53a2d23 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:45.257982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56052f94-4da5-4759-a944-6a00d53a2d23 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:45.258298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56052f94-4da5-4759-a944-6a00d53a2d23 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:45.259924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f333619e-5728-47e6-8931-a920638faf64 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:45.260747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f333619e-5728-47e6-8931-a920638faf64 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:45.274552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f333619e-5728-47e6-8931-a920638faf64 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:45.275168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f333619e-5728-47e6-8931-a920638faf64 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:45.276202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f333619e-5728-47e6-8931-a920638faf64 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:45.276902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f333619e-5728-47e6-8931-a920638faf64 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:45.277105 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-56052f94-4da5-4759-a944-6a00d53a2d23 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] HTTP exception thrown: Instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 could not be found. May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-56052f94-4da5-4759-a944-6a00d53a2d23 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Request method failure captured: May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 HTTP/1.1 May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanrBR36wNuSduDsTIaCyoOxADcAoT4oILDgO2xMip3ZXY_fh9pAVfjMmuj1IzabigD9ryk48_M9GQQZjPvLvQ90RP4Y62U3rFzJ4OrOlMakdw0pdo-FGPEWnLlnyvgrT6eMUr4sP71nawMUp6ladI-t3msnIDNOVFI9zpjh1nmzsdM May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 8f07539e283643c6b7bdc2c90ffa2ce1 May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestMultiNic-2040190249 May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestMultiNic-2040190249 May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 8f07539e283643c6b7bdc2c90ffa2ce1 May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestMultiNic-2040190249 May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestMultiNic-2040190249-project May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 9dd8bc74fda8476692c24f7c8b8f4b1c May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestMultiNic-2040190249-project May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 could not be found. May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4'} May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 could not be found. May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:51:45.279086 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:51:45.285359 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 could not be found. May 28 04:51:45.285359 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:45.285359 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:45.285359 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:45.285359 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:45.285359 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:45.285359 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:45.285359 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:51:45.285359 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:51:45.285359 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 could not be found. May 28 04:51:45.285359 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:45.289276 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-56052f94-4da5-4759-a944-6a00d53a2d23 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Returning 404 to user: Instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:45.290355 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-56052f94-4da5-4759-a944-6a00d53a2d23 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 404 len: 111 microversion: 2.1 time: 0.047975 May 28 04:51:45.295024 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2183/4267] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:51:45 2022] DELETE /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:51:45.299445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3c71f22a-0839-4ad0-9705-3b8d7f474a0c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:45.300057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3c71f22a-0839-4ad0-9705-3b8d7f474a0c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:45.312551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c71f22a-0839-4ad0-9705-3b8d7f474a0c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:45.313007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c71f22a-0839-4ad0-9705-3b8d7f474a0c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:45.313885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c71f22a-0839-4ad0-9705-3b8d7f474a0c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:45.314328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c71f22a-0839-4ad0-9705-3b8d7f474a0c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:45.344550 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-3c71f22a-0839-4ad0-9705-3b8d7f474a0c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] HTTP exception thrown: Instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 could not be found. May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3c71f22a-0839-4ad0-9705-3b8d7f474a0c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Request method failure captured: May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 HTTP/1.1 May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanrBR36wNuSduDsTIaCyoOxADcAoT4oILDgO2xMip3ZXY_fh9pAVfjMmuj1IzabigD9ryk48_M9GQQZjPvLvQ90RP4Y62U3rFzJ4OrOlMakdw0pdo-FGPEWnLlnyvgrT6eMUr4sP71nawMUp6ladI-t3msnIDNOVFI9zpjh1nmzsdM May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 8f07539e283643c6b7bdc2c90ffa2ce1 May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestMultiNic-2040190249 May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestMultiNic-2040190249 May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 8f07539e283643c6b7bdc2c90ffa2ce1 May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestMultiNic-2040190249 May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestMultiNic-2040190249-project May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 9dd8bc74fda8476692c24f7c8b8f4b1c May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestMultiNic-2040190249-project May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 could not be found. May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4'} May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 could not be found. May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 could not be found. May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:45.346203 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:45.354916 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:45.354916 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:45.354916 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:45.354916 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:51:45.354916 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:51:45.354916 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 could not be found. May 28 04:51:45.354916 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:45.354916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3c71f22a-0839-4ad0-9705-3b8d7f474a0c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Returning 404 to user: Instance 8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:45.354916 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3c71f22a-0839-4ad0-9705-3b8d7f474a0c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4" status: 404 len: 111 microversion: 2.1 time: 0.052464 May 28 04:51:45.359548 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2184/4268] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:45 2022] GET /compute/v2.1/servers/8e74c0b7-72bd-4c9d-bbe5-7383bdc489e4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:51:45.370398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8982f0bf-66a0-4851-a561-c7bd2fd9e3a2 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:45.370398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8982f0bf-66a0-4851-a561-c7bd2fd9e3a2 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:45.379311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8982f0bf-66a0-4851-a561-c7bd2fd9e3a2 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:45.379777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8982f0bf-66a0-4851-a561-c7bd2fd9e3a2 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:45.386091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8982f0bf-66a0-4851-a561-c7bd2fd9e3a2 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:45.386571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8982f0bf-66a0-4851-a561-c7bd2fd9e3a2 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:45.426054 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-8982f0bf-66a0-4851-a561-c7bd2fd9e3a2 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] HTTP exception thrown: Instance 831f1333-b707-473c-a6a5-f2ef08552976 could not be found. May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8982f0bf-66a0-4851-a561-c7bd2fd9e3a2 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Request method failure captured: May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 HTTP/1.1 May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanrBR36wNuSduDsTIaCyoOxADcAoT4oILDgO2xMip3ZXY_fh9pAVfjMmuj1IzabigD9ryk48_M9GQQZjPvLvQ90RP4Y62U3rFzJ4OrOlMakdw0pdo-FGPEWnLlnyvgrT6eMUr4sP71nawMUp6ladI-t3msnIDNOVFI9zpjh1nmzsdM May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 8f07539e283643c6b7bdc2c90ffa2ce1 May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestMultiNic-2040190249 May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestMultiNic-2040190249 May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 8f07539e283643c6b7bdc2c90ffa2ce1 May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestMultiNic-2040190249 May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestMultiNic-2040190249-project May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 9dd8bc74fda8476692c24f7c8b8f4b1c May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestMultiNic-2040190249-project May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 831f1333-b707-473c-a6a5-f2ef08552976 could not be found. May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '831f1333-b707-473c-a6a5-f2ef08552976'} May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 831f1333-b707-473c-a6a5-f2ef08552976 could not be found. May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:51:45.427673 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:51:45.431892 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 831f1333-b707-473c-a6a5-f2ef08552976 could not be found. May 28 04:51:45.431892 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:45.431892 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:45.431892 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:45.431892 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:45.431892 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:45.431892 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:45.431892 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:51:45.431892 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:51:45.431892 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 831f1333-b707-473c-a6a5-f2ef08552976 could not be found. May 28 04:51:45.431892 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:45.431892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8982f0bf-66a0-4851-a561-c7bd2fd9e3a2 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Returning 404 to user: Instance 831f1333-b707-473c-a6a5-f2ef08552976 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:45.431892 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8982f0bf-66a0-4851-a561-c7bd2fd9e3a2 tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "DELETE /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 404 len: 111 microversion: 2.1 time: 0.065760 May 28 04:51:45.436013 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2185/4269] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:51:45 2022] DELETE /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:51:45.441508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-21158e83-6ecd-4a74-bafa-ccefdbb03bb5 req-5c44a039-062e-4df2-b539-d4cfcd01558d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde949cb-a966-4689-b421-e8f1c21b58e4", "name": "network-vif-deleted", "tag": "86fc4516-0fd0-4b05-9b84-709e24cafb31"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:45.458718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-21158e83-6ecd-4a74-bafa-ccefdbb03bb5 req-5c44a039-062e-4df2-b539-d4cfcd01558d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:45.459941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-21158e83-6ecd-4a74-bafa-ccefdbb03bb5 req-5c44a039-062e-4df2-b539-d4cfcd01558d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:45.473803 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-21158e83-6ecd-4a74-bafa-ccefdbb03bb5 req-5c44a039-062e-4df2-b539-d4cfcd01558d service nova] Creating event network-vif-deleted:86fc4516-0fd0-4b05-9b84-709e24cafb31 for instance dde949cb-a966-4689-b421-e8f1c21b58e4 on n-h1-843700-1 May 28 04:51:45.481754 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-21158e83-6ecd-4a74-bafa-ccefdbb03bb5 req-5c44a039-062e-4df2-b539-d4cfcd01558d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044220 May 28 04:51:45.483095 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2186/4270] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:45.491197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f2701195-6867-4b3c-bdf6-ec2574919f1c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:45.491197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f2701195-6867-4b3c-bdf6-ec2574919f1c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] [instance: 831f1333-b707-473c-a6a5-f2ef08552976] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:45.506112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f2701195-6867-4b3c-bdf6-ec2574919f1c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:45.506336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f2701195-6867-4b3c-bdf6-ec2574919f1c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:45.508014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f2701195-6867-4b3c-bdf6-ec2574919f1c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:45.508728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f2701195-6867-4b3c-bdf6-ec2574919f1c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:45.541356 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-f2701195-6867-4b3c-bdf6-ec2574919f1c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] HTTP exception thrown: Instance 831f1333-b707-473c-a6a5-f2ef08552976 could not be found. May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f2701195-6867-4b3c-bdf6-ec2574919f1c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Request method failure captured: May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 HTTP/1.1 May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanrBR36wNuSduDsTIaCyoOxADcAoT4oILDgO2xMip3ZXY_fh9pAVfjMmuj1IzabigD9ryk48_M9GQQZjPvLvQ90RP4Y62U3rFzJ4OrOlMakdw0pdo-FGPEWnLlnyvgrT6eMUr4sP71nawMUp6ladI-t3msnIDNOVFI9zpjh1nmzsdM May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 8f07539e283643c6b7bdc2c90ffa2ce1 May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestMultiNic-2040190249 May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8f07539e283643c6b7bdc2c90ffa2ce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestMultiNic-2040190249 May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 8f07539e283643c6b7bdc2c90ffa2ce1 May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestMultiNic-2040190249 May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestMultiNic-2040190249-project May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 9dd8bc74fda8476692c24f7c8b8f4b1c May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestMultiNic-2040190249-project May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 831f1333-b707-473c-a6a5-f2ef08552976 could not be found. May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '831f1333-b707-473c-a6a5-f2ef08552976'} May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 831f1333-b707-473c-a6a5-f2ef08552976 could not be found. May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 831f1333-b707-473c-a6a5-f2ef08552976 could not be found. May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:45.543761 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:45.549848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:45.549848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:45.549848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:45.549848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:51:45.549848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:51:45.549848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 831f1333-b707-473c-a6a5-f2ef08552976 could not be found. May 28 04:51:45.549848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:45.549848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f2701195-6867-4b3c-bdf6-ec2574919f1c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] Returning 404 to user: Instance 831f1333-b707-473c-a6a5-f2ef08552976 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:45.549848 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f2701195-6867-4b3c-bdf6-ec2574919f1c tempest-ServersTestMultiNic-2040190249 tempest-ServersTestMultiNic-2040190249-project] 10.222.0.58 "GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976" status: 404 len: 111 microversion: 2.1 time: 0.063760 May 28 04:51:45.551177 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2187/4271] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:45 2022] GET /compute/v2.1/servers/831f1333-b707-473c-a6a5-f2ef08552976 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:51:45.557545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cef80ff6-4684-4a1f-8687-573fdb048e59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:45.565852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cef80ff6-4684-4a1f-8687-573fdb048e59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:45.565852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cef80ff6-4684-4a1f-8687-573fdb048e59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:45.566778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cef80ff6-4684-4a1f-8687-573fdb048e59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:45.568268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cef80ff6-4684-4a1f-8687-573fdb048e59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:45.568897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cef80ff6-4684-4a1f-8687-573fdb048e59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:45.628117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f333619e-5728-47e6-8931-a920638faf64 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:45.639537 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f333619e-5728-47e6-8931-a920638faf64 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1554 microversion: 2.1 time: 0.383612 May 28 04:51:45.640471 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2085/4272] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:45 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1554 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:45.733816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ba78690f-0a3f-46a8-8bdb-ef0605d526a2 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:45.734683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ba78690f-0a3f-46a8-8bdb-ef0605d526a2 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:45.745038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba78690f-0a3f-46a8-8bdb-ef0605d526a2 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:45.745575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba78690f-0a3f-46a8-8bdb-ef0605d526a2 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:45.746438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba78690f-0a3f-46a8-8bdb-ef0605d526a2 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:45.746938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba78690f-0a3f-46a8-8bdb-ef0605d526a2 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:45.860185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ba78690f-0a3f-46a8-8bdb-ef0605d526a2 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:45.867011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cef80ff6-4684-4a1f-8687-573fdb048e59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:45.888385 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cef80ff6-4684-4a1f-8687-573fdb048e59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 200 len: 1308 microversion: 2.1 time: 0.335870 May 28 04:51:45.897863 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ba78690f-0a3f-46a8-8bdb-ef0605d526a2 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0" status: 200 len: 1271 microversion: 2.1 time: 0.140991 May 28 04:51:45.901269 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2188/4273] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:45 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 1308 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:45.907249 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2086/4274] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:45 2022] GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0 => generated 1271 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:51:46.064017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f54492a9-dbc9-478d-aa28-20a202f3cf1b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:46.064801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f54492a9-dbc9-478d-aa28-20a202f3cf1b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:46.072846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f54492a9-dbc9-478d-aa28-20a202f3cf1b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:46.073437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f54492a9-dbc9-478d-aa28-20a202f3cf1b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:46.074309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f54492a9-dbc9-478d-aa28-20a202f3cf1b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:46.074844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f54492a9-dbc9-478d-aa28-20a202f3cf1b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:46.169811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f54492a9-dbc9-478d-aa28-20a202f3cf1b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:46.178456 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f54492a9-dbc9-478d-aa28-20a202f3cf1b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 200 len: 1466 microversion: 2.1 time: 0.118388 May 28 04:51:46.179269 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2189/4275] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:46 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 1466 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:46.483167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-9a864c03-c4d3-43ba-80fe-e1d4c66ae826 req-e68c4363-4e1c-41e0-b359-04400e5527d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4401f4bf-a185-4bf8-b99c-30104fd8e26e", "tag": "4dfbe3b7-6f6b-4c12-b73e-920e8a86a6ea"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:46.495515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9a864c03-c4d3-43ba-80fe-e1d4c66ae826 req-e68c4363-4e1c-41e0-b359-04400e5527d4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:46.496213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9a864c03-c4d3-43ba-80fe-e1d4c66ae826 req-e68c4363-4e1c-41e0-b359-04400e5527d4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:46.514281 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-9a864c03-c4d3-43ba-80fe-e1d4c66ae826 req-e68c4363-4e1c-41e0-b359-04400e5527d4 service nova] Creating event network-changed:4dfbe3b7-6f6b-4c12-b73e-920e8a86a6ea for instance 4401f4bf-a185-4bf8-b99c-30104fd8e26e on n-h2-843700-1 May 28 04:51:46.521383 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-9a864c03-c4d3-43ba-80fe-e1d4c66ae826 req-e68c4363-4e1c-41e0-b359-04400e5527d4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043256 May 28 04:51:46.522969 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2087/4276] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:46.663138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-efe8995b-e783-46fe-a4c6-29a0bfb78dd7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:46.664837 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-efe8995b-e783-46fe-a4c6-29a0bfb78dd7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:46.671132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efe8995b-e783-46fe-a4c6-29a0bfb78dd7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:46.671584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efe8995b-e783-46fe-a4c6-29a0bfb78dd7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:46.677743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efe8995b-e783-46fe-a4c6-29a0bfb78dd7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:46.677743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efe8995b-e783-46fe-a4c6-29a0bfb78dd7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:46.832935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ed915fb9-565e-4a02-89a9-75bc55946b1e tempest-ServerGroup264TestJSON-2043131120 tempest-ServerGroup264TestJSON-2043131120-project] Action: 'create', calling method: .version_select at 0x7f77074a3550>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:46.873806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-ed915fb9-565e-4a02-89a9-75bc55946b1e tempest-ServerGroup264TestJSON-2043131120 tempest-ServerGroup264TestJSON-2043131120-project] Getting quotas for project 93c316e7234143f49ecda4506105850e. Resources: {'server_groups'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:46.880318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-ed915fb9-565e-4a02-89a9-75bc55946b1e tempest-ServerGroup264TestJSON-2043131120 tempest-ServerGroup264TestJSON-2043131120-project] Getting quotas for user 1d70e47082994155afcc0d995510b062 and project 93c316e7234143f49ecda4506105850e. Resources: {'server_groups'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:46.976307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-efe8995b-e783-46fe-a4c6-29a0bfb78dd7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:46.994890 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-efe8995b-e783-46fe-a4c6-29a0bfb78dd7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1554 microversion: 2.1 time: 0.341692 May 28 04:51:46.995861 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2190/4277] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:46 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1554 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:47.006571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-ed915fb9-565e-4a02-89a9-75bc55946b1e tempest-ServerGroup264TestJSON-2043131120 tempest-ServerGroup264TestJSON-2043131120-project] Getting quotas for project 93c316e7234143f49ecda4506105850e. Resources: {'server_groups'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:47.009086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1240c176-1c2d-4d09-a30b-21068799644b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:47.010136 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1240c176-1c2d-4d09-a30b-21068799644b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:47.014855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-ed915fb9-565e-4a02-89a9-75bc55946b1e tempest-ServerGroup264TestJSON-2043131120 tempest-ServerGroup264TestJSON-2043131120-project] Getting quotas for user 1d70e47082994155afcc0d995510b062 and project 93c316e7234143f49ecda4506105850e. Resources: {'server_groups'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:47.023687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1240c176-1c2d-4d09-a30b-21068799644b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:47.024576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1240c176-1c2d-4d09-a30b-21068799644b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:47.025793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1240c176-1c2d-4d09-a30b-21068799644b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:47.026428 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1240c176-1c2d-4d09-a30b-21068799644b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:47.036820 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ed915fb9-565e-4a02-89a9-75bc55946b1e tempest-ServerGroup264TestJSON-2043131120 tempest-ServerGroup264TestJSON-2043131120-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.378869 May 28 04:51:47.038101 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2088/4278] 10.222.0.58 () {62 vars in 1213 bytes} [Sat May 28 04:51:46 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:51:47.048250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fc6f1478-b167-47fd-9b38-cf50d71bd641 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:47.049904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fc6f1478-b167-47fd-9b38-cf50d71bd641 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:47.069032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc6f1478-b167-47fd-9b38-cf50d71bd641 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:47.069797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc6f1478-b167-47fd-9b38-cf50d71bd641 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:47.070871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc6f1478-b167-47fd-9b38-cf50d71bd641 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:47.071577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc6f1478-b167-47fd-9b38-cf50d71bd641 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:47.072007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:UPDATE=14,nova_cell1:SELECT=83,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:47.446149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fc6f1478-b167-47fd-9b38-cf50d71bd641 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:47.455220 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fc6f1478-b167-47fd-9b38-cf50d71bd641 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0" status: 200 len: 1271 microversion: 2.1 time: 0.415550 May 28 04:51:47.457290 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2089/4279] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:47 2022] GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0 => generated 1271 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:47.463304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-78c23127-8c95-4b56-b957-c32ddd136c61 tempest-ServerGroup264TestJSON-2043131120 tempest-ServerGroup264TestJSON-2043131120-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:47.478903 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-78c23127-8c95-4b56-b957-c32ddd136c61 tempest-ServerGroup264TestJSON-2043131120 tempest-ServerGroup264TestJSON-2043131120-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.020262 May 28 04:51:47.479968 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2090/4280] 10.222.0.58 () {60 vars in 1192 bytes} [Sat May 28 04:51:47 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:51:47.485114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-afd4609f-3143-4c83-9b25-aff653708af2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:47.486095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-afd4609f-3143-4c83-9b25-aff653708af2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:47.494610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-afd4609f-3143-4c83-9b25-aff653708af2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:47.495427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-afd4609f-3143-4c83-9b25-aff653708af2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:47.496412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-afd4609f-3143-4c83-9b25-aff653708af2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:47.496889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-afd4609f-3143-4c83-9b25-aff653708af2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:47.638415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-afd4609f-3143-4c83-9b25-aff653708af2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:47.646687 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-afd4609f-3143-4c83-9b25-aff653708af2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 200 len: 1300 microversion: 2.1 time: 0.165433 May 28 04:51:47.647314 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2091/4281] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:47 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 1300 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:47.655347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-efcd4308-357b-4f0f-bd0c-e173a8926f62 tempest-ServerGroup264TestJSON-2043131120 tempest-ServerGroup264TestJSON-2043131120-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:47.663560 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-efcd4308-357b-4f0f-bd0c-e173a8926f62 tempest-ServerGroup264TestJSON-2043131120 tempest-ServerGroup264TestJSON-2043131120-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/1d3bc381-e689-4b34-b042-9db05f3e9bf3" status: 200 len: 235 microversion: 2.64 time: 0.015078 May 28 04:51:47.665358 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2092/4282] 10.222.0.58 () {60 vars in 1303 bytes} [Sat May 28 04:51:47 2022] GET /compute/v2.1/os-server-groups/1d3bc381-e689-4b34-b042-9db05f3e9bf3 => generated 235 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:51:47.674079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bf78d047-d316-4f33-8e35-55c0a515f2e7 tempest-ServerGroup264TestJSON-2043131120 tempest-ServerGroup264TestJSON-2043131120-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:47.735865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1240c176-1c2d-4d09-a30b-21068799644b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:47.743733 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1240c176-1c2d-4d09-a30b-21068799644b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 200 len: 1308 microversion: 2.1 time: 0.746634 May 28 04:51:47.751082 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2191/4283] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:46 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 1308 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:47.775554 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bf78d047-d316-4f33-8e35-55c0a515f2e7 tempest-ServerGroup264TestJSON-2043131120 tempest-ServerGroup264TestJSON-2043131120-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/1d3bc381-e689-4b34-b042-9db05f3e9bf3" status: 204 len: 0 microversion: 2.64 time: 0.105241 May 28 04:51:47.776317 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2093/4284] 10.222.0.58 () {60 vars in 1306 bytes} [Sat May 28 04:51:47 2022] DELETE /compute/v2.1/os-server-groups/1d3bc381-e689-4b34-b042-9db05f3e9bf3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:51:47.785515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6d54c84a-b718-47eb-a457-03fa0ae7855e tempest-ServerGroup264TestJSON-2043131120 tempest-ServerGroup264TestJSON-2043131120-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:47.792648 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-6d54c84a-b718-47eb-a457-03fa0ae7855e tempest-ServerGroup264TestJSON-2043131120 tempest-ServerGroup264TestJSON-2043131120-project] HTTP exception thrown: Instance group 1d3bc381-e689-4b34-b042-9db05f3e9bf3 could not be found. May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6d54c84a-b718-47eb-a457-03fa0ae7855e tempest-ServerGroup264TestJSON-2043131120 tempest-ServerGroup264TestJSON-2043131120-project] Request method failure captured: May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/os-server-groups/1d3bc381-e689-4b34-b042-9db05f3e9bf3 HTTP/1.1 May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikapiSAKQEdhTBYK-jEpIAdf6gkiAbU1lspBkD7x0_DHPqFfbtOWU-2pCnX_Poi4T2sbQi8lvsogmgkTcIdaTbr9LnUgww72JCgg4Kr5u-Y--ggXvm6Cfx2Cz8ZqftDqm11l4TZbd2a3b_1wlLR24_VDpmmp0cdgzJLbktcsujYmUuAs May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-Openstack-Nova-Api-Version: 2.64 May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 93c316e7234143f49ecda4506105850e May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerGroup264TestJSON-2043131120 May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_93c316e7234143f49ecda4506105850e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/93c316e7234143f49ecda4506105850e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/93c316e7234143f49ecda4506105850e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/93c316e7234143f49ecda4506105850e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerGroup264TestJSON-2043131120 May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 93c316e7234143f49ecda4506105850e May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerGroup264TestJSON-2043131120 May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerGroup264TestJSON-2043131120-project May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 1d70e47082994155afcc0d995510b062 May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerGroup264TestJSON-2043131120-project May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance group 1d3bc381-e689-4b34-b042-9db05f3e9bf3 could not be found. May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '1d3bc381-e689-4b34-b042-9db05f3e9bf3'} May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1d3bc381-e689-4b34-b042-9db05f3e9bf3 could not be found. May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1d3bc381-e689-4b34-b042-9db05f3e9bf3 could not be found. May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:47.797647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:47.803926 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:47.803926 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:47.803926 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:51:47.803926 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:51:47.803926 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1d3bc381-e689-4b34-b042-9db05f3e9bf3 could not be found. May 28 04:51:47.803926 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:47.803926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6d54c84a-b718-47eb-a457-03fa0ae7855e tempest-ServerGroup264TestJSON-2043131120 tempest-ServerGroup264TestJSON-2043131120-project] Returning 404 to user: Instance group 1d3bc381-e689-4b34-b042-9db05f3e9bf3 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:47.803926 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6d54c84a-b718-47eb-a457-03fa0ae7855e tempest-ServerGroup264TestJSON-2043131120 tempest-ServerGroup264TestJSON-2043131120-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/1d3bc381-e689-4b34-b042-9db05f3e9bf3" status: 404 len: 117 microversion: 2.64 time: 0.017688 May 28 04:51:47.803926 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2192/4285] 10.222.0.58 () {60 vars in 1306 bytes} [Sat May 28 04:51:47 2022] DELETE /compute/v2.1/os-server-groups/1d3bc381-e689-4b34-b042-9db05f3e9bf3 => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 04:51:48.012436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4097483a-125d-470f-b62c-48b10407d5cd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:48.013089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4097483a-125d-470f-b62c-48b10407d5cd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:48.020585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4097483a-125d-470f-b62c-48b10407d5cd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:48.021042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4097483a-125d-470f-b62c-48b10407d5cd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:48.021989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4097483a-125d-470f-b62c-48b10407d5cd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:48.022438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4097483a-125d-470f-b62c-48b10407d5cd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:48.422146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4097483a-125d-470f-b62c-48b10407d5cd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:48.439482 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4097483a-125d-470f-b62c-48b10407d5cd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1554 microversion: 2.1 time: 0.426482 May 28 04:51:48.439482 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2094/4286] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:48 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1554 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:48.477527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-15786193-c459-4447-a15c-778a754cd1cb tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:48.484768 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-15786193-c459-4447-a15c-778a754cd1cb tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:48.499791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-15786193-c459-4447-a15c-778a754cd1cb tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:48.500552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-15786193-c459-4447-a15c-778a754cd1cb tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:48.502186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-15786193-c459-4447-a15c-778a754cd1cb tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:48.502836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-15786193-c459-4447-a15c-778a754cd1cb tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:48.648074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-15786193-c459-4447-a15c-778a754cd1cb tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:48.664175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7360db62-7c74-4bb1-a641-0bd8f8d18b96 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:48.664785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7360db62-7c74-4bb1-a641-0bd8f8d18b96 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: dde949cb-a966-4689-b421-e8f1c21b58e4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:48.678916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7360db62-7c74-4bb1-a641-0bd8f8d18b96 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:48.679768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7360db62-7c74-4bb1-a641-0bd8f8d18b96 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:48.680731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7360db62-7c74-4bb1-a641-0bd8f8d18b96 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:48.684066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7360db62-7c74-4bb1-a641-0bd8f8d18b96 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:48.692884 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-15786193-c459-4447-a15c-778a754cd1cb tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0" status: 200 len: 1277 microversion: 2.1 time: 0.222776 May 28 04:51:48.712488 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-7360db62-7c74-4bb1-a641-0bd8f8d18b96 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] HTTP exception thrown: Instance dde949cb-a966-4689-b421-e8f1c21b58e4 could not be found. May 28 04:51:48.715347 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2193/4287] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:48 2022] GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0 => generated 1277 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7360db62-7c74-4bb1-a641-0bd8f8d18b96 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Request method failure captured: May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 HTTP/1.1 May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaiOBPq9qQrr95jSEOmRbogZ9t59pbtlXtSw81aS7-xhKzdjgN5RN9WIUU9s438FP46672OAQzJO5i-wir1g5z9E4w9mqkNRxgW8mIzqzjgGHh1XhcA4EQFEapFLU_4K_QXm_DQQpav1ycUA8keSbjSO649hYoTB4xij7c04YtdKQ_4 May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: b0c48bf20efd4291b37e616c658f96ff May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerActionsTestJSON-1958751992 May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerActionsTestJSON-1958751992 May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: b0c48bf20efd4291b37e616c658f96ff May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1958751992 May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerActionsTestJSON-1958751992-project May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 6272045226334bcf8b49a0aa41a07b95 May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerActionsTestJSON-1958751992-project May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance dde949cb-a966-4689-b421-e8f1c21b58e4 could not be found. May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'dde949cb-a966-4689-b421-e8f1c21b58e4'} May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde949cb-a966-4689-b421-e8f1c21b58e4 could not be found. May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde949cb-a966-4689-b421-e8f1c21b58e4 could not be found. May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:48.727201 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:48.732151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:48.732151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:48.732151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:48.732151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:51:48.732151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:51:48.732151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde949cb-a966-4689-b421-e8f1c21b58e4 could not be found. May 28 04:51:48.732151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:48.732151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7360db62-7c74-4bb1-a641-0bd8f8d18b96 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Returning 404 to user: Instance dde949cb-a966-4689-b421-e8f1c21b58e4 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:48.732151 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7360db62-7c74-4bb1-a641-0bd8f8d18b96 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4" status: 404 len: 111 microversion: 2.1 time: 0.068599 May 28 04:51:48.737400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5851b77f-5acd-47b1-9713-cc9e94805fcd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:48.737929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5851b77f-5acd-47b1-9713-cc9e94805fcd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:48.743086 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2095/4288] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:48 2022] GET /compute/v2.1/servers/dde949cb-a966-4689-b421-e8f1c21b58e4 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:51:48.748152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5851b77f-5acd-47b1-9713-cc9e94805fcd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:48.748614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5851b77f-5acd-47b1-9713-cc9e94805fcd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:48.749393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5851b77f-5acd-47b1-9713-cc9e94805fcd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:48.749831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5851b77f-5acd-47b1-9713-cc9e94805fcd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:48.763894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f8839cfc-b562-4004-8a62-db25ee2afc99 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:48.768897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f8839cfc-b562-4004-8a62-db25ee2afc99 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:48.794465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8839cfc-b562-4004-8a62-db25ee2afc99 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:48.796031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8839cfc-b562-4004-8a62-db25ee2afc99 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:48.798089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8839cfc-b562-4004-8a62-db25ee2afc99 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:48.800521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8839cfc-b562-4004-8a62-db25ee2afc99 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:48.813040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5851b77f-5acd-47b1-9713-cc9e94805fcd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:51:49.122199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f8839cfc-b562-4004-8a62-db25ee2afc99 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:49.137592 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f8839cfc-b562-4004-8a62-db25ee2afc99 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 200 len: 1488 microversion: 2.1 time: 0.380545 May 28 04:51:49.138187 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2096/4289] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:48 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 1488 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:49.154743 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b53e0a0f-2b03-4662-8b01-14aa3ba05423 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:49.157778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b53e0a0f-2b03-4662-8b01-14aa3ba05423 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:49.162812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b53e0a0f-2b03-4662-8b01-14aa3ba05423 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:49.163225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b53e0a0f-2b03-4662-8b01-14aa3ba05423 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:49.164418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b53e0a0f-2b03-4662-8b01-14aa3ba05423 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:49.164865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b53e0a0f-2b03-4662-8b01-14aa3ba05423 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:49.181922 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5851b77f-5acd-47b1-9713-cc9e94805fcd tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "DELETE /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88" status: 204 len: 0 microversion: 2.1 time: 0.448072 May 28 04:51:49.185670 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2194/4290] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:51:48 2022] DELETE /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 04:51:49.198230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b2a59ebe-6c5a-4c2d-af41-55e5a926fe80 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:49.199900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b2a59ebe-6c5a-4c2d-af41-55e5a926fe80 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:49.207440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b2a59ebe-6c5a-4c2d-af41-55e5a926fe80 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:49.211226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b2a59ebe-6c5a-4c2d-af41-55e5a926fe80 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:49.212262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b2a59ebe-6c5a-4c2d-af41-55e5a926fe80 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:49.214905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b2a59ebe-6c5a-4c2d-af41-55e5a926fe80 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:49.373712 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b53e0a0f-2b03-4662-8b01-14aa3ba05423 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "PUT /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 200 len: 1083 microversion: 2.1 time: 0.222942 May 28 04:51:49.374580 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2097/4291] 10.222.0.58 () {60 vars in 1255 bytes} [Sat May 28 04:51:49 2022] PUT /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 1083 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:51:49.390040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2dd6afac-9ef7-4d6c-82a3-20aad222f2da tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:49.390831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2dd6afac-9ef7-4d6c-82a3-20aad222f2da tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:49.399021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2dd6afac-9ef7-4d6c-82a3-20aad222f2da tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:49.399857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2dd6afac-9ef7-4d6c-82a3-20aad222f2da tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:49.400675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2dd6afac-9ef7-4d6c-82a3-20aad222f2da tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:49.401271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2dd6afac-9ef7-4d6c-82a3-20aad222f2da tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:49.760009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b2a59ebe-6c5a-4c2d-af41-55e5a926fe80 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:49.777499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2dd6afac-9ef7-4d6c-82a3-20aad222f2da tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:49.786347 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b2a59ebe-6c5a-4c2d-af41-55e5a926fe80 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88" status: 200 len: 1508 microversion: 2.1 time: 0.598138 May 28 04:51:49.788943 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2dd6afac-9ef7-4d6c-82a3-20aad222f2da tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 200 len: 1509 microversion: 2.1 time: 0.402996 May 28 04:51:49.799963 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2195/4292] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:49 2022] GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88 => generated 1508 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:49.800196 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2098/4293] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:49 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 1509 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:49.800307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d9ffc13d-8519-4c67-a130-0c978cdc4e37 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:49.801094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d9ffc13d-8519-4c67-a130-0c978cdc4e37 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:49.802552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-27fc4949-02eb-4803-9e3c-f2322f8cf8ee req-2e01db5f-02e3-4bd4-af10-07b8d1ace70c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2acbf858-4bd9-4004-ba98-569c9fe52f55", "name": "network-vif-deleted", "tag": "44741e68-238d-4ad5-be11-243269dd0ecd"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:49.815399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9ffc13d-8519-4c67-a130-0c978cdc4e37 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:49.815399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9ffc13d-8519-4c67-a130-0c978cdc4e37 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:49.815845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9ffc13d-8519-4c67-a130-0c978cdc4e37 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:49.816975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9ffc13d-8519-4c67-a130-0c978cdc4e37 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:49.818671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-27fc4949-02eb-4803-9e3c-f2322f8cf8ee req-2e01db5f-02e3-4bd4-af10-07b8d1ace70c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:49.820464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-27fc4949-02eb-4803-9e3c-f2322f8cf8ee req-2e01db5f-02e3-4bd4-af10-07b8d1ace70c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:49.853473 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-27fc4949-02eb-4803-9e3c-f2322f8cf8ee req-2e01db5f-02e3-4bd4-af10-07b8d1ace70c service nova] Creating event network-vif-deleted:44741e68-238d-4ad5-be11-243269dd0ecd for instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 on n-h1-843700-1 May 28 04:51:49.858707 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-27fc4949-02eb-4803-9e3c-f2322f8cf8ee req-2e01db5f-02e3-4bd4-af10-07b8d1ace70c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066123 May 28 04:51:49.859772 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2099/4294] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:49.865840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f0f3a625-9890-4aef-a887-c4f5c76a96e8 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:49.866790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f0f3a625-9890-4aef-a887-c4f5c76a96e8 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:49.875207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0f3a625-9890-4aef-a887-c4f5c76a96e8 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:49.875893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0f3a625-9890-4aef-a887-c4f5c76a96e8 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:49.878345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0f3a625-9890-4aef-a887-c4f5c76a96e8 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:49.878345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0f3a625-9890-4aef-a887-c4f5c76a96e8 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:50.041895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d9ffc13d-8519-4c67-a130-0c978cdc4e37 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:50.062194 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d9ffc13d-8519-4c67-a130-0c978cdc4e37 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1512 microversion: 2.1 time: 0.270891 May 28 04:51:50.062808 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2196/4295] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:49 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1512 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:50.068012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-619f5b48-4d0a-4328-9b35-a70e12d6c619 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:50.068568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-619f5b48-4d0a-4328-9b35-a70e12d6c619 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:50.088521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-619f5b48-4d0a-4328-9b35-a70e12d6c619 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:50.088985 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-619f5b48-4d0a-4328-9b35-a70e12d6c619 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:50.089777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-619f5b48-4d0a-4328-9b35-a70e12d6c619 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:50.090222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-619f5b48-4d0a-4328-9b35-a70e12d6c619 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:50.428371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f0f3a625-9890-4aef-a887-c4f5c76a96e8 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:50.449145 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f0f3a625-9890-4aef-a887-c4f5c76a96e8 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0" status: 200 len: 1319 microversion: 2.1 time: 0.586302 May 28 04:51:50.458702 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2100/4296] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:49 2022] GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0 => generated 1319 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:50.473202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-619f5b48-4d0a-4328-9b35-a70e12d6c619 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:50.493632 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-619f5b48-4d0a-4328-9b35-a70e12d6c619 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 200 len: 1509 microversion: 2.1 time: 0.429717 May 28 04:51:50.501623 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2197/4297] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:50 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 1509 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:50.517656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-201d5d42-cda5-41e2-bd80-d34be601decd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:50.520517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-201d5d42-cda5-41e2-bd80-d34be601decd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:50.531782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-201d5d42-cda5-41e2-bd80-d34be601decd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:50.535974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-201d5d42-cda5-41e2-bd80-d34be601decd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:50.535974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-201d5d42-cda5-41e2-bd80-d34be601decd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:50.535974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-201d5d42-cda5-41e2-bd80-d34be601decd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:50.621250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-201d5d42-cda5-41e2-bd80-d34be601decd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:51:50.819639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f0c7d29e-01de-45ed-b027-41b5ba7f935f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:50.821523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f0c7d29e-01de-45ed-b027-41b5ba7f935f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:50.856248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f0c7d29e-01de-45ed-b027-41b5ba7f935f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:50.859547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f0c7d29e-01de-45ed-b027-41b5ba7f935f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:50.867954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:50.868644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f0c7d29e-01de-45ed-b027-41b5ba7f935f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:50.868644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f0c7d29e-01de-45ed-b027-41b5ba7f935f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:51.147680 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-201d5d42-cda5-41e2-bd80-d34be601decd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 204 len: 0 microversion: 2.1 time: 0.633744 May 28 04:51:51.148011 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2101/4298] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:51:50 2022] DELETE /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 0 bytes in 635 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:51:51.159504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-531fa40e-f73f-438b-a9d5-1358f3a5f8ef tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:51.159504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-531fa40e-f73f-438b-a9d5-1358f3a5f8ef tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:51.177624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-531fa40e-f73f-438b-a9d5-1358f3a5f8ef tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:51.178078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-531fa40e-f73f-438b-a9d5-1358f3a5f8ef tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:51.184576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-531fa40e-f73f-438b-a9d5-1358f3a5f8ef tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:51.185228 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-531fa40e-f73f-438b-a9d5-1358f3a5f8ef tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:51.245438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:51.782822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-531fa40e-f73f-438b-a9d5-1358f3a5f8ef tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:51.796774 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-531fa40e-f73f-438b-a9d5-1358f3a5f8ef tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1345 microversion: 2.1 time: 0.646963 May 28 04:51:51.798458 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2102/4299] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:51 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1345 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:51.806546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6fb13d0e-5364-4072-888e-8783a5a7fad6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:51.816443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6fb13d0e-5364-4072-888e-8783a5a7fad6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:51.847232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f0c7d29e-01de-45ed-b027-41b5ba7f935f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:51.850891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:51.852786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6fb13d0e-5364-4072-888e-8783a5a7fad6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:51.856861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6fb13d0e-5364-4072-888e-8783a5a7fad6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:51.857365 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6fb13d0e-5364-4072-888e-8783a5a7fad6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:51.858068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6fb13d0e-5364-4072-888e-8783a5a7fad6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:51.875295 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f0c7d29e-01de-45ed-b027-41b5ba7f935f tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88" status: 200 len: 1508 microversion: 2.1 time: 1.073818 May 28 04:51:51.886277 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2198/4300] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:50 2022] GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88 => generated 1508 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:51.894570 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2dca6e53-05db-4faa-9fcb-e9577ac993ae tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:51.905214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2dca6e53-05db-4faa-9fcb-e9577ac993ae tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:51.905214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2dca6e53-05db-4faa-9fcb-e9577ac993ae tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:51.905214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2dca6e53-05db-4faa-9fcb-e9577ac993ae tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:51.905214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2dca6e53-05db-4faa-9fcb-e9577ac993ae tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:51.905214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2dca6e53-05db-4faa-9fcb-e9577ac993ae tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:52.386756 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2dca6e53-05db-4faa-9fcb-e9577ac993ae tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:52.392685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6fb13d0e-5364-4072-888e-8783a5a7fad6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:52.399088 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2dca6e53-05db-4faa-9fcb-e9577ac993ae tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0" status: 200 len: 1319 microversion: 2.1 time: 0.510207 May 28 04:51:52.400469 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2199/4301] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:51 2022] GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0 => generated 1319 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:52.405988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-4162be9f-bca6-4eb2-bfac-6e6d3bc0fe45 req-d8decd7c-a77f-4e69-af8d-7eac4ddec221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a1a34d-7c00-4e39-810d-7d17b6cc8a88", "name": "network-vif-deleted", "tag": "2ba3b775-f9f0-4585-8139-4120860e4fbf"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:52.413411 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6fb13d0e-5364-4072-888e-8783a5a7fad6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 200 len: 1515 microversion: 2.1 time: 0.612608 May 28 04:51:52.414301 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2103/4302] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:51 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 1515 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:52.436668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-4162be9f-bca6-4eb2-bfac-6e6d3bc0fe45 req-d8decd7c-a77f-4e69-af8d-7eac4ddec221 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:52.436668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-4162be9f-bca6-4eb2-bfac-6e6d3bc0fe45 req-d8decd7c-a77f-4e69-af8d-7eac4ddec221 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:52.460391 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-4162be9f-bca6-4eb2-bfac-6e6d3bc0fe45 req-d8decd7c-a77f-4e69-af8d-7eac4ddec221 service nova] Creating event network-vif-deleted:2ba3b775-f9f0-4585-8139-4120860e4fbf for instance 41a1a34d-7c00-4e39-810d-7d17b6cc8a88 on n-h2-843700-1 May 28 04:51:52.470482 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-4162be9f-bca6-4eb2-bfac-6e6d3bc0fe45 req-d8decd7c-a77f-4e69-af8d-7eac4ddec221 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068264 May 28 04:51:52.472673 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2200/4303] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:52.829906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f5ecc353-a132-4a16-b093-01f56d9e1071 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:52.830647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f5ecc353-a132-4a16-b093-01f56d9e1071 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:52.863363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5ecc353-a132-4a16-b093-01f56d9e1071 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:52.870329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5ecc353-a132-4a16-b093-01f56d9e1071 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:52.875286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5ecc353-a132-4a16-b093-01f56d9e1071 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:52.875286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5ecc353-a132-4a16-b093-01f56d9e1071 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:52.897488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-93867f9e-f84b-43b3-9e91-f0b3d3ce081b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:52.898427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-93867f9e-f84b-43b3-9e91-f0b3d3ce081b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:52.916449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93867f9e-f84b-43b3-9e91-f0b3d3ce081b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:52.916923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93867f9e-f84b-43b3-9e91-f0b3d3ce081b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:52.917718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93867f9e-f84b-43b3-9e91-f0b3d3ce081b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:52.921783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93867f9e-f84b-43b3-9e91-f0b3d3ce081b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:52.986339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93867f9e-f84b-43b3-9e91-f0b3d3ce081b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:52.987259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93867f9e-f84b-43b3-9e91-f0b3d3ce081b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:52.987922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-93867f9e-f84b-43b3-9e91-f0b3d3ce081b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lazy-loading 'fault' on Instance uuid 41a1a34d-7c00-4e39-810d-7d17b6cc8a88 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:51:53.040661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f5ecc353-a132-4a16-b093-01f56d9e1071 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:53.053570 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f5ecc353-a132-4a16-b093-01f56d9e1071 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1345 microversion: 2.1 time: 0.243003 May 28 04:51:53.054169 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2104/4304] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:52 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1345 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:53.137780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-93867f9e-f84b-43b3-9e91-f0b3d3ce081b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:53.157638 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-93867f9e-f84b-43b3-9e91-f0b3d3ce081b tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88" status: 200 len: 1305 microversion: 2.1 time: 0.261198 May 28 04:51:53.171788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-a827f3b8-493a-4472-8845-f2ebc575478e req-ece9f25e-a4f6-4a58-9157-c1dae1979725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0", "tag": "5a85b894-e7f7-4ac2-bad2-a98149f2cc31"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:53.179224 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2201/4305] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:52 2022] GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88 => generated 1305 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:51:53.192129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a827f3b8-493a-4472-8845-f2ebc575478e req-ece9f25e-a4f6-4a58-9157-c1dae1979725 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:53.193079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a827f3b8-493a-4472-8845-f2ebc575478e req-ece9f25e-a4f6-4a58-9157-c1dae1979725 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:53.214162 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-a827f3b8-493a-4472-8845-f2ebc575478e req-ece9f25e-a4f6-4a58-9157-c1dae1979725 service nova] Creating event network-changed:5a85b894-e7f7-4ac2-bad2-a98149f2cc31 for instance a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0 on n-h1-843700-1 May 28 04:51:53.231018 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-a827f3b8-493a-4472-8845-f2ebc575478e req-ece9f25e-a4f6-4a58-9157-c1dae1979725 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063105 May 28 04:51:53.232219 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2105/4306] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:53.277613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e435ab76-0ba9-4b4c-b4f7-251af05e1ac4 req-ea1923e2-92b2-483a-8faa-8620820f9bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4401f4bf-a185-4bf8-b99c-30104fd8e26e", "name": "network-vif-plugged", "status": "completed", "tag": "4dfbe3b7-6f6b-4c12-b73e-920e8a86a6ea"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:53.298265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e435ab76-0ba9-4b4c-b4f7-251af05e1ac4 req-ea1923e2-92b2-483a-8faa-8620820f9bc5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:53.299099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e435ab76-0ba9-4b4c-b4f7-251af05e1ac4 req-ea1923e2-92b2-483a-8faa-8620820f9bc5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:53.317674 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e435ab76-0ba9-4b4c-b4f7-251af05e1ac4 req-ea1923e2-92b2-483a-8faa-8620820f9bc5 service nova] Creating event network-vif-plugged:4dfbe3b7-6f6b-4c12-b73e-920e8a86a6ea for instance 4401f4bf-a185-4bf8-b99c-30104fd8e26e on n-h2-843700-1 May 28 04:51:53.335003 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e435ab76-0ba9-4b4c-b4f7-251af05e1ac4 req-ea1923e2-92b2-483a-8faa-8620820f9bc5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071121 May 28 04:51:53.335969 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2202/4307] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:53.418250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7a2e78cf-c23d-43a3-a970-7f88d860c3d0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:53.419166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7a2e78cf-c23d-43a3-a970-7f88d860c3d0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:53.431587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-916a15c4-5d10-468b-8717-1aa4c17d3c84 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:53.432302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-916a15c4-5d10-468b-8717-1aa4c17d3c84 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:53.443914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-916a15c4-5d10-468b-8717-1aa4c17d3c84 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:53.444370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-916a15c4-5d10-468b-8717-1aa4c17d3c84 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:53.445152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-916a15c4-5d10-468b-8717-1aa4c17d3c84 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:53.445604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-916a15c4-5d10-468b-8717-1aa4c17d3c84 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:53.446092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a2e78cf-c23d-43a3-a970-7f88d860c3d0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:53.446752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a2e78cf-c23d-43a3-a970-7f88d860c3d0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:53.447590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a2e78cf-c23d-43a3-a970-7f88d860c3d0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:53.448217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a2e78cf-c23d-43a3-a970-7f88d860c3d0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:53.700246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-916a15c4-5d10-468b-8717-1aa4c17d3c84 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:53.708203 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-916a15c4-5d10-468b-8717-1aa4c17d3c84 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 200 len: 1473 microversion: 2.1 time: 0.281838 May 28 04:51:53.715544 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2203/4308] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:53 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 1473 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:53.849874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7a2e78cf-c23d-43a3-a970-7f88d860c3d0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:53.862129 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7a2e78cf-c23d-43a3-a970-7f88d860c3d0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0" status: 200 len: 1319 microversion: 2.1 time: 0.447214 May 28 04:51:53.863027 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2106/4309] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:53 2022] GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0 => generated 1319 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:54.070485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aea6f9aa-f20b-4883-8313-74f443fd92cb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:54.071733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aea6f9aa-f20b-4883-8313-74f443fd92cb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:54.076362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:54.081720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aea6f9aa-f20b-4883-8313-74f443fd92cb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:54.082365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aea6f9aa-f20b-4883-8313-74f443fd92cb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:54.083365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aea6f9aa-f20b-4883-8313-74f443fd92cb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:54.084023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aea6f9aa-f20b-4883-8313-74f443fd92cb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:54.176832 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6729c5a1-6b85-4969-b165-ac0be116dd37 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:54.178624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6729c5a1-6b85-4969-b165-ac0be116dd37 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 41a1a34d-7c00-4e39-810d-7d17b6cc8a88] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:54.191141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aea6f9aa-f20b-4883-8313-74f443fd92cb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:54.199682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6729c5a1-6b85-4969-b165-ac0be116dd37 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:54.200539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6729c5a1-6b85-4969-b165-ac0be116dd37 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:54.203615 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aea6f9aa-f20b-4883-8313-74f443fd92cb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1345 microversion: 2.1 time: 0.137178 May 28 04:51:54.204483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6729c5a1-6b85-4969-b165-ac0be116dd37 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:54.205109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6729c5a1-6b85-4969-b165-ac0be116dd37 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:54.210792 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2204/4310] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:54 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1345 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:54.222857 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-6729c5a1-6b85-4969-b165-ac0be116dd37 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] HTTP exception thrown: Instance 41a1a34d-7c00-4e39-810d-7d17b6cc8a88 could not be found. May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6729c5a1-6b85-4969-b165-ac0be116dd37 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Request method failure captured: May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88 HTTP/1.1 May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaiOBPq9qQrr95jSEOmRbogZ9t59pbtlXtSw81aS7-xhKzdjgN5RN9WIUU9s438FP46672OAQzJO5i-wir1g5z9E4w9mqkNRxgW8mIzqzjgGHh1XhcA4EQFEapFLU_4K_QXm_DQQpav1ycUA8keSbjSO649hYoTB4xij7c04YtdKQ_4 May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: b0c48bf20efd4291b37e616c658f96ff May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerActionsTestJSON-1958751992 May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerActionsTestJSON-1958751992 May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: b0c48bf20efd4291b37e616c658f96ff May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1958751992 May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerActionsTestJSON-1958751992-project May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 6272045226334bcf8b49a0aa41a07b95 May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerActionsTestJSON-1958751992-project May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 41a1a34d-7c00-4e39-810d-7d17b6cc8a88 could not be found. May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '41a1a34d-7c00-4e39-810d-7d17b6cc8a88'} May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41a1a34d-7c00-4e39-810d-7d17b6cc8a88 could not be found. May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41a1a34d-7c00-4e39-810d-7d17b6cc8a88 could not be found. May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:54.224989 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:54.234198 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:54.234198 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:54.234198 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:54.234198 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:51:54.234198 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:51:54.234198 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41a1a34d-7c00-4e39-810d-7d17b6cc8a88 could not be found. May 28 04:51:54.234198 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:51:54.234198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6729c5a1-6b85-4969-b165-ac0be116dd37 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Returning 404 to user: Instance 41a1a34d-7c00-4e39-810d-7d17b6cc8a88 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:54.234198 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6729c5a1-6b85-4969-b165-ac0be116dd37 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88" status: 404 len: 111 microversion: 2.1 time: 0.058323 May 28 04:51:54.234198 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2107/4311] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:54 2022] GET /compute/v2.1/servers/41a1a34d-7c00-4e39-810d-7d17b6cc8a88 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:51:54.238915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-32e5d3e3-8c20-4173-b155-f3badfcb0b06 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:54.239588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-32e5d3e3-8c20-4173-b155-f3badfcb0b06 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:54.250090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-32e5d3e3-8c20-4173-b155-f3badfcb0b06 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:54.250445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-32e5d3e3-8c20-4173-b155-f3badfcb0b06 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:54.251656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-32e5d3e3-8c20-4173-b155-f3badfcb0b06 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:54.252316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-32e5d3e3-8c20-4173-b155-f3badfcb0b06 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:54.286125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-32e5d3e3-8c20-4173-b155-f3badfcb0b06 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:51:54.575318 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-32e5d3e3-8c20-4173-b155-f3badfcb0b06 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 204 len: 0 microversion: 2.1 time: 0.340456 May 28 04:51:54.576311 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2205/4312] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:51:54 2022] DELETE /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:51:54.585179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-95c17b2e-7a99-428e-8ef2-c0621b139f8c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:54.586018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-95c17b2e-7a99-428e-8ef2-c0621b139f8c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:54.592492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-95c17b2e-7a99-428e-8ef2-c0621b139f8c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:54.593077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-95c17b2e-7a99-428e-8ef2-c0621b139f8c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:54.593977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-95c17b2e-7a99-428e-8ef2-c0621b139f8c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:54.594581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-95c17b2e-7a99-428e-8ef2-c0621b139f8c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:54.634910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:54.688286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-09e5d0db-fa3e-492d-9934-64e8dc0d6646 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Action: 'create', calling method: .version_select at 0x7f7701a23f70>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-722905826", "policies": ["affinity"]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:54.704149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-09e5d0db-fa3e-492d-9934-64e8dc0d6646 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_groups'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:54.711237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-09e5d0db-fa3e-492d-9934-64e8dc0d6646 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for user 774c9f835a2941659cbfc7a2ef2e64af and project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_groups'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:54.792499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-95c17b2e-7a99-428e-8ef2-c0621b139f8c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:54.804832 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-95c17b2e-7a99-428e-8ef2-c0621b139f8c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1493 microversion: 2.1 time: 0.224423 May 28 04:51:54.805805 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2206/4313] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:54 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1493 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:54.818971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bae369aa-6a06-46c1-8523-547be54e1134 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:54.823984 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bae369aa-6a06-46c1-8523-547be54e1134 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:54.844814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bae369aa-6a06-46c1-8523-547be54e1134 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:54.845391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bae369aa-6a06-46c1-8523-547be54e1134 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:54.847381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bae369aa-6a06-46c1-8523-547be54e1134 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:54.847903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bae369aa-6a06-46c1-8523-547be54e1134 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:54.912403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bae369aa-6a06-46c1-8523-547be54e1134 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:54.913237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bae369aa-6a06-46c1-8523-547be54e1134 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:54.913956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-bae369aa-6a06-46c1-8523-547be54e1134 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lazy-loading 'fault' on Instance uuid 7698dfa6-fcc6-4aa9-869b-8772a97b29ff {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:51:54.944306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-09e5d0db-fa3e-492d-9934-64e8dc0d6646 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_groups'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:54.950322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-09e5d0db-fa3e-492d-9934-64e8dc0d6646 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for user 774c9f835a2941659cbfc7a2ef2e64af and project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_groups'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:54.968801 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-09e5d0db-fa3e-492d-9934-64e8dc0d6646 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.560563 May 28 04:51:54.969809 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2108/4314] 10.222.0.58 () {60 vars in 1173 bytes} [Sat May 28 04:51:54 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:54.975923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4becb21b-540b-4034-9171-17ebfff36ae5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:54.976662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4becb21b-540b-4034-9171-17ebfff36ae5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:54.985677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4becb21b-540b-4034-9171-17ebfff36ae5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:54.986225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4becb21b-540b-4034-9171-17ebfff36ae5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:54.987711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4becb21b-540b-4034-9171-17ebfff36ae5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:54.988266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4becb21b-540b-4034-9171-17ebfff36ae5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:54.992580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bae369aa-6a06-46c1-8523-547be54e1134 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:55.003156 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bae369aa-6a06-46c1-8523-547be54e1134 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 200 len: 1319 microversion: 2.1 time: 0.195290 May 28 04:51:55.004347 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2207/4315] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:54 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:55.009755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ed662548-cbff-4b36-b89a-92896961c657 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Action: 'create', calling method: .version_select at 0x7f77075f29d0>, body: {"server_group": {"name": "tempest-server-group-1382223710", "policies": ["affinity"]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:55.034179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-ed662548-cbff-4b36-b89a-92896961c657 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_groups'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:55.041099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-ed662548-cbff-4b36-b89a-92896961c657 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for user 774c9f835a2941659cbfc7a2ef2e64af and project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_groups'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:55.164106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4becb21b-540b-4034-9171-17ebfff36ae5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:55.172064 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4becb21b-540b-4034-9171-17ebfff36ae5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0" status: 200 len: 1319 microversion: 2.1 time: 0.201107 May 28 04:51:55.172576 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2109/4316] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:54 2022] GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:55.201053 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-268151bc-5555-42f4-bbd2-8a064520ad73 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:55.203295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-268151bc-5555-42f4-bbd2-8a064520ad73 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:55.215597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-268151bc-5555-42f4-bbd2-8a064520ad73 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:55.221271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-ed662548-cbff-4b36-b89a-92896961c657 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_groups'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:55.221741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-268151bc-5555-42f4-bbd2-8a064520ad73 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:55.221741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-268151bc-5555-42f4-bbd2-8a064520ad73 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:55.221741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-268151bc-5555-42f4-bbd2-8a064520ad73 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:55.226478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-ed662548-cbff-4b36-b89a-92896961c657 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for user 774c9f835a2941659cbfc7a2ef2e64af and project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_groups'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:55.240501 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ed662548-cbff-4b36-b89a-92896961c657 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.234825 May 28 04:51:55.241418 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2208/4317] 10.222.0.58 () {60 vars in 1172 bytes} [Sat May 28 04:51:55 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:55.246733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3b536fc8-1975-4af0-b14a-670241c87b53 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:55.247618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3b536fc8-1975-4af0-b14a-670241c87b53 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:55.254308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b536fc8-1975-4af0-b14a-670241c87b53 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:55.255101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b536fc8-1975-4af0-b14a-670241c87b53 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:55.256121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b536fc8-1975-4af0-b14a-670241c87b53 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:55.256756 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b536fc8-1975-4af0-b14a-670241c87b53 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:55.348406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3b536fc8-1975-4af0-b14a-670241c87b53 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:55.357421 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3b536fc8-1975-4af0-b14a-670241c87b53 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1345 microversion: 2.1 time: 0.114920 May 28 04:51:55.362901 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2209/4318] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:55 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1345 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:55.367441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-74a818da-e622-479f-bf79-82142b2792d5 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Action: 'create', calling method: .version_select at 0x7f770754c4c0>, body: {"server_group": {"name": "tempest-server-group-1382223710", "policies": ["affinity"]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:55.389164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-74a818da-e622-479f-bf79-82142b2792d5 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_groups'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:55.396025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-74a818da-e622-479f-bf79-82142b2792d5 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for user 774c9f835a2941659cbfc7a2ef2e64af and project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_groups'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:55.503825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-74a818da-e622-479f-bf79-82142b2792d5 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_groups'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:55.509347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-74a818da-e622-479f-bf79-82142b2792d5 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for user 774c9f835a2941659cbfc7a2ef2e64af and project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_groups'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:55.522977 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-74a818da-e622-479f-bf79-82142b2792d5 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.163771 May 28 04:51:55.528889 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2210/4319] 10.222.0.58 () {60 vars in 1172 bytes} [Sat May 28 04:51:55 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:55.534125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-75ce9576-593d-4f4e-829b-73931c13fa52 req-a84b9de0-cab6-43be-8bfe-d0b5f892c6bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7698dfa6-fcc6-4aa9-869b-8772a97b29ff", "name": "network-vif-deleted", "tag": "15aefd5c-55f0-4099-b383-523379318b22"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:55.542193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-75ce9576-593d-4f4e-829b-73931c13fa52 req-a84b9de0-cab6-43be-8bfe-d0b5f892c6bc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:55.542640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-75ce9576-593d-4f4e-829b-73931c13fa52 req-a84b9de0-cab6-43be-8bfe-d0b5f892c6bc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:55.554320 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-75ce9576-593d-4f4e-829b-73931c13fa52 req-a84b9de0-cab6-43be-8bfe-d0b5f892c6bc service nova] Creating event network-vif-deleted:15aefd5c-55f0-4099-b383-523379318b22 for instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff on n-h1-843700-1 May 28 04:51:55.559403 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-75ce9576-593d-4f4e-829b-73931c13fa52 req-a84b9de0-cab6-43be-8bfe-d0b5f892c6bc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029159 May 28 04:51:55.560377 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2211/4320] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:55.564994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b1664082-fd84-4330-a20b-a514610ec009 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:55.631211 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-268151bc-5555-42f4-bbd2-8a064520ad73 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1836 microversion: 2.1 time: 0.433646 May 28 04:51:55.631797 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2110/4321] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:55 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1836 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:51:55.649632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5cf08d37-d37f-41fb-b1fc-82c70caa4775 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:55.650264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5cf08d37-d37f-41fb-b1fc-82c70caa4775 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:55.656335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5cf08d37-d37f-41fb-b1fc-82c70caa4775 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:55.656876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5cf08d37-d37f-41fb-b1fc-82c70caa4775 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:55.657652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5cf08d37-d37f-41fb-b1fc-82c70caa4775 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:55.658095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5cf08d37-d37f-41fb-b1fc-82c70caa4775 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:55.709155 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b1664082-fd84-4330-a20b-a514610ec009 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/3bcf575f-7af3-48d0-a8e4-8dcc1b3f8fe8" status: 204 len: 0 microversion: 2.1 time: 0.147844 May 28 04:51:55.712827 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2212/4322] 10.222.0.58 () {58 vars in 1265 bytes} [Sat May 28 04:51:55 2022] DELETE /compute/v2.1/os-server-groups/3bcf575f-7af3-48d0-a8e4-8dcc1b3f8fe8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:51:55.718271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-152ab798-81c4-4f78-8c8b-3b0d53fd964e tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:55.740969 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-152ab798-81c4-4f78-8c8b-3b0d53fd964e tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.026088 May 28 04:51:55.741525 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2213/4323] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:51:55 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:55.756092 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b8d3c8fe-7a56-4c6d-98fe-a58c76132d64 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:55.809616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5cf08d37-d37f-41fb-b1fc-82c70caa4775 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:55.833039 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5cf08d37-d37f-41fb-b1fc-82c70caa4775 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1685 microversion: 2.1 time: 0.186968 May 28 04:51:55.835207 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2111/4324] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:55 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1685 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:55.840433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-531e2cee-23cf-43da-9f61-0a6486fe585c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:55.840611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-531e2cee-23cf-43da-9f61-0a6486fe585c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:55.850164 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b8d3c8fe-7a56-4c6d-98fe-a58c76132d64 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/169d3643-304d-4d30-a0ca-a19d5e5cada7" status: 204 len: 0 microversion: 2.1 time: 0.098595 May 28 04:51:55.850910 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2214/4325] 10.222.0.58 () {58 vars in 1265 bytes} [Sat May 28 04:51:55 2022] DELETE /compute/v2.1/os-server-groups/169d3643-304d-4d30-a0ca-a19d5e5cada7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:51:55.857130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-531e2cee-23cf-43da-9f61-0a6486fe585c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:55.857130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-531e2cee-23cf-43da-9f61-0a6486fe585c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:55.857130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-531e2cee-23cf-43da-9f61-0a6486fe585c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:55.857130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-531e2cee-23cf-43da-9f61-0a6486fe585c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:55.865062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8ee2e5d5-da26-478f-b3c0-e233a480818b tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:55.886746 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8ee2e5d5-da26-478f-b3c0-e233a480818b tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.026253 May 28 04:51:55.888255 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2215/4326] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:51:55 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:55.900287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bef1d02a-46dd-4f64-b2d9-7d8db30aaf55 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Action: 'create', calling method: .version_select at 0x7f7701b30550>, body: {"server_group": {"name": "tempest-server-group-326613108", "policies": ["affinity"]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:55.936891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-bef1d02a-46dd-4f64-b2d9-7d8db30aaf55 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_groups'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:55.940224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:55.948328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-bef1d02a-46dd-4f64-b2d9-7d8db30aaf55 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for user 774c9f835a2941659cbfc7a2ef2e64af and project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_groups'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:56.070246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-bef1d02a-46dd-4f64-b2d9-7d8db30aaf55 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_groups'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:56.084271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-bef1d02a-46dd-4f64-b2d9-7d8db30aaf55 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for user 774c9f835a2941659cbfc7a2ef2e64af and project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_groups'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:56.106535 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bef1d02a-46dd-4f64-b2d9-7d8db30aaf55 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.210559 May 28 04:51:56.107752 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2216/4327] 10.222.0.58 () {60 vars in 1172 bytes} [Sat May 28 04:51:55 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:56.113965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1922e9b8-3dd4-40d0-91ac-9b5a33af73a7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:56.115017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1922e9b8-3dd4-40d0-91ac-9b5a33af73a7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:56.122386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1922e9b8-3dd4-40d0-91ac-9b5a33af73a7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:56.126085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1922e9b8-3dd4-40d0-91ac-9b5a33af73a7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:56.126085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1922e9b8-3dd4-40d0-91ac-9b5a33af73a7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:56.126085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1922e9b8-3dd4-40d0-91ac-9b5a33af73a7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:56.144112 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-1922e9b8-3dd4-40d0-91ac-9b5a33af73a7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff could not be found. May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1922e9b8-3dd4-40d0-91ac-9b5a33af73a7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff HTTP/1.1 May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff could not be found. May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '7698dfa6-fcc6-4aa9-869b-8772a97b29ff'} May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff could not be found. May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff could not be found. May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:56.146047 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:56.151685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:56.151685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:56.151685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:51:56.151685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:51:56.151685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff could not be found. May 28 04:51:56.151685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:56.154232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1922e9b8-3dd4-40d0-91ac-9b5a33af73a7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:56.155354 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1922e9b8-3dd4-40d0-91ac-9b5a33af73a7 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 404 len: 111 microversion: 2.1 time: 0.046348 May 28 04:51:56.156448 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2217/4328] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:56 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:51:56.171115 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-69d8528d-01ad-4a14-80c9-d33dc1557968 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:56.286054 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-69d8528d-01ad-4a14-80c9-d33dc1557968 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/2519fec3-a27b-4ac2-99a4-ec58500142ca" status: 204 len: 0 microversion: 2.1 time: 0.128300 May 28 04:51:56.288458 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2218/4329] 10.222.0.58 () {58 vars in 1265 bytes} [Sat May 28 04:51:56 2022] DELETE /compute/v2.1/os-server-groups/2519fec3-a27b-4ac2-99a4-ec58500142ca => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:51:56.294457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-75e3530a-c688-43a2-a642-bfe8dcd09185 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:56.299936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-75e3530a-c688-43a2-a642-bfe8dcd09185 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:56.313590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75e3530a-c688-43a2-a642-bfe8dcd09185 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:56.314253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75e3530a-c688-43a2-a642-bfe8dcd09185 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:56.315351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75e3530a-c688-43a2-a642-bfe8dcd09185 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:56.317874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75e3530a-c688-43a2-a642-bfe8dcd09185 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:56.414627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-531e2cee-23cf-43da-9f61-0a6486fe585c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:56.435589 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-531e2cee-23cf-43da-9f61-0a6486fe585c tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1493 microversion: 2.1 time: 0.598498 May 28 04:51:56.447247 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2112/4330] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:55 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1493 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:56.447247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c66bacfb-154e-4c56-9a57-7efd21cf5b49 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:56.456577 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c66bacfb-154e-4c56-9a57-7efd21cf5b49 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.016842 May 28 04:51:56.458232 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2113/4331] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:51:56 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:56.464260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-20b5a7a8-491a-4eb4-9e36-ce0abf4eca83 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1140667141", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "fd0d7eb0-eb78-443c-941c-e203b5533601"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:56.524730 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-20b5a7a8-491a-4eb4-9e36-ce0abf4eca83 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] validate_networks() for [('fd0d7eb0-eb78-443c-941c-e203b5533601', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:51:56.685943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-75e3530a-c688-43a2-a642-bfe8dcd09185 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:56.696774 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-75e3530a-c688-43a2-a642-bfe8dcd09185 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0" status: 200 len: 1319 microversion: 2.1 time: 0.406911 May 28 04:51:56.697774 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2219/4332] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:56 2022] GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0 => generated 1319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:56.702872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-96d2d6db-aa44-42ed-8729-43b804ba1761 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:56.703627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-96d2d6db-aa44-42ed-8729-43b804ba1761 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:56.711045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96d2d6db-aa44-42ed-8729-43b804ba1761 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:56.711600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96d2d6db-aa44-42ed-8729-43b804ba1761 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:56.712460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96d2d6db-aa44-42ed-8729-43b804ba1761 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:56.712976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96d2d6db-aa44-42ed-8729-43b804ba1761 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:56.805059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-96d2d6db-aa44-42ed-8729-43b804ba1761 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:56.814000 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-96d2d6db-aa44-42ed-8729-43b804ba1761 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1345 microversion: 2.1 time: 0.115249 May 28 04:51:56.825298 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2220/4333] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:56 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1345 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:56.828168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-292f1bd9-779b-4d6c-92f7-4558268e5ea9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:56.829340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-292f1bd9-779b-4d6c-92f7-4558268e5ea9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:56.836234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-292f1bd9-779b-4d6c-92f7-4558268e5ea9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:56.836691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-292f1bd9-779b-4d6c-92f7-4558268e5ea9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:56.837472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-292f1bd9-779b-4d6c-92f7-4558268e5ea9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:56.839594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-292f1bd9-779b-4d6c-92f7-4558268e5ea9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:56.889388 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-292f1bd9-779b-4d6c-92f7-4558268e5ea9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405/action" status: 200 len: 32641 microversion: 2.1 time: 0.068661 May 28 04:51:56.896964 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2221/4334] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:51:56 2022] POST /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405/action => generated 32641 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:51:56.896964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-86ec4158-7eee-47fd-ad4f-4fc0b3d94931 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Action: 'create', calling method: .version_select at 0x7f7701bf8b80>, body: {"server_group": {"name": "tempest-server-group-77568339", "policies": ["anti-affinity"]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:56.921174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-86ec4158-7eee-47fd-ad4f-4fc0b3d94931 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_groups'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:56.929294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-86ec4158-7eee-47fd-ad4f-4fc0b3d94931 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for user 774c9f835a2941659cbfc7a2ef2e64af and project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_groups'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:57.049012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-86ec4158-7eee-47fd-ad4f-4fc0b3d94931 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_groups'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:57.054704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-86ec4158-7eee-47fd-ad4f-4fc0b3d94931 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for user 774c9f835a2941659cbfc7a2ef2e64af and project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_groups'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:57.072240 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-86ec4158-7eee-47fd-ad4f-4fc0b3d94931 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 167 microversion: 2.1 time: 0.180891 May 28 04:51:57.073176 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2222/4335] 10.222.0.58 () {60 vars in 1172 bytes} [Sat May 28 04:51:56 2022] POST /compute/v2.1/os-server-groups => generated 167 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:57.085435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f1ed9949-ca18-4a4e-8df8-94e131641792 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:57.176689 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f1ed9949-ca18-4a4e-8df8-94e131641792 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/8a072df2-b933-4b79-bd8d-2c0f4a823e66" status: 204 len: 0 microversion: 2.1 time: 0.097154 May 28 04:51:57.177416 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2223/4336] 10.222.0.58 () {58 vars in 1265 bytes} [Sat May 28 04:51:57 2022] DELETE /compute/v2.1/os-server-groups/8a072df2-b933-4b79-bd8d-2c0f4a823e66 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 04:51:57.185017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-652c6ab9-9645-42ba-9a57-7313aa115404 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:57.185988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-652c6ab9-9645-42ba-9a57-7313aa115404 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:57.195420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-652c6ab9-9645-42ba-9a57-7313aa115404 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:57.196072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-652c6ab9-9645-42ba-9a57-7313aa115404 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:57.197326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-652c6ab9-9645-42ba-9a57-7313aa115404 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:57.197931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-652c6ab9-9645-42ba-9a57-7313aa115404 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:57.349046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-652c6ab9-9645-42ba-9a57-7313aa115404 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4a7f2c7703a244afa147d0e4d285996f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6006b8b336944d938f6c13700cd19eb6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:57.349796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-652c6ab9-9645-42ba-9a57-7313aa115404 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] flavor_id is None. Assuming migration. {{(pid=126044) resize /opt/stack/nova/nova/compute/api.py:4142}} May 28 04:51:57.351247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-652c6ab9-9645-42ba-9a57-7313aa115404 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126044) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 04:51:57.384523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-20b5a7a8-491a-4eb4-9e36-ce0abf4eca83 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:51:57.385039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-20b5a7a8-491a-4eb4-9e36-ce0abf4eca83 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:51:57.385688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-20b5a7a8-491a-4eb4-9e36-ce0abf4eca83 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:51:57.386311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-20b5a7a8-491a-4eb4-9e36-ce0abf4eca83 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:51:57.386905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-20b5a7a8-491a-4eb4-9e36-ce0abf4eca83 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:51:57.397725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20b5a7a8-491a-4eb4-9e36-ce0abf4eca83 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:57.398181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20b5a7a8-491a-4eb4-9e36-ce0abf4eca83 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:57.399276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20b5a7a8-491a-4eb4-9e36-ce0abf4eca83 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:57.399784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20b5a7a8-491a-4eb4-9e36-ce0abf4eca83 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:57.419137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-20b5a7a8-491a-4eb4-9e36-ce0abf4eca83 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Getting quotas for project 724a5513bc2c42eabbefa450e207453e. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:57.424808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-20b5a7a8-491a-4eb4-9e36-ce0abf4eca83 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Getting quotas for user 71b6b3ac5a4249fd8f76fb2e7e2b6c18 and project 724a5513bc2c42eabbefa450e207453e. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:57.438627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-20b5a7a8-491a-4eb4-9e36-ce0abf4eca83 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:51:57.441962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-20b5a7a8-491a-4eb4-9e36-ce0abf4eca83 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:51:57.618167 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-20b5a7a8-491a-4eb4-9e36-ce0abf4eca83 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.157544 May 28 04:51:57.624803 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2114/4337] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:51:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:51:57.631881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b4e0c1c3-5884-48a8-9c7e-a4278ffe9aeb tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:57.645430 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b4e0c1c3-5884-48a8-9c7e-a4278ffe9aeb tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.019095 May 28 04:51:57.646308 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2115/4338] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:51:57 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:57.668406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-03c7e08f-201b-4b52-a036-c429e24f0c2a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:57.670330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-03c7e08f-201b-4b52-a036-c429e24f0c2a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:57.681944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03c7e08f-201b-4b52-a036-c429e24f0c2a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:57.684773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03c7e08f-201b-4b52-a036-c429e24f0c2a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:57.686465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03c7e08f-201b-4b52-a036-c429e24f0c2a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:57.687074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03c7e08f-201b-4b52-a036-c429e24f0c2a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:57.773354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03c7e08f-201b-4b52-a036-c429e24f0c2a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:57.773824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03c7e08f-201b-4b52-a036-c429e24f0c2a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:57.776120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-03c7e08f-201b-4b52-a036-c429e24f0c2a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lazy-loading 'fault' on Instance uuid 2a57aa6a-5fc6-496e-8363-83cc0600e0ee {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:51:57.850667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-03c7e08f-201b-4b52-a036-c429e24f0c2a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:57.858974 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-03c7e08f-201b-4b52-a036-c429e24f0c2a tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 200 len: 1304 microversion: 2.1 time: 0.211668 May 28 04:51:57.866939 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2116/4339] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:57 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 1304 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:57.867375 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-652c6ab9-9645-42ba-9a57-7313aa115404 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405/action" status: 202 len: 0 microversion: 2.1 time: 0.686406 May 28 04:51:57.872922 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2224/4340] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:51:57 2022] POST /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405/action => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:51:57.877552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e1acfc09-04e0-4390-9225-6f2fe84b6326 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:57.878251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e1acfc09-04e0-4390-9225-6f2fe84b6326 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:57.901315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-687edd51-1e00-4ea7-ad0c-83866c1735cc req-34690ba2-297a-4f59-b297-ac26432d2941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a57aa6a-5fc6-496e-8363-83cc0600e0ee", "name": "network-vif-deleted", "tag": "9d5b1efe-7693-4c10-a6a8-94203774e9f9"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:57.930517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-687edd51-1e00-4ea7-ad0c-83866c1735cc req-34690ba2-297a-4f59-b297-ac26432d2941 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:57.930968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-687edd51-1e00-4ea7-ad0c-83866c1735cc req-34690ba2-297a-4f59-b297-ac26432d2941 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:57.943741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e1acfc09-04e0-4390-9225-6f2fe84b6326 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:57.952063 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e1acfc09-04e0-4390-9225-6f2fe84b6326 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1209 microversion: 2.1 time: 0.078348 May 28 04:51:57.952769 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2225/4341] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:57 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1209 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:57.958391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cc65005e-42ec-46f1-b469-b506acf43021 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:57.959192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cc65005e-42ec-46f1-b469-b506acf43021 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:57.964493 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-687edd51-1e00-4ea7-ad0c-83866c1735cc req-34690ba2-297a-4f59-b297-ac26432d2941 service nova] Creating event network-vif-deleted:9d5b1efe-7693-4c10-a6a8-94203774e9f9 for instance 2a57aa6a-5fc6-496e-8363-83cc0600e0ee on n-h1-843700-1 May 28 04:51:57.966876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc65005e-42ec-46f1-b469-b506acf43021 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:57.967462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc65005e-42ec-46f1-b469-b506acf43021 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:57.975780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc65005e-42ec-46f1-b469-b506acf43021 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:57.975780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc65005e-42ec-46f1-b469-b506acf43021 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:57.985575 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-687edd51-1e00-4ea7-ad0c-83866c1735cc req-34690ba2-297a-4f59-b297-ac26432d2941 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097371 May 28 04:51:57.987671 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2117/4342] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:51:57.997410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0eb92824-7c89-4b3e-8db6-cbd03d212d5e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:57.998478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0eb92824-7c89-4b3e-8db6-cbd03d212d5e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:58.007653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0eb92824-7c89-4b3e-8db6-cbd03d212d5e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:58.008389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0eb92824-7c89-4b3e-8db6-cbd03d212d5e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:58.009484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0eb92824-7c89-4b3e-8db6-cbd03d212d5e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:58.010221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0eb92824-7c89-4b3e-8db6-cbd03d212d5e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:58.126376 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0eb92824-7c89-4b3e-8db6-cbd03d212d5e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:58.141083 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0eb92824-7c89-4b3e-8db6-cbd03d212d5e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1345 microversion: 2.1 time: 0.151906 May 28 04:51:58.142206 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2118/4343] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:57 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1345 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:58.162873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-221894ac-a32a-4d7e-89d5-0479faa12d86 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:58.163724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-221894ac-a32a-4d7e-89d5-0479faa12d86 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:58.170848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-221894ac-a32a-4d7e-89d5-0479faa12d86 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:58.171801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-221894ac-a32a-4d7e-89d5-0479faa12d86 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:58.172755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-221894ac-a32a-4d7e-89d5-0479faa12d86 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:58.173360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-221894ac-a32a-4d7e-89d5-0479faa12d86 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:58.483958 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-221894ac-a32a-4d7e-89d5-0479faa12d86 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:58.496051 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-221894ac-a32a-4d7e-89d5-0479faa12d86 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1694 microversion: 2.1 time: 0.350844 May 28 04:51:58.506465 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2119/4344] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:58 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1694 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:58.512132 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cb6b0d5e-2be3-4997-815c-b7c1f85b2752 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-143960320", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "33aa3a78-5c2b-4fbe-914c-fa6f09f95309"}]}, "os:scheduler_hints": {"group": "2e4d5f55-45a8-47bf-b084-49ff2fe2603d"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:51:58.518125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cc65005e-42ec-46f1-b469-b506acf43021 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:58.526158 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cc65005e-42ec-46f1-b469-b506acf43021 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0" status: 200 len: 1319 microversion: 2.1 time: 0.571819 May 28 04:51:58.540364 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2226/4345] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:57 2022] GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0 => generated 1319 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:58.591376 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-cb6b0d5e-2be3-4997-815c-b7c1f85b2752 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] validate_networks() for [('33aa3a78-5c2b-4fbe-914c-fa6f09f95309', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:51:58.878247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e57ad2e6-fa2c-4a30-babe-03130fd9b0c2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:58.879133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e57ad2e6-fa2c-4a30-babe-03130fd9b0c2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 2a57aa6a-5fc6-496e-8363-83cc0600e0ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:58.885514 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e57ad2e6-fa2c-4a30-babe-03130fd9b0c2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:58.885964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e57ad2e6-fa2c-4a30-babe-03130fd9b0c2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:58.889854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e57ad2e6-fa2c-4a30-babe-03130fd9b0c2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:58.889854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e57ad2e6-fa2c-4a30-babe-03130fd9b0c2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:58.905526 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-e57ad2e6-fa2c-4a30-babe-03130fd9b0c2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] HTTP exception thrown: Instance 2a57aa6a-5fc6-496e-8363-83cc0600e0ee could not be found. May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e57ad2e6-fa2c-4a30-babe-03130fd9b0c2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Request method failure captured: May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee HTTP/1.1 May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaiOBPq9qQrr95jSEOmRbogZ9t59pbtlXtSw81aS7-xhKzdjgN5RN9WIUU9s438FP46672OAQzJO5i-wir1g5z9E4w9mqkNRxgW8mIzqzjgGHh1XhcA4EQFEapFLU_4K_QXm_DQQpav1ycUA8keSbjSO649hYoTB4xij7c04YtdKQ_4 May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: b0c48bf20efd4291b37e616c658f96ff May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerActionsTestJSON-1958751992 May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerActionsTestJSON-1958751992 May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: b0c48bf20efd4291b37e616c658f96ff May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1958751992 May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerActionsTestJSON-1958751992-project May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 6272045226334bcf8b49a0aa41a07b95 May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerActionsTestJSON-1958751992-project May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 2a57aa6a-5fc6-496e-8363-83cc0600e0ee could not be found. May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '2a57aa6a-5fc6-496e-8363-83cc0600e0ee'} May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a57aa6a-5fc6-496e-8363-83cc0600e0ee could not be found. May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a57aa6a-5fc6-496e-8363-83cc0600e0ee could not be found. May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:51:58.907406 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:58.913297 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:51:58.913297 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:51:58.913297 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:51:58.913297 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:51:58.913297 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:51:58.913297 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a57aa6a-5fc6-496e-8363-83cc0600e0ee could not be found. May 28 04:51:58.913297 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:51:58.913297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e57ad2e6-fa2c-4a30-babe-03130fd9b0c2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Returning 404 to user: Instance 2a57aa6a-5fc6-496e-8363-83cc0600e0ee could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:51:58.913297 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e57ad2e6-fa2c-4a30-babe-03130fd9b0c2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee" status: 404 len: 111 microversion: 2.1 time: 0.035034 May 28 04:51:58.913297 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2227/4346] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:58 2022] GET /compute/v2.1/servers/2a57aa6a-5fc6-496e-8363-83cc0600e0ee => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:51:58.919561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ffa90ecc-f7a2-4ab0-90d4-e5f8ad4490ff tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:58.920204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ffa90ecc-f7a2-4ab0-90d4-e5f8ad4490ff tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:58.930177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ffa90ecc-f7a2-4ab0-90d4-e5f8ad4490ff tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:58.931528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ffa90ecc-f7a2-4ab0-90d4-e5f8ad4490ff tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:58.934145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ffa90ecc-f7a2-4ab0-90d4-e5f8ad4490ff tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:58.935606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ffa90ecc-f7a2-4ab0-90d4-e5f8ad4490ff tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:58.977700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ffa90ecc-f7a2-4ab0-90d4-e5f8ad4490ff tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:51:59.153139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-cb6b0d5e-2be3-4997-815c-b7c1f85b2752 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:51:59.153791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-cb6b0d5e-2be3-4997-815c-b7c1f85b2752 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:51:59.154448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-cb6b0d5e-2be3-4997-815c-b7c1f85b2752 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:51:59.155066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-cb6b0d5e-2be3-4997-815c-b7c1f85b2752 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:51:59.155649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-cb6b0d5e-2be3-4997-815c-b7c1f85b2752 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:51:59.178623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb6b0d5e-2be3-4997-815c-b7c1f85b2752 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:59.179203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb6b0d5e-2be3-4997-815c-b7c1f85b2752 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:59.180301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb6b0d5e-2be3-4997-815c-b7c1f85b2752 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:59.180814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb6b0d5e-2be3-4997-815c-b7c1f85b2752 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:59.204733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-cb6b0d5e-2be3-4997-815c-b7c1f85b2752 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for project b708685679fc4e4fa42b5797ca875be3. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:59.211193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-cb6b0d5e-2be3-4997-815c-b7c1f85b2752 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for user 774c9f835a2941659cbfc7a2ef2e64af and project b708685679fc4e4fa42b5797ca875be3. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:59.231028 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cb6b0d5e-2be3-4997-815c-b7c1f85b2752 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:51:59.233778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cb6b0d5e-2be3-4997-815c-b7c1f85b2752 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:51:59.357978 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ffa90ecc-f7a2-4ab0-90d4-e5f8ad4490ff tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "DELETE /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 204 len: 0 microversion: 2.1 time: 0.442308 May 28 04:51:59.359306 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2228/4347] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:51:58 2022] DELETE /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:51:59.368421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-533c1679-95ac-4ec0-b6b5-754f14b899b6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:59.369882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-533c1679-95ac-4ec0-b6b5-754f14b899b6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:59.373240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-cb6b0d5e-2be3-4997-815c-b7c1f85b2752 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_group_members'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:59.381859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-cb6b0d5e-2be3-4997-815c-b7c1f85b2752 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for user 774c9f835a2941659cbfc7a2ef2e64af and project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_group_members'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:59.383735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:51:59.384619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-533c1679-95ac-4ec0-b6b5-754f14b899b6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:59.385308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-533c1679-95ac-4ec0-b6b5-754f14b899b6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:59.389610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-533c1679-95ac-4ec0-b6b5-754f14b899b6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:59.389610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-533c1679-95ac-4ec0-b6b5-754f14b899b6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:59.484833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-533c1679-95ac-4ec0-b6b5-754f14b899b6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:59.494727 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-533c1679-95ac-4ec0-b6b5-754f14b899b6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1205 microversion: 2.1 time: 0.133863 May 28 04:51:59.495543 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2229/4348] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:59 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1205 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:59.510336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-58b058a6-ee5d-416c-9e4f-6b2f4fd22681 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:59.511955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-cb6b0d5e-2be3-4997-815c-b7c1f85b2752 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_group_members'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:51:59.512418 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-58b058a6-ee5d-416c-9e4f-6b2f4fd22681 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:59.519887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-cb6b0d5e-2be3-4997-815c-b7c1f85b2752 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Getting quotas for user 774c9f835a2941659cbfc7a2ef2e64af and project b708685679fc4e4fa42b5797ca875be3. Resources: {'server_group_members'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:51:59.530575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58b058a6-ee5d-416c-9e4f-6b2f4fd22681 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:59.534903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58b058a6-ee5d-416c-9e4f-6b2f4fd22681 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:59.535903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58b058a6-ee5d-416c-9e4f-6b2f4fd22681 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:59.536360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58b058a6-ee5d-416c-9e4f-6b2f4fd22681 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:59.555441 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cb6b0d5e-2be3-4997-815c-b7c1f85b2752 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.047109 May 28 04:51:59.556175 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2120/4349] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:51:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:51:59.569238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-46f82663-6bf6-462e-9f3b-c42a0826b201 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:59.569908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-46f82663-6bf6-462e-9f3b-c42a0826b201 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:59.577972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46f82663-6bf6-462e-9f3b-c42a0826b201 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:59.578883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46f82663-6bf6-462e-9f3b-c42a0826b201 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:59.579703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46f82663-6bf6-462e-9f3b-c42a0826b201 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:59.580751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46f82663-6bf6-462e-9f3b-c42a0826b201 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:59.730975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-58b058a6-ee5d-416c-9e4f-6b2f4fd22681 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:59.742913 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-58b058a6-ee5d-416c-9e4f-6b2f4fd22681 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1345 microversion: 2.1 time: 0.244203 May 28 04:51:59.744678 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2230/4350] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:59 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1345 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:59.755743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d5ee6db3-f6c8-4346-a37a-a84e27df9aa7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:59.756598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d5ee6db3-f6c8-4346-a37a-a84e27df9aa7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:59.774099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5ee6db3-f6c8-4346-a37a-a84e27df9aa7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:59.774842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5ee6db3-f6c8-4346-a37a-a84e27df9aa7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:59.775873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5ee6db3-f6c8-4346-a37a-a84e27df9aa7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:59.776614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5ee6db3-f6c8-4346-a37a-a84e27df9aa7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:59.823488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-46f82663-6bf6-462e-9f3b-c42a0826b201 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:51:59.833149 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-46f82663-6bf6-462e-9f3b-c42a0826b201 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1676 microversion: 2.1 time: 0.269738 May 28 04:51:59.835738 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2121/4351] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:59 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1676 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:51:59.840951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-99969e6c-5817-485a-9ce5-c0c7672f3c71 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:51:59.842656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-99969e6c-5817-485a-9ce5-c0c7672f3c71 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:51:59.855884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-99969e6c-5817-485a-9ce5-c0c7672f3c71 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:59.856725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-99969e6c-5817-485a-9ce5-c0c7672f3c71 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:51:59.857955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-99969e6c-5817-485a-9ce5-c0c7672f3c71 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:51:59.862601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-99969e6c-5817-485a-9ce5-c0c7672f3c71 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:00.154668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-99969e6c-5817-485a-9ce5-c0c7672f3c71 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:00.162963 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-99969e6c-5817-485a-9ce5-c0c7672f3c71 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0" status: 200 len: 1319 microversion: 2.1 time: 0.326057 May 28 04:52:00.163585 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2122/4352] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:59 2022] GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0 => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:00.168398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-29c79233-a9df-4dcf-ae1c-935afb7ac33a tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:00.169176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-29c79233-a9df-4dcf-ae1c-935afb7ac33a tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:00.178062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d5ee6db3-f6c8-4346-a37a-a84e27df9aa7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:00.186669 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d5ee6db3-f6c8-4346-a37a-a84e27df9aa7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1694 microversion: 2.1 time: 0.438917 May 28 04:52:00.189431 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2231/4353] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:51:59 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1694 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:00.251077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-29c79233-a9df-4dcf-ae1c-935afb7ac33a tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774c9f835a2941659cbfc7a2ef2e64af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b708685679fc4e4fa42b5797ca875be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:00.264816 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-29c79233-a9df-4dcf-ae1c-935afb7ac33a tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 200 len: 1212 microversion: 2.1 time: 0.099918 May 28 04:52:00.266098 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2123/4354] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:00 2022] GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 1212 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:00.420013 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-b0a3682c-7211-4539-abad-9f4c42ac5354 req-5af4f9db-b640-49c6-95cd-bb9cd8acd3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0", "name": "network-vif-plugged", "status": "completed", "tag": "5a85b894-e7f7-4ac2-bad2-a98149f2cc31"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:00.432178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b0a3682c-7211-4539-abad-9f4c42ac5354 req-5af4f9db-b640-49c6-95cd-bb9cd8acd3c5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:00.433959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b0a3682c-7211-4539-abad-9f4c42ac5354 req-5af4f9db-b640-49c6-95cd-bb9cd8acd3c5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:00.480740 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-b0a3682c-7211-4539-abad-9f4c42ac5354 req-5af4f9db-b640-49c6-95cd-bb9cd8acd3c5 service nova] Creating event network-vif-plugged:5a85b894-e7f7-4ac2-bad2-a98149f2cc31 for instance a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0 on n-h1-843700-1 May 28 04:52:00.494849 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-b0a3682c-7211-4539-abad-9f4c42ac5354 req-5af4f9db-b640-49c6-95cd-bb9cd8acd3c5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077886 May 28 04:52:00.499049 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2232/4355] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:00.512547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4a465fa7-e554-46aa-9de9-42eee6df1477 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:00.513654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4a465fa7-e554-46aa-9de9-42eee6df1477 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:00.530529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4a465fa7-e554-46aa-9de9-42eee6df1477 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:00.531179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4a465fa7-e554-46aa-9de9-42eee6df1477 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:00.532285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4a465fa7-e554-46aa-9de9-42eee6df1477 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:00.537205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4a465fa7-e554-46aa-9de9-42eee6df1477 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:00.649100 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4a465fa7-e554-46aa-9de9-42eee6df1477 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:00.660564 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4a465fa7-e554-46aa-9de9-42eee6df1477 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1279 microversion: 2.1 time: 0.151948 May 28 04:52:00.668468 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2124/4356] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:00 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1279 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:00.763294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-82f13bfb-7af1-4501-89dd-6c3d6bc0bc07 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:00.763995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-82f13bfb-7af1-4501-89dd-6c3d6bc0bc07 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:00.766455 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:00.774868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82f13bfb-7af1-4501-89dd-6c3d6bc0bc07 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:00.778296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82f13bfb-7af1-4501-89dd-6c3d6bc0bc07 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:00.778296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82f13bfb-7af1-4501-89dd-6c3d6bc0bc07 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:00.778296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82f13bfb-7af1-4501-89dd-6c3d6bc0bc07 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:00.831483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:00.851673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6db55a1e-925d-4b54-acb4-5cfc2845dee3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:00.852982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6db55a1e-925d-4b54-acb4-5cfc2845dee3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:00.865888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6db55a1e-925d-4b54-acb4-5cfc2845dee3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:00.868808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6db55a1e-925d-4b54-acb4-5cfc2845dee3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:00.871416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6db55a1e-925d-4b54-acb4-5cfc2845dee3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:00.872813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6db55a1e-925d-4b54-acb4-5cfc2845dee3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:01.008325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-82f13bfb-7af1-4501-89dd-6c3d6bc0bc07 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:01.026133 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-82f13bfb-7af1-4501-89dd-6c3d6bc0bc07 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1345 microversion: 2.1 time: 0.269162 May 28 04:52:01.035524 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2233/4357] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:00 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1345 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:01.179884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ec4017d7-8a30-47e7-8432-291b6cecd2c7 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:01.180896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ec4017d7-8a30-47e7-8432-291b6cecd2c7 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:01.188662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec4017d7-8a30-47e7-8432-291b6cecd2c7 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:01.190078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec4017d7-8a30-47e7-8432-291b6cecd2c7 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:01.191994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec4017d7-8a30-47e7-8432-291b6cecd2c7 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:01.192887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec4017d7-8a30-47e7-8432-291b6cecd2c7 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:01.621024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6db55a1e-925d-4b54-acb4-5cfc2845dee3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:01.637961 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6db55a1e-925d-4b54-acb4-5cfc2845dee3 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1676 microversion: 2.1 time: 0.790804 May 28 04:52:01.663188 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2125/4358] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:00 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1676 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:01.670291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fa5bf5bd-4bff-4ba7-a47e-5cc211f2ffd2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:01.671338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fa5bf5bd-4bff-4ba7-a47e-5cc211f2ffd2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:01.679740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa5bf5bd-4bff-4ba7-a47e-5cc211f2ffd2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:01.681078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa5bf5bd-4bff-4ba7-a47e-5cc211f2ffd2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:01.682475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa5bf5bd-4bff-4ba7-a47e-5cc211f2ffd2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:01.683186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa5bf5bd-4bff-4ba7-a47e-5cc211f2ffd2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:01.688438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:01.691858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ec4017d7-8a30-47e7-8432-291b6cecd2c7 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:01.699198 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ec4017d7-8a30-47e7-8432-291b6cecd2c7 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0" status: 200 len: 1319 microversion: 2.1 time: 0.522672 May 28 04:52:01.703842 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2234/4359] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:01 2022] GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0 => generated 1319 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:01.714978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1dd6bfc4-a10b-474b-af26-6a9984c574fd tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:01.715469 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1dd6bfc4-a10b-474b-af26-6a9984c574fd tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:01.723438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1dd6bfc4-a10b-474b-af26-6a9984c574fd tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:01.723898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1dd6bfc4-a10b-474b-af26-6a9984c574fd tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:01.724679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1dd6bfc4-a10b-474b-af26-6a9984c574fd tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:01.725123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1dd6bfc4-a10b-474b-af26-6a9984c574fd tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:01.922810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1dd6bfc4-a10b-474b-af26-6a9984c574fd tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774c9f835a2941659cbfc7a2ef2e64af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b708685679fc4e4fa42b5797ca875be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:01.952415 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1dd6bfc4-a10b-474b-af26-6a9984c574fd tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 200 len: 1216 microversion: 2.1 time: 0.244998 May 28 04:52:01.956318 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2235/4360] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:01 2022] GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 1216 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:01.969546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fa5bf5bd-4bff-4ba7-a47e-5cc211f2ffd2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:01.978799 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fa5bf5bd-4bff-4ba7-a47e-5cc211f2ffd2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1694 microversion: 2.1 time: 0.313193 May 28 04:52:01.979428 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0dab923f-4e25-4925-8988-7a5868022bce tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:01.982417 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2126/4361] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:01 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1694 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:01.984367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0dab923f-4e25-4925-8988-7a5868022bce tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:02.016154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0dab923f-4e25-4925-8988-7a5868022bce tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:02.019919 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0dab923f-4e25-4925-8988-7a5868022bce tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:02.023206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0dab923f-4e25-4925-8988-7a5868022bce tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:02.025578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0dab923f-4e25-4925-8988-7a5868022bce tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:02.043037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ebd2b0f9-f127-4577-a461-0f5472950a39 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:02.043671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ebd2b0f9-f127-4577-a461-0f5472950a39 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:02.053736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebd2b0f9-f127-4577-a461-0f5472950a39 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:02.056110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebd2b0f9-f127-4577-a461-0f5472950a39 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:02.056110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebd2b0f9-f127-4577-a461-0f5472950a39 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:02.060603 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebd2b0f9-f127-4577-a461-0f5472950a39 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:02.140242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebd2b0f9-f127-4577-a461-0f5472950a39 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:02.140700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebd2b0f9-f127-4577-a461-0f5472950a39 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:02.141168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-ebd2b0f9-f127-4577-a461-0f5472950a39 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lazy-loading 'fault' on Instance uuid 2acbf858-4bd9-4004-ba98-569c9fe52f55 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:52:02.237046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ebd2b0f9-f127-4577-a461-0f5472950a39 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:02.249439 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ebd2b0f9-f127-4577-a461-0f5472950a39 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 200 len: 1350 microversion: 2.1 time: 0.207752 May 28 04:52:02.250283 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2127/4362] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:02 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 1350 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:02.385929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0dab923f-4e25-4925-8988-7a5868022bce tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:02.395948 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0dab923f-4e25-4925-8988-7a5868022bce tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1309 microversion: 2.1 time: 0.438031 May 28 04:52:02.397224 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2236/4363] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:01 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1309 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:02.675431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cd161d25-82d4-465a-ac62-f28126fb4239 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:02.676066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cd161d25-82d4-465a-ac62-f28126fb4239 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:02.682840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd161d25-82d4-465a-ac62-f28126fb4239 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:02.683378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd161d25-82d4-465a-ac62-f28126fb4239 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:02.684166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd161d25-82d4-465a-ac62-f28126fb4239 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:02.684612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd161d25-82d4-465a-ac62-f28126fb4239 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:02.717100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-181b47a6-bcfe-4d48-8527-2be68e6123a5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:02.717720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-181b47a6-bcfe-4d48-8527-2be68e6123a5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:02.725243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-181b47a6-bcfe-4d48-8527-2be68e6123a5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:02.725980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-181b47a6-bcfe-4d48-8527-2be68e6123a5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:02.727146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-181b47a6-bcfe-4d48-8527-2be68e6123a5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:02.727835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-181b47a6-bcfe-4d48-8527-2be68e6123a5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:02.782665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cd161d25-82d4-465a-ac62-f28126fb4239 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:02.801313 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cd161d25-82d4-465a-ac62-f28126fb4239 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1608 microversion: 2.1 time: 0.134350 May 28 04:52:02.811027 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2128/4364] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:02 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1608 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:02.973500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cd80fad3-e0ec-4e59-9a49-b12801c00382 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:02.973500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cd80fad3-e0ec-4e59-9a49-b12801c00382 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:02.980898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd80fad3-e0ec-4e59-9a49-b12801c00382 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:02.988786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd80fad3-e0ec-4e59-9a49-b12801c00382 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:02.990790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd80fad3-e0ec-4e59-9a49-b12801c00382 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:02.994445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd80fad3-e0ec-4e59-9a49-b12801c00382 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:03.182766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-181b47a6-bcfe-4d48-8527-2be68e6123a5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:03.192778 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-181b47a6-bcfe-4d48-8527-2be68e6123a5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0" status: 200 len: 1508 microversion: 2.1 time: 0.480026 May 28 04:52:03.202218 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2237/4365] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:02 2022] GET /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0 => generated 1508 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:03.217143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-cf3e9018-d0fc-4621-a028-d09641dc708c req-7d7a9f9d-2f3e-4763-b939-09a0d2e02128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "215a4357-1792-4f6e-ae11-f8574b806b73", "name": "network-vif-deleted", "tag": "f007cebf-d19d-420d-891d-de3291249844"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:03.226597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-cf3e9018-d0fc-4621-a028-d09641dc708c req-7d7a9f9d-2f3e-4763-b939-09a0d2e02128 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:03.227418 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-cf3e9018-d0fc-4621-a028-d09641dc708c req-7d7a9f9d-2f3e-4763-b939-09a0d2e02128 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:03.250223 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-cf3e9018-d0fc-4621-a028-d09641dc708c req-7d7a9f9d-2f3e-4763-b939-09a0d2e02128 service nova] Creating event network-vif-deleted:f007cebf-d19d-420d-891d-de3291249844 for instance 215a4357-1792-4f6e-ae11-f8574b806b73 on n-h2-843700-1 May 28 04:52:03.263788 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-cf3e9018-d0fc-4621-a028-d09641dc708c req-7d7a9f9d-2f3e-4763-b939-09a0d2e02128 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060102 May 28 04:52:03.264420 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2238/4366] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:03.277431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d0e403bc-d947-4012-aee0-689c50626b42 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:03.281384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d0e403bc-d947-4012-aee0-689c50626b42 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:03.300186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d0e403bc-d947-4012-aee0-689c50626b42 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:03.300930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d0e403bc-d947-4012-aee0-689c50626b42 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:03.302097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d0e403bc-d947-4012-aee0-689c50626b42 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:03.302721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d0e403bc-d947-4012-aee0-689c50626b42 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:03.526270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cd80fad3-e0ec-4e59-9a49-b12801c00382 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774c9f835a2941659cbfc7a2ef2e64af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b708685679fc4e4fa42b5797ca875be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:03.536884 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cd80fad3-e0ec-4e59-9a49-b12801c00382 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 200 len: 1264 microversion: 2.1 time: 0.568878 May 28 04:52:03.537484 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2129/4367] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:02 2022] GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 1264 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:03.548007 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a539b65a-ce64-48ff-8989-40ca5daefd2a tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:03.549039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a539b65a-ce64-48ff-8989-40ca5daefd2a tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 4401f4bf-a185-4bf8-b99c-30104fd8e26e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:03.555756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a539b65a-ce64-48ff-8989-40ca5daefd2a tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:03.556492 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a539b65a-ce64-48ff-8989-40ca5daefd2a tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:03.557506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a539b65a-ce64-48ff-8989-40ca5daefd2a tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:03.558146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a539b65a-ce64-48ff-8989-40ca5daefd2a tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:03.983886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d0e403bc-d947-4012-aee0-689c50626b42 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:03.997470 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d0e403bc-d947-4012-aee0-689c50626b42 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1694 microversion: 2.1 time: 0.724258 May 28 04:52:03.999783 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2239/4368] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:03 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1694 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:04.012662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6a5577d9-23e4-45be-85b9-fca292083023 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:04.012662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6a5577d9-23e4-45be-85b9-fca292083023 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:04.027971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a5577d9-23e4-45be-85b9-fca292083023 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:04.029980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a5577d9-23e4-45be-85b9-fca292083023 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:04.029980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a5577d9-23e4-45be-85b9-fca292083023 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:04.030712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a5577d9-23e4-45be-85b9-fca292083023 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:04.040665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a539b65a-ce64-48ff-8989-40ca5daefd2a tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:04.051375 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a539b65a-ce64-48ff-8989-40ca5daefd2a tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/4401f4bf-a185-4bf8-b99c-30104fd8e26e" status: 200 len: 1507 microversion: 2.1 time: 0.508958 May 28 04:52:04.056331 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2130/4369] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:03 2022] GET /compute/v2.1/servers/4401f4bf-a185-4bf8-b99c-30104fd8e26e => generated 1507 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-6a5577d9-23e4-45be-85b9-fca292083023 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6a5577d9-23e4-45be-85b9-fca292083023 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 HTTP/1.1 May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '2acbf858-4bd9-4004-ba98-569c9fe52f55'} May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:04.056482 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:04.062879 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. May 28 04:52:04.062879 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:04.062879 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:04.062879 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:04.062879 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:04.062879 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:04.062879 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:04.062879 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:04.062879 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:04.062879 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. May 28 04:52:04.062879 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:04.062879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6a5577d9-23e4-45be-85b9-fca292083023 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:04.062879 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6a5577d9-23e4-45be-85b9-fca292083023 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 404 len: 111 microversion: 2.1 time: 0.057708 May 28 04:52:04.062879 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2240/4370] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:03 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:04.068391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c6c5ee7d-ba8b-4c1e-906b-0b4586c45a07 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:04.069515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c6c5ee7d-ba8b-4c1e-906b-0b4586c45a07 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:04.080826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6c5ee7d-ba8b-4c1e-906b-0b4586c45a07 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:04.081451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6c5ee7d-ba8b-4c1e-906b-0b4586c45a07 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:04.082350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6c5ee7d-ba8b-4c1e-906b-0b4586c45a07 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:04.082920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6c5ee7d-ba8b-4c1e-906b-0b4586c45a07 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:04.084675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5e0ab684-386b-49b5-b675-c9f6ec26c2ad tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:04.086295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5e0ab684-386b-49b5-b675-c9f6ec26c2ad tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:04.106334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5e0ab684-386b-49b5-b675-c9f6ec26c2ad tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:04.107775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5e0ab684-386b-49b5-b675-c9f6ec26c2ad tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:04.108565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5e0ab684-386b-49b5-b675-c9f6ec26c2ad tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:04.111121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5e0ab684-386b-49b5-b675-c9f6ec26c2ad tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:04.180275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5e0ab684-386b-49b5-b675-c9f6ec26c2ad tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:04.180781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5e0ab684-386b-49b5-b675-c9f6ec26c2ad tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:04.181244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-5e0ab684-386b-49b5-b675-c9f6ec26c2ad tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lazy-loading 'fault' on Instance uuid 215a4357-1792-4f6e-ae11-f8574b806b73 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:52:04.330825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5e0ab684-386b-49b5-b675-c9f6ec26c2ad tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6272045226334bcf8b49a0aa41a07b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c48bf20efd4291b37e616c658f96ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:04.341409 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5e0ab684-386b-49b5-b675-c9f6ec26c2ad tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 200 len: 1328 microversion: 2.1 time: 0.281693 May 28 04:52:04.347032 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2241/4371] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:04 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 1328 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:04.364171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f4cd9125-2d63-4105-a450-c75bac5a5f2d tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:04.365177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f4cd9125-2d63-4105-a450-c75bac5a5f2d tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 4401f4bf-a185-4bf8-b99c-30104fd8e26e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:04.380434 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4cd9125-2d63-4105-a450-c75bac5a5f2d tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:04.381264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4cd9125-2d63-4105-a450-c75bac5a5f2d tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:04.382274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4cd9125-2d63-4105-a450-c75bac5a5f2d tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:04.383491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4cd9125-2d63-4105-a450-c75bac5a5f2d tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:04.414233 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f4cd9125-2d63-4105-a450-c75bac5a5f2d tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 4401f4bf-a185-4bf8-b99c-30104fd8e26e] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:52:04.566741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c6c5ee7d-ba8b-4c1e-906b-0b4586c45a07 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:04.601302 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c6c5ee7d-ba8b-4c1e-906b-0b4586c45a07 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1309 microversion: 2.1 time: 0.533119 May 28 04:52:04.602645 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2131/4372] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:04 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1309 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:04.612077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-843b4218-ecfa-4640-ba86-2f0c7384458f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:04.613570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-843b4218-ecfa-4640-ba86-2f0c7384458f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:04.621676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-843b4218-ecfa-4640-ba86-2f0c7384458f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:04.622388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-843b4218-ecfa-4640-ba86-2f0c7384458f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:04.623866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-843b4218-ecfa-4640-ba86-2f0c7384458f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:04.630850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-843b4218-ecfa-4640-ba86-2f0c7384458f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:04.645925 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-843b4218-ecfa-4640-ba86-2f0c7384458f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-843b4218-ecfa-4640-ba86-2f0c7384458f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55/os-volume_attachments HTTP/1.1 May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'server_id': '2acbf858-4bd9-4004-ba98-569c9fe52f55'} May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:04.648206 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:04.653547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. May 28 04:52:04.653547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:04.653547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:04.653547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:04.653547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:04.653547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:04.653547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:04.653547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:04.653547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:04.653547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. May 28 04:52:04.653547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:04.657765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-843b4218-ecfa-4640-ba86-2f0c7384458f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:04.659403 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-843b4218-ecfa-4640-ba86-2f0c7384458f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.055212 May 28 04:52:04.660084 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2132/4373] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:52:04 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55/os-volume_attachments => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:04.665754 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-051e1852-893a-4869-994d-6e902559bcb1 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:04.666480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-051e1852-893a-4869-994d-6e902559bcb1 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:04.673319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-051e1852-893a-4869-994d-6e902559bcb1 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:04.675198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-051e1852-893a-4869-994d-6e902559bcb1 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:04.676777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-051e1852-893a-4869-994d-6e902559bcb1 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:04.677300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-051e1852-893a-4869-994d-6e902559bcb1 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:04.834192 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f4cd9125-2d63-4105-a450-c75bac5a5f2d tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4401f4bf-a185-4bf8-b99c-30104fd8e26e" status: 204 len: 0 microversion: 2.1 time: 0.489984 May 28 04:52:04.834842 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2242/4374] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:52:04 2022] DELETE /compute/v2.1/servers/4401f4bf-a185-4bf8-b99c-30104fd8e26e => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:52:04.848650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f9776d8f-cfca-4d6c-9cc2-ac54d80b5f99 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:04.851964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f9776d8f-cfca-4d6c-9cc2-ac54d80b5f99 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:04.897540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9776d8f-cfca-4d6c-9cc2-ac54d80b5f99 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:04.899951 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9776d8f-cfca-4d6c-9cc2-ac54d80b5f99 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:04.903338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9776d8f-cfca-4d6c-9cc2-ac54d80b5f99 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:04.906520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f9776d8f-cfca-4d6c-9cc2-ac54d80b5f99 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:04.973394 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f9776d8f-cfca-4d6c-9cc2-ac54d80b5f99 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:52:05.163468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-051e1852-893a-4869-994d-6e902559bcb1 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774c9f835a2941659cbfc7a2ef2e64af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b708685679fc4e4fa42b5797ca875be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:05.179518 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-051e1852-893a-4869-994d-6e902559bcb1 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 200 len: 1270 microversion: 2.1 time: 0.516093 May 28 04:52:05.180166 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2133/4375] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:04 2022] GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 1270 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:05.192978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-a3e985bc-2158-4563-897a-8bb95009fd50 req-ca394190-b1be-4116-8096-5dda1549fca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d240c27b-8a6b-4c15-ac5b-d9a7e5beda94", "tag": "a46253ec-f259-41f9-91b7-9c51ad92cede"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:05.219049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a3e985bc-2158-4563-897a-8bb95009fd50 req-ca394190-b1be-4116-8096-5dda1549fca0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:05.219521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a3e985bc-2158-4563-897a-8bb95009fd50 req-ca394190-b1be-4116-8096-5dda1549fca0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:05.233166 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-a3e985bc-2158-4563-897a-8bb95009fd50 req-ca394190-b1be-4116-8096-5dda1549fca0 service nova] Creating event network-changed:a46253ec-f259-41f9-91b7-9c51ad92cede for instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 on n-h1-843700-1 May 28 04:52:05.247585 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-a3e985bc-2158-4563-897a-8bb95009fd50 req-ca394190-b1be-4116-8096-5dda1549fca0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064090 May 28 04:52:05.257866 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2134/4376] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:05.267579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9def9ab1-8f9c-4d44-ad43-0729a3d57bbb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:05.276077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9def9ab1-8f9c-4d44-ad43-0729a3d57bbb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:05.289666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9def9ab1-8f9c-4d44-ad43-0729a3d57bbb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:05.293296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9def9ab1-8f9c-4d44-ad43-0729a3d57bbb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:05.293296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9def9ab1-8f9c-4d44-ad43-0729a3d57bbb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:05.293296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9def9ab1-8f9c-4d44-ad43-0729a3d57bbb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:05.365162 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f9776d8f-cfca-4d6c-9cc2-ac54d80b5f99 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0" status: 204 len: 0 microversion: 2.1 time: 0.525620 May 28 04:52:05.366589 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2243/4377] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:52:04 2022] DELETE /compute/v2.1/servers/a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 04:52:05.378267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4e7ece50-bc3d-4467-8c79-cc1e46ca684d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-808533019", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "807b877d-73e2-4031-b4ab-972d86c6cc59"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:05.496492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-4e7ece50-bc3d-4467-8c79-cc1e46ca684d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] validate_networks() for [('807b877d-73e2-4031-b4ab-972d86c6cc59', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:52:05.658091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9def9ab1-8f9c-4d44-ad43-0729a3d57bbb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:05.665853 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9def9ab1-8f9c-4d44-ad43-0729a3d57bbb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1699 microversion: 2.1 time: 0.406659 May 28 04:52:05.666431 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2135/4378] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:05 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1699 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:05.670930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e325bd52-5fdf-4c44-b4b5-effc3e0aa335 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:05.671572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e325bd52-5fdf-4c44-b4b5-effc3e0aa335 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] [instance: 215a4357-1792-4f6e-ae11-f8574b806b73] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:05.678066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e325bd52-5fdf-4c44-b4b5-effc3e0aa335 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:05.678243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e325bd52-5fdf-4c44-b4b5-effc3e0aa335 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:05.679036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e325bd52-5fdf-4c44-b4b5-effc3e0aa335 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:05.679357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e325bd52-5fdf-4c44-b4b5-effc3e0aa335 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:05.695876 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-e325bd52-5fdf-4c44-b4b5-effc3e0aa335 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] HTTP exception thrown: Instance 215a4357-1792-4f6e-ae11-f8574b806b73 could not be found. May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e325bd52-5fdf-4c44-b4b5-effc3e0aa335 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Request method failure captured: May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 HTTP/1.1 May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaiOBPq9qQrr95jSEOmRbogZ9t59pbtlXtSw81aS7-xhKzdjgN5RN9WIUU9s438FP46672OAQzJO5i-wir1g5z9E4w9mqkNRxgW8mIzqzjgGHh1XhcA4EQFEapFLU_4K_QXm_DQQpav1ycUA8keSbjSO649hYoTB4xij7c04YtdKQ_4 May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: b0c48bf20efd4291b37e616c658f96ff May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerActionsTestJSON-1958751992 May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b0c48bf20efd4291b37e616c658f96ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerActionsTestJSON-1958751992 May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: b0c48bf20efd4291b37e616c658f96ff May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1958751992 May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerActionsTestJSON-1958751992-project May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 6272045226334bcf8b49a0aa41a07b95 May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerActionsTestJSON-1958751992-project May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 215a4357-1792-4f6e-ae11-f8574b806b73 could not be found. May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '215a4357-1792-4f6e-ae11-f8574b806b73'} May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 215a4357-1792-4f6e-ae11-f8574b806b73 could not be found. May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 215a4357-1792-4f6e-ae11-f8574b806b73 could not be found. May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:05.697570 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:05.706594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:05.706594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:05.706594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:05.706594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:05.706594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:05.706594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 215a4357-1792-4f6e-ae11-f8574b806b73 could not be found. May 28 04:52:05.706594 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:05.706594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e325bd52-5fdf-4c44-b4b5-effc3e0aa335 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Returning 404 to user: Instance 215a4357-1792-4f6e-ae11-f8574b806b73 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:05.706594 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e325bd52-5fdf-4c44-b4b5-effc3e0aa335 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73" status: 404 len: 111 microversion: 2.1 time: 0.031630 May 28 04:52:05.706594 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2136/4379] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:05 2022] GET /compute/v2.1/servers/215a4357-1792-4f6e-ae11-f8574b806b73 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:05.706594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-906375f1-eef3-4c58-ab72-e569d58a99f0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1244543315", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "aa00a74f-7361-4532-a5cc-72e0389ed51f"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:05.771546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-906375f1-eef3-4c58-ab72-e569d58a99f0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] validate_networks() for [('aa00a74f-7361-4532-a5cc-72e0389ed51f', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:52:06.237936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4e7ece50-bc3d-4467-8c79-cc1e46ca684d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:52:06.238369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4e7ece50-bc3d-4467-8c79-cc1e46ca684d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:52:06.238852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4e7ece50-bc3d-4467-8c79-cc1e46ca684d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:52:06.239839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4e7ece50-bc3d-4467-8c79-cc1e46ca684d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:52:06.240551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4e7ece50-bc3d-4467-8c79-cc1e46ca684d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:52:06.251468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e7ece50-bc3d-4467-8c79-cc1e46ca684d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:06.251956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e7ece50-bc3d-4467-8c79-cc1e46ca684d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:06.252974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e7ece50-bc3d-4467-8c79-cc1e46ca684d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:06.254777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e7ece50-bc3d-4467-8c79-cc1e46ca684d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:06.274794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-4e7ece50-bc3d-4467-8c79-cc1e46ca684d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Getting quotas for project dd598ce55f9b43d38530dae05fa1bda1. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:52:06.280471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-4e7ece50-bc3d-4467-8c79-cc1e46ca684d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Getting quotas for user b05e9b7e95074a91bc984338593c6c84 and project dd598ce55f9b43d38530dae05fa1bda1. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:52:06.295527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4e7ece50-bc3d-4467-8c79-cc1e46ca684d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:52:06.296703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4e7ece50-bc3d-4467-8c79-cc1e46ca684d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:52:06.406774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-906375f1-eef3-4c58-ab72-e569d58a99f0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:52:06.407291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-906375f1-eef3-4c58-ab72-e569d58a99f0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:52:06.408532 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-906375f1-eef3-4c58-ab72-e569d58a99f0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:52:06.408985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-906375f1-eef3-4c58-ab72-e569d58a99f0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:52:06.409410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-906375f1-eef3-4c58-ab72-e569d58a99f0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:52:06.420231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-906375f1-eef3-4c58-ab72-e569d58a99f0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:06.420701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-906375f1-eef3-4c58-ab72-e569d58a99f0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:06.421529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-906375f1-eef3-4c58-ab72-e569d58a99f0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:06.421973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-906375f1-eef3-4c58-ab72-e569d58a99f0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:06.453434 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4e7ece50-bc3d-4467-8c79-cc1e46ca684d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085138 May 28 04:52:06.454587 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2244/4380] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:52:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:52:06.460632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-af20fa4f-f09a-47e7-a55d-1f28bb2ad1b9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:06.461704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-af20fa4f-f09a-47e7-a55d-1f28bb2ad1b9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:06.470881 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-af20fa4f-f09a-47e7-a55d-1f28bb2ad1b9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:06.471906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-af20fa4f-f09a-47e7-a55d-1f28bb2ad1b9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:06.472957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-af20fa4f-f09a-47e7-a55d-1f28bb2ad1b9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:06.473676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-af20fa4f-f09a-47e7-a55d-1f28bb2ad1b9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:06.505007 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-906375f1-eef3-4c58-ab72-e569d58a99f0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Getting quotas for project 9ac87488ec1b4944a056d28d154eede5. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:52:06.512253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-906375f1-eef3-4c58-ab72-e569d58a99f0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Getting quotas for user 6c1ff365f86047dcb5ba2ad991a29e81 and project 9ac87488ec1b4944a056d28d154eede5. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:52:06.528296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-906375f1-eef3-4c58-ab72-e569d58a99f0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Going to run 2 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:52:06.532535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-906375f1-eef3-4c58-ab72-e569d58a99f0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 474caa3e-f826-4a32-82aa-4c5bf30e2c7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:52:06.638616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-906375f1-eef3-4c58-ab72-e569d58a99f0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 0015d5ed-bee0-4520-8a13-42d5f5abc857] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=474caa3e-f826-4a32-82aa-4c5bf30e2c7d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:52:06.871400 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-906375f1-eef3-4c58-ab72-e569d58a99f0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.170568 May 28 04:52:06.872056 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2137/4381] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:52:05 2022] POST /compute/v2.1/servers => generated 32 bytes in 1172 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 28 04:52:06.887696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6f8a173a-9fa1-440a-997d-7ea483a669b2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] Calling method '.version_select at 0x7f7701d5cf70>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:07.002961 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6f8a173a-9fa1-440a-997d-7ea483a669b2 tempest-ServerActionsTestJSON-1958751992 tempest-ServerActionsTestJSON-1958751992-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-185302012" status: 202 len: 0 microversion: 2.1 time: 0.129500 May 28 04:52:07.011040 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2138/4382] 10.222.0.58 () {58 vars in 1217 bytes} [Sat May 28 04:52:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-185302012 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:52:07.133522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-349cb12e-3ca7-40f6-ab36-371a91db6c29 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-916267852", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:07.210527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-349cb12e-3ca7-40f6-ab36-371a91db6c29 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] validate_networks() for [('c40cfd3f-b8f6-4961-b680-d58c000ac161', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:52:07.602075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-af20fa4f-f09a-47e7-a55d-1f28bb2ad1b9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:07.612791 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-af20fa4f-f09a-47e7-a55d-1f28bb2ad1b9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1309 microversion: 2.1 time: 1.156428 May 28 04:52:07.627447 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2245/4383] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:06 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1309 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:07.633965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5970eb2b-b233-4e77-bb77-1f8e6712de0b tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:07.634821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5970eb2b-b233-4e77-bb77-1f8e6712de0b tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:07.644630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5970eb2b-b233-4e77-bb77-1f8e6712de0b tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:07.644630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5970eb2b-b233-4e77-bb77-1f8e6712de0b tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:07.645523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5970eb2b-b233-4e77-bb77-1f8e6712de0b tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:07.646137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5970eb2b-b233-4e77-bb77-1f8e6712de0b tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:08.294000 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5970eb2b-b233-4e77-bb77-1f8e6712de0b tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774c9f835a2941659cbfc7a2ef2e64af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b708685679fc4e4fa42b5797ca875be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:08.311749 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5970eb2b-b233-4e77-bb77-1f8e6712de0b tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 200 len: 1312 microversion: 2.1 time: 0.682256 May 28 04:52:08.312928 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2246/4384] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:07 2022] GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 1312 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:08.391251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-887592f5-448d-4227-9216-a29f87a12a10 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:08.394374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-887592f5-448d-4227-9216-a29f87a12a10 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:08.427559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-887592f5-448d-4227-9216-a29f87a12a10 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:08.434451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-887592f5-448d-4227-9216-a29f87a12a10 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:08.435905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-887592f5-448d-4227-9216-a29f87a12a10 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:08.437322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-887592f5-448d-4227-9216-a29f87a12a10 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:08.590728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-887592f5-448d-4227-9216-a29f87a12a10 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:08.603424 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-887592f5-448d-4227-9216-a29f87a12a10 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/66cb58ba-7ecb-418f-9fa9-8aa5f7f84357" status: 200 len: 1218 microversion: 2.1 time: 0.288962 May 28 04:52:08.604061 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2247/4385] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:08 2022] GET /compute/v2.1/servers/66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 => generated 1218 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:08.613389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef839bfe-fc7e-4dd2-9053-9ca9457a8f94 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:08.619683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ef839bfe-fc7e-4dd2-9053-9ca9457a8f94 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:08.639717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef839bfe-fc7e-4dd2-9053-9ca9457a8f94 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:08.651963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef839bfe-fc7e-4dd2-9053-9ca9457a8f94 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:08.653108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef839bfe-fc7e-4dd2-9053-9ca9457a8f94 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:08.653738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef839bfe-fc7e-4dd2-9053-9ca9457a8f94 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:08.664119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-349cb12e-3ca7-40f6-ab36-371a91db6c29 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:52:08.664651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-349cb12e-3ca7-40f6-ab36-371a91db6c29 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:52:08.665089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-349cb12e-3ca7-40f6-ab36-371a91db6c29 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:52:08.665556 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-349cb12e-3ca7-40f6-ab36-371a91db6c29 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:52:08.666242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-349cb12e-3ca7-40f6-ab36-371a91db6c29 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:52:08.675900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:08.683186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-349cb12e-3ca7-40f6-ab36-371a91db6c29 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:08.683651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-349cb12e-3ca7-40f6-ab36-371a91db6c29 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:08.684471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-349cb12e-3ca7-40f6-ab36-371a91db6c29 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:08.689329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-349cb12e-3ca7-40f6-ab36-371a91db6c29 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:08.744685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-349cb12e-3ca7-40f6-ab36-371a91db6c29 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Getting quotas for project c1de840d90bc4c97ac64a7b214f397c9. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:52:08.751846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-349cb12e-3ca7-40f6-ab36-371a91db6c29 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Getting quotas for user 18d148985c3544219da8b641f63346b0 and project c1de840d90bc4c97ac64a7b214f397c9. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:52:08.773166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-349cb12e-3ca7-40f6-ab36-371a91db6c29 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:52:08.777039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-349cb12e-3ca7-40f6-ab36-371a91db6c29 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:52:09.009999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef839bfe-fc7e-4dd2-9053-9ca9457a8f94 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:09.018583 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ef839bfe-fc7e-4dd2-9053-9ca9457a8f94 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1699 microversion: 2.1 time: 0.413533 May 28 04:52:09.019991 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2248/4386] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:08 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1699 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:09.043700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-187d80a0-7c98-430e-b7bf-a1d94f3ecbd5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:09.046811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-187d80a0-7c98-430e-b7bf-a1d94f3ecbd5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:09.047846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-187d80a0-7c98-430e-b7bf-a1d94f3ecbd5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Searching by: {'deleted': False, 'project_id': '9ac87488ec1b4944a056d28d154eede5'} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:52:09.087452 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-349cb12e-3ca7-40f6-ab36-371a91db6c29 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.079443 May 28 04:52:09.088400 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2139/4387] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:52:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 2084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:52:09.093107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-a4bc4f9f-74d4-4d59-b17f-037cde43e820 req-1d12fd0f-2642-4b2f-93e7-62e5b5fa8abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4401f4bf-a185-4bf8-b99c-30104fd8e26e", "name": "network-vif-deleted", "tag": "4dfbe3b7-6f6b-4c12-b73e-920e8a86a6ea"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:09.107026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a4bc4f9f-74d4-4d59-b17f-037cde43e820 req-1d12fd0f-2642-4b2f-93e7-62e5b5fa8abf service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:09.107775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a4bc4f9f-74d4-4d59-b17f-037cde43e820 req-1d12fd0f-2642-4b2f-93e7-62e5b5fa8abf service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:09.107965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-187d80a0-7c98-430e-b7bf-a1d94f3ecbd5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:09.108432 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-187d80a0-7c98-430e-b7bf-a1d94f3ecbd5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:09.109312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-187d80a0-7c98-430e-b7bf-a1d94f3ecbd5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:09.109756 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-187d80a0-7c98-430e-b7bf-a1d94f3ecbd5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:09.122113 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-a4bc4f9f-74d4-4d59-b17f-037cde43e820 req-1d12fd0f-2642-4b2f-93e7-62e5b5fa8abf service nova] Creating event network-vif-deleted:4dfbe3b7-6f6b-4c12-b73e-920e8a86a6ea for instance 4401f4bf-a185-4bf8-b99c-30104fd8e26e on n-h2-843700-1 May 28 04:52:09.129669 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-a4bc4f9f-74d4-4d59-b17f-037cde43e820 req-1d12fd0f-2642-4b2f-93e7-62e5b5fa8abf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039852 May 28 04:52:09.130933 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2140/4388] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:09.138292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b6f2a804-4d02-47ae-80fe-325d25c88c51 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:09.139125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b6f2a804-4d02-47ae-80fe-325d25c88c51 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:09.146806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6f2a804-4d02-47ae-80fe-325d25c88c51 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:09.148074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6f2a804-4d02-47ae-80fe-325d25c88c51 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:09.149292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6f2a804-4d02-47ae-80fe-325d25c88c51 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:09.150006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6f2a804-4d02-47ae-80fe-325d25c88c51 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:09.185190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.multi_cell_list [None req-187d80a0-7c98-430e-b7bf-a1d94f3ecbd5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=126044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:52:09.234287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b6f2a804-4d02-47ae-80fe-325d25c88c51 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:52:09.264744 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-187d80a0-7c98-430e-b7bf-a1d94f3ecbd5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.243350 May 28 04:52:09.267160 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2249/4389] 10.222.0.58 () {58 vars in 1124 bytes} [Sat May 28 04:52:09 2022] GET /compute/v2.1/servers => generated 1004 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:09.289537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3888a8b1-662f-42e3-959b-5ed810da911c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:09.293153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3888a8b1-662f-42e3-959b-5ed810da911c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:09.325825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3888a8b1-662f-42e3-959b-5ed810da911c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:09.326306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3888a8b1-662f-42e3-959b-5ed810da911c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:09.327147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3888a8b1-662f-42e3-959b-5ed810da911c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:09.327591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3888a8b1-662f-42e3-959b-5ed810da911c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:09.507701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:DELETE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:09.609586 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b6f2a804-4d02-47ae-80fe-325d25c88c51 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "DELETE /compute/v2.1/servers/66cb58ba-7ecb-418f-9fa9-8aa5f7f84357" status: 204 len: 0 microversion: 2.1 time: 0.477009 May 28 04:52:09.610191 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2141/4390] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:52:09 2022] DELETE /compute/v2.1/servers/66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:52:09.620544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d38ad2c7-198b-40d7-a405-4b511fc19495 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:09.622024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d38ad2c7-198b-40d7-a405-4b511fc19495 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:09.742824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d38ad2c7-198b-40d7-a405-4b511fc19495 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:09.749956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3888a8b1-662f-42e3-959b-5ed810da911c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:09.760686 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d38ad2c7-198b-40d7-a405-4b511fc19495 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1213 microversion: 2.1 time: 0.145923 May 28 04:52:09.775521 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3888a8b1-662f-42e3-959b-5ed810da911c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1309 microversion: 2.1 time: 0.506974 May 28 04:52:09.784925 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2250/4391] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:09 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1309 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:09.785083 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2142/4392] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:09 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1213 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:09.791084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-644cd92b-d829-43ef-9f2a-ce251bff8cdf tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:09.791751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-644cd92b-d829-43ef-9f2a-ce251bff8cdf tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:09.800003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e35a6041-32c3-473b-b25a-8bb8df7fc96b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:09.800671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e35a6041-32c3-473b-b25a-8bb8df7fc96b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 0015d5ed-bee0-4520-8a13-42d5f5abc857] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:09.807148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-644cd92b-d829-43ef-9f2a-ce251bff8cdf tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:09.813025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-644cd92b-d829-43ef-9f2a-ce251bff8cdf tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:09.813166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e35a6041-32c3-473b-b25a-8bb8df7fc96b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:09.814758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-644cd92b-d829-43ef-9f2a-ce251bff8cdf tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:09.815295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-644cd92b-d829-43ef-9f2a-ce251bff8cdf tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:09.815445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e35a6041-32c3-473b-b25a-8bb8df7fc96b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:09.816171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e35a6041-32c3-473b-b25a-8bb8df7fc96b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:09.816625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e35a6041-32c3-473b-b25a-8bb8df7fc96b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:10.049741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e35a6041-32c3-473b-b25a-8bb8df7fc96b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:10.061074 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e35a6041-32c3-473b-b25a-8bb8df7fc96b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857" status: 200 len: 1222 microversion: 2.1 time: 0.281089 May 28 04:52:10.061074 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2251/4393] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:09 2022] GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857 => generated 1222 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:10.069374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-d399b897-1a1c-486c-a3d9-ec9adf98e1d3 req-e9fea289-92d4-48a2-9ddd-fff42bf85d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0", "name": "network-vif-deleted", "tag": "5a85b894-e7f7-4ac2-bad2-a98149f2cc31"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:10.084769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d399b897-1a1c-486c-a3d9-ec9adf98e1d3 req-e9fea289-92d4-48a2-9ddd-fff42bf85d32 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:10.085220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d399b897-1a1c-486c-a3d9-ec9adf98e1d3 req-e9fea289-92d4-48a2-9ddd-fff42bf85d32 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:10.110311 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-d399b897-1a1c-486c-a3d9-ec9adf98e1d3 req-e9fea289-92d4-48a2-9ddd-fff42bf85d32 service nova] Creating event network-vif-deleted:5a85b894-e7f7-4ac2-bad2-a98149f2cc31 for instance a0cba8e8-1ac4-4bb6-bca2-8d0feb7d91d0 on n-h1-843700-1 May 28 04:52:10.132067 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-d399b897-1a1c-486c-a3d9-ec9adf98e1d3 req-e9fea289-92d4-48a2-9ddd-fff42bf85d32 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071829 May 28 04:52:10.133015 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2252/4394] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:10.139228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7c87c5f8-c6fe-4cfc-9b6a-e4ab34346834 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:10.140305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7c87c5f8-c6fe-4cfc-9b6a-e4ab34346834 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:10.154285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7c87c5f8-c6fe-4cfc-9b6a-e4ab34346834 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:10.155995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7c87c5f8-c6fe-4cfc-9b6a-e4ab34346834 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:10.158288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7c87c5f8-c6fe-4cfc-9b6a-e4ab34346834 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:10.158288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7c87c5f8-c6fe-4cfc-9b6a-e4ab34346834 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:10.255525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7c87c5f8-c6fe-4cfc-9b6a-e4ab34346834 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:10.265082 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7c87c5f8-c6fe-4cfc-9b6a-e4ab34346834 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/66cb58ba-7ecb-418f-9fa9-8aa5f7f84357" status: 200 len: 1216 microversion: 2.1 time: 0.130666 May 28 04:52:10.265928 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2253/4395] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:10 2022] GET /compute/v2.1/servers/66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 => generated 1216 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:10.270480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-644cd92b-d829-43ef-9f2a-ce251bff8cdf tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774c9f835a2941659cbfc7a2ef2e64af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b708685679fc4e4fa42b5797ca875be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:10.274926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-91d094a8-b331-4b81-901f-2774ac7026ae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:10.275573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-91d094a8-b331-4b81-901f-2774ac7026ae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:10.283479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-91d094a8-b331-4b81-901f-2774ac7026ae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:10.286140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-91d094a8-b331-4b81-901f-2774ac7026ae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:10.286291 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-644cd92b-d829-43ef-9f2a-ce251bff8cdf tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 200 len: 1312 microversion: 2.1 time: 0.506066 May 28 04:52:10.286393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-91d094a8-b331-4b81-901f-2774ac7026ae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:10.286393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-91d094a8-b331-4b81-901f-2774ac7026ae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:10.295219 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2143/4396] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:09 2022] GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 1312 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:10.550225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-91d094a8-b331-4b81-901f-2774ac7026ae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:10.562396 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-91d094a8-b331-4b81-901f-2774ac7026ae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1699 microversion: 2.1 time: 0.293787 May 28 04:52:10.574547 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2254/4397] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:10 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1699 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:10.790050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ff161c2d-d3e4-480f-9335-d579b7497e49 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:10.791698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ff161c2d-d3e4-480f-9335-d579b7497e49 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:10.800189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b0596dee-580d-44fa-86c5-fbc4789ff3dd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:10.801465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b0596dee-580d-44fa-86c5-fbc4789ff3dd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:10.814008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0596dee-580d-44fa-86c5-fbc4789ff3dd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:10.815409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0596dee-580d-44fa-86c5-fbc4789ff3dd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:10.818520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0596dee-580d-44fa-86c5-fbc4789ff3dd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:10.819946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0596dee-580d-44fa-86c5-fbc4789ff3dd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:10.830506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff161c2d-d3e4-480f-9335-d579b7497e49 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:10.831109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff161c2d-d3e4-480f-9335-d579b7497e49 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:10.831941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff161c2d-d3e4-480f-9335-d579b7497e49 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:10.832382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff161c2d-d3e4-480f-9335-d579b7497e49 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:11.093284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ff161c2d-d3e4-480f-9335-d579b7497e49 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:11.139203 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ff161c2d-d3e4-480f-9335-d579b7497e49 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1217 microversion: 2.1 time: 0.362074 May 28 04:52:11.151259 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2144/4398] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:10 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1217 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:11.157579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-55be1c77-d69f-4795-b0d9-3912e7e09865 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:11.158706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-55be1c77-d69f-4795-b0d9-3912e7e09865 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 0015d5ed-bee0-4520-8a13-42d5f5abc857] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:11.166715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-55be1c77-d69f-4795-b0d9-3912e7e09865 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:11.167902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-55be1c77-d69f-4795-b0d9-3912e7e09865 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:11.168986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-55be1c77-d69f-4795-b0d9-3912e7e09865 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:11.169920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-55be1c77-d69f-4795-b0d9-3912e7e09865 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:11.602449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b0596dee-580d-44fa-86c5-fbc4789ff3dd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:11.613321 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b0596dee-580d-44fa-86c5-fbc4789ff3dd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1309 microversion: 2.1 time: 0.823286 May 28 04:52:11.614120 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2255/4399] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:10 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1309 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:11.619399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-63651a6c-1fdb-49e3-9ee9-ed28aa491296 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:11.620550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-63651a6c-1fdb-49e3-9ee9-ed28aa491296 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:11.632960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-63651a6c-1fdb-49e3-9ee9-ed28aa491296 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:11.634866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-63651a6c-1fdb-49e3-9ee9-ed28aa491296 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:11.634866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-63651a6c-1fdb-49e3-9ee9-ed28aa491296 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:11.635593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-63651a6c-1fdb-49e3-9ee9-ed28aa491296 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:11.677930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-55be1c77-d69f-4795-b0d9-3912e7e09865 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:11.690050 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-55be1c77-d69f-4795-b0d9-3912e7e09865 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857" status: 200 len: 1270 microversion: 2.1 time: 0.534917 May 28 04:52:11.700992 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2145/4400] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:11 2022] GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857 => generated 1270 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:11.702030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-70dfb016-b190-4039-a1f2-5c12852a99f0 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:11.702765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-70dfb016-b190-4039-a1f2-5c12852a99f0 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:11.710016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70dfb016-b190-4039-a1f2-5c12852a99f0 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:11.710476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70dfb016-b190-4039-a1f2-5c12852a99f0 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:11.711297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70dfb016-b190-4039-a1f2-5c12852a99f0 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:11.711743 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70dfb016-b190-4039-a1f2-5c12852a99f0 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:11.804526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-63651a6c-1fdb-49e3-9ee9-ed28aa491296 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:11.822251 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-63651a6c-1fdb-49e3-9ee9-ed28aa491296 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/66cb58ba-7ecb-418f-9fa9-8aa5f7f84357" status: 200 len: 1218 microversion: 2.1 time: 0.205890 May 28 04:52:11.824993 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2256/4401] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:11 2022] GET /compute/v2.1/servers/66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 => generated 1218 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:11.840299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e80a4f59-86ab-40b4-a563-41ff25565516 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:11.840810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e80a4f59-86ab-40b4-a563-41ff25565516 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:11.858616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e80a4f59-86ab-40b4-a563-41ff25565516 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:11.858835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e80a4f59-86ab-40b4-a563-41ff25565516 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:11.859622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e80a4f59-86ab-40b4-a563-41ff25565516 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:11.860070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e80a4f59-86ab-40b4-a563-41ff25565516 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:11.914649 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e80a4f59-86ab-40b4-a563-41ff25565516 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/ips" status: 200 len: 147 microversion: 2.1 time: 0.088520 May 28 04:52:11.917392 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2257/4402] 10.222.0.58 () {58 vars in 1247 bytes} [Sat May 28 04:52:11 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/ips => generated 147 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:11.924828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7fe2ff7d-0cf5-47ac-ab3e-a7ee8fc138c5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:11.925380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7fe2ff7d-0cf5-47ac-ab3e-a7ee8fc138c5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:11.932162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fe2ff7d-0cf5-47ac-ab3e-a7ee8fc138c5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:11.932572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fe2ff7d-0cf5-47ac-ab3e-a7ee8fc138c5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:11.933342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fe2ff7d-0cf5-47ac-ab3e-a7ee8fc138c5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:11.933793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fe2ff7d-0cf5-47ac-ab3e-a7ee8fc138c5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:12.010173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-70dfb016-b190-4039-a1f2-5c12852a99f0 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774c9f835a2941659cbfc7a2ef2e64af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b708685679fc4e4fa42b5797ca875be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:12.016501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:12.038046 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-70dfb016-b190-4039-a1f2-5c12852a99f0 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 200 len: 1312 microversion: 2.1 time: 0.340194 May 28 04:52:12.041668 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2146/4403] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:11 2022] GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 1312 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:12.159417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d8dae588-f24b-46ac-a218-510d6a6f1dde tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:12.164312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d8dae588-f24b-46ac-a218-510d6a6f1dde tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:12.184531 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8dae588-f24b-46ac-a218-510d6a6f1dde tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:12.194471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8dae588-f24b-46ac-a218-510d6a6f1dde tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:12.197847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8dae588-f24b-46ac-a218-510d6a6f1dde tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:12.199107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8dae588-f24b-46ac-a218-510d6a6f1dde tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:12.255327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7fe2ff7d-0cf5-47ac-ab3e-a7ee8fc138c5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:12.264420 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7fe2ff7d-0cf5-47ac-ab3e-a7ee8fc138c5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1699 microversion: 2.1 time: 0.343720 May 28 04:52:12.277148 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2258/4404] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:11 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1699 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:12.285890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-419c7d04-65fd-498b-a7ca-d0bc02aa5995 req-f2e0df34-26ec-4993-9f2d-c04b4344546d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bfa8d9c-3440-4ff7-933c-ee7d614ab248", "tag": "6a57d163-2dea-4b8a-8a92-d65e0045681b"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:12.295682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-419c7d04-65fd-498b-a7ca-d0bc02aa5995 req-f2e0df34-26ec-4993-9f2d-c04b4344546d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:12.297918 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-419c7d04-65fd-498b-a7ca-d0bc02aa5995 req-f2e0df34-26ec-4993-9f2d-c04b4344546d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:12.314597 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-419c7d04-65fd-498b-a7ca-d0bc02aa5995 req-f2e0df34-26ec-4993-9f2d-c04b4344546d service nova] Creating event network-changed:6a57d163-2dea-4b8a-8a92-d65e0045681b for instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 on n-h1-843700-1 May 28 04:52:12.322376 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-419c7d04-65fd-498b-a7ca-d0bc02aa5995 req-f2e0df34-26ec-4993-9f2d-c04b4344546d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043071 May 28 04:52:12.325995 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2259/4405] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:12.354105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d8dae588-f24b-46ac-a218-510d6a6f1dde tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:12.364132 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d8dae588-f24b-46ac-a218-510d6a6f1dde tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1265 microversion: 2.1 time: 0.211030 May 28 04:52:12.365399 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2147/4406] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:12 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:12.630367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b98ca97e-5851-4426-9dbf-2727534a0929 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:12.631090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b98ca97e-5851-4426-9dbf-2727534a0929 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:12.641370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b98ca97e-5851-4426-9dbf-2727534a0929 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:12.641370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b98ca97e-5851-4426-9dbf-2727534a0929 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:12.641370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b98ca97e-5851-4426-9dbf-2727534a0929 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:12.641370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b98ca97e-5851-4426-9dbf-2727534a0929 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:12.712688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0c912319-ec6d-487e-a329-0af4f736eec4 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:12.713247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0c912319-ec6d-487e-a329-0af4f736eec4 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 0015d5ed-bee0-4520-8a13-42d5f5abc857] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:12.723314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c912319-ec6d-487e-a329-0af4f736eec4 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:12.723778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c912319-ec6d-487e-a329-0af4f736eec4 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:12.728704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c912319-ec6d-487e-a329-0af4f736eec4 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:12.729159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c912319-ec6d-487e-a329-0af4f736eec4 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:12.878473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0c912319-ec6d-487e-a329-0af4f736eec4 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:12.891120 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0c912319-ec6d-487e-a329-0af4f736eec4 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857" status: 200 len: 1276 microversion: 2.1 time: 0.184519 May 28 04:52:12.903098 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2148/4407] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:12 2022] GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857 => generated 1276 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:12.910099 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-21f74a73-c9a6-4d01-9a2a-a671e9fac35c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:12.911086 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-21f74a73-c9a6-4d01-9a2a-a671e9fac35c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:12.918085 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21f74a73-c9a6-4d01-9a2a-a671e9fac35c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:12.918851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21f74a73-c9a6-4d01-9a2a-a671e9fac35c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:12.919853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21f74a73-c9a6-4d01-9a2a-a671e9fac35c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:12.920514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21f74a73-c9a6-4d01-9a2a-a671e9fac35c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:12.968784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b98ca97e-5851-4426-9dbf-2727534a0929 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:13.005849 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b98ca97e-5851-4426-9dbf-2727534a0929 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1309 microversion: 2.1 time: 0.379491 May 28 04:52:13.007960 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2260/4408] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:12 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1309 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:13.033395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-21f74a73-c9a6-4d01-9a2a-a671e9fac35c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:13.041642 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-21f74a73-c9a6-4d01-9a2a-a671e9fac35c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/66cb58ba-7ecb-418f-9fa9-8aa5f7f84357" status: 200 len: 1218 microversion: 2.1 time: 0.136379 May 28 04:52:13.042002 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2149/4409] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:12 2022] GET /compute/v2.1/servers/66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 => generated 1218 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:13.059738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ff1afa77-b9ef-4372-b88a-fb636be1dece tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:13.060415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ff1afa77-b9ef-4372-b88a-fb636be1dece tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:13.072167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff1afa77-b9ef-4372-b88a-fb636be1dece tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:13.076292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff1afa77-b9ef-4372-b88a-fb636be1dece tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:13.076292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff1afa77-b9ef-4372-b88a-fb636be1dece tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:13.076292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff1afa77-b9ef-4372-b88a-fb636be1dece tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:13.283548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eb683af9-feaf-478d-a74c-7a639ea754d3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:13.284476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eb683af9-feaf-478d-a74c-7a639ea754d3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:13.291859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb683af9-feaf-478d-a74c-7a639ea754d3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:13.300002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb683af9-feaf-478d-a74c-7a639ea754d3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:13.302877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb683af9-feaf-478d-a74c-7a639ea754d3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:13.319616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb683af9-feaf-478d-a74c-7a639ea754d3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:13.358180 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ff1afa77-b9ef-4372-b88a-fb636be1dece tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774c9f835a2941659cbfc7a2ef2e64af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b708685679fc4e4fa42b5797ca875be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:13.373527 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ff1afa77-b9ef-4372-b88a-fb636be1dece tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 200 len: 1312 microversion: 2.1 time: 0.318616 May 28 04:52:13.387003 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2261/4410] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:13 2022] GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 1312 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:13.399924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-113411b1-bd7f-4c3c-97a8-6c0cd4a12883 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:13.402636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-113411b1-bd7f-4c3c-97a8-6c0cd4a12883 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:13.416730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-113411b1-bd7f-4c3c-97a8-6c0cd4a12883 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:13.418607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-113411b1-bd7f-4c3c-97a8-6c0cd4a12883 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:13.419609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-113411b1-bd7f-4c3c-97a8-6c0cd4a12883 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:13.421537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-113411b1-bd7f-4c3c-97a8-6c0cd4a12883 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:13.582969 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-113411b1-bd7f-4c3c-97a8-6c0cd4a12883 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:13.601354 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-113411b1-bd7f-4c3c-97a8-6c0cd4a12883 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1271 microversion: 2.1 time: 0.210901 May 28 04:52:13.620702 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2262/4411] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:13 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1271 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:13.759592 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eb683af9-feaf-478d-a74c-7a639ea754d3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:13.782381 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eb683af9-feaf-478d-a74c-7a639ea754d3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1699 microversion: 2.1 time: 0.502879 May 28 04:52:13.797024 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2150/4412] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:13 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1699 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:13.911820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d58c2c17-f3f5-4a90-ac0a-3aa553bcdc1c tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:13.912710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d58c2c17-f3f5-4a90-ac0a-3aa553bcdc1c tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 0015d5ed-bee0-4520-8a13-42d5f5abc857] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:13.922803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d58c2c17-f3f5-4a90-ac0a-3aa553bcdc1c tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:13.923836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d58c2c17-f3f5-4a90-ac0a-3aa553bcdc1c tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:13.931119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d58c2c17-f3f5-4a90-ac0a-3aa553bcdc1c tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:13.931791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d58c2c17-f3f5-4a90-ac0a-3aa553bcdc1c tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:14.023585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3792c24e-fa1b-4218-9113-d3f5b603caba tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:14.024431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3792c24e-fa1b-4218-9113-d3f5b603caba tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:14.037165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3792c24e-fa1b-4218-9113-d3f5b603caba tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:14.038342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3792c24e-fa1b-4218-9113-d3f5b603caba tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:14.051644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3792c24e-fa1b-4218-9113-d3f5b603caba tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:14.052412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3792c24e-fa1b-4218-9113-d3f5b603caba tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:14.073617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d58c2c17-f3f5-4a90-ac0a-3aa553bcdc1c tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:14.088305 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d58c2c17-f3f5-4a90-ac0a-3aa553bcdc1c tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857" status: 200 len: 1276 microversion: 2.1 time: 0.176277 May 28 04:52:14.089575 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2263/4413] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:13 2022] GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857 => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:14.100686 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-43ab5d46-0b6c-4758-aca9-e3cceccb253d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:14.101329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-43ab5d46-0b6c-4758-aca9-e3cceccb253d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:14.116012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43ab5d46-0b6c-4758-aca9-e3cceccb253d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:14.119263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43ab5d46-0b6c-4758-aca9-e3cceccb253d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:14.120264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43ab5d46-0b6c-4758-aca9-e3cceccb253d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:14.120890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43ab5d46-0b6c-4758-aca9-e3cceccb253d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:14.151702 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-43ab5d46-0b6c-4758-aca9-e3cceccb253d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 could not be found. May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-43ab5d46-0b6c-4758-aca9-e3cceccb253d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 HTTP/1.1 May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 could not be found. May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '66cb58ba-7ecb-418f-9fa9-8aa5f7f84357'} May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 could not be found. May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 could not be found. May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:14.154475 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:14.160094 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:14.160094 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:14.160094 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:14.160094 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:14.160094 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:14.160094 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 could not be found. May 28 04:52:14.160094 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:14.166327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-43ab5d46-0b6c-4758-aca9-e3cceccb253d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:14.167974 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-43ab5d46-0b6c-4758-aca9-e3cceccb253d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/66cb58ba-7ecb-418f-9fa9-8aa5f7f84357" status: 404 len: 111 microversion: 2.1 time: 0.077193 May 28 04:52:14.169645 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2264/4414] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:14 2022] GET /compute/v2.1/servers/66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:14.238519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eec071f7-2f74-4af7-83fa-0e2a91fdcf9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-396037194", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "807b877d-73e2-4031-b4ab-972d86c6cc59"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:14.338929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-eec071f7-2f74-4af7-83fa-0e2a91fdcf9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] validate_networks() for [('807b877d-73e2-4031-b4ab-972d86c6cc59', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:52:14.349828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3792c24e-fa1b-4218-9113-d3f5b603caba tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:14.367625 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3792c24e-fa1b-4218-9113-d3f5b603caba tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1309 microversion: 2.1 time: 0.347805 May 28 04:52:14.368983 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2151/4415] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:14 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1309 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:14.391147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2c6faae1-d56a-439a-9b44-3be616e9b174 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:14.392704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2c6faae1-d56a-439a-9b44-3be616e9b174 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:14.405506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c6faae1-d56a-439a-9b44-3be616e9b174 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:14.406236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c6faae1-d56a-439a-9b44-3be616e9b174 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:14.407337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c6faae1-d56a-439a-9b44-3be616e9b174 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:14.408606 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c6faae1-d56a-439a-9b44-3be616e9b174 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:14.784672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2c6faae1-d56a-439a-9b44-3be616e9b174 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774c9f835a2941659cbfc7a2ef2e64af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b708685679fc4e4fa42b5797ca875be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:14.792989 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2c6faae1-d56a-439a-9b44-3be616e9b174 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 200 len: 1312 microversion: 2.1 time: 0.405402 May 28 04:52:14.803128 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2152/4416] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:14 2022] GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 1312 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:14.808162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-ee9eb674-56fa-4378-9c0e-185f8d58a40d req-aad806ea-8046-4b3e-ac5d-326b52b95749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d240c27b-8a6b-4c15-ac5b-d9a7e5beda94", "name": "network-vif-plugged", "status": "completed", "tag": "a46253ec-f259-41f9-91b7-9c51ad92cede"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:14.819879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ee9eb674-56fa-4378-9c0e-185f8d58a40d req-aad806ea-8046-4b3e-ac5d-326b52b95749 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:14.820612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ee9eb674-56fa-4378-9c0e-185f8d58a40d req-aad806ea-8046-4b3e-ac5d-326b52b95749 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:14.868426 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-ee9eb674-56fa-4378-9c0e-185f8d58a40d req-aad806ea-8046-4b3e-ac5d-326b52b95749 service nova] Creating event network-vif-plugged:a46253ec-f259-41f9-91b7-9c51ad92cede for instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 on n-h1-843700-1 May 28 04:52:14.885936 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-ee9eb674-56fa-4378-9c0e-185f8d58a40d req-aad806ea-8046-4b3e-ac5d-326b52b95749 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080240 May 28 04:52:14.888293 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2153/4417] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:14.913623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aa4bfb92-3f91-4c2e-9959-a599322bf351 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:14.913623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-aa4bfb92-3f91-4c2e-9959-a599322bf351 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:14.969778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa4bfb92-3f91-4c2e-9959-a599322bf351 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:14.972353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa4bfb92-3f91-4c2e-9959-a599322bf351 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:14.985016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa4bfb92-3f91-4c2e-9959-a599322bf351 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:14.986499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa4bfb92-3f91-4c2e-9959-a599322bf351 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:15.301560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-eec071f7-2f74-4af7-83fa-0e2a91fdcf9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:52:15.302394 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-eec071f7-2f74-4af7-83fa-0e2a91fdcf9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:52:15.302888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-eec071f7-2f74-4af7-83fa-0e2a91fdcf9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:52:15.304208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-eec071f7-2f74-4af7-83fa-0e2a91fdcf9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:52:15.304824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-eec071f7-2f74-4af7-83fa-0e2a91fdcf9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:52:15.319019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eec071f7-2f74-4af7-83fa-0e2a91fdcf9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:15.319608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eec071f7-2f74-4af7-83fa-0e2a91fdcf9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:15.326482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eec071f7-2f74-4af7-83fa-0e2a91fdcf9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:15.326482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eec071f7-2f74-4af7-83fa-0e2a91fdcf9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:15.341079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-eec071f7-2f74-4af7-83fa-0e2a91fdcf9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Getting quotas for project dd598ce55f9b43d38530dae05fa1bda1. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:52:15.346981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-eec071f7-2f74-4af7-83fa-0e2a91fdcf9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Getting quotas for user b05e9b7e95074a91bc984338593c6c84 and project dd598ce55f9b43d38530dae05fa1bda1. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:52:15.350049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:15.362043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-eec071f7-2f74-4af7-83fa-0e2a91fdcf9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:52:15.364827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-eec071f7-2f74-4af7-83fa-0e2a91fdcf9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:52:15.434340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-aa4bfb92-3f91-4c2e-9959-a599322bf351 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:15.446306 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aa4bfb92-3f91-4c2e-9959-a599322bf351 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1313 microversion: 2.1 time: 0.553911 May 28 04:52:15.448269 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2154/4418] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:14 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:15.458410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-453ab746-e39b-4836-8355-e8a1802782ad tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:15.463725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-453ab746-e39b-4836-8355-e8a1802782ad tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:15.472308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-453ab746-e39b-4836-8355-e8a1802782ad tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:15.473150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-453ab746-e39b-4836-8355-e8a1802782ad tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:15.474521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-453ab746-e39b-4836-8355-e8a1802782ad tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:15.475262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-453ab746-e39b-4836-8355-e8a1802782ad tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:15.557303 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-eec071f7-2f74-4af7-83fa-0e2a91fdcf9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.323216 May 28 04:52:15.564203 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2265/4419] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:52:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:52:15.569800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4ca57867-8ceb-4ff5-a8e9-460698e3cc3a tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:15.570437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4ca57867-8ceb-4ff5-a8e9-460698e3cc3a tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 0015d5ed-bee0-4520-8a13-42d5f5abc857] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:15.589101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ca57867-8ceb-4ff5-a8e9-460698e3cc3a tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:15.589995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ca57867-8ceb-4ff5-a8e9-460698e3cc3a tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:15.590858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ca57867-8ceb-4ff5-a8e9-460698e3cc3a tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:15.593637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ca57867-8ceb-4ff5-a8e9-460698e3cc3a tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:15.778078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-453ab746-e39b-4836-8355-e8a1802782ad tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:15.789237 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-453ab746-e39b-4836-8355-e8a1802782ad tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1699 microversion: 2.1 time: 0.339492 May 28 04:52:15.801990 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2155/4420] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:15 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1699 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:15.811013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fc8e0fce-61e6-4bdd-981d-01937f0c31a2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:15.813404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fc8e0fce-61e6-4bdd-981d-01937f0c31a2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:15.822481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc8e0fce-61e6-4bdd-981d-01937f0c31a2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:15.832392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc8e0fce-61e6-4bdd-981d-01937f0c31a2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:15.832392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc8e0fce-61e6-4bdd-981d-01937f0c31a2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:15.832392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc8e0fce-61e6-4bdd-981d-01937f0c31a2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:15.869063 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4ca57867-8ceb-4ff5-a8e9-460698e3cc3a tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:15.881812 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4ca57867-8ceb-4ff5-a8e9-460698e3cc3a tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857" status: 200 len: 1318 microversion: 2.1 time: 0.313104 May 28 04:52:15.883095 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2266/4421] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:15 2022] GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:15.894234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8e2ab9f9-446e-48a2-bf2a-cdb74ada9869 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:15.894234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8e2ab9f9-446e-48a2-bf2a-cdb74ada9869 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:16.011526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8e2ab9f9-446e-48a2-bf2a-cdb74ada9869 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:16.056577 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8e2ab9f9-446e-48a2-bf2a-cdb74ada9869 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 200 len: 1214 microversion: 2.1 time: 0.169254 May 28 04:52:16.057760 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2267/4422] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:15 2022] GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 1214 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:16.066413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9427b8d4-d4ad-461d-a14f-898b2365b99a tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:16.067638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9427b8d4-d4ad-461d-a14f-898b2365b99a tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:16.070034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fc8e0fce-61e6-4bdd-981d-01937f0c31a2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:16.078778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9427b8d4-d4ad-461d-a14f-898b2365b99a tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:16.081171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9427b8d4-d4ad-461d-a14f-898b2365b99a tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:16.082238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9427b8d4-d4ad-461d-a14f-898b2365b99a tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:16.082971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9427b8d4-d4ad-461d-a14f-898b2365b99a tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:16.088880 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fc8e0fce-61e6-4bdd-981d-01937f0c31a2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1309 microversion: 2.1 time: 0.285666 May 28 04:52:16.092440 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2156/4423] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:15 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1309 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:16.100025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-37de255e-26c3-466e-9c22-400d068b04a3 req-bf7f88d2-3dbd-48d7-a2d4-038a3107cf33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "474caa3e-f826-4a32-82aa-4c5bf30e2c7d", "tag": "b3bfffb5-1c7e-45f1-b907-290b2a2be5b2"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:16.111485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-37de255e-26c3-466e-9c22-400d068b04a3 req-bf7f88d2-3dbd-48d7-a2d4-038a3107cf33 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:16.112196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-37de255e-26c3-466e-9c22-400d068b04a3 req-bf7f88d2-3dbd-48d7-a2d4-038a3107cf33 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:16.126025 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-37de255e-26c3-466e-9c22-400d068b04a3 req-bf7f88d2-3dbd-48d7-a2d4-038a3107cf33 service nova] Creating event network-changed:b3bfffb5-1c7e-45f1-b907-290b2a2be5b2 for instance 474caa3e-f826-4a32-82aa-4c5bf30e2c7d on n-h2-843700-1 May 28 04:52:16.135036 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-37de255e-26c3-466e-9c22-400d068b04a3 req-bf7f88d2-3dbd-48d7-a2d4-038a3107cf33 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041102 May 28 04:52:16.136384 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2157/4424] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:16.143471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8bd885d5-767c-46bc-821c-5c350a1f2f8d tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23779e36-bf77-4c46-b62c-9ad03a9f5e7f"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:16.145273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8bd885d5-767c-46bc-821c-5c350a1f2f8d tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:16.152154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8bd885d5-767c-46bc-821c-5c350a1f2f8d tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:16.152883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8bd885d5-767c-46bc-821c-5c350a1f2f8d tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:16.154156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8bd885d5-767c-46bc-821c-5c350a1f2f8d tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:16.155078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8bd885d5-767c-46bc-821c-5c350a1f2f8d tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:16.428620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9427b8d4-d4ad-461d-a14f-898b2365b99a tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774c9f835a2941659cbfc7a2ef2e64af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b708685679fc4e4fa42b5797ca875be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:16.433462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:16.438271 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9427b8d4-d4ad-461d-a14f-898b2365b99a tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 200 len: 1312 microversion: 2.1 time: 0.379248 May 28 04:52:16.438896 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2268/4425] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:16 2022] GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 1312 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:16.466165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b87583f9-ed56-49eb-b7ff-d09b31d5d213 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:16.467233 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b87583f9-ed56-49eb-b7ff-d09b31d5d213 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:16.475432 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b87583f9-ed56-49eb-b7ff-d09b31d5d213 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:16.476280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b87583f9-ed56-49eb-b7ff-d09b31d5d213 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:16.477476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b87583f9-ed56-49eb-b7ff-d09b31d5d213 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:16.478584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b87583f9-ed56-49eb-b7ff-d09b31d5d213 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:17.042163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b87583f9-ed56-49eb-b7ff-d09b31d5d213 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:17.050303 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b87583f9-ed56-49eb-b7ff-d09b31d5d213 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1313 microversion: 2.1 time: 0.589920 May 28 04:52:17.051214 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2269/4426] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:16 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1313 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:17.056502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4ecf7cc2-c1bb-4017-916f-ef38b3295788 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:17.057262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4ecf7cc2-c1bb-4017-916f-ef38b3295788 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:17.077850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ecf7cc2-c1bb-4017-916f-ef38b3295788 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:17.078389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ecf7cc2-c1bb-4017-916f-ef38b3295788 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:17.081193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ecf7cc2-c1bb-4017-916f-ef38b3295788 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:17.081744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ecf7cc2-c1bb-4017-916f-ef38b3295788 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:17.244307 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8bd885d5-767c-46bc-821c-5c350a1f2f8d tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "POST /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.106069 May 28 04:52:17.246375 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2158/4427] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 04:52:16 2022] POST /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments => generated 194 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:17.267451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4dd9ab4c-ada0-47d3-84a2-cff0bd483693 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:17.270790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4dd9ab4c-ada0-47d3-84a2-cff0bd483693 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 0015d5ed-bee0-4520-8a13-42d5f5abc857] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:17.289366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4dd9ab4c-ada0-47d3-84a2-cff0bd483693 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:17.289895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4dd9ab4c-ada0-47d3-84a2-cff0bd483693 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:17.293995 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4dd9ab4c-ada0-47d3-84a2-cff0bd483693 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:17.294520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4dd9ab4c-ada0-47d3-84a2-cff0bd483693 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:17.322738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4ecf7cc2-c1bb-4017-916f-ef38b3295788 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:17.332923 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4ecf7cc2-c1bb-4017-916f-ef38b3295788 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1699 microversion: 2.1 time: 0.280349 May 28 04:52:17.333790 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2270/4428] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:17 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1699 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:17.341466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c54e695e-1c7c-4d71-927c-96d3f84a96ed tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:17.342374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c54e695e-1c7c-4d71-927c-96d3f84a96ed tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:17.358412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c54e695e-1c7c-4d71-927c-96d3f84a96ed tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:17.359091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c54e695e-1c7c-4d71-927c-96d3f84a96ed tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:17.359893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c54e695e-1c7c-4d71-927c-96d3f84a96ed tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:17.361316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c54e695e-1c7c-4d71-927c-96d3f84a96ed tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:17.489301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c54e695e-1c7c-4d71-927c-96d3f84a96ed tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:17.497776 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c54e695e-1c7c-4d71-927c-96d3f84a96ed tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 200 len: 1218 microversion: 2.1 time: 0.162228 May 28 04:52:17.498976 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2271/4429] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:17 2022] GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 1218 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:17.505359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5ae6999d-8114-48af-b891-e492c609a7b1 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:17.506229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5ae6999d-8114-48af-b891-e492c609a7b1 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:17.516183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ae6999d-8114-48af-b891-e492c609a7b1 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:17.517483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ae6999d-8114-48af-b891-e492c609a7b1 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:17.518597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ae6999d-8114-48af-b891-e492c609a7b1 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:17.519059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ae6999d-8114-48af-b891-e492c609a7b1 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:17.567120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4dd9ab4c-ada0-47d3-84a2-cff0bd483693 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:17.584818 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4dd9ab4c-ada0-47d3-84a2-cff0bd483693 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857" status: 200 len: 1318 microversion: 2.1 time: 0.322244 May 28 04:52:17.586080 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2159/4430] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:17 2022] GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:17.598802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-f324d38d-bd05-4ffb-af6c-1284ce8113e0 req-acd6d332-14df-4fc1-b2aa-0986c06832c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0015d5ed-bee0-4520-8a13-42d5f5abc857", "tag": "cb667d54-41a5-4818-baec-43858e95a3d4"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:17.618538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f324d38d-bd05-4ffb-af6c-1284ce8113e0 req-acd6d332-14df-4fc1-b2aa-0986c06832c4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:17.619011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f324d38d-bd05-4ffb-af6c-1284ce8113e0 req-acd6d332-14df-4fc1-b2aa-0986c06832c4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:17.635421 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-f324d38d-bd05-4ffb-af6c-1284ce8113e0 req-acd6d332-14df-4fc1-b2aa-0986c06832c4 service nova] Creating event network-changed:cb667d54-41a5-4818-baec-43858e95a3d4 for instance 0015d5ed-bee0-4520-8a13-42d5f5abc857 on n-h1-843700-1 May 28 04:52:17.640759 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-f324d38d-bd05-4ffb-af6c-1284ce8113e0 req-acd6d332-14df-4fc1-b2aa-0986c06832c4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052892 May 28 04:52:17.641688 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2160/4431] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:17.647728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-81b071eb-2786-49ee-b4dc-9bef895904a0 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:17.648725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-81b071eb-2786-49ee-b4dc-9bef895904a0 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:17.666437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81b071eb-2786-49ee-b4dc-9bef895904a0 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:17.667021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81b071eb-2786-49ee-b4dc-9bef895904a0 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:17.668110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81b071eb-2786-49ee-b4dc-9bef895904a0 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:17.668611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81b071eb-2786-49ee-b4dc-9bef895904a0 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:17.851502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5ae6999d-8114-48af-b891-e492c609a7b1 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:17.859070 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5ae6999d-8114-48af-b891-e492c609a7b1 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1309 microversion: 2.1 time: 0.358246 May 28 04:52:17.859906 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2272/4432] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:17 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1309 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:17.934173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-81b071eb-2786-49ee-b4dc-9bef895904a0 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774c9f835a2941659cbfc7a2ef2e64af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b708685679fc4e4fa42b5797ca875be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:17.942739 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-81b071eb-2786-49ee-b4dc-9bef895904a0 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 200 len: 1312 microversion: 2.1 time: 0.299604 May 28 04:52:17.943357 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2161/4433] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:17 2022] GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 1312 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:18.068851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aee5b2ff-d3db-42be-89a6-0c11eeae35c4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:18.069626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aee5b2ff-d3db-42be-89a6-0c11eeae35c4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:18.076531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aee5b2ff-d3db-42be-89a6-0c11eeae35c4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:18.077108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aee5b2ff-d3db-42be-89a6-0c11eeae35c4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:18.078245 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aee5b2ff-d3db-42be-89a6-0c11eeae35c4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:18.078939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aee5b2ff-d3db-42be-89a6-0c11eeae35c4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:18.351017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b6d82323-dfa1-4094-8b12-e11abb50628b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:18.351636 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b6d82323-dfa1-4094-8b12-e11abb50628b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:18.361524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6d82323-dfa1-4094-8b12-e11abb50628b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:18.361988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6d82323-dfa1-4094-8b12-e11abb50628b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:18.362780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6d82323-dfa1-4094-8b12-e11abb50628b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:18.363255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6d82323-dfa1-4094-8b12-e11abb50628b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:18.395907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aee5b2ff-d3db-42be-89a6-0c11eeae35c4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:18.415886 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aee5b2ff-d3db-42be-89a6-0c11eeae35c4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1313 microversion: 2.1 time: 0.351756 May 28 04:52:18.416879 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2273/4434] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:18 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:18.422114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-53565c63-e2c8-49cf-acf8-fd4b923cca1a req-31ec1327-7341-4b1a-9cf2-9554d4ff287a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0e49dc0-451f-4328-aeef-3d0527ed5655", "tag": "59b7ea5c-b9ac-44ae-9dfb-762b6f39cde7"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:18.431863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-53565c63-e2c8-49cf-acf8-fd4b923cca1a req-31ec1327-7341-4b1a-9cf2-9554d4ff287a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:18.432235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-53565c63-e2c8-49cf-acf8-fd4b923cca1a req-31ec1327-7341-4b1a-9cf2-9554d4ff287a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:18.479315 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-53565c63-e2c8-49cf-acf8-fd4b923cca1a req-31ec1327-7341-4b1a-9cf2-9554d4ff287a service nova] Creating event network-changed:59b7ea5c-b9ac-44ae-9dfb-762b6f39cde7 for instance c0e49dc0-451f-4328-aeef-3d0527ed5655 on n-h2-843700-1 May 28 04:52:18.494001 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-53565c63-e2c8-49cf-acf8-fd4b923cca1a req-31ec1327-7341-4b1a-9cf2-9554d4ff287a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074070 May 28 04:52:18.495448 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2274/4435] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:18.519507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-30c1a10e-465d-4947-a23d-9ee865e84f80 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:18.522057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-30c1a10e-465d-4947-a23d-9ee865e84f80 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:18.536854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30c1a10e-465d-4947-a23d-9ee865e84f80 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:18.537326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30c1a10e-465d-4947-a23d-9ee865e84f80 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:18.539915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30c1a10e-465d-4947-a23d-9ee865e84f80 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:18.544614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30c1a10e-465d-4947-a23d-9ee865e84f80 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:18.724675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=8 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:18.784134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-30c1a10e-465d-4947-a23d-9ee865e84f80 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:18.792424 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-30c1a10e-465d-4947-a23d-9ee865e84f80 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 200 len: 1274 microversion: 2.1 time: 0.280101 May 28 04:52:18.793278 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2275/4436] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:18 2022] GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 1274 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:18.798666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-6af92628-c664-4134-8a05-0ecf7505753d req-76591eab-18f2-41e5-8946-de39a9aaaa98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bfa8d9c-3440-4ff7-933c-ee7d614ab248", "name": "network-vif-plugged", "status": "completed", "tag": "6a57d163-2dea-4b8a-8a92-d65e0045681b"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:18.807879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-6af92628-c664-4134-8a05-0ecf7505753d req-76591eab-18f2-41e5-8946-de39a9aaaa98 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:18.808337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-6af92628-c664-4134-8a05-0ecf7505753d req-76591eab-18f2-41e5-8946-de39a9aaaa98 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:18.821599 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-6af92628-c664-4134-8a05-0ecf7505753d req-76591eab-18f2-41e5-8946-de39a9aaaa98 service nova] Creating event network-vif-plugged:6a57d163-2dea-4b8a-8a92-d65e0045681b for instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 on n-h1-843700-1 May 28 04:52:18.828252 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-6af92628-c664-4134-8a05-0ecf7505753d req-76591eab-18f2-41e5-8946-de39a9aaaa98 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033894 May 28 04:52:18.829789 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2276/4437] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:18.836247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bfc36abd-27ca-4b01-b87f-421d0027df03 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:18.836971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bfc36abd-27ca-4b01-b87f-421d0027df03 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 0015d5ed-bee0-4520-8a13-42d5f5abc857] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:18.845872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfc36abd-27ca-4b01-b87f-421d0027df03 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:18.847814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfc36abd-27ca-4b01-b87f-421d0027df03 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:18.847814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfc36abd-27ca-4b01-b87f-421d0027df03 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:18.847814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfc36abd-27ca-4b01-b87f-421d0027df03 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:18.881840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b6d82323-dfa1-4094-8b12-e11abb50628b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:18.895534 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b6d82323-dfa1-4094-8b12-e11abb50628b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1698 microversion: 2.1 time: 0.548559 May 28 04:52:18.899401 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2162/4438] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:18 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1698 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:18.912703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-290c5c84-8909-4a71-9ba8-02caae0d95d8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:18.916193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-290c5c84-8909-4a71-9ba8-02caae0d95d8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:18.923278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-290c5c84-8909-4a71-9ba8-02caae0d95d8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:18.924121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-290c5c84-8909-4a71-9ba8-02caae0d95d8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:18.925079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-290c5c84-8909-4a71-9ba8-02caae0d95d8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:18.925678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-290c5c84-8909-4a71-9ba8-02caae0d95d8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:19.077936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bfc36abd-27ca-4b01-b87f-421d0027df03 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:19.108724 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bfc36abd-27ca-4b01-b87f-421d0027df03 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857" status: 200 len: 1318 microversion: 2.1 time: 0.276868 May 28 04:52:19.110329 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2277/4439] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:18 2022] GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:19.116896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4ccc7ca7-dac5-459c-87f0-01de128010b7 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:19.127867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4ccc7ca7-dac5-459c-87f0-01de128010b7 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:19.133375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ccc7ca7-dac5-459c-87f0-01de128010b7 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:19.134138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ccc7ca7-dac5-459c-87f0-01de128010b7 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:19.135195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ccc7ca7-dac5-459c-87f0-01de128010b7 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:19.136068 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ccc7ca7-dac5-459c-87f0-01de128010b7 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:19.174671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-290c5c84-8909-4a71-9ba8-02caae0d95d8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:19.186482 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-290c5c84-8909-4a71-9ba8-02caae0d95d8 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1489 microversion: 2.1 time: 0.283417 May 28 04:52:19.190754 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2163/4440] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:18 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1489 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:19.208004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-898c210f-7a23-40d1-8070-dce4b215373f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-242471902"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:19.214463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-898c210f-7a23-40d1-8070-dce4b215373f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:19.221413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-898c210f-7a23-40d1-8070-dce4b215373f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:19.222521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-898c210f-7a23-40d1-8070-dce4b215373f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:19.223885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-898c210f-7a23-40d1-8070-dce4b215373f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:19.224699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-898c210f-7a23-40d1-8070-dce4b215373f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:19.240972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:19.420705 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-898c210f-7a23-40d1-8070-dce4b215373f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "PUT /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1073 microversion: 2.1 time: 0.215531 May 28 04:52:19.420705 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2164/4441] 10.222.0.58 () {60 vars in 1255 bytes} [Sat May 28 04:52:19 2022] PUT /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1073 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:19.434408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1933b84d-2b8f-415d-94f2-fb67ae6b5777 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:19.435260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1933b84d-2b8f-415d-94f2-fb67ae6b5777 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:19.448469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1933b84d-2b8f-415d-94f2-fb67ae6b5777 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:19.448970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1933b84d-2b8f-415d-94f2-fb67ae6b5777 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:19.450415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1933b84d-2b8f-415d-94f2-fb67ae6b5777 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:19.451061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1933b84d-2b8f-415d-94f2-fb67ae6b5777 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:19.718124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4ccc7ca7-dac5-459c-87f0-01de128010b7 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774c9f835a2941659cbfc7a2ef2e64af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b708685679fc4e4fa42b5797ca875be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:19.735841 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4ccc7ca7-dac5-459c-87f0-01de128010b7 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 200 len: 1312 microversion: 2.1 time: 0.623297 May 28 04:52:19.736368 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2278/4442] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:19 2022] GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 1312 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:19.740974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b522ca7e-5f67-43d3-a577-bc28465fca48 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:19.741597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b522ca7e-5f67-43d3-a577-bc28465fca48 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:19.748639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=62 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:19.754266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b522ca7e-5f67-43d3-a577-bc28465fca48 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:19.754742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b522ca7e-5f67-43d3-a577-bc28465fca48 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:19.755570 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b522ca7e-5f67-43d3-a577-bc28465fca48 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:19.756023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b522ca7e-5f67-43d3-a577-bc28465fca48 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:20.081517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1933b84d-2b8f-415d-94f2-fb67ae6b5777 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:20.092364 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1933b84d-2b8f-415d-94f2-fb67ae6b5777 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1499 microversion: 2.1 time: 0.660626 May 28 04:52:20.098085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b522ca7e-5f67-43d3-a577-bc28465fca48 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:20.106174 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2165/4443] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:19 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1499 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:20.110265 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b522ca7e-5f67-43d3-a577-bc28465fca48 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1313 microversion: 2.1 time: 0.372801 May 28 04:52:20.114565 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2279/4444] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:19 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:20.121648 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-633b8966-6170-4af8-9910-2858e8bead06 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:20.124231 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-186956e2-4655-4265-8b59-7d8e7ceefe2d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:20.125086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-186956e2-4655-4265-8b59-7d8e7ceefe2d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:20.133433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-633b8966-6170-4af8-9910-2858e8bead06 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:20.141118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-186956e2-4655-4265-8b59-7d8e7ceefe2d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:20.141725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-186956e2-4655-4265-8b59-7d8e7ceefe2d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:20.142513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-186956e2-4655-4265-8b59-7d8e7ceefe2d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:20.149115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-633b8966-6170-4af8-9910-2858e8bead06 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:20.151441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-633b8966-6170-4af8-9910-2858e8bead06 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:20.151777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-186956e2-4655-4265-8b59-7d8e7ceefe2d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:20.153064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-633b8966-6170-4af8-9910-2858e8bead06 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:20.155114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-633b8966-6170-4af8-9910-2858e8bead06 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:20.267888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-633b8966-6170-4af8-9910-2858e8bead06 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:20.286955 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-633b8966-6170-4af8-9910-2858e8bead06 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 200 len: 1272 microversion: 2.1 time: 0.178319 May 28 04:52:20.287986 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2166/4445] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:20 2022] GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 1272 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:20.293837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-88f8636b-fdbd-4785-9876-7fae5b55370e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:20.303234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-88f8636b-fdbd-4785-9876-7fae5b55370e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:20.303234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88f8636b-fdbd-4785-9876-7fae5b55370e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:20.303866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88f8636b-fdbd-4785-9876-7fae5b55370e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:20.305174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88f8636b-fdbd-4785-9876-7fae5b55370e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:20.305729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88f8636b-fdbd-4785-9876-7fae5b55370e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:20.654818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-186956e2-4655-4265-8b59-7d8e7ceefe2d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:20.666667 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-186956e2-4655-4265-8b59-7d8e7ceefe2d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1698 microversion: 2.1 time: 0.550832 May 28 04:52:20.667382 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2280/4446] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:20 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1698 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:20.683447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9c165e99-f030-4544-87eb-aaaf193cf328 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:20.684796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9c165e99-f030-4544-87eb-aaaf193cf328 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 0015d5ed-bee0-4520-8a13-42d5f5abc857] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:20.698833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9c165e99-f030-4544-87eb-aaaf193cf328 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:20.699696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9c165e99-f030-4544-87eb-aaaf193cf328 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:20.705274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9c165e99-f030-4544-87eb-aaaf193cf328 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:20.705757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9c165e99-f030-4544-87eb-aaaf193cf328 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:20.832485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-88f8636b-fdbd-4785-9876-7fae5b55370e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:20.847116 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-88f8636b-fdbd-4785-9876-7fae5b55370e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1499 microversion: 2.1 time: 0.557836 May 28 04:52:20.847904 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2167/4447] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:20 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1499 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:20.859740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-13f651af-5ce3-4e70-a055-d52177978678 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:20.861231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-13f651af-5ce3-4e70-a055-d52177978678 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:20.877032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13f651af-5ce3-4e70-a055-d52177978678 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:20.878256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13f651af-5ce3-4e70-a055-d52177978678 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:20.881173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13f651af-5ce3-4e70-a055-d52177978678 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:20.883639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13f651af-5ce3-4e70-a055-d52177978678 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:21.260076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9c165e99-f030-4544-87eb-aaaf193cf328 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:21.275594 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9c165e99-f030-4544-87eb-aaaf193cf328 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857" status: 200 len: 1318 microversion: 2.1 time: 0.606442 May 28 04:52:21.278647 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2281/4448] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:20 2022] GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857 => generated 1318 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:21.281430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-9f372ab1-f6f8-491a-acbb-b1f22bbf7ef2 req-b4b649eb-1bdf-469d-9183-98e26f82f7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c89850-7792-485a-a6ba-79c3b19b5405", "name": "network-vif-unplugged", "status": "completed", "tag": "281843f9-caf9-43ff-9ade-dc1bd3a73fd1"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:21.303695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-9f372ab1-f6f8-491a-acbb-b1f22bbf7ef2 req-b4b649eb-1bdf-469d-9183-98e26f82f7e2 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:21.304057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-9f372ab1-f6f8-491a-acbb-b1f22bbf7ef2 req-b4b649eb-1bdf-469d-9183-98e26f82f7e2 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:21.330181 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-9f372ab1-f6f8-491a-acbb-b1f22bbf7ef2 req-b4b649eb-1bdf-469d-9183-98e26f82f7e2 service nova] Creating event network-vif-unplugged:281843f9-caf9-43ff-9ade-dc1bd3a73fd1 for instance 99c89850-7792-485a-a6ba-79c3b19b5405 on n-h2-843700-1 May 28 04:52:21.338125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-13f651af-5ce3-4e70-a055-d52177978678 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774c9f835a2941659cbfc7a2ef2e64af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b708685679fc4e4fa42b5797ca875be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:21.345716 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-13f651af-5ce3-4e70-a055-d52177978678 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 200 len: 1312 microversion: 2.1 time: 0.496710 May 28 04:52:21.346303 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2168/4449] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:20 2022] GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 1312 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:21.355086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-9f372ab1-f6f8-491a-acbb-b1f22bbf7ef2 req-b4b649eb-1bdf-469d-9183-98e26f82f7e2 service nova] Instance 99c89850-7792-485a-a6ba-79c3b19b5405 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:52:21.359185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-89b34a7b-a543-440c-b8a4-eeb016a15c59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:21.373097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-89b34a7b-a543-440c-b8a4-eeb016a15c59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:21.373831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-89b34a7b-a543-440c-b8a4-eeb016a15c59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:21.416409 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-9f372ab1-f6f8-491a-acbb-b1f22bbf7ef2 req-b4b649eb-1bdf-469d-9183-98e26f82f7e2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137447 May 28 04:52:21.421468 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2282/4450] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:21.422667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-89b34a7b-a543-440c-b8a4-eeb016a15c59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Going to try to stop instance {{(pid=126043) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 04:52:21.445975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4988350f-7d94-4590-8fd0-f89e7d8a4049 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:21.451059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4988350f-7d94-4590-8fd0-f89e7d8a4049 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:21.467731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4988350f-7d94-4590-8fd0-f89e7d8a4049 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:21.468757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4988350f-7d94-4590-8fd0-f89e7d8a4049 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:21.471883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4988350f-7d94-4590-8fd0-f89e7d8a4049 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:21.473349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4988350f-7d94-4590-8fd0-f89e7d8a4049 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:21.707354 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-89b34a7b-a543-440c-b8a4-eeb016a15c59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "POST /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94/action" status: 202 len: 0 microversion: 2.1 time: 0.356632 May 28 04:52:21.708711 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2169/4451] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:52:21 2022] POST /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:52:21.735586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e3217564-a9d4-4a99-963a-c5195ea84cdb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:21.744101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e3217564-a9d4-4a99-963a-c5195ea84cdb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:21.764074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3217564-a9d4-4a99-963a-c5195ea84cdb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:21.767348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3217564-a9d4-4a99-963a-c5195ea84cdb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:21.767348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3217564-a9d4-4a99-963a-c5195ea84cdb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:21.768136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3217564-a9d4-4a99-963a-c5195ea84cdb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:21.820793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4988350f-7d94-4590-8fd0-f89e7d8a4049 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:21.831782 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4988350f-7d94-4590-8fd0-f89e7d8a4049 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1313 microversion: 2.1 time: 0.407936 May 28 04:52:21.855367 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2283/4452] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:21 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1313 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:21.862659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8173a4fe-b9b1-4c15-aca4-91dfd30f5530 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:21.863973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8173a4fe-b9b1-4c15-aca4-91dfd30f5530 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:21.873301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8173a4fe-b9b1-4c15-aca4-91dfd30f5530 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:21.889173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8173a4fe-b9b1-4c15-aca4-91dfd30f5530 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:21.893618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8173a4fe-b9b1-4c15-aca4-91dfd30f5530 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:21.894800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8173a4fe-b9b1-4c15-aca4-91dfd30f5530 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:22.237948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e3217564-a9d4-4a99-963a-c5195ea84cdb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:22.245774 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e3217564-a9d4-4a99-963a-c5195ea84cdb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 200 len: 1314 microversion: 2.1 time: 0.535484 May 28 04:52:22.250429 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2170/4453] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:21 2022] GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 1314 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:22.256342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8173a4fe-b9b1-4c15-aca4-91dfd30f5530 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:22.262548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-05895b23-3e4e-4dcc-b8d1-cd3468676c46 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:22.271464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-05895b23-3e4e-4dcc-b8d1-cd3468676c46 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:22.271782 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8173a4fe-b9b1-4c15-aca4-91dfd30f5530 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1698 microversion: 2.1 time: 0.408919 May 28 04:52:22.271782 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2284/4454] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:21 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1698 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:22.275696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-05895b23-3e4e-4dcc-b8d1-cd3468676c46 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:22.276268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-05895b23-3e4e-4dcc-b8d1-cd3468676c46 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:22.277180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-05895b23-3e4e-4dcc-b8d1-cd3468676c46 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:22.280019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-05895b23-3e4e-4dcc-b8d1-cd3468676c46 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:22.293616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6ecc881b-0196-4b4d-864b-d4d456b50534 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:22.294629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6ecc881b-0196-4b4d-864b-d4d456b50534 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 0015d5ed-bee0-4520-8a13-42d5f5abc857] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:22.305421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6ecc881b-0196-4b4d-864b-d4d456b50534 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:22.306127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6ecc881b-0196-4b4d-864b-d4d456b50534 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:22.307111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6ecc881b-0196-4b4d-864b-d4d456b50534 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:22.311650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6ecc881b-0196-4b4d-864b-d4d456b50534 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:22.634973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6ecc881b-0196-4b4d-864b-d4d456b50534 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:22.657921 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6ecc881b-0196-4b4d-864b-d4d456b50534 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857" status: 200 len: 1318 microversion: 2.1 time: 0.365398 May 28 04:52:22.671500 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2285/4455] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:22 2022] GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857 => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:22.677578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d4144430-d164-425b-98cc-ad839c6f04ed tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:22.680911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d4144430-d164-425b-98cc-ad839c6f04ed tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:22.689868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d4144430-d164-425b-98cc-ad839c6f04ed tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:22.692779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d4144430-d164-425b-98cc-ad839c6f04ed tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:22.693919 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d4144430-d164-425b-98cc-ad839c6f04ed tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:22.694616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d4144430-d164-425b-98cc-ad839c6f04ed tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:22.833670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-05895b23-3e4e-4dcc-b8d1-cd3468676c46 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:22.842366 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-05895b23-3e4e-4dcc-b8d1-cd3468676c46 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1509 microversion: 2.1 time: 0.590189 May 28 04:52:22.851409 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2171/4456] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:22 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1509 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:22.857175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-375dc8bd-cd21-4a8b-9995-6b3e61f6f41c tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:22.862566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-375dc8bd-cd21-4a8b-9995-6b3e61f6f41c tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:22.872761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-375dc8bd-cd21-4a8b-9995-6b3e61f6f41c tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:22.873221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-375dc8bd-cd21-4a8b-9995-6b3e61f6f41c tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:22.874015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-375dc8bd-cd21-4a8b-9995-6b3e61f6f41c tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:22.874506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-375dc8bd-cd21-4a8b-9995-6b3e61f6f41c tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:23.064160 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d4144430-d164-425b-98cc-ad839c6f04ed tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774c9f835a2941659cbfc7a2ef2e64af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b708685679fc4e4fa42b5797ca875be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:23.076400 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d4144430-d164-425b-98cc-ad839c6f04ed tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 200 len: 1498 microversion: 2.1 time: 0.404160 May 28 04:52:23.079836 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2286/4457] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:22 2022] GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 1498 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:23.095672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5a24aa2e-61fc-473c-8307-db215c062db6 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:23.141102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.compute.server_groups [None req-5a24aa2e-61fc-473c-8307-db215c062db6 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Querying cell 8c12a9b9-d304-4763-b71f-4058d5ce2ded(cell1) for 1 instances {{(pid=126044) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 28 04:52:23.142468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a24aa2e-61fc-473c-8307-db215c062db6 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:23.142916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a24aa2e-61fc-473c-8307-db215c062db6 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:23.169081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:23.183799 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5a24aa2e-61fc-473c-8307-db215c062db6 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/2e4d5f55-45a8-47bf-b084-49ff2fe2603d" status: 200 len: 221 microversion: 2.1 time: 0.091367 May 28 04:52:23.184763 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2287/4458] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 04:52:23 2022] GET /compute/v2.1/os-server-groups/2e4d5f55-45a8-47bf-b084-49ff2fe2603d => generated 221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:52:23.202334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d9bbaa76-19e7-41b0-b228-514cfeda21cb tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:23.202334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d9bbaa76-19e7-41b0-b228-514cfeda21cb tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:23.206708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9bbaa76-19e7-41b0-b228-514cfeda21cb tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:23.207439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9bbaa76-19e7-41b0-b228-514cfeda21cb tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:23.208464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9bbaa76-19e7-41b0-b228-514cfeda21cb tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:23.209098 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9bbaa76-19e7-41b0-b228-514cfeda21cb tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:23.225155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-375dc8bd-cd21-4a8b-9995-6b3e61f6f41c tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:23.231192 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-375dc8bd-cd21-4a8b-9995-6b3e61f6f41c tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1313 microversion: 2.1 time: 0.378542 May 28 04:52:23.236564 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2172/4459] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:22 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:23.243296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-8821237e-66f5-448d-b19e-00c3b8cd519a req-b218f14d-361a-4e16-9642-60a0cce351d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474caa3e-f826-4a32-82aa-4c5bf30e2c7d", "name": "network-vif-plugged", "status": "completed", "tag": "b3bfffb5-1c7e-45f1-b907-290b2a2be5b2"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:23.253440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d9bbaa76-19e7-41b0-b228-514cfeda21cb tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:52:23.255366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8821237e-66f5-448d-b19e-00c3b8cd519a req-b218f14d-361a-4e16-9642-60a0cce351d4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:23.255823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8821237e-66f5-448d-b19e-00c3b8cd519a req-b218f14d-361a-4e16-9642-60a0cce351d4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:23.272278 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-8821237e-66f5-448d-b19e-00c3b8cd519a req-b218f14d-361a-4e16-9642-60a0cce351d4 service nova] Creating event network-vif-plugged:b3bfffb5-1c7e-45f1-b907-290b2a2be5b2 for instance 474caa3e-f826-4a32-82aa-4c5bf30e2c7d on n-h2-843700-1 May 28 04:52:23.279175 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-8821237e-66f5-448d-b19e-00c3b8cd519a req-b218f14d-361a-4e16-9642-60a0cce351d4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040580 May 28 04:52:23.281327 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2173/4460] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:23.287090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f63aa11c-fa5d-4def-970f-782b72d60a5e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:23.288051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f63aa11c-fa5d-4def-970f-782b72d60a5e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:23.295273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f63aa11c-fa5d-4def-970f-782b72d60a5e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:23.296063 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f63aa11c-fa5d-4def-970f-782b72d60a5e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:23.296866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f63aa11c-fa5d-4def-970f-782b72d60a5e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:23.297483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f63aa11c-fa5d-4def-970f-782b72d60a5e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:23.595998 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f63aa11c-fa5d-4def-970f-782b72d60a5e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:23.611842 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f63aa11c-fa5d-4def-970f-782b72d60a5e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 200 len: 1314 microversion: 2.1 time: 0.323063 May 28 04:52:23.612842 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2174/4461] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:23 2022] GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:23.621639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fc5e583c-df65-4dee-9c0b-57f24729224f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:23.626413 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d9bbaa76-19e7-41b0-b228-514cfeda21cb tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 204 len: 0 microversion: 2.1 time: 0.435019 May 28 04:52:23.627742 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2288/4462] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:52:23 2022] DELETE /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:52:23.634082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-35d66239-a916-40d9-aaf7-f545e8263ea2 req-18ddf130-4ecb-4baa-be28-fffac88d448b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c89850-7792-485a-a6ba-79c3b19b5405", "tag": "281843f9-caf9-43ff-9ade-dc1bd3a73fd1"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:23.638414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fc5e583c-df65-4dee-9c0b-57f24729224f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:23.656969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc5e583c-df65-4dee-9c0b-57f24729224f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:23.662650 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc5e583c-df65-4dee-9c0b-57f24729224f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:23.663562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc5e583c-df65-4dee-9c0b-57f24729224f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:23.671243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc5e583c-df65-4dee-9c0b-57f24729224f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:23.672335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-35d66239-a916-40d9-aaf7-f545e8263ea2 req-18ddf130-4ecb-4baa-be28-fffac88d448b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:23.672895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-35d66239-a916-40d9-aaf7-f545e8263ea2 req-18ddf130-4ecb-4baa-be28-fffac88d448b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:23.718233 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-35d66239-a916-40d9-aaf7-f545e8263ea2 req-18ddf130-4ecb-4baa-be28-fffac88d448b service nova] Creating event network-changed:281843f9-caf9-43ff-9ade-dc1bd3a73fd1 for instance 99c89850-7792-485a-a6ba-79c3b19b5405 on n-h2-843700-1 May 28 04:52:23.744939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-35d66239-a916-40d9-aaf7-f545e8263ea2 req-18ddf130-4ecb-4baa-be28-fffac88d448b service nova] Instance 99c89850-7792-485a-a6ba-79c3b19b5405 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:52:23.787701 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-35d66239-a916-40d9-aaf7-f545e8263ea2 req-18ddf130-4ecb-4baa-be28-fffac88d448b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157476 May 28 04:52:23.789422 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2289/4463] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:23.806111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1d2dd959-d497-4720-ac32-91285d78a470 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:23.807875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1d2dd959-d497-4720-ac32-91285d78a470 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:23.829946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d2dd959-d497-4720-ac32-91285d78a470 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:23.830520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d2dd959-d497-4720-ac32-91285d78a470 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:23.831365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d2dd959-d497-4720-ac32-91285d78a470 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:23.831803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d2dd959-d497-4720-ac32-91285d78a470 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:23.986396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fc5e583c-df65-4dee-9c0b-57f24729224f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:23.994588 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fc5e583c-df65-4dee-9c0b-57f24729224f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1696 microversion: 2.1 time: 0.379691 May 28 04:52:23.995456 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2175/4464] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:23 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1696 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:24.009976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4553e2f0-e355-422c-bb1d-f72e365cb822 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:24.010688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4553e2f0-e355-422c-bb1d-f72e365cb822 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 0015d5ed-bee0-4520-8a13-42d5f5abc857] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:24.016953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4553e2f0-e355-422c-bb1d-f72e365cb822 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:24.017526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4553e2f0-e355-422c-bb1d-f72e365cb822 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:24.018400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4553e2f0-e355-422c-bb1d-f72e365cb822 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:24.018944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4553e2f0-e355-422c-bb1d-f72e365cb822 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:24.031902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1d2dd959-d497-4720-ac32-91285d78a470 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774c9f835a2941659cbfc7a2ef2e64af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b708685679fc4e4fa42b5797ca875be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:24.043913 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1d2dd959-d497-4720-ac32-91285d78a470 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 200 len: 1504 microversion: 2.1 time: 0.248193 May 28 04:52:24.044818 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2290/4465] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:23 2022] GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:24.216592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4ba55f7d-cee7-424a-bfc0-78db0c4604ff tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-2088728755", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "663d37f8-faf5-4cd0-82a5-6ac7a648a21f"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:24.295403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-4ba55f7d-cee7-424a-bfc0-78db0c4604ff tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] validate_networks() for [('663d37f8-faf5-4cd0-82a5-6ac7a648a21f', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:52:24.609005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4553e2f0-e355-422c-bb1d-f72e365cb822 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:24.617949 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4553e2f0-e355-422c-bb1d-f72e365cb822 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857" status: 200 len: 1318 microversion: 2.1 time: 0.611666 May 28 04:52:24.618782 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2176/4466] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:23 2022] GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857 => generated 1318 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:24.626597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d3f04d78-fe29-4fb1-ad23-8cf2d7c2e075 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:24.627481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d3f04d78-fe29-4fb1-ad23-8cf2d7c2e075 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:24.634204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3f04d78-fe29-4fb1-ad23-8cf2d7c2e075 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:24.634859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3f04d78-fe29-4fb1-ad23-8cf2d7c2e075 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:24.635854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3f04d78-fe29-4fb1-ad23-8cf2d7c2e075 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:24.636515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3f04d78-fe29-4fb1-ad23-8cf2d7c2e075 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:25.074944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d3f04d78-fe29-4fb1-ad23-8cf2d7c2e075 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:25.084619 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d3f04d78-fe29-4fb1-ad23-8cf2d7c2e075 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1509 microversion: 2.1 time: 0.464601 May 28 04:52:25.095939 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2177/4467] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:24 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1509 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:25.101212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d6abc9bd-c90d-4178-9f8e-7651bd766d7b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:25.102023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d6abc9bd-c90d-4178-9f8e-7651bd766d7b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:25.111210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6abc9bd-c90d-4178-9f8e-7651bd766d7b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:25.111881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6abc9bd-c90d-4178-9f8e-7651bd766d7b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:25.113517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6abc9bd-c90d-4178-9f8e-7651bd766d7b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:25.114151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6abc9bd-c90d-4178-9f8e-7651bd766d7b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:25.330416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:25.433861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4ba55f7d-cee7-424a-bfc0-78db0c4604ff tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:52:25.434512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4ba55f7d-cee7-424a-bfc0-78db0c4604ff tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:52:25.435025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4ba55f7d-cee7-424a-bfc0-78db0c4604ff tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:52:25.437836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4ba55f7d-cee7-424a-bfc0-78db0c4604ff tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:52:25.437836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4ba55f7d-cee7-424a-bfc0-78db0c4604ff tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:52:25.445527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=49 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:25.448964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ba55f7d-cee7-424a-bfc0-78db0c4604ff tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:25.449612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ba55f7d-cee7-424a-bfc0-78db0c4604ff tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:25.450625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ba55f7d-cee7-424a-bfc0-78db0c4604ff tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:25.451409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ba55f7d-cee7-424a-bfc0-78db0c4604ff tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:25.477028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-4ba55f7d-cee7-424a-bfc0-78db0c4604ff tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Getting quotas for project 3444a0099cc64616854d5172bf7ff6e7. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:52:25.483742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-4ba55f7d-cee7-424a-bfc0-78db0c4604ff tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Getting quotas for user d780c97536c34c60a8deaf5b00e84cd2 and project 3444a0099cc64616854d5172bf7ff6e7. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:52:25.499841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4ba55f7d-cee7-424a-bfc0-78db0c4604ff tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:52:25.504457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4ba55f7d-cee7-424a-bfc0-78db0c4604ff tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:52:25.605584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d6abc9bd-c90d-4178-9f8e-7651bd766d7b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:25.620894 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4ba55f7d-cee7-424a-bfc0-78db0c4604ff tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.565281 May 28 04:52:25.622401 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2291/4468] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:52:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:52:25.639912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-ef9a2499-be18-449a-93de-6a4e73706409 req-649d0191-f1e2-495a-8704-b14c1d421166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6dd1de3-8a85-42b0-8ac8-49b66c6768d5", "tag": "db0b3c18-c41f-4153-82f7-d7bb4195f4fc"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:25.641039 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d6abc9bd-c90d-4178-9f8e-7651bd766d7b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1313 microversion: 2.1 time: 0.519976 May 28 04:52:25.645621 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2178/4469] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:25 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1313 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:25.662057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ef9a2499-be18-449a-93de-6a4e73706409 req-649d0191-f1e2-495a-8704-b14c1d421166 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:25.663239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ef9a2499-be18-449a-93de-6a4e73706409 req-649d0191-f1e2-495a-8704-b14c1d421166 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:25.670960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e2265afa-cb5b-41e8-bcff-ae03665a8a98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:25.680400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e2265afa-cb5b-41e8-bcff-ae03665a8a98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:25.684323 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-ef9a2499-be18-449a-93de-6a4e73706409 req-649d0191-f1e2-495a-8704-b14c1d421166 service nova] Creating event network-changed:db0b3c18-c41f-4153-82f7-d7bb4195f4fc for instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 on n-h1-843700-1 May 28 04:52:25.707059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2265afa-cb5b-41e8-bcff-ae03665a8a98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:25.708537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2265afa-cb5b-41e8-bcff-ae03665a8a98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:25.710221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2265afa-cb5b-41e8-bcff-ae03665a8a98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:25.711240 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-ef9a2499-be18-449a-93de-6a4e73706409 req-649d0191-f1e2-495a-8704-b14c1d421166 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087266 May 28 04:52:25.712546 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2292/4470] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:25.718771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4fc32622-7f8e-4319-a617-be84a12be14d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:25.720779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4fc32622-7f8e-4319-a617-be84a12be14d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:25.721752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2265afa-cb5b-41e8-bcff-ae03665a8a98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:25.734549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fc32622-7f8e-4319-a617-be84a12be14d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:25.738100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fc32622-7f8e-4319-a617-be84a12be14d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:25.738100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fc32622-7f8e-4319-a617-be84a12be14d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:25.738100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fc32622-7f8e-4319-a617-be84a12be14d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:26.355271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4fc32622-7f8e-4319-a617-be84a12be14d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:26.365185 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4fc32622-7f8e-4319-a617-be84a12be14d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1696 microversion: 2.1 time: 0.651289 May 28 04:52:26.366931 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2293/4471] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:25 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1696 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:26.379213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d0306819-2d2e-4d36-affe-7c807376376a tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:26.380191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d0306819-2d2e-4d36-affe-7c807376376a tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:26.386710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e2265afa-cb5b-41e8-bcff-ae03665a8a98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:26.391047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:26.398620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d0306819-2d2e-4d36-affe-7c807376376a tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:26.400234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d0306819-2d2e-4d36-affe-7c807376376a tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:26.401015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d0306819-2d2e-4d36-affe-7c807376376a tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:26.403256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d0306819-2d2e-4d36-affe-7c807376376a tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:26.403622 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e2265afa-cb5b-41e8-bcff-ae03665a8a98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 200 len: 1314 microversion: 2.1 time: 0.754141 May 28 04:52:26.404338 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2179/4472] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:25 2022] GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 1314 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:26.415930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-49dcc44b-da6c-4d14-a36b-38391ab6de08 req-59518630-34db-48de-a6c4-d233b8d7b565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0015d5ed-bee0-4520-8a13-42d5f5abc857", "name": "network-vif-plugged", "status": "completed", "tag": "cb667d54-41a5-4818-baec-43858e95a3d4"}, {"server_uuid": "c0e49dc0-451f-4328-aeef-3d0527ed5655", "name": "network-vif-plugged", "status": "completed", "tag": "59b7ea5c-b9ac-44ae-9dfb-762b6f39cde7"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:26.443920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-49dcc44b-da6c-4d14-a36b-38391ab6de08 req-59518630-34db-48de-a6c4-d233b8d7b565 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:26.444556 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-49dcc44b-da6c-4d14-a36b-38391ab6de08 req-59518630-34db-48de-a6c4-d233b8d7b565 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:26.464857 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-49dcc44b-da6c-4d14-a36b-38391ab6de08 req-59518630-34db-48de-a6c4-d233b8d7b565 service nova] Creating event network-vif-plugged:cb667d54-41a5-4818-baec-43858e95a3d4 for instance 0015d5ed-bee0-4520-8a13-42d5f5abc857 on n-h1-843700-1 May 28 04:52:26.465580 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-49dcc44b-da6c-4d14-a36b-38391ab6de08 req-59518630-34db-48de-a6c4-d233b8d7b565 service nova] Creating event network-vif-plugged:59b7ea5c-b9ac-44ae-9dfb-762b6f39cde7 for instance c0e49dc0-451f-4328-aeef-3d0527ed5655 on n-h2-843700-1 May 28 04:52:26.477013 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-49dcc44b-da6c-4d14-a36b-38391ab6de08 req-59518630-34db-48de-a6c4-d233b8d7b565 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069821 May 28 04:52:26.478117 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2180/4473] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:26.506582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f921255d-7829-4ebe-b8b7-7568a1a8edac tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:26.507350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f921255d-7829-4ebe-b8b7-7568a1a8edac tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:26.744255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f921255d-7829-4ebe-b8b7-7568a1a8edac tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780c97536c34c60a8deaf5b00e84cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3444a0099cc64616854d5172bf7ff6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:26.755524 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f921255d-7829-4ebe-b8b7-7568a1a8edac tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2" status: 200 len: 1216 microversion: 2.1 time: 0.275140 May 28 04:52:26.756140 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2181/4474] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:26 2022] GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2 => generated 1216 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:26.775083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3b7c5d01-d17c-41be-8acf-9a5354778088 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:26.776274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3b7c5d01-d17c-41be-8acf-9a5354778088 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 0015d5ed-bee0-4520-8a13-42d5f5abc857] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:26.778736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d0306819-2d2e-4d36-affe-7c807376376a tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774c9f835a2941659cbfc7a2ef2e64af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b708685679fc4e4fa42b5797ca875be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:26.788641 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d0306819-2d2e-4d36-affe-7c807376376a tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 200 len: 1504 microversion: 2.1 time: 0.420416 May 28 04:52:26.790111 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2294/4475] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:26 2022] GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 1504 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:26.795029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-648bf2be-d4ee-4f03-81c9-d232a97d4735 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:26.795830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-648bf2be-d4ee-4f03-81c9-d232a97d4735 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:26.796287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b7c5d01-d17c-41be-8acf-9a5354778088 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:26.796794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b7c5d01-d17c-41be-8acf-9a5354778088 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:26.798910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b7c5d01-d17c-41be-8acf-9a5354778088 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:26.800191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b7c5d01-d17c-41be-8acf-9a5354778088 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:26.804340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-648bf2be-d4ee-4f03-81c9-d232a97d4735 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:26.805091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-648bf2be-d4ee-4f03-81c9-d232a97d4735 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:26.806051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-648bf2be-d4ee-4f03-81c9-d232a97d4735 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:26.806665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-648bf2be-d4ee-4f03-81c9-d232a97d4735 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:27.105526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-648bf2be-d4ee-4f03-81c9-d232a97d4735 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:27.115711 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-648bf2be-d4ee-4f03-81c9-d232a97d4735 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1509 microversion: 2.1 time: 0.324255 May 28 04:52:27.126311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3b7c5d01-d17c-41be-8acf-9a5354778088 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:27.129968 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2295/4476] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:26 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1509 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:27.134340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3f0ef652-eebf-4461-93cc-d68964a898cf tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:27.135388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3f0ef652-eebf-4461-93cc-d68964a898cf tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:27.135531 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3b7c5d01-d17c-41be-8acf-9a5354778088 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857" status: 200 len: 1318 microversion: 2.1 time: 0.373868 May 28 04:52:27.136011 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2182/4477] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:26 2022] GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857 => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:27.145656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f0ef652-eebf-4461-93cc-d68964a898cf tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:27.146114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f0ef652-eebf-4461-93cc-d68964a898cf tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:27.146905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f0ef652-eebf-4461-93cc-d68964a898cf tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:27.147367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f0ef652-eebf-4461-93cc-d68964a898cf tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:27.287264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3f0ef652-eebf-4461-93cc-d68964a898cf tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:27.295158 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3f0ef652-eebf-4461-93cc-d68964a898cf tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1313 microversion: 2.1 time: 0.165951 May 28 04:52:27.295740 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2296/4478] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:27 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:27.384392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cf336cdb-5453-40b6-a3ad-89a800de5ffb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:27.385094 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cf336cdb-5453-40b6-a3ad-89a800de5ffb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:27.393362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf336cdb-5453-40b6-a3ad-89a800de5ffb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:27.393954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf336cdb-5453-40b6-a3ad-89a800de5ffb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:27.394792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf336cdb-5453-40b6-a3ad-89a800de5ffb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:27.395266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf336cdb-5453-40b6-a3ad-89a800de5ffb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:27.421303 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0c90a3d3-aa35-4ce2-a789-f091654bd577 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:27.422553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0c90a3d3-aa35-4ce2-a789-f091654bd577 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:27.429016 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c90a3d3-aa35-4ce2-a789-f091654bd577 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:27.429470 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c90a3d3-aa35-4ce2-a789-f091654bd577 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:27.430273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c90a3d3-aa35-4ce2-a789-f091654bd577 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:27.430710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c90a3d3-aa35-4ce2-a789-f091654bd577 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:27.596093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cf336cdb-5453-40b6-a3ad-89a800de5ffb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:27.605807 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cf336cdb-5453-40b6-a3ad-89a800de5ffb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1693 microversion: 2.1 time: 0.225717 May 28 04:52:27.609392 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2183/4479] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:27 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1693 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:27.609545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0c90a3d3-aa35-4ce2-a789-f091654bd577 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:27.622060 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0c90a3d3-aa35-4ce2-a789-f091654bd577 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 200 len: 1314 microversion: 2.1 time: 0.205312 May 28 04:52:27.623361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-952a839c-7827-4dff-a4ac-0f162800c25a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:27.624176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-952a839c-7827-4dff-a4ac-0f162800c25a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:27.630617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-952a839c-7827-4dff-a4ac-0f162800c25a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:27.631444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-952a839c-7827-4dff-a4ac-0f162800c25a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:27.632403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-952a839c-7827-4dff-a4ac-0f162800c25a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:27.632889 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2297/4480] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:27 2022] GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:27.633238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-952a839c-7827-4dff-a4ac-0f162800c25a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:27.768819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-3c9859b3-4f79-428b-a248-717fbc6f2925 req-7bfe996d-b3b7-4e10-9e0e-4e71084d40df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bfa8d9c-3440-4ff7-933c-ee7d614ab248", "name": "network-vif-deleted", "tag": "6a57d163-2dea-4b8a-8a92-d65e0045681b"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:27.798256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-3c9859b3-4f79-428b-a248-717fbc6f2925 req-7bfe996d-b3b7-4e10-9e0e-4e71084d40df service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:27.799214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-3c9859b3-4f79-428b-a248-717fbc6f2925 req-7bfe996d-b3b7-4e10-9e0e-4e71084d40df service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:27.813001 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-952a839c-7827-4dff-a4ac-0f162800c25a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405/action" status: 204 len: 0 microversion: 2.1 time: 0.192758 May 28 04:52:27.820199 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2184/4481] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:52:27 2022] POST /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405/action => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:52:27.827316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f8b895c7-f7a9-48d6-9348-64b6731a8ade tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:27.828383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f8b895c7-f7a9-48d6-9348-64b6731a8ade tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:27.839586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8b895c7-f7a9-48d6-9348-64b6731a8ade tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:27.841191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8b895c7-f7a9-48d6-9348-64b6731a8ade tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:27.842287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8b895c7-f7a9-48d6-9348-64b6731a8ade tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:27.843604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8b895c7-f7a9-48d6-9348-64b6731a8ade tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:27.854895 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-3c9859b3-4f79-428b-a248-717fbc6f2925 req-7bfe996d-b3b7-4e10-9e0e-4e71084d40df service nova] Creating event network-vif-deleted:6a57d163-2dea-4b8a-8a92-d65e0045681b for instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 on n-h1-843700-1 May 28 04:52:27.867808 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-3c9859b3-4f79-428b-a248-717fbc6f2925 req-7bfe996d-b3b7-4e10-9e0e-4e71084d40df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104105 May 28 04:52:27.869993 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2298/4482] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 28 04:52:27.885144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-808e6b0e-47d1-48d4-9e3f-f60931f7b954 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:27.886150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-808e6b0e-47d1-48d4-9e3f-f60931f7b954 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:27.903278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-808e6b0e-47d1-48d4-9e3f-f60931f7b954 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:27.903744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-808e6b0e-47d1-48d4-9e3f-f60931f7b954 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:27.904622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-808e6b0e-47d1-48d4-9e3f-f60931f7b954 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:27.905039 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-808e6b0e-47d1-48d4-9e3f-f60931f7b954 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:27.967987 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f8b895c7-f7a9-48d6-9348-64b6731a8ade tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780c97536c34c60a8deaf5b00e84cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3444a0099cc64616854d5172bf7ff6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:27.978454 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f8b895c7-f7a9-48d6-9348-64b6731a8ade tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2" status: 200 len: 1220 microversion: 2.1 time: 0.156508 May 28 04:52:27.979461 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2185/4483] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:27 2022] GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2 => generated 1220 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:27.984643 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b3ce9652-aea1-40f4-8493-657854b45554 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:27.986205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b3ce9652-aea1-40f4-8493-657854b45554 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:27.994304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b3ce9652-aea1-40f4-8493-657854b45554 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:27.994775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b3ce9652-aea1-40f4-8493-657854b45554 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:27.998617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b3ce9652-aea1-40f4-8493-657854b45554 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:27.998617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b3ce9652-aea1-40f4-8493-657854b45554 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:28.081490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-808e6b0e-47d1-48d4-9e3f-f60931f7b954 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774c9f835a2941659cbfc7a2ef2e64af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b708685679fc4e4fa42b5797ca875be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:28.097885 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-808e6b0e-47d1-48d4-9e3f-f60931f7b954 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 200 len: 1462 microversion: 2.1 time: 0.222968 May 28 04:52:28.097885 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2299/4484] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:27 2022] GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 1462 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:28.133826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-15d641e8-ddb8-4ea0-8a48-b8a8dd171d93 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:28.134498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-15d641e8-ddb8-4ea0-8a48-b8a8dd171d93 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:28.140837 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:28.143169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-15d641e8-ddb8-4ea0-8a48-b8a8dd171d93 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:28.143663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-15d641e8-ddb8-4ea0-8a48-b8a8dd171d93 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:28.144454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-15d641e8-ddb8-4ea0-8a48-b8a8dd171d93 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:28.144901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-15d641e8-ddb8-4ea0-8a48-b8a8dd171d93 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:28.798543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b3ce9652-aea1-40f4-8493-657854b45554 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:28.803945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-15d641e8-ddb8-4ea0-8a48-b8a8dd171d93 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:28.808601 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b3ce9652-aea1-40f4-8493-657854b45554 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1693 microversion: 2.1 time: 0.827984 May 28 04:52:28.817156 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2186/4485] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:27 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1693 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:28.817156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f9647e17-199b-4a7f-a96b-c15b3fc420d8 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:28.817156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f9647e17-199b-4a7f-a96b-c15b3fc420d8 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 0015d5ed-bee0-4520-8a13-42d5f5abc857] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:28.820803 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-15d641e8-ddb8-4ea0-8a48-b8a8dd171d93 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1509 microversion: 2.1 time: 0.691203 May 28 04:52:28.821610 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2300/4486] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:28 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1509 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:28.834253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ce8933f7-1e3d-4287-91ba-69f4ca4ad02d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:28.834253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ce8933f7-1e3d-4287-91ba-69f4ca4ad02d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:28.837634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9647e17-199b-4a7f-a96b-c15b3fc420d8 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:28.838296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9647e17-199b-4a7f-a96b-c15b3fc420d8 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:28.839778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9647e17-199b-4a7f-a96b-c15b3fc420d8 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:28.840401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9647e17-199b-4a7f-a96b-c15b3fc420d8 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:28.850451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce8933f7-1e3d-4287-91ba-69f4ca4ad02d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:28.850911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce8933f7-1e3d-4287-91ba-69f4ca4ad02d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:28.851779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce8933f7-1e3d-4287-91ba-69f4ca4ad02d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:28.852417 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce8933f7-1e3d-4287-91ba-69f4ca4ad02d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:29.095053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ce8933f7-1e3d-4287-91ba-69f4ca4ad02d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:29.103545 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ce8933f7-1e3d-4287-91ba-69f4ca4ad02d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1498 microversion: 2.1 time: 0.280591 May 28 04:52:29.104320 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2301/4487] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:28 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1498 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:29.116548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a0ae6d73-f5e7-4771-a811-c1600587454f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:29.116548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a0ae6d73-f5e7-4771-a811-c1600587454f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:29.119162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0ae6d73-f5e7-4771-a811-c1600587454f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:29.119743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0ae6d73-f5e7-4771-a811-c1600587454f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:29.120739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0ae6d73-f5e7-4771-a811-c1600587454f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:29.121284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0ae6d73-f5e7-4771-a811-c1600587454f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:29.153527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f9647e17-199b-4a7f-a96b-c15b3fc420d8 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:29.163291 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f9647e17-199b-4a7f-a96b-c15b3fc420d8 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857" status: 200 len: 1318 microversion: 2.1 time: 0.352386 May 28 04:52:29.166535 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2187/4488] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:28 2022] GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857 => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:29.172034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-da3bec2e-2536-4adc-9450-0683ec09f834 req-97d56dcc-474d-4f71-b87d-bf44e18f275e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c89850-7792-485a-a6ba-79c3b19b5405", "name": "network-vif-plugged", "status": "completed", "tag": "281843f9-caf9-43ff-9ade-dc1bd3a73fd1"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:29.183184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=99 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:29.185138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-da3bec2e-2536-4adc-9450-0683ec09f834 req-97d56dcc-474d-4f71-b87d-bf44e18f275e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:29.185588 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-da3bec2e-2536-4adc-9450-0683ec09f834 req-97d56dcc-474d-4f71-b87d-bf44e18f275e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:29.217384 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-da3bec2e-2536-4adc-9450-0683ec09f834 req-97d56dcc-474d-4f71-b87d-bf44e18f275e service nova] Creating event network-vif-plugged:281843f9-caf9-43ff-9ade-dc1bd3a73fd1 for instance 99c89850-7792-485a-a6ba-79c3b19b5405 on n-h2-843700-1 May 28 04:52:29.226215 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-da3bec2e-2536-4adc-9450-0683ec09f834 req-97d56dcc-474d-4f71-b87d-bf44e18f275e service nova] Instance 99c89850-7792-485a-a6ba-79c3b19b5405 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:52:29.257895 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-da3bec2e-2536-4adc-9450-0683ec09f834 req-97d56dcc-474d-4f71-b87d-bf44e18f275e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092142 May 28 04:52:29.259071 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2188/4489] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:29.269000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0c7f82ef-9778-4aaf-8059-942e71dcaf1d tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:29.270429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0c7f82ef-9778-4aaf-8059-942e71dcaf1d tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:29.277929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c7f82ef-9778-4aaf-8059-942e71dcaf1d tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:29.282804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c7f82ef-9778-4aaf-8059-942e71dcaf1d tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:29.282804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c7f82ef-9778-4aaf-8059-942e71dcaf1d tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:29.282804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0c7f82ef-9778-4aaf-8059-942e71dcaf1d tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:29.397442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0c7f82ef-9778-4aaf-8059-942e71dcaf1d tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780c97536c34c60a8deaf5b00e84cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3444a0099cc64616854d5172bf7ff6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:29.405341 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0c7f82ef-9778-4aaf-8059-942e71dcaf1d tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2" status: 200 len: 1268 microversion: 2.1 time: 0.144366 May 28 04:52:29.406268 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2189/4490] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:29 2022] GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2 => generated 1268 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:29.420987 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-79532800-7c00-4cb9-a887-787c5349c6f1 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:29.421741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-79532800-7c00-4cb9-a887-787c5349c6f1 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:29.428221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-79532800-7c00-4cb9-a887-787c5349c6f1 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:29.428929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-79532800-7c00-4cb9-a887-787c5349c6f1 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:29.429792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-79532800-7c00-4cb9-a887-787c5349c6f1 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:29.430311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-79532800-7c00-4cb9-a887-787c5349c6f1 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:29.446248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a0ae6d73-f5e7-4771-a811-c1600587454f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:29.456152 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-79532800-7c00-4cb9-a887-787c5349c6f1 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] HTTP exception thrown: Instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 could not be found. May 28 04:52:29.456567 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a0ae6d73-f5e7-4771-a811-c1600587454f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 200 len: 1314 microversion: 2.1 time: 0.351111 May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-79532800-7c00-4cb9-a887-787c5349c6f1 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Request method failure captured: May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 HTTP/1.1 May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikapqQ0gb3hSOJM4y4dtk0sucXKdiEdV9la8W2sAvNYcG4BEMN_ZVaKQRZVdObzCddhqgQWTnoLBv7O1TTOM5Sv8zIWLfrfJ1An_U48eMwf6WcZycwXd9qi36fIjGxkdIHB7BB6pvoN7sT06k90SWntNt8N1xTFmQAE9JDOe8fGTWUNU May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: b708685679fc4e4fa42b5797ca875be3 May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: b708685679fc4e4fa42b5797ca875be3 May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerGroupTestJSON-1689779321-project May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 774c9f835a2941659cbfc7a2ef2e64af May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerGroupTestJSON-1689779321-project May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 could not be found. May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '3bfa8d9c-3440-4ff7-933c-ee7d614ab248'} May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 could not be found. May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 could not be found. May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:29.458859 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.465192 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.465192 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:29.465192 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:29.465192 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:29.465192 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:29.465192 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 could not be found. May 28 04:52:29.465192 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.466405 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2302/4491] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:29 2022] GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:29.467526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-79532800-7c00-4cb9-a887-787c5349c6f1 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Returning 404 to user: Instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:29.470243 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-79532800-7c00-4cb9-a887-787c5349c6f1 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 404 len: 111 microversion: 2.1 time: 0.062229 May 28 04:52:29.471602 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2190/4492] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:29 2022] GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:29.475322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1865ed51-8875-4dae-b181-435c63f6faac tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:29.479609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1865ed51-8875-4dae-b181-435c63f6faac tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:29.489825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1865ed51-8875-4dae-b181-435c63f6faac tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:29.490611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1865ed51-8875-4dae-b181-435c63f6faac tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:29.491835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1865ed51-8875-4dae-b181-435c63f6faac tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:29.492493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0cca167a-9015-40ed-b380-b699ee87c367 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:29.492785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1865ed51-8875-4dae-b181-435c63f6faac tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:29.513317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.compute.server_groups [None req-0cca167a-9015-40ed-b380-b699ee87c367 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Querying cell 8c12a9b9-d304-4763-b71f-4058d5ce2ded(cell1) for 1 instances {{(pid=126043) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 28 04:52:29.514197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0cca167a-9015-40ed-b380-b699ee87c367 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:29.514651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0cca167a-9015-40ed-b380-b699ee87c367 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:29.522137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-1865ed51-8875-4dae-b181-435c63f6faac tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lazy-loading 'flavor' on Instance uuid c0e49dc0-451f-4328-aeef-3d0527ed5655 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:52:29.529305 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0cca167a-9015-40ed-b380-b699ee87c367 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.042688 May 28 04:52:29.530373 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2191/4493] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 04:52:29 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:29.546784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aac6af35-16dd-4e43-85bf-bc1d9e708c21 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:29.568191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.compute.server_groups [None req-aac6af35-16dd-4e43-85bf-bc1d9e708c21 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Querying cell 8c12a9b9-d304-4763-b71f-4058d5ce2ded(cell1) for 1 instances {{(pid=126043) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 28 04:52:29.571536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aac6af35-16dd-4e43-85bf-bc1d9e708c21 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:29.572217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aac6af35-16dd-4e43-85bf-bc1d9e708c21 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:29.592958 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aac6af35-16dd-4e43-85bf-bc1d9e708c21 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/2e4d5f55-45a8-47bf-b084-49ff2fe2603d" status: 200 len: 183 microversion: 2.1 time: 0.053488 May 28 04:52:29.595281 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2192/4494] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 04:52:29 2022] GET /compute/v2.1/os-server-groups/2e4d5f55-45a8-47bf-b084-49ff2fe2603d => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:52:29.606969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4ec17c7a-65da-4fbc-b65e-6e4b3a581670 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:29.607679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4ec17c7a-65da-4fbc-b65e-6e4b3a581670 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:29.615878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4ec17c7a-65da-4fbc-b65e-6e4b3a581670 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:29.616479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4ec17c7a-65da-4fbc-b65e-6e4b3a581670 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:29.617483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4ec17c7a-65da-4fbc-b65e-6e4b3a581670 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:29.618011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4ec17c7a-65da-4fbc-b65e-6e4b3a581670 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:29.633738 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-4ec17c7a-65da-4fbc-b65e-6e4b3a581670 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] HTTP exception thrown: Instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 could not be found. May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4ec17c7a-65da-4fbc-b65e-6e4b3a581670 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Request method failure captured: May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 HTTP/1.1 May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikapqQ0gb3hSOJM4y4dtk0sucXKdiEdV9la8W2sAvNYcG4BEMN_ZVaKQRZVdObzCddhqgQWTnoLBv7O1TTOM5Sv8zIWLfrfJ1An_U48eMwf6WcZycwXd9qi36fIjGxkdIHB7BB6pvoN7sT06k90SWntNt8N1xTFmQAE9JDOe8fGTWUNU May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: b708685679fc4e4fa42b5797ca875be3 May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: b708685679fc4e4fa42b5797ca875be3 May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerGroupTestJSON-1689779321-project May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 774c9f835a2941659cbfc7a2ef2e64af May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerGroupTestJSON-1689779321-project May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 could not be found. May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '3bfa8d9c-3440-4ff7-933c-ee7d614ab248'} May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 could not be found. May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:29.636121 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:29.647356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 could not be found. May 28 04:52:29.647356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.647356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:29.647356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.647356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.647356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:29.647356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:29.647356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:29.647356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:29.647356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 could not be found. May 28 04:52:29.647356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.647356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4ec17c7a-65da-4fbc-b65e-6e4b3a581670 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Returning 404 to user: Instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:29.647356 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4ec17c7a-65da-4fbc-b65e-6e4b3a581670 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 404 len: 111 microversion: 2.1 time: 0.036712 May 28 04:52:29.647356 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2193/4495] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:52:29 2022] DELETE /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:29.653577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-230854db-98bc-412a-96a1-63f7b6cc7bdc tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:29.654412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-230854db-98bc-412a-96a1-63f7b6cc7bdc tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] [instance: 3bfa8d9c-3440-4ff7-933c-ee7d614ab248] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:29.660859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-230854db-98bc-412a-96a1-63f7b6cc7bdc tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:29.662155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-230854db-98bc-412a-96a1-63f7b6cc7bdc tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:29.665393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-230854db-98bc-412a-96a1-63f7b6cc7bdc tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:29.665393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-230854db-98bc-412a-96a1-63f7b6cc7bdc tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:29.669513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:29.682956 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-230854db-98bc-412a-96a1-63f7b6cc7bdc tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] HTTP exception thrown: Instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 could not be found. May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-230854db-98bc-412a-96a1-63f7b6cc7bdc tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Request method failure captured: May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 HTTP/1.1 May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikapqQ0gb3hSOJM4y4dtk0sucXKdiEdV9la8W2sAvNYcG4BEMN_ZVaKQRZVdObzCddhqgQWTnoLBv7O1TTOM5Sv8zIWLfrfJ1An_U48eMwf6WcZycwXd9qi36fIjGxkdIHB7BB6pvoN7sT06k90SWntNt8N1xTFmQAE9JDOe8fGTWUNU May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: b708685679fc4e4fa42b5797ca875be3 May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: b708685679fc4e4fa42b5797ca875be3 May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerGroupTestJSON-1689779321-project May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 774c9f835a2941659cbfc7a2ef2e64af May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerGroupTestJSON-1689779321-project May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 could not be found. May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '3bfa8d9c-3440-4ff7-933c-ee7d614ab248'} May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 could not be found. May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 could not be found. May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:29.685255 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.692505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.692505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:29.692505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:29.692505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:29.692505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:29.692505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 could not be found. May 28 04:52:29.692505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.692505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-230854db-98bc-412a-96a1-63f7b6cc7bdc tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Returning 404 to user: Instance 3bfa8d9c-3440-4ff7-933c-ee7d614ab248 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:29.695495 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-230854db-98bc-412a-96a1-63f7b6cc7bdc tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248" status: 404 len: 111 microversion: 2.1 time: 0.046093 May 28 04:52:29.696714 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2194/4496] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:29 2022] GET /compute/v2.1/servers/3bfa8d9c-3440-4ff7-933c-ee7d614ab248 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:29.707454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ff86d907-68a4-4fd1-a1c7-85f6ef382d60 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:29.715420 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-ff86d907-68a4-4fd1-a1c7-85f6ef382d60 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] HTTP exception thrown: Instance group 8a072df2-b933-4b79-bd8d-2c0f4a823e66 could not be found. May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ff86d907-68a4-4fd1-a1c7-85f6ef382d60 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Request method failure captured: May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/os-server-groups/8a072df2-b933-4b79-bd8d-2c0f4a823e66 HTTP/1.1 May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikapqQ0gb3hSOJM4y4dtk0sucXKdiEdV9la8W2sAvNYcG4BEMN_ZVaKQRZVdObzCddhqgQWTnoLBv7O1TTOM5Sv8zIWLfrfJ1An_U48eMwf6WcZycwXd9qi36fIjGxkdIHB7BB6pvoN7sT06k90SWntNt8N1xTFmQAE9JDOe8fGTWUNU May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: b708685679fc4e4fa42b5797ca875be3 May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: b708685679fc4e4fa42b5797ca875be3 May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerGroupTestJSON-1689779321-project May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 774c9f835a2941659cbfc7a2ef2e64af May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerGroupTestJSON-1689779321-project May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance group 8a072df2-b933-4b79-bd8d-2c0f4a823e66 could not be found. May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '8a072df2-b933-4b79-bd8d-2c0f4a823e66'} May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8a072df2-b933-4b79-bd8d-2c0f4a823e66 could not be found. May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8a072df2-b933-4b79-bd8d-2c0f4a823e66 could not be found. May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.718575 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.724008 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:29.724008 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:29.724008 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:29.724008 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:29.724008 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8a072df2-b933-4b79-bd8d-2c0f4a823e66 could not be found. May 28 04:52:29.724008 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.725973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ff86d907-68a4-4fd1-a1c7-85f6ef382d60 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Returning 404 to user: Instance group 8a072df2-b933-4b79-bd8d-2c0f4a823e66 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:29.727114 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ff86d907-68a4-4fd1-a1c7-85f6ef382d60 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/8a072df2-b933-4b79-bd8d-2c0f4a823e66" status: 404 len: 117 microversion: 2.1 time: 0.025325 May 28 04:52:29.727868 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2195/4497] 10.222.0.58 () {58 vars in 1265 bytes} [Sat May 28 04:52:29 2022] DELETE /compute/v2.1/os-server-groups/8a072df2-b933-4b79-bd8d-2c0f4a823e66 => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:52:29.736470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5c4a04e8-25e4-4482-a479-c2f721025f87 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:29.744619 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-5c4a04e8-25e4-4482-a479-c2f721025f87 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] HTTP exception thrown: Instance group 2519fec3-a27b-4ac2-99a4-ec58500142ca could not be found. May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5c4a04e8-25e4-4482-a479-c2f721025f87 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Request method failure captured: May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/os-server-groups/2519fec3-a27b-4ac2-99a4-ec58500142ca HTTP/1.1 May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikapqQ0gb3hSOJM4y4dtk0sucXKdiEdV9la8W2sAvNYcG4BEMN_ZVaKQRZVdObzCddhqgQWTnoLBv7O1TTOM5Sv8zIWLfrfJ1An_U48eMwf6WcZycwXd9qi36fIjGxkdIHB7BB6pvoN7sT06k90SWntNt8N1xTFmQAE9JDOe8fGTWUNU May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: b708685679fc4e4fa42b5797ca875be3 May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: b708685679fc4e4fa42b5797ca875be3 May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerGroupTestJSON-1689779321-project May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 774c9f835a2941659cbfc7a2ef2e64af May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerGroupTestJSON-1689779321-project May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance group 2519fec3-a27b-4ac2-99a4-ec58500142ca could not be found. May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '2519fec3-a27b-4ac2-99a4-ec58500142ca'} May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2519fec3-a27b-4ac2-99a4-ec58500142ca could not be found. May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2519fec3-a27b-4ac2-99a4-ec58500142ca could not be found. May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.746417 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.752318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:29.752318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:29.752318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:29.752318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:29.752318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2519fec3-a27b-4ac2-99a4-ec58500142ca could not be found. May 28 04:52:29.752318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.752318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5c4a04e8-25e4-4482-a479-c2f721025f87 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Returning 404 to user: Instance group 2519fec3-a27b-4ac2-99a4-ec58500142ca could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:29.752318 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5c4a04e8-25e4-4482-a479-c2f721025f87 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/2519fec3-a27b-4ac2-99a4-ec58500142ca" status: 404 len: 117 microversion: 2.1 time: 0.015994 May 28 04:52:29.752318 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2196/4498] 10.222.0.58 () {58 vars in 1265 bytes} [Sat May 28 04:52:29 2022] DELETE /compute/v2.1/os-server-groups/2519fec3-a27b-4ac2-99a4-ec58500142ca => generated 117 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:52:29.759425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8618f301-3dcd-431b-ade1-76a1af3eb1ff tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:29.767774 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-8618f301-3dcd-431b-ade1-76a1af3eb1ff tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] HTTP exception thrown: Instance group 169d3643-304d-4d30-a0ca-a19d5e5cada7 could not be found. May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8618f301-3dcd-431b-ade1-76a1af3eb1ff tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Request method failure captured: May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/os-server-groups/169d3643-304d-4d30-a0ca-a19d5e5cada7 HTTP/1.1 May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikapqQ0gb3hSOJM4y4dtk0sucXKdiEdV9la8W2sAvNYcG4BEMN_ZVaKQRZVdObzCddhqgQWTnoLBv7O1TTOM5Sv8zIWLfrfJ1An_U48eMwf6WcZycwXd9qi36fIjGxkdIHB7BB6pvoN7sT06k90SWntNt8N1xTFmQAE9JDOe8fGTWUNU May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: b708685679fc4e4fa42b5797ca875be3 May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: b708685679fc4e4fa42b5797ca875be3 May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerGroupTestJSON-1689779321-project May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 774c9f835a2941659cbfc7a2ef2e64af May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerGroupTestJSON-1689779321-project May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance group 169d3643-304d-4d30-a0ca-a19d5e5cada7 could not be found. May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '169d3643-304d-4d30-a0ca-a19d5e5cada7'} May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 169d3643-304d-4d30-a0ca-a19d5e5cada7 could not be found. May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 169d3643-304d-4d30-a0ca-a19d5e5cada7 could not be found. May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.769440 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.775781 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:29.775781 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:29.775781 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:29.775781 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:29.775781 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 169d3643-304d-4d30-a0ca-a19d5e5cada7 could not be found. May 28 04:52:29.775781 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.775781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8618f301-3dcd-431b-ade1-76a1af3eb1ff tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Returning 404 to user: Instance group 169d3643-304d-4d30-a0ca-a19d5e5cada7 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:29.775781 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8618f301-3dcd-431b-ade1-76a1af3eb1ff tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/169d3643-304d-4d30-a0ca-a19d5e5cada7" status: 404 len: 117 microversion: 2.1 time: 0.017340 May 28 04:52:29.775781 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2197/4499] 10.222.0.58 () {58 vars in 1265 bytes} [Sat May 28 04:52:29 2022] DELETE /compute/v2.1/os-server-groups/169d3643-304d-4d30-a0ca-a19d5e5cada7 => generated 117 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:29.784067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-03e85019-4601-42dd-8657-81299c7def6c tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:29.791344 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-03e85019-4601-42dd-8657-81299c7def6c tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] HTTP exception thrown: Instance group 3bcf575f-7af3-48d0-a8e4-8dcc1b3f8fe8 could not be found. May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-03e85019-4601-42dd-8657-81299c7def6c tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Request method failure captured: May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/os-server-groups/3bcf575f-7af3-48d0-a8e4-8dcc1b3f8fe8 HTTP/1.1 May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikapqQ0gb3hSOJM4y4dtk0sucXKdiEdV9la8W2sAvNYcG4BEMN_ZVaKQRZVdObzCddhqgQWTnoLBv7O1TTOM5Sv8zIWLfrfJ1An_U48eMwf6WcZycwXd9qi36fIjGxkdIHB7BB6pvoN7sT06k90SWntNt8N1xTFmQAE9JDOe8fGTWUNU May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: b708685679fc4e4fa42b5797ca875be3 May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b708685679fc4e4fa42b5797ca875be3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: b708685679fc4e4fa42b5797ca875be3 May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerGroupTestJSON-1689779321 May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerGroupTestJSON-1689779321-project May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 774c9f835a2941659cbfc7a2ef2e64af May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerGroupTestJSON-1689779321-project May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance group 3bcf575f-7af3-48d0-a8e4-8dcc1b3f8fe8 could not be found. May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '3bcf575f-7af3-48d0-a8e4-8dcc1b3f8fe8'} May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3bcf575f-7af3-48d0-a8e4-8dcc1b3f8fe8 could not be found. May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3bcf575f-7af3-48d0-a8e4-8dcc1b3f8fe8 could not be found. May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.793472 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:29.799813 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:29.799813 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:29.799813 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:29.799813 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:29.799813 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3bcf575f-7af3-48d0-a8e4-8dcc1b3f8fe8 could not be found. May 28 04:52:29.799813 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:29.799813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-03e85019-4601-42dd-8657-81299c7def6c tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Returning 404 to user: Instance group 3bcf575f-7af3-48d0-a8e4-8dcc1b3f8fe8 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:29.799813 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-03e85019-4601-42dd-8657-81299c7def6c tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/3bcf575f-7af3-48d0-a8e4-8dcc1b3f8fe8" status: 404 len: 117 microversion: 2.1 time: 0.018575 May 28 04:52:29.803970 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2198/4500] 10.222.0.58 () {58 vars in 1265 bytes} [Sat May 28 04:52:29 2022] DELETE /compute/v2.1/os-server-groups/3bcf575f-7af3-48d0-a8e4-8dcc1b3f8fe8 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:29.808918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e1d39449-c0b6-44f8-b73c-e14474f26194 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:29.830938 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1865ed51-8875-4dae-b181-435c63f6faac tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "POST /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655/action" status: 200 len: 32 microversion: 2.1 time: 0.357308 May 28 04:52:29.832275 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2303/4501] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:52:29 2022] POST /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655/action => generated 32 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:52:29.852066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-046c077a-3416-4755-816c-c2a129e017f2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:29.853096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-046c077a-3416-4755-816c-c2a129e017f2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:29.861853 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-046c077a-3416-4755-816c-c2a129e017f2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:29.862539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-046c077a-3416-4755-816c-c2a129e017f2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:29.863456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-046c077a-3416-4755-816c-c2a129e017f2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:29.864183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-046c077a-3416-4755-816c-c2a129e017f2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:30.071302 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e1d39449-c0b6-44f8-b73c-e14474f26194 tempest-ServerGroupTestJSON-1689779321 tempest-ServerGroupTestJSON-1689779321-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/2e4d5f55-45a8-47bf-b084-49ff2fe2603d" status: 204 len: 0 microversion: 2.1 time: 0.265350 May 28 04:52:30.077690 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2199/4502] 10.222.0.58 () {58 vars in 1265 bytes} [Sat May 28 04:52:29 2022] DELETE /compute/v2.1/os-server-groups/2e4d5f55-45a8-47bf-b084-49ff2fe2603d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:52:30.085244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-76db1dac-fa2d-4680-84c2-82c6ab4af82a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:30.088074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-76db1dac-fa2d-4680-84c2-82c6ab4af82a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:30.098526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76db1dac-fa2d-4680-84c2-82c6ab4af82a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:30.100547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76db1dac-fa2d-4680-84c2-82c6ab4af82a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:30.101693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76db1dac-fa2d-4680-84c2-82c6ab4af82a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:30.102096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76db1dac-fa2d-4680-84c2-82c6ab4af82a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:30.240804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-046c077a-3416-4755-816c-c2a129e017f2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:30.252146 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-046c077a-3416-4755-816c-c2a129e017f2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1693 microversion: 2.1 time: 0.415491 May 28 04:52:30.254089 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2304/4503] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:29 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1693 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:30.263229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-050e1367-1f9c-46f5-a048-97c121896731 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:30.263229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-050e1367-1f9c-46f5-a048-97c121896731 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:30.275904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-050e1367-1f9c-46f5-a048-97c121896731 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:30.276379 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-050e1367-1f9c-46f5-a048-97c121896731 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:30.279845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-050e1367-1f9c-46f5-a048-97c121896731 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:30.279845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-050e1367-1f9c-46f5-a048-97c121896731 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:30.584620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-76db1dac-fa2d-4680-84c2-82c6ab4af82a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:30.596785 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-76db1dac-fa2d-4680-84c2-82c6ab4af82a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1509 microversion: 2.1 time: 0.517752 May 28 04:52:30.606862 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2200/4504] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:30 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1509 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:30.613471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ff993ed9-0d4e-4384-8044-34ec23a79ca0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:30.613748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ff993ed9-0d4e-4384-8044-34ec23a79ca0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 0015d5ed-bee0-4520-8a13-42d5f5abc857] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:30.620642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff993ed9-0d4e-4384-8044-34ec23a79ca0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:30.621180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff993ed9-0d4e-4384-8044-34ec23a79ca0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:30.621977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff993ed9-0d4e-4384-8044-34ec23a79ca0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:30.622480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff993ed9-0d4e-4384-8044-34ec23a79ca0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:30.817785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-050e1367-1f9c-46f5-a048-97c121896731 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:30.843418 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-050e1367-1f9c-46f5-a048-97c121896731 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.584039 May 28 04:52:30.855223 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2305/4505] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:30 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:30.855718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-61e6393b-5feb-4a22-bc44-16330ce543df tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:30.860906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-61e6393b-5feb-4a22-bc44-16330ce543df tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:30.868624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-61e6393b-5feb-4a22-bc44-16330ce543df tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:30.869560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-61e6393b-5feb-4a22-bc44-16330ce543df tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:30.870602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-61e6393b-5feb-4a22-bc44-16330ce543df tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:30.871495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-61e6393b-5feb-4a22-bc44-16330ce543df tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:31.016891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-61e6393b-5feb-4a22-bc44-16330ce543df tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780c97536c34c60a8deaf5b00e84cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3444a0099cc64616854d5172bf7ff6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:31.028574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ff993ed9-0d4e-4384-8044-34ec23a79ca0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:31.042353 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-61e6393b-5feb-4a22-bc44-16330ce543df tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2" status: 200 len: 1274 microversion: 2.1 time: 0.192776 May 28 04:52:31.042924 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ff993ed9-0d4e-4384-8044-34ec23a79ca0 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857" status: 200 len: 1507 microversion: 2.1 time: 0.434717 May 28 04:52:31.043658 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2201/4506] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:30 2022] GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857 => generated 1507 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:31.053658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aff64f56-5b3c-481a-9755-b372a74b2a99 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:31.053658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-aff64f56-5b3c-481a-9755-b372a74b2a99 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:31.055179 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2306/4507] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:30 2022] GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2 => generated 1274 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:31.066732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aff64f56-5b3c-481a-9755-b372a74b2a99 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:31.068463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aff64f56-5b3c-481a-9755-b372a74b2a99 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:31.069151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d5d16457-5b5b-4a1a-af10-5d9f261e8a92 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:31.071153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d5d16457-5b5b-4a1a-af10-5d9f261e8a92 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 474caa3e-f826-4a32-82aa-4c5bf30e2c7d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:31.071513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aff64f56-5b3c-481a-9755-b372a74b2a99 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:31.072006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aff64f56-5b3c-481a-9755-b372a74b2a99 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:31.084440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5d16457-5b5b-4a1a-af10-5d9f261e8a92 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:31.091594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5d16457-5b5b-4a1a-af10-5d9f261e8a92 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:31.092584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5d16457-5b5b-4a1a-af10-5d9f261e8a92 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:31.093331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5d16457-5b5b-4a1a-af10-5d9f261e8a92 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:31.482935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-aff64f56-5b3c-481a-9755-b372a74b2a99 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:31.504655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d5d16457-5b5b-4a1a-af10-5d9f261e8a92 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:31.513521 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aff64f56-5b3c-481a-9755-b372a74b2a99 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 200 len: 1314 microversion: 2.1 time: 0.467777 May 28 04:52:31.516564 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2202/4508] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:31 2022] GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:31.522918 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d5d16457-5b5b-4a1a-af10-5d9f261e8a92 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/474caa3e-f826-4a32-82aa-4c5bf30e2c7d" status: 200 len: 1506 microversion: 2.1 time: 0.462896 May 28 04:52:31.535018 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2307/4509] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:31 2022] GET /compute/v2.1/servers/474caa3e-f826-4a32-82aa-4c5bf30e2c7d => generated 1506 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:31.535462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-34a50004-aae7-49a2-b213-90b4cabbed9b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:31.535462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-34a50004-aae7-49a2-b213-90b4cabbed9b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:31.544379 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6c4c9eb9-3dc7-48df-81b1-1cbd5377ef7e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:31.544926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6c4c9eb9-3dc7-48df-81b1-1cbd5377ef7e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 474caa3e-f826-4a32-82aa-4c5bf30e2c7d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:31.549726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34a50004-aae7-49a2-b213-90b4cabbed9b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:31.550396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34a50004-aae7-49a2-b213-90b4cabbed9b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:31.553372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34a50004-aae7-49a2-b213-90b4cabbed9b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:31.553372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34a50004-aae7-49a2-b213-90b4cabbed9b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:31.553620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c4c9eb9-3dc7-48df-81b1-1cbd5377ef7e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:31.553620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c4c9eb9-3dc7-48df-81b1-1cbd5377ef7e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:31.553620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c4c9eb9-3dc7-48df-81b1-1cbd5377ef7e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:31.553620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c4c9eb9-3dc7-48df-81b1-1cbd5377ef7e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:31.595483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6c4c9eb9-3dc7-48df-81b1-1cbd5377ef7e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 474caa3e-f826-4a32-82aa-4c5bf30e2c7d] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:52:31.817473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-34a50004-aae7-49a2-b213-90b4cabbed9b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:31.826151 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-34a50004-aae7-49a2-b213-90b4cabbed9b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1693 microversion: 2.1 time: 0.308591 May 28 04:52:31.826876 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2203/4510] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:31 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1693 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:31.834037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1eabc74e-fd17-4d80-8081-d612d9b057d0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:31.835186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1eabc74e-fd17-4d80-8081-d612d9b057d0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:31.847213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1eabc74e-fd17-4d80-8081-d612d9b057d0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:31.847213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1eabc74e-fd17-4d80-8081-d612d9b057d0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:31.847213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1eabc74e-fd17-4d80-8081-d612d9b057d0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:31.848844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1eabc74e-fd17-4d80-8081-d612d9b057d0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:31.945354 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6c4c9eb9-3dc7-48df-81b1-1cbd5377ef7e tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "DELETE /compute/v2.1/servers/474caa3e-f826-4a32-82aa-4c5bf30e2c7d" status: 204 len: 0 microversion: 2.1 time: 0.405370 May 28 04:52:31.946705 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2308/4511] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:52:31 2022] DELETE /compute/v2.1/servers/474caa3e-f826-4a32-82aa-4c5bf30e2c7d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:52:31.953759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-790a3c00-213a-48d6-aed8-8591df58fc5d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:31.955199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-790a3c00-213a-48d6-aed8-8591df58fc5d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:31.964249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-790a3c00-213a-48d6-aed8-8591df58fc5d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:31.964962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-790a3c00-213a-48d6-aed8-8591df58fc5d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:31.965757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-790a3c00-213a-48d6-aed8-8591df58fc5d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:31.966206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-790a3c00-213a-48d6-aed8-8591df58fc5d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:32.051357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1eabc74e-fd17-4d80-8081-d612d9b057d0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:32.070030 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1eabc74e-fd17-4d80-8081-d612d9b057d0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1509 microversion: 2.1 time: 0.241705 May 28 04:52:32.071114 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2204/4512] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:31 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1509 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:32.077048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-33138a87-7577-4e0b-847c-cb88476b7d2b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:32.078287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-33138a87-7577-4e0b-847c-cb88476b7d2b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 0015d5ed-bee0-4520-8a13-42d5f5abc857] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:32.085492 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33138a87-7577-4e0b-847c-cb88476b7d2b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:32.086267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33138a87-7577-4e0b-847c-cb88476b7d2b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:32.087278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33138a87-7577-4e0b-847c-cb88476b7d2b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:32.087894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33138a87-7577-4e0b-847c-cb88476b7d2b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:32.119894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-33138a87-7577-4e0b-847c-cb88476b7d2b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 0015d5ed-bee0-4520-8a13-42d5f5abc857] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:52:32.126480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:32.142789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-790a3c00-213a-48d6-aed8-8591df58fc5d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:32.156554 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-790a3c00-213a-48d6-aed8-8591df58fc5d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.208368 May 28 04:52:32.157345 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2309/4513] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:31 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:32.162241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-145bfb5d-5169-4fcc-8860-ad91d664707e tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:32.163590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-145bfb5d-5169-4fcc-8860-ad91d664707e tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:32.170727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-145bfb5d-5169-4fcc-8860-ad91d664707e tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:32.171340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-145bfb5d-5169-4fcc-8860-ad91d664707e tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:32.172870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-145bfb5d-5169-4fcc-8860-ad91d664707e tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:32.173600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-145bfb5d-5169-4fcc-8860-ad91d664707e tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:32.314946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-145bfb5d-5169-4fcc-8860-ad91d664707e tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780c97536c34c60a8deaf5b00e84cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3444a0099cc64616854d5172bf7ff6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:32.323616 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-145bfb5d-5169-4fcc-8860-ad91d664707e tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2" status: 200 len: 1316 microversion: 2.1 time: 0.164984 May 28 04:52:32.327436 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2310/4514] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:32 2022] GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:32.414425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-5fea67d4-1b94-4fea-b16a-ab8024eafae4 req-231698c2-0bbf-4fb6-95b7-a938cec10ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6dd1de3-8a85-42b0-8ac8-49b66c6768d5", "name": "network-vif-plugged", "status": "completed", "tag": "db0b3c18-c41f-4153-82f7-d7bb4195f4fc"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:32.428309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5fea67d4-1b94-4fea-b16a-ab8024eafae4 req-231698c2-0bbf-4fb6-95b7-a938cec10ded service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:32.428816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5fea67d4-1b94-4fea-b16a-ab8024eafae4 req-231698c2-0bbf-4fb6-95b7-a938cec10ded service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:32.441054 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-5fea67d4-1b94-4fea-b16a-ab8024eafae4 req-231698c2-0bbf-4fb6-95b7-a938cec10ded service nova] Creating event network-vif-plugged:db0b3c18-c41f-4153-82f7-d7bb4195f4fc for instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 on n-h1-843700-1 May 28 04:52:32.446061 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-5fea67d4-1b94-4fea-b16a-ab8024eafae4 req-231698c2-0bbf-4fb6-95b7-a938cec10ded service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037182 May 28 04:52:32.446658 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2311/4515] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:32.483493 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-33138a87-7577-4e0b-847c-cb88476b7d2b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857" status: 204 len: 0 microversion: 2.1 time: 0.410008 May 28 04:52:32.484096 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2205/4516] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:52:32 2022] DELETE /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:52:32.495149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f3bdcaa6-0bd4-4637-bac5-670d08cced84 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:32.495862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f3bdcaa6-0bd4-4637-bac5-670d08cced84 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 474caa3e-f826-4a32-82aa-4c5bf30e2c7d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:32.502516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f3bdcaa6-0bd4-4637-bac5-670d08cced84 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:32.502972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f3bdcaa6-0bd4-4637-bac5-670d08cced84 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:32.503792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f3bdcaa6-0bd4-4637-bac5-670d08cced84 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:32.504224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f3bdcaa6-0bd4-4637-bac5-670d08cced84 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:32.535059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-185ba953-ca0b-4f24-9502-930a2c066c9d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:32.536216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-185ba953-ca0b-4f24-9502-930a2c066c9d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:32.546877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-185ba953-ca0b-4f24-9502-930a2c066c9d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:32.548897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-185ba953-ca0b-4f24-9502-930a2c066c9d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:32.548897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-185ba953-ca0b-4f24-9502-930a2c066c9d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:32.549177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-185ba953-ca0b-4f24-9502-930a2c066c9d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:32.739947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f3bdcaa6-0bd4-4637-bac5-670d08cced84 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:32.761848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-185ba953-ca0b-4f24-9502-930a2c066c9d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:32.764477 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f3bdcaa6-0bd4-4637-bac5-670d08cced84 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/474caa3e-f826-4a32-82aa-4c5bf30e2c7d" status: 200 len: 1512 microversion: 2.1 time: 0.272740 May 28 04:52:32.771081 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-185ba953-ca0b-4f24-9502-930a2c066c9d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 200 len: 1314 microversion: 2.1 time: 0.237980 May 28 04:52:32.771249 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2312/4517] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:32 2022] GET /compute/v2.1/servers/474caa3e-f826-4a32-82aa-4c5bf30e2c7d => generated 1512 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:32.771365 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2206/4518] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:32 2022] GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:32.843762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aedd1873-1796-465a-bfbe-0ad0bb067eaa tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:32.844942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aedd1873-1796-465a-bfbe-0ad0bb067eaa tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:32.851141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aedd1873-1796-465a-bfbe-0ad0bb067eaa tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:32.851597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aedd1873-1796-465a-bfbe-0ad0bb067eaa tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:32.852395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aedd1873-1796-465a-bfbe-0ad0bb067eaa tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:32.852839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aedd1873-1796-465a-bfbe-0ad0bb067eaa tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:32.983250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aedd1873-1796-465a-bfbe-0ad0bb067eaa tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:32.990909 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aedd1873-1796-465a-bfbe-0ad0bb067eaa tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1685 microversion: 2.1 time: 0.151022 May 28 04:52:32.991573 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2313/4519] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:32 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:33.088268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-74f63f65-23d7-457a-b020-dfd961a30b2a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:33.088890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-74f63f65-23d7-457a-b020-dfd961a30b2a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:33.096035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74f63f65-23d7-457a-b020-dfd961a30b2a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:33.096500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74f63f65-23d7-457a-b020-dfd961a30b2a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:33.097296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74f63f65-23d7-457a-b020-dfd961a30b2a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:33.097742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74f63f65-23d7-457a-b020-dfd961a30b2a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:33.174382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-171c3ce5-bf65-4170-a945-1acb3b81fbfb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:33.175144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-171c3ce5-bf65-4170-a945-1acb3b81fbfb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:33.181994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-171c3ce5-bf65-4170-a945-1acb3b81fbfb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:33.183145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-171c3ce5-bf65-4170-a945-1acb3b81fbfb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:33.184028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-171c3ce5-bf65-4170-a945-1acb3b81fbfb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:33.184424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-171c3ce5-bf65-4170-a945-1acb3b81fbfb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:33.248498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-74f63f65-23d7-457a-b020-dfd961a30b2a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:33.257332 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-74f63f65-23d7-457a-b020-dfd961a30b2a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1509 microversion: 2.1 time: 0.173292 May 28 04:52:33.258047 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2207/4520] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:33 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:33.343575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-20f89553-bada-4706-9b4f-d95ba1623733 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:33.343575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-20f89553-bada-4706-9b4f-d95ba1623733 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:33.343906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-171c3ce5-bf65-4170-a945-1acb3b81fbfb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:33.350222 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20f89553-bada-4706-9b4f-d95ba1623733 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:33.350942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20f89553-bada-4706-9b4f-d95ba1623733 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:33.351816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20f89553-bada-4706-9b4f-d95ba1623733 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:33.352333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20f89553-bada-4706-9b4f-d95ba1623733 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:33.352445 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-171c3ce5-bf65-4170-a945-1acb3b81fbfb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.182488 May 28 04:52:33.361672 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2314/4521] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:33 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:33.483772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-20f89553-bada-4706-9b4f-d95ba1623733 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780c97536c34c60a8deaf5b00e84cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3444a0099cc64616854d5172bf7ff6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:33.493139 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-20f89553-bada-4706-9b4f-d95ba1623733 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2" status: 200 len: 1316 microversion: 2.1 time: 0.156050 May 28 04:52:33.493834 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2208/4522] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:33 2022] GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:33.782754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-42d4abf4-7712-496f-b47b-4e033e0ee170 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:33.784139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8fe98606-da94-4ad7-a024-1edbaf4ae409 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:33.784719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-42d4abf4-7712-496f-b47b-4e033e0ee170 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 474caa3e-f826-4a32-82aa-4c5bf30e2c7d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:33.785430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8fe98606-da94-4ad7-a024-1edbaf4ae409 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:33.792373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42d4abf4-7712-496f-b47b-4e033e0ee170 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:33.793061 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42d4abf4-7712-496f-b47b-4e033e0ee170 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:33.794619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42d4abf4-7712-496f-b47b-4e033e0ee170 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:33.795081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42d4abf4-7712-496f-b47b-4e033e0ee170 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:33.807711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8fe98606-da94-4ad7-a024-1edbaf4ae409 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:33.808247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8fe98606-da94-4ad7-a024-1edbaf4ae409 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:33.809057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8fe98606-da94-4ad7-a024-1edbaf4ae409 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:33.809509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8fe98606-da94-4ad7-a024-1edbaf4ae409 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:34.004456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-42d4abf4-7712-496f-b47b-4e033e0ee170 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:34.013754 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-42d4abf4-7712-496f-b47b-4e033e0ee170 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/474caa3e-f826-4a32-82aa-4c5bf30e2c7d" status: 200 len: 1512 microversion: 2.1 time: 0.234923 May 28 04:52:34.024024 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2315/4523] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:33 2022] GET /compute/v2.1/servers/474caa3e-f826-4a32-82aa-4c5bf30e2c7d => generated 1512 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:34.050419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8fe98606-da94-4ad7-a024-1edbaf4ae409 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:34.059668 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8fe98606-da94-4ad7-a024-1edbaf4ae409 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 200 len: 1314 microversion: 2.1 time: 0.280228 May 28 04:52:34.064672 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2209/4524] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:33 2022] GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:34.275144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-113759c7-a8e0-4e3c-b3e5-a345df9f579f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:34.275782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-113759c7-a8e0-4e3c-b3e5-a345df9f579f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:34.282475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-113759c7-a8e0-4e3c-b3e5-a345df9f579f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:34.282924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-113759c7-a8e0-4e3c-b3e5-a345df9f579f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:34.283711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-113759c7-a8e0-4e3c-b3e5-a345df9f579f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:34.284153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-113759c7-a8e0-4e3c-b3e5-a345df9f579f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:34.370878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-22d5fece-b96f-4146-9ec2-885a015ba0c1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:34.372302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-22d5fece-b96f-4146-9ec2-885a015ba0c1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:34.379508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22d5fece-b96f-4146-9ec2-885a015ba0c1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:34.380407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22d5fece-b96f-4146-9ec2-885a015ba0c1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:34.381296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22d5fece-b96f-4146-9ec2-885a015ba0c1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:34.381843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22d5fece-b96f-4146-9ec2-885a015ba0c1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:34.612231 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-113759c7-a8e0-4e3c-b3e5-a345df9f579f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:34.629712 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-113759c7-a8e0-4e3c-b3e5-a345df9f579f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1509 microversion: 2.1 time: 0.358327 May 28 04:52:34.630673 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2316/4525] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:34 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1509 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:34.638373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b6c971f9-754d-4866-bb23-0e0a484e433d tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:34.639287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b6c971f9-754d-4866-bb23-0e0a484e433d tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:34.647014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b6c971f9-754d-4866-bb23-0e0a484e433d tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:34.647475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b6c971f9-754d-4866-bb23-0e0a484e433d tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:34.648316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b6c971f9-754d-4866-bb23-0e0a484e433d tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:34.648791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b6c971f9-754d-4866-bb23-0e0a484e433d tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:34.670571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-22d5fece-b96f-4146-9ec2-885a015ba0c1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:34.681465 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-22d5fece-b96f-4146-9ec2-885a015ba0c1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.315718 May 28 04:52:34.682062 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2210/4526] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:34 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:34.871808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b6c971f9-754d-4866-bb23-0e0a484e433d tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780c97536c34c60a8deaf5b00e84cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3444a0099cc64616854d5172bf7ff6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:34.897776 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b6c971f9-754d-4866-bb23-0e0a484e433d tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2" status: 200 len: 1316 microversion: 2.1 time: 0.253860 May 28 04:52:34.900305 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2317/4527] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:34 2022] GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:35.017620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-935d698f-a6c5-4988-baac-8929c6f77252 req-e479e383-47e0-4811-86df-65b72153bbfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474caa3e-f826-4a32-82aa-4c5bf30e2c7d", "name": "network-vif-deleted", "tag": "b3bfffb5-1c7e-45f1-b907-290b2a2be5b2"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:35.031139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cdc32fc4-6ef7-411f-87bb-7f1a04c1cbe5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:35.031968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cdc32fc4-6ef7-411f-87bb-7f1a04c1cbe5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 474caa3e-f826-4a32-82aa-4c5bf30e2c7d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:35.037634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-935d698f-a6c5-4988-baac-8929c6f77252 req-e479e383-47e0-4811-86df-65b72153bbfc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:35.040077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-935d698f-a6c5-4988-baac-8929c6f77252 req-e479e383-47e0-4811-86df-65b72153bbfc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:35.047049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cdc32fc4-6ef7-411f-87bb-7f1a04c1cbe5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:35.047770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cdc32fc4-6ef7-411f-87bb-7f1a04c1cbe5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:35.048737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cdc32fc4-6ef7-411f-87bb-7f1a04c1cbe5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:35.049377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cdc32fc4-6ef7-411f-87bb-7f1a04c1cbe5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:35.055536 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-935d698f-a6c5-4988-baac-8929c6f77252 req-e479e383-47e0-4811-86df-65b72153bbfc service nova] Creating event network-vif-deleted:b3bfffb5-1c7e-45f1-b907-290b2a2be5b2 for instance 474caa3e-f826-4a32-82aa-4c5bf30e2c7d on n-h2-843700-1 May 28 04:52:35.066199 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-935d698f-a6c5-4988-baac-8929c6f77252 req-e479e383-47e0-4811-86df-65b72153bbfc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053429 May 28 04:52:35.070362 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2211/4528] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:35.072502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:35.083038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6f0b0e16-ce3b-4261-8e8d-d0601a7e5b15 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:35.083038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6f0b0e16-ce3b-4261-8e8d-d0601a7e5b15 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:35.091235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f0b0e16-ce3b-4261-8e8d-d0601a7e5b15 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:35.095954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f0b0e16-ce3b-4261-8e8d-d0601a7e5b15 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:35.095954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f0b0e16-ce3b-4261-8e8d-d0601a7e5b15 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:35.095954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f0b0e16-ce3b-4261-8e8d-d0601a7e5b15 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:35.144687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cdc32fc4-6ef7-411f-87bb-7f1a04c1cbe5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:35.153034 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cdc32fc4-6ef7-411f-87bb-7f1a04c1cbe5 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/474caa3e-f826-4a32-82aa-4c5bf30e2c7d" status: 200 len: 1470 microversion: 2.1 time: 0.126032 May 28 04:52:35.160690 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2318/4529] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:35 2022] GET /compute/v2.1/servers/474caa3e-f826-4a32-82aa-4c5bf30e2c7d => generated 1470 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:35.582393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-08a96a2e-ca67-46ae-a287-ed8977cca15d req-7240f07c-29e3-4098-bde2-e22c45144fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0015d5ed-bee0-4520-8a13-42d5f5abc857", "name": "network-vif-deleted", "tag": "cb667d54-41a5-4818-baec-43858e95a3d4"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:35.593605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:35.597091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-08a96a2e-ca67-46ae-a287-ed8977cca15d req-7240f07c-29e3-4098-bde2-e22c45144fd0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:35.597771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-08a96a2e-ca67-46ae-a287-ed8977cca15d req-7240f07c-29e3-4098-bde2-e22c45144fd0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:35.611891 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-08a96a2e-ca67-46ae-a287-ed8977cca15d req-7240f07c-29e3-4098-bde2-e22c45144fd0 service nova] Creating event network-vif-deleted:cb667d54-41a5-4818-baec-43858e95a3d4 for instance 0015d5ed-bee0-4520-8a13-42d5f5abc857 on n-h1-843700-1 May 28 04:52:35.618084 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-08a96a2e-ca67-46ae-a287-ed8977cca15d req-7240f07c-29e3-4098-bde2-e22c45144fd0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042068 May 28 04:52:35.619245 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2319/4530] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:52:35.644250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6f0b0e16-ce3b-4261-8e8d-d0601a7e5b15 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:35.649547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-02216042-09e9-4a7c-9705-0d4d6229b12a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:35.651031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-02216042-09e9-4a7c-9705-0d4d6229b12a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:35.654926 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6f0b0e16-ce3b-4261-8e8d-d0601a7e5b15 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 200 len: 1501 microversion: 2.1 time: 0.581127 May 28 04:52:35.658719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02216042-09e9-4a7c-9705-0d4d6229b12a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:35.659470 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02216042-09e9-4a7c-9705-0d4d6229b12a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:35.660666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02216042-09e9-4a7c-9705-0d4d6229b12a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:35.661304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02216042-09e9-4a7c-9705-0d4d6229b12a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:35.671074 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2212/4531] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:35 2022] GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 1501 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:35.676999 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6c112849-ca88-4c09-a6bd-9b17e83ac4c8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:35.677541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6c112849-ca88-4c09-a6bd-9b17e83ac4c8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:35.686084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c112849-ca88-4c09-a6bd-9b17e83ac4c8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:35.686638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c112849-ca88-4c09-a6bd-9b17e83ac4c8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:35.687524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c112849-ca88-4c09-a6bd-9b17e83ac4c8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:35.692549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c112849-ca88-4c09-a6bd-9b17e83ac4c8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:35.710587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=5 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:35.821053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-02216042-09e9-4a7c-9705-0d4d6229b12a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:35.828560 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-02216042-09e9-4a7c-9705-0d4d6229b12a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1509 microversion: 2.1 time: 0.184477 May 28 04:52:35.829148 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2320/4532] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:35 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:35.833586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ecf5c616-9f73-43ac-9d5d-66f6ccd604fd tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:35.834400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ecf5c616-9f73-43ac-9d5d-66f6ccd604fd tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:35.841813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ecf5c616-9f73-43ac-9d5d-66f6ccd604fd tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:35.842277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ecf5c616-9f73-43ac-9d5d-66f6ccd604fd tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:35.843091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ecf5c616-9f73-43ac-9d5d-66f6ccd604fd tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:35.843539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ecf5c616-9f73-43ac-9d5d-66f6ccd604fd tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:35.984594 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6c112849-ca88-4c09-a6bd-9b17e83ac4c8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "POST /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5/action" status: 202 len: 0 microversion: 2.1 time: 0.311920 May 28 04:52:35.986498 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2213/4533] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:52:35 2022] POST /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:52:35.992844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5607b509-d3e0-4508-aed4-717b46089b5e tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:35.993823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5607b509-d3e0-4508-aed4-717b46089b5e tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:35.996011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ecf5c616-9f73-43ac-9d5d-66f6ccd604fd tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:36.002104 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5607b509-d3e0-4508-aed4-717b46089b5e tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:36.002568 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5607b509-d3e0-4508-aed4-717b46089b5e tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:36.003492 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5607b509-d3e0-4508-aed4-717b46089b5e tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:36.003824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5607b509-d3e0-4508-aed4-717b46089b5e tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:36.005520 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ecf5c616-9f73-43ac-9d5d-66f6ccd604fd tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.175363 May 28 04:52:36.006176 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2321/4534] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:35 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:36.010632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-753a3263-5f7d-4680-abd8-f63442c14961 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:36.012588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-753a3263-5f7d-4680-abd8-f63442c14961 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:36.017237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-753a3263-5f7d-4680-abd8-f63442c14961 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:36.017701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-753a3263-5f7d-4680-abd8-f63442c14961 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:36.018473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-753a3263-5f7d-4680-abd8-f63442c14961 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:36.018919 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-753a3263-5f7d-4680-abd8-f63442c14961 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:36.219729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5607b509-d3e0-4508-aed4-717b46089b5e tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780c97536c34c60a8deaf5b00e84cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3444a0099cc64616854d5172bf7ff6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:36.226770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-753a3263-5f7d-4680-abd8-f63442c14961 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:36.233259 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5607b509-d3e0-4508-aed4-717b46089b5e tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2" status: 200 len: 1316 microversion: 2.1 time: 0.245270 May 28 04:52:36.233857 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2214/4535] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:35 2022] GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2 => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:36.239287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-15abe1d1-9ef9-4890-bb39-e774d05b7ddc tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:36.239902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-15abe1d1-9ef9-4890-bb39-e774d05b7ddc tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 474caa3e-f826-4a32-82aa-4c5bf30e2c7d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:36.246022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15abe1d1-9ef9-4890-bb39-e774d05b7ddc tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:36.246480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15abe1d1-9ef9-4890-bb39-e774d05b7ddc tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:36.247538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15abe1d1-9ef9-4890-bb39-e774d05b7ddc tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:36.248178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15abe1d1-9ef9-4890-bb39-e774d05b7ddc tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:36.275509 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-753a3263-5f7d-4680-abd8-f63442c14961 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 200 len: 1506 microversion: 2.1 time: 0.268251 May 28 04:52:36.276123 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2322/4536] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:36 2022] GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 1506 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:36.285969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15abe1d1-9ef9-4890-bb39-e774d05b7ddc tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:36.286431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15abe1d1-9ef9-4890-bb39-e774d05b7ddc tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:36.287177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-15abe1d1-9ef9-4890-bb39-e774d05b7ddc tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lazy-loading 'fault' on Instance uuid 474caa3e-f826-4a32-82aa-4c5bf30e2c7d {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:52:36.334147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-15abe1d1-9ef9-4890-bb39-e774d05b7ddc tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1ff365f86047dcb5ba2ad991a29e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac87488ec1b4944a056d28d154eede5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:36.343886 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-15abe1d1-9ef9-4890-bb39-e774d05b7ddc tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/474caa3e-f826-4a32-82aa-4c5bf30e2c7d" status: 200 len: 1308 microversion: 2.1 time: 0.108850 May 28 04:52:36.345043 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2215/4537] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:36 2022] GET /compute/v2.1/servers/474caa3e-f826-4a32-82aa-4c5bf30e2c7d => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:36.539630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d5487350-47bb-4ba3-a1fe-e0731f9e3fc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1777157366", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:36.592335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-d5487350-47bb-4ba3-a1fe-e0731f9e3fc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] validate_networks() for [('d8b90133-44e4-4677-ae8d-d676a447193b', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:52:36.846051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c8e5379f-7271-4d07-acde-a5bc4f74dc6b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:36.846661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c8e5379f-7271-4d07-acde-a5bc4f74dc6b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:36.849125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:36.854495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c8e5379f-7271-4d07-acde-a5bc4f74dc6b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:36.854938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c8e5379f-7271-4d07-acde-a5bc4f74dc6b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:36.855867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c8e5379f-7271-4d07-acde-a5bc4f74dc6b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:36.866465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c8e5379f-7271-4d07-acde-a5bc4f74dc6b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:37.023589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d5487350-47bb-4ba3-a1fe-e0731f9e3fc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:52:37.023945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d5487350-47bb-4ba3-a1fe-e0731f9e3fc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:52:37.024414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d5487350-47bb-4ba3-a1fe-e0731f9e3fc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:52:37.024851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d5487350-47bb-4ba3-a1fe-e0731f9e3fc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:52:37.025263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d5487350-47bb-4ba3-a1fe-e0731f9e3fc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:52:37.035010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5487350-47bb-4ba3-a1fe-e0731f9e3fc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:37.035459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5487350-47bb-4ba3-a1fe-e0731f9e3fc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:37.036252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5487350-47bb-4ba3-a1fe-e0731f9e3fc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:37.036686 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5487350-47bb-4ba3-a1fe-e0731f9e3fc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:37.054144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-d5487350-47bb-4ba3-a1fe-e0731f9e3fc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Getting quotas for project 2092b676e36e4cb88f1e9ec9cf861b1a. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:52:37.056667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c8e5379f-7271-4d07-acde-a5bc4f74dc6b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:37.059490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-d5487350-47bb-4ba3-a1fe-e0731f9e3fc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Getting quotas for user 24a79b183ba14d3c8674b9ac0ffca2b3 and project 2092b676e36e4cb88f1e9ec9cf861b1a. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:52:37.064918 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c8e5379f-7271-4d07-acde-a5bc4f74dc6b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1509 microversion: 2.1 time: 0.223531 May 28 04:52:37.065536 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2216/4538] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:36 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:37.070167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b871ea7d-6014-47ab-a3da-b826ce63a997 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:37.070784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b871ea7d-6014-47ab-a3da-b826ce63a997 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:37.072855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d5487350-47bb-4ba3-a1fe-e0731f9e3fc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:52:37.075531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d5487350-47bb-4ba3-a1fe-e0731f9e3fc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:52:37.078045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b871ea7d-6014-47ab-a3da-b826ce63a997 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:37.078045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b871ea7d-6014-47ab-a3da-b826ce63a997 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:37.078288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b871ea7d-6014-47ab-a3da-b826ce63a997 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:37.079143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b871ea7d-6014-47ab-a3da-b826ce63a997 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:37.210408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b871ea7d-6014-47ab-a3da-b826ce63a997 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:37.217933 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b871ea7d-6014-47ab-a3da-b826ce63a997 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.151454 May 28 04:52:37.218506 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2217/4539] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:37 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:37.227813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-a8a6c63a-8a36-4c36-896c-432231df0b79 req-5ea86668-2437-4374-a936-009697ef400f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13adc5ad-6616-41e2-9042-dea4fa2537b2", "tag": "64eb229b-5cc1-4e36-b739-35c8595675ab"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:37.227967 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d5487350-47bb-4ba3-a1fe-e0731f9e3fc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.800260 May 28 04:52:37.227967 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2323/4540] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:52:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:52:37.230744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a8a6c63a-8a36-4c36-896c-432231df0b79 req-5ea86668-2437-4374-a936-009697ef400f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:37.231221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a8a6c63a-8a36-4c36-896c-432231df0b79 req-5ea86668-2437-4374-a936-009697ef400f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:37.236187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d82a2b9d-5579-4ce3-ac20-7f30689bc860 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:37.236799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d82a2b9d-5579-4ce3-ac20-7f30689bc860 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:37.242820 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-a8a6c63a-8a36-4c36-896c-432231df0b79 req-5ea86668-2437-4374-a936-009697ef400f service nova] Creating event network-changed:64eb229b-5cc1-4e36-b739-35c8595675ab for instance 13adc5ad-6616-41e2-9042-dea4fa2537b2 on n-h2-843700-1 May 28 04:52:37.259577 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-a8a6c63a-8a36-4c36-896c-432231df0b79 req-5ea86668-2437-4374-a936-009697ef400f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029710 May 28 04:52:37.260242 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2218/4541] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:37.267724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-785ca48c-79f5-4538-a9cf-1402fc418b92 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:37.268452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-785ca48c-79f5-4538-a9cf-1402fc418b92 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:37.275433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-785ca48c-79f5-4538-a9cf-1402fc418b92 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:37.275787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-785ca48c-79f5-4538-a9cf-1402fc418b92 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:37.276566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-785ca48c-79f5-4538-a9cf-1402fc418b92 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:37.277219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-785ca48c-79f5-4538-a9cf-1402fc418b92 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:37.293852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d82a2b9d-5579-4ce3-ac20-7f30689bc860 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:37.301005 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d82a2b9d-5579-4ce3-ac20-7f30689bc860 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1217 microversion: 2.1 time: 0.068390 May 28 04:52:37.301431 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2324/4542] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:37 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:37.306345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-85ed32ef-60f5-4877-87e4-06db6ee9339b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:37.306962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-85ed32ef-60f5-4877-87e4-06db6ee9339b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:37.314438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-85ed32ef-60f5-4877-87e4-06db6ee9339b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:37.315282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-85ed32ef-60f5-4877-87e4-06db6ee9339b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:37.319629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-85ed32ef-60f5-4877-87e4-06db6ee9339b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:37.319629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-85ed32ef-60f5-4877-87e4-06db6ee9339b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:37.517278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-785ca48c-79f5-4538-a9cf-1402fc418b92 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780c97536c34c60a8deaf5b00e84cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3444a0099cc64616854d5172bf7ff6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:37.525210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-85ed32ef-60f5-4877-87e4-06db6ee9339b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:37.531412 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-785ca48c-79f5-4538-a9cf-1402fc418b92 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2" status: 200 len: 1316 microversion: 2.1 time: 0.269893 May 28 04:52:37.531944 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2219/4543] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:37 2022] GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2 => generated 1316 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:37.536347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c261dba3-2518-4b61-8920-f9017424623b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:37.536945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c261dba3-2518-4b61-8920-f9017424623b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 474caa3e-f826-4a32-82aa-4c5bf30e2c7d] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:37.537218 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-85ed32ef-60f5-4877-87e4-06db6ee9339b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 200 len: 1486 microversion: 2.1 time: 0.234369 May 28 04:52:37.537802 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2325/4544] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:37 2022] GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 1486 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:37.543539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c261dba3-2518-4b61-8920-f9017424623b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:37.543985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c261dba3-2518-4b61-8920-f9017424623b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:37.544749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c261dba3-2518-4b61-8920-f9017424623b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:37.545184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c261dba3-2518-4b61-8920-f9017424623b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:37.554260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2a0d1df4-9656-4a17-8a07-b4af25b8205e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:37.554836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2a0d1df4-9656-4a17-8a07-b4af25b8205e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:37.559138 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-c261dba3-2518-4b61-8920-f9017424623b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] HTTP exception thrown: Instance 474caa3e-f826-4a32-82aa-4c5bf30e2c7d could not be found. May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c261dba3-2518-4b61-8920-f9017424623b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Request method failure captured: May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/474caa3e-f826-4a32-82aa-4c5bf30e2c7d HTTP/1.1 May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikapbSnDNNHs38ebW4i9t3-OC16cz6AdfTkHrAewJC5t3NHdZzMLj50DFaUEVWp-gEANrrGxNwDvZRZMNDbtxS8sEEsIzEMpvjtG3YCBgUnrvxsm6LkauF-WNSqUG7Yt-ugsYSMj-taey5ohrrxatyNX5f6xBCsBtjxK3LLqsTZchQMg May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 9ac87488ec1b4944a056d28d154eede5 May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-MultipleCreateTestJSON-893185590 May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9ac87488ec1b4944a056d28d154eede5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9ac87488ec1b4944a056d28d154eede5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9ac87488ec1b4944a056d28d154eede5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9ac87488ec1b4944a056d28d154eede5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-MultipleCreateTestJSON-893185590 May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 9ac87488ec1b4944a056d28d154eede5 May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-MultipleCreateTestJSON-893185590 May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-MultipleCreateTestJSON-893185590-project May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 6c1ff365f86047dcb5ba2ad991a29e81 May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-MultipleCreateTestJSON-893185590-project May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 474caa3e-f826-4a32-82aa-4c5bf30e2c7d could not be found. May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '474caa3e-f826-4a32-82aa-4c5bf30e2c7d'} May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 474caa3e-f826-4a32-82aa-4c5bf30e2c7d could not be found. May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 474caa3e-f826-4a32-82aa-4c5bf30e2c7d could not be found. May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:37.560982 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:37.567824 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:37.567824 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:37.567824 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:37.567824 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:37.567824 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:37.567824 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 474caa3e-f826-4a32-82aa-4c5bf30e2c7d could not be found. May 28 04:52:37.567824 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:37.568864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2a0d1df4-9656-4a17-8a07-b4af25b8205e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:37.569066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c261dba3-2518-4b61-8920-f9017424623b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Returning 404 to user: Instance 474caa3e-f826-4a32-82aa-4c5bf30e2c7d could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:37.569225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2a0d1df4-9656-4a17-8a07-b4af25b8205e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:37.569369 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c261dba3-2518-4b61-8920-f9017424623b tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/474caa3e-f826-4a32-82aa-4c5bf30e2c7d" status: 404 len: 111 microversion: 2.1 time: 0.029518 May 28 04:52:37.569512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2a0d1df4-9656-4a17-8a07-b4af25b8205e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:37.569615 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2220/4545] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:37 2022] GET /compute/v2.1/servers/474caa3e-f826-4a32-82aa-4c5bf30e2c7d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:37.569724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2a0d1df4-9656-4a17-8a07-b4af25b8205e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:37.571309 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5c72d729-b85d-43bc-bf65-f07446895f22 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:37.571922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5c72d729-b85d-43bc-bf65-f07446895f22 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] [instance: 0015d5ed-bee0-4520-8a13-42d5f5abc857] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:37.577791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c72d729-b85d-43bc-bf65-f07446895f22 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:37.578243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c72d729-b85d-43bc-bf65-f07446895f22 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:37.579087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c72d729-b85d-43bc-bf65-f07446895f22 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:37.579525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c72d729-b85d-43bc-bf65-f07446895f22 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:37.589465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2a0d1df4-9656-4a17-8a07-b4af25b8205e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:52:37.592799 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-5c72d729-b85d-43bc-bf65-f07446895f22 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] HTTP exception thrown: Instance 0015d5ed-bee0-4520-8a13-42d5f5abc857 could not be found. May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5c72d729-b85d-43bc-bf65-f07446895f22 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Request method failure captured: May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857 HTTP/1.1 May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikapbSnDNNHs38ebW4i9t3-OC16cz6AdfTkHrAewJC5t3NHdZzMLj50DFaUEVWp-gEANrrGxNwDvZRZMNDbtxS8sEEsIzEMpvjtG3YCBgUnrvxsm6LkauF-WNSqUG7Yt-ugsYSMj-taey5ohrrxatyNX5f6xBCsBtjxK3LLqsTZchQMg May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 9ac87488ec1b4944a056d28d154eede5 May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-MultipleCreateTestJSON-893185590 May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9ac87488ec1b4944a056d28d154eede5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9ac87488ec1b4944a056d28d154eede5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9ac87488ec1b4944a056d28d154eede5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9ac87488ec1b4944a056d28d154eede5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-MultipleCreateTestJSON-893185590 May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 9ac87488ec1b4944a056d28d154eede5 May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-MultipleCreateTestJSON-893185590 May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-MultipleCreateTestJSON-893185590-project May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 6c1ff365f86047dcb5ba2ad991a29e81 May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-MultipleCreateTestJSON-893185590-project May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 0015d5ed-bee0-4520-8a13-42d5f5abc857 could not be found. May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '0015d5ed-bee0-4520-8a13-42d5f5abc857'} May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0015d5ed-bee0-4520-8a13-42d5f5abc857 could not be found. May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0015d5ed-bee0-4520-8a13-42d5f5abc857 could not be found. May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:37.594458 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:37.600326 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:37.600326 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:37.600326 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:37.600326 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:37.600326 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:37.600326 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0015d5ed-bee0-4520-8a13-42d5f5abc857 could not be found. May 28 04:52:37.600326 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:37.600326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5c72d729-b85d-43bc-bf65-f07446895f22 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] Returning 404 to user: Instance 0015d5ed-bee0-4520-8a13-42d5f5abc857 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:37.600326 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5c72d729-b85d-43bc-bf65-f07446895f22 tempest-MultipleCreateTestJSON-893185590 tempest-MultipleCreateTestJSON-893185590-project] 10.222.0.58 "GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857" status: 404 len: 111 microversion: 2.1 time: 0.028169 May 28 04:52:37.600326 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2221/4546] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:37 2022] GET /compute/v2.1/servers/0015d5ed-bee0-4520-8a13-42d5f5abc857 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:52:37.890450 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2a0d1df4-9656-4a17-8a07-b4af25b8205e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 204 len: 0 microversion: 2.1 time: 0.339720 May 28 04:52:37.892178 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2326/4547] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:52:37 2022] DELETE /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 04:52:37.906077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a07e52b7-26ea-4fe7-a589-ba9e8da34c5b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:37.907463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a07e52b7-26ea-4fe7-a589-ba9e8da34c5b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:37.917610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a07e52b7-26ea-4fe7-a589-ba9e8da34c5b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:37.918074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a07e52b7-26ea-4fe7-a589-ba9e8da34c5b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:37.919965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a07e52b7-26ea-4fe7-a589-ba9e8da34c5b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:37.920414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a07e52b7-26ea-4fe7-a589-ba9e8da34c5b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:37.924050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:38.083116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef6ecd70-6056-4b00-9de2-558a1af43ff0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:38.084073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ef6ecd70-6056-4b00-9de2-558a1af43ff0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:38.091374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef6ecd70-6056-4b00-9de2-558a1af43ff0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:38.092078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef6ecd70-6056-4b00-9de2-558a1af43ff0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:38.093048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef6ecd70-6056-4b00-9de2-558a1af43ff0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:38.093650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef6ecd70-6056-4b00-9de2-558a1af43ff0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:38.226056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a07e52b7-26ea-4fe7-a589-ba9e8da34c5b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:38.236836 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a07e52b7-26ea-4fe7-a589-ba9e8da34c5b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 200 len: 1492 microversion: 2.1 time: 0.335605 May 28 04:52:38.237669 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2222/4548] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:37 2022] GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 1492 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:38.242410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5370d59b-9319-43b5-972e-d08007176a0e tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:38.243045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5370d59b-9319-43b5-972e-d08007176a0e tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:38.252465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5370d59b-9319-43b5-972e-d08007176a0e tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:38.252917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5370d59b-9319-43b5-972e-d08007176a0e tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:38.253806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5370d59b-9319-43b5-972e-d08007176a0e tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:38.254246 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5370d59b-9319-43b5-972e-d08007176a0e tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:38.440332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef6ecd70-6056-4b00-9de2-558a1af43ff0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:38.449230 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ef6ecd70-6056-4b00-9de2-558a1af43ff0 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1509 microversion: 2.1 time: 0.370645 May 28 04:52:38.461132 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2327/4549] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:38 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1509 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:38.471333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d434f740-43c8-4fbf-a68d-7244086ead82 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:38.472321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d434f740-43c8-4fbf-a68d-7244086ead82 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:38.533620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5370d59b-9319-43b5-972e-d08007176a0e tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:38.541902 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5370d59b-9319-43b5-972e-d08007176a0e tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.303038 May 28 04:52:38.551573 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2223/4550] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:38 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:38.556814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8eb4c4e4-f9ad-4e2f-8b93-08a31dacc530 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:38.557437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8eb4c4e4-f9ad-4e2f-8b93-08a31dacc530 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:38.564295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8eb4c4e4-f9ad-4e2f-8b93-08a31dacc530 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:38.564748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8eb4c4e4-f9ad-4e2f-8b93-08a31dacc530 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:38.566876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8eb4c4e4-f9ad-4e2f-8b93-08a31dacc530 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:38.566876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8eb4c4e4-f9ad-4e2f-8b93-08a31dacc530 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:38.569079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d434f740-43c8-4fbf-a68d-7244086ead82 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:38.575828 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d434f740-43c8-4fbf-a68d-7244086ead82 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1217 microversion: 2.1 time: 0.113394 May 28 04:52:38.576408 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2328/4551] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:38 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1217 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:38.722647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8eb4c4e4-f9ad-4e2f-8b93-08a31dacc530 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780c97536c34c60a8deaf5b00e84cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3444a0099cc64616854d5172bf7ff6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:38.730164 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8eb4c4e4-f9ad-4e2f-8b93-08a31dacc530 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2" status: 200 len: 1316 microversion: 2.1 time: 0.177282 May 28 04:52:38.730738 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2224/4552] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:38 2022] GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2 => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:39.113810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3de8b9a8-830c-4545-b952-fbd905582ffe tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:39.114221 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3de8b9a8-830c-4545-b952-fbd905582ffe tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:39.122084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3de8b9a8-830c-4545-b952-fbd905582ffe tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:39.123265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3de8b9a8-830c-4545-b952-fbd905582ffe tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:39.124263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3de8b9a8-830c-4545-b952-fbd905582ffe tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:39.124906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3de8b9a8-830c-4545-b952-fbd905582ffe tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:39.212872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-3de8b9a8-830c-4545-b952-fbd905582ffe tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lazy-loading 'services' on Instance uuid 50d15725-d599-410b-8d4d-d4460a1d96b6 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:52:39.255381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-20ce7395-727c-46c7-97f7-04f9de90cffd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:39.258176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-20ce7395-727c-46c7-97f7-04f9de90cffd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:39.267659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20ce7395-727c-46c7-97f7-04f9de90cffd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:39.268686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20ce7395-727c-46c7-97f7-04f9de90cffd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:39.269747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20ce7395-727c-46c7-97f7-04f9de90cffd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:39.270245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20ce7395-727c-46c7-97f7-04f9de90cffd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:39.469791 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3de8b9a8-830c-4545-b952-fbd905582ffe tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "DELETE /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments/23779e36-bf77-4c46-b62c-9ad03a9f5e7f" status: 202 len: 0 microversion: 2.1 time: 0.359138 May 28 04:52:39.474181 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2329/4553] 10.222.0.58 () {58 vars in 1415 bytes} [Sat May 28 04:52:39 2022] DELETE /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments/23779e36-bf77-4c46-b62c-9ad03a9f5e7f => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:52:39.495252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-74f6a95a-f55e-47b2-b9ef-6038ba66efe1 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:39.498782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-74f6a95a-f55e-47b2-b9ef-6038ba66efe1 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:39.516928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74f6a95a-f55e-47b2-b9ef-6038ba66efe1 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:39.520921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74f6a95a-f55e-47b2-b9ef-6038ba66efe1 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:39.527569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74f6a95a-f55e-47b2-b9ef-6038ba66efe1 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:39.527569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74f6a95a-f55e-47b2-b9ef-6038ba66efe1 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:39.896462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-74f6a95a-f55e-47b2-b9ef-6038ba66efe1 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:39.906277 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-74f6a95a-f55e-47b2-b9ef-6038ba66efe1 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1509 microversion: 2.1 time: 0.433803 May 28 04:52:39.918675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-20ce7395-727c-46c7-97f7-04f9de90cffd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:39.919168 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2330/4554] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:39 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1509 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:39.924503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d4c28408-c2ce-4c98-b37d-fba15519adbf tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:39.925751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d4c28408-c2ce-4c98-b37d-fba15519adbf tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:39.929404 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-20ce7395-727c-46c7-97f7-04f9de90cffd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 200 len: 1492 microversion: 2.1 time: 0.679303 May 28 04:52:39.930640 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2225/4555] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:39 2022] GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 1492 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:39.937051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-47ff849b-e59f-4886-810f-992172457385 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:39.938120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-47ff849b-e59f-4886-810f-992172457385 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:39.942592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d4c28408-c2ce-4c98-b37d-fba15519adbf tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:39.943089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d4c28408-c2ce-4c98-b37d-fba15519adbf tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:39.943879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d4c28408-c2ce-4c98-b37d-fba15519adbf tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:39.944327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d4c28408-c2ce-4c98-b37d-fba15519adbf tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:39.946800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47ff849b-e59f-4886-810f-992172457385 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:39.947290 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47ff849b-e59f-4886-810f-992172457385 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:39.948067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47ff849b-e59f-4886-810f-992172457385 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:39.948511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47ff849b-e59f-4886-810f-992172457385 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:39.979812 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d4c28408-c2ce-4c98-b37d-fba15519adbf tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058994 May 28 04:52:39.981272 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2331/4556] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:52:39 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:39.988558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e30c7caf-85cf-4f8b-8e71-7f99235c2a7e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:39.989421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e30c7caf-85cf-4f8b-8e71-7f99235c2a7e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:39.996514 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e30c7caf-85cf-4f8b-8e71-7f99235c2a7e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:39.997052 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e30c7caf-85cf-4f8b-8e71-7f99235c2a7e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:39.998010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e30c7caf-85cf-4f8b-8e71-7f99235c2a7e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:39.998626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e30c7caf-85cf-4f8b-8e71-7f99235c2a7e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:40.086111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e30c7caf-85cf-4f8b-8e71-7f99235c2a7e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:40.094140 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e30c7caf-85cf-4f8b-8e71-7f99235c2a7e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1269 microversion: 2.1 time: 0.111639 May 28 04:52:40.099048 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2332/4557] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:39 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1269 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:40.118235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e6aae107-416d-4442-883f-70f935cacfb7 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:40.118892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e6aae107-416d-4442-883f-70f935cacfb7 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:40.131542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e6aae107-416d-4442-883f-70f935cacfb7 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:40.138168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e6aae107-416d-4442-883f-70f935cacfb7 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:40.138168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e6aae107-416d-4442-883f-70f935cacfb7 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:40.138168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e6aae107-416d-4442-883f-70f935cacfb7 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:40.243984 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-47ff849b-e59f-4886-810f-992172457385 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:40.252451 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-47ff849b-e59f-4886-810f-992172457385 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.320666 May 28 04:52:40.264710 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2226/4558] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:39 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:40.474563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e6aae107-416d-4442-883f-70f935cacfb7 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780c97536c34c60a8deaf5b00e84cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3444a0099cc64616854d5172bf7ff6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:40.494973 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e6aae107-416d-4442-883f-70f935cacfb7 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2" status: 200 len: 1316 microversion: 2.1 time: 0.398042 May 28 04:52:40.495821 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2333/4559] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:40 2022] GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2 => generated 1316 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:40.518222 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-5afae961-1fb6-4400-b677-7f6aa4e62a9a req-d7e063e3-5e26-4bfa-a53e-051b1874b35b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6dd1de3-8a85-42b0-8ac8-49b66c6768d5", "name": "network-vif-deleted", "tag": "db0b3c18-c41f-4153-82f7-d7bb4195f4fc"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:40.531069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5afae961-1fb6-4400-b677-7f6aa4e62a9a req-d7e063e3-5e26-4bfa-a53e-051b1874b35b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:40.532372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5afae961-1fb6-4400-b677-7f6aa4e62a9a req-d7e063e3-5e26-4bfa-a53e-051b1874b35b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:40.558880 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-5afae961-1fb6-4400-b677-7f6aa4e62a9a req-d7e063e3-5e26-4bfa-a53e-051b1874b35b service nova] Creating event network-vif-deleted:db0b3c18-c41f-4153-82f7-d7bb4195f4fc for instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 on n-h1-843700-1 May 28 04:52:40.564040 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-5afae961-1fb6-4400-b677-7f6aa4e62a9a req-d7e063e3-5e26-4bfa-a53e-051b1874b35b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052856 May 28 04:52:40.565172 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2227/4560] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:40.925828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-52ac2bb8-ca56-4c5f-a75e-7dbd03abb0dd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:40.926536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-52ac2bb8-ca56-4c5f-a75e-7dbd03abb0dd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:40.938405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52ac2bb8-ca56-4c5f-a75e-7dbd03abb0dd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:40.939259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52ac2bb8-ca56-4c5f-a75e-7dbd03abb0dd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:40.943015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52ac2bb8-ca56-4c5f-a75e-7dbd03abb0dd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:40.946971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52ac2bb8-ca56-4c5f-a75e-7dbd03abb0dd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:41.013041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-19af4071-ad2d-450f-94dd-186a39c1e336 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1374229277", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": "none"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:41.089304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-19af4071-ad2d-450f-94dd-186a39c1e336 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:52:41.093480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-19af4071-ad2d-450f-94dd-186a39c1e336 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:52:41.093480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-19af4071-ad2d-450f-94dd-186a39c1e336 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:52:41.093480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-19af4071-ad2d-450f-94dd-186a39c1e336 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:52:41.093480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-19af4071-ad2d-450f-94dd-186a39c1e336 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:52:41.093878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:41.103106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19af4071-ad2d-450f-94dd-186a39c1e336 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:41.103830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19af4071-ad2d-450f-94dd-186a39c1e336 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:41.106501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19af4071-ad2d-450f-94dd-186a39c1e336 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:41.107083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19af4071-ad2d-450f-94dd-186a39c1e336 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:41.143196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-19af4071-ad2d-450f-94dd-186a39c1e336 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Getting quotas for project f6a24f1e82224880aaf44542f3da8e56. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:52:41.159678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-19af4071-ad2d-450f-94dd-186a39c1e336 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Getting quotas for user f8545357f8554939beb1e15759303ca8 and project f6a24f1e82224880aaf44542f3da8e56. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:52:41.187797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-19af4071-ad2d-450f-94dd-186a39c1e336 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:52:41.192737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-19af4071-ad2d-450f-94dd-186a39c1e336 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] [instance: e3b50a4d-2542-4c6a-9568-4eb7c84c75d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:52:41.223553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-52ac2bb8-ca56-4c5f-a75e-7dbd03abb0dd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:41.233466 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-52ac2bb8-ca56-4c5f-a75e-7dbd03abb0dd tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1509 microversion: 2.1 time: 0.311860 May 28 04:52:41.240605 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2228/4561] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:40 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1509 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:41.247216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-63bdb7d4-3feb-4505-bf99-365ad4123771 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:41.247979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-63bdb7d4-3feb-4505-bf99-365ad4123771 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:41.255728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:41.257523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63bdb7d4-3feb-4505-bf99-365ad4123771 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:41.258471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63bdb7d4-3feb-4505-bf99-365ad4123771 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:41.259158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63bdb7d4-3feb-4505-bf99-365ad4123771 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:41.260236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63bdb7d4-3feb-4505-bf99-365ad4123771 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:41.300313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63bdb7d4-3feb-4505-bf99-365ad4123771 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:41.301528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63bdb7d4-3feb-4505-bf99-365ad4123771 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:41.302190 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-63bdb7d4-3feb-4505-bf99-365ad4123771 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lazy-loading 'fault' on Instance uuid e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:52:41.315186 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-19af4071-ad2d-450f-94dd-186a39c1e336 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.513413 May 28 04:52:41.317321 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2334/4562] 10.222.0.58 () {62 vars in 1187 bytes} [Sat May 28 04:52:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 04:52:41.325192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-19980a6a-fe47-43b7-a442-f71a5687e1ef tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:41.326550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-19980a6a-fe47-43b7-a442-f71a5687e1ef tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:41.335596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19980a6a-fe47-43b7-a442-f71a5687e1ef tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:41.336304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19980a6a-fe47-43b7-a442-f71a5687e1ef tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:41.337261 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19980a6a-fe47-43b7-a442-f71a5687e1ef tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:41.337871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19980a6a-fe47-43b7-a442-f71a5687e1ef tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:41.356486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-63bdb7d4-3feb-4505-bf99-365ad4123771 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:41.366460 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-63bdb7d4-3feb-4505-bf99-365ad4123771 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 200 len: 1304 microversion: 2.1 time: 0.123835 May 28 04:52:41.379408 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2229/4563] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:41 2022] GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 1304 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:41.390350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-998c6d98-07f1-4258-8185-2adf3d9dc4d7 req-587fba6a-2b59-46b6-8616-3ca612e42022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13adc5ad-6616-41e2-9042-dea4fa2537b2", "name": "network-vif-plugged", "status": "completed", "tag": "64eb229b-5cc1-4e36-b739-35c8595675ab"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:41.398202 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-19980a6a-fe47-43b7-a442-f71a5687e1ef tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079622 May 28 04:52:41.399975 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2335/4564] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:52:41 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:41.406428 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e9ac9db1-0b67-4b5b-97ad-22526be2a00c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:41.407414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e9ac9db1-0b67-4b5b-97ad-22526be2a00c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:41.411632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-998c6d98-07f1-4258-8185-2adf3d9dc4d7 req-587fba6a-2b59-46b6-8616-3ca612e42022 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:41.412095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-998c6d98-07f1-4258-8185-2adf3d9dc4d7 req-587fba6a-2b59-46b6-8616-3ca612e42022 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:41.414706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9ac9db1-0b67-4b5b-97ad-22526be2a00c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:41.415500 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9ac9db1-0b67-4b5b-97ad-22526be2a00c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:41.416687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9ac9db1-0b67-4b5b-97ad-22526be2a00c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:41.417359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9ac9db1-0b67-4b5b-97ad-22526be2a00c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:41.439137 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-998c6d98-07f1-4258-8185-2adf3d9dc4d7 req-587fba6a-2b59-46b6-8616-3ca612e42022 service nova] Creating event network-vif-plugged:64eb229b-5cc1-4e36-b739-35c8595675ab for instance 13adc5ad-6616-41e2-9042-dea4fa2537b2 on n-h2-843700-1 May 28 04:52:41.451113 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-998c6d98-07f1-4258-8185-2adf3d9dc4d7 req-587fba6a-2b59-46b6-8616-3ca612e42022 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070282 May 28 04:52:41.453991 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2230/4565] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:41.470499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4d153506-9f24-4d69-a778-48a34690e2f0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:41.471429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4d153506-9f24-4d69-a778-48a34690e2f0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:41.487227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d153506-9f24-4d69-a778-48a34690e2f0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:41.489723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d153506-9f24-4d69-a778-48a34690e2f0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:41.489723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d153506-9f24-4d69-a778-48a34690e2f0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:41.489723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d153506-9f24-4d69-a778-48a34690e2f0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:41.775977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e9ac9db1-0b67-4b5b-97ad-22526be2a00c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:41.780856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:41.786597 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e9ac9db1-0b67-4b5b-97ad-22526be2a00c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1317 microversion: 2.1 time: 0.385322 May 28 04:52:41.787553 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2336/4566] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:41 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:41.793178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1f3da4fd-671e-48e7-b11f-38bdd0eec09e tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:41.793971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1f3da4fd-671e-48e7-b11f-38bdd0eec09e tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] [instance: e3b50a4d-2542-4c6a-9568-4eb7c84c75d4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:41.808073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4d153506-9f24-4d69-a778-48a34690e2f0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:41.815805 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4d153506-9f24-4d69-a778-48a34690e2f0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.360526 May 28 04:52:41.816916 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2231/4567] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:41 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:41.823185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-396eb102-b835-4791-bfa8-253279c88e85 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:41.831564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-396eb102-b835-4791-bfa8-253279c88e85 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:41.838022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-396eb102-b835-4791-bfa8-253279c88e85 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:41.839377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-396eb102-b835-4791-bfa8-253279c88e85 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:41.840407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-396eb102-b835-4791-bfa8-253279c88e85 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:41.841018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-396eb102-b835-4791-bfa8-253279c88e85 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:41.867396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1f3da4fd-671e-48e7-b11f-38bdd0eec09e tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:41.876600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1f3da4fd-671e-48e7-b11f-38bdd0eec09e tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:41.880579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1f3da4fd-671e-48e7-b11f-38bdd0eec09e tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:41.881750 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1f3da4fd-671e-48e7-b11f-38bdd0eec09e tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4" status: 200 len: 1281 microversion: 2.47 time: 0.092917 May 28 04:52:41.883322 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2337/4568] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:52:41 2022] GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4 => generated 1281 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:52:42.053238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-396eb102-b835-4791-bfa8-253279c88e85 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780c97536c34c60a8deaf5b00e84cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3444a0099cc64616854d5172bf7ff6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:42.062370 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-396eb102-b835-4791-bfa8-253279c88e85 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2" status: 200 len: 1316 microversion: 2.1 time: 0.242712 May 28 04:52:42.072245 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2232/4569] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:41 2022] GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2 => generated 1316 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:42.252368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-264a811e-19cd-4792-b58e-2a757b6ba58f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:42.253371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-264a811e-19cd-4792-b58e-2a757b6ba58f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:42.263116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-264a811e-19cd-4792-b58e-2a757b6ba58f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:42.263959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-264a811e-19cd-4792-b58e-2a757b6ba58f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:42.264958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-264a811e-19cd-4792-b58e-2a757b6ba58f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:42.265610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-264a811e-19cd-4792-b58e-2a757b6ba58f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:42.393067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aa7fa615-859a-4671-b86f-cad526b926f7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:42.394430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-aa7fa615-859a-4671-b86f-cad526b926f7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:42.401936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa7fa615-859a-4671-b86f-cad526b926f7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:42.402859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa7fa615-859a-4671-b86f-cad526b926f7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:42.404000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa7fa615-859a-4671-b86f-cad526b926f7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:42.405035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa7fa615-859a-4671-b86f-cad526b926f7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:42.424962 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-aa7fa615-859a-4671-b86f-cad526b926f7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 could not be found. May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aa7fa615-859a-4671-b86f-cad526b926f7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 HTTP/1.1 May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 could not be found. May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'e6dd1de3-8a85-42b0-8ac8-49b66c6768d5'} May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 could not be found. May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 could not be found. May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:42.428133 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:42.433560 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:42.433560 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:42.433560 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:42.433560 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:42.433560 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:42.433560 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 could not be found. May 28 04:52:42.433560 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:42.435152 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aa7fa615-859a-4671-b86f-cad526b926f7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:42.436454 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aa7fa615-859a-4671-b86f-cad526b926f7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 404 len: 111 microversion: 2.1 time: 0.048258 May 28 04:52:42.437043 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2233/4570] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:42 2022] GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:42.461535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-786278bc-f9d7-420a-83cb-d53e3286a40a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:42.463165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-786278bc-f9d7-420a-83cb-d53e3286a40a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:42.464703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-264a811e-19cd-4792-b58e-2a757b6ba58f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:42.472316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-786278bc-f9d7-420a-83cb-d53e3286a40a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:42.473251 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-786278bc-f9d7-420a-83cb-d53e3286a40a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:42.473396 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-264a811e-19cd-4792-b58e-2a757b6ba58f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1509 microversion: 2.1 time: 0.225727 May 28 04:52:42.473905 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2338/4571] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:42 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1509 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:42.475176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-786278bc-f9d7-420a-83cb-d53e3286a40a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:42.475854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-786278bc-f9d7-420a-83cb-d53e3286a40a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:42.523551 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-786278bc-f9d7-420a-83cb-d53e3286a40a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085176 May 28 04:52:42.527761 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2234/4572] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:52:42 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:42.579141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-10037cfb-eff5-4e53-a0de-9151633fe2c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-550072305", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "807b877d-73e2-4031-b4ab-972d86c6cc59"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:42.633792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-10037cfb-eff5-4e53-a0de-9151633fe2c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] validate_networks() for [('807b877d-73e2-4031-b4ab-972d86c6cc59', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:52:42.807776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-50b9748c-52ab-4a3e-9db4-c0378ed06eef tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:42.808404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-50b9748c-52ab-4a3e-9db4-c0378ed06eef tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:42.820571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50b9748c-52ab-4a3e-9db4-c0378ed06eef tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:42.820571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50b9748c-52ab-4a3e-9db4-c0378ed06eef tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:42.820859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50b9748c-52ab-4a3e-9db4-c0378ed06eef tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:42.821615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50b9748c-52ab-4a3e-9db4-c0378ed06eef tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:43.114274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-50b9748c-52ab-4a3e-9db4-c0378ed06eef tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:43.125100 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-50b9748c-52ab-4a3e-9db4-c0378ed06eef tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1317 microversion: 2.1 time: 0.321373 May 28 04:52:43.130744 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2235/4573] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:42 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:43.143147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7fcc34fd-49b8-4b9a-9928-002db9dde421 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:43.145164 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7fcc34fd-49b8-4b9a-9928-002db9dde421 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:43.155387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7fcc34fd-49b8-4b9a-9928-002db9dde421 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:43.161137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7fcc34fd-49b8-4b9a-9928-002db9dde421 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:43.161137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7fcc34fd-49b8-4b9a-9928-002db9dde421 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:43.161137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7fcc34fd-49b8-4b9a-9928-002db9dde421 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:43.711877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-10037cfb-eff5-4e53-a0de-9151633fe2c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:52:43.720841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-10037cfb-eff5-4e53-a0de-9151633fe2c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:52:43.721360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-10037cfb-eff5-4e53-a0de-9151633fe2c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:52:43.721793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-10037cfb-eff5-4e53-a0de-9151633fe2c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:52:43.722208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-10037cfb-eff5-4e53-a0de-9151633fe2c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:52:43.735771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-10037cfb-eff5-4e53-a0de-9151633fe2c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:43.736464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-10037cfb-eff5-4e53-a0de-9151633fe2c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:43.737285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-10037cfb-eff5-4e53-a0de-9151633fe2c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:43.738283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-10037cfb-eff5-4e53-a0de-9151633fe2c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:43.759528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-10037cfb-eff5-4e53-a0de-9151633fe2c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Getting quotas for project dd598ce55f9b43d38530dae05fa1bda1. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:52:43.765538 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-10037cfb-eff5-4e53-a0de-9151633fe2c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Getting quotas for user b05e9b7e95074a91bc984338593c6c84 and project dd598ce55f9b43d38530dae05fa1bda1. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:52:43.781874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-10037cfb-eff5-4e53-a0de-9151633fe2c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:52:43.784643 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-10037cfb-eff5-4e53-a0de-9151633fe2c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:52:43.793653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7fcc34fd-49b8-4b9a-9928-002db9dde421 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:43.807925 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7fcc34fd-49b8-4b9a-9928-002db9dde421 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.673897 May 28 04:52:43.808929 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2236/4574] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:43 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:43.821773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1bc90624-3165-4f2a-9e0c-c26a8cc13c49 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:43.823793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1bc90624-3165-4f2a-9e0c-c26a8cc13c49 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] [instance: e3b50a4d-2542-4c6a-9568-4eb7c84c75d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:43.838150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1bc90624-3165-4f2a-9e0c-c26a8cc13c49 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:43.838898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1bc90624-3165-4f2a-9e0c-c26a8cc13c49 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:43.840494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1bc90624-3165-4f2a-9e0c-c26a8cc13c49 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:43.841108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1bc90624-3165-4f2a-9e0c-c26a8cc13c49 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:43.925872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1bc90624-3165-4f2a-9e0c-c26a8cc13c49 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:43.934420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1bc90624-3165-4f2a-9e0c-c26a8cc13c49 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:43.935879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1bc90624-3165-4f2a-9e0c-c26a8cc13c49 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:43.937011 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1bc90624-3165-4f2a-9e0c-c26a8cc13c49 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4" status: 200 len: 1333 microversion: 2.47 time: 0.126428 May 28 04:52:43.938097 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2237/4575] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:52:43 2022] GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4 => generated 1333 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:52:43.951514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8d1304e1-a293-4c17-afe5-994112b134de tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:43.952133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8d1304e1-a293-4c17-afe5-994112b134de tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:43.970763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d1304e1-a293-4c17-afe5-994112b134de tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:43.971272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d1304e1-a293-4c17-afe5-994112b134de tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:43.972111 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d1304e1-a293-4c17-afe5-994112b134de tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:43.972564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8d1304e1-a293-4c17-afe5-994112b134de tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:44.051605 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-10037cfb-eff5-4e53-a0de-9151633fe2c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.476810 May 28 04:52:44.056292 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2339/4576] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:52:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:52:44.066656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-11d14b2d-295b-45c0-9c9a-6415a3fa4271 req-c7171040-aa19-4423-864e-764219cb2973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58022ec6-f4eb-4564-bed0-c3edd1d0daf4", "tag": "d2dc44c4-b245-41ae-bb82-8a262f7181c5"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:44.109380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-11d14b2d-295b-45c0-9c9a-6415a3fa4271 req-c7171040-aa19-4423-864e-764219cb2973 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:44.110743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-11d14b2d-295b-45c0-9c9a-6415a3fa4271 req-c7171040-aa19-4423-864e-764219cb2973 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:44.134123 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-11d14b2d-295b-45c0-9c9a-6415a3fa4271 req-c7171040-aa19-4423-864e-764219cb2973 service nova] Creating event network-changed:d2dc44c4-b245-41ae-bb82-8a262f7181c5 for instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 on n-h1-843700-1 May 28 04:52:44.147078 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-11d14b2d-295b-45c0-9c9a-6415a3fa4271 req-c7171040-aa19-4423-864e-764219cb2973 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089018 May 28 04:52:44.150944 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2340/4577] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:44.188940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3b24ce46-a603-4790-a117-248ab0accf88 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:44.191606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3b24ce46-a603-4790-a117-248ab0accf88 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:44.214482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b24ce46-a603-4790-a117-248ab0accf88 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:44.215072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b24ce46-a603-4790-a117-248ab0accf88 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:44.215974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b24ce46-a603-4790-a117-248ab0accf88 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:44.218618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b24ce46-a603-4790-a117-248ab0accf88 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:44.232266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8d1304e1-a293-4c17-afe5-994112b134de tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780c97536c34c60a8deaf5b00e84cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3444a0099cc64616854d5172bf7ff6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:44.248924 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8d1304e1-a293-4c17-afe5-994112b134de tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2" status: 200 len: 1504 microversion: 2.1 time: 0.308452 May 28 04:52:44.252837 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2238/4578] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:43 2022] GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2 => generated 1504 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:44.266462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d08ff98b-52b7-472c-aaca-ad7e383f463a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:44.269236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d08ff98b-52b7-472c-aaca-ad7e383f463a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:44.288472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d08ff98b-52b7-472c-aaca-ad7e383f463a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:44.289273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d08ff98b-52b7-472c-aaca-ad7e383f463a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:44.290338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d08ff98b-52b7-472c-aaca-ad7e383f463a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:44.291320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d08ff98b-52b7-472c-aaca-ad7e383f463a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:44.332892 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d08ff98b-52b7-472c-aaca-ad7e383f463a tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078575 May 28 04:52:44.334363 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2239/4579] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:52:44 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:44.344470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-57a2b4e8-2b56-49c8-9fd5-f00ee3d1a203 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:44.345198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-57a2b4e8-2b56-49c8-9fd5-f00ee3d1a203 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:44.415676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-57a2b4e8-2b56-49c8-9fd5-f00ee3d1a203 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:44.423104 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-57a2b4e8-2b56-49c8-9fd5-f00ee3d1a203 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1214 microversion: 2.1 time: 0.084433 May 28 04:52:44.432392 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2240/4580] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:44 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:44.432392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0a5ca0bc-88f7-4a45-ae51-3c95ab31d1e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:44.432392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0a5ca0bc-88f7-4a45-ae51-3c95ab31d1e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:44.436013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a5ca0bc-88f7-4a45-ae51-3c95ab31d1e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:44.436563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a5ca0bc-88f7-4a45-ae51-3c95ab31d1e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:44.437567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a5ca0bc-88f7-4a45-ae51-3c95ab31d1e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:44.438095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a5ca0bc-88f7-4a45-ae51-3c95ab31d1e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:44.471501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:44.484163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3b24ce46-a603-4790-a117-248ab0accf88 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:44.492467 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3b24ce46-a603-4790-a117-248ab0accf88 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1509 microversion: 2.1 time: 0.334270 May 28 04:52:44.493238 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2341/4581] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:44 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1509 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:44.497592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c976e2f2-b2e9-4d9f-92fc-feb1db0f77a5 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:44.498086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c976e2f2-b2e9-4d9f-92fc-feb1db0f77a5 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:44.504666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c976e2f2-b2e9-4d9f-92fc-feb1db0f77a5 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:44.505135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c976e2f2-b2e9-4d9f-92fc-feb1db0f77a5 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:44.505892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c976e2f2-b2e9-4d9f-92fc-feb1db0f77a5 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:44.506332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c976e2f2-b2e9-4d9f-92fc-feb1db0f77a5 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:44.614158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0a5ca0bc-88f7-4a45-ae51-3c95ab31d1e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:44.624475 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0a5ca0bc-88f7-4a45-ae51-3c95ab31d1e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1317 microversion: 2.1 time: 0.199147 May 28 04:52:44.628804 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2241/4582] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:44 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:44.680010 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c976e2f2-b2e9-4d9f-92fc-feb1db0f77a5 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "DELETE /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.185834 May 28 04:52:44.680752 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2342/4583] 10.222.0.58 () {58 vars in 1295 bytes} [Sat May 28 04:52:44 2022] DELETE /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2/os-server-password => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:52:44.690450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-77b905e4-ea40-4902-98f4-252c3ea04d40 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:44.690961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-77b905e4-ea40-4902-98f4-252c3ea04d40 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:44.697449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77b905e4-ea40-4902-98f4-252c3ea04d40 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:44.697958 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77b905e4-ea40-4902-98f4-252c3ea04d40 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:44.698687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77b905e4-ea40-4902-98f4-252c3ea04d40 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:44.699162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77b905e4-ea40-4902-98f4-252c3ea04d40 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:44.722934 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-77b905e4-ea40-4902-98f4-252c3ea04d40 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.036951 May 28 04:52:44.723634 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2242/4584] 10.222.0.58 () {58 vars in 1292 bytes} [Sat May 28 04:52:44 2022] GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2/os-server-password => generated 16 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:52:44.739965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a8ce49e1-df55-4115-b16d-407ebe4669b0 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:44.741147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a8ce49e1-df55-4115-b16d-407ebe4669b0 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:44.747431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a8ce49e1-df55-4115-b16d-407ebe4669b0 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:44.747972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a8ce49e1-df55-4115-b16d-407ebe4669b0 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:44.748807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a8ce49e1-df55-4115-b16d-407ebe4669b0 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:44.749316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a8ce49e1-df55-4115-b16d-407ebe4669b0 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:44.778873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a8ce49e1-df55-4115-b16d-407ebe4669b0 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:52:44.826427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-80e6aeb9-ce66-423b-9def-50331a4e55ff tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:44.827212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-80e6aeb9-ce66-423b-9def-50331a4e55ff tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:44.834449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80e6aeb9-ce66-423b-9def-50331a4e55ff tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:44.835138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80e6aeb9-ce66-423b-9def-50331a4e55ff tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:44.835992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80e6aeb9-ce66-423b-9def-50331a4e55ff tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:44.836510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80e6aeb9-ce66-423b-9def-50331a4e55ff tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:44.973527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-80e6aeb9-ce66-423b-9def-50331a4e55ff tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:44.981326 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-80e6aeb9-ce66-423b-9def-50331a4e55ff tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.159674 May 28 04:52:44.982169 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2243/4585] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:44 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:44.987168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1cc9f5bf-2cc4-4955-a0a8-0d15d6913358 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:44.988001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1cc9f5bf-2cc4-4955-a0a8-0d15d6913358 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] [instance: e3b50a4d-2542-4c6a-9568-4eb7c84c75d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:44.997283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cc9f5bf-2cc4-4955-a0a8-0d15d6913358 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:44.997747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cc9f5bf-2cc4-4955-a0a8-0d15d6913358 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:45.003863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cc9f5bf-2cc4-4955-a0a8-0d15d6913358 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:45.003863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cc9f5bf-2cc4-4955-a0a8-0d15d6913358 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:45.077996 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1cc9f5bf-2cc4-4955-a0a8-0d15d6913358 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:45.086587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1cc9f5bf-2cc4-4955-a0a8-0d15d6913358 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:45.088194 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1cc9f5bf-2cc4-4955-a0a8-0d15d6913358 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:45.089393 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1cc9f5bf-2cc4-4955-a0a8-0d15d6913358 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4" status: 200 len: 1339 microversion: 2.47 time: 0.106396 May 28 04:52:45.095508 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2244/4586] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:52:44 2022] GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4 => generated 1339 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:52:45.163442 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a8ce49e1-df55-4115-b16d-407ebe4669b0 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "DELETE /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2" status: 204 len: 0 microversion: 2.1 time: 0.426905 May 28 04:52:45.167888 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2343/4587] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:52:44 2022] DELETE /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:52:45.173808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c2bcc6f6-b4e0-4502-ae21-23f6b136124f tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:45.174592 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c2bcc6f6-b4e0-4502-ae21-23f6b136124f tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:45.180903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c2bcc6f6-b4e0-4502-ae21-23f6b136124f tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:45.181366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c2bcc6f6-b4e0-4502-ae21-23f6b136124f tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:45.182215 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c2bcc6f6-b4e0-4502-ae21-23f6b136124f tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:45.182664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c2bcc6f6-b4e0-4502-ae21-23f6b136124f tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:45.325217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c2bcc6f6-b4e0-4502-ae21-23f6b136124f tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780c97536c34c60a8deaf5b00e84cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3444a0099cc64616854d5172bf7ff6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:45.333038 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c2bcc6f6-b4e0-4502-ae21-23f6b136124f tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2" status: 200 len: 1510 microversion: 2.1 time: 0.164080 May 28 04:52:45.333618 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2245/4588] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:45 2022] GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:45.346258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-683c8660-6787-4d0f-82cd-2680b36a9e66 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:45.347307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-683c8660-6787-4d0f-82cd-2680b36a9e66 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:45.354249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-683c8660-6787-4d0f-82cd-2680b36a9e66 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:45.354704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-683c8660-6787-4d0f-82cd-2680b36a9e66 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:45.355503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-683c8660-6787-4d0f-82cd-2680b36a9e66 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:45.355952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-683c8660-6787-4d0f-82cd-2680b36a9e66 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:45.387287 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-683c8660-6787-4d0f-82cd-2680b36a9e66 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046056 May 28 04:52:45.388066 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2344/4589] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:52:45 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:45.440239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a027d0db-6349-41da-9500-ec98b95fa3c0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:45.440954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a027d0db-6349-41da-9500-ec98b95fa3c0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:45.447479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a027d0db-6349-41da-9500-ec98b95fa3c0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:45.447934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a027d0db-6349-41da-9500-ec98b95fa3c0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:45.448709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a027d0db-6349-41da-9500-ec98b95fa3c0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:45.449153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a027d0db-6349-41da-9500-ec98b95fa3c0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:45.509679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3269792a-535c-44f5-9875-2beacb8e542e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:45.510161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a027d0db-6349-41da-9500-ec98b95fa3c0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:45.510587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3269792a-535c-44f5-9875-2beacb8e542e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:45.517546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3269792a-535c-44f5-9875-2beacb8e542e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:45.517999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3269792a-535c-44f5-9875-2beacb8e542e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:45.518369 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a027d0db-6349-41da-9500-ec98b95fa3c0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1218 microversion: 2.1 time: 0.081971 May 28 04:52:45.518764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3269792a-535c-44f5-9875-2beacb8e542e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:45.519110 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2246/4590] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:45 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:45.519272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3269792a-535c-44f5-9875-2beacb8e542e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:45.642336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cfb87354-c1ef-4ab0-81e4-bfc192301d28 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:45.642968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cfb87354-c1ef-4ab0-81e4-bfc192301d28 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:45.649431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfb87354-c1ef-4ab0-81e4-bfc192301d28 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:45.649894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfb87354-c1ef-4ab0-81e4-bfc192301d28 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:45.650681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfb87354-c1ef-4ab0-81e4-bfc192301d28 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:45.651159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfb87354-c1ef-4ab0-81e4-bfc192301d28 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:45.655315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3269792a-535c-44f5-9875-2beacb8e542e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:45.664199 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3269792a-535c-44f5-9875-2beacb8e542e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1509 microversion: 2.1 time: 0.158368 May 28 04:52:45.665094 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2345/4591] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:45 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:45.780552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cfb87354-c1ef-4ab0-81e4-bfc192301d28 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:45.789033 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cfb87354-c1ef-4ab0-81e4-bfc192301d28 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1317 microversion: 2.1 time: 0.151102 May 28 04:52:45.791923 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2247/4592] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:45 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:46.002704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-531f8c8e-bb97-4317-ac63-c42e9e9c0cb4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:46.005111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-531f8c8e-bb97-4317-ac63-c42e9e9c0cb4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:46.012019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-531f8c8e-bb97-4317-ac63-c42e9e9c0cb4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:46.015306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-531f8c8e-bb97-4317-ac63-c42e9e9c0cb4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:46.015306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-531f8c8e-bb97-4317-ac63-c42e9e9c0cb4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:46.015306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-531f8c8e-bb97-4317-ac63-c42e9e9c0cb4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:46.109701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b273c3e8-0639-4883-bb91-e09c4a23a4a6 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:46.110805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b273c3e8-0639-4883-bb91-e09c4a23a4a6 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] [instance: e3b50a4d-2542-4c6a-9568-4eb7c84c75d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:46.125637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b273c3e8-0639-4883-bb91-e09c4a23a4a6 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:46.127534 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b273c3e8-0639-4883-bb91-e09c4a23a4a6 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:46.129139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b273c3e8-0639-4883-bb91-e09c4a23a4a6 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:46.131609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b273c3e8-0639-4883-bb91-e09c4a23a4a6 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:46.292114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b273c3e8-0639-4883-bb91-e09c4a23a4a6 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:46.304126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b273c3e8-0639-4883-bb91-e09c4a23a4a6 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:46.305721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b273c3e8-0639-4883-bb91-e09c4a23a4a6 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:46.306982 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b273c3e8-0639-4883-bb91-e09c4a23a4a6 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4" status: 200 len: 1339 microversion: 2.47 time: 0.201717 May 28 04:52:46.319210 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2248/4593] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:52:46 2022] GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4 => generated 1339 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:52:46.326645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-531f8c8e-bb97-4317-ac63-c42e9e9c0cb4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:46.334867 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-531f8c8e-bb97-4317-ac63-c42e9e9c0cb4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.340568 May 28 04:52:46.335470 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2346/4594] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:45 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:46.349712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-482c9446-0552-4e79-b32f-0d8a277d94e7 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:46.350495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-482c9446-0552-4e79-b32f-0d8a277d94e7 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:46.357234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-482c9446-0552-4e79-b32f-0d8a277d94e7 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:46.357810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-482c9446-0552-4e79-b32f-0d8a277d94e7 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:46.358692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-482c9446-0552-4e79-b32f-0d8a277d94e7 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:46.359888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-482c9446-0552-4e79-b32f-0d8a277d94e7 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:46.399802 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c57061b2-6d84-409c-a728-edc51ec0c4b5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:46.401160 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c57061b2-6d84-409c-a728-edc51ec0c4b5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:46.408331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c57061b2-6d84-409c-a728-edc51ec0c4b5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:46.409003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c57061b2-6d84-409c-a728-edc51ec0c4b5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:46.409959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c57061b2-6d84-409c-a728-edc51ec0c4b5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:46.410556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c57061b2-6d84-409c-a728-edc51ec0c4b5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:46.443594 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c57061b2-6d84-409c-a728-edc51ec0c4b5 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047702 May 28 04:52:46.444470 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2347/4595] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:52:46 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:52:46.544176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d5c62406-ca81-496c-9c1b-380d890cce04 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:46.544786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d5c62406-ca81-496c-9c1b-380d890cce04 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:46.551869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5c62406-ca81-496c-9c1b-380d890cce04 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:46.552899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5c62406-ca81-496c-9c1b-380d890cce04 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:46.553696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5c62406-ca81-496c-9c1b-380d890cce04 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:46.554268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5c62406-ca81-496c-9c1b-380d890cce04 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:46.573281 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-482c9446-0552-4e79-b32f-0d8a277d94e7 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780c97536c34c60a8deaf5b00e84cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3444a0099cc64616854d5172bf7ff6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:46.583011 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-482c9446-0552-4e79-b32f-0d8a277d94e7 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2" status: 200 len: 1510 microversion: 2.1 time: 0.237149 May 28 04:52:46.586696 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2249/4596] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:46 2022] GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2 => generated 1510 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:46.641641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d5c62406-ca81-496c-9c1b-380d890cce04 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:46.649599 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d5c62406-ca81-496c-9c1b-380d890cce04 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1218 microversion: 2.1 time: 0.119049 May 28 04:52:46.650181 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2348/4597] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:46 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:46.682109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f33cee10-5d67-4689-ac49-3d35d42c0ef5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:46.682983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f33cee10-5d67-4689-ac49-3d35d42c0ef5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:46.690600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f33cee10-5d67-4689-ac49-3d35d42c0ef5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:46.691945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f33cee10-5d67-4689-ac49-3d35d42c0ef5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:46.692853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f33cee10-5d67-4689-ac49-3d35d42c0ef5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:46.693654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f33cee10-5d67-4689-ac49-3d35d42c0ef5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:46.807082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c326c637-4aee-4556-8603-f72a6e6c58e7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:46.807872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c326c637-4aee-4556-8603-f72a6e6c58e7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:46.815751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c326c637-4aee-4556-8603-f72a6e6c58e7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:46.816593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c326c637-4aee-4556-8603-f72a6e6c58e7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:46.817554 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c326c637-4aee-4556-8603-f72a6e6c58e7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:46.818615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c326c637-4aee-4556-8603-f72a6e6c58e7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:47.050243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f33cee10-5d67-4689-ac49-3d35d42c0ef5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:47.059725 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f33cee10-5d67-4689-ac49-3d35d42c0ef5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1509 microversion: 2.1 time: 0.381622 May 28 04:52:47.063084 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2250/4598] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:46 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1509 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:47.139114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c326c637-4aee-4556-8603-f72a6e6c58e7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:47.153800 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c326c637-4aee-4556-8603-f72a6e6c58e7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1317 microversion: 2.1 time: 0.347328 May 28 04:52:47.164380 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2349/4599] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:46 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:47.480356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-681e8893-5bff-471a-b279-121d2a07b012 req-9f31568b-2149-4af4-9979-9e76b8314dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13adc5ad-6616-41e2-9042-dea4fa2537b2", "name": "network-vif-deleted", "tag": "64eb229b-5cc1-4e36-b739-35c8595675ab"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:47.482036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2480d481-4f46-41e1-9f8f-d0aa9ce09183 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:47.482036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2480d481-4f46-41e1-9f8f-d0aa9ce09183 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] [instance: e3b50a4d-2542-4c6a-9568-4eb7c84c75d4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:47.482036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2480d481-4f46-41e1-9f8f-d0aa9ce09183 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:47.482036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2480d481-4f46-41e1-9f8f-d0aa9ce09183 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:47.482036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2480d481-4f46-41e1-9f8f-d0aa9ce09183 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:47.482036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2480d481-4f46-41e1-9f8f-d0aa9ce09183 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:47.502182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-681e8893-5bff-471a-b279-121d2a07b012 req-9f31568b-2149-4af4-9979-9e76b8314dd8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:47.502182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-681e8893-5bff-471a-b279-121d2a07b012 req-9f31568b-2149-4af4-9979-9e76b8314dd8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:47.502182 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-681e8893-5bff-471a-b279-121d2a07b012 req-9f31568b-2149-4af4-9979-9e76b8314dd8 service nova] Creating event network-vif-deleted:64eb229b-5cc1-4e36-b739-35c8595675ab for instance 13adc5ad-6616-41e2-9042-dea4fa2537b2 on n-h2-843700-1 May 28 04:52:47.502182 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-681e8893-5bff-471a-b279-121d2a07b012 req-9f31568b-2149-4af4-9979-9e76b8314dd8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062315 May 28 04:52:47.502182 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2251/4600] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:47.502182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-104fbece-3501-4f48-bb93-6c34d7899d3e tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:47.502182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-104fbece-3501-4f48-bb93-6c34d7899d3e tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:47.502182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-104fbece-3501-4f48-bb93-6c34d7899d3e tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:47.502182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-104fbece-3501-4f48-bb93-6c34d7899d3e tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:47.502182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-104fbece-3501-4f48-bb93-6c34d7899d3e tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:47.502182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-104fbece-3501-4f48-bb93-6c34d7899d3e tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:47.503397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2480d481-4f46-41e1-9f8f-d0aa9ce09183 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:47.503397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2480d481-4f46-41e1-9f8f-d0aa9ce09183 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:47.503397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2480d481-4f46-41e1-9f8f-d0aa9ce09183 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:47.503397 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2480d481-4f46-41e1-9f8f-d0aa9ce09183 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4" status: 200 len: 1339 microversion: 2.47 time: 0.157914 May 28 04:52:47.503397 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2350/4601] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:52:47 2022] GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4 => generated 1339 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:52:47.503397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8ff95859-3ae8-43ba-91c5-9a9f3c8a392c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:47.503397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8ff95859-3ae8-43ba-91c5-9a9f3c8a392c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:47.503397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ff95859-3ae8-43ba-91c5-9a9f3c8a392c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:47.503397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ff95859-3ae8-43ba-91c5-9a9f3c8a392c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:47.503397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ff95859-3ae8-43ba-91c5-9a9f3c8a392c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:47.503397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ff95859-3ae8-43ba-91c5-9a9f3c8a392c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:47.532439 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8ff95859-3ae8-43ba-91c5-9a9f3c8a392c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048734 May 28 04:52:47.533323 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2351/4602] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:52:47 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:47.603716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ba2abd04-2dfc-46b4-af7a-5c15ba13348a tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:47.604523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ba2abd04-2dfc-46b4-af7a-5c15ba13348a tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:47.611453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba2abd04-2dfc-46b4-af7a-5c15ba13348a tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:47.612115 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba2abd04-2dfc-46b4-af7a-5c15ba13348a tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:47.612997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba2abd04-2dfc-46b4-af7a-5c15ba13348a tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:47.613545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba2abd04-2dfc-46b4-af7a-5c15ba13348a tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:47.647013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-104fbece-3501-4f48-bb93-6c34d7899d3e tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:47.655262 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-104fbece-3501-4f48-bb93-6c34d7899d3e tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.263228 May 28 04:52:47.665441 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2252/4603] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:47 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:47.675681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a9531c99-814a-4ef9-bf12-98749777dd88 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:47.676453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a9531c99-814a-4ef9-bf12-98749777dd88 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:47.693845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ba2abd04-2dfc-46b4-af7a-5c15ba13348a tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780c97536c34c60a8deaf5b00e84cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3444a0099cc64616854d5172bf7ff6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:47.699173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:47.699644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a9531c99-814a-4ef9-bf12-98749777dd88 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:47.700098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a9531c99-814a-4ef9-bf12-98749777dd88 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:47.701702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a9531c99-814a-4ef9-bf12-98749777dd88 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:47.703109 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ba2abd04-2dfc-46b4-af7a-5c15ba13348a tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2" status: 200 len: 1301 microversion: 2.1 time: 0.103394 May 28 04:52:47.703932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a9531c99-814a-4ef9-bf12-98749777dd88 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:47.712852 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2352/4604] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:47 2022] GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2 => generated 1301 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:47.791758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a9531c99-814a-4ef9-bf12-98749777dd88 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:47.792563 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a9531c99-814a-4ef9-bf12-98749777dd88 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1274 microversion: 2.1 time: 0.124146 May 28 04:52:47.793340 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2253/4605] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:47 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1274 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:48.082815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-46c17cfb-2f62-4395-a207-05a83c6a61aa tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:48.083676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-46c17cfb-2f62-4395-a207-05a83c6a61aa tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:48.090928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-46c17cfb-2f62-4395-a207-05a83c6a61aa tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:48.091721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-46c17cfb-2f62-4395-a207-05a83c6a61aa tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:48.093533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-46c17cfb-2f62-4395-a207-05a83c6a61aa tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:48.094606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-46c17cfb-2f62-4395-a207-05a83c6a61aa tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:48.173030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a6d16b0a-e8cd-4e88-929f-4a825c73a0c3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:48.173659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a6d16b0a-e8cd-4e88-929f-4a825c73a0c3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:48.185092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6d16b0a-e8cd-4e88-929f-4a825c73a0c3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:48.187092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6d16b0a-e8cd-4e88-929f-4a825c73a0c3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:48.189695 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6d16b0a-e8cd-4e88-929f-4a825c73a0c3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:48.191468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6d16b0a-e8cd-4e88-929f-4a825c73a0c3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:48.419895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-46c17cfb-2f62-4395-a207-05a83c6a61aa tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:48.432673 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-46c17cfb-2f62-4395-a207-05a83c6a61aa tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1486 microversion: 2.1 time: 0.357198 May 28 04:52:48.435106 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2353/4606] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:48 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1486 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:48.454188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-661d1102-8d86-4caa-90fc-8657be5749a6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-395531534"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:48.455743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-661d1102-8d86-4caa-90fc-8657be5749a6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:48.469237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-661d1102-8d86-4caa-90fc-8657be5749a6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:48.470289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-661d1102-8d86-4caa-90fc-8657be5749a6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:48.471728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-661d1102-8d86-4caa-90fc-8657be5749a6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:48.472178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-661d1102-8d86-4caa-90fc-8657be5749a6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:48.502906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a6d16b0a-e8cd-4e88-929f-4a825c73a0c3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:48.512747 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a6d16b0a-e8cd-4e88-929f-4a825c73a0c3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1317 microversion: 2.1 time: 0.344264 May 28 04:52:48.515660 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2254/4607] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:48 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:48.528682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-47ee4c86-1ee4-43de-a363-2a9ccc274f7e tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:48.530275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-47ee4c86-1ee4-43de-a363-2a9ccc274f7e tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] [instance: e3b50a4d-2542-4c6a-9568-4eb7c84c75d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:48.545622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47ee4c86-1ee4-43de-a363-2a9ccc274f7e tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:48.546107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47ee4c86-1ee4-43de-a363-2a9ccc274f7e tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:48.549189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47ee4c86-1ee4-43de-a363-2a9ccc274f7e tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:48.550729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47ee4c86-1ee4-43de-a363-2a9ccc274f7e tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:48.637189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-47ee4c86-1ee4-43de-a363-2a9ccc274f7e tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:48.647491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-47ee4c86-1ee4-43de-a363-2a9ccc274f7e tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:48.649420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-47ee4c86-1ee4-43de-a363-2a9ccc274f7e tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:48.650922 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-47ee4c86-1ee4-43de-a363-2a9ccc274f7e tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4" status: 200 len: 1360 microversion: 2.47 time: 0.134004 May 28 04:52:48.651780 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2255/4608] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:52:48 2022] GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4 => generated 1360 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:52:48.657418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-806fd07b-6601-49d6-b8e7-bf3f8d77c3fd tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:48.658731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-806fd07b-6601-49d6-b8e7-bf3f8d77c3fd tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:48.665613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-806fd07b-6601-49d6-b8e7-bf3f8d77c3fd tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:48.667919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-806fd07b-6601-49d6-b8e7-bf3f8d77c3fd tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:48.672462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-806fd07b-6601-49d6-b8e7-bf3f8d77c3fd tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:48.683120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-806fd07b-6601-49d6-b8e7-bf3f8d77c3fd tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:48.723832 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-661d1102-8d86-4caa-90fc-8657be5749a6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "PUT /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1059 microversion: 2.1 time: 0.274988 May 28 04:52:48.724765 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2354/4609] 10.222.0.58 () {60 vars in 1255 bytes} [Sat May 28 04:52:48 2022] PUT /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1059 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:48.748087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ab740c33-c5c7-46f9-8097-2b12500e5416 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-776105961"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:48.751570 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ab740c33-c5c7-46f9-8097-2b12500e5416 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] [instance: e3b50a4d-2542-4c6a-9568-4eb7c84c75d4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:48.761721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab740c33-c5c7-46f9-8097-2b12500e5416 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:48.766941 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-806fd07b-6601-49d6-b8e7-bf3f8d77c3fd tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113729 May 28 04:52:48.767776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab740c33-c5c7-46f9-8097-2b12500e5416 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:48.768889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab740c33-c5c7-46f9-8097-2b12500e5416 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:48.769565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab740c33-c5c7-46f9-8097-2b12500e5416 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:48.777147 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2256/4610] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:52:48 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:48.792602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d61536e2-65c9-4f35-bf67-a691e8ec93b0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:48.793521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d61536e2-65c9-4f35-bf67-a691e8ec93b0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:48.807118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d61536e2-65c9-4f35-bf67-a691e8ec93b0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:48.819196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d61536e2-65c9-4f35-bf67-a691e8ec93b0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:48.819196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d61536e2-65c9-4f35-bf67-a691e8ec93b0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:48.819196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d61536e2-65c9-4f35-bf67-a691e8ec93b0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:49.061219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d61536e2-65c9-4f35-bf67-a691e8ec93b0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:49.074982 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d61536e2-65c9-4f35-bf67-a691e8ec93b0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.295228 May 28 04:52:49.085570 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2257/4611] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:48 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:49.092214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d579c462-7739-4736-a792-26b389bade23 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:49.093102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d579c462-7739-4736-a792-26b389bade23 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] [instance: 13adc5ad-6616-41e2-9042-dea4fa2537b2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:49.099921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d579c462-7739-4736-a792-26b389bade23 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:49.103880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d579c462-7739-4736-a792-26b389bade23 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:49.103880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d579c462-7739-4736-a792-26b389bade23 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:49.103880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d579c462-7739-4736-a792-26b389bade23 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:49.122262 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-d579c462-7739-4736-a792-26b389bade23 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] HTTP exception thrown: Instance 13adc5ad-6616-41e2-9042-dea4fa2537b2 could not be found. May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d579c462-7739-4736-a792-26b389bade23 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Request method failure captured: May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2 HTTP/1.1 May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqHe6bpbSI2gMo2uEux1qBevmtYsTj6d417QZ-o84svcjZjpBQfTlr5voNbcex6bhwsnn6BKR2yOSZtKcXVoIsITrKRjD27AqLjHXyfL9IfivPUMpZHX4XdM5YzhWxgrxRf1SqsKMxyR44RnRY3Vu9twe-gu2q8t6PWqSQJlYL4wgU May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 3444a0099cc64616854d5172bf7ff6e7 May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerPasswordTestJSON-1709506914 May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3444a0099cc64616854d5172bf7ff6e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3444a0099cc64616854d5172bf7ff6e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3444a0099cc64616854d5172bf7ff6e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3444a0099cc64616854d5172bf7ff6e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerPasswordTestJSON-1709506914 May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 3444a0099cc64616854d5172bf7ff6e7 May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1709506914 May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerPasswordTestJSON-1709506914-project May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: d780c97536c34c60a8deaf5b00e84cd2 May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerPasswordTestJSON-1709506914-project May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 13adc5ad-6616-41e2-9042-dea4fa2537b2 could not be found. May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '13adc5ad-6616-41e2-9042-dea4fa2537b2'} May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13adc5ad-6616-41e2-9042-dea4fa2537b2 could not be found. May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13adc5ad-6616-41e2-9042-dea4fa2537b2 could not be found. May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:49.125418 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:49.135240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:49.135240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:49.135240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:49.135240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:49.135240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:49.135240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13adc5ad-6616-41e2-9042-dea4fa2537b2 could not be found. May 28 04:52:49.135240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:49.137538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d579c462-7739-4736-a792-26b389bade23 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] Returning 404 to user: Instance 13adc5ad-6616-41e2-9042-dea4fa2537b2 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:49.139495 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d579c462-7739-4736-a792-26b389bade23 tempest-ServerPasswordTestJSON-1709506914 tempest-ServerPasswordTestJSON-1709506914-project] 10.222.0.58 "GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2" status: 404 len: 111 microversion: 2.1 time: 0.052157 May 28 04:52:49.140522 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2258/4612] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:49 2022] GET /compute/v2.1/servers/13adc5ad-6616-41e2-9042-dea4fa2537b2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:49.149815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2d358391-7f3e-4ac5-8ec5-5d8e4f70f055 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:49.151030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2d358391-7f3e-4ac5-8ec5-5d8e4f70f055 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:49.160265 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d358391-7f3e-4ac5-8ec5-5d8e4f70f055 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:49.161268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d358391-7f3e-4ac5-8ec5-5d8e4f70f055 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:49.162397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d358391-7f3e-4ac5-8ec5-5d8e4f70f055 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:49.163241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d358391-7f3e-4ac5-8ec5-5d8e4f70f055 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:49.505050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2d358391-7f3e-4ac5-8ec5-5d8e4f70f055 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:49.511953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:49.518252 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2d358391-7f3e-4ac5-8ec5-5d8e4f70f055 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1486 microversion: 2.1 time: 0.374469 May 28 04:52:49.519173 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2259/4613] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:49 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1486 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:49.539264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f6c789c5-427d-4a11-b6d1-82218104bb65 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:49.539623 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ab740c33-c5c7-46f9-8097-2b12500e5416 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] 10.222.0.58 "POST /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4/action" status: 202 len: 52 microversion: 2.47 time: 0.804387 May 28 04:52:49.542016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f6c789c5-427d-4a11-b6d1-82218104bb65 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:49.548191 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2355/4614] 10.222.0.58 () {62 vars in 1318 bytes} [Sat May 28 04:52:48 2022] POST /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4/action => generated 52 bytes in 822 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) May 28 04:52:49.554616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-129b89de-df4c-4f5a-ac79-7e05b92d5843 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:49.556059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-129b89de-df4c-4f5a-ac79-7e05b92d5843 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:49.558091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6c789c5-427d-4a11-b6d1-82218104bb65 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:49.563647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6c789c5-427d-4a11-b6d1-82218104bb65 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:49.564670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6c789c5-427d-4a11-b6d1-82218104bb65 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:49.565207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6c789c5-427d-4a11-b6d1-82218104bb65 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:49.566561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-129b89de-df4c-4f5a-ac79-7e05b92d5843 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:49.567022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-129b89de-df4c-4f5a-ac79-7e05b92d5843 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:49.568069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-129b89de-df4c-4f5a-ac79-7e05b92d5843 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:49.568982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-129b89de-df4c-4f5a-ac79-7e05b92d5843 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:49.814216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f6c789c5-427d-4a11-b6d1-82218104bb65 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:49.820621 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f6c789c5-427d-4a11-b6d1-82218104bb65 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1314 microversion: 2.1 time: 0.286792 May 28 04:52:49.824862 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2260/4615] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:49 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:49.837414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-07c93fe0-f331-4542-8b32-ba18bea36902 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:49.839390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-07c93fe0-f331-4542-8b32-ba18bea36902 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:49.858057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07c93fe0-f331-4542-8b32-ba18bea36902 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:49.862141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07c93fe0-f331-4542-8b32-ba18bea36902 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:49.863153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07c93fe0-f331-4542-8b32-ba18bea36902 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:49.865746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07c93fe0-f331-4542-8b32-ba18bea36902 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:50.012144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-129b89de-df4c-4f5a-ac79-7e05b92d5843 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:50.020795 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-129b89de-df4c-4f5a-ac79-7e05b92d5843 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1317 microversion: 2.1 time: 0.471155 May 28 04:52:50.021397 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2356/4616] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:49 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:50.026139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-222dd7cd-1aa7-4d9b-a463-5a3c9443255b tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:50.026697 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-222dd7cd-1aa7-4d9b-a463-5a3c9443255b tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] [instance: e3b50a4d-2542-4c6a-9568-4eb7c84c75d4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:50.034934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-222dd7cd-1aa7-4d9b-a463-5a3c9443255b tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:50.035425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-222dd7cd-1aa7-4d9b-a463-5a3c9443255b tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:50.036209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-222dd7cd-1aa7-4d9b-a463-5a3c9443255b tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:50.036708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-222dd7cd-1aa7-4d9b-a463-5a3c9443255b tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:50.065401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-222dd7cd-1aa7-4d9b-a463-5a3c9443255b tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] [instance: e3b50a4d-2542-4c6a-9568-4eb7c84c75d4] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:52:50.157789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-07c93fe0-f331-4542-8b32-ba18bea36902 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:50.167237 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-07c93fe0-f331-4542-8b32-ba18bea36902 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1486 microversion: 2.1 time: 0.339217 May 28 04:52:50.171087 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2261/4617] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:49 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1486 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:50.190413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4fb6b27d-8c90-48f9-bbf0-49e5477d96da tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:50.200493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4fb6b27d-8c90-48f9-bbf0-49e5477d96da tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:50.216252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4fb6b27d-8c90-48f9-bbf0-49e5477d96da tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:50.219458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4fb6b27d-8c90-48f9-bbf0-49e5477d96da tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:50.220541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4fb6b27d-8c90-48f9-bbf0-49e5477d96da tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:50.221237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4fb6b27d-8c90-48f9-bbf0-49e5477d96da tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:50.286000 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4fb6b27d-8c90-48f9-bbf0-49e5477d96da tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099956 May 28 04:52:50.290010 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2262/4618] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:52:50 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:50.295723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-07ab94e3-2d8b-4cdc-8ce6-216ab5bf3c75 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:50.296470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-07ab94e3-2d8b-4cdc-8ce6-216ab5bf3c75 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:50.303799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07ab94e3-2d8b-4cdc-8ce6-216ab5bf3c75 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:50.304710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07ab94e3-2d8b-4cdc-8ce6-216ab5bf3c75 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:50.305631 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07ab94e3-2d8b-4cdc-8ce6-216ab5bf3c75 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:50.306181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07ab94e3-2d8b-4cdc-8ce6-216ab5bf3c75 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:50.384371 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-222dd7cd-1aa7-4d9b-a463-5a3c9443255b tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4" status: 204 len: 0 microversion: 2.47 time: 0.361699 May 28 04:52:50.384998 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2357/4619] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:52:50 2022] DELETE /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:52:50.398336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-73f6d6ea-3ec0-4c66-856e-e491294b64f6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:50.398935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-73f6d6ea-3ec0-4c66-856e-e491294b64f6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:50.416855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73f6d6ea-3ec0-4c66-856e-e491294b64f6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:50.426206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73f6d6ea-3ec0-4c66-856e-e491294b64f6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:50.427403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73f6d6ea-3ec0-4c66-856e-e491294b64f6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:50.428036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73f6d6ea-3ec0-4c66-856e-e491294b64f6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:50.506172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-73f6d6ea-3ec0-4c66-856e-e491294b64f6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:52:50.634174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-07ab94e3-2d8b-4cdc-8ce6-216ab5bf3c75 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:50.646879 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-07ab94e3-2d8b-4cdc-8ce6-216ab5bf3c75 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.355584 May 28 04:52:50.648254 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2263/4620] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:50 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:50.653101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-d33ab220-c10f-4702-bb9a-8277fd265aba req-d4f795e5-7abe-4c90-8e13-8aff79ceaee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3087299d-554e-4c36-8eb4-3082257b7e65", "tag": "8a7a1ead-8e33-447e-840c-7789196d4eee"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:50.674770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d33ab220-c10f-4702-bb9a-8277fd265aba req-d4f795e5-7abe-4c90-8e13-8aff79ceaee9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:50.675776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d33ab220-c10f-4702-bb9a-8277fd265aba req-d4f795e5-7abe-4c90-8e13-8aff79ceaee9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:50.705256 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-d33ab220-c10f-4702-bb9a-8277fd265aba req-d4f795e5-7abe-4c90-8e13-8aff79ceaee9 service nova] Creating event network-changed:8a7a1ead-8e33-447e-840c-7789196d4eee for instance 3087299d-554e-4c36-8eb4-3082257b7e65 on n-h2-843700-1 May 28 04:52:50.717413 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-d33ab220-c10f-4702-bb9a-8277fd265aba req-d4f795e5-7abe-4c90-8e13-8aff79ceaee9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067580 May 28 04:52:50.718452 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2264/4621] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:50.731597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0743f134-8e90-449f-a4e2-3393fcacce5d tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:50.732728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0743f134-8e90-449f-a4e2-3393fcacce5d tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] [instance: e3b50a4d-2542-4c6a-9568-4eb7c84c75d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:50.749724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0743f134-8e90-449f-a4e2-3393fcacce5d tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:50.756462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0743f134-8e90-449f-a4e2-3393fcacce5d tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:50.757957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0743f134-8e90-449f-a4e2-3393fcacce5d tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:50.758625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0743f134-8e90-449f-a4e2-3393fcacce5d tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:50.894701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0743f134-8e90-449f-a4e2-3393fcacce5d tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:50.907018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0743f134-8e90-449f-a4e2-3393fcacce5d tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:50.908790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0743f134-8e90-449f-a4e2-3393fcacce5d tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:50.911803 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0743f134-8e90-449f-a4e2-3393fcacce5d tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4" status: 200 len: 1366 microversion: 2.47 time: 0.191328 May 28 04:52:50.915276 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2265/4622] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:52:50 2022] GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:52:50.924902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-39c91b11-b393-4b62-bb81-10335061756a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:50.927913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-39c91b11-b393-4b62-bb81-10335061756a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:50.928579 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-73f6d6ea-3ec0-4c66-856e-e491294b64f6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 204 len: 0 microversion: 2.1 time: 0.534311 May 28 04:52:50.930032 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2358/4623] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:52:50 2022] DELETE /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:52:50.935700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-1d173590-4532-4e8d-9776-eccf1db0b87f req-8a2bdbb8-7e6b-4b72-9499-f312a02510f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58022ec6-f4eb-4564-bed0-c3edd1d0daf4", "name": "network-vif-plugged", "status": "completed", "tag": "d2dc44c4-b245-41ae-bb82-8a262f7181c5"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:50.945147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-39c91b11-b393-4b62-bb81-10335061756a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:50.945147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-39c91b11-b393-4b62-bb81-10335061756a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:50.945147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-39c91b11-b393-4b62-bb81-10335061756a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:50.945147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-39c91b11-b393-4b62-bb81-10335061756a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:50.955806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-1d173590-4532-4e8d-9776-eccf1db0b87f req-8a2bdbb8-7e6b-4b72-9499-f312a02510f6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:50.958409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-1d173590-4532-4e8d-9776-eccf1db0b87f req-8a2bdbb8-7e6b-4b72-9499-f312a02510f6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:50.989505 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-1d173590-4532-4e8d-9776-eccf1db0b87f req-8a2bdbb8-7e6b-4b72-9499-f312a02510f6 service nova] Creating event network-vif-plugged:d2dc44c4-b245-41ae-bb82-8a262f7181c5 for instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 on n-h1-843700-1 May 28 04:52:51.008756 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-1d173590-4532-4e8d-9776-eccf1db0b87f req-8a2bdbb8-7e6b-4b72-9499-f312a02510f6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069647 May 28 04:52:51.008756 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2359/4624] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:51.017913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c1232416-09b4-434f-84bf-f58058342739 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:51.021619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c1232416-09b4-434f-84bf-f58058342739 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:51.034597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1232416-09b4-434f-84bf-f58058342739 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:51.036824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1232416-09b4-434f-84bf-f58058342739 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:51.036824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1232416-09b4-434f-84bf-f58058342739 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:51.036824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1232416-09b4-434f-84bf-f58058342739 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:51.223244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-39c91b11-b393-4b62-bb81-10335061756a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:51.231510 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-39c91b11-b393-4b62-bb81-10335061756a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1314 microversion: 2.1 time: 0.314834 May 28 04:52:51.232087 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2266/4625] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:50 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:51.238702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5e9301b9-7e5b-4512-8d62-019051b9ce54 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:51.239344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5e9301b9-7e5b-4512-8d62-019051b9ce54 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:51.245764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e9301b9-7e5b-4512-8d62-019051b9ce54 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:51.246837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e9301b9-7e5b-4512-8d62-019051b9ce54 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:51.247891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e9301b9-7e5b-4512-8d62-019051b9ce54 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:51.248326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e9301b9-7e5b-4512-8d62-019051b9ce54 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:51.264522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c1232416-09b4-434f-84bf-f58058342739 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:51.277398 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c1232416-09b4-434f-84bf-f58058342739 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1492 microversion: 2.1 time: 0.267619 May 28 04:52:51.278264 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2360/4626] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:51 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1492 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:51.298003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9e979fb5-9708-4c9a-b1f2-bd2c05bf703c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:51.299399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9e979fb5-9708-4c9a-b1f2-bd2c05bf703c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:51.305256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:51.309244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e979fb5-9708-4c9a-b1f2-bd2c05bf703c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:51.309942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e979fb5-9708-4c9a-b1f2-bd2c05bf703c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:51.310786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e979fb5-9708-4c9a-b1f2-bd2c05bf703c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:51.311362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e979fb5-9708-4c9a-b1f2-bd2c05bf703c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:51.342934 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9e979fb5-9708-4c9a-b1f2-bd2c05bf703c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049337 May 28 04:52:51.344422 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2361/4627] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:52:51 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 04:52:51.410904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5e9301b9-7e5b-4512-8d62-019051b9ce54 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:51.414337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0712183f-4401-4182-96f7-b1dbd19c91c3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:51.414337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0712183f-4401-4182-96f7-b1dbd19c91c3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:51.419938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0712183f-4401-4182-96f7-b1dbd19c91c3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:51.420637 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5e9301b9-7e5b-4512-8d62-019051b9ce54 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1317 microversion: 2.1 time: 0.187245 May 28 04:52:51.420797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0712183f-4401-4182-96f7-b1dbd19c91c3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:51.421560 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2267/4628] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:51 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:51.422533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0712183f-4401-4182-96f7-b1dbd19c91c3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:51.423249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0712183f-4401-4182-96f7-b1dbd19c91c3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:51.453328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0712183f-4401-4182-96f7-b1dbd19c91c3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:52:51.664873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c62ff35d-9034-44a3-9d1e-ae237737445d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:51.665504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c62ff35d-9034-44a3-9d1e-ae237737445d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:51.674282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c62ff35d-9034-44a3-9d1e-ae237737445d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:51.674831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c62ff35d-9034-44a3-9d1e-ae237737445d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:51.675841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c62ff35d-9034-44a3-9d1e-ae237737445d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:51.676486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c62ff35d-9034-44a3-9d1e-ae237737445d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:51.762625 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0712183f-4401-4182-96f7-b1dbd19c91c3 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "DELETE /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 204 len: 0 microversion: 2.1 time: 0.355000 May 28 04:52:51.766938 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2362/4629] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:52:51 2022] DELETE /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:52:51.773997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5b2ea21f-7eda-479a-a60b-22002a596c3b tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:51.773997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5b2ea21f-7eda-479a-a60b-22002a596c3b tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:51.779747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b2ea21f-7eda-479a-a60b-22002a596c3b tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:51.780441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b2ea21f-7eda-479a-a60b-22002a596c3b tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:51.781995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b2ea21f-7eda-479a-a60b-22002a596c3b tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:51.782199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b2ea21f-7eda-479a-a60b-22002a596c3b tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:51.786632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:51.819951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c62ff35d-9034-44a3-9d1e-ae237737445d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:51.827799 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c62ff35d-9034-44a3-9d1e-ae237737445d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.166904 May 28 04:52:51.829020 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2268/4630] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:51 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:51.921042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5b2ea21f-7eda-479a-a60b-22002a596c3b tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:51.928936 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5b2ea21f-7eda-479a-a60b-22002a596c3b tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 200 len: 1679 microversion: 2.1 time: 0.160289 May 28 04:52:51.929570 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2363/4631] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:51 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:51.933916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-74d43860-45a3-4bf9-b5df-edf62305327a tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:51.934542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-74d43860-45a3-4bf9-b5df-edf62305327a tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] [instance: e3b50a4d-2542-4c6a-9568-4eb7c84c75d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:51.940799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74d43860-45a3-4bf9-b5df-edf62305327a tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:51.941515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74d43860-45a3-4bf9-b5df-edf62305327a tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:51.942293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74d43860-45a3-4bf9-b5df-edf62305327a tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:51.942737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74d43860-45a3-4bf9-b5df-edf62305327a tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:52.008771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-74d43860-45a3-4bf9-b5df-edf62305327a tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:52.018092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-74d43860-45a3-4bf9-b5df-edf62305327a tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:52.019649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-74d43860-45a3-4bf9-b5df-edf62305327a tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:52.020853 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-74d43860-45a3-4bf9-b5df-edf62305327a tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4" status: 200 len: 1366 microversion: 2.47 time: 0.091099 May 28 04:52:52.021406 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2269/4632] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:52:51 2022] GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4 => generated 1366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:52:52.248451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7d5080ea-2887-4242-aad7-3434f74295da tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:52.249064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7d5080ea-2887-4242-aad7-3434f74295da tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:52.256970 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d5080ea-2887-4242-aad7-3434f74295da tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:52.257412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d5080ea-2887-4242-aad7-3434f74295da tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:52.258162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d5080ea-2887-4242-aad7-3434f74295da tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:52.258599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d5080ea-2887-4242-aad7-3434f74295da tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:52.296266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9bef2aea-b139-4713-9df8-07f7ac99ef5b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:52.297248 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9bef2aea-b139-4713-9df8-07f7ac99ef5b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:52.303914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9bef2aea-b139-4713-9df8-07f7ac99ef5b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:52.304368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9bef2aea-b139-4713-9df8-07f7ac99ef5b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:52.306278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9bef2aea-b139-4713-9df8-07f7ac99ef5b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:52.307068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9bef2aea-b139-4713-9df8-07f7ac99ef5b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:52.470175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7d5080ea-2887-4242-aad7-3434f74295da tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:52.482484 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7d5080ea-2887-4242-aad7-3434f74295da tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1314 microversion: 2.1 time: 0.237590 May 28 04:52:52.483631 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2364/4633] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:52 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:52.490745 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a795fe34-9c41-4fbe-94f4-cab19fe8a900 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:52.491837 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a795fe34-9c41-4fbe-94f4-cab19fe8a900 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:52.508792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a795fe34-9c41-4fbe-94f4-cab19fe8a900 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:52.508792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a795fe34-9c41-4fbe-94f4-cab19fe8a900 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:52.508792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a795fe34-9c41-4fbe-94f4-cab19fe8a900 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:52.509146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a795fe34-9c41-4fbe-94f4-cab19fe8a900 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:52.509691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9bef2aea-b139-4713-9df8-07f7ac99ef5b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:52.520392 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9bef2aea-b139-4713-9df8-07f7ac99ef5b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1492 microversion: 2.1 time: 0.228869 May 28 04:52:52.521515 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2270/4634] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:52 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1492 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:52.637800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a795fe34-9c41-4fbe-94f4-cab19fe8a900 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:52.645367 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a795fe34-9c41-4fbe-94f4-cab19fe8a900 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1317 microversion: 2.1 time: 0.159239 May 28 04:52:52.645943 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2365/4635] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:52 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:52.766163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9bef2aea-b139-4713-9df8-07f7ac99ef5b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:52.767188 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9bef2aea-b139-4713-9df8-07f7ac99ef5b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001388 May 28 04:52:52.767525 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2271/4636] 10.222.0.58 () {56 vars in 885 bytes} [Sat May 28 04:52:52 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 28 04:52:52.846400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-858a0867-3e8d-4fc9-b86e-4e4acb1fbb40 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:52.847044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-858a0867-3e8d-4fc9-b86e-4e4acb1fbb40 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:52.853958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-858a0867-3e8d-4fc9-b86e-4e4acb1fbb40 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:52.854421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-858a0867-3e8d-4fc9-b86e-4e4acb1fbb40 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:52.857777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-858a0867-3e8d-4fc9-b86e-4e4acb1fbb40 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:52.857777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-858a0867-3e8d-4fc9-b86e-4e4acb1fbb40 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:52.946131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a086ee13-70f8-448c-a5d2-69eddc31af1c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:52.947683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a086ee13-70f8-448c-a5d2-69eddc31af1c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:52.953088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a086ee13-70f8-448c-a5d2-69eddc31af1c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:52.953542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a086ee13-70f8-448c-a5d2-69eddc31af1c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:52.954314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a086ee13-70f8-448c-a5d2-69eddc31af1c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:52.954813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a086ee13-70f8-448c-a5d2-69eddc31af1c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:53.003184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-858a0867-3e8d-4fc9-b86e-4e4acb1fbb40 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:53.010908 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-858a0867-3e8d-4fc9-b86e-4e4acb1fbb40 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.168953 May 28 04:52:53.011921 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2366/4637] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:52 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:53.039633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-00f649c6-b0c9-423b-b82e-05a8bf5bb6e5 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:53.040684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-00f649c6-b0c9-423b-b82e-05a8bf5bb6e5 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] [instance: e3b50a4d-2542-4c6a-9568-4eb7c84c75d4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:53.050886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00f649c6-b0c9-423b-b82e-05a8bf5bb6e5 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:53.050886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00f649c6-b0c9-423b-b82e-05a8bf5bb6e5 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:53.050886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00f649c6-b0c9-423b-b82e-05a8bf5bb6e5 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:53.050886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00f649c6-b0c9-423b-b82e-05a8bf5bb6e5 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:53.151821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-00f649c6-b0c9-423b-b82e-05a8bf5bb6e5 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:53.166139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a086ee13-70f8-448c-a5d2-69eddc31af1c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:53.170556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-00f649c6-b0c9-423b-b82e-05a8bf5bb6e5 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:53.172235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-00f649c6-b0c9-423b-b82e-05a8bf5bb6e5 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:53.173797 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-00f649c6-b0c9-423b-b82e-05a8bf5bb6e5 tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4" status: 200 len: 1366 microversion: 2.47 time: 0.138498 May 28 04:52:53.174003 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a086ee13-70f8-448c-a5d2-69eddc31af1c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 200 len: 1679 microversion: 2.1 time: 0.231641 May 28 04:52:53.174378 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2367/4638] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:52:53 2022] GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:52:53.175434 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2272/4639] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:52 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 1679 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:53.501089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-da7f8392-8f8a-4236-8036-7c9f6dfe4378 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:53.501722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-da7f8392-8f8a-4236-8036-7c9f6dfe4378 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:53.510677 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da7f8392-8f8a-4236-8036-7c9f6dfe4378 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:53.511187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da7f8392-8f8a-4236-8036-7c9f6dfe4378 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:53.511986 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da7f8392-8f8a-4236-8036-7c9f6dfe4378 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:53.512434 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da7f8392-8f8a-4236-8036-7c9f6dfe4378 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:53.538819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ad4e16bd-467b-4f3d-9e96-117d8b68abbf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:53.539858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ad4e16bd-467b-4f3d-9e96-117d8b68abbf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:53.547865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ad4e16bd-467b-4f3d-9e96-117d8b68abbf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:53.549342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ad4e16bd-467b-4f3d-9e96-117d8b68abbf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:53.550383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ad4e16bd-467b-4f3d-9e96-117d8b68abbf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:53.551075 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ad4e16bd-467b-4f3d-9e96-117d8b68abbf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:53.749517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:53.774465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=24 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:53.782922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-da7f8392-8f8a-4236-8036-7c9f6dfe4378 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:53.787168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ad4e16bd-467b-4f3d-9e96-117d8b68abbf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:53.790743 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-da7f8392-8f8a-4236-8036-7c9f6dfe4378 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1314 microversion: 2.1 time: 0.294348 May 28 04:52:53.791357 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2368/4640] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:53 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:53.795932 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ad4e16bd-467b-4f3d-9e96-117d8b68abbf tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1492 microversion: 2.1 time: 0.261313 May 28 04:52:53.796538 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dfd57a3c-7cfe-4e05-8950-d751ef8ded03 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:53.797864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dfd57a3c-7cfe-4e05-8950-d751ef8ded03 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:53.804150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dfd57a3c-7cfe-4e05-8950-d751ef8ded03 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:53.808484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dfd57a3c-7cfe-4e05-8950-d751ef8ded03 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:53.808484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dfd57a3c-7cfe-4e05-8950-d751ef8ded03 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:53.808484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dfd57a3c-7cfe-4e05-8950-d751ef8ded03 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:53.808960 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2273/4641] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:53 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1492 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:53.957714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-891bc38a-cc6e-4801-ac0d-718184796bd1 req-c3295852-b804-414e-b54d-501e32e2ca2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d240c27b-8a6b-4c15-ac5b-d9a7e5beda94", "name": "network-vif-deleted", "tag": "a46253ec-f259-41f9-91b7-9c51ad92cede"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:53.967082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-891bc38a-cc6e-4801-ac0d-718184796bd1 req-c3295852-b804-414e-b54d-501e32e2ca2f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:53.967916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-891bc38a-cc6e-4801-ac0d-718184796bd1 req-c3295852-b804-414e-b54d-501e32e2ca2f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:53.990520 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-891bc38a-cc6e-4801-ac0d-718184796bd1 req-c3295852-b804-414e-b54d-501e32e2ca2f service nova] Creating event network-vif-deleted:a46253ec-f259-41f9-91b7-9c51ad92cede for instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 on n-h1-843700-1 May 28 04:52:53.996992 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-891bc38a-cc6e-4801-ac0d-718184796bd1 req-c3295852-b804-414e-b54d-501e32e2ca2f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044332 May 28 04:52:53.998367 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2274/4642] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:52:54.028685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bb5d43f8-6010-4312-a96f-c089c9667f19 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:54.030558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bb5d43f8-6010-4312-a96f-c089c9667f19 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:54.036491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb5d43f8-6010-4312-a96f-c089c9667f19 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:54.036986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb5d43f8-6010-4312-a96f-c089c9667f19 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:54.037747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb5d43f8-6010-4312-a96f-c089c9667f19 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:54.038383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb5d43f8-6010-4312-a96f-c089c9667f19 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:54.130429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dfd57a3c-7cfe-4e05-8950-d751ef8ded03 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:54.151985 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dfd57a3c-7cfe-4e05-8950-d751ef8ded03 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1317 microversion: 2.1 time: 0.359490 May 28 04:52:54.152598 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2369/4643] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:53 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:54.192909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bab8ad26-5054-4dbd-8341-2c6fad27e204 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:54.193532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bab8ad26-5054-4dbd-8341-2c6fad27e204 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:54.202408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bab8ad26-5054-4dbd-8341-2c6fad27e204 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:54.202953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bab8ad26-5054-4dbd-8341-2c6fad27e204 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:54.203772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bab8ad26-5054-4dbd-8341-2c6fad27e204 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:54.204220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bab8ad26-5054-4dbd-8341-2c6fad27e204 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:54.214136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bb5d43f8-6010-4312-a96f-c089c9667f19 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:54.226472 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bb5d43f8-6010-4312-a96f-c089c9667f19 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.202235 May 28 04:52:54.232951 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2275/4644] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:54 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:54.233413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ea4c0ef5-5754-42ce-a9e2-fc740c7f910f tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:54.234795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ea4c0ef5-5754-42ce-a9e2-fc740c7f910f tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] [instance: e3b50a4d-2542-4c6a-9568-4eb7c84c75d4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:54.243065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea4c0ef5-5754-42ce-a9e2-fc740c7f910f tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:54.243786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea4c0ef5-5754-42ce-a9e2-fc740c7f910f tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:54.245184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea4c0ef5-5754-42ce-a9e2-fc740c7f910f tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:54.245858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea4c0ef5-5754-42ce-a9e2-fc740c7f910f tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:54.354569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ea4c0ef5-5754-42ce-a9e2-fc740c7f910f tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:54.364758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ea4c0ef5-5754-42ce-a9e2-fc740c7f910f tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:54.371018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ea4c0ef5-5754-42ce-a9e2-fc740c7f910f tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8545357f8554939beb1e15759303ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a24f1e82224880aaf44542f3da8e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:54.371018 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ea4c0ef5-5754-42ce-a9e2-fc740c7f910f tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4" status: 200 len: 1366 microversion: 2.47 time: 0.139978 May 28 04:52:54.371018 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2276/4645] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:52:54 2022] GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4 => generated 1366 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:52:54.432294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bab8ad26-5054-4dbd-8341-2c6fad27e204 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:54.445934 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bab8ad26-5054-4dbd-8341-2c6fad27e204 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 200 len: 1679 microversion: 2.1 time: 0.256851 May 28 04:52:54.446636 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2370/4646] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:54 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 1679 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:54.813759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ce26c663-a0cd-4bd1-b0ea-eb14d6408d4d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:54.815539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ce26c663-a0cd-4bd1-b0ea-eb14d6408d4d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:54.815813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ed10ff53-edee-4e35-b338-4cba5209e30f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:54.817004 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ed10ff53-edee-4e35-b338-4cba5209e30f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:54.828647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:54.831921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce26c663-a0cd-4bd1-b0ea-eb14d6408d4d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:54.834128 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed10ff53-edee-4e35-b338-4cba5209e30f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:54.835116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed10ff53-edee-4e35-b338-4cba5209e30f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:54.835776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce26c663-a0cd-4bd1-b0ea-eb14d6408d4d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:54.845526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed10ff53-edee-4e35-b338-4cba5209e30f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:54.845526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed10ff53-edee-4e35-b338-4cba5209e30f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:54.846541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce26c663-a0cd-4bd1-b0ea-eb14d6408d4d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:54.846541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce26c663-a0cd-4bd1-b0ea-eb14d6408d4d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:54.915209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed10ff53-edee-4e35-b338-4cba5209e30f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:54.915873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed10ff53-edee-4e35-b338-4cba5209e30f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:54.916497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-ed10ff53-edee-4e35-b338-4cba5209e30f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lazy-loading 'fault' on Instance uuid d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:52:54.999554 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ed10ff53-edee-4e35-b338-4cba5209e30f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:55.019636 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ed10ff53-edee-4e35-b338-4cba5209e30f tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 200 len: 1309 microversion: 2.1 time: 0.210484 May 28 04:52:55.021330 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2371/4647] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:54 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 1309 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:55.081114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ce26c663-a0cd-4bd1-b0ea-eb14d6408d4d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:55.089925 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ce26c663-a0cd-4bd1-b0ea-eb14d6408d4d tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1314 microversion: 2.1 time: 0.285572 May 28 04:52:55.090592 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2277/4648] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:54 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:55.171173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2bd3191b-f762-4632-9d5a-91bcf0fe7706 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:55.172532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2bd3191b-f762-4632-9d5a-91bcf0fe7706 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:55.181727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2e9018e1-a378-4150-807f-aa4c0b91c8a4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:55.184444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2e9018e1-a378-4150-807f-aa4c0b91c8a4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:55.191353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bd3191b-f762-4632-9d5a-91bcf0fe7706 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:55.196977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bd3191b-f762-4632-9d5a-91bcf0fe7706 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:55.196977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bd3191b-f762-4632-9d5a-91bcf0fe7706 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:55.196977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bd3191b-f762-4632-9d5a-91bcf0fe7706 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:55.197475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:55.197475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2e9018e1-a378-4150-807f-aa4c0b91c8a4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:55.200957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2e9018e1-a378-4150-807f-aa4c0b91c8a4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:55.202193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2e9018e1-a378-4150-807f-aa4c0b91c8a4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:55.204359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2e9018e1-a378-4150-807f-aa4c0b91c8a4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:55.296745 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2e9018e1-a378-4150-807f-aa4c0b91c8a4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405/action" status: 200 len: 24573 microversion: 2.1 time: 0.119190 May 28 04:52:55.297899 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2278/4649] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:52:55 2022] POST /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405/action => generated 24573 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:52:55.303698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0a051c52-5eef-4ff3-b5f3-9afa5df299e3 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:55.305805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0a051c52-5eef-4ff3-b5f3-9afa5df299e3 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:55.314222 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a051c52-5eef-4ff3-b5f3-9afa5df299e3 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:55.314714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a051c52-5eef-4ff3-b5f3-9afa5df299e3 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:55.316448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a051c52-5eef-4ff3-b5f3-9afa5df299e3 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:55.316950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a051c52-5eef-4ff3-b5f3-9afa5df299e3 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:55.321210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:55.394039 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2bd3191b-f762-4632-9d5a-91bcf0fe7706 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:55.403789 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2bd3191b-f762-4632-9d5a-91bcf0fe7706 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.237840 May 28 04:52:55.404627 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2372/4650] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:55 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:55.410728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-494987e6-0571-4790-95b4-e81cb0f5a29d tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:55.414911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-494987e6-0571-4790-95b4-e81cb0f5a29d tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] [instance: e3b50a4d-2542-4c6a-9568-4eb7c84c75d4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:55.418272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-494987e6-0571-4790-95b4-e81cb0f5a29d tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:55.419565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-494987e6-0571-4790-95b4-e81cb0f5a29d tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:55.420529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-494987e6-0571-4790-95b4-e81cb0f5a29d tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:55.421184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-494987e6-0571-4790-95b4-e81cb0f5a29d tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:55.451218 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-494987e6-0571-4790-95b4-e81cb0f5a29d tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] HTTP exception thrown: Instance e3b50a4d-2542-4c6a-9568-4eb7c84c75d4 could not be found. May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-494987e6-0571-4790-95b4-e81cb0f5a29d tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Request method failure captured: May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4 HTTP/1.1 May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaqY_7LWhLrlLeb2c3mV4pp-u9zFqp8aTvb9jOE-ZGG88_scUydnrjN3dCshgZL24NdnvfUcxlNW_CGygsk5cAtJXqTEc5Jcev_QJrgVx5klSvFa4dLsyCQQM9_nMNRsEwg2HSOnJqVz2X6QrYAJ5dyeeF3drxTkfhfnnsb8loavxLs May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-Openstack-Nova-Api-Version: 2.47 May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: f6a24f1e82224880aaf44542f3da8e56 May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersAaction247Test-2010718510 May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f6a24f1e82224880aaf44542f3da8e56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f6a24f1e82224880aaf44542f3da8e56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f6a24f1e82224880aaf44542f3da8e56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f6a24f1e82224880aaf44542f3da8e56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersAaction247Test-2010718510 May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: f6a24f1e82224880aaf44542f3da8e56 May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersAaction247Test-2010718510 May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersAaction247Test-2010718510-project May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: f8545357f8554939beb1e15759303ca8 May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersAaction247Test-2010718510-project May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance e3b50a4d-2542-4c6a-9568-4eb7c84c75d4 could not be found. May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'e3b50a4d-2542-4c6a-9568-4eb7c84c75d4'} May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b50a4d-2542-4c6a-9568-4eb7c84c75d4 could not be found. May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b50a4d-2542-4c6a-9568-4eb7c84c75d4 could not be found. May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:55.455748 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:55.461671 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:55.461671 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:55.461671 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:55.461671 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:55.461671 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:55.461671 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b50a4d-2542-4c6a-9568-4eb7c84c75d4 could not be found. May 28 04:52:55.461671 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:55.464522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-494987e6-0571-4790-95b4-e81cb0f5a29d tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] Returning 404 to user: Instance e3b50a4d-2542-4c6a-9568-4eb7c84c75d4 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:55.465541 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-494987e6-0571-4790-95b4-e81cb0f5a29d tempest-ServersAaction247Test-2010718510 tempest-ServersAaction247Test-2010718510-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4" status: 404 len: 111 microversion: 2.47 time: 0.059719 May 28 04:52:55.470470 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2373/4651] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:52:55 2022] GET /compute/v2.1/servers/e3b50a4d-2542-4c6a-9568-4eb7c84c75d4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 04:52:55.477127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-243971c6-697d-4590-8974-7d7b6b93cfff tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:55.477852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-243971c6-697d-4590-8974-7d7b6b93cfff tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:55.486085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-243971c6-697d-4590-8974-7d7b6b93cfff tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:55.486784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-243971c6-697d-4590-8974-7d7b6b93cfff tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:55.488106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-243971c6-697d-4590-8974-7d7b6b93cfff tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:55.488626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-243971c6-697d-4590-8974-7d7b6b93cfff tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:55.641226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-243971c6-697d-4590-8974-7d7b6b93cfff tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:55.654326 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-243971c6-697d-4590-8974-7d7b6b93cfff tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 200 len: 1611 microversion: 2.1 time: 0.178463 May 28 04:52:55.665463 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2374/4652] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:55 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 1611 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:55.681364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-a81a128d-c6d2-4da2-a2fd-6b4d5eee53af req-f9b86aeb-799f-4ecb-877f-a2901eebdfc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d15725-d599-410b-8d4d-d4460a1d96b6", "name": "network-vif-deleted", "tag": "1ff2e3fd-f7ce-4fff-a4eb-cb1552874f44"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:55.711152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a81a128d-c6d2-4da2-a2fd-6b4d5eee53af req-f9b86aeb-799f-4ecb-877f-a2901eebdfc2 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:55.719330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0a051c52-5eef-4ff3-b5f3-9afa5df299e3 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:55.723793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a81a128d-c6d2-4da2-a2fd-6b4d5eee53af req-f9b86aeb-799f-4ecb-877f-a2901eebdfc2 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:55.730167 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0a051c52-5eef-4ff3-b5f3-9afa5df299e3 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.430349 May 28 04:52:55.731188 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2279/4653] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:55 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:55.736420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cf73eb8a-a903-40b7-b3df-e25e6877376b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-69637108", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:55.747191 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-a81a128d-c6d2-4da2-a2fd-6b4d5eee53af req-f9b86aeb-799f-4ecb-877f-a2901eebdfc2 service nova] Creating event network-vif-deleted:1ff2e3fd-f7ce-4fff-a4eb-cb1552874f44 for instance 50d15725-d599-410b-8d4d-d4460a1d96b6 on n-h2-843700-1 May 28 04:52:55.759186 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-a81a128d-c6d2-4da2-a2fd-6b4d5eee53af req-f9b86aeb-799f-4ecb-877f-a2901eebdfc2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091885 May 28 04:52:55.760450 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2375/4654] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:55.821978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-cf73eb8a-a903-40b7-b3df-e25e6877376b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] validate_networks() for [('d8b90133-44e4-4677-ae8d-d676a447193b', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:52:56.038670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-af9023de-a39b-4581-b93f-571942ddaae5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:56.039479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-af9023de-a39b-4581-b93f-571942ddaae5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:56.048765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-af9023de-a39b-4581-b93f-571942ddaae5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.049330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-af9023de-a39b-4581-b93f-571942ddaae5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.050217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-af9023de-a39b-4581-b93f-571942ddaae5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.050736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-af9023de-a39b-4581-b93f-571942ddaae5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.066486 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-af9023de-a39b-4581-b93f-571942ddaae5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 could not be found. May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-af9023de-a39b-4581-b93f-571942ddaae5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 HTTP/1.1 May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 could not be found. May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'd240c27b-8a6b-4c15-ac5b-d9a7e5beda94'} May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 could not be found. May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 could not be found. May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.069718 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.076851 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:56.076851 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:56.076851 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:56.076851 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:56.076851 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 could not be found. May 28 04:52:56.076851 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.079183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-af9023de-a39b-4581-b93f-571942ddaae5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:56.081389 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-af9023de-a39b-4581-b93f-571942ddaae5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 404 len: 111 microversion: 2.1 time: 0.047729 May 28 04:52:56.082581 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2376/4655] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:56 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:52:56.103326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-05190189-a304-4d8b-9914-7021a28d8d4a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:56.103887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-05190189-a304-4d8b-9914-7021a28d8d4a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:56.112245 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05190189-a304-4d8b-9914-7021a28d8d4a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.112757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05190189-a304-4d8b-9914-7021a28d8d4a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.113655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05190189-a304-4d8b-9914-7021a28d8d4a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.114147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05190189-a304-4d8b-9914-7021a28d8d4a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.134496 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-05190189-a304-4d8b-9914-7021a28d8d4a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 could not be found. May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-05190189-a304-4d8b-9914-7021a28d8d4a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 HTTP/1.1 May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 could not be found. May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'd240c27b-8a6b-4c15-ac5b-d9a7e5beda94'} May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 could not be found. May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:56.148270 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 could not be found. May 28 04:52:56.153584 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.153584 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:56.153584 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.153584 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.153584 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:56.153584 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:56.153584 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:56.153584 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:56.153584 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 could not be found. May 28 04:52:56.153584 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.153584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-05190189-a304-4d8b-9914-7021a28d8d4a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:56.153584 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-05190189-a304-4d8b-9914-7021a28d8d4a tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 404 len: 111 microversion: 2.1 time: 0.051932 May 28 04:52:56.154580 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2377/4656] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:52:56 2022] DELETE /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:56.160931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c9723e9b-cea3-4c6f-8a29-1024771a1fa3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:56.161869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c9723e9b-cea3-4c6f-8a29-1024771a1fa3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:56.169510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9723e9b-cea3-4c6f-8a29-1024771a1fa3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.169979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9723e9b-cea3-4c6f-8a29-1024771a1fa3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.170814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9723e9b-cea3-4c6f-8a29-1024771a1fa3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.171306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9723e9b-cea3-4c6f-8a29-1024771a1fa3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.435686 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c9723e9b-cea3-4c6f-8a29-1024771a1fa3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:56.449724 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c9723e9b-cea3-4c6f-8a29-1024771a1fa3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1314 microversion: 2.1 time: 0.294481 May 28 04:52:56.450309 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2378/4657] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:56 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:56.456269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a7733102-0b73-4d8b-89bf-4619e71d5c13 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:56.459035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a7733102-0b73-4d8b-89bf-4619e71d5c13 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: d240c27b-8a6b-4c15-ac5b-d9a7e5beda94] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:56.466063 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-cf73eb8a-a903-40b7-b3df-e25e6877376b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:52:56.466808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-cf73eb8a-a903-40b7-b3df-e25e6877376b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:52:56.468227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-cf73eb8a-a903-40b7-b3df-e25e6877376b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:52:56.469481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-cf73eb8a-a903-40b7-b3df-e25e6877376b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:52:56.470159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-cf73eb8a-a903-40b7-b3df-e25e6877376b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:52:56.470820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7733102-0b73-4d8b-89bf-4619e71d5c13 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.471855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7733102-0b73-4d8b-89bf-4619e71d5c13 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.477900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7733102-0b73-4d8b-89bf-4619e71d5c13 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.477900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7733102-0b73-4d8b-89bf-4619e71d5c13 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.484518 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf73eb8a-a903-40b7-b3df-e25e6877376b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.485236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf73eb8a-a903-40b7-b3df-e25e6877376b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.486559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf73eb8a-a903-40b7-b3df-e25e6877376b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.487923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf73eb8a-a903-40b7-b3df-e25e6877376b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.488137 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-a7733102-0b73-4d8b-89bf-4619e71d5c13 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 could not be found. May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a7733102-0b73-4d8b-89bf-4619e71d5c13 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 HTTP/1.1 May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 could not be found. May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'd240c27b-8a6b-4c15-ac5b-d9a7e5beda94'} May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 could not be found. May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 could not be found. May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.489881 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.496054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:56.496054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:56.496054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:56.496054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:56.496054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 could not be found. May 28 04:52:56.496054 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.496054 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a7733102-0b73-4d8b-89bf-4619e71d5c13 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:56.496054 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a7733102-0b73-4d8b-89bf-4619e71d5c13 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94" status: 404 len: 111 microversion: 2.1 time: 0.042202 May 28 04:52:56.500794 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2379/4658] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:56 2022] GET /compute/v2.1/servers/d240c27b-8a6b-4c15-ac5b-d9a7e5beda94 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:56.512807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-720d52ad-fc32-4d86-96e5-3333162e5ee9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:56.512807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-720d52ad-fc32-4d86-96e5-3333162e5ee9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:56.525992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-cf73eb8a-a903-40b7-b3df-e25e6877376b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Getting quotas for project 2092b676e36e4cb88f1e9ec9cf861b1a. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:52:56.527544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-720d52ad-fc32-4d86-96e5-3333162e5ee9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.528102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-720d52ad-fc32-4d86-96e5-3333162e5ee9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.529719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-720d52ad-fc32-4d86-96e5-3333162e5ee9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.531472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-720d52ad-fc32-4d86-96e5-3333162e5ee9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.532431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-cf73eb8a-a903-40b7-b3df-e25e6877376b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Getting quotas for user 24a79b183ba14d3c8674b9ac0ffca2b3 and project 2092b676e36e4cb88f1e9ec9cf861b1a. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:52:56.546551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cf73eb8a-a903-40b7-b3df-e25e6877376b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:52:56.548949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cf73eb8a-a903-40b7-b3df-e25e6877376b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:52:56.553195 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-720d52ad-fc32-4d86-96e5-3333162e5ee9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff could not be found. May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-720d52ad-fc32-4d86-96e5-3333162e5ee9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff HTTP/1.1 May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff could not be found. May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '7698dfa6-fcc6-4aa9-869b-8772a97b29ff'} May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff could not be found. May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:56.554837 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff could not be found. May 28 04:52:56.560321 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.560321 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:56.560321 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.560321 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.560321 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:56.560321 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:56.560321 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:56.560321 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:56.560321 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff could not be found. May 28 04:52:56.560321 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.560321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-720d52ad-fc32-4d86-96e5-3333162e5ee9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:56.560321 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-720d52ad-fc32-4d86-96e5-3333162e5ee9 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 404 len: 111 microversion: 2.1 time: 0.056067 May 28 04:52:56.564996 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2380/4659] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:52:56 2022] DELETE /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:56.572611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d3850cb5-2fbf-4fe3-9344-fe873a497075 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:56.573525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d3850cb5-2fbf-4fe3-9344-fe873a497075 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 7698dfa6-fcc6-4aa9-869b-8772a97b29ff] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:56.582547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3850cb5-2fbf-4fe3-9344-fe873a497075 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.583516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3850cb5-2fbf-4fe3-9344-fe873a497075 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.584504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3850cb5-2fbf-4fe3-9344-fe873a497075 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.585832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3850cb5-2fbf-4fe3-9344-fe873a497075 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.613209 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-d3850cb5-2fbf-4fe3-9344-fe873a497075 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff could not be found. May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d3850cb5-2fbf-4fe3-9344-fe873a497075 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff HTTP/1.1 May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff could not be found. May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '7698dfa6-fcc6-4aa9-869b-8772a97b29ff'} May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff could not be found. May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff could not be found. May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.624220 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.633543 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:56.633543 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:56.633543 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:56.633543 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:56.633543 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff could not be found. May 28 04:52:56.633543 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.633543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d3850cb5-2fbf-4fe3-9344-fe873a497075 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance 7698dfa6-fcc6-4aa9-869b-8772a97b29ff could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:56.633543 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d3850cb5-2fbf-4fe3-9344-fe873a497075 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff" status: 404 len: 111 microversion: 2.1 time: 0.061769 May 28 04:52:56.633543 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2381/4660] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:56 2022] GET /compute/v2.1/servers/7698dfa6-fcc6-4aa9-869b-8772a97b29ff => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:52:56.640096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-23e6d3a1-9230-41e5-b2ac-86fcde470a8c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:56.641389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-23e6d3a1-9230-41e5-b2ac-86fcde470a8c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:56.649512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-23e6d3a1-9230-41e5-b2ac-86fcde470a8c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.650716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-23e6d3a1-9230-41e5-b2ac-86fcde470a8c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.651720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-23e6d3a1-9230-41e5-b2ac-86fcde470a8c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.652234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-23e6d3a1-9230-41e5-b2ac-86fcde470a8c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.669644 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-23e6d3a1-9230-41e5-b2ac-86fcde470a8c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance 4a73d352-1b6c-4221-872a-aee269b8c1ae could not be found. May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-23e6d3a1-9230-41e5-b2ac-86fcde470a8c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae HTTP/1.1 May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 4a73d352-1b6c-4221-872a-aee269b8c1ae could not be found. May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '4a73d352-1b6c-4221-872a-aee269b8c1ae'} May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a73d352-1b6c-4221-872a-aee269b8c1ae could not be found. May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:56.671280 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a73d352-1b6c-4221-872a-aee269b8c1ae could not be found. May 28 04:52:56.682170 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.682170 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:56.682170 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.682170 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.682170 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:56.682170 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:56.682170 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:56.682170 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:56.682170 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a73d352-1b6c-4221-872a-aee269b8c1ae could not be found. May 28 04:52:56.682170 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.682170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-23e6d3a1-9230-41e5-b2ac-86fcde470a8c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance 4a73d352-1b6c-4221-872a-aee269b8c1ae could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:56.682170 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-23e6d3a1-9230-41e5-b2ac-86fcde470a8c tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 404 len: 111 microversion: 2.1 time: 0.037878 May 28 04:52:56.682170 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2382/4661] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:52:56 2022] DELETE /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:56.691299 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cf73eb8a-a903-40b7-b3df-e25e6877376b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.958246 May 28 04:52:56.693216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9f128c99-a7d4-4ac7-8076-131fb40bce25 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:56.694946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9f128c99-a7d4-4ac7-8076-131fb40bce25 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:56.696885 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2280/4662] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:52:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:52:56.702089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-de3bc185-769a-4fb0-a709-96641e3b6ec2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:56.703321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f128c99-a7d4-4ac7-8076-131fb40bce25 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.703792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f128c99-a7d4-4ac7-8076-131fb40bce25 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.704464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-de3bc185-769a-4fb0-a709-96641e3b6ec2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 4a73d352-1b6c-4221-872a-aee269b8c1ae] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:56.704710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f128c99-a7d4-4ac7-8076-131fb40bce25 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.705164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f128c99-a7d4-4ac7-8076-131fb40bce25 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.717709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de3bc185-769a-4fb0-a709-96641e3b6ec2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.735334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de3bc185-769a-4fb0-a709-96641e3b6ec2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.737299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de3bc185-769a-4fb0-a709-96641e3b6ec2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.740004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de3bc185-769a-4fb0-a709-96641e3b6ec2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.759533 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-de3bc185-769a-4fb0-a709-96641e3b6ec2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance 4a73d352-1b6c-4221-872a-aee269b8c1ae could not be found. May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-de3bc185-769a-4fb0-a709-96641e3b6ec2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae HTTP/1.1 May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 4a73d352-1b6c-4221-872a-aee269b8c1ae could not be found. May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '4a73d352-1b6c-4221-872a-aee269b8c1ae'} May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a73d352-1b6c-4221-872a-aee269b8c1ae could not be found. May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a73d352-1b6c-4221-872a-aee269b8c1ae could not be found. May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:56.766406 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.772263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:56.772263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:56.772263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:56.772263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:56.772263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a73d352-1b6c-4221-872a-aee269b8c1ae could not be found. May 28 04:52:56.772263 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:56.772263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-de3bc185-769a-4fb0-a709-96641e3b6ec2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance 4a73d352-1b6c-4221-872a-aee269b8c1ae could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:56.772829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f128c99-a7d4-4ac7-8076-131fb40bce25 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.772829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f128c99-a7d4-4ac7-8076-131fb40bce25 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.772829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-9f128c99-a7d4-4ac7-8076-131fb40bce25 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lazy-loading 'fault' on Instance uuid 50d15725-d599-410b-8d4d-d4460a1d96b6 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:52:56.773194 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-de3bc185-769a-4fb0-a709-96641e3b6ec2 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae" status: 404 len: 111 microversion: 2.1 time: 0.072497 May 28 04:52:56.775392 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2281/4663] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:56 2022] GET /compute/v2.1/servers/4a73d352-1b6c-4221-872a-aee269b8c1ae => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:56.780705 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-80bbd0cc-1080-4b9e-b053-becd9fd3085d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:56.783491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-80bbd0cc-1080-4b9e-b053-becd9fd3085d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:56.848924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-80bbd0cc-1080-4b9e-b053-becd9fd3085d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:56.858392 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-80bbd0cc-1080-4b9e-b053-becd9fd3085d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 200 len: 1215 microversion: 2.1 time: 0.081603 May 28 04:52:56.872754 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2282/4664] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:56 2022] GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:56.878446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-06e43933-b028-4fcf-8822-69ec5ff77c7a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:56.880247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-06e43933-b028-4fcf-8822-69ec5ff77c7a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:56.888169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06e43933-b028-4fcf-8822-69ec5ff77c7a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.888918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06e43933-b028-4fcf-8822-69ec5ff77c7a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.889881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06e43933-b028-4fcf-8822-69ec5ff77c7a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.891098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06e43933-b028-4fcf-8822-69ec5ff77c7a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.895713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9f128c99-a7d4-4ac7-8076-131fb40bce25 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025cb09c79a147b3a648c950edcd1dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7c34036184ea8b80241695fdbf329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:56.910936 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9f128c99-a7d4-4ac7-8076-131fb40bce25 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 200 len: 1331 microversion: 2.1 time: 0.230758 May 28 04:52:56.915419 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2383/4665] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:56 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 1331 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:56.925946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e31b3d6f-4098-4b78-9a34-de44a93ddc7b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:56.926518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e31b3d6f-4098-4b78-9a34-de44a93ddc7b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:56.947341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e31b3d6f-4098-4b78-9a34-de44a93ddc7b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.947789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e31b3d6f-4098-4b78-9a34-de44a93ddc7b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.962818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e31b3d6f-4098-4b78-9a34-de44a93ddc7b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:56.964081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e31b3d6f-4098-4b78-9a34-de44a93ddc7b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:56.986628 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-e31b3d6f-4098-4b78-9a34-de44a93ddc7b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d could not be found. May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e31b3d6f-4098-4b78-9a34-de44a93ddc7b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d HTTP/1.1 May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d could not be found. May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '393747a2-794a-4b7a-8c05-a1e99fd68d0d'} May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d could not be found. May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:56.988706 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d could not be found. May 28 04:52:56.993108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.993108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:56.993108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:56.993108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:56.993108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:56.993108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:56.993108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:56.993108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:56.993108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d could not be found. May 28 04:52:56.993108 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.001281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e31b3d6f-4098-4b78-9a34-de44a93ddc7b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:57.001281 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e31b3d6f-4098-4b78-9a34-de44a93ddc7b tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "DELETE /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d" status: 404 len: 111 microversion: 2.1 time: 0.081319 May 28 04:52:57.001281 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2384/4666] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:52:56 2022] DELETE /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:57.010550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e1485f31-8887-4d03-8803-ad458850cebb tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:57.011630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e1485f31-8887-4d03-8803-ad458850cebb tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 393747a2-794a-4b7a-8c05-a1e99fd68d0d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:57.020434 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1485f31-8887-4d03-8803-ad458850cebb tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:57.021340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1485f31-8887-4d03-8803-ad458850cebb tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:57.022371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1485f31-8887-4d03-8803-ad458850cebb tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:57.023086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1485f31-8887-4d03-8803-ad458850cebb tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:57.065505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:52:57.069937 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-e1485f31-8887-4d03-8803-ad458850cebb tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d could not be found. May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e1485f31-8887-4d03-8803-ad458850cebb tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d HTTP/1.1 May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d could not be found. May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '393747a2-794a-4b7a-8c05-a1e99fd68d0d'} May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d could not be found. May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d could not be found. May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.075528 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.080929 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:57.080929 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:57.080929 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:57.080929 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:57.080929 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d could not be found. May 28 04:52:57.080929 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.080929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e1485f31-8887-4d03-8803-ad458850cebb tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance 393747a2-794a-4b7a-8c05-a1e99fd68d0d could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:57.080929 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e1485f31-8887-4d03-8803-ad458850cebb tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d" status: 404 len: 111 microversion: 2.1 time: 0.076646 May 28 04:52:57.087180 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2385/4667] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:57 2022] GET /compute/v2.1/servers/393747a2-794a-4b7a-8c05-a1e99fd68d0d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:57.097540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5373b160-2866-43f1-828c-675ed357a7a6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:57.102543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5373b160-2866-43f1-828c-675ed357a7a6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:57.123282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5373b160-2866-43f1-828c-675ed357a7a6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:57.124103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5373b160-2866-43f1-828c-675ed357a7a6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:57.127637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5373b160-2866-43f1-828c-675ed357a7a6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:57.128819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5373b160-2866-43f1-828c-675ed357a7a6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:57.165235 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-5373b160-2866-43f1-828c-675ed357a7a6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance 048721a7-0662-4ac7-b56f-03d3a623391d could not be found. May 28 04:52:57.172525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-06e43933-b028-4fcf-8822-69ec5ff77c7a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5373b160-2866-43f1-828c-675ed357a7a6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d HTTP/1.1 May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 048721a7-0662-4ac7-b56f-03d3a623391d could not be found. May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '048721a7-0662-4ac7-b56f-03d3a623391d'} May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 048721a7-0662-4ac7-b56f-03d3a623391d could not be found. May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:57.172672 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 048721a7-0662-4ac7-b56f-03d3a623391d could not be found. May 28 04:52:57.178568 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.178568 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:57.178568 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.178568 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.178568 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:57.178568 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:57.178568 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:57.178568 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:57.178568 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 048721a7-0662-4ac7-b56f-03d3a623391d could not be found. May 28 04:52:57.178568 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.178568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5373b160-2866-43f1-828c-675ed357a7a6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance 048721a7-0662-4ac7-b56f-03d3a623391d could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:57.178568 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5373b160-2866-43f1-828c-675ed357a7a6 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "DELETE /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d" status: 404 len: 111 microversion: 2.1 time: 0.087570 May 28 04:52:57.181320 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2386/4668] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:52:57 2022] DELETE /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:57.184949 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-06e43933-b028-4fcf-8822-69ec5ff77c7a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.310665 May 28 04:52:57.186329 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2283/4669] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:56 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:57.192469 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a5cebcb9-c4d0-47e9-85ac-56466015a213 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:57.193109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a5cebcb9-c4d0-47e9-85ac-56466015a213 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 048721a7-0662-4ac7-b56f-03d3a623391d] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:57.206425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5cebcb9-c4d0-47e9-85ac-56466015a213 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:57.206906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5cebcb9-c4d0-47e9-85ac-56466015a213 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:57.207682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5cebcb9-c4d0-47e9-85ac-56466015a213 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:57.208138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5cebcb9-c4d0-47e9-85ac-56466015a213 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:57.247902 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-a5cebcb9-c4d0-47e9-85ac-56466015a213 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance 048721a7-0662-4ac7-b56f-03d3a623391d could not be found. May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a5cebcb9-c4d0-47e9-85ac-56466015a213 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d HTTP/1.1 May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 048721a7-0662-4ac7-b56f-03d3a623391d could not be found. May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '048721a7-0662-4ac7-b56f-03d3a623391d'} May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 048721a7-0662-4ac7-b56f-03d3a623391d could not be found. May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 048721a7-0662-4ac7-b56f-03d3a623391d could not be found. May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.250647 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.258854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:57.258854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:57.258854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:57.258854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:57.258854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 048721a7-0662-4ac7-b56f-03d3a623391d could not be found. May 28 04:52:57.258854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.258854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a5cebcb9-c4d0-47e9-85ac-56466015a213 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance 048721a7-0662-4ac7-b56f-03d3a623391d could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:57.258854 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a5cebcb9-c4d0-47e9-85ac-56466015a213 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d" status: 404 len: 111 microversion: 2.1 time: 0.071017 May 28 04:52:57.258854 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2387/4670] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:57 2022] GET /compute/v2.1/servers/048721a7-0662-4ac7-b56f-03d3a623391d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:57.264781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f0650118-c6d2-49aa-93da-74cb6b3de6e5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:57.264781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f0650118-c6d2-49aa-93da-74cb6b3de6e5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:57.271003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0650118-c6d2-49aa-93da-74cb6b3de6e5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:57.271395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0650118-c6d2-49aa-93da-74cb6b3de6e5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:57.272185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0650118-c6d2-49aa-93da-74cb6b3de6e5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:57.272628 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0650118-c6d2-49aa-93da-74cb6b3de6e5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:57.296311 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-f0650118-c6d2-49aa-93da-74cb6b3de6e5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance 0341fb99-a637-4739-b319-b6b0b39b71b0 could not be found. May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f0650118-c6d2-49aa-93da-74cb6b3de6e5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 HTTP/1.1 May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 0341fb99-a637-4739-b319-b6b0b39b71b0 could not be found. May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '0341fb99-a637-4739-b319-b6b0b39b71b0'} May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0341fb99-a637-4739-b319-b6b0b39b71b0 could not be found. May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:57.298556 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0341fb99-a637-4739-b319-b6b0b39b71b0 could not be found. May 28 04:52:57.304533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:57.304533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:57.304533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:57.304533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.304533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:57.304533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:57.304533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:57.304533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:57.304533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0341fb99-a637-4739-b319-b6b0b39b71b0 could not be found. May 28 04:52:57.304533 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:57.304533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f0650118-c6d2-49aa-93da-74cb6b3de6e5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance 0341fb99-a637-4739-b319-b6b0b39b71b0 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:57.304533 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f0650118-c6d2-49aa-93da-74cb6b3de6e5 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 404 len: 111 microversion: 2.1 time: 0.042287 May 28 04:52:57.304533 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2284/4671] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:52:57 2022] DELETE /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:57.308587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-45b8890c-fc5a-48b3-9223-36958a5756fb tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:57.309419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-45b8890c-fc5a-48b3-9223-36958a5756fb tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 0341fb99-a637-4739-b319-b6b0b39b71b0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:57.316717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45b8890c-fc5a-48b3-9223-36958a5756fb tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:57.317396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45b8890c-fc5a-48b3-9223-36958a5756fb tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:57.318399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45b8890c-fc5a-48b3-9223-36958a5756fb tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:57.318832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45b8890c-fc5a-48b3-9223-36958a5756fb tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:57.335931 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-45b8890c-fc5a-48b3-9223-36958a5756fb tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance 0341fb99-a637-4739-b319-b6b0b39b71b0 could not be found. May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-45b8890c-fc5a-48b3-9223-36958a5756fb tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 HTTP/1.1 May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 0341fb99-a637-4739-b319-b6b0b39b71b0 could not be found. May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '0341fb99-a637-4739-b319-b6b0b39b71b0'} May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0341fb99-a637-4739-b319-b6b0b39b71b0 could not be found. May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0341fb99-a637-4739-b319-b6b0b39b71b0 could not be found. May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.337989 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.347275 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:57.347275 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:57.347275 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:57.347275 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:57.347275 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0341fb99-a637-4739-b319-b6b0b39b71b0 could not be found. May 28 04:52:57.347275 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.347275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-45b8890c-fc5a-48b3-9223-36958a5756fb tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance 0341fb99-a637-4739-b319-b6b0b39b71b0 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:57.347275 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-45b8890c-fc5a-48b3-9223-36958a5756fb tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0" status: 404 len: 111 microversion: 2.1 time: 0.034690 May 28 04:52:57.347275 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2388/4672] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:57 2022] GET /compute/v2.1/servers/0341fb99-a637-4739-b319-b6b0b39b71b0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:57.348330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f8d7528c-c273-4051-bb4a-20071b5ba332 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:57.349374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f8d7528c-c273-4051-bb4a-20071b5ba332 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 2cba10b0-cc7c-4961-b56a-70f0eccf0333] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:57.356617 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-f8d7528c-c273-4051-bb4a-20071b5ba332 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance 2cba10b0-cc7c-4961-b56a-70f0eccf0333 could not be found. May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f8d7528c-c273-4051-bb4a-20071b5ba332 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/2cba10b0-cc7c-4961-b56a-70f0eccf0333 HTTP/1.1 May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 2cba10b0-cc7c-4961-b56a-70f0eccf0333 could not be found. May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '2cba10b0-cc7c-4961-b56a-70f0eccf0333'} May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cba10b0-cc7c-4961-b56a-70f0eccf0333 could not be found. May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cba10b0-cc7c-4961-b56a-70f0eccf0333 could not be found. May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:57.358239 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:57.367801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.367801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:57.367801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:57.367801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:57.367801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:57.367801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cba10b0-cc7c-4961-b56a-70f0eccf0333 could not be found. May 28 04:52:57.367801 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:52:57.367801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f8d7528c-c273-4051-bb4a-20071b5ba332 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance 2cba10b0-cc7c-4961-b56a-70f0eccf0333 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:57.367801 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f8d7528c-c273-4051-bb4a-20071b5ba332 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2cba10b0-cc7c-4961-b56a-70f0eccf0333" status: 404 len: 111 microversion: 2.1 time: 0.015632 May 28 04:52:57.367801 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2285/4673] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:52:57 2022] DELETE /compute/v2.1/servers/2cba10b0-cc7c-4961-b56a-70f0eccf0333 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:52:57.377089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8df559d3-2eb2-471d-aca2-68720ca6072e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:57.377800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8df559d3-2eb2-471d-aca2-68720ca6072e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 2cba10b0-cc7c-4961-b56a-70f0eccf0333] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:57.387915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-1138a60b-d075-4bba-981b-c54991e79083 req-dee8bdec-0887-4c2a-8b7e-765d24257712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3087299d-554e-4c36-8eb4-3082257b7e65", "name": "network-vif-plugged", "status": "completed", "tag": "8a7a1ead-8e33-447e-840c-7789196d4eee"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:52:57.398400 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-8df559d3-2eb2-471d-aca2-68720ca6072e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance 2cba10b0-cc7c-4961-b56a-70f0eccf0333 could not be found. May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8df559d3-2eb2-471d-aca2-68720ca6072e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/2cba10b0-cc7c-4961-b56a-70f0eccf0333 HTTP/1.1 May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 2cba10b0-cc7c-4961-b56a-70f0eccf0333 could not be found. May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '2cba10b0-cc7c-4961-b56a-70f0eccf0333'} May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cba10b0-cc7c-4961-b56a-70f0eccf0333 could not be found. May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cba10b0-cc7c-4961-b56a-70f0eccf0333 could not be found. May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:57.401284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:57.407017 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:57.407017 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:57.407017 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cba10b0-cc7c-4961-b56a-70f0eccf0333 could not be found. May 28 04:52:57.407017 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.407017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8df559d3-2eb2-471d-aca2-68720ca6072e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance 2cba10b0-cc7c-4961-b56a-70f0eccf0333 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:57.407017 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8df559d3-2eb2-471d-aca2-68720ca6072e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/2cba10b0-cc7c-4961-b56a-70f0eccf0333" status: 404 len: 111 microversion: 2.1 time: 0.031667 May 28 04:52:57.407017 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2389/4674] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:57 2022] GET /compute/v2.1/servers/2cba10b0-cc7c-4961-b56a-70f0eccf0333 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:57.413485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9e286dda-0dd1-4d69-97ad-029757458f59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:57.415840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9e286dda-0dd1-4d69-97ad-029757458f59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 09a578bc-f131-4126-8426-6e97ab6178ba] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:57.418489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1138a60b-d075-4bba-981b-c54991e79083 req-dee8bdec-0887-4c2a-8b7e-765d24257712 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:57.418947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1138a60b-d075-4bba-981b-c54991e79083 req-dee8bdec-0887-4c2a-8b7e-765d24257712 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:57.433199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e286dda-0dd1-4d69-97ad-029757458f59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:57.433749 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-1138a60b-d075-4bba-981b-c54991e79083 req-dee8bdec-0887-4c2a-8b7e-765d24257712 service nova] Creating event network-vif-plugged:8a7a1ead-8e33-447e-840c-7789196d4eee for instance 3087299d-554e-4c36-8eb4-3082257b7e65 on n-h2-843700-1 May 28 04:52:57.433885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e286dda-0dd1-4d69-97ad-029757458f59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:57.434915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e286dda-0dd1-4d69-97ad-029757458f59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:57.435563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e286dda-0dd1-4d69-97ad-029757458f59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:57.441683 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-1138a60b-d075-4bba-981b-c54991e79083 req-dee8bdec-0887-4c2a-8b7e-765d24257712 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058322 May 28 04:52:57.444649 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2286/4675] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:52:57.469520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-77066a64-0e5b-49f8-90f0-a8b8ba972ac4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:57.470555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-77066a64-0e5b-49f8-90f0-a8b8ba972ac4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:57.470915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9e286dda-0dd1-4d69-97ad-029757458f59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 09a578bc-f131-4126-8426-6e97ab6178ba] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:52:57.480175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77066a64-0e5b-49f8-90f0-a8b8ba972ac4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:57.480646 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77066a64-0e5b-49f8-90f0-a8b8ba972ac4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:57.481441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77066a64-0e5b-49f8-90f0-a8b8ba972ac4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:57.482025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77066a64-0e5b-49f8-90f0-a8b8ba972ac4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:57.655907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-77066a64-0e5b-49f8-90f0-a8b8ba972ac4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:57.664511 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-77066a64-0e5b-49f8-90f0-a8b8ba972ac4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1314 microversion: 2.1 time: 0.200614 May 28 04:52:57.675407 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2287/4676] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:57 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:57.766920 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9e286dda-0dd1-4d69-97ad-029757458f59 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "DELETE /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba" status: 204 len: 0 microversion: 2.1 time: 0.358539 May 28 04:52:57.769512 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2390/4677] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:52:57 2022] DELETE /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:52:57.775843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-028bed1b-05d6-459d-ae8c-b3832ffb2493 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:57.776580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-028bed1b-05d6-459d-ae8c-b3832ffb2493 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 09a578bc-f131-4126-8426-6e97ab6178ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:57.783041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-028bed1b-05d6-459d-ae8c-b3832ffb2493 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:57.783467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-028bed1b-05d6-459d-ae8c-b3832ffb2493 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:57.784241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-028bed1b-05d6-459d-ae8c-b3832ffb2493 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:57.784677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-028bed1b-05d6-459d-ae8c-b3832ffb2493 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:57.886230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-020f0e07-3591-4c75-9d15-2dcf4837bffe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:57.886230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-020f0e07-3591-4c75-9d15-2dcf4837bffe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:57.957539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-020f0e07-3591-4c75-9d15-2dcf4837bffe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:57.964798 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-020f0e07-3591-4c75-9d15-2dcf4837bffe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 200 len: 1215 microversion: 2.1 time: 0.087150 May 28 04:52:57.966220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-028bed1b-05d6-459d-ae8c-b3832ffb2493 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:57.966688 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2391/4678] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:57 2022] GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:57.970594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bc397f3f-c605-4e2f-99a0-15d994de9fd8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:57.971309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bc397f3f-c605-4e2f-99a0-15d994de9fd8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:57.974109 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-028bed1b-05d6-459d-ae8c-b3832ffb2493 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba" status: 200 len: 1479 microversion: 2.1 time: 0.202290 May 28 04:52:57.974688 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2288/4679] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:57 2022] GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba => generated 1479 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:57.978960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bc397f3f-c605-4e2f-99a0-15d994de9fd8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:57.979723 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bc397f3f-c605-4e2f-99a0-15d994de9fd8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:57.980500 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bc397f3f-c605-4e2f-99a0-15d994de9fd8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:57.980944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bc397f3f-c605-4e2f-99a0-15d994de9fd8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:57.994924 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-bc397f3f-c605-4e2f-99a0-15d994de9fd8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] HTTP exception thrown: Instance 50d15725-d599-410b-8d4d-d4460a1d96b6 could not be found. May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bc397f3f-c605-4e2f-99a0-15d994de9fd8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Request method failure captured: May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 HTTP/1.1 May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikajS0ZZaXFlax6A342ymJ-aQoGJlvna1xZy9bO84b3D9OriaYICvIupIZdjiNLcHyTC7V-bCXuJxYAHanDCccz0wxij-I7blA2wa6CB5mbuJxMVXKjiUcQwy4f7KRJtSQW8-6D6CRl3EsAa-9i5aRJ6Odwpn_PfoRh6K409eAlefhoM May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 025cb09c79a147b3a648c950edcd1dc3 May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 50d15725-d599-410b-8d4d-d4460a1d96b6 could not be found. May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '50d15725-d599-410b-8d4d-d4460a1d96b6'} May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50d15725-d599-410b-8d4d-d4460a1d96b6 could not be found. May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50d15725-d599-410b-8d4d-d4460a1d96b6 could not be found. May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:52:57.996663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:58.002427 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:52:58.002427 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:52:58.002427 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:52:58.002427 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:52:58.002427 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:52:58.002427 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50d15725-d599-410b-8d4d-d4460a1d96b6 could not be found. May 28 04:52:58.002427 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:52:58.002427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bc397f3f-c605-4e2f-99a0-15d994de9fd8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Returning 404 to user: Instance 50d15725-d599-410b-8d4d-d4460a1d96b6 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:52:58.002427 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bc397f3f-c605-4e2f-99a0-15d994de9fd8 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 404 len: 111 microversion: 2.1 time: 0.031837 May 28 04:52:58.002427 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2392/4680] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:57 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:52:58.010932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4a421e66-6e4f-44e0-9ad7-d5e3d30665c9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '.version_select at 0x7f7700550670>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:58.101489 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4a421e66-6e4f-44e0-9ad7-d5e3d30665c9 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1160742859" status: 202 len: 0 microversion: 2.1 time: 0.097716 May 28 04:52:58.102100 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2289/4681] 10.222.0.58 () {58 vars in 1220 bytes} [Sat May 28 04:52:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1160742859 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:52:58.208925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ae88a53c-aa8c-48e3-a666-feb518634a36 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:58.209681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ae88a53c-aa8c-48e3-a666-feb518634a36 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:58.219807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae88a53c-aa8c-48e3-a666-feb518634a36 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:58.220508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae88a53c-aa8c-48e3-a666-feb518634a36 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:58.221487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae88a53c-aa8c-48e3-a666-feb518634a36 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:58.222042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae88a53c-aa8c-48e3-a666-feb518634a36 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:58.681621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-64c64735-2b24-411b-9af7-760a6583f3ee tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:58.682441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-64c64735-2b24-411b-9af7-760a6583f3ee tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:58.690016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-64c64735-2b24-411b-9af7-760a6583f3ee tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:58.690756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-64c64735-2b24-411b-9af7-760a6583f3ee tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:58.692089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-64c64735-2b24-411b-9af7-760a6583f3ee tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:58.692710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-64c64735-2b24-411b-9af7-760a6583f3ee tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:58.793249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ae88a53c-aa8c-48e3-a666-feb518634a36 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:58.798574 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ae88a53c-aa8c-48e3-a666-feb518634a36 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.597169 May 28 04:52:58.801261 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2393/4682] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:58 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:58.978936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-64c64735-2b24-411b-9af7-760a6583f3ee tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:58.983647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-475bb4f3-bd6b-449f-86dc-b510b2193054 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:58.984498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-475bb4f3-bd6b-449f-86dc-b510b2193054 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:58.990551 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-64c64735-2b24-411b-9af7-760a6583f3ee tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1314 microversion: 2.1 time: 0.312615 May 28 04:52:59.001694 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2290/4683] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:58 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:52:59.001841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-475bb4f3-bd6b-449f-86dc-b510b2193054 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:59.002652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-475bb4f3-bd6b-449f-86dc-b510b2193054 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:59.004113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-475bb4f3-bd6b-449f-86dc-b510b2193054 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:59.004722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-475bb4f3-bd6b-449f-86dc-b510b2193054 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:59.007371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f6cbeb91-8587-4859-91aa-9e85180dfd8e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:59.008004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f6cbeb91-8587-4859-91aa-9e85180dfd8e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 09a578bc-f131-4126-8426-6e97ab6178ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:59.041504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6cbeb91-8587-4859-91aa-9e85180dfd8e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:59.041504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6cbeb91-8587-4859-91aa-9e85180dfd8e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:59.041504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6cbeb91-8587-4859-91aa-9e85180dfd8e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:59.041504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6cbeb91-8587-4859-91aa-9e85180dfd8e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:59.120119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-475bb4f3-bd6b-449f-86dc-b510b2193054 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:59.133836 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-475bb4f3-bd6b-449f-86dc-b510b2193054 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 200 len: 1267 microversion: 2.1 time: 0.155881 May 28 04:52:59.144971 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2394/4684] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:58 2022] GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:59.384178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f6cbeb91-8587-4859-91aa-9e85180dfd8e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:52:59.393843 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f6cbeb91-8587-4859-91aa-9e85180dfd8e tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba" status: 200 len: 1479 microversion: 2.1 time: 0.400346 May 28 04:52:59.402314 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2291/4685] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:58 2022] GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba => generated 1479 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:52:59.815692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b970eaa1-969c-4579-ac5e-7007bb8a6bb7 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:52:59.817250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b970eaa1-969c-4579-ac5e-7007bb8a6bb7 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:52:59.824425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b970eaa1-969c-4579-ac5e-7007bb8a6bb7 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:59.825152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b970eaa1-969c-4579-ac5e-7007bb8a6bb7 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:52:59.826108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b970eaa1-969c-4579-ac5e-7007bb8a6bb7 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:52:59.826723 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b970eaa1-969c-4579-ac5e-7007bb8a6bb7 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:00.009954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9e9b85fb-351b-49f0-a7d7-dd333b1508b9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:00.010597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9e9b85fb-351b-49f0-a7d7-dd333b1508b9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:00.027212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e9b85fb-351b-49f0-a7d7-dd333b1508b9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:00.027212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e9b85fb-351b-49f0-a7d7-dd333b1508b9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:00.027212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e9b85fb-351b-49f0-a7d7-dd333b1508b9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:00.027212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e9b85fb-351b-49f0-a7d7-dd333b1508b9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:00.117488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b970eaa1-969c-4579-ac5e-7007bb8a6bb7 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:00.128901 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b970eaa1-969c-4579-ac5e-7007bb8a6bb7 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.315396 May 28 04:53:00.130525 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2395/4686] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:52:59 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:00.152141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-55a4d785-2105-47f3-a55f-4ae9d50d80a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:00.153243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-55a4d785-2105-47f3-a55f-4ae9d50d80a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:00.180335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55a4d785-2105-47f3-a55f-4ae9d50d80a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:00.181369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55a4d785-2105-47f3-a55f-4ae9d50d80a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:00.182360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55a4d785-2105-47f3-a55f-4ae9d50d80a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:00.183162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55a4d785-2105-47f3-a55f-4ae9d50d80a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:00.287300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9e9b85fb-351b-49f0-a7d7-dd333b1508b9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:00.297154 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9e9b85fb-351b-49f0-a7d7-dd333b1508b9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1314 microversion: 2.1 time: 0.291762 May 28 04:53:00.300741 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2292/4687] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:00 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:00.321076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-55a4d785-2105-47f3-a55f-4ae9d50d80a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:00.332329 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-55a4d785-2105-47f3-a55f-4ae9d50d80a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 200 len: 1273 microversion: 2.1 time: 0.184673 May 28 04:53:00.334054 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2396/4688] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:00 2022] GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 1273 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:00.412380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6ebd3b15-db45-4f24-8117-d4647f68a5bc tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:00.413256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6ebd3b15-db45-4f24-8117-d4647f68a5bc tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 09a578bc-f131-4126-8426-6e97ab6178ba] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:00.433275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ebd3b15-db45-4f24-8117-d4647f68a5bc tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:00.434004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ebd3b15-db45-4f24-8117-d4647f68a5bc tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:00.435746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ebd3b15-db45-4f24-8117-d4647f68a5bc tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:00.436382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ebd3b15-db45-4f24-8117-d4647f68a5bc tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:00.766559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6ebd3b15-db45-4f24-8117-d4647f68a5bc tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6b3ac5a4249fd8f76fb2e7e2b6c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724a5513bc2c42eabbefa450e207453e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:00.778975 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6ebd3b15-db45-4f24-8117-d4647f68a5bc tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba" status: 200 len: 1479 microversion: 2.1 time: 0.371204 May 28 04:53:00.781617 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2293/4689] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:00 2022] GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba => generated 1479 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:00.937357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-12789bd9-74f1-4dca-9ed2-4ec5f621b84a req-8f961dee-9fb0-4e5d-8b48-6b3b88113098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a578bc-f131-4126-8426-6e97ab6178ba", "name": "network-vif-deleted", "tag": "3355de16-9985-4732-975a-4a210f1700b2"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:00.947472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-12789bd9-74f1-4dca-9ed2-4ec5f621b84a req-8f961dee-9fb0-4e5d-8b48-6b3b88113098 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:00.948175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-12789bd9-74f1-4dca-9ed2-4ec5f621b84a req-8f961dee-9fb0-4e5d-8b48-6b3b88113098 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:00.961292 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-12789bd9-74f1-4dca-9ed2-4ec5f621b84a req-8f961dee-9fb0-4e5d-8b48-6b3b88113098 service nova] Creating event network-vif-deleted:3355de16-9985-4732-975a-4a210f1700b2 for instance 09a578bc-f131-4126-8426-6e97ab6178ba on n-h2-843700-1 May 28 04:53:00.967698 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-12789bd9-74f1-4dca-9ed2-4ec5f621b84a req-8f961dee-9fb0-4e5d-8b48-6b3b88113098 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034544 May 28 04:53:00.975592 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2397/4690] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:01.151193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7c3e8d1a-2096-4734-a17b-19ec19bb528a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:01.155786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7c3e8d1a-2096-4734-a17b-19ec19bb528a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:01.160111 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c3e8d1a-2096-4734-a17b-19ec19bb528a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:01.160838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c3e8d1a-2096-4734-a17b-19ec19bb528a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:01.161801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c3e8d1a-2096-4734-a17b-19ec19bb528a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:01.162415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c3e8d1a-2096-4734-a17b-19ec19bb528a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:01.315401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0e587979-92af-4f03-9a7d-224250e966b7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:01.316364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0e587979-92af-4f03-9a7d-224250e966b7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:01.327240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0e587979-92af-4f03-9a7d-224250e966b7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:01.332503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0e587979-92af-4f03-9a7d-224250e966b7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:01.333268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0e587979-92af-4f03-9a7d-224250e966b7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:01.336801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0e587979-92af-4f03-9a7d-224250e966b7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:01.510979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7c3e8d1a-2096-4734-a17b-19ec19bb528a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:01.531941 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7c3e8d1a-2096-4734-a17b-19ec19bb528a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.386487 May 28 04:53:01.533630 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2294/4691] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:01 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:01.569763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-070a8040-1acb-4877-a041-f6dc05ba44c8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:01.571358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-070a8040-1acb-4877-a041-f6dc05ba44c8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:01.598892 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-070a8040-1acb-4877-a041-f6dc05ba44c8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:01.603840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-070a8040-1acb-4877-a041-f6dc05ba44c8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:01.610475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-070a8040-1acb-4877-a041-f6dc05ba44c8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:01.610475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-070a8040-1acb-4877-a041-f6dc05ba44c8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:01.684218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0e587979-92af-4f03-9a7d-224250e966b7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:01.696197 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0e587979-92af-4f03-9a7d-224250e966b7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1502 microversion: 2.1 time: 0.386252 May 28 04:53:01.698145 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2398/4692] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:01 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1502 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:01.703335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f0769665-511d-4306-9009-a58b4b7e2a33 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:01.707646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f0769665-511d-4306-9009-a58b4b7e2a33 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:01.723932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f0769665-511d-4306-9009-a58b4b7e2a33 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:01.724383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f0769665-511d-4306-9009-a58b4b7e2a33 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:01.725218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f0769665-511d-4306-9009-a58b4b7e2a33 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:01.725661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f0769665-511d-4306-9009-a58b4b7e2a33 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:01.977216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-070a8040-1acb-4877-a041-f6dc05ba44c8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:01.988979 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-070a8040-1acb-4877-a041-f6dc05ba44c8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 200 len: 1315 microversion: 2.1 time: 0.442100 May 28 04:53:01.994168 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2295/4693] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:01 2022] GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:02.017424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f1dee72c-c7cb-4b02-9a5b-2b56513f82d4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:02.018075 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f1dee72c-c7cb-4b02-9a5b-2b56513f82d4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:02.040465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1dee72c-c7cb-4b02-9a5b-2b56513f82d4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:02.040934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1dee72c-c7cb-4b02-9a5b-2b56513f82d4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:02.042636 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1dee72c-c7cb-4b02-9a5b-2b56513f82d4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:02.045819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1dee72c-c7cb-4b02-9a5b-2b56513f82d4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:02.089681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-f1dee72c-c7cb-4b02-9a5b-2b56513f82d4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lazy-loading 'flavor' on Instance uuid 3087299d-554e-4c36-8eb4-3082257b7e65 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:53:02.117636 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f0769665-511d-4306-9009-a58b4b7e2a33 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1836 microversion: 2.1 time: 0.417713 May 28 04:53:02.119729 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2399/4694] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:01 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1836 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:02.140456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ca0463d0-8540-4187-8b72-93b846ae4c24 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:02.140456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ca0463d0-8540-4187-8b72-93b846ae4c24 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] [instance: 09a578bc-f131-4126-8426-6e97ab6178ba] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:02.146339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca0463d0-8540-4187-8b72-93b846ae4c24 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:02.147214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca0463d0-8540-4187-8b72-93b846ae4c24 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:02.148177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca0463d0-8540-4187-8b72-93b846ae4c24 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:02.148785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca0463d0-8540-4187-8b72-93b846ae4c24 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:02.164667 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-ca0463d0-8540-4187-8b72-93b846ae4c24 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] HTTP exception thrown: Instance 09a578bc-f131-4126-8426-6e97ab6178ba could not be found. May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ca0463d0-8540-4187-8b72-93b846ae4c24 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Request method failure captured: May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba HTTP/1.1 May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikanCu5oPMlG8_1j0_Ie6-BcJXwkSQYNFnYSyrjLg-RxU-GxKvOFYV2vWgSVOMceg3TvVGCcF33q6m9JZLnFVeCsbicKkRdMSZgHbYsdcA7zgPkW99Sz0Fz2SyNgwyngahcWUJuprA_f7xN5qBZOsK638o6unu56GwvVVDV_PvwqEI3g May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersTestJSON-1606309756 May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/724a5513bc2c42eabbefa450e207453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersTestJSON-1606309756 May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 724a5513bc2c42eabbefa450e207453e May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersTestJSON-1606309756 May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersTestJSON-1606309756-project May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 71b6b3ac5a4249fd8f76fb2e7e2b6c18 May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersTestJSON-1606309756-project May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 09a578bc-f131-4126-8426-6e97ab6178ba could not be found. May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '09a578bc-f131-4126-8426-6e97ab6178ba'} May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09a578bc-f131-4126-8426-6e97ab6178ba could not be found. May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09a578bc-f131-4126-8426-6e97ab6178ba could not be found. May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:02.166348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:02.172829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:02.172829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:02.172829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:02.172829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:02.172829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09a578bc-f131-4126-8426-6e97ab6178ba could not be found. May 28 04:53:02.172829 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:02.172829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ca0463d0-8540-4187-8b72-93b846ae4c24 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] Returning 404 to user: Instance 09a578bc-f131-4126-8426-6e97ab6178ba could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:02.172829 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ca0463d0-8540-4187-8b72-93b846ae4c24 tempest-ServersTestJSON-1606309756 tempest-ServersTestJSON-1606309756-project] 10.222.0.58 "GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba" status: 404 len: 111 microversion: 2.1 time: 0.043941 May 28 04:53:02.172829 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2400/4695] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:02 2022] GET /compute/v2.1/servers/09a578bc-f131-4126-8426-6e97ab6178ba => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:53:02.550091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c408e554-044d-4c95-bab3-e95c2ebead87 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:02.551011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c408e554-044d-4c95-bab3-e95c2ebead87 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:02.557866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c408e554-044d-4c95-bab3-e95c2ebead87 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:02.558623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c408e554-044d-4c95-bab3-e95c2ebead87 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:02.559799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c408e554-044d-4c95-bab3-e95c2ebead87 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:02.560465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c408e554-044d-4c95-bab3-e95c2ebead87 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:02.902748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c408e554-044d-4c95-bab3-e95c2ebead87 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:02.919137 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c408e554-044d-4c95-bab3-e95c2ebead87 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.371684 May 28 04:53:02.921431 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2401/4696] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:02 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:02.931705 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-bb72e0f9-2007-4abe-b71f-b046cb115a6a req-63135010-2cd6-43cc-8485-ab8170f3d30b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90", "tag": "f82baeec-8a04-4b71-8524-5425d5f53a7d"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:02.945964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:02.948783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-bb72e0f9-2007-4abe-b71f-b046cb115a6a req-63135010-2cd6-43cc-8485-ab8170f3d30b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:02.953005 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-bb72e0f9-2007-4abe-b71f-b046cb115a6a req-63135010-2cd6-43cc-8485-ab8170f3d30b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:02.962926 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f1dee72c-c7cb-4b02-9a5b-2b56513f82d4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "POST /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65/action" status: 202 len: 0 microversion: 2.1 time: 0.964770 May 28 04:53:02.964086 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-bb72e0f9-2007-4abe-b71f-b046cb115a6a req-63135010-2cd6-43cc-8485-ab8170f3d30b service nova] Creating event network-changed:f82baeec-8a04-4b71-8524-5425d5f53a7d for instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 on n-h1-843700-1 May 28 04:53:02.974459 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2296/4697] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:53:01 2022] POST /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65/action => generated 0 bytes in 975 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:53:02.980498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2fba4af7-cfdd-4b58-a9e1-97a4c8c88f81 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:02.981210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2fba4af7-cfdd-4b58-a9e1-97a4c8c88f81 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:02.985918 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-bb72e0f9-2007-4abe-b71f-b046cb115a6a req-63135010-2cd6-43cc-8485-ab8170f3d30b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062587 May 28 04:53:02.989224 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2402/4698] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:03.003917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2fba4af7-cfdd-4b58-a9e1-97a4c8c88f81 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:03.004713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2fba4af7-cfdd-4b58-a9e1-97a4c8c88f81 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:03.005782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2fba4af7-cfdd-4b58-a9e1-97a4c8c88f81 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:03.015629 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2fba4af7-cfdd-4b58-a9e1-97a4c8c88f81 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:03.026199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a07de026-3c82-4130-b256-0ee9debeddab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:03.026199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a07de026-3c82-4130-b256-0ee9debeddab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:03.031266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a07de026-3c82-4130-b256-0ee9debeddab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:03.032031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a07de026-3c82-4130-b256-0ee9debeddab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:03.032926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a07de026-3c82-4130-b256-0ee9debeddab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:03.033555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a07de026-3c82-4130-b256-0ee9debeddab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:03.383267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a07de026-3c82-4130-b256-0ee9debeddab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:03.393654 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a07de026-3c82-4130-b256-0ee9debeddab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 200 len: 1315 microversion: 2.1 time: 0.388662 May 28 04:53:03.398031 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2403/4699] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:03 2022] GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:03.603178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2fba4af7-cfdd-4b58-a9e1-97a4c8c88f81 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:03.616696 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2fba4af7-cfdd-4b58-a9e1-97a4c8c88f81 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1508 microversion: 2.1 time: 0.637159 May 28 04:53:03.617532 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2297/4700] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:02 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1508 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:03.941017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-df052fa7-8876-4aa0-921e-d23cc0f53eb4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:03.941458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-df052fa7-8876-4aa0-921e-d23cc0f53eb4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:03.969393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df052fa7-8876-4aa0-921e-d23cc0f53eb4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:03.970925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df052fa7-8876-4aa0-921e-d23cc0f53eb4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:03.972756 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df052fa7-8876-4aa0-921e-d23cc0f53eb4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:03.973208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df052fa7-8876-4aa0-921e-d23cc0f53eb4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:04.413340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-488ce5c9-7d33-4f6a-9d52-0b06faded53a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:04.414722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-488ce5c9-7d33-4f6a-9d52-0b06faded53a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:04.426726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-488ce5c9-7d33-4f6a-9d52-0b06faded53a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:04.428801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-488ce5c9-7d33-4f6a-9d52-0b06faded53a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:04.432065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-488ce5c9-7d33-4f6a-9d52-0b06faded53a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:04.435049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-488ce5c9-7d33-4f6a-9d52-0b06faded53a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:05.205999 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-488ce5c9-7d33-4f6a-9d52-0b06faded53a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:05.217275 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-488ce5c9-7d33-4f6a-9d52-0b06faded53a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 200 len: 1315 microversion: 2.1 time: 0.808310 May 28 04:53:05.231738 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2298/4701] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:04 2022] GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 1315 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:05.245768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e529dcf4-8861-40be-972d-8d1892d5613c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:05.246685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e529dcf4-8861-40be-972d-8d1892d5613c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:05.260352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-df052fa7-8876-4aa0-921e-d23cc0f53eb4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:05.271458 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-df052fa7-8876-4aa0-921e-d23cc0f53eb4 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 1.337651 May 28 04:53:05.275496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e529dcf4-8861-40be-972d-8d1892d5613c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:05.276482 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2404/4702] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:03 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:05.282966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e529dcf4-8861-40be-972d-8d1892d5613c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:05.284076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e529dcf4-8861-40be-972d-8d1892d5613c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:05.284749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e529dcf4-8861-40be-972d-8d1892d5613c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:05.295306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e157a685-eb1e-4e75-a733-64d50b85cbd1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:05.296018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e157a685-eb1e-4e75-a733-64d50b85cbd1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:05.304323 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e157a685-eb1e-4e75-a733-64d50b85cbd1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:05.304787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e157a685-eb1e-4e75-a733-64d50b85cbd1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:05.305587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e157a685-eb1e-4e75-a733-64d50b85cbd1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:05.306099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e157a685-eb1e-4e75-a733-64d50b85cbd1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:05.321329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:05.338848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e157a685-eb1e-4e75-a733-64d50b85cbd1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:53:05.511834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:05.694062 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e157a685-eb1e-4e75-a733-64d50b85cbd1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "DELETE /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 204 len: 0 microversion: 2.1 time: 0.415898 May 28 04:53:05.695320 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2405/4703] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:53:05 2022] DELETE /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:53:05.701373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-809c74c0-faab-4e85-aedf-4bc18ef8b2a0 req-9b6074a5-8a08-48da-a166-ea1f75b6b5fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c89850-7792-485a-a6ba-79c3b19b5405", "tag": "281843f9-caf9-43ff-9ade-dc1bd3a73fd1"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:05.720521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-809c74c0-faab-4e85-aedf-4bc18ef8b2a0 req-9b6074a5-8a08-48da-a166-ea1f75b6b5fe service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:05.720976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-809c74c0-faab-4e85-aedf-4bc18ef8b2a0 req-9b6074a5-8a08-48da-a166-ea1f75b6b5fe service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:05.744090 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-809c74c0-faab-4e85-aedf-4bc18ef8b2a0 req-9b6074a5-8a08-48da-a166-ea1f75b6b5fe service nova] Creating event network-changed:281843f9-caf9-43ff-9ade-dc1bd3a73fd1 for instance 99c89850-7792-485a-a6ba-79c3b19b5405 on n-h2-843700-1 May 28 04:53:05.760145 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-809c74c0-faab-4e85-aedf-4bc18ef8b2a0 req-9b6074a5-8a08-48da-a166-ea1f75b6b5fe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062319 May 28 04:53:05.761078 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2406/4704] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:05.770609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e422dcc6-4862-4c4d-adb6-2756c9ad0755 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:05.771353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e422dcc6-4862-4c4d-adb6-2756c9ad0755 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:05.788592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e422dcc6-4862-4c4d-adb6-2756c9ad0755 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:05.790012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e422dcc6-4862-4c4d-adb6-2756c9ad0755 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:05.791955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e422dcc6-4862-4c4d-adb6-2756c9ad0755 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:05.792404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e422dcc6-4862-4c4d-adb6-2756c9ad0755 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:05.835017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e529dcf4-8861-40be-972d-8d1892d5613c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:05.844830 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e529dcf4-8861-40be-972d-8d1892d5613c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1508 microversion: 2.1 time: 0.611672 May 28 04:53:05.845434 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2299/4705] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:05 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1508 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:06.183435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e422dcc6-4862-4c4d-adb6-2756c9ad0755 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:06.193460 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e422dcc6-4862-4c4d-adb6-2756c9ad0755 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1691 microversion: 2.1 time: 0.431132 May 28 04:53:06.194303 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2407/4706] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:05 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1691 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:06.239747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c10dda81-5aeb-40b5-882c-6eecd15ea315 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:06.240417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c10dda81-5aeb-40b5-882c-6eecd15ea315 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:06.259575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c10dda81-5aeb-40b5-882c-6eecd15ea315 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:06.260044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c10dda81-5aeb-40b5-882c-6eecd15ea315 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:06.260851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c10dda81-5aeb-40b5-882c-6eecd15ea315 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:06.261286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c10dda81-5aeb-40b5-882c-6eecd15ea315 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:06.293244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-89ce519f-7d7d-4deb-aca7-d91fcafa9912 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:06.294633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-89ce519f-7d7d-4deb-aca7-d91fcafa9912 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:06.333365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89ce519f-7d7d-4deb-aca7-d91fcafa9912 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:06.334789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89ce519f-7d7d-4deb-aca7-d91fcafa9912 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:06.336336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89ce519f-7d7d-4deb-aca7-d91fcafa9912 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:06.338548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89ce519f-7d7d-4deb-aca7-d91fcafa9912 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:06.516099 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:06.716252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-89ce519f-7d7d-4deb-aca7-d91fcafa9912 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:06.726489 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-89ce519f-7d7d-4deb-aca7-d91fcafa9912 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1504 microversion: 2.1 time: 0.437255 May 28 04:53:06.736676 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2408/4707] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:06 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1504 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:06.766764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c10dda81-5aeb-40b5-882c-6eecd15ea315 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:06.797739 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c10dda81-5aeb-40b5-882c-6eecd15ea315 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 200 len: 1315 microversion: 2.1 time: 0.561194 May 28 04:53:06.799041 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2300/4708] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:06 2022] GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:06.870969 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2b3b170a-e7a1-4b13-8580-e83fcef87522 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:06.874757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2b3b170a-e7a1-4b13-8580-e83fcef87522 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:06.886432 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b3b170a-e7a1-4b13-8580-e83fcef87522 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:06.887227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b3b170a-e7a1-4b13-8580-e83fcef87522 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:06.888848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b3b170a-e7a1-4b13-8580-e83fcef87522 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:06.889473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b3b170a-e7a1-4b13-8580-e83fcef87522 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:07.093078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2b3b170a-e7a1-4b13-8580-e83fcef87522 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:07.101356 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2b3b170a-e7a1-4b13-8580-e83fcef87522 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1508 microversion: 2.1 time: 0.239108 May 28 04:53:07.101949 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2409/4709] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:06 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1508 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:07.212207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2f0ff87b-05c0-4c31-808a-ab8377983dae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:07.213610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2f0ff87b-05c0-4c31-808a-ab8377983dae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:07.219253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=8 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:07.225074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f0ff87b-05c0-4c31-808a-ab8377983dae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:07.225798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f0ff87b-05c0-4c31-808a-ab8377983dae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:07.226772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f0ff87b-05c0-4c31-808a-ab8377983dae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:07.227417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f0ff87b-05c0-4c31-808a-ab8377983dae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:07.469717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2f0ff87b-05c0-4c31-808a-ab8377983dae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:07.478816 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2f0ff87b-05c0-4c31-808a-ab8377983dae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1691 microversion: 2.1 time: 0.271289 May 28 04:53:07.479443 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2301/4710] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:07 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1691 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:07.746087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-169f0e09-bc14-4e23-ad2b-e5c579604bb0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:07.747742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-169f0e09-bc14-4e23-ad2b-e5c579604bb0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:07.760832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-169f0e09-bc14-4e23-ad2b-e5c579604bb0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:07.762701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-169f0e09-bc14-4e23-ad2b-e5c579604bb0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:07.764444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-169f0e09-bc14-4e23-ad2b-e5c579604bb0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:07.764936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-169f0e09-bc14-4e23-ad2b-e5c579604bb0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:07.815915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0ee3d19b-fcc7-407c-ba0a-a18d47ff1ead tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:07.816602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0ee3d19b-fcc7-407c-ba0a-a18d47ff1ead tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:07.823298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ee3d19b-fcc7-407c-ba0a-a18d47ff1ead tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:07.823974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ee3d19b-fcc7-407c-ba0a-a18d47ff1ead tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:07.824967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ee3d19b-fcc7-407c-ba0a-a18d47ff1ead tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:07.825422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ee3d19b-fcc7-407c-ba0a-a18d47ff1ead tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:07.962560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:08.026960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-169f0e09-bc14-4e23-ad2b-e5c579604bb0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:08.036697 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-169f0e09-bc14-4e23-ad2b-e5c579604bb0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1484 microversion: 2.1 time: 0.294394 May 28 04:53:08.037321 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2410/4711] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:07 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1484 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:08.075354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0ee3d19b-fcc7-407c-ba0a-a18d47ff1ead tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:08.087844 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0ee3d19b-fcc7-407c-ba0a-a18d47ff1ead tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 200 len: 1315 microversion: 2.1 time: 0.276568 May 28 04:53:08.095771 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2302/4712] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:07 2022] GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:08.127917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d12eeffd-2eae-4f72-bdc2-93fb6b538d40 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:08.127917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d12eeffd-2eae-4f72-bdc2-93fb6b538d40 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:08.138053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d12eeffd-2eae-4f72-bdc2-93fb6b538d40 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:08.138846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d12eeffd-2eae-4f72-bdc2-93fb6b538d40 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:08.140103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d12eeffd-2eae-4f72-bdc2-93fb6b538d40 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:08.142275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d12eeffd-2eae-4f72-bdc2-93fb6b538d40 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:08.288531 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4021c822-68a7-4c79-9ee1-6b608c14aedb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-528781009", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:08.355798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d12eeffd-2eae-4f72-bdc2-93fb6b538d40 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:08.368822 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d12eeffd-2eae-4f72-bdc2-93fb6b538d40 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1508 microversion: 2.1 time: 0.252820 May 28 04:53:08.375912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-4021c822-68a7-4c79-9ee1-6b608c14aedb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] validate_networks() for [('c40cfd3f-b8f6-4961-b680-d58c000ac161', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:53:08.380055 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2411/4713] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:08 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:08.500097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-439d565e-dad9-4f90-b956-638c52e0312c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:08.500866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-439d565e-dad9-4f90-b956-638c52e0312c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:08.516762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-439d565e-dad9-4f90-b956-638c52e0312c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:08.518014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-439d565e-dad9-4f90-b956-638c52e0312c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:08.520343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-439d565e-dad9-4f90-b956-638c52e0312c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:08.528572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-439d565e-dad9-4f90-b956-638c52e0312c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:09.319968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-4021c822-68a7-4c79-9ee1-6b608c14aedb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:53:09.320961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-4021c822-68a7-4c79-9ee1-6b608c14aedb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:53:09.321828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-4021c822-68a7-4c79-9ee1-6b608c14aedb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:53:09.322439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-4021c822-68a7-4c79-9ee1-6b608c14aedb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:53:09.323152 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-4021c822-68a7-4c79-9ee1-6b608c14aedb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:53:09.337774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4021c822-68a7-4c79-9ee1-6b608c14aedb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:09.338161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4021c822-68a7-4c79-9ee1-6b608c14aedb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:09.338969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4021c822-68a7-4c79-9ee1-6b608c14aedb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:09.344406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4021c822-68a7-4c79-9ee1-6b608c14aedb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:09.371719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-439d565e-dad9-4f90-b956-638c52e0312c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:09.379651 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-439d565e-dad9-4f90-b956-638c52e0312c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1691 microversion: 2.1 time: 0.885940 May 28 04:53:09.382856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-4021c822-68a7-4c79-9ee1-6b608c14aedb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Getting quotas for project c1de840d90bc4c97ac64a7b214f397c9. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:53:09.383261 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2412/4714] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:08 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1691 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:09.389275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-4021c822-68a7-4c79-9ee1-6b608c14aedb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Getting quotas for user 18d148985c3544219da8b641f63346b0 and project c1de840d90bc4c97ac64a7b214f397c9. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:53:09.391929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5c26963f-4f04-43d7-9bc3-6e552de26b48 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:09.397838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5c26963f-4f04-43d7-9bc3-6e552de26b48 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:09.407779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4021c822-68a7-4c79-9ee1-6b608c14aedb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:53:09.410245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4021c822-68a7-4c79-9ee1-6b608c14aedb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:53:09.432669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c26963f-4f04-43d7-9bc3-6e552de26b48 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:09.432669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c26963f-4f04-43d7-9bc3-6e552de26b48 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:09.432669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c26963f-4f04-43d7-9bc3-6e552de26b48 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:09.432669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c26963f-4f04-43d7-9bc3-6e552de26b48 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:09.446762 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-5c26963f-4f04-43d7-9bc3-6e552de26b48 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] HTTP exception thrown: Instance 50d15725-d599-410b-8d4d-d4460a1d96b6 could not be found. May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5c26963f-4f04-43d7-9bc3-6e552de26b48 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Request method failure captured: May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 HTTP/1.1 May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikajS0ZZaXFlax6A342ymJ-aQoGJlvna1xZy9bO84b3D9OriaYICvIupIZdjiNLcHyTC7V-bCXuJxYAHanDCccz0wxij-I7blA2wa6CB5mbuJxMVXKjiUcQwy4f7KRJtSQW8-6D6CRl3EsAa-9i5aRJ6Odwpn_PfoRh6K409eAlefhoM May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 025cb09c79a147b3a648c950edcd1dc3 May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 50d15725-d599-410b-8d4d-d4460a1d96b6 could not be found. May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '50d15725-d599-410b-8d4d-d4460a1d96b6'} May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50d15725-d599-410b-8d4d-d4460a1d96b6 could not be found. May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:53:09.448537 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:09.457581 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50d15725-d599-410b-8d4d-d4460a1d96b6 could not be found. May 28 04:53:09.457581 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:09.457581 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:09.457581 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:09.457581 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:09.457581 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:09.457581 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:09.457581 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:09.457581 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:09.457581 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50d15725-d599-410b-8d4d-d4460a1d96b6 could not be found. May 28 04:53:09.457581 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:09.457581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5c26963f-4f04-43d7-9bc3-6e552de26b48 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Returning 404 to user: Instance 50d15725-d599-410b-8d4d-d4460a1d96b6 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:09.457581 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5c26963f-4f04-43d7-9bc3-6e552de26b48 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "DELETE /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 404 len: 111 microversion: 2.1 time: 0.064533 May 28 04:53:09.457581 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2413/4715] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:53:09 2022] DELETE /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:53:09.457581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5c26963f-4f04-43d7-9bc3-6e552de26b48 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:09.457581 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5c26963f-4f04-43d7-9bc3-6e552de26b48 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001256 May 28 04:53:09.457581 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2414/4716] 10.222.0.58 () {56 vars in 885 bytes} [Sat May 28 04:53:09 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 28 04:53:09.463326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-55a5d24e-0b01-4182-929a-51e43f657e47 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:09.464156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-55a5d24e-0b01-4182-929a-51e43f657e47 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:09.471153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55a5d24e-0b01-4182-929a-51e43f657e47 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:09.471910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55a5d24e-0b01-4182-929a-51e43f657e47 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:09.473828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55a5d24e-0b01-4182-929a-51e43f657e47 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:09.474509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55a5d24e-0b01-4182-929a-51e43f657e47 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:09.602379 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4021c822-68a7-4c79-9ee1-6b608c14aedb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.319372 May 28 04:53:09.608206 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2303/4717] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:53:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 04:53:09.613783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c7f80707-f06f-4a38-9198-b7d0d77cecf7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:09.620090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c7f80707-f06f-4a38-9198-b7d0d77cecf7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:09.634521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7f80707-f06f-4a38-9198-b7d0d77cecf7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:09.635296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7f80707-f06f-4a38-9198-b7d0d77cecf7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:09.644037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7f80707-f06f-4a38-9198-b7d0d77cecf7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:09.644500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7f80707-f06f-4a38-9198-b7d0d77cecf7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:09.701566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-55a5d24e-0b01-4182-929a-51e43f657e47 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:09.721082 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-55a5d24e-0b01-4182-929a-51e43f657e47 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 200 len: 1315 microversion: 2.1 time: 0.262166 May 28 04:53:09.722858 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2415/4718] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:09 2022] GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:09.741717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-d1b6e458-6899-4131-98ff-56569b54a2ce req-e5b5f306-64cd-47c9-98b5-c5f9b2cd1680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c89850-7792-485a-a6ba-79c3b19b5405", "name": "network-vif-deleted", "tag": "281843f9-caf9-43ff-9ade-dc1bd3a73fd1"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:09.779953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d1b6e458-6899-4131-98ff-56569b54a2ce req-e5b5f306-64cd-47c9-98b5-c5f9b2cd1680 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:09.780982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d1b6e458-6899-4131-98ff-56569b54a2ce req-e5b5f306-64cd-47c9-98b5-c5f9b2cd1680 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:09.848565 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-d1b6e458-6899-4131-98ff-56569b54a2ce req-e5b5f306-64cd-47c9-98b5-c5f9b2cd1680 service nova] Creating event network-vif-deleted:281843f9-caf9-43ff-9ade-dc1bd3a73fd1 for instance 99c89850-7792-485a-a6ba-79c3b19b5405 on n-h2-843700-1 May 28 04:53:09.868157 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-d1b6e458-6899-4131-98ff-56569b54a2ce req-e5b5f306-64cd-47c9-98b5-c5f9b2cd1680 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142457 May 28 04:53:09.869824 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2416/4719] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:09.896349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-082d089d-6063-4071-bfe3-d9888e04f855 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:09.909766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-082d089d-6063-4071-bfe3-d9888e04f855 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 50d15725-d599-410b-8d4d-d4460a1d96b6] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:09.948008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-082d089d-6063-4071-bfe3-d9888e04f855 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:09.948670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-082d089d-6063-4071-bfe3-d9888e04f855 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:09.949685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-082d089d-6063-4071-bfe3-d9888e04f855 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:09.961637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-082d089d-6063-4071-bfe3-d9888e04f855 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:09.993757 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-082d089d-6063-4071-bfe3-d9888e04f855 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] HTTP exception thrown: Instance 50d15725-d599-410b-8d4d-d4460a1d96b6 could not be found. May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-082d089d-6063-4071-bfe3-d9888e04f855 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Request method failure captured: May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 HTTP/1.1 May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikajS0ZZaXFlax6A342ymJ-aQoGJlvna1xZy9bO84b3D9OriaYICvIupIZdjiNLcHyTC7V-bCXuJxYAHanDCccz0wxij-I7blA2wa6CB5mbuJxMVXKjiUcQwy4f7KRJtSQW8-6D6CRl3EsAa-9i5aRJ6Odwpn_PfoRh6K409eAlefhoM May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 025cb09c79a147b3a648c950edcd1dc3 May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 50d15725-d599-410b-8d4d-d4460a1d96b6 could not be found. May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '50d15725-d599-410b-8d4d-d4460a1d96b6'} May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50d15725-d599-410b-8d4d-d4460a1d96b6 could not be found. May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50d15725-d599-410b-8d4d-d4460a1d96b6 could not be found. May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:09.997398 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:10.010596 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:10.010596 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:10.010596 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:10.010596 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:10.010596 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:10.010596 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50d15725-d599-410b-8d4d-d4460a1d96b6 could not be found. May 28 04:53:10.010596 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:10.010596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-082d089d-6063-4071-bfe3-d9888e04f855 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Returning 404 to user: Instance 50d15725-d599-410b-8d4d-d4460a1d96b6 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:10.010596 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-082d089d-6063-4071-bfe3-d9888e04f855 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6" status: 404 len: 111 microversion: 2.1 time: 0.127476 May 28 04:53:10.010596 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2417/4720] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:09 2022] GET /compute/v2.1/servers/50d15725-d599-410b-8d4d-d4460a1d96b6 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:53:10.010596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-082d089d-6063-4071-bfe3-d9888e04f855 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:10.010596 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-082d089d-6063-4071-bfe3-d9888e04f855 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.003082 May 28 04:53:10.015825 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2418/4721] 10.222.0.58 () {54 vars in 1034 bytes} [Sat May 28 04:53:10 2022] GET /compute/v2/ => generated 379 bytes in 12 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) May 28 04:53:10.021911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0ac4abaf-291e-4f73-9d38-e773086394ea tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:10.022665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0ac4abaf-291e-4f73-9d38-e773086394ea tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:10.086410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c7f80707-f06f-4a38-9198-b7d0d77cecf7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:10.099393 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c7f80707-f06f-4a38-9198-b7d0d77cecf7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1508 microversion: 2.1 time: 0.486269 May 28 04:53:10.113790 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2304/4722] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:09 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1508 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:10.115654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c7f80707-f06f-4a38-9198-b7d0d77cecf7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:10.120334 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c7f80707-f06f-4a38-9198-b7d0d77cecf7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001987 May 28 04:53:10.127233 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2305/4723] 10.222.0.58 () {54 vars in 1040 bytes} [Sat May 28 04:53:10 2022] GET /compute/v2.1/ => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:10.128449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c7f80707-f06f-4a38-9198-b7d0d77cecf7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:10.138196 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c7f80707-f06f-4a38-9198-b7d0d77cecf7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003617 May 28 04:53:10.138912 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2306/4724] 10.222.0.58 () {56 vars in 885 bytes} [Sat May 28 04:53:10 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 28 04:53:10.166712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0ac4abaf-291e-4f73-9d38-e773086394ea tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:10.176414 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0ac4abaf-291e-4f73-9d38-e773086394ea tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1213 microversion: 2.1 time: 0.157756 May 28 04:53:10.177664 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2419/4725] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:10 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1213 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:10.407030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-917d34be-078e-43e6-bacf-4ae79652454e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:10.407616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-917d34be-078e-43e6-bacf-4ae79652454e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:10.419309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-917d34be-078e-43e6-bacf-4ae79652454e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:10.419698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-917d34be-078e-43e6-bacf-4ae79652454e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:10.427377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-917d34be-078e-43e6-bacf-4ae79652454e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:10.429166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-917d34be-078e-43e6-bacf-4ae79652454e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:10.451641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-582cfe0b-17ca-4755-9d27-3bf86d77cc3b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-2025111885", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:10.530727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-917d34be-078e-43e6-bacf-4ae79652454e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:10.530727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-917d34be-078e-43e6-bacf-4ae79652454e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:10.530727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-917d34be-078e-43e6-bacf-4ae79652454e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lazy-loading 'fault' on Instance uuid 99c89850-7792-485a-a6ba-79c3b19b5405 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:53:10.540137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-582cfe0b-17ca-4755-9d27-3bf86d77cc3b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] validate_networks() for [('8ff9610a-46de-41e5-86ae-47efda2d2743', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:53:10.673737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-917d34be-078e-43e6-bacf-4ae79652454e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:10.681214 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-917d34be-078e-43e6-bacf-4ae79652454e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 200 len: 1357 microversion: 2.1 time: 0.280846 May 28 04:53:10.682106 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2420/4726] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:10 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 1357 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:10.740238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-db220e98-f859-45cc-8910-bb5dc73e7b20 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:10.746849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-db220e98-f859-45cc-8910-bb5dc73e7b20 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:10.751177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db220e98-f859-45cc-8910-bb5dc73e7b20 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:10.751635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db220e98-f859-45cc-8910-bb5dc73e7b20 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:10.752407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db220e98-f859-45cc-8910-bb5dc73e7b20 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:10.752852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db220e98-f859-45cc-8910-bb5dc73e7b20 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:11.219357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-db220e98-f859-45cc-8910-bb5dc73e7b20 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:11.230479 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-db220e98-f859-45cc-8910-bb5dc73e7b20 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 200 len: 1315 microversion: 2.1 time: 0.494172 May 28 04:53:11.255524 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2421/4727] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:10 2022] GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:11.270958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eb21041a-3069-4926-9a7c-effd0eafe5df tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:11.273397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-eb21041a-3069-4926-9a7c-effd0eafe5df tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:11.292076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb21041a-3069-4926-9a7c-effd0eafe5df tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:11.294685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb21041a-3069-4926-9a7c-effd0eafe5df tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:11.297393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb21041a-3069-4926-9a7c-effd0eafe5df tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:11.299241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eb21041a-3069-4926-9a7c-effd0eafe5df tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:11.571179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-582cfe0b-17ca-4755-9d27-3bf86d77cc3b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:53:11.571746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-582cfe0b-17ca-4755-9d27-3bf86d77cc3b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:53:11.572070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-582cfe0b-17ca-4755-9d27-3bf86d77cc3b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:53:11.572484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-582cfe0b-17ca-4755-9d27-3bf86d77cc3b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:53:11.572896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-582cfe0b-17ca-4755-9d27-3bf86d77cc3b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:53:11.587614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-582cfe0b-17ca-4755-9d27-3bf86d77cc3b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:11.594354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-582cfe0b-17ca-4755-9d27-3bf86d77cc3b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:11.595399 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-582cfe0b-17ca-4755-9d27-3bf86d77cc3b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:11.595857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-582cfe0b-17ca-4755-9d27-3bf86d77cc3b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:11.651915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-eb21041a-3069-4926-9a7c-effd0eafe5df tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:11.660595 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-eb21041a-3069-4926-9a7c-effd0eafe5df tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1508 microversion: 2.1 time: 0.402890 May 28 04:53:11.661185 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2422/4728] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:11 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1508 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:11.667741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-582cfe0b-17ca-4755-9d27-3bf86d77cc3b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Getting quotas for project b48bceb63c3f41f0a1e5051e83ac1391. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:53:11.677049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-119a6eef-df7f-42fd-8dab-e8feeb0bff2a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:11.677864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-119a6eef-df7f-42fd-8dab-e8feeb0bff2a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:11.680100 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-582cfe0b-17ca-4755-9d27-3bf86d77cc3b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Getting quotas for user 35b061bc8b03440dbbbea79a18c00d16 and project b48bceb63c3f41f0a1e5051e83ac1391. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:53:11.708418 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-119a6eef-df7f-42fd-8dab-e8feeb0bff2a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:11.708882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-119a6eef-df7f-42fd-8dab-e8feeb0bff2a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:11.710147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-119a6eef-df7f-42fd-8dab-e8feeb0bff2a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:11.711882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-119a6eef-df7f-42fd-8dab-e8feeb0bff2a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:11.735269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-582cfe0b-17ca-4755-9d27-3bf86d77cc3b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:53:11.741656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-582cfe0b-17ca-4755-9d27-3bf86d77cc3b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:53:11.838959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:11.852487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-119a6eef-df7f-42fd-8dab-e8feeb0bff2a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:11.862340 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-119a6eef-df7f-42fd-8dab-e8feeb0bff2a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1209 microversion: 2.1 time: 0.196137 May 28 04:53:11.866155 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2423/4729] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:11 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1209 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:11.882762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2da36ea8-9e24-4656-a280-780a798f8d71 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:11.883953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2da36ea8-9e24-4656-a280-780a798f8d71 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 99c89850-7792-485a-a6ba-79c3b19b5405] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:11.897604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2da36ea8-9e24-4656-a280-780a798f8d71 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:11.898874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2da36ea8-9e24-4656-a280-780a798f8d71 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:11.900724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2da36ea8-9e24-4656-a280-780a798f8d71 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:11.900849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2da36ea8-9e24-4656-a280-780a798f8d71 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:11.920578 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-2da36ea8-9e24-4656-a280-780a798f8d71 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] HTTP exception thrown: Instance 99c89850-7792-485a-a6ba-79c3b19b5405 could not be found. May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2da36ea8-9e24-4656-a280-780a798f8d71 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Request method failure captured: May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 HTTP/1.1 May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaoQYQchrh2XakGGrNw11ys5UQs4OXIf9xMNV-20af4LsMX_Su4KFUIfZemhe-Tzn-w4pVHjS_smiI_SiLygbVF215cZ7DSG83uVMXJbfi_bMltF9zMlgcj2MGtyWWf07NkL17iAcfEzeiladbpIl0-FrLXe9iLR4H4noFpN95vJXZI May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d14e7de3a28f42a79197e1c06c4676dd May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2101778381 May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d14e7de3a28f42a79197e1c06c4676dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d14e7de3a28f42a79197e1c06c4676dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d14e7de3a28f42a79197e1c06c4676dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d14e7de3a28f42a79197e1c06c4676dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2101778381 May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d14e7de3a28f42a79197e1c06c4676dd May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2101778381 May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TestNetworkAdvancedServerOps-2101778381-project May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 82b17444b87742e1b45409810cbe06d2 May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2101778381-project May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 99c89850-7792-485a-a6ba-79c3b19b5405 could not be found. May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '99c89850-7792-485a-a6ba-79c3b19b5405'} May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99c89850-7792-485a-a6ba-79c3b19b5405 could not be found. May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99c89850-7792-485a-a6ba-79c3b19b5405 could not be found. May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:11.923352 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:11.932035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:11.932035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:11.932035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:11.932035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:11.932035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:11.932035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:11.932035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99c89850-7792-485a-a6ba-79c3b19b5405 could not be found. May 28 04:53:11.932035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:11.932035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2da36ea8-9e24-4656-a280-780a798f8d71 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Returning 404 to user: Instance 99c89850-7792-485a-a6ba-79c3b19b5405 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:11.932035 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2da36ea8-9e24-4656-a280-780a798f8d71 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405" status: 404 len: 111 microversion: 2.1 time: 0.057014 May 28 04:53:11.932035 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2424/4730] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:11 2022] GET /compute/v2.1/servers/99c89850-7792-485a-a6ba-79c3b19b5405 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:53:11.971878 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-582cfe0b-17ca-4755-9d27-3bf86d77cc3b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.830495 May 28 04:53:11.975499 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2307/4731] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:53:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:53:11.985497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b30e9085-a551-4c2d-8b21-4355dc953216 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:11.986551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b30e9085-a551-4c2d-8b21-4355dc953216 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:12.068476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b30e9085-a551-4c2d-8b21-4355dc953216 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:12.080028 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b30e9085-a551-4c2d-8b21-4355dc953216 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1223 microversion: 2.1 time: 0.098435 May 28 04:53:12.081316 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2425/4732] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:11 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:12.252089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b84ae2c3-62d2-42f6-b062-a7175aeb4905 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:12.253114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b84ae2c3-62d2-42f6-b062-a7175aeb4905 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:12.271833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b84ae2c3-62d2-42f6-b062-a7175aeb4905 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:12.273300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b84ae2c3-62d2-42f6-b062-a7175aeb4905 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:12.278147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b84ae2c3-62d2-42f6-b062-a7175aeb4905 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:12.279936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b84ae2c3-62d2-42f6-b062-a7175aeb4905 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:12.544566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b84ae2c3-62d2-42f6-b062-a7175aeb4905 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:12.557618 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b84ae2c3-62d2-42f6-b062-a7175aeb4905 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 200 len: 1315 microversion: 2.1 time: 0.311792 May 28 04:53:12.558539 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2308/4733] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:12 2022] GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:12.677685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-27613704-0c26-45d9-b611-025c34713d98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:12.678916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-27613704-0c26-45d9-b611-025c34713d98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:12.692578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27613704-0c26-45d9-b611-025c34713d98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:12.693040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27613704-0c26-45d9-b611-025c34713d98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:12.694018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27613704-0c26-45d9-b611-025c34713d98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:12.694639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27613704-0c26-45d9-b611-025c34713d98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:12.881259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8a9ed9bf-299b-48e1-b1e5-ef08ed3c84c1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:12.882530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8a9ed9bf-299b-48e1-b1e5-ef08ed3c84c1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:12.925773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a9ed9bf-299b-48e1-b1e5-ef08ed3c84c1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:12.926228 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a9ed9bf-299b-48e1-b1e5-ef08ed3c84c1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:12.935963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a9ed9bf-299b-48e1-b1e5-ef08ed3c84c1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:12.937323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a9ed9bf-299b-48e1-b1e5-ef08ed3c84c1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:12.987691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-27613704-0c26-45d9-b611-025c34713d98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:13.003165 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-27613704-0c26-45d9-b611-025c34713d98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1508 microversion: 2.1 time: 0.324845 May 28 04:53:13.004162 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2426/4734] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:12 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1508 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:13.009881 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-453b815f-e686-4674-b1d1-29c893cfaf14 req-ce607d22-7ad2-414a-bec6-3890df0d08db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90", "name": "network-vif-plugged", "status": "completed", "tag": "f82baeec-8a04-4b71-8524-5425d5f53a7d"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:13.033661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-453b815f-e686-4674-b1d1-29c893cfaf14 req-ce607d22-7ad2-414a-bec6-3890df0d08db service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:13.043639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-453b815f-e686-4674-b1d1-29c893cfaf14 req-ce607d22-7ad2-414a-bec6-3890df0d08db service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:13.065820 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-453b815f-e686-4674-b1d1-29c893cfaf14 req-ce607d22-7ad2-414a-bec6-3890df0d08db service nova] Creating event network-vif-plugged:f82baeec-8a04-4b71-8524-5425d5f53a7d for instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 on n-h1-843700-1 May 28 04:53:13.089674 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-453b815f-e686-4674-b1d1-29c893cfaf14 req-ce607d22-7ad2-414a-bec6-3890df0d08db service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082362 May 28 04:53:13.093960 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2427/4735] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:13.140509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-56af66b0-8d6d-439d-9207-1e0f8e8adecf tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:13.142253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-56af66b0-8d6d-439d-9207-1e0f8e8adecf tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:13.161008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8a9ed9bf-299b-48e1-b1e5-ef08ed3c84c1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:13.185689 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8a9ed9bf-299b-48e1-b1e5-ef08ed3c84c1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1273 microversion: 2.1 time: 0.309708 May 28 04:53:13.205582 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2309/4736] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:12 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1273 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:13.255535 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-56af66b0-8d6d-439d-9207-1e0f8e8adecf tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:13.267889 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-56af66b0-8d6d-439d-9207-1e0f8e8adecf tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1223 microversion: 2.1 time: 0.170880 May 28 04:53:13.268852 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2428/4737] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:13 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1223 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:13.574796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1b344604-7746-438d-8bb0-7dc4646d4767 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:13.575966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1b344604-7746-438d-8bb0-7dc4646d4767 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:13.592863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b344604-7746-438d-8bb0-7dc4646d4767 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:13.595861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b344604-7746-438d-8bb0-7dc4646d4767 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:13.595861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b344604-7746-438d-8bb0-7dc4646d4767 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:13.596572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b344604-7746-438d-8bb0-7dc4646d4767 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:13.884375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1b344604-7746-438d-8bb0-7dc4646d4767 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:13.893346 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1b344604-7746-438d-8bb0-7dc4646d4767 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 200 len: 1315 microversion: 2.1 time: 0.322631 May 28 04:53:13.896960 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2310/4738] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:13 2022] GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:14.021067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d1de87d1-becf-4947-93c7-2c66ffaec2bd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:14.022476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d1de87d1-becf-4947-93c7-2c66ffaec2bd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:14.038457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d1de87d1-becf-4947-93c7-2c66ffaec2bd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:14.043784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d1de87d1-becf-4947-93c7-2c66ffaec2bd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:14.044641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d1de87d1-becf-4947-93c7-2c66ffaec2bd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:14.045095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d1de87d1-becf-4947-93c7-2c66ffaec2bd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:14.210124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ecad5a7b-4de7-494c-bcff-73cd34e259d1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:14.211637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ecad5a7b-4de7-494c-bcff-73cd34e259d1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:14.252169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecad5a7b-4de7-494c-bcff-73cd34e259d1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:14.253903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecad5a7b-4de7-494c-bcff-73cd34e259d1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:14.257456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecad5a7b-4de7-494c-bcff-73cd34e259d1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:14.262611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecad5a7b-4de7-494c-bcff-73cd34e259d1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:14.427082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ecad5a7b-4de7-494c-bcff-73cd34e259d1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:14.440892 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ecad5a7b-4de7-494c-bcff-73cd34e259d1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1271 microversion: 2.1 time: 0.234750 May 28 04:53:14.441855 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2311/4739] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:14 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1271 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:14.447699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d1de87d1-becf-4947-93c7-2c66ffaec2bd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:14.453757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ef650bb5-c620-4cf4-8cce-b4b0e4472ea3 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:14.454512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ef650bb5-c620-4cf4-8cce-b4b0e4472ea3 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:14.459679 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d1de87d1-becf-4947-93c7-2c66ffaec2bd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1508 microversion: 2.1 time: 0.441665 May 28 04:53:14.460921 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2429/4740] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:14 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1508 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:14.493598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ef650bb5-c620-4cf4-8cce-b4b0e4472ea3 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:14.494150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ef650bb5-c620-4cf4-8cce-b4b0e4472ea3 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:14.494857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ef650bb5-c620-4cf4-8cce-b4b0e4472ea3 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:14.499814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ef650bb5-c620-4cf4-8cce-b4b0e4472ea3 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:14.643745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ef650bb5-c620-4cf4-8cce-b4b0e4472ea3 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:14.654533 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ef650bb5-c620-4cf4-8cce-b4b0e4472ea3 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1219 microversion: 2.1 time: 0.210294 May 28 04:53:14.655490 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2312/4741] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:14 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1219 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:14.912463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a86c1544-dbb0-4f9d-a102-44e4f5e184b0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:14.914341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a86c1544-dbb0-4f9d-a102-44e4f5e184b0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:14.921466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a86c1544-dbb0-4f9d-a102-44e4f5e184b0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:14.921928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a86c1544-dbb0-4f9d-a102-44e4f5e184b0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:14.922817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a86c1544-dbb0-4f9d-a102-44e4f5e184b0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:14.924442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a86c1544-dbb0-4f9d-a102-44e4f5e184b0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:15.240726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a86c1544-dbb0-4f9d-a102-44e4f5e184b0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:15.260622 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a86c1544-dbb0-4f9d-a102-44e4f5e184b0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 200 len: 1505 microversion: 2.1 time: 0.350499 May 28 04:53:15.261886 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2313/4742] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:14 2022] GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:15.288119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dfa7e4d9-1e35-4ec1-94db-78a78231e034 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:15.288892 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dfa7e4d9-1e35-4ec1-94db-78a78231e034 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:15.300298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfa7e4d9-1e35-4ec1-94db-78a78231e034 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:15.301049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfa7e4d9-1e35-4ec1-94db-78a78231e034 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:15.314125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfa7e4d9-1e35-4ec1-94db-78a78231e034 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:15.314125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfa7e4d9-1e35-4ec1-94db-78a78231e034 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:15.362265 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dfa7e4d9-1e35-4ec1-94db-78a78231e034 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:53:15.389930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7a10b202-e8aa-49cb-aceb-2ab87c5bb592 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Action: 'create', calling method: .version_select at 0x7f7700856dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-921428728"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:15.820524 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dfa7e4d9-1e35-4ec1-94db-78a78231e034 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 204 len: 0 microversion: 2.1 time: 0.536573 May 28 04:53:15.824630 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2314/4743] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:53:15 2022] DELETE /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 04:53:15.841151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-02242810-0be5-434c-8480-3eace17bdd14 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:15.851429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-02242810-0be5-434c-8480-3eace17bdd14 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:15.876888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02242810-0be5-434c-8480-3eace17bdd14 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:15.877736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02242810-0be5-434c-8480-3eace17bdd14 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:15.878762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02242810-0be5-434c-8480-3eace17bdd14 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:15.879590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02242810-0be5-434c-8480-3eace17bdd14 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:16.148430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-02242810-0be5-434c-8480-3eace17bdd14 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:16.161585 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-02242810-0be5-434c-8480-3eace17bdd14 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1313 microversion: 2.1 time: 0.332708 May 28 04:53:16.162232 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2315/4744] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:15 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:16.167353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e221281d-46d4-4c92-a9b9-db5f3ae35b1e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:16.167965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e221281d-46d4-4c92-a9b9-db5f3ae35b1e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:16.181579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e221281d-46d4-4c92-a9b9-db5f3ae35b1e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:16.182658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e221281d-46d4-4c92-a9b9-db5f3ae35b1e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:16.184067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e221281d-46d4-4c92-a9b9-db5f3ae35b1e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:16.188101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e221281d-46d4-4c92-a9b9-db5f3ae35b1e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:16.450657 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7a10b202-e8aa-49cb-aceb-2ab87c5bb592 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.593539 May 28 04:53:16.452736 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2430/4745] 10.222.0.58 () {60 vars in 1154 bytes} [Sat May 28 04:53:14 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1596 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 28 04:53:16.457683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2d6522a5-6d26-4fe7-a617-92d22c873794 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:16.458442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2d6522a5-6d26-4fe7-a617-92d22c873794 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:16.481865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d6522a5-6d26-4fe7-a617-92d22c873794 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:16.486135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d6522a5-6d26-4fe7-a617-92d22c873794 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:16.488916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d6522a5-6d26-4fe7-a617-92d22c873794 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:16.489551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d6522a5-6d26-4fe7-a617-92d22c873794 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:16.567600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e221281d-46d4-4c92-a9b9-db5f3ae35b1e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:16.581419 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e221281d-46d4-4c92-a9b9-db5f3ae35b1e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1508 microversion: 2.1 time: 0.417753 May 28 04:53:16.591674 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2316/4746] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:16 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1508 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:16.597605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-39acd5c9-c57a-430e-8ab6-619b4ed47b9e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:16.627772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-39acd5c9-c57a-430e-8ab6-619b4ed47b9e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:16.664223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-39acd5c9-c57a-430e-8ab6-619b4ed47b9e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:16.666908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-39acd5c9-c57a-430e-8ab6-619b4ed47b9e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:16.669728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-39acd5c9-c57a-430e-8ab6-619b4ed47b9e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:16.670320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-39acd5c9-c57a-430e-8ab6-619b4ed47b9e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:16.707843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2d6522a5-6d26-4fe7-a617-92d22c873794 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:16.723056 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2d6522a5-6d26-4fe7-a617-92d22c873794 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1293 microversion: 2.1 time: 0.263331 May 28 04:53:16.724314 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2431/4747] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:16 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1293 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:16.731868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c319a32b-e565-4767-aae1-cf65a24d28c8 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f7700c0baf0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:16.864282 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c319a32b-e565-4767-aae1-cf65a24d28c8 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5" status: 200 len: 344 microversion: 2.1 time: 0.136018 May 28 04:53:16.867092 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2432/4748] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 04:53:16 2022] GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:17.180524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6ff40ecc-f416-4c3d-891b-90bd945fa88a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:17.181064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6ff40ecc-f416-4c3d-891b-90bd945fa88a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:17.205520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6ff40ecc-f416-4c3d-891b-90bd945fa88a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:17.205993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6ff40ecc-f416-4c3d-891b-90bd945fa88a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:17.206924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6ff40ecc-f416-4c3d-891b-90bd945fa88a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:17.208680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6ff40ecc-f416-4c3d-891b-90bd945fa88a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:17.219393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:17.298170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-39acd5c9-c57a-430e-8ab6-619b4ed47b9e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:17.302375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:17.313012 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-39acd5c9-c57a-430e-8ab6-619b4ed47b9e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 200 len: 1511 microversion: 2.1 time: 0.719109 May 28 04:53:17.316637 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2317/4749] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:16 2022] GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 1511 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:17.583340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6ff40ecc-f416-4c3d-891b-90bd945fa88a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:17.595099 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6ff40ecc-f416-4c3d-891b-90bd945fa88a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1313 microversion: 2.1 time: 0.418989 May 28 04:53:17.598102 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2433/4750] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:17 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:17.609008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-685acb2d-3355-480b-ac74-74c52b53e8ac tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:17.609959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-685acb2d-3355-480b-ac74-74c52b53e8ac tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:17.626084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-685acb2d-3355-480b-ac74-74c52b53e8ac tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:17.626942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-685acb2d-3355-480b-ac74-74c52b53e8ac tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:17.628410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-685acb2d-3355-480b-ac74-74c52b53e8ac tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:17.629083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-685acb2d-3355-480b-ac74-74c52b53e8ac tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:17.741640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4c2f2099-4762-4b25-8823-dcf211c43187 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:17.742260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4c2f2099-4762-4b25-8823-dcf211c43187 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:17.762868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c2f2099-4762-4b25-8823-dcf211c43187 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:17.765744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c2f2099-4762-4b25-8823-dcf211c43187 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:17.766922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c2f2099-4762-4b25-8823-dcf211c43187 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:17.767414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c2f2099-4762-4b25-8823-dcf211c43187 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:19.028818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-685acb2d-3355-480b-ac74-74c52b53e8ac tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:19.046427 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-685acb2d-3355-480b-ac74-74c52b53e8ac tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1508 microversion: 2.1 time: 1.452064 May 28 04:53:19.058582 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2318/4751] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:17 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1508 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:19.072045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2037ed9e-7116-419e-b279-24a9da2e6c0b tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f770184b040>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:19.151914 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2037ed9e-7116-419e-b279-24a9da2e6c0b tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5" status: 200 len: 344 microversion: 2.1 time: 0.091704 May 28 04:53:19.152826 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2319/4752] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 04:53:19 2022] GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:19.168179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-3dbda82e-a75a-46b0-bb7c-e51740aff9c2 req-0a56f974-5fae-4c7a-b7a9-2e2c2d312663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63b00ce5-f08a-474b-bd22-a04e0e5dedad", "tag": "d8e5e0e0-fb93-4165-9f46-d044a2d75318"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:19.194167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3dbda82e-a75a-46b0-bb7c-e51740aff9c2 req-0a56f974-5fae-4c7a-b7a9-2e2c2d312663 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:19.198812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3dbda82e-a75a-46b0-bb7c-e51740aff9c2 req-0a56f974-5fae-4c7a-b7a9-2e2c2d312663 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:19.229185 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-3dbda82e-a75a-46b0-bb7c-e51740aff9c2 req-0a56f974-5fae-4c7a-b7a9-2e2c2d312663 service nova] Creating event network-changed:d8e5e0e0-fb93-4165-9f46-d044a2d75318 for instance 63b00ce5-f08a-474b-bd22-a04e0e5dedad on n-h2-843700-1 May 28 04:53:19.245181 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-3dbda82e-a75a-46b0-bb7c-e51740aff9c2 req-0a56f974-5fae-4c7a-b7a9-2e2c2d312663 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090759 May 28 04:53:19.247914 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2320/4753] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:19.260509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f241ec0c-25d2-45f6-a5c5-ad55ea30b652 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:19.261389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f241ec0c-25d2-45f6-a5c5-ad55ea30b652 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:19.268726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f241ec0c-25d2-45f6-a5c5-ad55ea30b652 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:19.270080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f241ec0c-25d2-45f6-a5c5-ad55ea30b652 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:19.271713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f241ec0c-25d2-45f6-a5c5-ad55ea30b652 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:19.272372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f241ec0c-25d2-45f6-a5c5-ad55ea30b652 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:19.357129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4c2f2099-4762-4b25-8823-dcf211c43187 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:19.371398 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4c2f2099-4762-4b25-8823-dcf211c43187 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1323 microversion: 2.1 time: 1.634779 May 28 04:53:19.386063 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2434/4754] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:17 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1323 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:19.398753 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f01913ef-1595-4fdb-8d6e-c3a2e55b6384 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:19.403974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f01913ef-1595-4fdb-8d6e-c3a2e55b6384 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:19.411742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f01913ef-1595-4fdb-8d6e-c3a2e55b6384 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:19.412621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f01913ef-1595-4fdb-8d6e-c3a2e55b6384 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:19.413652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f01913ef-1595-4fdb-8d6e-c3a2e55b6384 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:19.414355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f01913ef-1595-4fdb-8d6e-c3a2e55b6384 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:19.747071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f241ec0c-25d2-45f6-a5c5-ad55ea30b652 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:19.756122 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f241ec0c-25d2-45f6-a5c5-ad55ea30b652 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 200 len: 1511 microversion: 2.1 time: 0.506069 May 28 04:53:19.756728 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2321/4755] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:19 2022] GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 1511 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:19.887664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f01913ef-1595-4fdb-8d6e-c3a2e55b6384 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:19.900546 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f01913ef-1595-4fdb-8d6e-c3a2e55b6384 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1313 microversion: 2.1 time: 0.513166 May 28 04:53:19.901230 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2435/4756] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:19 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:20.066491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7442918c-214c-4fea-b36e-ac179e3616fd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:20.067335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7442918c-214c-4fea-b36e-ac179e3616fd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:20.074915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7442918c-214c-4fea-b36e-ac179e3616fd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:20.075403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7442918c-214c-4fea-b36e-ac179e3616fd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:20.076322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7442918c-214c-4fea-b36e-ac179e3616fd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:20.076839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7442918c-214c-4fea-b36e-ac179e3616fd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:20.097576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e4927bd0-4586-4dfa-9d51-cf75b5546d21 req-5201c63e-1b42-4591-8790-faf45fd76ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90", "name": "network-vif-deleted", "tag": "f82baeec-8a04-4b71-8524-5425d5f53a7d"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:20.119124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e4927bd0-4586-4dfa-9d51-cf75b5546d21 req-5201c63e-1b42-4591-8790-faf45fd76ece service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:20.119886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e4927bd0-4586-4dfa-9d51-cf75b5546d21 req-5201c63e-1b42-4591-8790-faf45fd76ece service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:20.133812 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e4927bd0-4586-4dfa-9d51-cf75b5546d21 req-5201c63e-1b42-4591-8790-faf45fd76ece service nova] Creating event network-vif-deleted:f82baeec-8a04-4b71-8524-5425d5f53a7d for instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 on n-h1-843700-1 May 28 04:53:20.140088 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e4927bd0-4586-4dfa-9d51-cf75b5546d21 req-5201c63e-1b42-4591-8790-faf45fd76ece service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045454 May 28 04:53:20.141325 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2436/4757] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:20.166336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fb251962-48dd-4b83-855d-d516fdac7fe6 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f77007e3940>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:20.236488 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fb251962-48dd-4b83-855d-d516fdac7fe6 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5" status: 200 len: 345 microversion: 2.1 time: 0.074717 May 28 04:53:20.241049 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2437/4758] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 04:53:20 2022] GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5 => generated 345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:20.250427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eaef51a3-aa15-4449-a049-35ad278a1ed0 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Action: 'create', calling method: .version_select at 0x7f77007eba60>, body: {"snapshot": {"volume_id": "d738397f-be29-46fd-ba8f-1b14c893edc5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-617918129"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:20.408361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7442918c-214c-4fea-b36e-ac179e3616fd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:20.418642 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7442918c-214c-4fea-b36e-ac179e3616fd tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1508 microversion: 2.1 time: 0.356428 May 28 04:53:20.419942 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2322/4759] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:20 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1508 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:20.426793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e2cd1484-a019-4780-836b-452dd40eb323 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:20.428321 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e2cd1484-a019-4780-836b-452dd40eb323 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:20.438896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2cd1484-a019-4780-836b-452dd40eb323 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:20.441516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2cd1484-a019-4780-836b-452dd40eb323 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:20.441516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2cd1484-a019-4780-836b-452dd40eb323 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:20.442207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2cd1484-a019-4780-836b-452dd40eb323 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:20.717901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e2cd1484-a019-4780-836b-452dd40eb323 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:20.728413 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e2cd1484-a019-4780-836b-452dd40eb323 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1323 microversion: 2.1 time: 0.307033 May 28 04:53:20.743019 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2323/4760] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:20 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1323 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:20.774693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ae707f15-196c-49b0-affe-ab9557ff3659 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:20.775350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ae707f15-196c-49b0-affe-ab9557ff3659 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:20.791681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae707f15-196c-49b0-affe-ab9557ff3659 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:20.793185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae707f15-196c-49b0-affe-ab9557ff3659 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:20.795209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae707f15-196c-49b0-affe-ab9557ff3659 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:20.797260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae707f15-196c-49b0-affe-ab9557ff3659 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:20.905478 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-eaef51a3-aa15-4449-a049-35ad278a1ed0 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.659212 May 28 04:53:20.906332 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2438/4761] 10.222.0.58 () {60 vars in 1161 bytes} [Sat May 28 04:53:20 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:20.917786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6008f81a-7af0-461f-be45-f342592a4304 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f7700855280>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:20.937076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae707f15-196c-49b0-affe-ab9557ff3659 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:20.939298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae707f15-196c-49b0-affe-ab9557ff3659 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:20.942613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-ae707f15-196c-49b0-affe-ab9557ff3659 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lazy-loading 'fault' on Instance uuid 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:53:20.993557 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6008f81a-7af0-461f-be45-f342592a4304 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662" status: 200 len: 286 microversion: 2.1 time: 0.081024 May 28 04:53:20.994239 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2439/4762] 10.222.0.58 () {58 vars in 1250 bytes} [Sat May 28 04:53:20 2022] GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:53:21.001464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5f1f5e0f-7385-4a3d-aea1-071c17d4094a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:21.003357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5f1f5e0f-7385-4a3d-aea1-071c17d4094a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:21.012687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f1f5e0f-7385-4a3d-aea1-071c17d4094a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:21.013140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f1f5e0f-7385-4a3d-aea1-071c17d4094a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:21.014707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f1f5e0f-7385-4a3d-aea1-071c17d4094a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:21.015453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f1f5e0f-7385-4a3d-aea1-071c17d4094a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:21.107244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ae707f15-196c-49b0-affe-ab9557ff3659 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:21.120735 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ae707f15-196c-49b0-affe-ab9557ff3659 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 200 len: 1305 microversion: 2.1 time: 0.351176 May 28 04:53:21.147094 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2324/4763] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:20 2022] GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 1305 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:21.152479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4006699d-6f26-4cc6-91f0-88552c7d0919 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f77019744c0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:21.281596 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4006699d-6f26-4cc6-91f0-88552c7d0919 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.132888 May 28 04:53:21.282268 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2325/4764] 10.222.0.58 () {58 vars in 1139 bytes} [Sat May 28 04:53:21 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:21.292919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e6d1ffc2-69eb-4489-ba1a-3ce999f0e315 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f7700d6bf70>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:21.363781 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e6d1ffc2-69eb-4489-ba1a-3ce999f0e315 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662" status: 200 len: 286 microversion: 2.1 time: 0.075284 May 28 04:53:21.364687 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2326/4765] 10.222.0.58 () {58 vars in 1250 bytes} [Sat May 28 04:53:21 2022] GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662 => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:53:21.398849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f9d06a75-8a55-43d5-8402-4b2ee0b1b719 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:21.401310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f9d06a75-8a55-43d5-8402-4b2ee0b1b719 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:21.419921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9d06a75-8a55-43d5-8402-4b2ee0b1b719 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:21.420777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9d06a75-8a55-43d5-8402-4b2ee0b1b719 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:21.438353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9d06a75-8a55-43d5-8402-4b2ee0b1b719 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:21.439319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f9d06a75-8a55-43d5-8402-4b2ee0b1b719 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:21.474599 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-f9d06a75-8a55-43d5-8402-4b2ee0b1b719 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] HTTP exception thrown: Instance 711037c4-54ef-4071-a370-fd39338dccf8 could not be found. May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f9d06a75-8a55-43d5-8402-4b2ee0b1b719 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Request method failure captured: May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 HTTP/1.1 May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikajS0ZZaXFlax6A342ymJ-aQoGJlvna1xZy9bO84b3D9OriaYICvIupIZdjiNLcHyTC7V-bCXuJxYAHanDCccz0wxij-I7blA2wa6CB5mbuJxMVXKjiUcQwy4f7KRJtSQW8-6D6CRl3EsAa-9i5aRJ6Odwpn_PfoRh6K409eAlefhoM May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 025cb09c79a147b3a648c950edcd1dc3 May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 711037c4-54ef-4071-a370-fd39338dccf8 could not be found. May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '711037c4-54ef-4071-a370-fd39338dccf8'} May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 711037c4-54ef-4071-a370-fd39338dccf8 could not be found. May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:53:21.478798 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:21.486061 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 711037c4-54ef-4071-a370-fd39338dccf8 could not be found. May 28 04:53:21.486061 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:21.486061 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:21.486061 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:21.486061 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:21.486061 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:21.486061 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:21.486061 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:21.486061 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:21.486061 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 711037c4-54ef-4071-a370-fd39338dccf8 could not be found. May 28 04:53:21.486061 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:21.486061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f9d06a75-8a55-43d5-8402-4b2ee0b1b719 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Returning 404 to user: Instance 711037c4-54ef-4071-a370-fd39338dccf8 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:21.486061 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f9d06a75-8a55-43d5-8402-4b2ee0b1b719 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "DELETE /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8" status: 404 len: 111 microversion: 2.1 time: 0.088475 May 28 04:53:21.486061 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2327/4766] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:53:21 2022] DELETE /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:53:21.492541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3fd8d70b-e11a-48d6-ad60-22d2485c3b9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:21.493178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3fd8d70b-e11a-48d6-ad60-22d2485c3b9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:21.515421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3fd8d70b-e11a-48d6-ad60-22d2485c3b9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:21.519866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3fd8d70b-e11a-48d6-ad60-22d2485c3b9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:21.519866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3fd8d70b-e11a-48d6-ad60-22d2485c3b9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:21.519866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3fd8d70b-e11a-48d6-ad60-22d2485c3b9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:21.536568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5f1f5e0f-7385-4a3d-aea1-071c17d4094a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:21.551464 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5f1f5e0f-7385-4a3d-aea1-071c17d4094a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1313 microversion: 2.1 time: 0.555877 May 28 04:53:21.552071 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2440/4767] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:20 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1313 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:21.562616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2aa92b5f-513f-4aa1-b2b8-8df5120bb3ad tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:21.570549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2aa92b5f-513f-4aa1-b2b8-8df5120bb3ad tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 711037c4-54ef-4071-a370-fd39338dccf8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:21.590763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2aa92b5f-513f-4aa1-b2b8-8df5120bb3ad tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:21.593477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2aa92b5f-513f-4aa1-b2b8-8df5120bb3ad tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:21.594857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2aa92b5f-513f-4aa1-b2b8-8df5120bb3ad tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:21.595712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2aa92b5f-513f-4aa1-b2b8-8df5120bb3ad tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:21.603535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:21.649580 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-2aa92b5f-513f-4aa1-b2b8-8df5120bb3ad tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] HTTP exception thrown: Instance 711037c4-54ef-4071-a370-fd39338dccf8 could not be found. May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2aa92b5f-513f-4aa1-b2b8-8df5120bb3ad tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Request method failure captured: May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 HTTP/1.1 May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikajS0ZZaXFlax6A342ymJ-aQoGJlvna1xZy9bO84b3D9OriaYICvIupIZdjiNLcHyTC7V-bCXuJxYAHanDCccz0wxij-I7blA2wa6CB5mbuJxMVXKjiUcQwy4f7KRJtSQW8-6D6CRl3EsAa-9i5aRJ6Odwpn_PfoRh6K409eAlefhoM May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 025cb09c79a147b3a648c950edcd1dc3 May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 711037c4-54ef-4071-a370-fd39338dccf8 could not be found. May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '711037c4-54ef-4071-a370-fd39338dccf8'} May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 711037c4-54ef-4071-a370-fd39338dccf8 could not be found. May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 711037c4-54ef-4071-a370-fd39338dccf8 could not be found. May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:21.652848 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:21.657596 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:21.657596 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:21.657596 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:21.657596 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:21.657596 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:21.657596 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 711037c4-54ef-4071-a370-fd39338dccf8 could not be found. May 28 04:53:21.657596 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:21.657596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2aa92b5f-513f-4aa1-b2b8-8df5120bb3ad tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Returning 404 to user: Instance 711037c4-54ef-4071-a370-fd39338dccf8 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:21.667592 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2aa92b5f-513f-4aa1-b2b8-8df5120bb3ad tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8" status: 404 len: 111 microversion: 2.1 time: 0.102071 May 28 04:53:21.671701 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2441/4768] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:21 2022] GET /compute/v2.1/servers/711037c4-54ef-4071-a370-fd39338dccf8 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:53:21.683519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-87cc8933-fd97-4112-b605-1af3b7a57066 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:21.688702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-87cc8933-fd97-4112-b605-1af3b7a57066 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:21.695017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=12 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:21.710467 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87cc8933-fd97-4112-b605-1af3b7a57066 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:21.711335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87cc8933-fd97-4112-b605-1af3b7a57066 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:21.717208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87cc8933-fd97-4112-b605-1af3b7a57066 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:21.718070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87cc8933-fd97-4112-b605-1af3b7a57066 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:21.760738 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-87cc8933-fd97-4112-b605-1af3b7a57066 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] HTTP exception thrown: Instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 could not be found. May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-87cc8933-fd97-4112-b605-1af3b7a57066 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Request method failure captured: May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 HTTP/1.1 May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikajS0ZZaXFlax6A342ymJ-aQoGJlvna1xZy9bO84b3D9OriaYICvIupIZdjiNLcHyTC7V-bCXuJxYAHanDCccz0wxij-I7blA2wa6CB5mbuJxMVXKjiUcQwy4f7KRJtSQW8-6D6CRl3EsAa-9i5aRJ6Odwpn_PfoRh6K409eAlefhoM May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 025cb09c79a147b3a648c950edcd1dc3 May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 could not be found. May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '06f67b96-191c-4c64-96bf-e1e61c33ee69'} May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 could not be found. May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:53:21.763854 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:21.768382 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 could not be found. May 28 04:53:21.768382 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:21.768382 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:21.768382 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:21.768382 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:21.768382 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:21.768382 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:21.768382 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:21.768382 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:21.768382 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 could not be found. May 28 04:53:21.768382 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:21.768382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-87cc8933-fd97-4112-b605-1af3b7a57066 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Returning 404 to user: Instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:21.768382 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-87cc8933-fd97-4112-b605-1af3b7a57066 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "DELETE /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69" status: 404 len: 111 microversion: 2.1 time: 0.089804 May 28 04:53:21.768382 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2442/4769] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:53:21 2022] DELETE /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:53:21.778152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8504d6e7-664a-416e-9f9e-7082085da071 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:21.779433 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8504d6e7-664a-416e-9f9e-7082085da071 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:21.790504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8504d6e7-664a-416e-9f9e-7082085da071 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:21.791313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8504d6e7-664a-416e-9f9e-7082085da071 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:21.792608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8504d6e7-664a-416e-9f9e-7082085da071 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:21.793379 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8504d6e7-664a-416e-9f9e-7082085da071 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:21.828649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3fd8d70b-e11a-48d6-ad60-22d2485c3b9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:21.838924 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3fd8d70b-e11a-48d6-ad60-22d2485c3b9f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1508 microversion: 2.1 time: 0.353420 May 28 04:53:21.839768 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2328/4770] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:21 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1508 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:21.853108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9f209441-fe34-4f35-836d-2ae9e353791c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:21.853992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9f209441-fe34-4f35-836d-2ae9e353791c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 06f67b96-191c-4c64-96bf-e1e61c33ee69] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:21.860923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f209441-fe34-4f35-836d-2ae9e353791c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:21.861621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f209441-fe34-4f35-836d-2ae9e353791c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:21.862565 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f209441-fe34-4f35-836d-2ae9e353791c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:21.863199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f209441-fe34-4f35-836d-2ae9e353791c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:21.879301 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-9f209441-fe34-4f35-836d-2ae9e353791c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] HTTP exception thrown: Instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 could not be found. May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9f209441-fe34-4f35-836d-2ae9e353791c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Request method failure captured: May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 HTTP/1.1 May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikajS0ZZaXFlax6A342ymJ-aQoGJlvna1xZy9bO84b3D9OriaYICvIupIZdjiNLcHyTC7V-bCXuJxYAHanDCccz0wxij-I7blA2wa6CB5mbuJxMVXKjiUcQwy4f7KRJtSQW8-6D6CRl3EsAa-9i5aRJ6Odwpn_PfoRh6K409eAlefhoM May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 025cb09c79a147b3a648c950edcd1dc3 May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 could not be found. May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '06f67b96-191c-4c64-96bf-e1e61c33ee69'} May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 could not be found. May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 could not be found. May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:21.881102 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:21.886753 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:21.886753 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:21.886753 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:21.886753 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:21.886753 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:21.886753 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 could not be found. May 28 04:53:21.886753 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:21.889813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9f209441-fe34-4f35-836d-2ae9e353791c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Returning 404 to user: Instance 06f67b96-191c-4c64-96bf-e1e61c33ee69 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:21.890745 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9f209441-fe34-4f35-836d-2ae9e353791c tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69" status: 404 len: 111 microversion: 2.1 time: 0.049851 May 28 04:53:21.891638 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2329/4771] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:21 2022] GET /compute/v2.1/servers/06f67b96-191c-4c64-96bf-e1e61c33ee69 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:53:22.138565 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-68ce9059-c710-4fbb-8d54-62e0aad939e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:22.141174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-68ce9059-c710-4fbb-8d54-62e0aad939e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:22.155320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8504d6e7-664a-416e-9f9e-7082085da071 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:22.156209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68ce9059-c710-4fbb-8d54-62e0aad939e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:22.158909 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68ce9059-c710-4fbb-8d54-62e0aad939e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:22.161765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68ce9059-c710-4fbb-8d54-62e0aad939e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:22.162231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68ce9059-c710-4fbb-8d54-62e0aad939e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:22.166534 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8504d6e7-664a-416e-9f9e-7082085da071 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1323 microversion: 2.1 time: 0.397751 May 28 04:53:22.170536 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2443/4772] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:21 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1323 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:22.181721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-b6fe7526-8716-4f22-a660-9540c54ab4db req-a0309571-4b8b-4293-b7c2-63a69df198bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d9bcfd7-7d49-4c32-ae2c-748617114b96", "tag": "cb04aa76-1a04-4fb5-a21c-24d0b903b510"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:22.208702 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-68ce9059-c710-4fbb-8d54-62e0aad939e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:53:22.213897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b6fe7526-8716-4f22-a660-9540c54ab4db req-a0309571-4b8b-4293-b7c2-63a69df198bd service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:22.215215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b6fe7526-8716-4f22-a660-9540c54ab4db req-a0309571-4b8b-4293-b7c2-63a69df198bd service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-68ce9059-c710-4fbb-8d54-62e0aad939e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 HTTP/1.1 May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90'} May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:22.216454 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:22.222157 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:22.222157 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:22.222157 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:22.222157 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:22.222157 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:22.222157 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:53:22.222157 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:22.227468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-68ce9059-c710-4fbb-8d54-62e0aad939e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:22.227726 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-68ce9059-c710-4fbb-8d54-62e0aad939e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 404 len: 111 microversion: 2.1 time: 0.092074 May 28 04:53:22.228313 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2330/4773] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:22 2022] GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:53:22.234291 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-b6fe7526-8716-4f22-a660-9540c54ab4db req-a0309571-4b8b-4293-b7c2-63a69df198bd service nova] Creating event network-changed:cb04aa76-1a04-4fb5-a21c-24d0b903b510 for instance 0d9bcfd7-7d49-4c32-ae2c-748617114b96 on n-h1-843700-1 May 28 04:53:22.240290 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-b6fe7526-8716-4f22-a660-9540c54ab4db req-a0309571-4b8b-4293-b7c2-63a69df198bd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062583 May 28 04:53:22.241355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-498f0456-bd1e-4560-9950-68990d099be2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:22.242029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-498f0456-bd1e-4560-9950-68990d099be2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:22.246152 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2444/4774] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:53:22.259535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-498f0456-bd1e-4560-9950-68990d099be2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:22.262765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-498f0456-bd1e-4560-9950-68990d099be2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:22.263669 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-498f0456-bd1e-4560-9950-68990d099be2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:22.264154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-498f0456-bd1e-4560-9950-68990d099be2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:22.377027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fcd62980-e170-42d0-ad4e-5aaa83561e06 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f770754c0d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:22.428878 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fcd62980-e170-42d0-ad4e-5aaa83561e06 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662" status: 200 len: 286 microversion: 2.1 time: 0.056875 May 28 04:53:22.429728 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2445/4775] 10.222.0.58 () {58 vars in 1250 bytes} [Sat May 28 04:53:22 2022] GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662 => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:53:22.568559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4ea673ce-caca-4d79-93b0-60adeb4c5d12 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:22.569307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4ea673ce-caca-4d79-93b0-60adeb4c5d12 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:22.581632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ea673ce-caca-4d79-93b0-60adeb4c5d12 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:22.582346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ea673ce-caca-4d79-93b0-60adeb4c5d12 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:22.589392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ea673ce-caca-4d79-93b0-60adeb4c5d12 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:22.589392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ea673ce-caca-4d79-93b0-60adeb4c5d12 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:22.691742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-498f0456-bd1e-4560-9950-68990d099be2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:22.708330 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-498f0456-bd1e-4560-9950-68990d099be2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.473792 May 28 04:53:22.723243 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2331/4776] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:22 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:22.857486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f37f4df4-0c1f-4b29-b335-5caadee0ff7b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:22.858961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f37f4df4-0c1f-4b29-b335-5caadee0ff7b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:22.878051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f37f4df4-0c1f-4b29-b335-5caadee0ff7b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:22.880412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f37f4df4-0c1f-4b29-b335-5caadee0ff7b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:22.882416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f37f4df4-0c1f-4b29-b335-5caadee0ff7b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:22.885871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f37f4df4-0c1f-4b29-b335-5caadee0ff7b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:22.895944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4ea673ce-caca-4d79-93b0-60adeb4c5d12 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:22.908267 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4ea673ce-caca-4d79-93b0-60adeb4c5d12 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1313 microversion: 2.1 time: 0.342419 May 28 04:53:22.915696 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2446/4777] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:22 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:22.987403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4ec63e98-9981-4408-921e-90eb6e3f60df tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4ec63e98-9981-4408-921e-90eb6e3f60df tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 163 May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: {"server": {"name": 12345, "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'networks': [{'uuid': 'd8b90133-44e4-4677-ae8d-d676a447193b'}]}}} May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise error May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 12345 May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:53:22.990035 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:53:22.997097 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:53:22.997097 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 28 04:53:22.997097 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:22.997097 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:22.997097 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:22.997097 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:22.997097 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:22.997097 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:22.997097 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:53:22.997097 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:53:22.997097 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 28 04:53:22.997097 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:22.997097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4ec63e98-9981-4408-921e-90eb6e3f60df tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:22.997097 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4ec63e98-9981-4408-921e-90eb6e3f60df tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.010743 May 28 04:53:23.000388 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2447/4778] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:53:22 2022] POST /compute/v2.1/servers => generated 127 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:53:23.013335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-350aaf88-622b-4c07-9248-87d9ab97f62f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:23.016950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-350aaf88-622b-4c07-9248-87d9ab97f62f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:23.043329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-350aaf88-622b-4c07-9248-87d9ab97f62f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:23.047325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-350aaf88-622b-4c07-9248-87d9ab97f62f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:23.051248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-350aaf88-622b-4c07-9248-87d9ab97f62f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:23.056642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-350aaf88-622b-4c07-9248-87d9ab97f62f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:23.263159 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:23.450721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f37f4df4-0c1f-4b29-b335-5caadee0ff7b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:23.459506 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f37f4df4-0c1f-4b29-b335-5caadee0ff7b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1508 microversion: 2.1 time: 0.605335 May 28 04:53:23.464851 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2332/4779] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:22 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1508 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:23.472846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a8cab755-3273-4449-9ef5-a86bde862d7b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '.version_select at 0x7f7700d97a60>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:23.580773 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a8cab755-3273-4449-9ef5-a86bde862d7b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2090468210" status: 202 len: 0 microversion: 2.1 time: 0.114876 May 28 04:53:23.581369 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2333/4780] 10.222.0.58 () {58 vars in 1283 bytes} [Sat May 28 04:53:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2090468210 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:53:23.594402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-07f886d1-20eb-4792-ad0a-db6a23012a2e tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:23.596847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-07f886d1-20eb-4792-ad0a-db6a23012a2e tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:23.629879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07f886d1-20eb-4792-ad0a-db6a23012a2e tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:23.633732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-350aaf88-622b-4c07-9248-87d9ab97f62f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:23.646311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07f886d1-20eb-4792-ad0a-db6a23012a2e tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:23.650609 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-350aaf88-622b-4c07-9248-87d9ab97f62f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.648458 May 28 04:53:23.652088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07f886d1-20eb-4792-ad0a-db6a23012a2e tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:23.661336 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2448/4781] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:22 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:23.661705 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07f886d1-20eb-4792-ad0a-db6a23012a2e tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:23.680585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-16f42386-0735-4721-98e0-f6aa06d764b2 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f77073b73a0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:23.724161 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-16f42386-0735-4721-98e0-f6aa06d764b2 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662" status: 200 len: 286 microversion: 2.1 time: 0.069655 May 28 04:53:23.724759 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2449/4782] 10.222.0.58 () {58 vars in 1250 bytes} [Sat May 28 04:53:23 2022] GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:23.731924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4a61753d-4c2f-4489-b858-2bf5803d823c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'create', calling method: .version_select at 0x7f77007d8c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2044320799", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiJ6VVOiWUfp6lqAAVSS5pcr8OrjAkaYzc9Z8zJM0Yel6djg06YFkLR+25guG1+0/UuqX6mil0w3xIgGQk9eUUYlutp8YwNU+DyBc0+kfCRtJbqrUvNrXOlNScCxMrT2A=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:23.765791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-4a61753d-4c2f-4489-b858-2bf5803d823c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Getting quotas for project d14e7de3a28f42a79197e1c06c4676dd. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:53:23.789801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-4a61753d-4c2f-4489-b858-2bf5803d823c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Getting quotas for user 82b17444b87742e1b45409810cbe06d2 and project d14e7de3a28f42a79197e1c06c4676dd. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:53:23.879186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:23.981675 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4a61753d-4c2f-4489-b858-2bf5803d823c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.255841 May 28 04:53:23.982685 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2450/4783] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:53:23 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:23.991384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-371db0b8-fa77-433c-b0dd-d8564581c4bd tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:23.992335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-371db0b8-fa77-433c-b0dd-d8564581c4bd tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:24.008800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-371db0b8-fa77-433c-b0dd-d8564581c4bd tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:24.009950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-371db0b8-fa77-433c-b0dd-d8564581c4bd tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:24.011301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-371db0b8-fa77-433c-b0dd-d8564581c4bd tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:24.012444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-371db0b8-fa77-433c-b0dd-d8564581c4bd tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:24.136094 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-07f886d1-20eb-4792-ad0a-db6a23012a2e tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:24.155565 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-07f886d1-20eb-4792-ad0a-db6a23012a2e tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1323 microversion: 2.1 time: 0.566905 May 28 04:53:24.166058 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2334/4784] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:23 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1323 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:24.167572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b5a0fddb-b4d0-4235-bedf-af2fd426eb84 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:24.168262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b5a0fddb-b4d0-4235-bedf-af2fd426eb84 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:24.179537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b5a0fddb-b4d0-4235-bedf-af2fd426eb84 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:24.195537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b5a0fddb-b4d0-4235-bedf-af2fd426eb84 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:24.196844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b5a0fddb-b4d0-4235-bedf-af2fd426eb84 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:24.197545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b5a0fddb-b4d0-4235-bedf-af2fd426eb84 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:24.550945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-371db0b8-fa77-433c-b0dd-d8564581c4bd tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:24.560756 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-371db0b8-fa77-433c-b0dd-d8564581c4bd tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.576682 May 28 04:53:24.561368 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2451/4785] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:23 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:24.588251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-128334f0-1b87-484b-a3bb-e4a159f26aef tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:24.593308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-128334f0-1b87-484b-a3bb-e4a159f26aef tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:24.604598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-128334f0-1b87-484b-a3bb-e4a159f26aef tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:24.607223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-128334f0-1b87-484b-a3bb-e4a159f26aef tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:24.609336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-128334f0-1b87-484b-a3bb-e4a159f26aef tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:24.613742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-128334f0-1b87-484b-a3bb-e4a159f26aef tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:24.635333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b5a0fddb-b4d0-4235-bedf-af2fd426eb84 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:24.644917 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b5a0fddb-b4d0-4235-bedf-af2fd426eb84 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1313 microversion: 2.1 time: 0.486316 May 28 04:53:24.646014 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2335/4786] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:24 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1313 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:24.736675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cb9599e2-a4bf-4b17-9dd6-6e26d7194a1a tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f7700c74f70>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:24.798577 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cb9599e2-a4bf-4b17-9dd6-6e26d7194a1a tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662" status: 200 len: 286 microversion: 2.1 time: 0.066363 May 28 04:53:24.799057 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2336/4787] 10.222.0.58 () {58 vars in 1250 bytes} [Sat May 28 04:53:24 2022] GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:53:24.872161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-128334f0-1b87-484b-a3bb-e4a159f26aef tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:24.881044 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-128334f0-1b87-484b-a3bb-e4a159f26aef tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1508 microversion: 2.1 time: 0.302223 May 28 04:53:24.881643 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2452/4788] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:24 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1508 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:25.174942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5feac600-e4fb-4be5-b896-6a202578e25b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:25.175970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5feac600-e4fb-4be5-b896-6a202578e25b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:25.184546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5feac600-e4fb-4be5-b896-6a202578e25b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:25.185500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5feac600-e4fb-4be5-b896-6a202578e25b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:25.187091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5feac600-e4fb-4be5-b896-6a202578e25b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:25.187738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5feac600-e4fb-4be5-b896-6a202578e25b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:25.373616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5feac600-e4fb-4be5-b896-6a202578e25b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:25.381913 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5feac600-e4fb-4be5-b896-6a202578e25b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1323 microversion: 2.1 time: 0.212061 May 28 04:53:25.382553 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2337/4789] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:25 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1323 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:25.437020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-4a608081-7ffb-41ac-9ed9-3d478979e991 req-e6852de6-9e05-4a60-8606-074254cc35b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63b00ce5-f08a-474b-bd22-a04e0e5dedad", "name": "network-vif-plugged", "status": "completed", "tag": "d8e5e0e0-fb93-4165-9f46-d044a2d75318"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:25.450640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-4a608081-7ffb-41ac-9ed9-3d478979e991 req-e6852de6-9e05-4a60-8606-074254cc35b8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:25.451426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-4a608081-7ffb-41ac-9ed9-3d478979e991 req-e6852de6-9e05-4a60-8606-074254cc35b8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:25.491558 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-4a608081-7ffb-41ac-9ed9-3d478979e991 req-e6852de6-9e05-4a60-8606-074254cc35b8 service nova] Creating event network-vif-plugged:d8e5e0e0-fb93-4165-9f46-d044a2d75318 for instance 63b00ce5-f08a-474b-bd22-a04e0e5dedad on n-h2-843700-1 May 28 04:53:25.496631 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-4a608081-7ffb-41ac-9ed9-3d478979e991 req-e6852de6-9e05-4a60-8606-074254cc35b8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063298 May 28 04:53:25.497500 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2453/4790] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:25.666529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b10a8b25-4ad5-4d23-a2cd-33bf5816b804 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:25.667895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b10a8b25-4ad5-4d23-a2cd-33bf5816b804 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:25.677985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b10a8b25-4ad5-4d23-a2cd-33bf5816b804 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:25.680139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b10a8b25-4ad5-4d23-a2cd-33bf5816b804 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:25.683388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b10a8b25-4ad5-4d23-a2cd-33bf5816b804 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:25.684543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b10a8b25-4ad5-4d23-a2cd-33bf5816b804 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:25.811444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fd5b82c9-49d5-4634-bc21-4826e76d31bd tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f77007e3820>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:25.862680 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fd5b82c9-49d5-4634-bc21-4826e76d31bd tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662" status: 200 len: 287 microversion: 2.1 time: 0.056630 May 28 04:53:25.863666 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2454/4791] 10.222.0.58 () {58 vars in 1250 bytes} [Sat May 28 04:53:25 2022] GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:25.884894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-63ee2640-5dd9-4ee7-bb1b-641eed9f7bbe tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f77007e3310>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:25.927019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b10a8b25-4ad5-4d23-a2cd-33bf5816b804 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:25.935503 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b10a8b25-4ad5-4d23-a2cd-33bf5816b804 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1313 microversion: 2.1 time: 0.277092 May 28 04:53:25.936918 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2338/4792] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:25 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:25.943483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9b14bbe7-eeb7-47c7-8348-4f4f4578495b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:25.948954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9b14bbe7-eeb7-47c7-8348-4f4f4578495b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:25.966690 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b14bbe7-eeb7-47c7-8348-4f4f4578495b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:25.967280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b14bbe7-eeb7-47c7-8348-4f4f4578495b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:25.968252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b14bbe7-eeb7-47c7-8348-4f4f4578495b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:25.968789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b14bbe7-eeb7-47c7-8348-4f4f4578495b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:26.056003 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-63ee2640-5dd9-4ee7-bb1b-641eed9f7bbe tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662" status: 202 len: 0 microversion: 2.1 time: 0.178464 May 28 04:53:26.056821 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2455/4793] 10.222.0.58 () {58 vars in 1253 bytes} [Sat May 28 04:53:25 2022] DELETE /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:53:26.070146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-67081dd9-51a5-4fb1-9b98-417a01ac5eb3 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f77007ebb80>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:26.133653 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-67081dd9-51a5-4fb1-9b98-417a01ac5eb3 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662" status: 200 len: 286 microversion: 2.1 time: 0.072401 May 28 04:53:26.138500 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2456/4794] 10.222.0.58 () {58 vars in 1250 bytes} [Sat May 28 04:53:26 2022] GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:26.211795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9b14bbe7-eeb7-47c7-8348-4f4f4578495b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:26.221693 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9b14bbe7-eeb7-47c7-8348-4f4f4578495b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1508 microversion: 2.1 time: 0.282796 May 28 04:53:26.231510 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2339/4795] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:25 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1508 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:26.401153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0c26889b-5b11-4ad4-98ee-83f017589bb8 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:26.402057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0c26889b-5b11-4ad4-98ee-83f017589bb8 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:26.411946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c26889b-5b11-4ad4-98ee-83f017589bb8 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:26.413358 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c26889b-5b11-4ad4-98ee-83f017589bb8 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:26.414366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c26889b-5b11-4ad4-98ee-83f017589bb8 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:26.415280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c26889b-5b11-4ad4-98ee-83f017589bb8 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:26.617803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0c26889b-5b11-4ad4-98ee-83f017589bb8 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:26.626575 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0c26889b-5b11-4ad4-98ee-83f017589bb8 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1323 microversion: 2.1 time: 0.231154 May 28 04:53:26.641147 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2457/4796] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:26 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1323 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:26.964718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b10772b3-0baa-4fb9-9062-4bd958951b6d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:26.965916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b10772b3-0baa-4fb9-9062-4bd958951b6d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:26.980417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b10772b3-0baa-4fb9-9062-4bd958951b6d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:26.981488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b10772b3-0baa-4fb9-9062-4bd958951b6d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:26.986557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b10772b3-0baa-4fb9-9062-4bd958951b6d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:26.987134 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b10772b3-0baa-4fb9-9062-4bd958951b6d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:27.150026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-796ad14f-79e4-4adc-8b00-aac3da4ae685 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f77007e31f0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:27.236308 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-796ad14f-79e4-4adc-8b00-aac3da4ae685 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662" status: 200 len: 286 microversion: 2.1 time: 0.094316 May 28 04:53:27.237184 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2458/4797] 10.222.0.58 () {58 vars in 1250 bytes} [Sat May 28 04:53:27 2022] GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662 => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:53:27.245304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-160c9ed6-e88a-4cc9-aea1-846e0c63e5f7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:27.246196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-160c9ed6-e88a-4cc9-aea1-846e0c63e5f7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:27.262765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-160c9ed6-e88a-4cc9-aea1-846e0c63e5f7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:27.263530 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-160c9ed6-e88a-4cc9-aea1-846e0c63e5f7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:27.268054 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-160c9ed6-e88a-4cc9-aea1-846e0c63e5f7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:27.270247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-160c9ed6-e88a-4cc9-aea1-846e0c63e5f7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:27.392766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b10772b3-0baa-4fb9-9062-4bd958951b6d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:27.404604 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b10772b3-0baa-4fb9-9062-4bd958951b6d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1313 microversion: 2.1 time: 0.444682 May 28 04:53:27.416969 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2340/4798] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:26 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1313 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:27.645390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2269f11d-aa59-4ef1-a677-4a781ce4293d tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:27.645928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2269f11d-aa59-4ef1-a677-4a781ce4293d tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:27.675504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2269f11d-aa59-4ef1-a677-4a781ce4293d tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:27.675975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2269f11d-aa59-4ef1-a677-4a781ce4293d tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:27.676820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2269f11d-aa59-4ef1-a677-4a781ce4293d tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:27.677263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2269f11d-aa59-4ef1-a677-4a781ce4293d tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:28.271482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-160c9ed6-e88a-4cc9-aea1-846e0c63e5f7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:28.281251 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-160c9ed6-e88a-4cc9-aea1-846e0c63e5f7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1508 microversion: 2.1 time: 1.042858 May 28 04:53:28.294125 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2459/4799] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:27 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1508 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:28.300613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2269f11d-aa59-4ef1-a677-4a781ce4293d tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:28.307971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:28.309478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-efb6b2d3-5cbe-41f9-9865-a49169d49b3e tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f77007ebe50>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:28.309621 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2269f11d-aa59-4ef1-a677-4a781ce4293d tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1323 microversion: 2.1 time: 0.671027 May 28 04:53:28.313206 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2341/4800] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:27 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1323 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:28.349603 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-efb6b2d3-5cbe-41f9-9865-a49169d49b3e tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662" status: 200 len: 286 microversion: 2.1 time: 0.051146 May 28 04:53:28.350456 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2460/4801] 10.222.0.58 () {58 vars in 1250 bytes} [Sat May 28 04:53:28 2022] GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662 => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:28.426179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d09ae7fe-3055-4891-a2c1-7a440477ae57 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:28.429134 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d09ae7fe-3055-4891-a2c1-7a440477ae57 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:28.438186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d09ae7fe-3055-4891-a2c1-7a440477ae57 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:28.439204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d09ae7fe-3055-4891-a2c1-7a440477ae57 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:28.441332 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d09ae7fe-3055-4891-a2c1-7a440477ae57 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:28.442365 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d09ae7fe-3055-4891-a2c1-7a440477ae57 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:28.693118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d09ae7fe-3055-4891-a2c1-7a440477ae57 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:28.703075 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d09ae7fe-3055-4891-a2c1-7a440477ae57 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1499 microversion: 2.1 time: 0.283126 May 28 04:53:28.704458 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2342/4802] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:28 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1499 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:28.724210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3d2e0a65-1af8-4b06-97c3-93a5cc0be562 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:28.725375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3d2e0a65-1af8-4b06-97c3-93a5cc0be562 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:28.745724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d2e0a65-1af8-4b06-97c3-93a5cc0be562 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:28.755086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d2e0a65-1af8-4b06-97c3-93a5cc0be562 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:28.756398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d2e0a65-1af8-4b06-97c3-93a5cc0be562 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:28.756859 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d2e0a65-1af8-4b06-97c3-93a5cc0be562 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:28.802650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-3d2e0a65-1af8-4b06-97c3-93a5cc0be562 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lazy-loading 'flavor' on Instance uuid 63b00ce5-f08a-474b-bd22-a04e0e5dedad {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:53:28.840542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-0deae639-2d3c-4663-ad10-ebc0b1b858f0 req-f9e924b0-deaa-4aa5-8dd6-26f865886650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d9bcfd7-7d49-4c32-ae2c-748617114b96", "name": "network-vif-plugged", "status": "completed", "tag": "cb04aa76-1a04-4fb5-a21c-24d0b903b510"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:28.853545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0deae639-2d3c-4663-ad10-ebc0b1b858f0 req-f9e924b0-deaa-4aa5-8dd6-26f865886650 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:28.856465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0deae639-2d3c-4663-ad10-ebc0b1b858f0 req-f9e924b0-deaa-4aa5-8dd6-26f865886650 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:28.881798 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-0deae639-2d3c-4663-ad10-ebc0b1b858f0 req-f9e924b0-deaa-4aa5-8dd6-26f865886650 service nova] Creating event network-vif-plugged:cb04aa76-1a04-4fb5-a21c-24d0b903b510 for instance 0d9bcfd7-7d49-4c32-ae2c-748617114b96 on n-h1-843700-1 May 28 04:53:28.893058 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-0deae639-2d3c-4663-ad10-ebc0b1b858f0 req-f9e924b0-deaa-4aa5-8dd6-26f865886650 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063811 May 28 04:53:28.894923 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2343/4803] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:29.247061 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3d2e0a65-1af8-4b06-97c3-93a5cc0be562 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "POST /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad/action" status: 200 len: 32 microversion: 2.1 time: 0.527918 May 28 04:53:29.259721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fbbdb6e3-8717-468f-9164-b131baa83242 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:29.260687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fbbdb6e3-8717-468f-9164-b131baa83242 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:29.261638 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2461/4804] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:53:28 2022] POST /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad/action => generated 32 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:53:29.277926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbbdb6e3-8717-468f-9164-b131baa83242 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:29.279345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbbdb6e3-8717-468f-9164-b131baa83242 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:29.288561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbbdb6e3-8717-468f-9164-b131baa83242 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:29.293634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbbdb6e3-8717-468f-9164-b131baa83242 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:29.303030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9eb45e1e-13dc-47bc-8529-bb7cef41ac6a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:29.306556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9eb45e1e-13dc-47bc-8529-bb7cef41ac6a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:29.314391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9eb45e1e-13dc-47bc-8529-bb7cef41ac6a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:29.314848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9eb45e1e-13dc-47bc-8529-bb7cef41ac6a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:29.315907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9eb45e1e-13dc-47bc-8529-bb7cef41ac6a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:29.320807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9eb45e1e-13dc-47bc-8529-bb7cef41ac6a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:29.764056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fbbdb6e3-8717-468f-9164-b131baa83242 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:29.776374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9eb45e1e-13dc-47bc-8529-bb7cef41ac6a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:29.779310 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fbbdb6e3-8717-468f-9164-b131baa83242 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1505 microversion: 2.1 time: 0.524916 May 28 04:53:29.780872 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2344/4805] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:29 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1505 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:29.785871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9e404b0e-191d-43de-a7f8-6d7efd8ebea4 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:29.786558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9e404b0e-191d-43de-a7f8-6d7efd8ebea4 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:29.796623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e404b0e-191d-43de-a7f8-6d7efd8ebea4 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:29.797402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e404b0e-191d-43de-a7f8-6d7efd8ebea4 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:29.797570 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9eb45e1e-13dc-47bc-8529-bb7cef41ac6a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1508 microversion: 2.1 time: 0.498442 May 28 04:53:29.799061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e404b0e-191d-43de-a7f8-6d7efd8ebea4 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:29.799394 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2462/4806] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:29 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1508 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:29.800030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e404b0e-191d-43de-a7f8-6d7efd8ebea4 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:29.814559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-369d9d2d-19c1-40c4-91f2-a0096bf6d0c6 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f77007e30d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:29.866885 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-369d9d2d-19c1-40c4-91f2-a0096bf6d0c6 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662" status: 200 len: 286 microversion: 2.1 time: 0.065416 May 28 04:53:29.868000 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2463/4807] 10.222.0.58 () {58 vars in 1250 bytes} [Sat May 28 04:53:29 2022] GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:29.873662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0a266859-4c48-4613-a9e4-ad25548d6193 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1744757489", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "2626d27b-28ba-47f7-97c8-d56f74094a9c", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:29.998478 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-0a266859-4c48-4613-a9e4-ad25548d6193 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Block Device 2626d27b-28ba-47f7-97c8-d56f74094a9c is not bootable. May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0a266859-4c48-4613-a9e4-ad25548d6193 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 358 May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1744757489", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "2626d27b-28ba-47f7-97c8-d56f74094a9c", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: exception: Block Device 2626d27b-28ba-47f7-97c8-d56f74094a9c is not bootable. May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1744757489', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '2626d27b-28ba-47f7-97c8-d56f74094a9c'}], 'networks': [{'uuid': 'd8b90133-44e4-4677-ae8d-d676a447193b'}]}}} May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._create_instance( May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 2626d27b-28ba-47f7-97c8-d56f74094a9c is not bootable. May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:30.010905 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:30.018878 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:30.018878 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:30.018878 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:30.018878 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 04:53:30.018878 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 28 04:53:30.018878 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 28 04:53:30.018878 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 2626d27b-28ba-47f7-97c8-d56f74094a9c is not bootable. May 28 04:53:30.018878 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:30.018878 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:30.018878 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:30.018878 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:30.018878 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:30.018878 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:30.018878 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:30.018878 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:30.018878 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 2626d27b-28ba-47f7-97c8-d56f74094a9c is not bootable. May 28 04:53:30.018878 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:30.018878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0a266859-4c48-4613-a9e4-ad25548d6193 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 400 to user: Block Device 2626d27b-28ba-47f7-97c8-d56f74094a9c is not bootable. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:30.018878 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0a266859-4c48-4613-a9e4-ad25548d6193 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.147312 May 28 04:53:30.018878 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2464/4808] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:53:29 2022] POST /compute/v2.1/servers => generated 110 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:53:30.037256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-de38ab4f-dca3-4a6c-a1aa-d016f09a3609 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:30.038170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-de38ab4f-dca3-4a6c-a1aa-d016f09a3609 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:30.046939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de38ab4f-dca3-4a6c-a1aa-d016f09a3609 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:30.047650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de38ab4f-dca3-4a6c-a1aa-d016f09a3609 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:30.048495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de38ab4f-dca3-4a6c-a1aa-d016f09a3609 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:30.049005 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de38ab4f-dca3-4a6c-a1aa-d016f09a3609 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:30.062682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:30.221461 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9e404b0e-191d-43de-a7f8-6d7efd8ebea4 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:30.244101 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9e404b0e-191d-43de-a7f8-6d7efd8ebea4 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1323 microversion: 2.1 time: 0.461215 May 28 04:53:30.244741 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2345/4809] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:29 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1323 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:30.368482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-de38ab4f-dca3-4a6c-a1aa-d016f09a3609 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:30.379450 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-de38ab4f-dca3-4a6c-a1aa-d016f09a3609 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.347729 May 28 04:53:30.383067 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2465/4810] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:30 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:30.401758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6de21436-4d0d-4353-a4f1-25c05c53f565 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:30.402481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6de21436-4d0d-4353-a4f1-25c05c53f565 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:30.417623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6de21436-4d0d-4353-a4f1-25c05c53f565 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:30.418123 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6de21436-4d0d-4353-a4f1-25c05c53f565 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:30.419347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6de21436-4d0d-4353-a4f1-25c05c53f565 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:30.419818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6de21436-4d0d-4353-a4f1-25c05c53f565 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:30.700095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6de21436-4d0d-4353-a4f1-25c05c53f565 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:30.709257 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6de21436-4d0d-4353-a4f1-25c05c53f565 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.314349 May 28 04:53:30.709925 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2346/4811] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:30 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:30.798348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6cac7188-716e-45c4-94bf-ac1a676b86a5 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:30.798714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6cac7188-716e-45c4-94bf-ac1a676b86a5 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:30.805485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6cac7188-716e-45c4-94bf-ac1a676b86a5 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:30.806657 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6cac7188-716e-45c4-94bf-ac1a676b86a5 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:30.806874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6cac7188-716e-45c4-94bf-ac1a676b86a5 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:30.807547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6cac7188-716e-45c4-94bf-ac1a676b86a5 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:30.818485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-acd25865-830f-4a58-bb85-e3f4dc0daf8a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:30.819127 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-acd25865-830f-4a58-bb85-e3f4dc0daf8a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:30.836546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-acd25865-830f-4a58-bb85-e3f4dc0daf8a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:30.837293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-acd25865-830f-4a58-bb85-e3f4dc0daf8a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:30.839571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-acd25865-830f-4a58-bb85-e3f4dc0daf8a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:30.840291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-acd25865-830f-4a58-bb85-e3f4dc0daf8a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:31.250635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6cac7188-716e-45c4-94bf-ac1a676b86a5 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:31.259822 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6cac7188-716e-45c4-94bf-ac1a676b86a5 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1505 microversion: 2.1 time: 0.466266 May 28 04:53:31.270369 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2466/4812] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:30 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:31.275549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e9d426c9-a21f-43c0-bc15-9207a4ae30a5 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f77007ebd30>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:31.307649 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-e9d426c9-a21f-43c0-bc15-9207a4ae30a5 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] HTTP exception thrown: Snapshot e3c4ed05-6cb1-4047-bf95-521021e91662 could not be found. May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e9d426c9-a21f-43c0-bc15-9207a4ae30a5 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Request method failure captured: May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662 HTTP/1.1 May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaq6NgdYkq0i19972adjZVTvrw0y-nspeCKa7LJSl-x9iAYfVi-ppSl4tgDDWVnweXjFQQRsoTHKoWctJwFZODmyZjbRN5Cns26PVDqYjRlKnqC4rPk5aApszYDKwUywCMkqK_NnSmzxtAb6FU8Nq89FXjTliYOHyxaf9iQk6E9J4xI May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 72402d174d034867a61bbad7484d922a May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-963804881 May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_72402d174d034867a61bbad7484d922a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/72402d174d034867a61bbad7484d922a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/72402d174d034867a61bbad7484d922a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/72402d174d034867a61bbad7484d922a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-VolumesSnapshotsTestJSON-963804881 May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 72402d174d034867a61bbad7484d922a May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-963804881 May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-VolumesSnapshotsTestJSON-963804881-project May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: ab287a65f06f4cfa951d64df65ad457f May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-VolumesSnapshotsTestJSON-963804881-project May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: exception: Snapshot e3c4ed05-6cb1-4047-bf95-521021e91662 could not be found. May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'e3c4ed05-6cb1-4047-bf95-521021e91662'} May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e3c4ed05-6cb1-4047-bf95-521021e91662 could not be found. (HTTP 404) (Request-ID: req-e1036190-e933-4759-a5cd-f833d4d014d4) May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 04:53:31.313225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e3c4ed05-6cb1-4047-bf95-521021e91662 could not be found. May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e3c4ed05-6cb1-4047-bf95-521021e91662 could not be found. May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e3c4ed05-6cb1-4047-bf95-521021e91662 could not be found. May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e9d426c9-a21f-43c0-bc15-9207a4ae30a5 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Returning 404 to user: Snapshot e3c4ed05-6cb1-4047-bf95-521021e91662 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e9d426c9-a21f-43c0-bc15-9207a4ae30a5 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662" status: 404 len: 111 microversion: 2.1 time: 0.042995 May 28 04:53:31.325151 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2467/4813] 10.222.0.58 () {58 vars in 1250 bytes} [Sat May 28 04:53:31 2022] GET /compute/v2.1/os-snapshots/e3c4ed05-6cb1-4047-bf95-521021e91662 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:53:31.328824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0df78d27-34c8-4cd3-8df0-64919b1564c1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:31.328824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0df78d27-34c8-4cd3-8df0-64919b1564c1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:31.339991 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-acd25865-830f-4a58-bb85-e3f4dc0daf8a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:31.342552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0df78d27-34c8-4cd3-8df0-64919b1564c1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:31.343045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0df78d27-34c8-4cd3-8df0-64919b1564c1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:31.358466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0df78d27-34c8-4cd3-8df0-64919b1564c1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:31.358466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0df78d27-34c8-4cd3-8df0-64919b1564c1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:31.358879 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-acd25865-830f-4a58-bb85-e3f4dc0daf8a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1508 microversion: 2.1 time: 0.534878 May 28 04:53:31.358879 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2347/4814] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:30 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1508 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:31.362838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f5a1dfb3-5cb3-471b-a5e6-7adbd8803093 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:31.367347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f5a1dfb3-5cb3-471b-a5e6-7adbd8803093 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:31.374534 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5a1dfb3-5cb3-471b-a5e6-7adbd8803093 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:31.382752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5a1dfb3-5cb3-471b-a5e6-7adbd8803093 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:31.382752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5a1dfb3-5cb3-471b-a5e6-7adbd8803093 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:31.382752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5a1dfb3-5cb3-471b-a5e6-7adbd8803093 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-0df78d27-34c8-4cd3-8df0-64919b1564c1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] HTTP exception thrown: Instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 could not be found. May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0df78d27-34c8-4cd3-8df0-64919b1564c1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Request method failure captured: May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52 HTTP/1.1 May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikajS0ZZaXFlax6A342ymJ-aQoGJlvna1xZy9bO84b3D9OriaYICvIupIZdjiNLcHyTC7V-bCXuJxYAHanDCccz0wxij-I7blA2wa6CB5mbuJxMVXKjiUcQwy4f7KRJtSQW8-6D6CRl3EsAa-9i5aRJ6Odwpn_PfoRh6K409eAlefhoM May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 025cb09c79a147b3a648c950edcd1dc3 May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 could not be found. May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '0459f5ac-8ba7-47a4-9c7b-808496f08d52'} May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 could not be found. May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:53:31.383372 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:53:31.391039 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:53:31.391039 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:31.391039 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 could not be found. May 28 04:53:31.391039 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:31.391039 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:31.391039 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:31.391039 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:31.391039 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:31.391039 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:31.391039 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:31.391039 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:31.391039 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 could not be found. May 28 04:53:31.391039 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:31.391039 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0df78d27-34c8-4cd3-8df0-64919b1564c1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Returning 404 to user: Instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:31.391039 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0df78d27-34c8-4cd3-8df0-64919b1564c1 tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52" status: 404 len: 111 microversion: 2.1 time: 0.067548 May 28 04:53:31.391039 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2468/4815] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:53:31 2022] DELETE /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:53:31.409962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7b3c29e6-9f8c-491f-8a74-3cc9eacbb142 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f77007eb310>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:31.690641 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7b3c29e6-9f8c-491f-8a74-3cc9eacbb142 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5" status: 202 len: 0 microversion: 2.1 time: 0.303370 May 28 04:53:31.691551 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2469/4816] 10.222.0.58 () {58 vars in 1247 bytes} [Sat May 28 04:53:31 2022] DELETE /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:53:31.718201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9e95518d-d954-434a-adc3-dfa7f7d04d4f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:31.722115 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9e95518d-d954-434a-adc3-dfa7f7d04d4f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] [instance: 0459f5ac-8ba7-47a4-9c7b-808496f08d52] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:31.749099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e95518d-d954-434a-adc3-dfa7f7d04d4f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:31.753937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e95518d-d954-434a-adc3-dfa7f7d04d4f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:31.755149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e95518d-d954-434a-adc3-dfa7f7d04d4f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:31.757379 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e95518d-d954-434a-adc3-dfa7f7d04d4f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:31.786152 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-9e95518d-d954-434a-adc3-dfa7f7d04d4f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] HTTP exception thrown: Instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 could not be found. May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9e95518d-d954-434a-adc3-dfa7f7d04d4f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Request method failure captured: May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52 HTTP/1.1 May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikajS0ZZaXFlax6A342ymJ-aQoGJlvna1xZy9bO84b3D9OriaYICvIupIZdjiNLcHyTC7V-bCXuJxYAHanDCccz0wxij-I7blA2wa6CB5mbuJxMVXKjiUcQwy4f7KRJtSQW8-6D6CRl3EsAa-9i5aRJ6Odwpn_PfoRh6K409eAlefhoM May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1e7c34036184ea8b80241695fdbf329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d1e7c34036184ea8b80241695fdbf329 May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1299700363 May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 025cb09c79a147b3a648c950edcd1dc3 May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AttachVolumeNegativeTest-1299700363-project May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 could not be found. May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '0459f5ac-8ba7-47a4-9c7b-808496f08d52'} May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 could not be found. May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 could not be found. May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:31.788973 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:31.798238 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:31.798238 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:31.798238 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:31.798238 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:31.798238 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:31.798238 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 could not be found. May 28 04:53:31.798238 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:31.801203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9e95518d-d954-434a-adc3-dfa7f7d04d4f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] Returning 404 to user: Instance 0459f5ac-8ba7-47a4-9c7b-808496f08d52 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:31.801884 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9e95518d-d954-434a-adc3-dfa7f7d04d4f tempest-AttachVolumeNegativeTest-1299700363 tempest-AttachVolumeNegativeTest-1299700363-project] 10.222.0.58 "GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52" status: 404 len: 111 microversion: 2.1 time: 0.104223 May 28 04:53:31.802756 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2470/4817] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:31 2022] GET /compute/v2.1/servers/0459f5ac-8ba7-47a4-9c7b-808496f08d52 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:53:31.812065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b541b522-e956-4022-8631-a9fb19790803 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f77007ebdc0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:31.904219 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b541b522-e956-4022-8631-a9fb19790803 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5" status: 200 len: 344 microversion: 2.1 time: 0.096427 May 28 04:53:31.909627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f5a1dfb3-5cb3-471b-a5e6-7adbd8803093 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:31.910097 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2471/4818] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 04:53:31 2022] GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5 => generated 344 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:31.918667 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f5a1dfb3-5cb3-471b-a5e6-7adbd8803093 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1518 microversion: 2.1 time: 0.567411 May 28 04:53:31.919919 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2348/4819] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:31 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1518 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:31.939808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a4665748-702a-448b-9ac5-5e75c4e8b26b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:31.941679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a4665748-702a-448b-9ac5-5e75c4e8b26b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:31.953087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4665748-702a-448b-9ac5-5e75c4e8b26b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:31.967066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4665748-702a-448b-9ac5-5e75c4e8b26b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:31.967066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4665748-702a-448b-9ac5-5e75c4e8b26b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:31.967066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4665748-702a-448b-9ac5-5e75c4e8b26b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:31.993953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-a4665748-702a-448b-9ac5-5e75c4e8b26b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lazy-loading 'flavor' on Instance uuid 0d9bcfd7-7d49-4c32-ae2c-748617114b96 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:53:32.278128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-181accd6-d476-4ed7-b761-f7e33a2be9b0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:32.279337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-181accd6-d476-4ed7-b761-f7e33a2be9b0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:32.291054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-181accd6-d476-4ed7-b761-f7e33a2be9b0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:32.291894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-181accd6-d476-4ed7-b761-f7e33a2be9b0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:32.294188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-181accd6-d476-4ed7-b761-f7e33a2be9b0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:32.297121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-181accd6-d476-4ed7-b761-f7e33a2be9b0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:32.424793 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a4665748-702a-448b-9ac5-5e75c4e8b26b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "POST /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96/action" status: 200 len: 32 microversion: 2.1 time: 0.493165 May 28 04:53:32.425654 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2472/4820] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:53:31 2022] POST /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96/action => generated 32 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:53:32.438429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fa3b3049-af68-42df-9f52-fc0c3502fc0a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:32.439178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fa3b3049-af68-42df-9f52-fc0c3502fc0a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:32.471869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa3b3049-af68-42df-9f52-fc0c3502fc0a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:32.473435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa3b3049-af68-42df-9f52-fc0c3502fc0a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:32.473968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa3b3049-af68-42df-9f52-fc0c3502fc0a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:32.476893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa3b3049-af68-42df-9f52-fc0c3502fc0a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:33.416760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fa3b3049-af68-42df-9f52-fc0c3502fc0a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:33.424577 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fa3b3049-af68-42df-9f52-fc0c3502fc0a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1508 microversion: 2.1 time: 0.997676 May 28 04:53:33.425172 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2473/4821] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:32 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1508 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:33.438181 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-72f140f4-67e2-4daa-9796-2c5a22662e41 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:33.438805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-72f140f4-67e2-4daa-9796-2c5a22662e41 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:33.453933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72f140f4-67e2-4daa-9796-2c5a22662e41 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:33.454451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72f140f4-67e2-4daa-9796-2c5a22662e41 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:33.455260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72f140f4-67e2-4daa-9796-2c5a22662e41 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:33.455702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72f140f4-67e2-4daa-9796-2c5a22662e41 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:33.600391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-181accd6-d476-4ed7-b761-f7e33a2be9b0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:33.632115 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-181accd6-d476-4ed7-b761-f7e33a2be9b0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1505 microversion: 2.1 time: 1.353555 May 28 04:53:33.633401 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2349/4822] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:32 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1505 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:33.659582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-26988817-cc5e-4876-a6fb-c83860c92339 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f7701828f70>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:33.784225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-72f140f4-67e2-4daa-9796-2c5a22662e41 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:33.794298 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-26988817-cc5e-4876-a6fb-c83860c92339 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5" status: 200 len: 344 microversion: 2.1 time: 0.155222 May 28 04:53:33.796679 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2350/4823] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 04:53:33 2022] GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:33.807416 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-72f140f4-67e2-4daa-9796-2c5a22662e41 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1524 microversion: 2.1 time: 0.381061 May 28 04:53:33.809782 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2474/4824] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:33 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1524 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:34.442369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8f4f36c9-5aa4-4596-b0b6-5abb93ba68fb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:34.443513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8f4f36c9-5aa4-4596-b0b6-5abb93ba68fb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:34.458337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f4f36c9-5aa4-4596-b0b6-5abb93ba68fb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:34.459588 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f4f36c9-5aa4-4596-b0b6-5abb93ba68fb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:34.462201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f4f36c9-5aa4-4596-b0b6-5abb93ba68fb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:34.462885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f4f36c9-5aa4-4596-b0b6-5abb93ba68fb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:34.649712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aaf13f97-79e0-4c87-9753-3859423524eb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:34.650331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aaf13f97-79e0-4c87-9753-3859423524eb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:34.652969 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:34.664772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aaf13f97-79e0-4c87-9753-3859423524eb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:34.665251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aaf13f97-79e0-4c87-9753-3859423524eb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:34.667352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aaf13f97-79e0-4c87-9753-3859423524eb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:34.671722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aaf13f97-79e0-4c87-9753-3859423524eb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:34.833923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8f4f36c9-5aa4-4596-b0b6-5abb93ba68fb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:34.845115 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8f4f36c9-5aa4-4596-b0b6-5abb93ba68fb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1529 microversion: 2.1 time: 0.407314 May 28 04:53:34.859823 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2351/4825] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:34 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1529 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:34.859823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ce9c8734-99ef-4aa2-99e4-5539fab201a2 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f7701828f70>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:34.953812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aaf13f97-79e0-4c87-9753-3859423524eb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:34.970949 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aaf13f97-79e0-4c87-9753-3859423524eb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1505 microversion: 2.1 time: 0.316138 May 28 04:53:34.971712 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2475/4826] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:34 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:34.976857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a85fcc2b-9049-4f4c-9606-fcf91bee439a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:34.977725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a85fcc2b-9049-4f4c-9606-fcf91bee439a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:34.988159 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a85fcc2b-9049-4f4c-9606-fcf91bee439a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:34.992978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a85fcc2b-9049-4f4c-9606-fcf91bee439a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:34.994049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a85fcc2b-9049-4f4c-9606-fcf91bee439a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:34.994669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a85fcc2b-9049-4f4c-9606-fcf91bee439a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:35.036763 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ce9c8734-99ef-4aa2-99e4-5539fab201a2 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5" status: 200 len: 344 microversion: 2.1 time: 0.184275 May 28 04:53:35.037391 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2352/4827] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 04:53:34 2022] GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:35.111960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fa76e0c7-fd49-4515-85dc-9230f8f1327c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1691811385", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "012b12af-263c-4753-8fad-4a4022b439aa", "destination_type": "local"}, {"source_type": "volume", "uuid": "34cfbf19-9439-4bcb-b42a-6d82c5e4a880", "destination_type": "invalid"}], "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fa76e0c7-fd49-4515-85dc-9230f8f1327c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 495 May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1691811385", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "012b12af-263c-4753-8fad-4a4022b439aa", "destination_type": "local"}, {"source_type": "volume", "uuid": "34cfbf19-9439-4bcb-b42a-6d82c5e4a880", "destination_type": "invalid"}], "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1691811385', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '012b12af-263c-4753-8fad-4a4022b439aa', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '34cfbf19-9439-4bcb-b42a-6d82c5e4a880', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'd8b90133-44e4-4677-ae8d-d676a447193b'}]}}} May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'invalid' May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:35.116151 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:35.122508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:35.122508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:35.122508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:53:35.122508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:53:35.122508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:53:35.122508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:53:35.122508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:53:35.122508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:53:35.122508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 28 04:53:35.122508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:35.122508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:35.122508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:35.122508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:35.122508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:35.122508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:35.122508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:53:35.122508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:53:35.122508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 28 04:53:35.122508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:35.122508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fa76e0c7-fd49-4515-85dc-9230f8f1327c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:35.125947 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fa76e0c7-fd49-4515-85dc-9230f8f1327c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.019006 May 28 04:53:35.127484 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2353/4828] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:53:35 2022] POST /compute/v2.1/servers => generated 155 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 04:53:35.144623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7dffb309-e276-4a17-a22c-bf02590c53ab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:35.144623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7dffb309-e276-4a17-a22c-bf02590c53ab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:35.169334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7dffb309-e276-4a17-a22c-bf02590c53ab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:35.169832 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7dffb309-e276-4a17-a22c-bf02590c53ab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:35.170792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7dffb309-e276-4a17-a22c-bf02590c53ab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:35.171497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7dffb309-e276-4a17-a22c-bf02590c53ab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:35.574578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7dffb309-e276-4a17-a22c-bf02590c53ab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:35.584607 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7dffb309-e276-4a17-a22c-bf02590c53ab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.452998 May 28 04:53:35.603376 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2354/4829] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:35 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:35.606759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a85fcc2b-9049-4f4c-9606-fcf91bee439a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:35.610762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e9b426a2-6fe9-42f3-b42c-cf52a6775652 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:35.611645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e9b426a2-6fe9-42f3-b42c-cf52a6775652 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:35.618806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9b426a2-6fe9-42f3-b42c-cf52a6775652 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:35.619404 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a85fcc2b-9049-4f4c-9606-fcf91bee439a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1524 microversion: 2.1 time: 0.642907 May 28 04:53:35.619822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9b426a2-6fe9-42f3-b42c-cf52a6775652 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:35.620280 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2476/4830] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:34 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1524 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:35.621191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9b426a2-6fe9-42f3-b42c-cf52a6775652 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:35.621818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9b426a2-6fe9-42f3-b42c-cf52a6775652 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:35.866902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-73b66f3b-f8c6-4cae-a6da-38523cfbe314 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:35.868233 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-73b66f3b-f8c6-4cae-a6da-38523cfbe314 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:35.878158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73b66f3b-f8c6-4cae-a6da-38523cfbe314 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:35.878612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73b66f3b-f8c6-4cae-a6da-38523cfbe314 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:35.879418 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73b66f3b-f8c6-4cae-a6da-38523cfbe314 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:35.879871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73b66f3b-f8c6-4cae-a6da-38523cfbe314 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:35.912249 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e9b426a2-6fe9-42f3-b42c-cf52a6775652 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:35.926729 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e9b426a2-6fe9-42f3-b42c-cf52a6775652 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.321939 May 28 04:53:35.952631 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2355/4831] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:35 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:35.979464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d7104b39-05b9-41b4-8100-49024a1d8860 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:35.986235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d7104b39-05b9-41b4-8100-49024a1d8860 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:35.992067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d7104b39-05b9-41b4-8100-49024a1d8860 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:35.992775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d7104b39-05b9-41b4-8100-49024a1d8860 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:36.001751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d7104b39-05b9-41b4-8100-49024a1d8860 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:36.002543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d7104b39-05b9-41b4-8100-49024a1d8860 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:36.216524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-73b66f3b-f8c6-4cae-a6da-38523cfbe314 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:36.229321 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-73b66f3b-f8c6-4cae-a6da-38523cfbe314 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1524 microversion: 2.1 time: 0.366207 May 28 04:53:36.251466 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2477/4832] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:35 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1524 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:36.266538 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bca2af9b-8632-4817-99f8-89ba1218ba9d tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f77007eb3a0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:36.339782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d7104b39-05b9-41b4-8100-49024a1d8860 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:36.350767 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d7104b39-05b9-41b4-8100-49024a1d8860 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1505 microversion: 2.1 time: 0.375443 May 28 04:53:36.352150 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2356/4833] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:35 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:36.357229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c63dd188-b2f2-44a3-a7ee-fa400b47d7e9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1368565132", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c63dd188-b2f2-44a3-a7ee-fa400b47d7e9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 492 May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1368565132", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1368565132', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'd8b90133-44e4-4677-ae8d-d676a447193b'}]}}} May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: May 28 04:53:36.360775 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 28 04:53:36.364803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:36.370872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c63dd188-b2f2-44a3-a7ee-fa400b47d7e9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:36.370872 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c63dd188-b2f2-44a3-a7ee-fa400b47d7e9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.015779 May 28 04:53:36.370872 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2357/4834] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:53:36 2022] POST /compute/v2.1/servers => generated 624 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:53:36.408674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-93d40fec-04e3-4feb-ab3b-528d430d5ecc tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:36.412175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-93d40fec-04e3-4feb-ab3b-528d430d5ecc tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:36.444235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93d40fec-04e3-4feb-ab3b-528d430d5ecc tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:36.446414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93d40fec-04e3-4feb-ab3b-528d430d5ecc tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:36.447364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93d40fec-04e3-4feb-ab3b-528d430d5ecc tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:36.448756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93d40fec-04e3-4feb-ab3b-528d430d5ecc tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:36.476479 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bca2af9b-8632-4817-99f8-89ba1218ba9d tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5" status: 200 len: 344 microversion: 2.1 time: 0.222365 May 28 04:53:36.477328 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2478/4835] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 04:53:36 2022] GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5 => generated 344 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:36.639736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-baef5d5c-c63d-4f85-9dab-e9a63be257ef tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:36.640351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-baef5d5c-c63d-4f85-9dab-e9a63be257ef tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:36.653699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-baef5d5c-c63d-4f85-9dab-e9a63be257ef tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:36.655957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-baef5d5c-c63d-4f85-9dab-e9a63be257ef tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:36.657879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-baef5d5c-c63d-4f85-9dab-e9a63be257ef tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:36.658518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-baef5d5c-c63d-4f85-9dab-e9a63be257ef tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:36.823970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-93d40fec-04e3-4feb-ab3b-528d430d5ecc tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:36.841378 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-93d40fec-04e3-4feb-ab3b-528d430d5ecc tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.449830 May 28 04:53:36.844358 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2358/4836] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:36 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:36.867713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d84b000f-fd2d-4f5d-b41d-b4f6cebb3cbb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:36.869644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d84b000f-fd2d-4f5d-b41d-b4f6cebb3cbb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:36.902968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d84b000f-fd2d-4f5d-b41d-b4f6cebb3cbb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:36.907579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d84b000f-fd2d-4f5d-b41d-b4f6cebb3cbb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:36.910719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d84b000f-fd2d-4f5d-b41d-b4f6cebb3cbb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:36.915724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d84b000f-fd2d-4f5d-b41d-b4f6cebb3cbb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:37.636955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-baef5d5c-c63d-4f85-9dab-e9a63be257ef tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:37.657529 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-baef5d5c-c63d-4f85-9dab-e9a63be257ef tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1524 microversion: 2.1 time: 1.023330 May 28 04:53:37.677508 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2479/4837] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:36 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1524 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:37.704990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9119f21e-43b3-4d4f-a6a5-60c074d75088 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:37.705636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9119f21e-43b3-4d4f-a6a5-60c074d75088 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:37.751250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9119f21e-43b3-4d4f-a6a5-60c074d75088 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:37.757689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9119f21e-43b3-4d4f-a6a5-60c074d75088 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:37.760012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9119f21e-43b3-4d4f-a6a5-60c074d75088 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:37.766865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9119f21e-43b3-4d4f-a6a5-60c074d75088 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:37.778893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d84b000f-fd2d-4f5d-b41d-b4f6cebb3cbb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:37.796510 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d84b000f-fd2d-4f5d-b41d-b4f6cebb3cbb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.933158 May 28 04:53:37.798441 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2359/4838] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:36 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:37.807270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0a96c9fc-666b-4c9b-a762-c2d78160ccf9 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:37.807912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0a96c9fc-666b-4c9b-a762-c2d78160ccf9 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:37.852107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:37.860627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a96c9fc-666b-4c9b-a762-c2d78160ccf9 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:37.861098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a96c9fc-666b-4c9b-a762-c2d78160ccf9 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:37.861970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a96c9fc-666b-4c9b-a762-c2d78160ccf9 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:37.862420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a96c9fc-666b-4c9b-a762-c2d78160ccf9 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:38.467414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9119f21e-43b3-4d4f-a6a5-60c074d75088 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:38.481994 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9119f21e-43b3-4d4f-a6a5-60c074d75088 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1524 microversion: 2.1 time: 0.802238 May 28 04:53:38.484988 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2480/4839] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:37 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1524 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:38.506600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-676928d8-d1a9-4888-88d6-8df5408f5b09 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f77007ad8b0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:38.640553 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-676928d8-d1a9-4888-88d6-8df5408f5b09 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5" status: 200 len: 344 microversion: 2.1 time: 0.151189 May 28 04:53:38.642152 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2481/4840] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 04:53:38 2022] GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:38.647751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-8e88b1a2-2c3f-434c-b2f5-8fb9a0a10f7b req-31cee81a-3fe6-46ea-8ff1-6391ef5e3751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3087299d-554e-4c36-8eb4-3082257b7e65", "name": "network-vif-plugged", "status": "completed", "tag": "8a7a1ead-8e33-447e-840c-7789196d4eee"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:38.682606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8e88b1a2-2c3f-434c-b2f5-8fb9a0a10f7b req-31cee81a-3fe6-46ea-8ff1-6391ef5e3751 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:38.695838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8e88b1a2-2c3f-434c-b2f5-8fb9a0a10f7b req-31cee81a-3fe6-46ea-8ff1-6391ef5e3751 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:38.751149 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-8e88b1a2-2c3f-434c-b2f5-8fb9a0a10f7b req-31cee81a-3fe6-46ea-8ff1-6391ef5e3751 service nova] Creating event network-vif-plugged:8a7a1ead-8e33-447e-840c-7789196d4eee for instance 3087299d-554e-4c36-8eb4-3082257b7e65 on n-h2-843700-1 May 28 04:53:38.779714 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-8e88b1a2-2c3f-434c-b2f5-8fb9a0a10f7b req-31cee81a-3fe6-46ea-8ff1-6391ef5e3751 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135332 May 28 04:53:38.786396 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2482/4841] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:38.802345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-70fa0497-9e83-41b0-8711-49abc58330b1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-70fa0497-9e83-41b0-8711-49abc58330b1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 416 May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'networks': [{'uuid': 'd8b90133-44e4-4677-ae8d-d676a447193b'}]}}} May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise error May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:38.823362 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 04:53:38.827622 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:38.835445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-70fa0497-9e83-41b0-8711-49abc58330b1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:38.842522 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-70fa0497-9e83-41b0-8711-49abc58330b1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.043399 May 28 04:53:38.843303 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2483/4842] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:53:38 2022] POST /compute/v2.1/servers => generated 619 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:53:38.873577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-93016462-b296-4f92-80ef-e0dcfa255084 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:38.876140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-93016462-b296-4f92-80ef-e0dcfa255084 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:38.915315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93016462-b296-4f92-80ef-e0dcfa255084 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:38.915315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93016462-b296-4f92-80ef-e0dcfa255084 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:38.924189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93016462-b296-4f92-80ef-e0dcfa255084 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:38.927614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93016462-b296-4f92-80ef-e0dcfa255084 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:38.969380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0a96c9fc-666b-4c9b-a762-c2d78160ccf9 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:38.993476 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0a96c9fc-666b-4c9b-a762-c2d78160ccf9 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1505 microversion: 2.1 time: 1.193867 May 28 04:53:38.997869 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2360/4843] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:37 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1505 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:39.019492 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dfe0e97a-2b16-4288-afe3-206b84ca807f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:39.030095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dfe0e97a-2b16-4288-afe3-206b84ca807f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:39.057594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfe0e97a-2b16-4288-afe3-206b84ca807f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:39.058471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfe0e97a-2b16-4288-afe3-206b84ca807f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:39.061869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfe0e97a-2b16-4288-afe3-206b84ca807f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:39.062557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfe0e97a-2b16-4288-afe3-206b84ca807f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:39.747944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dfe0e97a-2b16-4288-afe3-206b84ca807f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:39.757019 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dfe0e97a-2b16-4288-afe3-206b84ca807f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.756920 May 28 04:53:39.759718 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2361/4844] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:38 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:39.780367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e227ac58-36fd-4b8e-b7fb-6a69f68dbb2b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:39.786424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-93016462-b296-4f92-80ef-e0dcfa255084 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:39.796255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e227ac58-36fd-4b8e-b7fb-6a69f68dbb2b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:39.797527 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-93016462-b296-4f92-80ef-e0dcfa255084 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1524 microversion: 2.1 time: 0.949604 May 28 04:53:39.801060 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2484/4845] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:38 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1524 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:39.832155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e227ac58-36fd-4b8e-b7fb-6a69f68dbb2b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:39.835206 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e227ac58-36fd-4b8e-b7fb-6a69f68dbb2b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:39.835858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-221afcf5-b1ac-4c1a-8bdb-d621ffbb9aa1 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f7701b4e5e0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:39.839158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e227ac58-36fd-4b8e-b7fb-6a69f68dbb2b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:39.845323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e227ac58-36fd-4b8e-b7fb-6a69f68dbb2b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:39.900311 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-221afcf5-b1ac-4c1a-8bdb-d621ffbb9aa1 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] HTTP exception thrown: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-221afcf5-b1ac-4c1a-8bdb-d621ffbb9aa1 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Request method failure captured: May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5 HTTP/1.1 May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaq6NgdYkq0i19972adjZVTvrw0y-nspeCKa7LJSl-x9iAYfVi-ppSl4tgDDWVnweXjFQQRsoTHKoWctJwFZODmyZjbRN5Cns26PVDqYjRlKnqC4rPk5aApszYDKwUywCMkqK_NnSmzxtAb6FU8Nq89FXjTliYOHyxaf9iQk6E9J4xI May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 72402d174d034867a61bbad7484d922a May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-963804881 May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_72402d174d034867a61bbad7484d922a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/72402d174d034867a61bbad7484d922a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/72402d174d034867a61bbad7484d922a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/72402d174d034867a61bbad7484d922a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-VolumesSnapshotsTestJSON-963804881 May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 72402d174d034867a61bbad7484d922a May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-963804881 May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-VolumesSnapshotsTestJSON-963804881-project May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: ab287a65f06f4cfa951d64df65ad457f May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-VolumesSnapshotsTestJSON-963804881-project May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: exception: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'd738397f-be29-46fd-ba8f-1b14c893edc5'} May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. (HTTP 404) (Request-ID: req-0652781f-9f03-4246-b354-c3a612a34a09) May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 04:53:39.902721 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. May 28 04:53:39.908563 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:39.915109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-221afcf5-b1ac-4c1a-8bdb-d621ffbb9aa1 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Returning 404 to user: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:39.915109 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-221afcf5-b1ac-4c1a-8bdb-d621ffbb9aa1 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5" status: 404 len: 109 microversion: 2.1 time: 0.111106 May 28 04:53:39.916240 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2485/4846] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 04:53:39 2022] GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5 => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:53:39.929256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5aa7033e-2fbd-4c3a-8603-5a1a06159d24 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:39.937413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5aa7033e-2fbd-4c3a-8603-5a1a06159d24 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:39.972209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5aa7033e-2fbd-4c3a-8603-5a1a06159d24 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:39.972696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5aa7033e-2fbd-4c3a-8603-5a1a06159d24 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:39.973517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5aa7033e-2fbd-4c3a-8603-5a1a06159d24 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:39.973961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5aa7033e-2fbd-4c3a-8603-5a1a06159d24 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:40.434448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5aa7033e-2fbd-4c3a-8603-5a1a06159d24 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:40.448618 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5aa7033e-2fbd-4c3a-8603-5a1a06159d24 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.528581 May 28 04:53:40.450266 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2486/4847] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:39 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:40.468493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-055c7a86-4aec-4c04-af25-b08e317183c2 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f77007e3160>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:40.490999 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e227ac58-36fd-4b8e-b7fb-6a69f68dbb2b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:40.508840 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e227ac58-36fd-4b8e-b7fb-6a69f68dbb2b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1524 microversion: 2.1 time: 0.744483 May 28 04:53:40.511727 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2362/4848] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:39 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1524 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:40.528072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e875b6b1-e217-4f7b-93e1-e4d215526ec1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:40.530287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e875b6b1-e217-4f7b-93e1-e4d215526ec1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:40.556336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e875b6b1-e217-4f7b-93e1-e4d215526ec1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:40.557257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e875b6b1-e217-4f7b-93e1-e4d215526ec1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:40.558257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e875b6b1-e217-4f7b-93e1-e4d215526ec1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:40.559515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e875b6b1-e217-4f7b-93e1-e4d215526ec1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:40.580875 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-055c7a86-4aec-4c04-af25-b08e317183c2 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] HTTP exception thrown: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-055c7a86-4aec-4c04-af25-b08e317183c2 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Request method failure captured: May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5 HTTP/1.1 May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaq6NgdYkq0i19972adjZVTvrw0y-nspeCKa7LJSl-x9iAYfVi-ppSl4tgDDWVnweXjFQQRsoTHKoWctJwFZODmyZjbRN5Cns26PVDqYjRlKnqC4rPk5aApszYDKwUywCMkqK_NnSmzxtAb6FU8Nq89FXjTliYOHyxaf9iQk6E9J4xI May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 72402d174d034867a61bbad7484d922a May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-963804881 May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_72402d174d034867a61bbad7484d922a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/72402d174d034867a61bbad7484d922a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/72402d174d034867a61bbad7484d922a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/72402d174d034867a61bbad7484d922a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-VolumesSnapshotsTestJSON-963804881 May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 72402d174d034867a61bbad7484d922a May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-963804881 May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-VolumesSnapshotsTestJSON-963804881-project May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: ab287a65f06f4cfa951d64df65ad457f May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-VolumesSnapshotsTestJSON-963804881-project May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: exception: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'd738397f-be29-46fd-ba8f-1b14c893edc5'} May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. (HTTP 404) (Request-ID: req-e591893e-45ee-4bfe-8704-c832b15f5572) May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 04:53:40.583373 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-055c7a86-4aec-4c04-af25-b08e317183c2 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Returning 404 to user: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:40.590332 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-055c7a86-4aec-4c04-af25-b08e317183c2 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5" status: 404 len: 109 microversion: 2.1 time: 0.130033 May 28 04:53:40.601132 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2487/4849] 10.222.0.58 () {58 vars in 1247 bytes} [Sat May 28 04:53:40 2022] DELETE /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5 => generated 109 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:53:40.613946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-72eee92a-26f5-4e8f-adcf-d5104388f349 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Calling method '.version_select at 0x7f77007ad550>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:40.644290 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:40.703937 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-72eee92a-26f5-4e8f-adcf-d5104388f349 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] HTTP exception thrown: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-72eee92a-26f5-4e8f-adcf-d5104388f349 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Request method failure captured: May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5 HTTP/1.1 May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaq6NgdYkq0i19972adjZVTvrw0y-nspeCKa7LJSl-x9iAYfVi-ppSl4tgDDWVnweXjFQQRsoTHKoWctJwFZODmyZjbRN5Cns26PVDqYjRlKnqC4rPk5aApszYDKwUywCMkqK_NnSmzxtAb6FU8Nq89FXjTliYOHyxaf9iQk6E9J4xI May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 72402d174d034867a61bbad7484d922a May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-963804881 May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_72402d174d034867a61bbad7484d922a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/72402d174d034867a61bbad7484d922a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/72402d174d034867a61bbad7484d922a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/72402d174d034867a61bbad7484d922a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-VolumesSnapshotsTestJSON-963804881 May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 72402d174d034867a61bbad7484d922a May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-963804881 May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-VolumesSnapshotsTestJSON-963804881-project May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: ab287a65f06f4cfa951d64df65ad457f May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-VolumesSnapshotsTestJSON-963804881-project May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: exception: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'd738397f-be29-46fd-ba8f-1b14c893edc5'} May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. (HTTP 404) (Request-ID: req-629b3db1-e295-4f86-88fb-518fe205c460) May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 04:53:40.706566 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. May 28 04:53:40.711922 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:40.717287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-72eee92a-26f5-4e8f-adcf-d5104388f349 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] Returning 404 to user: Volume d738397f-be29-46fd-ba8f-1b14c893edc5 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:40.718378 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-72eee92a-26f5-4e8f-adcf-d5104388f349 tempest-VolumesSnapshotsTestJSON-963804881 tempest-VolumesSnapshotsTestJSON-963804881-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5" status: 404 len: 109 microversion: 2.1 time: 0.112603 May 28 04:53:40.719206 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2488/4850] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 04:53:40 2022] GET /compute/v2.1/os-volumes/d738397f-be29-46fd-ba8f-1b14c893edc5 => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:53:40.821084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5d0f9822-4606-42c0-892b-cc0054d73754 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:40.822518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5d0f9822-4606-42c0-892b-cc0054d73754 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:40.832607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d0f9822-4606-42c0-892b-cc0054d73754 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:40.856084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d0f9822-4606-42c0-892b-cc0054d73754 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:40.856084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d0f9822-4606-42c0-892b-cc0054d73754 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:40.856084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d0f9822-4606-42c0-892b-cc0054d73754 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:41.458709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5d0f9822-4606-42c0-892b-cc0054d73754 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:41.471459 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5d0f9822-4606-42c0-892b-cc0054d73754 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1524 microversion: 2.1 time: 0.654768 May 28 04:53:41.486014 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2489/4851] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:40 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1524 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:41.499630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-46c36237-8341-4626-9b67-cd758129f87e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1705711437", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": -1, "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:41.516897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e875b6b1-e217-4f7b-93e1-e4d215526ec1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:41.521768 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-46c36237-8341-4626-9b67-cd758129f87e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Flavor -1 could not be found. May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-46c36237-8341-4626-9b67-cd758129f87e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 206 May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1705711437", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": -1, "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: exception: Flavor -1 could not be found. May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1705711437', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': -1, 'networks': [{'uuid': 'd8b90133-44e4-4677-ae8d-d676a447193b'}]}}} May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:41.524582 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:41.531289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:41.531289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:41.531289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:41.531289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:41.531289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 04:53:41.531289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 28 04:53:41.531289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 28 04:53:41.531289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. May 28 04:53:41.531289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:41.531289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:41.531289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:41.531289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:41.531289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:41.531289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:41.531289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:41.531289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:41.531289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. May 28 04:53:41.531289 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:41.533291 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e875b6b1-e217-4f7b-93e1-e4d215526ec1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1505 microversion: 2.1 time: 1.012250 May 28 04:53:41.533291 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2363/4852] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:40 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1505 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:41.535909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-46c36237-8341-4626-9b67-cd758129f87e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:41.536956 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-46c36237-8341-4626-9b67-cd758129f87e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.049135 May 28 04:53:41.538121 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2490/4853] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:53:41 2022] POST /compute/v2.1/servers => generated 73 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 04:53:41.539181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-349e3eb9-d906-4b63-849f-26f5ad1fc9b8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:41.539822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-349e3eb9-d906-4b63-849f-26f5ad1fc9b8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:41.548919 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c7675e18-b90a-4c33-9508-53310cfd0de9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:41.559263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c7675e18-b90a-4c33-9508-53310cfd0de9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:41.559418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-349e3eb9-d906-4b63-849f-26f5ad1fc9b8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:41.559418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-349e3eb9-d906-4b63-849f-26f5ad1fc9b8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:41.559418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-349e3eb9-d906-4b63-849f-26f5ad1fc9b8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:41.559418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-349e3eb9-d906-4b63-849f-26f5ad1fc9b8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:41.571607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c7675e18-b90a-4c33-9508-53310cfd0de9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:41.572442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c7675e18-b90a-4c33-9508-53310cfd0de9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:41.575342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c7675e18-b90a-4c33-9508-53310cfd0de9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:41.576372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c7675e18-b90a-4c33-9508-53310cfd0de9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:42.009559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c7675e18-b90a-4c33-9508-53310cfd0de9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:42.017666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:42.019782 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c7675e18-b90a-4c33-9508-53310cfd0de9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.476835 May 28 04:53:42.020308 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2491/4854] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:41 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:42.051659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-349e3eb9-d906-4b63-849f-26f5ad1fc9b8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:42.060861 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-349e3eb9-d906-4b63-849f-26f5ad1fc9b8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1524 microversion: 2.1 time: 0.531025 May 28 04:53:42.070443 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4c2a0df3-2d14-4ba8-984a-e02b08d46e2d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:42.071103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4c2a0df3-2d14-4ba8-984a-e02b08d46e2d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:42.089272 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2364/4855] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:41 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1524 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:42.114310 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c2a0df3-2d14-4ba8-984a-e02b08d46e2d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:42.114803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c2a0df3-2d14-4ba8-984a-e02b08d46e2d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:42.118661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c2a0df3-2d14-4ba8-984a-e02b08d46e2d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:42.123327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c2a0df3-2d14-4ba8-984a-e02b08d46e2d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:42.385344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4c2a0df3-2d14-4ba8-984a-e02b08d46e2d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:42.396276 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4c2a0df3-2d14-4ba8-984a-e02b08d46e2d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.354235 May 28 04:53:42.410847 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2492/4856] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:42 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:42.491767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-04e96331-f601-46fb-9d10-1a634dc43a72 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:42.492461 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-04e96331-f601-46fb-9d10-1a634dc43a72 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:42.512570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-04e96331-f601-46fb-9d10-1a634dc43a72 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:42.519400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-04e96331-f601-46fb-9d10-1a634dc43a72 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:42.520370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-04e96331-f601-46fb-9d10-1a634dc43a72 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:42.520835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-04e96331-f601-46fb-9d10-1a634dc43a72 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:42.547506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-941d5ccb-2a44-41c3-ab21-04311a1c9b3d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:42.548017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-941d5ccb-2a44-41c3-ab21-04311a1c9b3d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:42.584072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-941d5ccb-2a44-41c3-ab21-04311a1c9b3d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:42.584072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-941d5ccb-2a44-41c3-ab21-04311a1c9b3d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:42.593250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-941d5ccb-2a44-41c3-ab21-04311a1c9b3d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:42.594257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-941d5ccb-2a44-41c3-ab21-04311a1c9b3d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:43.171320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-04e96331-f601-46fb-9d10-1a634dc43a72 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:43.184444 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-04e96331-f601-46fb-9d10-1a634dc43a72 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1524 microversion: 2.1 time: 0.696586 May 28 04:53:43.189082 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2365/4857] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:42 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1524 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:43.206267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-941d5ccb-2a44-41c3-ab21-04311a1c9b3d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:43.212712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3fd8ea65-5f18-48e9-b26d-69faaa9e505a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1766590452", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3fd8ea65-5f18-48e9-b26d-69faaa9e505a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 173 May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1766590452", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1766590452', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'd8b90133-44e4-4677-ae8d-d676a447193b'}]}}} May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi -1 May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:53:43.218436 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:53:43.224700 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:53:43.224700 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:53:43.224700 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 28 04:53:43.224700 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:43.224700 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:43.224700 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:43.224700 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:43.224700 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:43.224700 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:43.224700 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:53:43.224700 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:53:43.224700 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 28 04:53:43.224700 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:43.227371 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-941d5ccb-2a44-41c3-ab21-04311a1c9b3d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1505 microversion: 2.1 time: 0.679503 May 28 04:53:43.228254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3fd8ea65-5f18-48e9-b26d-69faaa9e505a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:43.229397 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3fd8ea65-5f18-48e9-b26d-69faaa9e505a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.037236 May 28 04:53:43.233626 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2493/4858] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:42 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1505 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:43.234222 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2366/4859] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:53:43 2022] POST /compute/v2.1/servers => generated 145 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:53:43.240820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-db9cb25d-4e98-4070-a8bd-3b9be81aacc9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:43.242115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-db9cb25d-4e98-4070-a8bd-3b9be81aacc9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:43.243279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e87008f4-4756-4c9a-83d4-7f4a36130d92 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:43.247235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e87008f4-4756-4c9a-83d4-7f4a36130d92 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:43.259017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e87008f4-4756-4c9a-83d4-7f4a36130d92 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:43.259318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db9cb25d-4e98-4070-a8bd-3b9be81aacc9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:43.260155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db9cb25d-4e98-4070-a8bd-3b9be81aacc9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:43.260651 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e87008f4-4756-4c9a-83d4-7f4a36130d92 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:43.261697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db9cb25d-4e98-4070-a8bd-3b9be81aacc9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:43.262793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e87008f4-4756-4c9a-83d4-7f4a36130d92 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:43.263331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e87008f4-4756-4c9a-83d4-7f4a36130d92 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:43.266849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db9cb25d-4e98-4070-a8bd-3b9be81aacc9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:43.709117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e87008f4-4756-4c9a-83d4-7f4a36130d92 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:43.709117 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e87008f4-4756-4c9a-83d4-7f4a36130d92 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1524 microversion: 2.1 time: 0.430024 May 28 04:53:43.709117 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2494/4860] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:43 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1524 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:43.722838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-de9d8c00-4b58-4535-ac91-db70ca2ead26 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1641033810", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "d3c40751-8e05-4111-8cbf-459e5a833f5d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2044320799", "security_groups": [{"name": "tempest-secgroup-smoke-727214677"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:43.940308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-db9cb25d-4e98-4070-a8bd-3b9be81aacc9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:43.970431 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-db9cb25d-4e98-4070-a8bd-3b9be81aacc9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.721524 May 28 04:53:43.982520 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2367/4861] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:43 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:44.004376 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fffef79e-f602-4cc2-b49c-11ca892d98ee tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:44.005016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fffef79e-f602-4cc2-b49c-11ca892d98ee tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:44.029151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fffef79e-f602-4cc2-b49c-11ca892d98ee tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:44.033564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fffef79e-f602-4cc2-b49c-11ca892d98ee tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:44.036588 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fffef79e-f602-4cc2-b49c-11ca892d98ee tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:44.038113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fffef79e-f602-4cc2-b49c-11ca892d98ee tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:44.240891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-de9d8c00-4b58-4535-ac91-db70ca2ead26 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] validate_networks() for [('d3c40751-8e05-4111-8cbf-459e5a833f5d', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:53:44.483402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fffef79e-f602-4cc2-b49c-11ca892d98ee tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:44.498132 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fffef79e-f602-4cc2-b49c-11ca892d98ee tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.513762 May 28 04:53:44.517519 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2368/4862] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:43 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:44.530411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b0426f38-671a-486f-a10f-a0a036129524 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:44.535554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b0426f38-671a-486f-a10f-a0a036129524 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:44.566908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0426f38-671a-486f-a10f-a0a036129524 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:44.568914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0426f38-671a-486f-a10f-a0a036129524 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:44.571906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0426f38-671a-486f-a10f-a0a036129524 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:44.572575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0426f38-671a-486f-a10f-a0a036129524 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:45.463395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b0426f38-671a-486f-a10f-a0a036129524 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:45.481453 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b0426f38-671a-486f-a10f-a0a036129524 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1524 microversion: 2.1 time: 0.961195 May 28 04:53:45.483486 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2369/4863] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:44 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1524 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:45.488366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-abf07a9f-2847-489f-9b74-3e4b78865971 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:45.489324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-abf07a9f-2847-489f-9b74-3e4b78865971 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:45.503630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abf07a9f-2847-489f-9b74-3e4b78865971 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:45.504355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abf07a9f-2847-489f-9b74-3e4b78865971 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:45.505369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abf07a9f-2847-489f-9b74-3e4b78865971 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:45.506769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abf07a9f-2847-489f-9b74-3e4b78865971 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:45.874047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-abf07a9f-2847-489f-9b74-3e4b78865971 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:45.882331 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-abf07a9f-2847-489f-9b74-3e4b78865971 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1505 microversion: 2.1 time: 0.397529 May 28 04:53:45.891322 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2370/4864] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:45 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1505 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:45.898495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-04693261-32a5-414c-b136-460cd68cd81b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:45.899161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-04693261-32a5-414c-b136-460cd68cd81b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:45.920099 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-04693261-32a5-414c-b136-460cd68cd81b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:45.922631 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-04693261-32a5-414c-b136-460cd68cd81b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:45.922631 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-04693261-32a5-414c-b136-460cd68cd81b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:45.923010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-04693261-32a5-414c-b136-460cd68cd81b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:46.074590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-de9d8c00-4b58-4535-ac91-db70ca2ead26 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:53:46.075168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-de9d8c00-4b58-4535-ac91-db70ca2ead26 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:53:46.076388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-de9d8c00-4b58-4535-ac91-db70ca2ead26 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:53:46.077232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-de9d8c00-4b58-4535-ac91-db70ca2ead26 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:53:46.077851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-de9d8c00-4b58-4535-ac91-db70ca2ead26 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:53:46.124506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de9d8c00-4b58-4535-ac91-db70ca2ead26 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:46.124975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de9d8c00-4b58-4535-ac91-db70ca2ead26 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:46.125806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de9d8c00-4b58-4535-ac91-db70ca2ead26 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:46.126257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de9d8c00-4b58-4535-ac91-db70ca2ead26 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:46.207141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-de9d8c00-4b58-4535-ac91-db70ca2ead26 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Getting quotas for project d14e7de3a28f42a79197e1c06c4676dd. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:53:46.229295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-de9d8c00-4b58-4535-ac91-db70ca2ead26 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Getting quotas for user 82b17444b87742e1b45409810cbe06d2 and project d14e7de3a28f42a79197e1c06c4676dd. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:53:46.253258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-de9d8c00-4b58-4535-ac91-db70ca2ead26 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:53:46.255947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-de9d8c00-4b58-4535-ac91-db70ca2ead26 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:53:46.278567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-04693261-32a5-414c-b136-460cd68cd81b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:46.290264 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-04693261-32a5-414c-b136-460cd68cd81b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1524 microversion: 2.1 time: 0.398345 May 28 04:53:46.291498 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2371/4865] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:45 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1524 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:46.297954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-19be8dd5-fc4f-4a69-90bc-f6ee3b2d6b1f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-300141516", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:46.303404 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-19be8dd5-fc4f-4a69-90bc-f6ee3b2d6b1f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-19be8dd5-fc4f-4a69-90bc-f6ee3b2d6b1f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 215 May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-300141516", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-300141516', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._validate_network_id( May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:46.306872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:46.313191 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:46.313191 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:46.313191 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:46.313191 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:46.313191 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:46.313191 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 28 04:53:46.313191 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:46.313191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-19be8dd5-fc4f-4a69-90bc-f6ee3b2d6b1f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:46.313191 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-19be8dd5-fc4f-4a69-90bc-f6ee3b2d6b1f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.014309 May 28 04:53:46.313191 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2372/4866] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:53:46 2022] POST /compute/v2.1/servers => generated 123 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:53:46.320394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-03f277d7-384a-451f-a771-96371d0c4152 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:46.321569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-03f277d7-384a-451f-a771-96371d0c4152 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:46.337472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03f277d7-384a-451f-a771-96371d0c4152 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:46.338088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03f277d7-384a-451f-a771-96371d0c4152 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:46.339223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03f277d7-384a-451f-a771-96371d0c4152 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:46.339772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03f277d7-384a-451f-a771-96371d0c4152 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:46.511686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-03f277d7-384a-451f-a771-96371d0c4152 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:46.521413 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-03f277d7-384a-451f-a771-96371d0c4152 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.204984 May 28 04:53:46.544515 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2373/4867] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:46 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:46.556104 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-de9d8c00-4b58-4535-ac91-db70ca2ead26 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.838422 May 28 04:53:46.556761 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2495/4868] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:53:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 2840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 04:53:46.569526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c9222338-7baa-440f-810d-1adcebb3b97c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:46.570475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c9222338-7baa-440f-810d-1adcebb3b97c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:46.574233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4459b55e-238a-47f5-a14b-3cab10dac6dc tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:46.576739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4459b55e-238a-47f5-a14b-3cab10dac6dc tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:46.579675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9222338-7baa-440f-810d-1adcebb3b97c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:46.580325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9222338-7baa-440f-810d-1adcebb3b97c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:46.581276 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9222338-7baa-440f-810d-1adcebb3b97c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:46.581889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9222338-7baa-440f-810d-1adcebb3b97c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:46.596373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4459b55e-238a-47f5-a14b-3cab10dac6dc tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:46.600339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4459b55e-238a-47f5-a14b-3cab10dac6dc tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:46.607785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4459b55e-238a-47f5-a14b-3cab10dac6dc tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:46.611399 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4459b55e-238a-47f5-a14b-3cab10dac6dc tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:47.182107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c9222338-7baa-440f-810d-1adcebb3b97c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:47.198017 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c9222338-7baa-440f-810d-1adcebb3b97c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.634659 May 28 04:53:47.210710 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2496/4869] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:46 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:47.215834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3e7e92c5-daa8-49b8-bad4-605dee42d8f3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:47.216929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3e7e92c5-daa8-49b8-bad4-605dee42d8f3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:47.399790 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3e7e92c5-daa8-49b8-bad4-605dee42d8f3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:47.411702 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3e7e92c5-daa8-49b8-bad4-605dee42d8f3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1267 microversion: 2.1 time: 0.207431 May 28 04:53:47.423311 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2497/4870] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:47 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:47.428250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4459b55e-238a-47f5-a14b-3cab10dac6dc tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:47.429853 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7f240232-3e14-4c3b-b3e4-29998535330b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:47.430719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7f240232-3e14-4c3b-b3e4-29998535330b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:47.442786 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4459b55e-238a-47f5-a14b-3cab10dac6dc tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1524 microversion: 2.1 time: 0.883536 May 28 04:53:47.444922 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2374/4871] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:46 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1524 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:47.455565 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-87a90ee9-79e9-4fac-b2a6-33ff3973f442 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:47.455782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f240232-3e14-4c3b-b3e4-29998535330b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:47.457259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f240232-3e14-4c3b-b3e4-29998535330b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:47.460102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f240232-3e14-4c3b-b3e4-29998535330b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:47.462446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f240232-3e14-4c3b-b3e4-29998535330b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:47.463920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-87a90ee9-79e9-4fac-b2a6-33ff3973f442 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:47.481802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87a90ee9-79e9-4fac-b2a6-33ff3973f442 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:47.482922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87a90ee9-79e9-4fac-b2a6-33ff3973f442 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:47.484039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87a90ee9-79e9-4fac-b2a6-33ff3973f442 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:47.487471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87a90ee9-79e9-4fac-b2a6-33ff3973f442 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:47.877227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7f240232-3e14-4c3b-b3e4-29998535330b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:47.906522 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7f240232-3e14-4c3b-b3e4-29998535330b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1505 microversion: 2.1 time: 0.481851 May 28 04:53:47.907905 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2498/4872] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:47 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1505 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:47.912878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-55cc6ab4-4e0d-4a62-a9ff-c600888bf1db tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-41038719", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "key_name": "tempest-key-1058354766", "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:47.941582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-87a90ee9-79e9-4fac-b2a6-33ff3973f442 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:47.953388 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-87a90ee9-79e9-4fac-b2a6-33ff3973f442 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1524 microversion: 2.1 time: 0.507083 May 28 04:53:47.954370 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2375/4873] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:47 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1524 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:48.441561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8a9014ee-4b11-4154-b8c2-a0a7582faa68 tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] Action: 'create', calling method: .version_select at 0x7f7701c939d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-15620247", "metadata": {"Type": "work"}}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8a9014ee-4b11-4154-b8c2-a0a7582faa68 tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] Request method failure captured: May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 120 May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikarbxsjTzdRUzRGaCihppQGHb3reR1q1oz463UhmQPxXG5YmQFMUmXlArAxrjMWaqNWhsLQRqf6662zFB4rvZSZeOS8noYilwiFAhLMFzbJudD_qtt5pQIVzwWgphqNaM70ihE6qBeRBT5gdf5RmXf2xCmP3uVL8rCEF-_Qi7KE0shQ May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d7c51cac535f4ca8ac9a0539911f5b76 May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-VolumesNegativeTest-1995439743 May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-VolumesNegativeTest-1995439743 May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d7c51cac535f4ca8ac9a0539911f5b76 May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-VolumesNegativeTest-1995439743 May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-VolumesNegativeTest-1995439743-project May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: f33825384535457487cd387b6d0a0ec7 May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-VolumesNegativeTest-1995439743-project May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-15620247", "metadata": {"Type": "work"}}} May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-15620247', 'metadata': {'Type': 'work'}}}} May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['volume']: May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi '#$%' May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:53:48.442718 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:53:48.449613 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 28 04:53:48.449613 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:48.449613 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:48.449613 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:48.449613 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:48.449613 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:48.449613 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:48.449613 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:53:48.449613 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:53:48.449613 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 28 04:53:48.449613 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:48.449613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8a9014ee-4b11-4154-b8c2-a0a7582faa68 tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:48.449613 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8a9014ee-4b11-4154-b8c2-a0a7582faa68 tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.491430 May 28 04:53:48.449613 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2376/4874] 10.222.0.58 () {60 vars in 1155 bytes} [Sat May 28 04:53:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 493 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:53:48.456426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-88e2ef4a-5e9d-4f3f-baab-5173362639ab tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:48.471104 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-88e2ef4a-5e9d-4f3f-baab-5173362639ab tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:48.495928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88e2ef4a-5e9d-4f3f-baab-5173362639ab tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:48.496823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88e2ef4a-5e9d-4f3f-baab-5173362639ab tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:48.498341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88e2ef4a-5e9d-4f3f-baab-5173362639ab tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:48.499004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88e2ef4a-5e9d-4f3f-baab-5173362639ab tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:48.620677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-88e2ef4a-5e9d-4f3f-baab-5173362639ab tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:48.632576 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-88e2ef4a-5e9d-4f3f-baab-5173362639ab tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1263 microversion: 2.1 time: 0.182748 May 28 04:53:48.633575 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2377/4875] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:48 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1263 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:48.640126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8bc98964-f857-4604-82c2-18606036b60c tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] Action: 'create', calling method: .version_select at 0x7f7701cd53a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-436651643", "metadata": {"Type": "work"}}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8bc98964-f857-4604-82c2-18606036b60c tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] Request method failure captured: May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 119 May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikarbxsjTzdRUzRGaCihppQGHb3reR1q1oz463UhmQPxXG5YmQFMUmXlArAxrjMWaqNWhsLQRqf6662zFB4rvZSZeOS8noYilwiFAhLMFzbJudD_qtt5pQIVzwWgphqNaM70ihE6qBeRBT5gdf5RmXf2xCmP3uVL8rCEF-_Qi7KE0shQ May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d7c51cac535f4ca8ac9a0539911f5b76 May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-VolumesNegativeTest-1995439743 May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-VolumesNegativeTest-1995439743 May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d7c51cac535f4ca8ac9a0539911f5b76 May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-VolumesNegativeTest-1995439743 May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-VolumesNegativeTest-1995439743-project May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: f33825384535457487cd387b6d0a0ec7 May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-VolumesNegativeTest-1995439743-project May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-436651643", "metadata": {"Type": "work"}}} May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-436651643', 'metadata': {'Type': 'work'}}}} May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['volume']: May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi '0' May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:53:48.643547 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:53:48.648413 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 28 04:53:48.648413 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:48.648413 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:48.648413 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:48.648413 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:48.648413 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:48.648413 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:48.648413 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:53:48.648413 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:53:48.648413 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 28 04:53:48.648413 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:48.657321 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8bc98964-f857-4604-82c2-18606036b60c tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:48.667386 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8bc98964-f857-4604-82c2-18606036b60c tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.032048 May 28 04:53:48.671183 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2378/4876] 10.222.0.58 () {60 vars in 1155 bytes} [Sat May 28 04:53:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:53:48.682878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c6bf60a3-5b23-4dc6-85da-0b4f9f671e6a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:48.682878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c6bf60a3-5b23-4dc6-85da-0b4f9f671e6a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:48.711422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6bf60a3-5b23-4dc6-85da-0b4f9f671e6a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:48.711898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6bf60a3-5b23-4dc6-85da-0b4f9f671e6a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:48.712683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6bf60a3-5b23-4dc6-85da-0b4f9f671e6a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:48.713129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6bf60a3-5b23-4dc6-85da-0b4f9f671e6a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:48.750702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-55cc6ab4-4e0d-4a62-a9ff-c600888bf1db tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] validate_networks() for [('d8b90133-44e4-4677-ae8d-d676a447193b', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:53:49.300439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c6bf60a3-5b23-4dc6-85da-0b4f9f671e6a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:49.313352 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c6bf60a3-5b23-4dc6-85da-0b4f9f671e6a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1524 microversion: 2.1 time: 0.640241 May 28 04:53:49.315292 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2379/4877] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:48 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1524 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:49.328422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-326524fd-2a3d-420a-81c5-cfa515c959c9 tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] Action: 'create', calling method: .version_select at 0x7f7701cd5670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1361230416", "metadata": {"Type": "work"}}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-326524fd-2a3d-420a-81c5-cfa515c959c9 tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] Request method failure captured: May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 119 May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikarbxsjTzdRUzRGaCihppQGHb3reR1q1oz463UhmQPxXG5YmQFMUmXlArAxrjMWaqNWhsLQRqf6662zFB4rvZSZeOS8noYilwiFAhLMFzbJudD_qtt5pQIVzwWgphqNaM70ihE6qBeRBT5gdf5RmXf2xCmP3uVL8rCEF-_Qi7KE0shQ May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d7c51cac535f4ca8ac9a0539911f5b76 May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-VolumesNegativeTest-1995439743 May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-VolumesNegativeTest-1995439743 May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d7c51cac535f4ca8ac9a0539911f5b76 May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-VolumesNegativeTest-1995439743 May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-VolumesNegativeTest-1995439743-project May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: f33825384535457487cd387b6d0a0ec7 May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-VolumesNegativeTest-1995439743-project May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1361230416", "metadata": {"Type": "work"}}} May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1361230416', 'metadata': {'Type': 'work'}}}} May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['volume']: May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi '' May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:53:49.331170 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:53:49.344785 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 28 04:53:49.344785 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:49.344785 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:49.344785 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:49.344785 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:49.344785 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:49.344785 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:49.344785 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:53:49.344785 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:53:49.344785 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 28 04:53:49.344785 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:49.344785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-326524fd-2a3d-420a-81c5-cfa515c959c9 tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:49.344785 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-326524fd-2a3d-420a-81c5-cfa515c959c9 tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020373 May 28 04:53:49.344785 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2380/4878] 10.222.0.58 () {60 vars in 1155 bytes} [Sat May 28 04:53:49 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:53:49.358926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7999cfe0-e506-4808-8aa1-81ef61146922 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:49.359697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7999cfe0-e506-4808-8aa1-81ef61146922 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:49.389850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7999cfe0-e506-4808-8aa1-81ef61146922 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:49.397252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7999cfe0-e506-4808-8aa1-81ef61146922 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:49.398412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7999cfe0-e506-4808-8aa1-81ef61146922 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:49.399605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7999cfe0-e506-4808-8aa1-81ef61146922 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:49.435733 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-55cc6ab4-4e0d-4a62-a9ff-c600888bf1db tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Invalid key_name provided. May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-55cc6ab4-4e0d-4a62-a9ff-c600888bf1db tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 245 May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-41038719", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "key_name": "tempest-key-1058354766", "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: exception: Invalid key_name provided. May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-41038719', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'key_name': 'tempest-key-1058354766', 'networks': [{'uuid': 'd8b90133-44e4-4677-ae8d-d676a447193b'}]}}} May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._create_instance( May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1058354766 not found for user 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:49.438030 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. May 28 04:53:49.442805 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:49.446021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-55cc6ab4-4e0d-4a62-a9ff-c600888bf1db tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 400 to user: Invalid key_name provided. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:49.452731 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-55cc6ab4-4e0d-4a62-a9ff-c600888bf1db tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.543499 May 28 04:53:49.455046 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2499/4879] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:53:47 2022] POST /compute/v2.1/servers => generated 70 bytes in 1546 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 04:53:49.460253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9f15e2a2-2315-42df-a30b-ddba022f18e3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:49.464814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9f15e2a2-2315-42df-a30b-ddba022f18e3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:49.497796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f15e2a2-2315-42df-a30b-ddba022f18e3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:49.501344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f15e2a2-2315-42df-a30b-ddba022f18e3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:49.503211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f15e2a2-2315-42df-a30b-ddba022f18e3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:49.517984 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f15e2a2-2315-42df-a30b-ddba022f18e3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:49.896315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7999cfe0-e506-4808-8aa1-81ef61146922 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:49.906205 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7999cfe0-e506-4808-8aa1-81ef61146922 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1505 microversion: 2.1 time: 0.561779 May 28 04:53:49.914031 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2381/4880] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:49 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1505 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:49.931491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-07f3fd27-2f98-4895-8b16-9db0d9c5950b tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] Calling method '.version_select at 0x7f77017f84c0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:49.985896 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-07f3fd27-2f98-4895-8b16-9db0d9c5950b tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] HTTP exception thrown: Volume tempest-invalid-1913849396 could not be found. May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-07f3fd27-2f98-4895-8b16-9db0d9c5950b tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] Request method failure captured: May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1913849396 HTTP/1.1 May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikarbxsjTzdRUzRGaCihppQGHb3reR1q1oz463UhmQPxXG5YmQFMUmXlArAxrjMWaqNWhsLQRqf6662zFB4rvZSZeOS8noYilwiFAhLMFzbJudD_qtt5pQIVzwWgphqNaM70ihE6qBeRBT5gdf5RmXf2xCmP3uVL8rCEF-_Qi7KE0shQ May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d7c51cac535f4ca8ac9a0539911f5b76 May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-VolumesNegativeTest-1995439743 May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-VolumesNegativeTest-1995439743 May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d7c51cac535f4ca8ac9a0539911f5b76 May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-VolumesNegativeTest-1995439743 May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-VolumesNegativeTest-1995439743-project May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: f33825384535457487cd387b6d0a0ec7 May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-VolumesNegativeTest-1995439743-project May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: exception: Volume tempest-invalid-1913849396 could not be found. May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'tempest-invalid-1913849396'} May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1913849396 could not be found. (HTTP 404) (Request-ID: req-a8d9d8bd-3144-4c9e-ad0d-c7524ea05590) May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 04:53:49.989508 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1913849396 could not be found. May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1913849396 could not be found. May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1913849396 could not be found. May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-07f3fd27-2f98-4895-8b16-9db0d9c5950b tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] Returning 404 to user: Volume tempest-invalid-1913849396 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-07f3fd27-2f98-4895-8b16-9db0d9c5950b tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1913849396" status: 404 len: 99 microversion: 2.1 time: 0.076550 May 28 04:53:50.001358 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2382/4881] 10.222.0.58 () {58 vars in 1217 bytes} [Sat May 28 04:53:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1913849396 => generated 99 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:53:50.012836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c2b7671e-4acd-4766-b33c-8186dbf77447 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:50.016383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c2b7671e-4acd-4766-b33c-8186dbf77447 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:50.034680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9f15e2a2-2315-42df-a30b-ddba022f18e3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:50.043277 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9f15e2a2-2315-42df-a30b-ddba022f18e3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1524 microversion: 2.1 time: 0.586921 May 28 04:53:50.061232 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2500/4882] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:49 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1524 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:50.061232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6147a1e5-f7d4-4b2d-b22b-6e328d3b223b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:50.061232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6147a1e5-f7d4-4b2d-b22b-6e328d3b223b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:50.067230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c2b7671e-4acd-4766-b33c-8186dbf77447 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:50.069973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c2b7671e-4acd-4766-b33c-8186dbf77447 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:50.077432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c2b7671e-4acd-4766-b33c-8186dbf77447 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:50.078080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c2b7671e-4acd-4766-b33c-8186dbf77447 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:50.101352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6147a1e5-f7d4-4b2d-b22b-6e328d3b223b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:50.112301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6147a1e5-f7d4-4b2d-b22b-6e328d3b223b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:50.119313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6147a1e5-f7d4-4b2d-b22b-6e328d3b223b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:50.120734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6147a1e5-f7d4-4b2d-b22b-6e328d3b223b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:50.251913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6147a1e5-f7d4-4b2d-b22b-6e328d3b223b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:50.262098 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6147a1e5-f7d4-4b2d-b22b-6e328d3b223b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1325 microversion: 2.1 time: 0.209211 May 28 04:53:50.268381 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2501/4883] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:50 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1325 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:50.289947 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-973b24c9-eea2-4844-b48f-5e0f1d2f66ee tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017866 May 28 04:53:50.295292 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2502/4884] 10.222.0.58 () {58 vars in 1139 bytes} [Sat May 28 04:53:50 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 28 04:53:50.304200 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-56542d47-a9c0-4219-8a0f-b33de7bbc73e tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007739 May 28 04:53:50.305709 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2503/4885] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:53:50 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 28 04:53:50.329809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-13dbf59e-71ca-4740-a359-54ea1ab9c4ec tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] Calling method '.version_select at 0x7f770075eca0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:50.408812 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-13dbf59e-71ca-4740-a359-54ea1ab9c4ec tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] HTTP exception thrown: Volume 3e9ca2ac-478d-4329-a561-fcdaf49c7116 could not be found. May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-13dbf59e-71ca-4740-a359-54ea1ab9c4ec tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] Request method failure captured: May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/os-volumes/3e9ca2ac-478d-4329-a561-fcdaf49c7116 HTTP/1.1 May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikarbxsjTzdRUzRGaCihppQGHb3reR1q1oz463UhmQPxXG5YmQFMUmXlArAxrjMWaqNWhsLQRqf6662zFB4rvZSZeOS8noYilwiFAhLMFzbJudD_qtt5pQIVzwWgphqNaM70ihE6qBeRBT5gdf5RmXf2xCmP3uVL8rCEF-_Qi7KE0shQ May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d7c51cac535f4ca8ac9a0539911f5b76 May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-VolumesNegativeTest-1995439743 May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-VolumesNegativeTest-1995439743 May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d7c51cac535f4ca8ac9a0539911f5b76 May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-VolumesNegativeTest-1995439743 May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-VolumesNegativeTest-1995439743-project May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: f33825384535457487cd387b6d0a0ec7 May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-VolumesNegativeTest-1995439743-project May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: exception: Volume 3e9ca2ac-478d-4329-a561-fcdaf49c7116 could not be found. May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '3e9ca2ac-478d-4329-a561-fcdaf49c7116'} May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3e9ca2ac-478d-4329-a561-fcdaf49c7116 could not be found. (HTTP 404) (Request-ID: req-7b425f22-8b59-4d27-b7b8-d33418e367bb) May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 04:53:50.415579 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3e9ca2ac-478d-4329-a561-fcdaf49c7116 could not be found. May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3e9ca2ac-478d-4329-a561-fcdaf49c7116 could not be found. May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3e9ca2ac-478d-4329-a561-fcdaf49c7116 could not be found. May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-13dbf59e-71ca-4740-a359-54ea1ab9c4ec tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] Returning 404 to user: Volume 3e9ca2ac-478d-4329-a561-fcdaf49c7116 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:50.420587 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-13dbf59e-71ca-4740-a359-54ea1ab9c4ec tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/3e9ca2ac-478d-4329-a561-fcdaf49c7116" status: 404 len: 109 microversion: 2.1 time: 0.101302 May 28 04:53:50.423802 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2504/4886] 10.222.0.58 () {58 vars in 1247 bytes} [Sat May 28 04:53:50 2022] DELETE /compute/v2.1/os-volumes/3e9ca2ac-478d-4329-a561-fcdaf49c7116 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:53:50.431773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-10a726b4-6dee-49f3-aeae-3cdc3d86f9fa tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:50.432961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-10a726b4-6dee-49f3-aeae-3cdc3d86f9fa tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:50.444733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c2b7671e-4acd-4766-b33c-8186dbf77447 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:50.454764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-10a726b4-6dee-49f3-aeae-3cdc3d86f9fa tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:50.457012 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c2b7671e-4acd-4766-b33c-8186dbf77447 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.458545 May 28 04:53:50.459305 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2383/4887] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:49 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:50.460208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-10a726b4-6dee-49f3-aeae-3cdc3d86f9fa tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:50.464067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-10a726b4-6dee-49f3-aeae-3cdc3d86f9fa tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:50.465662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fcc44178-0599-4b77-9990-ec162532d451 tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] Calling method '.version_select at 0x7f77017f8430>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:50.467124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-10a726b4-6dee-49f3-aeae-3cdc3d86f9fa tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:50.534428 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-fcc44178-0599-4b77-9990-ec162532d451 tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] HTTP exception thrown: Volume d557b65f-a2f9-48ec-9772-f0881495281a could not be found. May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fcc44178-0599-4b77-9990-ec162532d451 tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] Request method failure captured: May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/os-volumes/d557b65f-a2f9-48ec-9772-f0881495281a HTTP/1.1 May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikarbxsjTzdRUzRGaCihppQGHb3reR1q1oz463UhmQPxXG5YmQFMUmXlArAxrjMWaqNWhsLQRqf6662zFB4rvZSZeOS8noYilwiFAhLMFzbJudD_qtt5pQIVzwWgphqNaM70ihE6qBeRBT5gdf5RmXf2xCmP3uVL8rCEF-_Qi7KE0shQ May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d7c51cac535f4ca8ac9a0539911f5b76 May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-VolumesNegativeTest-1995439743 May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7c51cac535f4ca8ac9a0539911f5b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-VolumesNegativeTest-1995439743 May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d7c51cac535f4ca8ac9a0539911f5b76 May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-VolumesNegativeTest-1995439743 May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-VolumesNegativeTest-1995439743-project May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: f33825384535457487cd387b6d0a0ec7 May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-VolumesNegativeTest-1995439743-project May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: method: May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: exception: Volume d557b65f-a2f9-48ec-9772-f0881495281a could not be found. May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'd557b65f-a2f9-48ec-9772-f0881495281a'} May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d557b65f-a2f9-48ec-9772-f0881495281a could not be found. (HTTP 404) (Request-ID: req-ce93cf4d-c744-4b4f-9038-b8eaf192a0cf) May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 04:53:50.538318 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d557b65f-a2f9-48ec-9772-f0881495281a could not be found. May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d557b65f-a2f9-48ec-9772-f0881495281a could not be found. May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d557b65f-a2f9-48ec-9772-f0881495281a could not be found. May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fcc44178-0599-4b77-9990-ec162532d451 tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] Returning 404 to user: Volume d557b65f-a2f9-48ec-9772-f0881495281a could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fcc44178-0599-4b77-9990-ec162532d451 tempest-VolumesNegativeTest-1995439743 tempest-VolumesNegativeTest-1995439743-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/d557b65f-a2f9-48ec-9772-f0881495281a" status: 404 len: 109 microversion: 2.1 time: 0.078989 May 28 04:53:50.544041 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2384/4888] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 04:53:50 2022] GET /compute/v2.1/os-volumes/d557b65f-a2f9-48ec-9772-f0881495281a => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:53:50.551264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7f927da8-968a-442c-999b-a88e46b437b4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:50.553090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7f927da8-968a-442c-999b-a88e46b437b4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:50.572390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f927da8-968a-442c-999b-a88e46b437b4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:50.572965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f927da8-968a-442c-999b-a88e46b437b4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:50.577082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f927da8-968a-442c-999b-a88e46b437b4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:50.577651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f927da8-968a-442c-999b-a88e46b437b4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:50.893530 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-10a726b4-6dee-49f3-aeae-3cdc3d86f9fa tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:50.909113 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-10a726b4-6dee-49f3-aeae-3cdc3d86f9fa tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1524 microversion: 2.1 time: 0.484434 May 28 04:53:50.912496 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2505/4889] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:50 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1524 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:50.935750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2252750c-8ebc-4036-bd9d-645bfbebe550 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:50.939854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2252750c-8ebc-4036-bd9d-645bfbebe550 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:50.964410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2252750c-8ebc-4036-bd9d-645bfbebe550 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:50.970250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2252750c-8ebc-4036-bd9d-645bfbebe550 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:50.993792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2252750c-8ebc-4036-bd9d-645bfbebe550 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:50.995528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2252750c-8ebc-4036-bd9d-645bfbebe550 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:51.061651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7f927da8-968a-442c-999b-a88e46b437b4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:51.071552 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7f927da8-968a-442c-999b-a88e46b437b4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.530252 May 28 04:53:51.072999 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2385/4890] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:50 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:51.078766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-49e8fd2e-ac19-4dab-9079-b12e8a7e4e35 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:51.079755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-49e8fd2e-ac19-4dab-9079-b12e8a7e4e35 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:51.087586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49e8fd2e-ac19-4dab-9079-b12e8a7e4e35 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:51.088717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49e8fd2e-ac19-4dab-9079-b12e8a7e4e35 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:51.089921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49e8fd2e-ac19-4dab-9079-b12e8a7e4e35 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:51.090598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49e8fd2e-ac19-4dab-9079-b12e8a7e4e35 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:51.316355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2252750c-8ebc-4036-bd9d-645bfbebe550 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:51.334476 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2252750c-8ebc-4036-bd9d-645bfbebe550 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1505 microversion: 2.1 time: 0.406809 May 28 04:53:51.350628 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2506/4891] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:50 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1505 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:51.362569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7ec000b3-3f5b-4f39-b2b6-add1ae4857f3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:51.364738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7ec000b3-3f5b-4f39-b2b6-add1ae4857f3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:51.384099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ec000b3-3f5b-4f39-b2b6-add1ae4857f3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:51.387603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ec000b3-3f5b-4f39-b2b6-add1ae4857f3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:51.387603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ec000b3-3f5b-4f39-b2b6-add1ae4857f3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:51.390402 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ec000b3-3f5b-4f39-b2b6-add1ae4857f3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:51.426582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-49e8fd2e-ac19-4dab-9079-b12e8a7e4e35 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:51.430874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:51.440099 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-49e8fd2e-ac19-4dab-9079-b12e8a7e4e35 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1524 microversion: 2.1 time: 0.365295 May 28 04:53:51.441197 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2386/4892] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:51 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1524 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:51.451260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9b146b9b-9aec-4e90-9b9b-f8462326f5de tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1900591096", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:51.508559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7ec000b3-3f5b-4f39-b2b6-add1ae4857f3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:51.517407 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7ec000b3-3f5b-4f39-b2b6-add1ae4857f3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1325 microversion: 2.1 time: 0.165136 May 28 04:53:51.519887 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2507/4893] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:51 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1325 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:51.580754 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.security_group_api [None req-9b146b9b-9aec-4e90-9b9b-f8462326f5de tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Neutron security group does_not_exist not found {{(pid=126043) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} May 28 04:53:51.581269 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-9b146b9b-9aec-4e90-9b9b-f8462326f5de tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9b146b9b-9aec-4e90-9b9b-f8462326f5de tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 258 May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1900591096", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: exception: Unable to find security_group with name or id 'does_not_exist' May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1900591096', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'd8b90133-44e4-4677-ae8d-d676a447193b'}]}}} May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name May 28 04:53:51.589954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._create_instance( May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:51.596193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9b146b9b-9aec-4e90-9b9b-f8462326f5de tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:51.601465 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9b146b9b-9aec-4e90-9b9b-f8462326f5de tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.149840 May 28 04:53:51.601465 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2387/4894] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:53:51 2022] POST /compute/v2.1/servers => generated 106 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:53:51.607739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f5c3136a-c0bc-437b-bfc0-9b34d24b0f25 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:51.608628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f5c3136a-c0bc-437b-bfc0-9b34d24b0f25 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:51.614511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:51.616343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5c3136a-c0bc-437b-bfc0-9b34d24b0f25 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:51.616987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5c3136a-c0bc-437b-bfc0-9b34d24b0f25 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:51.617957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5c3136a-c0bc-437b-bfc0-9b34d24b0f25 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:51.618568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5c3136a-c0bc-437b-bfc0-9b34d24b0f25 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:51.773149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f5c3136a-c0bc-437b-bfc0-9b34d24b0f25 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:51.784520 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f5c3136a-c0bc-437b-bfc0-9b34d24b0f25 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.180485 May 28 04:53:51.785687 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2508/4895] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:51 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:51.815279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0aed50e7-9295-4e1f-8ea1-e5b76aec0e7d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:51.815279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0aed50e7-9295-4e1f-8ea1-e5b76aec0e7d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:51.824299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0aed50e7-9295-4e1f-8ea1-e5b76aec0e7d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:51.824769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0aed50e7-9295-4e1f-8ea1-e5b76aec0e7d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:51.826124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0aed50e7-9295-4e1f-8ea1-e5b76aec0e7d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:51.826976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0aed50e7-9295-4e1f-8ea1-e5b76aec0e7d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:51.930217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-08acf903-3c05-4731-a137-2860770a576a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:51.931140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-08acf903-3c05-4731-a137-2860770a576a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:51.945809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08acf903-3c05-4731-a137-2860770a576a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:51.946369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08acf903-3c05-4731-a137-2860770a576a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:51.949011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08acf903-3c05-4731-a137-2860770a576a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:51.951154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08acf903-3c05-4731-a137-2860770a576a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:52.234145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0aed50e7-9295-4e1f-8ea1-e5b76aec0e7d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:52.246581 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0aed50e7-9295-4e1f-8ea1-e5b76aec0e7d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.448679 May 28 04:53:52.251377 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2388/4896] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:51 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:52.267991 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d3f27bba-d556-4810-a375-ab2b9a60ccc0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:52.270582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d3f27bba-d556-4810-a375-ab2b9a60ccc0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 02e73b9a-090f-47a1-b14e-e78c2f497b24] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:52.303137 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-d3f27bba-d556-4810-a375-ab2b9a60ccc0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance 02e73b9a-090f-47a1-b14e-e78c2f497b24 could not be found. May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d3f27bba-d556-4810-a375-ab2b9a60ccc0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/02e73b9a-090f-47a1-b14e-e78c2f497b24 HTTP/1.1 May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 02e73b9a-090f-47a1-b14e-e78c2f497b24 could not be found. May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '02e73b9a-090f-47a1-b14e-e78c2f497b24'} May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02e73b9a-090f-47a1-b14e-e78c2f497b24 could not be found. May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02e73b9a-090f-47a1-b14e-e78c2f497b24 could not be found. May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:52.308021 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:52.313599 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:52.313599 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:52.313599 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:52.313599 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:52.313599 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:52.313599 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02e73b9a-090f-47a1-b14e-e78c2f497b24 could not be found. May 28 04:53:52.313599 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:52.318337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d3f27bba-d556-4810-a375-ab2b9a60ccc0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance 02e73b9a-090f-47a1-b14e-e78c2f497b24 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:52.319768 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d3f27bba-d556-4810-a375-ab2b9a60ccc0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "DELETE /compute/v2.1/servers/02e73b9a-090f-47a1-b14e-e78c2f497b24" status: 404 len: 111 microversion: 2.1 time: 0.058842 May 28 04:53:52.327420 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2389/4897] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:53:52 2022] DELETE /compute/v2.1/servers/02e73b9a-090f-47a1-b14e-e78c2f497b24 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:53:52.335163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2b966b90-72e5-4641-8e0a-b009a46a44ae tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:52.346373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-08acf903-3c05-4731-a137-2860770a576a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:52.346922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2b966b90-72e5-4641-8e0a-b009a46a44ae tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:52.375690 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-08acf903-3c05-4731-a137-2860770a576a tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1524 microversion: 2.1 time: 0.439856 May 28 04:53:52.375690 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2509/4898] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:51 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1524 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:52.376001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b966b90-72e5-4641-8e0a-b009a46a44ae tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:52.376001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b966b90-72e5-4641-8e0a-b009a46a44ae tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:52.376001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b966b90-72e5-4641-8e0a-b009a46a44ae tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:52.376001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b966b90-72e5-4641-8e0a-b009a46a44ae tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:52.383491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ca93b5f8-603f-43bc-a910-52b4f692fedc tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:52.384793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ca93b5f8-603f-43bc-a910-52b4f692fedc tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:52.407400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca93b5f8-603f-43bc-a910-52b4f692fedc tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:52.407400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca93b5f8-603f-43bc-a910-52b4f692fedc tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:52.407400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca93b5f8-603f-43bc-a910-52b4f692fedc tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:52.414020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca93b5f8-603f-43bc-a910-52b4f692fedc tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:52.817182 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ca93b5f8-603f-43bc-a910-52b4f692fedc tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:52.827057 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ca93b5f8-603f-43bc-a910-52b4f692fedc tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1505 microversion: 2.1 time: 0.461398 May 28 04:53:52.831428 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2510/4899] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:52 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1505 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:52.852384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5c88ec63-7ede-4488-867b-cfc16f08f0eb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:52.857596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5c88ec63-7ede-4488-867b-cfc16f08f0eb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:52.876367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2b966b90-72e5-4641-8e0a-b009a46a44ae tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:52.879667 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2b966b90-72e5-4641-8e0a-b009a46a44ae tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.548548 May 28 04:53:52.885316 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2390/4900] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:52 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:52.887315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c88ec63-7ede-4488-867b-cfc16f08f0eb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:52.888154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c88ec63-7ede-4488-867b-cfc16f08f0eb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:52.892070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c88ec63-7ede-4488-867b-cfc16f08f0eb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:52.892760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c88ec63-7ede-4488-867b-cfc16f08f0eb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:52.909065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5c4bd5cd-3017-4523-ba37-b1c4a08dff32 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:52.909065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5c4bd5cd-3017-4523-ba37-b1c4a08dff32 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:52.928348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c4bd5cd-3017-4523-ba37-b1c4a08dff32 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:52.932456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c4bd5cd-3017-4523-ba37-b1c4a08dff32 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:52.937448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c4bd5cd-3017-4523-ba37-b1c4a08dff32 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:52.937448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c4bd5cd-3017-4523-ba37-b1c4a08dff32 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:53.275790 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5c88ec63-7ede-4488-867b-cfc16f08f0eb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:53.286090 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5c88ec63-7ede-4488-867b-cfc16f08f0eb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1524 microversion: 2.1 time: 0.452478 May 28 04:53:53.287225 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2511/4901] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:52 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1524 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:53.292150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5c4bd5cd-3017-4523-ba37-b1c4a08dff32 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:53.302913 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5c4bd5cd-3017-4523-ba37-b1c4a08dff32 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1392 microversion: 2.1 time: 0.416023 May 28 04:53:53.304493 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2391/4902] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:52 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1392 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:53.309858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b51750e4-d288-483c-a979-488340a52f00 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:53.311067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b51750e4-d288-483c-a979-488340a52f00 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:53.333362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b51750e4-d288-483c-a979-488340a52f00 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:53.334320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b51750e4-d288-483c-a979-488340a52f00 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:53.335700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b51750e4-d288-483c-a979-488340a52f00 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:53.336810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b51750e4-d288-483c-a979-488340a52f00 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:53.390269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cc4f7599-5dcd-48e7-a733-976317b44c84 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:53.391411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cc4f7599-5dcd-48e7-a733-976317b44c84 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:53.412205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc4f7599-5dcd-48e7-a733-976317b44c84 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:53.412205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc4f7599-5dcd-48e7-a733-976317b44c84 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:53.412205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc4f7599-5dcd-48e7-a733-976317b44c84 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:53.412205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc4f7599-5dcd-48e7-a733-976317b44c84 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:53.683070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b51750e4-d288-483c-a979-488340a52f00 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:53.699280 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b51750e4-d288-483c-a979-488340a52f00 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.410532 May 28 04:53:53.713941 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2512/4903] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:53 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:53.728622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1ec92353-9ac7-4294-b08e-611ab049a4e3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:53.729123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1ec92353-9ac7-4294-b08e-611ab049a4e3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Failed to fetch instance by id 9223372036854775808 {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2926}} May 28 04:53:53.729653 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-1ec92353-9ac7-4294-b08e-611ab049a4e3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1ec92353-9ac7-4294-b08e-611ab049a4e3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 9223372036854775808 could not be found. May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '9223372036854775808'} May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:53.739056 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:53.754857 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:53.754857 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:53.754857 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:53.754857 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. May 28 04:53:53.754857 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:53.754857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1ec92353-9ac7-4294-b08e-611ab049a4e3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:53.754857 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1ec92353-9ac7-4294-b08e-611ab049a4e3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.030497 May 28 04:53:53.754857 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2513/4904] 10.222.0.58 () {58 vars in 1187 bytes} [Sat May 28 04:53:53 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:53:53.763365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-53a5b497-9e04-4ee3-a507-9225a1044005 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:53.763995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-53a5b497-9e04-4ee3-a507-9225a1044005 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:53.783956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53a5b497-9e04-4ee3-a507-9225a1044005 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:53.783956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53a5b497-9e04-4ee3-a507-9225a1044005 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:53.783956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53a5b497-9e04-4ee3-a507-9225a1044005 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:53.789317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53a5b497-9e04-4ee3-a507-9225a1044005 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:53.845410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cc4f7599-5dcd-48e7-a733-976317b44c84 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:53.857432 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cc4f7599-5dcd-48e7-a733-976317b44c84 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1524 microversion: 2.1 time: 0.477606 May 28 04:53:53.865807 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2392/4905] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:53 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1524 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:53.879546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a78cb40a-540e-4d9e-b73d-a1d3487577d1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:53.881046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a78cb40a-540e-4d9e-b73d-a1d3487577d1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:53.898028 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a78cb40a-540e-4d9e-b73d-a1d3487577d1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:53.899756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a78cb40a-540e-4d9e-b73d-a1d3487577d1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:53.900735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a78cb40a-540e-4d9e-b73d-a1d3487577d1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:53.912820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a78cb40a-540e-4d9e-b73d-a1d3487577d1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:54.399023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-53a5b497-9e04-4ee3-a507-9225a1044005 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:54.399023 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-53a5b497-9e04-4ee3-a507-9225a1044005 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.545410 May 28 04:53:54.399023 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2514/4906] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:53 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:54.402037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a78cb40a-540e-4d9e-b73d-a1d3487577d1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:54.402170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-74d435e4-441e-482a-80c2-f5eb35394c1a req-e39a44dd-601b-42df-9096-fec5cd35a690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "260294eb-db79-4280-a534-928afd9312d0", "tag": "3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:54.402289 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a78cb40a-540e-4d9e-b73d-a1d3487577d1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1505 microversion: 2.1 time: 0.444723 May 28 04:53:54.402289 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2393/4907] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:53 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:54.402489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-74d435e4-441e-482a-80c2-f5eb35394c1a req-e39a44dd-601b-42df-9096-fec5cd35a690 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:54.402489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-74d435e4-441e-482a-80c2-f5eb35394c1a req-e39a44dd-601b-42df-9096-fec5cd35a690 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:54.402704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7e023acf-4c73-4c95-b34e-a5bc6cacc978 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:54.402704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7e023acf-4c73-4c95-b34e-a5bc6cacc978 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:54.402888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:54.403021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e023acf-4c73-4c95-b34e-a5bc6cacc978 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:54.403021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e023acf-4c73-4c95-b34e-a5bc6cacc978 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:54.403021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e023acf-4c73-4c95-b34e-a5bc6cacc978 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:54.403021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e023acf-4c73-4c95-b34e-a5bc6cacc978 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:54.403399 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-74d435e4-441e-482a-80c2-f5eb35394c1a req-e39a44dd-601b-42df-9096-fec5cd35a690 service nova] Creating event network-changed:3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0 for instance 260294eb-db79-4280-a534-928afd9312d0 on n-h2-843700-1 May 28 04:53:54.403399 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-74d435e4-441e-482a-80c2-f5eb35394c1a req-e39a44dd-601b-42df-9096-fec5cd35a690 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033986 May 28 04:53:54.403399 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2515/4908] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:53:54.403399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3931bf52-4195-4fea-a837-d89d4ac32c5e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:54.403399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3931bf52-4195-4fea-a837-d89d4ac32c5e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:54.403399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3931bf52-4195-4fea-a837-d89d4ac32c5e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:54.403399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3931bf52-4195-4fea-a837-d89d4ac32c5e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:54.403399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3931bf52-4195-4fea-a837-d89d4ac32c5e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:54.403399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3931bf52-4195-4fea-a837-d89d4ac32c5e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:54.626510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3931bf52-4195-4fea-a837-d89d4ac32c5e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:54.632179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7e023acf-4c73-4c95-b34e-a5bc6cacc978 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:54.637048 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3931bf52-4195-4fea-a837-d89d4ac32c5e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1392 microversion: 2.1 time: 0.299079 May 28 04:53:54.638457 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2516/4909] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:54 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1392 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:54.647193 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7e023acf-4c73-4c95-b34e-a5bc6cacc978 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1524 microversion: 2.1 time: 0.327660 May 28 04:53:54.647193 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2394/4910] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:54 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1524 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:54.657081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0f7590d5-3a4c-4b4c-9615-bdf4c2329fce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:54.657711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0f7590d5-3a4c-4b4c-9615-bdf4c2329fce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:54.665639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f7590d5-3a4c-4b4c-9615-bdf4c2329fce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:54.666098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f7590d5-3a4c-4b4c-9615-bdf4c2329fce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:54.666894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f7590d5-3a4c-4b4c-9615-bdf4c2329fce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:54.667479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f7590d5-3a4c-4b4c-9615-bdf4c2329fce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:54.872884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0f7590d5-3a4c-4b4c-9615-bdf4c2329fce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:54.881501 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0f7590d5-3a4c-4b4c-9615-bdf4c2329fce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.228796 May 28 04:53:54.882170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a408edbb-b937-497d-90ba-6e52838d9477 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:54.882170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a408edbb-b937-497d-90ba-6e52838d9477 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:54.890646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a408edbb-b937-497d-90ba-6e52838d9477 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:54.891404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a408edbb-b937-497d-90ba-6e52838d9477 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:54.892369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a408edbb-b937-497d-90ba-6e52838d9477 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:54.894598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a408edbb-b937-497d-90ba-6e52838d9477 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:54.910701 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2395/4911] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:54 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:54.915635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-11fda01d-18b9-45a8-a424-2ee2a244eaba tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:54.916204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-11fda01d-18b9-45a8-a424-2ee2a244eaba tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Failed to fetch instance by id -1 {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2926}} May 28 04:53:54.916727 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-11fda01d-18b9-45a8-a424-2ee2a244eaba tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance -1 could not be found. May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-11fda01d-18b9-45a8-a424-2ee2a244eaba tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance -1 could not be found. May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '-1'} May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:54.918296 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:54.928120 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:54.928120 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:54.928120 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. May 28 04:53:54.928120 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:54.928120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-11fda01d-18b9-45a8-a424-2ee2a244eaba tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance -1 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:54.928120 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-11fda01d-18b9-45a8-a424-2ee2a244eaba tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.009388 May 28 04:53:54.928120 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2396/4912] 10.222.0.58 () {58 vars in 1136 bytes} [Sat May 28 04:53:54 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 04:53:54.932342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-51121d71-5860-4888-8fad-ac3ffe8b661f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:54.933318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-51121d71-5860-4888-8fad-ac3ffe8b661f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:54.942757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-51121d71-5860-4888-8fad-ac3ffe8b661f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:54.944142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-51121d71-5860-4888-8fad-ac3ffe8b661f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:54.945692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-51121d71-5860-4888-8fad-ac3ffe8b661f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:54.946143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-51121d71-5860-4888-8fad-ac3ffe8b661f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:55.215368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-51121d71-5860-4888-8fad-ac3ffe8b661f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:55.229831 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-51121d71-5860-4888-8fad-ac3ffe8b661f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.297319 May 28 04:53:55.243340 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2397/4913] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:54 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:55.249171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5301d5e5-e8a6-49ce-b699-2af6b736363f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:55.258427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5301d5e5-e8a6-49ce-b699-2af6b736363f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:55.274627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a408edbb-b937-497d-90ba-6e52838d9477 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:55.285857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5301d5e5-e8a6-49ce-b699-2af6b736363f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:55.287200 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a408edbb-b937-497d-90ba-6e52838d9477 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1524 microversion: 2.1 time: 0.406682 May 28 04:53:55.288936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5301d5e5-e8a6-49ce-b699-2af6b736363f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:55.289744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5301d5e5-e8a6-49ce-b699-2af6b736363f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:55.290152 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2517/4914] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:54 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1524 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:55.290796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5301d5e5-e8a6-49ce-b699-2af6b736363f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:55.418721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cd0e66f4-2eda-4acc-bf34-98a55f9127cb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:55.419365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cd0e66f4-2eda-4acc-bf34-98a55f9127cb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:55.437297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cd0e66f4-2eda-4acc-bf34-98a55f9127cb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:55.437766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cd0e66f4-2eda-4acc-bf34-98a55f9127cb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:55.440380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cd0e66f4-2eda-4acc-bf34-98a55f9127cb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:55.442709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cd0e66f4-2eda-4acc-bf34-98a55f9127cb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:55.502927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5301d5e5-e8a6-49ce-b699-2af6b736363f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:55.515382 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5301d5e5-e8a6-49ce-b699-2af6b736363f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.270522 May 28 04:53:55.520682 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2398/4915] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:55 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:55.538785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2e1b7f8c-050f-430c-a6f9-5466eff3d9ab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:55.540108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2e1b7f8c-050f-430c-a6f9-5466eff3d9ab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 2edc28f3-d3f5-427a-9c28-e43bb4048f72] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:55.548968 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-2e1b7f8c-050f-430c-a6f9-5466eff3d9ab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance 2edc28f3-d3f5-427a-9c28-e43bb4048f72 could not be found. May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2e1b7f8c-050f-430c-a6f9-5466eff3d9ab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/2edc28f3-d3f5-427a-9c28-e43bb4048f72/action HTTP/1.1 May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 19 May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: {"forceDelete": {}} May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 2edc28f3-d3f5-427a-9c28-e43bb4048f72 could not be found. May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '2edc28f3-d3f5-427a-9c28-e43bb4048f72', 'body': {'forceDelete': {}}} May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2edc28f3-d3f5-427a-9c28-e43bb4048f72 could not be found. May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2edc28f3-d3f5-427a-9c28-e43bb4048f72 could not be found. May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:55.560369 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:55.570834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:55.570834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:55.570834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2edc28f3-d3f5-427a-9c28-e43bb4048f72 could not be found. May 28 04:53:55.570834 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:53:55.570834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2e1b7f8c-050f-430c-a6f9-5466eff3d9ab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance 2edc28f3-d3f5-427a-9c28-e43bb4048f72 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:55.570834 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2e1b7f8c-050f-430c-a6f9-5466eff3d9ab tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/2edc28f3-d3f5-427a-9c28-e43bb4048f72/action" status: 404 len: 111 microversion: 2.1 time: 0.028122 May 28 04:53:55.570834 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2399/4916] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:53:55 2022] POST /compute/v2.1/servers/2edc28f3-d3f5-427a-9c28-e43bb4048f72/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:53:55.573743 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a5b092d9-38b3-427b-b916-cf44284bb438 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:55.580425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a5b092d9-38b3-427b-b916-cf44284bb438 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:55.594377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5b092d9-38b3-427b-b916-cf44284bb438 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:55.596728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5b092d9-38b3-427b-b916-cf44284bb438 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:55.597824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5b092d9-38b3-427b-b916-cf44284bb438 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:55.600264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5b092d9-38b3-427b-b916-cf44284bb438 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:55.810417 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cd0e66f4-2eda-4acc-bf34-98a55f9127cb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:55.824281 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cd0e66f4-2eda-4acc-bf34-98a55f9127cb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1505 microversion: 2.1 time: 0.409573 May 28 04:53:55.825631 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2518/4917] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:55 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1505 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:55.831447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3785fe0f-01fb-46ea-a38f-c94006f6eed1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:55.832403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3785fe0f-01fb-46ea-a38f-c94006f6eed1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:55.844562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3785fe0f-01fb-46ea-a38f-c94006f6eed1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:55.845439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3785fe0f-01fb-46ea-a38f-c94006f6eed1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:55.846567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3785fe0f-01fb-46ea-a38f-c94006f6eed1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:55.847338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3785fe0f-01fb-46ea-a38f-c94006f6eed1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:55.883664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a5b092d9-38b3-427b-b916-cf44284bb438 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:55.905372 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a5b092d9-38b3-427b-b916-cf44284bb438 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.336073 May 28 04:53:55.911722 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2400/4918] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:55 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:55.927131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cd1d107d-c69d-4165-928e-9bd062806fe3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:55.933275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cd1d107d-c69d-4165-928e-9bd062806fe3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:55.946254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd1d107d-c69d-4165-928e-9bd062806fe3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:55.951703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd1d107d-c69d-4165-928e-9bd062806fe3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:55.953015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd1d107d-c69d-4165-928e-9bd062806fe3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:55.953690 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd1d107d-c69d-4165-928e-9bd062806fe3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:56.172221 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:56.261595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3785fe0f-01fb-46ea-a38f-c94006f6eed1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:56.277931 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3785fe0f-01fb-46ea-a38f-c94006f6eed1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1392 microversion: 2.1 time: 0.450794 May 28 04:53:56.278584 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2519/4919] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:55 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1392 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:56.296249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-14326725-1921-4687-bfb2-cbf3e2f85299 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:56.299914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-14326725-1921-4687-bfb2-cbf3e2f85299 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:56.327484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14326725-1921-4687-bfb2-cbf3e2f85299 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:56.332130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14326725-1921-4687-bfb2-cbf3e2f85299 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:56.333492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14326725-1921-4687-bfb2-cbf3e2f85299 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:56.334163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14326725-1921-4687-bfb2-cbf3e2f85299 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:56.339861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cd1d107d-c69d-4165-928e-9bd062806fe3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:56.358723 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cd1d107d-c69d-4165-928e-9bd062806fe3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1524 microversion: 2.1 time: 0.445219 May 28 04:53:56.359478 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2401/4920] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:55 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1524 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:56.368694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1016e8cb-eb5d-43e0-baa7-81c86a21e7f1 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:56.369688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1016e8cb-eb5d-43e0-baa7-81c86a21e7f1 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:56.394078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1016e8cb-eb5d-43e0-baa7-81c86a21e7f1 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:56.394719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1016e8cb-eb5d-43e0-baa7-81c86a21e7f1 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:56.395789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1016e8cb-eb5d-43e0-baa7-81c86a21e7f1 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:56.396801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1016e8cb-eb5d-43e0-baa7-81c86a21e7f1 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:56.764876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-14326725-1921-4687-bfb2-cbf3e2f85299 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:56.785284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1016e8cb-eb5d-43e0-baa7-81c86a21e7f1 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:56.785671 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-14326725-1921-4687-bfb2-cbf3e2f85299 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.503297 May 28 04:53:56.788055 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2520/4921] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:56 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:56.792483 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1016e8cb-eb5d-43e0-baa7-81c86a21e7f1 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1524 microversion: 2.1 time: 0.431711 May 28 04:53:56.793111 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2402/4922] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:56 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1524 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:56.811166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4b80ad19-5d2d-473a-8464-ca3d8f9e6095 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:56.812583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4b80ad19-5d2d-473a-8464-ca3d8f9e6095 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: da6d5f0d-86c3-4515-b8c3-5a6708e71e2e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:56.818982 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-4b80ad19-5d2d-473a-8464-ca3d8f9e6095 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance da6d5f0d-86c3-4515-b8c3-5a6708e71e2e could not be found. May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4b80ad19-5d2d-473a-8464-ca3d8f9e6095 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/da6d5f0d-86c3-4515-b8c3-5a6708e71e2e/action HTTP/1.1 May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 39 May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: {"os-getConsoleOutput": {"length": 10}} May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance da6d5f0d-86c3-4515-b8c3-5a6708e71e2e could not be found. May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'da6d5f0d-86c3-4515-b8c3-5a6708e71e2e', 'body': {'os-getConsoleOutput': {'length': 10}}} May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da6d5f0d-86c3-4515-b8c3-5a6708e71e2e could not be found. May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da6d5f0d-86c3-4515-b8c3-5a6708e71e2e could not be found. May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:56.824934 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:56.837864 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:56.837864 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:56.837864 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:56.837864 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:56.837864 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da6d5f0d-86c3-4515-b8c3-5a6708e71e2e could not be found. May 28 04:53:56.837864 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:56.837864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4b80ad19-5d2d-473a-8464-ca3d8f9e6095 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance da6d5f0d-86c3-4515-b8c3-5a6708e71e2e could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:56.837864 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4b80ad19-5d2d-473a-8464-ca3d8f9e6095 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/da6d5f0d-86c3-4515-b8c3-5a6708e71e2e/action" status: 404 len: 111 microversion: 2.1 time: 0.020411 May 28 04:53:56.837864 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2521/4923] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:53:56 2022] POST /compute/v2.1/servers/da6d5f0d-86c3-4515-b8c3-5a6708e71e2e/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:53:56.840653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-595c3e19-faf1-4b25-b8a0-5dd5e54e347c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:56.841998 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-595c3e19-faf1-4b25-b8a0-5dd5e54e347c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:56.852077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7dec511c-146d-48bb-817d-7a68f630d1bb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:56.854935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-595c3e19-faf1-4b25-b8a0-5dd5e54e347c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:56.855943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-595c3e19-faf1-4b25-b8a0-5dd5e54e347c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:56.857144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-595c3e19-faf1-4b25-b8a0-5dd5e54e347c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:56.857601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-595c3e19-faf1-4b25-b8a0-5dd5e54e347c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:56.860846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7dec511c-146d-48bb-817d-7a68f630d1bb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:56.871235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7dec511c-146d-48bb-817d-7a68f630d1bb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:56.879769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7dec511c-146d-48bb-817d-7a68f630d1bb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:56.880856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7dec511c-146d-48bb-817d-7a68f630d1bb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:56.882589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7dec511c-146d-48bb-817d-7a68f630d1bb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:57.146618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-595c3e19-faf1-4b25-b8a0-5dd5e54e347c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:57.161288 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-595c3e19-faf1-4b25-b8a0-5dd5e54e347c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.327266 May 28 04:53:57.162140 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2403/4924] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:56 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:57.172597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7dec511c-146d-48bb-817d-7a68f630d1bb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:57.180651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c4c3b182-73da-43b2-a1ac-4d11a852bff7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:57.181508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c4c3b182-73da-43b2-a1ac-4d11a852bff7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:57.192362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c4c3b182-73da-43b2-a1ac-4d11a852bff7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:57.192853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c4c3b182-73da-43b2-a1ac-4d11a852bff7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:57.193505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c4c3b182-73da-43b2-a1ac-4d11a852bff7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:57.193956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c4c3b182-73da-43b2-a1ac-4d11a852bff7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:57.197043 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7dec511c-146d-48bb-817d-7a68f630d1bb tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1505 microversion: 2.1 time: 0.348794 May 28 04:53:57.197647 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2522/4925] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:56 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:57.295619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-74ed9ce0-0a82-4e5d-b1e3-f12538708b1b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:57.296489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-74ed9ce0-0a82-4e5d-b1e3-f12538708b1b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:57.305425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74ed9ce0-0a82-4e5d-b1e3-f12538708b1b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:57.306122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74ed9ce0-0a82-4e5d-b1e3-f12538708b1b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:57.313413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74ed9ce0-0a82-4e5d-b1e3-f12538708b1b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:57.314247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74ed9ce0-0a82-4e5d-b1e3-f12538708b1b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:57.391170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c4c3b182-73da-43b2-a1ac-4d11a852bff7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:57.409412 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c4c3b182-73da-43b2-a1ac-4d11a852bff7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.229521 May 28 04:53:57.409412 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2404/4926] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:57 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:57.410731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=8 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:57.417898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b5cc93ad-5d66-4324-a972-c14d50997ba9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:57.418647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b5cc93ad-5d66-4324-a972-c14d50997ba9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:57.430335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b5cc93ad-5d66-4324-a972-c14d50997ba9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:57.432091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b5cc93ad-5d66-4324-a972-c14d50997ba9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:57.433757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b5cc93ad-5d66-4324-a972-c14d50997ba9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:57.435198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b5cc93ad-5d66-4324-a972-c14d50997ba9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:57.612883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-74ed9ce0-0a82-4e5d-b1e3-f12538708b1b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:57.629940 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-74ed9ce0-0a82-4e5d-b1e3-f12538708b1b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1392 microversion: 2.1 time: 0.338012 May 28 04:53:57.631177 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2523/4927] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:57 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1392 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:57.641436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2ba963d6-4d19-4e0d-9f85-5ba9d3cc6b72 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:57.645000 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2ba963d6-4d19-4e0d-9f85-5ba9d3cc6b72 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: a58a458c-5a05-4117-898e-293507f7e964] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:57.652764 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-2ba963d6-4d19-4e0d-9f85-5ba9d3cc6b72 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance a58a458c-5a05-4117-898e-293507f7e964 could not be found. May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2ba963d6-4d19-4e0d-9f85-5ba9d3cc6b72 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/a58a458c-5a05-4117-898e-293507f7e964 HTTP/1.1 May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance a58a458c-5a05-4117-898e-293507f7e964 could not be found. May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'a58a458c-5a05-4117-898e-293507f7e964'} May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a58a458c-5a05-4117-898e-293507f7e964 could not be found. May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a58a458c-5a05-4117-898e-293507f7e964 could not be found. May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:57.655497 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:57.660329 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:57.660329 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:53:57.660329 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:53:57.660329 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a58a458c-5a05-4117-898e-293507f7e964 could not be found. May 28 04:53:57.660329 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:57.664524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2ba963d6-4d19-4e0d-9f85-5ba9d3cc6b72 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance a58a458c-5a05-4117-898e-293507f7e964 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:57.665900 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2ba963d6-4d19-4e0d-9f85-5ba9d3cc6b72 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/a58a458c-5a05-4117-898e-293507f7e964" status: 404 len: 111 microversion: 2.1 time: 0.032006 May 28 04:53:57.667031 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2524/4928] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:57 2022] GET /compute/v2.1/servers/a58a458c-5a05-4117-898e-293507f7e964 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:53:57.676549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5f18b7d8-2a6c-43e8-ac1c-adbf7715631d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:57.677466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5f18b7d8-2a6c-43e8-ac1c-adbf7715631d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:57.690170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f18b7d8-2a6c-43e8-ac1c-adbf7715631d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:57.691190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f18b7d8-2a6c-43e8-ac1c-adbf7715631d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:57.692396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f18b7d8-2a6c-43e8-ac1c-adbf7715631d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:57.694349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f18b7d8-2a6c-43e8-ac1c-adbf7715631d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:57.754517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b5cc93ad-5d66-4324-a972-c14d50997ba9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:57.766484 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b5cc93ad-5d66-4324-a972-c14d50997ba9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1524 microversion: 2.1 time: 0.352341 May 28 04:53:57.782010 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2405/4929] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:57 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1524 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:57.810608 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0a05fe88-c9fe-4f2f-8a27-93a9bc796302 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:57.812208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0a05fe88-c9fe-4f2f-8a27-93a9bc796302 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:57.819912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a05fe88-c9fe-4f2f-8a27-93a9bc796302 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:57.822278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a05fe88-c9fe-4f2f-8a27-93a9bc796302 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:57.826447 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a05fe88-c9fe-4f2f-8a27-93a9bc796302 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:57.828270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a05fe88-c9fe-4f2f-8a27-93a9bc796302 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:58.022709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5f18b7d8-2a6c-43e8-ac1c-adbf7715631d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:58.041948 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5f18b7d8-2a6c-43e8-ac1c-adbf7715631d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.370213 May 28 04:53:58.042890 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2525/4930] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:57 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:58.064361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9cb3ded1-6afa-4e59-9d8a-52ed1bf2fd10 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:58.066690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9cb3ded1-6afa-4e59-9d8a-52ed1bf2fd10 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:58.080381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9cb3ded1-6afa-4e59-9d8a-52ed1bf2fd10 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:58.086511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9cb3ded1-6afa-4e59-9d8a-52ed1bf2fd10 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:58.086511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9cb3ded1-6afa-4e59-9d8a-52ed1bf2fd10 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:58.086511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9cb3ded1-6afa-4e59-9d8a-52ed1bf2fd10 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:58.192340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0a05fe88-c9fe-4f2f-8a27-93a9bc796302 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:58.214487 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0a05fe88-c9fe-4f2f-8a27-93a9bc796302 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1524 microversion: 2.1 time: 0.408440 May 28 04:53:58.215651 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2406/4931] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:57 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1524 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:58.225376 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3ba71bd8-1d37-439e-8db7-d67972b6aee0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:58.226010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3ba71bd8-1d37-439e-8db7-d67972b6aee0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:58.243260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ba71bd8-1d37-439e-8db7-d67972b6aee0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:58.246523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ba71bd8-1d37-439e-8db7-d67972b6aee0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:58.248117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ba71bd8-1d37-439e-8db7-d67972b6aee0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:58.252426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ba71bd8-1d37-439e-8db7-d67972b6aee0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:58.304187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:53:58.472555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9cb3ded1-6afa-4e59-9d8a-52ed1bf2fd10 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:58.494879 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9cb3ded1-6afa-4e59-9d8a-52ed1bf2fd10 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.435710 May 28 04:53:58.497518 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2526/4932] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:58 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:58.561109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3ba71bd8-1d37-439e-8db7-d67972b6aee0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:58.573870 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3ba71bd8-1d37-439e-8db7-d67972b6aee0 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1505 microversion: 2.1 time: 0.356526 May 28 04:53:58.574471 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2407/4933] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:58 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:58.649302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6144536c-5fa9-4ded-869d-3cb7c3bc8941 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:58.650030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6144536c-5fa9-4ded-869d-3cb7c3bc8941 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:58.661810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6144536c-5fa9-4ded-869d-3cb7c3bc8941 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:58.663557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6144536c-5fa9-4ded-869d-3cb7c3bc8941 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:58.666810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6144536c-5fa9-4ded-869d-3cb7c3bc8941 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:58.667643 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6144536c-5fa9-4ded-869d-3cb7c3bc8941 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:58.786619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-372b7108-cf00-4c7c-9625-338f90ece38b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:58.788169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-372b7108-cf00-4c7c-9625-338f90ece38b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:58.797927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-372b7108-cf00-4c7c-9625-338f90ece38b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:58.798712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-372b7108-cf00-4c7c-9625-338f90ece38b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:58.800425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-372b7108-cf00-4c7c-9625-338f90ece38b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:58.801071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-372b7108-cf00-4c7c-9625-338f90ece38b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:58.892605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6144536c-5fa9-4ded-869d-3cb7c3bc8941 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:58.903028 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6144536c-5fa9-4ded-869d-3cb7c3bc8941 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1392 microversion: 2.1 time: 0.259163 May 28 04:53:58.906437 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2527/4934] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:58 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1392 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:58.916232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6ee43a9d-3a90-4238-9b91-8977587555cf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1123675911", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6ee43a9d-3a90-4238-9b91-8977587555cf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 238 May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1123675911", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1123675911', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'd8b90133-44e4-4677-ae8d-d676a447193b'}]}}} May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise error May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:53:58.920685 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6ee43a9d-3a90-4238-9b91-8977587555cf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6ee43a9d-3a90-4238-9b91-8977587555cf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022577 May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2528/4935] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:53:58 2022] POST /compute/v2.1/servers => generated 139 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3ac435f2-5719-4488-8e5a-3841db5c6470 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3ac435f2-5719-4488-8e5a-3841db5c6470 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ac435f2-5719-4488-8e5a-3841db5c6470 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ac435f2-5719-4488-8e5a-3841db5c6470 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ac435f2-5719-4488-8e5a-3841db5c6470 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:59.174348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ac435f2-5719-4488-8e5a-3841db5c6470 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:59.178061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-372b7108-cf00-4c7c-9625-338f90ece38b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:59.178061 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-372b7108-cf00-4c7c-9625-338f90ece38b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1524 microversion: 2.1 time: 0.361153 May 28 04:53:59.178061 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2408/4936] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:58 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1524 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:59.219575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3ac435f2-5719-4488-8e5a-3841db5c6470 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:59.231078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7d764902-c194-4889-b1a0-5fff16f22c8e tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:59.264284 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3ac435f2-5719-4488-8e5a-3841db5c6470 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.294146 May 28 04:53:59.264559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7d764902-c194-4889-b1a0-5fff16f22c8e tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:59.264624 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2529/4937] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:58 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:59.264700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d764902-c194-4889-b1a0-5fff16f22c8e tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:59.264700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d764902-c194-4889-b1a0-5fff16f22c8e tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:59.264700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d764902-c194-4889-b1a0-5fff16f22c8e tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:59.264700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d764902-c194-4889-b1a0-5fff16f22c8e tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:59.284112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f6adcfb4-6b84-4372-93ff-b6d5dd35596a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:59.284979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f6adcfb4-6b84-4372-93ff-b6d5dd35596a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:59.292415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6adcfb4-6b84-4372-93ff-b6d5dd35596a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:59.297249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6adcfb4-6b84-4372-93ff-b6d5dd35596a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:59.299681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6adcfb4-6b84-4372-93ff-b6d5dd35596a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:59.303902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6adcfb4-6b84-4372-93ff-b6d5dd35596a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:59.636363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7d764902-c194-4889-b1a0-5fff16f22c8e tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:59.644943 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7d764902-c194-4889-b1a0-5fff16f22c8e tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1524 microversion: 2.1 time: 0.417916 May 28 04:53:59.645561 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2409/4938] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:59 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1524 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:53:59.651360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-76d38d84-3532-48db-8714-45f833765350 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:59.652190 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-76d38d84-3532-48db-8714-45f833765350 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:59.659219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76d38d84-3532-48db-8714-45f833765350 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:59.659792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76d38d84-3532-48db-8714-45f833765350 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:59.660477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76d38d84-3532-48db-8714-45f833765350 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:59.660930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76d38d84-3532-48db-8714-45f833765350 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:59.662502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f6adcfb4-6b84-4372-93ff-b6d5dd35596a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:59.672338 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f6adcfb4-6b84-4372-93ff-b6d5dd35596a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.392386 May 28 04:53:59.675033 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2530/4939] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:59 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:59.799735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-76d38d84-3532-48db-8714-45f833765350 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:53:59.807428 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-76d38d84-3532-48db-8714-45f833765350 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1485 microversion: 2.1 time: 0.160888 May 28 04:53:59.808011 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2410/4940] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:59 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1485 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:53:59.827699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4cd7952b-ac36-4235-a3ce-ad426c8c06ce tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:53:59.828239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4cd7952b-ac36-4235-a3ce-ad426c8c06ce tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:59.834318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4cd7952b-ac36-4235-a3ce-ad426c8c06ce tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:59.834772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4cd7952b-ac36-4235-a3ce-ad426c8c06ce tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:59.835554 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4cd7952b-ac36-4235-a3ce-ad426c8c06ce tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:59.836017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4cd7952b-ac36-4235-a3ce-ad426c8c06ce tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:59.922690 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5b90f412-9aad-4ebc-ac9e-9bb7351c858f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:53:59.923340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5b90f412-9aad-4ebc-ac9e-9bb7351c858f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:53:59.930154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5b90f412-9aad-4ebc-ac9e-9bb7351c858f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:59.930617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5b90f412-9aad-4ebc-ac9e-9bb7351c858f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:53:59.931473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5b90f412-9aad-4ebc-ac9e-9bb7351c858f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:53:59.932002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5b90f412-9aad-4ebc-ac9e-9bb7351c858f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:00.099581 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4cd7952b-ac36-4235-a3ce-ad426c8c06ce tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "POST /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad/action" status: 202 len: 0 microversion: 2.1 time: 0.275249 May 28 04:54:00.117250 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2531/4941] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:53:59 2022] POST /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:54:00.130390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-147b2d6d-41df-4780-b480-dfb65fb1f5b8 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:00.130390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-147b2d6d-41df-4780-b480-dfb65fb1f5b8 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:00.136147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-147b2d6d-41df-4780-b480-dfb65fb1f5b8 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:00.136701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-147b2d6d-41df-4780-b480-dfb65fb1f5b8 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:00.138260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-147b2d6d-41df-4780-b480-dfb65fb1f5b8 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:00.138903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-147b2d6d-41df-4780-b480-dfb65fb1f5b8 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:00.204141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5b90f412-9aad-4ebc-ac9e-9bb7351c858f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:00.220519 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5b90f412-9aad-4ebc-ac9e-9bb7351c858f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1392 microversion: 2.1 time: 0.301844 May 28 04:54:00.225529 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2411/4942] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:53:59 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1392 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:00.238894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53d211f9-8685-4b57-a1a5-9d436b011bfe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1690068072", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53d211f9-8685-4b57-a1a5-9d436b011bfe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 235 May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1690068072", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1690068072', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'd8b90133-44e4-4677-ae8d-d676a447193b'}]}}} May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = func(instance) May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'notvalid' May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:54:00.248546 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 28 04:54:00.252158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:00.267460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53d211f9-8685-4b57-a1a5-9d436b011bfe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:54:00.271810 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-53d211f9-8685-4b57-a1a5-9d436b011bfe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.045099 May 28 04:54:00.282226 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2412/4943] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:54:00 2022] POST /compute/v2.1/servers => generated 133 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:54:00.292153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b6dc3e3a-1418-4769-ae10-256452daeeeb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:00.297402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b6dc3e3a-1418-4769-ae10-256452daeeeb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:00.306131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6dc3e3a-1418-4769-ae10-256452daeeeb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:00.309131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6dc3e3a-1418-4769-ae10-256452daeeeb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:00.311596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6dc3e3a-1418-4769-ae10-256452daeeeb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:00.313000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6dc3e3a-1418-4769-ae10-256452daeeeb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:00.765506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b6dc3e3a-1418-4769-ae10-256452daeeeb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:00.777954 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b6dc3e3a-1418-4769-ae10-256452daeeeb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1524 microversion: 2.1 time: 0.494315 May 28 04:54:00.785907 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2413/4944] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:00 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1524 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:00.803232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e9d7593a-8050-4af8-b999-6cadc2da2d72 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:00.809067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e9d7593a-8050-4af8-b999-6cadc2da2d72 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:00.826221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9d7593a-8050-4af8-b999-6cadc2da2d72 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:00.827076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9d7593a-8050-4af8-b999-6cadc2da2d72 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:00.831241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-147b2d6d-41df-4780-b480-dfb65fb1f5b8 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:00.840603 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9d7593a-8050-4af8-b999-6cadc2da2d72 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:00.841630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9d7593a-8050-4af8-b999-6cadc2da2d72 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:00.843410 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-147b2d6d-41df-4780-b480-dfb65fb1f5b8 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1493 microversion: 2.1 time: 0.721741 May 28 04:54:00.853544 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2532/4945] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:00 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1493 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:00.853544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eab359c0-5bdc-4df4-86a0-66b7a7166ba1 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:00.853544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-eab359c0-5bdc-4df4-86a0-66b7a7166ba1 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:00.858467 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eab359c0-5bdc-4df4-86a0-66b7a7166ba1 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:00.859189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eab359c0-5bdc-4df4-86a0-66b7a7166ba1 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:00.860242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eab359c0-5bdc-4df4-86a0-66b7a7166ba1 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:00.860925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eab359c0-5bdc-4df4-86a0-66b7a7166ba1 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:01.164692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-eab359c0-5bdc-4df4-86a0-66b7a7166ba1 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:01.176279 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-eab359c0-5bdc-4df4-86a0-66b7a7166ba1 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1524 microversion: 2.1 time: 0.329604 May 28 04:54:01.184673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e9d7593a-8050-4af8-b999-6cadc2da2d72 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:01.191165 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2533/4946] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:00 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1524 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:01.194746 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e9d7593a-8050-4af8-b999-6cadc2da2d72 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.407517 May 28 04:54:01.199070 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2414/4947] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:00 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:01.215175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-08447f67-394c-4332-9ca6-cdff36c8bca6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:01.216418 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-08447f67-394c-4332-9ca6-cdff36c8bca6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:01.223117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08447f67-394c-4332-9ca6-cdff36c8bca6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:01.223799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08447f67-394c-4332-9ca6-cdff36c8bca6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:01.224757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08447f67-394c-4332-9ca6-cdff36c8bca6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:01.225334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08447f67-394c-4332-9ca6-cdff36c8bca6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:01.237907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-96d58aa2-053b-4aa2-bfc7-31265ca656b6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:01.239024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-96d58aa2-053b-4aa2-bfc7-31265ca656b6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:01.248678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:54:01.252293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-96d58aa2-053b-4aa2-bfc7-31265ca656b6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:01.253777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-96d58aa2-053b-4aa2-bfc7-31265ca656b6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:01.256040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-96d58aa2-053b-4aa2-bfc7-31265ca656b6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:01.256738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-96d58aa2-053b-4aa2-bfc7-31265ca656b6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:01.431203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-08447f67-394c-4332-9ca6-cdff36c8bca6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:01.444171 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-08447f67-394c-4332-9ca6-cdff36c8bca6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.232822 May 28 04:54:01.457117 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2534/4948] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:01 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:01.465824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2f8ec7d4-1e04-49d6-974b-0395ab91d9f7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:01.465824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2f8ec7d4-1e04-49d6-974b-0395ab91d9f7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 0d7b2fc7-13f6-4333-8705-e3d869c73c3c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:01.468971 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-2f8ec7d4-1e04-49d6-974b-0395ab91d9f7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance 0d7b2fc7-13f6-4333-8705-e3d869c73c3c could not be found. May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2f8ec7d4-1e04-49d6-974b-0395ab91d9f7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/0d7b2fc7-13f6-4333-8705-e3d869c73c3c/action HTTP/1.1 May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 13 May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: {"pause": {}} May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 0d7b2fc7-13f6-4333-8705-e3d869c73c3c could not be found. May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '0d7b2fc7-13f6-4333-8705-e3d869c73c3c', 'body': {'pause': {}}} May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d7b2fc7-13f6-4333-8705-e3d869c73c3c could not be found. May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d7b2fc7-13f6-4333-8705-e3d869c73c3c could not be found. May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:01.477850 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:01.480988 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:54:01.480988 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:54:01.480988 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d7b2fc7-13f6-4333-8705-e3d869c73c3c could not be found. May 28 04:54:01.480988 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:01.480988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2f8ec7d4-1e04-49d6-974b-0395ab91d9f7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance 0d7b2fc7-13f6-4333-8705-e3d869c73c3c could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:54:01.480988 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2f8ec7d4-1e04-49d6-974b-0395ab91d9f7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/0d7b2fc7-13f6-4333-8705-e3d869c73c3c/action" status: 404 len: 111 microversion: 2.1 time: 0.021269 May 28 04:54:01.489369 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2535/4949] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:01 2022] POST /compute/v2.1/servers/0d7b2fc7-13f6-4333-8705-e3d869c73c3c/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:54:01.494325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ecabd250-3f0a-4db0-b3e7-1d349cc0cdf5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:01.498045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ecabd250-3f0a-4db0-b3e7-1d349cc0cdf5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:01.515916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ecabd250-3f0a-4db0-b3e7-1d349cc0cdf5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:01.516453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ecabd250-3f0a-4db0-b3e7-1d349cc0cdf5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:01.517406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ecabd250-3f0a-4db0-b3e7-1d349cc0cdf5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:01.518054 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ecabd250-3f0a-4db0-b3e7-1d349cc0cdf5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:01.531418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-96d58aa2-053b-4aa2-bfc7-31265ca656b6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:01.540625 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-96d58aa2-053b-4aa2-bfc7-31265ca656b6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1392 microversion: 2.1 time: 0.307096 May 28 04:54:01.553095 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2415/4950] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:01 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1392 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:01.559280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-d0cb8e55-620c-4e72-b513-57c77389252c req-c0344b2a-0b3a-4a8a-9bfe-7673a363b01d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260294eb-db79-4280-a534-928afd9312d0", "name": "network-vif-plugged", "status": "completed", "tag": "3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:01.569186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d0cb8e55-620c-4e72-b513-57c77389252c req-c0344b2a-0b3a-4a8a-9bfe-7673a363b01d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:01.569928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d0cb8e55-620c-4e72-b513-57c77389252c req-c0344b2a-0b3a-4a8a-9bfe-7673a363b01d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:01.592140 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-d0cb8e55-620c-4e72-b513-57c77389252c req-c0344b2a-0b3a-4a8a-9bfe-7673a363b01d service nova] Creating event network-vif-plugged:3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0 for instance 260294eb-db79-4280-a534-928afd9312d0 on n-h2-843700-1 May 28 04:54:01.615299 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-d0cb8e55-620c-4e72-b513-57c77389252c req-c0344b2a-0b3a-4a8a-9bfe-7673a363b01d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060465 May 28 04:54:01.618870 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2416/4951] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:54:01.693892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ecabd250-3f0a-4db0-b3e7-1d349cc0cdf5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:01.702424 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ecabd250-3f0a-4db0-b3e7-1d349cc0cdf5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.211143 May 28 04:54:01.702424 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2536/4952] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:01 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:01.721649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-22e5a365-88a3-44aa-8f66-f781f93d50e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:01.723260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-22e5a365-88a3-44aa-8f66-f781f93d50e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:01.728990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22e5a365-88a3-44aa-8f66-f781f93d50e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:01.729447 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22e5a365-88a3-44aa-8f66-f781f93d50e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:01.730370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22e5a365-88a3-44aa-8f66-f781f93d50e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:01.730808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22e5a365-88a3-44aa-8f66-f781f93d50e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:01.800815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2faea1ff-7126-487c-890a-8bf08d4aa7f0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:01.801438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2faea1ff-7126-487c-890a-8bf08d4aa7f0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:01.808385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2faea1ff-7126-487c-890a-8bf08d4aa7f0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:01.817994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2faea1ff-7126-487c-890a-8bf08d4aa7f0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:01.817994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2faea1ff-7126-487c-890a-8bf08d4aa7f0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:01.817994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2faea1ff-7126-487c-890a-8bf08d4aa7f0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:01.926655 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-22e5a365-88a3-44aa-8f66-f781f93d50e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:01.934896 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-22e5a365-88a3-44aa-8f66-f781f93d50e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.219101 May 28 04:54:01.935522 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2417/4953] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:01 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:01.956794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dd267514-f3db-4945-bcfa-15284c9bd3a8 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:01.957672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dd267514-f3db-4945-bcfa-15284c9bd3a8 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:01.970002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd267514-f3db-4945-bcfa-15284c9bd3a8 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:01.970526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd267514-f3db-4945-bcfa-15284c9bd3a8 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:01.972013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd267514-f3db-4945-bcfa-15284c9bd3a8 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:01.972626 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd267514-f3db-4945-bcfa-15284c9bd3a8 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:01.996282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2faea1ff-7126-487c-890a-8bf08d4aa7f0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:02.004489 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2faea1ff-7126-487c-890a-8bf08d4aa7f0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1524 microversion: 2.1 time: 0.207533 May 28 04:54:02.014752 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2537/4954] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:01 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1524 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:02.022454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-41f0a98c-3b6b-467e-9533-de67c1f848cb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:02.022454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-41f0a98c-3b6b-467e-9533-de67c1f848cb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:02.029505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41f0a98c-3b6b-467e-9533-de67c1f848cb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:02.030031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41f0a98c-3b6b-467e-9533-de67c1f848cb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:02.030823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41f0a98c-3b6b-467e-9533-de67c1f848cb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:02.031484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41f0a98c-3b6b-467e-9533-de67c1f848cb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:02.151392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dd267514-f3db-4945-bcfa-15284c9bd3a8 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:02.159743 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dd267514-f3db-4945-bcfa-15284c9bd3a8 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1493 microversion: 2.1 time: 0.221917 May 28 04:54:02.160490 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2418/4955] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:01 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1493 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:02.198054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-55704226-e1b1-4f2f-876e-7967a1eee71d tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:02.200044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-55704226-e1b1-4f2f-876e-7967a1eee71d tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:02.203572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:54:02.207816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-55704226-e1b1-4f2f-876e-7967a1eee71d tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:02.208275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-55704226-e1b1-4f2f-876e-7967a1eee71d tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:02.209103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-55704226-e1b1-4f2f-876e-7967a1eee71d tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:02.209660 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-55704226-e1b1-4f2f-876e-7967a1eee71d tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:02.280198 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-41f0a98c-3b6b-467e-9533-de67c1f848cb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action" status: 202 len: 0 microversion: 2.1 time: 0.263245 May 28 04:54:02.280863 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2538/4956] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:02 2022] POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:54:02.302866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-55ea9626-0851-4a3d-b963-cbd569575958 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:02.303659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-55ea9626-0851-4a3d-b963-cbd569575958 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:02.328241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55ea9626-0851-4a3d-b963-cbd569575958 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:02.328982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55ea9626-0851-4a3d-b963-cbd569575958 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:02.330069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55ea9626-0851-4a3d-b963-cbd569575958 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:02.334275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55ea9626-0851-4a3d-b963-cbd569575958 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:02.390083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-55704226-e1b1-4f2f-876e-7967a1eee71d tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:02.400660 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-55704226-e1b1-4f2f-876e-7967a1eee71d tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1504 microversion: 2.1 time: 0.206795 May 28 04:54:02.408930 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2419/4957] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:02 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:02.427928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f5ed7627-7528-4913-acc7-dc14fb1429f1 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Action: 'create', calling method: .version_select at 0x7f7701a398b0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1083216726", "description": "tempest-description-251119173"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:02.538621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-55ea9626-0851-4a3d-b963-cbd569575958 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:02.546388 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-55ea9626-0851-4a3d-b963-cbd569575958 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1511 microversion: 2.1 time: 0.260577 May 28 04:54:02.546947 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2539/4958] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:02 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1511 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:02.562371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6d27edf5-2a24-4ffc-bcf2-c08069ec2f77 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:02.562768 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6d27edf5-2a24-4ffc-bcf2-c08069ec2f77 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:02.569089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d27edf5-2a24-4ffc-bcf2-c08069ec2f77 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:02.569546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d27edf5-2a24-4ffc-bcf2-c08069ec2f77 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:02.570325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d27edf5-2a24-4ffc-bcf2-c08069ec2f77 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:02.570793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d27edf5-2a24-4ffc-bcf2-c08069ec2f77 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:02.764812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6d27edf5-2a24-4ffc-bcf2-c08069ec2f77 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:02.774092 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6d27edf5-2a24-4ffc-bcf2-c08069ec2f77 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1392 microversion: 2.1 time: 0.216633 May 28 04:54:02.783789 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2540/4959] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:02 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1392 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:02.947882 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f5ed7627-7528-4913-acc7-dc14fb1429f1 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.523996 May 28 04:54:02.948842 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2420/4960] 10.222.0.58 () {60 vars in 1179 bytes} [Sat May 28 04:54:02 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:54:02.960835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a606d285-3255-49de-8624-1c85ea91ac07 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1083216726"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:02.961803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a606d285-3255-49de-8624-1c85ea91ac07 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:02.968753 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a606d285-3255-49de-8624-1c85ea91ac07 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:02.969200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a606d285-3255-49de-8624-1c85ea91ac07 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:02.969960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a606d285-3255-49de-8624-1c85ea91ac07 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:02.970396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a606d285-3255-49de-8624-1c85ea91ac07 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:03.021833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-88c566f6-cbfe-4fff-a959-63b9277b488b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:03.022725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-88c566f6-cbfe-4fff-a959-63b9277b488b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:03.033950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88c566f6-cbfe-4fff-a959-63b9277b488b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:03.034421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88c566f6-cbfe-4fff-a959-63b9277b488b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:03.039769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88c566f6-cbfe-4fff-a959-63b9277b488b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:03.040557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88c566f6-cbfe-4fff-a959-63b9277b488b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:03.183898 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.network.security_group_api [None req-a606d285-3255-49de-8624-1c85ea91ac07 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Adding security group 71ecb9e5-1ada-4858-9d2f-2dee64fd17c3 to port cb04aa76-1a04-4fb5-a21c-24d0b903b510 May 28 04:54:03.327488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-88c566f6-cbfe-4fff-a959-63b9277b488b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:03.338638 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-88c566f6-cbfe-4fff-a959-63b9277b488b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1506 microversion: 2.1 time: 0.320728 May 28 04:54:03.339198 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2421/4961] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:03 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:03.352002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-af7dab9a-25e9-4d98-bf8c-1e80e39d49e1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:03.352627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-af7dab9a-25e9-4d98-bf8c-1e80e39d49e1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:03.359435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af7dab9a-25e9-4d98-bf8c-1e80e39d49e1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:03.359893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af7dab9a-25e9-4d98-bf8c-1e80e39d49e1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:03.360674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af7dab9a-25e9-4d98-bf8c-1e80e39d49e1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:03.361119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af7dab9a-25e9-4d98-bf8c-1e80e39d49e1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:03.606050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-af7dab9a-25e9-4d98-bf8c-1e80e39d49e1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:03.617892 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-af7dab9a-25e9-4d98-bf8c-1e80e39d49e1 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1493 microversion: 2.1 time: 0.277206 May 28 04:54:03.619195 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2422/4962] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:03 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1493 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:03.624762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0076ebf4-4cec-4e69-9e4a-124aeb27ad63 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:03.625639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0076ebf4-4cec-4e69-9e4a-124aeb27ad63 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:03.635529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0076ebf4-4cec-4e69-9e4a-124aeb27ad63 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:03.636592 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0076ebf4-4cec-4e69-9e4a-124aeb27ad63 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:03.639257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0076ebf4-4cec-4e69-9e4a-124aeb27ad63 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:03.639916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0076ebf4-4cec-4e69-9e4a-124aeb27ad63 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:03.817807 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a606d285-3255-49de-8624-1c85ea91ac07 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "POST /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96/action" status: 202 len: 0 microversion: 2.1 time: 0.861402 May 28 04:54:03.818432 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2541/4963] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:02 2022] POST /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96/action => generated 0 bytes in 863 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:54:03.825691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7add7781-6a2f-4ae2-8b10-8a79486ae50b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:03.826270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7add7781-6a2f-4ae2-8b10-8a79486ae50b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:03.839478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7add7781-6a2f-4ae2-8b10-8a79486ae50b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:03.848548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7add7781-6a2f-4ae2-8b10-8a79486ae50b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:03.848548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7add7781-6a2f-4ae2-8b10-8a79486ae50b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:03.848548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7add7781-6a2f-4ae2-8b10-8a79486ae50b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:03.985802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0076ebf4-4cec-4e69-9e4a-124aeb27ad63 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:03.997926 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0076ebf4-4cec-4e69-9e4a-124aeb27ad63 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1491 microversion: 2.1 time: 0.375969 May 28 04:54:03.998838 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2423/4964] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:03 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1491 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:04.005477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cf4a42c7-9dfc-45ed-beac-903a0863bd9b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1083216726"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:04.006344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cf4a42c7-9dfc-45ed-beac-903a0863bd9b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:04.016042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf4a42c7-9dfc-45ed-beac-903a0863bd9b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:04.016945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf4a42c7-9dfc-45ed-beac-903a0863bd9b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:04.018061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf4a42c7-9dfc-45ed-beac-903a0863bd9b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:04.020820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf4a42c7-9dfc-45ed-beac-903a0863bd9b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:04.065086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7add7781-6a2f-4ae2-8b10-8a79486ae50b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:04.074533 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7add7781-6a2f-4ae2-8b10-8a79486ae50b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1392 microversion: 2.1 time: 0.255053 May 28 04:54:04.078084 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2542/4965] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:03 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1392 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:04.091962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-a6f99644-4bca-46ae-a323-ebf477f271c6 req-2f4237df-8323-4c62-b72b-5b812b70bf83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d9bcfd7-7d49-4c32-ae2c-748617114b96", "tag": "cb04aa76-1a04-4fb5-a21c-24d0b903b510"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:04.102120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a6f99644-4bca-46ae-a323-ebf477f271c6 req-2f4237df-8323-4c62-b72b-5b812b70bf83 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:04.102689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a6f99644-4bca-46ae-a323-ebf477f271c6 req-2f4237df-8323-4c62-b72b-5b812b70bf83 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:04.116793 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-a6f99644-4bca-46ae-a323-ebf477f271c6 req-2f4237df-8323-4c62-b72b-5b812b70bf83 service nova] Creating event network-changed:cb04aa76-1a04-4fb5-a21c-24d0b903b510 for instance 0d9bcfd7-7d49-4c32-ae2c-748617114b96 on n-h1-843700-1 May 28 04:54:04.123140 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-a6f99644-4bca-46ae-a323-ebf477f271c6 req-2f4237df-8323-4c62-b72b-5b812b70bf83 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035213 May 28 04:54:04.124322 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2543/4966] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:54:04.136445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-18d445be-2631-4d27-9ce6-795f556cf335 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:04.138257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-18d445be-2631-4d27-9ce6-795f556cf335 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:04.156732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-18d445be-2631-4d27-9ce6-795f556cf335 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:04.157202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-18d445be-2631-4d27-9ce6-795f556cf335 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:04.157997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-18d445be-2631-4d27-9ce6-795f556cf335 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:04.161210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-18d445be-2631-4d27-9ce6-795f556cf335 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:04.214753 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-18d445be-2631-4d27-9ce6-795f556cf335 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Cannot 'pause' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state paused May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-18d445be-2631-4d27-9ce6-795f556cf335 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action HTTP/1.1 May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 13 May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: {"pause": {}} May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: exception: Cannot 'pause' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state paused May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '58022ec6-f4eb-4564-bed0-c3edd1d0daf4', 'body': {'pause': {}}} May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 in vm_state paused. Cannot pause while the instance is in this state. May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state paused May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:04.216976 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:04.220104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:04.220104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:54:04.220104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:54:04.220104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state paused May 28 04:54:04.220104 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:04.223943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-18d445be-2631-4d27-9ce6-795f556cf335 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 409 to user: Cannot 'pause' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state paused {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:54:04.224828 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-18d445be-2631-4d27-9ce6-795f556cf335 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action" status: 409 len: 143 microversion: 2.1 time: 0.099301 May 28 04:54:04.225414 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2544/4967] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:04 2022] POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action => generated 143 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 04:54:04.236930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4585aeb2-ebb0-4b64-a24f-ce81ff931192 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:04.237691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4585aeb2-ebb0-4b64-a24f-ce81ff931192 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:04.244525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4585aeb2-ebb0-4b64-a24f-ce81ff931192 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:04.245215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4585aeb2-ebb0-4b64-a24f-ce81ff931192 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:04.246417 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4585aeb2-ebb0-4b64-a24f-ce81ff931192 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:04.247074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4585aeb2-ebb0-4b64-a24f-ce81ff931192 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:04.468250 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4585aeb2-ebb0-4b64-a24f-ce81ff931192 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action" status: 202 len: 0 microversion: 2.1 time: 0.237926 May 28 04:54:04.469526 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2545/4968] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:04 2022] POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:54:04.488612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ccf300d1-2147-46a5-9201-147773686080 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:04.490854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ccf300d1-2147-46a5-9201-147773686080 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:04.499764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ccf300d1-2147-46a5-9201-147773686080 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:04.500517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ccf300d1-2147-46a5-9201-147773686080 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:04.501536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ccf300d1-2147-46a5-9201-147773686080 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:04.502225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ccf300d1-2147-46a5-9201-147773686080 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:04.704821 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.network.security_group_api [None req-cf4a42c7-9dfc-45ed-beac-903a0863bd9b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Removing security group 71ecb9e5-1ada-4858-9d2f-2dee64fd17c3 from port cb04aa76-1a04-4fb5-a21c-24d0b903b510 May 28 04:54:04.897945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ccf300d1-2147-46a5-9201-147773686080 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:04.908395 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ccf300d1-2147-46a5-9201-147773686080 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1506 microversion: 2.1 time: 0.437416 May 28 04:54:04.909145 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2546/4969] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:04 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1506 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:04.928320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0b821f44-787f-4b0d-b003-5ce74e15f787 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:04.934035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0b821f44-787f-4b0d-b003-5ce74e15f787 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:04.939546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b821f44-787f-4b0d-b003-5ce74e15f787 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:04.940256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b821f44-787f-4b0d-b003-5ce74e15f787 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:04.941537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b821f44-787f-4b0d-b003-5ce74e15f787 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:04.942045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b821f44-787f-4b0d-b003-5ce74e15f787 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:05.308333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0b821f44-787f-4b0d-b003-5ce74e15f787 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:05.316797 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0b821f44-787f-4b0d-b003-5ce74e15f787 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.399064 May 28 04:54:05.317379 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2547/4970] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:04 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:05.321876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a5a520aa-904d-44d7-8be8-cb9d88018a26 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:05.322587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a5a520aa-904d-44d7-8be8-cb9d88018a26 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:05.336454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5a520aa-904d-44d7-8be8-cb9d88018a26 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:05.337142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5a520aa-904d-44d7-8be8-cb9d88018a26 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:05.338306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5a520aa-904d-44d7-8be8-cb9d88018a26 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:05.338933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5a520aa-904d-44d7-8be8-cb9d88018a26 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:05.605890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a5a520aa-904d-44d7-8be8-cb9d88018a26 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:05.618187 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a5a520aa-904d-44d7-8be8-cb9d88018a26 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1499 microversion: 2.1 time: 0.298790 May 28 04:54:05.631785 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2548/4971] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:05 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1499 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:05.642610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e1e61855-cbb4-49a1-b64e-8192ba46e608 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:05.643318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e1e61855-cbb4-49a1-b64e-8192ba46e608 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:05.651208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1e61855-cbb4-49a1-b64e-8192ba46e608 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:05.652087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1e61855-cbb4-49a1-b64e-8192ba46e608 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:05.653099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1e61855-cbb4-49a1-b64e-8192ba46e608 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:05.653776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1e61855-cbb4-49a1-b64e-8192ba46e608 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:05.772766 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cf4a42c7-9dfc-45ed-beac-903a0863bd9b tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "POST /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96/action" status: 202 len: 0 microversion: 2.1 time: 1.771639 May 28 04:54:05.774385 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2424/4972] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:03 2022] POST /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96/action => generated 0 bytes in 1775 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:54:05.783770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fa2bf03d-d734-4550-b878-f6ab84533b23 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:05.784945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fa2bf03d-d734-4550-b878-f6ab84533b23 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:05.794931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa2bf03d-d734-4550-b878-f6ab84533b23 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:05.795880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa2bf03d-d734-4550-b878-f6ab84533b23 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:05.797514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa2bf03d-d734-4550-b878-f6ab84533b23 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:05.804515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa2bf03d-d734-4550-b878-f6ab84533b23 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:05.852089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e1e61855-cbb4-49a1-b64e-8192ba46e608 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:05.862838 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e1e61855-cbb4-49a1-b64e-8192ba46e608 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1564 microversion: 2.1 time: 0.225366 May 28 04:54:05.864013 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2549/4973] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:05 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1564 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:05.868842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a8ff4d85-4d31-45a3-9a0b-cd2c95421156 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:05.869672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a8ff4d85-4d31-45a3-9a0b-cd2c95421156 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:05.878407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a8ff4d85-4d31-45a3-9a0b-cd2c95421156 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:05.878864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a8ff4d85-4d31-45a3-9a0b-cd2c95421156 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:05.879677 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a8ff4d85-4d31-45a3-9a0b-cd2c95421156 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:05.880785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a8ff4d85-4d31-45a3-9a0b-cd2c95421156 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:05.916859 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a8ff4d85-4d31-45a3-9a0b-cd2c95421156 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:54:05.955218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:54:05.980110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fa2bf03d-d734-4550-b878-f6ab84533b23 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:05.999959 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fa2bf03d-d734-4550-b878-f6ab84533b23 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.221185 May 28 04:54:06.011588 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2425/4974] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:05 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:06.017396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dfaa6042-4843-40df-9c32-a04a628acd50 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Action: 'create', calling method: .version_select at 0x7f7701a23790>, body: {"pool": null} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:06.234066 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a8ff4d85-4d31-45a3-9a0b-cd2c95421156 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "DELETE /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 204 len: 0 microversion: 2.1 time: 0.368537 May 28 04:54:06.237309 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2550/4975] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:54:05 2022] DELETE /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:54:06.242891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7e2864cd-a1fb-45a7-90ce-7a96607b1cda tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:06.244579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7e2864cd-a1fb-45a7-90ce-7a96607b1cda tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:06.253969 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e2864cd-a1fb-45a7-90ce-7a96607b1cda tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:06.254967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e2864cd-a1fb-45a7-90ce-7a96607b1cda tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:06.256037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e2864cd-a1fb-45a7-90ce-7a96607b1cda tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:06.256964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e2864cd-a1fb-45a7-90ce-7a96607b1cda tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:06.793430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7e2864cd-a1fb-45a7-90ce-7a96607b1cda tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:06.805813 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7e2864cd-a1fb-45a7-90ce-7a96607b1cda tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1564 microversion: 2.1 time: 0.567842 May 28 04:54:06.806897 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2551/4976] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:06 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1564 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:06.823193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-42ebe115-3ed3-4b62-b8d7-254a9ef34db3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:06.823871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-42ebe115-3ed3-4b62-b8d7-254a9ef34db3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:06.835841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42ebe115-3ed3-4b62-b8d7-254a9ef34db3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:06.836377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42ebe115-3ed3-4b62-b8d7-254a9ef34db3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:06.837208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42ebe115-3ed3-4b62-b8d7-254a9ef34db3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:06.837713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42ebe115-3ed3-4b62-b8d7-254a9ef34db3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:07.098695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-42ebe115-3ed3-4b62-b8d7-254a9ef34db3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:07.107582 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-42ebe115-3ed3-4b62-b8d7-254a9ef34db3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1506 microversion: 2.1 time: 0.291361 May 28 04:54:07.108186 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2552/4977] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:06 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:07.113247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8a777dc9-f53c-4ac8-b124-bc5dd74dda30 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:07.114630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8a777dc9-f53c-4ac8-b124-bc5dd74dda30 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:07.124427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a777dc9-f53c-4ac8-b124-bc5dd74dda30 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:07.125043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a777dc9-f53c-4ac8-b124-bc5dd74dda30 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:07.131463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a777dc9-f53c-4ac8-b124-bc5dd74dda30 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:07.131463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a777dc9-f53c-4ac8-b124-bc5dd74dda30 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:07.150336 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-8a777dc9-f53c-4ac8-b124-bc5dd74dda30 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8a777dc9-f53c-4ac8-b124-bc5dd74dda30 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90/action HTTP/1.1 May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 28 May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: {"reboot": {"type": "SOFT"}} May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90', 'body': {'reboot': {'type': 'SOFT'}}} May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:54:07.153106 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:54:07.160477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:54:07.160477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:07.160477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:07.160477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:07.160477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:07.160477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:07.160477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:07.160477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:54:07.160477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:54:07.160477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:54:07.160477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:07.160477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8a777dc9-f53c-4ac8-b124-bc5dd74dda30 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:54:07.160477 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8a777dc9-f53c-4ac8-b124-bc5dd74dda30 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90/action" status: 404 len: 111 microversion: 2.1 time: 0.045786 May 28 04:54:07.160477 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2553/4978] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:07 2022] POST /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:54:07.166711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-3b91696e-f570-46cb-b3fe-484bea7be7e0 req-cd99265b-b7d3-4eb9-8205-e69845ed6636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d9bcfd7-7d49-4c32-ae2c-748617114b96", "tag": "cb04aa76-1a04-4fb5-a21c-24d0b903b510"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:07.181991 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-3b91696e-f570-46cb-b3fe-484bea7be7e0 req-cd99265b-b7d3-4eb9-8205-e69845ed6636 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:07.183100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-3b91696e-f570-46cb-b3fe-484bea7be7e0 req-cd99265b-b7d3-4eb9-8205-e69845ed6636 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:07.198747 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-3b91696e-f570-46cb-b3fe-484bea7be7e0 req-cd99265b-b7d3-4eb9-8205-e69845ed6636 service nova] Creating event network-changed:cb04aa76-1a04-4fb5-a21c-24d0b903b510 for instance 0d9bcfd7-7d49-4c32-ae2c-748617114b96 on n-h1-843700-1 May 28 04:54:07.206014 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-3b91696e-f570-46cb-b3fe-484bea7be7e0 req-cd99265b-b7d3-4eb9-8205-e69845ed6636 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048536 May 28 04:54:07.207166 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2554/4979] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:54:07.216216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-873af14d-7a9f-4674-ac6c-9ded3eb8bfca tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:07.217091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-873af14d-7a9f-4674-ac6c-9ded3eb8bfca tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:07.229971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-873af14d-7a9f-4674-ac6c-9ded3eb8bfca tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:07.232241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-873af14d-7a9f-4674-ac6c-9ded3eb8bfca tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:07.232241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-873af14d-7a9f-4674-ac6c-9ded3eb8bfca tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:07.233263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-873af14d-7a9f-4674-ac6c-9ded3eb8bfca tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:07.440901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-873af14d-7a9f-4674-ac6c-9ded3eb8bfca tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:07.450356 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-873af14d-7a9f-4674-ac6c-9ded3eb8bfca tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1505 microversion: 2.1 time: 0.241070 May 28 04:54:07.455543 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2555/4980] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:07 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1505 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:07.460259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-793979ff-de32-4275-8dc3-2dfe4f94b84d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:07.467160 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-793979ff-de32-4275-8dc3-2dfe4f94b84d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:07.485787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-793979ff-de32-4275-8dc3-2dfe4f94b84d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:07.486255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-793979ff-de32-4275-8dc3-2dfe4f94b84d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:07.487049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-793979ff-de32-4275-8dc3-2dfe4f94b84d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:07.487498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-793979ff-de32-4275-8dc3-2dfe4f94b84d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:07.866338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-793979ff-de32-4275-8dc3-2dfe4f94b84d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:07.874111 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-793979ff-de32-4275-8dc3-2dfe4f94b84d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.417485 May 28 04:54:07.887567 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2556/4981] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:07 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:07.893342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-d9cca9f9-c696-4442-978c-9d71bff365c0 req-b721ec0e-a868-40da-9b5b-103ec0152cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3087299d-554e-4c36-8eb4-3082257b7e65", "name": "network-vif-unplugged", "status": "completed", "tag": "8a7a1ead-8e33-447e-840c-7789196d4eee"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:07.912046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:54:07.914173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d9cca9f9-c696-4442-978c-9d71bff365c0 req-b721ec0e-a868-40da-9b5b-103ec0152cee service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:07.915265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d9cca9f9-c696-4442-978c-9d71bff365c0 req-b721ec0e-a868-40da-9b5b-103ec0152cee service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:07.927085 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-d9cca9f9-c696-4442-978c-9d71bff365c0 req-b721ec0e-a868-40da-9b5b-103ec0152cee service nova] Creating event network-vif-unplugged:8a7a1ead-8e33-447e-840c-7789196d4eee for instance 3087299d-554e-4c36-8eb4-3082257b7e65 on n-h2-843700-1 May 28 04:54:07.933003 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-d9cca9f9-c696-4442-978c-9d71bff365c0 req-b721ec0e-a868-40da-9b5b-103ec0152cee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043829 May 28 04:54:07.933829 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2557/4982] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:54:07.943816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-72817cbc-f1e6-4039-921d-727bd7c94729 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:07.943816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-72817cbc-f1e6-4039-921d-727bd7c94729 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:07.952988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72817cbc-f1e6-4039-921d-727bd7c94729 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:07.953544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72817cbc-f1e6-4039-921d-727bd7c94729 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:07.954421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72817cbc-f1e6-4039-921d-727bd7c94729 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:07.954933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72817cbc-f1e6-4039-921d-727bd7c94729 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:08.368834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-72817cbc-f1e6-4039-921d-727bd7c94729 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:08.382889 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-72817cbc-f1e6-4039-921d-727bd7c94729 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.444898 May 28 04:54:08.384738 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2558/4983] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:07 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:08.399532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3f053cba-6afe-47c0-9685-41b18a205fa9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:08.400527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3f053cba-6afe-47c0-9685-41b18a205fa9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:08.409921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f053cba-6afe-47c0-9685-41b18a205fa9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:08.410592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f053cba-6afe-47c0-9685-41b18a205fa9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:08.411747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f053cba-6afe-47c0-9685-41b18a205fa9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:08.412200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f053cba-6afe-47c0-9685-41b18a205fa9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:08.624093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3f053cba-6afe-47c0-9685-41b18a205fa9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:08.645482 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3f053cba-6afe-47c0-9685-41b18a205fa9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1506 microversion: 2.1 time: 0.258911 May 28 04:54:08.646211 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2559/4984] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:08 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:08.654822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8adeeacf-295c-4f82-afa4-935eb62446f8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:08.658761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8adeeacf-295c-4f82-afa4-935eb62446f8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: af7d6d7c-8231-4fa2-9987-5bc7a7321c7f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:08.663599 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-8adeeacf-295c-4f82-afa4-935eb62446f8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance af7d6d7c-8231-4fa2-9987-5bc7a7321c7f could not be found. May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8adeeacf-295c-4f82-afa4-935eb62446f8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/af7d6d7c-8231-4fa2-9987-5bc7a7321c7f/action HTTP/1.1 May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 28 May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: {"reboot": {"type": "SOFT"}} May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance af7d6d7c-8231-4fa2-9987-5bc7a7321c7f could not be found. May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'af7d6d7c-8231-4fa2-9987-5bc7a7321c7f', 'body': {'reboot': {'type': 'SOFT'}}} May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7d6d7c-8231-4fa2-9987-5bc7a7321c7f could not be found. May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7d6d7c-8231-4fa2-9987-5bc7a7321c7f could not be found. May 28 04:54:08.666182 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:08.670946 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:08.670946 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:08.670946 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:08.670946 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:08.670946 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:08.670946 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:54:08.670946 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:54:08.670946 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7d6d7c-8231-4fa2-9987-5bc7a7321c7f could not be found. May 28 04:54:08.670946 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:08.673885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8adeeacf-295c-4f82-afa4-935eb62446f8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance af7d6d7c-8231-4fa2-9987-5bc7a7321c7f could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:54:08.675643 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8adeeacf-295c-4f82-afa4-935eb62446f8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/af7d6d7c-8231-4fa2-9987-5bc7a7321c7f/action" status: 404 len: 111 microversion: 2.1 time: 0.028010 May 28 04:54:08.676749 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2560/4985] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:08 2022] POST /compute/v2.1/servers/af7d6d7c-8231-4fa2-9987-5bc7a7321c7f/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:54:08.687127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eeb66af5-2fdc-40d4-a6b4-0cda326d389b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:08.688828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-eeb66af5-2fdc-40d4-a6b4-0cda326d389b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:08.700533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eeb66af5-2fdc-40d4-a6b4-0cda326d389b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:08.700533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eeb66af5-2fdc-40d4-a6b4-0cda326d389b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:08.702026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eeb66af5-2fdc-40d4-a6b4-0cda326d389b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:08.703352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eeb66af5-2fdc-40d4-a6b4-0cda326d389b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:08.872218 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dfaa6042-4843-40df-9c32-a04a628acd50 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.859482 May 28 04:54:08.873429 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2426/4986] 10.222.0.58 () {60 vars in 1169 bytes} [Sat May 28 04:54:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:54:08.878304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ac91cebc-b8bf-42c7-bf71-0979b50c613e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:08.879440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ac91cebc-b8bf-42c7-bf71-0979b50c613e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:08.896161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ac91cebc-b8bf-42c7-bf71-0979b50c613e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:08.897250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ac91cebc-b8bf-42c7-bf71-0979b50c613e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:08.900484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ac91cebc-b8bf-42c7-bf71-0979b50c613e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:08.901131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ac91cebc-b8bf-42c7-bf71-0979b50c613e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:08.952822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-eeb66af5-2fdc-40d4-a6b4-0cda326d389b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:08.960075 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-eeb66af5-2fdc-40d4-a6b4-0cda326d389b tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1505 microversion: 2.1 time: 0.282029 May 28 04:54:08.960650 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2561/4987] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:08 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:08.974551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-527c2804-1d92-4cb6-b527-51dab281e1b7 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.224"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:08.978641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-527c2804-1d92-4cb6-b527-51dab281e1b7 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:08.984167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-527c2804-1d92-4cb6-b527-51dab281e1b7 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:08.984628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-527c2804-1d92-4cb6-b527-51dab281e1b7 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:08.985466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-527c2804-1d92-4cb6-b527-51dab281e1b7 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:08.985914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-527c2804-1d92-4cb6-b527-51dab281e1b7 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:09.014567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-527c2804-1d92-4cb6-b527-51dab281e1b7 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Acquired lock "refresh_cache-0d9bcfd7-7d49-4c32-ae2c-748617114b96" {{(pid=126044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 04:54:09.286270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ac91cebc-b8bf-42c7-bf71-0979b50c613e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:09.298260 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ac91cebc-b8bf-42c7-bf71-0979b50c613e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.423555 May 28 04:54:09.300260 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2427/4988] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:08 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:09.331153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-15ee28ff-6bd5-4aca-a12f-cc4ea56b9bec tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:09.336352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-15ee28ff-6bd5-4aca-a12f-cc4ea56b9bec tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:09.350420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15ee28ff-6bd5-4aca-a12f-cc4ea56b9bec tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:09.351622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15ee28ff-6bd5-4aca-a12f-cc4ea56b9bec tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:09.352759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15ee28ff-6bd5-4aca-a12f-cc4ea56b9bec tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:09.353354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15ee28ff-6bd5-4aca-a12f-cc4ea56b9bec tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:09.360862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:54:09.661625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-15ee28ff-6bd5-4aca-a12f-cc4ea56b9bec tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:09.673698 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-15ee28ff-6bd5-4aca-a12f-cc4ea56b9bec tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.360023 May 28 04:54:09.674395 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2428/4989] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:09 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:10.136074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d345dea1-6ded-4754-a7b3-66d6a026e49f tempest-PortsAdminExtendedAttrsIpV6TestJSON-883251302 tempest-PortsAdminExtendedAttrsIpV6TestJSON-883251302-project-admin] Calling method '.version_select at 0x7f7701a39af0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:10.137145 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:54:10.137145 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:54:10.139286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d345dea1-6ded-4754-a7b3-66d6a026e49f tempest-PortsAdminExtendedAttrsIpV6TestJSON-883251302 tempest-PortsAdminExtendedAttrsIpV6TestJSON-883251302-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:10.142176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d345dea1-6ded-4754-a7b3-66d6a026e49f tempest-PortsAdminExtendedAttrsIpV6TestJSON-883251302 tempest-PortsAdminExtendedAttrsIpV6TestJSON-883251302-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:10.162425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d345dea1-6ded-4754-a7b3-66d6a026e49f tempest-PortsAdminExtendedAttrsIpV6TestJSON-883251302 tempest-PortsAdminExtendedAttrsIpV6TestJSON-883251302-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:10.163321 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d345dea1-6ded-4754-a7b3-66d6a026e49f tempest-PortsAdminExtendedAttrsIpV6TestJSON-883251302 tempest-PortsAdminExtendedAttrsIpV6TestJSON-883251302-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:10.177506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d345dea1-6ded-4754-a7b3-66d6a026e49f tempest-PortsAdminExtendedAttrsIpV6TestJSON-883251302 tempest-PortsAdminExtendedAttrsIpV6TestJSON-883251302-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:10.178592 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d345dea1-6ded-4754-a7b3-66d6a026e49f tempest-PortsAdminExtendedAttrsIpV6TestJSON-883251302 tempest-PortsAdminExtendedAttrsIpV6TestJSON-883251302-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:10.189605 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d345dea1-6ded-4754-a7b3-66d6a026e49f tempest-PortsAdminExtendedAttrsIpV6TestJSON-883251302 tempest-PortsAdminExtendedAttrsIpV6TestJSON-883251302-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.513543 May 28 04:54:10.190562 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2429/4990] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:54:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:54:10.198703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dae7d07c-9c9c-4266-a800-878882330228 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:10.203461 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dae7d07c-9c9c-4266-a800-878882330228 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:10.220480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dae7d07c-9c9c-4266-a800-878882330228 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:10.221240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dae7d07c-9c9c-4266-a800-878882330228 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:10.224423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dae7d07c-9c9c-4266-a800-878882330228 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:10.225961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dae7d07c-9c9c-4266-a800-878882330228 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:10.693042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dae7d07c-9c9c-4266-a800-878882330228 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:10.706339 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dae7d07c-9c9c-4266-a800-878882330228 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 200 len: 1449 microversion: 2.1 time: 0.513787 May 28 04:54:10.707865 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2430/4991] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:10 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 1449 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:10.716866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8aaa0fea-b8cd-498f-a60e-4af0fc9a76b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "012b12af-263c-4753-8fad-4a4022b439aa"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:10.719796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8aaa0fea-b8cd-498f-a60e-4af0fc9a76b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:10.728437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8aaa0fea-b8cd-498f-a60e-4af0fc9a76b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:10.729668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8aaa0fea-b8cd-498f-a60e-4af0fc9a76b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:10.730755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8aaa0fea-b8cd-498f-a60e-4af0fc9a76b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:10.732045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8aaa0fea-b8cd-498f-a60e-4af0fc9a76b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:10.757653 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-8aaa0fea-b8cd-498f-a60e-4af0fc9a76b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8aaa0fea-b8cd-498f-a60e-4af0fc9a76b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90/action HTTP/1.1 May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 65 May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: {"rebuild": {"imageRef": "012b12af-263c-4753-8fad-4a4022b439aa"}} May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90', 'body': {'rebuild': {'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa'}}} May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 28 04:54:10.760735 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild May 28 04:54:10.764210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 28 04:54:10.764210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:54:10.764210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:54:10.764210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:54:10.764210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:54:10.764210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:54:10.764210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:10.764210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:10.764210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:10.764210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:10.764210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:10.764210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:10.764210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:54:10.764210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:54:10.764210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:54:10.764210 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:10.766367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8aaa0fea-b8cd-498f-a60e-4af0fc9a76b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:54:10.767448 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8aaa0fea-b8cd-498f-a60e-4af0fc9a76b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90/action" status: 404 len: 111 microversion: 2.1 time: 0.058408 May 28 04:54:10.768499 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2431/4992] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:10 2022] POST /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:54:10.773762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4c9575cd-d187-4758-a861-95427c024270 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:10.774594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4c9575cd-d187-4758-a861-95427c024270 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:10.784534 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c9575cd-d187-4758-a861-95427c024270 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:10.785220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c9575cd-d187-4758-a861-95427c024270 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:10.786681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c9575cd-d187-4758-a861-95427c024270 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:10.787309 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c9575cd-d187-4758-a861-95427c024270 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:10.824864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c9575cd-d187-4758-a861-95427c024270 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:10.825826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c9575cd-d187-4758-a861-95427c024270 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:10.826378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-4c9575cd-d187-4758-a861-95427c024270 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lazy-loading 'fault' on Instance uuid 63b00ce5-f08a-474b-bd22-a04e0e5dedad {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:54:10.942596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4c9575cd-d187-4758-a861-95427c024270 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:10.952910 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4c9575cd-d187-4758-a861-95427c024270 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 200 len: 1303 microversion: 2.1 time: 0.183199 May 28 04:54:10.956626 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2432/4993] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:10 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 1303 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:10.969217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-ba546f8a-13c0-4331-bcb5-10449db731b3 req-454a6717-8914-4a7e-a143-9b0a9c91226d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63b00ce5-f08a-474b-bd22-a04e0e5dedad", "name": "network-vif-deleted", "tag": "d8e5e0e0-fb93-4165-9f46-d044a2d75318"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:10.987552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ba546f8a-13c0-4331-bcb5-10449db731b3 req-454a6717-8914-4a7e-a143-9b0a9c91226d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:10.988945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ba546f8a-13c0-4331-bcb5-10449db731b3 req-454a6717-8914-4a7e-a143-9b0a9c91226d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:11.012944 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-ba546f8a-13c0-4331-bcb5-10449db731b3 req-454a6717-8914-4a7e-a143-9b0a9c91226d service nova] Creating event network-vif-deleted:d8e5e0e0-fb93-4165-9f46-d044a2d75318 for instance 63b00ce5-f08a-474b-bd22-a04e0e5dedad on n-h2-843700-1 May 28 04:54:11.021020 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-ba546f8a-13c0-4331-bcb5-10449db731b3 req-454a6717-8914-4a7e-a143-9b0a9c91226d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063158 May 28 04:54:11.025562 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2433/4994] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:54:11.031654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-25d6cd05-6436-4692-9019-aaac5c1622d8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:11.032659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-25d6cd05-6436-4692-9019-aaac5c1622d8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:11.044433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25d6cd05-6436-4692-9019-aaac5c1622d8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:11.045139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25d6cd05-6436-4692-9019-aaac5c1622d8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:11.046131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25d6cd05-6436-4692-9019-aaac5c1622d8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:11.046765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25d6cd05-6436-4692-9019-aaac5c1622d8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:11.080253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-25d6cd05-6436-4692-9019-aaac5c1622d8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:54:11.087858 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.compute.api [None req-25d6cd05-6436-4692-9019-aaac5c1622d8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Working on deleting snapshot b138fc21-1f5c-4902-8456-248af17303d2 from shelved instance... May 28 04:54:11.670936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-527c2804-1d92-4cb6-b527-51dab281e1b7 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Building network info cache for instance {{(pid=126044) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 28 04:54:12.511542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-527c2804-1d92-4cb6-b527-51dab281e1b7 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Updating instance_info_cache with network_info: [{"id": "cb04aa76-1a04-4fb5-a21c-24d0b903b510", "address": "fa:16:3e:df:80:fb", "network": {"id": "8ff9610a-46de-41e5-86ae-47efda2d2743", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-666773050-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b48bceb63c3f41f0a1e5051e83ac1391", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapcb04aa76-1a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126044) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 04:54:12.594205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-527c2804-1d92-4cb6-b527-51dab281e1b7 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Releasing lock "refresh_cache-0d9bcfd7-7d49-4c32-ae2c-748617114b96" {{(pid=126044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 04:54:12.595199 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-527c2804-1d92-4cb6-b527-51dab281e1b7 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "POST /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96/action" status: 202 len: 0 microversion: 2.1 time: 3.624636 May 28 04:54:12.595887 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2562/4995] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:08 2022] POST /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96/action => generated 0 bytes in 3635 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 28 04:54:12.606706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b852810b-c251-4098-938c-01bb4891e734 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:12.606706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b852810b-c251-4098-938c-01bb4891e734 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:12.618277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b852810b-c251-4098-938c-01bb4891e734 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:12.618746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b852810b-c251-4098-938c-01bb4891e734 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:12.619569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b852810b-c251-4098-938c-01bb4891e734 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:12.620019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b852810b-c251-4098-938c-01bb4891e734 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:12.842087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-25d6cd05-6436-4692-9019-aaac5c1622d8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Doing local delete in cell 8c12a9b9-d304-4763-b71f-4058d5ce2ded(cell1) {{(pid=126043) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 28 04:54:12.843832 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25d6cd05-6436-4692-9019-aaac5c1622d8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:12.844448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25d6cd05-6436-4692-9019-aaac5c1622d8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:12.844893 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.compute.api [None req-25d6cd05-6436-4692-9019-aaac5c1622d8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 28 04:54:12.853508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-25d6cd05-6436-4692-9019-aaac5c1622d8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] deallocate_for_instance() {{(pid=126043) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} May 28 04:54:12.976006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b852810b-c251-4098-938c-01bb4891e734 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:12.985285 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b852810b-c251-4098-938c-01bb4891e734 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.384742 May 28 04:54:12.985999 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2563/4996] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:12 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:12.992431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-09065c3a-3799-46f8-9a46-3e7e9d2ef4d6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:12.993898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-09065c3a-3799-46f8-9a46-3e7e9d2ef4d6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:13.003331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09065c3a-3799-46f8-9a46-3e7e9d2ef4d6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:13.004124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09065c3a-3799-46f8-9a46-3e7e9d2ef4d6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:13.005139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09065c3a-3799-46f8-9a46-3e7e9d2ef4d6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:13.005764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09065c3a-3799-46f8-9a46-3e7e9d2ef4d6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:13.295268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-09065c3a-3799-46f8-9a46-3e7e9d2ef4d6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:13.306861 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-09065c3a-3799-46f8-9a46-3e7e9d2ef4d6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1564 microversion: 2.1 time: 0.319145 May 28 04:54:13.309759 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2564/4997] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:12 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1564 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:13.332914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-68699176-cdfd-4a55-94fa-d9b5f1000eda req-722c82b3-5d8b-4f56-84f7-990b7566c001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d9bcfd7-7d49-4c32-ae2c-748617114b96", "tag": "cb04aa76-1a04-4fb5-a21c-24d0b903b510"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:13.344602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-68699176-cdfd-4a55-94fa-d9b5f1000eda req-722c82b3-5d8b-4f56-84f7-990b7566c001 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:13.345394 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-68699176-cdfd-4a55-94fa-d9b5f1000eda req-722c82b3-5d8b-4f56-84f7-990b7566c001 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:13.365483 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-68699176-cdfd-4a55-94fa-d9b5f1000eda req-722c82b3-5d8b-4f56-84f7-990b7566c001 service nova] Creating event network-changed:cb04aa76-1a04-4fb5-a21c-24d0b903b510 for instance 0d9bcfd7-7d49-4c32-ae2c-748617114b96 on n-h1-843700-1 May 28 04:54:13.380328 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-68699176-cdfd-4a55-94fa-d9b5f1000eda req-722c82b3-5d8b-4f56-84f7-990b7566c001 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067747 May 28 04:54:13.381380 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2565/4998] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:54:13.393299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ca1ea1d0-c6e2-4019-bb0e-8e0e31c010ec tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:13.397432 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ca1ea1d0-c6e2-4019-bb0e-8e0e31c010ec tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: 63b00ce5-f08a-474b-bd22-a04e0e5dedad] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:13.408901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca1ea1d0-c6e2-4019-bb0e-8e0e31c010ec tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:13.414658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca1ea1d0-c6e2-4019-bb0e-8e0e31c010ec tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:13.415848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca1ea1d0-c6e2-4019-bb0e-8e0e31c010ec tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:13.416454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca1ea1d0-c6e2-4019-bb0e-8e0e31c010ec tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:13.442742 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-ca1ea1d0-c6e2-4019-bb0e-8e0e31c010ec tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] HTTP exception thrown: Instance 63b00ce5-f08a-474b-bd22-a04e0e5dedad could not be found. May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ca1ea1d0-c6e2-4019-bb0e-8e0e31c010ec tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Request method failure captured: May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad HTTP/1.1 May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikap11ytZQFFJYi2RxqmBHZzsGYLZJIkPzYBV6UHr1tNoTYA0GJAD_1ooQ6Rm5B2unuhzxgUi5STO8FJMByQ8sbEOuOe94LaVdRjMnk3fqCv4izHZAslopGsV5r0n3Fosam6KgazoB8phoG7XhK3YDkgo-uV4_cHh8CrJtHw2Jw0lA1c May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: c1de840d90bc4c97ac64a7b214f397c9 May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerRescueTestJSON-1729560723 May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c1de840d90bc4c97ac64a7b214f397c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c1de840d90bc4c97ac64a7b214f397c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c1de840d90bc4c97ac64a7b214f397c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c1de840d90bc4c97ac64a7b214f397c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerRescueTestJSON-1729560723 May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: c1de840d90bc4c97ac64a7b214f397c9 May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerRescueTestJSON-1729560723 May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerRescueTestJSON-1729560723-project May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 18d148985c3544219da8b641f63346b0 May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerRescueTestJSON-1729560723-project May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 63b00ce5-f08a-474b-bd22-a04e0e5dedad could not be found. May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '63b00ce5-f08a-474b-bd22-a04e0e5dedad'} May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63b00ce5-f08a-474b-bd22-a04e0e5dedad could not be found. May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63b00ce5-f08a-474b-bd22-a04e0e5dedad could not be found. May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:13.445366 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:13.450603 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:13.450603 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:13.450603 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:13.450603 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:54:13.450603 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:54:13.450603 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63b00ce5-f08a-474b-bd22-a04e0e5dedad could not be found. May 28 04:54:13.450603 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:13.454274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ca1ea1d0-c6e2-4019-bb0e-8e0e31c010ec tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Returning 404 to user: Instance 63b00ce5-f08a-474b-bd22-a04e0e5dedad could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:54:13.455778 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ca1ea1d0-c6e2-4019-bb0e-8e0e31c010ec tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad" status: 404 len: 111 microversion: 2.1 time: 0.072706 May 28 04:54:13.460663 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2566/4999] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:13 2022] GET /compute/v2.1/servers/63b00ce5-f08a-474b-bd22-a04e0e5dedad => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:54:13.468565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8de22099-1d56-43e6-81af-5a7ee13dc067 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.224"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:13.830481 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8de22099-1d56-43e6-81af-5a7ee13dc067 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:13.845211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8de22099-1d56-43e6-81af-5a7ee13dc067 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:13.845682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8de22099-1d56-43e6-81af-5a7ee13dc067 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:13.847517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8de22099-1d56-43e6-81af-5a7ee13dc067 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:13.847996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8de22099-1d56-43e6-81af-5a7ee13dc067 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:13.988337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-25d6cd05-6436-4692-9019-aaac5c1622d8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Updating instance_info_cache with network_info: [] {{(pid=126043) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 04:54:14.692266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8de22099-1d56-43e6-81af-5a7ee13dc067 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Acquired lock "refresh_cache-0d9bcfd7-7d49-4c32-ae2c-748617114b96" {{(pid=126044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 04:54:15.036232 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-25d6cd05-6436-4692-9019-aaac5c1622d8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 204 len: 0 microversion: 2.1 time: 4.008998 May 28 04:54:15.036827 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2434/5000] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:54:11 2022] DELETE /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 0 bytes in 4011 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:54:15.042702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5521e925-fe13-4dc2-91f6-0762f42b14c1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:15.043835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5521e925-fe13-4dc2-91f6-0762f42b14c1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:15.050467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5521e925-fe13-4dc2-91f6-0762f42b14c1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:15.052317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5521e925-fe13-4dc2-91f6-0762f42b14c1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:15.053268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5521e925-fe13-4dc2-91f6-0762f42b14c1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:15.053887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5521e925-fe13-4dc2-91f6-0762f42b14c1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:15.366601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5521e925-fe13-4dc2-91f6-0762f42b14c1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:15.375846 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5521e925-fe13-4dc2-91f6-0762f42b14c1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.337016 May 28 04:54:15.376516 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2435/5001] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:15 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:15.381336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-2f390426-9672-48b1-ab5f-87352a19678b req-57e47afa-80f9-4d56-b0b8-be5eab2d5bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "260294eb-db79-4280-a534-928afd9312d0", "tag": "3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:15.389378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2f390426-9672-48b1-ab5f-87352a19678b req-57e47afa-80f9-4d56-b0b8-be5eab2d5bf3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:15.390058 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2f390426-9672-48b1-ab5f-87352a19678b req-57e47afa-80f9-4d56-b0b8-be5eab2d5bf3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:15.404058 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-2f390426-9672-48b1-ab5f-87352a19678b req-57e47afa-80f9-4d56-b0b8-be5eab2d5bf3 service nova] Creating event network-changed:3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0 for instance 260294eb-db79-4280-a534-928afd9312d0 on n-h2-843700-1 May 28 04:54:15.409618 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-2f390426-9672-48b1-ab5f-87352a19678b req-57e47afa-80f9-4d56-b0b8-be5eab2d5bf3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031740 May 28 04:54:15.410694 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2436/5002] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:54:15.417571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8ec400ec-da15-4e68-a568-a77236f2fed6 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:15.417571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8ec400ec-da15-4e68-a568-a77236f2fed6 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:15.424497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ec400ec-da15-4e68-a568-a77236f2fed6 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:15.425140 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ec400ec-da15-4e68-a568-a77236f2fed6 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:15.426318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ec400ec-da15-4e68-a568-a77236f2fed6 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:15.426939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ec400ec-da15-4e68-a568-a77236f2fed6 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:15.459391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8ec400ec-da15-4e68-a568-a77236f2fed6 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:54:15.855369 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8ec400ec-da15-4e68-a568-a77236f2fed6 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 204 len: 0 microversion: 2.1 time: 0.439758 May 28 04:54:15.856414 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2437/5003] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:54:15 2022] DELETE /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:54:15.862037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-45f381d4-a62e-4a76-a461-652a5a2a5cec tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:15.863016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-45f381d4-a62e-4a76-a461-652a5a2a5cec tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:15.873256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45f381d4-a62e-4a76-a461-652a5a2a5cec tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:15.873957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45f381d4-a62e-4a76-a461-652a5a2a5cec tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:15.874944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45f381d4-a62e-4a76-a461-652a5a2a5cec tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:15.876228 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45f381d4-a62e-4a76-a461-652a5a2a5cec tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:15.897620 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-45f381d4-a62e-4a76-a461-652a5a2a5cec tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance 3087299d-554e-4c36-8eb4-3082257b7e65 could not be found. May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-45f381d4-a62e-4a76-a461-652a5a2a5cec tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 HTTP/1.1 May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 3087299d-554e-4c36-8eb4-3082257b7e65 could not be found. May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '3087299d-554e-4c36-8eb4-3082257b7e65'} May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3087299d-554e-4c36-8eb4-3082257b7e65 could not be found. May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3087299d-554e-4c36-8eb4-3082257b7e65 could not be found. May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:15.899509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:15.904261 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:15.904261 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:15.904261 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:15.904261 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:54:15.904261 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:54:15.904261 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3087299d-554e-4c36-8eb4-3082257b7e65 could not be found. May 28 04:54:15.904261 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:15.905345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-45f381d4-a62e-4a76-a461-652a5a2a5cec tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance 3087299d-554e-4c36-8eb4-3082257b7e65 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:54:15.906260 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-45f381d4-a62e-4a76-a461-652a5a2a5cec tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 404 len: 111 microversion: 2.1 time: 0.048553 May 28 04:54:15.906776 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2438/5004] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:15 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:54:15.911406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8be24612-af9c-4806-99f0-f3c26c87b9c7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "012b12af-263c-4753-8fad-4a4022b439aa"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:15.912854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8be24612-af9c-4806-99f0-f3c26c87b9c7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: bbd6a443-eaa4-4793-8e9c-90cf0c5520e7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:15.923487 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-8be24612-af9c-4806-99f0-f3c26c87b9c7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance bbd6a443-eaa4-4793-8e9c-90cf0c5520e7 could not be found. May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8be24612-af9c-4806-99f0-f3c26c87b9c7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/bbd6a443-eaa4-4793-8e9c-90cf0c5520e7/action HTTP/1.1 May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 65 May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: {"rebuild": {"imageRef": "012b12af-263c-4753-8fad-4a4022b439aa"}} May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance bbd6a443-eaa4-4793-8e9c-90cf0c5520e7 could not be found. May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'bbd6a443-eaa4-4793-8e9c-90cf0c5520e7', 'body': {'rebuild': {'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa'}}} May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbd6a443-eaa4-4793-8e9c-90cf0c5520e7 could not be found. May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 28 04:54:15.925505 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:54:15.929099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:54:15.929099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:54:15.929099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:54:15.929099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbd6a443-eaa4-4793-8e9c-90cf0c5520e7 could not be found. May 28 04:54:15.929099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:15.929099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:15.929099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:15.929099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:15.929099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:15.929099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:15.929099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:54:15.929099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:54:15.929099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbd6a443-eaa4-4793-8e9c-90cf0c5520e7 could not be found. May 28 04:54:15.929099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:15.930884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8be24612-af9c-4806-99f0-f3c26c87b9c7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance bbd6a443-eaa4-4793-8e9c-90cf0c5520e7 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:54:15.932396 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8be24612-af9c-4806-99f0-f3c26c87b9c7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/bbd6a443-eaa4-4793-8e9c-90cf0c5520e7/action" status: 404 len: 111 microversion: 2.1 time: 0.024250 May 28 04:54:15.933392 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2439/5005] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:15 2022] POST /compute/v2.1/servers/bbd6a443-eaa4-4793-8e9c-90cf0c5520e7/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:54:15.938723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b27d9aa4-9b3d-4e6e-af90-232830ea415f req-c66d0157-44dc-45ea-8ded-686f57ca9ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3087299d-554e-4c36-8eb4-3082257b7e65", "name": "network-vif-deleted", "tag": "8a7a1ead-8e33-447e-840c-7789196d4eee"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:15.955972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b27d9aa4-9b3d-4e6e-af90-232830ea415f req-c66d0157-44dc-45ea-8ded-686f57ca9ca8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:15.955972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b27d9aa4-9b3d-4e6e-af90-232830ea415f req-c66d0157-44dc-45ea-8ded-686f57ca9ca8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:15.955972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:54:15.965781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.compute.server_external_events [req-b27d9aa4-9b3d-4e6e-af90-232830ea415f req-c66d0157-44dc-45ea-8ded-686f57ca9ca8 service nova] Unable to find a host for instance 3087299d-554e-4c36-8eb4-3082257b7e65. Dropping event network-vif-deleted {{(pid=126043) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 28 04:54:15.966827 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b27d9aa4-9b3d-4e6e-af90-232830ea415f req-c66d0157-44dc-45ea-8ded-686f57ca9ca8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.032127 May 28 04:54:15.967977 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2440/5006] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 28 04:54:15.972824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f87b6ee0-3565-4c12-aea4-9e8fa32e425d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:15.973703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f87b6ee0-3565-4c12-aea4-9e8fa32e425d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:15.984675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f87b6ee0-3565-4c12-aea4-9e8fa32e425d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:15.984675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f87b6ee0-3565-4c12-aea4-9e8fa32e425d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:15.984675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f87b6ee0-3565-4c12-aea4-9e8fa32e425d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:15.984675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f87b6ee0-3565-4c12-aea4-9e8fa32e425d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:16.053102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-8de22099-1d56-43e6-81af-5a7ee13dc067 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Building network info cache for instance {{(pid=126044) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 28 04:54:16.400503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f87b6ee0-3565-4c12-aea4-9e8fa32e425d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:16.428473 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f87b6ee0-3565-4c12-aea4-9e8fa32e425d tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1490 microversion: 2.1 time: 0.457993 May 28 04:54:16.429258 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2441/5007] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:15 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1490 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:16.437111 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d18a9edd-493c-4dc6-be35-c8c6e899e2d7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:16.438019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d18a9edd-493c-4dc6-be35-c8c6e899e2d7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:16.461270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d18a9edd-493c-4dc6-be35-c8c6e899e2d7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:16.461831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d18a9edd-493c-4dc6-be35-c8c6e899e2d7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:16.464864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d18a9edd-493c-4dc6-be35-c8c6e899e2d7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:16.475608 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d18a9edd-493c-4dc6-be35-c8c6e899e2d7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:16.762412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d18a9edd-493c-4dc6-be35-c8c6e899e2d7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:16.772747 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d18a9edd-493c-4dc6-be35-c8c6e899e2d7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.341081 May 28 04:54:16.774260 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2442/5008] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:16 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:16.792947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ecbae441-4f95-412b-b6bd-90f31ae53e03 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1743470868", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "807b877d-73e2-4031-b4ab-972d86c6cc59"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:16.871400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-ecbae441-4f95-412b-b6bd-90f31ae53e03 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] validate_networks() for [('807b877d-73e2-4031-b4ab-972d86c6cc59', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:54:17.039922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-8de22099-1d56-43e6-81af-5a7ee13dc067 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Updating instance_info_cache with network_info: [{"id": "cb04aa76-1a04-4fb5-a21c-24d0b903b510", "address": "fa:16:3e:df:80:fb", "network": {"id": "8ff9610a-46de-41e5-86ae-47efda2d2743", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-666773050-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b48bceb63c3f41f0a1e5051e83ac1391", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapcb04aa76-1a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126044) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 04:54:17.149481 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8de22099-1d56-43e6-81af-5a7ee13dc067 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Releasing lock "refresh_cache-0d9bcfd7-7d49-4c32-ae2c-748617114b96" {{(pid=126044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 04:54:17.150367 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8de22099-1d56-43e6-81af-5a7ee13dc067 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "POST /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96/action" status: 202 len: 0 microversion: 2.1 time: 3.687559 May 28 04:54:17.151192 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2567/5009] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:13 2022] POST /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96/action => generated 0 bytes in 3690 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 28 04:54:17.161618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-832d4251-2767-4726-ac6d-d584b35a3a07 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:17.162246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-832d4251-2767-4726-ac6d-d584b35a3a07 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:17.178137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-832d4251-2767-4726-ac6d-d584b35a3a07 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:17.178606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-832d4251-2767-4726-ac6d-d584b35a3a07 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:17.179593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-832d4251-2767-4726-ac6d-d584b35a3a07 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:17.180188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-832d4251-2767-4726-ac6d-d584b35a3a07 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:17.454474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-832d4251-2767-4726-ac6d-d584b35a3a07 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:17.462408 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-832d4251-2767-4726-ac6d-d584b35a3a07 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.307145 May 28 04:54:17.464084 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2568/5010] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:17 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:17.469905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-85ebc164-28d9-4407-94ab-49726278beb5 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '.version_select at 0x7f7700c1f430>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:17.676434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-ecbae441-4f95-412b-b6bd-90f31ae53e03 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:54:17.676895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-ecbae441-4f95-412b-b6bd-90f31ae53e03 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:54:17.677335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-ecbae441-4f95-412b-b6bd-90f31ae53e03 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:54:17.677809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-ecbae441-4f95-412b-b6bd-90f31ae53e03 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:54:17.678235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-ecbae441-4f95-412b-b6bd-90f31ae53e03 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:54:17.688351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecbae441-4f95-412b-b6bd-90f31ae53e03 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:17.692920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecbae441-4f95-412b-b6bd-90f31ae53e03 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:17.692920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecbae441-4f95-412b-b6bd-90f31ae53e03 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:17.692920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecbae441-4f95-412b-b6bd-90f31ae53e03 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:17.708442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-ecbae441-4f95-412b-b6bd-90f31ae53e03 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Getting quotas for project dd598ce55f9b43d38530dae05fa1bda1. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:54:17.720053 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-ecbae441-4f95-412b-b6bd-90f31ae53e03 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Getting quotas for user b05e9b7e95074a91bc984338593c6c84 and project dd598ce55f9b43d38530dae05fa1bda1. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:54:17.743255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ecbae441-4f95-412b-b6bd-90f31ae53e03 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:54:17.745619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ecbae441-4f95-412b-b6bd-90f31ae53e03 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:54:17.889095 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ecbae441-4f95-412b-b6bd-90f31ae53e03 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.113476 May 28 04:54:17.890055 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2443/5011] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:54:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:54:17.899912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-98a1089b-910f-4b62-b0ee-205d3eace16f tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:17.900797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-98a1089b-910f-4b62-b0ee-205d3eace16f tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:17.925628 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98a1089b-910f-4b62-b0ee-205d3eace16f tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:17.932336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98a1089b-910f-4b62-b0ee-205d3eace16f tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:17.933182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98a1089b-910f-4b62-b0ee-205d3eace16f tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:17.933914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98a1089b-910f-4b62-b0ee-205d3eace16f tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:18.765359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-98a1089b-910f-4b62-b0ee-205d3eace16f tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:18.779440 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-98a1089b-910f-4b62-b0ee-205d3eace16f tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1490 microversion: 2.1 time: 0.883261 May 28 04:54:18.788793 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2444/5012] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:17 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1490 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:18.794435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bb446bf0-8d57-439e-9a75-0685a1415bac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:18.800128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bb446bf0-8d57-439e-9a75-0685a1415bac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 2d93b2db-8bf8-436a-84ff-6083448c0da4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:18.807054 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-bb446bf0-8d57-439e-9a75-0685a1415bac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance 2d93b2db-8bf8-436a-84ff-6083448c0da4 could not be found. May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bb446bf0-8d57-439e-9a75-0685a1415bac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/2d93b2db-8bf8-436a-84ff-6083448c0da4/action HTTP/1.1 May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 15 May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: {"restore": {}} May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 2d93b2db-8bf8-436a-84ff-6083448c0da4 could not be found. May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '2d93b2db-8bf8-436a-84ff-6083448c0da4', 'body': {'restore': {}}} May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d93b2db-8bf8-436a-84ff-6083448c0da4 could not be found. May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d93b2db-8bf8-436a-84ff-6083448c0da4 could not be found. May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:18.810099 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:18.817738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:54:18.817738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:54:18.817738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d93b2db-8bf8-436a-84ff-6083448c0da4 could not be found. May 28 04:54:18.817738 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:18.817738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bb446bf0-8d57-439e-9a75-0685a1415bac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance 2d93b2db-8bf8-436a-84ff-6083448c0da4 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:54:18.817738 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bb446bf0-8d57-439e-9a75-0685a1415bac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/2d93b2db-8bf8-436a-84ff-6083448c0da4/action" status: 404 len: 111 microversion: 2.1 time: 0.021631 May 28 04:54:18.817738 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2445/5013] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:18 2022] POST /compute/v2.1/servers/2d93b2db-8bf8-436a-84ff-6083448c0da4/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:54:18.822179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-89af6565-58c2-45a0-898e-a71bfcde9ef8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:18.822882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-89af6565-58c2-45a0-898e-a71bfcde9ef8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:18.936195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-89af6565-58c2-45a0-898e-a71bfcde9ef8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:18.943849 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-89af6565-58c2-45a0-898e-a71bfcde9ef8 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1215 microversion: 2.1 time: 0.129894 May 28 04:54:18.944909 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2446/5014] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:18 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1215 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:18.949877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-cf7b13ce-d612-4b7b-9cbc-7a067ba5b677 req-6feca055-5a09-4bbb-a671-3ec2b24b21df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d9bcfd7-7d49-4c32-ae2c-748617114b96", "tag": "cb04aa76-1a04-4fb5-a21c-24d0b903b510"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:18.958397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-cf7b13ce-d612-4b7b-9cbc-7a067ba5b677 req-6feca055-5a09-4bbb-a671-3ec2b24b21df service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:18.958844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-cf7b13ce-d612-4b7b-9cbc-7a067ba5b677 req-6feca055-5a09-4bbb-a671-3ec2b24b21df service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:18.970435 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-cf7b13ce-d612-4b7b-9cbc-7a067ba5b677 req-6feca055-5a09-4bbb-a671-3ec2b24b21df service nova] Creating event network-changed:cb04aa76-1a04-4fb5-a21c-24d0b903b510 for instance 0d9bcfd7-7d49-4c32-ae2c-748617114b96 on n-h1-843700-1 May 28 04:54:18.975538 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-cf7b13ce-d612-4b7b-9cbc-7a067ba5b677 req-6feca055-5a09-4bbb-a671-3ec2b24b21df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029271 May 28 04:54:18.976141 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2447/5015] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:54:18.981865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-91ff58e5-f614-4918-855b-b00ffa8867b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:18.982567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-91ff58e5-f614-4918-855b-b00ffa8867b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:18.988912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91ff58e5-f614-4918-855b-b00ffa8867b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:18.989365 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91ff58e5-f614-4918-855b-b00ffa8867b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:18.990176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91ff58e5-f614-4918-855b-b00ffa8867b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:18.990617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91ff58e5-f614-4918-855b-b00ffa8867b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:19.288342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-91ff58e5-f614-4918-855b-b00ffa8867b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:19.299688 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-91ff58e5-f614-4918-855b-b00ffa8867b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.321977 May 28 04:54:19.312183 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2448/5016] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:18 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:19.319364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-e0712f52-e6fd-4249-88f7-4ffb36534a1b req-45eba216-9bc0-4ccf-88e6-df0ade685c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e49dc0-451f-4328-aeef-3d0527ed5655", "name": "network-vif-deleted", "tag": "59b7ea5c-b9ac-44ae-9dfb-762b6f39cde7"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:19.379527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-e0712f52-e6fd-4249-88f7-4ffb36534a1b req-45eba216-9bc0-4ccf-88e6-df0ade685c28 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:19.380461 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-e0712f52-e6fd-4249-88f7-4ffb36534a1b req-45eba216-9bc0-4ccf-88e6-df0ade685c28 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:19.397525 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-e0712f52-e6fd-4249-88f7-4ffb36534a1b req-45eba216-9bc0-4ccf-88e6-df0ade685c28 service nova] Creating event network-vif-deleted:59b7ea5c-b9ac-44ae-9dfb-762b6f39cde7 for instance c0e49dc0-451f-4328-aeef-3d0527ed5655 on n-h2-843700-1 May 28 04:54:19.414234 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-e0712f52-e6fd-4249-88f7-4ffb36534a1b req-45eba216-9bc0-4ccf-88e6-df0ade685c28 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103588 May 28 04:54:19.415573 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2449/5017] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:54:19.421715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-84f19666-65b9-4920-b06e-2a674c2f30bf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:19.423127 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-84f19666-65b9-4920-b06e-2a674c2f30bf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:19.433974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84f19666-65b9-4920-b06e-2a674c2f30bf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:19.434683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84f19666-65b9-4920-b06e-2a674c2f30bf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:19.435894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84f19666-65b9-4920-b06e-2a674c2f30bf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:19.436531 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84f19666-65b9-4920-b06e-2a674c2f30bf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:19.471427 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-85ebc164-28d9-4407-94ab-49726278beb5 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/a59e3e52-0aaa-47fa-a821-a9f9e2576dd6" status: 202 len: 0 microversion: 2.1 time: 2.005942 May 28 04:54:19.479126 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2569/5018] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 04:54:17 2022] DELETE /compute/v2.1/os-floating-ips/a59e3e52-0aaa-47fa-a821-a9f9e2576dd6 => generated 0 bytes in 2014 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:54:19.484629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-23f34f15-7329-4029-85b9-d7f8f819b1bf tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '.version_select at 0x7f77007b9310>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:19.784165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-84f19666-65b9-4920-b06e-2a674c2f30bf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:19.799009 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-84f19666-65b9-4920-b06e-2a674c2f30bf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.378980 May 28 04:54:19.799009 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2450/5019] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:19 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:19.806121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-73abfbf7-5845-43e0-8e4f-0e6438421ca6 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:19.806746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-73abfbf7-5845-43e0-8e4f-0e6438421ca6 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:19.832031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73abfbf7-5845-43e0-8e4f-0e6438421ca6 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:19.832031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73abfbf7-5845-43e0-8e4f-0e6438421ca6 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:19.832031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73abfbf7-5845-43e0-8e4f-0e6438421ca6 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:19.832270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73abfbf7-5845-43e0-8e4f-0e6438421ca6 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:19.889727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73abfbf7-5845-43e0-8e4f-0e6438421ca6 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:19.893109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73abfbf7-5845-43e0-8e4f-0e6438421ca6 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:19.893627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-73abfbf7-5845-43e0-8e4f-0e6438421ca6 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lazy-loading 'fault' on Instance uuid c0e49dc0-451f-4328-aeef-3d0527ed5655 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:54:19.995184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-73abfbf7-5845-43e0-8e4f-0e6438421ca6 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d148985c3544219da8b641f63346b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1de840d90bc4c97ac64a7b214f397c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:20.021722 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-73abfbf7-5845-43e0-8e4f-0e6438421ca6 tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 200 len: 1303 microversion: 2.1 time: 0.221750 May 28 04:54:20.022349 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2451/5020] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:19 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 1303 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:20.050712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3265808e-82df-4837-8c3e-49d8bb6fdbd0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:20.051338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3265808e-82df-4837-8c3e-49d8bb6fdbd0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:20.067693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3265808e-82df-4837-8c3e-49d8bb6fdbd0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:20.068346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3265808e-82df-4837-8c3e-49d8bb6fdbd0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:20.069236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3265808e-82df-4837-8c3e-49d8bb6fdbd0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:20.069769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3265808e-82df-4837-8c3e-49d8bb6fdbd0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:20.097363 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-3265808e-82df-4837-8c3e-49d8bb6fdbd0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Cannot 'restore' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state active May 28 04:54:20.097901 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-23f34f15-7329-4029-85b9-d7f8f819b1bf tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/71ecb9e5-1ada-4858-9d2f-2dee64fd17c3" status: 202 len: 0 microversion: 2.1 time: 0.618144 May 28 04:54:20.098660 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2570/5021] 10.222.0.58 () {58 vars in 1271 bytes} [Sat May 28 04:54:19 2022] DELETE /compute/v2.1/os-security-groups/71ecb9e5-1ada-4858-9d2f-2dee64fd17c3 => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3265808e-82df-4837-8c3e-49d8bb6fdbd0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action HTTP/1.1 May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 15 May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: {"restore": {}} May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: exception: Cannot 'restore' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state active May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '58022ec6-f4eb-4564-bed0-c3edd1d0daf4', 'body': {'restore': {}}} May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 in vm_state active. Cannot restore while the instance is in this state. May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state active May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:20.100284 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:20.104093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:20.104093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:54:20.104093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:54:20.104093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state active May 28 04:54:20.104093 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:20.104423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-484d0f25-85de-4d75-bca3-57edbe849e72 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:20.105180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3265808e-82df-4837-8c3e-49d8bb6fdbd0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 409 to user: Cannot 'restore' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state active {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:54:20.105305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-484d0f25-85de-4d75-bca3-57edbe849e72 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:20.107242 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3265808e-82df-4837-8c3e-49d8bb6fdbd0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action" status: 409 len: 145 microversion: 2.1 time: 0.083377 May 28 04:54:20.108953 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2452/5022] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:20 2022] POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action => generated 145 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 04:54:20.122540 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fa41b02e-e332-4291-b8e7-78a5d169ca95 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:20.122540 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fa41b02e-e332-4291-b8e7-78a5d169ca95 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:20.122738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-484d0f25-85de-4d75-bca3-57edbe849e72 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:20.122825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:54:20.122898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-484d0f25-85de-4d75-bca3-57edbe849e72 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:20.122898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-484d0f25-85de-4d75-bca3-57edbe849e72 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:20.123071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-484d0f25-85de-4d75-bca3-57edbe849e72 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:20.142908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa41b02e-e332-4291-b8e7-78a5d169ca95 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:20.147584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa41b02e-e332-4291-b8e7-78a5d169ca95 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:20.155203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa41b02e-e332-4291-b8e7-78a5d169ca95 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:20.155822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa41b02e-e332-4291-b8e7-78a5d169ca95 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:20.197590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fa41b02e-e332-4291-b8e7-78a5d169ca95 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:54:20.201109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=92,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:54:20.283211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-484d0f25-85de-4d75-bca3-57edbe849e72 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:20.292534 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-484d0f25-85de-4d75-bca3-57edbe849e72 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1267 microversion: 2.1 time: 0.192654 May 28 04:54:20.302337 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2571/5023] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:20 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:20.302337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-417eb64b-aad4-4b19-8862-7ec3d0c132a1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:20.302337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-417eb64b-aad4-4b19-8862-7ec3d0c132a1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:20.305492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-417eb64b-aad4-4b19-8862-7ec3d0c132a1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:20.306030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-417eb64b-aad4-4b19-8862-7ec3d0c132a1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:20.306884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-417eb64b-aad4-4b19-8862-7ec3d0c132a1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:20.307551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-417eb64b-aad4-4b19-8862-7ec3d0c132a1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:20.579193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-417eb64b-aad4-4b19-8862-7ec3d0c132a1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:20.589520 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-417eb64b-aad4-4b19-8862-7ec3d0c132a1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.294669 May 28 04:54:20.599155 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2572/5024] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:20 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:20.610866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-07e35d23-7d00-4072-a814-85aa63938acb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:20.615854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-07e35d23-7d00-4072-a814-85aa63938acb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:20.628949 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07e35d23-7d00-4072-a814-85aa63938acb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:20.631104 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fa41b02e-e332-4291-b8e7-78a5d169ca95 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 204 len: 0 microversion: 2.1 time: 0.519626 May 28 04:54:20.631626 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2453/5025] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:54:20 2022] DELETE /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:54:20.632981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07e35d23-7d00-4072-a814-85aa63938acb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:20.633827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07e35d23-7d00-4072-a814-85aa63938acb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:20.636228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07e35d23-7d00-4072-a814-85aa63938acb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:20.642189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2036970d-9983-4aba-b0a3-4a060b6f3b73 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:20.643213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2036970d-9983-4aba-b0a3-4a060b6f3b73 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:20.670229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2036970d-9983-4aba-b0a3-4a060b6f3b73 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:20.675033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2036970d-9983-4aba-b0a3-4a060b6f3b73 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:20.677431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2036970d-9983-4aba-b0a3-4a060b6f3b73 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:20.678586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2036970d-9983-4aba-b0a3-4a060b6f3b73 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:20.917284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-07e35d23-7d00-4072-a814-85aa63938acb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:20.928959 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-07e35d23-7d00-4072-a814-85aa63938acb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.322851 May 28 04:54:20.929830 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2573/5026] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:20 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:20.940981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2036970d-9983-4aba-b0a3-4a060b6f3b73 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:20.947386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e032e30f-482e-4554-9a69-83777849d11b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:20.948221 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e032e30f-482e-4554-9a69-83777849d11b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 7324d2f0-4df8-40bd-90c5-bb103289406a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:20.953730 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2036970d-9983-4aba-b0a3-4a060b6f3b73 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1510 microversion: 2.1 time: 0.317946 May 28 04:54:20.954622 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2454/5027] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:20 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1510 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:20.955900 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-e032e30f-482e-4554-9a69-83777849d11b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance 7324d2f0-4df8-40bd-90c5-bb103289406a could not be found. May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e032e30f-482e-4554-9a69-83777849d11b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/7324d2f0-4df8-40bd-90c5-bb103289406a/action HTTP/1.1 May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 14 May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: {"resume": {}} May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 7324d2f0-4df8-40bd-90c5-bb103289406a could not be found. May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '7324d2f0-4df8-40bd-90c5-bb103289406a', 'body': {'resume': {}}} May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7324d2f0-4df8-40bd-90c5-bb103289406a could not be found. May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7324d2f0-4df8-40bd-90c5-bb103289406a could not be found. May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:20.961817 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:20.965513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:54:20.965513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:54:20.965513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7324d2f0-4df8-40bd-90c5-bb103289406a could not be found. May 28 04:54:20.965513 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:20.967337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e032e30f-482e-4554-9a69-83777849d11b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance 7324d2f0-4df8-40bd-90c5-bb103289406a could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:54:20.968539 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e032e30f-482e-4554-9a69-83777849d11b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/7324d2f0-4df8-40bd-90c5-bb103289406a/action" status: 404 len: 111 microversion: 2.1 time: 0.025744 May 28 04:54:20.969604 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2574/5028] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:20 2022] POST /compute/v2.1/servers/7324d2f0-4df8-40bd-90c5-bb103289406a/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:54:20.985881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-966a9ce7-a6bb-4eff-a7cf-d9624a12af99 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:20.986623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-966a9ce7-a6bb-4eff-a7cf-d9624a12af99 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:20.992920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-966a9ce7-a6bb-4eff-a7cf-d9624a12af99 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:20.993789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-966a9ce7-a6bb-4eff-a7cf-d9624a12af99 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:20.994668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-966a9ce7-a6bb-4eff-a7cf-d9624a12af99 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:20.995338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-966a9ce7-a6bb-4eff-a7cf-d9624a12af99 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:21.049766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-253a4d54-c8bd-426c-ae7f-0bd541e3bc6a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:21.050450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-253a4d54-c8bd-426c-ae7f-0bd541e3bc6a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] [instance: c0e49dc0-451f-4328-aeef-3d0527ed5655] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:21.065145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-253a4d54-c8bd-426c-ae7f-0bd541e3bc6a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:21.066579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-253a4d54-c8bd-426c-ae7f-0bd541e3bc6a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:21.072744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-253a4d54-c8bd-426c-ae7f-0bd541e3bc6a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:21.073571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-253a4d54-c8bd-426c-ae7f-0bd541e3bc6a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:21.099898 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-253a4d54-c8bd-426c-ae7f-0bd541e3bc6a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] HTTP exception thrown: Instance c0e49dc0-451f-4328-aeef-3d0527ed5655 could not be found. May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-253a4d54-c8bd-426c-ae7f-0bd541e3bc6a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Request method failure captured: May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 HTTP/1.1 May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikap11ytZQFFJYi2RxqmBHZzsGYLZJIkPzYBV6UHr1tNoTYA0GJAD_1ooQ6Rm5B2unuhzxgUi5STO8FJMByQ8sbEOuOe94LaVdRjMnk3fqCv4izHZAslopGsV5r0n3Fosam6KgazoB8phoG7XhK3YDkgo-uV4_cHh8CrJtHw2Jw0lA1c May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: c1de840d90bc4c97ac64a7b214f397c9 May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerRescueTestJSON-1729560723 May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c1de840d90bc4c97ac64a7b214f397c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c1de840d90bc4c97ac64a7b214f397c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c1de840d90bc4c97ac64a7b214f397c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c1de840d90bc4c97ac64a7b214f397c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerRescueTestJSON-1729560723 May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: c1de840d90bc4c97ac64a7b214f397c9 May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerRescueTestJSON-1729560723 May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerRescueTestJSON-1729560723-project May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 18d148985c3544219da8b641f63346b0 May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerRescueTestJSON-1729560723-project May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance c0e49dc0-451f-4328-aeef-3d0527ed5655 could not be found. May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'c0e49dc0-451f-4328-aeef-3d0527ed5655'} May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0e49dc0-451f-4328-aeef-3d0527ed5655 could not be found. May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0e49dc0-451f-4328-aeef-3d0527ed5655 could not be found. May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:21.101725 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:21.106225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:21.106225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:21.106225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:21.106225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:54:21.106225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:54:21.106225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0e49dc0-451f-4328-aeef-3d0527ed5655 could not be found. May 28 04:54:21.106225 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:54:21.106225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-253a4d54-c8bd-426c-ae7f-0bd541e3bc6a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] Returning 404 to user: Instance c0e49dc0-451f-4328-aeef-3d0527ed5655 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:54:21.107679 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-253a4d54-c8bd-426c-ae7f-0bd541e3bc6a tempest-ServerRescueTestJSON-1729560723 tempest-ServerRescueTestJSON-1729560723-project] 10.222.0.58 "GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655" status: 404 len: 111 microversion: 2.1 time: 0.062841 May 28 04:54:21.108504 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2575/5029] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:21 2022] GET /compute/v2.1/servers/c0e49dc0-451f-4328-aeef-3d0527ed5655 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:54:21.268501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-966a9ce7-a6bb-4eff-a7cf-d9624a12af99 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:21.278633 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-966a9ce7-a6bb-4eff-a7cf-d9624a12af99 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.296857 May 28 04:54:21.289524 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2455/5030] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:20 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:21.301219 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-221b3330-a092-48a7-981e-f6e5de66bb39 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:21.303540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-221b3330-a092-48a7-981e-f6e5de66bb39 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:21.311149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-249c59ff-d10f-4e2d-9407-d09544b64488 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:21.311783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-249c59ff-d10f-4e2d-9407-d09544b64488 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:21.314857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-221b3330-a092-48a7-981e-f6e5de66bb39 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:21.315600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-221b3330-a092-48a7-981e-f6e5de66bb39 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:21.316611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-221b3330-a092-48a7-981e-f6e5de66bb39 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:21.318113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-221b3330-a092-48a7-981e-f6e5de66bb39 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:21.323919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-249c59ff-d10f-4e2d-9407-d09544b64488 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:21.327632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-249c59ff-d10f-4e2d-9407-d09544b64488 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:21.327632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-249c59ff-d10f-4e2d-9407-d09544b64488 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:21.327632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-249c59ff-d10f-4e2d-9407-d09544b64488 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:21.445486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-249c59ff-d10f-4e2d-9407-d09544b64488 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:21.462554 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-249c59ff-d10f-4e2d-9407-d09544b64488 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1285 microversion: 2.1 time: 0.155499 May 28 04:54:21.467145 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2456/5031] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:21 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:21.560862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-221b3330-a092-48a7-981e-f6e5de66bb39 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:21.578001 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-221b3330-a092-48a7-981e-f6e5de66bb39 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.281462 May 28 04:54:21.578592 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2576/5032] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:21 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:21.595681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e625c747-6d99-4185-ae75-8816696d0e44 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:21.596448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e625c747-6d99-4185-ae75-8816696d0e44 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:21.603374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e625c747-6d99-4185-ae75-8816696d0e44 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:21.603970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e625c747-6d99-4185-ae75-8816696d0e44 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:21.609314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e625c747-6d99-4185-ae75-8816696d0e44 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:21.609314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e625c747-6d99-4185-ae75-8816696d0e44 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-e625c747-6d99-4185-ae75-8816696d0e44 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Cannot 'resume' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state active May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e625c747-6d99-4185-ae75-8816696d0e44 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action HTTP/1.1 May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 14 May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: {"resume": {}} May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: exception: Cannot 'resume' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state active May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '58022ec6-f4eb-4564-bed0-c3edd1d0daf4', 'body': {'resume': {}}} May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 in vm_state active. Cannot resume while the instance is in this state. May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state active May 28 04:54:21.643500 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:21.647509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:21.647509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:21.647509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:21.647509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:21.647509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:21.647509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:54:21.647509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:54:21.647509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state active May 28 04:54:21.647509 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:21.647509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e625c747-6d99-4185-ae75-8816696d0e44 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 409 to user: Cannot 'resume' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state active {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:54:21.647509 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e625c747-6d99-4185-ae75-8816696d0e44 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action" status: 409 len: 144 microversion: 2.1 time: 0.050474 May 28 04:54:21.653367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2fb4def1-cee9-452d-b134-3de7a5fd0a33 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:21.653989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2fb4def1-cee9-452d-b134-3de7a5fd0a33 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:21.658281 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2457/5033] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:21 2022] POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action => generated 144 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 04:54:21.661419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2fb4def1-cee9-452d-b134-3de7a5fd0a33 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:21.662603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2fb4def1-cee9-452d-b134-3de7a5fd0a33 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:21.663458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2fb4def1-cee9-452d-b134-3de7a5fd0a33 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:21.665528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2fb4def1-cee9-452d-b134-3de7a5fd0a33 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:21.920409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2fb4def1-cee9-452d-b134-3de7a5fd0a33 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:21.928411 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2fb4def1-cee9-452d-b134-3de7a5fd0a33 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.280949 May 28 04:54:21.929294 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2577/5034] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:21 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:21.948015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1b003bb5-a6c5-4f76-a2bd-4a5191d1d887 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:21.948739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1b003bb5-a6c5-4f76-a2bd-4a5191d1d887 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:21.955712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b003bb5-a6c5-4f76-a2bd-4a5191d1d887 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:21.956172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b003bb5-a6c5-4f76-a2bd-4a5191d1d887 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:21.956930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b003bb5-a6c5-4f76-a2bd-4a5191d1d887 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:21.957371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b003bb5-a6c5-4f76-a2bd-4a5191d1d887 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:21.972797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c4f4dde1-8428-4ab7-aa97-1717fdcdac3f tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:21.973846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c4f4dde1-8428-4ab7-aa97-1717fdcdac3f tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:21.989156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4f4dde1-8428-4ab7-aa97-1717fdcdac3f tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:21.989622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4f4dde1-8428-4ab7-aa97-1717fdcdac3f tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:21.990557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4f4dde1-8428-4ab7-aa97-1717fdcdac3f tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:21.992046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4f4dde1-8428-4ab7-aa97-1717fdcdac3f tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:22.181369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1b003bb5-a6c5-4f76-a2bd-4a5191d1d887 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:22.189915 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1b003bb5-a6c5-4f76-a2bd-4a5191d1d887 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.246032 May 28 04:54:22.190504 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2458/5035] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:21 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:22.243309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c4f4dde1-8428-4ab7-aa97-1717fdcdac3f tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:22.256532 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c4f4dde1-8428-4ab7-aa97-1717fdcdac3f tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1510 microversion: 2.1 time: 0.289604 May 28 04:54:22.258142 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2578/5036] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:21 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1510 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:22.316421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5bfdf9bf-3c57-43c7-a1a9-cbcc1fe27f02 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5bfdf9bf-3c57-43c7-a1a9-cbcc1fe27f02 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 160 May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: {"server": {"name": "", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "d8b90133-44e4-4677-ae8d-d676a447193b"}]}} May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute name. Value: . '' is too short May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'body': {'server': {'name': '', 'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa', 'flavorRef': '452', 'networks': [{'uuid': 'd8b90133-44e4-4677-ae8d-d676a447193b'}]}}} May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi '' May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:54:22.319939 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:54:22.323148 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:54:22.323148 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 28 04:54:22.323148 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:22.323148 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:22.323148 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:22.323148 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:22.323148 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:22.323148 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:22.323148 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:54:22.323148 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:54:22.323148 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 28 04:54:22.323148 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:22.323148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5bfdf9bf-3c57-43c7-a1a9-cbcc1fe27f02 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:54:22.323148 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5bfdf9bf-3c57-43c7-a1a9-cbcc1fe27f02 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.008406 May 28 04:54:22.323148 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2459/5037] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:54:22 2022] POST /compute/v2.1/servers => generated 108 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 04:54:22.329663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-00fc2b03-d936-4c6e-9d80-cea34edca1d9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:22.330282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-00fc2b03-d936-4c6e-9d80-cea34edca1d9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:22.337263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00fc2b03-d936-4c6e-9d80-cea34edca1d9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:22.337725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00fc2b03-d936-4c6e-9d80-cea34edca1d9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:22.338690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00fc2b03-d936-4c6e-9d80-cea34edca1d9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:22.339175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00fc2b03-d936-4c6e-9d80-cea34edca1d9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:22.482760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1d2b7082-981b-4f1e-8f40-f0acec93a64c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:22.484220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1d2b7082-981b-4f1e-8f40-f0acec93a64c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:22.496007 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d2b7082-981b-4f1e-8f40-f0acec93a64c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:22.497953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d2b7082-981b-4f1e-8f40-f0acec93a64c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:22.499591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d2b7082-981b-4f1e-8f40-f0acec93a64c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:22.500304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d2b7082-981b-4f1e-8f40-f0acec93a64c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:22.565698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-00fc2b03-d936-4c6e-9d80-cea34edca1d9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:22.574701 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-00fc2b03-d936-4c6e-9d80-cea34edca1d9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.248698 May 28 04:54:22.575892 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2579/5038] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:22 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:22.599181 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3ea94562-07b9-4c5a-b47c-ad1d0d1c6211 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:22.599968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3ea94562-07b9-4c5a-b47c-ad1d0d1c6211 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:22.610078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ea94562-07b9-4c5a-b47c-ad1d0d1c6211 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:22.610616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ea94562-07b9-4c5a-b47c-ad1d0d1c6211 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:22.611533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ea94562-07b9-4c5a-b47c-ad1d0d1c6211 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:22.612084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ea94562-07b9-4c5a-b47c-ad1d0d1c6211 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:22.874595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1d2b7082-981b-4f1e-8f40-f0acec93a64c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:22.900210 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1d2b7082-981b-4f1e-8f40-f0acec93a64c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1327 microversion: 2.1 time: 0.421743 May 28 04:54:22.903246 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2460/5039] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:22 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1327 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:22.983111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3ea94562-07b9-4c5a-b47c-ad1d0d1c6211 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:22.994385 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3ea94562-07b9-4c5a-b47c-ad1d0d1c6211 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.404283 May 28 04:54:22.995518 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2580/5040] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:22 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:23.013182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3c28ba61-be62-4f66-8998-432da66ea6da tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:23.013852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3c28ba61-be62-4f66-8998-432da66ea6da tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: a4956fd7-ea07-4d22-a363-cf2f922933eb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:23.021815 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-3c28ba61-be62-4f66-8998-432da66ea6da tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance a4956fd7-ea07-4d22-a363-cf2f922933eb could not be found. May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3c28ba61-be62-4f66-8998-432da66ea6da tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/a4956fd7-ea07-4d22-a363-cf2f922933eb/action HTTP/1.1 May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 14 May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: {"shelve": {}} May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance a4956fd7-ea07-4d22-a363-cf2f922933eb could not be found. May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'a4956fd7-ea07-4d22-a363-cf2f922933eb', 'body': {'shelve': {}}} May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4956fd7-ea07-4d22-a363-cf2f922933eb could not be found. May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4956fd7-ea07-4d22-a363-cf2f922933eb could not be found. May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:23.037103 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:23.049241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:54:23.049241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:54:23.049241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4956fd7-ea07-4d22-a363-cf2f922933eb could not be found. May 28 04:54:23.049241 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:23.049241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3c28ba61-be62-4f66-8998-432da66ea6da tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance a4956fd7-ea07-4d22-a363-cf2f922933eb could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:54:23.049241 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3c28ba61-be62-4f66-8998-432da66ea6da tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/a4956fd7-ea07-4d22-a363-cf2f922933eb/action" status: 404 len: 111 microversion: 2.1 time: 0.030709 May 28 04:54:23.049241 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2461/5041] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:23 2022] POST /compute/v2.1/servers/a4956fd7-ea07-4d22-a363-cf2f922933eb/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:54:23.050978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-367cf815-95d8-4a13-95db-98541d2338e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:23.051626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-367cf815-95d8-4a13-95db-98541d2338e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:23.061470 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-367cf815-95d8-4a13-95db-98541d2338e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:23.061929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-367cf815-95d8-4a13-95db-98541d2338e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:23.064802 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-367cf815-95d8-4a13-95db-98541d2338e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:23.066381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-367cf815-95d8-4a13-95db-98541d2338e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:23.276257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2314ee45-23c7-4bff-a15b-78b1487dd913 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:23.277016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2314ee45-23c7-4bff-a15b-78b1487dd913 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:23.286944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2314ee45-23c7-4bff-a15b-78b1487dd913 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:23.292361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2314ee45-23c7-4bff-a15b-78b1487dd913 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:23.294618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2314ee45-23c7-4bff-a15b-78b1487dd913 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:23.295298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2314ee45-23c7-4bff-a15b-78b1487dd913 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:23.310891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:54:23.460451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-367cf815-95d8-4a13-95db-98541d2338e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:23.472090 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-367cf815-95d8-4a13-95db-98541d2338e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.425718 May 28 04:54:23.473477 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2581/5042] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:23 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:23.490473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6d50d7b5-c62b-49fc-82c0-832f131d5e2a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:23.491312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6d50d7b5-c62b-49fc-82c0-832f131d5e2a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:23.498309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d50d7b5-c62b-49fc-82c0-832f131d5e2a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:23.498924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d50d7b5-c62b-49fc-82c0-832f131d5e2a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:23.499964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d50d7b5-c62b-49fc-82c0-832f131d5e2a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:23.500671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d50d7b5-c62b-49fc-82c0-832f131d5e2a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:23.677481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2314ee45-23c7-4bff-a15b-78b1487dd913 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:23.685808 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2314ee45-23c7-4bff-a15b-78b1487dd913 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1510 microversion: 2.1 time: 0.414623 May 28 04:54:23.686390 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2462/5043] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:23 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1510 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:23.919104 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5fcb76f5-db05-4124-8b6e-493e809b9f11 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:23.919927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5fcb76f5-db05-4124-8b6e-493e809b9f11 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:23.927686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5fcb76f5-db05-4124-8b6e-493e809b9f11 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:23.928145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5fcb76f5-db05-4124-8b6e-493e809b9f11 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:23.929546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5fcb76f5-db05-4124-8b6e-493e809b9f11 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:23.929546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5fcb76f5-db05-4124-8b6e-493e809b9f11 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:24.071183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6d50d7b5-c62b-49fc-82c0-832f131d5e2a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:24.082806 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6d50d7b5-c62b-49fc-82c0-832f131d5e2a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.596142 May 28 04:54:24.090904 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2582/5044] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:23 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:24.112468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6346eaab-9d3a-4455-9d97-0b74f6805dec tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:24.113306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6346eaab-9d3a-4455-9d97-0b74f6805dec tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:24.137881 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6346eaab-9d3a-4455-9d97-0b74f6805dec tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:24.138496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6346eaab-9d3a-4455-9d97-0b74f6805dec tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:24.139608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6346eaab-9d3a-4455-9d97-0b74f6805dec tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:24.141027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6346eaab-9d3a-4455-9d97-0b74f6805dec tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:24.206397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5fcb76f5-db05-4124-8b6e-493e809b9f11 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:24.216798 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5fcb76f5-db05-4124-8b6e-493e809b9f11 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1315 microversion: 2.1 time: 0.299652 May 28 04:54:24.218314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-6346eaab-9d3a-4455-9d97-0b74f6805dec tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lazy-loading 'flavor' on Instance uuid 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:54:24.219662 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2463/5045] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:23 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:24.473896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-8608788a-d54b-4981-bc71-8b4d4b7b4a67 req-59af9b71-3a02-481c-8795-612f12c0a265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d9bcfd7-7d49-4c32-ae2c-748617114b96", "name": "network-vif-deleted", "tag": "cb04aa76-1a04-4fb5-a21c-24d0b903b510"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:24.494074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8608788a-d54b-4981-bc71-8b4d4b7b4a67 req-59af9b71-3a02-481c-8795-612f12c0a265 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:24.494777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8608788a-d54b-4981-bc71-8b4d4b7b4a67 req-59af9b71-3a02-481c-8795-612f12c0a265 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:24.508423 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-8608788a-d54b-4981-bc71-8b4d4b7b4a67 req-59af9b71-3a02-481c-8795-612f12c0a265 service nova] Creating event network-vif-deleted:cb04aa76-1a04-4fb5-a21c-24d0b903b510 for instance 0d9bcfd7-7d49-4c32-ae2c-748617114b96 on n-h1-843700-1 May 28 04:54:24.523535 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-8608788a-d54b-4981-bc71-8b4d4b7b4a67 req-59af9b71-3a02-481c-8795-612f12c0a265 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053624 May 28 04:54:24.525891 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2464/5046] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:54:24.705781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-03ab02c1-5f55-4caf-91a2-e7b5d5cfe156 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:24.706516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-03ab02c1-5f55-4caf-91a2-e7b5d5cfe156 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:24.715726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03ab02c1-5f55-4caf-91a2-e7b5d5cfe156 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:24.716635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03ab02c1-5f55-4caf-91a2-e7b5d5cfe156 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:24.717622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03ab02c1-5f55-4caf-91a2-e7b5d5cfe156 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:24.718834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03ab02c1-5f55-4caf-91a2-e7b5d5cfe156 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:24.868722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-03ab02c1-5f55-4caf-91a2-e7b5d5cfe156 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b061bc8b03440dbbbea79a18c00d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48bceb63c3f41f0a1e5051e83ac1391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:24.882405 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-03ab02c1-5f55-4caf-91a2-e7b5d5cfe156 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 200 len: 1294 microversion: 2.1 time: 0.182770 May 28 04:54:24.883872 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2465/5047] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:24 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 1294 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:24.922534 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6346eaab-9d3a-4455-9d97-0b74f6805dec tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action" status: 202 len: 0 microversion: 2.1 time: 0.817909 May 28 04:54:24.932674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-052bd0ed-d828-4ef9-aa7a-1f4da267ba3e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:24.933398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-052bd0ed-d828-4ef9-aa7a-1f4da267ba3e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:24.936562 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2583/5048] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:24 2022] POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action => generated 0 bytes in 823 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:54:24.941304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-052bd0ed-d828-4ef9-aa7a-1f4da267ba3e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:24.941771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-052bd0ed-d828-4ef9-aa7a-1f4da267ba3e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:24.942740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-052bd0ed-d828-4ef9-aa7a-1f4da267ba3e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:24.943216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-052bd0ed-d828-4ef9-aa7a-1f4da267ba3e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:25.118145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-052bd0ed-d828-4ef9-aa7a-1f4da267ba3e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:25.149979 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-052bd0ed-d828-4ef9-aa7a-1f4da267ba3e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1512 microversion: 2.1 time: 0.220282 May 28 04:54:25.163449 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2466/5049] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:24 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1512 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:25.238821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8b0a5245-2767-4b66-a058-540a6a69c7fc tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:25.241127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8b0a5245-2767-4b66-a058-540a6a69c7fc tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:25.255997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b0a5245-2767-4b66-a058-540a6a69c7fc tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:25.257430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b0a5245-2767-4b66-a058-540a6a69c7fc tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:25.258383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b0a5245-2767-4b66-a058-540a6a69c7fc tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:25.259738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b0a5245-2767-4b66-a058-540a6a69c7fc tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:25.473907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8b0a5245-2767-4b66-a058-540a6a69c7fc tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:25.489188 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8b0a5245-2767-4b66-a058-540a6a69c7fc tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1315 microversion: 2.1 time: 0.257189 May 28 04:54:25.499642 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2584/5050] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:25 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:25.903270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1362e79d-da1e-4f95-a64f-0bf0ad3ef5b6 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:25.903893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1362e79d-da1e-4f95-a64f-0bf0ad3ef5b6 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] [instance: 0d9bcfd7-7d49-4c32-ae2c-748617114b96] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:25.913455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1362e79d-da1e-4f95-a64f-0bf0ad3ef5b6 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:25.914144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1362e79d-da1e-4f95-a64f-0bf0ad3ef5b6 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:25.915838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1362e79d-da1e-4f95-a64f-0bf0ad3ef5b6 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:25.916545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1362e79d-da1e-4f95-a64f-0bf0ad3ef5b6 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:25.953657 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-1362e79d-da1e-4f95-a64f-0bf0ad3ef5b6 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] HTTP exception thrown: Instance 0d9bcfd7-7d49-4c32-ae2c-748617114b96 could not be found. May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1362e79d-da1e-4f95-a64f-0bf0ad3ef5b6 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Request method failure captured: May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 HTTP/1.1 May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaq1I62Lu1HYVVZdgeetuwwuMd0vsNrABAlnmi8AM4QW1htpuSVsYFRM792W2G1myNqviu0Jj0omCEJORbnUQbzoZVFV3wvT1EZznAH4bc1OD1djIBWQOheiXBiGu0vAtDOMNF1Pfs5CQL1qCJF9NPAJwh8SMRH0xoQvv4Ihw2uCvRw May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: b48bceb63c3f41f0a1e5051e83ac1391 May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-2067593917 May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b48bceb63c3f41f0a1e5051e83ac1391"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b48bceb63c3f41f0a1e5051e83ac1391"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b48bceb63c3f41f0a1e5051e83ac1391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b48bceb63c3f41f0a1e5051e83ac1391"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-2067593917 May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: b48bceb63c3f41f0a1e5051e83ac1391 May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-2067593917 May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerRescueTestJSONUnderV235-2067593917-project May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 35b061bc8b03440dbbbea79a18c00d16 May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-2067593917-project May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 0d9bcfd7-7d49-4c32-ae2c-748617114b96 could not be found. May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '0d9bcfd7-7d49-4c32-ae2c-748617114b96'} May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d9bcfd7-7d49-4c32-ae2c-748617114b96 could not be found. May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d9bcfd7-7d49-4c32-ae2c-748617114b96 could not be found. May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:25.955910 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:54:25.959749 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:25.959749 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:54:25.959749 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:54:25.959749 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:54:25.959749 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:54:25.959749 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:54:25.959749 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d9bcfd7-7d49-4c32-ae2c-748617114b96 could not be found. May 28 04:54:25.959749 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:54:25.963426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1362e79d-da1e-4f95-a64f-0bf0ad3ef5b6 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] Returning 404 to user: Instance 0d9bcfd7-7d49-4c32-ae2c-748617114b96 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:54:25.966321 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1362e79d-da1e-4f95-a64f-0bf0ad3ef5b6 tempest-ServerRescueTestJSONUnderV235-2067593917 tempest-ServerRescueTestJSONUnderV235-2067593917-project] 10.222.0.58 "GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96" status: 404 len: 111 microversion: 2.1 time: 0.069387 May 28 04:54:25.968036 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2467/5051] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:25 2022] GET /compute/v2.1/servers/0d9bcfd7-7d49-4c32-ae2c-748617114b96 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:54:26.170664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fe009cd1-61ed-4daa-a1da-66a8db2e75a5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:26.171409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fe009cd1-61ed-4daa-a1da-66a8db2e75a5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:26.177678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe009cd1-61ed-4daa-a1da-66a8db2e75a5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:26.178201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe009cd1-61ed-4daa-a1da-66a8db2e75a5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:26.179810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe009cd1-61ed-4daa-a1da-66a8db2e75a5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:26.179810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe009cd1-61ed-4daa-a1da-66a8db2e75a5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:26.475830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fe009cd1-61ed-4daa-a1da-66a8db2e75a5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:26.489416 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fe009cd1-61ed-4daa-a1da-66a8db2e75a5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1512 microversion: 2.1 time: 0.321191 May 28 04:54:26.491202 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2585/5052] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:26 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1512 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:26.508363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f0fa5a0b-4dc3-425f-82fa-c143cfdef094 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:26.508983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f0fa5a0b-4dc3-425f-82fa-c143cfdef094 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:26.517220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0fa5a0b-4dc3-425f-82fa-c143cfdef094 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:26.517751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0fa5a0b-4dc3-425f-82fa-c143cfdef094 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:26.518527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0fa5a0b-4dc3-425f-82fa-c143cfdef094 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:26.519197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0fa5a0b-4dc3-425f-82fa-c143cfdef094 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:26.544853 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-3bbe941d-e377-494d-9aef-ee6ed01688c4 req-2d82454c-2931-4770-b070-667d891cf425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ddeac5b-bb14-4476-bf40-51def0581dda", "tag": "d6968238-0889-4b2d-a132-38e72ea2a6f1"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:26.554891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-3bbe941d-e377-494d-9aef-ee6ed01688c4 req-2d82454c-2931-4770-b070-667d891cf425 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:26.555750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-3bbe941d-e377-494d-9aef-ee6ed01688c4 req-2d82454c-2931-4770-b070-667d891cf425 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:26.576595 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-3bbe941d-e377-494d-9aef-ee6ed01688c4 req-2d82454c-2931-4770-b070-667d891cf425 service nova] Creating event network-changed:d6968238-0889-4b2d-a132-38e72ea2a6f1 for instance 5ddeac5b-bb14-4476-bf40-51def0581dda on n-h1-843700-1 May 28 04:54:26.579614 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-3bbe941d-e377-494d-9aef-ee6ed01688c4 req-2d82454c-2931-4770-b070-667d891cf425 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042827 May 28 04:54:26.580867 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2586/5053] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:54:26.836552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f0fa5a0b-4dc3-425f-82fa-c143cfdef094 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:26.846273 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f0fa5a0b-4dc3-425f-82fa-c143cfdef094 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1315 microversion: 2.1 time: 0.343122 May 28 04:54:26.854079 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2468/5054] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:26 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:27.508021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f03c8230-933b-4bd8-9716-dc3e84d0adbe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:27.508814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f03c8230-933b-4bd8-9716-dc3e84d0adbe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:27.516938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f03c8230-933b-4bd8-9716-dc3e84d0adbe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:27.517560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f03c8230-933b-4bd8-9716-dc3e84d0adbe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:27.518382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f03c8230-933b-4bd8-9716-dc3e84d0adbe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:27.518890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f03c8230-933b-4bd8-9716-dc3e84d0adbe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:27.788786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f03c8230-933b-4bd8-9716-dc3e84d0adbe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:27.800338 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f03c8230-933b-4bd8-9716-dc3e84d0adbe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1512 microversion: 2.1 time: 0.296754 May 28 04:54:27.810177 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2587/5055] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:27 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:27.864982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2e9e2c1b-bb1c-40a8-b032-646c8552d221 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:27.865605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2e9e2c1b-bb1c-40a8-b032-646c8552d221 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:27.868618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:54:27.875344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2e9e2c1b-bb1c-40a8-b032-646c8552d221 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:27.875728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2e9e2c1b-bb1c-40a8-b032-646c8552d221 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:27.876507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2e9e2c1b-bb1c-40a8-b032-646c8552d221 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:27.876953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2e9e2c1b-bb1c-40a8-b032-646c8552d221 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:28.169409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2e9e2c1b-bb1c-40a8-b032-646c8552d221 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:28.178624 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2e9e2c1b-bb1c-40a8-b032-646c8552d221 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1315 microversion: 2.1 time: 0.317415 May 28 04:54:28.180319 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2469/5056] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:27 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:28.822544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7b09faf8-ae1d-4805-a96e-dcde811cd772 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:28.823852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7b09faf8-ae1d-4805-a96e-dcde811cd772 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:28.837375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b09faf8-ae1d-4805-a96e-dcde811cd772 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:28.838254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b09faf8-ae1d-4805-a96e-dcde811cd772 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:28.839282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b09faf8-ae1d-4805-a96e-dcde811cd772 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:28.840369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b09faf8-ae1d-4805-a96e-dcde811cd772 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:28.845281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:54:29.096062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7b09faf8-ae1d-4805-a96e-dcde811cd772 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:29.104301 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7b09faf8-ae1d-4805-a96e-dcde811cd772 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1512 microversion: 2.1 time: 0.289009 May 28 04:54:29.108520 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2588/5057] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:28 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1512 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:29.202377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0f24a411-373d-4c6f-95ff-ddc42a343ad6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:29.202377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0f24a411-373d-4c6f-95ff-ddc42a343ad6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:29.202377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=8 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:54:29.211654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f24a411-373d-4c6f-95ff-ddc42a343ad6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:29.216945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f24a411-373d-4c6f-95ff-ddc42a343ad6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:29.217819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f24a411-373d-4c6f-95ff-ddc42a343ad6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:29.218276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f24a411-373d-4c6f-95ff-ddc42a343ad6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:29.476813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0f24a411-373d-4c6f-95ff-ddc42a343ad6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:29.492298 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0f24a411-373d-4c6f-95ff-ddc42a343ad6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1315 microversion: 2.1 time: 0.298650 May 28 04:54:29.492930 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2470/5058] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:29 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:30.134520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-16f62810-1704-4356-bd58-1a40f514b62e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:30.135261 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-16f62810-1704-4356-bd58-1a40f514b62e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:30.149253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-16f62810-1704-4356-bd58-1a40f514b62e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:30.149833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-16f62810-1704-4356-bd58-1a40f514b62e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:30.152188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-16f62810-1704-4356-bd58-1a40f514b62e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:30.155325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-16f62810-1704-4356-bd58-1a40f514b62e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:30.371756 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-16f62810-1704-4356-bd58-1a40f514b62e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:30.381137 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-16f62810-1704-4356-bd58-1a40f514b62e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1512 microversion: 2.1 time: 0.260575 May 28 04:54:30.382328 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2589/5059] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:30 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1512 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:30.510550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d8dead88-a4d0-4cf5-bc4b-1dfea6784fc1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:30.511258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d8dead88-a4d0-4cf5-bc4b-1dfea6784fc1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:30.520147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8dead88-a4d0-4cf5-bc4b-1dfea6784fc1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:30.520612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8dead88-a4d0-4cf5-bc4b-1dfea6784fc1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:30.522118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8dead88-a4d0-4cf5-bc4b-1dfea6784fc1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:30.522736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8dead88-a4d0-4cf5-bc4b-1dfea6784fc1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:30.700856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d8dead88-a4d0-4cf5-bc4b-1dfea6784fc1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:30.709653 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d8dead88-a4d0-4cf5-bc4b-1dfea6784fc1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1315 microversion: 2.1 time: 0.203524 May 28 04:54:30.710244 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2590/5060] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:30 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:30.745033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0a8bb8c5-60a3-49f9-bc66-c6aba19aac38 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1722811771", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": "none"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:30.824581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0a8bb8c5-60a3-49f9-bc66-c6aba19aac38 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:54:30.825872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0a8bb8c5-60a3-49f9-bc66-c6aba19aac38 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:54:30.826602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0a8bb8c5-60a3-49f9-bc66-c6aba19aac38 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:54:30.827259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0a8bb8c5-60a3-49f9-bc66-c6aba19aac38 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:54:30.827882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0a8bb8c5-60a3-49f9-bc66-c6aba19aac38 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:54:30.839665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a8bb8c5-60a3-49f9-bc66-c6aba19aac38 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:30.841061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a8bb8c5-60a3-49f9-bc66-c6aba19aac38 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:30.842422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a8bb8c5-60a3-49f9-bc66-c6aba19aac38 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:30.843056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0a8bb8c5-60a3-49f9-bc66-c6aba19aac38 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:30.905556 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0a8bb8c5-60a3-49f9-bc66-c6aba19aac38 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Getting quotas for project 5f5882bae6fe4056b111e9b3de9e58c4. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:54:30.921826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0a8bb8c5-60a3-49f9-bc66-c6aba19aac38 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Getting quotas for user 77e852d1a61c4c77bd3d6df2559cc8c0 and project 5f5882bae6fe4056b111e9b3de9e58c4. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:54:30.956137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0a8bb8c5-60a3-49f9-bc66-c6aba19aac38 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:54:30.958874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0a8bb8c5-60a3-49f9-bc66-c6aba19aac38 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 967b34cd-7be0-483f-95cc-6f75fd0d9341] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:54:31.141023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e7580c04-593a-4d43-846c-c9a6fa3beeb1 req-bcf56dda-8be3-4c47-b3c9-076a706bbe5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ddeac5b-bb14-4476-bf40-51def0581dda", "name": "network-vif-plugged", "status": "completed", "tag": "d6968238-0889-4b2d-a132-38e72ea2a6f1"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:31.153493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e7580c04-593a-4d43-846c-c9a6fa3beeb1 req-bcf56dda-8be3-4c47-b3c9-076a706bbe5e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:31.154254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e7580c04-593a-4d43-846c-c9a6fa3beeb1 req-bcf56dda-8be3-4c47-b3c9-076a706bbe5e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:31.173494 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0a8bb8c5-60a3-49f9-bc66-c6aba19aac38 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.941600 May 28 04:54:31.179344 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2471/5061] 10.222.0.58 () {62 vars in 1187 bytes} [Sat May 28 04:54:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 04:54:31.190379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c6bf6526-6b97-4ae7-b720-57b96496a112 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:31.191213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c6bf6526-6b97-4ae7-b720-57b96496a112 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 967b34cd-7be0-483f-95cc-6f75fd0d9341] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:31.203907 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e7580c04-593a-4d43-846c-c9a6fa3beeb1 req-bcf56dda-8be3-4c47-b3c9-076a706bbe5e service nova] Creating event network-vif-plugged:d6968238-0889-4b2d-a132-38e72ea2a6f1 for instance 5ddeac5b-bb14-4476-bf40-51def0581dda on n-h1-843700-1 May 28 04:54:31.214598 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e7580c04-593a-4d43-846c-c9a6fa3beeb1 req-bcf56dda-8be3-4c47-b3c9-076a706bbe5e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079381 May 28 04:54:31.220622 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2591/5062] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:54:31.277827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c6bf6526-6b97-4ae7-b720-57b96496a112 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:31.295455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c6bf6526-6b97-4ae7-b720-57b96496a112 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:31.303314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c6bf6526-6b97-4ae7-b720-57b96496a112 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:31.313204 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c6bf6526-6b97-4ae7-b720-57b96496a112 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/967b34cd-7be0-483f-95cc-6f75fd0d9341" status: 200 len: 1278 microversion: 2.47 time: 0.121031 May 28 04:54:31.313204 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2472/5063] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:31 2022] GET /compute/v2.1/servers/967b34cd-7be0-483f-95cc-6f75fd0d9341 => generated 1278 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:54:31.401580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f73a4564-5561-4bcc-8fbb-571cb76fbc58 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:31.403208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f73a4564-5561-4bcc-8fbb-571cb76fbc58 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:31.411579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f73a4564-5561-4bcc-8fbb-571cb76fbc58 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:31.412356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f73a4564-5561-4bcc-8fbb-571cb76fbc58 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:31.416340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f73a4564-5561-4bcc-8fbb-571cb76fbc58 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:31.416340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f73a4564-5561-4bcc-8fbb-571cb76fbc58 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:31.536266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8db5da2f-0ff6-4e73-af12-88fc3f588b48 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-826954831", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": "none"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:31.593677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-8db5da2f-0ff6-4e73-af12-88fc3f588b48 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:54:31.594260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-8db5da2f-0ff6-4e73-af12-88fc3f588b48 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:54:31.595021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-8db5da2f-0ff6-4e73-af12-88fc3f588b48 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:54:31.595577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-8db5da2f-0ff6-4e73-af12-88fc3f588b48 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:54:31.596736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-8db5da2f-0ff6-4e73-af12-88fc3f588b48 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:54:31.607823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8db5da2f-0ff6-4e73-af12-88fc3f588b48 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:31.608452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8db5da2f-0ff6-4e73-af12-88fc3f588b48 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:31.609621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8db5da2f-0ff6-4e73-af12-88fc3f588b48 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:31.619546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8db5da2f-0ff6-4e73-af12-88fc3f588b48 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:31.637090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-8db5da2f-0ff6-4e73-af12-88fc3f588b48 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Getting quotas for project 5f5882bae6fe4056b111e9b3de9e58c4. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:54:31.637573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f73a4564-5561-4bcc-8fbb-571cb76fbc58 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:31.642932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-8db5da2f-0ff6-4e73-af12-88fc3f588b48 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Getting quotas for user 77e852d1a61c4c77bd3d6df2559cc8c0 and project 5f5882bae6fe4056b111e9b3de9e58c4. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:54:31.648888 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f73a4564-5561-4bcc-8fbb-571cb76fbc58 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1512 microversion: 2.1 time: 0.253540 May 28 04:54:31.658944 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2592/5064] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:31 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1512 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:31.658944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-350cb6b1-99e1-461a-9c99-391d0eb21a06 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:31.658944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-350cb6b1-99e1-461a-9c99-391d0eb21a06 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:31.664316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-350cb6b1-99e1-461a-9c99-391d0eb21a06 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:31.664876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-350cb6b1-99e1-461a-9c99-391d0eb21a06 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:31.665808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-350cb6b1-99e1-461a-9c99-391d0eb21a06 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:31.666354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-350cb6b1-99e1-461a-9c99-391d0eb21a06 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:31.666957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8db5da2f-0ff6-4e73-af12-88fc3f588b48 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:54:31.669692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8db5da2f-0ff6-4e73-af12-88fc3f588b48 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:54:31.719764 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-350cb6b1-99e1-461a-9c99-391d0eb21a06 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0/action" status: 200 len: 24557 microversion: 2.1 time: 0.068226 May 28 04:54:31.721588 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2593/5065] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:31 2022] POST /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0/action => generated 24557 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:54:31.733020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aefbda9b-4f55-458d-8d4a-975dd6df08ac tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:31.733618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aefbda9b-4f55-458d-8d4a-975dd6df08ac tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:31.767966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aefbda9b-4f55-458d-8d4a-975dd6df08ac tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:31.768431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aefbda9b-4f55-458d-8d4a-975dd6df08ac tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:31.774846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aefbda9b-4f55-458d-8d4a-975dd6df08ac tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:31.774846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aefbda9b-4f55-458d-8d4a-975dd6df08ac tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:31.843822 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8db5da2f-0ff6-4e73-af12-88fc3f588b48 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.312013 May 28 04:54:31.857042 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2473/5066] 10.222.0.58 () {62 vars in 1187 bytes} [Sat May 28 04:54:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 314 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 04:54:31.866156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9eb9dca5-6740-4ac4-9dbc-a1187f61ceb5 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:31.867688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9eb9dca5-6740-4ac4-9dbc-a1187f61ceb5 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:31.922008 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9eb9dca5-6740-4ac4-9dbc-a1187f61ceb5 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "PUT /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 991 microversion: 2.47 time: 0.063429 May 28 04:54:31.923670 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2474/5067] 10.222.0.58 () {62 vars in 1296 bytes} [Sat May 28 04:54:31 2022] PUT /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:54:31.944765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-78bae1e0-1632-40b7-b774-520893bdd8c6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:31.945676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-78bae1e0-1632-40b7-b774-520893bdd8c6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:32.470599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-78bae1e0-1632-40b7-b774-520893bdd8c6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:32.491439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-78bae1e0-1632-40b7-b774-520893bdd8c6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:32.493529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-78bae1e0-1632-40b7-b774-520893bdd8c6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:32.494879 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-78bae1e0-1632-40b7-b774-520893bdd8c6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1277 microversion: 2.47 time: 0.557466 May 28 04:54:32.496486 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2475/5068] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:31 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1277 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:54:32.519528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aefbda9b-4f55-458d-8d4a-975dd6df08ac tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:32.530869 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aefbda9b-4f55-458d-8d4a-975dd6df08ac tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1315 microversion: 2.1 time: 0.802634 May 28 04:54:32.535182 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2594/5069] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:31 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1315 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:32.665689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-25838145-df45-476d-b647-84a7accc058b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:32.666372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-25838145-df45-476d-b647-84a7accc058b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:32.673366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25838145-df45-476d-b647-84a7accc058b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:32.673822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25838145-df45-476d-b647-84a7accc058b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:32.674600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25838145-df45-476d-b647-84a7accc058b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:32.675067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25838145-df45-476d-b647-84a7accc058b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:32.873370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-25838145-df45-476d-b647-84a7accc058b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:32.883676 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-25838145-df45-476d-b647-84a7accc058b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1512 microversion: 2.1 time: 0.221701 May 28 04:54:32.884262 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2476/5070] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:32 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1512 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:33.516516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-40e84f12-7666-4526-a174-5cdfa317cf26 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:33.517429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-40e84f12-7666-4526-a174-5cdfa317cf26 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:33.530337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40e84f12-7666-4526-a174-5cdfa317cf26 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:33.531127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40e84f12-7666-4526-a174-5cdfa317cf26 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:33.535279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40e84f12-7666-4526-a174-5cdfa317cf26 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:33.535817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40e84f12-7666-4526-a174-5cdfa317cf26 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:33.553223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-319f521c-ade9-4656-afc7-5a14270970f6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:33.554360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-319f521c-ade9-4656-afc7-5a14270970f6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:33.561972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-319f521c-ade9-4656-afc7-5a14270970f6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:33.562434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-319f521c-ade9-4656-afc7-5a14270970f6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:33.563449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-319f521c-ade9-4656-afc7-5a14270970f6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:33.564307 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-319f521c-ade9-4656-afc7-5a14270970f6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:33.617277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-40e84f12-7666-4526-a174-5cdfa317cf26 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:33.629501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-40e84f12-7666-4526-a174-5cdfa317cf26 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:33.631351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-40e84f12-7666-4526-a174-5cdfa317cf26 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:33.632739 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-40e84f12-7666-4526-a174-5cdfa317cf26 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1273 microversion: 2.47 time: 0.120143 May 28 04:54:33.633846 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2595/5071] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:33 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1273 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:54:33.735744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-319f521c-ade9-4656-afc7-5a14270970f6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:33.744180 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-319f521c-ade9-4656-afc7-5a14270970f6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1502 microversion: 2.1 time: 0.196276 May 28 04:54:33.756631 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2477/5072] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:33 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1502 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:33.761617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b0b4e4a0-6030-4ff2-b90a-9ea86ec299a9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:33.768218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0b4e4a0-6030-4ff2-b90a-9ea86ec299a9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:33.768760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0b4e4a0-6030-4ff2-b90a-9ea86ec299a9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:33.792448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b0b4e4a0-6030-4ff2-b90a-9ea86ec299a9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Going to try to stop instance {{(pid=126044) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 04:54:33.901884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f5fda566-e0eb-4e27-bce0-170b8268e841 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:33.903158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f5fda566-e0eb-4e27-bce0-170b8268e841 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:33.912183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5fda566-e0eb-4e27-bce0-170b8268e841 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:33.912646 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5fda566-e0eb-4e27-bce0-170b8268e841 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:33.913422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5fda566-e0eb-4e27-bce0-170b8268e841 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:33.913858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5fda566-e0eb-4e27-bce0-170b8268e841 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:34.043834 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b0b4e4a0-6030-4ff2-b90a-9ea86ec299a9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "POST /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda/action" status: 202 len: 0 microversion: 2.1 time: 0.285981 May 28 04:54:34.045011 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2596/5073] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:33 2022] POST /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:54:34.054451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8605203c-c494-4f6c-b0e0-a2ea01ebf991 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:34.057130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8605203c-c494-4f6c-b0e0-a2ea01ebf991 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:34.066722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8605203c-c494-4f6c-b0e0-a2ea01ebf991 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:34.067484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8605203c-c494-4f6c-b0e0-a2ea01ebf991 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:34.069698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8605203c-c494-4f6c-b0e0-a2ea01ebf991 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:34.069698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8605203c-c494-4f6c-b0e0-a2ea01ebf991 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:34.115678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f5fda566-e0eb-4e27-bce0-170b8268e841 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:34.133305 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f5fda566-e0eb-4e27-bce0-170b8268e841 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1512 microversion: 2.1 time: 0.235419 May 28 04:54:34.134748 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2478/5074] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:33 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1512 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:34.260817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8605203c-c494-4f6c-b0e0-a2ea01ebf991 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:34.271127 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8605203c-c494-4f6c-b0e0-a2ea01ebf991 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1512 microversion: 2.1 time: 0.222033 May 28 04:54:34.272616 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2597/5075] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:34 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1512 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:34.653196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-40ad4c86-56fd-4fe9-9ea9-7764ee82d403 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:34.654018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-40ad4c86-56fd-4fe9-9ea9-7764ee82d403 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:34.661189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40ad4c86-56fd-4fe9-9ea9-7764ee82d403 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:34.661937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40ad4c86-56fd-4fe9-9ea9-7764ee82d403 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:34.662978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40ad4c86-56fd-4fe9-9ea9-7764ee82d403 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:34.663527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40ad4c86-56fd-4fe9-9ea9-7764ee82d403 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:34.739241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-40ad4c86-56fd-4fe9-9ea9-7764ee82d403 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:34.748032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-40ad4c86-56fd-4fe9-9ea9-7764ee82d403 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:34.750340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-40ad4c86-56fd-4fe9-9ea9-7764ee82d403 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:34.752319 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-40ad4c86-56fd-4fe9-9ea9-7764ee82d403 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1337 microversion: 2.47 time: 0.103810 May 28 04:54:34.755121 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2479/5076] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:34 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1337 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:54:35.151142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-61b346a1-7e02-4053-b0a5-1e1aeee1e2e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:35.151769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-61b346a1-7e02-4053-b0a5-1e1aeee1e2e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:35.158716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-61b346a1-7e02-4053-b0a5-1e1aeee1e2e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:35.159220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-61b346a1-7e02-4053-b0a5-1e1aeee1e2e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:35.160020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-61b346a1-7e02-4053-b0a5-1e1aeee1e2e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:35.160467 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-61b346a1-7e02-4053-b0a5-1e1aeee1e2e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:35.289369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e29c0e51-af0f-4722-a5d6-972cf7b04878 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:35.290608 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e29c0e51-af0f-4722-a5d6-972cf7b04878 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:35.298078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e29c0e51-af0f-4722-a5d6-972cf7b04878 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:35.298830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e29c0e51-af0f-4722-a5d6-972cf7b04878 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:35.299651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e29c0e51-af0f-4722-a5d6-972cf7b04878 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:35.300114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e29c0e51-af0f-4722-a5d6-972cf7b04878 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:35.309915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-61b346a1-7e02-4053-b0a5-1e1aeee1e2e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:35.323356 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-61b346a1-7e02-4053-b0a5-1e1aeee1e2e6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1512 microversion: 2.1 time: 0.176130 May 28 04:54:35.323988 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2598/5077] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:35 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:35.488817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e29c0e51-af0f-4722-a5d6-972cf7b04878 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:35.497822 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e29c0e51-af0f-4722-a5d6-972cf7b04878 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1512 microversion: 2.1 time: 0.212661 May 28 04:54:35.507779 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2480/5078] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:35 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1512 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:35.772222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-82595c70-4655-4b16-8ef5-525ada9fec8e tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:35.772844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-82595c70-4655-4b16-8ef5-525ada9fec8e tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:35.780159 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82595c70-4655-4b16-8ef5-525ada9fec8e tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:35.780712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82595c70-4655-4b16-8ef5-525ada9fec8e tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:35.781432 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82595c70-4655-4b16-8ef5-525ada9fec8e tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:35.782274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82595c70-4655-4b16-8ef5-525ada9fec8e tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:35.857708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-82595c70-4655-4b16-8ef5-525ada9fec8e tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:35.867416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-82595c70-4655-4b16-8ef5-525ada9fec8e tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:35.869688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-82595c70-4655-4b16-8ef5-525ada9fec8e tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:35.871110 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-82595c70-4655-4b16-8ef5-525ada9fec8e tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1335 microversion: 2.47 time: 0.103064 May 28 04:54:35.872156 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2599/5079] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:35 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1335 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:54:36.340946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-47989fea-e5b8-4aec-8e7f-1dead8df1939 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:36.341618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-47989fea-e5b8-4aec-8e7f-1dead8df1939 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:36.349584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47989fea-e5b8-4aec-8e7f-1dead8df1939 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:36.350046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47989fea-e5b8-4aec-8e7f-1dead8df1939 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:36.350828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47989fea-e5b8-4aec-8e7f-1dead8df1939 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:36.351298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47989fea-e5b8-4aec-8e7f-1dead8df1939 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:36.515420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fa9df55b-6e83-4788-a99a-d86f46cb38eb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:36.516045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fa9df55b-6e83-4788-a99a-d86f46cb38eb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:36.528863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa9df55b-6e83-4788-a99a-d86f46cb38eb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:36.530373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa9df55b-6e83-4788-a99a-d86f46cb38eb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:36.531466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa9df55b-6e83-4788-a99a-d86f46cb38eb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:36.532104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa9df55b-6e83-4788-a99a-d86f46cb38eb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:36.561734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-47989fea-e5b8-4aec-8e7f-1dead8df1939 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:36.572691 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-47989fea-e5b8-4aec-8e7f-1dead8df1939 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1533 microversion: 2.1 time: 0.236100 May 28 04:54:36.580384 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2481/5080] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:36 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1533 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:36.895330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fe9f2d05-e0d3-4248-bc6d-9b55bc619451 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:36.896215 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fe9f2d05-e0d3-4248-bc6d-9b55bc619451 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:36.899533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:54:36.903872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe9f2d05-e0d3-4248-bc6d-9b55bc619451 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:36.904429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe9f2d05-e0d3-4248-bc6d-9b55bc619451 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:36.905216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe9f2d05-e0d3-4248-bc6d-9b55bc619451 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:36.905663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe9f2d05-e0d3-4248-bc6d-9b55bc619451 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:36.945268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fa9df55b-6e83-4788-a99a-d86f46cb38eb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:36.953578 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fa9df55b-6e83-4788-a99a-d86f46cb38eb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1512 microversion: 2.1 time: 0.443336 May 28 04:54:36.954414 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2600/5081] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:36 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1512 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:37.007685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fe9f2d05-e0d3-4248-bc6d-9b55bc619451 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:37.017877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fe9f2d05-e0d3-4248-bc6d-9b55bc619451 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:37.019457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fe9f2d05-e0d3-4248-bc6d-9b55bc619451 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:37.020766 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fe9f2d05-e0d3-4248-bc6d-9b55bc619451 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1335 microversion: 2.47 time: 0.131794 May 28 04:54:37.021511 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2482/5082] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:36 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1335 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:54:37.596495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b0332a27-172b-4489-a70c-d6f7f68a25cf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:37.597449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b0332a27-172b-4489-a70c-d6f7f68a25cf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:37.606677 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0332a27-172b-4489-a70c-d6f7f68a25cf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:37.609363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0332a27-172b-4489-a70c-d6f7f68a25cf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:37.612482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0332a27-172b-4489-a70c-d6f7f68a25cf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:37.613032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0332a27-172b-4489-a70c-d6f7f68a25cf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:37.814135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b0332a27-172b-4489-a70c-d6f7f68a25cf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:37.824587 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b0332a27-172b-4489-a70c-d6f7f68a25cf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1533 microversion: 2.1 time: 0.231262 May 28 04:54:37.836461 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2601/5083] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:37 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1533 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:37.972103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2f55baa3-4728-4ddb-bff7-d44aadc767c1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:37.972862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2f55baa3-4728-4ddb-bff7-d44aadc767c1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:37.987076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f55baa3-4728-4ddb-bff7-d44aadc767c1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:37.990451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f55baa3-4728-4ddb-bff7-d44aadc767c1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:37.990451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f55baa3-4728-4ddb-bff7-d44aadc767c1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:37.990451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f55baa3-4728-4ddb-bff7-d44aadc767c1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:38.043638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f1fe75ff-2e17-4f64-96c7-4c65a6e3a67a tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:38.045169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f1fe75ff-2e17-4f64-96c7-4c65a6e3a67a tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:38.072769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f1fe75ff-2e17-4f64-96c7-4c65a6e3a67a tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:38.075421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f1fe75ff-2e17-4f64-96c7-4c65a6e3a67a tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:38.076550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f1fe75ff-2e17-4f64-96c7-4c65a6e3a67a tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:38.078895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f1fe75ff-2e17-4f64-96c7-4c65a6e3a67a tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:38.214297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f1fe75ff-2e17-4f64-96c7-4c65a6e3a67a tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:38.266274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f1fe75ff-2e17-4f64-96c7-4c65a6e3a67a tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:38.273109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f1fe75ff-2e17-4f64-96c7-4c65a6e3a67a tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:38.281782 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f1fe75ff-2e17-4f64-96c7-4c65a6e3a67a tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1335 microversion: 2.47 time: 0.240232 May 28 04:54:38.282053 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2f55baa3-4728-4ddb-bff7-d44aadc767c1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:38.286257 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2602/5084] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:38 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1335 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:54:38.303626 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2f55baa3-4728-4ddb-bff7-d44aadc767c1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1512 microversion: 2.1 time: 0.335935 May 28 04:54:38.307864 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2483/5085] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:37 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1512 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:38.845076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fadf3ce5-25de-4980-b122-7de568513908 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:38.846513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fadf3ce5-25de-4980-b122-7de568513908 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:38.864607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=88 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:54:38.867959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fadf3ce5-25de-4980-b122-7de568513908 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:38.868596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fadf3ce5-25de-4980-b122-7de568513908 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:38.871719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fadf3ce5-25de-4980-b122-7de568513908 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:38.872324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fadf3ce5-25de-4980-b122-7de568513908 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:39.200678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fadf3ce5-25de-4980-b122-7de568513908 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:39.221667 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fadf3ce5-25de-4980-b122-7de568513908 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1528 microversion: 2.1 time: 0.383642 May 28 04:54:39.223732 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2603/5086] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:38 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1528 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:39.305171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a8c49018-4ca7-4c6a-b437-12fdc1241629 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:39.305692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a8c49018-4ca7-4c6a-b437-12fdc1241629 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:39.320472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a8c49018-4ca7-4c6a-b437-12fdc1241629 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:39.321622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a8c49018-4ca7-4c6a-b437-12fdc1241629 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:39.325351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cfff5c5f-880f-48ca-b169-94cf14fb8098 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:39.325978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cfff5c5f-880f-48ca-b169-94cf14fb8098 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:39.326718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a8c49018-4ca7-4c6a-b437-12fdc1241629 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:39.328573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a8c49018-4ca7-4c6a-b437-12fdc1241629 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:39.337682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfff5c5f-880f-48ca-b169-94cf14fb8098 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:39.338139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfff5c5f-880f-48ca-b169-94cf14fb8098 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:39.338946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfff5c5f-880f-48ca-b169-94cf14fb8098 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:39.355314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfff5c5f-880f-48ca-b169-94cf14fb8098 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:39.383221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:54:39.672471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cfff5c5f-880f-48ca-b169-94cf14fb8098 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:39.679494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:54:39.688897 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cfff5c5f-880f-48ca-b169-94cf14fb8098 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1512 microversion: 2.1 time: 0.365738 May 28 04:54:39.689938 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2604/5087] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:39 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1512 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:39.990062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a8c49018-4ca7-4c6a-b437-12fdc1241629 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:40.004916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a8c49018-4ca7-4c6a-b437-12fdc1241629 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:40.018346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a8c49018-4ca7-4c6a-b437-12fdc1241629 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:40.020992 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a8c49018-4ca7-4c6a-b437-12fdc1241629 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1356 microversion: 2.47 time: 0.720898 May 28 04:54:40.029764 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2484/5088] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:39 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1356 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:54:40.041618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3939c7bf-4299-497f-9163-73e29fe46863 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "012b12af-263c-4753-8fad-4a4022b439aa"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:40.043225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3939c7bf-4299-497f-9163-73e29fe46863 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:40.080507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3939c7bf-4299-497f-9163-73e29fe46863 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:40.080969 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3939c7bf-4299-497f-9163-73e29fe46863 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:40.088127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3939c7bf-4299-497f-9163-73e29fe46863 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:40.090709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3939c7bf-4299-497f-9163-73e29fe46863 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:40.243113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0eba8770-1105-49c4-8dd2-65d0d67421b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:40.244286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0eba8770-1105-49c4-8dd2-65d0d67421b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:40.262582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0eba8770-1105-49c4-8dd2-65d0d67421b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:40.282351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0eba8770-1105-49c4-8dd2-65d0d67421b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:40.286093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0eba8770-1105-49c4-8dd2-65d0d67421b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:40.292591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0eba8770-1105-49c4-8dd2-65d0d67421b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:40.338782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-3939c7bf-4299-497f-9163-73e29fe46863 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:54:40.339891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-3939c7bf-4299-497f-9163-73e29fe46863 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:54:40.341605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-3939c7bf-4299-497f-9163-73e29fe46863 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:54:40.343355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-3939c7bf-4299-497f-9163-73e29fe46863 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:54:40.344003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-3939c7bf-4299-497f-9163-73e29fe46863 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:54:40.684543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3939c7bf-4299-497f-9163-73e29fe46863 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:40.700082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3939c7bf-4299-497f-9163-73e29fe46863 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:40.703855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3939c7bf-4299-497f-9163-73e29fe46863 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:40.705891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3939c7bf-4299-497f-9163-73e29fe46863 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:40.707584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3939c7bf-4299-497f-9163-73e29fe46863 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:40.726283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0eba8770-1105-49c4-8dd2-65d0d67421b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:40.766428 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0eba8770-1105-49c4-8dd2-65d0d67421b2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1528 microversion: 2.1 time: 0.526677 May 28 04:54:40.770455 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2485/5089] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:40 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1528 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:40.781252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ea3de061-fb16-4a31-ad22-f9f9e54a4064 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:40.782142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ea3de061-fb16-4a31-ad22-f9f9e54a4064 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:40.790948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea3de061-fb16-4a31-ad22-f9f9e54a4064 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:40.791549 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3939c7bf-4299-497f-9163-73e29fe46863 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "POST /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4/action" status: 202 len: 1078 microversion: 2.47 time: 0.749985 May 28 04:54:40.792034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea3de061-fb16-4a31-ad22-f9f9e54a4064 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:40.793106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea3de061-fb16-4a31-ad22-f9f9e54a4064 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:40.793802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea3de061-fb16-4a31-ad22-f9f9e54a4064 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:40.795503 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2605/5090] 10.222.0.58 () {62 vars in 1318 bytes} [Sat May 28 04:54:40 2022] POST /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4/action => generated 1078 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 28 04:54:40.808638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1f102b94-11cb-4b4b-9cac-7b1cd2a9c9a1 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:40.808638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1f102b94-11cb-4b4b-9cac-7b1cd2a9c9a1 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:40.822979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f102b94-11cb-4b4b-9cac-7b1cd2a9c9a1 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:40.823612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f102b94-11cb-4b4b-9cac-7b1cd2a9c9a1 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:40.832731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f102b94-11cb-4b4b-9cac-7b1cd2a9c9a1 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:40.833191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f102b94-11cb-4b4b-9cac-7b1cd2a9c9a1 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:41.075778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1f102b94-11cb-4b4b-9cac-7b1cd2a9c9a1 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:41.093282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1f102b94-11cb-4b4b-9cac-7b1cd2a9c9a1 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:41.098585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1f102b94-11cb-4b4b-9cac-7b1cd2a9c9a1 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:41.101599 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1f102b94-11cb-4b4b-9cac-7b1cd2a9c9a1 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.298583 May 28 04:54:41.106077 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2606/5091] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:40 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:54:41.400781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ea3de061-fb16-4a31-ad22-f9f9e54a4064 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:41.418474 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ea3de061-fb16-4a31-ad22-f9f9e54a4064 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1512 microversion: 2.1 time: 0.644107 May 28 04:54:41.419302 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2486/5092] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:40 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1512 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:41.784385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-41e4d733-041f-45be-a2ba-8458a6e13ff0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:41.785139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-41e4d733-041f-45be-a2ba-8458a6e13ff0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:41.802294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41e4d733-041f-45be-a2ba-8458a6e13ff0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:41.803226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41e4d733-041f-45be-a2ba-8458a6e13ff0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:41.808595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41e4d733-041f-45be-a2ba-8458a6e13ff0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:41.808595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41e4d733-041f-45be-a2ba-8458a6e13ff0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:42.125097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e1bb177b-d81e-4407-9ebc-bbb714e7268f tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:42.125849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e1bb177b-d81e-4407-9ebc-bbb714e7268f tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:42.128000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:54:42.141804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e1bb177b-d81e-4407-9ebc-bbb714e7268f tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:42.147551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e1bb177b-d81e-4407-9ebc-bbb714e7268f tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:42.154398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e1bb177b-d81e-4407-9ebc-bbb714e7268f tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:42.156951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e1bb177b-d81e-4407-9ebc-bbb714e7268f tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:42.212960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-41e4d733-041f-45be-a2ba-8458a6e13ff0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:42.227518 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-41e4d733-041f-45be-a2ba-8458a6e13ff0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1528 microversion: 2.1 time: 0.442929 May 28 04:54:42.232682 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2607/5093] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:41 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1528 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:42.372481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e1bb177b-d81e-4407-9ebc-bbb714e7268f tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:42.382312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e1bb177b-d81e-4407-9ebc-bbb714e7268f tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:42.388705 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e1bb177b-d81e-4407-9ebc-bbb714e7268f tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:42.388705 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e1bb177b-d81e-4407-9ebc-bbb714e7268f tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.267886 May 28 04:54:42.388705 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2487/5094] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:42 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:54:42.436553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f2ee332e-68d1-4312-87f6-cdd66cbdbc8e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:42.440378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f2ee332e-68d1-4312-87f6-cdd66cbdbc8e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:42.453888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f2ee332e-68d1-4312-87f6-cdd66cbdbc8e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:42.459786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f2ee332e-68d1-4312-87f6-cdd66cbdbc8e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:42.463369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f2ee332e-68d1-4312-87f6-cdd66cbdbc8e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:42.463369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f2ee332e-68d1-4312-87f6-cdd66cbdbc8e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:42.662352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e0083478-ae2d-4b44-abed-cf88e94d1482 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:42.663151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e0083478-ae2d-4b44-abed-cf88e94d1482 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:42.673013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=16 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:54:42.676234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0083478-ae2d-4b44-abed-cf88e94d1482 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:42.676703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0083478-ae2d-4b44-abed-cf88e94d1482 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:42.677678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0083478-ae2d-4b44-abed-cf88e94d1482 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:42.678698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0083478-ae2d-4b44-abed-cf88e94d1482 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:42.994553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f2ee332e-68d1-4312-87f6-cdd66cbdbc8e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:43.009657 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f2ee332e-68d1-4312-87f6-cdd66cbdbc8e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1512 microversion: 2.1 time: 0.576925 May 28 04:54:43.010582 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2608/5095] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:42 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1512 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:43.104157 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e0083478-ae2d-4b44-abed-cf88e94d1482 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1834 microversion: 2.1 time: 0.449214 May 28 04:54:43.105349 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2488/5096] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:42 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1834 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:43.128997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-267b4e6e-e128-4389-8380-cc07b40a3058 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:43.141072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-267b4e6e-e128-4389-8380-cc07b40a3058 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:43.152442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-267b4e6e-e128-4389-8380-cc07b40a3058 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:43.152962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-267b4e6e-e128-4389-8380-cc07b40a3058 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:43.153728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-267b4e6e-e128-4389-8380-cc07b40a3058 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:43.154178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-267b4e6e-e128-4389-8380-cc07b40a3058 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:43.250609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f4284174-293b-4239-97e8-e086f4154d99 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:43.252155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f4284174-293b-4239-97e8-e086f4154d99 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:43.279148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4284174-293b-4239-97e8-e086f4154d99 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:43.279148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4284174-293b-4239-97e8-e086f4154d99 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:43.279640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4284174-293b-4239-97e8-e086f4154d99 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:43.280258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4284174-293b-4239-97e8-e086f4154d99 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:43.436242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-267b4e6e-e128-4389-8380-cc07b40a3058 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:43.457413 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-267b4e6e-e128-4389-8380-cc07b40a3058 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1683 microversion: 2.1 time: 0.332168 May 28 04:54:43.467461 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2609/5097] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:43 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1683 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:43.493130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e353e662-35e1-4d4f-a496-8ea11e6c89ee tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:43.493809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e353e662-35e1-4d4f-a496-8ea11e6c89ee tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:43.509289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e353e662-35e1-4d4f-a496-8ea11e6c89ee tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:43.509785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e353e662-35e1-4d4f-a496-8ea11e6c89ee tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:43.520941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e353e662-35e1-4d4f-a496-8ea11e6c89ee tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:43.522798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e353e662-35e1-4d4f-a496-8ea11e6c89ee tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:43.789965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e353e662-35e1-4d4f-a496-8ea11e6c89ee tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:43.801228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e353e662-35e1-4d4f-a496-8ea11e6c89ee tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:43.806757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e353e662-35e1-4d4f-a496-8ea11e6c89ee tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:43.814663 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e353e662-35e1-4d4f-a496-8ea11e6c89ee tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.333554 May 28 04:54:43.816752 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2610/5098] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:43 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:54:43.923429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c91ea66d-6088-4566-8098-b7198ed41862 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:43.925369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c91ea66d-6088-4566-8098-b7198ed41862 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:43.951294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c91ea66d-6088-4566-8098-b7198ed41862 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:43.951727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c91ea66d-6088-4566-8098-b7198ed41862 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:43.952676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c91ea66d-6088-4566-8098-b7198ed41862 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:43.952983 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c91ea66d-6088-4566-8098-b7198ed41862 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:44.009692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f4284174-293b-4239-97e8-e086f4154d99 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:44.021125 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f4284174-293b-4239-97e8-e086f4154d99 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1528 microversion: 2.1 time: 0.775737 May 28 04:54:44.032377 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2489/5099] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:43 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1528 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:44.045116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bda7ef6d-9b8d-4853-aa69-14643e195c38 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:44.045757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bda7ef6d-9b8d-4853-aa69-14643e195c38 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:44.082596 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c91ea66d-6088-4566-8098-b7198ed41862 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0/action" status: 200 len: 32627 microversion: 2.1 time: 0.163504 May 28 04:54:44.084595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bda7ef6d-9b8d-4853-aa69-14643e195c38 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:44.089882 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2611/5100] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:43 2022] POST /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0/action => generated 32627 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:54:44.090760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bda7ef6d-9b8d-4853-aa69-14643e195c38 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:44.091800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bda7ef6d-9b8d-4853-aa69-14643e195c38 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:44.092422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bda7ef6d-9b8d-4853-aa69-14643e195c38 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:44.237496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5c7c6dc7-f7ae-4b9e-84a4-7f3bc35acf6b tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:44.239461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5c7c6dc7-f7ae-4b9e-84a4-7f3bc35acf6b tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:44.264355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c7c6dc7-f7ae-4b9e-84a4-7f3bc35acf6b tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:44.264870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c7c6dc7-f7ae-4b9e-84a4-7f3bc35acf6b tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:44.270035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c7c6dc7-f7ae-4b9e-84a4-7f3bc35acf6b tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:44.270533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c7c6dc7-f7ae-4b9e-84a4-7f3bc35acf6b tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:44.376184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5c7c6dc7-f7ae-4b9e-84a4-7f3bc35acf6b tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4a7f2c7703a244afa147d0e4d285996f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6006b8b336944d938f6c13700cd19eb6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:44.377938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5c7c6dc7-f7ae-4b9e-84a4-7f3bc35acf6b tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] [instance: 260294eb-db79-4280-a534-928afd9312d0] flavor_id is None. Assuming migration. {{(pid=126044) resize /opt/stack/nova/nova/compute/api.py:4142}} May 28 04:54:44.379129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5c7c6dc7-f7ae-4b9e-84a4-7f3bc35acf6b tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] [instance: 260294eb-db79-4280-a534-928afd9312d0] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126044) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 04:54:44.471964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bda7ef6d-9b8d-4853-aa69-14643e195c38 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:44.486794 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bda7ef6d-9b8d-4853-aa69-14643e195c38 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1512 microversion: 2.1 time: 0.453188 May 28 04:54:44.490697 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2490/5101] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:44 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1512 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:44.836252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4806a4cf-e738-4e53-949d-fe950f71f58c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:44.837415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4806a4cf-e738-4e53-949d-fe950f71f58c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:44.851767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4806a4cf-e738-4e53-949d-fe950f71f58c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:44.855616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4806a4cf-e738-4e53-949d-fe950f71f58c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:44.856864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4806a4cf-e738-4e53-949d-fe950f71f58c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:44.857479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4806a4cf-e738-4e53-949d-fe950f71f58c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:44.945042 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5c7c6dc7-f7ae-4b9e-84a4-7f3bc35acf6b tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0/action" status: 202 len: 0 microversion: 2.1 time: 0.711780 May 28 04:54:44.946252 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2612/5102] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:54:44 2022] POST /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0/action => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:54:44.961907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c519cb1e-2c3c-4095-b417-9c7562c81789 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:44.963011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c519cb1e-2c3c-4095-b417-9c7562c81789 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:44.982540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c519cb1e-2c3c-4095-b417-9c7562c81789 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:44.984573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c519cb1e-2c3c-4095-b417-9c7562c81789 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:44.987678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c519cb1e-2c3c-4095-b417-9c7562c81789 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:44.987678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c519cb1e-2c3c-4095-b417-9c7562c81789 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:45.095471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4806a4cf-e738-4e53-949d-fe950f71f58c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:45.108346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4806a4cf-e738-4e53-949d-fe950f71f58c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:45.132974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4806a4cf-e738-4e53-949d-fe950f71f58c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:45.138939 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4806a4cf-e738-4e53-949d-fe950f71f58c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.306132 May 28 04:54:45.143997 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2491/5103] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:44 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:54:45.160832 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-40d2c9ce-c3f4-42c5-b5b2-0cfc22a8bfc4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:45.165031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-40d2c9ce-c3f4-42c5-b5b2-0cfc22a8bfc4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:45.183361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40d2c9ce-c3f4-42c5-b5b2-0cfc22a8bfc4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:45.190527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40d2c9ce-c3f4-42c5-b5b2-0cfc22a8bfc4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:45.194224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40d2c9ce-c3f4-42c5-b5b2-0cfc22a8bfc4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:45.194858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40d2c9ce-c3f4-42c5-b5b2-0cfc22a8bfc4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:45.770915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c519cb1e-2c3c-4095-b417-9c7562c81789 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:45.789787 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c519cb1e-2c3c-4095-b417-9c7562c81789 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1692 microversion: 2.1 time: 0.832662 May 28 04:54:45.807113 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2613/5104] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:44 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1692 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:45.826279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b0aedaf5-031f-45c9-9071-d654199c7e42 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:45.826983 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b0aedaf5-031f-45c9-9071-d654199c7e42 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:45.848910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0aedaf5-031f-45c9-9071-d654199c7e42 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:45.849411 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0aedaf5-031f-45c9-9071-d654199c7e42 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:45.850262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0aedaf5-031f-45c9-9071-d654199c7e42 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:45.850713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0aedaf5-031f-45c9-9071-d654199c7e42 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:45.879084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-40d2c9ce-c3f4-42c5-b5b2-0cfc22a8bfc4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:45.887582 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-40d2c9ce-c3f4-42c5-b5b2-0cfc22a8bfc4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1528 microversion: 2.1 time: 0.742305 May 28 04:54:45.888187 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2492/5105] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:45 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1528 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:45.911474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-52565984-2034-48ae-9bee-ae26d261bce8 req-43d5c970-45bf-4a00-9ed5-6b13d199b267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58022ec6-f4eb-4564-bed0-c3edd1d0daf4", "name": "network-vif-plugged", "status": "completed", "tag": "d2dc44c4-b245-41ae-bb82-8a262f7181c5"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:45.952060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-52565984-2034-48ae-9bee-ae26d261bce8 req-43d5c970-45bf-4a00-9ed5-6b13d199b267 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:45.952727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-52565984-2034-48ae-9bee-ae26d261bce8 req-43d5c970-45bf-4a00-9ed5-6b13d199b267 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:45.988340 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-52565984-2034-48ae-9bee-ae26d261bce8 req-43d5c970-45bf-4a00-9ed5-6b13d199b267 service nova] Creating event network-vif-plugged:d2dc44c4-b245-41ae-bb82-8a262f7181c5 for instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 on n-h1-843700-1 May 28 04:54:46.003763 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-52565984-2034-48ae-9bee-ae26d261bce8 req-43d5c970-45bf-4a00-9ed5-6b13d199b267 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099946 May 28 04:54:46.017152 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2493/5106] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:54:46.154761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b0aedaf5-031f-45c9-9071-d654199c7e42 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:46.178072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fb5e9a1e-f4b6-4e29-ae35-33aeffe76da1 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:46.187432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fb5e9a1e-f4b6-4e29-ae35-33aeffe76da1 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:46.202548 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b0aedaf5-031f-45c9-9071-d654199c7e42 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1512 microversion: 2.1 time: 0.390958 May 28 04:54:46.203221 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2614/5107] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:45 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1512 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:46.210539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fb5e9a1e-f4b6-4e29-ae35-33aeffe76da1 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:46.212699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fb5e9a1e-f4b6-4e29-ae35-33aeffe76da1 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:46.214933 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fb5e9a1e-f4b6-4e29-ae35-33aeffe76da1 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:46.216812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fb5e9a1e-f4b6-4e29-ae35-33aeffe76da1 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:46.357736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fb5e9a1e-f4b6-4e29-ae35-33aeffe76da1 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:46.373044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fb5e9a1e-f4b6-4e29-ae35-33aeffe76da1 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:46.379106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fb5e9a1e-f4b6-4e29-ae35-33aeffe76da1 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:46.380979 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fb5e9a1e-f4b6-4e29-ae35-33aeffe76da1 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.223811 May 28 04:54:46.383371 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2494/5108] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:46 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:54:46.811942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-14a58c73-6c3c-4577-b091-ed7f6bf06bf7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:46.814018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-14a58c73-6c3c-4577-b091-ed7f6bf06bf7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:46.879109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14a58c73-6c3c-4577-b091-ed7f6bf06bf7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:46.890685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14a58c73-6c3c-4577-b091-ed7f6bf06bf7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:46.894122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14a58c73-6c3c-4577-b091-ed7f6bf06bf7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:46.896576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14a58c73-6c3c-4577-b091-ed7f6bf06bf7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:46.919970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5a7e1b90-6811-4187-815f-c03c6b76d534 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:46.919970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5a7e1b90-6811-4187-815f-c03c6b76d534 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:46.939118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a7e1b90-6811-4187-815f-c03c6b76d534 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:46.944215 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a7e1b90-6811-4187-815f-c03c6b76d534 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:46.948913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a7e1b90-6811-4187-815f-c03c6b76d534 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:46.950660 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a7e1b90-6811-4187-815f-c03c6b76d534 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:47.826539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-14a58c73-6c3c-4577-b091-ed7f6bf06bf7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:47.846405 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-14a58c73-6c3c-4577-b091-ed7f6bf06bf7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1692 microversion: 2.1 time: 1.033857 May 28 04:54:47.847450 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2615/5109] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:46 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1692 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:47.852396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e5021428-1580-4d33-bacb-723989aa81c1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:47.853016 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e5021428-1580-4d33-bacb-723989aa81c1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:47.895656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5021428-1580-4d33-bacb-723989aa81c1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:47.896119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5021428-1580-4d33-bacb-723989aa81c1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:47.902327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5021428-1580-4d33-bacb-723989aa81c1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:47.906269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5021428-1580-4d33-bacb-723989aa81c1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:47.910186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5a7e1b90-6811-4187-815f-c03c6b76d534 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:47.925644 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5a7e1b90-6811-4187-815f-c03c6b76d534 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1528 microversion: 2.1 time: 1.023076 May 28 04:54:47.931167 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2495/5110] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:46 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1528 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:47.943602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-133b50cc-c103-465b-ae28-1bc97ec7d5d3 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:47.944459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-133b50cc-c103-465b-ae28-1bc97ec7d5d3 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:47.957730 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-133b50cc-c103-465b-ae28-1bc97ec7d5d3 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:47.958703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-133b50cc-c103-465b-ae28-1bc97ec7d5d3 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:47.960144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-133b50cc-c103-465b-ae28-1bc97ec7d5d3 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:47.960919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-133b50cc-c103-465b-ae28-1bc97ec7d5d3 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:48.076808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-133b50cc-c103-465b-ae28-1bc97ec7d5d3 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:48.103288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-133b50cc-c103-465b-ae28-1bc97ec7d5d3 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:48.107641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-133b50cc-c103-465b-ae28-1bc97ec7d5d3 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:48.110255 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-133b50cc-c103-465b-ae28-1bc97ec7d5d3 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.177766 May 28 04:54:48.121384 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2496/5111] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:47 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:54:48.496462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e5021428-1580-4d33-bacb-723989aa81c1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:48.504423 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e5021428-1580-4d33-bacb-723989aa81c1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1512 microversion: 2.1 time: 0.655853 May 28 04:54:48.515350 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2616/5112] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:47 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1512 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:48.864508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a31d0434-8c51-4a3a-a1f7-32ffe042ee54 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:48.865692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a31d0434-8c51-4a3a-a1f7-32ffe042ee54 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:48.882529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a31d0434-8c51-4a3a-a1f7-32ffe042ee54 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:48.884492 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a31d0434-8c51-4a3a-a1f7-32ffe042ee54 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:48.894129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a31d0434-8c51-4a3a-a1f7-32ffe042ee54 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:48.896325 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a31d0434-8c51-4a3a-a1f7-32ffe042ee54 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:48.951885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9473339d-af35-44a2-b679-9f7017c7a72a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:48.952636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9473339d-af35-44a2-b679-9f7017c7a72a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:48.980512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9473339d-af35-44a2-b679-9f7017c7a72a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:48.983815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9473339d-af35-44a2-b679-9f7017c7a72a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:48.986258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9473339d-af35-44a2-b679-9f7017c7a72a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:48.988002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9473339d-af35-44a2-b679-9f7017c7a72a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:49.483125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a31d0434-8c51-4a3a-a1f7-32ffe042ee54 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:49.503735 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a31d0434-8c51-4a3a-a1f7-32ffe042ee54 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1692 microversion: 2.1 time: 0.643236 May 28 04:54:49.510435 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2497/5113] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:48 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1692 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:49.522517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ef8ba8ff-024b-4df3-b8b2-d8a0fd016cbc tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:49.527900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ef8ba8ff-024b-4df3-b8b2-d8a0fd016cbc tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:49.544478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ef8ba8ff-024b-4df3-b8b2-d8a0fd016cbc tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:49.544936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ef8ba8ff-024b-4df3-b8b2-d8a0fd016cbc tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:49.553789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ef8ba8ff-024b-4df3-b8b2-d8a0fd016cbc tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:49.554290 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ef8ba8ff-024b-4df3-b8b2-d8a0fd016cbc tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:49.601494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9473339d-af35-44a2-b679-9f7017c7a72a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:49.615902 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9473339d-af35-44a2-b679-9f7017c7a72a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1528 microversion: 2.1 time: 0.670546 May 28 04:54:49.617923 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2617/5114] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:48 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1528 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:49.625133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d878a17f-264a-4982-822f-8d9de729f2b4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:49.626201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d878a17f-264a-4982-822f-8d9de729f2b4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:49.635047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d878a17f-264a-4982-822f-8d9de729f2b4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:49.635962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d878a17f-264a-4982-822f-8d9de729f2b4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:49.638213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d878a17f-264a-4982-822f-8d9de729f2b4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:49.640007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d878a17f-264a-4982-822f-8d9de729f2b4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:49.692516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:54:49.708098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ef8ba8ff-024b-4df3-b8b2-d8a0fd016cbc tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:49.725137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ef8ba8ff-024b-4df3-b8b2-d8a0fd016cbc tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:49.727337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ef8ba8ff-024b-4df3-b8b2-d8a0fd016cbc tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:49.733628 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ef8ba8ff-024b-4df3-b8b2-d8a0fd016cbc tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.218622 May 28 04:54:49.740128 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2498/5115] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:49 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:54:49.992412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d878a17f-264a-4982-822f-8d9de729f2b4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:50.006913 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d878a17f-264a-4982-822f-8d9de729f2b4 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1512 microversion: 2.1 time: 0.386878 May 28 04:54:50.010783 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2618/5116] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:49 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1512 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:50.521647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c3460bda-ee4b-4419-859b-a75e5329656d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:50.522303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c3460bda-ee4b-4419-859b-a75e5329656d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:50.533378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3460bda-ee4b-4419-859b-a75e5329656d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:50.535013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3460bda-ee4b-4419-859b-a75e5329656d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:50.537510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3460bda-ee4b-4419-859b-a75e5329656d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:50.540798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3460bda-ee4b-4419-859b-a75e5329656d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:50.638381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d5ccca3f-133a-4d85-88f3-4a05a514e291 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:50.639037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d5ccca3f-133a-4d85-88f3-4a05a514e291 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:50.671479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5ccca3f-133a-4d85-88f3-4a05a514e291 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:50.673766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5ccca3f-133a-4d85-88f3-4a05a514e291 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:50.680364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5ccca3f-133a-4d85-88f3-4a05a514e291 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:50.680978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5ccca3f-133a-4d85-88f3-4a05a514e291 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:50.923621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c3460bda-ee4b-4419-859b-a75e5329656d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:50.940843 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c3460bda-ee4b-4419-859b-a75e5329656d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1692 microversion: 2.1 time: 0.423330 May 28 04:54:50.958587 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2499/5117] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:50 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1692 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:50.989121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-23ccc244-b20d-44f9-b07d-7bb982b69928 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:50.990433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-23ccc244-b20d-44f9-b07d-7bb982b69928 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:51.034313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23ccc244-b20d-44f9-b07d-7bb982b69928 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:51.036019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23ccc244-b20d-44f9-b07d-7bb982b69928 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:51.038652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23ccc244-b20d-44f9-b07d-7bb982b69928 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:51.050429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23ccc244-b20d-44f9-b07d-7bb982b69928 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:51.336704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-23ccc244-b20d-44f9-b07d-7bb982b69928 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:51.350414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-23ccc244-b20d-44f9-b07d-7bb982b69928 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:51.352813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-23ccc244-b20d-44f9-b07d-7bb982b69928 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:51.356662 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-23ccc244-b20d-44f9-b07d-7bb982b69928 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.396956 May 28 04:54:51.359951 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2500/5118] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:50 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:54:51.375820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dcd69c15-5e6d-4729-8072-bae3e2de8797 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:51.376464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dcd69c15-5e6d-4729-8072-bae3e2de8797 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:51.397993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dcd69c15-5e6d-4729-8072-bae3e2de8797 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:51.397993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dcd69c15-5e6d-4729-8072-bae3e2de8797 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:51.401021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dcd69c15-5e6d-4729-8072-bae3e2de8797 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:51.401718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dcd69c15-5e6d-4729-8072-bae3e2de8797 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:51.496822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d5ccca3f-133a-4d85-88f3-4a05a514e291 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:51.509425 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d5ccca3f-133a-4d85-88f3-4a05a514e291 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1528 microversion: 2.1 time: 0.879400 May 28 04:54:51.512287 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2619/5119] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:50 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1528 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:51.914060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dcd69c15-5e6d-4729-8072-bae3e2de8797 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:51.922070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:54:51.936759 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dcd69c15-5e6d-4729-8072-bae3e2de8797 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1512 microversion: 2.1 time: 0.575471 May 28 04:54:51.938712 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2501/5120] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:51 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1512 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:51.962283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-feaaca30-d29e-48e2-be1c-e53542d93a0c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:51.962283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-feaaca30-d29e-48e2-be1c-e53542d93a0c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:51.981598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-feaaca30-d29e-48e2-be1c-e53542d93a0c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:51.982055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-feaaca30-d29e-48e2-be1c-e53542d93a0c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:51.982843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-feaaca30-d29e-48e2-be1c-e53542d93a0c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:51.983306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-feaaca30-d29e-48e2-be1c-e53542d93a0c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:52.378162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-db1706b0-820c-4056-92ca-5746f5b4bb89 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:52.378780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-db1706b0-820c-4056-92ca-5746f5b4bb89 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:52.385673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db1706b0-820c-4056-92ca-5746f5b4bb89 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:52.386286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db1706b0-820c-4056-92ca-5746f5b4bb89 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:52.399889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db1706b0-820c-4056-92ca-5746f5b4bb89 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:52.400526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-feaaca30-d29e-48e2-be1c-e53542d93a0c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:52.400706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db1706b0-820c-4056-92ca-5746f5b4bb89 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:52.412745 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-feaaca30-d29e-48e2-be1c-e53542d93a0c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1692 microversion: 2.1 time: 0.458881 May 28 04:54:52.429135 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2620/5121] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:51 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1692 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:52.529799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-03856967-405b-4e73-a7cc-3472719a2dd9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:52.531442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-03856967-405b-4e73-a7cc-3472719a2dd9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:52.544824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03856967-405b-4e73-a7cc-3472719a2dd9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:52.550284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03856967-405b-4e73-a7cc-3472719a2dd9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:52.554120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03856967-405b-4e73-a7cc-3472719a2dd9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:52.555922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03856967-405b-4e73-a7cc-3472719a2dd9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:52.646821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-db1706b0-820c-4056-92ca-5746f5b4bb89 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:52.669527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-db1706b0-820c-4056-92ca-5746f5b4bb89 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:52.669527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-db1706b0-820c-4056-92ca-5746f5b4bb89 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:52.672605 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-db1706b0-820c-4056-92ca-5746f5b4bb89 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.298457 May 28 04:54:52.676402 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2502/5122] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:52 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:54:52.943074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-03856967-405b-4e73-a7cc-3472719a2dd9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:52.958783 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-03856967-405b-4e73-a7cc-3472719a2dd9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1528 microversion: 2.1 time: 0.432875 May 28 04:54:52.960679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-daae10a0-757e-47ed-8252-058563930799 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:52.962705 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2621/5123] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:52 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1528 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:52.976182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-daae10a0-757e-47ed-8252-058563930799 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:52.988352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-daae10a0-757e-47ed-8252-058563930799 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:52.989850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-daae10a0-757e-47ed-8252-058563930799 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:52.990719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-daae10a0-757e-47ed-8252-058563930799 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:52.994432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-daae10a0-757e-47ed-8252-058563930799 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:53.321864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-daae10a0-757e-47ed-8252-058563930799 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:53.335598 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-daae10a0-757e-47ed-8252-058563930799 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1512 microversion: 2.1 time: 0.375025 May 28 04:54:53.349973 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2503/5124] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:52 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1512 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:53.438028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-de0ef178-198b-4954-9596-fb1f98840f02 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:53.439164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-de0ef178-198b-4954-9596-fb1f98840f02 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:53.464636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de0ef178-198b-4954-9596-fb1f98840f02 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:53.467343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de0ef178-198b-4954-9596-fb1f98840f02 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:53.471725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de0ef178-198b-4954-9596-fb1f98840f02 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:53.472190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de0ef178-198b-4954-9596-fb1f98840f02 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:53.693114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9547a9f8-9f48-485b-99d9-551f6dcd7994 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:53.694049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9547a9f8-9f48-485b-99d9-551f6dcd7994 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:53.708965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9547a9f8-9f48-485b-99d9-551f6dcd7994 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:53.713996 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9547a9f8-9f48-485b-99d9-551f6dcd7994 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:53.715586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9547a9f8-9f48-485b-99d9-551f6dcd7994 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:53.715586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9547a9f8-9f48-485b-99d9-551f6dcd7994 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:53.896238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-de0ef178-198b-4954-9596-fb1f98840f02 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:53.914944 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-de0ef178-198b-4954-9596-fb1f98840f02 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1692 microversion: 2.1 time: 0.475971 May 28 04:54:53.915656 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2622/5125] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:53 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1692 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:53.932906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9547a9f8-9f48-485b-99d9-551f6dcd7994 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:53.943855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9547a9f8-9f48-485b-99d9-551f6dcd7994 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:53.957854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9547a9f8-9f48-485b-99d9-551f6dcd7994 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:53.960014 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9547a9f8-9f48-485b-99d9-551f6dcd7994 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.270422 May 28 04:54:53.971734 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2504/5126] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:53 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:54:53.979239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-51fb05d5-4c27-4add-8a6c-8aa7115aeeaa tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:53.983495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-51fb05d5-4c27-4add-8a6c-8aa7115aeeaa tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:53.992318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51fb05d5-4c27-4add-8a6c-8aa7115aeeaa tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:53.994841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51fb05d5-4c27-4add-8a6c-8aa7115aeeaa tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:53.997710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51fb05d5-4c27-4add-8a6c-8aa7115aeeaa tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:53.998801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51fb05d5-4c27-4add-8a6c-8aa7115aeeaa tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:54.279907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-51fb05d5-4c27-4add-8a6c-8aa7115aeeaa tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:54.289160 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-51fb05d5-4c27-4add-8a6c-8aa7115aeeaa tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1528 microversion: 2.1 time: 0.315306 May 28 04:54:54.295679 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2623/5127] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:53 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1528 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:54:54.360252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-644f4a26-1081-44e5-baa5-48fe69ba4c6e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:54.361143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-644f4a26-1081-44e5-baa5-48fe69ba4c6e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:54.369499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-644f4a26-1081-44e5-baa5-48fe69ba4c6e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:54.370302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-644f4a26-1081-44e5-baa5-48fe69ba4c6e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:54.372235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-644f4a26-1081-44e5-baa5-48fe69ba4c6e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:54.374778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-644f4a26-1081-44e5-baa5-48fe69ba4c6e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:54.627744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-644f4a26-1081-44e5-baa5-48fe69ba4c6e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:54.656673 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-644f4a26-1081-44e5-baa5-48fe69ba4c6e tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1512 microversion: 2.1 time: 0.303171 May 28 04:54:54.676833 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2505/5128] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:54 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1512 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:54.932946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7f6856e0-51ab-4ed0-8611-6442c0c21af1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:54.933634 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7f6856e0-51ab-4ed0-8611-6442c0c21af1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:54.947305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f6856e0-51ab-4ed0-8611-6442c0c21af1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:54.947769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f6856e0-51ab-4ed0-8611-6442c0c21af1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:54.953837 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f6856e0-51ab-4ed0-8611-6442c0c21af1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:54.957445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f6856e0-51ab-4ed0-8611-6442c0c21af1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:54.978912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-34f9e240-07bf-4af3-8a62-9fbeeb26ee65 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:54.981037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-34f9e240-07bf-4af3-8a62-9fbeeb26ee65 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:54.999846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34f9e240-07bf-4af3-8a62-9fbeeb26ee65 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:55.000312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34f9e240-07bf-4af3-8a62-9fbeeb26ee65 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:55.010008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34f9e240-07bf-4af3-8a62-9fbeeb26ee65 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:55.011925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34f9e240-07bf-4af3-8a62-9fbeeb26ee65 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:55.281111 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-34f9e240-07bf-4af3-8a62-9fbeeb26ee65 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:55.293169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-34f9e240-07bf-4af3-8a62-9fbeeb26ee65 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:55.309023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-34f9e240-07bf-4af3-8a62-9fbeeb26ee65 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:55.313360 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-34f9e240-07bf-4af3-8a62-9fbeeb26ee65 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.338582 May 28 04:54:55.314460 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2506/5129] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:54 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:54:55.438869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7f6856e0-51ab-4ed0-8611-6442c0c21af1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:55.447329 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7f6856e0-51ab-4ed0-8611-6442c0c21af1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1692 microversion: 2.1 time: 0.518817 May 28 04:54:55.452611 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2624/5130] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:54 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1692 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:55.465751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c7c88605-e464-4c92-b37d-b3ab5310da22 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:55.466627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c7c88605-e464-4c92-b37d-b3ab5310da22 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:55.481463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c7c88605-e464-4c92-b37d-b3ab5310da22 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:55.484141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c7c88605-e464-4c92-b37d-b3ab5310da22 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:55.486940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c7c88605-e464-4c92-b37d-b3ab5310da22 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:55.489311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c7c88605-e464-4c92-b37d-b3ab5310da22 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:55.732665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c7c88605-e464-4c92-b37d-b3ab5310da22 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:55.741436 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c7c88605-e464-4c92-b37d-b3ab5310da22 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1528 microversion: 2.1 time: 0.280105 May 28 04:54:55.742285 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2625/5131] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:55 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1528 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:55.748449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-66fd3683-893c-4a18-8234-a4a75b8a3fe1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:55.749229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-66fd3683-893c-4a18-8234-a4a75b8a3fe1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:55.756937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66fd3683-893c-4a18-8234-a4a75b8a3fe1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:55.758824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66fd3683-893c-4a18-8234-a4a75b8a3fe1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:55.759323 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66fd3683-893c-4a18-8234-a4a75b8a3fe1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:55.759913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66fd3683-893c-4a18-8234-a4a75b8a3fe1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:55.817816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1b376abd-31f1-4723-b4c9-aae3c05b36e8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1584194518", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:55.978554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-1b376abd-31f1-4723-b4c9-aae3c05b36e8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] validate_networks() for [('d63ab384-ad3a-43f9-a13d-6556ad80eb46', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:54:56.275387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-66fd3683-893c-4a18-8234-a4a75b8a3fe1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:56.291067 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-66fd3683-893c-4a18-8234-a4a75b8a3fe1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1512 microversion: 2.1 time: 0.541202 May 28 04:54:56.291677 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2626/5132] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:55 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1512 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:56.335660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5a88ee97-4a3e-4c0d-86e0-319698df00db tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:56.336771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5a88ee97-4a3e-4c0d-86e0-319698df00db tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:56.357029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a88ee97-4a3e-4c0d-86e0-319698df00db tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:56.358437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a88ee97-4a3e-4c0d-86e0-319698df00db tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:56.363100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a88ee97-4a3e-4c0d-86e0-319698df00db tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:56.364513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a88ee97-4a3e-4c0d-86e0-319698df00db tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:56.613722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5a88ee97-4a3e-4c0d-86e0-319698df00db tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:56.629165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5a88ee97-4a3e-4c0d-86e0-319698df00db tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:56.644316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5a88ee97-4a3e-4c0d-86e0-319698df00db tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:56.644316 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5a88ee97-4a3e-4c0d-86e0-319698df00db tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.312255 May 28 04:54:56.644316 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2627/5133] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:56 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:54:56.649604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aabbd5d1-303a-49b6-8ee8-86a8a228bb95 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:56.650645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aabbd5d1-303a-49b6-8ee8-86a8a228bb95 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:56.658958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aabbd5d1-303a-49b6-8ee8-86a8a228bb95 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:56.660091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aabbd5d1-303a-49b6-8ee8-86a8a228bb95 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:56.661572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aabbd5d1-303a-49b6-8ee8-86a8a228bb95 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:56.662268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aabbd5d1-303a-49b6-8ee8-86a8a228bb95 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:57.170107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-1b376abd-31f1-4723-b4c9-aae3c05b36e8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:54:57.172066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-1b376abd-31f1-4723-b4c9-aae3c05b36e8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:54:57.172813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-1b376abd-31f1-4723-b4c9-aae3c05b36e8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:54:57.174352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-1b376abd-31f1-4723-b4c9-aae3c05b36e8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:54:57.175243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-1b376abd-31f1-4723-b4c9-aae3c05b36e8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:54:57.211969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b376abd-31f1-4723-b4c9-aae3c05b36e8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:57.216454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b376abd-31f1-4723-b4c9-aae3c05b36e8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:57.218192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b376abd-31f1-4723-b4c9-aae3c05b36e8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:57.222328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b376abd-31f1-4723-b4c9-aae3c05b36e8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:57.304135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-1b376abd-31f1-4723-b4c9-aae3c05b36e8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Getting quotas for project f043f5d6fc0a47429a445d8f25401570. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:54:57.311822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-1b376abd-31f1-4723-b4c9-aae3c05b36e8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Getting quotas for user 227be762b2bc4bbba6d3e3e9a1d28c9c and project f043f5d6fc0a47429a445d8f25401570. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:54:57.340751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1b376abd-31f1-4723-b4c9-aae3c05b36e8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:54:57.342910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aabbd5d1-303a-49b6-8ee8-86a8a228bb95 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:57.348518 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1b376abd-31f1-4723-b4c9-aae3c05b36e8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:54:57.352346 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aabbd5d1-303a-49b6-8ee8-86a8a228bb95 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1697 microversion: 2.1 time: 0.708050 May 28 04:54:57.354511 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2628/5134] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:56 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1697 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:57.377389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ce732a95-c77a-46bc-bcce-2f805c47d4a5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:57.378404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ce732a95-c77a-46bc-bcce-2f805c47d4a5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:57.397773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce732a95-c77a-46bc-bcce-2f805c47d4a5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:57.399909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce732a95-c77a-46bc-bcce-2f805c47d4a5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:57.401941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce732a95-c77a-46bc-bcce-2f805c47d4a5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:57.403667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce732a95-c77a-46bc-bcce-2f805c47d4a5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:57.562447 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1b376abd-31f1-4723-b4c9-aae3c05b36e8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.243228 May 28 04:54:57.563396 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2507/5135] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:54:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 2245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:54:57.580296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-71ed1c32-6ff3-432e-a4b3-b86f53796f94 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:57.588224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-71ed1c32-6ff3-432e-a4b3-b86f53796f94 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:57.613113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71ed1c32-6ff3-432e-a4b3-b86f53796f94 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:57.613526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71ed1c32-6ff3-432e-a4b3-b86f53796f94 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:57.614305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71ed1c32-6ff3-432e-a4b3-b86f53796f94 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:57.646340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71ed1c32-6ff3-432e-a4b3-b86f53796f94 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:57.895469 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ce732a95-c77a-46bc-bcce-2f805c47d4a5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:57.905239 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ce732a95-c77a-46bc-bcce-2f805c47d4a5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1528 microversion: 2.1 time: 0.549183 May 28 04:54:57.920319 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2629/5136] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:57 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1528 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:57.924735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e66b1229-e530-48f6-aa1a-fd9c9363f36c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:57.925379 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e66b1229-e530-48f6-aa1a-fd9c9363f36c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:58.026531 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-71ed1c32-6ff3-432e-a4b3-b86f53796f94 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:58.051107 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-71ed1c32-6ff3-432e-a4b3-b86f53796f94 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1512 microversion: 2.1 time: 0.481279 May 28 04:54:58.053892 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2508/5137] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:57 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1512 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:58.068717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-59fb88d8-1553-4c71-855b-6938480a4f10 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:58.072008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-59fb88d8-1553-4c71-855b-6938480a4f10 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:58.083295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59fb88d8-1553-4c71-855b-6938480a4f10 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:58.084305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59fb88d8-1553-4c71-855b-6938480a4f10 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:58.086684 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59fb88d8-1553-4c71-855b-6938480a4f10 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:58.087271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e66b1229-e530-48f6-aa1a-fd9c9363f36c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:58.088019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59fb88d8-1553-4c71-855b-6938480a4f10 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:58.099692 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e66b1229-e530-48f6-aa1a-fd9c9363f36c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1222 microversion: 2.1 time: 0.186582 May 28 04:54:58.100612 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2630/5138] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:57 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1222 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:58.326888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-59fb88d8-1553-4c71-855b-6938480a4f10 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:58.326888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-59fb88d8-1553-4c71-855b-6938480a4f10 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:58.326888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-59fb88d8-1553-4c71-855b-6938480a4f10 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:58.326888 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-59fb88d8-1553-4c71-855b-6938480a4f10 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.180615 May 28 04:54:58.326888 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2509/5139] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:58 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:54:58.328496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4083832f-be91-4478-9fd5-f002379f835c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-415483325", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:54:58.369344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-4083832f-be91-4478-9fd5-f002379f835c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] validate_networks() for [('d63ab384-ad3a-43f9-a13d-6556ad80eb46', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:54:58.373627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a3750148-ee05-4b53-8103-fe6c0ece4543 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:58.374583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a3750148-ee05-4b53-8103-fe6c0ece4543 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:58.383543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3750148-ee05-4b53-8103-fe6c0ece4543 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:58.384625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3750148-ee05-4b53-8103-fe6c0ece4543 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:58.385535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3750148-ee05-4b53-8103-fe6c0ece4543 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:58.386255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3750148-ee05-4b53-8103-fe6c0ece4543 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:58.878031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a3750148-ee05-4b53-8103-fe6c0ece4543 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:58.894728 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a3750148-ee05-4b53-8103-fe6c0ece4543 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1697 microversion: 2.1 time: 0.527315 May 28 04:54:58.897525 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2510/5140] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:58 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1697 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:58.936057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-37421771-8faf-4446-bb87-222af3024ab5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:58.936846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-37421771-8faf-4446-bb87-222af3024ab5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:58.946387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-37421771-8faf-4446-bb87-222af3024ab5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:58.947199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-37421771-8faf-4446-bb87-222af3024ab5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:58.948887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-37421771-8faf-4446-bb87-222af3024ab5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:58.949523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-37421771-8faf-4446-bb87-222af3024ab5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:59.321487 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-37421771-8faf-4446-bb87-222af3024ab5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:59.331930 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-37421771-8faf-4446-bb87-222af3024ab5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1528 microversion: 2.1 time: 0.407445 May 28 04:54:59.332568 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2511/5141] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:58 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1528 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:59.358141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9ed0c9b1-0a3a-49ad-8316-354729fe83c5 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:59.360198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9ed0c9b1-0a3a-49ad-8316-354729fe83c5 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:59.372197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ed0c9b1-0a3a-49ad-8316-354729fe83c5 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:59.373888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ed0c9b1-0a3a-49ad-8316-354729fe83c5 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:59.375522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ed0c9b1-0a3a-49ad-8316-354729fe83c5 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:59.376508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ed0c9b1-0a3a-49ad-8316-354729fe83c5 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:59.443240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4083832f-be91-4478-9fd5-f002379f835c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:54:59.444560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4083832f-be91-4478-9fd5-f002379f835c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:54:59.445231 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4083832f-be91-4478-9fd5-f002379f835c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:54:59.445902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4083832f-be91-4478-9fd5-f002379f835c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:54:59.446563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4083832f-be91-4478-9fd5-f002379f835c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:54:59.466942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4083832f-be91-4478-9fd5-f002379f835c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:59.469662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4083832f-be91-4478-9fd5-f002379f835c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:59.470799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4083832f-be91-4478-9fd5-f002379f835c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:59.473794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4083832f-be91-4478-9fd5-f002379f835c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:59.506684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-4083832f-be91-4478-9fd5-f002379f835c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Getting quotas for project f043f5d6fc0a47429a445d8f25401570. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:54:59.513895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-4083832f-be91-4478-9fd5-f002379f835c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Getting quotas for user 227be762b2bc4bbba6d3e3e9a1d28c9c and project f043f5d6fc0a47429a445d8f25401570. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:54:59.529429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4083832f-be91-4478-9fd5-f002379f835c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:54:59.532588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4083832f-be91-4478-9fd5-f002379f835c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:54:59.683325 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4083832f-be91-4478-9fd5-f002379f835c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.380566 May 28 04:54:59.686569 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2631/5142] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:54:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:54:59.707330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3cd161eb-00df-4896-aef4-1f56f5c520c8 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:59.711095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3cd161eb-00df-4896-aef4-1f56f5c520c8 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:59.731279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3cd161eb-00df-4896-aef4-1f56f5c520c8 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:59.732056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3cd161eb-00df-4896-aef4-1f56f5c520c8 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:59.733788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3cd161eb-00df-4896-aef4-1f56f5c520c8 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:59.736276 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3cd161eb-00df-4896-aef4-1f56f5c520c8 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:59.799268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9ed0c9b1-0a3a-49ad-8316-354729fe83c5 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:59.807667 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9ed0c9b1-0a3a-49ad-8316-354729fe83c5 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1512 microversion: 2.1 time: 0.462660 May 28 04:54:59.809748 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2512/5143] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:59 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1512 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:59.833600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eba454c1-060e-4a57-bab6-ff42a58b5f95 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:59.834225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eba454c1-060e-4a57-bab6-ff42a58b5f95 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:59.922460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eba454c1-060e-4a57-bab6-ff42a58b5f95 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:59.931144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3cd161eb-00df-4896-aef4-1f56f5c520c8 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:59.939296 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eba454c1-060e-4a57-bab6-ff42a58b5f95 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1221 microversion: 2.1 time: 0.128434 May 28 04:54:59.954129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3cd161eb-00df-4896-aef4-1f56f5c520c8 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:59.962359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3cd161eb-00df-4896-aef4-1f56f5c520c8 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:54:59.962359 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3cd161eb-00df-4896-aef4-1f56f5c520c8 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.267541 May 28 04:54:59.962596 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2513/5144] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:59 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1221 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:54:59.962596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c719ed20-30de-403e-a1a7-9cca1871b32d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:54:59.975367 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2632/5145] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:54:59 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:54:59.976089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c719ed20-30de-403e-a1a7-9cca1871b32d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:54:59.983871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c719ed20-30de-403e-a1a7-9cca1871b32d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:59.984303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c719ed20-30de-403e-a1a7-9cca1871b32d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:54:59.985370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c719ed20-30de-403e-a1a7-9cca1871b32d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:54:59.986026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c719ed20-30de-403e-a1a7-9cca1871b32d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:00.348540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-283c5f14-d53b-4d8b-b51b-57f6868014a0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:00.349357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-283c5f14-d53b-4d8b-b51b-57f6868014a0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:00.361636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-283c5f14-d53b-4d8b-b51b-57f6868014a0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:00.362163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-283c5f14-d53b-4d8b-b51b-57f6868014a0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:00.363064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-283c5f14-d53b-4d8b-b51b-57f6868014a0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:00.367623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-283c5f14-d53b-4d8b-b51b-57f6868014a0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:00.809802 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-283c5f14-d53b-4d8b-b51b-57f6868014a0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:00.828830 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-283c5f14-d53b-4d8b-b51b-57f6868014a0 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1528 microversion: 2.1 time: 0.484091 May 28 04:55:00.834344 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2633/5146] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:00 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1528 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:00.846584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-51155373-45ba-4444-888d-7da20fa1e2a0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:00.850214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-51155373-45ba-4444-888d-7da20fa1e2a0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:00.857424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51155373-45ba-4444-888d-7da20fa1e2a0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:00.868809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c719ed20-30de-403e-a1a7-9cca1871b32d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:00.878875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51155373-45ba-4444-888d-7da20fa1e2a0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:00.880019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51155373-45ba-4444-888d-7da20fa1e2a0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:00.880587 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c719ed20-30de-403e-a1a7-9cca1871b32d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1697 microversion: 2.1 time: 0.919941 May 28 04:55:00.881405 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2514/5147] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:54:59 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1697 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:00.881898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51155373-45ba-4444-888d-7da20fa1e2a0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:00.957515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7a0b54fa-b418-492a-be52-d87c3c619fca tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:00.958220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7a0b54fa-b418-492a-be52-d87c3c619fca tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:01.156760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7a0b54fa-b418-492a-be52-d87c3c619fca tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:01.166094 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7a0b54fa-b418-492a-be52-d87c3c619fca tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1221 microversion: 2.1 time: 0.213265 May 28 04:55:01.184268 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2515/5148] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:00 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1221 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:01.193481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cdc25e0a-89d2-4d07-8e5c-a09b3f1c32f0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:01.200431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cdc25e0a-89d2-4d07-8e5c-a09b3f1c32f0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:01.223815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdc25e0a-89d2-4d07-8e5c-a09b3f1c32f0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:01.227645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdc25e0a-89d2-4d07-8e5c-a09b3f1c32f0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:01.228827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdc25e0a-89d2-4d07-8e5c-a09b3f1c32f0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:01.232154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdc25e0a-89d2-4d07-8e5c-a09b3f1c32f0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:01.406935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cdc25e0a-89d2-4d07-8e5c-a09b3f1c32f0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:01.417910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cdc25e0a-89d2-4d07-8e5c-a09b3f1c32f0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:01.422602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cdc25e0a-89d2-4d07-8e5c-a09b3f1c32f0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:01.422602 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cdc25e0a-89d2-4d07-8e5c-a09b3f1c32f0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.235702 May 28 04:55:01.423451 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2516/5149] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:55:01 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:55:01.424663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-51155373-45ba-4444-888d-7da20fa1e2a0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:01.433038 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-51155373-45ba-4444-888d-7da20fa1e2a0 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1489 microversion: 2.1 time: 0.597438 May 28 04:55:01.439958 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2634/5150] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:00 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1489 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:01.457506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6d731ee3-3ed8-4d95-8139-8bd2e14b1f4a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:01.457506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6d731ee3-3ed8-4d95-8139-8bd2e14b1f4a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:01.462977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6d731ee3-3ed8-4d95-8139-8bd2e14b1f4a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:01.464453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6d731ee3-3ed8-4d95-8139-8bd2e14b1f4a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:01.465505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6d731ee3-3ed8-4d95-8139-8bd2e14b1f4a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:01.479446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6d731ee3-3ed8-4d95-8139-8bd2e14b1f4a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:01.556385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6d731ee3-3ed8-4d95-8139-8bd2e14b1f4a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:55:01.850128 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-265de092-4918-41f4-b49f-b327f847872a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:01.851403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-265de092-4918-41f4-b49f-b327f847872a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:01.877755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-265de092-4918-41f4-b49f-b327f847872a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:01.878509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-265de092-4918-41f4-b49f-b327f847872a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:01.879633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-265de092-4918-41f4-b49f-b327f847872a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:01.880472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-265de092-4918-41f4-b49f-b327f847872a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:02.108949 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6d731ee3-3ed8-4d95-8139-8bd2e14b1f4a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 204 len: 0 microversion: 2.1 time: 0.659178 May 28 04:55:02.113896 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2517/5151] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:55:01 2022] DELETE /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 0 bytes in 662 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:55:02.125426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8c08c2a1-50be-49c6-8daf-aab5678f572b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:02.127675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8c08c2a1-50be-49c6-8daf-aab5678f572b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:02.142266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c08c2a1-50be-49c6-8daf-aab5678f572b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:02.145158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c08c2a1-50be-49c6-8daf-aab5678f572b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:02.148597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c08c2a1-50be-49c6-8daf-aab5678f572b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:02.149992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c08c2a1-50be-49c6-8daf-aab5678f572b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:02.282891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-265de092-4918-41f4-b49f-b327f847872a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:02.303828 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-265de092-4918-41f4-b49f-b327f847872a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1528 microversion: 2.1 time: 0.456724 May 28 04:55:02.316241 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2635/5152] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:01 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1528 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:02.323647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a68cb47c-c8cd-4193-93ea-803cfea8d918 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:02.324551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a68cb47c-c8cd-4193-93ea-803cfea8d918 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:02.347563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a68cb47c-c8cd-4193-93ea-803cfea8d918 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:02.349636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a68cb47c-c8cd-4193-93ea-803cfea8d918 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:02.351215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a68cb47c-c8cd-4193-93ea-803cfea8d918 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:02.352943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a68cb47c-c8cd-4193-93ea-803cfea8d918 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:02.403256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:02.860183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8c08c2a1-50be-49c6-8daf-aab5678f572b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:02.869398 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8c08c2a1-50be-49c6-8daf-aab5678f572b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1697 microversion: 2.1 time: 0.753782 May 28 04:55:02.882808 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2518/5153] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:02 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1697 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:02.898446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-43bca023-92fd-4b9b-96e2-9fc1d4f93b5b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:02.902766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-43bca023-92fd-4b9b-96e2-9fc1d4f93b5b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:02.921675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a68cb47c-c8cd-4193-93ea-803cfea8d918 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:02.936604 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a68cb47c-c8cd-4193-93ea-803cfea8d918 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1495 microversion: 2.1 time: 0.616163 May 28 04:55:02.947109 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2636/5154] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:02 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1495 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:02.956751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43bca023-92fd-4b9b-96e2-9fc1d4f93b5b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:02.957322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43bca023-92fd-4b9b-96e2-9fc1d4f93b5b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:02.958375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-803d6894-7deb-4033-bce0-1f94c9628803 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:02.958724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43bca023-92fd-4b9b-96e2-9fc1d4f93b5b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:02.959137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-803d6894-7deb-4033-bce0-1f94c9628803 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:02.959646 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43bca023-92fd-4b9b-96e2-9fc1d4f93b5b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:02.980967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-803d6894-7deb-4033-bce0-1f94c9628803 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:02.981636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-803d6894-7deb-4033-bce0-1f94c9628803 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:02.982621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-803d6894-7deb-4033-bce0-1f94c9628803 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:02.984771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-803d6894-7deb-4033-bce0-1f94c9628803 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:02.994436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:03.141306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-803d6894-7deb-4033-bce0-1f94c9628803 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:03.151797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-803d6894-7deb-4033-bce0-1f94c9628803 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:03.154935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-803d6894-7deb-4033-bce0-1f94c9628803 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:03.160513 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-803d6894-7deb-4033-bce0-1f94c9628803 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.215670 May 28 04:55:03.172966 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2637/5155] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:55:02 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:55:03.174315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-43bca023-92fd-4b9b-96e2-9fc1d4f93b5b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:03.185394 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-43bca023-92fd-4b9b-96e2-9fc1d4f93b5b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1217 microversion: 2.1 time: 0.290821 May 28 04:55:03.186059 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2519/5156] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:02 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1217 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:03.329844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-315f6b67-2923-468d-934c-a44af9e88c28 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:03.329844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-315f6b67-2923-468d-934c-a44af9e88c28 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:03.332384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-315f6b67-2923-468d-934c-a44af9e88c28 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:03.332384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-315f6b67-2923-468d-934c-a44af9e88c28 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:03.332796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-315f6b67-2923-468d-934c-a44af9e88c28 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:03.333140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-315f6b67-2923-468d-934c-a44af9e88c28 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:03.901534 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c5313bce-4d20-441c-8c5f-1246d34b59bd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:03.902242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c5313bce-4d20-441c-8c5f-1246d34b59bd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:03.923332 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:03.927565 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5313bce-4d20-441c-8c5f-1246d34b59bd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:03.928246 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5313bce-4d20-441c-8c5f-1246d34b59bd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:03.930001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5313bce-4d20-441c-8c5f-1246d34b59bd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:03.937110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c5313bce-4d20-441c-8c5f-1246d34b59bd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:04.245150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-315f6b67-2923-468d-934c-a44af9e88c28 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:04.275905 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-315f6b67-2923-468d-934c-a44af9e88c28 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1528 microversion: 2.1 time: 0.955836 May 28 04:55:04.277224 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2638/5157] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:03 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1528 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:04.286094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ce620ac7-67e4-4f2e-b6fb-b79da6206344 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:04.298347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ce620ac7-67e4-4f2e-b6fb-b79da6206344 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:04.333182 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce620ac7-67e4-4f2e-b6fb-b79da6206344 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:04.335035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce620ac7-67e4-4f2e-b6fb-b79da6206344 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:04.335035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce620ac7-67e4-4f2e-b6fb-b79da6206344 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:04.335035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce620ac7-67e4-4f2e-b6fb-b79da6206344 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:04.692867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c5313bce-4d20-441c-8c5f-1246d34b59bd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:04.700616 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c5313bce-4d20-441c-8c5f-1246d34b59bd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1697 microversion: 2.1 time: 0.804470 May 28 04:55:04.707158 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2520/5158] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:03 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1697 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:04.718178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8a0990d5-bbd8-452a-8f75-89620a1975c2 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:04.726379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8a0990d5-bbd8-452a-8f75-89620a1975c2 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:04.748385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a0990d5-bbd8-452a-8f75-89620a1975c2 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:04.750219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a0990d5-bbd8-452a-8f75-89620a1975c2 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:04.751248 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a0990d5-bbd8-452a-8f75-89620a1975c2 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:04.752573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a0990d5-bbd8-452a-8f75-89620a1975c2 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:05.070641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8a0990d5-bbd8-452a-8f75-89620a1975c2 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:05.079908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8a0990d5-bbd8-452a-8f75-89620a1975c2 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:05.085144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8a0990d5-bbd8-452a-8f75-89620a1975c2 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:05.096147 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8a0990d5-bbd8-452a-8f75-89620a1975c2 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.387664 May 28 04:55:05.096986 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2521/5159] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:55:04 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:55:05.106373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b8f1a185-c9df-44ad-b553-0cf3400c2af9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:05.107514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b8f1a185-c9df-44ad-b553-0cf3400c2af9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:05.124107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8f1a185-c9df-44ad-b553-0cf3400c2af9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:05.124853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8f1a185-c9df-44ad-b553-0cf3400c2af9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:05.125891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8f1a185-c9df-44ad-b553-0cf3400c2af9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:05.130622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ce620ac7-67e4-4f2e-b6fb-b79da6206344 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:05.137613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8f1a185-c9df-44ad-b553-0cf3400c2af9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:05.147666 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ce620ac7-67e4-4f2e-b6fb-b79da6206344 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1495 microversion: 2.1 time: 0.868769 May 28 04:55:05.148635 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2639/5160] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:04 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1495 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:05.293862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a496a376-7d88-4d90-b6af-67e1cb3e4e17 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:05.295580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a496a376-7d88-4d90-b6af-67e1cb3e4e17 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:05.305283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b8f1a185-c9df-44ad-b553-0cf3400c2af9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:05.314463 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b8f1a185-c9df-44ad-b553-0cf3400c2af9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1279 microversion: 2.1 time: 0.212380 May 28 04:55:05.328390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a496a376-7d88-4d90-b6af-67e1cb3e4e17 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:05.358748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a496a376-7d88-4d90-b6af-67e1cb3e4e17 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:05.359336 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2522/5161] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:05 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1279 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:05.360484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a496a376-7d88-4d90-b6af-67e1cb3e4e17 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:05.361161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a496a376-7d88-4d90-b6af-67e1cb3e4e17 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:05.532125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-edebb3bd-f14a-4997-8603-250de7db5301 req-c7bdb90b-bce8-492a-b2f5-b34575cdaf69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ddeac5b-bb14-4476-bf40-51def0581dda", "name": "network-vif-deleted", "tag": "d6968238-0889-4b2d-a132-38e72ea2a6f1"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:05.548067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-edebb3bd-f14a-4997-8603-250de7db5301 req-c7bdb90b-bce8-492a-b2f5-b34575cdaf69 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:05.548595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-edebb3bd-f14a-4997-8603-250de7db5301 req-c7bdb90b-bce8-492a-b2f5-b34575cdaf69 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:05.572302 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-edebb3bd-f14a-4997-8603-250de7db5301 req-c7bdb90b-bce8-492a-b2f5-b34575cdaf69 service nova] Creating event network-vif-deleted:d6968238-0889-4b2d-a132-38e72ea2a6f1 for instance 5ddeac5b-bb14-4476-bf40-51def0581dda on n-h1-843700-1 May 28 04:55:05.593846 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-edebb3bd-f14a-4997-8603-250de7db5301 req-c7bdb90b-bce8-492a-b2f5-b34575cdaf69 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065500 May 28 04:55:05.595303 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2523/5162] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:55:05.725174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-013a5985-57b4-41d8-a9fb-20429e43b7a9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:05.727942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-013a5985-57b4-41d8-a9fb-20429e43b7a9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:05.751091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-013a5985-57b4-41d8-a9fb-20429e43b7a9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:05.752343 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-013a5985-57b4-41d8-a9fb-20429e43b7a9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:05.754345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-013a5985-57b4-41d8-a9fb-20429e43b7a9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:05.755778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-013a5985-57b4-41d8-a9fb-20429e43b7a9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:05.970048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a496a376-7d88-4d90-b6af-67e1cb3e4e17 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:05.985884 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a496a376-7d88-4d90-b6af-67e1cb3e4e17 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1528 microversion: 2.1 time: 0.695148 May 28 04:55:05.986549 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2640/5163] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:05 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1528 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:55:06.118763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-27dee5d2-b6c4-4df0-8816-22d6fcc6dda6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:06.120464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-27dee5d2-b6c4-4df0-8816-22d6fcc6dda6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:06.141232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27dee5d2-b6c4-4df0-8816-22d6fcc6dda6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:06.141711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27dee5d2-b6c4-4df0-8816-22d6fcc6dda6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:06.142512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27dee5d2-b6c4-4df0-8816-22d6fcc6dda6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:06.145579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27dee5d2-b6c4-4df0-8816-22d6fcc6dda6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:06.332466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-27dee5d2-b6c4-4df0-8816-22d6fcc6dda6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:06.345757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-27dee5d2-b6c4-4df0-8816-22d6fcc6dda6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:06.349673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-27dee5d2-b6c4-4df0-8816-22d6fcc6dda6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:06.356287 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-27dee5d2-b6c4-4df0-8816-22d6fcc6dda6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.239065 May 28 04:55:06.357222 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2641/5164] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:55:06 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:55:06.379582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e1fee736-7e95-4461-a99e-b49bde383a4a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:06.380267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e1fee736-7e95-4461-a99e-b49bde383a4a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:06.382267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:06.382935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-013a5985-57b4-41d8-a9fb-20429e43b7a9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:06.396578 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-013a5985-57b4-41d8-a9fb-20429e43b7a9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1697 microversion: 2.1 time: 0.675994 May 28 04:55:06.398801 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2524/5165] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:05 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1697 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:06.403904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e424fe92-1eef-400c-b017-5e5b60c7585e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:06.410164 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e424fe92-1eef-400c-b017-5e5b60c7585e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:06.414636 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e424fe92-1eef-400c-b017-5e5b60c7585e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:06.418946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e424fe92-1eef-400c-b017-5e5b60c7585e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:06.420648 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e424fe92-1eef-400c-b017-5e5b60c7585e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:06.425294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1fee736-7e95-4461-a99e-b49bde383a4a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:06.426573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1fee736-7e95-4461-a99e-b49bde383a4a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:06.429054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e424fe92-1eef-400c-b017-5e5b60c7585e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:06.431181 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1fee736-7e95-4461-a99e-b49bde383a4a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:06.440324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1fee736-7e95-4461-a99e-b49bde383a4a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:06.571813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1fee736-7e95-4461-a99e-b49bde383a4a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:06.572262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1fee736-7e95-4461-a99e-b49bde383a4a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:06.573367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-e1fee736-7e95-4461-a99e-b49bde383a4a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lazy-loading 'fault' on Instance uuid 5ddeac5b-bb14-4476-bf40-51def0581dda {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:55:06.859635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e1fee736-7e95-4461-a99e-b49bde383a4a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:06.860900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e424fe92-1eef-400c-b017-5e5b60c7585e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:06.871999 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e1fee736-7e95-4461-a99e-b49bde383a4a tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 200 len: 1305 microversion: 2.1 time: 0.513855 May 28 04:55:06.882391 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2642/5166] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:06 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 1305 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:06.902354 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e424fe92-1eef-400c-b017-5e5b60c7585e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1279 microversion: 2.1 time: 0.499394 May 28 04:55:06.903607 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2525/5167] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:06 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1279 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:07.004889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-21ec35da-7dc2-46ac-afd5-0bf3e73bffce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:07.005232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-21ec35da-7dc2-46ac-afd5-0bf3e73bffce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:07.023488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21ec35da-7dc2-46ac-afd5-0bf3e73bffce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:07.023951 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21ec35da-7dc2-46ac-afd5-0bf3e73bffce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:07.024744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21ec35da-7dc2-46ac-afd5-0bf3e73bffce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:07.025187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21ec35da-7dc2-46ac-afd5-0bf3e73bffce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:07.376020 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ba80620e-3822-45ef-a57e-c85597659ade tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:07.377209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ba80620e-3822-45ef-a57e-c85597659ade tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:07.387334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:07.397027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba80620e-3822-45ef-a57e-c85597659ade tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:07.397841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba80620e-3822-45ef-a57e-c85597659ade tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:07.398862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba80620e-3822-45ef-a57e-c85597659ade tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:07.399534 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba80620e-3822-45ef-a57e-c85597659ade tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:07.399967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-21ec35da-7dc2-46ac-afd5-0bf3e73bffce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:07.413956 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-21ec35da-7dc2-46ac-afd5-0bf3e73bffce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1528 microversion: 2.1 time: 0.414348 May 28 04:55:07.427426 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2643/5168] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:06 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1528 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:55:07.432932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-88ba7f65-153b-43dc-aba1-ae883d868952 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:07.442024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-88ba7f65-153b-43dc-aba1-ae883d868952 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:07.460613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-88ba7f65-153b-43dc-aba1-ae883d868952 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:07.461445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-88ba7f65-153b-43dc-aba1-ae883d868952 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:07.462499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-88ba7f65-153b-43dc-aba1-ae883d868952 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:07.463392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-88ba7f65-153b-43dc-aba1-ae883d868952 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:07.728387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ba80620e-3822-45ef-a57e-c85597659ade tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:07.737470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ba80620e-3822-45ef-a57e-c85597659ade tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:07.749644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ba80620e-3822-45ef-a57e-c85597659ade tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:07.755888 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ba80620e-3822-45ef-a57e-c85597659ade tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.384413 May 28 04:55:07.760600 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2526/5169] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:55:07 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:55:07.892570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d35d28c9-43d4-45f8-bf8e-345ce81ebd1b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:07.893187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d35d28c9-43d4-45f8-bf8e-345ce81ebd1b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:07.910867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d35d28c9-43d4-45f8-bf8e-345ce81ebd1b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:07.911904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d35d28c9-43d4-45f8-bf8e-345ce81ebd1b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:07.912701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d35d28c9-43d4-45f8-bf8e-345ce81ebd1b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:07.922064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d35d28c9-43d4-45f8-bf8e-345ce81ebd1b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:07.949169 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-d35d28c9-43d4-45f8-bf8e-345ce81ebd1b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance 5ddeac5b-bb14-4476-bf40-51def0581dda could not be found. May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d35d28c9-43d4-45f8-bf8e-345ce81ebd1b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda HTTP/1.1 May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 5ddeac5b-bb14-4476-bf40-51def0581dda could not be found. May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '5ddeac5b-bb14-4476-bf40-51def0581dda'} May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ddeac5b-bb14-4476-bf40-51def0581dda could not be found. May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ddeac5b-bb14-4476-bf40-51def0581dda could not be found. May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:07.953427 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:07.963772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:07.963772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:07.963772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:07.963772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:07.963772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:07.963772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ddeac5b-bb14-4476-bf40-51def0581dda could not be found. May 28 04:55:07.963772 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:07.963772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d35d28c9-43d4-45f8-bf8e-345ce81ebd1b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance 5ddeac5b-bb14-4476-bf40-51def0581dda could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:07.963772 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d35d28c9-43d4-45f8-bf8e-345ce81ebd1b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 404 len: 111 microversion: 2.1 time: 0.071715 May 28 04:55:07.971946 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2527/5170] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:07 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:55:07.986192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cd954b3a-2dad-45c2-a8e5-1c0a0cd7279b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:07.986833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cd954b3a-2dad-45c2-a8e5-1c0a0cd7279b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:08.002411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd954b3a-2dad-45c2-a8e5-1c0a0cd7279b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:08.002873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd954b3a-2dad-45c2-a8e5-1c0a0cd7279b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:08.003681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd954b3a-2dad-45c2-a8e5-1c0a0cd7279b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:08.004210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd954b3a-2dad-45c2-a8e5-1c0a0cd7279b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:08.216166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-88ba7f65-153b-43dc-aba1-ae883d868952 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:08.225543 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-88ba7f65-153b-43dc-aba1-ae883d868952 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1697 microversion: 2.1 time: 0.796690 May 28 04:55:08.231698 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2644/5171] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:07 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1697 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:08.254407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b0f1ec40-e5aa-4c0c-b877-3ad9820fc835 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-671494244", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "807b877d-73e2-4031-b4ab-972d86c6cc59"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:08.420875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-b0f1ec40-e5aa-4c0c-b877-3ad9820fc835 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] validate_networks() for [('807b877d-73e2-4031-b4ab-972d86c6cc59', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:55:09.489640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:09.522974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cd954b3a-2dad-45c2-a8e5-1c0a0cd7279b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:09.539360 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cd954b3a-2dad-45c2-a8e5-1c0a0cd7279b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1321 microversion: 2.1 time: 1.558591 May 28 04:55:09.539360 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2528/5172] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:07 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1321 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:09.544924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7de7aca9-7067-469e-a759-bdffd2613b6a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:09.545542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7de7aca9-7067-469e-a759-bdffd2613b6a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:09.549879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=8 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:09.561290 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7de7aca9-7067-469e-a759-bdffd2613b6a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:09.561757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7de7aca9-7067-469e-a759-bdffd2613b6a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:09.562554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7de7aca9-7067-469e-a759-bdffd2613b6a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:09.563285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7de7aca9-7067-469e-a759-bdffd2613b6a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:10.212210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-b0f1ec40-e5aa-4c0c-b877-3ad9820fc835 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:55:10.213816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-b0f1ec40-e5aa-4c0c-b877-3ad9820fc835 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:55:10.214480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-b0f1ec40-e5aa-4c0c-b877-3ad9820fc835 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:55:10.215156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-b0f1ec40-e5aa-4c0c-b877-3ad9820fc835 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:55:10.215793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-b0f1ec40-e5aa-4c0c-b877-3ad9820fc835 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:55:10.218680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7de7aca9-7067-469e-a759-bdffd2613b6a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:10.228072 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7de7aca9-7067-469e-a759-bdffd2613b6a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1528 microversion: 2.1 time: 0.689056 May 28 04:55:10.230163 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2529/5173] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:09 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1528 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:10.237360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a3d8b2e7-466a-4c38-bddc-41ad3b8e0466 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:10.238044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a3d8b2e7-466a-4c38-bddc-41ad3b8e0466 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:10.240456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0f1ec40-e5aa-4c0c-b877-3ad9820fc835 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:10.241172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0f1ec40-e5aa-4c0c-b877-3ad9820fc835 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:10.242261 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0f1ec40-e5aa-4c0c-b877-3ad9820fc835 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:10.242850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0f1ec40-e5aa-4c0c-b877-3ad9820fc835 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:10.267407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3d8b2e7-466a-4c38-bddc-41ad3b8e0466 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:10.267872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3d8b2e7-466a-4c38-bddc-41ad3b8e0466 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:10.268683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3d8b2e7-466a-4c38-bddc-41ad3b8e0466 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:10.269106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3d8b2e7-466a-4c38-bddc-41ad3b8e0466 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:10.269306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-b0f1ec40-e5aa-4c0c-b877-3ad9820fc835 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Getting quotas for project dd598ce55f9b43d38530dae05fa1bda1. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:55:10.275438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-b0f1ec40-e5aa-4c0c-b877-3ad9820fc835 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Getting quotas for user b05e9b7e95074a91bc984338593c6c84 and project dd598ce55f9b43d38530dae05fa1bda1. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:55:10.290880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b0f1ec40-e5aa-4c0c-b877-3ad9820fc835 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:55:10.293538 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b0f1ec40-e5aa-4c0c-b877-3ad9820fc835 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:55:10.477281 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a3d8b2e7-466a-4c38-bddc-41ad3b8e0466 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:10.490155 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b0f1ec40-e5aa-4c0c-b877-3ad9820fc835 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.239837 May 28 04:55:10.493279 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2645/5174] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:55:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:55:10.497211 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a3d8b2e7-466a-4c38-bddc-41ad3b8e0466 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:10.498751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a3d8b2e7-466a-4c38-bddc-41ad3b8e0466 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:10.500187 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a3d8b2e7-466a-4c38-bddc-41ad3b8e0466 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.268658 May 28 04:55:10.500892 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2530/5175] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:55:10 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:55:10.519953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b35daf2c-8351-4287-995d-9805cd51d186 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:10.520908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b35daf2c-8351-4287-995d-9805cd51d186 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:10.538058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b35daf2c-8351-4287-995d-9805cd51d186 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:10.538806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b35daf2c-8351-4287-995d-9805cd51d186 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:10.539818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b35daf2c-8351-4287-995d-9805cd51d186 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:10.547037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b35daf2c-8351-4287-995d-9805cd51d186 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:10.987841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-4b6cc155-4e49-4c4b-9586-64f256681605 req-c8a15cf4-fa8a-49e8-96fa-7815283f08ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af197e5a-1493-44f1-ae5c-05fad352ed02", "tag": "dd856e8a-99dc-4955-a294-ae6827b9378e"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:11.010422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4b6cc155-4e49-4c4b-9586-64f256681605 req-c8a15cf4-fa8a-49e8-96fa-7815283f08ac service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:11.011429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4b6cc155-4e49-4c4b-9586-64f256681605 req-c8a15cf4-fa8a-49e8-96fa-7815283f08ac service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:11.034407 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-4b6cc155-4e49-4c4b-9586-64f256681605 req-c8a15cf4-fa8a-49e8-96fa-7815283f08ac service nova] Creating event network-changed:dd856e8a-99dc-4955-a294-ae6827b9378e for instance af197e5a-1493-44f1-ae5c-05fad352ed02 on n-h1-843700-1 May 28 04:55:11.045047 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-4b6cc155-4e49-4c4b-9586-64f256681605 req-c8a15cf4-fa8a-49e8-96fa-7815283f08ac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.529404 May 28 04:55:11.046044 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2531/5176] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:55:11.056051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6b1a65a1-bed0-43db-bd39-f6573e5dd1e7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:11.057817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6b1a65a1-bed0-43db-bd39-f6573e5dd1e7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:11.165661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=10 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:11.462583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6b1a65a1-bed0-43db-bd39-f6573e5dd1e7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:11.470719 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6b1a65a1-bed0-43db-bd39-f6573e5dd1e7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 200 len: 1214 microversion: 2.1 time: 0.422747 May 28 04:55:11.471942 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2532/5177] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:11 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 1214 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:11.484285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ce4a291c-f61c-4be3-b662-7698df1f5baa tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:11.484914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ce4a291c-f61c-4be3-b662-7698df1f5baa tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:11.491997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce4a291c-f61c-4be3-b662-7698df1f5baa tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:11.492736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce4a291c-f61c-4be3-b662-7698df1f5baa tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:11.493713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce4a291c-f61c-4be3-b662-7698df1f5baa tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:11.494768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce4a291c-f61c-4be3-b662-7698df1f5baa tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:11.751253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b35daf2c-8351-4287-995d-9805cd51d186 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:11.759577 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b35daf2c-8351-4287-995d-9805cd51d186 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1697 microversion: 2.1 time: 1.262759 May 28 04:55:11.765842 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2646/5178] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:10 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1697 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:11.770625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef46204b-048e-4d76-b123-a4703d0194c8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:11.771284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ef46204b-048e-4d76-b123-a4703d0194c8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:11.779227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef46204b-048e-4d76-b123-a4703d0194c8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:11.779671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef46204b-048e-4d76-b123-a4703d0194c8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:11.780455 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef46204b-048e-4d76-b123-a4703d0194c8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:11.780896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef46204b-048e-4d76-b123-a4703d0194c8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:12.099637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ce4a291c-f61c-4be3-b662-7698df1f5baa tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:12.115660 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ce4a291c-f61c-4be3-b662-7698df1f5baa tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1321 microversion: 2.1 time: 0.641090 May 28 04:55:12.127702 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2533/5179] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:11 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1321 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:12.147123 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7b98ec14-234c-4643-a488-a6954418d786 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:12.149242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7b98ec14-234c-4643-a488-a6954418d786 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:12.168374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b98ec14-234c-4643-a488-a6954418d786 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:12.168810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b98ec14-234c-4643-a488-a6954418d786 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:12.169721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b98ec14-234c-4643-a488-a6954418d786 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:12.170420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b98ec14-234c-4643-a488-a6954418d786 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:12.354254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef46204b-048e-4d76-b123-a4703d0194c8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:12.366711 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ef46204b-048e-4d76-b123-a4703d0194c8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1510 microversion: 2.1 time: 0.597243 May 28 04:55:12.367795 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2647/5180] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:11 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1510 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:12.398266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7b98ec14-234c-4643-a488-a6954418d786 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:12.407018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7b98ec14-234c-4643-a488-a6954418d786 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:12.414550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7b98ec14-234c-4643-a488-a6954418d786 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:12.415829 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7b98ec14-234c-4643-a488-a6954418d786 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.282590 May 28 04:55:12.427212 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2534/5181] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:55:12 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:55:12.487991 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d4e51cbe-51b2-4f6e-89c8-d077a82eaa93 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:12.488829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d4e51cbe-51b2-4f6e-89c8-d077a82eaa93 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:12.496380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d4e51cbe-51b2-4f6e-89c8-d077a82eaa93 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:12.497112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d4e51cbe-51b2-4f6e-89c8-d077a82eaa93 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:12.498076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d4e51cbe-51b2-4f6e-89c8-d077a82eaa93 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:12.498798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d4e51cbe-51b2-4f6e-89c8-d077a82eaa93 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:12.739932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d4e51cbe-51b2-4f6e-89c8-d077a82eaa93 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:12.749190 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d4e51cbe-51b2-4f6e-89c8-d077a82eaa93 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 200 len: 1210 microversion: 2.1 time: 0.265588 May 28 04:55:12.749791 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2648/5182] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:12 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 1210 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:55:12.777303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-739a5253-1256-4481-807e-c4f7cd372d43 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:12.777924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-739a5253-1256-4481-807e-c4f7cd372d43 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:12.791906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-739a5253-1256-4481-807e-c4f7cd372d43 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:12.792375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-739a5253-1256-4481-807e-c4f7cd372d43 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:12.793167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-739a5253-1256-4481-807e-c4f7cd372d43 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:12.798595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-739a5253-1256-4481-807e-c4f7cd372d43 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:13.133128 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-64c48d1f-7406-442d-86f7-f93d01ce90a0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:13.133849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-64c48d1f-7406-442d-86f7-f93d01ce90a0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:13.141839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64c48d1f-7406-442d-86f7-f93d01ce90a0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:13.142639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64c48d1f-7406-442d-86f7-f93d01ce90a0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:13.143481 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64c48d1f-7406-442d-86f7-f93d01ce90a0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:13.143939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64c48d1f-7406-442d-86f7-f93d01ce90a0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:13.547551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-739a5253-1256-4481-807e-c4f7cd372d43 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:13.561943 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-739a5253-1256-4481-807e-c4f7cd372d43 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1697 microversion: 2.1 time: 0.788685 May 28 04:55:13.564104 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2535/5183] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:12 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1697 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:13.578857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ec515b31-1536-465b-aa07-7ed0f9d61cee tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:13.580077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ec515b31-1536-465b-aa07-7ed0f9d61cee tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:13.586391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec515b31-1536-465b-aa07-7ed0f9d61cee tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:13.586870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec515b31-1536-465b-aa07-7ed0f9d61cee tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:13.587672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec515b31-1536-465b-aa07-7ed0f9d61cee tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:13.588841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec515b31-1536-465b-aa07-7ed0f9d61cee tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:13.659226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-64c48d1f-7406-442d-86f7-f93d01ce90a0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:13.667405 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-64c48d1f-7406-442d-86f7-f93d01ce90a0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1321 microversion: 2.1 time: 0.538252 May 28 04:55:13.682886 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2649/5184] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:13 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1321 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:55:13.683132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-20e16604-3f8f-46fa-9ab0-4719626a3a64 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:13.683907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-20e16604-3f8f-46fa-9ab0-4719626a3a64 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:13.690604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-20e16604-3f8f-46fa-9ab0-4719626a3a64 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:13.691304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-20e16604-3f8f-46fa-9ab0-4719626a3a64 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:13.692226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-20e16604-3f8f-46fa-9ab0-4719626a3a64 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:13.692811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-20e16604-3f8f-46fa-9ab0-4719626a3a64 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:13.768293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-20e16604-3f8f-46fa-9ab0-4719626a3a64 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:13.777037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ec515b31-1536-465b-aa07-7ed0f9d61cee tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:13.777200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-20e16604-3f8f-46fa-9ab0-4719626a3a64 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:13.778662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-20e16604-3f8f-46fa-9ab0-4719626a3a64 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:13.779955 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-20e16604-3f8f-46fa-9ab0-4719626a3a64 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1365 microversion: 2.47 time: 0.101844 May 28 04:55:13.780520 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2650/5185] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:55:13 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1365 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:55:13.785289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-4315a633-4246-4694-98a2-b559b49644b0 req-b28f12dd-ed21-42a4-ae1c-990ef7446e1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccd1d50a-ecb5-406b-be4a-94ad6d8665b5", "tag": "44d44357-8cc4-4d64-b33e-5500f94dcfbe"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:13.789304 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ec515b31-1536-465b-aa07-7ed0f9d61cee tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1510 microversion: 2.1 time: 0.223545 May 28 04:55:13.790113 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2536/5186] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:13 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:13.797954 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-4315a633-4246-4694-98a2-b559b49644b0 req-b28f12dd-ed21-42a4-ae1c-990ef7446e1e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:13.798151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4d1e15ad-6c8a-40b5-a3ef-c5f2cbef7b98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:13.798776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4d1e15ad-6c8a-40b5-a3ef-c5f2cbef7b98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:13.801038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-4315a633-4246-4694-98a2-b559b49644b0 req-b28f12dd-ed21-42a4-ae1c-990ef7446e1e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:13.805532 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d1e15ad-6c8a-40b5-a3ef-c5f2cbef7b98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:13.806184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d1e15ad-6c8a-40b5-a3ef-c5f2cbef7b98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:13.807022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d1e15ad-6c8a-40b5-a3ef-c5f2cbef7b98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:13.807473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d1e15ad-6c8a-40b5-a3ef-c5f2cbef7b98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:13.814834 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-4315a633-4246-4694-98a2-b559b49644b0 req-b28f12dd-ed21-42a4-ae1c-990ef7446e1e service nova] Creating event network-changed:44d44357-8cc4-4d64-b33e-5500f94dcfbe for instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 on n-h1-843700-1 May 28 04:55:13.820014 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-4315a633-4246-4694-98a2-b559b49644b0 req-b28f12dd-ed21-42a4-ae1c-990ef7446e1e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038192 May 28 04:55:13.820711 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2651/5187] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:55:13.875801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4d1e15ad-6c8a-40b5-a3ef-c5f2cbef7b98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:13.884320 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4d1e15ad-6c8a-40b5-a3ef-c5f2cbef7b98 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 200 len: 1266 microversion: 2.1 time: 0.090425 May 28 04:55:13.884936 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2537/5188] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:13 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:14.581007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2b2c6202-88c7-4387-ac34-cc1dc1f25bab tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:14.582871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2b2c6202-88c7-4387-ac34-cc1dc1f25bab tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:14.598483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b2c6202-88c7-4387-ac34-cc1dc1f25bab tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:14.604193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b2c6202-88c7-4387-ac34-cc1dc1f25bab tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:14.605273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b2c6202-88c7-4387-ac34-cc1dc1f25bab tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:14.606342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b2c6202-88c7-4387-ac34-cc1dc1f25bab tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:14.684166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5a346d20-aa30-497d-ad33-c9d29bf4e6cf tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:14.685611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5a346d20-aa30-497d-ad33-c9d29bf4e6cf tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:14.694709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a346d20-aa30-497d-ad33-c9d29bf4e6cf tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:14.695595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a346d20-aa30-497d-ad33-c9d29bf4e6cf tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:14.696995 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a346d20-aa30-497d-ad33-c9d29bf4e6cf tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:14.697687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a346d20-aa30-497d-ad33-c9d29bf4e6cf tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:14.989866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2b2c6202-88c7-4387-ac34-cc1dc1f25bab tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:14.998844 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2b2c6202-88c7-4387-ac34-cc1dc1f25bab tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1696 microversion: 2.1 time: 0.422297 May 28 04:55:14.999888 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2652/5189] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:14 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1696 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:15.002682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5a346d20-aa30-497d-ad33-c9d29bf4e6cf tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:15.012350 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5a346d20-aa30-497d-ad33-c9d29bf4e6cf tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1321 microversion: 2.1 time: 0.332642 May 28 04:55:15.022441 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2538/5190] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:14 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1321 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:15.023254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ac36664f-72e8-42c2-b9c9-cf6755e17ea3 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:15.024445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ac36664f-72e8-42c2-b9c9-cf6755e17ea3 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:15.032151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9bbe14a9-cd13-4287-b602-1695e6efb2b8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:15.032432 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac36664f-72e8-42c2-b9c9-cf6755e17ea3 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:15.033139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac36664f-72e8-42c2-b9c9-cf6755e17ea3 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:15.033253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9bbe14a9-cd13-4287-b602-1695e6efb2b8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:15.034289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac36664f-72e8-42c2-b9c9-cf6755e17ea3 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:15.034839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac36664f-72e8-42c2-b9c9-cf6755e17ea3 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:15.040605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9bbe14a9-cd13-4287-b602-1695e6efb2b8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:15.041144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9bbe14a9-cd13-4287-b602-1695e6efb2b8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:15.042017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9bbe14a9-cd13-4287-b602-1695e6efb2b8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:15.042454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9bbe14a9-cd13-4287-b602-1695e6efb2b8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:15.049076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:15.206029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ac36664f-72e8-42c2-b9c9-cf6755e17ea3 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:15.218293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ac36664f-72e8-42c2-b9c9-cf6755e17ea3 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:15.226836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ac36664f-72e8-42c2-b9c9-cf6755e17ea3 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:15.229100 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ac36664f-72e8-42c2-b9c9-cf6755e17ea3 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1371 microversion: 2.47 time: 0.227925 May 28 04:55:15.230187 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2653/5191] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:55:15 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:55:15.236652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c579e080-044c-4aaa-a5c5-d8b653c4caf9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:15.237644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c579e080-044c-4aaa-a5c5-d8b653c4caf9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:15.245196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c579e080-044c-4aaa-a5c5-d8b653c4caf9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:15.245650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c579e080-044c-4aaa-a5c5-d8b653c4caf9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:15.246557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c579e080-044c-4aaa-a5c5-d8b653c4caf9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:15.247023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c579e080-044c-4aaa-a5c5-d8b653c4caf9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:15.251732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:15.305825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9bbe14a9-cd13-4287-b602-1695e6efb2b8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:15.315209 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9bbe14a9-cd13-4287-b602-1695e6efb2b8 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1510 microversion: 2.1 time: 0.291313 May 28 04:55:15.315953 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2539/5192] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:15 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1510 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:15.337105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c579e080-044c-4aaa-a5c5-d8b653c4caf9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:15.346593 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c579e080-044c-4aaa-a5c5-d8b653c4caf9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 200 len: 1272 microversion: 2.1 time: 0.114884 May 28 04:55:15.348105 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2654/5193] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:15 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 1272 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:15.571756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-c6c37d9b-12d4-4bb6-9666-14051b1445dc req-000880d4-6dec-41f6-b973-fbcd32e13933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58022ec6-f4eb-4564-bed0-c3edd1d0daf4", "name": "network-vif-unplugged", "status": "completed", "tag": "d2dc44c4-b245-41ae-bb82-8a262f7181c5"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:15.581285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c6c37d9b-12d4-4bb6-9666-14051b1445dc req-000880d4-6dec-41f6-b973-fbcd32e13933 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:15.581735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c6c37d9b-12d4-4bb6-9666-14051b1445dc req-000880d4-6dec-41f6-b973-fbcd32e13933 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:15.603119 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-c6c37d9b-12d4-4bb6-9666-14051b1445dc req-000880d4-6dec-41f6-b973-fbcd32e13933 service nova] Creating event network-vif-unplugged:d2dc44c4-b245-41ae-bb82-8a262f7181c5 for instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 on n-h1-843700-1 May 28 04:55:15.609877 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-c6c37d9b-12d4-4bb6-9666-14051b1445dc req-000880d4-6dec-41f6-b973-fbcd32e13933 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.292210 May 28 04:55:15.610624 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2540/5194] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:55:16.019698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-828a6268-3cc1-4fd6-bf81-6bb666cf4c81 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:16.030980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ca12c7fe-faac-4b76-89a6-36c00a9d0829 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:16.032143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-828a6268-3cc1-4fd6-bf81-6bb666cf4c81 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:16.039720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ca12c7fe-faac-4b76-89a6-36c00a9d0829 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:16.062307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-828a6268-3cc1-4fd6-bf81-6bb666cf4c81 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:16.067699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-828a6268-3cc1-4fd6-bf81-6bb666cf4c81 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:16.069818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca12c7fe-faac-4b76-89a6-36c00a9d0829 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:16.070288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca12c7fe-faac-4b76-89a6-36c00a9d0829 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:16.071716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-828a6268-3cc1-4fd6-bf81-6bb666cf4c81 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:16.072790 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-828a6268-3cc1-4fd6-bf81-6bb666cf4c81 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:16.075535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca12c7fe-faac-4b76-89a6-36c00a9d0829 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:16.077896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca12c7fe-faac-4b76-89a6-36c00a9d0829 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:16.842552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-828a6268-3cc1-4fd6-bf81-6bb666cf4c81 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:16.846558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ca12c7fe-faac-4b76-89a6-36c00a9d0829 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:16.853965 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-828a6268-3cc1-4fd6-bf81-6bb666cf4c81 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1696 microversion: 2.1 time: 0.839375 May 28 04:55:16.860197 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ca12c7fe-faac-4b76-89a6-36c00a9d0829 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1321 microversion: 2.1 time: 0.834335 May 28 04:55:16.860786 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2541/5195] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:16 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1321 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:55:16.865685 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2655/5196] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:16 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1696 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:16.868598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fd8e6364-de67-48f2-b3e6-188a1bc8bee2 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:16.869279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fd8e6364-de67-48f2-b3e6-188a1bc8bee2 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:16.877710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-35df49bc-788a-4828-9fe6-bac8d82b83ac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:16.878349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-35df49bc-788a-4828-9fe6-bac8d82b83ac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:16.883494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fd8e6364-de67-48f2-b3e6-188a1bc8bee2 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:16.883957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fd8e6364-de67-48f2-b3e6-188a1bc8bee2 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:16.884941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fd8e6364-de67-48f2-b3e6-188a1bc8bee2 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:16.885205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35df49bc-788a-4828-9fe6-bac8d82b83ac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:16.885386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fd8e6364-de67-48f2-b3e6-188a1bc8bee2 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:16.886149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35df49bc-788a-4828-9fe6-bac8d82b83ac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:16.887149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35df49bc-788a-4828-9fe6-bac8d82b83ac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:16.887759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35df49bc-788a-4828-9fe6-bac8d82b83ac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:17.044346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fd8e6364-de67-48f2-b3e6-188a1bc8bee2 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:17.058442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fd8e6364-de67-48f2-b3e6-188a1bc8bee2 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:17.063540 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fd8e6364-de67-48f2-b3e6-188a1bc8bee2 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:17.064915 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fd8e6364-de67-48f2-b3e6-188a1bc8bee2 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1371 microversion: 2.47 time: 0.203013 May 28 04:55:17.068091 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2542/5197] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:55:16 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:55:17.076668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a494cb5b-4589-4d1d-a0cc-f68dd86d2734 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:17.077361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a494cb5b-4589-4d1d-a0cc-f68dd86d2734 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:17.089131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a494cb5b-4589-4d1d-a0cc-f68dd86d2734 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:17.090699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a494cb5b-4589-4d1d-a0cc-f68dd86d2734 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:17.091788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a494cb5b-4589-4d1d-a0cc-f68dd86d2734 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:17.092432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a494cb5b-4589-4d1d-a0cc-f68dd86d2734 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:17.633161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-35df49bc-788a-4828-9fe6-bac8d82b83ac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:17.644970 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-35df49bc-788a-4828-9fe6-bac8d82b83ac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1453 microversion: 2.1 time: 0.777921 May 28 04:55:17.645746 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2656/5198] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:16 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1453 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:17.651178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-beb87efa-fa2f-4131-b23a-809299b8d6de req-14d8f4a8-7741-4d71-a7b2-9b02ec7cb78f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260294eb-db79-4280-a534-928afd9312d0", "name": "network-vif-unplugged", "status": "completed", "tag": "3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:17.671581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-beb87efa-fa2f-4131-b23a-809299b8d6de req-14d8f4a8-7741-4d71-a7b2-9b02ec7cb78f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:17.671581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-beb87efa-fa2f-4131-b23a-809299b8d6de req-14d8f4a8-7741-4d71-a7b2-9b02ec7cb78f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:17.684518 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-beb87efa-fa2f-4131-b23a-809299b8d6de req-14d8f4a8-7741-4d71-a7b2-9b02ec7cb78f service nova] Creating event network-vif-unplugged:3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0 for instance 260294eb-db79-4280-a534-928afd9312d0 on n-h1-843700-1 May 28 04:55:17.691263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-beb87efa-fa2f-4131-b23a-809299b8d6de req-14d8f4a8-7741-4d71-a7b2-9b02ec7cb78f service nova] Instance 260294eb-db79-4280-a534-928afd9312d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:55:17.702918 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-beb87efa-fa2f-4131-b23a-809299b8d6de req-14d8f4a8-7741-4d71-a7b2-9b02ec7cb78f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055858 May 28 04:55:17.703704 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2657/5199] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:55:17.708927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-be4eee57-1b68-4073-afef-ed77e3fbdbae tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:17.709803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-be4eee57-1b68-4073-afef-ed77e3fbdbae tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:17.717275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-be4eee57-1b68-4073-afef-ed77e3fbdbae tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:17.717920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-be4eee57-1b68-4073-afef-ed77e3fbdbae tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:17.718845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-be4eee57-1b68-4073-afef-ed77e3fbdbae tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:17.720003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-be4eee57-1b68-4073-afef-ed77e3fbdbae tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:18.384844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a494cb5b-4589-4d1d-a0cc-f68dd86d2734 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:18.394189 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a494cb5b-4589-4d1d-a0cc-f68dd86d2734 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 200 len: 1314 microversion: 2.1 time: 1.324054 May 28 04:55:18.410981 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2543/5200] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:17 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 1314 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:18.413149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-734c5792-b6bc-4648-bb7d-0d4690efa8f6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:18.414554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-734c5792-b6bc-4648-bb7d-0d4690efa8f6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:18.422739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-734c5792-b6bc-4648-bb7d-0d4690efa8f6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:18.423250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-734c5792-b6bc-4648-bb7d-0d4690efa8f6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:18.424209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-734c5792-b6bc-4648-bb7d-0d4690efa8f6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:18.425046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-734c5792-b6bc-4648-bb7d-0d4690efa8f6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:18.914159 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-be4eee57-1b68-4073-afef-ed77e3fbdbae tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:18.929504 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-be4eee57-1b68-4073-afef-ed77e3fbdbae tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1453 microversion: 2.1 time: 1.223393 May 28 04:55:18.930360 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2658/5201] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:17 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1453 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:18.939214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-72652686-a13f-4580-b4a4-412e1fdfb967 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:18.942031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-72652686-a13f-4580-b4a4-412e1fdfb967 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:18.951828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72652686-a13f-4580-b4a4-412e1fdfb967 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:18.952625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72652686-a13f-4580-b4a4-412e1fdfb967 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:18.954898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72652686-a13f-4580-b4a4-412e1fdfb967 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:18.955772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72652686-a13f-4580-b4a4-412e1fdfb967 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:19.244548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-734c5792-b6bc-4648-bb7d-0d4690efa8f6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:19.256199 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-734c5792-b6bc-4648-bb7d-0d4690efa8f6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1696 microversion: 2.1 time: 0.846449 May 28 04:55:19.257236 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2544/5202] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:18 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1696 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:19.267691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-305b1644-5717-4183-a88d-10a0f196d513 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:19.268600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-305b1644-5717-4183-a88d-10a0f196d513 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:19.277209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-305b1644-5717-4183-a88d-10a0f196d513 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:19.280270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-305b1644-5717-4183-a88d-10a0f196d513 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:19.280270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-305b1644-5717-4183-a88d-10a0f196d513 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:19.280270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-305b1644-5717-4183-a88d-10a0f196d513 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:19.474912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-305b1644-5717-4183-a88d-10a0f196d513 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:19.484000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-305b1644-5717-4183-a88d-10a0f196d513 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:19.485611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-305b1644-5717-4183-a88d-10a0f196d513 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:19.486839 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-305b1644-5717-4183-a88d-10a0f196d513 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1356 microversion: 2.47 time: 0.225735 May 28 04:55:19.502474 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2545/5203] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:55:19 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1356 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:55:19.601795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-72652686-a13f-4580-b4a4-412e1fdfb967 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:19.609244 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-72652686-a13f-4580-b4a4-412e1fdfb967 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1321 microversion: 2.1 time: 0.677445 May 28 04:55:19.611153 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2659/5204] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:18 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1321 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:19.632771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-77cae22d-f93a-4756-adc5-8172c560b2f4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:19.633547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-77cae22d-f93a-4756-adc5-8172c560b2f4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:19.640042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77cae22d-f93a-4756-adc5-8172c560b2f4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:19.640520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77cae22d-f93a-4756-adc5-8172c560b2f4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:19.641303 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77cae22d-f93a-4756-adc5-8172c560b2f4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:19.641735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77cae22d-f93a-4756-adc5-8172c560b2f4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:19.702690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-77cae22d-f93a-4756-adc5-8172c560b2f4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lazy-loading 'flavor' on Instance uuid 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:55:19.710880 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-77cae22d-f93a-4756-adc5-8172c560b2f4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Cannot 'shelve' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state shelved_offloaded May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-77cae22d-f93a-4756-adc5-8172c560b2f4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action HTTP/1.1 May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 14 May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: {"shelve": {}} May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: exception: Cannot 'shelve' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state shelved_offloaded May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '58022ec6-f4eb-4564-bed0-c3edd1d0daf4', 'body': {'shelve': {}}} May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve May 28 04:55:19.713449 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 04:55:19.717242 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 04:55:19.717242 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 04:55:19.717242 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state shelved_offloaded May 28 04:55:19.717242 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:19.717242 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:19.717242 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:19.717242 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:19.717242 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:19.717242 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:19.717242 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:19.717242 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:19.717242 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state shelved_offloaded May 28 04:55:19.717242 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:19.717242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-77cae22d-f93a-4756-adc5-8172c560b2f4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 409 to user: Cannot 'shelve' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state shelved_offloaded {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:19.717242 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-77cae22d-f93a-4756-adc5-8172c560b2f4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action" status: 409 len: 155 microversion: 2.1 time: 0.099363 May 28 04:55:19.717242 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2660/5205] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:55:19 2022] POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action => generated 155 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 04:55:19.724059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-fab4149e-0e6f-42e1-ae34-8f162c543347 req-ea88cb7b-e4c6-4471-9aa1-2c5521bb72fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af197e5a-1493-44f1-ae5c-05fad352ed02", "name": "network-vif-plugged", "status": "completed", "tag": "dd856e8a-99dc-4955-a294-ae6827b9378e"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:19.734192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-fab4149e-0e6f-42e1-ae34-8f162c543347 req-ea88cb7b-e4c6-4471-9aa1-2c5521bb72fa service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:19.734646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-fab4149e-0e6f-42e1-ae34-8f162c543347 req-ea88cb7b-e4c6-4471-9aa1-2c5521bb72fa service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:19.748385 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-fab4149e-0e6f-42e1-ae34-8f162c543347 req-ea88cb7b-e4c6-4471-9aa1-2c5521bb72fa service nova] Creating event network-vif-plugged:dd856e8a-99dc-4955-a294-ae6827b9378e for instance af197e5a-1493-44f1-ae5c-05fad352ed02 on n-h1-843700-1 May 28 04:55:19.756304 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-fab4149e-0e6f-42e1-ae34-8f162c543347 req-ea88cb7b-e4c6-4471-9aa1-2c5521bb72fa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038839 May 28 04:55:19.761079 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2661/5206] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:55:19.792783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-0e405103-9a27-4527-a90e-60431ae8bf84 req-0d2ca570-d3ba-4728-ba9a-138e62ed4b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a2ae555-84a4-4580-9169-022e9c89d321", "tag": "9ac90f6b-0cb2-4acb-a468-fbb56b154035"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:19.795205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4319a877-340c-40b1-a0fa-5a29ae3a6cae tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:19.796877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4319a877-340c-40b1-a0fa-5a29ae3a6cae tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:19.809101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0e405103-9a27-4527-a90e-60431ae8bf84 req-0d2ca570-d3ba-4728-ba9a-138e62ed4b59 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:19.813152 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0e405103-9a27-4527-a90e-60431ae8bf84 req-0d2ca570-d3ba-4728-ba9a-138e62ed4b59 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:19.828713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4319a877-340c-40b1-a0fa-5a29ae3a6cae tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:19.829458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4319a877-340c-40b1-a0fa-5a29ae3a6cae tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:19.830701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4319a877-340c-40b1-a0fa-5a29ae3a6cae tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:19.841384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4319a877-340c-40b1-a0fa-5a29ae3a6cae tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:19.845842 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-0e405103-9a27-4527-a90e-60431ae8bf84 req-0d2ca570-d3ba-4728-ba9a-138e62ed4b59 service nova] Creating event network-changed:9ac90f6b-0cb2-4acb-a468-fbb56b154035 for instance 2a2ae555-84a4-4580-9169-022e9c89d321 on n-h2-843700-1 May 28 04:55:19.857530 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-0e405103-9a27-4527-a90e-60431ae8bf84 req-0d2ca570-d3ba-4728-ba9a-138e62ed4b59 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.352147 May 28 04:55:19.857972 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2546/5207] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:55:19.864340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8a1fbaa7-c54e-41bf-821c-3be259c8cad0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:19.868580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8a1fbaa7-c54e-41bf-821c-3be259c8cad0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:19.869641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8a1fbaa7-c54e-41bf-821c-3be259c8cad0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Searching by: {'deleted': False, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4'} {{(pid=126043) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 04:55:19.879211 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a1fbaa7-c54e-41bf-821c-3be259c8cad0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:19.879706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a1fbaa7-c54e-41bf-821c-3be259c8cad0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:19.880760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a1fbaa7-c54e-41bf-821c-3be259c8cad0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:19.882348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a1fbaa7-c54e-41bf-821c-3be259c8cad0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:20.029849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.multi_cell_list [None req-8a1fbaa7-c54e-41bf-821c-3be259c8cad0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 04:55:20.124520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8a1fbaa7-c54e-41bf-821c-3be259c8cad0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:20.132207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a1fbaa7-c54e-41bf-821c-3be259c8cad0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:20.132661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a1fbaa7-c54e-41bf-821c-3be259c8cad0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:20.144231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8a1fbaa7-c54e-41bf-821c-3be259c8cad0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:20.145761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8a1fbaa7-c54e-41bf-821c-3be259c8cad0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:20.256797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:20.290763 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8a1fbaa7-c54e-41bf-821c-3be259c8cad0 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.431384 May 28 04:55:20.291587 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2547/5208] 10.222.0.58 () {60 vars in 1186 bytes} [Sat May 28 04:55:19 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:55:20.297119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-12f1aedc-a1ce-46ab-8b92-f1f0ec34cfad tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:20.297820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-12f1aedc-a1ce-46ab-8b92-f1f0ec34cfad tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:20.304701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-12f1aedc-a1ce-46ab-8b92-f1f0ec34cfad tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:20.305167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-12f1aedc-a1ce-46ab-8b92-f1f0ec34cfad tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:20.305947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-12f1aedc-a1ce-46ab-8b92-f1f0ec34cfad tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:20.306948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-12f1aedc-a1ce-46ab-8b92-f1f0ec34cfad tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:20.367041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:20.388093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4319a877-340c-40b1-a0fa-5a29ae3a6cae tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:20.411328 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4319a877-340c-40b1-a0fa-5a29ae3a6cae tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 200 len: 1314 microversion: 2.1 time: 0.648523 May 28 04:55:20.412652 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2662/5209] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:19 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 1314 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:20.444331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-c472b628-aeab-4c7b-9855-08254b42ca3e req-4066b5c1-8aaa-4ca0-8846-e3bac4d6759c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "260294eb-db79-4280-a534-928afd9312d0", "tag": "3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:20.453263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c472b628-aeab-4c7b-9855-08254b42ca3e req-4066b5c1-8aaa-4ca0-8846-e3bac4d6759c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:20.453714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c472b628-aeab-4c7b-9855-08254b42ca3e req-4066b5c1-8aaa-4ca0-8846-e3bac4d6759c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:20.467075 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-c472b628-aeab-4c7b-9855-08254b42ca3e req-4066b5c1-8aaa-4ca0-8846-e3bac4d6759c service nova] Creating event network-changed:3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0 for instance 260294eb-db79-4280-a534-928afd9312d0 on n-h1-843700-1 May 28 04:55:20.474191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-c472b628-aeab-4c7b-9855-08254b42ca3e req-4066b5c1-8aaa-4ca0-8846-e3bac4d6759c service nova] Instance 260294eb-db79-4280-a534-928afd9312d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:55:20.489531 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-c472b628-aeab-4c7b-9855-08254b42ca3e req-4066b5c1-8aaa-4ca0-8846-e3bac4d6759c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071987 May 28 04:55:20.489531 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2663/5210] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:55:20.492683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8c45a0c0-95f7-45bd-9b55-f9699a50d2db tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:20.493379 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8c45a0c0-95f7-45bd-9b55-f9699a50d2db tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:20.500569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8c45a0c0-95f7-45bd-9b55-f9699a50d2db tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:20.501250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8c45a0c0-95f7-45bd-9b55-f9699a50d2db tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:20.502223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8c45a0c0-95f7-45bd-9b55-f9699a50d2db tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:20.502812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8c45a0c0-95f7-45bd-9b55-f9699a50d2db tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:20.579501 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-12f1aedc-a1ce-46ab-8b92-f1f0ec34cfad tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action" status: 202 len: 0 microversion: 2.1 time: 0.286670 May 28 04:55:20.581209 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2548/5211] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:55:20 2022] POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:55:20.588442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0f04eb14-7786-420c-853e-1342aafec934 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:20.589329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0f04eb14-7786-420c-853e-1342aafec934 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:20.597034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f04eb14-7786-420c-853e-1342aafec934 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:20.597851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f04eb14-7786-420c-853e-1342aafec934 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:20.598982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f04eb14-7786-420c-853e-1342aafec934 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:20.599664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f04eb14-7786-420c-853e-1342aafec934 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:20.634293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0f04eb14-7786-420c-853e-1342aafec934 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:55:20.772868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8c45a0c0-95f7-45bd-9b55-f9699a50d2db tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:20.782810 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8c45a0c0-95f7-45bd-9b55-f9699a50d2db tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1696 microversion: 2.1 time: 0.294140 May 28 04:55:20.793823 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2664/5212] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:20 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1696 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:20.799654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3c76afb7-dc8c-4715-b6ff-aa4208e5af67 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:20.804827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3c76afb7-dc8c-4715-b6ff-aa4208e5af67 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:20.807291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c76afb7-dc8c-4715-b6ff-aa4208e5af67 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:20.807920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c76afb7-dc8c-4715-b6ff-aa4208e5af67 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:20.808693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c76afb7-dc8c-4715-b6ff-aa4208e5af67 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:20.809118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c76afb7-dc8c-4715-b6ff-aa4208e5af67 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:20.977354 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0f04eb14-7786-420c-853e-1342aafec934 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "DELETE /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 204 len: 0 microversion: 2.47 time: 0.394642 May 28 04:55:20.981589 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2549/5213] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:55:20 2022] DELETE /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:55:20.993173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4fc609b8-48d5-4827-b489-c75429685e6a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:20.994498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4fc609b8-48d5-4827-b489-c75429685e6a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:21.001744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4fc609b8-48d5-4827-b489-c75429685e6a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:21.002231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4fc609b8-48d5-4827-b489-c75429685e6a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:21.003254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4fc609b8-48d5-4827-b489-c75429685e6a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:21.003694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4fc609b8-48d5-4827-b489-c75429685e6a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:21.016870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3c76afb7-dc8c-4715-b6ff-aa4208e5af67 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:21.026596 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3c76afb7-dc8c-4715-b6ff-aa4208e5af67 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1461 microversion: 2.1 time: 0.231356 May 28 04:55:21.027899 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2665/5214] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:20 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1461 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:21.033322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5ed0e7ea-e8af-4923-a28a-282d5c904ca6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:21.034213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5ed0e7ea-e8af-4923-a28a-282d5c904ca6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:21.041057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ed0e7ea-e8af-4923-a28a-282d5c904ca6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:21.041922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ed0e7ea-e8af-4923-a28a-282d5c904ca6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:21.043966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ed0e7ea-e8af-4923-a28a-282d5c904ca6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:21.043966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ed0e7ea-e8af-4923-a28a-282d5c904ca6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:21.270082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5ed0e7ea-e8af-4923-a28a-282d5c904ca6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:21.280612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5ed0e7ea-e8af-4923-a28a-282d5c904ca6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:21.283098 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5ed0e7ea-e8af-4923-a28a-282d5c904ca6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:21.297274 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5ed0e7ea-e8af-4923-a28a-282d5c904ca6 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1362 microversion: 2.47 time: 0.255380 May 28 04:55:21.297274 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2666/5215] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:55:21 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:55:21.429081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3642973c-6524-4d0a-a5fb-84ebdfb50890 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:21.429781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3642973c-6524-4d0a-a5fb-84ebdfb50890 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:21.441119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3642973c-6524-4d0a-a5fb-84ebdfb50890 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:21.445588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3642973c-6524-4d0a-a5fb-84ebdfb50890 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:21.449156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3642973c-6524-4d0a-a5fb-84ebdfb50890 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:21.449777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3642973c-6524-4d0a-a5fb-84ebdfb50890 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:21.500778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4fc609b8-48d5-4827-b489-c75429685e6a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:21.511554 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4fc609b8-48d5-4827-b489-c75429685e6a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1321 microversion: 2.1 time: 0.528251 May 28 04:55:21.514367 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2550/5216] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:20 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1321 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:21.782052 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3642973c-6524-4d0a-a5fb-84ebdfb50890 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:21.791472 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3642973c-6524-4d0a-a5fb-84ebdfb50890 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 200 len: 1314 microversion: 2.1 time: 0.366033 May 28 04:55:21.795176 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2667/5217] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:21 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:55:21.817073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ba6bd4d7-e0c1-49aa-b4b8-5851a052eef3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:21.817073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ba6bd4d7-e0c1-49aa-b4b8-5851a052eef3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:21.835253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba6bd4d7-e0c1-49aa-b4b8-5851a052eef3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:21.838152 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba6bd4d7-e0c1-49aa-b4b8-5851a052eef3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:21.841102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba6bd4d7-e0c1-49aa-b4b8-5851a052eef3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:21.841563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba6bd4d7-e0c1-49aa-b4b8-5851a052eef3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:22.026642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ba6bd4d7-e0c1-49aa-b4b8-5851a052eef3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:22.035248 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ba6bd4d7-e0c1-49aa-b4b8-5851a052eef3 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1696 microversion: 2.1 time: 0.229370 May 28 04:55:22.037117 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2551/5218] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:21 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1696 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:22.044500 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3d6ec7d8-2390-4950-9fe4-9d1e91ce021e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:22.045127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3d6ec7d8-2390-4950-9fe4-9d1e91ce021e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:22.051306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d6ec7d8-2390-4950-9fe4-9d1e91ce021e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:22.051960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d6ec7d8-2390-4950-9fe4-9d1e91ce021e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:22.052897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d6ec7d8-2390-4950-9fe4-9d1e91ce021e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:22.053500 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d6ec7d8-2390-4950-9fe4-9d1e91ce021e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:22.282783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3d6ec7d8-2390-4950-9fe4-9d1e91ce021e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:22.290111 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3d6ec7d8-2390-4950-9fe4-9d1e91ce021e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1461 microversion: 2.1 time: 0.249461 May 28 04:55:22.291615 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2668/5219] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:22 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1461 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:22.311819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53364af9-9217-4755-be66-76ef86e56e2c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:22.313001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-53364af9-9217-4755-be66-76ef86e56e2c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:22.341758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53364af9-9217-4755-be66-76ef86e56e2c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:22.342211 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53364af9-9217-4755-be66-76ef86e56e2c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:22.343022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53364af9-9217-4755-be66-76ef86e56e2c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:22.343546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53364af9-9217-4755-be66-76ef86e56e2c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:22.544055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e778b695-4d06-41b0-ad3e-05e07af01392 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:22.545070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e778b695-4d06-41b0-ad3e-05e07af01392 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:22.556049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e778b695-4d06-41b0-ad3e-05e07af01392 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:22.556767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e778b695-4d06-41b0-ad3e-05e07af01392 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:22.558103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e778b695-4d06-41b0-ad3e-05e07af01392 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:22.558547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e778b695-4d06-41b0-ad3e-05e07af01392 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:22.830903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-53364af9-9217-4755-be66-76ef86e56e2c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:22.840760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-53364af9-9217-4755-be66-76ef86e56e2c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:22.847598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-53364af9-9217-4755-be66-76ef86e56e2c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:22.847598 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-53364af9-9217-4755-be66-76ef86e56e2c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 200 len: 1362 microversion: 2.47 time: 0.544297 May 28 04:55:22.847598 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2552/5220] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:55:22 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 1362 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:55:22.849977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5bde569d-5e61-4fa7-8b68-7b7791cf04cb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:22.850718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5bde569d-5e61-4fa7-8b68-7b7791cf04cb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:22.858086 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5bde569d-5e61-4fa7-8b68-7b7791cf04cb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:22.858680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5bde569d-5e61-4fa7-8b68-7b7791cf04cb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:22.859751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5bde569d-5e61-4fa7-8b68-7b7791cf04cb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:22.860204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5bde569d-5e61-4fa7-8b68-7b7791cf04cb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:22.951819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e778b695-4d06-41b0-ad3e-05e07af01392 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:22.959765 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e778b695-4d06-41b0-ad3e-05e07af01392 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1321 microversion: 2.1 time: 0.433294 May 28 04:55:22.969623 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2669/5221] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:22 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1321 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:55:23.050125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5bde569d-5e61-4fa7-8b68-7b7791cf04cb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:23.052687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:23.053837 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b8ad747a-bf38-4ce7-b023-148735ea3a2e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:23.054474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b8ad747a-bf38-4ce7-b023-148735ea3a2e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:23.061228 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5bde569d-5e61-4fa7-8b68-7b7791cf04cb tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 200 len: 1314 microversion: 2.1 time: 0.215089 May 28 04:55:23.062365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8ad747a-bf38-4ce7-b023-148735ea3a2e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:23.063209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8ad747a-bf38-4ce7-b023-148735ea3a2e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:23.064006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8ad747a-bf38-4ce7-b023-148735ea3a2e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:23.064458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8ad747a-bf38-4ce7-b023-148735ea3a2e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:23.065423 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2553/5222] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:22 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:23.308368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-35abe221-af46-4a36-a68a-c65de632bc4a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:23.309385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-35abe221-af46-4a36-a68a-c65de632bc4a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:23.316196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-35abe221-af46-4a36-a68a-c65de632bc4a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:23.316767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-35abe221-af46-4a36-a68a-c65de632bc4a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:23.317624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-35abe221-af46-4a36-a68a-c65de632bc4a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:23.319220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-35abe221-af46-4a36-a68a-c65de632bc4a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:23.350126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b8ad747a-bf38-4ce7-b023-148735ea3a2e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:23.361853 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b8ad747a-bf38-4ce7-b023-148735ea3a2e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1694 microversion: 2.1 time: 0.311393 May 28 04:55:23.363062 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2670/5223] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:23 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1694 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:55:23.429551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-421e38b8-89b2-49d8-ac33-af84acde148b req-175bee6b-a808-4731-b4c9-82cb2a0cab67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccd1d50a-ecb5-406b-be4a-94ad6d8665b5", "name": "network-vif-plugged", "status": "completed", "tag": "44d44357-8cc4-4d64-b33e-5500f94dcfbe"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:23.444461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-421e38b8-89b2-49d8-ac33-af84acde148b req-175bee6b-a808-4731-b4c9-82cb2a0cab67 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:23.444923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-421e38b8-89b2-49d8-ac33-af84acde148b req-175bee6b-a808-4731-b4c9-82cb2a0cab67 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:23.460423 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-421e38b8-89b2-49d8-ac33-af84acde148b req-175bee6b-a808-4731-b4c9-82cb2a0cab67 service nova] Creating event network-vif-plugged:44d44357-8cc4-4d64-b33e-5500f94dcfbe for instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 on n-h1-843700-1 May 28 04:55:23.466289 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-421e38b8-89b2-49d8-ac33-af84acde148b req-175bee6b-a808-4731-b4c9-82cb2a0cab67 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040401 May 28 04:55:23.467496 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2671/5224] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:55:23.622529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-35abe221-af46-4a36-a68a-c65de632bc4a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:23.631170 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-35abe221-af46-4a36-a68a-c65de632bc4a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1463 microversion: 2.1 time: 0.327041 May 28 04:55:23.643008 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2554/5225] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:23 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1463 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:23.864215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-91c4705d-0c4c-4861-aa1e-c109efb9167e tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:23.864928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-91c4705d-0c4c-4861-aa1e-c109efb9167e tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 60bdb14f-7809-477e-aebe-f56cc0e1e7f4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:23.871515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-91c4705d-0c4c-4861-aa1e-c109efb9167e tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:23.871993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-91c4705d-0c4c-4861-aa1e-c109efb9167e tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:23.872766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-91c4705d-0c4c-4861-aa1e-c109efb9167e tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:23.873207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-91c4705d-0c4c-4861-aa1e-c109efb9167e tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:23.890576 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-91c4705d-0c4c-4861-aa1e-c109efb9167e tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] HTTP exception thrown: Instance 60bdb14f-7809-477e-aebe-f56cc0e1e7f4 could not be found. May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-91c4705d-0c4c-4861-aa1e-c109efb9167e tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Request method failure captured: May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 HTTP/1.1 May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikasFuKbAITMNDgoWlHbUbdOaqjXlB8ihp0-grHf6S0KnCQc4TanujJpUeO3ITG-Y0Q--6yV6i0BE0cD8QYWRpm3YyXN-wPx5VkRDOSOFZUFYwTaankKolu2AKL5yxS_HiC0c7e4aALaFrFGuRcclhuDG3VQA8B9PleRN28sAlbueo7E May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-Openstack-Nova-Api-Version: 2.47 May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 5f5882bae6fe4056b111e9b3de9e58c4 May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerShowV247Test-1734889737 May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5f5882bae6fe4056b111e9b3de9e58c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5f5882bae6fe4056b111e9b3de9e58c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f5882bae6fe4056b111e9b3de9e58c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f5882bae6fe4056b111e9b3de9e58c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerShowV247Test-1734889737 May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 5f5882bae6fe4056b111e9b3de9e58c4 May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerShowV247Test-1734889737 May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerShowV247Test-1734889737-project May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 77e852d1a61c4c77bd3d6df2559cc8c0 May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerShowV247Test-1734889737-project May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 60bdb14f-7809-477e-aebe-f56cc0e1e7f4 could not be found. May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '60bdb14f-7809-477e-aebe-f56cc0e1e7f4'} May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60bdb14f-7809-477e-aebe-f56cc0e1e7f4 could not be found. May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60bdb14f-7809-477e-aebe-f56cc0e1e7f4 could not be found. May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:23.892981 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:23.897114 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:23.897114 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:23.897114 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:23.897114 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:23.897114 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:23.897114 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60bdb14f-7809-477e-aebe-f56cc0e1e7f4 could not be found. May 28 04:55:23.897114 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:23.898674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-91c4705d-0c4c-4861-aa1e-c109efb9167e tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Returning 404 to user: Instance 60bdb14f-7809-477e-aebe-f56cc0e1e7f4 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:23.899446 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-91c4705d-0c4c-4861-aa1e-c109efb9167e tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4" status: 404 len: 111 microversion: 2.47 time: 0.039654 May 28 04:55:23.903910 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2672/5226] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:55:23 2022] GET /compute/v2.1/servers/60bdb14f-7809-477e-aebe-f56cc0e1e7f4 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 04:55:23.909558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c3396841-be0f-4c76-a774-5bae07b1b54c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:23.910066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c3396841-be0f-4c76-a774-5bae07b1b54c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 967b34cd-7be0-483f-95cc-6f75fd0d9341] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:23.920239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3396841-be0f-4c76-a774-5bae07b1b54c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:23.921292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3396841-be0f-4c76-a774-5bae07b1b54c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:23.922156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3396841-be0f-4c76-a774-5bae07b1b54c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:23.922603 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3396841-be0f-4c76-a774-5bae07b1b54c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:23.961086 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c3396841-be0f-4c76-a774-5bae07b1b54c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 967b34cd-7be0-483f-95cc-6f75fd0d9341] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:55:23.976797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f4281417-4b02-4ae3-903e-fbb7c963075a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:23.977549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f4281417-4b02-4ae3-903e-fbb7c963075a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:23.984035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4281417-4b02-4ae3-903e-fbb7c963075a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:23.984523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4281417-4b02-4ae3-903e-fbb7c963075a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:23.985293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4281417-4b02-4ae3-903e-fbb7c963075a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:23.985921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f4281417-4b02-4ae3-903e-fbb7c963075a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:24.004893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:24.230434 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f4281417-4b02-4ae3-903e-fbb7c963075a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:24.234679 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f4281417-4b02-4ae3-903e-fbb7c963075a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1321 microversion: 2.1 time: 0.262295 May 28 04:55:24.236368 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2673/5227] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:23 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:55:24.242823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-893e2d5c-305d-4790-a2f2-28be40b854c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:24.244291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-893e2d5c-305d-4790-a2f2-28be40b854c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:24.251068 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-893e2d5c-305d-4790-a2f2-28be40b854c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:24.251824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-893e2d5c-305d-4790-a2f2-28be40b854c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:24.252674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-893e2d5c-305d-4790-a2f2-28be40b854c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:24.253193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-893e2d5c-305d-4790-a2f2-28be40b854c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:24.308664 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c3396841-be0f-4c76-a774-5bae07b1b54c tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "DELETE /compute/v2.1/servers/967b34cd-7be0-483f-95cc-6f75fd0d9341" status: 204 len: 0 microversion: 2.47 time: 0.402695 May 28 04:55:24.309282 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2555/5228] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 04:55:23 2022] DELETE /compute/v2.1/servers/967b34cd-7be0-483f-95cc-6f75fd0d9341 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 04:55:24.334079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-32e68bf9-1a1b-4b7c-a7f4-216d45c8816a tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:24.336966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-32e68bf9-1a1b-4b7c-a7f4-216d45c8816a tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 967b34cd-7be0-483f-95cc-6f75fd0d9341] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:24.345494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-32e68bf9-1a1b-4b7c-a7f4-216d45c8816a tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:24.346179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-32e68bf9-1a1b-4b7c-a7f4-216d45c8816a tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:24.346961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-32e68bf9-1a1b-4b7c-a7f4-216d45c8816a tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:24.347567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-32e68bf9-1a1b-4b7c-a7f4-216d45c8816a tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:24.439922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-32e68bf9-1a1b-4b7c-a7f4-216d45c8816a tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:24.444656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-893e2d5c-305d-4790-a2f2-28be40b854c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:24.454254 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-893e2d5c-305d-4790-a2f2-28be40b854c2 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 200 len: 1314 microversion: 2.1 time: 0.216109 May 28 04:55:24.454820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-32e68bf9-1a1b-4b7c-a7f4-216d45c8816a tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:24.454950 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2674/5229] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:24 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:24.456898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-32e68bf9-1a1b-4b7c-a7f4-216d45c8816a tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:24.458521 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-32e68bf9-1a1b-4b7c-a7f4-216d45c8816a tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/967b34cd-7be0-483f-95cc-6f75fd0d9341" status: 200 len: 1363 microversion: 2.47 time: 0.144106 May 28 04:55:24.459621 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2556/5230] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:55:24 2022] GET /compute/v2.1/servers/967b34cd-7be0-483f-95cc-6f75fd0d9341 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:55:24.460007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f198a3d3-2c9b-4a09-8793-79562b248884 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:24.460803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f198a3d3-2c9b-4a09-8793-79562b248884 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:24.469354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f198a3d3-2c9b-4a09-8793-79562b248884 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:24.469751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f198a3d3-2c9b-4a09-8793-79562b248884 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:24.482046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f198a3d3-2c9b-4a09-8793-79562b248884 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:24.482542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f198a3d3-2c9b-4a09-8793-79562b248884 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:24.651821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-498e6c8a-7e00-44c7-83dc-9b231905fd74 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:24.652797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-498e6c8a-7e00-44c7-83dc-9b231905fd74 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:24.660390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-498e6c8a-7e00-44c7-83dc-9b231905fd74 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:24.660899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-498e6c8a-7e00-44c7-83dc-9b231905fd74 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:24.661676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-498e6c8a-7e00-44c7-83dc-9b231905fd74 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:24.662120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-498e6c8a-7e00-44c7-83dc-9b231905fd74 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:24.667319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f198a3d3-2c9b-4a09-8793-79562b248884 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:24.675948 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f198a3d3-2c9b-4a09-8793-79562b248884 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1691 microversion: 2.1 time: 0.219904 May 28 04:55:24.677457 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2675/5231] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:24 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1691 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:24.695516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d22640ee-90df-4166-8071-6d0b6da7c193 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:24.696429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d22640ee-90df-4166-8071-6d0b6da7c193 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:24.703684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d22640ee-90df-4166-8071-6d0b6da7c193 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:24.704145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d22640ee-90df-4166-8071-6d0b6da7c193 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:24.704982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d22640ee-90df-4166-8071-6d0b6da7c193 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:24.705398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d22640ee-90df-4166-8071-6d0b6da7c193 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:24.953159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-498e6c8a-7e00-44c7-83dc-9b231905fd74 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:24.962903 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-498e6c8a-7e00-44c7-83dc-9b231905fd74 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1519 microversion: 2.1 time: 0.316283 May 28 04:55:24.963526 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2557/5232] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:24 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1519 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:55:25.183295 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d22640ee-90df-4166-8071-6d0b6da7c193 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0/action" status: 202 len: 0 microversion: 2.1 time: 0.490346 May 28 04:55:25.194394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0f04a904-da0e-4c70-9df3-11bc54f10a88 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:25.195102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0f04a904-da0e-4c70-9df3-11bc54f10a88 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:25.203849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f04a904-da0e-4c70-9df3-11bc54f10a88 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:25.204450 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2676/5233] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:55:24 2022] POST /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:55:25.204748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f04a904-da0e-4c70-9df3-11bc54f10a88 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:25.205790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f04a904-da0e-4c70-9df3-11bc54f10a88 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:25.206240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f04a904-da0e-4c70-9df3-11bc54f10a88 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:25.254589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2cca3d52-0c6d-40f3-90a7-810acec8c984 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:25.255747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2cca3d52-0c6d-40f3-90a7-810acec8c984 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:25.265159 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2cca3d52-0c6d-40f3-90a7-810acec8c984 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:25.265822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2cca3d52-0c6d-40f3-90a7-810acec8c984 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:25.266752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2cca3d52-0c6d-40f3-90a7-810acec8c984 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:25.267365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2cca3d52-0c6d-40f3-90a7-810acec8c984 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:25.529100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2cca3d52-0c6d-40f3-90a7-810acec8c984 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:25.538943 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2cca3d52-0c6d-40f3-90a7-810acec8c984 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1514 microversion: 2.1 time: 0.289671 May 28 04:55:25.543938 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2677/5234] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:25 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1514 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:25.549213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1193777a-64a3-45ac-9501-3aabbb313032 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:25.549830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1193777a-64a3-45ac-9501-3aabbb313032 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:25.557007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1193777a-64a3-45ac-9501-3aabbb313032 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:25.558075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1193777a-64a3-45ac-9501-3aabbb313032 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:25.560423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1193777a-64a3-45ac-9501-3aabbb313032 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:25.561035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1193777a-64a3-45ac-9501-3aabbb313032 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:25.915994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1193777a-64a3-45ac-9501-3aabbb313032 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:25.928109 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1193777a-64a3-45ac-9501-3aabbb313032 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 200 len: 1314 microversion: 2.1 time: 0.382574 May 28 04:55:25.928929 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2678/5235] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:25 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:25.939405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-923db69c-7909-4642-8af6-92a711ec5e3d tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:25.943874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-923db69c-7909-4642-8af6-92a711ec5e3d tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 967b34cd-7be0-483f-95cc-6f75fd0d9341] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:25.960721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-923db69c-7909-4642-8af6-92a711ec5e3d tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:25.961285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-923db69c-7909-4642-8af6-92a711ec5e3d tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:25.965403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-923db69c-7909-4642-8af6-92a711ec5e3d tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:25.965902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-923db69c-7909-4642-8af6-92a711ec5e3d tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:25.993122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0f04a904-da0e-4c70-9df3-11bc54f10a88 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:26.002571 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0f04a904-da0e-4c70-9df3-11bc54f10a88 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1690 microversion: 2.1 time: 0.812213 May 28 04:55:26.003199 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2558/5236] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:25 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1690 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:26.013106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-923db69c-7909-4642-8af6-92a711ec5e3d tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:26.013826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-923db69c-7909-4642-8af6-92a711ec5e3d tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:26.014286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-923db69c-7909-4642-8af6-92a711ec5e3d tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lazy-loading 'fault' on Instance uuid 967b34cd-7be0-483f-95cc-6f75fd0d9341 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:55:26.019492 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-96044d87-5b38-4e50-b807-b00436f8429d req-e8fa8119-8e97-4957-8023-633d56a9aae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a2ae555-84a4-4580-9169-022e9c89d321", "name": "network-vif-plugged", "status": "completed", "tag": "9ac90f6b-0cb2-4acb-a468-fbb56b154035"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:26.031848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-96044d87-5b38-4e50-b807-b00436f8429d req-e8fa8119-8e97-4957-8023-633d56a9aae5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:26.037614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-96044d87-5b38-4e50-b807-b00436f8429d req-e8fa8119-8e97-4957-8023-633d56a9aae5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:26.051105 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-96044d87-5b38-4e50-b807-b00436f8429d req-e8fa8119-8e97-4957-8023-633d56a9aae5 service nova] Creating event network-vif-plugged:9ac90f6b-0cb2-4acb-a468-fbb56b154035 for instance 2a2ae555-84a4-4580-9169-022e9c89d321 on n-h2-843700-1 May 28 04:55:26.057629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-923db69c-7909-4642-8af6-92a711ec5e3d tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:26.066811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-923db69c-7909-4642-8af6-92a711ec5e3d tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:26.068370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-923db69c-7909-4642-8af6-92a711ec5e3d tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e852d1a61c4c77bd3d6df2559cc8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5882bae6fe4056b111e9b3de9e58c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:26.069570 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-923db69c-7909-4642-8af6-92a711ec5e3d tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/967b34cd-7be0-483f-95cc-6f75fd0d9341" status: 200 len: 1368 microversion: 2.47 time: 0.139124 May 28 04:55:26.079018 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2679/5237] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:55:25 2022] GET /compute/v2.1/servers/967b34cd-7be0-483f-95cc-6f75fd0d9341 => generated 1368 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:55:26.079375 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-96044d87-5b38-4e50-b807-b00436f8429d req-e8fa8119-8e97-4957-8023-633d56a9aae5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066264 May 28 04:55:26.079375 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2559/5238] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:55:26.094108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-54889ca4-3f4b-4228-9e25-e130c6f79276 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:26.094826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-54889ca4-3f4b-4228-9e25-e130c6f79276 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:26.107176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fbe96ae4-c71d-4018-97d8-5bb30fc391d9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:26.108216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fbe96ae4-c71d-4018-97d8-5bb30fc391d9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:26.131646 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54889ca4-3f4b-4228-9e25-e130c6f79276 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:26.135989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54889ca4-3f4b-4228-9e25-e130c6f79276 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:26.140965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54889ca4-3f4b-4228-9e25-e130c6f79276 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:26.141443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54889ca4-3f4b-4228-9e25-e130c6f79276 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:26.147939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fbe96ae4-c71d-4018-97d8-5bb30fc391d9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:26.159882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fbe96ae4-c71d-4018-97d8-5bb30fc391d9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:26.159882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fbe96ae4-c71d-4018-97d8-5bb30fc391d9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:26.159882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fbe96ae4-c71d-4018-97d8-5bb30fc391d9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:26.249052 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-fbe96ae4-c71d-4018-97d8-5bb30fc391d9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lazy-loading 'flavor' on Instance uuid ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:55:26.518656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-54889ca4-3f4b-4228-9e25-e130c6f79276 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:26.529448 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-54889ca4-3f4b-4228-9e25-e130c6f79276 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1519 microversion: 2.1 time: 0.454097 May 28 04:55:26.530916 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2560/5239] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:26 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1519 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:26.622449 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fbe96ae4-c71d-4018-97d8-5bb30fc391d9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "POST /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5/action" status: 200 len: 32 microversion: 2.1 time: 0.550979 May 28 04:55:26.624083 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2680/5240] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:55:26 2022] POST /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5/action => generated 32 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:55:26.642728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cee817aa-573b-4c49-9a82-e6e71d385786 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:26.643670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cee817aa-573b-4c49-9a82-e6e71d385786 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:26.649155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:26.654165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cee817aa-573b-4c49-9a82-e6e71d385786 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:26.655072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cee817aa-573b-4c49-9a82-e6e71d385786 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:26.656504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cee817aa-573b-4c49-9a82-e6e71d385786 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:26.669232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cee817aa-573b-4c49-9a82-e6e71d385786 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:26.993841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cee817aa-573b-4c49-9a82-e6e71d385786 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:27.002950 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cee817aa-573b-4c49-9a82-e6e71d385786 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1520 microversion: 2.1 time: 0.373601 May 28 04:55:27.004076 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2561/5241] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:26 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1520 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:27.020983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fef9e5c5-1c74-4855-91f7-29587bccd586 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:27.022241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fef9e5c5-1c74-4855-91f7-29587bccd586 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:27.036677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fef9e5c5-1c74-4855-91f7-29587bccd586 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:27.037803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fef9e5c5-1c74-4855-91f7-29587bccd586 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:27.038855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fef9e5c5-1c74-4855-91f7-29587bccd586 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:27.039514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fef9e5c5-1c74-4855-91f7-29587bccd586 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:27.564642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c42b9dd0-e136-4285-b570-d83e19640dd6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:27.567789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c42b9dd0-e136-4285-b570-d83e19640dd6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:27.570700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:27.586876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c42b9dd0-e136-4285-b570-d83e19640dd6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:27.589290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c42b9dd0-e136-4285-b570-d83e19640dd6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:27.591266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c42b9dd0-e136-4285-b570-d83e19640dd6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:27.592348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c42b9dd0-e136-4285-b570-d83e19640dd6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:27.654142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fef9e5c5-1c74-4855-91f7-29587bccd586 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:27.669063 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fef9e5c5-1c74-4855-91f7-29587bccd586 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1690 microversion: 2.1 time: 0.652020 May 28 04:55:27.674316 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2562/5242] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:27 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1690 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:55:27.707193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b1c08424-8327-41e6-b28a-2de28e673dd7 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:27.711298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b1c08424-8327-41e6-b28a-2de28e673dd7 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] [instance: 967b34cd-7be0-483f-95cc-6f75fd0d9341] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:27.728843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b1c08424-8327-41e6-b28a-2de28e673dd7 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:27.729971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b1c08424-8327-41e6-b28a-2de28e673dd7 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:27.733166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b1c08424-8327-41e6-b28a-2de28e673dd7 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:27.733789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b1c08424-8327-41e6-b28a-2de28e673dd7 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:27.754406 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-b1c08424-8327-41e6-b28a-2de28e673dd7 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] HTTP exception thrown: Instance 967b34cd-7be0-483f-95cc-6f75fd0d9341 could not be found. May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b1c08424-8327-41e6-b28a-2de28e673dd7 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Request method failure captured: May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/967b34cd-7be0-483f-95cc-6f75fd0d9341 HTTP/1.1 May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikasFuKbAITMNDgoWlHbUbdOaqjXlB8ihp0-grHf6S0KnCQc4TanujJpUeO3ITG-Y0Q--6yV6i0BE0cD8QYWRpm3YyXN-wPx5VkRDOSOFZUFYwTaankKolu2AKL5yxS_HiC0c7e4aALaFrFGuRcclhuDG3VQA8B9PleRN28sAlbueo7E May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-Openstack-Nova-Api-Version: 2.47 May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 5f5882bae6fe4056b111e9b3de9e58c4 May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerShowV247Test-1734889737 May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5f5882bae6fe4056b111e9b3de9e58c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5f5882bae6fe4056b111e9b3de9e58c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f5882bae6fe4056b111e9b3de9e58c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f5882bae6fe4056b111e9b3de9e58c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerShowV247Test-1734889737 May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 5f5882bae6fe4056b111e9b3de9e58c4 May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerShowV247Test-1734889737 May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerShowV247Test-1734889737-project May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 77e852d1a61c4c77bd3d6df2559cc8c0 May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerShowV247Test-1734889737-project May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 967b34cd-7be0-483f-95cc-6f75fd0d9341 could not be found. May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '967b34cd-7be0-483f-95cc-6f75fd0d9341'} May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 967b34cd-7be0-483f-95cc-6f75fd0d9341 could not be found. May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 967b34cd-7be0-483f-95cc-6f75fd0d9341 could not be found. May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:27.756618 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:27.761724 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:27.761724 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:27.761724 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:27.761724 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:27.761724 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:27.761724 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 967b34cd-7be0-483f-95cc-6f75fd0d9341 could not be found. May 28 04:55:27.761724 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:27.762972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b1c08424-8327-41e6-b28a-2de28e673dd7 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] Returning 404 to user: Instance 967b34cd-7be0-483f-95cc-6f75fd0d9341 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:27.764244 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b1c08424-8327-41e6-b28a-2de28e673dd7 tempest-ServerShowV247Test-1734889737 tempest-ServerShowV247Test-1734889737-project] 10.222.0.58 "GET /compute/v2.1/servers/967b34cd-7be0-483f-95cc-6f75fd0d9341" status: 404 len: 111 microversion: 2.47 time: 0.078946 May 28 04:55:27.766154 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2563/5243] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:55:27 2022] GET /compute/v2.1/servers/967b34cd-7be0-483f-95cc-6f75fd0d9341 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 04:55:27.772564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9c449eb6-566d-4d74-be02-02acd6e0f2ce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:27.774237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9c449eb6-566d-4d74-be02-02acd6e0f2ce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:27.782486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9c449eb6-566d-4d74-be02-02acd6e0f2ce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:27.783344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9c449eb6-566d-4d74-be02-02acd6e0f2ce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:27.789381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9c449eb6-566d-4d74-be02-02acd6e0f2ce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:27.789381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9c449eb6-566d-4d74-be02-02acd6e0f2ce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:28.230004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9c449eb6-566d-4d74-be02-02acd6e0f2ce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:28.241926 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9c449eb6-566d-4d74-be02-02acd6e0f2ce tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1519 microversion: 2.1 time: 0.474027 May 28 04:55:28.262869 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2564/5244] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:27 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1519 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:28.268279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b8fd6e21-b67a-4d4d-bb27-f62eb685d259 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:28.269192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b8fd6e21-b67a-4d4d-bb27-f62eb685d259 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:28.276153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8fd6e21-b67a-4d4d-bb27-f62eb685d259 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:28.279711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8fd6e21-b67a-4d4d-bb27-f62eb685d259 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:28.280760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8fd6e21-b67a-4d4d-bb27-f62eb685d259 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:28.283380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8fd6e21-b67a-4d4d-bb27-f62eb685d259 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:28.391818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c42b9dd0-e136-4285-b570-d83e19640dd6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:28.407346 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c42b9dd0-e136-4285-b570-d83e19640dd6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 200 len: 1314 microversion: 2.1 time: 1.463397 May 28 04:55:28.407980 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2681/5245] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:26 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 1314 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:28.412795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-ae62f920-8a10-4f64-8229-ccf0f44fcbb9 req-1b826b17-4a8f-4339-8c08-5cb3658a7b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260294eb-db79-4280-a534-928afd9312d0", "name": "network-vif-plugged", "status": "completed", "tag": "3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:28.434626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ae62f920-8a10-4f64-8229-ccf0f44fcbb9 req-1b826b17-4a8f-4339-8c08-5cb3658a7b93 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:28.436365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ae62f920-8a10-4f64-8229-ccf0f44fcbb9 req-1b826b17-4a8f-4339-8c08-5cb3658a7b93 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:28.463163 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-ae62f920-8a10-4f64-8229-ccf0f44fcbb9 req-1b826b17-4a8f-4339-8c08-5cb3658a7b93 service nova] Creating event network-vif-plugged:3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0 for instance 260294eb-db79-4280-a534-928afd9312d0 on n-h1-843700-1 May 28 04:55:28.477239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-ae62f920-8a10-4f64-8229-ccf0f44fcbb9 req-1b826b17-4a8f-4339-8c08-5cb3658a7b93 service nova] Instance 260294eb-db79-4280-a534-928afd9312d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:55:28.503945 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-ae62f920-8a10-4f64-8229-ccf0f44fcbb9 req-1b826b17-4a8f-4339-8c08-5cb3658a7b93 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093555 May 28 04:55:28.506938 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2682/5246] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:55:28.673627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b8fd6e21-b67a-4d4d-bb27-f62eb685d259 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:28.691012 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b8fd6e21-b67a-4d4d-bb27-f62eb685d259 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1520 microversion: 2.1 time: 0.426531 May 28 04:55:28.695173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-272cf523-0368-4c45-ac9e-0b7337615fb2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:28.695891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-272cf523-0368-4c45-ac9e-0b7337615fb2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:28.703668 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2565/5247] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:28 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1520 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:28.715092 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-272cf523-0368-4c45-ac9e-0b7337615fb2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:28.715759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-272cf523-0368-4c45-ac9e-0b7337615fb2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:28.723517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-272cf523-0368-4c45-ac9e-0b7337615fb2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:28.724230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-272cf523-0368-4c45-ac9e-0b7337615fb2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:28.934014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-272cf523-0368-4c45-ac9e-0b7337615fb2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:28.952304 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-272cf523-0368-4c45-ac9e-0b7337615fb2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1690 microversion: 2.1 time: 0.251408 May 28 04:55:28.953879 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2683/5248] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:28 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1690 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:29.264252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-187a6afb-4c60-4aa2-a2b8-d0da6383c41e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:29.266173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-187a6afb-4c60-4aa2-a2b8-d0da6383c41e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:29.277257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-187a6afb-4c60-4aa2-a2b8-d0da6383c41e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:29.277980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-187a6afb-4c60-4aa2-a2b8-d0da6383c41e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:29.278842 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-187a6afb-4c60-4aa2-a2b8-d0da6383c41e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:29.279316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-187a6afb-4c60-4aa2-a2b8-d0da6383c41e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:29.429477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-640d5a9b-42b9-4a90-b43a-de30af3868ea tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:29.432522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-640d5a9b-42b9-4a90-b43a-de30af3868ea tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:29.443735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-640d5a9b-42b9-4a90-b43a-de30af3868ea tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:29.444999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-640d5a9b-42b9-4a90-b43a-de30af3868ea tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:29.446287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-640d5a9b-42b9-4a90-b43a-de30af3868ea tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:29.448465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-187a6afb-4c60-4aa2-a2b8-d0da6383c41e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:29.448630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-640d5a9b-42b9-4a90-b43a-de30af3868ea tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:29.464484 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-187a6afb-4c60-4aa2-a2b8-d0da6383c41e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1519 microversion: 2.1 time: 0.208190 May 28 04:55:29.465707 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2566/5249] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:29 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:29.710771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f69036e8-0420-41ef-b34f-040b93fc0c40 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:29.711643 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f69036e8-0420-41ef-b34f-040b93fc0c40 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:29.719666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f69036e8-0420-41ef-b34f-040b93fc0c40 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:29.720410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f69036e8-0420-41ef-b34f-040b93fc0c40 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:29.721614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f69036e8-0420-41ef-b34f-040b93fc0c40 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:29.722356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f69036e8-0420-41ef-b34f-040b93fc0c40 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:29.927736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:30.119634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:30.400925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-640d5a9b-42b9-4a90-b43a-de30af3868ea tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:30.410042 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-640d5a9b-42b9-4a90-b43a-de30af3868ea tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 200 len: 1502 microversion: 2.1 time: 0.989482 May 28 04:55:30.413938 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2684/5250] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:29 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 1502 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:30.432995 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f69036e8-0420-41ef-b34f-040b93fc0c40 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:30.443448 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f69036e8-0420-41ef-b34f-040b93fc0c40 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1520 microversion: 2.1 time: 0.736478 May 28 04:55:30.444014 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2567/5251] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:29 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1520 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:30.445690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-89061081-f576-4835-b668-167597332b5f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:30.447448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-89061081-f576-4835-b668-167597332b5f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:30.456399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89061081-f576-4835-b668-167597332b5f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:30.456399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89061081-f576-4835-b668-167597332b5f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:30.460793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5320aef3-efe3-4dab-8d66-315769b6a0d5 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:30.461341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5320aef3-efe3-4dab-8d66-315769b6a0d5 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:30.463720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89061081-f576-4835-b668-167597332b5f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:30.464202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89061081-f576-4835-b668-167597332b5f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:30.473917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5320aef3-efe3-4dab-8d66-315769b6a0d5 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:30.474383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5320aef3-efe3-4dab-8d66-315769b6a0d5 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:30.476469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5320aef3-efe3-4dab-8d66-315769b6a0d5 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:30.476469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5320aef3-efe3-4dab-8d66-315769b6a0d5 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:30.527199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-5320aef3-efe3-4dab-8d66-315769b6a0d5 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lazy-loading 'flavor' on Instance uuid 2a2ae555-84a4-4580-9169-022e9c89d321 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:55:30.690625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-89061081-f576-4835-b668-167597332b5f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:30.704590 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-89061081-f576-4835-b668-167597332b5f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1690 microversion: 2.1 time: 0.280130 May 28 04:55:30.705635 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2685/5252] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:30 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1690 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:30.716145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-999d7da6-c2f8-48a7-aa74-e4699094c01f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:30.721764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-999d7da6-c2f8-48a7-aa74-e4699094c01f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:30.731253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-999d7da6-c2f8-48a7-aa74-e4699094c01f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:30.743179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-999d7da6-c2f8-48a7-aa74-e4699094c01f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:30.743179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-999d7da6-c2f8-48a7-aa74-e4699094c01f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:30.743179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-999d7da6-c2f8-48a7-aa74-e4699094c01f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:30.754622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:30.770397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:31.152605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-999d7da6-c2f8-48a7-aa74-e4699094c01f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:31.164363 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-999d7da6-c2f8-48a7-aa74-e4699094c01f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1519 microversion: 2.1 time: 0.455852 May 28 04:55:31.167840 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2686/5253] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:30 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1519 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:31.277807 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5320aef3-efe3-4dab-8d66-315769b6a0d5 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "POST /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321/action" status: 202 len: 0 microversion: 2.1 time: 0.828877 May 28 04:55:31.279374 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2568/5254] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:55:30 2022] POST /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321/action => generated 0 bytes in 831 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:55:31.287797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a241f83e-cf27-40c0-819d-4824dde385f6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:31.288453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a241f83e-cf27-40c0-819d-4824dde385f6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:31.306955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a241f83e-cf27-40c0-819d-4824dde385f6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:31.306955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a241f83e-cf27-40c0-819d-4824dde385f6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:31.307336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a241f83e-cf27-40c0-819d-4824dde385f6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:31.308094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a241f83e-cf27-40c0-819d-4824dde385f6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:31.463250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bf55757a-4509-469b-b481-66cee9b40888 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:31.463965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bf55757a-4509-469b-b481-66cee9b40888 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:31.482755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf55757a-4509-469b-b481-66cee9b40888 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:31.486586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf55757a-4509-469b-b481-66cee9b40888 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:31.487688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf55757a-4509-469b-b481-66cee9b40888 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:31.489286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf55757a-4509-469b-b481-66cee9b40888 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:31.674916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a241f83e-cf27-40c0-819d-4824dde385f6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:31.684594 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a241f83e-cf27-40c0-819d-4824dde385f6 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 200 len: 1510 microversion: 2.1 time: 0.401270 May 28 04:55:31.690719 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2687/5255] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:31 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 1510 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:31.729952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5e47ef6c-1954-46a3-af2c-8df45a0a0de0 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:31.735834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5e47ef6c-1954-46a3-af2c-8df45a0a0de0 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:31.739100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5e47ef6c-1954-46a3-af2c-8df45a0a0de0 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:31.742384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5e47ef6c-1954-46a3-af2c-8df45a0a0de0 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:31.743901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5e47ef6c-1954-46a3-af2c-8df45a0a0de0 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:31.744712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5e47ef6c-1954-46a3-af2c-8df45a0a0de0 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:31.848499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bf55757a-4509-469b-b481-66cee9b40888 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:31.864593 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bf55757a-4509-469b-b481-66cee9b40888 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1520 microversion: 2.1 time: 0.405527 May 28 04:55:31.871196 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2569/5256] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:31 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1520 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:32.020013 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5e47ef6c-1954-46a3-af2c-8df45a0a0de0 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:32.029059 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5e47ef6c-1954-46a3-af2c-8df45a0a0de0 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1690 microversion: 2.1 time: 0.306797 May 28 04:55:32.040421 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2688/5257] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:31 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1690 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:55:32.185462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4be81896-81f4-498d-9fa5-3fd86d58a492 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:32.186109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4be81896-81f4-498d-9fa5-3fd86d58a492 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:32.205538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4be81896-81f4-498d-9fa5-3fd86d58a492 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:32.206210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4be81896-81f4-498d-9fa5-3fd86d58a492 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:32.207037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4be81896-81f4-498d-9fa5-3fd86d58a492 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:32.208130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4be81896-81f4-498d-9fa5-3fd86d58a492 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:32.578790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4be81896-81f4-498d-9fa5-3fd86d58a492 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:32.597359 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4be81896-81f4-498d-9fa5-3fd86d58a492 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1519 microversion: 2.1 time: 0.414187 May 28 04:55:32.599206 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2570/5258] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:32 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1519 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:32.705497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c2cff860-fb15-4bde-83d2-b14c5061eb5b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:32.707016 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c2cff860-fb15-4bde-83d2-b14c5061eb5b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:32.722383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2cff860-fb15-4bde-83d2-b14c5061eb5b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:32.727009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2cff860-fb15-4bde-83d2-b14c5061eb5b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:32.727009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2cff860-fb15-4bde-83d2-b14c5061eb5b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:32.727009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2cff860-fb15-4bde-83d2-b14c5061eb5b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:32.891249 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-357e903f-2e22-49fc-aaff-b000e66f9677 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:32.892375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-357e903f-2e22-49fc-aaff-b000e66f9677 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:32.905696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-357e903f-2e22-49fc-aaff-b000e66f9677 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:32.906644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-357e903f-2e22-49fc-aaff-b000e66f9677 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:32.908088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-357e903f-2e22-49fc-aaff-b000e66f9677 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:32.908721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-357e903f-2e22-49fc-aaff-b000e66f9677 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:33.570837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-357e903f-2e22-49fc-aaff-b000e66f9677 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:33.583007 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-357e903f-2e22-49fc-aaff-b000e66f9677 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1520 microversion: 2.1 time: 0.703743 May 28 04:55:33.586578 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2571/5259] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:32 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1520 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:55:33.599666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3eaa316d-7c37-4706-9e6d-72380a190412 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:33.601965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3eaa316d-7c37-4706-9e6d-72380a190412 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:33.627423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3eaa316d-7c37-4706-9e6d-72380a190412 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:33.631180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3eaa316d-7c37-4706-9e6d-72380a190412 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:33.631180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3eaa316d-7c37-4706-9e6d-72380a190412 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:33.631180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3eaa316d-7c37-4706-9e6d-72380a190412 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:33.957113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c2cff860-fb15-4bde-83d2-b14c5061eb5b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:33.972231 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c2cff860-fb15-4bde-83d2-b14c5061eb5b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 200 len: 1493 microversion: 2.1 time: 1.271704 May 28 04:55:33.975324 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2689/5260] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:32 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 1493 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:34.002401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cc439807-ef8f-4a4b-9def-07ff9438d5a6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:34.007363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cc439807-ef8f-4a4b-9def-07ff9438d5a6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:34.020783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc439807-ef8f-4a4b-9def-07ff9438d5a6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:34.022397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc439807-ef8f-4a4b-9def-07ff9438d5a6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:34.023454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc439807-ef8f-4a4b-9def-07ff9438d5a6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:34.024120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc439807-ef8f-4a4b-9def-07ff9438d5a6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:34.292249 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3eaa316d-7c37-4706-9e6d-72380a190412 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:34.320539 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3eaa316d-7c37-4706-9e6d-72380a190412 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1690 microversion: 2.1 time: 0.730169 May 28 04:55:34.327167 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2572/5261] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:33 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1690 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:34.353936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fa2e204b-3eb6-4222-9431-c1fccb1eb928 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:34.357105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fa2e204b-3eb6-4222-9431-c1fccb1eb928 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:34.376464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa2e204b-3eb6-4222-9431-c1fccb1eb928 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:34.377087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa2e204b-3eb6-4222-9431-c1fccb1eb928 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:34.378744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa2e204b-3eb6-4222-9431-c1fccb1eb928 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:34.379720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa2e204b-3eb6-4222-9431-c1fccb1eb928 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:34.409457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cc439807-ef8f-4a4b-9def-07ff9438d5a6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:34.421631 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cc439807-ef8f-4a4b-9def-07ff9438d5a6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1519 microversion: 2.1 time: 0.441906 May 28 04:55:34.422455 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2690/5262] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:33 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1519 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:34.438373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fa2e204b-3eb6-4222-9431-c1fccb1eb928 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:55:34.604909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3c9cd15e-4a08-48e2-91c4-ff54528f1c01 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:34.606780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3c9cd15e-4a08-48e2-91c4-ff54528f1c01 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:34.627170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c9cd15e-4a08-48e2-91c4-ff54528f1c01 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:34.632009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c9cd15e-4a08-48e2-91c4-ff54528f1c01 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:34.632009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c9cd15e-4a08-48e2-91c4-ff54528f1c01 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:34.632009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c9cd15e-4a08-48e2-91c4-ff54528f1c01 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:34.834323 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fa2e204b-3eb6-4222-9431-c1fccb1eb928 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 204 len: 0 microversion: 2.1 time: 0.504245 May 28 04:55:34.835638 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2573/5263] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:55:34 2022] DELETE /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:55:34.862158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7adfb342-3efa-46da-8d1a-140345b26034 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:34.865649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7adfb342-3efa-46da-8d1a-140345b26034 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:34.881075 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7adfb342-3efa-46da-8d1a-140345b26034 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:34.881986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7adfb342-3efa-46da-8d1a-140345b26034 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:34.893628 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7adfb342-3efa-46da-8d1a-140345b26034 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:34.894126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7adfb342-3efa-46da-8d1a-140345b26034 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:34.924532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3c9cd15e-4a08-48e2-91c4-ff54528f1c01 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:34.936722 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3c9cd15e-4a08-48e2-91c4-ff54528f1c01 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1520 microversion: 2.1 time: 0.336885 May 28 04:55:34.940321 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2691/5264] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:34 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1520 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:35.265985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7adfb342-3efa-46da-8d1a-140345b26034 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:35.278245 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7adfb342-3efa-46da-8d1a-140345b26034 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 200 len: 1499 microversion: 2.1 time: 0.437726 May 28 04:55:35.292032 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2574/5265] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:34 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 1499 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:35.338270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-29cc3dba-b9a1-4a86-bd12-58b723a10a50 req-afdf3d03-ca1c-452c-b4f6-61f45356e4af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260294eb-db79-4280-a534-928afd9312d0", "name": "network-vif-unplugged", "status": "completed", "tag": "3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:35.347773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4efc4413-aae1-44e5-a4f6-4432a731dd77 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:35.348745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4efc4413-aae1-44e5-a4f6-4432a731dd77 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:35.354932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-29cc3dba-b9a1-4a86-bd12-58b723a10a50 req-afdf3d03-ca1c-452c-b4f6-61f45356e4af service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:35.362530 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-29cc3dba-b9a1-4a86-bd12-58b723a10a50 req-afdf3d03-ca1c-452c-b4f6-61f45356e4af service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:35.364231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4efc4413-aae1-44e5-a4f6-4432a731dd77 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:35.366904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4efc4413-aae1-44e5-a4f6-4432a731dd77 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:35.367998 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4efc4413-aae1-44e5-a4f6-4432a731dd77 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:35.371236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4efc4413-aae1-44e5-a4f6-4432a731dd77 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:35.406630 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-29cc3dba-b9a1-4a86-bd12-58b723a10a50 req-afdf3d03-ca1c-452c-b4f6-61f45356e4af service nova] Creating event network-vif-unplugged:3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0 for instance 260294eb-db79-4280-a534-928afd9312d0 on n-h2-843700-1 May 28 04:55:35.424110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-29cc3dba-b9a1-4a86-bd12-58b723a10a50 req-afdf3d03-ca1c-452c-b4f6-61f45356e4af service nova] Instance 260294eb-db79-4280-a534-928afd9312d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:55:35.459546 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-29cc3dba-b9a1-4a86-bd12-58b723a10a50 req-afdf3d03-ca1c-452c-b4f6-61f45356e4af service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125986 May 28 04:55:35.460275 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2692/5266] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:55:35.472238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2e48dcf6-96bc-41d1-990e-383af09ae655 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:35.473819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2e48dcf6-96bc-41d1-990e-383af09ae655 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:35.481652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e48dcf6-96bc-41d1-990e-383af09ae655 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:35.482815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e48dcf6-96bc-41d1-990e-383af09ae655 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:35.484103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e48dcf6-96bc-41d1-990e-383af09ae655 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:35.484863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e48dcf6-96bc-41d1-990e-383af09ae655 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:35.755927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4efc4413-aae1-44e5-a4f6-4432a731dd77 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:35.767984 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4efc4413-aae1-44e5-a4f6-4432a731dd77 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1690 microversion: 2.1 time: 0.427829 May 28 04:55:35.768617 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2575/5267] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:35 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1690 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:35.812806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2e48dcf6-96bc-41d1-990e-383af09ae655 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:35.829967 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2e48dcf6-96bc-41d1-990e-383af09ae655 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1519 microversion: 2.1 time: 0.367948 May 28 04:55:35.835097 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2693/5268] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:35 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1519 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:35.971156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fde81f58-d1b8-4d13-bd42-72d339a74c43 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:35.974624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fde81f58-d1b8-4d13-bd42-72d339a74c43 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:36.006124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fde81f58-d1b8-4d13-bd42-72d339a74c43 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:36.017048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fde81f58-d1b8-4d13-bd42-72d339a74c43 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:36.019988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fde81f58-d1b8-4d13-bd42-72d339a74c43 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:36.023048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fde81f58-d1b8-4d13-bd42-72d339a74c43 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:36.299514 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-11bb7882-1d3e-44a5-bb9e-6d7783acb216 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:36.300458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-11bb7882-1d3e-44a5-bb9e-6d7783acb216 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:36.313062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11bb7882-1d3e-44a5-bb9e-6d7783acb216 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:36.319200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11bb7882-1d3e-44a5-bb9e-6d7783acb216 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:36.320285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11bb7882-1d3e-44a5-bb9e-6d7783acb216 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:36.320814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11bb7882-1d3e-44a5-bb9e-6d7783acb216 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:36.640456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fde81f58-d1b8-4d13-bd42-72d339a74c43 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:36.652569 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fde81f58-d1b8-4d13-bd42-72d339a74c43 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1520 microversion: 2.1 time: 0.697840 May 28 04:55:36.655347 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2576/5269] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:35 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1520 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:36.710740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-11bb7882-1d3e-44a5-bb9e-6d7783acb216 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:36.732825 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-11bb7882-1d3e-44a5-bb9e-6d7783acb216 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 200 len: 1499 microversion: 2.1 time: 0.437630 May 28 04:55:36.734189 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2694/5270] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:36 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 1499 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:36.789988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dfce8376-9168-43ae-9a5e-3e7aaee18c43 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:36.795825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dfce8376-9168-43ae-9a5e-3e7aaee18c43 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:36.802666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfce8376-9168-43ae-9a5e-3e7aaee18c43 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:36.803165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfce8376-9168-43ae-9a5e-3e7aaee18c43 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:36.804783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfce8376-9168-43ae-9a5e-3e7aaee18c43 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:36.805238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfce8376-9168-43ae-9a5e-3e7aaee18c43 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:36.871689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3dffe30f-adb2-4228-9803-4ac99d4fad0b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:36.871689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3dffe30f-adb2-4228-9803-4ac99d4fad0b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:36.894501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3dffe30f-adb2-4228-9803-4ac99d4fad0b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:36.905243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3dffe30f-adb2-4228-9803-4ac99d4fad0b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:36.918438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3dffe30f-adb2-4228-9803-4ac99d4fad0b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:36.919655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3dffe30f-adb2-4228-9803-4ac99d4fad0b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:37.261682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dfce8376-9168-43ae-9a5e-3e7aaee18c43 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:37.293670 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dfce8376-9168-43ae-9a5e-3e7aaee18c43 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1690 microversion: 2.1 time: 0.506558 May 28 04:55:37.294964 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2577/5271] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:36 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1690 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:37.455037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3dffe30f-adb2-4228-9803-4ac99d4fad0b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:37.470326 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3dffe30f-adb2-4228-9803-4ac99d4fad0b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1519 microversion: 2.1 time: 0.625929 May 28 04:55:37.471302 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2695/5272] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:36 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1519 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:37.679369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1bf2601b-4fe8-4df8-93ab-ab0645ad1690 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:37.680218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1bf2601b-4fe8-4df8-93ab-ab0645ad1690 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:37.706678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1bf2601b-4fe8-4df8-93ab-ab0645ad1690 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:37.708730 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1bf2601b-4fe8-4df8-93ab-ab0645ad1690 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:37.717055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1bf2601b-4fe8-4df8-93ab-ab0645ad1690 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:37.718145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1bf2601b-4fe8-4df8-93ab-ab0645ad1690 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:37.752383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b7457349-b75b-47b1-bd63-012db5f65daf tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:37.754489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b7457349-b75b-47b1-bd63-012db5f65daf tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:37.768912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b7457349-b75b-47b1-bd63-012db5f65daf tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:37.770157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b7457349-b75b-47b1-bd63-012db5f65daf tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:37.771349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b7457349-b75b-47b1-bd63-012db5f65daf tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:37.772173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b7457349-b75b-47b1-bd63-012db5f65daf tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:38.324704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b7457349-b75b-47b1-bd63-012db5f65daf tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:38.345128 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b7457349-b75b-47b1-bd63-012db5f65daf tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 200 len: 1499 microversion: 2.1 time: 0.588079 May 28 04:55:38.346936 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2696/5273] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:37 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 1499 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:38.361742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-2703a586-5fc6-48a8-a8a1-45248f7e4c6a req-941c692d-96dd-4af6-87f4-e829e20bc1c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "260294eb-db79-4280-a534-928afd9312d0", "tag": "3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:38.387456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2703a586-5fc6-48a8-a8a1-45248f7e4c6a req-941c692d-96dd-4af6-87f4-e829e20bc1c5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:38.390124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2703a586-5fc6-48a8-a8a1-45248f7e4c6a req-941c692d-96dd-4af6-87f4-e829e20bc1c5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:38.406813 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-2703a586-5fc6-48a8-a8a1-45248f7e4c6a req-941c692d-96dd-4af6-87f4-e829e20bc1c5 service nova] Creating event network-changed:3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0 for instance 260294eb-db79-4280-a534-928afd9312d0 on n-h2-843700-1 May 28 04:55:38.416921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-2703a586-5fc6-48a8-a8a1-45248f7e4c6a req-941c692d-96dd-4af6-87f4-e829e20bc1c5 service nova] Instance 260294eb-db79-4280-a534-928afd9312d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 04:55:38.434040 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-2703a586-5fc6-48a8-a8a1-45248f7e4c6a req-941c692d-96dd-4af6-87f4-e829e20bc1c5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084657 May 28 04:55:38.435373 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2697/5274] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:55:38.443412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d3299bb3-a05e-4d84-9a83-edb083313a6b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:38.445305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d3299bb3-a05e-4d84-9a83-edb083313a6b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:38.456458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3299bb3-a05e-4d84-9a83-edb083313a6b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:38.457177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3299bb3-a05e-4d84-9a83-edb083313a6b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:38.462652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1bf2601b-4fe8-4df8-93ab-ab0645ad1690 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:38.475861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3299bb3-a05e-4d84-9a83-edb083313a6b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:38.476977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3299bb3-a05e-4d84-9a83-edb083313a6b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:38.482305 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1bf2601b-4fe8-4df8-93ab-ab0645ad1690 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1520 microversion: 2.1 time: 0.805975 May 28 04:55:38.491650 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2578/5275] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:37 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1520 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:38.507314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f2f8d157-179b-4710-b840-cd4c18d264a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:38.508262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f2f8d157-179b-4710-b840-cd4c18d264a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:38.533931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2f8d157-179b-4710-b840-cd4c18d264a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:38.535624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2f8d157-179b-4710-b840-cd4c18d264a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:38.538521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2f8d157-179b-4710-b840-cd4c18d264a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:38.539079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2f8d157-179b-4710-b840-cd4c18d264a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:39.107549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d3299bb3-a05e-4d84-9a83-edb083313a6b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:39.118121 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d3299bb3-a05e-4d84-9a83-edb083313a6b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1690 microversion: 2.1 time: 0.681170 May 28 04:55:39.124139 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2698/5276] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:38 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1690 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:39.130413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f2f8d157-179b-4710-b840-cd4c18d264a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:39.142534 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f2f8d157-179b-4710-b840-cd4c18d264a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1519 microversion: 2.1 time: 0.649520 May 28 04:55:39.143390 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2579/5277] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:38 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1519 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:39.370391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ae4aef7a-3df7-4469-b939-516a4130560c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:39.372685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ae4aef7a-3df7-4469-b939-516a4130560c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:39.413023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae4aef7a-3df7-4469-b939-516a4130560c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:39.418578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae4aef7a-3df7-4469-b939-516a4130560c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:39.425387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae4aef7a-3df7-4469-b939-516a4130560c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:39.427149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae4aef7a-3df7-4469-b939-516a4130560c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:39.510481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-037f850c-d0e8-4ed3-96eb-1aa224dd6103 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:39.513547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-037f850c-d0e8-4ed3-96eb-1aa224dd6103 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:39.540613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-037f850c-d0e8-4ed3-96eb-1aa224dd6103 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:39.541977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-037f850c-d0e8-4ed3-96eb-1aa224dd6103 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:39.544144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-037f850c-d0e8-4ed3-96eb-1aa224dd6103 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:39.546069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-037f850c-d0e8-4ed3-96eb-1aa224dd6103 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:39.693610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ae4aef7a-3df7-4469-b939-516a4130560c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:39.702703 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ae4aef7a-3df7-4469-b939-516a4130560c tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 200 len: 1457 microversion: 2.1 time: 0.341372 May 28 04:55:39.707210 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2699/5278] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:39 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 1457 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:40.042425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-037f850c-d0e8-4ed3-96eb-1aa224dd6103 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:40.073055 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-037f850c-d0e8-4ed3-96eb-1aa224dd6103 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1520 microversion: 2.1 time: 0.569284 May 28 04:55:40.073696 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2580/5279] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:39 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1520 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:40.149052 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-77f4e325-5089-45b9-99c1-dadbe22aa420 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:40.150469 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-77f4e325-5089-45b9-99c1-dadbe22aa420 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:40.161440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3f0b2880-6aab-4912-b981-3752ae705aa5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:40.162366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3f0b2880-6aab-4912-b981-3752ae705aa5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:40.188517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f0b2880-6aab-4912-b981-3752ae705aa5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:40.190219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f0b2880-6aab-4912-b981-3752ae705aa5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:40.194878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f0b2880-6aab-4912-b981-3752ae705aa5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:40.194878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f0b2880-6aab-4912-b981-3752ae705aa5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:40.204812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77f4e325-5089-45b9-99c1-dadbe22aa420 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:40.205283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77f4e325-5089-45b9-99c1-dadbe22aa420 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:40.206107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77f4e325-5089-45b9-99c1-dadbe22aa420 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:40.206559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77f4e325-5089-45b9-99c1-dadbe22aa420 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:40.681846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3f0b2880-6aab-4912-b981-3752ae705aa5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:40.686613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-77f4e325-5089-45b9-99c1-dadbe22aa420 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:40.709493 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3f0b2880-6aab-4912-b981-3752ae705aa5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1519 microversion: 2.1 time: 0.552908 May 28 04:55:40.711264 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2581/5280] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:40 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1519 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:55:40.713178 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-77f4e325-5089-45b9-99c1-dadbe22aa420 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1690 microversion: 2.1 time: 0.580963 May 28 04:55:40.718156 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2700/5281] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:40 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1690 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:40.742314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-d7a5ae12-8e5a-436c-8234-a4fbca8bda89 req-5d6e96a9-d6eb-4615-8029-8ec726b62631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a2ae555-84a4-4580-9169-022e9c89d321", "name": "network-vif-deleted", "tag": "9ac90f6b-0cb2-4acb-a468-fbb56b154035"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:40.761931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d7a5ae12-8e5a-436c-8234-a4fbca8bda89 req-5d6e96a9-d6eb-4615-8029-8ec726b62631 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:40.762706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d7a5ae12-8e5a-436c-8234-a4fbca8bda89 req-5d6e96a9-d6eb-4615-8029-8ec726b62631 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:40.778746 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-d7a5ae12-8e5a-436c-8234-a4fbca8bda89 req-5d6e96a9-d6eb-4615-8029-8ec726b62631 service nova] Creating event network-vif-deleted:9ac90f6b-0cb2-4acb-a468-fbb56b154035 for instance 2a2ae555-84a4-4580-9169-022e9c89d321 on n-h2-843700-1 May 28 04:55:40.784151 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-d7a5ae12-8e5a-436c-8234-a4fbca8bda89 req-5d6e96a9-d6eb-4615-8029-8ec726b62631 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054803 May 28 04:55:40.785287 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2701/5282] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:55:40.790855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aaec6358-ff71-470e-8dff-cebe2eb0b2a9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:40.791747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aaec6358-ff71-470e-8dff-cebe2eb0b2a9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:40.798731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aaec6358-ff71-470e-8dff-cebe2eb0b2a9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:40.799228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aaec6358-ff71-470e-8dff-cebe2eb0b2a9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:40.800190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aaec6358-ff71-470e-8dff-cebe2eb0b2a9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:40.800640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aaec6358-ff71-470e-8dff-cebe2eb0b2a9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:40.891253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aaec6358-ff71-470e-8dff-cebe2eb0b2a9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05e9b7e95074a91bc984338593c6c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd598ce55f9b43d38530dae05fa1bda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:40.900062 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aaec6358-ff71-470e-8dff-cebe2eb0b2a9 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 200 len: 1290 microversion: 2.1 time: 0.113519 May 28 04:55:40.900666 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2702/5283] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:40 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 1290 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:40.912816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0f8f0f0a-d195-4db8-b2e0-09cd5c2cb4e6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-221255965", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "77459cf2-860d-4036-a771-9729396f7161"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:41.003352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-0f8f0f0a-d195-4db8-b2e0-09cd5c2cb4e6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] validate_networks() for [('77459cf2-860d-4036-a771-9729396f7161', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:55:41.092264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0905933d-d372-4aab-8165-7bd426653a13 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:41.097177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0905933d-d372-4aab-8165-7bd426653a13 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:41.104578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0905933d-d372-4aab-8165-7bd426653a13 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:41.105022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0905933d-d372-4aab-8165-7bd426653a13 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:41.107519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0905933d-d372-4aab-8165-7bd426653a13 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:41.107978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0905933d-d372-4aab-8165-7bd426653a13 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:41.490882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0905933d-d372-4aab-8165-7bd426653a13 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:41.510189 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0905933d-d372-4aab-8165-7bd426653a13 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1520 microversion: 2.1 time: 0.424141 May 28 04:55:41.522131 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2703/5284] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:41 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1520 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:41.675355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0f8f0f0a-d195-4db8-b2e0-09cd5c2cb4e6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:55:41.676378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0f8f0f0a-d195-4db8-b2e0-09cd5c2cb4e6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:55:41.677201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0f8f0f0a-d195-4db8-b2e0-09cd5c2cb4e6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:55:41.678106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0f8f0f0a-d195-4db8-b2e0-09cd5c2cb4e6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:55:41.679296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0f8f0f0a-d195-4db8-b2e0-09cd5c2cb4e6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:55:41.693817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f8f0f0a-d195-4db8-b2e0-09cd5c2cb4e6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:41.694444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f8f0f0a-d195-4db8-b2e0-09cd5c2cb4e6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:41.695295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f8f0f0a-d195-4db8-b2e0-09cd5c2cb4e6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:41.696528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f8f0f0a-d195-4db8-b2e0-09cd5c2cb4e6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:41.720104 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0f8f0f0a-d195-4db8-b2e0-09cd5c2cb4e6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Getting quotas for project c49ee69fe41f41d082a920768b51cdf7. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:55:41.731007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8165b240-63e7-4b57-8a40-c124faac67ac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:41.732123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8165b240-63e7-4b57-8a40-c124faac67ac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:41.739770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8165b240-63e7-4b57-8a40-c124faac67ac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:41.740399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8165b240-63e7-4b57-8a40-c124faac67ac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:41.741415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8165b240-63e7-4b57-8a40-c124faac67ac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:41.742175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8165b240-63e7-4b57-8a40-c124faac67ac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:41.744349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0f8f0f0a-d195-4db8-b2e0-09cd5c2cb4e6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Getting quotas for user 207c97ffbad7462c83c2ad908da2dba1 and project c49ee69fe41f41d082a920768b51cdf7. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:55:41.759806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0f8f0f0a-d195-4db8-b2e0-09cd5c2cb4e6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:55:41.762915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0f8f0f0a-d195-4db8-b2e0-09cd5c2cb4e6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:55:41.803759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:41.901110 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0f8f0f0a-d195-4db8-b2e0-09cd5c2cb4e6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.187357 May 28 04:55:41.902386 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2582/5285] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:55:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:55:41.908007 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-602d4831-98a3-4cab-b509-90bf5759d09c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:41.911412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-602d4831-98a3-4cab-b509-90bf5759d09c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:41.919876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-602d4831-98a3-4cab-b509-90bf5759d09c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:41.920691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-602d4831-98a3-4cab-b509-90bf5759d09c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:41.921782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-602d4831-98a3-4cab-b509-90bf5759d09c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:41.922770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-602d4831-98a3-4cab-b509-90bf5759d09c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:42.560509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8165b240-63e7-4b57-8a40-c124faac67ac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:42.577180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-602d4831-98a3-4cab-b509-90bf5759d09c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:42.584898 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-602d4831-98a3-4cab-b509-90bf5759d09c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1683 microversion: 2.1 time: 0.681277 May 28 04:55:42.588704 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8165b240-63e7-4b57-8a40-c124faac67ac tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1519 microversion: 2.1 time: 0.864985 May 28 04:55:42.589081 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2583/5286] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:41 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1683 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:42.592715 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2704/5287] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:41 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1519 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:55:42.596444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-15dfe9b4-ef85-4960-be54-96fad0f62f6c tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:42.598163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-15dfe9b4-ef85-4960-be54-96fad0f62f6c tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:42.606452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-19b4f21a-cfb5-42c3-9f59-0d42f541dd7f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:42.607023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-19b4f21a-cfb5-42c3-9f59-0d42f541dd7f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:42.626938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19b4f21a-cfb5-42c3-9f59-0d42f541dd7f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:42.628496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19b4f21a-cfb5-42c3-9f59-0d42f541dd7f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:42.630421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19b4f21a-cfb5-42c3-9f59-0d42f541dd7f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:42.636268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19b4f21a-cfb5-42c3-9f59-0d42f541dd7f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:42.659136 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-19b4f21a-cfb5-42c3-9f59-0d42f541dd7f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance 2a2ae555-84a4-4580-9169-022e9c89d321 could not be found. May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-19b4f21a-cfb5-42c3-9f59-0d42f541dd7f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 HTTP/1.1 May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 2a2ae555-84a4-4580-9169-022e9c89d321 could not be found. May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '2a2ae555-84a4-4580-9169-022e9c89d321'} May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a2ae555-84a4-4580-9169-022e9c89d321 could not be found. May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a2ae555-84a4-4580-9169-022e9c89d321 could not be found. May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:42.661224 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:42.666962 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:42.666962 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:42.666962 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:42.666962 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:42.666962 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:42.666962 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a2ae555-84a4-4580-9169-022e9c89d321 could not be found. May 28 04:55:42.666962 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:42.666962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-19b4f21a-cfb5-42c3-9f59-0d42f541dd7f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance 2a2ae555-84a4-4580-9169-022e9c89d321 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:42.666962 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-19b4f21a-cfb5-42c3-9f59-0d42f541dd7f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 404 len: 111 microversion: 2.1 time: 0.068782 May 28 04:55:42.666962 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2705/5288] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:42 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:55:42.674648 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-785280d8-18e2-485d-b3a7-c0d9bbfdc428 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:42.675591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-785280d8-18e2-485d-b3a7-c0d9bbfdc428 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:42.684350 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-785280d8-18e2-485d-b3a7-c0d9bbfdc428 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:42.684809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-785280d8-18e2-485d-b3a7-c0d9bbfdc428 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:42.685582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-785280d8-18e2-485d-b3a7-c0d9bbfdc428 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:42.686020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-785280d8-18e2-485d-b3a7-c0d9bbfdc428 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:42.703536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-15dfe9b4-ef85-4960-be54-96fad0f62f6c tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '207c97ffbad7462c83c2ad908da2dba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49ee69fe41f41d082a920768b51cdf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:42.715205 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-15dfe9b4-ef85-4960-be54-96fad0f62f6c tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] 10.222.0.58 "GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 200 len: 1227 microversion: 2.1 time: 0.122527 May 28 04:55:42.716457 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2584/5289] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:42 2022] GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 1227 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:42.723534 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-59b5a4e8-f82f-48dd-99db-fb2b62b46def tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:42.724448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-59b5a4e8-f82f-48dd-99db-fb2b62b46def tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:42.768967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59b5a4e8-f82f-48dd-99db-fb2b62b46def tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:42.769361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59b5a4e8-f82f-48dd-99db-fb2b62b46def tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:42.770178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59b5a4e8-f82f-48dd-99db-fb2b62b46def tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:42.788550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59b5a4e8-f82f-48dd-99db-fb2b62b46def tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:42.788550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-59b5a4e8-f82f-48dd-99db-fb2b62b46def tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance 2a2ae555-84a4-4580-9169-022e9c89d321 could not be found. May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-59b5a4e8-f82f-48dd-99db-fb2b62b46def tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 HTTP/1.1 May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 2a2ae555-84a4-4580-9169-022e9c89d321 could not be found. May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '2a2ae555-84a4-4580-9169-022e9c89d321'} May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a2ae555-84a4-4580-9169-022e9c89d321 could not be found. May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:55:42.823030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:55:42.826390 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:42.826390 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:42.826390 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a2ae555-84a4-4580-9169-022e9c89d321 could not be found. May 28 04:55:42.826390 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:42.826390 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:42.826390 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:42.826390 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:42.826390 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:42.826390 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:42.826390 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:42.826390 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:42.826390 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a2ae555-84a4-4580-9169-022e9c89d321 could not be found. May 28 04:55:42.826390 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:42.826390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-59b5a4e8-f82f-48dd-99db-fb2b62b46def tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance 2a2ae555-84a4-4580-9169-022e9c89d321 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:42.835156 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-59b5a4e8-f82f-48dd-99db-fb2b62b46def tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 404 len: 111 microversion: 2.1 time: 0.103601 May 28 04:55:42.838186 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2585/5290] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:55:42 2022] DELETE /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:55:42.847757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5517ad7a-8268-4906-b80e-6d0aad0adfa7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:42.848178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5517ad7a-8268-4906-b80e-6d0aad0adfa7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2a2ae555-84a4-4580-9169-022e9c89d321] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:42.872988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5517ad7a-8268-4906-b80e-6d0aad0adfa7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:42.873676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5517ad7a-8268-4906-b80e-6d0aad0adfa7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:42.874653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5517ad7a-8268-4906-b80e-6d0aad0adfa7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:42.877264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5517ad7a-8268-4906-b80e-6d0aad0adfa7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-5517ad7a-8268-4906-b80e-6d0aad0adfa7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance 2a2ae555-84a4-4580-9169-022e9c89d321 could not be found. May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5517ad7a-8268-4906-b80e-6d0aad0adfa7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 HTTP/1.1 May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 2a2ae555-84a4-4580-9169-022e9c89d321 could not be found. May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '2a2ae555-84a4-4580-9169-022e9c89d321'} May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a2ae555-84a4-4580-9169-022e9c89d321 could not be found. May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:42.910623 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:42.915553 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a2ae555-84a4-4580-9169-022e9c89d321 could not be found. May 28 04:55:42.915553 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:42.915553 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:42.915553 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:42.915553 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:42.915553 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:42.915553 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:42.915553 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:42.915553 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:42.915553 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a2ae555-84a4-4580-9169-022e9c89d321 could not be found. May 28 04:55:42.915553 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:42.921116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5517ad7a-8268-4906-b80e-6d0aad0adfa7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance 2a2ae555-84a4-4580-9169-022e9c89d321 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:42.922314 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5517ad7a-8268-4906-b80e-6d0aad0adfa7 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321" status: 404 len: 111 microversion: 2.1 time: 0.079502 May 28 04:55:42.923780 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2586/5291] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:42 2022] GET /compute/v2.1/servers/2a2ae555-84a4-4580-9169-022e9c89d321 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:55:42.946305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ebe4862f-37b2-4e69-8abb-914f4c077def tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:42.955062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ebe4862f-37b2-4e69-8abb-914f4c077def tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:42.974160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebe4862f-37b2-4e69-8abb-914f4c077def tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:42.974543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebe4862f-37b2-4e69-8abb-914f4c077def tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:42.975445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebe4862f-37b2-4e69-8abb-914f4c077def tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:42.975864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebe4862f-37b2-4e69-8abb-914f4c077def tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:43.011130 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-ebe4862f-37b2-4e69-8abb-914f4c077def tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance 5ddeac5b-bb14-4476-bf40-51def0581dda could not be found. May 28 04:55:43.015838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-785280d8-18e2-485d-b3a7-c0d9bbfdc428 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ebe4862f-37b2-4e69-8abb-914f4c077def tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda HTTP/1.1 May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 5ddeac5b-bb14-4476-bf40-51def0581dda could not be found. May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '5ddeac5b-bb14-4476-bf40-51def0581dda'} May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ddeac5b-bb14-4476-bf40-51def0581dda could not be found. May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:43.025900 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:43.030954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ddeac5b-bb14-4476-bf40-51def0581dda could not be found. May 28 04:55:43.030954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.030954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:43.030954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.030954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.030954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:43.030954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:43.030954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:43.030954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:43.030954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ddeac5b-bb14-4476-bf40-51def0581dda could not be found. May 28 04:55:43.030954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.033305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ebe4862f-37b2-4e69-8abb-914f4c077def tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance 5ddeac5b-bb14-4476-bf40-51def0581dda could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:43.034578 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ebe4862f-37b2-4e69-8abb-914f4c077def tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 404 len: 111 microversion: 2.1 time: 0.100090 May 28 04:55:43.037491 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2587/5292] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:55:42 2022] DELETE /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:55:43.045973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7c18c9c9-c100-4712-835b-eedd6be81155 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:43.052867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7c18c9c9-c100-4712-835b-eedd6be81155 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 5ddeac5b-bb14-4476-bf40-51def0581dda] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:43.054021 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-785280d8-18e2-485d-b3a7-c0d9bbfdc428 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1520 microversion: 2.1 time: 0.375681 May 28 04:55:43.057138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c18c9c9-c100-4712-835b-eedd6be81155 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:43.057758 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2706/5293] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:42 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1520 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:43.059553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c18c9c9-c100-4712-835b-eedd6be81155 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:43.063842 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c18c9c9-c100-4712-835b-eedd6be81155 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:43.064496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c18c9c9-c100-4712-835b-eedd6be81155 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:43.084003 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-7c18c9c9-c100-4712-835b-eedd6be81155 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance 5ddeac5b-bb14-4476-bf40-51def0581dda could not be found. May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7c18c9c9-c100-4712-835b-eedd6be81155 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda HTTP/1.1 May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 5ddeac5b-bb14-4476-bf40-51def0581dda could not be found. May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '5ddeac5b-bb14-4476-bf40-51def0581dda'} May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ddeac5b-bb14-4476-bf40-51def0581dda could not be found. May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ddeac5b-bb14-4476-bf40-51def0581dda could not be found. May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:43.085800 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.090020 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.090020 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:43.090020 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:43.090020 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:43.090020 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:43.090020 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ddeac5b-bb14-4476-bf40-51def0581dda could not be found. May 28 04:55:43.090020 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.091566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7c18c9c9-c100-4712-835b-eedd6be81155 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance 5ddeac5b-bb14-4476-bf40-51def0581dda could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:43.092599 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7c18c9c9-c100-4712-835b-eedd6be81155 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda" status: 404 len: 111 microversion: 2.1 time: 0.051734 May 28 04:55:43.093363 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2588/5294] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:43 2022] GET /compute/v2.1/servers/5ddeac5b-bb14-4476-bf40-51def0581dda => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:55:43.101653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-53b144b6-cdf2-4850-99c9-c942ec905b09 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:43.102153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-53b144b6-cdf2-4850-99c9-c942ec905b09 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:43.109621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53b144b6-cdf2-4850-99c9-c942ec905b09 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:43.110075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53b144b6-cdf2-4850-99c9-c942ec905b09 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:43.111591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53b144b6-cdf2-4850-99c9-c942ec905b09 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:43.112539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53b144b6-cdf2-4850-99c9-c942ec905b09 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:43.136128 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-53b144b6-cdf2-4850-99c9-c942ec905b09 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance 3087299d-554e-4c36-8eb4-3082257b7e65 could not be found. May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-53b144b6-cdf2-4850-99c9-c942ec905b09 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 HTTP/1.1 May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 3087299d-554e-4c36-8eb4-3082257b7e65 could not be found. May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '3087299d-554e-4c36-8eb4-3082257b7e65'} May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3087299d-554e-4c36-8eb4-3082257b7e65 could not be found. May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:43.138424 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:43.142784 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3087299d-554e-4c36-8eb4-3082257b7e65 could not be found. May 28 04:55:43.142784 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:43.142784 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:43.142784 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:43.142784 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.142784 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:43.142784 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:43.142784 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:43.142784 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:43.142784 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3087299d-554e-4c36-8eb4-3082257b7e65 could not be found. May 28 04:55:43.142784 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:43.145046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-53b144b6-cdf2-4850-99c9-c942ec905b09 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance 3087299d-554e-4c36-8eb4-3082257b7e65 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:43.146120 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-53b144b6-cdf2-4850-99c9-c942ec905b09 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 404 len: 111 microversion: 2.1 time: 0.048496 May 28 04:55:43.148731 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2707/5295] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:55:43 2022] DELETE /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:55:43.156770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-02d7f461-045d-4f9c-b597-842096286302 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:43.157515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-02d7f461-045d-4f9c-b597-842096286302 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 3087299d-554e-4c36-8eb4-3082257b7e65] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:43.164473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02d7f461-045d-4f9c-b597-842096286302 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:43.165300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02d7f461-045d-4f9c-b597-842096286302 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:43.166337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02d7f461-045d-4f9c-b597-842096286302 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:43.166980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02d7f461-045d-4f9c-b597-842096286302 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:43.187678 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-02d7f461-045d-4f9c-b597-842096286302 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance 3087299d-554e-4c36-8eb4-3082257b7e65 could not be found. May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-02d7f461-045d-4f9c-b597-842096286302 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 HTTP/1.1 May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 3087299d-554e-4c36-8eb4-3082257b7e65 could not be found. May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '3087299d-554e-4c36-8eb4-3082257b7e65'} May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3087299d-554e-4c36-8eb4-3082257b7e65 could not be found. May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3087299d-554e-4c36-8eb4-3082257b7e65 could not be found. May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:43.189396 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.193214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.193214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:43.193214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:43.193214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:43.193214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:43.193214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3087299d-554e-4c36-8eb4-3082257b7e65 could not be found. May 28 04:55:43.193214 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.193214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-02d7f461-045d-4f9c-b597-842096286302 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance 3087299d-554e-4c36-8eb4-3082257b7e65 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:43.193214 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-02d7f461-045d-4f9c-b597-842096286302 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65" status: 404 len: 111 microversion: 2.1 time: 0.038679 May 28 04:55:43.200820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-68b4209c-a5d3-4685-970d-7d411409869b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:43.201599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-68b4209c-a5d3-4685-970d-7d411409869b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:43.206635 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2589/5296] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:43 2022] GET /compute/v2.1/servers/3087299d-554e-4c36-8eb4-3082257b7e65 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:55:43.213430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68b4209c-a5d3-4685-970d-7d411409869b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:43.214290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68b4209c-a5d3-4685-970d-7d411409869b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:43.215700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68b4209c-a5d3-4685-970d-7d411409869b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:43.216337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68b4209c-a5d3-4685-970d-7d411409869b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:43.235157 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-68b4209c-a5d3-4685-970d-7d411409869b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 could not be found. May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-68b4209c-a5d3-4685-970d-7d411409869b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 HTTP/1.1 May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 could not be found. May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'e6dd1de3-8a85-42b0-8ac8-49b66c6768d5'} May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 could not be found. May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:43.237099 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:43.240442 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 could not be found. May 28 04:55:43.240442 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:43.240442 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:43.240442 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:43.240442 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.240442 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:43.240442 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:43.240442 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:43.240442 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:43.240442 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 could not be found. May 28 04:55:43.240442 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:43.240442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-68b4209c-a5d3-4685-970d-7d411409869b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:43.240442 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-68b4209c-a5d3-4685-970d-7d411409869b tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 404 len: 111 microversion: 2.1 time: 0.042603 May 28 04:55:43.249325 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-31ccab3b-d0d9-4450-b184-0014aef29cdc tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:43.249946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-31ccab3b-d0d9-4450-b184-0014aef29cdc tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: e6dd1de3-8a85-42b0-8ac8-49b66c6768d5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:43.253278 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2708/5297] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:55:43 2022] DELETE /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:55:43.258069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31ccab3b-d0d9-4450-b184-0014aef29cdc tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:43.259363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31ccab3b-d0d9-4450-b184-0014aef29cdc tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:43.260376 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31ccab3b-d0d9-4450-b184-0014aef29cdc tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:43.260985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31ccab3b-d0d9-4450-b184-0014aef29cdc tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:43.277084 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-31ccab3b-d0d9-4450-b184-0014aef29cdc tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 could not be found. May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-31ccab3b-d0d9-4450-b184-0014aef29cdc tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 HTTP/1.1 May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 could not be found. May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'e6dd1de3-8a85-42b0-8ac8-49b66c6768d5'} May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 could not be found. May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 could not be found. May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:43.279408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.283117 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.283117 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:43.283117 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:43.283117 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:43.283117 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:43.283117 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 could not be found. May 28 04:55:43.283117 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.285064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-31ccab3b-d0d9-4450-b184-0014aef29cdc tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:43.286305 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-31ccab3b-d0d9-4450-b184-0014aef29cdc tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5" status: 404 len: 111 microversion: 2.1 time: 0.041744 May 28 04:55:43.297623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d6c7bbe1-ec2d-4167-9f75-d0fce21d1cb1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:43.298143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d6c7bbe1-ec2d-4167-9f75-d0fce21d1cb1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:43.303403 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2590/5298] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:43 2022] GET /compute/v2.1/servers/e6dd1de3-8a85-42b0-8ac8-49b66c6768d5 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:55:43.305473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d6c7bbe1-ec2d-4167-9f75-d0fce21d1cb1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:43.305933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d6c7bbe1-ec2d-4167-9f75-d0fce21d1cb1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:43.306768 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d6c7bbe1-ec2d-4167-9f75-d0fce21d1cb1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:43.307297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d6c7bbe1-ec2d-4167-9f75-d0fce21d1cb1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:43.324358 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-d6c7bbe1-ec2d-4167-9f75-d0fce21d1cb1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 could not be found. May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d6c7bbe1-ec2d-4167-9f75-d0fce21d1cb1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 HTTP/1.1 May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 could not be found. May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '66cb58ba-7ecb-418f-9fa9-8aa5f7f84357'} May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 could not be found. May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:43.326009 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:43.330698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 could not be found. May 28 04:55:43.330698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:43.330698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:43.330698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:43.330698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.330698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:43.330698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:43.330698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:43.330698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:43.330698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 could not be found. May 28 04:55:43.330698 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:43.330698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d6c7bbe1-ec2d-4167-9f75-d0fce21d1cb1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:43.330698 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d6c7bbe1-ec2d-4167-9f75-d0fce21d1cb1 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "DELETE /compute/v2.1/servers/66cb58ba-7ecb-418f-9fa9-8aa5f7f84357" status: 404 len: 111 microversion: 2.1 time: 0.035403 May 28 04:55:43.330698 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2709/5299] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:55:43 2022] DELETE /compute/v2.1/servers/66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:55:43.340212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-023b628b-fbc3-44bc-b0fc-a8dbdd6c77d3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:43.341436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-023b628b-fbc3-44bc-b0fc-a8dbdd6c77d3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:43.352896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-023b628b-fbc3-44bc-b0fc-a8dbdd6c77d3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:43.352896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-023b628b-fbc3-44bc-b0fc-a8dbdd6c77d3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:43.353659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-023b628b-fbc3-44bc-b0fc-a8dbdd6c77d3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:43.354269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-023b628b-fbc3-44bc-b0fc-a8dbdd6c77d3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:43.368932 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-023b628b-fbc3-44bc-b0fc-a8dbdd6c77d3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 could not be found. May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-023b628b-fbc3-44bc-b0fc-a8dbdd6c77d3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 HTTP/1.1 May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 could not be found. May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '66cb58ba-7ecb-418f-9fa9-8aa5f7f84357'} May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 could not be found. May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 could not be found. May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:43.370943 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.375038 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:43.375038 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:43.375038 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:43.375038 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:43.375038 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:43.375038 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 could not be found. May 28 04:55:43.375038 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:43.375038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-023b628b-fbc3-44bc-b0fc-a8dbdd6c77d3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance 66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:43.375038 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-023b628b-fbc3-44bc-b0fc-a8dbdd6c77d3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/66cb58ba-7ecb-418f-9fa9-8aa5f7f84357" status: 404 len: 111 microversion: 2.1 time: 0.038584 May 28 04:55:43.375038 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2591/5300] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:43 2022] GET /compute/v2.1/servers/66cb58ba-7ecb-418f-9fa9-8aa5f7f84357 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:55:43.612488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-76ccfa8f-ee98-4227-80d7-ac7aa2e4cd63 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:43.613744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-76ccfa8f-ee98-4227-80d7-ac7aa2e4cd63 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:43.625076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76ccfa8f-ee98-4227-80d7-ac7aa2e4cd63 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:43.625913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76ccfa8f-ee98-4227-80d7-ac7aa2e4cd63 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:43.628380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76ccfa8f-ee98-4227-80d7-ac7aa2e4cd63 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:43.629140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76ccfa8f-ee98-4227-80d7-ac7aa2e4cd63 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:43.734406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a5af5162-835c-45f7-af7f-d7add236a5c2 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:43.737867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a5af5162-835c-45f7-af7f-d7add236a5c2 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:43.755602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5af5162-835c-45f7-af7f-d7add236a5c2 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:43.756470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5af5162-835c-45f7-af7f-d7add236a5c2 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:43.757464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5af5162-835c-45f7-af7f-d7add236a5c2 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:43.758101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5af5162-835c-45f7-af7f-d7add236a5c2 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:43.916944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a5af5162-835c-45f7-af7f-d7add236a5c2 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '207c97ffbad7462c83c2ad908da2dba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49ee69fe41f41d082a920768b51cdf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:43.928004 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a5af5162-835c-45f7-af7f-d7add236a5c2 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] 10.222.0.58 "GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 200 len: 1231 microversion: 2.1 time: 0.198369 May 28 04:55:43.929200 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2592/5301] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:43 2022] GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 1231 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:44.044621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-76ccfa8f-ee98-4227-80d7-ac7aa2e4cd63 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:44.054299 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-76ccfa8f-ee98-4227-80d7-ac7aa2e4cd63 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1519 microversion: 2.1 time: 0.448766 May 28 04:55:44.057884 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2710/5302] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:43 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1519 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:44.083945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1ac8f955-ae81-450a-9549-ef835ade3feb tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:44.084820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1ac8f955-ae81-450a-9549-ef835ade3feb tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:44.094922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ac8f955-ae81-450a-9549-ef835ade3feb tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:44.098670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ac8f955-ae81-450a-9549-ef835ade3feb tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:44.099716 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ac8f955-ae81-450a-9549-ef835ade3feb tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:44.100813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ac8f955-ae81-450a-9549-ef835ade3feb tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:44.203711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-45f09cd1-3bae-446d-8a25-2149ea5407cc req-7fb605a5-794b-432a-83f4-35a9f993d955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260294eb-db79-4280-a534-928afd9312d0", "name": "network-vif-plugged", "status": "completed", "tag": "3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:44.229438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-45f09cd1-3bae-446d-8a25-2149ea5407cc req-7fb605a5-794b-432a-83f4-35a9f993d955 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:44.231579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-45f09cd1-3bae-446d-8a25-2149ea5407cc req-7fb605a5-794b-432a-83f4-35a9f993d955 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:44.276405 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-45f09cd1-3bae-446d-8a25-2149ea5407cc req-7fb605a5-794b-432a-83f4-35a9f993d955 service nova] Creating event network-vif-plugged:3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0 for instance 260294eb-db79-4280-a534-928afd9312d0 on n-h2-843700-1 May 28 04:55:44.288286 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-45f09cd1-3bae-446d-8a25-2149ea5407cc req-7fb605a5-794b-432a-83f4-35a9f993d955 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088859 May 28 04:55:44.294231 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2711/5303] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:55:44.418480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1ac8f955-ae81-450a-9549-ef835ade3feb tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:44.433457 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1ac8f955-ae81-450a-9549-ef835ade3feb tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1520 microversion: 2.1 time: 0.363261 May 28 04:55:44.435087 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2593/5304] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:44 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1520 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:44.947135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-db998975-ab53-46ed-970c-c9fd1edca6c4 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:44.947807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-db998975-ab53-46ed-970c-c9fd1edca6c4 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:44.956024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db998975-ab53-46ed-970c-c9fd1edca6c4 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:44.956491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db998975-ab53-46ed-970c-c9fd1edca6c4 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:44.957284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db998975-ab53-46ed-970c-c9fd1edca6c4 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:44.957729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db998975-ab53-46ed-970c-c9fd1edca6c4 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:45.069515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-db998975-ab53-46ed-970c-c9fd1edca6c4 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '207c97ffbad7462c83c2ad908da2dba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49ee69fe41f41d082a920768b51cdf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:45.076268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a73b5ef6-0be2-4044-b163-2d0e9b061da5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:45.077803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a73b5ef6-0be2-4044-b163-2d0e9b061da5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:45.082154 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-db998975-ab53-46ed-970c-c9fd1edca6c4 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] 10.222.0.58 "GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 200 len: 1279 microversion: 2.1 time: 0.140056 May 28 04:55:45.085216 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2712/5305] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:44 2022] GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 1279 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:45.090678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a73b5ef6-0be2-4044-b163-2d0e9b061da5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:45.090678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a73b5ef6-0be2-4044-b163-2d0e9b061da5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:45.090678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a73b5ef6-0be2-4044-b163-2d0e9b061da5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:45.090678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a73b5ef6-0be2-4044-b163-2d0e9b061da5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:45.344307 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a73b5ef6-0be2-4044-b163-2d0e9b061da5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:45.354727 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a73b5ef6-0be2-4044-b163-2d0e9b061da5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1519 microversion: 2.1 time: 0.284053 May 28 04:55:45.367959 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2594/5306] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:45 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1519 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:45.452999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-13bb1f1f-f181-4c9e-b2fa-76aba3a874fd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:45.453766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-13bb1f1f-f181-4c9e-b2fa-76aba3a874fd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:45.468009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13bb1f1f-f181-4c9e-b2fa-76aba3a874fd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:45.468628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13bb1f1f-f181-4c9e-b2fa-76aba3a874fd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:45.469529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13bb1f1f-f181-4c9e-b2fa-76aba3a874fd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:45.470064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13bb1f1f-f181-4c9e-b2fa-76aba3a874fd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:45.730950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-13bb1f1f-f181-4c9e-b2fa-76aba3a874fd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:45.744778 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-13bb1f1f-f181-4c9e-b2fa-76aba3a874fd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1520 microversion: 2.1 time: 0.295727 May 28 04:55:45.745370 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2713/5307] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:45 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:46.106446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6ba94a7a-ef8b-460e-8827-d404ef61bfb4 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:46.238361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6ba94a7a-ef8b-460e-8827-d404ef61bfb4 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:46.238361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ba94a7a-ef8b-460e-8827-d404ef61bfb4 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:46.238361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ba94a7a-ef8b-460e-8827-d404ef61bfb4 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:46.238361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ba94a7a-ef8b-460e-8827-d404ef61bfb4 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:46.238361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ba94a7a-ef8b-460e-8827-d404ef61bfb4 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:46.238361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6ba94a7a-ef8b-460e-8827-d404ef61bfb4 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '207c97ffbad7462c83c2ad908da2dba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49ee69fe41f41d082a920768b51cdf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:46.238361 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6ba94a7a-ef8b-460e-8827-d404ef61bfb4 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] 10.222.0.58 "GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 200 len: 1285 microversion: 2.1 time: 0.111023 May 28 04:55:46.238361 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2595/5308] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:46 2022] GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 1285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:46.372076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f1712bd1-762c-4c14-bd10-1892bb086571 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:46.372839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f1712bd1-762c-4c14-bd10-1892bb086571 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:46.379566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f1712bd1-762c-4c14-bd10-1892bb086571 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:46.380239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f1712bd1-762c-4c14-bd10-1892bb086571 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:46.381048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f1712bd1-762c-4c14-bd10-1892bb086571 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:46.381661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f1712bd1-762c-4c14-bd10-1892bb086571 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:46.614929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f1712bd1-762c-4c14-bd10-1892bb086571 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:46.626699 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f1712bd1-762c-4c14-bd10-1892bb086571 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1519 microversion: 2.1 time: 0.259643 May 28 04:55:46.627928 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2714/5309] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:46 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1519 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:46.775296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6e0638c3-0eec-42b3-b8bf-010e978bbe52 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:46.776365 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6e0638c3-0eec-42b3-b8bf-010e978bbe52 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:46.787959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6e0638c3-0eec-42b3-b8bf-010e978bbe52 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:46.788767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6e0638c3-0eec-42b3-b8bf-010e978bbe52 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:46.791524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6e0638c3-0eec-42b3-b8bf-010e978bbe52 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:46.792965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6e0638c3-0eec-42b3-b8bf-010e978bbe52 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:47.002353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6e0638c3-0eec-42b3-b8bf-010e978bbe52 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:47.014492 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6e0638c3-0eec-42b3-b8bf-010e978bbe52 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1520 microversion: 2.1 time: 0.246415 May 28 04:55:47.015711 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2596/5310] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:46 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:47.255548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c51361e9-283f-4a43-a229-8bc39700beb1 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:47.256175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c51361e9-283f-4a43-a229-8bc39700beb1 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:47.272212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c51361e9-283f-4a43-a229-8bc39700beb1 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:47.272864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c51361e9-283f-4a43-a229-8bc39700beb1 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:47.273798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c51361e9-283f-4a43-a229-8bc39700beb1 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:47.275018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c51361e9-283f-4a43-a229-8bc39700beb1 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:47.584677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-611f89da-942a-479a-874f-07da0f92396a req-53505718-cbaa-46e8-b8ec-a855aea2197e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58022ec6-f4eb-4564-bed0-c3edd1d0daf4", "name": "network-vif-plugged", "status": "completed", "tag": "d2dc44c4-b245-41ae-bb82-8a262f7181c5"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:47.606041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-611f89da-942a-479a-874f-07da0f92396a req-53505718-cbaa-46e8-b8ec-a855aea2197e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:47.611060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-611f89da-942a-479a-874f-07da0f92396a req-53505718-cbaa-46e8-b8ec-a855aea2197e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:47.667932 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-611f89da-942a-479a-874f-07da0f92396a req-53505718-cbaa-46e8-b8ec-a855aea2197e service nova] Creating event network-vif-plugged:d2dc44c4-b245-41ae-bb82-8a262f7181c5 for instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 on n-h1-843700-1 May 28 04:55:47.680326 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-611f89da-942a-479a-874f-07da0f92396a req-53505718-cbaa-46e8-b8ec-a855aea2197e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099293 May 28 04:55:47.682917 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2597/5311] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:55:47.716054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-22c5019f-d424-49cf-be79-5f5c9319bd89 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:47.718704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-22c5019f-d424-49cf-be79-5f5c9319bd89 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:47.751214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22c5019f-d424-49cf-be79-5f5c9319bd89 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:47.753341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22c5019f-d424-49cf-be79-5f5c9319bd89 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:47.757557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22c5019f-d424-49cf-be79-5f5c9319bd89 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:47.758245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22c5019f-d424-49cf-be79-5f5c9319bd89 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:47.782506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c51361e9-283f-4a43-a229-8bc39700beb1 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '207c97ffbad7462c83c2ad908da2dba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49ee69fe41f41d082a920768b51cdf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:47.793380 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c51361e9-283f-4a43-a229-8bc39700beb1 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] 10.222.0.58 "GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 200 len: 1327 microversion: 2.1 time: 0.541696 May 28 04:55:47.801859 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2715/5312] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:47 2022] GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 1327 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:48.037306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4f1e42bc-4668-4ec4-b012-755ebb564fb1 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:48.039293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4f1e42bc-4668-4ec4-b012-755ebb564fb1 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:48.047316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f1e42bc-4668-4ec4-b012-755ebb564fb1 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:48.048187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f1e42bc-4668-4ec4-b012-755ebb564fb1 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:48.049185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f1e42bc-4668-4ec4-b012-755ebb564fb1 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:48.049846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f1e42bc-4668-4ec4-b012-755ebb564fb1 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:48.238145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-22c5019f-d424-49cf-be79-5f5c9319bd89 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:48.248396 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-22c5019f-d424-49cf-be79-5f5c9319bd89 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1519 microversion: 2.1 time: 0.564174 May 28 04:55:48.258639 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2598/5313] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:47 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1519 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:48.339359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4f1e42bc-4668-4ec4-b012-755ebb564fb1 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:48.347385 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4f1e42bc-4668-4ec4-b012-755ebb564fb1 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1520 microversion: 2.1 time: 0.314885 May 28 04:55:48.350470 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2716/5314] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:48 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:55:48.817824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1ac4e8fc-1234-4c07-8a10-09fe419125c9 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:48.819438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1ac4e8fc-1234-4c07-8a10-09fe419125c9 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:48.834484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ac4e8fc-1234-4c07-8a10-09fe419125c9 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:48.835060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ac4e8fc-1234-4c07-8a10-09fe419125c9 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:48.835741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ac4e8fc-1234-4c07-8a10-09fe419125c9 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:48.836175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ac4e8fc-1234-4c07-8a10-09fe419125c9 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:49.056172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-3fb25d7a-9b7f-45f5-b51e-c103d9ddddea req-936a4bdf-d803-4e55-bed8-9c07a023acdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86491332-11fd-4053-b81a-1d64dcab9cb9", "tag": "561b794d-e794-4f69-9aa4-36b3df3116df"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:49.074516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-3fb25d7a-9b7f-45f5-b51e-c103d9ddddea req-936a4bdf-d803-4e55-bed8-9c07a023acdc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:49.075389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-3fb25d7a-9b7f-45f5-b51e-c103d9ddddea req-936a4bdf-d803-4e55-bed8-9c07a023acdc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:49.089008 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-3fb25d7a-9b7f-45f5-b51e-c103d9ddddea req-936a4bdf-d803-4e55-bed8-9c07a023acdc service nova] Creating event network-changed:561b794d-e794-4f69-9aa4-36b3df3116df for instance 86491332-11fd-4053-b81a-1d64dcab9cb9 on n-h2-843700-1 May 28 04:55:49.101929 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-3fb25d7a-9b7f-45f5-b51e-c103d9ddddea req-936a4bdf-d803-4e55-bed8-9c07a023acdc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055939 May 28 04:55:49.103505 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2717/5315] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:55:49.268051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5934aa25-dfa1-4455-ad48-f71e274e9e76 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:49.268890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5934aa25-dfa1-4455-ad48-f71e274e9e76 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:49.287704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5934aa25-dfa1-4455-ad48-f71e274e9e76 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:49.288166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5934aa25-dfa1-4455-ad48-f71e274e9e76 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:49.289155 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5934aa25-dfa1-4455-ad48-f71e274e9e76 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:49.290368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5934aa25-dfa1-4455-ad48-f71e274e9e76 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:49.382981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1ac4e8fc-1234-4c07-8a10-09fe419125c9 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '207c97ffbad7462c83c2ad908da2dba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49ee69fe41f41d082a920768b51cdf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:49.393035 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1ac4e8fc-1234-4c07-8a10-09fe419125c9 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] 10.222.0.58 "GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 200 len: 1327 microversion: 2.1 time: 0.578909 May 28 04:55:49.407724 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2599/5316] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:48 2022] GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 1327 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:49.414399 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f4c83f1a-fbbb-45c2-8aef-6eecd542184e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:49.415267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f4c83f1a-fbbb-45c2-8aef-6eecd542184e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:49.419000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:49.423176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4c83f1a-fbbb-45c2-8aef-6eecd542184e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:49.423803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4c83f1a-fbbb-45c2-8aef-6eecd542184e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:49.424746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4c83f1a-fbbb-45c2-8aef-6eecd542184e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:49.425365 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4c83f1a-fbbb-45c2-8aef-6eecd542184e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:50.509669 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f4c83f1a-fbbb-45c2-8aef-6eecd542184e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:50.529123 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f4c83f1a-fbbb-45c2-8aef-6eecd542184e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1520 microversion: 2.1 time: 1.120001 May 28 04:55:50.530074 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2600/5317] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:49 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1520 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:50.537724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ae673bb1-e53c-4984-82df-2e5343c08ab6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:50.541299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ae673bb1-e53c-4984-82df-2e5343c08ab6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:50.557720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae673bb1-e53c-4984-82df-2e5343c08ab6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:50.558427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae673bb1-e53c-4984-82df-2e5343c08ab6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:50.562562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae673bb1-e53c-4984-82df-2e5343c08ab6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:50.563222 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae673bb1-e53c-4984-82df-2e5343c08ab6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:50.621495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5934aa25-dfa1-4455-ad48-f71e274e9e76 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:50.634656 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5934aa25-dfa1-4455-ad48-f71e274e9e76 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1519 microversion: 2.1 time: 1.369810 May 28 04:55:50.646326 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2718/5318] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:49 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1519 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:50.781860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ae673bb1-e53c-4984-82df-2e5343c08ab6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '207c97ffbad7462c83c2ad908da2dba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49ee69fe41f41d082a920768b51cdf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:50.791025 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ae673bb1-e53c-4984-82df-2e5343c08ab6 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] 10.222.0.58 "GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 200 len: 1327 microversion: 2.1 time: 0.259180 May 28 04:55:50.799156 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2601/5319] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:50 2022] GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 1327 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:51.546164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bc070b5e-bc9d-48c8-b196-12d2e80922b6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:51.546789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bc070b5e-bc9d-48c8-b196-12d2e80922b6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:51.558868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bc070b5e-bc9d-48c8-b196-12d2e80922b6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:51.559372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bc070b5e-bc9d-48c8-b196-12d2e80922b6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:51.560158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bc070b5e-bc9d-48c8-b196-12d2e80922b6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:51.560597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bc070b5e-bc9d-48c8-b196-12d2e80922b6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:51.658188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fcbdacff-c44b-49c1-9d51-2a595b1d3023 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:51.659518 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fcbdacff-c44b-49c1-9d51-2a595b1d3023 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:51.676382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcbdacff-c44b-49c1-9d51-2a595b1d3023 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:51.693398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcbdacff-c44b-49c1-9d51-2a595b1d3023 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:51.697685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcbdacff-c44b-49c1-9d51-2a595b1d3023 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:51.698470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcbdacff-c44b-49c1-9d51-2a595b1d3023 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:51.717464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:52.051379 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bc070b5e-bc9d-48c8-b196-12d2e80922b6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:52.061160 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bc070b5e-bc9d-48c8-b196-12d2e80922b6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1520 microversion: 2.1 time: 0.518882 May 28 04:55:52.070335 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2719/5320] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:51 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1520 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:52.079936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e3f53cb1-de02-49e5-995c-287761af6049 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:52.079936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e3f53cb1-de02-49e5-995c-287761af6049 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:52.082915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3f53cb1-de02-49e5-995c-287761af6049 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:52.083400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3f53cb1-de02-49e5-995c-287761af6049 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:52.084396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3f53cb1-de02-49e5-995c-287761af6049 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:52.085004 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3f53cb1-de02-49e5-995c-287761af6049 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:52.206972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fcbdacff-c44b-49c1-9d51-2a595b1d3023 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:52.221310 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fcbdacff-c44b-49c1-9d51-2a595b1d3023 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1519 microversion: 2.1 time: 0.573121 May 28 04:55:52.222434 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2602/5321] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:51 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1519 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:52.336862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f18976d1-1ebb-4c9d-8b48-f84fa7e5b647 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:52.337640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f18976d1-1ebb-4c9d-8b48-f84fa7e5b647 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:52.344698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f18976d1-1ebb-4c9d-8b48-f84fa7e5b647 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:52.345451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f18976d1-1ebb-4c9d-8b48-f84fa7e5b647 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:52.346574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f18976d1-1ebb-4c9d-8b48-f84fa7e5b647 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:52.347261 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f18976d1-1ebb-4c9d-8b48-f84fa7e5b647 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:52.383622 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-f18976d1-1ebb-4c9d-8b48-f84fa7e5b647 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f18976d1-1ebb-4c9d-8b48-f84fa7e5b647 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 HTTP/1.1 May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '2acbf858-4bd9-4004-ba98-569c9fe52f55'} May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:52.386652 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:52.392386 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. May 28 04:55:52.392386 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:52.392386 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:52.392386 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:52.392386 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:52.392386 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:52.392386 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:52.392386 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:52.392386 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:52.392386 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. May 28 04:55:52.392386 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:52.392386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f18976d1-1ebb-4c9d-8b48-f84fa7e5b647 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:52.399808 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f18976d1-1ebb-4c9d-8b48-f84fa7e5b647 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 404 len: 111 microversion: 2.1 time: 0.066240 May 28 04:55:52.401640 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2603/5322] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:55:52 2022] DELETE /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:55:52.417098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8680bc96-2bdf-48c2-9e3f-3c2130ea2b7f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:52.418019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8680bc96-2bdf-48c2-9e3f-3c2130ea2b7f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 2acbf858-4bd9-4004-ba98-569c9fe52f55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:52.433330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8680bc96-2bdf-48c2-9e3f-3c2130ea2b7f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:52.438326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8680bc96-2bdf-48c2-9e3f-3c2130ea2b7f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:52.443560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8680bc96-2bdf-48c2-9e3f-3c2130ea2b7f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:52.443560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8680bc96-2bdf-48c2-9e3f-3c2130ea2b7f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:52.457123 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-8680bc96-2bdf-48c2-9e3f-3c2130ea2b7f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8680bc96-2bdf-48c2-9e3f-3c2130ea2b7f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 HTTP/1.1 May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '2acbf858-4bd9-4004-ba98-569c9fe52f55'} May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:52.459840 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:52.464313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:52.464313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:52.464313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:52.464313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:52.464313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:52.464313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. May 28 04:55:52.464313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:52.465582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8680bc96-2bdf-48c2-9e3f-3c2130ea2b7f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance 2acbf858-4bd9-4004-ba98-569c9fe52f55 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:52.466753 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8680bc96-2bdf-48c2-9e3f-3c2130ea2b7f tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55" status: 404 len: 111 microversion: 2.1 time: 0.060127 May 28 04:55:52.468466 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2604/5323] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:52 2022] GET /compute/v2.1/servers/2acbf858-4bd9-4004-ba98-569c9fe52f55 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:55:52.488072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e3f53cb1-de02-49e5-995c-287761af6049 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '207c97ffbad7462c83c2ad908da2dba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49ee69fe41f41d082a920768b51cdf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:52.488561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2dce4cfd-caf2-4378-9212-cda6b5129eba tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:52.489948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2dce4cfd-caf2-4378-9212-cda6b5129eba tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:52.498246 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e3f53cb1-de02-49e5-995c-287761af6049 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] 10.222.0.58 "GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 200 len: 1327 microversion: 2.1 time: 0.426118 May 28 04:55:52.502850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2dce4cfd-caf2-4378-9212-cda6b5129eba tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:52.506714 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2720/5324] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:52 2022] GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 1327 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:52.506823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2dce4cfd-caf2-4378-9212-cda6b5129eba tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:52.506823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2dce4cfd-caf2-4378-9212-cda6b5129eba tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:52.506823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2dce4cfd-caf2-4378-9212-cda6b5129eba tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:52.527804 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-2dce4cfd-caf2-4378-9212-cda6b5129eba tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance 25437109-2e1e-48a8-97ad-af5014923c55 could not be found. May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2dce4cfd-caf2-4378-9212-cda6b5129eba tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 HTTP/1.1 May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 25437109-2e1e-48a8-97ad-af5014923c55 could not be found. May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '25437109-2e1e-48a8-97ad-af5014923c55'} May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25437109-2e1e-48a8-97ad-af5014923c55 could not be found. May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:52.531203 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:52.535425 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25437109-2e1e-48a8-97ad-af5014923c55 could not be found. May 28 04:55:52.535425 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:52.535425 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:52.535425 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:52.535425 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:52.535425 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:52.535425 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:52.535425 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:52.535425 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:52.535425 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25437109-2e1e-48a8-97ad-af5014923c55 could not be found. May 28 04:55:52.535425 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:52.535425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2dce4cfd-caf2-4378-9212-cda6b5129eba tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance 25437109-2e1e-48a8-97ad-af5014923c55 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:52.535425 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2dce4cfd-caf2-4378-9212-cda6b5129eba tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "DELETE /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 404 len: 111 microversion: 2.1 time: 0.054300 May 28 04:55:52.535425 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2605/5325] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:55:52 2022] DELETE /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:55:52.542193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ffbfb4d3-50d7-4c94-a810-3fd5cc6d6be3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:52.542827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ffbfb4d3-50d7-4c94-a810-3fd5cc6d6be3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] [instance: 25437109-2e1e-48a8-97ad-af5014923c55] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:52.553382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ffbfb4d3-50d7-4c94-a810-3fd5cc6d6be3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:52.553382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ffbfb4d3-50d7-4c94-a810-3fd5cc6d6be3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:52.553382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ffbfb4d3-50d7-4c94-a810-3fd5cc6d6be3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:52.553382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ffbfb4d3-50d7-4c94-a810-3fd5cc6d6be3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:52.569484 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-ffbfb4d3-50d7-4c94-a810-3fd5cc6d6be3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] HTTP exception thrown: Instance 25437109-2e1e-48a8-97ad-af5014923c55 could not be found. May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ffbfb4d3-50d7-4c94-a810-3fd5cc6d6be3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Request method failure captured: May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 HTTP/1.1 May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaoRRuoNTnJSACjFGy5oDza_a3--MmhOaXhBn-QgYt6qAWxUJKS7KtV8e7wb7_w80J1xougDcIjkA-GPHE0K5D0ZS1NLKO4T3Y9TFkaOjQ1ChUykiFjf1RXzWFvkYtgl22vQdeUiDIiAvZDS55s6rPWz5N21dnSEIW4hWWMYOuh-uSc May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd598ce55f9b43d38530dae05fa1bda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: dd598ce55f9b43d38530dae05fa1bda1 May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743449930 May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: b05e9b7e95074a91bc984338593c6c84 May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-DeleteServersTestJSON-1743449930-project May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 25437109-2e1e-48a8-97ad-af5014923c55 could not be found. May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '25437109-2e1e-48a8-97ad-af5014923c55'} May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25437109-2e1e-48a8-97ad-af5014923c55 could not be found. May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25437109-2e1e-48a8-97ad-af5014923c55 could not be found. May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:52.571426 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:52.574815 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:52.574815 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:52.574815 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:52.574815 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:52.574815 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:52.574815 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25437109-2e1e-48a8-97ad-af5014923c55 could not be found. May 28 04:55:52.574815 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:52.574815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ffbfb4d3-50d7-4c94-a810-3fd5cc6d6be3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] Returning 404 to user: Instance 25437109-2e1e-48a8-97ad-af5014923c55 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:52.574815 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ffbfb4d3-50d7-4c94-a810-3fd5cc6d6be3 tempest-DeleteServersTestJSON-1743449930 tempest-DeleteServersTestJSON-1743449930-project] 10.222.0.58 "GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55" status: 404 len: 111 microversion: 2.1 time: 0.035506 May 28 04:55:52.574815 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2721/5326] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:52 2022] GET /compute/v2.1/servers/25437109-2e1e-48a8-97ad-af5014923c55 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:55:53.078786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-67fafbb4-5854-4427-af48-2474f59ea7be tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:53.079426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-67fafbb4-5854-4427-af48-2474f59ea7be tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:53.089768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=8 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:53.091473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-67fafbb4-5854-4427-af48-2474f59ea7be tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:53.096494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-67fafbb4-5854-4427-af48-2474f59ea7be tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:53.098775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-67fafbb4-5854-4427-af48-2474f59ea7be tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:53.099282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-67fafbb4-5854-4427-af48-2474f59ea7be tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:53.238325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-435d806b-1be5-437e-84a4-b0288a0b4843 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:53.238971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-435d806b-1be5-437e-84a4-b0288a0b4843 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:53.250853 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-435d806b-1be5-437e-84a4-b0288a0b4843 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:53.251591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-435d806b-1be5-437e-84a4-b0288a0b4843 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:53.252783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-435d806b-1be5-437e-84a4-b0288a0b4843 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:53.253427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-435d806b-1be5-437e-84a4-b0288a0b4843 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:53.783978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-67fafbb4-5854-4427-af48-2474f59ea7be tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:53.794691 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-67fafbb4-5854-4427-af48-2474f59ea7be tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1520 microversion: 2.1 time: 0.720363 May 28 04:55:53.798364 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2606/5327] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:53 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1520 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:53.809491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f3aaf3a8-c697-429e-ba13-8f1f1a000f44 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:53.810615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f3aaf3a8-c697-429e-ba13-8f1f1a000f44 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:53.827175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-435d806b-1be5-437e-84a4-b0288a0b4843 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:53.827787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3aaf3a8-c697-429e-ba13-8f1f1a000f44 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:53.828403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3aaf3a8-c697-429e-ba13-8f1f1a000f44 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:53.829208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3aaf3a8-c697-429e-ba13-8f1f1a000f44 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:53.829654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3aaf3a8-c697-429e-ba13-8f1f1a000f44 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:53.847009 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-435d806b-1be5-437e-84a4-b0288a0b4843 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.613175 May 28 04:55:53.853492 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2722/5328] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:53 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:53.869322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-163f37fa-263e-4514-9234-b8c247c6a274 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:53.870509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-163f37fa-263e-4514-9234-b8c247c6a274 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:53.882214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-163f37fa-263e-4514-9234-b8c247c6a274 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:53.886511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-163f37fa-263e-4514-9234-b8c247c6a274 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:53.886511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-163f37fa-263e-4514-9234-b8c247c6a274 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:53.886511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-163f37fa-263e-4514-9234-b8c247c6a274 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:54.519024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f3aaf3a8-c697-429e-ba13-8f1f1a000f44 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '207c97ffbad7462c83c2ad908da2dba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49ee69fe41f41d082a920768b51cdf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:54.527858 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f3aaf3a8-c697-429e-ba13-8f1f1a000f44 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] 10.222.0.58 "GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 200 len: 1327 microversion: 2.1 time: 0.728122 May 28 04:55:54.537787 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2607/5329] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:53 2022] GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 1327 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:54.653991 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-163f37fa-263e-4514-9234-b8c247c6a274 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:54.672915 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-163f37fa-263e-4514-9234-b8c247c6a274 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.807485 May 28 04:55:54.674111 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2723/5330] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:53 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:54.699552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a94d53c1-55d8-4f5e-a27c-51dca6fa0523 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:54.700491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a94d53c1-55d8-4f5e-a27c-51dca6fa0523 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:54.710903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a94d53c1-55d8-4f5e-a27c-51dca6fa0523 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:54.711732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a94d53c1-55d8-4f5e-a27c-51dca6fa0523 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:54.712735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a94d53c1-55d8-4f5e-a27c-51dca6fa0523 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:54.713368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a94d53c1-55d8-4f5e-a27c-51dca6fa0523 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:54.819512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d690c82e-bcae-4406-baea-8a600d3016ce tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:54.820360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d690c82e-bcae-4406-baea-8a600d3016ce tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:54.831549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d690c82e-bcae-4406-baea-8a600d3016ce tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:54.832420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d690c82e-bcae-4406-baea-8a600d3016ce tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:54.833548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d690c82e-bcae-4406-baea-8a600d3016ce tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:54.834556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d690c82e-bcae-4406-baea-8a600d3016ce tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:55.135912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a94d53c1-55d8-4f5e-a27c-51dca6fa0523 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:55.159313 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a94d53c1-55d8-4f5e-a27c-51dca6fa0523 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.454787 May 28 04:55:55.172527 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2608/5331] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:54 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:55.183558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53c09c48-6608-4a1d-9349-75dc177f07cc tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:55.188924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d690c82e-bcae-4406-baea-8a600d3016ce tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:55.200161 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d690c82e-bcae-4406-baea-8a600d3016ce tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1520 microversion: 2.1 time: 0.389338 May 28 04:55:55.209845 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2724/5332] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:54 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1520 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:55:55.215831 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-53c09c48-6608-4a1d-9349-75dc177f07cc tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance 55655848-cafd-4aea-8204-1c6a1ee910b7 has no mapping to a cell. May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53c09c48-6608-4a1d-9349-75dc177f07cc tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/55655848-cafd-4aea-8204-1c6a1ee910b7/action HTTP/1.1 May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 15 May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: {"os-stop": {}} May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 55655848-cafd-4aea-8204-1c6a1ee910b7 has no mapping to a cell. May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '55655848-cafd-4aea-8204-1c6a1ee910b7', 'body': {'os-stop': {}}} May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 55655848-cafd-4aea-8204-1c6a1ee910b7 has no mapping to a cell. May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:55.234719 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55655848-cafd-4aea-8204-1c6a1ee910b7 has no mapping to a cell. May 28 04:55:55.238279 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:55.238279 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:55.238279 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:55.238279 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:55.238279 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:55.238279 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:55.238279 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:55.238279 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:55.238279 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55655848-cafd-4aea-8204-1c6a1ee910b7 has no mapping to a cell. May 28 04:55:55.238279 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:55.238279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53c09c48-6608-4a1d-9349-75dc177f07cc tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance 55655848-cafd-4aea-8204-1c6a1ee910b7 has no mapping to a cell. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:55.238279 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-53c09c48-6608-4a1d-9349-75dc177f07cc tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/55655848-cafd-4aea-8204-1c6a1ee910b7/action" status: 404 len: 117 microversion: 2.1 time: 0.062824 May 28 04:55:55.238279 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2609/5333] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:55:55 2022] POST /compute/v2.1/servers/55655848-cafd-4aea-8204-1c6a1ee910b7/action => generated 117 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:55:55.253704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a7169e47-5186-49e8-a01f-085caa33de08 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:55.254465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a7169e47-5186-49e8-a01f-085caa33de08 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:55.276833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7169e47-5186-49e8-a01f-085caa33de08 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:55.277707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7169e47-5186-49e8-a01f-085caa33de08 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:55.279080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7169e47-5186-49e8-a01f-085caa33de08 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:55.279745 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7169e47-5186-49e8-a01f-085caa33de08 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:55.547698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4b26e691-6f62-4ae9-9521-be1b395c29f5 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:55.548239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4b26e691-6f62-4ae9-9521-be1b395c29f5 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:55.557617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b26e691-6f62-4ae9-9521-be1b395c29f5 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:55.558545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b26e691-6f62-4ae9-9521-be1b395c29f5 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:55.559974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b26e691-6f62-4ae9-9521-be1b395c29f5 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:55.560945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b26e691-6f62-4ae9-9521-be1b395c29f5 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:55.567646 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:55.822630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a7169e47-5186-49e8-a01f-085caa33de08 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:55.825736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:55.836494 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a7169e47-5186-49e8-a01f-085caa33de08 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.594475 May 28 04:55:55.839672 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2725/5334] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:55 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:55.856386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1d0aa648-33ca-4192-a150-f69e4fdc84ba tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:55.857751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1d0aa648-33ca-4192-a150-f69e4fdc84ba tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:55.864552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d0aa648-33ca-4192-a150-f69e4fdc84ba tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:55.865450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d0aa648-33ca-4192-a150-f69e4fdc84ba tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:55.866502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d0aa648-33ca-4192-a150-f69e4fdc84ba tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:55.867972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1d0aa648-33ca-4192-a150-f69e4fdc84ba tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:55.907788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4b26e691-6f62-4ae9-9521-be1b395c29f5 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '207c97ffbad7462c83c2ad908da2dba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49ee69fe41f41d082a920768b51cdf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:55.916773 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4b26e691-6f62-4ae9-9521-be1b395c29f5 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] 10.222.0.58 "GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 200 len: 1327 microversion: 2.1 time: 0.374754 May 28 04:55:55.918806 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2610/5335] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:55 2022] GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 1327 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:55.946926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-310906f0-d085-47e5-9a75-4c8dc721eddd req-2919c5a8-bde7-4208-aa7a-7d636d26e3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86491332-11fd-4053-b81a-1d64dcab9cb9", "name": "network-vif-plugged", "status": "completed", "tag": "561b794d-e794-4f69-9aa4-36b3df3116df"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:55.964061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-310906f0-d085-47e5-9a75-4c8dc721eddd req-2919c5a8-bde7-4208-aa7a-7d636d26e3d9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:55.964522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-310906f0-d085-47e5-9a75-4c8dc721eddd req-2919c5a8-bde7-4208-aa7a-7d636d26e3d9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:55.976470 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-310906f0-d085-47e5-9a75-4c8dc721eddd req-2919c5a8-bde7-4208-aa7a-7d636d26e3d9 service nova] Creating event network-vif-plugged:561b794d-e794-4f69-9aa4-36b3df3116df for instance 86491332-11fd-4053-b81a-1d64dcab9cb9 on n-h2-843700-1 May 28 04:55:55.983594 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-310906f0-d085-47e5-9a75-4c8dc721eddd req-2919c5a8-bde7-4208-aa7a-7d636d26e3d9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039894 May 28 04:55:55.983594 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2611/5336] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:55:56.044654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1d0aa648-33ca-4192-a150-f69e4fdc84ba tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:56.061023 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1d0aa648-33ca-4192-a150-f69e4fdc84ba tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.208631 May 28 04:55:56.062099 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2726/5337] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:55 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:56.081296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7b83c6f3-9c8c-4046-bfe8-b87e5ed47b97 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:56.082251 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7b83c6f3-9c8c-4046-bfe8-b87e5ed47b97 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 058004e2-5248-4682-ae40-5dfd693e8477] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:56.090069 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-7b83c6f3-9c8c-4046-bfe8-b87e5ed47b97 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance 058004e2-5248-4682-ae40-5dfd693e8477 could not be found. May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7b83c6f3-9c8c-4046-bfe8-b87e5ed47b97 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/058004e2-5248-4682-ae40-5dfd693e8477/action HTTP/1.1 May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 15 May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: {"suspend": {}} May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 058004e2-5248-4682-ae40-5dfd693e8477 could not be found. May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '058004e2-5248-4682-ae40-5dfd693e8477', 'body': {'suspend': {}}} May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 058004e2-5248-4682-ae40-5dfd693e8477 could not be found. May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 058004e2-5248-4682-ae40-5dfd693e8477 could not be found. May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:56.093231 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:56.104132 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:56.104132 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:56.104132 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 058004e2-5248-4682-ae40-5dfd693e8477 could not be found. May 28 04:55:56.104132 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:56.104132 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7b83c6f3-9c8c-4046-bfe8-b87e5ed47b97 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance 058004e2-5248-4682-ae40-5dfd693e8477 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:56.104132 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7b83c6f3-9c8c-4046-bfe8-b87e5ed47b97 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/058004e2-5248-4682-ae40-5dfd693e8477/action" status: 404 len: 111 microversion: 2.1 time: 0.020644 May 28 04:55:56.104132 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2612/5338] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:55:56 2022] POST /compute/v2.1/servers/058004e2-5248-4682-ae40-5dfd693e8477/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:55:56.105814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d35313ca-686b-4142-892b-40c9a352b9c2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:56.106483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d35313ca-686b-4142-892b-40c9a352b9c2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:56.113547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d35313ca-686b-4142-892b-40c9a352b9c2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:56.114003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d35313ca-686b-4142-892b-40c9a352b9c2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:56.114780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d35313ca-686b-4142-892b-40c9a352b9c2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:56.115359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d35313ca-686b-4142-892b-40c9a352b9c2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:56.229656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-06aaa1f7-2451-444b-a4f9-394334faec5b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:56.230340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-06aaa1f7-2451-444b-a4f9-394334faec5b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:56.241964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06aaa1f7-2451-444b-a4f9-394334faec5b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:56.243633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06aaa1f7-2451-444b-a4f9-394334faec5b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:56.244776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06aaa1f7-2451-444b-a4f9-394334faec5b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:56.245719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06aaa1f7-2451-444b-a4f9-394334faec5b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:56.521715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d35313ca-686b-4142-892b-40c9a352b9c2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:56.526488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-06aaa1f7-2451-444b-a4f9-394334faec5b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:56.529985 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d35313ca-686b-4142-892b-40c9a352b9c2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.428693 May 28 04:55:56.530582 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2727/5339] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:56 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:56.537562 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-06aaa1f7-2451-444b-a4f9-394334faec5b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1520 microversion: 2.1 time: 0.315434 May 28 04:55:56.538264 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2613/5340] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:56 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:56.547996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ed88cbb5-a931-42d4-a695-be67c03dafff tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:56.548750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ed88cbb5-a931-42d4-a695-be67c03dafff tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:56.556881 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed88cbb5-a931-42d4-a695-be67c03dafff tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:56.557454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed88cbb5-a931-42d4-a695-be67c03dafff tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:56.558341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed88cbb5-a931-42d4-a695-be67c03dafff tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:56.558907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed88cbb5-a931-42d4-a695-be67c03dafff tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:56.723673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ed88cbb5-a931-42d4-a695-be67c03dafff tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:56.733196 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ed88cbb5-a931-42d4-a695-be67c03dafff tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.189536 May 28 04:55:56.734146 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2728/5341] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:56 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:56.752986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-31c7f64a-ac61-484a-9a93-5b3724250bf9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:56.755767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-31c7f64a-ac61-484a-9a93-5b3724250bf9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:56.761469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31c7f64a-ac61-484a-9a93-5b3724250bf9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:56.762466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31c7f64a-ac61-484a-9a93-5b3724250bf9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:56.763451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31c7f64a-ac61-484a-9a93-5b3724250bf9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:56.764068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31c7f64a-ac61-484a-9a93-5b3724250bf9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:56.794504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-31c7f64a-ac61-484a-9a93-5b3724250bf9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lazy-loading 'flavor' on Instance uuid 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:55:56.935086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4d6d2029-d6ed-4ac3-b97c-5db0fc32b10e tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:56.935814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4d6d2029-d6ed-4ac3-b97c-5db0fc32b10e tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:56.942264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d6d2029-d6ed-4ac3-b97c-5db0fc32b10e tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:56.942721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d6d2029-d6ed-4ac3-b97c-5db0fc32b10e tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:56.943545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d6d2029-d6ed-4ac3-b97c-5db0fc32b10e tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:56.943987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d6d2029-d6ed-4ac3-b97c-5db0fc32b10e tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:57.136221 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4d6d2029-d6ed-4ac3-b97c-5db0fc32b10e tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '207c97ffbad7462c83c2ad908da2dba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49ee69fe41f41d082a920768b51cdf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:57.144181 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4d6d2029-d6ed-4ac3-b97c-5db0fc32b10e tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] 10.222.0.58 "GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 200 len: 1327 microversion: 2.1 time: 0.213225 May 28 04:55:57.144945 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2729/5342] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:56 2022] GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 1327 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:57.162705 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-31c7f64a-ac61-484a-9a93-5b3724250bf9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action" status: 202 len: 0 microversion: 2.1 time: 0.415405 May 28 04:55:57.163515 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2614/5343] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:55:56 2022] POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:55:57.182037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bdb9c475-91d8-44a9-bd85-881eb44e356d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:57.183194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bdb9c475-91d8-44a9-bd85-881eb44e356d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:57.190091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdb9c475-91d8-44a9-bd85-881eb44e356d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:57.191218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdb9c475-91d8-44a9-bd85-881eb44e356d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:57.192422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdb9c475-91d8-44a9-bd85-881eb44e356d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:57.193026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdb9c475-91d8-44a9-bd85-881eb44e356d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:57.449246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bdb9c475-91d8-44a9-bd85-881eb44e356d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:57.457306 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bdb9c475-91d8-44a9-bd85-881eb44e356d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1514 microversion: 2.1 time: 0.281837 May 28 04:55:57.458083 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2730/5344] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:57 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1514 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:57.556457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dc0ddee8-fd42-4f80-b9ef-4f7375402227 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:57.557844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dc0ddee8-fd42-4f80-b9ef-4f7375402227 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:57.574060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc0ddee8-fd42-4f80-b9ef-4f7375402227 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:57.574736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc0ddee8-fd42-4f80-b9ef-4f7375402227 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:57.576129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc0ddee8-fd42-4f80-b9ef-4f7375402227 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:57.579461 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc0ddee8-fd42-4f80-b9ef-4f7375402227 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:57.933692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dc0ddee8-fd42-4f80-b9ef-4f7375402227 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:57.956657 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dc0ddee8-fd42-4f80-b9ef-4f7375402227 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1500 microversion: 2.1 time: 0.405268 May 28 04:55:57.968199 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2615/5345] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:57 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1500 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:57.981446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6c29dbca-1070-44c4-8cd3-8bb2d9568aa9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:57.982906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6c29dbca-1070-44c4-8cd3-8bb2d9568aa9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:57.988743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:55:57.993345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c29dbca-1070-44c4-8cd3-8bb2d9568aa9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:57.993920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c29dbca-1070-44c4-8cd3-8bb2d9568aa9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:57.995087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c29dbca-1070-44c4-8cd3-8bb2d9568aa9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:57.995652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c29dbca-1070-44c4-8cd3-8bb2d9568aa9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:58.163181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-07e4be13-1a9f-4fa3-8993-ef1885e976cd tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:58.163967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-07e4be13-1a9f-4fa3-8993-ef1885e976cd tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:58.171348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07e4be13-1a9f-4fa3-8993-ef1885e976cd tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:58.172129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07e4be13-1a9f-4fa3-8993-ef1885e976cd tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:58.173169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07e4be13-1a9f-4fa3-8993-ef1885e976cd tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:58.173712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07e4be13-1a9f-4fa3-8993-ef1885e976cd tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:58.660045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-07e4be13-1a9f-4fa3-8993-ef1885e976cd tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '207c97ffbad7462c83c2ad908da2dba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49ee69fe41f41d082a920768b51cdf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:58.671756 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-07e4be13-1a9f-4fa3-8993-ef1885e976cd tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] 10.222.0.58 "GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 200 len: 1527 microversion: 2.1 time: 0.513519 May 28 04:55:58.672931 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2616/5346] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:58 2022] GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 1527 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:55:58.678363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e079789e-1ee1-4067-b1bf-de897dcce4a4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:58.679098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e079789e-1ee1-4067-b1bf-de897dcce4a4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:58.685836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e079789e-1ee1-4067-b1bf-de897dcce4a4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:58.686415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e079789e-1ee1-4067-b1bf-de897dcce4a4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:58.686521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6c29dbca-1070-44c4-8cd3-8bb2d9568aa9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:58.688085 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e079789e-1ee1-4067-b1bf-de897dcce4a4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:58.689924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e079789e-1ee1-4067-b1bf-de897dcce4a4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:58.694791 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6c29dbca-1070-44c4-8cd3-8bb2d9568aa9 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1515 microversion: 2.1 time: 0.719252 May 28 04:55:58.696168 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2731/5347] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:57 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1515 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:58.702056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8a4a1c4e-5da1-4feb-9231-b03e15048fff tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:58.703066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8a4a1c4e-5da1-4feb-9231-b03e15048fff tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:58.710403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a4a1c4e-5da1-4feb-9231-b03e15048fff tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:58.711785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a4a1c4e-5da1-4feb-9231-b03e15048fff tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:58.712684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a4a1c4e-5da1-4feb-9231-b03e15048fff tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:58.713928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a4a1c4e-5da1-4feb-9231-b03e15048fff tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:59.099589 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e079789e-1ee1-4067-b1bf-de897dcce4a4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:59.102520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8a4a1c4e-5da1-4feb-9231-b03e15048fff tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '207c97ffbad7462c83c2ad908da2dba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49ee69fe41f41d082a920768b51cdf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:59.112055 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8a4a1c4e-5da1-4feb-9231-b03e15048fff tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] 10.222.0.58 "GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 200 len: 1527 microversion: 2.1 time: 0.413937 May 28 04:55:59.113157 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2732/5348] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:58 2022] GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 1527 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:59.118847 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e079789e-1ee1-4067-b1bf-de897dcce4a4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1497 microversion: 2.1 time: 0.443135 May 28 04:55:59.121808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-15fc03cf-ce9f-4840-bbba-097dbac659a4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:59.121917 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2617/5349] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:58 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1497 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:59.121997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-15fc03cf-ce9f-4840-bbba-097dbac659a4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: 458ffc1f-84f5-475d-96ca-c171d652ac51] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:59.127747 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-15fc03cf-ce9f-4840-bbba-097dbac659a4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] HTTP exception thrown: Instance 458ffc1f-84f5-475d-96ca-c171d652ac51 could not be found. May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-15fc03cf-ce9f-4840-bbba-097dbac659a4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Request method failure captured: May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/458ffc1f-84f5-475d-96ca-c171d652ac51/action HTTP/1.1 May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 14 May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaseTx-CUErJTvPPURHUDDZW_2xVLiNPRiy1eiv9_fcFy45c02JpQ6VvqCXLzIK18DfT6aHtEfhTBsOxiJEfEG-fv6OQ2f3JYTQWF_vNEb8rrFvp-Wh1TVJC4d-u-zkyoCZX0D4P_h38dgB9yzRPIskmXiQK2RKoPWvSUe713g1UiE0 May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: f043f5d6fc0a47429a445d8f25401570 May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: f043f5d6fc0a47429a445d8f25401570 May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerRescueNegativeTestJSON-1590365959-project May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 227be762b2bc4bbba6d3e3e9a1d28c9c May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1590365959-project May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: {"rescue": {}} May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 458ffc1f-84f5-475d-96ca-c171d652ac51 could not be found. May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '458ffc1f-84f5-475d-96ca-c171d652ac51', 'body': {'rescue': {}}} May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 458ffc1f-84f5-475d-96ca-c171d652ac51 could not be found. May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 458ffc1f-84f5-475d-96ca-c171d652ac51 could not be found. May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:59.135762 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:59.140023 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:59.140023 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:59.140023 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:59.140023 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:59.140023 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 458ffc1f-84f5-475d-96ca-c171d652ac51 could not be found. May 28 04:55:59.140023 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:59.142013 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-15fc03cf-ce9f-4840-bbba-097dbac659a4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Returning 404 to user: Instance 458ffc1f-84f5-475d-96ca-c171d652ac51 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:59.150504 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-15fc03cf-ce9f-4840-bbba-097dbac659a4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "POST /compute/v2.1/servers/458ffc1f-84f5-475d-96ca-c171d652ac51/action" status: 404 len: 111 microversion: 2.1 time: 0.028748 May 28 04:55:59.150504 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2733/5350] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:55:59 2022] POST /compute/v2.1/servers/458ffc1f-84f5-475d-96ca-c171d652ac51/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:55:59.150741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c9dc921c-6129-4fbb-a97f-234b78dce6e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:59.150741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c9dc921c-6129-4fbb-a97f-234b78dce6e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:59.155577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9dc921c-6129-4fbb-a97f-234b78dce6e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:59.162441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9dc921c-6129-4fbb-a97f-234b78dce6e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:59.166357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9dc921c-6129-4fbb-a97f-234b78dce6e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:59.167023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9dc921c-6129-4fbb-a97f-234b78dce6e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:59.195815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-c9dc921c-6129-4fbb-a97f-234b78dce6e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lazy-loading 'flavor' on Instance uuid 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:55:59.210050 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-c9dc921c-6129-4fbb-a97f-234b78dce6e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Cannot 'suspend' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state suspended May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c9dc921c-6129-4fbb-a97f-234b78dce6e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action HTTP/1.1 May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 15 May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: {"suspend": {}} May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: exception: Cannot 'suspend' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state suspended May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '58022ec6-f4eb-4564-bed0-c3edd1d0daf4', 'body': {'suspend': {}}} May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 in vm_state suspended. Cannot suspend while the instance is in this state. May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend May 28 04:55:59.212672 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 04:55:59.216986 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 04:55:59.216986 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 04:55:59.216986 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state suspended May 28 04:55:59.216986 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:59.216986 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:59.216986 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:59.216986 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:59.216986 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:59.216986 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:59.216986 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:59.216986 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:59.216986 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state suspended May 28 04:55:59.216986 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:55:59.219014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c9dc921c-6129-4fbb-a97f-234b78dce6e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 409 to user: Cannot 'suspend' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state suspended {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:59.220285 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c9dc921c-6129-4fbb-a97f-234b78dce6e4 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action" status: 409 len: 148 microversion: 2.1 time: 0.077801 May 28 04:55:59.221561 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2618/5351] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:55:59 2022] POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action => generated 148 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 04:55:59.230042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e75b15d5-26eb-4dde-88de-574ee71c2a59 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:59.231756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e75b15d5-26eb-4dde-88de-574ee71c2a59 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:59.244938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e75b15d5-26eb-4dde-88de-574ee71c2a59 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:59.245480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e75b15d5-26eb-4dde-88de-574ee71c2a59 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:59.246348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e75b15d5-26eb-4dde-88de-574ee71c2a59 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:59.246866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e75b15d5-26eb-4dde-88de-574ee71c2a59 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:59.518894 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e75b15d5-26eb-4dde-88de-574ee71c2a59 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "POST /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02/action" status: 202 len: 0 microversion: 2.1 time: 0.294954 May 28 04:55:59.520697 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2619/5352] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:55:59 2022] POST /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:55:59.540342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f8b4c8c8-813a-4e19-98bb-9bcebdd6c02a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:55:59.541727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f8b4c8c8-813a-4e19-98bb-9bcebdd6c02a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:59.563541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8b4c8c8-813a-4e19-98bb-9bcebdd6c02a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:59.564080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8b4c8c8-813a-4e19-98bb-9bcebdd6c02a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:59.564893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8b4c8c8-813a-4e19-98bb-9bcebdd6c02a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:59.565313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8b4c8c8-813a-4e19-98bb-9bcebdd6c02a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:59.580404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c62aa830-5e87-45ce-8661-c3c2db250b34 tempest-ServersNegativeTestMultiTenantJSON-900874223 tempest-ServersNegativeTestMultiTenantJSON-900874223-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:59.581295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c62aa830-5e87-45ce-8661-c3c2db250b34 tempest-ServersNegativeTestMultiTenantJSON-900874223 tempest-ServersNegativeTestMultiTenantJSON-900874223-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:59.594717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c62aa830-5e87-45ce-8661-c3c2db250b34 tempest-ServersNegativeTestMultiTenantJSON-900874223 tempest-ServersNegativeTestMultiTenantJSON-900874223-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:59.598179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c62aa830-5e87-45ce-8661-c3c2db250b34 tempest-ServersNegativeTestMultiTenantJSON-900874223 tempest-ServersNegativeTestMultiTenantJSON-900874223-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:59.599279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c62aa830-5e87-45ce-8661-c3c2db250b34 tempest-ServersNegativeTestMultiTenantJSON-900874223 tempest-ServersNegativeTestMultiTenantJSON-900874223-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:59.601576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c62aa830-5e87-45ce-8661-c3c2db250b34 tempest-ServersNegativeTestMultiTenantJSON-900874223 tempest-ServersNegativeTestMultiTenantJSON-900874223-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:59.646910 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-c62aa830-5e87-45ce-8661-c3c2db250b34 tempest-ServersNegativeTestMultiTenantJSON-900874223 tempest-ServersNegativeTestMultiTenantJSON-900874223-project] HTTP exception thrown: Instance 86491332-11fd-4053-b81a-1d64dcab9cb9 could not be found. May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c62aa830-5e87-45ce-8661-c3c2db250b34 tempest-ServersNegativeTestMultiTenantJSON-900874223 tempest-ServersNegativeTestMultiTenantJSON-900874223-project] Request method failure captured: May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 HTTP/1.1 May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikatLtt7eL32Mxp1jKvKVG2CkAt65XToGXmJXZY6wGqHck0LyvWx8RQw8VNcYAQ5jzn2Rv83_TJonG5KpLFGKc3z7o4Wr1SeOb0qEMNVkdHEgVc2ge9f9WrgTv7vFaIDi8IoqfPlagrjZ3979YQ-f8L2decj8ZXet4L6DuI967BOSQXw May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 50910caecec64e4da93077e77708aea9 May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-900874223 May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50910caecec64e4da93077e77708aea9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50910caecec64e4da93077e77708aea9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50910caecec64e4da93077e77708aea9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50910caecec64e4da93077e77708aea9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-900874223 May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 50910caecec64e4da93077e77708aea9 May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-900874223 May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestMultiTenantJSON-900874223-project May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 86dda9136aa04946a918eef5d0ffed5d May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-900874223-project May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 86491332-11fd-4053-b81a-1d64dcab9cb9 could not be found. May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '86491332-11fd-4053-b81a-1d64dcab9cb9'} May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86491332-11fd-4053-b81a-1d64dcab9cb9 could not be found. May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:55:59.654405 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:55:59.658107 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86491332-11fd-4053-b81a-1d64dcab9cb9 could not be found. May 28 04:55:59.658107 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:59.658107 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:55:59.658107 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:59.658107 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:55:59.658107 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:55:59.658107 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:55:59.658107 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:55:59.658107 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:55:59.658107 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86491332-11fd-4053-b81a-1d64dcab9cb9 could not be found. May 28 04:55:59.658107 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:55:59.660368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c62aa830-5e87-45ce-8661-c3c2db250b34 tempest-ServersNegativeTestMultiTenantJSON-900874223 tempest-ServersNegativeTestMultiTenantJSON-900874223-project] Returning 404 to user: Instance 86491332-11fd-4053-b81a-1d64dcab9cb9 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:55:59.661361 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c62aa830-5e87-45ce-8661-c3c2db250b34 tempest-ServersNegativeTestMultiTenantJSON-900874223 tempest-ServersNegativeTestMultiTenantJSON-900874223-project] 10.222.0.58 "DELETE /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 404 len: 111 microversion: 2.1 time: 0.515705 May 28 04:55:59.662363 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2734/5353] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:55:59 2022] DELETE /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 111 bytes in 517 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:55:59.671427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5301b13a-a9d6-49f5-9463-5803ccdf8854 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:59.672159 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5301b13a-a9d6-49f5-9463-5803ccdf8854 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:59.678767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5301b13a-a9d6-49f5-9463-5803ccdf8854 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:59.679391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5301b13a-a9d6-49f5-9463-5803ccdf8854 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:59.681027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5301b13a-a9d6-49f5-9463-5803ccdf8854 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:59.681787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5301b13a-a9d6-49f5-9463-5803ccdf8854 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:59.825841 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f8b4c8c8-813a-4e19-98bb-9bcebdd6c02a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action" status: 202 len: 0 microversion: 2.1 time: 0.302980 May 28 04:55:59.828960 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2620/5354] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:55:59 2022] POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:55:59.832370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4fa4d5b8-4bd9-4f46-9854-97c76b169584 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:59.833138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4fa4d5b8-4bd9-4f46-9854-97c76b169584 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:59.843241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4fa4d5b8-4bd9-4f46-9854-97c76b169584 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:59.843913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4fa4d5b8-4bd9-4f46-9854-97c76b169584 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:59.845675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4fa4d5b8-4bd9-4f46-9854-97c76b169584 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:59.845675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4fa4d5b8-4bd9-4f46-9854-97c76b169584 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:59.888027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5301b13a-a9d6-49f5-9463-5803ccdf8854 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:55:59.900769 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5301b13a-a9d6-49f5-9463-5803ccdf8854 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1520 microversion: 2.1 time: 0.234688 May 28 04:55:59.901381 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2735/5355] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:59 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:55:59.915602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5b312fe8-6987-4eb6-9002-db9daa4b48a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:55:59.916218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5b312fe8-6987-4eb6-9002-db9daa4b48a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:55:59.922956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b312fe8-6987-4eb6-9002-db9daa4b48a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:59.923376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b312fe8-6987-4eb6-9002-db9daa4b48a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:55:59.924150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b312fe8-6987-4eb6-9002-db9daa4b48a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:55:59.924587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b312fe8-6987-4eb6-9002-db9daa4b48a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:00.133894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4fa4d5b8-4bd9-4f46-9854-97c76b169584 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '207c97ffbad7462c83c2ad908da2dba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49ee69fe41f41d082a920768b51cdf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:00.144108 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4fa4d5b8-4bd9-4f46-9854-97c76b169584 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] 10.222.0.58 "GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 200 len: 1527 microversion: 2.1 time: 0.316020 May 28 04:56:00.144710 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2621/5356] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:59 2022] GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 1527 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:00.161126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-90e1d91d-447a-45e4-97a7-f49715c5bca2 tempest-ServersNegativeTestMultiTenantJSON-900874223 tempest-ServersNegativeTestMultiTenantJSON-900874223-project] Action: 'update', calling method: >, body: {"server": {"name": "86491332-11fd-4053-b81a-1d64dcab9cb9_new"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:00.162525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-90e1d91d-447a-45e4-97a7-f49715c5bca2 tempest-ServersNegativeTestMultiTenantJSON-900874223 tempest-ServersNegativeTestMultiTenantJSON-900874223-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:00.168744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-90e1d91d-447a-45e4-97a7-f49715c5bca2 tempest-ServersNegativeTestMultiTenantJSON-900874223 tempest-ServersNegativeTestMultiTenantJSON-900874223-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:00.169225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-90e1d91d-447a-45e4-97a7-f49715c5bca2 tempest-ServersNegativeTestMultiTenantJSON-900874223 tempest-ServersNegativeTestMultiTenantJSON-900874223-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:00.169983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-90e1d91d-447a-45e4-97a7-f49715c5bca2 tempest-ServersNegativeTestMultiTenantJSON-900874223 tempest-ServersNegativeTestMultiTenantJSON-900874223-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:00.170427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-90e1d91d-447a-45e4-97a7-f49715c5bca2 tempest-ServersNegativeTestMultiTenantJSON-900874223 tempest-ServersNegativeTestMultiTenantJSON-900874223-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:00.184456 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-90e1d91d-447a-45e4-97a7-f49715c5bca2 tempest-ServersNegativeTestMultiTenantJSON-900874223 tempest-ServersNegativeTestMultiTenantJSON-900874223-project] HTTP exception thrown: Instance 86491332-11fd-4053-b81a-1d64dcab9cb9 could not be found. May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-90e1d91d-447a-45e4-97a7-f49715c5bca2 tempest-ServersNegativeTestMultiTenantJSON-900874223 tempest-ServersNegativeTestMultiTenantJSON-900874223-project] Request method failure captured: May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: request: PUT /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 HTTP/1.1 May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 64 May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikatLtt7eL32Mxp1jKvKVG2CkAt65XToGXmJXZY6wGqHck0LyvWx8RQw8VNcYAQ5jzn2Rv83_TJonG5KpLFGKc3z7o4Wr1SeOb0qEMNVkdHEgVc2ge9f9WrgTv7vFaIDi8IoqfPlagrjZ3979YQ-f8L2decj8ZXet4L6DuI967BOSQXw May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 50910caecec64e4da93077e77708aea9 May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-900874223 May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50910caecec64e4da93077e77708aea9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50910caecec64e4da93077e77708aea9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50910caecec64e4da93077e77708aea9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50910caecec64e4da93077e77708aea9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-900874223 May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 50910caecec64e4da93077e77708aea9 May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-900874223 May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestMultiTenantJSON-900874223-project May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 86dda9136aa04946a918eef5d0ffed5d May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-900874223-project May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: {"server": {"name": "86491332-11fd-4053-b81a-1d64dcab9cb9_new"}} May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 86491332-11fd-4053-b81a-1d64dcab9cb9 could not be found. May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '86491332-11fd-4053-b81a-1d64dcab9cb9', 'body': {'server': {'name': '86491332-11fd-4053-b81a-1d64dcab9cb9_new'}}} May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86491332-11fd-4053-b81a-1d64dcab9cb9 could not be found. May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 28 04:56:00.186441 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update May 28 04:56:00.190743 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) May 28 04:56:00.190743 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:56:00.190743 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:56:00.190743 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:56:00.190743 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:56:00.190743 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86491332-11fd-4053-b81a-1d64dcab9cb9 could not be found. May 28 04:56:00.190743 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:00.190743 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:00.190743 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:00.190743 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:00.190743 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:00.190743 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:00.190743 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:56:00.190743 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:56:00.190743 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86491332-11fd-4053-b81a-1d64dcab9cb9 could not be found. May 28 04:56:00.190743 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:00.190743 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-90e1d91d-447a-45e4-97a7-f49715c5bca2 tempest-ServersNegativeTestMultiTenantJSON-900874223 tempest-ServersNegativeTestMultiTenantJSON-900874223-project] Returning 404 to user: Instance 86491332-11fd-4053-b81a-1d64dcab9cb9 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:56:00.190743 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-90e1d91d-447a-45e4-97a7-f49715c5bca2 tempest-ServersNegativeTestMultiTenantJSON-900874223 tempest-ServersNegativeTestMultiTenantJSON-900874223-project] 10.222.0.58 "PUT /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 404 len: 111 microversion: 2.1 time: 0.031206 May 28 04:56:00.190743 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2622/5357] 10.222.0.58 () {60 vars in 1255 bytes} [Sat May 28 04:56:00 2022] PUT /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:56:00.197794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ca52b3e1-318b-42f0-9189-62493a85cc99 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:00.198303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ca52b3e1-318b-42f0-9189-62493a85cc99 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:00.204758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca52b3e1-318b-42f0-9189-62493a85cc99 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:00.205219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca52b3e1-318b-42f0-9189-62493a85cc99 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:00.206042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca52b3e1-318b-42f0-9189-62493a85cc99 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:00.206494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca52b3e1-318b-42f0-9189-62493a85cc99 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:00.216591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5b312fe8-6987-4eb6-9002-db9daa4b48a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:00.224903 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5b312fe8-6987-4eb6-9002-db9daa4b48a9 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1503 microversion: 2.1 time: 0.313248 May 28 04:56:00.226093 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2736/5358] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:55:59 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1503 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:00.234042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ca52b3e1-318b-42f0-9189-62493a85cc99 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:56:00.383591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:56:00.550214 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ca52b3e1-318b-42f0-9189-62493a85cc99 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] 10.222.0.58 "DELETE /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 204 len: 0 microversion: 2.1 time: 0.356183 May 28 04:56:00.551678 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2623/5359] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:56:00 2022] DELETE /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:56:00.563202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-19a60233-a01a-4d4c-bc61-234ba338d73b tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:00.563882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-19a60233-a01a-4d4c-bc61-234ba338d73b tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:00.573936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19a60233-a01a-4d4c-bc61-234ba338d73b tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:00.575237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19a60233-a01a-4d4c-bc61-234ba338d73b tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:00.576411 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19a60233-a01a-4d4c-bc61-234ba338d73b tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:00.577035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19a60233-a01a-4d4c-bc61-234ba338d73b tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:00.920021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-76cbd91e-bfc6-422c-851d-9208a2b3d46c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:00.921174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-76cbd91e-bfc6-422c-851d-9208a2b3d46c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:00.931922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76cbd91e-bfc6-422c-851d-9208a2b3d46c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:00.938387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76cbd91e-bfc6-422c-851d-9208a2b3d46c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:00.938387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76cbd91e-bfc6-422c-851d-9208a2b3d46c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:00.938387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76cbd91e-bfc6-422c-851d-9208a2b3d46c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:00.957321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-19a60233-a01a-4d4c-bc61-234ba338d73b tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '207c97ffbad7462c83c2ad908da2dba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49ee69fe41f41d082a920768b51cdf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:00.966570 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-19a60233-a01a-4d4c-bc61-234ba338d73b tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] 10.222.0.58 "GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 200 len: 1533 microversion: 2.1 time: 0.410026 May 28 04:56:00.978642 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2737/5360] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:00 2022] GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 1533 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:01.234289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-76cbd91e-bfc6-422c-851d-9208a2b3d46c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:01.241730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8b42b0ac-8313-46f4-b102-ba2931e0326f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:01.243163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8b42b0ac-8313-46f4-b102-ba2931e0326f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:01.246814 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-76cbd91e-bfc6-422c-851d-9208a2b3d46c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1500 microversion: 2.1 time: 0.332603 May 28 04:56:01.250201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b42b0ac-8313-46f4-b102-ba2931e0326f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:01.250849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b42b0ac-8313-46f4-b102-ba2931e0326f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:01.252094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b42b0ac-8313-46f4-b102-ba2931e0326f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:01.253643 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b42b0ac-8313-46f4-b102-ba2931e0326f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:01.259711 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2624/5361] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:00 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1500 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:01.266829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-78700822-6c67-481f-b28a-c9d227093bf6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:01.268135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-78700822-6c67-481f-b28a-c9d227093bf6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:01.283296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78700822-6c67-481f-b28a-c9d227093bf6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:01.283759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78700822-6c67-481f-b28a-c9d227093bf6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:01.284624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78700822-6c67-481f-b28a-c9d227093bf6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:01.285074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78700822-6c67-481f-b28a-c9d227093bf6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:01.323803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-78700822-6c67-481f-b28a-c9d227093bf6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lazy-loading 'flavor' on Instance uuid af197e5a-1493-44f1-ae5c-05fad352ed02 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:56:01.337132 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-78700822-6c67-481f-b28a-c9d227093bf6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] HTTP exception thrown: Cannot 'rescue' instance af197e5a-1493-44f1-ae5c-05fad352ed02 while it is in vm_state paused May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-78700822-6c67-481f-b28a-c9d227093bf6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Request method failure captured: May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02/action HTTP/1.1 May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 14 May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaseTx-CUErJTvPPURHUDDZW_2xVLiNPRiy1eiv9_fcFy45c02JpQ6VvqCXLzIK18DfT6aHtEfhTBsOxiJEfEG-fv6OQ2f3JYTQWF_vNEb8rrFvp-Wh1TVJC4d-u-zkyoCZX0D4P_h38dgB9yzRPIskmXiQK2RKoPWvSUe713g1UiE0 May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: f043f5d6fc0a47429a445d8f25401570 May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: f043f5d6fc0a47429a445d8f25401570 May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerRescueNegativeTestJSON-1590365959-project May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 227be762b2bc4bbba6d3e3e9a1d28c9c May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1590365959-project May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: {"rescue": {}} May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: exception: Cannot 'rescue' instance af197e5a-1493-44f1-ae5c-05fad352ed02 while it is in vm_state paused May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'af197e5a-1493-44f1-ae5c-05fad352ed02', 'body': {'rescue': {}}} May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance af197e5a-1493-44f1-ae5c-05fad352ed02 in vm_state paused. Cannot rescue while the instance is in this state. May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance af197e5a-1493-44f1-ae5c-05fad352ed02 while it is in vm_state paused May 28 04:56:01.339036 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:01.342903 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:01.342903 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:01.342903 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:01.342903 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:01.342903 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:01.342903 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:56:01.342903 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:56:01.342903 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance af197e5a-1493-44f1-ae5c-05fad352ed02 while it is in vm_state paused May 28 04:56:01.342903 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:01.354265 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-78700822-6c67-481f-b28a-c9d227093bf6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Returning 409 to user: Cannot 'rescue' instance af197e5a-1493-44f1-ae5c-05fad352ed02 while it is in vm_state paused {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:56:01.354265 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-78700822-6c67-481f-b28a-c9d227093bf6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "POST /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02/action" status: 409 len: 144 microversion: 2.1 time: 0.084884 May 28 04:56:01.354265 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2625/5362] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:56:01 2022] POST /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02/action => generated 144 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 04:56:01.360415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2208fe85-5173-4f48-b0b6-899c1c27752c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:01.361227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2208fe85-5173-4f48-b0b6-899c1c27752c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:01.368824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2208fe85-5173-4f48-b0b6-899c1c27752c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:01.369391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2208fe85-5173-4f48-b0b6-899c1c27752c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:01.370244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2208fe85-5173-4f48-b0b6-899c1c27752c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:01.370778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2208fe85-5173-4f48-b0b6-899c1c27752c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:01.669588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8b42b0ac-8313-46f4-b102-ba2931e0326f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:01.670646 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2208fe85-5173-4f48-b0b6-899c1c27752c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "POST /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02/action" status: 202 len: 0 microversion: 2.1 time: 0.317458 May 28 04:56:01.671452 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2626/5363] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:56:01 2022] POST /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:56:01.680995 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8b42b0ac-8313-46f4-b102-ba2931e0326f tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1503 microversion: 2.1 time: 0.443149 May 28 04:56:01.686871 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2738/5364] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:01 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1503 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:56:01.701773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-36846f0c-9f53-4b5e-bddc-6e26011daf11 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:01.702944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-36846f0c-9f53-4b5e-bddc-6e26011daf11 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:01.717937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-36846f0c-9f53-4b5e-bddc-6e26011daf11 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:01.722234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-36846f0c-9f53-4b5e-bddc-6e26011daf11 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:01.724395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-36846f0c-9f53-4b5e-bddc-6e26011daf11 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:01.727564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-36846f0c-9f53-4b5e-bddc-6e26011daf11 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:01.988553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-df4bcc13-3870-43db-95d5-ac801dd06f2d tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:01.990730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-df4bcc13-3870-43db-95d5-ac801dd06f2d tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:02.014291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df4bcc13-3870-43db-95d5-ac801dd06f2d tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:02.014747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df4bcc13-3870-43db-95d5-ac801dd06f2d tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:02.019839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df4bcc13-3870-43db-95d5-ac801dd06f2d tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:02.020562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df4bcc13-3870-43db-95d5-ac801dd06f2d tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:02.732710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-36846f0c-9f53-4b5e-bddc-6e26011daf11 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:02.740826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-df4bcc13-3870-43db-95d5-ac801dd06f2d tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '207c97ffbad7462c83c2ad908da2dba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49ee69fe41f41d082a920768b51cdf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:02.761025 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-36846f0c-9f53-4b5e-bddc-6e26011daf11 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1507 microversion: 2.1 time: 1.084732 May 28 04:56:02.771582 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2627/5365] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:01 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1507 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:02.771582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d49c1a05-e19e-4c4a-9fe6-4d671540d869 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:02.771582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d49c1a05-e19e-4c4a-9fe6-4d671540d869 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:02.773203 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-df4bcc13-3870-43db-95d5-ac801dd06f2d tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] 10.222.0.58 "GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 200 len: 1533 microversion: 2.1 time: 0.789371 May 28 04:56:02.777173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d49c1a05-e19e-4c4a-9fe6-4d671540d869 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:02.777667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d49c1a05-e19e-4c4a-9fe6-4d671540d869 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:02.778551 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2739/5366] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:01 2022] GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 1533 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:02.780364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d49c1a05-e19e-4c4a-9fe6-4d671540d869 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:02.781025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d49c1a05-e19e-4c4a-9fe6-4d671540d869 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:03.168436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d49c1a05-e19e-4c4a-9fe6-4d671540d869 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:03.177120 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d49c1a05-e19e-4c4a-9fe6-4d671540d869 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.413724 May 28 04:56:03.190205 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2628/5367] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:02 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:03.201965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8700c5bb-d2b4-4ccc-bbd6-568b4b55968d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:03.203260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8700c5bb-d2b4-4ccc-bbd6-568b4b55968d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:03.214787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8700c5bb-d2b4-4ccc-bbd6-568b4b55968d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:03.215430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8700c5bb-d2b4-4ccc-bbd6-568b4b55968d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:03.216454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8700c5bb-d2b4-4ccc-bbd6-568b4b55968d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:03.217008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8700c5bb-d2b4-4ccc-bbd6-568b4b55968d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:03.438742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8700c5bb-d2b4-4ccc-bbd6-568b4b55968d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:03.453435 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8700c5bb-d2b4-4ccc-bbd6-568b4b55968d tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.259716 May 28 04:56:03.457048 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2740/5368] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:03 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:03.482734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3472d78b-ae70-4a13-a9d5-8dfe44601104 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:03.484248 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3472d78b-ae70-4a13-a9d5-8dfe44601104 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: eb3c1deb-275e-469e-8482-59c6754faecb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:03.512803 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-3472d78b-ae70-4a13-a9d5-8dfe44601104 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance eb3c1deb-275e-469e-8482-59c6754faecb could not be found. May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3472d78b-ae70-4a13-a9d5-8dfe44601104 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/eb3c1deb-275e-469e-8482-59c6754faecb/action HTTP/1.1 May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 15 May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: {"unpause": {}} May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance eb3c1deb-275e-469e-8482-59c6754faecb could not be found. May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'eb3c1deb-275e-469e-8482-59c6754faecb', 'body': {'unpause': {}}} May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb3c1deb-275e-469e-8482-59c6754faecb could not be found. May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb3c1deb-275e-469e-8482-59c6754faecb could not be found. May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:03.515967 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:03.529455 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:56:03.529455 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:56:03.529455 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb3c1deb-275e-469e-8482-59c6754faecb could not be found. May 28 04:56:03.529455 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:03.529455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3472d78b-ae70-4a13-a9d5-8dfe44601104 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance eb3c1deb-275e-469e-8482-59c6754faecb could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:56:03.529455 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3472d78b-ae70-4a13-a9d5-8dfe44601104 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/eb3c1deb-275e-469e-8482-59c6754faecb/action" status: 404 len: 111 microversion: 2.1 time: 0.045910 May 28 04:56:03.529455 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2629/5369] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:56:03 2022] POST /compute/v2.1/servers/eb3c1deb-275e-469e-8482-59c6754faecb/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:56:03.530294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ed2e5055-b3bb-4fe3-aa3a-648c0f80a57b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:03.530294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ed2e5055-b3bb-4fe3-aa3a-648c0f80a57b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:03.537372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed2e5055-b3bb-4fe3-aa3a-648c0f80a57b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:03.537979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed2e5055-b3bb-4fe3-aa3a-648c0f80a57b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:03.539140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed2e5055-b3bb-4fe3-aa3a-648c0f80a57b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:03.539668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed2e5055-b3bb-4fe3-aa3a-648c0f80a57b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:03.780023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5e2a9c23-7f93-401f-895c-e9c0cf1de81c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:03.781420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5e2a9c23-7f93-401f-895c-e9c0cf1de81c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:03.792777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e2a9c23-7f93-401f-895c-e9c0cf1de81c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:03.795809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e2a9c23-7f93-401f-895c-e9c0cf1de81c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:03.796811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e2a9c23-7f93-401f-895c-e9c0cf1de81c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:03.798163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e2a9c23-7f93-401f-895c-e9c0cf1de81c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:03.834472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ed2e5055-b3bb-4fe3-aa3a-648c0f80a57b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:03.851428 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ed2e5055-b3bb-4fe3-aa3a-648c0f80a57b tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.322768 May 28 04:56:03.869637 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2741/5370] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:03 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:03.884773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5432c4ae-d838-4268-8bc6-963f6289b1d8 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:03.885963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5432c4ae-d838-4268-8bc6-963f6289b1d8 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:03.902586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5432c4ae-d838-4268-8bc6-963f6289b1d8 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:03.903354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5432c4ae-d838-4268-8bc6-963f6289b1d8 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:03.906171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5432c4ae-d838-4268-8bc6-963f6289b1d8 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:03.906637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5432c4ae-d838-4268-8bc6-963f6289b1d8 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:04.047404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5432c4ae-d838-4268-8bc6-963f6289b1d8 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '207c97ffbad7462c83c2ad908da2dba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49ee69fe41f41d082a920768b51cdf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:04.057587 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5432c4ae-d838-4268-8bc6-963f6289b1d8 tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] 10.222.0.58 "GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 200 len: 1491 microversion: 2.1 time: 0.185049 May 28 04:56:04.063228 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2742/5371] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:03 2022] GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 1491 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:04.071048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b9d4efae-6f00-4f8b-8523-bfa65d32aa51 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:04.071831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b9d4efae-6f00-4f8b-8523-bfa65d32aa51 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:04.078706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b9d4efae-6f00-4f8b-8523-bfa65d32aa51 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:04.081714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b9d4efae-6f00-4f8b-8523-bfa65d32aa51 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:04.081714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b9d4efae-6f00-4f8b-8523-bfa65d32aa51 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:04.081714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b9d4efae-6f00-4f8b-8523-bfa65d32aa51 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:04.154469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5e2a9c23-7f93-401f-895c-e9c0cf1de81c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:04.170366 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5e2a9c23-7f93-401f-895c-e9c0cf1de81c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1515 microversion: 2.1 time: 0.394087 May 28 04:56:04.178263 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2630/5372] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:03 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1515 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:56:04.198685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-9bf9a8df-63d6-405e-830b-988b5963fbd3 req-0f259407-ff90-4be6-ba92-8a1fc3579f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86491332-11fd-4053-b81a-1d64dcab9cb9", "name": "network-vif-deleted", "tag": "561b794d-e794-4f69-9aa4-36b3df3116df"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:04.210207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9bf9a8df-63d6-405e-830b-988b5963fbd3 req-0f259407-ff90-4be6-ba92-8a1fc3579f96 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:04.210668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9bf9a8df-63d6-405e-830b-988b5963fbd3 req-0f259407-ff90-4be6-ba92-8a1fc3579f96 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:04.224658 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-9bf9a8df-63d6-405e-830b-988b5963fbd3 req-0f259407-ff90-4be6-ba92-8a1fc3579f96 service nova] Creating event network-vif-deleted:561b794d-e794-4f69-9aa4-36b3df3116df for instance 86491332-11fd-4053-b81a-1d64dcab9cb9 on n-h2-843700-1 May 28 04:56:04.230804 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-9bf9a8df-63d6-405e-830b-988b5963fbd3 req-0f259407-ff90-4be6-ba92-8a1fc3579f96 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044423 May 28 04:56:04.231662 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2631/5373] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:56:04.401021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b9d4efae-6f00-4f8b-8523-bfa65d32aa51 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:04.416799 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b9d4efae-6f00-4f8b-8523-bfa65d32aa51 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.356706 May 28 04:56:04.417254 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2743/5374] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:04 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:04.438796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3a2fa769-5d40-44a7-ae51-1145b3ddd3b7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:04.438935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3a2fa769-5d40-44a7-ae51-1145b3ddd3b7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:04.449073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a2fa769-5d40-44a7-ae51-1145b3ddd3b7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:04.449951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a2fa769-5d40-44a7-ae51-1145b3ddd3b7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:04.456453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a2fa769-5d40-44a7-ae51-1145b3ddd3b7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:04.456453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a2fa769-5d40-44a7-ae51-1145b3ddd3b7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:04.495868 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-3a2fa769-5d40-44a7-ae51-1145b3ddd3b7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Cannot 'unpause' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state active May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3a2fa769-5d40-44a7-ae51-1145b3ddd3b7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action HTTP/1.1 May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 15 May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: {"unpause": {}} May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: exception: Cannot 'unpause' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state active May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '58022ec6-f4eb-4564-bed0-c3edd1d0daf4', 'body': {'unpause': {}}} May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 in vm_state active. Cannot unpause while the instance is in this state. May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state active May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:04.497530 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:04.501410 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:04.501410 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:56:04.501410 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:56:04.501410 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state active May 28 04:56:04.501410 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:04.503327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3a2fa769-5d40-44a7-ae51-1145b3ddd3b7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 409 to user: Cannot 'unpause' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state active {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:56:04.504573 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3a2fa769-5d40-44a7-ae51-1145b3ddd3b7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action" status: 409 len: 145 microversion: 2.1 time: 0.071584 May 28 04:56:04.505659 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2632/5375] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:56:04 2022] POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action => generated 145 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 04:56:04.516738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1fd356ea-c90a-4938-a163-f2cab9843285 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:04.517425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1fd356ea-c90a-4938-a163-f2cab9843285 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:04.524073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fd356ea-c90a-4938-a163-f2cab9843285 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:04.524622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fd356ea-c90a-4938-a163-f2cab9843285 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:04.526030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fd356ea-c90a-4938-a163-f2cab9843285 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:04.526030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fd356ea-c90a-4938-a163-f2cab9843285 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:04.530395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:56:04.958940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1fd356ea-c90a-4938-a163-f2cab9843285 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:04.981718 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1fd356ea-c90a-4938-a163-f2cab9843285 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.470058 May 28 04:56:04.982347 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2744/5376] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:04 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:05.017834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-88d2778a-54d2-4e83-8d39-d43f3140aed3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:05.018423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-88d2778a-54d2-4e83-8d39-d43f3140aed3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:05.030463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88d2778a-54d2-4e83-8d39-d43f3140aed3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:05.030953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88d2778a-54d2-4e83-8d39-d43f3140aed3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:05.031809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88d2778a-54d2-4e83-8d39-d43f3140aed3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:05.032256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-88d2778a-54d2-4e83-8d39-d43f3140aed3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:05.076159 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1cc0d143-5897-453f-91a0-775a6a2dbaec tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:05.076797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1cc0d143-5897-453f-91a0-775a6a2dbaec tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] [instance: 86491332-11fd-4053-b81a-1d64dcab9cb9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:05.089046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1cc0d143-5897-453f-91a0-775a6a2dbaec tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:05.089882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1cc0d143-5897-453f-91a0-775a6a2dbaec tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:05.090682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1cc0d143-5897-453f-91a0-775a6a2dbaec tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:05.091168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1cc0d143-5897-453f-91a0-775a6a2dbaec tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:05.144493 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-1cc0d143-5897-453f-91a0-775a6a2dbaec tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] HTTP exception thrown: Instance 86491332-11fd-4053-b81a-1d64dcab9cb9 could not be found. May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1cc0d143-5897-453f-91a0-775a6a2dbaec tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Request method failure captured: May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 HTTP/1.1 May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikatHUCDwDO3CP7emXVs5d0vV5RJ1N6RH5aiuQ7357aBDBSuV1tSlsOMGeZyTXBmqH5TEbsXCyMA1vxkawRuXL6xBMc96-ac-D9RoP9fsyE9Bwm1tkUFQB108qEN83iCFw12bD3c7QMfHN0QOn-NdvxNxRZ6575NFHdVKQVVx2n2xTZ0 May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: c49ee69fe41f41d082a920768b51cdf7 May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1691471254 May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c49ee69fe41f41d082a920768b51cdf7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c49ee69fe41f41d082a920768b51cdf7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c49ee69fe41f41d082a920768b51cdf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c49ee69fe41f41d082a920768b51cdf7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1691471254 May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: c49ee69fe41f41d082a920768b51cdf7 May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1691471254 May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1691471254-project May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 207c97ffbad7462c83c2ad908da2dba1 May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1691471254-project May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 86491332-11fd-4053-b81a-1d64dcab9cb9 could not be found. May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '86491332-11fd-4053-b81a-1d64dcab9cb9'} May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86491332-11fd-4053-b81a-1d64dcab9cb9 could not be found. May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86491332-11fd-4053-b81a-1d64dcab9cb9 could not be found. May 28 04:56:05.146067 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:05.149921 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:05.149921 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:05.149921 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:05.149921 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:05.149921 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:05.149921 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:56:05.149921 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:56:05.149921 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86491332-11fd-4053-b81a-1d64dcab9cb9 could not be found. May 28 04:56:05.149921 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:05.152026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1cc0d143-5897-453f-91a0-775a6a2dbaec tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] Returning 404 to user: Instance 86491332-11fd-4053-b81a-1d64dcab9cb9 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:56:05.152909 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1cc0d143-5897-453f-91a0-775a6a2dbaec tempest-ServersNegativeTestMultiTenantJSON-1691471254 tempest-ServersNegativeTestMultiTenantJSON-1691471254-project] 10.222.0.58 "GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9" status: 404 len: 111 microversion: 2.1 time: 0.081338 May 28 04:56:05.153488 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2745/5377] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:05 2022] GET /compute/v2.1/servers/86491332-11fd-4053-b81a-1d64dcab9cb9 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:56:05.314929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-88d2778a-54d2-4e83-8d39-d43f3140aed3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:05.323531 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-88d2778a-54d2-4e83-8d39-d43f3140aed3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.310078 May 28 04:56:05.336501 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2633/5378] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:05 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:05.344758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ad882e7d-fdc7-46c6-bb86-1d1eb9ad59b5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:05.345576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ad882e7d-fdc7-46c6-bb86-1d1eb9ad59b5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 7532c0bd-27c7-42e7-bd05-10c5de929eaa] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:05.357840 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-ad882e7d-fdc7-46c6-bb86-1d1eb9ad59b5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance 7532c0bd-27c7-42e7-bd05-10c5de929eaa could not be found. May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ad882e7d-fdc7-46c6-bb86-1d1eb9ad59b5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/7532c0bd-27c7-42e7-bd05-10c5de929eaa/action HTTP/1.1 May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 18 May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: {"unshelve": null} May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 7532c0bd-27c7-42e7-bd05-10c5de929eaa could not be found. May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '7532c0bd-27c7-42e7-bd05-10c5de929eaa', 'body': {'unshelve': None}} May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7532c0bd-27c7-42e7-bd05-10c5de929eaa could not be found. May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7532c0bd-27c7-42e7-bd05-10c5de929eaa could not be found. May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:05.362320 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:05.367407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:05.367407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:56:05.367407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:56:05.367407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7532c0bd-27c7-42e7-bd05-10c5de929eaa could not be found. May 28 04:56:05.367407 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:05.368535 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ad882e7d-fdc7-46c6-bb86-1d1eb9ad59b5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance 7532c0bd-27c7-42e7-bd05-10c5de929eaa could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:56:05.373246 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ad882e7d-fdc7-46c6-bb86-1d1eb9ad59b5 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/7532c0bd-27c7-42e7-bd05-10c5de929eaa/action" status: 404 len: 111 microversion: 2.1 time: 0.031289 May 28 04:56:05.375151 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2746/5379] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:56:05 2022] POST /compute/v2.1/servers/7532c0bd-27c7-42e7-bd05-10c5de929eaa/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:56:05.384726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-931fcbb1-e29b-4b63-875a-7535640c5ffe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:05.385289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-931fcbb1-e29b-4b63-875a-7535640c5ffe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:05.393884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-931fcbb1-e29b-4b63-875a-7535640c5ffe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:05.394358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-931fcbb1-e29b-4b63-875a-7535640c5ffe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:05.395296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-931fcbb1-e29b-4b63-875a-7535640c5ffe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:05.395602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-931fcbb1-e29b-4b63-875a-7535640c5ffe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:05.624297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-931fcbb1-e29b-4b63-875a-7535640c5ffe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:05.639439 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-931fcbb1-e29b-4b63-875a-7535640c5ffe tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.259108 May 28 04:56:05.640393 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2634/5380] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:05 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:05.662780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5990cf2e-fda9-4366-ab7d-c66dc84dd146 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:05.666200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5990cf2e-fda9-4366-ab7d-c66dc84dd146 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:05.677295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5990cf2e-fda9-4366-ab7d-c66dc84dd146 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:05.678025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5990cf2e-fda9-4366-ab7d-c66dc84dd146 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:05.680520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5990cf2e-fda9-4366-ab7d-c66dc84dd146 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:05.682122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5990cf2e-fda9-4366-ab7d-c66dc84dd146 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:06.747050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5990cf2e-fda9-4366-ab7d-c66dc84dd146 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:06.758313 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5990cf2e-fda9-4366-ab7d-c66dc84dd146 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 1.101479 May 28 04:56:06.759106 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2747/5381] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:05 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:06.781258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f0e1f7cf-ad78-48b8-aed8-a506697592f7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:06.781853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f0e1f7cf-ad78-48b8-aed8-a506697592f7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:06.799311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0e1f7cf-ad78-48b8-aed8-a506697592f7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:06.802335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0e1f7cf-ad78-48b8-aed8-a506697592f7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:06.803414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0e1f7cf-ad78-48b8-aed8-a506697592f7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:06.806874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0e1f7cf-ad78-48b8-aed8-a506697592f7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:06.837790 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-f0e1f7cf-ad78-48b8-aed8-a506697592f7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Cannot 'unshelve' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state active May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f0e1f7cf-ad78-48b8-aed8-a506697592f7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action HTTP/1.1 May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 18 May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: {"unshelve": null} May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: exception: Cannot 'unshelve' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state active May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '58022ec6-f4eb-4564-bed0-c3edd1d0daf4', 'body': {'unshelve': None}} May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 in vm_state active. Cannot unshelve while the instance is in this state. May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state active May 28 04:56:06.841131 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:06.852526 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:06.852526 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:06.852526 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:06.852526 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:06.852526 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:06.852526 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:56:06.852526 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:56:06.852526 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state active May 28 04:56:06.852526 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:06.852526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f0e1f7cf-ad78-48b8-aed8-a506697592f7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 409 to user: Cannot 'unshelve' instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 while it is in vm_state active {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:56:06.852526 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f0e1f7cf-ad78-48b8-aed8-a506697592f7 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action" status: 409 len: 146 microversion: 2.1 time: 0.067673 May 28 04:56:06.852526 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2635/5382] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:56:06 2022] POST /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4/action => generated 146 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 04:56:06.855358 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-206140a7-3c1b-455e-92f0-f7f7e512123c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:06.856059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-206140a7-3c1b-455e-92f0-f7f7e512123c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:06.870961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-206140a7-3c1b-455e-92f0-f7f7e512123c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:06.871576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-206140a7-3c1b-455e-92f0-f7f7e512123c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:06.872508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-206140a7-3c1b-455e-92f0-f7f7e512123c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:06.874618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-206140a7-3c1b-455e-92f0-f7f7e512123c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:07.419865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-206140a7-3c1b-455e-92f0-f7f7e512123c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:07.428494 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-206140a7-3c1b-455e-92f0-f7f7e512123c tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.578835 May 28 04:56:07.429112 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2748/5383] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:06 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:07.447532 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1a748041-9bb4-45a1-9dbf-82bd843fedcb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:07.448155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1a748041-9bb4-45a1-9dbf-82bd843fedcb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:07.456632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a748041-9bb4-45a1-9dbf-82bd843fedcb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:07.458068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a748041-9bb4-45a1-9dbf-82bd843fedcb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:07.459233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a748041-9bb4-45a1-9dbf-82bd843fedcb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:07.459674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a748041-9bb4-45a1-9dbf-82bd843fedcb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:07.859888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1a748041-9bb4-45a1-9dbf-82bd843fedcb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:07.879333 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1a748041-9bb4-45a1-9dbf-82bd843fedcb tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.435409 May 28 04:56:07.884070 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2636/5384] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:07 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:07.907724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fe6984c7-61dd-41e3-b61b-63b641e25ef6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1087285048_updated"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:07.911192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fe6984c7-61dd-41e3-b61b-63b641e25ef6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: b1fbe9ef-0af5-4cce-b573-886c7dc014f7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:07.952705 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-fe6984c7-61dd-41e3-b61b-63b641e25ef6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance b1fbe9ef-0af5-4cce-b573-886c7dc014f7 could not be found. May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fe6984c7-61dd-41e3-b61b-63b641e25ef6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: request: PUT /compute/v2.1/servers/b1fbe9ef-0af5-4cce-b573-886c7dc014f7 HTTP/1.1 May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 81 May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1087285048_updated"}} May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance b1fbe9ef-0af5-4cce-b573-886c7dc014f7 could not be found. May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'b1fbe9ef-0af5-4cce-b573-886c7dc014f7', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1087285048_updated'}}} May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1fbe9ef-0af5-4cce-b573-886c7dc014f7 could not be found. May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) May 28 04:56:07.954101 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:56:07.957666 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:56:07.957666 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:56:07.957666 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:56:07.957666 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1fbe9ef-0af5-4cce-b573-886c7dc014f7 could not be found. May 28 04:56:07.957666 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:07.957666 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:07.957666 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:07.957666 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:07.957666 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:07.957666 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:07.957666 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:56:07.957666 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:56:07.957666 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1fbe9ef-0af5-4cce-b573-886c7dc014f7 could not be found. May 28 04:56:07.957666 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:07.957666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fe6984c7-61dd-41e3-b61b-63b641e25ef6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance b1fbe9ef-0af5-4cce-b573-886c7dc014f7 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:56:07.957666 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fe6984c7-61dd-41e3-b61b-63b641e25ef6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "PUT /compute/v2.1/servers/b1fbe9ef-0af5-4cce-b573-886c7dc014f7" status: 404 len: 111 microversion: 2.1 time: 0.057986 May 28 04:56:07.965530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-526a138f-2863-4516-96e8-7e50f5307571 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:07.966154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-526a138f-2863-4516-96e8-7e50f5307571 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:07.973037 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2749/5385] 10.222.0.58 () {60 vars in 1255 bytes} [Sat May 28 04:56:07 2022] PUT /compute/v2.1/servers/b1fbe9ef-0af5-4cce-b573-886c7dc014f7 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:56:07.973624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-526a138f-2863-4516-96e8-7e50f5307571 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:07.974080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-526a138f-2863-4516-96e8-7e50f5307571 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:07.975072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-526a138f-2863-4516-96e8-7e50f5307571 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:07.975692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-526a138f-2863-4516-96e8-7e50f5307571 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:08.346464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7c4ebb96-5297-4b19-92a8-b154de339647 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:08.347926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7c4ebb96-5297-4b19-92a8-b154de339647 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:08.364880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7c4ebb96-5297-4b19-92a8-b154de339647 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:08.367064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7c4ebb96-5297-4b19-92a8-b154de339647 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:08.368159 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7c4ebb96-5297-4b19-92a8-b154de339647 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:08.369092 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7c4ebb96-5297-4b19-92a8-b154de339647 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:08.409882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-7c4ebb96-5297-4b19-92a8-b154de339647 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lazy-loading 'flavor' on Instance uuid af197e5a-1493-44f1-ae5c-05fad352ed02 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:56:08.608083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-526a138f-2863-4516-96e8-7e50f5307571 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:08.619808 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-526a138f-2863-4516-96e8-7e50f5307571 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.658875 May 28 04:56:08.631984 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2637/5386] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:07 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:08.649746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3a0be937-6e14-40b7-9d6c-cd205113d70a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:08.652988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3a0be937-6e14-40b7-9d6c-cd205113d70a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:08.666880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a0be937-6e14-40b7-9d6c-cd205113d70a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:08.668822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a0be937-6e14-40b7-9d6c-cd205113d70a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:08.671989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a0be937-6e14-40b7-9d6c-cd205113d70a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:08.675273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a0be937-6e14-40b7-9d6c-cd205113d70a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:08.678551 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7c4ebb96-5297-4b19-92a8-b154de339647 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "POST /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02/action" status: 200 len: 32 microversion: 2.1 time: 0.338060 May 28 04:56:08.680468 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2750/5387] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:56:08 2022] POST /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02/action => generated 32 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:56:08.689255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3061f7ea-9ec0-4a4f-89ca-a42672ccb54a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:08.691903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3061f7ea-9ec0-4a4f-89ca-a42672ccb54a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:08.705470 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3061f7ea-9ec0-4a4f-89ca-a42672ccb54a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:08.710212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3061f7ea-9ec0-4a4f-89ca-a42672ccb54a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:08.711966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3061f7ea-9ec0-4a4f-89ca-a42672ccb54a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:08.712630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3061f7ea-9ec0-4a4f-89ca-a42672ccb54a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:09.644027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3061f7ea-9ec0-4a4f-89ca-a42672ccb54a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:09.660050 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3061f7ea-9ec0-4a4f-89ca-a42672ccb54a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1521 microversion: 2.1 time: 0.972496 May 28 04:56:09.660050 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2751/5388] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:08 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1521 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:56:09.664317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-176258c4-b4b8-4e26-91fa-71aa10e77799 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:09.665718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-176258c4-b4b8-4e26-91fa-71aa10e77799 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:09.672525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-176258c4-b4b8-4e26-91fa-71aa10e77799 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:09.673265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-176258c4-b4b8-4e26-91fa-71aa10e77799 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:09.674291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-176258c4-b4b8-4e26-91fa-71aa10e77799 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:09.674975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-176258c4-b4b8-4e26-91fa-71aa10e77799 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:09.680091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3a0be937-6e14-40b7-9d6c-cd205113d70a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:09.691817 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3a0be937-6e14-40b7-9d6c-cd205113d70a tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 1.050447 May 28 04:56:09.692405 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2638/5389] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:08 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:09.710747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5f6ee6b8-7793-4f33-b5ff-f2408a325523 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5f6ee6b8-7793-4f33-b5ff-f2408a325523 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: request: PUT /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 HTTP/1.1 May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 280 May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '58022ec6-f4eb-4564-bed0-c3edd1d0daf4', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:09.713379 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 04:56:09.717331 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:09.723899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5f6ee6b8-7793-4f33-b5ff-f2408a325523 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:56:09.725024 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5f6ee6b8-7793-4f33-b5ff-f2408a325523 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "PUT /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 400 len: 619 microversion: 2.1 time: 0.019470 May 28 04:56:09.725776 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2639/5390] 10.222.0.58 () {60 vars in 1256 bytes} [Sat May 28 04:56:09 2022] PUT /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 04:56:09.743548 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-176258c4-b4b8-4e26-91fa-71aa10e77799 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0/action" status: 200 len: 63221 microversion: 2.1 time: 0.083895 May 28 04:56:09.751343 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2752/5391] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:56:09 2022] POST /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0/action => generated 63221 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:56:09.751594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f7207ed4-a565-4363-8520-e0b26bc7fcb6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:09.751594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f7207ed4-a565-4363-8520-e0b26bc7fcb6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:09.766845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7207ed4-a565-4363-8520-e0b26bc7fcb6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:09.767674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7207ed4-a565-4363-8520-e0b26bc7fcb6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:09.768684 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7207ed4-a565-4363-8520-e0b26bc7fcb6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:09.769335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7207ed4-a565-4363-8520-e0b26bc7fcb6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:10.430114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f7207ed4-a565-4363-8520-e0b26bc7fcb6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:10.443119 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f7207ed4-a565-4363-8520-e0b26bc7fcb6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.708446 May 28 04:56:10.455497 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2640/5392] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:09 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:10.460821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-05b744c9-b91f-4faf-8a85-71c70365e0bf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:10.461542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-05b744c9-b91f-4faf-8a85-71c70365e0bf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:10.469905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05b744c9-b91f-4faf-8a85-71c70365e0bf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:10.470371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05b744c9-b91f-4faf-8a85-71c70365e0bf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:10.490816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05b744c9-b91f-4faf-8a85-71c70365e0bf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:10.492373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05b744c9-b91f-4faf-8a85-71c70365e0bf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:10.680382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-86eac994-3e8f-408a-b2ce-6c572093602e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:10.680382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-86eac994-3e8f-408a-b2ce-6c572093602e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:10.706192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-86eac994-3e8f-408a-b2ce-6c572093602e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:10.706662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-86eac994-3e8f-408a-b2ce-6c572093602e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:10.713005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-86eac994-3e8f-408a-b2ce-6c572093602e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:10.713005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-86eac994-3e8f-408a-b2ce-6c572093602e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:10.866204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-05b744c9-b91f-4faf-8a85-71c70365e0bf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:10.875527 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-05b744c9-b91f-4faf-8a85-71c70365e0bf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.418516 May 28 04:56:10.884446 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2753/5393] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:10 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:56:10.893686 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-76a856a8-96df-432b-bb50-9be5a530d2d6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-76a856a8-96df-432b-bb50-9be5a530d2d6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: request: PUT /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 HTTP/1.1 May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 24 May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: {"server": {"name": ""}} May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: exception: Invalid input for field/attribute name. Value: . '' is too short May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '58022ec6-f4eb-4564-bed0-c3edd1d0daf4', 'body': {'server': {'name': ''}}} May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise error May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi '' May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 04:56:10.906300 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 28 04:56:10.910259 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:10.910259 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:10.910259 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:10.910259 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:10.910259 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:10.910259 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:10.910259 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 04:56:10.910259 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 04:56:10.910259 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 28 04:56:10.910259 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:10.910259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-76a856a8-96df-432b-bb50-9be5a530d2d6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:56:10.910259 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-76a856a8-96df-432b-bb50-9be5a530d2d6 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "PUT /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 400 len: 108 microversion: 2.1 time: 0.018161 May 28 04:56:10.910259 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2754/5394] 10.222.0.58 () {60 vars in 1255 bytes} [Sat May 28 04:56:10 2022] PUT /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 04:56:10.924378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-940e0bd1-8a39-48a8-b50e-0451cb4219dd tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:10.925002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-940e0bd1-8a39-48a8-b50e-0451cb4219dd tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:10.953754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-940e0bd1-8a39-48a8-b50e-0451cb4219dd tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:10.957830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-940e0bd1-8a39-48a8-b50e-0451cb4219dd tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:10.958856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-940e0bd1-8a39-48a8-b50e-0451cb4219dd tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:10.961139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-940e0bd1-8a39-48a8-b50e-0451cb4219dd tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:11.377124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-86eac994-3e8f-408a-b2ce-6c572093602e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:11.388222 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-86eac994-3e8f-408a-b2ce-6c572093602e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1521 microversion: 2.1 time: 0.716736 May 28 04:56:11.389512 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2641/5395] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:10 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1521 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:11.646330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-940e0bd1-8a39-48a8-b50e-0451cb4219dd tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:11.660313 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-940e0bd1-8a39-48a8-b50e-0451cb4219dd tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1506 microversion: 2.1 time: 0.744506 May 28 04:56:11.675648 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2755/5396] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:10 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1506 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:56:12.410035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3ddf7bb7-3549-4170-a632-136c8fa0a4d3 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:12.410666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3ddf7bb7-3549-4170-a632-136c8fa0a4d3 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:12.421861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ddf7bb7-3549-4170-a632-136c8fa0a4d3 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:12.422325 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ddf7bb7-3549-4170-a632-136c8fa0a4d3 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:12.430223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ddf7bb7-3549-4170-a632-136c8fa0a4d3 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:12.431022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ddf7bb7-3549-4170-a632-136c8fa0a4d3 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:12.459910 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:56:12.460994 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 04:56:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 04:56:12.691451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3ddf7bb7-3549-4170-a632-136c8fa0a4d3 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:12.694034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:56:12.715938 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3ddf7bb7-3549-4170-a632-136c8fa0a4d3 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1521 microversion: 2.1 time: 0.314138 May 28 04:56:12.728238 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2642/5397] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:12 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:13.251156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e2adcab6-c511-4c9b-8139-251fb7f626b1 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:13.256342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e2adcab6-c511-4c9b-8139-251fb7f626b1 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:13.273109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2adcab6-c511-4c9b-8139-251fb7f626b1 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:13.273863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2adcab6-c511-4c9b-8139-251fb7f626b1 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:13.276352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2adcab6-c511-4c9b-8139-251fb7f626b1 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:13.278972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2adcab6-c511-4c9b-8139-251fb7f626b1 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:13.715117 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e2adcab6-c511-4c9b-8139-251fb7f626b1 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1834 microversion: 2.1 time: 1.018096 May 28 04:56:13.722597 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2756/5398] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:12 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1834 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:13.739676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5d4b68d3-f76d-4b02-adf9-1a90e1e798f2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:13.741078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5d4b68d3-f76d-4b02-adf9-1a90e1e798f2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:13.753236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d4b68d3-f76d-4b02-adf9-1a90e1e798f2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:13.756678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d4b68d3-f76d-4b02-adf9-1a90e1e798f2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:13.756678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d4b68d3-f76d-4b02-adf9-1a90e1e798f2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:13.761154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d4b68d3-f76d-4b02-adf9-1a90e1e798f2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:14.346582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5d4b68d3-f76d-4b02-adf9-1a90e1e798f2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:14.362461 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5d4b68d3-f76d-4b02-adf9-1a90e1e798f2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1521 microversion: 2.1 time: 0.622033 May 28 04:56:14.364290 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2643/5399] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:13 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1521 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:15.380098 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e90240c8-e5a7-4ef0-85fb-16c2a73f0409 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:15.380714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e90240c8-e5a7-4ef0-85fb-16c2a73f0409 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:15.406712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e90240c8-e5a7-4ef0-85fb-16c2a73f0409 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:15.409173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e90240c8-e5a7-4ef0-85fb-16c2a73f0409 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:15.418346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e90240c8-e5a7-4ef0-85fb-16c2a73f0409 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:15.418346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e90240c8-e5a7-4ef0-85fb-16c2a73f0409 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:16.188333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e90240c8-e5a7-4ef0-85fb-16c2a73f0409 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:16.208510 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e90240c8-e5a7-4ef0-85fb-16c2a73f0409 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1521 microversion: 2.1 time: 0.832983 May 28 04:56:16.213687 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2757/5400] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:15 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1521 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:17.230107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5a563182-23a1-4f9e-9e13-d247368becb5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:17.231768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5a563182-23a1-4f9e-9e13-d247368becb5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:17.256226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a563182-23a1-4f9e-9e13-d247368becb5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:17.258502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a563182-23a1-4f9e-9e13-d247368becb5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:17.261937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a563182-23a1-4f9e-9e13-d247368becb5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:17.266040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a563182-23a1-4f9e-9e13-d247368becb5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:17.792164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c8ce5ab4-78ce-43c0-9ee8-3a03e5be0e3d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:17.792813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c8ce5ab4-78ce-43c0-9ee8-3a03e5be0e3d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:17.815614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8ce5ab4-78ce-43c0-9ee8-3a03e5be0e3d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:17.817322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8ce5ab4-78ce-43c0-9ee8-3a03e5be0e3d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:17.823238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8ce5ab4-78ce-43c0-9ee8-3a03e5be0e3d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:17.825679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8ce5ab4-78ce-43c0-9ee8-3a03e5be0e3d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:17.917666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5a563182-23a1-4f9e-9e13-d247368becb5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:17.928725 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5a563182-23a1-4f9e-9e13-d247368becb5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1521 microversion: 2.1 time: 0.705227 May 28 04:56:17.929941 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2644/5401] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:17 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1521 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:17.949688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-ce23e280-6047-4dad-a883-4a666fb704df req-54da2371-5562-41e8-bd98-e190ce84c587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "260294eb-db79-4280-a534-928afd9312d0", "tag": "3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:17.955492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c8ce5ab4-78ce-43c0-9ee8-3a03e5be0e3d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:56:17.978181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ce23e280-6047-4dad-a883-4a666fb704df req-54da2371-5562-41e8-bd98-e190ce84c587 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:17.978633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ce23e280-6047-4dad-a883-4a666fb704df req-54da2371-5562-41e8-bd98-e190ce84c587 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:18.018738 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-ce23e280-6047-4dad-a883-4a666fb704df req-54da2371-5562-41e8-bd98-e190ce84c587 service nova] Creating event network-changed:3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0 for instance 260294eb-db79-4280-a534-928afd9312d0 on n-h2-843700-1 May 28 04:56:18.040997 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-ce23e280-6047-4dad-a883-4a666fb704df req-54da2371-5562-41e8-bd98-e190ce84c587 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109763 May 28 04:56:18.045307 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2645/5402] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:56:18.530178 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c8ce5ab4-78ce-43c0-9ee8-3a03e5be0e3d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "DELETE /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 204 len: 0 microversion: 2.1 time: 0.743356 May 28 04:56:18.531465 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2758/5403] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:56:17 2022] DELETE /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:56:18.540605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0f871e9e-7673-453f-b1c9-aee9ecd03427 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:18.541326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0f871e9e-7673-453f-b1c9-aee9ecd03427 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:18.560003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f871e9e-7673-453f-b1c9-aee9ecd03427 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:18.565555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f871e9e-7673-453f-b1c9-aee9ecd03427 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:18.566576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f871e9e-7673-453f-b1c9-aee9ecd03427 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:18.568009 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f871e9e-7673-453f-b1c9-aee9ecd03427 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:18.947957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-27a20694-47ff-40ae-85b2-1a98b8166b3b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:18.948662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-27a20694-47ff-40ae-85b2-1a98b8166b3b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:18.964125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27a20694-47ff-40ae-85b2-1a98b8166b3b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:18.964598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27a20694-47ff-40ae-85b2-1a98b8166b3b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:18.965521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27a20694-47ff-40ae-85b2-1a98b8166b3b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:18.965833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27a20694-47ff-40ae-85b2-1a98b8166b3b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:19.000453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0f871e9e-7673-453f-b1c9-aee9ecd03427 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:19.027559 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0f871e9e-7673-453f-b1c9-aee9ecd03427 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1689 microversion: 2.1 time: 0.477718 May 28 04:56:19.028280 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2646/5404] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:18 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1689 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:19.442776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-27a20694-47ff-40ae-85b2-1a98b8166b3b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:19.458492 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-27a20694-47ff-40ae-85b2-1a98b8166b3b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1521 microversion: 2.1 time: 0.512836 May 28 04:56:19.459484 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2759/5405] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:18 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1521 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:56:20.045756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ac3f7b23-2430-4613-8c3e-fba79b03a7d9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:20.047020 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ac3f7b23-2430-4613-8c3e-fba79b03a7d9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:20.081840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ac3f7b23-2430-4613-8c3e-fba79b03a7d9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:20.081840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ac3f7b23-2430-4613-8c3e-fba79b03a7d9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:20.087624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ac3f7b23-2430-4613-8c3e-fba79b03a7d9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:20.089568 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ac3f7b23-2430-4613-8c3e-fba79b03a7d9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:20.477490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-62c68386-1f4c-4452-9574-e3d6807892f7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:20.478271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-62c68386-1f4c-4452-9574-e3d6807892f7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:20.508084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-62c68386-1f4c-4452-9574-e3d6807892f7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:20.508847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-62c68386-1f4c-4452-9574-e3d6807892f7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:20.529927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-62c68386-1f4c-4452-9574-e3d6807892f7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:20.530520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-62c68386-1f4c-4452-9574-e3d6807892f7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:20.648670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ac3f7b23-2430-4613-8c3e-fba79b03a7d9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:20.666576 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ac3f7b23-2430-4613-8c3e-fba79b03a7d9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1689 microversion: 2.1 time: 0.624584 May 28 04:56:20.684491 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2647/5406] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:20 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1689 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:20.986106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-62c68386-1f4c-4452-9574-e3d6807892f7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:21.001722 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-62c68386-1f4c-4452-9574-e3d6807892f7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1521 microversion: 2.1 time: 0.522068 May 28 04:56:21.001722 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2760/5407] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:20 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1521 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:56:21.064600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-16bdafe7-58bc-462d-ad4c-cdffa77a721e tempest-ComputeTenantNetworksTest-54870722 tempest-ComputeTenantNetworksTest-54870722-project] Calling method '.version_select at 0x7f7700284e50>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:21.613655 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-16bdafe7-58bc-462d-ad4c-cdffa77a721e tempest-ComputeTenantNetworksTest-54870722 tempest-ComputeTenantNetworksTest-54870722-project] 10.222.0.58 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.816603 May 28 04:56:21.621491 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2648/5408] 10.222.0.58 () {58 vars in 1157 bytes} [Sat May 28 04:56:20 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:56:21.626182 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b93ca64d-2e34-433b-8b66-71c3cf8cc258 tempest-ComputeTenantNetworksTest-54870722 tempest-ComputeTenantNetworksTest-54870722-project] Calling method '.version_select at 0x7f7707423ee0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:21.691366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9fb71637-e682-4c0c-9f17-4fdde8b79471 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:21.693142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9fb71637-e682-4c0c-9f17-4fdde8b79471 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:21.695515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:56:21.708808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fb71637-e682-4c0c-9f17-4fdde8b79471 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:21.709842 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fb71637-e682-4c0c-9f17-4fdde8b79471 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:21.711652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fb71637-e682-4c0c-9f17-4fdde8b79471 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:21.715566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9fb71637-e682-4c0c-9f17-4fdde8b79471 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:21.804477 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b93ca64d-2e34-433b-8b66-71c3cf8cc258 tempest-ComputeTenantNetworksTest-54870722 tempest-ComputeTenantNetworksTest-54870722-project] 10.222.0.58 "GET /compute/v2.1/os-tenant-networks/d848bb3c-6e3c-4bde-91d0-e900da0a29ef" status: 200 len: 139 microversion: 2.1 time: 0.179553 May 28 04:56:21.804477 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2761/5409] 10.222.0.58 () {58 vars in 1268 bytes} [Sat May 28 04:56:21 2022] GET /compute/v2.1/os-tenant-networks/d848bb3c-6e3c-4bde-91d0-e900da0a29ef => generated 139 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:56:22.013584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef523d60-9715-4c87-9c19-387b72a40eb0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:22.014431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ef523d60-9715-4c87-9c19-387b72a40eb0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:22.022835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef523d60-9715-4c87-9c19-387b72a40eb0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:22.025485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef523d60-9715-4c87-9c19-387b72a40eb0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:22.029317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef523d60-9715-4c87-9c19-387b72a40eb0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:22.035806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef523d60-9715-4c87-9c19-387b72a40eb0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:22.093362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:56:22.141475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9fb71637-e682-4c0c-9f17-4fdde8b79471 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:22.152421 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9fb71637-e682-4c0c-9f17-4fdde8b79471 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 200 len: 1503 microversion: 2.1 time: 0.466109 May 28 04:56:22.153126 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2649/5410] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:21 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 1503 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:56:22.318949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-50f2dd9b-fb36-4526-ab97-1bf66ab52b84 req-1f2d96bc-b4a9-4918-a3bf-06206eb19f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260294eb-db79-4280-a534-928afd9312d0", "name": "network-vif-deleted", "tag": "3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:22.344943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-50f2dd9b-fb36-4526-ab97-1bf66ab52b84 req-1f2d96bc-b4a9-4918-a3bf-06206eb19f75 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:22.351682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-50f2dd9b-fb36-4526-ab97-1bf66ab52b84 req-1f2d96bc-b4a9-4918-a3bf-06206eb19f75 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:22.363027 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-50f2dd9b-fb36-4526-ab97-1bf66ab52b84 req-1f2d96bc-b4a9-4918-a3bf-06206eb19f75 service nova] Creating event network-vif-deleted:3d0fd757-667c-4ef7-8cc5-4ed0a165e0e0 for instance 260294eb-db79-4280-a534-928afd9312d0 on n-h2-843700-1 May 28 04:56:22.374272 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-50f2dd9b-fb36-4526-ab97-1bf66ab52b84 req-1f2d96bc-b4a9-4918-a3bf-06206eb19f75 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059234 May 28 04:56:22.376753 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2650/5411] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:56:23.172603 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-926ad687-08e3-4e8e-9a6c-3bf1778fa6cf tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:23.173618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-926ad687-08e3-4e8e-9a6c-3bf1778fa6cf tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 260294eb-db79-4280-a534-928afd9312d0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:23.190620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-926ad687-08e3-4e8e-9a6c-3bf1778fa6cf tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:23.191422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-926ad687-08e3-4e8e-9a6c-3bf1778fa6cf tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:23.192398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-926ad687-08e3-4e8e-9a6c-3bf1778fa6cf tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:23.193743 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-926ad687-08e3-4e8e-9a6c-3bf1778fa6cf tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:23.217921 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-926ad687-08e3-4e8e-9a6c-3bf1778fa6cf tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] HTTP exception thrown: Instance 260294eb-db79-4280-a534-928afd9312d0 could not be found. May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-926ad687-08e3-4e8e-9a6c-3bf1778fa6cf tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Request method failure captured: May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 HTTP/1.1 May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaoQYQchrh2XakGGrNw11ys5UQs4OXIf9xMNV-20af4LsMX_Su4KFUIfZemhe-Tzn-w4pVHjS_smiI_SiLygbVF215cZ7DSG83uVMXJbfi_bMltF9zMlgcj2MGtyWWf07NkL17iAcfEzeiladbpIl0-FrLXe9iLR4H4noFpN95vJXZI May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d14e7de3a28f42a79197e1c06c4676dd May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2101778381 May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d14e7de3a28f42a79197e1c06c4676dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d14e7de3a28f42a79197e1c06c4676dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d14e7de3a28f42a79197e1c06c4676dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d14e7de3a28f42a79197e1c06c4676dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2101778381 May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d14e7de3a28f42a79197e1c06c4676dd May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2101778381 May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestNetworkAdvancedServerOps-2101778381-project May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 82b17444b87742e1b45409810cbe06d2 May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2101778381-project May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 260294eb-db79-4280-a534-928afd9312d0 could not be found. May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '260294eb-db79-4280-a534-928afd9312d0'} May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 260294eb-db79-4280-a534-928afd9312d0 could not be found. May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 260294eb-db79-4280-a534-928afd9312d0 could not be found. May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:23.219954 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:23.224063 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:23.224063 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:23.224063 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:23.224063 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:23.224063 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:56:23.224063 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:56:23.224063 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 260294eb-db79-4280-a534-928afd9312d0 could not be found. May 28 04:56:23.224063 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:23.227250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-926ad687-08e3-4e8e-9a6c-3bf1778fa6cf tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Returning 404 to user: Instance 260294eb-db79-4280-a534-928afd9312d0 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:56:23.228448 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-926ad687-08e3-4e8e-9a6c-3bf1778fa6cf tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0" status: 404 len: 111 microversion: 2.1 time: 0.061939 May 28 04:56:23.229330 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2651/5412] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:23 2022] GET /compute/v2.1/servers/260294eb-db79-4280-a534-928afd9312d0 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:56:23.665081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef523d60-9715-4c87-9c19-387b72a40eb0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:23.673554 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ef523d60-9715-4c87-9c19-387b72a40eb0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1521 microversion: 2.1 time: 1.664306 May 28 04:56:23.679172 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2762/5413] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:22 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1521 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:24.696788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0f104135-4369-4f2d-9b48-de98d61d589c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:24.697611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0f104135-4369-4f2d-9b48-de98d61d589c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:24.708686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f104135-4369-4f2d-9b48-de98d61d589c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:24.714872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f104135-4369-4f2d-9b48-de98d61d589c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:24.715952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f104135-4369-4f2d-9b48-de98d61d589c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:24.716523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f104135-4369-4f2d-9b48-de98d61d589c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:25.428536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0f104135-4369-4f2d-9b48-de98d61d589c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:25.484830 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0f104135-4369-4f2d-9b48-de98d61d589c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1521 microversion: 2.1 time: 0.770700 May 28 04:56:25.486826 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2652/5414] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:24 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1521 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:26.505959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-11bb57a8-7aee-4988-929e-1ad5eaa8ce02 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:26.506652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-11bb57a8-7aee-4988-929e-1ad5eaa8ce02 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:26.525531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11bb57a8-7aee-4988-929e-1ad5eaa8ce02 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:26.526642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11bb57a8-7aee-4988-929e-1ad5eaa8ce02 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:26.527544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11bb57a8-7aee-4988-929e-1ad5eaa8ce02 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:26.528223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11bb57a8-7aee-4988-929e-1ad5eaa8ce02 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:27.271594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-11bb57a8-7aee-4988-929e-1ad5eaa8ce02 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:27.281634 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-11bb57a8-7aee-4988-929e-1ad5eaa8ce02 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1501 microversion: 2.1 time: 0.781407 May 28 04:56:27.286084 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2763/5415] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:26 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1501 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:27.309033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b72b393f-946a-40f5-9be5-3121fef9348c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94546e0a-efcc-4b0c-bdbb-b9346bbfeb56"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:27.310158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b72b393f-946a-40f5-9be5-3121fef9348c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:27.324317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b72b393f-946a-40f5-9be5-3121fef9348c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:27.327848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b72b393f-946a-40f5-9be5-3121fef9348c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:27.332785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b72b393f-946a-40f5-9be5-3121fef9348c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:27.332785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b72b393f-946a-40f5-9be5-3121fef9348c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:27.406453 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-b72b393f-946a-40f5-9be5-3121fef9348c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] HTTP exception thrown: Cannot 'attach_volume' instance af197e5a-1493-44f1-ae5c-05fad352ed02 while it is in vm_state rescued May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b72b393f-946a-40f5-9be5-3121fef9348c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Request method failure captured: May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02/os-volume_attachments HTTP/1.1 May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 74 May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaseTx-CUErJTvPPURHUDDZW_2xVLiNPRiy1eiv9_fcFy45c02JpQ6VvqCXLzIK18DfT6aHtEfhTBsOxiJEfEG-fv6OQ2f3JYTQWF_vNEb8rrFvp-Wh1TVJC4d-u-zkyoCZX0D4P_h38dgB9yzRPIskmXiQK2RKoPWvSUe713g1UiE0 May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: f043f5d6fc0a47429a445d8f25401570 May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: f043f5d6fc0a47429a445d8f25401570 May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerRescueNegativeTestJSON-1590365959-project May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 227be762b2bc4bbba6d3e3e9a1d28c9c May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1590365959-project May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: {"volumeAttachment": {"volumeId": "94546e0a-efcc-4b0c-bdbb-b9346bbfeb56"}} May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: exception: Cannot 'attach_volume' instance af197e5a-1493-44f1-ae5c-05fad352ed02 while it is in vm_state rescued May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'server_id': 'af197e5a-1493-44f1-ae5c-05fad352ed02', 'body': {'volumeAttachment': {'volumeId': '94546e0a-efcc-4b0c-bdbb-b9346bbfeb56'}}} May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance af197e5a-1493-44f1-ae5c-05fad352ed02 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 28 04:56:27.408026 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 04:56:27.411828 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 04:56:27.411828 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 04:56:27.411828 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance af197e5a-1493-44f1-ae5c-05fad352ed02 while it is in vm_state rescued May 28 04:56:27.411828 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:27.411828 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:27.411828 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:27.411828 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:27.411828 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:27.411828 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:27.411828 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:56:27.411828 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:56:27.411828 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance af197e5a-1493-44f1-ae5c-05fad352ed02 while it is in vm_state rescued May 28 04:56:27.411828 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:27.411828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b72b393f-946a-40f5-9be5-3121fef9348c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Returning 409 to user: Cannot 'attach_volume' instance af197e5a-1493-44f1-ae5c-05fad352ed02 while it is in vm_state rescued {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:56:27.411828 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b72b393f-946a-40f5-9be5-3121fef9348c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "POST /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.114750 May 28 04:56:27.418964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0c20137e-5e1a-46dc-91e5-00834e833234 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:27.419674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0c20137e-5e1a-46dc-91e5-00834e833234 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:27.429122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c20137e-5e1a-46dc-91e5-00834e833234 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:27.429743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c20137e-5e1a-46dc-91e5-00834e833234 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:27.432661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c20137e-5e1a-46dc-91e5-00834e833234 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:27.432952 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2653/5416] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 04:56:27 2022] POST /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02/os-volume_attachments => generated 152 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 04:56:27.433215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c20137e-5e1a-46dc-91e5-00834e833234 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:27.735485 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0c20137e-5e1a-46dc-91e5-00834e833234 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "POST /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02/action" status: 202 len: 0 microversion: 2.1 time: 0.319890 May 28 04:56:27.737067 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2764/5417] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:56:27 2022] POST /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:56:27.753588 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-61a16cb7-fb3b-44d2-850c-8500d9def169 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:27.756536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-61a16cb7-fb3b-44d2-850c-8500d9def169 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:27.772642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-61a16cb7-fb3b-44d2-850c-8500d9def169 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:27.779202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-61a16cb7-fb3b-44d2-850c-8500d9def169 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:27.780368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-61a16cb7-fb3b-44d2-850c-8500d9def169 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:27.782401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-61a16cb7-fb3b-44d2-850c-8500d9def169 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:28.490867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-61a16cb7-fb3b-44d2-850c-8500d9def169 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:28.507461 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-61a16cb7-fb3b-44d2-850c-8500d9def169 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1509 microversion: 2.1 time: 0.759824 May 28 04:56:28.508170 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2654/5418] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:27 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1509 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:29.037883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0948cddb-9227-4295-999d-e99135903fc2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:29.038356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0948cddb-9227-4295-999d-e99135903fc2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:29.047367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:56:29.051364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0948cddb-9227-4295-999d-e99135903fc2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:29.052236 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0948cddb-9227-4295-999d-e99135903fc2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:29.053302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0948cddb-9227-4295-999d-e99135903fc2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:29.054473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0948cddb-9227-4295-999d-e99135903fc2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:29.075539 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-0948cddb-9227-4295-999d-e99135903fc2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0948cddb-9227-4295-999d-e99135903fc2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 HTTP/1.1 May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90'} May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:56:29.077439 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:56:29.082875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:56:29.082875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:29.082875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:29.082875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:29.082875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:29.082875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:29.082875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:29.082875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:56:29.082875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:56:29.082875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:56:29.082875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:56:29.085130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0948cddb-9227-4295-999d-e99135903fc2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:56:29.086168 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0948cddb-9227-4295-999d-e99135903fc2 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 404 len: 111 microversion: 2.1 time: 0.053733 May 28 04:56:29.088708 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2765/5419] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:56:29 2022] DELETE /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:56:29.097352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8cf47d70-cc54-451f-a33c-b5f792725eb1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:29.098230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8cf47d70-cc54-451f-a33c-b5f792725eb1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:29.106264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cf47d70-cc54-451f-a33c-b5f792725eb1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:29.107038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cf47d70-cc54-451f-a33c-b5f792725eb1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:29.107986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cf47d70-cc54-451f-a33c-b5f792725eb1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:29.108608 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cf47d70-cc54-451f-a33c-b5f792725eb1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:29.181159 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-8cf47d70-cc54-451f-a33c-b5f792725eb1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8cf47d70-cc54-451f-a33c-b5f792725eb1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 HTTP/1.1 May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90'} May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:29.185403 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:29.189885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:29.189885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:29.189885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:29.189885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:56:29.189885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:56:29.189885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. May 28 04:56:29.189885 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:29.191171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8cf47d70-cc54-451f-a33c-b5f792725eb1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance 6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:56:29.194491 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8cf47d70-cc54-451f-a33c-b5f792725eb1 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90" status: 404 len: 111 microversion: 2.1 time: 0.100187 May 28 04:56:29.198165 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2655/5420] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:29 2022] GET /compute/v2.1/servers/6a31eaeb-b8aa-4ffc-8e54-a67cf6e8df90 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:56:29.205379 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e156f323-fc03-4e6c-b891-651e1b7eee6e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:29.206118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e156f323-fc03-4e6c-b891-651e1b7eee6e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:29.215496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e156f323-fc03-4e6c-b891-651e1b7eee6e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:29.216206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e156f323-fc03-4e6c-b891-651e1b7eee6e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:29.217177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e156f323-fc03-4e6c-b891-651e1b7eee6e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:29.220019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e156f323-fc03-4e6c-b891-651e1b7eee6e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:29.306377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e156f323-fc03-4e6c-b891-651e1b7eee6e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:56:29.527031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0d5ae2bb-be0b-4c0d-bf9f-563d070dc721 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:29.528008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0d5ae2bb-be0b-4c0d-bf9f-563d070dc721 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:29.544945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d5ae2bb-be0b-4c0d-bf9f-563d070dc721 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:29.550699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d5ae2bb-be0b-4c0d-bf9f-563d070dc721 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:29.555233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d5ae2bb-be0b-4c0d-bf9f-563d070dc721 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:29.556891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d5ae2bb-be0b-4c0d-bf9f-563d070dc721 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:29.677890 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e156f323-fc03-4e6c-b891-651e1b7eee6e tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "DELETE /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 204 len: 0 microversion: 2.1 time: 0.478047 May 28 04:56:29.679250 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2766/5421] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:56:29 2022] DELETE /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:56:29.689681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8008b715-c45e-41c4-ac69-b34125b474cf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:29.690788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8008b715-c45e-41c4-ac69-b34125b474cf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:29.704050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8008b715-c45e-41c4-ac69-b34125b474cf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:29.704893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8008b715-c45e-41c4-ac69-b34125b474cf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:29.707209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8008b715-c45e-41c4-ac69-b34125b474cf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:29.707865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8008b715-c45e-41c4-ac69-b34125b474cf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:30.369065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8008b715-c45e-41c4-ac69-b34125b474cf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:30.396684 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8008b715-c45e-41c4-ac69-b34125b474cf tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1512 microversion: 2.1 time: 0.712959 May 28 04:56:30.400107 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2767/5422] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:29 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1512 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:56:31.099342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0d5ae2bb-be0b-4c0d-bf9f-563d070dc721 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:31.108729 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0d5ae2bb-be0b-4c0d-bf9f-563d070dc721 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1509 microversion: 2.1 time: 1.586539 May 28 04:56:31.127703 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2656/5423] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:29 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1509 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:31.422091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-68a5b790-f8f0-4251-bf34-8eef0fe69f26 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:31.423560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-68a5b790-f8f0-4251-bf34-8eef0fe69f26 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:31.438854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68a5b790-f8f0-4251-bf34-8eef0fe69f26 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:31.441067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68a5b790-f8f0-4251-bf34-8eef0fe69f26 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:31.443219 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68a5b790-f8f0-4251-bf34-8eef0fe69f26 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:31.445420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68a5b790-f8f0-4251-bf34-8eef0fe69f26 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:31.962632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e4537893-13d4-4148-ba57-88a81e74d823 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '.version_select at 0x7f77002961f0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:32.086381 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e4537893-13d4-4148-ba57-88a81e74d823 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2044320799" status: 202 len: 0 microversion: 2.1 time: 0.128109 May 28 04:56:32.087463 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2657/5424] 10.222.0.58 () {58 vars in 1283 bytes} [Sat May 28 04:56:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2044320799 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 04:56:32.091151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-68a5b790-f8f0-4251-bf34-8eef0fe69f26 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:32.100042 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-68a5b790-f8f0-4251-bf34-8eef0fe69f26 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1512 microversion: 2.1 time: 0.681875 May 28 04:56:32.106449 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2768/5425] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:31 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1512 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:32.136789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a63387a0-9c0e-40c4-803d-9e6ea10d7be4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:32.138026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a63387a0-9c0e-40c4-803d-9e6ea10d7be4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:32.153437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-15170cb2-f983-41d7-a091-f1245e02a141 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'create', calling method: .version_select at 0x7f7707470ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-720682662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuNcGYpV0HgKAWB9YgpJp8WIhfDeEPwy7qpBq9shYGbkwHCBStVUJ9hf7IFEho6Lx5RbbyKA8OArJ4JwI4gtt7UafCBI4efsDCqocl2e2DwLzosKpK7tteW0VtPCnJXqA=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:32.162526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a63387a0-9c0e-40c4-803d-9e6ea10d7be4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:32.164867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a63387a0-9c0e-40c4-803d-9e6ea10d7be4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:32.169580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a63387a0-9c0e-40c4-803d-9e6ea10d7be4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:32.170238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a63387a0-9c0e-40c4-803d-9e6ea10d7be4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:32.210778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-15170cb2-f983-41d7-a091-f1245e02a141 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Getting quotas for project d14e7de3a28f42a79197e1c06c4676dd. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:56:32.230414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-15170cb2-f983-41d7-a091-f1245e02a141 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Getting quotas for user 82b17444b87742e1b45409810cbe06d2 and project d14e7de3a28f42a79197e1c06c4676dd. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:56:32.371211 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-15170cb2-f983-41d7-a091-f1245e02a141 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.229444 May 28 04:56:32.376591 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2769/5426] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:56:32 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:56:32.654128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a63387a0-9c0e-40c4-803d-9e6ea10d7be4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:32.664304 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a63387a0-9c0e-40c4-803d-9e6ea10d7be4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1509 microversion: 2.1 time: 0.531444 May 28 04:56:32.667151 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2658/5427] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:32 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1509 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:33.135175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bfb1a59d-c6d2-442c-83fa-d5998c6c8bc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:33.135808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bfb1a59d-c6d2-442c-83fa-d5998c6c8bc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:33.150668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfb1a59d-c6d2-442c-83fa-d5998c6c8bc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:33.151237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfb1a59d-c6d2-442c-83fa-d5998c6c8bc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:33.152221 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfb1a59d-c6d2-442c-83fa-d5998c6c8bc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:33.152671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfb1a59d-c6d2-442c-83fa-d5998c6c8bc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:33.686934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-44b0704b-5909-4cdd-ba9c-c0bc94a3419f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:33.687667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-44b0704b-5909-4cdd-ba9c-c0bc94a3419f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:33.703295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44b0704b-5909-4cdd-ba9c-c0bc94a3419f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:33.705600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44b0704b-5909-4cdd-ba9c-c0bc94a3419f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:33.706672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44b0704b-5909-4cdd-ba9c-c0bc94a3419f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:33.707544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44b0704b-5909-4cdd-ba9c-c0bc94a3419f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:33.977434 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bfb1a59d-c6d2-442c-83fa-d5998c6c8bc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:33.987891 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bfb1a59d-c6d2-442c-83fa-d5998c6c8bc3 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1512 microversion: 2.1 time: 0.866219 May 28 04:56:33.988508 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2770/5428] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:33 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1512 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:34.226557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-dae543e8-670f-447d-ba71-028258733850 req-c0ee9bbe-257b-4747-85f8-3a8eef1802e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58022ec6-f4eb-4564-bed0-c3edd1d0daf4", "name": "network-vif-deleted", "tag": "d2dc44c4-b245-41ae-bb82-8a262f7181c5"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:34.271607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-dae543e8-670f-447d-ba71-028258733850 req-c0ee9bbe-257b-4747-85f8-3a8eef1802e5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:34.271607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-dae543e8-670f-447d-ba71-028258733850 req-c0ee9bbe-257b-4747-85f8-3a8eef1802e5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:34.341861 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-dae543e8-670f-447d-ba71-028258733850 req-c0ee9bbe-257b-4747-85f8-3a8eef1802e5 service nova] Creating event network-vif-deleted:d2dc44c4-b245-41ae-bb82-8a262f7181c5 for instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 on n-h1-843700-1 May 28 04:56:34.367798 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-dae543e8-670f-447d-ba71-028258733850 req-c0ee9bbe-257b-4747-85f8-3a8eef1802e5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154466 May 28 04:56:34.374398 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2771/5429] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:56:34.406586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-44b0704b-5909-4cdd-ba9c-c0bc94a3419f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:34.434250 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-44b0704b-5909-4cdd-ba9c-c0bc94a3419f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1515 microversion: 2.1 time: 0.745933 May 28 04:56:34.441827 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2659/5430] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:33 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1515 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:35.015088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-08b5e315-a9f2-4ac2-b3dd-7fce44470456 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:35.015818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-08b5e315-a9f2-4ac2-b3dd-7fce44470456 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:35.031239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08b5e315-a9f2-4ac2-b3dd-7fce44470456 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:35.031767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08b5e315-a9f2-4ac2-b3dd-7fce44470456 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:35.032619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08b5e315-a9f2-4ac2-b3dd-7fce44470456 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:35.033057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08b5e315-a9f2-4ac2-b3dd-7fce44470456 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:35.092451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08b5e315-a9f2-4ac2-b3dd-7fce44470456 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:35.093029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08b5e315-a9f2-4ac2-b3dd-7fce44470456 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:35.093560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-08b5e315-a9f2-4ac2-b3dd-7fce44470456 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lazy-loading 'fault' on Instance uuid 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:56:35.265663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-08b5e315-a9f2-4ac2-b3dd-7fce44470456 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a79b183ba14d3c8674b9ac0ffca2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2092b676e36e4cb88f1e9ec9cf861b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:35.281298 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-08b5e315-a9f2-4ac2-b3dd-7fce44470456 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 200 len: 1307 microversion: 2.1 time: 0.275231 May 28 04:56:35.291575 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2772/5431] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:35 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 1307 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:36.302627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4d6063da-37e5-4475-b223-8f36dee58899 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:36.307250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4d6063da-37e5-4475-b223-8f36dee58899 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] [instance: 58022ec6-f4eb-4564-bed0-c3edd1d0daf4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:36.331733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d6063da-37e5-4475-b223-8f36dee58899 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:36.333932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d6063da-37e5-4475-b223-8f36dee58899 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:36.335821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d6063da-37e5-4475-b223-8f36dee58899 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:36.338490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d6063da-37e5-4475-b223-8f36dee58899 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:36.382443 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-4d6063da-37e5-4475-b223-8f36dee58899 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] HTTP exception thrown: Instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 could not be found. May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4d6063da-37e5-4475-b223-8f36dee58899 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Request method failure captured: May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 HTTP/1.1 May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaqURMRthPequJTg5Qqs-cVLMJCbxbW_I0Wx_EYNxJoFQo_vQ8nWu4tWdJ42Rg8KvjB_M4u089FvBYkPl20zP5bJL3aoSn63kQyFU_HBSPk65W7yxXEB58oe0x2WKqmmK2rDdvsuaQJ_uM9qir92JNTyn1Fe7Gb6QyGlW0ZK6qy-8eY May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2092b676e36e4cb88f1e9ec9cf861b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 2092b676e36e4cb88f1e9ec9cf861b1a May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-972883349 May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-972883349-project May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24a79b183ba14d3c8674b9ac0ffca2b3 May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-972883349-project May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 could not be found. May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '58022ec6-f4eb-4564-bed0-c3edd1d0daf4'} May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 could not be found. May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 could not be found. May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:56:36.384247 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:36.391941 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:56:36.391941 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:56:36.391941 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:56:36.391941 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:56:36.391941 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:56:36.391941 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 could not be found. May 28 04:56:36.391941 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:56:36.391941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4d6063da-37e5-4475-b223-8f36dee58899 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] Returning 404 to user: Instance 58022ec6-f4eb-4564-bed0-c3edd1d0daf4 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:56:36.391941 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4d6063da-37e5-4475-b223-8f36dee58899 tempest-ServersNegativeTestJSON-972883349 tempest-ServersNegativeTestJSON-972883349-project] 10.222.0.58 "GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4" status: 404 len: 111 microversion: 2.1 time: 0.093045 May 28 04:56:36.391941 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2660/5432] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:36 2022] GET /compute/v2.1/servers/58022ec6-f4eb-4564-bed0-c3edd1d0daf4 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:56:39.919934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6ee57ada-68f5-4807-bdb3-cff79e3a9a70 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Action: 'create', calling method: .version_select at 0x7f77075b3280>, body: {"keypair": {"name": "tempest-keypair-592305767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzJBRzsJ5yZFvUmImSjIAaBh5Ay/4RgBvMgmzZWRoar2k2O8vf7ixxVV2cTLTuIHeikCPluuE7Yw2FMTwiVstTrcPj+1jl92I2QWhdCx0S6Uy9TuYEXg86+K1gsUvUOxg=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:39.948169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-6ee57ada-68f5-4807-bdb3-cff79e3a9a70 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Getting quotas for project f043f5d6fc0a47429a445d8f25401570. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:56:39.978204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-6ee57ada-68f5-4807-bdb3-cff79e3a9a70 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Getting quotas for user 227be762b2bc4bbba6d3e3e9a1d28c9c and project f043f5d6fc0a47429a445d8f25401570. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:56:40.081775 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6ee57ada-68f5-4807-bdb3-cff79e3a9a70 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.161013 May 28 04:56:40.081775 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2773/5433] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:56:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:56:46.883671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ba81f775-ce15-4278-b104-f6458c0dd993 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-321554188", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d63ab384-ad3a-43f9-a13d-6556ad80eb46"}], "security_groups": [{"name": "tempest-securitygroup--1554264330"}], "key_name": "tempest-keypair-592305767", "user_data": "}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:46.905737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:56:46.906425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=75 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:56:47.614388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-ba81f775-ce15-4278-b104-f6458c0dd993 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] validate_networks() for [('d63ab384-ad3a-43f9-a13d-6556ad80eb46', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:56:47.998462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6ee57ada-68f5-4807-bdb3-cff79e3a9a70 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:47.999659 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6ee57ada-68f5-4807-bdb3-cff79e3a9a70 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001531 May 28 04:56:48.000014 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2774/5434] 10.222.0.58 () {56 vars in 885 bytes} [Sat May 28 04:56:47 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 28 04:56:49.213927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-ba81f775-ce15-4278-b104-f6458c0dd993 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:56:49.214448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-ba81f775-ce15-4278-b104-f6458c0dd993 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:56:49.215106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-ba81f775-ce15-4278-b104-f6458c0dd993 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:56:49.215618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-ba81f775-ce15-4278-b104-f6458c0dd993 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:56:49.216143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-ba81f775-ce15-4278-b104-f6458c0dd993 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:56:49.236715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba81f775-ce15-4278-b104-f6458c0dd993 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:49.242196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba81f775-ce15-4278-b104-f6458c0dd993 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:49.243545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba81f775-ce15-4278-b104-f6458c0dd993 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:49.244842 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba81f775-ce15-4278-b104-f6458c0dd993 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:49.275325 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-ba81f775-ce15-4278-b104-f6458c0dd993 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Getting quotas for project f043f5d6fc0a47429a445d8f25401570. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:56:49.283880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-ba81f775-ce15-4278-b104-f6458c0dd993 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Getting quotas for user 227be762b2bc4bbba6d3e3e9a1d28c9c and project f043f5d6fc0a47429a445d8f25401570. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:56:49.300338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ba81f775-ce15-4278-b104-f6458c0dd993 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:56:49.304396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ba81f775-ce15-4278-b104-f6458c0dd993 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:56:49.466338 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ba81f775-ce15-4278-b104-f6458c0dd993 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.588773 May 28 04:56:49.470205 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2661/5435] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:56:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 2593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:56:49.484421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-47ad6c9c-98bf-4864-b91c-dc1050045bc7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:49.485087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-47ad6c9c-98bf-4864-b91c-dc1050045bc7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:49.494760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:56:49.894841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-47ad6c9c-98bf-4864-b91c-dc1050045bc7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:49.922753 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-47ad6c9c-98bf-4864-b91c-dc1050045bc7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1244 microversion: 2.1 time: 0.446161 May 28 04:56:49.927671 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2775/5436] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:49 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1244 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:50.947987 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fe8472a1-8567-4cc1-87b0-6920fd630f5f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:50.947987 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fe8472a1-8567-4cc1-87b0-6920fd630f5f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:51.168681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fe8472a1-8567-4cc1-87b0-6920fd630f5f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:51.183967 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fe8472a1-8567-4cc1-87b0-6920fd630f5f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1244 microversion: 2.1 time: 0.240749 May 28 04:56:51.184665 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2662/5437] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:50 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1244 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:52.202200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-55958355-fea2-4098-8f34-83c14a27a113 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:52.203498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-55958355-fea2-4098-8f34-83c14a27a113 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:52.213406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55958355-fea2-4098-8f34-83c14a27a113 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:52.214120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55958355-fea2-4098-8f34-83c14a27a113 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:52.219078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55958355-fea2-4098-8f34-83c14a27a113 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:52.219868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-55958355-fea2-4098-8f34-83c14a27a113 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:52.411521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-55958355-fea2-4098-8f34-83c14a27a113 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:52.423606 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-55958355-fea2-4098-8f34-83c14a27a113 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1296 microversion: 2.1 time: 0.224195 May 28 04:56:52.435774 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2776/5438] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:52 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1296 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:53.531166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cce55fa6-9432-4a44-85e0-a9295fe7da25 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:53.531166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cce55fa6-9432-4a44-85e0-a9295fe7da25 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:53.531166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cce55fa6-9432-4a44-85e0-a9295fe7da25 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:53.531166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cce55fa6-9432-4a44-85e0-a9295fe7da25 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:53.531166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cce55fa6-9432-4a44-85e0-a9295fe7da25 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:53.531166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cce55fa6-9432-4a44-85e0-a9295fe7da25 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:53.603132 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cce55fa6-9432-4a44-85e0-a9295fe7da25 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:53.620888 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cce55fa6-9432-4a44-85e0-a9295fe7da25 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1302 microversion: 2.1 time: 0.180691 May 28 04:56:53.633748 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2663/5439] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:53 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1302 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:54.641268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1436bf31-f04a-4d41-84ab-01cf4fd9f892 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:54.641901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1436bf31-f04a-4d41-84ab-01cf4fd9f892 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:54.650270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1436bf31-f04a-4d41-84ab-01cf4fd9f892 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:54.659140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1436bf31-f04a-4d41-84ab-01cf4fd9f892 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:54.660365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1436bf31-f04a-4d41-84ab-01cf4fd9f892 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:54.663355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1436bf31-f04a-4d41-84ab-01cf4fd9f892 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:54.879752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1436bf31-f04a-4d41-84ab-01cf4fd9f892 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:54.894385 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1436bf31-f04a-4d41-84ab-01cf4fd9f892 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1302 microversion: 2.1 time: 0.257065 May 28 04:56:54.896009 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2777/5440] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:54 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1302 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:55.916611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-23e87513-ec3e-4271-8e47-9c77ec3ee5b7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:55.917810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-23e87513-ec3e-4271-8e47-9c77ec3ee5b7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:55.928009 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23e87513-ec3e-4271-8e47-9c77ec3ee5b7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:55.935148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23e87513-ec3e-4271-8e47-9c77ec3ee5b7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:55.935148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23e87513-ec3e-4271-8e47-9c77ec3ee5b7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:55.935148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23e87513-ec3e-4271-8e47-9c77ec3ee5b7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:56.358592 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-23e87513-ec3e-4271-8e47-9c77ec3ee5b7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:56.371512 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-23e87513-ec3e-4271-8e47-9c77ec3ee5b7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1370 microversion: 2.1 time: 0.462044 May 28 04:56:56.383217 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2664/5441] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:55 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1370 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:57.393369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4af16e2b-f2e5-4792-ace8-ccd08bc1da33 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:57.393961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4af16e2b-f2e5-4792-ace8-ccd08bc1da33 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:57.411065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4af16e2b-f2e5-4792-ace8-ccd08bc1da33 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:57.416050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4af16e2b-f2e5-4792-ace8-ccd08bc1da33 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:57.417240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4af16e2b-f2e5-4792-ace8-ccd08bc1da33 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:57.417853 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4af16e2b-f2e5-4792-ace8-ccd08bc1da33 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:58.006305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4af16e2b-f2e5-4792-ace8-ccd08bc1da33 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:56:58.006305 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4af16e2b-f2e5-4792-ace8-ccd08bc1da33 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1370 microversion: 2.1 time: 0.595254 May 28 04:56:58.006305 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2778/5442] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:57 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1370 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:56:58.704345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a876d5c5-c69d-4f2d-8b65-29dc3fcd0ad5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1270462422", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "ebc2398e-22d6-4305-ad0d-ca61b792458c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-720682662", "security_groups": [{"name": "tempest-secgroup-smoke-88773862"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:56:59.037807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-a876d5c5-c69d-4f2d-8b65-29dc3fcd0ad5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] validate_networks() for [('ebc2398e-22d6-4305-ad0d-ca61b792458c', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:56:59.045013 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0cbbff51-dbce-4230-9d03-89b7a058c266 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:56:59.045673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0cbbff51-dbce-4230-9d03-89b7a058c266 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:56:59.056997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0cbbff51-dbce-4230-9d03-89b7a058c266 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:59.057410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0cbbff51-dbce-4230-9d03-89b7a058c266 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:59.058199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0cbbff51-dbce-4230-9d03-89b7a058c266 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:56:59.059614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0cbbff51-dbce-4230-9d03-89b7a058c266 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:56:59.259240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:56:59.903717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=10 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:56:59.989176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0cbbff51-dbce-4230-9d03-89b7a058c266 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:00.002593 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0cbbff51-dbce-4230-9d03-89b7a058c266 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1370 microversion: 2.1 time: 0.962553 May 28 04:57:00.009302 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2779/5443] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:56:59 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1370 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:57:00.037444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-f7129093-3f80-439e-a9c5-2a793fcaad92 req-35508af5-1819-4655-ba48-f072c4a5e1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9317fed-13ab-4242-843f-ef74497895e1", "tag": "d288a5a0-3ba2-4f53-8886-2642d079bc88"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:57:00.054704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:57:00.084246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f7129093-3f80-439e-a9c5-2a793fcaad92 req-35508af5-1819-4655-ba48-f072c4a5e1f3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:00.087080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f7129093-3f80-439e-a9c5-2a793fcaad92 req-35508af5-1819-4655-ba48-f072c4a5e1f3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:00.110616 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-f7129093-3f80-439e-a9c5-2a793fcaad92 req-35508af5-1819-4655-ba48-f072c4a5e1f3 service nova] Creating event network-changed:d288a5a0-3ba2-4f53-8886-2642d079bc88 for instance d9317fed-13ab-4242-843f-ef74497895e1 on n-h2-843700-1 May 28 04:57:00.118453 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-f7129093-3f80-439e-a9c5-2a793fcaad92 req-35508af5-1819-4655-ba48-f072c4a5e1f3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107442 May 28 04:57:00.119709 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2780/5444] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:57:00.665117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a876d5c5-c69d-4f2d-8b65-29dc3fcd0ad5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:57:00.665574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a876d5c5-c69d-4f2d-8b65-29dc3fcd0ad5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:57:00.666016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a876d5c5-c69d-4f2d-8b65-29dc3fcd0ad5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:57:00.666431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a876d5c5-c69d-4f2d-8b65-29dc3fcd0ad5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:57:00.666852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a876d5c5-c69d-4f2d-8b65-29dc3fcd0ad5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:57:00.683062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a876d5c5-c69d-4f2d-8b65-29dc3fcd0ad5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:00.686561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a876d5c5-c69d-4f2d-8b65-29dc3fcd0ad5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:00.688442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a876d5c5-c69d-4f2d-8b65-29dc3fcd0ad5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:00.695133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a876d5c5-c69d-4f2d-8b65-29dc3fcd0ad5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:00.733688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-a876d5c5-c69d-4f2d-8b65-29dc3fcd0ad5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Getting quotas for project d14e7de3a28f42a79197e1c06c4676dd. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:57:00.748971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-a876d5c5-c69d-4f2d-8b65-29dc3fcd0ad5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Getting quotas for user 82b17444b87742e1b45409810cbe06d2 and project d14e7de3a28f42a79197e1c06c4676dd. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:57:00.796184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a876d5c5-c69d-4f2d-8b65-29dc3fcd0ad5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:57:00.807277 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a876d5c5-c69d-4f2d-8b65-29dc3fcd0ad5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:57:01.025156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2d02c232-0925-48c9-a153-a09d2411271a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:01.026097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2d02c232-0925-48c9-a153-a09d2411271a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:01.035730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d02c232-0925-48c9-a153-a09d2411271a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:01.036309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d02c232-0925-48c9-a153-a09d2411271a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:01.037883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d02c232-0925-48c9-a153-a09d2411271a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:01.038431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d02c232-0925-48c9-a153-a09d2411271a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:01.245294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2d02c232-0925-48c9-a153-a09d2411271a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:01.256814 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2d02c232-0925-48c9-a153-a09d2411271a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1370 microversion: 2.1 time: 0.236813 May 28 04:57:01.257432 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2781/5445] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:01 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1370 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:57:01.906667 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a876d5c5-c69d-4f2d-8b65-29dc3fcd0ad5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 3.210022 May 28 04:57:01.914247 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2665/5446] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:56:58 2022] POST /compute/v2.1/servers => generated 404 bytes in 3219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:57:01.917920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a12faabb-eb72-4377-96d2-00366ea09b1e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:01.918817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a12faabb-eb72-4377-96d2-00366ea09b1e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:02.077805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a12faabb-eb72-4377-96d2-00366ea09b1e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:02.129747 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a12faabb-eb72-4377-96d2-00366ea09b1e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1266 microversion: 2.1 time: 0.178802 May 28 04:57:02.131534 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2782/5447] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:01 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:57:02.280979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2f444116-8dc3-4c2f-964d-e1670e91b015 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:02.281616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2f444116-8dc3-4c2f-964d-e1670e91b015 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:02.303810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f444116-8dc3-4c2f-964d-e1670e91b015 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:02.304282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f444116-8dc3-4c2f-964d-e1670e91b015 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:02.305717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f444116-8dc3-4c2f-964d-e1670e91b015 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:02.306167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f444116-8dc3-4c2f-964d-e1670e91b015 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:02.625913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2f444116-8dc3-4c2f-964d-e1670e91b015 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:02.643066 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2f444116-8dc3-4c2f-964d-e1670e91b015 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1370 microversion: 2.1 time: 0.363872 May 28 04:57:02.644516 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2666/5448] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:02 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1370 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:03.146902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ca747591-3402-49ac-bbe8-48463495b067 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:03.147547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ca747591-3402-49ac-bbe8-48463495b067 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:03.283664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ca747591-3402-49ac-bbe8-48463495b067 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:03.293318 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ca747591-3402-49ac-bbe8-48463495b067 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1266 microversion: 2.1 time: 0.150111 May 28 04:57:03.306306 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2783/5449] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:03 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:03.665378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4c150ddc-3c7e-44d7-947f-b1f0e1b27650 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:03.685793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4c150ddc-3c7e-44d7-947f-b1f0e1b27650 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:03.685793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c150ddc-3c7e-44d7-947f-b1f0e1b27650 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:03.685793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c150ddc-3c7e-44d7-947f-b1f0e1b27650 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:03.687520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c150ddc-3c7e-44d7-947f-b1f0e1b27650 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:03.688918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c150ddc-3c7e-44d7-947f-b1f0e1b27650 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:04.004879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4c150ddc-3c7e-44d7-947f-b1f0e1b27650 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:04.022885 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4c150ddc-3c7e-44d7-947f-b1f0e1b27650 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1370 microversion: 2.1 time: 0.365788 May 28 04:57:04.024716 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2667/5450] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:03 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1370 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:04.316198 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1e33f1a9-5df6-4b75-83f0-9cedf820d639 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:04.320217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1e33f1a9-5df6-4b75-83f0-9cedf820d639 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:04.339691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e33f1a9-5df6-4b75-83f0-9cedf820d639 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:04.341222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e33f1a9-5df6-4b75-83f0-9cedf820d639 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:04.343382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e33f1a9-5df6-4b75-83f0-9cedf820d639 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:04.345393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e33f1a9-5df6-4b75-83f0-9cedf820d639 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:04.479661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1e33f1a9-5df6-4b75-83f0-9cedf820d639 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:04.494904 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1e33f1a9-5df6-4b75-83f0-9cedf820d639 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1318 microversion: 2.1 time: 0.184309 May 28 04:57:04.496801 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2784/5451] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:04 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:05.042777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fcb98943-b735-4883-b56d-0d25ece510a6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:05.043438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fcb98943-b735-4883-b56d-0d25ece510a6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:05.054858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcb98943-b735-4883-b56d-0d25ece510a6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:05.057958 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcb98943-b735-4883-b56d-0d25ece510a6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:05.059083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcb98943-b735-4883-b56d-0d25ece510a6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:05.062632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcb98943-b735-4883-b56d-0d25ece510a6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:05.275129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fcb98943-b735-4883-b56d-0d25ece510a6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:05.283848 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fcb98943-b735-4883-b56d-0d25ece510a6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1370 microversion: 2.1 time: 0.246330 May 28 04:57:05.293142 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2668/5452] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:05 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1370 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:05.519867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6c89845f-9f98-4cb1-98dd-23aea11a2903 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:05.521142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6c89845f-9f98-4cb1-98dd-23aea11a2903 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:05.535387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c89845f-9f98-4cb1-98dd-23aea11a2903 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:05.536131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c89845f-9f98-4cb1-98dd-23aea11a2903 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:05.537154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c89845f-9f98-4cb1-98dd-23aea11a2903 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:05.537767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c89845f-9f98-4cb1-98dd-23aea11a2903 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:05.656535 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6c89845f-9f98-4cb1-98dd-23aea11a2903 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:05.668573 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6c89845f-9f98-4cb1-98dd-23aea11a2903 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1324 microversion: 2.1 time: 0.152506 May 28 04:57:05.685612 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2785/5453] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:05 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1324 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:06.305872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e0afce55-466f-454e-af79-18a7c368e91f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:06.308900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e0afce55-466f-454e-af79-18a7c368e91f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:06.319267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0afce55-466f-454e-af79-18a7c368e91f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:06.323347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0afce55-466f-454e-af79-18a7c368e91f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:06.324553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0afce55-466f-454e-af79-18a7c368e91f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:06.325394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0afce55-466f-454e-af79-18a7c368e91f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:06.460935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-29355c55-1f24-49e2-9da5-4ad7490ecec3 req-7e4c2c75-eb39-4b90-9f34-920fcdb3ed93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9317fed-13ab-4242-843f-ef74497895e1", "name": "network-vif-plugged", "status": "completed", "tag": "d288a5a0-3ba2-4f53-8886-2642d079bc88"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:57:06.474583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-29355c55-1f24-49e2-9da5-4ad7490ecec3 req-7e4c2c75-eb39-4b90-9f34-920fcdb3ed93 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:06.480246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-29355c55-1f24-49e2-9da5-4ad7490ecec3 req-7e4c2c75-eb39-4b90-9f34-920fcdb3ed93 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:06.495143 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-29355c55-1f24-49e2-9da5-4ad7490ecec3 req-7e4c2c75-eb39-4b90-9f34-920fcdb3ed93 service nova] Creating event network-vif-plugged:d288a5a0-3ba2-4f53-8886-2642d079bc88 for instance d9317fed-13ab-4242-843f-ef74497895e1 on n-h2-843700-1 May 28 04:57:06.501016 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-29355c55-1f24-49e2-9da5-4ad7490ecec3 req-7e4c2c75-eb39-4b90-9f34-920fcdb3ed93 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043319 May 28 04:57:06.527472 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2786/5454] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:57:06.702470 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0c74a7c6-dd7b-4a6e-8f60-565e2c0634b9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:06.704240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0c74a7c6-dd7b-4a6e-8f60-565e2c0634b9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:06.723041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c74a7c6-dd7b-4a6e-8f60-565e2c0634b9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:06.723518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c74a7c6-dd7b-4a6e-8f60-565e2c0634b9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:06.729627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c74a7c6-dd7b-4a6e-8f60-565e2c0634b9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:06.732743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c74a7c6-dd7b-4a6e-8f60-565e2c0634b9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:06.851824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0c74a7c6-dd7b-4a6e-8f60-565e2c0634b9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:06.861390 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0c74a7c6-dd7b-4a6e-8f60-565e2c0634b9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1324 microversion: 2.1 time: 0.163578 May 28 04:57:06.872762 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2787/5455] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:06 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1324 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:57:06.904581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e0afce55-466f-454e-af79-18a7c368e91f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:06.921924 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e0afce55-466f-454e-af79-18a7c368e91f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1370 microversion: 2.1 time: 0.619639 May 28 04:57:06.922512 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2669/5456] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:06 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1370 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:07.877673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-407cbe57-9900-487c-864a-725293edeec6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:07.878392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-407cbe57-9900-487c-864a-725293edeec6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:07.890858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-407cbe57-9900-487c-864a-725293edeec6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:07.891370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-407cbe57-9900-487c-864a-725293edeec6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:07.892173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-407cbe57-9900-487c-864a-725293edeec6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:07.902050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-407cbe57-9900-487c-864a-725293edeec6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:07.940369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-65aa1492-24b3-42b4-83f1-4283dee9ee3c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:07.941606 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-65aa1492-24b3-42b4-83f1-4283dee9ee3c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:07.956008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65aa1492-24b3-42b4-83f1-4283dee9ee3c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:07.956726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65aa1492-24b3-42b4-83f1-4283dee9ee3c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:07.957705 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65aa1492-24b3-42b4-83f1-4283dee9ee3c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:07.959714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65aa1492-24b3-42b4-83f1-4283dee9ee3c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:08.556553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-407cbe57-9900-487c-864a-725293edeec6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:08.572041 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-407cbe57-9900-487c-864a-725293edeec6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1390 microversion: 2.1 time: 0.698182 May 28 04:57:08.574861 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2788/5457] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:07 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1390 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:08.651589 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-65aa1492-24b3-42b4-83f1-4283dee9ee3c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:08.666683 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-65aa1492-24b3-42b4-83f1-4283dee9ee3c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1370 microversion: 2.1 time: 0.730086 May 28 04:57:08.669804 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2670/5458] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:07 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1370 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:09.507344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-de6245e6-2552-4059-9f78-c4b108896d50 req-70f37517-af06-4823-b49a-39f954b38dba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cb86d59-cc4a-4fa1-a3e2-07d535ddb044", "tag": "c98c716b-3208-4e40-870a-b2c59f465c7c"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:57:09.523137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-de6245e6-2552-4059-9f78-c4b108896d50 req-70f37517-af06-4823-b49a-39f954b38dba service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:09.523609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-de6245e6-2552-4059-9f78-c4b108896d50 req-70f37517-af06-4823-b49a-39f954b38dba service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:09.545067 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-de6245e6-2552-4059-9f78-c4b108896d50 req-70f37517-af06-4823-b49a-39f954b38dba service nova] Creating event network-changed:c98c716b-3208-4e40-870a-b2c59f465c7c for instance 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 on n-h1-843700-1 May 28 04:57:09.554463 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-de6245e6-2552-4059-9f78-c4b108896d50 req-70f37517-af06-4823-b49a-39f954b38dba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050915 May 28 04:57:09.555366 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2789/5459] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:57:09.592772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7654d994-a98c-4b00-9f33-c8c7c0f1f40f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:09.594318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7654d994-a98c-4b00-9f33-c8c7c0f1f40f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:09.608652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7654d994-a98c-4b00-9f33-c8c7c0f1f40f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:09.610146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7654d994-a98c-4b00-9f33-c8c7c0f1f40f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:09.611908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7654d994-a98c-4b00-9f33-c8c7c0f1f40f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:09.613678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7654d994-a98c-4b00-9f33-c8c7c0f1f40f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:09.688810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f3a95fc9-8098-4666-882e-a6afc7e9f8cd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:09.692771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f3a95fc9-8098-4666-882e-a6afc7e9f8cd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:09.721740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f3a95fc9-8098-4666-882e-a6afc7e9f8cd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:09.722239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f3a95fc9-8098-4666-882e-a6afc7e9f8cd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:09.725972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f3a95fc9-8098-4666-882e-a6afc7e9f8cd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:09.726472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f3a95fc9-8098-4666-882e-a6afc7e9f8cd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:10.567038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7654d994-a98c-4b00-9f33-c8c7c0f1f40f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:10.584621 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7654d994-a98c-4b00-9f33-c8c7c0f1f40f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1390 microversion: 2.1 time: 0.996730 May 28 04:57:10.585911 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2671/5460] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:09 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1390 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:10.622144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f3a95fc9-8098-4666-882e-a6afc7e9f8cd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:10.631566 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f3a95fc9-8098-4666-882e-a6afc7e9f8cd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1563 microversion: 2.1 time: 0.948815 May 28 04:57:10.636081 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2790/5461] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:09 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1563 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:10.656466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2bb07986-b3ba-4882-91aa-f9999cee3c72 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:10.657610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2bb07986-b3ba-4882-91aa-f9999cee3c72 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:10.668369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2bb07986-b3ba-4882-91aa-f9999cee3c72 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:10.679291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2bb07986-b3ba-4882-91aa-f9999cee3c72 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:10.680613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2bb07986-b3ba-4882-91aa-f9999cee3c72 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:10.681261 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2bb07986-b3ba-4882-91aa-f9999cee3c72 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:10.737547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:57:10.774753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=14 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:57:10.895206 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2bb07986-b3ba-4882-91aa-f9999cee3c72 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.243145 May 28 04:57:10.896737 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2672/5462] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 04:57:10 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-interface => generated 284 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:57:11.602324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-352730e3-c5b4-467c-b2f9-0ad1bf5b9a69 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:11.603406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-352730e3-c5b4-467c-b2f9-0ad1bf5b9a69 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:11.610538 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-352730e3-c5b4-467c-b2f9-0ad1bf5b9a69 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:11.623598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-352730e3-c5b4-467c-b2f9-0ad1bf5b9a69 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:11.623598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-352730e3-c5b4-467c-b2f9-0ad1bf5b9a69 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:11.623598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-352730e3-c5b4-467c-b2f9-0ad1bf5b9a69 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:13.000770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-352730e3-c5b4-467c-b2f9-0ad1bf5b9a69 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:13.010411 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-352730e3-c5b4-467c-b2f9-0ad1bf5b9a69 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1390 microversion: 2.1 time: 1.412473 May 28 04:57:13.011390 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2791/5463] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:11 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1390 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:14.028311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ee68d889-a07b-4934-a264-605156e6b9eb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:14.029467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ee68d889-a07b-4934-a264-605156e6b9eb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:14.060925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ee68d889-a07b-4934-a264-605156e6b9eb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:14.061413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ee68d889-a07b-4934-a264-605156e6b9eb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:14.062206 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ee68d889-a07b-4934-a264-605156e6b9eb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:14.062649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ee68d889-a07b-4934-a264-605156e6b9eb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:14.340239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ee68d889-a07b-4934-a264-605156e6b9eb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:14.366347 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ee68d889-a07b-4934-a264-605156e6b9eb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1390 microversion: 2.1 time: 0.329093 May 28 04:57:14.367148 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2673/5464] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:14 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1390 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:14.393086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-2c48ae32-7757-42fc-801c-31e5cbc2bc09 req-1e5335ad-e937-43c4-919a-78e774c81540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9317fed-13ab-4242-843f-ef74497895e1", "tag": "d288a5a0-3ba2-4f53-8886-2642d079bc88"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:57:14.397607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:57:14.410105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2c48ae32-7757-42fc-801c-31e5cbc2bc09 req-1e5335ad-e937-43c4-919a-78e774c81540 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:14.410554 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2c48ae32-7757-42fc-801c-31e5cbc2bc09 req-1e5335ad-e937-43c4-919a-78e774c81540 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:14.424516 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-2c48ae32-7757-42fc-801c-31e5cbc2bc09 req-1e5335ad-e937-43c4-919a-78e774c81540 service nova] Creating event network-changed:d288a5a0-3ba2-4f53-8886-2642d079bc88 for instance d9317fed-13ab-4242-843f-ef74497895e1 on n-h2-843700-1 May 28 04:57:14.431414 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-2c48ae32-7757-42fc-801c-31e5cbc2bc09 req-1e5335ad-e937-43c4-919a-78e774c81540 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041994 May 28 04:57:14.432904 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2792/5465] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:57:15.384521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d0e46fca-412e-4e1c-b04e-1aa3e79be409 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:15.385384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d0e46fca-412e-4e1c-b04e-1aa3e79be409 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:15.396733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0e46fca-412e-4e1c-b04e-1aa3e79be409 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:15.402013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0e46fca-412e-4e1c-b04e-1aa3e79be409 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:15.406883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0e46fca-412e-4e1c-b04e-1aa3e79be409 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:15.406883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0e46fca-412e-4e1c-b04e-1aa3e79be409 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:15.767216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d0e46fca-412e-4e1c-b04e-1aa3e79be409 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:15.782574 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d0e46fca-412e-4e1c-b04e-1aa3e79be409 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1390 microversion: 2.1 time: 0.400129 May 28 04:57:15.783613 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2674/5466] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:15 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1390 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:16.800825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-db5f95c0-bb29-4b7f-9bdd-f1f1c9373b63 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:16.802064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-db5f95c0-bb29-4b7f-9bdd-f1f1c9373b63 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:16.823269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db5f95c0-bb29-4b7f-9bdd-f1f1c9373b63 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:16.823473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db5f95c0-bb29-4b7f-9bdd-f1f1c9373b63 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:16.824275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db5f95c0-bb29-4b7f-9bdd-f1f1c9373b63 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:16.825021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db5f95c0-bb29-4b7f-9bdd-f1f1c9373b63 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:17.093170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-db5f95c0-bb29-4b7f-9bdd-f1f1c9373b63 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:17.102828 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-db5f95c0-bb29-4b7f-9bdd-f1f1c9373b63 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1390 microversion: 2.1 time: 0.306196 May 28 04:57:17.103471 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2793/5467] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:16 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1390 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:17.772657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-ce2a66ff-538d-42fb-8b22-3fc65ebe5643 req-ce945c11-2e5d-44af-bb1e-209b9a479840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb86d59-cc4a-4fa1-a3e2-07d535ddb044", "name": "network-vif-plugged", "status": "completed", "tag": "c98c716b-3208-4e40-870a-b2c59f465c7c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:57:17.780337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:57:17.783014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ce2a66ff-538d-42fb-8b22-3fc65ebe5643 req-ce945c11-2e5d-44af-bb1e-209b9a479840 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:17.783652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ce2a66ff-538d-42fb-8b22-3fc65ebe5643 req-ce945c11-2e5d-44af-bb1e-209b9a479840 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:17.786744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=69 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:57:17.796946 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-ce2a66ff-538d-42fb-8b22-3fc65ebe5643 req-ce945c11-2e5d-44af-bb1e-209b9a479840 service nova] Creating event network-vif-plugged:c98c716b-3208-4e40-870a-b2c59f465c7c for instance 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 on n-h1-843700-1 May 28 04:57:17.802885 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-ce2a66ff-538d-42fb-8b22-3fc65ebe5643 req-ce945c11-2e5d-44af-bb1e-209b9a479840 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034629 May 28 04:57:17.803543 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2675/5468] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:57:18.121474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6539b805-4c0e-40ba-8eba-2550fcf3aa07 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:18.122081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6539b805-4c0e-40ba-8eba-2550fcf3aa07 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:18.129357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6539b805-4c0e-40ba-8eba-2550fcf3aa07 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:18.130357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6539b805-4c0e-40ba-8eba-2550fcf3aa07 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:18.131246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6539b805-4c0e-40ba-8eba-2550fcf3aa07 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:18.132017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6539b805-4c0e-40ba-8eba-2550fcf3aa07 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:18.287678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6539b805-4c0e-40ba-8eba-2550fcf3aa07 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:18.295587 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6539b805-4c0e-40ba-8eba-2550fcf3aa07 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1390 microversion: 2.1 time: 0.178785 May 28 04:57:18.296248 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2794/5469] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:18 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1390 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:19.315167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3ea13a68-183e-4141-a024-ea86fa5f9143 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:19.315867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3ea13a68-183e-4141-a024-ea86fa5f9143 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:19.324454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ea13a68-183e-4141-a024-ea86fa5f9143 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:19.324917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ea13a68-183e-4141-a024-ea86fa5f9143 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:19.326010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ea13a68-183e-4141-a024-ea86fa5f9143 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:19.326751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ea13a68-183e-4141-a024-ea86fa5f9143 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:19.480098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3ea13a68-183e-4141-a024-ea86fa5f9143 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:19.488317 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3ea13a68-183e-4141-a024-ea86fa5f9143 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1562 microversion: 2.1 time: 0.179362 May 28 04:57:19.489917 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2676/5470] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:19 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1562 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:19.505454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1f5f2869-79eb-4d2f-9c9d-ff65c242dfc9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:19.506699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1f5f2869-79eb-4d2f-9c9d-ff65c242dfc9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:19.514131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f5f2869-79eb-4d2f-9c9d-ff65c242dfc9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:19.514905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f5f2869-79eb-4d2f-9c9d-ff65c242dfc9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:19.515715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f5f2869-79eb-4d2f-9c9d-ff65c242dfc9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:19.516269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f5f2869-79eb-4d2f-9c9d-ff65c242dfc9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:19.665393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1f5f2869-79eb-4d2f-9c9d-ff65c242dfc9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:19.673927 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1f5f2869-79eb-4d2f-9c9d-ff65c242dfc9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1562 microversion: 2.1 time: 0.172761 May 28 04:57:19.674526 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2795/5471] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:19 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1562 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:22.381455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6bd8001a-7a34-46ee-90f7-e24faad2ee5d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:22.382056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6bd8001a-7a34-46ee-90f7-e24faad2ee5d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:22.386116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-34742797-36ab-44fc-8eb7-733db836ad98 req-1b82a734-4436-463f-90ae-2459c429bb39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cb86d59-cc4a-4fa1-a3e2-07d535ddb044", "tag": "c98c716b-3208-4e40-870a-b2c59f465c7c"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:57:22.392064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6bd8001a-7a34-46ee-90f7-e24faad2ee5d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:22.392529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6bd8001a-7a34-46ee-90f7-e24faad2ee5d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:22.393322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6bd8001a-7a34-46ee-90f7-e24faad2ee5d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:22.393775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6bd8001a-7a34-46ee-90f7-e24faad2ee5d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:22.396218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-34742797-36ab-44fc-8eb7-733db836ad98 req-1b82a734-4436-463f-90ae-2459c429bb39 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:22.396747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-34742797-36ab-44fc-8eb7-733db836ad98 req-1b82a734-4436-463f-90ae-2459c429bb39 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:22.412125 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-34742797-36ab-44fc-8eb7-733db836ad98 req-1b82a734-4436-463f-90ae-2459c429bb39 service nova] Creating event network-changed:c98c716b-3208-4e40-870a-b2c59f465c7c for instance 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 on n-h1-843700-1 May 28 04:57:22.418119 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-34742797-36ab-44fc-8eb7-733db836ad98 req-1b82a734-4436-463f-90ae-2459c429bb39 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036056 May 28 04:57:22.422200 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2796/5472] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:57:22.646102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6bd8001a-7a34-46ee-90f7-e24faad2ee5d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:22.658021 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6bd8001a-7a34-46ee-90f7-e24faad2ee5d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1562 microversion: 2.1 time: 0.278795 May 28 04:57:22.661458 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2677/5473] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:22 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1562 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:39.194739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6d7d7612-f8c6-4884-8554-d048570c5ad8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Action: 'create', calling method: .version_select at 0x7f7701e4e430>, body: {"keypair": {"name": "tempest-keypair-1082304735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9AdfdKcB8HIoC6wv0dINxwC9cESLL/42RSOgV8zafbG/79ULRNT46oY1cwkL1qlq7e/Ay3LgKOGVn9vHDGeCUjjiDv7egpCZByu9vAmnG7glqnRELJl664jezcqZHxeQ=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:57:39.204521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=37 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:57:39.205694 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=94 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:57:39.218517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-6d7d7612-f8c6-4884-8554-d048570c5ad8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Getting quotas for project 5d8d40a350e64704ae9e918d236df9d2. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:57:39.224409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-6d7d7612-f8c6-4884-8554-d048570c5ad8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Getting quotas for user fc426b7992084b8ca99e20a7f9ce297f and project 5d8d40a350e64704ae9e918d236df9d2. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:57:39.335848 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6d7d7612-f8c6-4884-8554-d048570c5ad8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.146357 May 28 04:57:39.337029 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2797/5474] 10.222.0.58 () {62 vars in 1199 bytes} [Sat May 28 04:57:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 149 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 28 04:57:41.788209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=5 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:57:41.789726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=13 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:57:42.209581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7b44b636-6104-48fb-95d1-7a7f4fe464da tempest-PortsAdminExtendedAttrsTestJSON-401044441 tempest-PortsAdminExtendedAttrsTestJSON-401044441-project-admin] Calling method '.version_select at 0x7f77002aa9d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:42.215370 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 04:57:42.215370 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 04:57:42.215370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b44b636-6104-48fb-95d1-7a7f4fe464da tempest-PortsAdminExtendedAttrsTestJSON-401044441 tempest-PortsAdminExtendedAttrsTestJSON-401044441-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:42.215370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b44b636-6104-48fb-95d1-7a7f4fe464da tempest-PortsAdminExtendedAttrsTestJSON-401044441 tempest-PortsAdminExtendedAttrsTestJSON-401044441-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:42.247255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b44b636-6104-48fb-95d1-7a7f4fe464da tempest-PortsAdminExtendedAttrsTestJSON-401044441 tempest-PortsAdminExtendedAttrsTestJSON-401044441-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:42.247721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b44b636-6104-48fb-95d1-7a7f4fe464da tempest-PortsAdminExtendedAttrsTestJSON-401044441 tempest-PortsAdminExtendedAttrsTestJSON-401044441-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:42.273520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b44b636-6104-48fb-95d1-7a7f4fe464da tempest-PortsAdminExtendedAttrsTestJSON-401044441 tempest-PortsAdminExtendedAttrsTestJSON-401044441-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:42.274258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b44b636-6104-48fb-95d1-7a7f4fe464da tempest-PortsAdminExtendedAttrsTestJSON-401044441 tempest-PortsAdminExtendedAttrsTestJSON-401044441-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:42.292073 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7b44b636-6104-48fb-95d1-7a7f4fe464da tempest-PortsAdminExtendedAttrsTestJSON-401044441 tempest-PortsAdminExtendedAttrsTestJSON-401044441-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.514560 May 28 04:57:42.294274 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2678/5475] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 04:57:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:57:42.960776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c395545a-e9ad-4431-aa65-0d5e52c7d2d2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-265642261", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "20f6ab89-2f7d-4bcd-ac28-119b1d5d7eeb"}, {"port": "bb59fa13-05c2-4a27-aca1-04b55a00e89a", "tag": "port-1"}, {"port": "61b2868e-0dad-46f9-8275-e618419765f6", "tag": "port-2"}, {"uuid": "96ad368f-aa1f-43e4-baf8-ac983ad4964c", "tag": "net-1"}, {"uuid": "96ad368f-aa1f-43e4-baf8-ac983ad4964c"}, {"uuid": "4cfa8f83-6450-474e-9a14-6c2fac01c8e1", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "4cfa8f83-6450-474e-9a14-6c2fac01c8e1", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "cfb68256-fb0d-4c5e-a705-b148617ce9b7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "d53347fe-f175-41f7-9827-729f0d811e2e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "39692659-a695-4620-ab01-fb56067820c7", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--340181325"}], "key_name": "tempest-keypair-1082304735", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:57:43.220360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-c395545a-e9ad-4431-aa65-0d5e52c7d2d2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] validate_networks() for [('20f6ab89-2f7d-4bcd-ac28-119b1d5d7eeb', None, None, None, None, None), (None, None, 'bb59fa13-05c2-4a27-aca1-04b55a00e89a', None, None, None), (None, None, '61b2868e-0dad-46f9-8275-e618419765f6', None, None, None), ('96ad368f-aa1f-43e4-baf8-ac983ad4964c', None, None, None, None, None), ('96ad368f-aa1f-43e4-baf8-ac983ad4964c', None, None, None, None, None), ('4cfa8f83-6450-474e-9a14-6c2fac01c8e1', '10.2.2.100', None, None, None, None), ('4cfa8f83-6450-474e-9a14-6c2fac01c8e1', '10.2.2.200', None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:57:43.380232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-117bae18-0aef-4382-9584-39f00d3d3262 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:57:43.382098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-117bae18-0aef-4382-9584-39f00d3d3262 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:43.411146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-117bae18-0aef-4382-9584-39f00d3d3262 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:43.412370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-117bae18-0aef-4382-9584-39f00d3d3262 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:43.413410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-117bae18-0aef-4382-9584-39f00d3d3262 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:43.414662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-117bae18-0aef-4382-9584-39f00d3d3262 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:43.493552 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-117bae18-0aef-4382-9584-39f00d3d3262 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044/action" status: 200 len: 24572 microversion: 2.1 time: 0.123697 May 28 04:57:43.499791 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2679/5476] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:57:43 2022] POST /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044/action => generated 24572 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:57:45.901888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3b515415-d89e-4586-9055-79bc38702f16 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55376061-f9ef-42a2-a971-8782f240dca4"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:57:45.903934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3b515415-d89e-4586-9055-79bc38702f16 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:45.922587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b515415-d89e-4586-9055-79bc38702f16 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:45.926576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b515415-d89e-4586-9055-79bc38702f16 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:45.928523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b515415-d89e-4586-9055-79bc38702f16 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:45.930336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b515415-d89e-4586-9055-79bc38702f16 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:47.064190 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3b515415-d89e-4586-9055-79bc38702f16 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "POST /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.183410 May 28 04:57:47.067270 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2680/5477] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 04:57:45 2022] POST /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments => generated 194 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:57:48.103777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c395545a-e9ad-4431-aa65-0d5e52c7d2d2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:57:48.104282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c395545a-e9ad-4431-aa65-0d5e52c7d2d2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:57:48.104678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c395545a-e9ad-4431-aa65-0d5e52c7d2d2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:57:48.105090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c395545a-e9ad-4431-aa65-0d5e52c7d2d2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:57:48.105507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c395545a-e9ad-4431-aa65-0d5e52c7d2d2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:57:48.124777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c395545a-e9ad-4431-aa65-0d5e52c7d2d2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:48.125247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c395545a-e9ad-4431-aa65-0d5e52c7d2d2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:48.126057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c395545a-e9ad-4431-aa65-0d5e52c7d2d2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:48.126499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c395545a-e9ad-4431-aa65-0d5e52c7d2d2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:48.219967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-c395545a-e9ad-4431-aa65-0d5e52c7d2d2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Getting quotas for project 5d8d40a350e64704ae9e918d236df9d2. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:57:48.237577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-c395545a-e9ad-4431-aa65-0d5e52c7d2d2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Getting quotas for user fc426b7992084b8ca99e20a7f9ce297f and project 5d8d40a350e64704ae9e918d236df9d2. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:57:48.953315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c395545a-e9ad-4431-aa65-0d5e52c7d2d2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:57:48.962451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c395545a-e9ad-4431-aa65-0d5e52c7d2d2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='cfb68256-fb0d-4c5e-a705-b148617ce9b7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='d53347fe-f175-41f7-9827-729f0d811e2e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39692659-a695-4620-ab01-fb56067820c7',volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:57:50.945563 n-d-843700-1 devstack@n-api.service[126044]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c395545a-e9ad-4431-aa65-0d5e52c7d2d2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [ab39741c-8c64-4598-a3d7-bc53248797d0] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 04:57:51.953884 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [None req-c395545a-e9ad-4431-aa65-0d5e52c7d2d2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [ab39741c-8c64-4598-a3d7-bc53248797d0] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 53560. May 28 04:57:51.960009 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c395545a-e9ad-4431-aa65-0d5e52c7d2d2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 9.023003 May 28 04:57:51.961217 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2798/5478] 10.222.0.58 () {62 vars in 1188 bytes} [Sat May 28 04:57:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 9026 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 28 04:57:51.974317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3fd416c8-934f-490d-90a8-6d6399c476e4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:51.975847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3fd416c8-934f-490d-90a8-6d6399c476e4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:52.470122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3fd416c8-934f-490d-90a8-6d6399c476e4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:52.487691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3fd416c8-934f-490d-90a8-6d6399c476e4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:52.492927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3fd416c8-934f-490d-90a8-6d6399c476e4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:52.504774 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3fd416c8-934f-490d-90a8-6d6399c476e4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1285 microversion: 2.32 time: 0.534030 May 28 04:57:52.511110 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2681/5479] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:57:51 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1285 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:57:53.530847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-67bdbc0d-5bfc-44d7-a3ef-b1323fcd4add tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:53.531738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-67bdbc0d-5bfc-44d7-a3ef-b1323fcd4add tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:53.658298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-67bdbc0d-5bfc-44d7-a3ef-b1323fcd4add tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:53.676733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-67bdbc0d-5bfc-44d7-a3ef-b1323fcd4add tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:53.688944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-67bdbc0d-5bfc-44d7-a3ef-b1323fcd4add tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:53.693823 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-67bdbc0d-5bfc-44d7-a3ef-b1323fcd4add tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1285 microversion: 2.32 time: 0.168217 May 28 04:57:53.695599 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2799/5480] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:57:53 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:57:54.510701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8836faaa-47e8-4efa-9e2e-4d5df877f1cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:54.510701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8836faaa-47e8-4efa-9e2e-4d5df877f1cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:54.516806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8836faaa-47e8-4efa-9e2e-4d5df877f1cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:54.517277 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8836faaa-47e8-4efa-9e2e-4d5df877f1cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:54.518075 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8836faaa-47e8-4efa-9e2e-4d5df877f1cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:54.523600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8836faaa-47e8-4efa-9e2e-4d5df877f1cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:54.715262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-169e4518-bbdf-4098-aceb-56b4467da072 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:54.715262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-169e4518-bbdf-4098-aceb-56b4467da072 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:54.736808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-169e4518-bbdf-4098-aceb-56b4467da072 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:54.743737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-169e4518-bbdf-4098-aceb-56b4467da072 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:54.743737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-169e4518-bbdf-4098-aceb-56b4467da072 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:54.743737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-169e4518-bbdf-4098-aceb-56b4467da072 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:55.091525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-169e4518-bbdf-4098-aceb-56b4467da072 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:55.119672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-169e4518-bbdf-4098-aceb-56b4467da072 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:55.122451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-169e4518-bbdf-4098-aceb-56b4467da072 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:55.124649 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-169e4518-bbdf-4098-aceb-56b4467da072 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1527 microversion: 2.32 time: 0.415187 May 28 04:57:55.126830 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2800/5481] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:57:54 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1527 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:57:55.779780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8836faaa-47e8-4efa-9e2e-4d5df877f1cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:55.813815 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8836faaa-47e8-4efa-9e2e-4d5df877f1cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1681 microversion: 2.1 time: 1.312295 May 28 04:57:55.828058 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2682/5482] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:54 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1681 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:56.154980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ff77b77a-7284-4121-8800-b80b2228bf8f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:56.155917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ff77b77a-7284-4121-8800-b80b2228bf8f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:56.185227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff77b77a-7284-4121-8800-b80b2228bf8f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:56.185981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff77b77a-7284-4121-8800-b80b2228bf8f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:56.188167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff77b77a-7284-4121-8800-b80b2228bf8f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:56.189839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff77b77a-7284-4121-8800-b80b2228bf8f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:56.195087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-320669e0-6aad-47c3-8237-9b2338058bd0 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:57:56.196337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-320669e0-6aad-47c3-8237-9b2338058bd0 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:56.225535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-320669e0-6aad-47c3-8237-9b2338058bd0 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:56.229421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-320669e0-6aad-47c3-8237-9b2338058bd0 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:56.231536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-320669e0-6aad-47c3-8237-9b2338058bd0 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:56.231536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-320669e0-6aad-47c3-8237-9b2338058bd0 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:56.353244 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-320669e0-6aad-47c3-8237-9b2338058bd0 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044/action" status: 200 len: 32645 microversion: 2.1 time: 0.143075 May 28 04:57:56.355718 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2683/5483] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:57:56 2022] POST /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044/action => generated 32645 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 04:57:56.405776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ff77b77a-7284-4121-8800-b80b2228bf8f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:56.431714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ff77b77a-7284-4121-8800-b80b2228bf8f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:56.440150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ff77b77a-7284-4121-8800-b80b2228bf8f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:56.443346 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ff77b77a-7284-4121-8800-b80b2228bf8f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1583 microversion: 2.32 time: 0.302441 May 28 04:57:56.447140 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2801/5484] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:57:56 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1583 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:57:56.513863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e953eb1d-1119-4264-9fb0-ff8437b6903b tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:56.515031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e953eb1d-1119-4264-9fb0-ff8437b6903b tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:56.535136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e953eb1d-1119-4264-9fb0-ff8437b6903b tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:56.536922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e953eb1d-1119-4264-9fb0-ff8437b6903b tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:56.539388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e953eb1d-1119-4264-9fb0-ff8437b6903b tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:56.540207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e953eb1d-1119-4264-9fb0-ff8437b6903b tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:57.172984 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e953eb1d-1119-4264-9fb0-ff8437b6903b tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1832 microversion: 2.1 time: 0.661722 May 28 04:57:57.173695 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2684/5485] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:57:56 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1832 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:57:57.201545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c3a1deda-6c80-45ff-a2e5-8438629c2557 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:57:57.203462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c3a1deda-6c80-45ff-a2e5-8438629c2557 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:57.224959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3a1deda-6c80-45ff-a2e5-8438629c2557 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:57.226711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3a1deda-6c80-45ff-a2e5-8438629c2557 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:57.229891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3a1deda-6c80-45ff-a2e5-8438629c2557 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:57.231988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3a1deda-6c80-45ff-a2e5-8438629c2557 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:57.310274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-c3a1deda-6c80-45ff-a2e5-8438629c2557 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lazy-loading 'flavor' on Instance uuid 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:57:57.345414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c3a1deda-6c80-45ff-a2e5-8438629c2557 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Going to try to live migrate instance to another host {{(pid=126044) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 28 04:57:57.479252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-130fe15b-b661-45de-b183-299a3f3c5f0c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:57.479886 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-130fe15b-b661-45de-b183-299a3f3c5f0c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:57.507969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-130fe15b-b661-45de-b183-299a3f3c5f0c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:57.509042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-130fe15b-b661-45de-b183-299a3f3c5f0c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:57.512573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-130fe15b-b661-45de-b183-299a3f3c5f0c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:57.513772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-130fe15b-b661-45de-b183-299a3f3c5f0c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:57.852667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-130fe15b-b661-45de-b183-299a3f3c5f0c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:57.866472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-130fe15b-b661-45de-b183-299a3f3c5f0c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:57.870736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-130fe15b-b661-45de-b183-299a3f3c5f0c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:57.872214 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-130fe15b-b661-45de-b183-299a3f3c5f0c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1593 microversion: 2.32 time: 0.410990 May 28 04:57:57.875600 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2685/5486] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:57:57 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1593 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:57:58.182672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:57:58.894865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1eb3b923-db9c-47b9-9d4c-51a0a5c4a2ef tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:57:58.896352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1eb3b923-db9c-47b9-9d4c-51a0a5c4a2ef tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:57:58.911726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1eb3b923-db9c-47b9-9d4c-51a0a5c4a2ef tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:58.912454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1eb3b923-db9c-47b9-9d4c-51a0a5c4a2ef tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:58.913469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1eb3b923-db9c-47b9-9d4c-51a0a5c4a2ef tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:57:58.914078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1eb3b923-db9c-47b9-9d4c-51a0a5c4a2ef tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:57:59.093077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1eb3b923-db9c-47b9-9d4c-51a0a5c4a2ef tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:59.104275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1eb3b923-db9c-47b9-9d4c-51a0a5c4a2ef tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:59.106275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1eb3b923-db9c-47b9-9d4c-51a0a5c4a2ef tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:57:59.107766 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1eb3b923-db9c-47b9-9d4c-51a0a5c4a2ef tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1593 microversion: 2.32 time: 0.218525 May 28 04:57:59.119519 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2686/5487] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:57:58 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1593 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:58:00.128653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-74f97d3a-868a-4b94-9e18-67747b89d073 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:00.130245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-74f97d3a-868a-4b94-9e18-67747b89d073 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:00.140504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74f97d3a-868a-4b94-9e18-67747b89d073 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:00.141429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74f97d3a-868a-4b94-9e18-67747b89d073 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:00.142720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74f97d3a-868a-4b94-9e18-67747b89d073 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:00.143416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74f97d3a-868a-4b94-9e18-67747b89d073 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:00.307301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-74f97d3a-868a-4b94-9e18-67747b89d073 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:00.342336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-74f97d3a-868a-4b94-9e18-67747b89d073 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:00.344755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-74f97d3a-868a-4b94-9e18-67747b89d073 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:00.346229 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-74f97d3a-868a-4b94-9e18-67747b89d073 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1593 microversion: 2.32 time: 0.221787 May 28 04:58:00.347059 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2687/5488] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:00 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1593 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:01.368481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1c3a7e1f-cfb8-45db-984f-bf73616375e6 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:01.369744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1c3a7e1f-cfb8-45db-984f-bf73616375e6 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:01.380726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1c3a7e1f-cfb8-45db-984f-bf73616375e6 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:01.387727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1c3a7e1f-cfb8-45db-984f-bf73616375e6 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:01.388795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1c3a7e1f-cfb8-45db-984f-bf73616375e6 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:01.389433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1c3a7e1f-cfb8-45db-984f-bf73616375e6 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:01.863266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1c3a7e1f-cfb8-45db-984f-bf73616375e6 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:01.882915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1c3a7e1f-cfb8-45db-984f-bf73616375e6 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:01.884945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1c3a7e1f-cfb8-45db-984f-bf73616375e6 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:01.886549 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1c3a7e1f-cfb8-45db-984f-bf73616375e6 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1660 microversion: 2.32 time: 0.521835 May 28 04:58:01.887768 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2688/5489] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:01 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1660 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:58:02.317561 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c3a1deda-6c80-45ff-a2e5-8438629c2557 tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044/action" status: 202 len: 0 microversion: 2.1 time: 5.123077 May 28 04:58:02.327236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fc759fab-4b29-4113-9962-162777bd5edd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:02.327764 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2802/5490] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:57:57 2022] POST /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044/action => generated 0 bytes in 5134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:58:02.328560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fc759fab-4b29-4113-9962-162777bd5edd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:02.337404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc759fab-4b29-4113-9962-162777bd5edd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:02.339527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc759fab-4b29-4113-9962-162777bd5edd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:02.339527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc759fab-4b29-4113-9962-162777bd5edd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:02.339929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc759fab-4b29-4113-9962-162777bd5edd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:02.485729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:58:02.772624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fc759fab-4b29-4113-9962-162777bd5edd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:02.787500 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fc759fab-4b29-4113-9962-162777bd5edd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1691 microversion: 2.1 time: 0.464474 May 28 04:58:02.788729 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2689/5491] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:02 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1691 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:58:02.910107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9614d51a-360a-435e-9a41-47fd3f15ebc4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:02.910932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9614d51a-360a-435e-9a41-47fd3f15ebc4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:02.924277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9614d51a-360a-435e-9a41-47fd3f15ebc4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:02.944672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9614d51a-360a-435e-9a41-47fd3f15ebc4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:02.949044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9614d51a-360a-435e-9a41-47fd3f15ebc4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:02.950376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9614d51a-360a-435e-9a41-47fd3f15ebc4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:03.288550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9614d51a-360a-435e-9a41-47fd3f15ebc4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:03.302884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9614d51a-360a-435e-9a41-47fd3f15ebc4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:03.304838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9614d51a-360a-435e-9a41-47fd3f15ebc4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:03.307150 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9614d51a-360a-435e-9a41-47fd3f15ebc4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1660 microversion: 2.32 time: 0.404822 May 28 04:58:03.308403 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2803/5492] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:02 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1660 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:03.807491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4c1b36cb-b731-45f9-b52a-033337ff4d2f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:03.808261 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4c1b36cb-b731-45f9-b52a-033337ff4d2f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:03.833104 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c1b36cb-b731-45f9-b52a-033337ff4d2f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:03.836963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c1b36cb-b731-45f9-b52a-033337ff4d2f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:03.838143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c1b36cb-b731-45f9-b52a-033337ff4d2f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:03.838951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c1b36cb-b731-45f9-b52a-033337ff4d2f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:04.108217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4c1b36cb-b731-45f9-b52a-033337ff4d2f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:04.136854 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4c1b36cb-b731-45f9-b52a-033337ff4d2f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1691 microversion: 2.1 time: 0.334245 May 28 04:58:04.138027 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2690/5493] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:03 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1691 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:04.329624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d5a420bb-4c43-4375-8241-3af922b4d0b5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:04.331339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d5a420bb-4c43-4375-8241-3af922b4d0b5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:04.340206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=12 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:58:04.342217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5a420bb-4c43-4375-8241-3af922b4d0b5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:04.342673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5a420bb-4c43-4375-8241-3af922b4d0b5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:04.344004 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5a420bb-4c43-4375-8241-3af922b4d0b5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:04.344625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5a420bb-4c43-4375-8241-3af922b4d0b5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:04.877240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d5a420bb-4c43-4375-8241-3af922b4d0b5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:04.906129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d5a420bb-4c43-4375-8241-3af922b4d0b5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:04.908629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d5a420bb-4c43-4375-8241-3af922b4d0b5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:04.916503 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d5a420bb-4c43-4375-8241-3af922b4d0b5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1706 microversion: 2.32 time: 0.591932 May 28 04:58:04.930778 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2804/5494] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:04 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1706 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:05.155586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a2f94563-b997-4c42-b12e-a8fc8b3aa3ee tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:05.157002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a2f94563-b997-4c42-b12e-a8fc8b3aa3ee tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:05.170592 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2f94563-b997-4c42-b12e-a8fc8b3aa3ee tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:05.174029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2f94563-b997-4c42-b12e-a8fc8b3aa3ee tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:05.175363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2f94563-b997-4c42-b12e-a8fc8b3aa3ee tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:05.178442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2f94563-b997-4c42-b12e-a8fc8b3aa3ee tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:05.557915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a2f94563-b997-4c42-b12e-a8fc8b3aa3ee tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:05.569201 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a2f94563-b997-4c42-b12e-a8fc8b3aa3ee tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1691 microversion: 2.1 time: 0.419291 May 28 04:58:05.571588 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2691/5495] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:05 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1691 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:05.937316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2eb0bfa8-1eb8-4ea4-b2ac-6db7ff40805f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:05.938917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2eb0bfa8-1eb8-4ea4-b2ac-6db7ff40805f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:05.952940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2eb0bfa8-1eb8-4ea4-b2ac-6db7ff40805f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:05.954339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2eb0bfa8-1eb8-4ea4-b2ac-6db7ff40805f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:05.955396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2eb0bfa8-1eb8-4ea4-b2ac-6db7ff40805f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:05.957826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2eb0bfa8-1eb8-4ea4-b2ac-6db7ff40805f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:06.498209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-0f75912f-f8ff-4e30-b2ac-7cc3ec8a9e82 req-f453b16d-a02a-487c-a1d6-463fb328efd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb86d59-cc4a-4fa1-a3e2-07d535ddb044", "name": "network-vif-unplugged", "status": "completed", "tag": "c98c716b-3208-4e40-870a-b2c59f465c7c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:58:06.511975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0f75912f-f8ff-4e30-b2ac-7cc3ec8a9e82 req-f453b16d-a02a-487c-a1d6-463fb328efd7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:06.512672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0f75912f-f8ff-4e30-b2ac-7cc3ec8a9e82 req-f453b16d-a02a-487c-a1d6-463fb328efd7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:06.531326 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-0f75912f-f8ff-4e30-b2ac-7cc3ec8a9e82 req-f453b16d-a02a-487c-a1d6-463fb328efd7 service nova] Creating event network-vif-unplugged:c98c716b-3208-4e40-870a-b2c59f465c7c for instance 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 on n-h1-843700-1 May 28 04:58:06.544877 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-0f75912f-f8ff-4e30-b2ac-7cc3ec8a9e82 req-f453b16d-a02a-487c-a1d6-463fb328efd7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049237 May 28 04:58:06.548448 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2692/5496] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:58:06.589061 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2eb0bfa8-1eb8-4ea4-b2ac-6db7ff40805f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:06.590172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-37983d8a-00ba-4466-8de7-312280ad0e4e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:06.591270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-37983d8a-00ba-4466-8de7-312280ad0e4e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:06.601026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-37983d8a-00ba-4466-8de7-312280ad0e4e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:06.607628 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-37983d8a-00ba-4466-8de7-312280ad0e4e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:06.614021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-37983d8a-00ba-4466-8de7-312280ad0e4e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:06.615264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-37983d8a-00ba-4466-8de7-312280ad0e4e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:06.635965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2eb0bfa8-1eb8-4ea4-b2ac-6db7ff40805f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:06.637785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2eb0bfa8-1eb8-4ea4-b2ac-6db7ff40805f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:06.653867 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2eb0bfa8-1eb8-4ea4-b2ac-6db7ff40805f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1706 microversion: 2.32 time: 0.720754 May 28 04:58:06.661641 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2805/5497] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:05 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1706 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:07.010662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-37983d8a-00ba-4466-8de7-312280ad0e4e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:07.018424 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-37983d8a-00ba-4466-8de7-312280ad0e4e tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1691 microversion: 2.1 time: 0.433847 May 28 04:58:07.031367 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2693/5498] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:06 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1691 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:58:07.678158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c7327e37-2e15-4cea-a6e2-ec0d422314fe tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:07.678807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c7327e37-2e15-4cea-a6e2-ec0d422314fe tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:07.686430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c7327e37-2e15-4cea-a6e2-ec0d422314fe tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:07.698160 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c7327e37-2e15-4cea-a6e2-ec0d422314fe tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:07.701266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c7327e37-2e15-4cea-a6e2-ec0d422314fe tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:07.702645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c7327e37-2e15-4cea-a6e2-ec0d422314fe tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:08.048399 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-45c6755a-ffe6-484e-96a3-bb4061ee99d6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:08.049056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-45c6755a-ffe6-484e-96a3-bb4061ee99d6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:08.064914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45c6755a-ffe6-484e-96a3-bb4061ee99d6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:08.070514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45c6755a-ffe6-484e-96a3-bb4061ee99d6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:08.070514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45c6755a-ffe6-484e-96a3-bb4061ee99d6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:08.070514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45c6755a-ffe6-484e-96a3-bb4061ee99d6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:08.199889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c7327e37-2e15-4cea-a6e2-ec0d422314fe tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:08.218738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c7327e37-2e15-4cea-a6e2-ec0d422314fe tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:08.226841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c7327e37-2e15-4cea-a6e2-ec0d422314fe tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:08.228492 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c7327e37-2e15-4cea-a6e2-ec0d422314fe tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1752 microversion: 2.32 time: 0.555458 May 28 04:58:08.233489 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2806/5499] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:07 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1752 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:08.616132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-164ae2de-57de-4dca-9cb0-18dec3230498 req-c21ea045-db47-4f91-89fd-81392889e833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cb86d59-cc4a-4fa1-a3e2-07d535ddb044", "tag": "c98c716b-3208-4e40-870a-b2c59f465c7c"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:58:08.664936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-164ae2de-57de-4dca-9cb0-18dec3230498 req-c21ea045-db47-4f91-89fd-81392889e833 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:08.670253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-164ae2de-57de-4dca-9cb0-18dec3230498 req-c21ea045-db47-4f91-89fd-81392889e833 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:08.707172 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-164ae2de-57de-4dca-9cb0-18dec3230498 req-c21ea045-db47-4f91-89fd-81392889e833 service nova] Creating event network-changed:c98c716b-3208-4e40-870a-b2c59f465c7c for instance 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 on n-h1-843700-1 May 28 04:58:08.722909 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-164ae2de-57de-4dca-9cb0-18dec3230498 req-c21ea045-db47-4f91-89fd-81392889e833 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112142 May 28 04:58:08.731359 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2807/5500] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:58:09.098630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-45c6755a-ffe6-484e-96a3-bb4061ee99d6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:09.111324 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-45c6755a-ffe6-484e-96a3-bb4061ee99d6 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1691 microversion: 2.1 time: 1.062888 May 28 04:58:09.119668 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2694/5501] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:08 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1691 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:58:09.252904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4c699886-4e43-40d7-9911-17b053894a61 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:09.253865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4c699886-4e43-40d7-9911-17b053894a61 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:09.266842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c699886-4e43-40d7-9911-17b053894a61 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:09.269059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c699886-4e43-40d7-9911-17b053894a61 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:09.272243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c699886-4e43-40d7-9911-17b053894a61 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:09.275271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c699886-4e43-40d7-9911-17b053894a61 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:09.947604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4c699886-4e43-40d7-9911-17b053894a61 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:09.968804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4c699886-4e43-40d7-9911-17b053894a61 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:09.977884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4c699886-4e43-40d7-9911-17b053894a61 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:09.982669 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4c699886-4e43-40d7-9911-17b053894a61 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1752 microversion: 2.32 time: 0.735942 May 28 04:58:09.986138 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2808/5502] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:09 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1752 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:10.138898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c7195291-dda7-48d9-825a-846e1fd645b4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:10.140445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c7195291-dda7-48d9-825a-846e1fd645b4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:10.153019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7195291-dda7-48d9-825a-846e1fd645b4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:10.156902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7195291-dda7-48d9-825a-846e1fd645b4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:10.158172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7195291-dda7-48d9-825a-846e1fd645b4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:10.164914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7195291-dda7-48d9-825a-846e1fd645b4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:10.229361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:58:10.812689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c7195291-dda7-48d9-825a-846e1fd645b4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:10.824260 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c7195291-dda7-48d9-825a-846e1fd645b4 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1691 microversion: 2.1 time: 0.691882 May 28 04:58:10.827057 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2695/5503] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:10 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1691 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:11.009176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-86dc083f-6ec0-4029-988b-1ceb2afd29de tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:11.027360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-86dc083f-6ec0-4029-988b-1ceb2afd29de tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:11.046250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-86dc083f-6ec0-4029-988b-1ceb2afd29de tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:11.047430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-86dc083f-6ec0-4029-988b-1ceb2afd29de tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:11.051065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-86dc083f-6ec0-4029-988b-1ceb2afd29de tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:11.054972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-86dc083f-6ec0-4029-988b-1ceb2afd29de tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:11.460104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-86dc083f-6ec0-4029-988b-1ceb2afd29de tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:11.484460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-86dc083f-6ec0-4029-988b-1ceb2afd29de tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:11.487926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-86dc083f-6ec0-4029-988b-1ceb2afd29de tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:11.489411 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-86dc083f-6ec0-4029-988b-1ceb2afd29de tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1798 microversion: 2.32 time: 0.485427 May 28 04:58:11.492029 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2809/5504] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:11 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1798 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:11.845721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a052bad8-da4e-43a9-96b3-d2394db731e1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:11.846926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a052bad8-da4e-43a9-96b3-d2394db731e1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:11.863639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a052bad8-da4e-43a9-96b3-d2394db731e1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:11.864433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a052bad8-da4e-43a9-96b3-d2394db731e1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:11.865441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a052bad8-da4e-43a9-96b3-d2394db731e1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:11.866040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a052bad8-da4e-43a9-96b3-d2394db731e1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:12.209640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a052bad8-da4e-43a9-96b3-d2394db731e1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:12.221550 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a052bad8-da4e-43a9-96b3-d2394db731e1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1691 microversion: 2.1 time: 0.381860 May 28 04:58:12.225575 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2696/5505] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:11 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1691 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:12.513837 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d5a95e87-a703-4622-a4a7-998e54425682 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:12.514458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d5a95e87-a703-4622-a4a7-998e54425682 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:12.532407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5a95e87-a703-4622-a4a7-998e54425682 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:12.532876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5a95e87-a703-4622-a4a7-998e54425682 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:12.533824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5a95e87-a703-4622-a4a7-998e54425682 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:12.534701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5a95e87-a703-4622-a4a7-998e54425682 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:13.083977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d5a95e87-a703-4622-a4a7-998e54425682 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:13.091797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:58:13.102305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d5a95e87-a703-4622-a4a7-998e54425682 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:13.107185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d5a95e87-a703-4622-a4a7-998e54425682 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:13.113014 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d5a95e87-a703-4622-a4a7-998e54425682 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1844 microversion: 2.32 time: 0.603031 May 28 04:58:13.114092 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2810/5506] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:12 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1844 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:13.243323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-35ccad01-7d6a-4fee-aaa2-9c5d2848a228 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:13.244833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-35ccad01-7d6a-4fee-aaa2-9c5d2848a228 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:13.273325 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-35ccad01-7d6a-4fee-aaa2-9c5d2848a228 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:13.274638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-35ccad01-7d6a-4fee-aaa2-9c5d2848a228 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:13.275657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-35ccad01-7d6a-4fee-aaa2-9c5d2848a228 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:13.279095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-35ccad01-7d6a-4fee-aaa2-9c5d2848a228 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:13.446225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-8b79d6bb-b4f0-4e6e-b025-7461acd7c60c req-5dc466a7-3898-456c-ba3b-7f63533a823c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "tag": "e8a39c56-6241-47f0-8b49-def4fa9702ac"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:58:13.453652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:58:13.456289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8b79d6bb-b4f0-4e6e-b025-7461acd7c60c req-5dc466a7-3898-456c-ba3b-7f63533a823c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:13.456907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8b79d6bb-b4f0-4e6e-b025-7461acd7c60c req-5dc466a7-3898-456c-ba3b-7f63533a823c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:13.473102 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-8b79d6bb-b4f0-4e6e-b025-7461acd7c60c req-5dc466a7-3898-456c-ba3b-7f63533a823c service nova] Creating event network-changed:e8a39c56-6241-47f0-8b49-def4fa9702ac for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 04:58:13.479295 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-8b79d6bb-b4f0-4e6e-b025-7461acd7c60c req-5dc466a7-3898-456c-ba3b-7f63533a823c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040411 May 28 04:58:13.479632 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2811/5507] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:58:13.814027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-35ccad01-7d6a-4fee-aaa2-9c5d2848a228 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:13.833001 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-35ccad01-7d6a-4fee-aaa2-9c5d2848a228 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1691 microversion: 2.1 time: 0.596485 May 28 04:58:13.848665 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2697/5508] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:13 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1691 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:14.138151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-afcdc066-030f-4349-a2ba-0670729f642a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:14.139405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-afcdc066-030f-4349-a2ba-0670729f642a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:14.158412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-afcdc066-030f-4349-a2ba-0670729f642a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:14.159247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-afcdc066-030f-4349-a2ba-0670729f642a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:14.161713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-afcdc066-030f-4349-a2ba-0670729f642a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:14.162469 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-afcdc066-030f-4349-a2ba-0670729f642a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:14.179872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-aedcb8a8-8e26-4ca5-843c-006bffa1a6cc req-b3996696-c32c-452d-8fd1-ccd24d14af29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb86d59-cc4a-4fa1-a3e2-07d535ddb044", "name": "network-vif-unplugged", "status": "completed", "tag": "c98c716b-3208-4e40-870a-b2c59f465c7c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:58:14.200579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=45 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:58:14.200579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-aedcb8a8-8e26-4ca5-843c-006bffa1a6cc req-b3996696-c32c-452d-8fd1-ccd24d14af29 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:14.200579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-aedcb8a8-8e26-4ca5-843c-006bffa1a6cc req-b3996696-c32c-452d-8fd1-ccd24d14af29 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:14.237713 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-aedcb8a8-8e26-4ca5-843c-006bffa1a6cc req-b3996696-c32c-452d-8fd1-ccd24d14af29 service nova] Creating event network-vif-unplugged:c98c716b-3208-4e40-870a-b2c59f465c7c for instance 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 on n-h1-843700-1 May 28 04:58:14.246406 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-aedcb8a8-8e26-4ca5-843c-006bffa1a6cc req-b3996696-c32c-452d-8fd1-ccd24d14af29 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073232 May 28 04:58:14.248341 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2698/5509] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:58:14.853097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-236f0b7b-246e-4b56-9aaa-fdb5216e7249 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:14.853823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-236f0b7b-246e-4b56-9aaa-fdb5216e7249 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:14.873289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-236f0b7b-246e-4b56-9aaa-fdb5216e7249 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:14.873828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-236f0b7b-246e-4b56-9aaa-fdb5216e7249 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:14.879316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-236f0b7b-246e-4b56-9aaa-fdb5216e7249 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:14.884466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-236f0b7b-246e-4b56-9aaa-fdb5216e7249 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:15.728075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-afcdc066-030f-4349-a2ba-0670729f642a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:15.742493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-afcdc066-030f-4349-a2ba-0670729f642a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:15.745718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-afcdc066-030f-4349-a2ba-0670729f642a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:15.749678 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-afcdc066-030f-4349-a2ba-0670729f642a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1844 microversion: 2.32 time: 1.618521 May 28 04:58:15.750515 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2812/5510] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:14 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1844 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:15.843981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-3ac5ba57-86ed-41c1-b2d8-8c94b31bdcca req-a7ed5395-f55a-4e53-8ab8-86d77c5ae11e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "tag": "bb59fa13-05c2-4a27-aca1-04b55a00e89a"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:58:15.855669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-3ac5ba57-86ed-41c1-b2d8-8c94b31bdcca req-a7ed5395-f55a-4e53-8ab8-86d77c5ae11e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:15.863302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-3ac5ba57-86ed-41c1-b2d8-8c94b31bdcca req-a7ed5395-f55a-4e53-8ab8-86d77c5ae11e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:15.905376 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-3ac5ba57-86ed-41c1-b2d8-8c94b31bdcca req-a7ed5395-f55a-4e53-8ab8-86d77c5ae11e service nova] Creating event network-changed:bb59fa13-05c2-4a27-aca1-04b55a00e89a for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 04:58:15.923550 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-3ac5ba57-86ed-41c1-b2d8-8c94b31bdcca req-a7ed5395-f55a-4e53-8ab8-86d77c5ae11e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083083 May 28 04:58:15.924948 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2813/5511] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:58:16.770696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b77b13d2-ea44-4901-802e-819bf5c0f846 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:16.771446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b77b13d2-ea44-4901-802e-819bf5c0f846 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:16.791063 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b77b13d2-ea44-4901-802e-819bf5c0f846 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:16.791545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b77b13d2-ea44-4901-802e-819bf5c0f846 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:16.792343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b77b13d2-ea44-4901-802e-819bf5c0f846 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:16.793168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b77b13d2-ea44-4901-802e-819bf5c0f846 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:16.939081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-236f0b7b-246e-4b56-9aaa-fdb5216e7249 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:16.947241 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-236f0b7b-246e-4b56-9aaa-fdb5216e7249 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1691 microversion: 2.1 time: 2.098350 May 28 04:58:16.963813 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2699/5512] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:14 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1691 bytes in 2116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:58:17.499299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b77b13d2-ea44-4901-802e-819bf5c0f846 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:17.519519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b77b13d2-ea44-4901-802e-819bf5c0f846 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:17.521290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b77b13d2-ea44-4901-802e-819bf5c0f846 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:17.522767 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b77b13d2-ea44-4901-802e-819bf5c0f846 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1865 microversion: 2.32 time: 0.757716 May 28 04:58:17.534567 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2814/5513] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:16 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1865 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:17.966377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ecedd7f7-b7f4-4459-a4d3-d8481da396f8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:17.967744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ecedd7f7-b7f4-4459-a4d3-d8481da396f8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:17.976879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecedd7f7-b7f4-4459-a4d3-d8481da396f8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:17.982189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecedd7f7-b7f4-4459-a4d3-d8481da396f8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:17.984400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecedd7f7-b7f4-4459-a4d3-d8481da396f8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:17.985036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ecedd7f7-b7f4-4459-a4d3-d8481da396f8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:18.407933 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ecedd7f7-b7f4-4459-a4d3-d8481da396f8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:18.418462 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ecedd7f7-b7f4-4459-a4d3-d8481da396f8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1691 microversion: 2.1 time: 0.457640 May 28 04:58:18.432961 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2700/5514] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:17 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1691 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:18.541800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c248877d-0a58-4baf-8a00-daa2579270af tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:18.542426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c248877d-0a58-4baf-8a00-daa2579270af tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:18.556454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c248877d-0a58-4baf-8a00-daa2579270af tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:18.556921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c248877d-0a58-4baf-8a00-daa2579270af tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:18.557761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c248877d-0a58-4baf-8a00-daa2579270af tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:18.558457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c248877d-0a58-4baf-8a00-daa2579270af tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:19.436954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-abfefdf7-5881-4bc5-b87a-5275850fd6b8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:19.437573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-abfefdf7-5881-4bc5-b87a-5275850fd6b8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:19.445543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abfefdf7-5881-4bc5-b87a-5275850fd6b8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:19.461488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abfefdf7-5881-4bc5-b87a-5275850fd6b8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:19.462732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abfefdf7-5881-4bc5-b87a-5275850fd6b8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:19.463480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abfefdf7-5881-4bc5-b87a-5275850fd6b8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:19.675142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c248877d-0a58-4baf-8a00-daa2579270af tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:19.691688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c248877d-0a58-4baf-8a00-daa2579270af tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:19.694829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c248877d-0a58-4baf-8a00-daa2579270af tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:19.707186 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c248877d-0a58-4baf-8a00-daa2579270af tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1886 microversion: 2.32 time: 1.159679 May 28 04:58:19.710418 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2815/5515] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:18 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1886 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:19.932762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-abfefdf7-5881-4bc5-b87a-5275850fd6b8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:19.949459 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-abfefdf7-5881-4bc5-b87a-5275850fd6b8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1691 microversion: 2.1 time: 0.516611 May 28 04:58:19.950062 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2701/5516] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:19 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1691 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:58:20.717783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6b655660-e1fe-4069-9a44-29169162350b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:20.719064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6b655660-e1fe-4069-9a44-29169162350b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:20.729700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6b655660-e1fe-4069-9a44-29169162350b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:20.729700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6b655660-e1fe-4069-9a44-29169162350b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:20.729700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6b655660-e1fe-4069-9a44-29169162350b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:20.729700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6b655660-e1fe-4069-9a44-29169162350b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:20.911993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-31d8809f-9293-406d-9869-a26177bb036d req-36d937ab-a1a3-416b-8a06-3fe4a498b71b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "tag": "61b2868e-0dad-46f9-8275-e618419765f6"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:58:20.935849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-31d8809f-9293-406d-9869-a26177bb036d req-36d937ab-a1a3-416b-8a06-3fe4a498b71b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:20.940891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-31d8809f-9293-406d-9869-a26177bb036d req-36d937ab-a1a3-416b-8a06-3fe4a498b71b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:20.965467 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-31d8809f-9293-406d-9869-a26177bb036d req-36d937ab-a1a3-416b-8a06-3fe4a498b71b service nova] Creating event network-changed:61b2868e-0dad-46f9-8275-e618419765f6 for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 04:58:20.979628 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-31d8809f-9293-406d-9869-a26177bb036d req-36d937ab-a1a3-416b-8a06-3fe4a498b71b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079502 May 28 04:58:20.986275 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2702/5517] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:58:21.014116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9277240b-acb7-4ec5-8c52-8f7f16f779ee tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:21.018438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9277240b-acb7-4ec5-8c52-8f7f16f779ee tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:21.044674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9277240b-acb7-4ec5-8c52-8f7f16f779ee tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:21.045359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9277240b-acb7-4ec5-8c52-8f7f16f779ee tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:21.050018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9277240b-acb7-4ec5-8c52-8f7f16f779ee tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:21.050482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9277240b-acb7-4ec5-8c52-8f7f16f779ee tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:21.858645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9277240b-acb7-4ec5-8c52-8f7f16f779ee tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:21.866795 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9277240b-acb7-4ec5-8c52-8f7f16f779ee tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1691 microversion: 2.1 time: 0.871638 May 28 04:58:21.869412 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2703/5518] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:20 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1691 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:21.932269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ce7b9bfc-42fd-4767-ba22-2089887dc444 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:58:21.933762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ce7b9bfc-42fd-4767-ba22-2089887dc444 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:21.947250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce7b9bfc-42fd-4767-ba22-2089887dc444 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:21.947924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce7b9bfc-42fd-4767-ba22-2089887dc444 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:21.948910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce7b9bfc-42fd-4767-ba22-2089887dc444 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:21.953881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce7b9bfc-42fd-4767-ba22-2089887dc444 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:22.011742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-ce7b9bfc-42fd-4767-ba22-2089887dc444 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lazy-loading 'flavor' on Instance uuid d9317fed-13ab-4242-843f-ef74497895e1 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:58:22.162668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6b655660-e1fe-4069-9a44-29169162350b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:22.179599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6b655660-e1fe-4069-9a44-29169162350b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:22.181495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6b655660-e1fe-4069-9a44-29169162350b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:22.183098 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6b655660-e1fe-4069-9a44-29169162350b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1886 microversion: 2.32 time: 1.469146 May 28 04:58:22.184457 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2816/5519] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:20 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1886 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:22.699569 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ce7b9bfc-42fd-4767-ba22-2089887dc444 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "POST /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/action" status: 200 len: 32 microversion: 2.1 time: 0.772063 May 28 04:58:22.700204 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2704/5520] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:58:21 2022] POST /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/action => generated 32 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 04:58:22.715134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-42b53a98-6ae3-4a46-a391-7af701fc73fd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:22.716151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-42b53a98-6ae3-4a46-a391-7af701fc73fd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:22.733733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42b53a98-6ae3-4a46-a391-7af701fc73fd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:22.743203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42b53a98-6ae3-4a46-a391-7af701fc73fd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:22.744821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42b53a98-6ae3-4a46-a391-7af701fc73fd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:22.746537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42b53a98-6ae3-4a46-a391-7af701fc73fd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:22.887031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b9c85421-1e65-43b6-953b-6d194dd0fa48 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:22.888789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b9c85421-1e65-43b6-953b-6d194dd0fa48 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:22.901289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9c85421-1e65-43b6-953b-6d194dd0fa48 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:22.904786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9c85421-1e65-43b6-953b-6d194dd0fa48 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:22.907426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9c85421-1e65-43b6-953b-6d194dd0fa48 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:22.910840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9c85421-1e65-43b6-953b-6d194dd0fa48 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:23.654418 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-42b53a98-6ae3-4a46-a391-7af701fc73fd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:23.668965 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-42b53a98-6ae3-4a46-a391-7af701fc73fd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1733 microversion: 2.1 time: 0.959166 May 28 04:58:23.684680 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2817/5521] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:22 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1733 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:23.695036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-281f8b82-ae96-452e-9b92-8c5f5b0a72ad tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:23.697224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b9c85421-1e65-43b6-953b-6d194dd0fa48 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:23.701214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-281f8b82-ae96-452e-9b92-8c5f5b0a72ad tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:23.706745 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b9c85421-1e65-43b6-953b-6d194dd0fa48 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1681 microversion: 2.1 time: 0.824416 May 28 04:58:23.712111 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2705/5522] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:22 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1681 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:58:23.732999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-281f8b82-ae96-452e-9b92-8c5f5b0a72ad tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:23.732999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-281f8b82-ae96-452e-9b92-8c5f5b0a72ad tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:23.733275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-40cff665-6048-415b-95af-b116b82f69cf tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:23.733700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-40cff665-6048-415b-95af-b116b82f69cf tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:23.734743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-281f8b82-ae96-452e-9b92-8c5f5b0a72ad tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:23.735658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-281f8b82-ae96-452e-9b92-8c5f5b0a72ad tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:23.746272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40cff665-6048-415b-95af-b116b82f69cf tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:23.747449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40cff665-6048-415b-95af-b116b82f69cf tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:23.748520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40cff665-6048-415b-95af-b116b82f69cf tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:23.750812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40cff665-6048-415b-95af-b116b82f69cf tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:24.816071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-281f8b82-ae96-452e-9b92-8c5f5b0a72ad tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:24.824130 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-40cff665-6048-415b-95af-b116b82f69cf tempest-TestNetworkAdvancedServerOps-983843453 tempest-TestNetworkAdvancedServerOps-983843453-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1832 microversion: 2.1 time: 1.095253 May 28 04:58:24.830710 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2706/5523] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:23 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1832 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:24.835835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1b476b8f-5144-446a-93b8-25daae1ac707 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:24.838741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-281f8b82-ae96-452e-9b92-8c5f5b0a72ad tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:24.840718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-281f8b82-ae96-452e-9b92-8c5f5b0a72ad tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:24.843166 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-281f8b82-ae96-452e-9b92-8c5f5b0a72ad tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1886 microversion: 2.32 time: 1.155933 May 28 04:58:24.845204 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2818/5524] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:23 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1886 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:24.847871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1b476b8f-5144-446a-93b8-25daae1ac707 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:24.852847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4fb58102-fdf4-498f-890a-5f8d57289445 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:24.855967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4fb58102-fdf4-498f-890a-5f8d57289445 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:24.859366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b476b8f-5144-446a-93b8-25daae1ac707 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:24.859829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b476b8f-5144-446a-93b8-25daae1ac707 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:24.868872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fb58102-fdf4-498f-890a-5f8d57289445 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:24.869346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fb58102-fdf4-498f-890a-5f8d57289445 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:24.871384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b476b8f-5144-446a-93b8-25daae1ac707 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:24.871854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b476b8f-5144-446a-93b8-25daae1ac707 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:24.873496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fb58102-fdf4-498f-890a-5f8d57289445 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:24.874258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fb58102-fdf4-498f-890a-5f8d57289445 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:25.559027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4fb58102-fdf4-498f-890a-5f8d57289445 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:25.569372 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4fb58102-fdf4-498f-890a-5f8d57289445 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1681 microversion: 2.1 time: 0.722816 May 28 04:58:25.573336 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2819/5525] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:24 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1681 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:25.862423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-82d3e552-00fa-49b0-8d34-728411aee076 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:25.866684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-82d3e552-00fa-49b0-8d34-728411aee076 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:25.872010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1b476b8f-5144-446a-93b8-25daae1ac707 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:25.883906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82d3e552-00fa-49b0-8d34-728411aee076 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:25.884583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82d3e552-00fa-49b0-8d34-728411aee076 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:25.885412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82d3e552-00fa-49b0-8d34-728411aee076 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:25.885905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82d3e552-00fa-49b0-8d34-728411aee076 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:25.895903 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1b476b8f-5144-446a-93b8-25daae1ac707 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1733 microversion: 2.1 time: 1.056442 May 28 04:58:25.896654 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2707/5526] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:24 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1733 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:25.997640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bcbf8a77-c4ea-4248-b574-51f173885271 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:58:26.003560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bcbf8a77-c4ea-4248-b574-51f173885271 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:26.029587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bcbf8a77-c4ea-4248-b574-51f173885271 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:26.031572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bcbf8a77-c4ea-4248-b574-51f173885271 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:26.032888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bcbf8a77-c4ea-4248-b574-51f173885271 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:26.038699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bcbf8a77-c4ea-4248-b574-51f173885271 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:26.128591 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bcbf8a77-c4ea-4248-b574-51f173885271 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044/action" status: 200 len: 38628 microversion: 2.1 time: 0.137989 May 28 04:58:26.136449 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2708/5527] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:58:25 2022] POST /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044/action => generated 38628 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 04:58:26.583644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-615af496-04f0-44b6-b9c7-107d4c782b01 req-ea3af86a-a637-4797-a2e5-005dd799881d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "tag": "957dc55b-f873-4efe-bcf8-2621e22f7c67"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:58:26.611942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-615af496-04f0-44b6-b9c7-107d4c782b01 req-ea3af86a-a637-4797-a2e5-005dd799881d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:26.613118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-615af496-04f0-44b6-b9c7-107d4c782b01 req-ea3af86a-a637-4797-a2e5-005dd799881d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:26.638898 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-615af496-04f0-44b6-b9c7-107d4c782b01 req-ea3af86a-a637-4797-a2e5-005dd799881d service nova] Creating event network-changed:957dc55b-f873-4efe-bcf8-2621e22f7c67 for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 04:58:26.649014 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-615af496-04f0-44b6-b9c7-107d4c782b01 req-ea3af86a-a637-4797-a2e5-005dd799881d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071833 May 28 04:58:26.651799 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2709/5528] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:58:26.918045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-921cf2e0-a91a-41a0-a60e-f1df75a9a24f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:26.919546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-921cf2e0-a91a-41a0-a60e-f1df75a9a24f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:26.938385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-921cf2e0-a91a-41a0-a60e-f1df75a9a24f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:26.945119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-921cf2e0-a91a-41a0-a60e-f1df75a9a24f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:26.946495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-921cf2e0-a91a-41a0-a60e-f1df75a9a24f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:26.947294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-921cf2e0-a91a-41a0-a60e-f1df75a9a24f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:27.282594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-82d3e552-00fa-49b0-8d34-728411aee076 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:27.300414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-82d3e552-00fa-49b0-8d34-728411aee076 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:27.307523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-82d3e552-00fa-49b0-8d34-728411aee076 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:27.309013 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-82d3e552-00fa-49b0-8d34-728411aee076 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1886 microversion: 2.32 time: 1.451220 May 28 04:58:27.309592 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2820/5529] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:25 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1886 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:58:28.331096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f77a9384-d4c7-48b8-9bbc-af5024a6cdba tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:28.332435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f77a9384-d4c7-48b8-9bbc-af5024a6cdba tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:28.357471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f77a9384-d4c7-48b8-9bbc-af5024a6cdba tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:28.365330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f77a9384-d4c7-48b8-9bbc-af5024a6cdba tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:28.366303 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f77a9384-d4c7-48b8-9bbc-af5024a6cdba tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:28.366769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f77a9384-d4c7-48b8-9bbc-af5024a6cdba tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:28.510457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-921cf2e0-a91a-41a0-a60e-f1df75a9a24f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:28.524117 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-921cf2e0-a91a-41a0-a60e-f1df75a9a24f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1733 microversion: 2.1 time: 1.613622 May 28 04:58:28.526008 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2710/5530] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:26 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1733 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:29.069751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-8aef2492-9aa4-4c77-90dc-0c12f3034d73 req-d41b3f72-897c-433d-ae9f-017543711057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "tag": "6ee64452-58e9-4d01-9ea8-79160a3e1c92"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:58:29.085749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8aef2492-9aa4-4c77-90dc-0c12f3034d73 req-d41b3f72-897c-433d-ae9f-017543711057 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:29.086210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8aef2492-9aa4-4c77-90dc-0c12f3034d73 req-d41b3f72-897c-433d-ae9f-017543711057 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:29.109802 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-8aef2492-9aa4-4c77-90dc-0c12f3034d73 req-d41b3f72-897c-433d-ae9f-017543711057 service nova] Creating event network-changed:6ee64452-58e9-4d01-9ea8-79160a3e1c92 for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 04:58:29.160080 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-8aef2492-9aa4-4c77-90dc-0c12f3034d73 req-d41b3f72-897c-433d-ae9f-017543711057 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095000 May 28 04:58:29.163539 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2711/5531] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:58:29.547743 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-350a18e1-41bf-40bf-83c4-182d84855d6e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:29.555911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-350a18e1-41bf-40bf-83c4-182d84855d6e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:29.572099 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-350a18e1-41bf-40bf-83c4-182d84855d6e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:29.572921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-350a18e1-41bf-40bf-83c4-182d84855d6e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:29.576579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-350a18e1-41bf-40bf-83c4-182d84855d6e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:29.577436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-350a18e1-41bf-40bf-83c4-182d84855d6e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:29.872448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f77a9384-d4c7-48b8-9bbc-af5024a6cdba tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:29.889431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f77a9384-d4c7-48b8-9bbc-af5024a6cdba tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:29.893916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f77a9384-d4c7-48b8-9bbc-af5024a6cdba tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:29.895198 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f77a9384-d4c7-48b8-9bbc-af5024a6cdba tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1886 microversion: 2.32 time: 1.570666 May 28 04:58:29.899897 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2821/5532] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:28 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1886 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:30.918647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-24ba44fa-ba9c-4ff6-a278-3fa17e02ce25 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:30.919525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-24ba44fa-ba9c-4ff6-a278-3fa17e02ce25 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:30.932790 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24ba44fa-ba9c-4ff6-a278-3fa17e02ce25 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:30.936012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24ba44fa-ba9c-4ff6-a278-3fa17e02ce25 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:30.941044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24ba44fa-ba9c-4ff6-a278-3fa17e02ce25 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:30.941849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24ba44fa-ba9c-4ff6-a278-3fa17e02ce25 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:31.949695 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-350a18e1-41bf-40bf-83c4-182d84855d6e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:31.962237 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-350a18e1-41bf-40bf-83c4-182d84855d6e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1733 microversion: 2.1 time: 2.422373 May 28 04:58:31.966604 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2712/5533] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:29 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1733 bytes in 2428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:32.424236 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-24ba44fa-ba9c-4ff6-a278-3fa17e02ce25 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:32.437999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-24ba44fa-ba9c-4ff6-a278-3fa17e02ce25 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:32.441008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-24ba44fa-ba9c-4ff6-a278-3fa17e02ce25 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:32.443439 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-24ba44fa-ba9c-4ff6-a278-3fa17e02ce25 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1886 microversion: 2.32 time: 1.529602 May 28 04:58:32.445597 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2822/5534] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:30 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1886 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:32.875977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-278cd2be-2909-4cf7-b8b3-2871809c98cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:32.875977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-278cd2be-2909-4cf7-b8b3-2871809c98cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:32.887452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-09a2715c-fbb3-4c57-b2e5-4bb14a80d56e req-a1c10696-2d0f-4e01-90bf-71ff7556408b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cb86d59-cc4a-4fa1-a3e2-07d535ddb044", "tag": "c98c716b-3208-4e40-870a-b2c59f465c7c"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:58:32.908849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-278cd2be-2909-4cf7-b8b3-2871809c98cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:32.909403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-278cd2be-2909-4cf7-b8b3-2871809c98cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:32.913140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-09a2715c-fbb3-4c57-b2e5-4bb14a80d56e req-a1c10696-2d0f-4e01-90bf-71ff7556408b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:32.913594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-09a2715c-fbb3-4c57-b2e5-4bb14a80d56e req-a1c10696-2d0f-4e01-90bf-71ff7556408b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:32.914793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-278cd2be-2909-4cf7-b8b3-2871809c98cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:32.916619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-278cd2be-2909-4cf7-b8b3-2871809c98cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:32.978466 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-09a2715c-fbb3-4c57-b2e5-4bb14a80d56e req-a1c10696-2d0f-4e01-90bf-71ff7556408b service nova] Creating event network-changed:c98c716b-3208-4e40-870a-b2c59f465c7c for instance 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 on n-h2-843700-1 May 28 04:58:32.994860 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-09a2715c-fbb3-4c57-b2e5-4bb14a80d56e req-a1c10696-2d0f-4e01-90bf-71ff7556408b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111846 May 28 04:58:33.011260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:58:33.017140 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2823/5535] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:58:33.031605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-278cd2be-2909-4cf7-b8b3-2871809c98cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:58:33.035242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fe3697d5-d17c-4167-bf26-e2845f9a822b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:33.037423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fe3697d5-d17c-4167-bf26-e2845f9a822b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:33.058346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe3697d5-d17c-4167-bf26-e2845f9a822b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:33.062423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe3697d5-d17c-4167-bf26-e2845f9a822b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:33.063487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe3697d5-d17c-4167-bf26-e2845f9a822b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:33.065326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe3697d5-d17c-4167-bf26-e2845f9a822b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:33.474933 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-278cd2be-2909-4cf7-b8b3-2871809c98cc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 204 len: 0 microversion: 2.1 time: 0.611599 May 28 04:58:33.475994 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2713/5536] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:58:32 2022] DELETE /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:58:33.488107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0768ed4b-1762-4370-91a0-83977ba4d6d9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:33.489009 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0768ed4b-1762-4370-91a0-83977ba4d6d9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:33.515549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0768ed4b-1762-4370-91a0-83977ba4d6d9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:33.515549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0768ed4b-1762-4370-91a0-83977ba4d6d9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:33.519175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0768ed4b-1762-4370-91a0-83977ba4d6d9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:33.526036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0768ed4b-1762-4370-91a0-83977ba4d6d9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:33.828982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fe3697d5-d17c-4167-bf26-e2845f9a822b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:33.845938 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fe3697d5-d17c-4167-bf26-e2845f9a822b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1733 microversion: 2.1 time: 0.826556 May 28 04:58:33.846818 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2824/5537] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:33 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1733 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:33.865924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-223b0020-5bb5-4fcc-8a6f-85927cd2ed9f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:33.868849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-223b0020-5bb5-4fcc-8a6f-85927cd2ed9f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:33.887438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-223b0020-5bb5-4fcc-8a6f-85927cd2ed9f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:33.889368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-223b0020-5bb5-4fcc-8a6f-85927cd2ed9f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:33.894293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-223b0020-5bb5-4fcc-8a6f-85927cd2ed9f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:33.894750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-223b0020-5bb5-4fcc-8a6f-85927cd2ed9f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:34.174878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-223b0020-5bb5-4fcc-8a6f-85927cd2ed9f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:34.186027 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-223b0020-5bb5-4fcc-8a6f-85927cd2ed9f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1687 microversion: 2.1 time: 0.336685 May 28 04:58:34.190178 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2825/5538] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:33 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1687 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:34.514490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0768ed4b-1762-4370-91a0-83977ba4d6d9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:34.547392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0768ed4b-1762-4370-91a0-83977ba4d6d9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:34.549163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0768ed4b-1762-4370-91a0-83977ba4d6d9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:34.554754 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0768ed4b-1762-4370-91a0-83977ba4d6d9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1886 microversion: 2.32 time: 1.077234 May 28 04:58:34.567050 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2714/5539] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:33 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1886 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:34.862505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1677d025-7a17-415b-91fa-39c705cf2de2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:34.864244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1677d025-7a17-415b-91fa-39c705cf2de2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:34.874861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1677d025-7a17-415b-91fa-39c705cf2de2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:34.875630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1677d025-7a17-415b-91fa-39c705cf2de2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:34.884312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1677d025-7a17-415b-91fa-39c705cf2de2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:34.885071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1677d025-7a17-415b-91fa-39c705cf2de2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:35.079199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-a3beb243-d72a-4a78-8487-38d4afdf8116 req-f7c28da8-44c0-4dec-84fd-949dbaad24ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "tag": "8031bb99-e01d-435c-86af-766fd0b45f7c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:58:35.092665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a3beb243-d72a-4a78-8487-38d4afdf8116 req-f7c28da8-44c0-4dec-84fd-949dbaad24ba service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:35.093123 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a3beb243-d72a-4a78-8487-38d4afdf8116 req-f7c28da8-44c0-4dec-84fd-949dbaad24ba service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:35.144271 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-a3beb243-d72a-4a78-8487-38d4afdf8116 req-f7c28da8-44c0-4dec-84fd-949dbaad24ba service nova] Creating event network-changed:8031bb99-e01d-435c-86af-766fd0b45f7c for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 04:58:35.149993 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-a3beb243-d72a-4a78-8487-38d4afdf8116 req-f7c28da8-44c0-4dec-84fd-949dbaad24ba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075900 May 28 04:58:35.151109 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2715/5540] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 28 04:58:35.212826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c4dd9205-7e4b-4643-bb9f-2416886a8ec7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:35.213554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c4dd9205-7e4b-4643-bb9f-2416886a8ec7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:35.226415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c4dd9205-7e4b-4643-bb9f-2416886a8ec7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:35.226888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c4dd9205-7e4b-4643-bb9f-2416886a8ec7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:35.227719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c4dd9205-7e4b-4643-bb9f-2416886a8ec7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:35.228275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c4dd9205-7e4b-4643-bb9f-2416886a8ec7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:36.360349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1677d025-7a17-415b-91fa-39c705cf2de2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:36.383598 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1677d025-7a17-415b-91fa-39c705cf2de2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1733 microversion: 2.1 time: 1.524898 May 28 04:58:36.384121 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2826/5541] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:34 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1733 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:36.420928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9fd95ab2-4e56-4337-ae8e-0777458901b1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:36.427970 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9fd95ab2-4e56-4337-ae8e-0777458901b1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:36.443377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c4dd9205-7e4b-4643-bb9f-2416886a8ec7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:36.446563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fd95ab2-4e56-4337-ae8e-0777458901b1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:36.449532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fd95ab2-4e56-4337-ae8e-0777458901b1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:36.452646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fd95ab2-4e56-4337-ae8e-0777458901b1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:36.458118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fd95ab2-4e56-4337-ae8e-0777458901b1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:36.460691 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c4dd9205-7e4b-4643-bb9f-2416886a8ec7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1687 microversion: 2.1 time: 1.255740 May 28 04:58:36.463186 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2716/5542] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:35 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1687 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:37.402323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d555648b-e557-456d-9d8b-c7d4f3f66d2e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:37.403239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d555648b-e557-456d-9d8b-c7d4f3f66d2e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:37.420789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d555648b-e557-456d-9d8b-c7d4f3f66d2e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:37.421650 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d555648b-e557-456d-9d8b-c7d4f3f66d2e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:37.423556 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d555648b-e557-456d-9d8b-c7d4f3f66d2e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:37.424540 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d555648b-e557-456d-9d8b-c7d4f3f66d2e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:37.778515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9fd95ab2-4e56-4337-ae8e-0777458901b1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:37.802277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9fd95ab2-4e56-4337-ae8e-0777458901b1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:37.806832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9fd95ab2-4e56-4337-ae8e-0777458901b1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:37.811685 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9fd95ab2-4e56-4337-ae8e-0777458901b1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1886 microversion: 2.32 time: 1.413194 May 28 04:58:37.815395 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2827/5543] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:36 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1886 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:37.825520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1f16396e-e07e-46bc-af53-da4e125ad3c5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:37.826295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1f16396e-e07e-46bc-af53-da4e125ad3c5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:37.846522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f16396e-e07e-46bc-af53-da4e125ad3c5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:37.848355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f16396e-e07e-46bc-af53-da4e125ad3c5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:37.851064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f16396e-e07e-46bc-af53-da4e125ad3c5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:37.853366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f16396e-e07e-46bc-af53-da4e125ad3c5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:38.020709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1f16396e-e07e-46bc-af53-da4e125ad3c5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:38.034623 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1f16396e-e07e-46bc-af53-da4e125ad3c5 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1502 microversion: 2.1 time: 0.217938 May 28 04:58:38.038694 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2828/5544] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:37 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1502 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:38.208212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d555648b-e557-456d-9d8b-c7d4f3f66d2e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:38.230707 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d555648b-e557-456d-9d8b-c7d4f3f66d2e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1733 microversion: 2.1 time: 0.821939 May 28 04:58:38.234043 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2717/5545] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:37 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1733 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:58:38.638320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-4da6354b-d870-45fb-928d-c73a76a93e2d req-6fd1ef7c-bd04-4ac9-ab03-0195d6f78fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "tag": "01a910c0-bb8d-4131-b876-19533c7842f6"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:58:38.664161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-4da6354b-d870-45fb-928d-c73a76a93e2d req-6fd1ef7c-bd04-4ac9-ab03-0195d6f78fba service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:38.667549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-4da6354b-d870-45fb-928d-c73a76a93e2d req-6fd1ef7c-bd04-4ac9-ab03-0195d6f78fba service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:38.705918 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-4da6354b-d870-45fb-928d-c73a76a93e2d req-6fd1ef7c-bd04-4ac9-ab03-0195d6f78fba service nova] Creating event network-changed:01a910c0-bb8d-4131-b876-19533c7842f6 for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 04:58:38.717475 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-4da6354b-d870-45fb-928d-c73a76a93e2d req-6fd1ef7c-bd04-4ac9-ab03-0195d6f78fba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086777 May 28 04:58:38.721455 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2829/5546] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:58:38.830884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8ef1efc7-dd0a-46a2-adef-2ae24a7942b7 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:38.831521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8ef1efc7-dd0a-46a2-adef-2ae24a7942b7 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:38.844909 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ef1efc7-dd0a-46a2-adef-2ae24a7942b7 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:38.846493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ef1efc7-dd0a-46a2-adef-2ae24a7942b7 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:38.847335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ef1efc7-dd0a-46a2-adef-2ae24a7942b7 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:38.847779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ef1efc7-dd0a-46a2-adef-2ae24a7942b7 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:39.055887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d2c9dd35-4658-4ef4-ac43-207433834966 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:39.057329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d2c9dd35-4658-4ef4-ac43-207433834966 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:39.075137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d2c9dd35-4658-4ef4-ac43-207433834966 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:39.080324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d2c9dd35-4658-4ef4-ac43-207433834966 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:39.080324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d2c9dd35-4658-4ef4-ac43-207433834966 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:39.080324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d2c9dd35-4658-4ef4-ac43-207433834966 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:39.131403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:58:39.703134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d2c9dd35-4658-4ef4-ac43-207433834966 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:39.716054 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d2c9dd35-4658-4ef4-ac43-207433834966 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 200 len: 1502 microversion: 2.1 time: 0.662096 May 28 04:58:39.717048 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2830/5547] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:39 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 1502 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:58:39.741212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-47971c3d-1641-4783-bed5-0144a6818b91 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:39.744795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-47971c3d-1641-4783-bed5-0144a6818b91 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:39.756150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47971c3d-1641-4783-bed5-0144a6818b91 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:39.756612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47971c3d-1641-4783-bed5-0144a6818b91 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:39.757447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47971c3d-1641-4783-bed5-0144a6818b91 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:39.757887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47971c3d-1641-4783-bed5-0144a6818b91 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:39.978499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8ef1efc7-dd0a-46a2-adef-2ae24a7942b7 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:39.994854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8ef1efc7-dd0a-46a2-adef-2ae24a7942b7 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:40.000198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8ef1efc7-dd0a-46a2-adef-2ae24a7942b7 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:40.004657 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8ef1efc7-dd0a-46a2-adef-2ae24a7942b7 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1886 microversion: 2.32 time: 1.176035 May 28 04:58:40.008501 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2718/5548] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:38 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1886 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:40.018749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-95f50059-a903-4ee5-b3fc-61cb15bda636 req-95a5b731-074a-4739-b692-95b4b422a642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb86d59-cc4a-4fa1-a3e2-07d535ddb044", "name": "network-vif-deleted", "tag": "c98c716b-3208-4e40-870a-b2c59f465c7c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:58:40.037486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-95f50059-a903-4ee5-b3fc-61cb15bda636 req-95a5b731-074a-4739-b692-95b4b422a642 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:40.042962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-95f50059-a903-4ee5-b3fc-61cb15bda636 req-95a5b731-074a-4739-b692-95b4b422a642 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:40.063309 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-95f50059-a903-4ee5-b3fc-61cb15bda636 req-95a5b731-074a-4739-b692-95b4b422a642 service nova] Creating event network-vif-deleted:c98c716b-3208-4e40-870a-b2c59f465c7c for instance 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 on n-h2-843700-1 May 28 04:58:40.075934 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-95f50059-a903-4ee5-b3fc-61cb15bda636 req-95a5b731-074a-4739-b692-95b4b422a642 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068295 May 28 04:58:40.078719 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2719/5549] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:58:40.264075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-47971c3d-1641-4783-bed5-0144a6818b91 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:40.313182 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-47971c3d-1641-4783-bed5-0144a6818b91 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1733 microversion: 2.1 time: 0.593153 May 28 04:58:40.314136 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2831/5550] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:39 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1733 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:40.736800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-444a6755-1ba7-4e53-b9fe-e7e363e405c9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:40.740384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-444a6755-1ba7-4e53-b9fe-e7e363e405c9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:40.762677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-444a6755-1ba7-4e53-b9fe-e7e363e405c9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:40.763185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-444a6755-1ba7-4e53-b9fe-e7e363e405c9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:40.763974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-444a6755-1ba7-4e53-b9fe-e7e363e405c9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:40.766544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-444a6755-1ba7-4e53-b9fe-e7e363e405c9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:40.803249 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-444a6755-1ba7-4e53-b9fe-e7e363e405c9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] HTTP exception thrown: Instance 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 could not be found. May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-444a6755-1ba7-4e53-b9fe-e7e363e405c9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Request method failure captured: May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 HTTP/1.1 May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaoQYQchrh2XakGGrNw11ys5UQs4OXIf9xMNV-20af4LsMX_Su4KFUIfZemhe-Tzn-w4pVHjS_smiI_SiLygbVF215cZ7DSG83uVMXJbfi_bMltF9zMlgcj2MGtyWWf07NkL17iAcfEzeiladbpIl0-FrLXe9iLR4H4noFpN95vJXZI May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d14e7de3a28f42a79197e1c06c4676dd May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2101778381 May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d14e7de3a28f42a79197e1c06c4676dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d14e7de3a28f42a79197e1c06c4676dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d14e7de3a28f42a79197e1c06c4676dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d14e7de3a28f42a79197e1c06c4676dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2101778381 May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d14e7de3a28f42a79197e1c06c4676dd May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2101778381 May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestNetworkAdvancedServerOps-2101778381-project May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 82b17444b87742e1b45409810cbe06d2 May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2101778381-project May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 could not be found. May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '7cb86d59-cc4a-4fa1-a3e2-07d535ddb044'} May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 could not be found. May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 could not be found. May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:58:40.809622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:58:40.815383 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:58:40.815383 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:58:40.815383 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:58:40.815383 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:58:40.815383 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:58:40.815383 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:58:40.815383 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 could not be found. May 28 04:58:40.815383 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:58:40.818534 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-444a6755-1ba7-4e53-b9fe-e7e363e405c9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Returning 404 to user: Instance 7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:58:40.819803 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-444a6755-1ba7-4e53-b9fe-e7e363e405c9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044" status: 404 len: 111 microversion: 2.1 time: 0.089811 May 28 04:58:40.823232 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2720/5551] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:40 2022] GET /compute/v2.1/servers/7cb86d59-cc4a-4fa1-a3e2-07d535ddb044 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 04:58:41.024944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-754d7e22-d7ab-44a0-b223-2ed34d5f90a1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:41.025582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-754d7e22-d7ab-44a0-b223-2ed34d5f90a1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:41.049228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-754d7e22-d7ab-44a0-b223-2ed34d5f90a1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:41.051676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-754d7e22-d7ab-44a0-b223-2ed34d5f90a1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:41.053406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-754d7e22-d7ab-44a0-b223-2ed34d5f90a1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:41.053993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-754d7e22-d7ab-44a0-b223-2ed34d5f90a1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:41.331200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-40b3c617-98f0-4be3-a201-2ce99c4b9240 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:41.331831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-40b3c617-98f0-4be3-a201-2ce99c4b9240 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:41.345149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40b3c617-98f0-4be3-a201-2ce99c4b9240 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:41.346397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40b3c617-98f0-4be3-a201-2ce99c4b9240 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:41.350241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40b3c617-98f0-4be3-a201-2ce99c4b9240 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:41.351994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40b3c617-98f0-4be3-a201-2ce99c4b9240 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:41.670878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-754d7e22-d7ab-44a0-b223-2ed34d5f90a1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:41.683022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-754d7e22-d7ab-44a0-b223-2ed34d5f90a1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:41.689472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-754d7e22-d7ab-44a0-b223-2ed34d5f90a1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:41.695744 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-754d7e22-d7ab-44a0-b223-2ed34d5f90a1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1886 microversion: 2.32 time: 0.675536 May 28 04:58:41.696583 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2832/5552] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:41 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1886 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:42.422136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-40b3c617-98f0-4be3-a201-2ce99c4b9240 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:42.440316 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-40b3c617-98f0-4be3-a201-2ce99c4b9240 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1733 microversion: 2.1 time: 1.111720 May 28 04:58:42.442663 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2721/5553] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:41 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1733 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:58:42.715600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c89c1560-a0b2-47b5-974d-dae5cab07a1d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:42.716790 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c89c1560-a0b2-47b5-974d-dae5cab07a1d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:42.726268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c89c1560-a0b2-47b5-974d-dae5cab07a1d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:42.726960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c89c1560-a0b2-47b5-974d-dae5cab07a1d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:42.728134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c89c1560-a0b2-47b5-974d-dae5cab07a1d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:42.734884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c89c1560-a0b2-47b5-974d-dae5cab07a1d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:43.307195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c89c1560-a0b2-47b5-974d-dae5cab07a1d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:43.321138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c89c1560-a0b2-47b5-974d-dae5cab07a1d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:43.324711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c89c1560-a0b2-47b5-974d-dae5cab07a1d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:43.326903 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c89c1560-a0b2-47b5-974d-dae5cab07a1d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1886 microversion: 2.32 time: 0.613920 May 28 04:58:43.327595 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2833/5554] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:42 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1886 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:43.462891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1ddb7594-f682-4837-9389-62894e051e2c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:43.464346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1ddb7594-f682-4837-9389-62894e051e2c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:43.473760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ddb7594-f682-4837-9389-62894e051e2c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:43.474489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ddb7594-f682-4837-9389-62894e051e2c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:43.475880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ddb7594-f682-4837-9389-62894e051e2c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:43.476521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ddb7594-f682-4837-9389-62894e051e2c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:44.188148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1ddb7594-f682-4837-9389-62894e051e2c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:44.200790 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1ddb7594-f682-4837-9389-62894e051e2c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1733 microversion: 2.1 time: 0.743701 May 28 04:58:44.213207 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2722/5555] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:43 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1733 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:44.348239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3ec1fa18-f9de-4e97-badf-78131992e2fc tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:44.354459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3ec1fa18-f9de-4e97-badf-78131992e2fc tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:44.367462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ec1fa18-f9de-4e97-badf-78131992e2fc tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:44.369533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ec1fa18-f9de-4e97-badf-78131992e2fc tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:44.371239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ec1fa18-f9de-4e97-badf-78131992e2fc tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:44.372884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ec1fa18-f9de-4e97-badf-78131992e2fc tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:45.219574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a6630d88-b153-47a2-822c-b81a04198810 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:45.220767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a6630d88-b153-47a2-822c-b81a04198810 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:45.232926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:58:45.238347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6630d88-b153-47a2-822c-b81a04198810 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:45.238795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6630d88-b153-47a2-822c-b81a04198810 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:45.243542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6630d88-b153-47a2-822c-b81a04198810 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:45.244136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6630d88-b153-47a2-822c-b81a04198810 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:45.328371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3ec1fa18-f9de-4e97-badf-78131992e2fc tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:45.353412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3ec1fa18-f9de-4e97-badf-78131992e2fc tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:45.356392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3ec1fa18-f9de-4e97-badf-78131992e2fc tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:45.358215 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3ec1fa18-f9de-4e97-badf-78131992e2fc tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1886 microversion: 2.32 time: 1.016466 May 28 04:58:45.360025 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2834/5556] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:44 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1886 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:46.378165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a6fd14b0-7693-49aa-9f06-1ba6338685fa tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:46.381168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a6fd14b0-7693-49aa-9f06-1ba6338685fa tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:46.390466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=48 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:58:46.400522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6fd14b0-7693-49aa-9f06-1ba6338685fa tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:46.400989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6fd14b0-7693-49aa-9f06-1ba6338685fa tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:46.401822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6fd14b0-7693-49aa-9f06-1ba6338685fa tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:46.402270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6fd14b0-7693-49aa-9f06-1ba6338685fa tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:46.733104 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a6630d88-b153-47a2-822c-b81a04198810 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:46.747072 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a6630d88-b153-47a2-822c-b81a04198810 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1733 microversion: 2.1 time: 1.531498 May 28 04:58:46.760924 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2723/5557] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:45 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1733 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:58:47.070473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a6fd14b0-7693-49aa-9f06-1ba6338685fa tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:47.089639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a6fd14b0-7693-49aa-9f06-1ba6338685fa tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:47.091745 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a6fd14b0-7693-49aa-9f06-1ba6338685fa tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:47.101298 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a6fd14b0-7693-49aa-9f06-1ba6338685fa tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1886 microversion: 2.32 time: 0.724484 May 28 04:58:47.102384 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2835/5558] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:46 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1886 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:58:47.769697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cf655453-6e88-4d31-86f7-cde55ed6e3d0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:47.770630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cf655453-6e88-4d31-86f7-cde55ed6e3d0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:47.784918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf655453-6e88-4d31-86f7-cde55ed6e3d0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:47.788886 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf655453-6e88-4d31-86f7-cde55ed6e3d0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:47.793021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf655453-6e88-4d31-86f7-cde55ed6e3d0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:47.793501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf655453-6e88-4d31-86f7-cde55ed6e3d0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:48.125444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9196b11e-4d23-4418-bf65-ec831ad0c1bd tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:48.136521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9196b11e-4d23-4418-bf65-ec831ad0c1bd tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:48.154358 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9196b11e-4d23-4418-bf65-ec831ad0c1bd tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:48.154845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9196b11e-4d23-4418-bf65-ec831ad0c1bd tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:48.158675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9196b11e-4d23-4418-bf65-ec831ad0c1bd tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:48.158675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9196b11e-4d23-4418-bf65-ec831ad0c1bd tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:48.578242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cf655453-6e88-4d31-86f7-cde55ed6e3d0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:48.590213 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cf655453-6e88-4d31-86f7-cde55ed6e3d0 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1733 microversion: 2.1 time: 0.825044 May 28 04:58:48.597759 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2724/5559] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:47 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1733 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:48.784396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9196b11e-4d23-4418-bf65-ec831ad0c1bd tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:48.793729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9196b11e-4d23-4418-bf65-ec831ad0c1bd tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:48.795379 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9196b11e-4d23-4418-bf65-ec831ad0c1bd tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:48.796578 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9196b11e-4d23-4418-bf65-ec831ad0c1bd tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1886 microversion: 2.32 time: 0.676871 May 28 04:58:48.815560 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2836/5560] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:48 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1886 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:49.619522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c61893cf-2ca7-4c32-baeb-3442f949eff2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:49.620779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c61893cf-2ca7-4c32-baeb-3442f949eff2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:49.636136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c61893cf-2ca7-4c32-baeb-3442f949eff2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:49.644080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c61893cf-2ca7-4c32-baeb-3442f949eff2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:49.644080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c61893cf-2ca7-4c32-baeb-3442f949eff2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:49.644080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c61893cf-2ca7-4c32-baeb-3442f949eff2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:49.816858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9ffe36fb-8127-4676-9484-f27189083d49 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:49.818014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9ffe36fb-8127-4676-9484-f27189083d49 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:49.834591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ffe36fb-8127-4676-9484-f27189083d49 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:49.840296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ffe36fb-8127-4676-9484-f27189083d49 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:49.843222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ffe36fb-8127-4676-9484-f27189083d49 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:49.845300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ffe36fb-8127-4676-9484-f27189083d49 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:51.887930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9ffe36fb-8127-4676-9484-f27189083d49 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:51.904497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9ffe36fb-8127-4676-9484-f27189083d49 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:51.909383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9ffe36fb-8127-4676-9484-f27189083d49 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:51.914300 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9ffe36fb-8127-4676-9484-f27189083d49 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1886 microversion: 2.32 time: 2.101635 May 28 04:58:51.936183 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2837/5561] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:49 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1886 bytes in 2118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:52.249615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c61893cf-2ca7-4c32-baeb-3442f949eff2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:52.265144 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c61893cf-2ca7-4c32-baeb-3442f949eff2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1733 microversion: 2.1 time: 2.654846 May 28 04:58:52.265948 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2725/5562] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:49 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1733 bytes in 2656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:52.934012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6eeff459-849f-4e5e-9340-d379c4590abd tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:52.935225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6eeff459-849f-4e5e-9340-d379c4590abd tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:52.947081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6eeff459-849f-4e5e-9340-d379c4590abd tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:52.951691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6eeff459-849f-4e5e-9340-d379c4590abd tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:52.954333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6eeff459-849f-4e5e-9340-d379c4590abd tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:52.954954 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6eeff459-849f-4e5e-9340-d379c4590abd tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:53.281640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0d6e4a4c-541e-4124-b896-7182332a2787 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:53.282302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0d6e4a4c-541e-4124-b896-7182332a2787 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:53.293748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d6e4a4c-541e-4124-b896-7182332a2787 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:53.294845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d6e4a4c-541e-4124-b896-7182332a2787 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:53.296072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d6e4a4c-541e-4124-b896-7182332a2787 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:53.296684 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d6e4a4c-541e-4124-b896-7182332a2787 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:53.594333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6eeff459-849f-4e5e-9340-d379c4590abd tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:53.605085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6eeff459-849f-4e5e-9340-d379c4590abd tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:53.606586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6eeff459-849f-4e5e-9340-d379c4590abd tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:53.607868 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6eeff459-849f-4e5e-9340-d379c4590abd tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1886 microversion: 2.32 time: 0.678251 May 28 04:58:53.624853 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2838/5563] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:52 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1886 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:53.707630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0d6e4a4c-541e-4124-b896-7182332a2787 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:53.720741 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0d6e4a4c-541e-4124-b896-7182332a2787 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1733 microversion: 2.1 time: 0.442322 May 28 04:58:53.721431 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2726/5564] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:53 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1733 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:58:54.628817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-432d33bf-a5b3-4b56-a094-8a0deb86551d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:54.630378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-432d33bf-a5b3-4b56-a094-8a0deb86551d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:54.639851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-432d33bf-a5b3-4b56-a094-8a0deb86551d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:54.641185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-432d33bf-a5b3-4b56-a094-8a0deb86551d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:54.643523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-432d33bf-a5b3-4b56-a094-8a0deb86551d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:54.644248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-432d33bf-a5b3-4b56-a094-8a0deb86551d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:54.738188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6d9daca2-79d4-4da6-8075-0bc01ded9e95 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:54.738908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6d9daca2-79d4-4da6-8075-0bc01ded9e95 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:54.756036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6d9daca2-79d4-4da6-8075-0bc01ded9e95 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:54.756550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6d9daca2-79d4-4da6-8075-0bc01ded9e95 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:54.757361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6d9daca2-79d4-4da6-8075-0bc01ded9e95 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:54.758187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6d9daca2-79d4-4da6-8075-0bc01ded9e95 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:55.304039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6d9daca2-79d4-4da6-8075-0bc01ded9e95 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:55.312949 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6d9daca2-79d4-4da6-8075-0bc01ded9e95 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1713 microversion: 2.1 time: 0.579105 May 28 04:58:55.314092 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2727/5565] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:54 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1713 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:58:55.527711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-432d33bf-a5b3-4b56-a094-8a0deb86551d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:55.545619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-432d33bf-a5b3-4b56-a094-8a0deb86551d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:55.552908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-432d33bf-a5b3-4b56-a094-8a0deb86551d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:55.555204 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-432d33bf-a5b3-4b56-a094-8a0deb86551d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1886 microversion: 2.32 time: 0.932130 May 28 04:58:55.558219 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2839/5566] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:54 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1886 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:55.600640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f82ab9d4-ead4-4a31-a89d-aa2955f1bd07 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:55.601301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f82ab9d4-ead4-4a31-a89d-aa2955f1bd07 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:55.612862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f82ab9d4-ead4-4a31-a89d-aa2955f1bd07 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:55.621254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f82ab9d4-ead4-4a31-a89d-aa2955f1bd07 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:55.622870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f82ab9d4-ead4-4a31-a89d-aa2955f1bd07 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:55.623595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f82ab9d4-ead4-4a31-a89d-aa2955f1bd07 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:55.828322 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-f82ab9d4-ead4-4a31-a89d-aa2955f1bd07 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] HTTP exception thrown: Cannot 'detach_volume' instance d9317fed-13ab-4242-843f-ef74497895e1 while it is in vm_state rescued May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f82ab9d4-ead4-4a31-a89d-aa2955f1bd07 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Request method failure captured: May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments/55376061-f9ef-42a2-a971-8782f240dca4 HTTP/1.1 May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaseTx-CUErJTvPPURHUDDZW_2xVLiNPRiy1eiv9_fcFy45c02JpQ6VvqCXLzIK18DfT6aHtEfhTBsOxiJEfEG-fv6OQ2f3JYTQWF_vNEb8rrFvp-Wh1TVJC4d-u-zkyoCZX0D4P_h38dgB9yzRPIskmXiQK2RKoPWvSUe713g1UiE0 May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: f043f5d6fc0a47429a445d8f25401570 May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: f043f5d6fc0a47429a445d8f25401570 May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerRescueNegativeTestJSON-1590365959-project May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 227be762b2bc4bbba6d3e3e9a1d28c9c May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1590365959-project May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: exception: Cannot 'detach_volume' instance d9317fed-13ab-4242-843f-ef74497895e1 while it is in vm_state rescued May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'server_id': 'd9317fed-13ab-4242-843f-ef74497895e1', 'id': '55376061-f9ef-42a2-a971-8782f240dca4'} May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d9317fed-13ab-4242-843f-ef74497895e1 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d9317fed-13ab-4242-843f-ef74497895e1 while it is in vm_state rescued May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:58:55.831527 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:58:55.838925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:58:55.838925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:58:55.838925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:58:55.838925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:58:55.838925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d9317fed-13ab-4242-843f-ef74497895e1 while it is in vm_state rescued May 28 04:58:55.838925 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:58:55.838925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f82ab9d4-ead4-4a31-a89d-aa2955f1bd07 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Returning 409 to user: Cannot 'detach_volume' instance d9317fed-13ab-4242-843f-ef74497895e1 while it is in vm_state rescued {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:58:55.845609 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f82ab9d4-ead4-4a31-a89d-aa2955f1bd07 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments/55376061-f9ef-42a2-a971-8782f240dca4" status: 409 len: 152 microversion: 2.1 time: 0.246626 May 28 04:58:55.846285 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2728/5567] 10.222.0.58 () {58 vars in 1415 bytes} [Sat May 28 04:58:55 2022] DELETE /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments/55376061-f9ef-42a2-a971-8782f240dca4 => generated 152 bytes in 251 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 04:58:55.855372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bd814643-e247-4361-8d8d-7d7d31cf428a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:58:55.856580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bd814643-e247-4361-8d8d-7d7d31cf428a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:55.868861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd814643-e247-4361-8d8d-7d7d31cf428a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:55.871143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd814643-e247-4361-8d8d-7d7d31cf428a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:55.872862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd814643-e247-4361-8d8d-7d7d31cf428a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:55.875006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd814643-e247-4361-8d8d-7d7d31cf428a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:56.183246 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bd814643-e247-4361-8d8d-7d7d31cf428a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "POST /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/action" status: 202 len: 0 microversion: 2.1 time: 0.330686 May 28 04:58:56.184853 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2840/5568] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:58:55 2022] POST /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:58:56.195583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e12e6fa4-b39e-4021-8dd1-6a00aeea74f4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:56.199788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e12e6fa4-b39e-4021-8dd1-6a00aeea74f4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:56.219050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e12e6fa4-b39e-4021-8dd1-6a00aeea74f4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:56.222668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e12e6fa4-b39e-4021-8dd1-6a00aeea74f4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:56.230525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e12e6fa4-b39e-4021-8dd1-6a00aeea74f4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:56.231366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e12e6fa4-b39e-4021-8dd1-6a00aeea74f4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:56.629506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7cdc8488-627c-48f9-b8b6-ada0547c87ff tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1212384396", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "a47da2f1-de37-4263-87fb-f7d7604363f6"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:58:56.754782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-7cdc8488-627c-48f9-b8b6-ada0547c87ff tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] validate_networks() for [('a47da2f1-de37-4263-87fb-f7d7604363f6', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:58:57.272084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e12e6fa4-b39e-4021-8dd1-6a00aeea74f4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:57.288118 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e12e6fa4-b39e-4021-8dd1-6a00aeea74f4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1721 microversion: 2.1 time: 1.096722 May 28 04:58:57.298576 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2841/5569] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:56 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1721 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:57.298576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9d9c10c6-c563-4d80-a9c6-7de20d668ee4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:57.298576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9d9c10c6-c563-4d80-a9c6-7de20d668ee4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:57.316113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d9c10c6-c563-4d80-a9c6-7de20d668ee4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:57.316113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d9c10c6-c563-4d80-a9c6-7de20d668ee4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:57.316113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d9c10c6-c563-4d80-a9c6-7de20d668ee4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:57.316113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d9c10c6-c563-4d80-a9c6-7de20d668ee4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:57.982094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9d9c10c6-c563-4d80-a9c6-7de20d668ee4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:58.001361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9d9c10c6-c563-4d80-a9c6-7de20d668ee4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:58.002844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9d9c10c6-c563-4d80-a9c6-7de20d668ee4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:58.009961 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9d9c10c6-c563-4d80-a9c6-7de20d668ee4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1886 microversion: 2.32 time: 0.719565 May 28 04:58:58.015332 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2842/5570] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:57 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1886 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:58.026582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-22edb991-84ed-48d3-adf4-95365b800a20 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '.version_select at 0x7f770160ee50>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:58.177689 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-22edb991-84ed-48d3-adf4-95365b800a20 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-720682662" status: 202 len: 0 microversion: 2.1 time: 0.159074 May 28 04:58:58.178289 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2843/5571] 10.222.0.58 () {58 vars in 1280 bytes} [Sat May 28 04:58:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-720682662 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:58:58.224859 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a3ea6aad-4d09-4065-9356-9d29d31531a0 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'create', calling method: .version_select at 0x7f7701238820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-613504025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDXmMHl9Gd+Bcc5H9PO1Dfv2+XIhi/s0fca6W1ppVDZw8fyFx6lpMR84LI8wzRrfBhCm1vfgA8nNPJ8YpIaPiXpCx4rChM0wmWQL4auL1MBR4lXrK0RvrnnYYrKsfpR6A=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:58:58.259649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-a3ea6aad-4d09-4065-9356-9d29d31531a0 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Getting quotas for project d14e7de3a28f42a79197e1c06c4676dd. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:58:58.267444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-a3ea6aad-4d09-4065-9356-9d29d31531a0 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Getting quotas for user 82b17444b87742e1b45409810cbe06d2 and project d14e7de3a28f42a79197e1c06c4676dd. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:58:58.414044 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a3ea6aad-4d09-4065-9356-9d29d31531a0 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.193195 May 28 04:58:58.414689 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2844/5572] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 04:58:58 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:58:58.428161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3f461331-3f2c-4f9e-80c9-b059db0b9afd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:58.429880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3f461331-3f2c-4f9e-80c9-b059db0b9afd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:58.449382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f461331-3f2c-4f9e-80c9-b059db0b9afd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:58.449849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f461331-3f2c-4f9e-80c9-b059db0b9afd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:58.457332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f461331-3f2c-4f9e-80c9-b059db0b9afd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:58.458060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f461331-3f2c-4f9e-80c9-b059db0b9afd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:58.707269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7cdc8488-627c-48f9-b8b6-ada0547c87ff tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:58:58.707810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7cdc8488-627c-48f9-b8b6-ada0547c87ff tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:58:58.708248 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7cdc8488-627c-48f9-b8b6-ada0547c87ff tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:58:58.708858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7cdc8488-627c-48f9-b8b6-ada0547c87ff tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:58:58.709702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7cdc8488-627c-48f9-b8b6-ada0547c87ff tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:58:58.739394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7cdc8488-627c-48f9-b8b6-ada0547c87ff tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:58.740925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7cdc8488-627c-48f9-b8b6-ada0547c87ff tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:58.743333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7cdc8488-627c-48f9-b8b6-ada0547c87ff tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:58.744711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7cdc8488-627c-48f9-b8b6-ada0547c87ff tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:58.790509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-7cdc8488-627c-48f9-b8b6-ada0547c87ff tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Getting quotas for project 207b5b2a321740aaa2cfc3b23ad75aa9. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:58:58.798489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-7cdc8488-627c-48f9-b8b6-ada0547c87ff tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Getting quotas for user 9708d0a9af4d4c9eb22ebc14e9409612 and project 207b5b2a321740aaa2cfc3b23ad75aa9. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:58:58.850580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7cdc8488-627c-48f9-b8b6-ada0547c87ff tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:58:58.857062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7cdc8488-627c-48f9-b8b6-ada0547c87ff tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:58:58.933067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3f461331-3f2c-4f9e-80c9-b059db0b9afd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:58.951498 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3f461331-3f2c-4f9e-80c9-b059db0b9afd tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1721 microversion: 2.1 time: 0.525773 May 28 04:58:58.964880 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2845/5573] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:58 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1721 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:59.054090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-449af668-32fb-4248-a893-1e7819ade2ca tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:59.056728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-449af668-32fb-4248-a893-1e7819ade2ca tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:59.081544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-449af668-32fb-4248-a893-1e7819ade2ca tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:59.082286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-449af668-32fb-4248-a893-1e7819ade2ca tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:59.083597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-449af668-32fb-4248-a893-1e7819ade2ca tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:59.084267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-449af668-32fb-4248-a893-1e7819ade2ca tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:59.149462 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7cdc8488-627c-48f9-b8b6-ada0547c87ff tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.972584 May 28 04:58:59.150266 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2729/5574] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:58:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:58:59.169132 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c3057d33-87ba-45be-8ca9-3b7bbd6d268c tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:59.176428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c3057d33-87ba-45be-8ca9-3b7bbd6d268c tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:59.519463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c3057d33-87ba-45be-8ca9-3b7bbd6d268c tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:59.533807 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c3057d33-87ba-45be-8ca9-3b7bbd6d268c tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1215 microversion: 2.1 time: 0.376867 May 28 04:58:59.534711 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2730/5575] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:59 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1215 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:58:59.680264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-449af668-32fb-4248-a893-1e7819ade2ca tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:59.692853 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-449af668-32fb-4248-a893-1e7819ade2ca tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:59.694529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-449af668-32fb-4248-a893-1e7819ade2ca tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:58:59.696763 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-449af668-32fb-4248-a893-1e7819ade2ca tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1886 microversion: 2.32 time: 0.662707 May 28 04:58:59.698257 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2846/5576] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:58:59 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1886 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:58:59.969851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d2694f54-e31e-44a1-ab14-9cec99142f04 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:58:59.970467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d2694f54-e31e-44a1-ab14-9cec99142f04 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:58:59.982214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d2694f54-e31e-44a1-ab14-9cec99142f04 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:59.985905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d2694f54-e31e-44a1-ab14-9cec99142f04 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:58:59.986879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d2694f54-e31e-44a1-ab14-9cec99142f04 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:58:59.987533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d2694f54-e31e-44a1-ab14-9cec99142f04 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:00.551330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7c0a99ed-6662-423b-ba4a-a2bd86c55fa1 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:00.552202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7c0a99ed-6662-423b-ba4a-a2bd86c55fa1 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:00.712927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7c0a99ed-6662-423b-ba4a-a2bd86c55fa1 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:00.721505 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7c0a99ed-6662-423b-ba4a-a2bd86c55fa1 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1215 microversion: 2.1 time: 0.174522 May 28 04:59:00.722474 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2847/5577] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:00 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1215 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:59:00.727913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-87f7e829-b183-4a34-9e8e-704c1ce80d11 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:00.728532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-87f7e829-b183-4a34-9e8e-704c1ce80d11 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:00.736581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87f7e829-b183-4a34-9e8e-704c1ce80d11 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:00.740858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87f7e829-b183-4a34-9e8e-704c1ce80d11 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:00.740858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87f7e829-b183-4a34-9e8e-704c1ce80d11 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:00.740858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87f7e829-b183-4a34-9e8e-704c1ce80d11 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:00.876341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d2694f54-e31e-44a1-ab14-9cec99142f04 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:00.890294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:59:00.895100 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d2694f54-e31e-44a1-ab14-9cec99142f04 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1727 microversion: 2.1 time: 0.928927 May 28 04:59:00.896536 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2731/5578] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:58:59 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1727 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:00.915363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a9ea3381-765e-4337-aadc-92cd5c31d404 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:00.916161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a9ea3381-765e-4337-aadc-92cd5c31d404 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:00.925944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a9ea3381-765e-4337-aadc-92cd5c31d404 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:00.926790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a9ea3381-765e-4337-aadc-92cd5c31d404 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:00.928951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a9ea3381-765e-4337-aadc-92cd5c31d404 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:00.932928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a9ea3381-765e-4337-aadc-92cd5c31d404 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:01.161982 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a9ea3381-765e-4337-aadc-92cd5c31d404 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.252558 May 28 04:59:01.163258 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2732/5579] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 04:59:00 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-interface => generated 284 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:59:01.238187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-87f7e829-b183-4a34-9e8e-704c1ce80d11 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:01.244656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:59:01.266931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-87f7e829-b183-4a34-9e8e-704c1ce80d11 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:01.268647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-87f7e829-b183-4a34-9e8e-704c1ce80d11 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:01.269869 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-87f7e829-b183-4a34-9e8e-704c1ce80d11 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1886 microversion: 2.32 time: 0.546382 May 28 04:59:01.281018 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2848/5580] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:00 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1886 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:59:01.743630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-37507b1b-8b62-4b3c-b244-11b4988e7bab tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:01.744302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-37507b1b-8b62-4b3c-b244-11b4988e7bab tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:01.758904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-37507b1b-8b62-4b3c-b244-11b4988e7bab tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:01.759467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-37507b1b-8b62-4b3c-b244-11b4988e7bab tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:01.760265 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-37507b1b-8b62-4b3c-b244-11b4988e7bab tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:01.760739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-37507b1b-8b62-4b3c-b244-11b4988e7bab tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:01.984637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-37507b1b-8b62-4b3c-b244-11b4988e7bab tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:02.005126 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-37507b1b-8b62-4b3c-b244-11b4988e7bab tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1267 microversion: 2.1 time: 0.266686 May 28 04:59:02.011647 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2733/5581] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:01 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1267 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:02.290169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f8a04882-defa-4c46-9aca-7810c11ffdd1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:02.291561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f8a04882-defa-4c46-9aca-7810c11ffdd1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:02.311094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8a04882-defa-4c46-9aca-7810c11ffdd1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:02.313536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8a04882-defa-4c46-9aca-7810c11ffdd1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:02.314119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8a04882-defa-4c46-9aca-7810c11ffdd1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:02.314874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8a04882-defa-4c46-9aca-7810c11ffdd1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:02.917460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f8a04882-defa-4c46-9aca-7810c11ffdd1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:02.926811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f8a04882-defa-4c46-9aca-7810c11ffdd1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:02.941289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f8a04882-defa-4c46-9aca-7810c11ffdd1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:02.942758 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f8a04882-defa-4c46-9aca-7810c11ffdd1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 0.658183 May 28 04:59:02.955059 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2849/5582] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:02 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:59:03.028850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-42bef4a2-55ad-4549-8cc2-8d161780098e tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:03.030365 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-42bef4a2-55ad-4549-8cc2-8d161780098e tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:03.040672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42bef4a2-55ad-4549-8cc2-8d161780098e tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:03.041278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42bef4a2-55ad-4549-8cc2-8d161780098e tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:03.042517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42bef4a2-55ad-4549-8cc2-8d161780098e tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:03.044106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42bef4a2-55ad-4549-8cc2-8d161780098e tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:03.142182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-42bef4a2-55ad-4549-8cc2-8d161780098e tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:03.160828 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-42bef4a2-55ad-4549-8cc2-8d161780098e tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1273 microversion: 2.1 time: 0.136476 May 28 04:59:03.161428 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2734/5583] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:03 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1273 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:03.963223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2862c2c3-f6a6-4aa9-85f2-97af8043041d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:03.964713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2862c2c3-f6a6-4aa9-85f2-97af8043041d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:03.974025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2862c2c3-f6a6-4aa9-85f2-97af8043041d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:03.974730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2862c2c3-f6a6-4aa9-85f2-97af8043041d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:03.975713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2862c2c3-f6a6-4aa9-85f2-97af8043041d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:03.976389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2862c2c3-f6a6-4aa9-85f2-97af8043041d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:04.187493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fa435b2e-ba5d-4058-b785-736f4f821a63 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:04.189536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fa435b2e-ba5d-4058-b785-736f4f821a63 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:04.199028 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa435b2e-ba5d-4058-b785-736f4f821a63 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:04.202586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa435b2e-ba5d-4058-b785-736f4f821a63 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:04.202586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa435b2e-ba5d-4058-b785-736f4f821a63 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:04.202586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa435b2e-ba5d-4058-b785-736f4f821a63 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:04.375192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fa435b2e-ba5d-4058-b785-736f4f821a63 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:04.391263 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fa435b2e-ba5d-4058-b785-736f4f821a63 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1273 microversion: 2.1 time: 0.209793 May 28 04:59:04.392200 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2735/5584] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:04 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1273 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:59:04.408593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b107ed85-f65f-4e11-9123-d96d94b59074 req-7ed68058-9dd2-415b-82e7-295cf6feda09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9317fed-13ab-4242-843f-ef74497895e1", "tag": "d288a5a0-3ba2-4f53-8886-2642d079bc88"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:59:04.419556 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b107ed85-f65f-4e11-9123-d96d94b59074 req-7ed68058-9dd2-415b-82e7-295cf6feda09 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:04.426272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b107ed85-f65f-4e11-9123-d96d94b59074 req-7ed68058-9dd2-415b-82e7-295cf6feda09 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:04.455314 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b107ed85-f65f-4e11-9123-d96d94b59074 req-7ed68058-9dd2-415b-82e7-295cf6feda09 service nova] Creating event network-changed:d288a5a0-3ba2-4f53-8886-2642d079bc88 for instance d9317fed-13ab-4242-843f-ef74497895e1 on n-h2-843700-1 May 28 04:59:04.475575 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b107ed85-f65f-4e11-9123-d96d94b59074 req-7ed68058-9dd2-415b-82e7-295cf6feda09 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082085 May 28 04:59:04.476535 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2736/5585] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:59:04.654164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2862c2c3-f6a6-4aa9-85f2-97af8043041d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:04.665991 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2862c2c3-f6a6-4aa9-85f2-97af8043041d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:04.667593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2862c2c3-f6a6-4aa9-85f2-97af8043041d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:04.669111 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2862c2c3-f6a6-4aa9-85f2-97af8043041d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 0.710789 May 28 04:59:04.670130 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2850/5586] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:03 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:59:05.426462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-40e9684c-07e0-424e-9daf-e159b6daa691 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:05.428170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-40e9684c-07e0-424e-9daf-e159b6daa691 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:05.436238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40e9684c-07e0-424e-9daf-e159b6daa691 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:05.437385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40e9684c-07e0-424e-9daf-e159b6daa691 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:05.439034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40e9684c-07e0-424e-9daf-e159b6daa691 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:05.439930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40e9684c-07e0-424e-9daf-e159b6daa691 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:05.690229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f304a4fd-7ecf-4238-acf3-b324b7a03f7c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:05.692990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f304a4fd-7ecf-4238-acf3-b324b7a03f7c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:05.699489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f304a4fd-7ecf-4238-acf3-b324b7a03f7c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:05.700762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f304a4fd-7ecf-4238-acf3-b324b7a03f7c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:05.701734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f304a4fd-7ecf-4238-acf3-b324b7a03f7c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:05.702346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f304a4fd-7ecf-4238-acf3-b324b7a03f7c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:06.096391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-40e9684c-07e0-424e-9daf-e159b6daa691 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:06.116232 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-40e9684c-07e0-424e-9daf-e159b6daa691 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1315 microversion: 2.1 time: 0.700988 May 28 04:59:06.123339 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2737/5587] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:05 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1315 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:06.345611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f304a4fd-7ecf-4238-acf3-b324b7a03f7c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:06.355056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f304a4fd-7ecf-4238-acf3-b324b7a03f7c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:06.356847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f304a4fd-7ecf-4238-acf3-b324b7a03f7c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:06.358308 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f304a4fd-7ecf-4238-acf3-b324b7a03f7c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 0.673958 May 28 04:59:06.359179 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2851/5588] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:05 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:59:06.562540 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-4c68a2ef-cd12-4279-a6fa-8a5e0a9aa794 req-2f55e40b-16bc-4de6-9cbc-ec36691fa9ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9317fed-13ab-4242-843f-ef74497895e1", "tag": "d288a5a0-3ba2-4f53-8886-2642d079bc88"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:59:06.587125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4c68a2ef-cd12-4279-a6fa-8a5e0a9aa794 req-2f55e40b-16bc-4de6-9cbc-ec36691fa9ee service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:06.587525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4c68a2ef-cd12-4279-a6fa-8a5e0a9aa794 req-2f55e40b-16bc-4de6-9cbc-ec36691fa9ee service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:06.602187 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-4c68a2ef-cd12-4279-a6fa-8a5e0a9aa794 req-2f55e40b-16bc-4de6-9cbc-ec36691fa9ee service nova] Creating event network-changed:d288a5a0-3ba2-4f53-8886-2642d079bc88 for instance d9317fed-13ab-4242-843f-ef74497895e1 on n-h2-843700-1 May 28 04:59:06.609131 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-4c68a2ef-cd12-4279-a6fa-8a5e0a9aa794 req-2f55e40b-16bc-4de6-9cbc-ec36691fa9ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053012 May 28 04:59:06.610653 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2738/5589] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:59:07.141145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-934906cd-d41b-4c25-bc6b-b63faba6605d tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:07.141782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-934906cd-d41b-4c25-bc6b-b63faba6605d tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:07.154173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-934906cd-d41b-4c25-bc6b-b63faba6605d tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:07.154648 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-934906cd-d41b-4c25-bc6b-b63faba6605d tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:07.155769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-934906cd-d41b-4c25-bc6b-b63faba6605d tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:07.156218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-934906cd-d41b-4c25-bc6b-b63faba6605d tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:07.378813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6f44a282-9fc2-4cad-99f0-d93cc4c92675 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:07.380185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6f44a282-9fc2-4cad-99f0-d93cc4c92675 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:07.395802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f44a282-9fc2-4cad-99f0-d93cc4c92675 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:07.400702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f44a282-9fc2-4cad-99f0-d93cc4c92675 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:07.402541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f44a282-9fc2-4cad-99f0-d93cc4c92675 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:07.403257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f44a282-9fc2-4cad-99f0-d93cc4c92675 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:07.600052 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-934906cd-d41b-4c25-bc6b-b63faba6605d tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:07.613745 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-934906cd-d41b-4c25-bc6b-b63faba6605d tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1315 microversion: 2.1 time: 0.478202 May 28 04:59:07.615091 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2852/5590] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:07 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:07.991889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6f44a282-9fc2-4cad-99f0-d93cc4c92675 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:08.003552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6f44a282-9fc2-4cad-99f0-d93cc4c92675 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:08.005364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6f44a282-9fc2-4cad-99f0-d93cc4c92675 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:08.006771 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6f44a282-9fc2-4cad-99f0-d93cc4c92675 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 0.633450 May 28 04:59:08.018609 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2739/5591] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:07 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:59:08.631211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-72c74d87-76ad-44b4-832f-24ccb9568a9b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:08.631923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-72c74d87-76ad-44b4-832f-24ccb9568a9b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:08.642249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72c74d87-76ad-44b4-832f-24ccb9568a9b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:08.643084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72c74d87-76ad-44b4-832f-24ccb9568a9b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:08.651326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72c74d87-76ad-44b4-832f-24ccb9568a9b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:08.652570 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72c74d87-76ad-44b4-832f-24ccb9568a9b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:08.702435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-96abc93c-94dd-46bc-9d34-0bbcb42e826c req-34dcc281-5b43-4f8f-8bf6-1c6cb2199cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281fbd8b-34b4-4f55-b31c-dab1846b2eb7", "tag": "912c00b5-690d-406a-8dbc-6f4e7332100d"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:59:08.723202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-96abc93c-94dd-46bc-9d34-0bbcb42e826c req-34dcc281-5b43-4f8f-8bf6-1c6cb2199cd8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:08.723553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-96abc93c-94dd-46bc-9d34-0bbcb42e826c req-34dcc281-5b43-4f8f-8bf6-1c6cb2199cd8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:08.770135 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-96abc93c-94dd-46bc-9d34-0bbcb42e826c req-34dcc281-5b43-4f8f-8bf6-1c6cb2199cd8 service nova] Creating event network-changed:912c00b5-690d-406a-8dbc-6f4e7332100d for instance 281fbd8b-34b4-4f55-b31c-dab1846b2eb7 on n-h1-843700-1 May 28 04:59:08.781782 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-96abc93c-94dd-46bc-9d34-0bbcb42e826c req-34dcc281-5b43-4f8f-8bf6-1c6cb2199cd8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082708 May 28 04:59:08.782734 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2740/5592] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:59:09.022520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:59:09.027399 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a67c0b04-c2d6-4f40-bb9a-9ace99dc8fd8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:09.028385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a67c0b04-c2d6-4f40-bb9a-9ace99dc8fd8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:09.037365 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a67c0b04-c2d6-4f40-bb9a-9ace99dc8fd8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:09.038191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a67c0b04-c2d6-4f40-bb9a-9ace99dc8fd8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:09.039277 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a67c0b04-c2d6-4f40-bb9a-9ace99dc8fd8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:09.040037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a67c0b04-c2d6-4f40-bb9a-9ace99dc8fd8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:09.054180 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-72c74d87-76ad-44b4-832f-24ccb9568a9b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:09.071779 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-72c74d87-76ad-44b4-832f-24ccb9568a9b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1315 microversion: 2.1 time: 0.444277 May 28 04:59:09.076931 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2853/5593] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:08 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:09.460567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a67c0b04-c2d6-4f40-bb9a-9ace99dc8fd8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:09.472499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a67c0b04-c2d6-4f40-bb9a-9ace99dc8fd8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:09.474662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a67c0b04-c2d6-4f40-bb9a-9ace99dc8fd8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:09.476113 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a67c0b04-c2d6-4f40-bb9a-9ace99dc8fd8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 0.454383 May 28 04:59:09.477429 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2741/5594] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:09 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:59:10.089326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5e91a09e-b031-466a-934b-e05500717438 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:10.089911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5e91a09e-b031-466a-934b-e05500717438 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:10.097490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5e91a09e-b031-466a-934b-e05500717438 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:10.097953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5e91a09e-b031-466a-934b-e05500717438 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:10.098971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5e91a09e-b031-466a-934b-e05500717438 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:10.099457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5e91a09e-b031-466a-934b-e05500717438 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:10.494711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7aeb8680-0ca3-447f-b665-ba7ffd980a48 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:10.495998 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7aeb8680-0ca3-447f-b665-ba7ffd980a48 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:10.501889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=8 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:59:10.509633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7aeb8680-0ca3-447f-b665-ba7ffd980a48 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:10.511055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7aeb8680-0ca3-447f-b665-ba7ffd980a48 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:10.512104 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7aeb8680-0ca3-447f-b665-ba7ffd980a48 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:10.512551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7aeb8680-0ca3-447f-b665-ba7ffd980a48 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:10.538798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5e91a09e-b031-466a-934b-e05500717438 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:10.546962 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5e91a09e-b031-466a-934b-e05500717438 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1315 microversion: 2.1 time: 0.461323 May 28 04:59:10.548283 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2854/5595] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:10 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:11.188891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7aeb8680-0ca3-447f-b665-ba7ffd980a48 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:11.200582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7aeb8680-0ca3-447f-b665-ba7ffd980a48 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:11.202305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7aeb8680-0ca3-447f-b665-ba7ffd980a48 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:11.212634 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7aeb8680-0ca3-447f-b665-ba7ffd980a48 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 0.721613 May 28 04:59:11.213283 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2742/5596] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:10 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:59:11.567077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:59:11.567783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f6c483cf-5cb4-43f8-ac6f-6cd5e78d31f0 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:11.568620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f6c483cf-5cb4-43f8-ac6f-6cd5e78d31f0 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:11.588174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6c483cf-5cb4-43f8-ac6f-6cd5e78d31f0 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:11.588911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6c483cf-5cb4-43f8-ac6f-6cd5e78d31f0 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:11.590067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6c483cf-5cb4-43f8-ac6f-6cd5e78d31f0 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:11.590670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6c483cf-5cb4-43f8-ac6f-6cd5e78d31f0 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:12.023961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f6c483cf-5cb4-43f8-ac6f-6cd5e78d31f0 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:12.032104 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f6c483cf-5cb4-43f8-ac6f-6cd5e78d31f0 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1315 microversion: 2.1 time: 0.469860 May 28 04:59:12.034665 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2855/5597] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:11 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:12.233876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4c7d7d5e-30dd-488a-8e02-095f68491b39 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:12.235083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4c7d7d5e-30dd-488a-8e02-095f68491b39 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:12.242138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c7d7d5e-30dd-488a-8e02-095f68491b39 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:12.242598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c7d7d5e-30dd-488a-8e02-095f68491b39 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:12.243436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c7d7d5e-30dd-488a-8e02-095f68491b39 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:12.243875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c7d7d5e-30dd-488a-8e02-095f68491b39 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:12.771111 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4c7d7d5e-30dd-488a-8e02-095f68491b39 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:12.782106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4c7d7d5e-30dd-488a-8e02-095f68491b39 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:12.784473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4c7d7d5e-30dd-488a-8e02-095f68491b39 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:12.785642 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4c7d7d5e-30dd-488a-8e02-095f68491b39 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 0.555822 May 28 04:59:12.786443 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2743/5598] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:12 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:59:13.057502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d13e650c-35fc-4255-8968-6a8998f0df1e tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:13.058311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d13e650c-35fc-4255-8968-6a8998f0df1e tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:13.075575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d13e650c-35fc-4255-8968-6a8998f0df1e tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:13.076703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d13e650c-35fc-4255-8968-6a8998f0df1e tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:13.077811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d13e650c-35fc-4255-8968-6a8998f0df1e tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:13.079112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d13e650c-35fc-4255-8968-6a8998f0df1e tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:13.804065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-75d3ef99-73ac-428d-ad67-e35276ce5f4b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:13.805431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-75d3ef99-73ac-428d-ad67-e35276ce5f4b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:13.823651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75d3ef99-73ac-428d-ad67-e35276ce5f4b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:13.834015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75d3ef99-73ac-428d-ad67-e35276ce5f4b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:13.838210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75d3ef99-73ac-428d-ad67-e35276ce5f4b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:13.838210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75d3ef99-73ac-428d-ad67-e35276ce5f4b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:13.871467 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d13e650c-35fc-4255-8968-6a8998f0df1e tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:13.880240 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d13e650c-35fc-4255-8968-6a8998f0df1e tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1315 microversion: 2.1 time: 0.825538 May 28 04:59:13.880240 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2856/5599] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:13 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1315 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:14.396625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-75d3ef99-73ac-428d-ad67-e35276ce5f4b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:14.409122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-75d3ef99-73ac-428d-ad67-e35276ce5f4b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:14.412467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-75d3ef99-73ac-428d-ad67-e35276ce5f4b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:14.418133 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-75d3ef99-73ac-428d-ad67-e35276ce5f4b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 0.617733 May 28 04:59:14.419370 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2744/5600] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:13 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:59:14.894567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1921a6ad-ad0f-4996-be9b-f48f53cf41fc tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:14.896878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1921a6ad-ad0f-4996-be9b-f48f53cf41fc tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:14.908817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1921a6ad-ad0f-4996-be9b-f48f53cf41fc tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:14.909279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1921a6ad-ad0f-4996-be9b-f48f53cf41fc tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:14.910084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1921a6ad-ad0f-4996-be9b-f48f53cf41fc tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:14.910529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1921a6ad-ad0f-4996-be9b-f48f53cf41fc tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:15.301212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1921a6ad-ad0f-4996-be9b-f48f53cf41fc tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:15.323401 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1921a6ad-ad0f-4996-be9b-f48f53cf41fc tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1315 microversion: 2.1 time: 0.425502 May 28 04:59:15.325460 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2857/5601] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:14 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:15.438832 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-06e497ee-248a-458c-a2a8-d9d8f6d0f7ca tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:15.440979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-06e497ee-248a-458c-a2a8-d9d8f6d0f7ca tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:15.458300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06e497ee-248a-458c-a2a8-d9d8f6d0f7ca tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:15.459088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06e497ee-248a-458c-a2a8-d9d8f6d0f7ca tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:15.460731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06e497ee-248a-458c-a2a8-d9d8f6d0f7ca tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:15.461385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06e497ee-248a-458c-a2a8-d9d8f6d0f7ca tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:16.334532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5980e869-e7e5-4c51-aade-4ff97ab57b7b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:16.335780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5980e869-e7e5-4c51-aade-4ff97ab57b7b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:16.352210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5980e869-e7e5-4c51-aade-4ff97ab57b7b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:16.352637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5980e869-e7e5-4c51-aade-4ff97ab57b7b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:16.353468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5980e869-e7e5-4c51-aade-4ff97ab57b7b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:16.353926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5980e869-e7e5-4c51-aade-4ff97ab57b7b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:16.618362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-06e497ee-248a-458c-a2a8-d9d8f6d0f7ca tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:16.668860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-06e497ee-248a-458c-a2a8-d9d8f6d0f7ca tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:16.669234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-06e497ee-248a-458c-a2a8-d9d8f6d0f7ca tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:16.670690 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-06e497ee-248a-458c-a2a8-d9d8f6d0f7ca tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 1.237206 May 28 04:59:16.686915 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2745/5602] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:15 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:59:16.699271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-5977f27c-3235-4b87-8d60-f76bec4b8fc8 req-0e1c43b7-79be-42e7-a73b-8ba256b21a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "281fbd8b-34b4-4f55-b31c-dab1846b2eb7", "name": "network-vif-plugged", "status": "completed", "tag": "912c00b5-690d-406a-8dbc-6f4e7332100d"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:59:16.747300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:59:16.751953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5977f27c-3235-4b87-8d60-f76bec4b8fc8 req-0e1c43b7-79be-42e7-a73b-8ba256b21a7b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:16.752633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5977f27c-3235-4b87-8d60-f76bec4b8fc8 req-0e1c43b7-79be-42e7-a73b-8ba256b21a7b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:16.801920 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-5977f27c-3235-4b87-8d60-f76bec4b8fc8 req-0e1c43b7-79be-42e7-a73b-8ba256b21a7b service nova] Creating event network-vif-plugged:912c00b5-690d-406a-8dbc-6f4e7332100d for instance 281fbd8b-34b4-4f55-b31c-dab1846b2eb7 on n-h1-843700-1 May 28 04:59:16.817936 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-5977f27c-3235-4b87-8d60-f76bec4b8fc8 req-0e1c43b7-79be-42e7-a73b-8ba256b21a7b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129496 May 28 04:59:16.818953 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2746/5603] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:59:17.028724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5980e869-e7e5-4c51-aade-4ff97ab57b7b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:17.038370 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5980e869-e7e5-4c51-aade-4ff97ab57b7b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1315 microversion: 2.1 time: 0.708457 May 28 04:59:17.043647 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2858/5604] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:16 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:17.707991 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4b5d4a97-21ad-4b58-bed9-3ce95a8b98f2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:17.711178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4b5d4a97-21ad-4b58-bed9-3ce95a8b98f2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:17.739331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b5d4a97-21ad-4b58-bed9-3ce95a8b98f2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:17.749121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b5d4a97-21ad-4b58-bed9-3ce95a8b98f2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:17.753899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b5d4a97-21ad-4b58-bed9-3ce95a8b98f2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:17.756001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b5d4a97-21ad-4b58-bed9-3ce95a8b98f2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:18.055680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-97c044bf-6fe7-4f4f-b362-d79a365ec4dd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:18.056294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-97c044bf-6fe7-4f4f-b362-d79a365ec4dd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:18.060560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:59:18.076105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-97c044bf-6fe7-4f4f-b362-d79a365ec4dd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:18.077647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-97c044bf-6fe7-4f4f-b362-d79a365ec4dd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:18.079775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-97c044bf-6fe7-4f4f-b362-d79a365ec4dd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:18.086168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-97c044bf-6fe7-4f4f-b362-d79a365ec4dd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:18.401896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4b5d4a97-21ad-4b58-bed9-3ce95a8b98f2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:18.451989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4b5d4a97-21ad-4b58-bed9-3ce95a8b98f2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:18.451989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4b5d4a97-21ad-4b58-bed9-3ce95a8b98f2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:18.451989 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4b5d4a97-21ad-4b58-bed9-3ce95a8b98f2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 0.751321 May 28 04:59:18.452501 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2747/5605] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:17 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:59:18.655328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-97c044bf-6fe7-4f4f-b362-d79a365ec4dd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:18.668229 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-97c044bf-6fe7-4f4f-b362-d79a365ec4dd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1315 microversion: 2.1 time: 0.615655 May 28 04:59:18.680363 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2859/5606] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:18 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1315 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:59:19.476965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fe016864-aaa1-44a2-bb14-4386db5a581c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:19.477601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fe016864-aaa1-44a2-bb14-4386db5a581c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:19.494869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe016864-aaa1-44a2-bb14-4386db5a581c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:19.495800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe016864-aaa1-44a2-bb14-4386db5a581c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:19.497138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe016864-aaa1-44a2-bb14-4386db5a581c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:19.499588 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe016864-aaa1-44a2-bb14-4386db5a581c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:19.686805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1b845b9a-9584-46b0-9d74-bec8c41d517a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:19.687428 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1b845b9a-9584-46b0-9d74-bec8c41d517a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:19.697762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b845b9a-9584-46b0-9d74-bec8c41d517a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:19.698232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b845b9a-9584-46b0-9d74-bec8c41d517a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:19.702242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b845b9a-9584-46b0-9d74-bec8c41d517a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:19.703415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b845b9a-9584-46b0-9d74-bec8c41d517a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:20.513927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1b845b9a-9584-46b0-9d74-bec8c41d517a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:20.532143 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1b845b9a-9584-46b0-9d74-bec8c41d517a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1502 microversion: 2.1 time: 0.848748 May 28 04:59:20.548486 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2860/5607] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:19 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1502 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:20.561862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fe016864-aaa1-44a2-bb14-4386db5a581c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:20.579836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-365e0970-5450-4e01-840f-eb7742c25acb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1617898973", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "081f292c-b351-4a1e-a4f3-b585a4aa2beb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-613504025", "security_groups": [{"name": "tempest-secgroup-smoke-1804887632"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:59:20.589829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fe016864-aaa1-44a2-bb14-4386db5a581c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:20.595674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fe016864-aaa1-44a2-bb14-4386db5a581c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:20.595674 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fe016864-aaa1-44a2-bb14-4386db5a581c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 1.123222 May 28 04:59:20.595674 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2748/5608] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:19 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:59:20.601614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a44069e6-e9e0-42fe-a76c-593bb25d9ebd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:20.602867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a44069e6-e9e0-42fe-a76c-593bb25d9ebd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:20.624062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a44069e6-e9e0-42fe-a76c-593bb25d9ebd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:20.624691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a44069e6-e9e0-42fe-a76c-593bb25d9ebd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:20.629689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a44069e6-e9e0-42fe-a76c-593bb25d9ebd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:20.639699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a44069e6-e9e0-42fe-a76c-593bb25d9ebd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:20.981133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-365e0970-5450-4e01-840f-eb7742c25acb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] validate_networks() for [('081f292c-b351-4a1e-a4f3-b585a4aa2beb', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 04:59:21.241941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a44069e6-e9e0-42fe-a76c-593bb25d9ebd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:21.252015 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a44069e6-e9e0-42fe-a76c-593bb25d9ebd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1502 microversion: 2.1 time: 0.656235 May 28 04:59:21.252514 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2749/5609] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:20 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1502 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:21.274690 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-77ade40f-7998-4fc0-ad87-b15bc95fa829 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:59:21.275780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-77ade40f-7998-4fc0-ad87-b15bc95fa829 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:21.285198 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77ade40f-7998-4fc0-ad87-b15bc95fa829 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:21.285962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77ade40f-7998-4fc0-ad87-b15bc95fa829 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:21.287242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77ade40f-7998-4fc0-ad87-b15bc95fa829 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:21.288141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77ade40f-7998-4fc0-ad87-b15bc95fa829 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:21.362044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-77ade40f-7998-4fc0-ad87-b15bc95fa829 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lazy-loading 'flavor' on Instance uuid 281fbd8b-34b4-4f55-b31c-dab1846b2eb7 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:59:21.491558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:59:21.720838 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-77ade40f-7998-4fc0-ad87-b15bc95fa829 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "POST /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7/action" status: 202 len: 0 microversion: 2.1 time: 0.455905 May 28 04:59:21.723768 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2750/5610] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:59:21 2022] POST /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:59:21.744939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d9522d57-02b3-4c27-b2f9-e3933f601a72 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:21.745907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d9522d57-02b3-4c27-b2f9-e3933f601a72 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:21.758421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d9522d57-02b3-4c27-b2f9-e3933f601a72 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:21.768618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d9522d57-02b3-4c27-b2f9-e3933f601a72 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:21.772048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d9522d57-02b3-4c27-b2f9-e3933f601a72 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:21.772893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d9522d57-02b3-4c27-b2f9-e3933f601a72 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:22.034426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-365e0970-5450-4e01-840f-eb7742c25acb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 04:59:22.034426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-365e0970-5450-4e01-840f-eb7742c25acb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 04:59:22.034426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-365e0970-5450-4e01-840f-eb7742c25acb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 04:59:22.040968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-365e0970-5450-4e01-840f-eb7742c25acb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 04:59:22.043129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-365e0970-5450-4e01-840f-eb7742c25acb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 04:59:22.062913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-365e0970-5450-4e01-840f-eb7742c25acb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:22.063835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-365e0970-5450-4e01-840f-eb7742c25acb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:22.066560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-365e0970-5450-4e01-840f-eb7742c25acb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:22.066560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-365e0970-5450-4e01-840f-eb7742c25acb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:22.091288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-365e0970-5450-4e01-840f-eb7742c25acb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Getting quotas for project d14e7de3a28f42a79197e1c06c4676dd. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 04:59:22.099822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-365e0970-5450-4e01-840f-eb7742c25acb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Getting quotas for user 82b17444b87742e1b45409810cbe06d2 and project d14e7de3a28f42a79197e1c06c4676dd. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 04:59:22.116462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-365e0970-5450-4e01-840f-eb7742c25acb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 04:59:22.120913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-365e0970-5450-4e01-840f-eb7742c25acb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 04:59:22.266972 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-365e0970-5450-4e01-840f-eb7742c25acb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.716236 May 28 04:59:22.273375 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2861/5611] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 04:59:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 04:59:22.274285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8099348d-f253-4ed9-b8aa-3b8ca6beca4a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:22.275299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8099348d-f253-4ed9-b8aa-3b8ca6beca4a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:22.283518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8099348d-f253-4ed9-b8aa-3b8ca6beca4a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:22.284106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8099348d-f253-4ed9-b8aa-3b8ca6beca4a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:22.284990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8099348d-f253-4ed9-b8aa-3b8ca6beca4a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:22.285553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8099348d-f253-4ed9-b8aa-3b8ca6beca4a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:22.426535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d9522d57-02b3-4c27-b2f9-e3933f601a72 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:22.449736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d9522d57-02b3-4c27-b2f9-e3933f601a72 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:22.454182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d9522d57-02b3-4c27-b2f9-e3933f601a72 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:22.455489 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d9522d57-02b3-4c27-b2f9-e3933f601a72 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 0.717639 May 28 04:59:22.456095 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2751/5612] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:21 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:59:22.477815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-98efbb17-7ba0-4c32-b9a5-ffc101974ada tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:22.482169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-98efbb17-7ba0-4c32-b9a5-ffc101974ada tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:22.712834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-98efbb17-7ba0-4c32-b9a5-ffc101974ada tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:22.721095 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-98efbb17-7ba0-4c32-b9a5-ffc101974ada tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1266 microversion: 2.1 time: 0.263949 May 28 04:59:22.735386 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2752/5613] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:22 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:22.977258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8099348d-f253-4ed9-b8aa-3b8ca6beca4a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:22.988204 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8099348d-f253-4ed9-b8aa-3b8ca6beca4a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1510 microversion: 2.1 time: 0.715774 May 28 04:59:22.990375 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2862/5614] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:22 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1510 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:23.476443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-49516841-4fa5-4b90-b886-4fbb98643d6e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:23.477063 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-49516841-4fa5-4b90-b886-4fbb98643d6e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:23.488716 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49516841-4fa5-4b90-b886-4fbb98643d6e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:23.489184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49516841-4fa5-4b90-b886-4fbb98643d6e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:23.490034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49516841-4fa5-4b90-b886-4fbb98643d6e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:23.490477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49516841-4fa5-4b90-b886-4fbb98643d6e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:23.740603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a72c844b-43b1-47ac-8bfd-e647aba2e186 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:23.741230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a72c844b-43b1-47ac-8bfd-e647aba2e186 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:23.758953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a72c844b-43b1-47ac-8bfd-e647aba2e186 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:23.758953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a72c844b-43b1-47ac-8bfd-e647aba2e186 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:23.763259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a72c844b-43b1-47ac-8bfd-e647aba2e186 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:23.763923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a72c844b-43b1-47ac-8bfd-e647aba2e186 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:24.341905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a72c844b-43b1-47ac-8bfd-e647aba2e186 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:24.352536 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a72c844b-43b1-47ac-8bfd-e647aba2e186 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1270 microversion: 2.1 time: 0.616134 May 28 04:59:24.357634 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2863/5615] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:23 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1270 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:24.367825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-08d2b486-ed7c-4837-9536-044bd8c5f464 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:24.370315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-08d2b486-ed7c-4837-9536-044bd8c5f464 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:24.394664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08d2b486-ed7c-4837-9536-044bd8c5f464 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:24.405520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08d2b486-ed7c-4837-9536-044bd8c5f464 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:24.407016 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08d2b486-ed7c-4837-9536-044bd8c5f464 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:24.415723 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-08d2b486-ed7c-4837-9536-044bd8c5f464 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:24.812917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-49516841-4fa5-4b90-b886-4fbb98643d6e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:24.828312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-49516841-4fa5-4b90-b886-4fbb98643d6e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:24.843837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-49516841-4fa5-4b90-b886-4fbb98643d6e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:24.845484 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-49516841-4fa5-4b90-b886-4fbb98643d6e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 1.373175 May 28 04:59:24.850459 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2753/5616] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:23 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:59:24.897195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-08d2b486-ed7c-4837-9536-044bd8c5f464 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:24.905442 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-08d2b486-ed7c-4837-9536-044bd8c5f464 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1493 microversion: 2.1 time: 0.545986 May 28 04:59:24.906225 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2864/5617] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:24 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1493 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:24.928379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-15fed018-2b8a-41f8-a125-c4a06c6f8260 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:59:24.928929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-15fed018-2b8a-41f8-a125-c4a06c6f8260 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:24.942338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15fed018-2b8a-41f8-a125-c4a06c6f8260 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:24.945982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15fed018-2b8a-41f8-a125-c4a06c6f8260 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:24.949340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15fed018-2b8a-41f8-a125-c4a06c6f8260 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:24.949340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15fed018-2b8a-41f8-a125-c4a06c6f8260 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:25.335985 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-15fed018-2b8a-41f8-a125-c4a06c6f8260 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "POST /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7/action" status: 202 len: 0 microversion: 2.1 time: 0.410928 May 28 04:59:25.338159 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2754/5618] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:59:24 2022] POST /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:59:25.348396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a65c8b7a-e3fd-4b99-8310-1b8af4bde16b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:25.349863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a65c8b7a-e3fd-4b99-8310-1b8af4bde16b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:25.358620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a65c8b7a-e3fd-4b99-8310-1b8af4bde16b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:25.370824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a65c8b7a-e3fd-4b99-8310-1b8af4bde16b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:25.370824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a65c8b7a-e3fd-4b99-8310-1b8af4bde16b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:25.375438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-834385f0-cff4-44c1-9799-9b9408f7010f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:25.376348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-834385f0-cff4-44c1-9799-9b9408f7010f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:25.382112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a65c8b7a-e3fd-4b99-8310-1b8af4bde16b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:25.387914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-834385f0-cff4-44c1-9799-9b9408f7010f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:25.399427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-834385f0-cff4-44c1-9799-9b9408f7010f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:25.402591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-834385f0-cff4-44c1-9799-9b9408f7010f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:25.403301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-834385f0-cff4-44c1-9799-9b9408f7010f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:25.628788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-834385f0-cff4-44c1-9799-9b9408f7010f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:25.646699 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-834385f0-cff4-44c1-9799-9b9408f7010f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1336 microversion: 2.1 time: 0.267662 May 28 04:59:25.647783 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2755/5619] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:25 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1336 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:25.869036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-964d22aa-9efe-47b4-8401-d94bac088d33 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:25.869699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-964d22aa-9efe-47b4-8401-d94bac088d33 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:25.885031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-964d22aa-9efe-47b4-8401-d94bac088d33 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:25.885408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-964d22aa-9efe-47b4-8401-d94bac088d33 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:25.888819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-964d22aa-9efe-47b4-8401-d94bac088d33 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:25.889190 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-964d22aa-9efe-47b4-8401-d94bac088d33 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:25.908450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a65c8b7a-e3fd-4b99-8310-1b8af4bde16b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:25.925977 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a65c8b7a-e3fd-4b99-8310-1b8af4bde16b tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1499 microversion: 2.1 time: 0.583369 May 28 04:59:25.937411 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2865/5620] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:25 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1499 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:26.335368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-964d22aa-9efe-47b4-8401-d94bac088d33 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:26.350689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-964d22aa-9efe-47b4-8401-d94bac088d33 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:26.355023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-964d22aa-9efe-47b4-8401-d94bac088d33 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:26.359487 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-964d22aa-9efe-47b4-8401-d94bac088d33 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 0.494975 May 28 04:59:26.367814 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2756/5621] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:25 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:59:26.668412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3dd6d223-7639-4902-85fc-0d9c02ef966a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:26.669038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3dd6d223-7639-4902-85fc-0d9c02ef966a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:26.689577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3dd6d223-7639-4902-85fc-0d9c02ef966a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:26.690041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3dd6d223-7639-4902-85fc-0d9c02ef966a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:26.690829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3dd6d223-7639-4902-85fc-0d9c02ef966a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:26.698782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3dd6d223-7639-4902-85fc-0d9c02ef966a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:26.714021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:59:26.945942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bd93d0a8-3ab2-4eac-aff8-688e591b6c1a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:26.947092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bd93d0a8-3ab2-4eac-aff8-688e591b6c1a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:26.965561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd93d0a8-3ab2-4eac-aff8-688e591b6c1a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:26.966032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd93d0a8-3ab2-4eac-aff8-688e591b6c1a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:26.969355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd93d0a8-3ab2-4eac-aff8-688e591b6c1a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:26.969355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd93d0a8-3ab2-4eac-aff8-688e591b6c1a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:27.872603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3dd6d223-7639-4902-85fc-0d9c02ef966a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:27.901176 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3dd6d223-7639-4902-85fc-0d9c02ef966a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1392 microversion: 2.1 time: 1.236529 May 28 04:59:27.916049 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2866/5622] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:26 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1392 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:27.940556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ebeade22-06e8-4d38-b0ad-076a0b18148d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:27.943345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ebeade22-06e8-4d38-b0ad-076a0b18148d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:27.965706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ebeade22-06e8-4d38-b0ad-076a0b18148d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:27.973598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ebeade22-06e8-4d38-b0ad-076a0b18148d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:27.974531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ebeade22-06e8-4d38-b0ad-076a0b18148d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:27.975038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ebeade22-06e8-4d38-b0ad-076a0b18148d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:27.982431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bd93d0a8-3ab2-4eac-aff8-688e591b6c1a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:27.996761 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bd93d0a8-3ab2-4eac-aff8-688e591b6c1a tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1499 microversion: 2.1 time: 1.054514 May 28 04:59:27.999240 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2757/5623] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:26 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1499 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:28.508397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ebeade22-06e8-4d38-b0ad-076a0b18148d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:28.521820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ebeade22-06e8-4d38-b0ad-076a0b18148d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:28.523930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ebeade22-06e8-4d38-b0ad-076a0b18148d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:28.526045 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ebeade22-06e8-4d38-b0ad-076a0b18148d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 0.603074 May 28 04:59:28.539196 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2867/5624] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:27 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:59:28.921792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-21258dac-f395-497c-9694-dc8008adb73d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:28.922415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-21258dac-f395-497c-9694-dc8008adb73d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:28.928719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21258dac-f395-497c-9694-dc8008adb73d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:28.929409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21258dac-f395-497c-9694-dc8008adb73d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:28.930190 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21258dac-f395-497c-9694-dc8008adb73d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:28.930802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21258dac-f395-497c-9694-dc8008adb73d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:29.014177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-96497cfd-4e5b-4a6c-bebb-444e8a960a60 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:29.014797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-96497cfd-4e5b-4a6c-bebb-444e8a960a60 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:29.033816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96497cfd-4e5b-4a6c-bebb-444e8a960a60 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:29.034763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96497cfd-4e5b-4a6c-bebb-444e8a960a60 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:29.035758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96497cfd-4e5b-4a6c-bebb-444e8a960a60 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:29.036721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96497cfd-4e5b-4a6c-bebb-444e8a960a60 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:29.461874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-21258dac-f395-497c-9694-dc8008adb73d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:29.476297 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-21258dac-f395-497c-9694-dc8008adb73d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1392 microversion: 2.1 time: 0.558334 May 28 04:59:29.477472 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2758/5625] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:28 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1392 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:29.497433 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:59:29.497869 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 04:59:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 04:59:29.547590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5bb6add6-1ed6-40c6-bfa0-034963142909 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:29.548801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5bb6add6-1ed6-40c6-bfa0-034963142909 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:29.566442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5bb6add6-1ed6-40c6-bfa0-034963142909 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:29.567332 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5bb6add6-1ed6-40c6-bfa0-034963142909 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:29.568391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5bb6add6-1ed6-40c6-bfa0-034963142909 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:29.569002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5bb6add6-1ed6-40c6-bfa0-034963142909 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:29.621352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-96497cfd-4e5b-4a6c-bebb-444e8a960a60 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:29.646477 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-96497cfd-4e5b-4a6c-bebb-444e8a960a60 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1502 microversion: 2.1 time: 0.634517 May 28 04:59:29.647157 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2868/5626] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:29 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1502 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:29.668990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-285c6741-ca8d-419b-b157-68a6cdc34a11 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:59:29.673227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-285c6741-ca8d-419b-b157-68a6cdc34a11 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:29.684546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-285c6741-ca8d-419b-b157-68a6cdc34a11 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:29.685790 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-285c6741-ca8d-419b-b157-68a6cdc34a11 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:29.689679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-285c6741-ca8d-419b-b157-68a6cdc34a11 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:29.689679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-285c6741-ca8d-419b-b157-68a6cdc34a11 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:29.717684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-285c6741-ca8d-419b-b157-68a6cdc34a11 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lazy-loading 'flavor' on Instance uuid 281fbd8b-34b4-4f55-b31c-dab1846b2eb7 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:59:29.961391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5bb6add6-1ed6-40c6-bfa0-034963142909 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:29.978769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5bb6add6-1ed6-40c6-bfa0-034963142909 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:29.980385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5bb6add6-1ed6-40c6-bfa0-034963142909 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:29.981617 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5bb6add6-1ed6-40c6-bfa0-034963142909 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 0.439798 May 28 04:59:29.982171 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2759/5627] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:29 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:59:30.029301 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-285c6741-ca8d-419b-b157-68a6cdc34a11 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "POST /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7/action" status: 202 len: 0 microversion: 2.1 time: 0.365851 May 28 04:59:30.031955 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2869/5628] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:59:29 2022] POST /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:59:30.042481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-05bd992e-e0db-4379-b52d-15f6a499daa7 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:30.043226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-05bd992e-e0db-4379-b52d-15f6a499daa7 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:30.057360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-05bd992e-e0db-4379-b52d-15f6a499daa7 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:30.057360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-05bd992e-e0db-4379-b52d-15f6a499daa7 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:30.057360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-05bd992e-e0db-4379-b52d-15f6a499daa7 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:30.057669 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-05bd992e-e0db-4379-b52d-15f6a499daa7 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:30.168682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-29041ed6-4893-4cbe-bd68-811e17f73fc0 req-300e97bb-5dd3-42a5-b856-a32d05b0b16b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82767745-0d0e-4892-b97e-28a49a746db0", "tag": "79daf806-2760-45f3-a32b-75949a5241dd"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:59:30.180713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-29041ed6-4893-4cbe-bd68-811e17f73fc0 req-300e97bb-5dd3-42a5-b856-a32d05b0b16b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:30.181182 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-29041ed6-4893-4cbe-bd68-811e17f73fc0 req-300e97bb-5dd3-42a5-b856-a32d05b0b16b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:30.203630 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-29041ed6-4893-4cbe-bd68-811e17f73fc0 req-300e97bb-5dd3-42a5-b856-a32d05b0b16b service nova] Creating event network-changed:79daf806-2760-45f3-a32b-75949a5241dd for instance 82767745-0d0e-4892-b97e-28a49a746db0 on n-h1-843700-1 May 28 04:59:30.211024 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-29041ed6-4893-4cbe-bd68-811e17f73fc0 req-300e97bb-5dd3-42a5-b856-a32d05b0b16b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047775 May 28 04:59:30.215427 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2870/5629] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:59:30.425311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-05bd992e-e0db-4379-b52d-15f6a499daa7 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:30.456925 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-05bd992e-e0db-4379-b52d-15f6a499daa7 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1510 microversion: 2.1 time: 0.411113 May 28 04:59:30.459503 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2760/5630] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:30 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1510 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:30.496046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d27bcc10-3fba-449b-869a-3b08635c354d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:30.497203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d27bcc10-3fba-449b-869a-3b08635c354d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:30.547198 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d27bcc10-3fba-449b-869a-3b08635c354d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:30.551076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d27bcc10-3fba-449b-869a-3b08635c354d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:30.551925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d27bcc10-3fba-449b-869a-3b08635c354d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:30.552391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d27bcc10-3fba-449b-869a-3b08635c354d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:30.815788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d27bcc10-3fba-449b-869a-3b08635c354d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:30.840846 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d27bcc10-3fba-449b-869a-3b08635c354d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1392 microversion: 2.1 time: 0.350683 May 28 04:59:30.842561 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2871/5631] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:30 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1392 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:31.004863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a680c7a8-a660-4039-9dda-3e6882992199 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:31.004863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a680c7a8-a660-4039-9dda-3e6882992199 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:31.011686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a680c7a8-a660-4039-9dda-3e6882992199 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:31.012564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a680c7a8-a660-4039-9dda-3e6882992199 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:31.016206 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a680c7a8-a660-4039-9dda-3e6882992199 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:31.016884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a680c7a8-a660-4039-9dda-3e6882992199 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:31.476737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c83b27b8-b484-41f4-9918-f9e2b42d04fd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:31.479605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c83b27b8-b484-41f4-9918-f9e2b42d04fd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:31.498065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c83b27b8-b484-41f4-9918-f9e2b42d04fd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:31.503354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c83b27b8-b484-41f4-9918-f9e2b42d04fd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:31.505307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c83b27b8-b484-41f4-9918-f9e2b42d04fd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:31.510577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c83b27b8-b484-41f4-9918-f9e2b42d04fd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:32.073663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a680c7a8-a660-4039-9dda-3e6882992199 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:32.078618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:59:32.086117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a680c7a8-a660-4039-9dda-3e6882992199 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:32.087874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a680c7a8-a660-4039-9dda-3e6882992199 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:32.089257 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a680c7a8-a660-4039-9dda-3e6882992199 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 1.093303 May 28 04:59:32.090477 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2761/5632] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:30 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:59:32.095843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8f6d062d-efe5-45ac-8bf6-b34576d9879a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:32.096675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8f6d062d-efe5-45ac-8bf6-b34576d9879a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:32.104614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f6d062d-efe5-45ac-8bf6-b34576d9879a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:32.105400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f6d062d-efe5-45ac-8bf6-b34576d9879a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:32.110974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:59:32.111478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f6d062d-efe5-45ac-8bf6-b34576d9879a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:32.112122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f6d062d-efe5-45ac-8bf6-b34576d9879a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:32.384528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c83b27b8-b484-41f4-9918-f9e2b42d04fd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:32.406231 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c83b27b8-b484-41f4-9918-f9e2b42d04fd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1493 microversion: 2.1 time: 0.934375 May 28 04:59:32.422551 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2872/5633] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:31 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1493 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:59:32.428318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-58282d15-4595-43b7-be89-01fe9db515be req-6d81612d-6523-4bee-b293-30af36bfa030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "name": "network-vif-plugged", "status": "completed", "tag": "bb59fa13-05c2-4a27-aca1-04b55a00e89a"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:59:32.445814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-58282d15-4595-43b7-be89-01fe9db515be req-6d81612d-6523-4bee-b293-30af36bfa030 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:32.446463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-58282d15-4595-43b7-be89-01fe9db515be req-6d81612d-6523-4bee-b293-30af36bfa030 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:32.517544 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-58282d15-4595-43b7-be89-01fe9db515be req-6d81612d-6523-4bee-b293-30af36bfa030 service nova] Creating event network-vif-plugged:bb59fa13-05c2-4a27-aca1-04b55a00e89a for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 04:59:32.529812 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-58282d15-4595-43b7-be89-01fe9db515be req-6d81612d-6523-4bee-b293-30af36bfa030 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104567 May 28 04:59:32.530783 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2873/5634] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:59:32.541578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4f5f3902-a5f9-4645-a69b-0793ceb8bc95 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:59:32.544391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4f5f3902-a5f9-4645-a69b-0793ceb8bc95 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:32.562524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f5f3902-a5f9-4645-a69b-0793ceb8bc95 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:32.564983 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f5f3902-a5f9-4645-a69b-0793ceb8bc95 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:32.566013 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f5f3902-a5f9-4645-a69b-0793ceb8bc95 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:32.566261 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f5f3902-a5f9-4645-a69b-0793ceb8bc95 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:32.670620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8f6d062d-efe5-45ac-8bf6-b34576d9879a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:32.690083 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8f6d062d-efe5-45ac-8bf6-b34576d9879a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1392 microversion: 2.1 time: 0.597037 May 28 04:59:32.693369 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2762/5635] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:32 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1392 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:32.880970 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4f5f3902-a5f9-4645-a69b-0793ceb8bc95 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "POST /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7/action" status: 202 len: 0 microversion: 2.1 time: 0.348391 May 28 04:59:32.884579 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2874/5636] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:59:32 2022] POST /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:59:32.898369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dee331b4-e0cd-43e7-9c21-c47d5b67798d tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:32.899632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dee331b4-e0cd-43e7-9c21-c47d5b67798d tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:32.909273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:59:32.922489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dee331b4-e0cd-43e7-9c21-c47d5b67798d tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:32.924582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dee331b4-e0cd-43e7-9c21-c47d5b67798d tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:32.925671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dee331b4-e0cd-43e7-9c21-c47d5b67798d tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:32.926344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dee331b4-e0cd-43e7-9c21-c47d5b67798d tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:33.110580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-478fe000-5dd9-4d54-835a-6a17f1c6d7e1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:33.120588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-478fe000-5dd9-4d54-835a-6a17f1c6d7e1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:33.146860 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-478fe000-5dd9-4d54-835a-6a17f1c6d7e1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:33.148368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-478fe000-5dd9-4d54-835a-6a17f1c6d7e1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:33.150184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-478fe000-5dd9-4d54-835a-6a17f1c6d7e1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:33.152757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-478fe000-5dd9-4d54-835a-6a17f1c6d7e1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:34.131621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-478fe000-5dd9-4d54-835a-6a17f1c6d7e1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:34.146750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-478fe000-5dd9-4d54-835a-6a17f1c6d7e1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:34.148516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-478fe000-5dd9-4d54-835a-6a17f1c6d7e1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:34.148678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dee331b4-e0cd-43e7-9c21-c47d5b67798d tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:34.152598 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-478fe000-5dd9-4d54-835a-6a17f1c6d7e1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 1.048213 May 28 04:59:34.164606 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dee331b4-e0cd-43e7-9c21-c47d5b67798d tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1499 microversion: 2.1 time: 1.277118 May 28 04:59:34.177588 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2875/5637] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:33 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:59:34.177588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dd7242f9-e474-4c10-9cbc-4873f6d7c672 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:34.177588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dd7242f9-e474-4c10-9cbc-4873f6d7c672 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:34.190655 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2763/5638] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:32 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1499 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:34.193331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd7242f9-e474-4c10-9cbc-4873f6d7c672 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:34.198382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd7242f9-e474-4c10-9cbc-4873f6d7c672 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:34.198382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd7242f9-e474-4c10-9cbc-4873f6d7c672 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:34.198382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd7242f9-e474-4c10-9cbc-4873f6d7c672 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:34.568815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-5f4c5575-ba69-4e00-9d0f-fdfe68681847 req-1a7c464c-fc3a-4143-9df9-723d33429620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "name": "network-vif-plugged", "status": "completed", "tag": "e8a39c56-6241-47f0-8b49-def4fa9702ac"}, {"server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "name": "network-vif-plugged", "status": "completed", "tag": "61b2868e-0dad-46f9-8275-e618419765f6"}, {"server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "name": "network-vif-plugged", "status": "completed", "tag": "6ee64452-58e9-4d01-9ea8-79160a3e1c92"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:59:34.574832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dd7242f9-e474-4c10-9cbc-4873f6d7c672 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:34.584108 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dd7242f9-e474-4c10-9cbc-4873f6d7c672 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1392 microversion: 2.1 time: 0.415951 May 28 04:59:34.586389 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2876/5639] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:34 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1392 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:34.598278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5f4c5575-ba69-4e00-9d0f-fdfe68681847 req-1a7c464c-fc3a-4143-9df9-723d33429620 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:34.598278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5f4c5575-ba69-4e00-9d0f-fdfe68681847 req-1a7c464c-fc3a-4143-9df9-723d33429620 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:34.640824 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-5f4c5575-ba69-4e00-9d0f-fdfe68681847 req-1a7c464c-fc3a-4143-9df9-723d33429620 service nova] Creating event network-vif-plugged:e8a39c56-6241-47f0-8b49-def4fa9702ac for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 04:59:34.640824 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-5f4c5575-ba69-4e00-9d0f-fdfe68681847 req-1a7c464c-fc3a-4143-9df9-723d33429620 service nova] Creating event network-vif-plugged:61b2868e-0dad-46f9-8275-e618419765f6 for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 04:59:34.640824 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-5f4c5575-ba69-4e00-9d0f-fdfe68681847 req-1a7c464c-fc3a-4143-9df9-723d33429620 service nova] Creating event network-vif-plugged:6ee64452-58e9-4d01-9ea8-79160a3e1c92 for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 04:59:34.649570 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-5f4c5575-ba69-4e00-9d0f-fdfe68681847 req-1a7c464c-fc3a-4143-9df9-723d33429620 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.084518 May 28 04:59:34.659644 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2764/5640] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:59:35.175549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1b247ece-b98e-4ac2-be10-22f9f728e946 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:35.176971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1b247ece-b98e-4ac2-be10-22f9f728e946 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:35.188757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8c7620f4-5c78-4dcf-8896-28c205cabaeb tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:35.192375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8c7620f4-5c78-4dcf-8896-28c205cabaeb tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:35.212419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b247ece-b98e-4ac2-be10-22f9f728e946 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:35.213930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c7620f4-5c78-4dcf-8896-28c205cabaeb tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:35.218388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b247ece-b98e-4ac2-be10-22f9f728e946 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:35.219275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c7620f4-5c78-4dcf-8896-28c205cabaeb tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:35.221017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c7620f4-5c78-4dcf-8896-28c205cabaeb tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:35.221547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b247ece-b98e-4ac2-be10-22f9f728e946 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:35.222773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b247ece-b98e-4ac2-be10-22f9f728e946 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:35.223456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c7620f4-5c78-4dcf-8896-28c205cabaeb tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:35.775408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8c7620f4-5c78-4dcf-8896-28c205cabaeb tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:35.791568 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8c7620f4-5c78-4dcf-8896-28c205cabaeb tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1499 microversion: 2.1 time: 0.608075 May 28 04:59:35.792685 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2765/5641] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:35 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1499 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:59:35.805125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d0a2418e-ee84-4656-a6ff-bb1e6d876a5f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:35.807841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d0a2418e-ee84-4656-a6ff-bb1e6d876a5f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:35.830137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0a2418e-ee84-4656-a6ff-bb1e6d876a5f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:35.830137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0a2418e-ee84-4656-a6ff-bb1e6d876a5f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:35.830137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0a2418e-ee84-4656-a6ff-bb1e6d876a5f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:35.830137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0a2418e-ee84-4656-a6ff-bb1e6d876a5f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:35.830538 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1b247ece-b98e-4ac2-be10-22f9f728e946 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:35.890497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1b247ece-b98e-4ac2-be10-22f9f728e946 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:35.902086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1b247ece-b98e-4ac2-be10-22f9f728e946 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:35.908042 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1b247ece-b98e-4ac2-be10-22f9f728e946 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 0.737701 May 28 04:59:35.912106 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2877/5642] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:35 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:59:36.002617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7b8de067-d645-4bde-baa4-8f989aa042c5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:36.003448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7b8de067-d645-4bde-baa4-8f989aa042c5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:36.021915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b8de067-d645-4bde-baa4-8f989aa042c5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:36.022379 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b8de067-d645-4bde-baa4-8f989aa042c5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:36.023191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b8de067-d645-4bde-baa4-8f989aa042c5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:36.023631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b8de067-d645-4bde-baa4-8f989aa042c5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:36.198213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-7b8de067-d645-4bde-baa4-8f989aa042c5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lazy-loading 'services' on Instance uuid d9317fed-13ab-4242-843f-ef74497895e1 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:59:36.333406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d0a2418e-ee84-4656-a6ff-bb1e6d876a5f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:36.345477 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d0a2418e-ee84-4656-a6ff-bb1e6d876a5f tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1392 microversion: 2.1 time: 0.549760 May 28 04:59:36.348732 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2766/5643] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:35 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1392 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:36.508137 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7b8de067-d645-4bde-baa4-8f989aa042c5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments/55376061-f9ef-42a2-a971-8782f240dca4" status: 202 len: 0 microversion: 2.1 time: 0.510813 May 28 04:59:36.509062 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2878/5644] 10.222.0.58 () {58 vars in 1415 bytes} [Sat May 28 04:59:35 2022] DELETE /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments/55376061-f9ef-42a2-a971-8782f240dca4 => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 04:59:36.527937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c198b8d6-351e-4ed1-bab8-d6efa5671633 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:36.531079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c198b8d6-351e-4ed1-bab8-d6efa5671633 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:36.556262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c198b8d6-351e-4ed1-bab8-d6efa5671633 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:36.568205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c198b8d6-351e-4ed1-bab8-d6efa5671633 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:36.570604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c198b8d6-351e-4ed1-bab8-d6efa5671633 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:36.571551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c198b8d6-351e-4ed1-bab8-d6efa5671633 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:36.579745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:59:36.622261 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c198b8d6-351e-4ed1-bab8-d6efa5671633 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108081 May 28 04:59:36.626167 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2767/5645] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:59:36 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:59:36.734477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-7af2b394-da40-4ea4-8e07-7b7f3d5d0d95 req-cca1fbfc-38b2-45f0-a982-6ced0de37486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "name": "network-vif-plugged", "status": "completed", "tag": "957dc55b-f873-4efe-bcf8-2621e22f7c67"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:59:36.754365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-7af2b394-da40-4ea4-8e07-7b7f3d5d0d95 req-cca1fbfc-38b2-45f0-a982-6ced0de37486 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:36.757689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-7af2b394-da40-4ea4-8e07-7b7f3d5d0d95 req-cca1fbfc-38b2-45f0-a982-6ced0de37486 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:36.793898 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-7af2b394-da40-4ea4-8e07-7b7f3d5d0d95 req-cca1fbfc-38b2-45f0-a982-6ced0de37486 service nova] Creating event network-vif-plugged:957dc55b-f873-4efe-bcf8-2621e22f7c67 for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 04:59:36.812973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-83f7b43b-3d7a-466e-ab72-14ed168fb8d6 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:36.815913 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-7af2b394-da40-4ea4-8e07-7b7f3d5d0d95 req-cca1fbfc-38b2-45f0-a982-6ced0de37486 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090147 May 28 04:59:36.816871 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2879/5646] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:59:36.817127 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-83f7b43b-3d7a-466e-ab72-14ed168fb8d6 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:36.831313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-83f7b43b-3d7a-466e-ab72-14ed168fb8d6 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:36.832115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-83f7b43b-3d7a-466e-ab72-14ed168fb8d6 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:36.836324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-83f7b43b-3d7a-466e-ab72-14ed168fb8d6 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:36.836324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-83f7b43b-3d7a-466e-ab72-14ed168fb8d6 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:36.932382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9f934d52-6ff7-48e9-93d1-1246c1877eb9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:36.933363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9f934d52-6ff7-48e9-93d1-1246c1877eb9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:36.955660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f934d52-6ff7-48e9-93d1-1246c1877eb9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:36.956116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f934d52-6ff7-48e9-93d1-1246c1877eb9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:36.956966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f934d52-6ff7-48e9-93d1-1246c1877eb9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:36.958600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f934d52-6ff7-48e9-93d1-1246c1877eb9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:37.975236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-83f7b43b-3d7a-466e-ab72-14ed168fb8d6 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:37.984639 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-83f7b43b-3d7a-466e-ab72-14ed168fb8d6 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1502 microversion: 2.1 time: 1.178836 May 28 04:59:37.996655 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2768/5647] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:36 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1502 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:59:38.004063 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-28b561cf-549f-46f4-988b-d2356581f5e2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:38.008669 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-28b561cf-549f-46f4-988b-d2356581f5e2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:38.021093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-28b561cf-549f-46f4-988b-d2356581f5e2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:38.022025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-28b561cf-549f-46f4-988b-d2356581f5e2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:38.027943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-28b561cf-549f-46f4-988b-d2356581f5e2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:38.032728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-28b561cf-549f-46f4-988b-d2356581f5e2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:38.488884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9f934d52-6ff7-48e9-93d1-1246c1877eb9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:38.508046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9f934d52-6ff7-48e9-93d1-1246c1877eb9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:38.511654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9f934d52-6ff7-48e9-93d1-1246c1877eb9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:38.518884 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9f934d52-6ff7-48e9-93d1-1246c1877eb9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 1.590037 May 28 04:59:38.524311 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2880/5648] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:36 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:59:38.529029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b4515fa0-67ea-4249-9e7f-4f83eca12aee tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:38.530020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b4515fa0-67ea-4249-9e7f-4f83eca12aee tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:38.551481 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4515fa0-67ea-4249-9e7f-4f83eca12aee tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:38.551899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4515fa0-67ea-4249-9e7f-4f83eca12aee tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:38.560821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4515fa0-67ea-4249-9e7f-4f83eca12aee tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:38.561296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4515fa0-67ea-4249-9e7f-4f83eca12aee tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:38.623581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:59:38.623581 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b4515fa0-67ea-4249-9e7f-4f83eca12aee tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085767 May 28 04:59:38.623581 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2881/5649] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:59:38 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:59:38.623581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c1284f57-bcb3-41af-9a0d-7d6cec99bfbd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:38.623581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c1284f57-bcb3-41af-9a0d-7d6cec99bfbd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:38.623581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1284f57-bcb3-41af-9a0d-7d6cec99bfbd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:38.625109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1284f57-bcb3-41af-9a0d-7d6cec99bfbd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:38.625562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1284f57-bcb3-41af-9a0d-7d6cec99bfbd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:38.626187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1284f57-bcb3-41af-9a0d-7d6cec99bfbd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:38.660775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c1284f57-bcb3-41af-9a0d-7d6cec99bfbd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:59:38.894040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-28b561cf-549f-46f4-988b-d2356581f5e2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:38.911857 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-28b561cf-549f-46f4-988b-d2356581f5e2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1392 microversion: 2.1 time: 0.913649 May 28 04:59:38.912566 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2769/5650] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:37 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1392 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:39.029189 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c1284f57-bcb3-41af-9a0d-7d6cec99bfbd tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "DELETE /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 204 len: 0 microversion: 2.1 time: 0.418773 May 28 04:59:39.029800 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2882/5651] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:59:38 2022] DELETE /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:59:39.041722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7147c1a7-e1ca-4c24-9b75-6296e553b4de tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:39.043283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7147c1a7-e1ca-4c24-9b75-6296e553b4de tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:39.058960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-c8275327-9a52-4e12-9ad2-ea9e2b1ab63e req-6e3992a5-36e2-42d9-a83e-e253039cd60a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "name": "network-vif-plugged", "status": "completed", "tag": "01a910c0-bb8d-4131-b876-19533c7842f6"}, {"server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "name": "network-vif-plugged", "status": "completed", "tag": "8031bb99-e01d-435c-86af-766fd0b45f7c"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:59:39.079045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7147c1a7-e1ca-4c24-9b75-6296e553b4de tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:39.079793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7147c1a7-e1ca-4c24-9b75-6296e553b4de tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:39.080773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7147c1a7-e1ca-4c24-9b75-6296e553b4de tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:39.082124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c8275327-9a52-4e12-9ad2-ea9e2b1ab63e req-6e3992a5-36e2-42d9-a83e-e253039cd60a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:39.082895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7147c1a7-e1ca-4c24-9b75-6296e553b4de tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:39.089041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c8275327-9a52-4e12-9ad2-ea9e2b1ab63e req-6e3992a5-36e2-42d9-a83e-e253039cd60a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:39.113314 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-c8275327-9a52-4e12-9ad2-ea9e2b1ab63e req-6e3992a5-36e2-42d9-a83e-e253039cd60a service nova] Creating event network-vif-plugged:01a910c0-bb8d-4131-b876-19533c7842f6 for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 04:59:39.115633 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-c8275327-9a52-4e12-9ad2-ea9e2b1ab63e req-6e3992a5-36e2-42d9-a83e-e253039cd60a service nova] Creating event network-vif-plugged:8031bb99-e01d-435c-86af-766fd0b45f7c for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 04:59:39.126834 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-c8275327-9a52-4e12-9ad2-ea9e2b1ab63e req-6e3992a5-36e2-42d9-a83e-e253039cd60a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073375 May 28 04:59:39.151163 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2883/5652] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:59:39.539141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f196c4f0-9b85-4326-baa4-eaf300d24779 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:39.540102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f196c4f0-9b85-4326-baa4-eaf300d24779 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:39.553368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f196c4f0-9b85-4326-baa4-eaf300d24779 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:39.554094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f196c4f0-9b85-4326-baa4-eaf300d24779 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:39.555242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f196c4f0-9b85-4326-baa4-eaf300d24779 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:39.555947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f196c4f0-9b85-4326-baa4-eaf300d24779 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:39.860217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7147c1a7-e1ca-4c24-9b75-6296e553b4de tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:39.871729 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7147c1a7-e1ca-4c24-9b75-6296e553b4de tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1508 microversion: 2.1 time: 0.832605 May 28 04:59:39.872982 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2770/5653] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:39 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1508 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:39.887576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-920b4850-83eb-4b0e-af01-53a903a51624 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:39.892553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-920b4850-83eb-4b0e-af01-53a903a51624 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:39.909271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-920b4850-83eb-4b0e-af01-53a903a51624 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:39.912600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-920b4850-83eb-4b0e-af01-53a903a51624 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:39.915379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-920b4850-83eb-4b0e-af01-53a903a51624 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:39.917691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-920b4850-83eb-4b0e-af01-53a903a51624 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:40.010902 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-920b4850-83eb-4b0e-af01-53a903a51624 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135334 May 28 04:59:40.011890 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2771/5654] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:59:39 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:59:40.016960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e04a5923-277b-4959-ab93-53b16184c5f8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:40.017889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e04a5923-277b-4959-ab93-53b16184c5f8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:40.024503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e04a5923-277b-4959-ab93-53b16184c5f8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:40.025304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e04a5923-277b-4959-ab93-53b16184c5f8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:40.026330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e04a5923-277b-4959-ab93-53b16184c5f8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:40.027020 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e04a5923-277b-4959-ab93-53b16184c5f8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:40.040995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f196c4f0-9b85-4326-baa4-eaf300d24779 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:40.056036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f196c4f0-9b85-4326-baa4-eaf300d24779 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:40.058254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f196c4f0-9b85-4326-baa4-eaf300d24779 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:40.059527 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f196c4f0-9b85-4326-baa4-eaf300d24779 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1874 microversion: 2.32 time: 0.525600 May 28 04:59:40.063040 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2884/5655] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:39 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1874 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 04:59:40.463462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e04a5923-277b-4959-ab93-53b16184c5f8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:40.479840 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e04a5923-277b-4959-ab93-53b16184c5f8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1392 microversion: 2.1 time: 0.466528 May 28 04:59:40.482273 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2772/5656] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:40 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1392 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:40.897095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5bebe7f6-1044-4d37-bc2a-3cf428486b07 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:40.899717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5bebe7f6-1044-4d37-bc2a-3cf428486b07 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:40.930775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5bebe7f6-1044-4d37-bc2a-3cf428486b07 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:40.932549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5bebe7f6-1044-4d37-bc2a-3cf428486b07 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:40.937007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5bebe7f6-1044-4d37-bc2a-3cf428486b07 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:40.938758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5bebe7f6-1044-4d37-bc2a-3cf428486b07 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:41.023217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fd00293e-22e2-40cd-a12e-07cc0328553b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:41.024711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fd00293e-22e2-40cd-a12e-07cc0328553b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:41.042135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fd00293e-22e2-40cd-a12e-07cc0328553b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:41.042364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fd00293e-22e2-40cd-a12e-07cc0328553b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:41.053083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fd00293e-22e2-40cd-a12e-07cc0328553b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:41.053551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fd00293e-22e2-40cd-a12e-07cc0328553b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:41.136714 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fd00293e-22e2-40cd-a12e-07cc0328553b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117559 May 28 04:59:41.157403 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2773/5657] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:59:41 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:59:41.174662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b44842ab-1f41-4b2d-940f-51fc6dc66232 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:41.175569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b44842ab-1f41-4b2d-940f-51fc6dc66232 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:41.190666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b44842ab-1f41-4b2d-940f-51fc6dc66232 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:41.191901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b44842ab-1f41-4b2d-940f-51fc6dc66232 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:41.192916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b44842ab-1f41-4b2d-940f-51fc6dc66232 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:41.193599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b44842ab-1f41-4b2d-940f-51fc6dc66232 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:43.355305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b44842ab-1f41-4b2d-940f-51fc6dc66232 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:43.366970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b44842ab-1f41-4b2d-940f-51fc6dc66232 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:43.370027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b44842ab-1f41-4b2d-940f-51fc6dc66232 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:43.371630 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b44842ab-1f41-4b2d-940f-51fc6dc66232 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 2825 microversion: 2.32 time: 2.213164 May 28 04:59:43.385317 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2774/5658] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 04:59:41 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 2825 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:59:43.385317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-ea0124f9-6e14-4a0e-aa58-1c7a9d0059b6 req-191b10ff-74fe-43d7-9c58-892b181786e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82767745-0d0e-4892-b97e-28a49a746db0", "name": "network-vif-plugged", "status": "completed", "tag": "79daf806-2760-45f3-a32b-75949a5241dd"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:59:43.391753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ea0124f9-6e14-4a0e-aa58-1c7a9d0059b6 req-191b10ff-74fe-43d7-9c58-892b181786e0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:43.392820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ea0124f9-6e14-4a0e-aa58-1c7a9d0059b6 req-191b10ff-74fe-43d7-9c58-892b181786e0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:43.412116 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-ea0124f9-6e14-4a0e-aa58-1c7a9d0059b6 req-191b10ff-74fe-43d7-9c58-892b181786e0 service nova] Creating event network-vif-plugged:79daf806-2760-45f3-a32b-75949a5241dd for instance 82767745-0d0e-4892-b97e-28a49a746db0 on n-h1-843700-1 May 28 04:59:43.424248 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-ea0124f9-6e14-4a0e-aa58-1c7a9d0059b6 req-191b10ff-74fe-43d7-9c58-892b181786e0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043422 May 28 04:59:43.424248 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2775/5659] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:59:43.438853 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5bebe7f6-1044-4d37-bc2a-3cf428486b07 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:43.450332 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5bebe7f6-1044-4d37-bc2a-3cf428486b07 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1508 microversion: 2.1 time: 2.564356 May 28 04:59:43.451677 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2885/5660] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:40 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1508 bytes in 2566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:43.457676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b58f6b32-9fdb-42ed-977d-10adb8400c1c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:43.458960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b58f6b32-9fdb-42ed-977d-10adb8400c1c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:43.466425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1f4ea7be-60bd-4a2e-a29b-b07df132690d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:43.467275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1f4ea7be-60bd-4a2e-a29b-b07df132690d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:43.470074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b58f6b32-9fdb-42ed-977d-10adb8400c1c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:43.470823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b58f6b32-9fdb-42ed-977d-10adb8400c1c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:43.472157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b58f6b32-9fdb-42ed-977d-10adb8400c1c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:43.474859 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b58f6b32-9fdb-42ed-977d-10adb8400c1c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:43.495339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1f4ea7be-60bd-4a2e-a29b-b07df132690d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:43.496049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1f4ea7be-60bd-4a2e-a29b-b07df132690d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:43.497009 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1f4ea7be-60bd-4a2e-a29b-b07df132690d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:43.498208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1f4ea7be-60bd-4a2e-a29b-b07df132690d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:43.523660 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b58f6b32-9fdb-42ed-977d-10adb8400c1c tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070337 May 28 04:59:43.525482 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2886/5661] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:59:43 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:59:43.531880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-95d9066c-562b-42d0-8b5c-fb110efce75d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:43.532711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-95d9066c-562b-42d0-8b5c-fb110efce75d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:43.546892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-95d9066c-562b-42d0-8b5c-fb110efce75d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:43.547713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-95d9066c-562b-42d0-8b5c-fb110efce75d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:43.548698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-95d9066c-562b-42d0-8b5c-fb110efce75d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:43.549313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-95d9066c-562b-42d0-8b5c-fb110efce75d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:43.949704 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-95d9066c-562b-42d0-8b5c-fb110efce75d tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.422688 May 28 04:59:43.950730 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2887/5662] 10.222.0.58 () {60 vars in 1315 bytes} [Sat May 28 04:59:43 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce/os-interface => generated 1828 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 04:59:44.328415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1f4ea7be-60bd-4a2e-a29b-b07df132690d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:44.354282 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1f4ea7be-60bd-4a2e-a29b-b07df132690d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1392 microversion: 2.1 time: 0.924200 May 28 04:59:44.360634 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2776/5663] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:43 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1392 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:44.467580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-424376a7-776c-468c-9565-cc1653bf8c0f tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:44.468929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-424376a7-776c-468c-9565-cc1653bf8c0f tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:44.488887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-424376a7-776c-468c-9565-cc1653bf8c0f tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:44.489491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-424376a7-776c-468c-9565-cc1653bf8c0f tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:44.495308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-424376a7-776c-468c-9565-cc1653bf8c0f tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:44.495308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-424376a7-776c-468c-9565-cc1653bf8c0f tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:44.536749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aa6aff06-189e-44ab-a62b-e64ad73ef397 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:44.537837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-aa6aff06-189e-44ab-a62b-e64ad73ef397 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:44.547238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa6aff06-189e-44ab-a62b-e64ad73ef397 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:44.547698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa6aff06-189e-44ab-a62b-e64ad73ef397 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:44.548498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa6aff06-189e-44ab-a62b-e64ad73ef397 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:44.548942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa6aff06-189e-44ab-a62b-e64ad73ef397 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:44.622850 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aa6aff06-189e-44ab-a62b-e64ad73ef397 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090104 May 28 04:59:44.624731 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2777/5664] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:59:44 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:59:44.821816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-424376a7-776c-468c-9565-cc1653bf8c0f tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:44.832702 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-424376a7-776c-468c-9565-cc1653bf8c0f tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1466 microversion: 2.1 time: 0.369407 May 28 04:59:44.840994 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2888/5665] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:44 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1466 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:45.032680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-d9e478cf-7459-4bd0-8cf2-d0a7599a6b83 req-de192c4a-6041-4d28-8bf6-504ab263a297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "281fbd8b-34b4-4f55-b31c-dab1846b2eb7", "name": "network-vif-deleted", "tag": "912c00b5-690d-406a-8dbc-6f4e7332100d"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:59:45.069564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d9e478cf-7459-4bd0-8cf2-d0a7599a6b83 req-de192c4a-6041-4d28-8bf6-504ab263a297 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:45.071520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d9e478cf-7459-4bd0-8cf2-d0a7599a6b83 req-de192c4a-6041-4d28-8bf6-504ab263a297 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:45.134389 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-d9e478cf-7459-4bd0-8cf2-d0a7599a6b83 req-de192c4a-6041-4d28-8bf6-504ab263a297 service nova] Creating event network-vif-deleted:912c00b5-690d-406a-8dbc-6f4e7332100d for instance 281fbd8b-34b4-4f55-b31c-dab1846b2eb7 on n-h1-843700-1 May 28 04:59:45.153197 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-d9e478cf-7459-4bd0-8cf2-d0a7599a6b83 req-de192c4a-6041-4d28-8bf6-504ab263a297 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124875 May 28 04:59:45.163959 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2778/5666] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:59:45.372909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-947f614c-f17f-43b8-b21b-161706d8dd38 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:45.374372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-947f614c-f17f-43b8-b21b-161706d8dd38 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:45.384540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-947f614c-f17f-43b8-b21b-161706d8dd38 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:45.396475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-947f614c-f17f-43b8-b21b-161706d8dd38 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:45.400708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-947f614c-f17f-43b8-b21b-161706d8dd38 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:45.401332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-947f614c-f17f-43b8-b21b-161706d8dd38 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:45.637033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f4727d9d-85f7-4861-b376-0c70d4e834c7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:45.638053 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f4727d9d-85f7-4861-b376-0c70d4e834c7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:45.663036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4727d9d-85f7-4861-b376-0c70d4e834c7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:45.670033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4727d9d-85f7-4861-b376-0c70d4e834c7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:45.670033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4727d9d-85f7-4861-b376-0c70d4e834c7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:45.670680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4727d9d-85f7-4861-b376-0c70d4e834c7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:45.759303 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f4727d9d-85f7-4861-b376-0c70d4e834c7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127867 May 28 04:59:45.759896 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2779/5667] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:59:45 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:59:45.857424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2b452171-4a44-4490-8f37-c49ab346af17 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:45.858082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2b452171-4a44-4490-8f37-c49ab346af17 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:45.873208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b452171-4a44-4490-8f37-c49ab346af17 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:45.874431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b452171-4a44-4490-8f37-c49ab346af17 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:45.891551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b452171-4a44-4490-8f37-c49ab346af17 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:45.892227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b452171-4a44-4490-8f37-c49ab346af17 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:45.937772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b452171-4a44-4490-8f37-c49ab346af17 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:45.938485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b452171-4a44-4490-8f37-c49ab346af17 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:45.939261 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-2b452171-4a44-4490-8f37-c49ab346af17 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lazy-loading 'fault' on Instance uuid 281fbd8b-34b4-4f55-b31c-dab1846b2eb7 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 04:59:46.646073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-947f614c-f17f-43b8-b21b-161706d8dd38 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:46.683597 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-947f614c-f17f-43b8-b21b-161706d8dd38 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1392 microversion: 2.1 time: 1.315078 May 28 04:59:46.687395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2b452171-4a44-4490-8f37-c49ab346af17 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9708d0a9af4d4c9eb22ebc14e9409612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b5b2a321740aaa2cfc3b23ad75aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:46.700089 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2889/5668] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:45 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1392 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:46.713758 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2b452171-4a44-4490-8f37-c49ab346af17 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 200 len: 1305 microversion: 2.1 time: 0.840592 May 28 04:59:46.723988 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2780/5669] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:45 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 1305 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:46.775559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1ead780a-42fd-4b58-b3a5-56cd542f0fc5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:46.791578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1ead780a-42fd-4b58-b3a5-56cd542f0fc5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:46.812251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ead780a-42fd-4b58-b3a5-56cd542f0fc5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:46.814658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ead780a-42fd-4b58-b3a5-56cd542f0fc5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:46.821285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ead780a-42fd-4b58-b3a5-56cd542f0fc5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:46.822143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ead780a-42fd-4b58-b3a5-56cd542f0fc5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:46.905484 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1ead780a-42fd-4b58-b3a5-56cd542f0fc5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136863 May 28 04:59:46.911831 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2890/5670] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:59:46 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:59:47.704257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9ee9dd76-544d-400a-a53c-6f22f51d8f7c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:47.705024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9ee9dd76-544d-400a-a53c-6f22f51d8f7c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:47.718055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ee9dd76-544d-400a-a53c-6f22f51d8f7c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:47.718516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ee9dd76-544d-400a-a53c-6f22f51d8f7c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:47.719339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ee9dd76-544d-400a-a53c-6f22f51d8f7c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:47.719783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ee9dd76-544d-400a-a53c-6f22f51d8f7c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:47.733480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7779376d-b6aa-4317-a387-6f697c8c7567 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:47.735643 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7779376d-b6aa-4317-a387-6f697c8c7567 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] [instance: 281fbd8b-34b4-4f55-b31c-dab1846b2eb7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:47.749063 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7779376d-b6aa-4317-a387-6f697c8c7567 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:47.752173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7779376d-b6aa-4317-a387-6f697c8c7567 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:47.755334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7779376d-b6aa-4317-a387-6f697c8c7567 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:47.755982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7779376d-b6aa-4317-a387-6f697c8c7567 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:47.794711 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-7779376d-b6aa-4317-a387-6f697c8c7567 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] HTTP exception thrown: Instance 281fbd8b-34b4-4f55-b31c-dab1846b2eb7 could not be found. May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7779376d-b6aa-4317-a387-6f697c8c7567 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Request method failure captured: May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 HTTP/1.1 May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikawHuMnQvhuUb5swfjwJ4CRGImXapI6qsFVp0nMLNPaApaiW613X8lzgfkli0pZgr5IcyBZgPY0OgzN0K1em84MJvFeM1EZl-lmNS_4GkjBw23fUQ6RH0LLb9mOAh5hNPS-Wfru_wWs4eg_s8N4k-JhJ5vQ16GAc_INXpSAtYQ_o40M May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 207b5b2a321740aaa2cfc3b23ad75aa9 May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TestServerAdvancedOps-465466424 May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_207b5b2a321740aaa2cfc3b23ad75aa9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/207b5b2a321740aaa2cfc3b23ad75aa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/207b5b2a321740aaa2cfc3b23ad75aa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/207b5b2a321740aaa2cfc3b23ad75aa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TestServerAdvancedOps-465466424 May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 207b5b2a321740aaa2cfc3b23ad75aa9 May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TestServerAdvancedOps-465466424 May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TestServerAdvancedOps-465466424-project May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 9708d0a9af4d4c9eb22ebc14e9409612 May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TestServerAdvancedOps-465466424-project May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 281fbd8b-34b4-4f55-b31c-dab1846b2eb7 could not be found. May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '281fbd8b-34b4-4f55-b31c-dab1846b2eb7'} May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 281fbd8b-34b4-4f55-b31c-dab1846b2eb7 could not be found. May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 281fbd8b-34b4-4f55-b31c-dab1846b2eb7 could not be found. May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:59:47.798688 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:59:47.804274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:59:47.804274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:59:47.804274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:59:47.804274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:59:47.804274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:59:47.804274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 281fbd8b-34b4-4f55-b31c-dab1846b2eb7 could not be found. May 28 04:59:47.804274 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:59:47.808628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7779376d-b6aa-4317-a387-6f697c8c7567 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] Returning 404 to user: Instance 281fbd8b-34b4-4f55-b31c-dab1846b2eb7 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:59:47.809921 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7779376d-b6aa-4317-a387-6f697c8c7567 tempest-TestServerAdvancedOps-465466424 tempest-TestServerAdvancedOps-465466424-project] 10.222.0.58 "GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7" status: 404 len: 111 microversion: 2.1 time: 0.082264 May 28 04:59:47.816956 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2891/5671] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:47 2022] GET /compute/v2.1/servers/281fbd8b-34b4-4f55-b31c-dab1846b2eb7 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 04:59:47.919766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-61406ecb-837b-43fd-b7cc-cce57786483f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:47.921656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-61406ecb-837b-43fd-b7cc-cce57786483f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:47.965041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-61406ecb-837b-43fd-b7cc-cce57786483f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:47.965041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-61406ecb-837b-43fd-b7cc-cce57786483f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:47.966836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-61406ecb-837b-43fd-b7cc-cce57786483f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:47.968255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-61406ecb-837b-43fd-b7cc-cce57786483f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:48.110877 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-61406ecb-837b-43fd-b7cc-cce57786483f tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195680 May 28 04:59:48.116847 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2892/5672] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:59:47 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:59:48.536367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-facd4993-6c39-4999-86ef-46d33e2667c5 req-84b4b962-29bc-4d27-b91a-5e8b79f6fc8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "tag": "e8a39c56-6241-47f0-8b49-def4fa9702ac"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:59:48.550840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-facd4993-6c39-4999-86ef-46d33e2667c5 req-84b4b962-29bc-4d27-b91a-5e8b79f6fc8f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:48.555213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-facd4993-6c39-4999-86ef-46d33e2667c5 req-84b4b962-29bc-4d27-b91a-5e8b79f6fc8f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:48.627332 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-facd4993-6c39-4999-86ef-46d33e2667c5 req-84b4b962-29bc-4d27-b91a-5e8b79f6fc8f service nova] Creating event network-changed:e8a39c56-6241-47f0-8b49-def4fa9702ac for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 04:59:48.703796 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-facd4993-6c39-4999-86ef-46d33e2667c5 req-84b4b962-29bc-4d27-b91a-5e8b79f6fc8f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176172 May 28 04:59:48.707452 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2893/5673] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 28 04:59:49.124153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-297601da-548e-43b5-87d4-767fcbc7e7cf tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:49.125911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-297601da-548e-43b5-87d4-767fcbc7e7cf tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:49.148334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-297601da-548e-43b5-87d4-767fcbc7e7cf tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:49.155179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-297601da-548e-43b5-87d4-767fcbc7e7cf tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:49.156289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-297601da-548e-43b5-87d4-767fcbc7e7cf tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:49.160124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-297601da-548e-43b5-87d4-767fcbc7e7cf tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:49.288394 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-297601da-548e-43b5-87d4-767fcbc7e7cf tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167687 May 28 04:59:49.294356 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2894/5674] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:59:49 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:59:50.302376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-84ed9d66-d8a8-4056-9d94-f69a6bc0ba60 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:50.303545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-84ed9d66-d8a8-4056-9d94-f69a6bc0ba60 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:50.336781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:59:50.337869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84ed9d66-d8a8-4056-9d94-f69a6bc0ba60 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:50.338338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84ed9d66-d8a8-4056-9d94-f69a6bc0ba60 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:50.339181 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84ed9d66-d8a8-4056-9d94-f69a6bc0ba60 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:50.339633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84ed9d66-d8a8-4056-9d94-f69a6bc0ba60 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:50.470613 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-84ed9d66-d8a8-4056-9d94-f69a6bc0ba60 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173659 May 28 04:59:50.471254 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2895/5675] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:59:50 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:59:50.824404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9ee9dd76-544d-400a-a53c-6f22f51d8f7c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:50.837885 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9ee9dd76-544d-400a-a53c-6f22f51d8f7c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1565 microversion: 2.1 time: 3.133818 May 28 04:59:50.854063 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2781/5676] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:47 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1565 bytes in 3155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:50.859770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1821192d-af43-4448-826a-c6030d1b77c9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:50.868450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1821192d-af43-4448-826a-c6030d1b77c9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:50.898552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1821192d-af43-4448-826a-c6030d1b77c9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:50.906604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1821192d-af43-4448-826a-c6030d1b77c9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:50.907693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1821192d-af43-4448-826a-c6030d1b77c9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:50.908257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1821192d-af43-4448-826a-c6030d1b77c9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:51.484755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eed40fb8-518d-4103-b1cf-00819d0ea537 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:51.486503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eed40fb8-518d-4103-b1cf-00819d0ea537 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:51.504562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1821192d-af43-4448-826a-c6030d1b77c9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:51.524253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=76 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:59:51.528063 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1821192d-af43-4448-826a-c6030d1b77c9 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1565 microversion: 2.1 time: 0.668025 May 28 04:59:51.543081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eed40fb8-518d-4103-b1cf-00819d0ea537 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:51.545769 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2896/5677] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:50 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1565 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 04:59:51.548059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eed40fb8-518d-4103-b1cf-00819d0ea537 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:51.549117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eed40fb8-518d-4103-b1cf-00819d0ea537 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:51.551571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eed40fb8-518d-4103-b1cf-00819d0ea537 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:51.637158 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eed40fb8-518d-4103-b1cf-00819d0ea537 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158907 May 28 04:59:51.643129 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2782/5678] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:59:51 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 04:59:52.650590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ea33cfbf-9b71-4cfa-81f7-da65913bff05 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:52.651950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ea33cfbf-9b71-4cfa-81f7-da65913bff05 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:52.671867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea33cfbf-9b71-4cfa-81f7-da65913bff05 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:52.675571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea33cfbf-9b71-4cfa-81f7-da65913bff05 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:52.680831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea33cfbf-9b71-4cfa-81f7-da65913bff05 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:52.683677 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea33cfbf-9b71-4cfa-81f7-da65913bff05 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:52.832143 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ea33cfbf-9b71-4cfa-81f7-da65913bff05 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182431 May 28 04:59:52.842973 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2897/5679] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:59:52 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:59:53.846927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a5e95a90-cbe0-467d-bd8d-88c5f412f637 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:53.847882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a5e95a90-cbe0-467d-bd8d-88c5f412f637 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:53.875087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5e95a90-cbe0-467d-bd8d-88c5f412f637 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:53.875707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5e95a90-cbe0-467d-bd8d-88c5f412f637 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:53.876542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5e95a90-cbe0-467d-bd8d-88c5f412f637 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:53.876993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5e95a90-cbe0-467d-bd8d-88c5f412f637 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:53.958322 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a5e95a90-cbe0-467d-bd8d-88c5f412f637 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115929 May 28 04:59:53.962499 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2783/5680] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:59:53 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:59:54.971139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f2b8f69b-0a98-42db-bc19-241c423d7e59 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:54.972203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f2b8f69b-0a98-42db-bc19-241c423d7e59 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:54.987428 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f2b8f69b-0a98-42db-bc19-241c423d7e59 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:54.988115 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f2b8f69b-0a98-42db-bc19-241c423d7e59 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:54.989575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f2b8f69b-0a98-42db-bc19-241c423d7e59 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:54.991689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f2b8f69b-0a98-42db-bc19-241c423d7e59 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:55.052832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:59:55.065916 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f2b8f69b-0a98-42db-bc19-241c423d7e59 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099912 May 28 04:59:55.067219 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2898/5681] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:59:54 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:59:56.355388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9b41be14-081a-4c3e-b656-cbf7e950e7ae tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:56.357189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9b41be14-081a-4c3e-b656-cbf7e950e7ae tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:56.368576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b41be14-081a-4c3e-b656-cbf7e950e7ae tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:56.370805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b41be14-081a-4c3e-b656-cbf7e950e7ae tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:56.372054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b41be14-081a-4c3e-b656-cbf7e950e7ae tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:56.373876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b41be14-081a-4c3e-b656-cbf7e950e7ae tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:56.424445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 04:59:56.428822 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9b41be14-081a-4c3e-b656-cbf7e950e7ae tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.353332 May 28 04:59:56.436658 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2784/5682] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:59:56 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments => generated 197 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:59:57.442088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-05211a5f-f2ae-4cd8-afb6-c7c5781c629a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:57.443794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-05211a5f-f2ae-4cd8-afb6-c7c5781c629a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:57.462957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05211a5f-f2ae-4cd8-afb6-c7c5781c629a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:57.463799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05211a5f-f2ae-4cd8-afb6-c7c5781c629a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:57.464812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05211a5f-f2ae-4cd8-afb6-c7c5781c629a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:57.465336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05211a5f-f2ae-4cd8-afb6-c7c5781c629a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:57.533990 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-05211a5f-f2ae-4cd8-afb6-c7c5781c629a tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096369 May 28 04:59:57.535067 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2899/5683] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 04:59:57 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 04:59:57.658344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-df64d9e1-1473-43de-a9e9-a09a61786606 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:59:57.660656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-df64d9e1-1473-43de-a9e9-a09a61786606 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:57.689359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df64d9e1-1473-43de-a9e9-a09a61786606 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:57.690093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df64d9e1-1473-43de-a9e9-a09a61786606 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:57.691128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df64d9e1-1473-43de-a9e9-a09a61786606 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:57.691832 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df64d9e1-1473-43de-a9e9-a09a61786606 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:57.731682 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-df64d9e1-1473-43de-a9e9-a09a61786606 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] HTTP exception thrown: Cannot 'reboot' instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 while it is in vm_state rescued May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-df64d9e1-1473-43de-a9e9-a09a61786606 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Request method failure captured: May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5/action HTTP/1.1 May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 28 May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaseTx-CUErJTvPPURHUDDZW_2xVLiNPRiy1eiv9_fcFy45c02JpQ6VvqCXLzIK18DfT6aHtEfhTBsOxiJEfEG-fv6OQ2f3JYTQWF_vNEb8rrFvp-Wh1TVJC4d-u-zkyoCZX0D4P_h38dgB9yzRPIskmXiQK2RKoPWvSUe713g1UiE0 May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: f043f5d6fc0a47429a445d8f25401570 May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: f043f5d6fc0a47429a445d8f25401570 May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerRescueNegativeTestJSON-1590365959-project May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 227be762b2bc4bbba6d3e3e9a1d28c9c May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1590365959-project May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: {"reboot": {"type": "HARD"}} May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: exception: Cannot 'reboot' instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 while it is in vm_state rescued May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'ccd1d50a-ecb5-406b-be4a-94ad6d8665b5', 'body': {'reboot': {'type': 'HARD'}}} May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 04:59:57.734350 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 04:59:57.739612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 while it is in vm_state rescued May 28 04:59:57.739612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:59:57.739612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:59:57.739612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:59:57.739612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:59:57.739612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:59:57.739612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:59:57.739612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:59:57.739612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:59:57.739612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 while it is in vm_state rescued May 28 04:59:57.739612 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 04:59:57.741950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-df64d9e1-1473-43de-a9e9-a09a61786606 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Returning 409 to user: Cannot 'reboot' instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 while it is in vm_state rescued {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:59:57.743186 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-df64d9e1-1473-43de-a9e9-a09a61786606 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "POST /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5/action" status: 409 len: 145 microversion: 2.1 time: 0.093979 May 28 04:59:57.745553 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2785/5684] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:59:57 2022] POST /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5/action => generated 145 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 04:59:57.765173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-80325c0b-0e70-473b-9291-16023bf53fef tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "012b12af-263c-4753-8fad-4a4022b439aa"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:59:57.766951 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-80325c0b-0e70-473b-9291-16023bf53fef tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:57.773874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80325c0b-0e70-473b-9291-16023bf53fef tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:57.774342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80325c0b-0e70-473b-9291-16023bf53fef tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:57.775187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80325c0b-0e70-473b-9291-16023bf53fef tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:57.775634 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80325c0b-0e70-473b-9291-16023bf53fef tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:57.839400 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-80325c0b-0e70-473b-9291-16023bf53fef tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] HTTP exception thrown: Cannot 'rebuild' instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 while it is in vm_state rescued May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-80325c0b-0e70-473b-9291-16023bf53fef tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Request method failure captured: May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5/action HTTP/1.1 May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 65 May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaseTx-CUErJTvPPURHUDDZW_2xVLiNPRiy1eiv9_fcFy45c02JpQ6VvqCXLzIK18DfT6aHtEfhTBsOxiJEfEG-fv6OQ2f3JYTQWF_vNEb8rrFvp-Wh1TVJC4d-u-zkyoCZX0D4P_h38dgB9yzRPIskmXiQK2RKoPWvSUe713g1UiE0 May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: f043f5d6fc0a47429a445d8f25401570 May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: f043f5d6fc0a47429a445d8f25401570 May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerRescueNegativeTestJSON-1590365959-project May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 227be762b2bc4bbba6d3e3e9a1d28c9c May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1590365959-project May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: {"rebuild": {"imageRef": "012b12af-263c-4753-8fad-4a4022b439aa"}} May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: exception: Cannot 'rebuild' instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 while it is in vm_state rescued May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'ccd1d50a-ecb5-406b-be4a-94ad6d8665b5', 'body': {'rebuild': {'imageRef': '012b12af-263c-4753-8fad-4a4022b439aa'}}} May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 in vm_state rescued. Cannot rebuild while the instance is in this state. May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:59:57.842522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 04:59:57.846804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 04:59:57.846804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 28 04:59:57.846804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild May 28 04:59:57.846804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 04:59:57.846804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 04:59:57.846804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 04:59:57.846804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 while it is in vm_state rescued May 28 04:59:57.846804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:59:57.846804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 04:59:57.846804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:59:57.846804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 04:59:57.846804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 04:59:57.846804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 04:59:57.846804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 04:59:57.846804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 04:59:57.846804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 while it is in vm_state rescued May 28 04:59:57.846804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 04:59:57.850173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-80325c0b-0e70-473b-9291-16023bf53fef tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Returning 409 to user: Cannot 'rebuild' instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 while it is in vm_state rescued {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 04:59:57.851097 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-80325c0b-0e70-473b-9291-16023bf53fef tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "POST /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5/action" status: 409 len: 146 microversion: 2.1 time: 0.100124 May 28 04:59:57.852179 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2900/5685] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 04:59:57 2022] POST /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5/action => generated 146 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 04:59:57.862458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4d1b1cba-3df4-41a5-b79e-d79f33ffe0b5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:57.863274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4d1b1cba-3df4-41a5-b79e-d79f33ffe0b5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:57.872232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d1b1cba-3df4-41a5-b79e-d79f33ffe0b5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:57.872707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d1b1cba-3df4-41a5-b79e-d79f33ffe0b5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:57.874105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d1b1cba-3df4-41a5-b79e-d79f33ffe0b5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:57.874610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d1b1cba-3df4-41a5-b79e-d79f33ffe0b5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:57.912812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4d1b1cba-3df4-41a5-b79e-d79f33ffe0b5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 04:59:58.226831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6f0d09a7-3a89-4fa2-be06-9fb73867158c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:58.227491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6f0d09a7-3a89-4fa2-be06-9fb73867158c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:58.238256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f0d09a7-3a89-4fa2-be06-9fb73867158c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:58.238974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f0d09a7-3a89-4fa2-be06-9fb73867158c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:58.240017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f0d09a7-3a89-4fa2-be06-9fb73867158c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:58.240475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f0d09a7-3a89-4fa2-be06-9fb73867158c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:58.420079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6f0d09a7-3a89-4fa2-be06-9fb73867158c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:58.441987 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6f0d09a7-3a89-4fa2-be06-9fb73867158c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1565 microversion: 2.1 time: 0.217078 May 28 04:59:58.443066 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2901/5686] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:58 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1565 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 04:59:58.459056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-aec5f557-3be6-4fe3-a7ed-b8fac12c5aa5 req-5f16a548-80aa-43eb-96ee-7b0218f8bd14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82767745-0d0e-4892-b97e-28a49a746db0", "tag": "79daf806-2760-45f3-a32b-75949a5241dd"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 04:59:58.485386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-aec5f557-3be6-4fe3-a7ed-b8fac12c5aa5 req-5f16a548-80aa-43eb-96ee-7b0218f8bd14 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:58.487821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-aec5f557-3be6-4fe3-a7ed-b8fac12c5aa5 req-5f16a548-80aa-43eb-96ee-7b0218f8bd14 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:58.520128 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-aec5f557-3be6-4fe3-a7ed-b8fac12c5aa5 req-5f16a548-80aa-43eb-96ee-7b0218f8bd14 service nova] Creating event network-changed:79daf806-2760-45f3-a32b-75949a5241dd for instance 82767745-0d0e-4892-b97e-28a49a746db0 on n-h1-843700-1 May 28 04:59:58.535944 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-aec5f557-3be6-4fe3-a7ed-b8fac12c5aa5 req-5f16a548-80aa-43eb-96ee-7b0218f8bd14 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090021 May 28 04:59:58.541851 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2902/5687] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 04:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 04:59:58.587438 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4d1b1cba-3df4-41a5-b79e-d79f33ffe0b5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 204 len: 0 microversion: 2.1 time: 0.726029 May 28 04:59:58.589300 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2786/5688] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 04:59:57 2022] DELETE /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 04:59:58.598871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-785c8d62-874b-480c-9d9c-aafb77a48e97 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 04:59:58.600746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-785c8d62-874b-480c-9d9c-aafb77a48e97 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 04:59:58.649989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-785c8d62-874b-480c-9d9c-aafb77a48e97 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:58.649989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-785c8d62-874b-480c-9d9c-aafb77a48e97 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:58.649989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-785c8d62-874b-480c-9d9c-aafb77a48e97 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 04:59:58.649989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-785c8d62-874b-480c-9d9c-aafb77a48e97 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 04:59:59.082189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-785c8d62-874b-480c-9d9c-aafb77a48e97 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 04:59:59.099332 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-785c8d62-874b-480c-9d9c-aafb77a48e97 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1687 microversion: 2.1 time: 0.504640 May 28 04:59:59.100577 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2903/5689] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 04:59:58 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1687 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:00.119514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dfca5394-6916-48f2-b3e8-fc55f1bb6172 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:00.121412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dfca5394-6916-48f2-b3e8-fc55f1bb6172 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:00.132803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfca5394-6916-48f2-b3e8-fc55f1bb6172 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:00.134299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfca5394-6916-48f2-b3e8-fc55f1bb6172 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:00.135376 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfca5394-6916-48f2-b3e8-fc55f1bb6172 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:00.136442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dfca5394-6916-48f2-b3e8-fc55f1bb6172 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:00.718305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dfca5394-6916-48f2-b3e8-fc55f1bb6172 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:00.746423 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dfca5394-6916-48f2-b3e8-fc55f1bb6172 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1687 microversion: 2.1 time: 0.624650 May 28 05:00:00.746423 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2787/5690] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:00 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1687 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:01.762289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2f94211c-7f3b-4d14-9373-976bd49b4e24 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:01.763713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2f94211c-7f3b-4d14-9373-976bd49b4e24 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:01.772130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f94211c-7f3b-4d14-9373-976bd49b4e24 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:01.772907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f94211c-7f3b-4d14-9373-976bd49b4e24 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:01.773936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f94211c-7f3b-4d14-9373-976bd49b4e24 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:01.774578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f94211c-7f3b-4d14-9373-976bd49b4e24 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:02.134410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2f94211c-7f3b-4d14-9373-976bd49b4e24 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:02.142666 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2f94211c-7f3b-4d14-9373-976bd49b4e24 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1687 microversion: 2.1 time: 0.384723 May 28 05:00:02.144505 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2904/5691] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:01 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1687 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:00:03.161275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e236757a-cdc4-4442-b1f5-092cdcb38ce4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:03.161910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e236757a-cdc4-4442-b1f5-092cdcb38ce4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:03.174478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e236757a-cdc4-4442-b1f5-092cdcb38ce4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:03.175444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e236757a-cdc4-4442-b1f5-092cdcb38ce4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:03.176577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e236757a-cdc4-4442-b1f5-092cdcb38ce4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:03.177230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e236757a-cdc4-4442-b1f5-092cdcb38ce4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:03.607600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e236757a-cdc4-4442-b1f5-092cdcb38ce4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:03.614342 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e236757a-cdc4-4442-b1f5-092cdcb38ce4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1687 microversion: 2.1 time: 0.456963 May 28 05:00:03.620314 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2788/5692] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:03 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1687 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:04.637884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2b74c0eb-00a7-48f9-961c-454081d911e5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:04.642652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2b74c0eb-00a7-48f9-961c-454081d911e5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:04.661583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b74c0eb-00a7-48f9-961c-454081d911e5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:04.665752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b74c0eb-00a7-48f9-961c-454081d911e5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:04.666681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b74c0eb-00a7-48f9-961c-454081d911e5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:04.667235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b74c0eb-00a7-48f9-961c-454081d911e5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:04.870605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2b74c0eb-00a7-48f9-961c-454081d911e5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:04.879842 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2b74c0eb-00a7-48f9-961c-454081d911e5 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1619 microversion: 2.1 time: 0.247024 May 28 05:00:04.887311 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2905/5693] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:04 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1619 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:05.315152 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-31829174-5140-4521-b118-374ea2d0b05d req-216188df-7352-4b2f-8744-54b32137b704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9317fed-13ab-4242-843f-ef74497895e1", "name": "network-vif-deleted", "tag": "d288a5a0-3ba2-4f53-8886-2642d079bc88"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:00:05.336985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-31829174-5140-4521-b118-374ea2d0b05d req-216188df-7352-4b2f-8744-54b32137b704 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:05.337689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-31829174-5140-4521-b118-374ea2d0b05d req-216188df-7352-4b2f-8744-54b32137b704 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:05.379138 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-31829174-5140-4521-b118-374ea2d0b05d req-216188df-7352-4b2f-8744-54b32137b704 service nova] Creating event network-vif-deleted:d288a5a0-3ba2-4f53-8886-2642d079bc88 for instance d9317fed-13ab-4242-843f-ef74497895e1 on n-h2-843700-1 May 28 05:00:05.388225 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-31829174-5140-4521-b118-374ea2d0b05d req-216188df-7352-4b2f-8744-54b32137b704 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081255 May 28 05:00:05.394504 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2789/5694] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:00:05.909103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3a61a892-9f5a-4e90-b5ea-2701c8cc382e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:05.909737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3a61a892-9f5a-4e90-b5ea-2701c8cc382e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:05.921661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a61a892-9f5a-4e90-b5ea-2701c8cc382e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:05.922130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a61a892-9f5a-4e90-b5ea-2701c8cc382e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:05.923034 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a61a892-9f5a-4e90-b5ea-2701c8cc382e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:05.934520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a61a892-9f5a-4e90-b5ea-2701c8cc382e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:05.973558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a61a892-9f5a-4e90-b5ea-2701c8cc382e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:05.974111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a61a892-9f5a-4e90-b5ea-2701c8cc382e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:05.974644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-3a61a892-9f5a-4e90-b5ea-2701c8cc382e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lazy-loading 'fault' on Instance uuid d9317fed-13ab-4242-843f-ef74497895e1 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:00:06.109607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3a61a892-9f5a-4e90-b5ea-2701c8cc382e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:06.121002 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3a61a892-9f5a-4e90-b5ea-2701c8cc382e tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 200 len: 1334 microversion: 2.1 time: 0.218354 May 28 05:00:06.163514 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2906/5695] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:05 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 1334 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:07.142532 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b3669656-a00f-41a6-a1d1-6eb3b7231b77 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:07.144093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b3669656-a00f-41a6-a1d1-6eb3b7231b77 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: d9317fed-13ab-4242-843f-ef74497895e1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:07.163544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b3669656-a00f-41a6-a1d1-6eb3b7231b77 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:07.167953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b3669656-a00f-41a6-a1d1-6eb3b7231b77 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:07.167953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b3669656-a00f-41a6-a1d1-6eb3b7231b77 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:07.167953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b3669656-a00f-41a6-a1d1-6eb3b7231b77 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:07.195679 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-b3669656-a00f-41a6-a1d1-6eb3b7231b77 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] HTTP exception thrown: Instance d9317fed-13ab-4242-843f-ef74497895e1 could not be found. May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b3669656-a00f-41a6-a1d1-6eb3b7231b77 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Request method failure captured: May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 HTTP/1.1 May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaseTx-CUErJTvPPURHUDDZW_2xVLiNPRiy1eiv9_fcFy45c02JpQ6VvqCXLzIK18DfT6aHtEfhTBsOxiJEfEG-fv6OQ2f3JYTQWF_vNEb8rrFvp-Wh1TVJC4d-u-zkyoCZX0D4P_h38dgB9yzRPIskmXiQK2RKoPWvSUe713g1UiE0 May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: f043f5d6fc0a47429a445d8f25401570 May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: f043f5d6fc0a47429a445d8f25401570 May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerRescueNegativeTestJSON-1590365959-project May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 227be762b2bc4bbba6d3e3e9a1d28c9c May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1590365959-project May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance d9317fed-13ab-4242-843f-ef74497895e1 could not be found. May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'd9317fed-13ab-4242-843f-ef74497895e1'} May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9317fed-13ab-4242-843f-ef74497895e1 could not be found. May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9317fed-13ab-4242-843f-ef74497895e1 could not be found. May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:00:07.201274 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:00:07.210064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:00:07.210064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:00:07.210064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:00:07.210064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:00:07.210064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:00:07.210064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:00:07.210064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9317fed-13ab-4242-843f-ef74497895e1 could not be found. May 28 05:00:07.210064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:00:07.210064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b3669656-a00f-41a6-a1d1-6eb3b7231b77 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Returning 404 to user: Instance d9317fed-13ab-4242-843f-ef74497895e1 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:00:07.216194 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b3669656-a00f-41a6-a1d1-6eb3b7231b77 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1" status: 404 len: 111 microversion: 2.1 time: 0.063914 May 28 05:00:07.222973 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2790/5696] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:07 2022] GET /compute/v2.1/servers/d9317fed-13ab-4242-843f-ef74497895e1 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:00:07.231846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-250d5413-9787-451c-af9c-20ae0bd11f75 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '.version_select at 0x7f7700c16b80>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:07.367437 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-250d5413-9787-451c-af9c-20ae0bd11f75 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-592305767" status: 202 len: 0 microversion: 2.1 time: 0.139742 May 28 05:00:07.368422 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2907/5697] 10.222.0.58 () {58 vars in 1217 bytes} [Sat May 28 05:00:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-592305767 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:00:09.758308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-97a811a7-31cf-4329-a3d9-edbb0237947a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:00:09.759901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-97a811a7-31cf-4329-a3d9-edbb0237947a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:09.779618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97a811a7-31cf-4329-a3d9-edbb0237947a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:09.781429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97a811a7-31cf-4329-a3d9-edbb0237947a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:09.782871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97a811a7-31cf-4329-a3d9-edbb0237947a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:09.785437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-97a811a7-31cf-4329-a3d9-edbb0237947a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:09.914198 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-97a811a7-31cf-4329-a3d9-edbb0237947a tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0/action" status: 200 len: 24565 microversion: 2.1 time: 0.164195 May 28 05:00:09.915637 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2791/5698] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:00:09 2022] POST /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0/action => generated 24565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:00:21.039954 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=45 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:00:21.040962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:00:21.050342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9e5507c7-14ca-44c4-8cd5-31f947a94db2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "012b12af-263c-4753-8fad-4a4022b439aa"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:00:21.051870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9e5507c7-14ca-44c4-8cd5-31f947a94db2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:21.147089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e5507c7-14ca-44c4-8cd5-31f947a94db2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:21.151680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e5507c7-14ca-44c4-8cd5-31f947a94db2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:21.156012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e5507c7-14ca-44c4-8cd5-31f947a94db2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:21.161576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e5507c7-14ca-44c4-8cd5-31f947a94db2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:21.373633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-9e5507c7-14ca-44c4-8cd5-31f947a94db2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:00:21.374498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-9e5507c7-14ca-44c4-8cd5-31f947a94db2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:00:21.378380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-9e5507c7-14ca-44c4-8cd5-31f947a94db2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:00:21.379044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-9e5507c7-14ca-44c4-8cd5-31f947a94db2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:00:21.381772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-9e5507c7-14ca-44c4-8cd5-31f947a94db2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:00:21.775978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9e5507c7-14ca-44c4-8cd5-31f947a94db2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:21.788150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e5507c7-14ca-44c4-8cd5-31f947a94db2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:21.788622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e5507c7-14ca-44c4-8cd5-31f947a94db2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:21.793816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e5507c7-14ca-44c4-8cd5-31f947a94db2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:21.794335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e5507c7-14ca-44c4-8cd5-31f947a94db2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:21.896583 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9e5507c7-14ca-44c4-8cd5-31f947a94db2 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0/action" status: 202 len: 1138 microversion: 2.1 time: 0.859000 May 28 05:00:21.916556 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2908/5699] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:00:21 2022] POST /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0/action => generated 1138 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 28 05:00:21.922471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3441c6c1-0767-4e94-82af-397463f6a3ae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:21.923918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3441c6c1-0767-4e94-82af-397463f6a3ae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:21.941430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:00:21.947310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:00:21.947310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3441c6c1-0767-4e94-82af-397463f6a3ae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:21.949236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3441c6c1-0767-4e94-82af-397463f6a3ae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:21.953582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3441c6c1-0767-4e94-82af-397463f6a3ae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:21.954275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3441c6c1-0767-4e94-82af-397463f6a3ae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:22.852124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3441c6c1-0767-4e94-82af-397463f6a3ae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:22.862212 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3441c6c1-0767-4e94-82af-397463f6a3ae tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1692 microversion: 2.1 time: 0.947996 May 28 05:00:22.866451 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2792/5700] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:21 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1692 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:23.883433 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-50f9c8b9-94e3-47ea-84df-a7ed4c783e41 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:23.885269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-50f9c8b9-94e3-47ea-84df-a7ed4c783e41 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:23.894441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50f9c8b9-94e3-47ea-84df-a7ed4c783e41 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:23.895284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50f9c8b9-94e3-47ea-84df-a7ed4c783e41 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:23.896315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50f9c8b9-94e3-47ea-84df-a7ed4c783e41 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:23.902716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50f9c8b9-94e3-47ea-84df-a7ed4c783e41 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:24.620269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-50f9c8b9-94e3-47ea-84df-a7ed4c783e41 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:24.631878 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-50f9c8b9-94e3-47ea-84df-a7ed4c783e41 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1692 microversion: 2.1 time: 0.756049 May 28 05:00:24.636980 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2909/5701] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:23 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1692 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:26.371655 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8af7abee-8438-42e0-a423-6f2fe64ae935 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:26.372990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8af7abee-8438-42e0-a423-6f2fe64ae935 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:26.427827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8af7abee-8438-42e0-a423-6f2fe64ae935 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:26.428307 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8af7abee-8438-42e0-a423-6f2fe64ae935 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:26.447381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8af7abee-8438-42e0-a423-6f2fe64ae935 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:26.451148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8af7abee-8438-42e0-a423-6f2fe64ae935 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:27.120791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8af7abee-8438-42e0-a423-6f2fe64ae935 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:27.130549 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8af7abee-8438-42e0-a423-6f2fe64ae935 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1692 microversion: 2.1 time: 1.478604 May 28 05:00:27.136360 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2793/5702] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:25 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1692 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:28.154904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9e2b0991-f549-411b-a6de-f6ab101da402 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:28.155593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9e2b0991-f549-411b-a6de-f6ab101da402 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:28.175902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e2b0991-f549-411b-a6de-f6ab101da402 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:28.176477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e2b0991-f549-411b-a6de-f6ab101da402 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:28.177169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e2b0991-f549-411b-a6de-f6ab101da402 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:28.177611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e2b0991-f549-411b-a6de-f6ab101da402 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:28.605637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9e2b0991-f549-411b-a6de-f6ab101da402 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:28.618758 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9e2b0991-f549-411b-a6de-f6ab101da402 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1692 microversion: 2.1 time: 0.468036 May 28 05:00:28.624747 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2910/5703] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:28 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1692 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:29.651446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e27e6189-f8a9-445f-b975-921eea9b1b21 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:29.652231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e27e6189-f8a9-445f-b975-921eea9b1b21 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:29.667099 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e27e6189-f8a9-445f-b975-921eea9b1b21 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:29.668431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e27e6189-f8a9-445f-b975-921eea9b1b21 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:29.671228 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e27e6189-f8a9-445f-b975-921eea9b1b21 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:29.671803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e27e6189-f8a9-445f-b975-921eea9b1b21 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:29.978013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e27e6189-f8a9-445f-b975-921eea9b1b21 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:29.987120 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e27e6189-f8a9-445f-b975-921eea9b1b21 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1692 microversion: 2.1 time: 0.347285 May 28 05:00:29.991114 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2794/5704] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:29 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1692 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:31.008956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7016de8e-8aeb-420f-b884-e813d82ba3ef tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:31.010228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7016de8e-8aeb-420f-b884-e813d82ba3ef tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:31.042981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7016de8e-8aeb-420f-b884-e813d82ba3ef tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:31.049011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7016de8e-8aeb-420f-b884-e813d82ba3ef tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:31.049011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7016de8e-8aeb-420f-b884-e813d82ba3ef tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:31.049011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7016de8e-8aeb-420f-b884-e813d82ba3ef tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:31.618801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7016de8e-8aeb-420f-b884-e813d82ba3ef tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:31.631808 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7016de8e-8aeb-420f-b884-e813d82ba3ef tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1692 microversion: 2.1 time: 0.625281 May 28 05:00:31.645024 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2911/5705] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:31 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1692 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:32.656877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8cc671ff-4a43-433b-84e8-d82d4477c5b8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:32.660619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8cc671ff-4a43-433b-84e8-d82d4477c5b8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:32.668818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7f778fac-b8a2-49ac-a816-d6dd6f348509 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:32.669402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7f778fac-b8a2-49ac-a816-d6dd6f348509 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:32.678588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8cc671ff-4a43-433b-84e8-d82d4477c5b8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:32.679444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8cc671ff-4a43-433b-84e8-d82d4477c5b8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:32.680951 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8cc671ff-4a43-433b-84e8-d82d4477c5b8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:32.681569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8cc671ff-4a43-433b-84e8-d82d4477c5b8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:32.713458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f778fac-b8a2-49ac-a816-d6dd6f348509 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:32.713851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f778fac-b8a2-49ac-a816-d6dd6f348509 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:32.714658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f778fac-b8a2-49ac-a816-d6dd6f348509 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:32.733907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f778fac-b8a2-49ac-a816-d6dd6f348509 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:32.849037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7f778fac-b8a2-49ac-a816-d6dd6f348509 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:00:33.405484 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7f778fac-b8a2-49ac-a816-d6dd6f348509 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 204 len: 0 microversion: 2.1 time: 0.754699 May 28 05:00:33.407055 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2795/5706] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:00:32 2022] DELETE /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:00:33.416550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d12c92a4-f336-4522-961a-7fd1065d28f6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:33.419191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d12c92a4-f336-4522-961a-7fd1065d28f6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:33.432014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d12c92a4-f336-4522-961a-7fd1065d28f6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:33.435436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d12c92a4-f336-4522-961a-7fd1065d28f6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:33.436952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d12c92a4-f336-4522-961a-7fd1065d28f6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:33.439375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d12c92a4-f336-4522-961a-7fd1065d28f6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:33.449542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8cc671ff-4a43-433b-84e8-d82d4477c5b8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:33.465762 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8cc671ff-4a43-433b-84e8-d82d4477c5b8 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1692 microversion: 2.1 time: 0.808974 May 28 05:00:33.468074 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2912/5707] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:32 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1692 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:33.755339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d12c92a4-f336-4522-961a-7fd1065d28f6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:33.766323 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d12c92a4-f336-4522-961a-7fd1065d28f6 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1506 microversion: 2.1 time: 0.354997 May 28 05:00:33.768385 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2796/5708] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:33 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:00:34.488597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ec1babea-6edb-4886-8fb3-a97f2a8c9987 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:34.489813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ec1babea-6edb-4886-8fb3-a97f2a8c9987 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:34.505005 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec1babea-6edb-4886-8fb3-a97f2a8c9987 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:34.507171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec1babea-6edb-4886-8fb3-a97f2a8c9987 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:34.508160 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec1babea-6edb-4886-8fb3-a97f2a8c9987 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:34.509976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec1babea-6edb-4886-8fb3-a97f2a8c9987 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:34.788959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-85d220f8-a985-4202-8b31-596c1cb67129 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:34.789503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-85d220f8-a985-4202-8b31-596c1cb67129 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:34.832725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85d220f8-a985-4202-8b31-596c1cb67129 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:34.836164 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85d220f8-a985-4202-8b31-596c1cb67129 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:34.839205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85d220f8-a985-4202-8b31-596c1cb67129 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:34.839968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85d220f8-a985-4202-8b31-596c1cb67129 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:35.258944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ec1babea-6edb-4886-8fb3-a97f2a8c9987 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:35.272593 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ec1babea-6edb-4886-8fb3-a97f2a8c9987 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1692 microversion: 2.1 time: 0.788744 May 28 05:00:35.302096 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2913/5709] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:34 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1692 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:35.341389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-85d220f8-a985-4202-8b31-596c1cb67129 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:35.352625 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-85d220f8-a985-4202-8b31-596c1cb67129 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1506 microversion: 2.1 time: 0.571960 May 28 05:00:35.354800 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2797/5710] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:34 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1506 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:36.311753 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6d924f0d-51cd-40d3-bcab-d3ff0edc22b7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:36.312525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6d924f0d-51cd-40d3-bcab-d3ff0edc22b7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:36.329685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d924f0d-51cd-40d3-bcab-d3ff0edc22b7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:36.330361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d924f0d-51cd-40d3-bcab-d3ff0edc22b7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:36.331896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d924f0d-51cd-40d3-bcab-d3ff0edc22b7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:36.333781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d924f0d-51cd-40d3-bcab-d3ff0edc22b7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:36.788146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-50acf827-666c-41b4-8bf8-19de4e9d5d9b req-6e3bd1d4-ff4e-4ac5-88d0-3eb5dd461893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccd1d50a-ecb5-406b-be4a-94ad6d8665b5", "name": "network-vif-deleted", "tag": "44d44357-8cc4-4d64-b33e-5500f94dcfbe"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:00:36.805934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-50acf827-666c-41b4-8bf8-19de4e9d5d9b req-6e3bd1d4-ff4e-4ac5-88d0-3eb5dd461893 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:36.806395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-50acf827-666c-41b4-8bf8-19de4e9d5d9b req-6e3bd1d4-ff4e-4ac5-88d0-3eb5dd461893 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:36.840491 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-50acf827-666c-41b4-8bf8-19de4e9d5d9b req-6e3bd1d4-ff4e-4ac5-88d0-3eb5dd461893 service nova] Creating event network-vif-deleted:44d44357-8cc4-4d64-b33e-5500f94dcfbe for instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 on n-h1-843700-1 May 28 05:00:36.852590 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-50acf827-666c-41b4-8bf8-19de4e9d5d9b req-6e3bd1d4-ff4e-4ac5-88d0-3eb5dd461893 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.496431 May 28 05:00:36.855104 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2798/5711] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:00:36.866161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-59c8b17c-45f1-477b-ae0e-2223dd4792f7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:36.870624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-59c8b17c-45f1-477b-ae0e-2223dd4792f7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:36.893867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59c8b17c-45f1-477b-ae0e-2223dd4792f7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:36.893867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59c8b17c-45f1-477b-ae0e-2223dd4792f7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:36.893867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59c8b17c-45f1-477b-ae0e-2223dd4792f7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:36.893867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59c8b17c-45f1-477b-ae0e-2223dd4792f7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:36.955306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59c8b17c-45f1-477b-ae0e-2223dd4792f7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:36.956570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59c8b17c-45f1-477b-ae0e-2223dd4792f7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:36.957167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-59c8b17c-45f1-477b-ae0e-2223dd4792f7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lazy-loading 'fault' on Instance uuid ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:00:37.098702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6d924f0d-51cd-40d3-bcab-d3ff0edc22b7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:37.100031 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6d924f0d-51cd-40d3-bcab-d3ff0edc22b7 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1692 microversion: 2.1 time: 0.790835 May 28 05:00:37.101000 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2914/5712] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:36 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1692 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:37.108178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-59c8b17c-45f1-477b-ae0e-2223dd4792f7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:37.128205 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-59c8b17c-45f1-477b-ae0e-2223dd4792f7 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 200 len: 1311 microversion: 2.1 time: 0.269986 May 28 05:00:37.129659 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2799/5713] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:36 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 1311 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:38.118496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ce5e4785-eed9-49fe-b663-71433985cd3b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:38.119836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ce5e4785-eed9-49fe-b663-71433985cd3b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:38.139278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce5e4785-eed9-49fe-b663-71433985cd3b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:38.140397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce5e4785-eed9-49fe-b663-71433985cd3b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:38.141540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce5e4785-eed9-49fe-b663-71433985cd3b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:38.156441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ca148029-0230-4ad5-a71f-034726be73a8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:38.159516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ca148029-0230-4ad5-a71f-034726be73a8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: ccd1d50a-ecb5-406b-be4a-94ad6d8665b5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:38.165368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce5e4785-eed9-49fe-b663-71433985cd3b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:38.180317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca148029-0230-4ad5-a71f-034726be73a8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:38.185389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca148029-0230-4ad5-a71f-034726be73a8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:38.187491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca148029-0230-4ad5-a71f-034726be73a8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:38.192920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ca148029-0230-4ad5-a71f-034726be73a8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:38.244129 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-ca148029-0230-4ad5-a71f-034726be73a8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] HTTP exception thrown: Instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 could not be found. May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ca148029-0230-4ad5-a71f-034726be73a8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Request method failure captured: May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 HTTP/1.1 May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikaseTx-CUErJTvPPURHUDDZW_2xVLiNPRiy1eiv9_fcFy45c02JpQ6VvqCXLzIK18DfT6aHtEfhTBsOxiJEfEG-fv6OQ2f3JYTQWF_vNEb8rrFvp-Wh1TVJC4d-u-zkyoCZX0D4P_h38dgB9yzRPIskmXiQK2RKoPWvSUe713g1UiE0 May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: f043f5d6fc0a47429a445d8f25401570 May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: f043f5d6fc0a47429a445d8f25401570 May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerRescueNegativeTestJSON-1590365959-project May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 227be762b2bc4bbba6d3e3e9a1d28c9c May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1590365959-project May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 could not be found. May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'ccd1d50a-ecb5-406b-be4a-94ad6d8665b5'} May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 could not be found. May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 could not be found. May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:00:38.252273 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:00:38.256832 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:00:38.256832 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:00:38.256832 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:00:38.256832 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:00:38.256832 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:00:38.256832 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:00:38.256832 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 could not be found. May 28 05:00:38.256832 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:00:38.256832 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ca148029-0230-4ad5-a71f-034726be73a8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Returning 404 to user: Instance ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:00:38.259462 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ca148029-0230-4ad5-a71f-034726be73a8 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5" status: 404 len: 111 microversion: 2.1 time: 0.106905 May 28 05:00:38.266389 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2800/5714] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:38 2022] GET /compute/v2.1/servers/ccd1d50a-ecb5-406b-be4a-94ad6d8665b5 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:00:38.273237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7bdba82b-09cd-4bdb-b973-bbbd4bcb8b6b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:38.273744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7bdba82b-09cd-4bdb-b973-bbbd4bcb8b6b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:38.298742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7bdba82b-09cd-4bdb-b973-bbbd4bcb8b6b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:38.301077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7bdba82b-09cd-4bdb-b973-bbbd4bcb8b6b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:38.308232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7bdba82b-09cd-4bdb-b973-bbbd4bcb8b6b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:38.309426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7bdba82b-09cd-4bdb-b973-bbbd4bcb8b6b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:38.344772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7bdba82b-09cd-4bdb-b973-bbbd4bcb8b6b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:00:38.760539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ce5e4785-eed9-49fe-b663-71433985cd3b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:38.773546 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ce5e4785-eed9-49fe-b663-71433985cd3b tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1692 microversion: 2.1 time: 0.658836 May 28 05:00:38.776394 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2915/5715] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:38 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1692 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:38.828609 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7bdba82b-09cd-4bdb-b973-bbbd4bcb8b6b tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "DELETE /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 204 len: 0 microversion: 2.1 time: 0.558456 May 28 05:00:38.829267 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2801/5716] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:00:38 2022] DELETE /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:00:38.838034 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a5a0019a-36c9-4176-aa52-31c9d05b57ff tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:38.839086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a5a0019a-36c9-4176-aa52-31c9d05b57ff tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:38.855119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5a0019a-36c9-4176-aa52-31c9d05b57ff tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:38.856184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5a0019a-36c9-4176-aa52-31c9d05b57ff tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:38.859105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5a0019a-36c9-4176-aa52-31c9d05b57ff tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:38.859802 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5a0019a-36c9-4176-aa52-31c9d05b57ff tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:39.134909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a5a0019a-36c9-4176-aa52-31c9d05b57ff tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:39.148961 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a5a0019a-36c9-4176-aa52-31c9d05b57ff tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1521 microversion: 2.1 time: 0.315540 May 28 05:00:39.156689 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2916/5717] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:38 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:39.795487 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-326ea6b0-07cc-481e-85e8-84bd99c4b7fc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:39.796340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-326ea6b0-07cc-481e-85e8-84bd99c4b7fc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:39.811812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-326ea6b0-07cc-481e-85e8-84bd99c4b7fc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:39.812482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-326ea6b0-07cc-481e-85e8-84bd99c4b7fc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:39.813595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-326ea6b0-07cc-481e-85e8-84bd99c4b7fc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:39.820964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-326ea6b0-07cc-481e-85e8-84bd99c4b7fc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:40.054172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-326ea6b0-07cc-481e-85e8-84bd99c4b7fc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:40.077497 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-326ea6b0-07cc-481e-85e8-84bd99c4b7fc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1710 microversion: 2.1 time: 0.287480 May 28 05:00:40.078628 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2802/5718] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:39 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1710 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:40.172862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e122266d-77e1-46b9-a5da-b42d18d40a45 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:40.174255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e122266d-77e1-46b9-a5da-b42d18d40a45 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:40.237678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e122266d-77e1-46b9-a5da-b42d18d40a45 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:40.238506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e122266d-77e1-46b9-a5da-b42d18d40a45 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:40.239962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e122266d-77e1-46b9-a5da-b42d18d40a45 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:40.240704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e122266d-77e1-46b9-a5da-b42d18d40a45 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:40.458337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e122266d-77e1-46b9-a5da-b42d18d40a45 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:40.467788 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e122266d-77e1-46b9-a5da-b42d18d40a45 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1521 microversion: 2.1 time: 0.300711 May 28 05:00:40.468384 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2917/5719] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:40 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:41.095787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-44a201c6-7000-4183-b4f8-5396afbb11b1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:41.097169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-44a201c6-7000-4183-b4f8-5396afbb11b1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:41.115598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44a201c6-7000-4183-b4f8-5396afbb11b1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:41.116442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44a201c6-7000-4183-b4f8-5396afbb11b1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:41.117491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44a201c6-7000-4183-b4f8-5396afbb11b1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:41.118175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44a201c6-7000-4183-b4f8-5396afbb11b1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:41.390273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-44a201c6-7000-4183-b4f8-5396afbb11b1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:41.400242 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-44a201c6-7000-4183-b4f8-5396afbb11b1 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1698 microversion: 2.1 time: 0.308364 May 28 05:00:41.400839 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2803/5720] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:41 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1698 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:41.485292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fd1dcfd4-5539-4477-8ff0-426c6cd860d4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:41.487862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fd1dcfd4-5539-4477-8ff0-426c6cd860d4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:41.497174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd1dcfd4-5539-4477-8ff0-426c6cd860d4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:41.497946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd1dcfd4-5539-4477-8ff0-426c6cd860d4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:41.498973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd1dcfd4-5539-4477-8ff0-426c6cd860d4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:41.499662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd1dcfd4-5539-4477-8ff0-426c6cd860d4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:42.418415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-978986a9-0421-41d8-a1f5-9a0da1c0dabc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:42.419832 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-978986a9-0421-41d8-a1f5-9a0da1c0dabc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:42.430652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-978986a9-0421-41d8-a1f5-9a0da1c0dabc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:42.435814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-978986a9-0421-41d8-a1f5-9a0da1c0dabc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:42.443414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-978986a9-0421-41d8-a1f5-9a0da1c0dabc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:42.444247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-978986a9-0421-41d8-a1f5-9a0da1c0dabc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:42.514272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fd1dcfd4-5539-4477-8ff0-426c6cd860d4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:42.531401 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fd1dcfd4-5539-4477-8ff0-426c6cd860d4 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1521 microversion: 2.1 time: 1.050524 May 28 05:00:42.546358 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2918/5721] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:41 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1521 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:42.931698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-d1f58e06-3d92-46d9-a677-081ae04134da req-b50b7ed1-a91b-486a-ad3d-a3bb76db1a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82767745-0d0e-4892-b97e-28a49a746db0", "name": "network-vif-unplugged", "status": "completed", "tag": "79daf806-2760-45f3-a32b-75949a5241dd"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:00:42.948088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d1f58e06-3d92-46d9-a677-081ae04134da req-b50b7ed1-a91b-486a-ad3d-a3bb76db1a6c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:42.955310 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d1f58e06-3d92-46d9-a677-081ae04134da req-b50b7ed1-a91b-486a-ad3d-a3bb76db1a6c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:42.981646 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-d1f58e06-3d92-46d9-a677-081ae04134da req-b50b7ed1-a91b-486a-ad3d-a3bb76db1a6c service nova] Creating event network-vif-unplugged:79daf806-2760-45f3-a32b-75949a5241dd for instance 82767745-0d0e-4892-b97e-28a49a746db0 on n-h1-843700-1 May 28 05:00:42.988284 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-d1f58e06-3d92-46d9-a677-081ae04134da req-b50b7ed1-a91b-486a-ad3d-a3bb76db1a6c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.266406 May 28 05:00:42.990278 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2919/5722] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:00:43.032207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-978986a9-0421-41d8-a1f5-9a0da1c0dabc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:43.042843 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-978986a9-0421-41d8-a1f5-9a0da1c0dabc tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1698 microversion: 2.1 time: 0.628881 May 28 05:00:43.044542 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2804/5723] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:42 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1698 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:43.550329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ad0b7311-4112-47fd-8584-2aa75b820048 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:43.552781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ad0b7311-4112-47fd-8584-2aa75b820048 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:43.562606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad0b7311-4112-47fd-8584-2aa75b820048 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:43.563203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad0b7311-4112-47fd-8584-2aa75b820048 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:43.564179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad0b7311-4112-47fd-8584-2aa75b820048 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:43.564812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad0b7311-4112-47fd-8584-2aa75b820048 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:43.945380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ad0b7311-4112-47fd-8584-2aa75b820048 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:43.963539 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ad0b7311-4112-47fd-8584-2aa75b820048 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1521 microversion: 2.1 time: 0.417523 May 28 05:00:43.967136 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2920/5724] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:43 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:43.970918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-f695fc3e-754a-40f2-81d2-67334ea530ab req-ef721c7c-a084-4600-85b5-0e42105388fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af197e5a-1493-44f1-ae5c-05fad352ed02", "name": "network-vif-deleted", "tag": "dd856e8a-99dc-4955-a294-ae6827b9378e"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:00:43.985928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f695fc3e-754a-40f2-81d2-67334ea530ab req-ef721c7c-a084-4600-85b5-0e42105388fe service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:43.987834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f695fc3e-754a-40f2-81d2-67334ea530ab req-ef721c7c-a084-4600-85b5-0e42105388fe service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:44.073442 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-f695fc3e-754a-40f2-81d2-67334ea530ab req-ef721c7c-a084-4600-85b5-0e42105388fe service nova] Creating event network-vif-deleted:dd856e8a-99dc-4955-a294-ae6827b9378e for instance af197e5a-1493-44f1-ae5c-05fad352ed02 on n-h1-843700-1 May 28 05:00:44.073442 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-f695fc3e-754a-40f2-81d2-67334ea530ab req-ef721c7c-a084-4600-85b5-0e42105388fe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107011 May 28 05:00:44.073442 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2805/5725] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:00:44.073696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c1eb5626-5278-494b-aec2-0b38273eb41c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:44.082290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c1eb5626-5278-494b-aec2-0b38273eb41c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:44.180836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1eb5626-5278-494b-aec2-0b38273eb41c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:44.181601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1eb5626-5278-494b-aec2-0b38273eb41c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:44.182791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1eb5626-5278-494b-aec2-0b38273eb41c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:44.183438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1eb5626-5278-494b-aec2-0b38273eb41c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:44.758969 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c1eb5626-5278-494b-aec2-0b38273eb41c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:44.775335 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c1eb5626-5278-494b-aec2-0b38273eb41c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1683 microversion: 2.1 time: 0.710737 May 28 05:00:44.782269 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2921/5726] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:44 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1683 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:44.985295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0e3b8190-a9b7-4d8c-9241-2bbadc51fbe2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:44.987106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0e3b8190-a9b7-4d8c-9241-2bbadc51fbe2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:45.004609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e3b8190-a9b7-4d8c-9241-2bbadc51fbe2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:45.005423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e3b8190-a9b7-4d8c-9241-2bbadc51fbe2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:45.008107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e3b8190-a9b7-4d8c-9241-2bbadc51fbe2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:45.010337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e3b8190-a9b7-4d8c-9241-2bbadc51fbe2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:45.094480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e3b8190-a9b7-4d8c-9241-2bbadc51fbe2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:45.097872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e3b8190-a9b7-4d8c-9241-2bbadc51fbe2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:45.098649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-0e3b8190-a9b7-4d8c-9241-2bbadc51fbe2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lazy-loading 'fault' on Instance uuid af197e5a-1493-44f1-ae5c-05fad352ed02 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:00:45.102420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:00:45.234130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0e3b8190-a9b7-4d8c-9241-2bbadc51fbe2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227be762b2bc4bbba6d3e3e9a1d28c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f043f5d6fc0a47429a445d8f25401570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:00:45.243868 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0e3b8190-a9b7-4d8c-9241-2bbadc51fbe2 tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 200 len: 1312 microversion: 2.1 time: 0.265567 May 28 05:00:45.254612 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2806/5727] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:44 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 1312 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:00:46.262901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1dc0446b-27bd-4af4-a2c9-94c35479945d tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:00:46.263563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1dc0446b-27bd-4af4-a2c9-94c35479945d tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] [instance: af197e5a-1493-44f1-ae5c-05fad352ed02] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:00:46.280687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1dc0446b-27bd-4af4-a2c9-94c35479945d tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:46.281157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1dc0446b-27bd-4af4-a2c9-94c35479945d tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:46.281950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1dc0446b-27bd-4af4-a2c9-94c35479945d tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:46.282395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1dc0446b-27bd-4af4-a2c9-94c35479945d tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:46.322773 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-1dc0446b-27bd-4af4-a2c9-94c35479945d tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] HTTP exception thrown: Instance af197e5a-1493-44f1-ae5c-05fad352ed02 could not be found. May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1dc0446b-27bd-4af4-a2c9-94c35479945d tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Request method failure captured: May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 HTTP/1.1 May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaseTx-CUErJTvPPURHUDDZW_2xVLiNPRiy1eiv9_fcFy45c02JpQ6VvqCXLzIK18DfT6aHtEfhTBsOxiJEfEG-fv6OQ2f3JYTQWF_vNEb8rrFvp-Wh1TVJC4d-u-zkyoCZX0D4P_h38dgB9yzRPIskmXiQK2RKoPWvSUe713g1UiE0 May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: f043f5d6fc0a47429a445d8f25401570 May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f043f5d6fc0a47429a445d8f25401570"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: f043f5d6fc0a47429a445d8f25401570 May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1590365959 May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerRescueNegativeTestJSON-1590365959-project May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 227be762b2bc4bbba6d3e3e9a1d28c9c May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1590365959-project May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance af197e5a-1493-44f1-ae5c-05fad352ed02 could not be found. May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'af197e5a-1493-44f1-ae5c-05fad352ed02'} May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af197e5a-1493-44f1-ae5c-05fad352ed02 could not be found. May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af197e5a-1493-44f1-ae5c-05fad352ed02 could not be found. May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:00:46.325285 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:00:46.330803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:00:46.330803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:00:46.330803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:00:46.330803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:00:46.330803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:00:46.330803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:00:46.330803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af197e5a-1493-44f1-ae5c-05fad352ed02 could not be found. May 28 05:00:46.330803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:00:46.350154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1dc0446b-27bd-4af4-a2c9-94c35479945d tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] Returning 404 to user: Instance af197e5a-1493-44f1-ae5c-05fad352ed02 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:00:46.352816 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1dc0446b-27bd-4af4-a2c9-94c35479945d tempest-ServerRescueNegativeTestJSON-1590365959 tempest-ServerRescueNegativeTestJSON-1590365959-project] 10.222.0.58 "GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02" status: 404 len: 111 microversion: 2.1 time: 0.093724 May 28 05:00:46.355244 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2922/5728] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:00:46 2022] GET /compute/v2.1/servers/af197e5a-1493-44f1-ae5c-05fad352ed02 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:00:49.160308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-a037cd70-f0df-4d0b-81ff-d68dc5bee46c req-22db3665-2ece-4ae8-9c2d-00e04ac0ee88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82767745-0d0e-4892-b97e-28a49a746db0", "name": "network-vif-plugged", "status": "completed", "tag": "79daf806-2760-45f3-a32b-75949a5241dd"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:00:49.186085 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a037cd70-f0df-4d0b-81ff-d68dc5bee46c req-22db3665-2ece-4ae8-9c2d-00e04ac0ee88 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:00:49.188882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a037cd70-f0df-4d0b-81ff-d68dc5bee46c req-22db3665-2ece-4ae8-9c2d-00e04ac0ee88 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:00:49.238795 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-a037cd70-f0df-4d0b-81ff-d68dc5bee46c req-22db3665-2ece-4ae8-9c2d-00e04ac0ee88 service nova] Creating event network-vif-plugged:79daf806-2760-45f3-a32b-75949a5241dd for instance 82767745-0d0e-4892-b97e-28a49a746db0 on n-h1-843700-1 May 28 05:00:49.268948 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-a037cd70-f0df-4d0b-81ff-d68dc5bee46c req-22db3665-2ece-4ae8-9c2d-00e04ac0ee88 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106679 May 28 05:00:49.272456 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2807/5729] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:01:07.317018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b0af709b-5afc-4ae6-8524-20c0e9efc57c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:01:07.318606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b0af709b-5afc-4ae6-8524-20c0e9efc57c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:07.325269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=34 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:01:07.327264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:01:07.328989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0af709b-5afc-4ae6-8524-20c0e9efc57c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:07.329630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0af709b-5afc-4ae6-8524-20c0e9efc57c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:07.330584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0af709b-5afc-4ae6-8524-20c0e9efc57c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:07.331255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0af709b-5afc-4ae6-8524-20c0e9efc57c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:07.406596 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b0af709b-5afc-4ae6-8524-20c0e9efc57c tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "POST /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0/action" status: 200 len: 24569 microversion: 2.1 time: 0.093373 May 28 05:01:07.410287 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2923/5730] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:01:07 2022] POST /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0/action => generated 24569 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:01:11.234765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:01:11.541060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0903d5f2-fdcf-4617-b975-3b911c180620 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Action: 'create', calling method: .version_select at 0x7f77009aa820>, body: {"keypair": {"name": "tempest-keypair-1805764625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5/8gp2rz0tcqfLK3TJZMtoM7xfcYy/kVkQheDT90HxPeoTOM4m4MEnAcbCFf2oaeaFI5mH4gFCuqkFc3URrbuGmjw3ebScbI+ODmZTZnoadnMc/uMICrAeFSKe4yyEBA=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:01:11.561013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0903d5f2-fdcf-4617-b975-3b911c180620 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Getting quotas for project 844635ce88914d628f312550a4b128ba. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:01:11.577308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-0903d5f2-fdcf-4617-b975-3b911c180620 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Getting quotas for user c09d2cdac73148e3ac1f118e2de31365 and project 844635ce88914d628f312550a4b128ba. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:01:11.738212 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0903d5f2-fdcf-4617-b975-3b911c180620 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.511311 May 28 05:01:11.739624 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2808/5731] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 05:01:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:01:16.228296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3375f7b7-a99e-4957-86f8-6c1d2e21003a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-991003013", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee3f40bc-ca82-4c59-b6b9-c9598eb48b69"}], "security_groups": [{"name": "tempest-securitygroup--976806071"}], "key_name": "tempest-keypair-1805764625", "user_data": "}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:01:16.467034 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-3375f7b7-a99e-4957-86f8-6c1d2e21003a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] validate_networks() for [('ee3f40bc-ca82-4c59-b6b9-c9598eb48b69', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:01:17.223742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-3375f7b7-a99e-4957-86f8-6c1d2e21003a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:01:17.224458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-3375f7b7-a99e-4957-86f8-6c1d2e21003a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:01:17.225187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-3375f7b7-a99e-4957-86f8-6c1d2e21003a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:01:17.227798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-3375f7b7-a99e-4957-86f8-6c1d2e21003a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:01:17.228658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-3375f7b7-a99e-4957-86f8-6c1d2e21003a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:01:17.242232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3375f7b7-a99e-4957-86f8-6c1d2e21003a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:17.243059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3375f7b7-a99e-4957-86f8-6c1d2e21003a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:17.244229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3375f7b7-a99e-4957-86f8-6c1d2e21003a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:17.245498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3375f7b7-a99e-4957-86f8-6c1d2e21003a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:17.268063 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-3375f7b7-a99e-4957-86f8-6c1d2e21003a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Getting quotas for project 844635ce88914d628f312550a4b128ba. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:01:17.276837 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-3375f7b7-a99e-4957-86f8-6c1d2e21003a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Getting quotas for user c09d2cdac73148e3ac1f118e2de31365 and project 844635ce88914d628f312550a4b128ba. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:01:17.293169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3375f7b7-a99e-4957-86f8-6c1d2e21003a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:01:17.296478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3375f7b7-a99e-4957-86f8-6c1d2e21003a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:01:17.468636 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3375f7b7-a99e-4957-86f8-6c1d2e21003a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.245874 May 28 05:01:17.474170 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2924/5732] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:01:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 1252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:01:17.499901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-39d84010-c3d1-405c-83d8-1d535193ba50 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:17.499901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-39d84010-c3d1-405c-83d8-1d535193ba50 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:17.655783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-39d84010-c3d1-405c-83d8-1d535193ba50 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:17.673812 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-39d84010-c3d1-405c-83d8-1d535193ba50 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1237 microversion: 2.1 time: 0.192610 May 28 05:01:17.674905 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2809/5733] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:01:17 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1237 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:01:18.693343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bff338a5-99e9-477e-b0ae-8eaca4571e3a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:18.694355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bff338a5-99e9-477e-b0ae-8eaca4571e3a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:19.622193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bff338a5-99e9-477e-b0ae-8eaca4571e3a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:19.629410 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bff338a5-99e9-477e-b0ae-8eaca4571e3a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1237 microversion: 2.1 time: 0.941045 May 28 05:01:19.630011 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2925/5734] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:01:18 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1237 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:01:20.646402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f4255e33-a535-4fff-90d1-bfa3f2149f78 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:20.652245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f4255e33-a535-4fff-90d1-bfa3f2149f78 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:20.672990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4255e33-a535-4fff-90d1-bfa3f2149f78 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:20.673765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4255e33-a535-4fff-90d1-bfa3f2149f78 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:20.675243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4255e33-a535-4fff-90d1-bfa3f2149f78 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:20.675890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4255e33-a535-4fff-90d1-bfa3f2149f78 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:20.782542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f4255e33-a535-4fff-90d1-bfa3f2149f78 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:20.791335 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f4255e33-a535-4fff-90d1-bfa3f2149f78 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1289 microversion: 2.1 time: 0.149056 May 28 05:01:20.795220 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2810/5735] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:01:20 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1289 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:01:21.454513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-33cefc30-87a2-4508-919b-5d0a7d49fd08 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:21.460203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-3cdddfec-858f-4327-a05c-daf1b6c6d035 req-87a70e28-50f5-4800-aade-c1a37545085e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82767745-0d0e-4892-b97e-28a49a746db0", "tag": "79daf806-2760-45f3-a32b-75949a5241dd"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:01:21.463455 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-33cefc30-87a2-4508-919b-5d0a7d49fd08 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:21.487103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3cdddfec-858f-4327-a05c-daf1b6c6d035 req-87a70e28-50f5-4800-aade-c1a37545085e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:21.487552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3cdddfec-858f-4327-a05c-daf1b6c6d035 req-87a70e28-50f5-4800-aade-c1a37545085e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:21.492311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-33cefc30-87a2-4508-919b-5d0a7d49fd08 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:21.492769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-33cefc30-87a2-4508-919b-5d0a7d49fd08 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:21.493548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-33cefc30-87a2-4508-919b-5d0a7d49fd08 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:21.500501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-33cefc30-87a2-4508-919b-5d0a7d49fd08 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:21.554102 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-3cdddfec-858f-4327-a05c-daf1b6c6d035 req-87a70e28-50f5-4800-aade-c1a37545085e service nova] Creating event network-changed:79daf806-2760-45f3-a32b-75949a5241dd for instance 82767745-0d0e-4892-b97e-28a49a746db0 on n-h1-843700-1 May 28 05:01:21.602163 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-3cdddfec-858f-4327-a05c-daf1b6c6d035 req-87a70e28-50f5-4800-aade-c1a37545085e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142994 May 28 05:01:21.607901 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2811/5736] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:01:21.614902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-33cefc30-87a2-4508-919b-5d0a7d49fd08 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:01:21.820933 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bb6ea3c8-71ff-4e48-a61b-86820f2c6038 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:21.822450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bb6ea3c8-71ff-4e48-a61b-86820f2c6038 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:21.874499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb6ea3c8-71ff-4e48-a61b-86820f2c6038 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:21.875643 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb6ea3c8-71ff-4e48-a61b-86820f2c6038 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:21.879768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb6ea3c8-71ff-4e48-a61b-86820f2c6038 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:21.881661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb6ea3c8-71ff-4e48-a61b-86820f2c6038 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:22.159649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bb6ea3c8-71ff-4e48-a61b-86820f2c6038 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:22.173285 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bb6ea3c8-71ff-4e48-a61b-86820f2c6038 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1307 microversion: 2.1 time: 0.360308 May 28 05:01:22.187228 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2812/5737] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:01:21 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1307 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:01:22.210348 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-33cefc30-87a2-4508-919b-5d0a7d49fd08 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "DELETE /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 204 len: 0 microversion: 2.1 time: 0.761747 May 28 05:01:22.212035 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2926/5738] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:01:21 2022] DELETE /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:01:22.220105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3fbd4fc8-d7c6-4400-9854-c7304bc98b2d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:22.220736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3fbd4fc8-d7c6-4400-9854-c7304bc98b2d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:22.235984 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3fbd4fc8-d7c6-4400-9854-c7304bc98b2d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:22.237657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3fbd4fc8-d7c6-4400-9854-c7304bc98b2d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:22.240316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3fbd4fc8-d7c6-4400-9854-c7304bc98b2d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:22.240780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3fbd4fc8-d7c6-4400-9854-c7304bc98b2d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:22.453297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3fbd4fc8-d7c6-4400-9854-c7304bc98b2d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:22.462084 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3fbd4fc8-d7c6-4400-9854-c7304bc98b2d tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1689 microversion: 2.1 time: 0.246822 May 28 05:01:22.462693 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2813/5739] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:01:22 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1689 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:01:23.196870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-be8fd458-5676-4f39-95cf-a6297d96d152 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:23.197698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-be8fd458-5676-4f39-95cf-a6297d96d152 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:23.210632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-be8fd458-5676-4f39-95cf-a6297d96d152 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:23.214756 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-be8fd458-5676-4f39-95cf-a6297d96d152 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:23.216068 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-be8fd458-5676-4f39-95cf-a6297d96d152 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:23.217739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-be8fd458-5676-4f39-95cf-a6297d96d152 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:23.372491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-be8fd458-5676-4f39-95cf-a6297d96d152 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:23.381042 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-be8fd458-5676-4f39-95cf-a6297d96d152 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1295 microversion: 2.1 time: 0.188714 May 28 05:01:23.381651 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2927/5740] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:01:23 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1295 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:01:23.482588 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cecd21f6-b2dd-4bdf-8a14-5e46574c8e39 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:23.491915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cecd21f6-b2dd-4bdf-8a14-5e46574c8e39 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:23.507938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cecd21f6-b2dd-4bdf-8a14-5e46574c8e39 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:23.508392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cecd21f6-b2dd-4bdf-8a14-5e46574c8e39 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:23.512682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cecd21f6-b2dd-4bdf-8a14-5e46574c8e39 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:23.513345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cecd21f6-b2dd-4bdf-8a14-5e46574c8e39 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:23.957175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cecd21f6-b2dd-4bdf-8a14-5e46574c8e39 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:23.980618 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cecd21f6-b2dd-4bdf-8a14-5e46574c8e39 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1689 microversion: 2.1 time: 0.501183 May 28 05:01:23.994878 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2814/5741] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:01:23 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1689 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:01:24.401787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ad424005-cccf-4ac7-a573-33e3b13b91d8 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:24.402417 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ad424005-cccf-4ac7-a573-33e3b13b91d8 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:24.409657 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad424005-cccf-4ac7-a573-33e3b13b91d8 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:24.410460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad424005-cccf-4ac7-a573-33e3b13b91d8 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:24.411301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad424005-cccf-4ac7-a573-33e3b13b91d8 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:24.415607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad424005-cccf-4ac7-a573-33e3b13b91d8 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:24.960465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-3f07c5b8-b7d8-43dd-9092-f15151e8a528 req-87293e7d-586b-41db-81f8-2b727e12e8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82767745-0d0e-4892-b97e-28a49a746db0", "name": "network-vif-deleted", "tag": "79daf806-2760-45f3-a32b-75949a5241dd"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:01:24.967102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ad424005-cccf-4ac7-a573-33e3b13b91d8 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:24.983460 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ad424005-cccf-4ac7-a573-33e3b13b91d8 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1362 microversion: 2.1 time: 0.586157 May 28 05:01:24.986210 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2928/5742] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:01:24 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1362 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:01:25.017347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-70f38301-d46d-46d1-ab8f-961402225edd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:25.018209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-70f38301-d46d-46d1-ab8f-961402225edd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:25.029704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70f38301-d46d-46d1-ab8f-961402225edd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:25.032793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3f07c5b8-b7d8-43dd-9092-f15151e8a528 req-87293e7d-586b-41db-81f8-2b727e12e8f5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:25.032932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70f38301-d46d-46d1-ab8f-961402225edd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:25.033050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3f07c5b8-b7d8-43dd-9092-f15151e8a528 req-87293e7d-586b-41db-81f8-2b727e12e8f5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:25.033981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70f38301-d46d-46d1-ab8f-961402225edd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:25.034922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70f38301-d46d-46d1-ab8f-961402225edd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:25.073646 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-3f07c5b8-b7d8-43dd-9092-f15151e8a528 req-87293e7d-586b-41db-81f8-2b727e12e8f5 service nova] Creating event network-vif-deleted:79daf806-2760-45f3-a32b-75949a5241dd for instance 82767745-0d0e-4892-b97e-28a49a746db0 on n-h1-843700-1 May 28 05:01:25.112435 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-3f07c5b8-b7d8-43dd-9092-f15151e8a528 req-87293e7d-586b-41db-81f8-2b727e12e8f5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159561 May 28 05:01:25.113972 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2815/5743] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:01:25.538813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-70f38301-d46d-46d1-ab8f-961402225edd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b17444b87742e1b45409810cbe06d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14e7de3a28f42a79197e1c06c4676dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:25.549386 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-70f38301-d46d-46d1-ab8f-961402225edd tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 200 len: 1503 microversion: 2.1 time: 0.535991 May 28 05:01:25.550548 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2929/5744] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:01:25 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 1503 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:01:26.010084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4615d764-fff1-4dee-9ffd-b7640ac339fb tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:26.011494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4615d764-fff1-4dee-9ffd-b7640ac339fb tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:26.032825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4615d764-fff1-4dee-9ffd-b7640ac339fb tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:26.033290 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4615d764-fff1-4dee-9ffd-b7640ac339fb tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:26.056554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4615d764-fff1-4dee-9ffd-b7640ac339fb tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:26.059450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4615d764-fff1-4dee-9ffd-b7640ac339fb tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:26.375666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4615d764-fff1-4dee-9ffd-b7640ac339fb tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:26.388605 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4615d764-fff1-4dee-9ffd-b7640ac339fb tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1362 microversion: 2.1 time: 0.386933 May 28 05:01:26.391430 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2816/5745] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:01:25 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1362 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:01:26.568074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8f61bf88-c017-411b-ac0f-8b22a5f6f1eb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:26.568729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8f61bf88-c017-411b-ac0f-8b22a5f6f1eb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] [instance: 82767745-0d0e-4892-b97e-28a49a746db0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:26.580306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f61bf88-c017-411b-ac0f-8b22a5f6f1eb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:26.580774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f61bf88-c017-411b-ac0f-8b22a5f6f1eb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:26.581573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f61bf88-c017-411b-ac0f-8b22a5f6f1eb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:26.582023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f61bf88-c017-411b-ac0f-8b22a5f6f1eb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:26.633243 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-8f61bf88-c017-411b-ac0f-8b22a5f6f1eb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] HTTP exception thrown: Instance 82767745-0d0e-4892-b97e-28a49a746db0 could not be found. May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8f61bf88-c017-411b-ac0f-8b22a5f6f1eb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Request method failure captured: May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 HTTP/1.1 May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikaoQYQchrh2XakGGrNw11ys5UQs4OXIf9xMNV-20af4LsMX_Su4KFUIfZemhe-Tzn-w4pVHjS_smiI_SiLygbVF215cZ7DSG83uVMXJbfi_bMltF9zMlgcj2MGtyWWf07NkL17iAcfEzeiladbpIl0-FrLXe9iLR4H4noFpN95vJXZI May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d14e7de3a28f42a79197e1c06c4676dd May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2101778381 May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d14e7de3a28f42a79197e1c06c4676dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d14e7de3a28f42a79197e1c06c4676dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d14e7de3a28f42a79197e1c06c4676dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d14e7de3a28f42a79197e1c06c4676dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2101778381 May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d14e7de3a28f42a79197e1c06c4676dd May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2101778381 May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TestNetworkAdvancedServerOps-2101778381-project May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 82b17444b87742e1b45409810cbe06d2 May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2101778381-project May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 82767745-0d0e-4892-b97e-28a49a746db0 could not be found. May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '82767745-0d0e-4892-b97e-28a49a746db0'} May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82767745-0d0e-4892-b97e-28a49a746db0 could not be found. May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82767745-0d0e-4892-b97e-28a49a746db0 could not be found. May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:01:26.634866 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:01:26.645853 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:01:26.645853 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:01:26.645853 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:01:26.645853 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:01:26.645853 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:01:26.645853 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:01:26.645853 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82767745-0d0e-4892-b97e-28a49a746db0 could not be found. May 28 05:01:26.645853 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:01:26.645853 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8f61bf88-c017-411b-ac0f-8b22a5f6f1eb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Returning 404 to user: Instance 82767745-0d0e-4892-b97e-28a49a746db0 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:01:26.645853 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8f61bf88-c017-411b-ac0f-8b22a5f6f1eb tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0" status: 404 len: 111 microversion: 2.1 time: 0.073281 May 28 05:01:26.645853 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2930/5746] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:01:26 2022] GET /compute/v2.1/servers/82767745-0d0e-4892-b97e-28a49a746db0 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:01:26.946130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-780cbbff-ee49-4206-b134-640b9f4f0d1a req-7523ced5-409b-4ba9-a349-b7921639b001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b28a05b-9b15-4b95-995f-88592e01319e", "tag": "84e61710-b29e-45a1-881b-41db16e2042f"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:01:26.975135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-780cbbff-ee49-4206-b134-640b9f4f0d1a req-7523ced5-409b-4ba9-a349-b7921639b001 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:26.975614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-780cbbff-ee49-4206-b134-640b9f4f0d1a req-7523ced5-409b-4ba9-a349-b7921639b001 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:27.077083 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-780cbbff-ee49-4206-b134-640b9f4f0d1a req-7523ced5-409b-4ba9-a349-b7921639b001 service nova] Creating event network-changed:84e61710-b29e-45a1-881b-41db16e2042f for instance 3b28a05b-9b15-4b95-995f-88592e01319e on n-h2-843700-1 May 28 05:01:27.090240 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-780cbbff-ee49-4206-b134-640b9f4f0d1a req-7523ced5-409b-4ba9-a349-b7921639b001 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.327895 May 28 05:01:27.107868 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2817/5747] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:01:27.407996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-60e40f03-524c-42a6-9e30-d7004f2ac5fd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:27.408644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-60e40f03-524c-42a6-9e30-d7004f2ac5fd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:27.432461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:01:27.434117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60e40f03-524c-42a6-9e30-d7004f2ac5fd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:27.434583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60e40f03-524c-42a6-9e30-d7004f2ac5fd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:27.435420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60e40f03-524c-42a6-9e30-d7004f2ac5fd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:27.435875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60e40f03-524c-42a6-9e30-d7004f2ac5fd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:28.425277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-60e40f03-524c-42a6-9e30-d7004f2ac5fd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:28.433885 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-60e40f03-524c-42a6-9e30-d7004f2ac5fd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1362 microversion: 2.1 time: 1.029765 May 28 05:01:28.434503 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2931/5748] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:01:27 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1362 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:01:29.448803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:01:29.455174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-073c83ac-5cab-482b-8800-d21733ea4946 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:29.456190 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-073c83ac-5cab-482b-8800-d21733ea4946 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:29.472813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-073c83ac-5cab-482b-8800-d21733ea4946 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:29.478515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-073c83ac-5cab-482b-8800-d21733ea4946 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:29.479743 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-073c83ac-5cab-482b-8800-d21733ea4946 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:29.480605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-073c83ac-5cab-482b-8800-d21733ea4946 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:30.023818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-073c83ac-5cab-482b-8800-d21733ea4946 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:30.043896 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-073c83ac-5cab-482b-8800-d21733ea4946 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1362 microversion: 2.1 time: 0.596521 May 28 05:01:30.044518 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2818/5749] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:01:29 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1362 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:01:30.161646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-01c21f7b-42e9-4573-a739-26f50e127ba1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:30.162621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-01c21f7b-42e9-4573-a739-26f50e127ba1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:30.168492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=8 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:01:30.170137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01c21f7b-42e9-4573-a739-26f50e127ba1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:30.170605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01c21f7b-42e9-4573-a739-26f50e127ba1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:30.179707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01c21f7b-42e9-4573-a739-26f50e127ba1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:30.180193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01c21f7b-42e9-4573-a739-26f50e127ba1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:30.736152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-01c21f7b-42e9-4573-a739-26f50e127ba1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:30.765085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-01c21f7b-42e9-4573-a739-26f50e127ba1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:30.767031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-01c21f7b-42e9-4573-a739-26f50e127ba1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:30.768554 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-01c21f7b-42e9-4573-a739-26f50e127ba1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 2944 microversion: 2.32 time: 0.611706 May 28 05:01:30.798614 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2932/5750] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:01:30 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 2944 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:01:30.800528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-654b73f4-b3d1-4fef-9410-7d6d4f077dab tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:30.805699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-654b73f4-b3d1-4fef-9410-7d6d4f077dab tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:30.818662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-654b73f4-b3d1-4fef-9410-7d6d4f077dab tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:30.825872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-654b73f4-b3d1-4fef-9410-7d6d4f077dab tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:30.825872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-654b73f4-b3d1-4fef-9410-7d6d4f077dab tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:30.825872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-654b73f4-b3d1-4fef-9410-7d6d4f077dab tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:31.063274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-25ffcd43-d3d7-42a1-a764-c2539f06e36e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:31.063770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-25ffcd43-d3d7-42a1-a764-c2539f06e36e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:31.079547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25ffcd43-d3d7-42a1-a764-c2539f06e36e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:31.079547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25ffcd43-d3d7-42a1-a764-c2539f06e36e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:31.083769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25ffcd43-d3d7-42a1-a764-c2539f06e36e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:31.084322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25ffcd43-d3d7-42a1-a764-c2539f06e36e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:31.569551 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-654b73f4-b3d1-4fef-9410-7d6d4f077dab tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.781910 May 28 05:01:31.571006 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2819/5751] 10.222.0.58 () {60 vars in 1315 bytes} [Sat May 28 05:01:30 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce/os-interface => generated 1828 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:01:31.924534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-25ffcd43-d3d7-42a1-a764-c2539f06e36e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:31.945017 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-25ffcd43-d3d7-42a1-a764-c2539f06e36e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1362 microversion: 2.1 time: 0.885955 May 28 05:01:31.947107 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2933/5752] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:01:31 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1362 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:01:32.965387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-888efdc6-39dc-4ec3-9524-4ad353cfe784 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:32.967543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-888efdc6-39dc-4ec3-9524-4ad353cfe784 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:33.014123 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-888efdc6-39dc-4ec3-9524-4ad353cfe784 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:33.014123 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-888efdc6-39dc-4ec3-9524-4ad353cfe784 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:33.015620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-888efdc6-39dc-4ec3-9524-4ad353cfe784 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:33.020055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-888efdc6-39dc-4ec3-9524-4ad353cfe784 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:33.586266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-888efdc6-39dc-4ec3-9524-4ad353cfe784 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:33.600898 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-888efdc6-39dc-4ec3-9524-4ad353cfe784 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1362 microversion: 2.1 time: 0.640802 May 28 05:01:33.605201 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2820/5753] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:01:32 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1362 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:01:34.627750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8240e2e1-d269-4ca7-a6a1-a924f8455796 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:34.629366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8240e2e1-d269-4ca7-a6a1-a924f8455796 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:34.687260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8240e2e1-d269-4ca7-a6a1-a924f8455796 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:34.688120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8240e2e1-d269-4ca7-a6a1-a924f8455796 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:34.690768 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8240e2e1-d269-4ca7-a6a1-a924f8455796 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:34.692086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8240e2e1-d269-4ca7-a6a1-a924f8455796 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:34.963709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8240e2e1-d269-4ca7-a6a1-a924f8455796 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:34.977799 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8240e2e1-d269-4ca7-a6a1-a924f8455796 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1362 microversion: 2.1 time: 0.358767 May 28 05:01:34.982590 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2934/5754] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:01:34 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:01:36.016852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6ee1cde7-22a1-43eb-a2d7-619b2ffe832a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:36.018503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6ee1cde7-22a1-43eb-a2d7-619b2ffe832a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:36.032456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ee1cde7-22a1-43eb-a2d7-619b2ffe832a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:36.033320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ee1cde7-22a1-43eb-a2d7-619b2ffe832a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:36.034435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ee1cde7-22a1-43eb-a2d7-619b2ffe832a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:36.038587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ee1cde7-22a1-43eb-a2d7-619b2ffe832a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:36.552974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6ee1cde7-22a1-43eb-a2d7-619b2ffe832a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:36.606146 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6ee1cde7-22a1-43eb-a2d7-619b2ffe832a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1362 microversion: 2.1 time: 0.594927 May 28 05:01:36.610933 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2821/5755] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:01:36 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1362 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:01:36.887217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5296fa5d-3d58-4806-ba50-99abe8604410 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] Calling method '.version_select at 0x7f7700c0b670>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:37.021983 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5296fa5d-3d58-4806-ba50-99abe8604410 tempest-TestNetworkAdvancedServerOps-2101778381 tempest-TestNetworkAdvancedServerOps-2101778381-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-613504025" status: 202 len: 0 microversion: 2.1 time: 0.139160 May 28 05:01:37.027418 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2935/5756] 10.222.0.58 () {58 vars in 1280 bytes} [Sat May 28 05:01:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-613504025 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:01:37.078168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-d275cb7e-7313-4993-b4cd-18e25605a049 req-da3b40b8-2971-4982-9e36-ee670e6764d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b28a05b-9b15-4b95-995f-88592e01319e", "name": "network-vif-plugged", "status": "completed", "tag": "84e61710-b29e-45a1-881b-41db16e2042f"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:01:37.100650 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d275cb7e-7313-4993-b4cd-18e25605a049 req-da3b40b8-2971-4982-9e36-ee670e6764d8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:37.109535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d275cb7e-7313-4993-b4cd-18e25605a049 req-da3b40b8-2971-4982-9e36-ee670e6764d8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:37.173040 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-d275cb7e-7313-4993-b4cd-18e25605a049 req-da3b40b8-2971-4982-9e36-ee670e6764d8 service nova] Creating event network-vif-plugged:84e61710-b29e-45a1-881b-41db16e2042f for instance 3b28a05b-9b15-4b95-995f-88592e01319e on n-h2-843700-1 May 28 05:01:37.194917 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-d275cb7e-7313-4993-b4cd-18e25605a049 req-da3b40b8-2971-4982-9e36-ee670e6764d8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122087 May 28 05:01:37.202725 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2822/5757] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:01:37.633597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6c377b51-ab4a-4d93-8762-c8ccc0c6bda9 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:37.634629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6c377b51-ab4a-4d93-8762-c8ccc0c6bda9 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:37.654559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c377b51-ab4a-4d93-8762-c8ccc0c6bda9 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:37.655395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c377b51-ab4a-4d93-8762-c8ccc0c6bda9 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:37.656431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c377b51-ab4a-4d93-8762-c8ccc0c6bda9 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:37.657198 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c377b51-ab4a-4d93-8762-c8ccc0c6bda9 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:38.212489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6c377b51-ab4a-4d93-8762-c8ccc0c6bda9 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:38.221312 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6c377b51-ab4a-4d93-8762-c8ccc0c6bda9 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1362 microversion: 2.1 time: 0.593881 May 28 05:01:38.221915 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2936/5758] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:01:37 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1362 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:01:39.240633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6dab51e2-398c-4642-9d01-50894e0fa3f1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:39.242060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6dab51e2-398c-4642-9d01-50894e0fa3f1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:39.256901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6dab51e2-398c-4642-9d01-50894e0fa3f1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:39.257507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6dab51e2-398c-4642-9d01-50894e0fa3f1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:39.258510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6dab51e2-398c-4642-9d01-50894e0fa3f1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:39.264773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6dab51e2-398c-4642-9d01-50894e0fa3f1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:39.602335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6dab51e2-398c-4642-9d01-50894e0fa3f1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:01:39.621583 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6dab51e2-398c-4642-9d01-50894e0fa3f1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1547 microversion: 2.1 time: 0.386683 May 28 05:01:39.622656 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2823/5759] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:01:39 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1547 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:01:39.640109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-39433235-a90e-43c3-8691-bb450e651f38 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:01:39.640702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-39433235-a90e-43c3-8691-bb450e651f38 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:01:39.655524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39433235-a90e-43c3-8691-bb450e651f38 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:39.656344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39433235-a90e-43c3-8691-bb450e651f38 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:39.657345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39433235-a90e-43c3-8691-bb450e651f38 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:39.658001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39433235-a90e-43c3-8691-bb450e651f38 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:39.810150 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-39433235-a90e-43c3-8691-bb450e651f38 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174220 May 28 05:01:39.815179 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2937/5760] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 05:01:39 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e/os-interface => generated 285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:01:42.017801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b2765ad8-b555-4fcf-921c-c12020462a2c req-82ea446f-f3e9-4bde-927d-846c6bc4233d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b28a05b-9b15-4b95-995f-88592e01319e", "tag": "84e61710-b29e-45a1-881b-41db16e2042f"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:01:42.051563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b2765ad8-b555-4fcf-921c-c12020462a2c req-82ea446f-f3e9-4bde-927d-846c6bc4233d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:01:42.059406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b2765ad8-b555-4fcf-921c-c12020462a2c req-82ea446f-f3e9-4bde-927d-846c6bc4233d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:01:42.081280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=71 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:01:42.120696 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b2765ad8-b555-4fcf-921c-c12020462a2c req-82ea446f-f3e9-4bde-927d-846c6bc4233d service nova] Creating event network-changed:84e61710-b29e-45a1-881b-41db16e2042f for instance 3b28a05b-9b15-4b95-995f-88592e01319e on n-h2-843700-1 May 28 05:01:42.154697 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b2765ad8-b555-4fcf-921c-c12020462a2c req-82ea446f-f3e9-4bde-927d-846c6bc4233d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137792 May 28 05:01:42.156642 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2824/5761] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:02:15.587559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:02:15.588445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:02:15.592576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-da807299-7976-4019-88a3-05e690f636dd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:02:15.593085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-da807299-7976-4019-88a3-05e690f636dd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:02:15.611925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da807299-7976-4019-88a3-05e690f636dd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:02:15.614735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da807299-7976-4019-88a3-05e690f636dd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:02:15.615698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da807299-7976-4019-88a3-05e690f636dd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:02:15.616164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da807299-7976-4019-88a3-05e690f636dd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:02:15.725242 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-da807299-7976-4019-88a3-05e690f636dd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e/ips" status: 200 len: 145 microversion: 2.1 time: 0.139693 May 28 05:02:15.726822 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2938/5762] 10.222.0.58 () {58 vars in 1247 bytes} [Sat May 28 05:02:15 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e/ips => generated 145 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:02:22.461152 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-677b599c-11bb-4e5b-a973-c753c3a66d0b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5a13890-3300-41e5-a21a-610fe13abe33"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:02:22.463921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-677b599c-11bb-4e5b-a973-c753c3a66d0b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:02:22.473827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:02:22.478450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-677b599c-11bb-4e5b-a973-c753c3a66d0b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:02:22.482593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-677b599c-11bb-4e5b-a973-c753c3a66d0b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:02:22.482593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-677b599c-11bb-4e5b-a973-c753c3a66d0b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:02:22.482593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-677b599c-11bb-4e5b-a973-c753c3a66d0b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:02:23.716136 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-677b599c-11bb-4e5b-a973-c753c3a66d0b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "POST /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.265634 May 28 05:02:23.717565 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2825/5763] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 05:02:22 2022] POST /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e/os-volume_attachments => generated 194 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:02:55.805213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-222d9b7e-b062-4e86-a8f7-0a3fc8410550 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:02:55.831011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-222d9b7e-b062-4e86-a8f7-0a3fc8410550 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:02:55.831460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-222d9b7e-b062-4e86-a8f7-0a3fc8410550 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:02:55.912387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-222d9b7e-b062-4e86-a8f7-0a3fc8410550 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Going to try to stop instance {{(pid=126044) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 05:02:56.282715 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-222d9b7e-b062-4e86-a8f7-0a3fc8410550 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "POST /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e/action" status: 202 len: 0 microversion: 2.1 time: 0.483201 May 28 05:02:56.284239 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2939/5764] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:02:55 2022] POST /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:02:56.291173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:02:56.292056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:02:56.296828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4eca80e8-412e-4ed9-b498-33e271049d96 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:02:56.298889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4eca80e8-412e-4ed9-b498-33e271049d96 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:02:56.320068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4eca80e8-412e-4ed9-b498-33e271049d96 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:02:56.322639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4eca80e8-412e-4ed9-b498-33e271049d96 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:02:56.322830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4eca80e8-412e-4ed9-b498-33e271049d96 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:02:56.324409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4eca80e8-412e-4ed9-b498-33e271049d96 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:02:57.030712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4eca80e8-412e-4ed9-b498-33e271049d96 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:02:57.056054 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4eca80e8-412e-4ed9-b498-33e271049d96 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1722 microversion: 2.1 time: 0.754127 May 28 05:02:57.056054 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2826/5765] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:02:56 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1722 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:02:58.069503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-832d15de-500b-450e-9e9e-28d9e8fd688e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:02:58.070223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-832d15de-500b-450e-9e9e-28d9e8fd688e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:02:58.094629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-832d15de-500b-450e-9e9e-28d9e8fd688e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:02:58.095133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-832d15de-500b-450e-9e9e-28d9e8fd688e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:02:58.097631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-832d15de-500b-450e-9e9e-28d9e8fd688e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:02:58.097631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-832d15de-500b-450e-9e9e-28d9e8fd688e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:02:58.672976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-832d15de-500b-450e-9e9e-28d9e8fd688e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:02:58.689297 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-832d15de-500b-450e-9e9e-28d9e8fd688e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1722 microversion: 2.1 time: 0.626538 May 28 05:02:58.689910 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2940/5766] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:02:58 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1722 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:02:59.718168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-14ec8026-e9ef-4736-bc4d-bc1bd5e7454e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:02:59.719399 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-14ec8026-e9ef-4736-bc4d-bc1bd5e7454e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:02:59.738139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-14ec8026-e9ef-4736-bc4d-bc1bd5e7454e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:02:59.739836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-14ec8026-e9ef-4736-bc4d-bc1bd5e7454e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:02:59.741790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-14ec8026-e9ef-4736-bc4d-bc1bd5e7454e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:02:59.743235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-14ec8026-e9ef-4736-bc4d-bc1bd5e7454e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:00.263643 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-14ec8026-e9ef-4736-bc4d-bc1bd5e7454e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:00.272868 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-14ec8026-e9ef-4736-bc4d-bc1bd5e7454e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1722 microversion: 2.1 time: 0.559565 May 28 05:03:00.292192 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2827/5767] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:02:59 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1722 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:03:01.306252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c06167b4-4d48-4254-984f-8f2e89586d11 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:01.306252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c06167b4-4d48-4254-984f-8f2e89586d11 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:01.316900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c06167b4-4d48-4254-984f-8f2e89586d11 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:01.318885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c06167b4-4d48-4254-984f-8f2e89586d11 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:01.319812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c06167b4-4d48-4254-984f-8f2e89586d11 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:01.323499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c06167b4-4d48-4254-984f-8f2e89586d11 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:01.601571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c06167b4-4d48-4254-984f-8f2e89586d11 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:01.614620 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c06167b4-4d48-4254-984f-8f2e89586d11 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1722 microversion: 2.1 time: 0.325881 May 28 05:03:01.619223 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2941/5768] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:03:01 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1722 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:03:02.635500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-abd5eb84-eb41-41a7-96a8-d4a0743f5a60 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:02.642172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-abd5eb84-eb41-41a7-96a8-d4a0743f5a60 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:02.648765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abd5eb84-eb41-41a7-96a8-d4a0743f5a60 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:02.653347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abd5eb84-eb41-41a7-96a8-d4a0743f5a60 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:02.656769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abd5eb84-eb41-41a7-96a8-d4a0743f5a60 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:02.661538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abd5eb84-eb41-41a7-96a8-d4a0743f5a60 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:03.786469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-abd5eb84-eb41-41a7-96a8-d4a0743f5a60 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:03.810352 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-abd5eb84-eb41-41a7-96a8-d4a0743f5a60 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1722 microversion: 2.1 time: 1.169563 May 28 05:03:03.811094 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2828/5769] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:03:02 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1722 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:03:04.828151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ce8ce5be-1ef9-499d-b3ee-b0fc1b552e27 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:04.829488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ce8ce5be-1ef9-499d-b3ee-b0fc1b552e27 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:04.848807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce8ce5be-1ef9-499d-b3ee-b0fc1b552e27 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:04.853752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce8ce5be-1ef9-499d-b3ee-b0fc1b552e27 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:04.862365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce8ce5be-1ef9-499d-b3ee-b0fc1b552e27 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:04.863409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce8ce5be-1ef9-499d-b3ee-b0fc1b552e27 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:05.504808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ce8ce5be-1ef9-499d-b3ee-b0fc1b552e27 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:05.518438 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ce8ce5be-1ef9-499d-b3ee-b0fc1b552e27 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1722 microversion: 2.1 time: 0.693998 May 28 05:03:05.519467 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2942/5770] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:03:04 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1722 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:03:06.538702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-614450e8-94df-43f3-b026-a5ba085e16af tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:06.541791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-614450e8-94df-43f3-b026-a5ba085e16af tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:06.550873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-614450e8-94df-43f3-b026-a5ba085e16af tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:06.551946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-614450e8-94df-43f3-b026-a5ba085e16af tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:06.553561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-614450e8-94df-43f3-b026-a5ba085e16af tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:06.554199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-614450e8-94df-43f3-b026-a5ba085e16af tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:07.108505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-614450e8-94df-43f3-b026-a5ba085e16af tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:07.122676 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-614450e8-94df-43f3-b026-a5ba085e16af tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1722 microversion: 2.1 time: 0.588702 May 28 05:03:07.123875 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2829/5771] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:03:06 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1722 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:03:08.140993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-81de5fda-2132-4c68-a713-14d7338255c2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:08.140993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-81de5fda-2132-4c68-a713-14d7338255c2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:08.153998 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-81de5fda-2132-4c68-a713-14d7338255c2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:08.154462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-81de5fda-2132-4c68-a713-14d7338255c2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:08.155311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-81de5fda-2132-4c68-a713-14d7338255c2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:08.157783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-81de5fda-2132-4c68-a713-14d7338255c2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:08.509347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-81de5fda-2132-4c68-a713-14d7338255c2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:08.518188 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-81de5fda-2132-4c68-a713-14d7338255c2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1722 microversion: 2.1 time: 0.382216 May 28 05:03:08.523423 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2943/5772] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:03:08 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1722 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:03:09.543090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5a34d324-fc5c-492c-8555-d53700db2472 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:09.543721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5a34d324-fc5c-492c-8555-d53700db2472 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:09.551797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a34d324-fc5c-492c-8555-d53700db2472 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:09.553482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a34d324-fc5c-492c-8555-d53700db2472 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:09.554468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a34d324-fc5c-492c-8555-d53700db2472 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:09.555108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a34d324-fc5c-492c-8555-d53700db2472 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:10.708133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5a34d324-fc5c-492c-8555-d53700db2472 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:10.733346 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5a34d324-fc5c-492c-8555-d53700db2472 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1722 microversion: 2.1 time: 1.185284 May 28 05:03:10.733346 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2830/5773] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:03:09 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1722 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:03:11.744432 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f581ce58-6c67-4800-b458-7677141c0242 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:11.745152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f581ce58-6c67-4800-b458-7677141c0242 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:11.761466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f581ce58-6c67-4800-b458-7677141c0242 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:11.761466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f581ce58-6c67-4800-b458-7677141c0242 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:11.764965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f581ce58-6c67-4800-b458-7677141c0242 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:11.765669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f581ce58-6c67-4800-b458-7677141c0242 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:11.977184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f581ce58-6c67-4800-b458-7677141c0242 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:11.989480 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f581ce58-6c67-4800-b458-7677141c0242 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1722 microversion: 2.1 time: 0.253751 May 28 05:03:11.995030 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2944/5774] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:03:11 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:03:13.015323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8b2972af-9108-4c55-b12c-55b8ad922dfd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:13.018544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8b2972af-9108-4c55-b12c-55b8ad922dfd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:13.031370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b2972af-9108-4c55-b12c-55b8ad922dfd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:13.032543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b2972af-9108-4c55-b12c-55b8ad922dfd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:13.033691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b2972af-9108-4c55-b12c-55b8ad922dfd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:13.034557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b2972af-9108-4c55-b12c-55b8ad922dfd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:13.409170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8b2972af-9108-4c55-b12c-55b8ad922dfd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:13.418904 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8b2972af-9108-4c55-b12c-55b8ad922dfd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1722 microversion: 2.1 time: 0.409373 May 28 05:03:13.419511 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2831/5775] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:03:13 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1722 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:03:14.436416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ac54800f-373a-4176-acf4-794e5f12e690 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:14.437039 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ac54800f-373a-4176-acf4-794e5f12e690 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:14.453491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac54800f-373a-4176-acf4-794e5f12e690 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:14.455071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac54800f-373a-4176-acf4-794e5f12e690 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:14.456927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac54800f-373a-4176-acf4-794e5f12e690 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:14.458397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac54800f-373a-4176-acf4-794e5f12e690 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:14.803287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ac54800f-373a-4176-acf4-794e5f12e690 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:14.813210 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ac54800f-373a-4176-acf4-794e5f12e690 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1722 microversion: 2.1 time: 0.380615 May 28 05:03:14.825448 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2945/5776] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:03:14 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1722 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:03:15.832909 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-74fdba21-f0fb-4bb7-9e2e-f271892e43df tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:15.833510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-74fdba21-f0fb-4bb7-9e2e-f271892e43df tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:15.849934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74fdba21-f0fb-4bb7-9e2e-f271892e43df tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:15.850621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74fdba21-f0fb-4bb7-9e2e-f271892e43df tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:15.852030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74fdba21-f0fb-4bb7-9e2e-f271892e43df tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:15.852469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74fdba21-f0fb-4bb7-9e2e-f271892e43df tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:16.421626 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-74fdba21-f0fb-4bb7-9e2e-f271892e43df tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:16.421626 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-74fdba21-f0fb-4bb7-9e2e-f271892e43df tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1722 microversion: 2.1 time: 0.470852 May 28 05:03:16.421626 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2832/5777] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:03:15 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1722 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:03:17.317840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-18cfc497-a8cf-4bdc-b133-a92450f8dd41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:17.319220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-18cfc497-a8cf-4bdc-b133-a92450f8dd41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:17.327561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-18cfc497-a8cf-4bdc-b133-a92450f8dd41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:17.328018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-18cfc497-a8cf-4bdc-b133-a92450f8dd41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:17.333061 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-18cfc497-a8cf-4bdc-b133-a92450f8dd41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:17.333560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-18cfc497-a8cf-4bdc-b133-a92450f8dd41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:17.594499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-18cfc497-a8cf-4bdc-b133-a92450f8dd41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:17.606057 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-18cfc497-a8cf-4bdc-b133-a92450f8dd41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1722 microversion: 2.1 time: 0.292159 May 28 05:03:17.606666 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2946/5778] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:03:17 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1722 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:03:18.623221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-24820637-cb90-443b-9bd3-8c2f7b482a6d tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:18.623851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-24820637-cb90-443b-9bd3-8c2f7b482a6d tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:18.641698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24820637-cb90-443b-9bd3-8c2f7b482a6d tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:18.642166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24820637-cb90-443b-9bd3-8c2f7b482a6d tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:18.642975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24820637-cb90-443b-9bd3-8c2f7b482a6d tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:18.643450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24820637-cb90-443b-9bd3-8c2f7b482a6d tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:19.054463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-24820637-cb90-443b-9bd3-8c2f7b482a6d tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:19.066672 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-24820637-cb90-443b-9bd3-8c2f7b482a6d tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1722 microversion: 2.1 time: 0.447446 May 28 05:03:19.067549 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2833/5779] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:03:18 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1722 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:03:20.085030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d8e7f4cb-a341-4fcd-9708-11a91b2a6857 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:20.085797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d8e7f4cb-a341-4fcd-9708-11a91b2a6857 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:20.094145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8e7f4cb-a341-4fcd-9708-11a91b2a6857 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:20.107775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8e7f4cb-a341-4fcd-9708-11a91b2a6857 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:20.113053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8e7f4cb-a341-4fcd-9708-11a91b2a6857 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:20.113611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8e7f4cb-a341-4fcd-9708-11a91b2a6857 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:20.482947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d8e7f4cb-a341-4fcd-9708-11a91b2a6857 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:20.524282 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d8e7f4cb-a341-4fcd-9708-11a91b2a6857 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1722 microversion: 2.1 time: 0.443779 May 28 05:03:20.529885 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2947/5780] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:03:20 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1722 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:03:21.552213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a2af7415-b692-42d3-9f51-df600b2018fa tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:21.554008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a2af7415-b692-42d3-9f51-df600b2018fa tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:21.570715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2af7415-b692-42d3-9f51-df600b2018fa tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:21.571997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2af7415-b692-42d3-9f51-df600b2018fa tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:21.573071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2af7415-b692-42d3-9f51-df600b2018fa tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:21.574279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a2af7415-b692-42d3-9f51-df600b2018fa tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:21.837193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a2af7415-b692-42d3-9f51-df600b2018fa tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:21.853115 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a2af7415-b692-42d3-9f51-df600b2018fa tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1722 microversion: 2.1 time: 0.307433 May 28 05:03:21.854172 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2834/5781] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:03:21 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1722 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:03:22.871387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bf277278-fa80-453c-baa8-aadceee7f816 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:22.872635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bf277278-fa80-453c-baa8-aadceee7f816 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:22.891881 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf277278-fa80-453c-baa8-aadceee7f816 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:22.894013 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf277278-fa80-453c-baa8-aadceee7f816 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:22.895353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf277278-fa80-453c-baa8-aadceee7f816 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:22.897099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf277278-fa80-453c-baa8-aadceee7f816 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:23.502941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bf277278-fa80-453c-baa8-aadceee7f816 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:23.512900 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bf277278-fa80-453c-baa8-aadceee7f816 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1699 microversion: 2.1 time: 0.645488 May 28 05:03:23.529586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9dde1d6e-2835-42bd-8b1a-9a9e478fc0d6 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:03:23.531394 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2948/5782] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:03:22 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1699 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:03:23.544201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9dde1d6e-2835-42bd-8b1a-9a9e478fc0d6 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:23.544869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9dde1d6e-2835-42bd-8b1a-9a9e478fc0d6 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:23.602333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9dde1d6e-2835-42bd-8b1a-9a9e478fc0d6 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Going to try to start instance {{(pid=126043) start /opt/stack/nova/nova/compute/api.py:2730}} May 28 05:03:23.931219 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9dde1d6e-2835-42bd-8b1a-9a9e478fc0d6 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "POST /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e/action" status: 202 len: 0 microversion: 2.1 time: 0.395797 May 28 05:03:23.935613 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2835/5783] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:03:23 2022] POST /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:03:23.942257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f8fcdf89-f7b0-44f8-9e44-5f1b5f3b55e2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:23.944959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f8fcdf89-f7b0-44f8-9e44-5f1b5f3b55e2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:23.975990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8fcdf89-f7b0-44f8-9e44-5f1b5f3b55e2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:23.976696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8fcdf89-f7b0-44f8-9e44-5f1b5f3b55e2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:23.977728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8fcdf89-f7b0-44f8-9e44-5f1b5f3b55e2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:23.978321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8fcdf89-f7b0-44f8-9e44-5f1b5f3b55e2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:24.391309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f8fcdf89-f7b0-44f8-9e44-5f1b5f3b55e2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:24.406208 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f8fcdf89-f7b0-44f8-9e44-5f1b5f3b55e2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1708 microversion: 2.1 time: 0.469555 May 28 05:03:24.406816 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2949/5784] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:03:23 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1708 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:03:25.424705 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e942bfd0-f7cd-4de1-a495-28d3498310de tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:25.425426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e942bfd0-f7cd-4de1-a495-28d3498310de tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:25.441128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e942bfd0-f7cd-4de1-a495-28d3498310de tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:25.442673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e942bfd0-f7cd-4de1-a495-28d3498310de tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:25.445141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e942bfd0-f7cd-4de1-a495-28d3498310de tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:25.445608 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e942bfd0-f7cd-4de1-a495-28d3498310de tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:25.785088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e942bfd0-f7cd-4de1-a495-28d3498310de tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:25.799302 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e942bfd0-f7cd-4de1-a495-28d3498310de tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1708 microversion: 2.1 time: 0.376679 May 28 05:03:25.825824 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2836/5785] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:03:25 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1708 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:03:26.831392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-14305afe-2db3-49d9-a109-8d917e8528dd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:26.832091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-14305afe-2db3-49d9-a109-8d917e8528dd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:26.877404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14305afe-2db3-49d9-a109-8d917e8528dd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:26.878775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14305afe-2db3-49d9-a109-8d917e8528dd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:26.882083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14305afe-2db3-49d9-a109-8d917e8528dd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:26.888144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14305afe-2db3-49d9-a109-8d917e8528dd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:27.408270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-14305afe-2db3-49d9-a109-8d917e8528dd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:27.424180 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-14305afe-2db3-49d9-a109-8d917e8528dd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1708 microversion: 2.1 time: 0.604530 May 28 05:03:27.424818 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2950/5786] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:03:26 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1708 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:03:28.444786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-209248cb-cfcb-41a6-a766-40c72747d699 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:28.445324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-209248cb-cfcb-41a6-a766-40c72747d699 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:28.454639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-209248cb-cfcb-41a6-a766-40c72747d699 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:28.455590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-209248cb-cfcb-41a6-a766-40c72747d699 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:28.456579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-209248cb-cfcb-41a6-a766-40c72747d699 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:28.458231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-209248cb-cfcb-41a6-a766-40c72747d699 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:28.774377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-209248cb-cfcb-41a6-a766-40c72747d699 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:28.785246 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-209248cb-cfcb-41a6-a766-40c72747d699 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1712 microversion: 2.1 time: 0.347053 May 28 05:03:28.786681 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2837/5787] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:03:28 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1712 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:03:38.150332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=26 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:03:38.151391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:03:38.618660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fdef5dc6-5f46-4e7b-b0dd-d6db4af9737b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:38.619451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fdef5dc6-5f46-4e7b-b0dd-d6db4af9737b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:38.638961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fdef5dc6-5f46-4e7b-b0dd-d6db4af9737b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:38.645504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fdef5dc6-5f46-4e7b-b0dd-d6db4af9737b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:38.653487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fdef5dc6-5f46-4e7b-b0dd-d6db4af9737b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:38.656119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fdef5dc6-5f46-4e7b-b0dd-d6db4af9737b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:38.729184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fdef5dc6-5f46-4e7b-b0dd-d6db4af9737b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:03:39.230047 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fdef5dc6-5f46-4e7b-b0dd-d6db4af9737b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "DELETE /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 204 len: 0 microversion: 2.32 time: 1.086500 May 28 05:03:39.230949 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2951/5788] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 05:03:38 2022] DELETE /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 0 bytes in 1088 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 05:03:39.240308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bd59eddc-fa1b-4290-bc35-52753377c2cb tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:39.241707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bd59eddc-fa1b-4290-bc35-52753377c2cb tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:39.261560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=24 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:03:39.262401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:03:39.275934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd59eddc-fa1b-4290-bc35-52753377c2cb tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:39.276393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd59eddc-fa1b-4290-bc35-52753377c2cb tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:39.277197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd59eddc-fa1b-4290-bc35-52753377c2cb tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:39.277638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd59eddc-fa1b-4290-bc35-52753377c2cb tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:39.869854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bd59eddc-fa1b-4290-bc35-52753377c2cb tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:39.882176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bd59eddc-fa1b-4290-bc35-52753377c2cb tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:39.883725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bd59eddc-fa1b-4290-bc35-52753377c2cb tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:39.891258 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bd59eddc-fa1b-4290-bc35-52753377c2cb tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 2950 microversion: 2.32 time: 0.655977 May 28 05:03:39.896008 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2838/5789] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:03:39 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 2950 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:03:40.914298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cc1fafb4-dfb3-4690-a865-74ab49cca06a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:40.915365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cc1fafb4-dfb3-4690-a865-74ab49cca06a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:40.935700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc1fafb4-dfb3-4690-a865-74ab49cca06a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:40.936751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc1fafb4-dfb3-4690-a865-74ab49cca06a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:40.939924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc1fafb4-dfb3-4690-a865-74ab49cca06a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:40.940607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cc1fafb4-dfb3-4690-a865-74ab49cca06a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:41.578433 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cc1fafb4-dfb3-4690-a865-74ab49cca06a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:41.600899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cc1fafb4-dfb3-4690-a865-74ab49cca06a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:41.615562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cc1fafb4-dfb3-4690-a865-74ab49cca06a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:41.616799 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cc1fafb4-dfb3-4690-a865-74ab49cca06a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 2950 microversion: 2.32 time: 0.708158 May 28 05:03:41.618634 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2952/5790] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:03:40 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 2950 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:03:42.641997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-319dce85-d770-4344-89b3-fed5c78ba024 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:42.643014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-319dce85-d770-4344-89b3-fed5c78ba024 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:42.650857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-319dce85-d770-4344-89b3-fed5c78ba024 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:42.665981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-319dce85-d770-4344-89b3-fed5c78ba024 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:42.667209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-319dce85-d770-4344-89b3-fed5c78ba024 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:42.667401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-319dce85-d770-4344-89b3-fed5c78ba024 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:43.500808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-319dce85-d770-4344-89b3-fed5c78ba024 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:43.532180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-319dce85-d770-4344-89b3-fed5c78ba024 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:43.533758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-319dce85-d770-4344-89b3-fed5c78ba024 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:43.535191 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-319dce85-d770-4344-89b3-fed5c78ba024 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 2950 microversion: 2.32 time: 0.900986 May 28 05:03:43.536331 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2839/5791] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:03:42 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 2950 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:03:44.556650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-09096a0f-0502-40d2-a0e9-55d621c81adc tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:44.557282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-09096a0f-0502-40d2-a0e9-55d621c81adc tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:44.578659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09096a0f-0502-40d2-a0e9-55d621c81adc tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:44.583505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09096a0f-0502-40d2-a0e9-55d621c81adc tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:44.584608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09096a0f-0502-40d2-a0e9-55d621c81adc tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:44.585543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09096a0f-0502-40d2-a0e9-55d621c81adc tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:45.313746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-09096a0f-0502-40d2-a0e9-55d621c81adc tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:45.327471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-09096a0f-0502-40d2-a0e9-55d621c81adc tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:45.348905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-09096a0f-0502-40d2-a0e9-55d621c81adc tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:45.358694 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-09096a0f-0502-40d2-a0e9-55d621c81adc tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 2929 microversion: 2.32 time: 0.806061 May 28 05:03:45.369157 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2953/5792] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:03:44 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 2929 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:03:45.391477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-f224e4eb-dd9e-40fb-85aa-a949014041f6 req-79ab4650-f1dd-4331-8826-2d841cd15aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "name": "network-vif-unplugged", "status": "completed", "tag": "6ee64452-58e9-4d01-9ea8-79160a3e1c92"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:03:45.407741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f224e4eb-dd9e-40fb-85aa-a949014041f6 req-79ab4650-f1dd-4331-8826-2d841cd15aca service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:45.408477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f224e4eb-dd9e-40fb-85aa-a949014041f6 req-79ab4650-f1dd-4331-8826-2d841cd15aca service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:45.448660 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-f224e4eb-dd9e-40fb-85aa-a949014041f6 req-79ab4650-f1dd-4331-8826-2d841cd15aca service nova] Creating event network-vif-unplugged:6ee64452-58e9-4d01-9ea8-79160a3e1c92 for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 05:03:45.463041 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-f224e4eb-dd9e-40fb-85aa-a949014041f6 req-79ab4650-f1dd-4331-8826-2d841cd15aca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075169 May 28 05:03:45.463805 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2840/5793] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:03:46.381876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-271a30a7-a223-42ea-af67-6f456c7474e6 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:46.382491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-271a30a7-a223-42ea-af67-6f456c7474e6 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:46.415140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-271a30a7-a223-42ea-af67-6f456c7474e6 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:46.415978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-271a30a7-a223-42ea-af67-6f456c7474e6 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:46.418663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-271a30a7-a223-42ea-af67-6f456c7474e6 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:46.419604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-271a30a7-a223-42ea-af67-6f456c7474e6 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:47.070816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-271a30a7-a223-42ea-af67-6f456c7474e6 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:47.085107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-271a30a7-a223-42ea-af67-6f456c7474e6 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:47.091401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-271a30a7-a223-42ea-af67-6f456c7474e6 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:47.097272 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-271a30a7-a223-42ea-af67-6f456c7474e6 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 2908 microversion: 2.32 time: 0.719795 May 28 05:03:47.111874 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2954/5794] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:03:46 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 2908 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:03:47.947598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-26a07bb3-c6fa-4ac2-9b69-f83da505954d req-b9525229-bbf7-4606-b137-8684dc412810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "name": "network-vif-deleted", "tag": "e8a39c56-6241-47f0-8b49-def4fa9702ac"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:03:47.995357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-26a07bb3-c6fa-4ac2-9b69-f83da505954d req-b9525229-bbf7-4606-b137-8684dc412810 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:47.995904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-26a07bb3-c6fa-4ac2-9b69-f83da505954d req-b9525229-bbf7-4606-b137-8684dc412810 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:48.033624 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-26a07bb3-c6fa-4ac2-9b69-f83da505954d req-b9525229-bbf7-4606-b137-8684dc412810 service nova] Creating event network-vif-deleted:e8a39c56-6241-47f0-8b49-def4fa9702ac for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 05:03:48.045412 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-26a07bb3-c6fa-4ac2-9b69-f83da505954d req-b9525229-bbf7-4606-b137-8684dc412810 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101888 May 28 05:03:48.047573 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2841/5795] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:03:48.118017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c5b31c64-fffd-48b0-8c4e-d8b24208d2c4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:48.119240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c5b31c64-fffd-48b0-8c4e-d8b24208d2c4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:48.131486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c5b31c64-fffd-48b0-8c4e-d8b24208d2c4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:48.133025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c5b31c64-fffd-48b0-8c4e-d8b24208d2c4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:48.135860 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c5b31c64-fffd-48b0-8c4e-d8b24208d2c4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:48.136478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c5b31c64-fffd-48b0-8c4e-d8b24208d2c4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:48.538901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-d988fe84-4c9d-4d8a-a71a-61c6b565a79d req-d8acf645-0dce-4133-8d58-a9c576afa963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "name": "network-vif-unplugged", "status": "completed", "tag": "957dc55b-f873-4efe-bcf8-2621e22f7c67"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:03:48.554570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d988fe84-4c9d-4d8a-a71a-61c6b565a79d req-d8acf645-0dce-4133-8d58-a9c576afa963 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:48.569003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d988fe84-4c9d-4d8a-a71a-61c6b565a79d req-d8acf645-0dce-4133-8d58-a9c576afa963 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:48.610065 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-d988fe84-4c9d-4d8a-a71a-61c6b565a79d req-d8acf645-0dce-4133-8d58-a9c576afa963 service nova] Creating event network-vif-unplugged:957dc55b-f873-4efe-bcf8-2621e22f7c67 for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 05:03:48.636107 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-d988fe84-4c9d-4d8a-a71a-61c6b565a79d req-d8acf645-0dce-4133-8d58-a9c576afa963 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102712 May 28 05:03:48.636986 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2842/5796] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:03:48.796270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c5b31c64-fffd-48b0-8c4e-d8b24208d2c4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:48.834738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c5b31c64-fffd-48b0-8c4e-d8b24208d2c4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:48.842036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c5b31c64-fffd-48b0-8c4e-d8b24208d2c4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:48.850636 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c5b31c64-fffd-48b0-8c4e-d8b24208d2c4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 2862 microversion: 2.32 time: 0.734758 May 28 05:03:48.869691 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2955/5797] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:03:48 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 2862 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:03:49.878731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9d8d24f5-4d8d-4781-a712-11ae9cfa762b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:49.880111 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9d8d24f5-4d8d-4781-a712-11ae9cfa762b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:49.897208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d8d24f5-4d8d-4781-a712-11ae9cfa762b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:49.897974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d8d24f5-4d8d-4781-a712-11ae9cfa762b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:49.901022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d8d24f5-4d8d-4781-a712-11ae9cfa762b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:49.906561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d8d24f5-4d8d-4781-a712-11ae9cfa762b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:50.531132 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9d8d24f5-4d8d-4781-a712-11ae9cfa762b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:50.548731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9d8d24f5-4d8d-4781-a712-11ae9cfa762b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:50.551957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9d8d24f5-4d8d-4781-a712-11ae9cfa762b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:50.553976 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9d8d24f5-4d8d-4781-a712-11ae9cfa762b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 2575 microversion: 2.32 time: 0.680818 May 28 05:03:50.558511 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2843/5798] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:03:49 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 2575 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:03:50.848733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-6662ddb4-bbff-43b1-8786-8ab73d5ddc43 req-1228ebea-efe2-4682-9ae4-fac408fa42e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "name": "network-vif-unplugged", "status": "completed", "tag": "01a910c0-bb8d-4131-b876-19533c7842f6"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:03:50.882252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-47bee399-73f0-42f3-966f-ee1e47a44cb5 req-ac47e6d9-c560-4e1d-8fad-8e6ed10d1393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "name": "network-vif-deleted", "tag": "8031bb99-e01d-435c-86af-766fd0b45f7c"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:03:50.918458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-47bee399-73f0-42f3-966f-ee1e47a44cb5 req-ac47e6d9-c560-4e1d-8fad-8e6ed10d1393 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:50.921329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-6662ddb4-bbff-43b1-8786-8ab73d5ddc43 req-1228ebea-efe2-4682-9ae4-fac408fa42e8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:50.922565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-6662ddb4-bbff-43b1-8786-8ab73d5ddc43 req-1228ebea-efe2-4682-9ae4-fac408fa42e8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:50.926892 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-47bee399-73f0-42f3-966f-ee1e47a44cb5 req-ac47e6d9-c560-4e1d-8fad-8e6ed10d1393 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:50.972751 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-6662ddb4-bbff-43b1-8786-8ab73d5ddc43 req-1228ebea-efe2-4682-9ae4-fac408fa42e8 service nova] Creating event network-vif-unplugged:01a910c0-bb8d-4131-b876-19533c7842f6 for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 05:03:50.979605 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-47bee399-73f0-42f3-966f-ee1e47a44cb5 req-ac47e6d9-c560-4e1d-8fad-8e6ed10d1393 service nova] Creating event network-vif-deleted:8031bb99-e01d-435c-86af-766fd0b45f7c for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 05:03:50.987336 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-6662ddb4-bbff-43b1-8786-8ab73d5ddc43 req-1228ebea-efe2-4682-9ae4-fac408fa42e8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156579 May 28 05:03:51.010291 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-47bee399-73f0-42f3-966f-ee1e47a44cb5 req-ac47e6d9-c560-4e1d-8fad-8e6ed10d1393 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132676 May 28 05:03:51.010921 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2844/5799] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:03:51.013448 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2956/5800] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:03:51.580678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-252393ff-6aee-4b46-9ae1-feaa3b81a511 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:51.581380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-252393ff-6aee-4b46-9ae1-feaa3b81a511 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:51.605095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-252393ff-6aee-4b46-9ae1-feaa3b81a511 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:51.605568 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-252393ff-6aee-4b46-9ae1-feaa3b81a511 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:51.606360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-252393ff-6aee-4b46-9ae1-feaa3b81a511 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:51.606805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-252393ff-6aee-4b46-9ae1-feaa3b81a511 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:52.113050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-252393ff-6aee-4b46-9ae1-feaa3b81a511 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:52.142255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-252393ff-6aee-4b46-9ae1-feaa3b81a511 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:52.165361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-252393ff-6aee-4b46-9ae1-feaa3b81a511 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:52.170089 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-252393ff-6aee-4b46-9ae1-feaa3b81a511 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 2369 microversion: 2.32 time: 0.593925 May 28 05:03:52.187408 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2845/5801] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:03:51 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 2369 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:03:53.110511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-1c637ffd-e05a-4661-8150-fc21e79178e6 req-3e30cd1c-8bbc-4064-bc1d-070aa2ef674d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "name": "network-vif-deleted", "tag": "957dc55b-f873-4efe-bcf8-2621e22f7c67"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:03:53.130800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-1c637ffd-e05a-4661-8150-fc21e79178e6 req-3e30cd1c-8bbc-4064-bc1d-070aa2ef674d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:53.133142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-1c637ffd-e05a-4661-8150-fc21e79178e6 req-3e30cd1c-8bbc-4064-bc1d-070aa2ef674d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:53.157682 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-1c637ffd-e05a-4661-8150-fc21e79178e6 req-3e30cd1c-8bbc-4064-bc1d-070aa2ef674d service nova] Creating event network-vif-deleted:957dc55b-f873-4efe-bcf8-2621e22f7c67 for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 05:03:53.168123 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-1c637ffd-e05a-4661-8150-fc21e79178e6 req-3e30cd1c-8bbc-4064-bc1d-070aa2ef674d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073363 May 28 05:03:53.175440 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2957/5802] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:03:53.193697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-414c4564-4702-4e0f-903e-5f04bef21b31 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:53.194333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-414c4564-4702-4e0f-903e-5f04bef21b31 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:53.221716 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-414c4564-4702-4e0f-903e-5f04bef21b31 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:53.225249 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-414c4564-4702-4e0f-903e-5f04bef21b31 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:53.226197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-414c4564-4702-4e0f-903e-5f04bef21b31 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:53.229854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-414c4564-4702-4e0f-903e-5f04bef21b31 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:53.825247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-414c4564-4702-4e0f-903e-5f04bef21b31 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:53.842264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-414c4564-4702-4e0f-903e-5f04bef21b31 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:53.850423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-414c4564-4702-4e0f-903e-5f04bef21b31 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:53.866141 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-414c4564-4702-4e0f-903e-5f04bef21b31 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 2323 microversion: 2.32 time: 0.670365 May 28 05:03:53.868251 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2846/5803] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:03:53 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 2323 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:03:54.886947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3a3ac597-f4f9-4d0e-922e-19c53f75634c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:54.888402 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3a3ac597-f4f9-4d0e-922e-19c53f75634c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:54.902340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a3ac597-f4f9-4d0e-922e-19c53f75634c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:54.904138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a3ac597-f4f9-4d0e-922e-19c53f75634c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:54.906807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a3ac597-f4f9-4d0e-922e-19c53f75634c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:54.908678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a3ac597-f4f9-4d0e-922e-19c53f75634c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:55.075596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3a3ac597-f4f9-4d0e-922e-19c53f75634c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:55.098626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3a3ac597-f4f9-4d0e-922e-19c53f75634c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:55.100715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3a3ac597-f4f9-4d0e-922e-19c53f75634c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:55.111302 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3a3ac597-f4f9-4d0e-922e-19c53f75634c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 2142 microversion: 2.32 time: 0.228469 May 28 05:03:55.124170 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2958/5804] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:03:54 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 2142 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:03:55.287611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-c246c9a7-c36a-4fdb-ae33-7d0509d2968e req-8fafd2b6-afc8-4049-a2b1-12caa8189fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "name": "network-vif-deleted", "tag": "6ee64452-58e9-4d01-9ea8-79160a3e1c92"}, {"server_uuid": "abd212dc-4ad7-49ff-add2-fb073ee8c3ce", "name": "network-vif-deleted", "tag": "01a910c0-bb8d-4131-b876-19533c7842f6"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:03:55.304187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c246c9a7-c36a-4fdb-ae33-7d0509d2968e req-8fafd2b6-afc8-4049-a2b1-12caa8189fc5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:55.313701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c246c9a7-c36a-4fdb-ae33-7d0509d2968e req-8fafd2b6-afc8-4049-a2b1-12caa8189fc5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:55.327600 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-c246c9a7-c36a-4fdb-ae33-7d0509d2968e req-8fafd2b6-afc8-4049-a2b1-12caa8189fc5 service nova] Creating event network-vif-deleted:6ee64452-58e9-4d01-9ea8-79160a3e1c92 for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 05:03:55.328338 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-c246c9a7-c36a-4fdb-ae33-7d0509d2968e req-8fafd2b6-afc8-4049-a2b1-12caa8189fc5 service nova] Creating event network-vif-deleted:01a910c0-bb8d-4131-b876-19533c7842f6 for instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce on n-h2-843700-1 May 28 05:03:55.335026 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-c246c9a7-c36a-4fdb-ae33-7d0509d2968e req-8fafd2b6-afc8-4049-a2b1-12caa8189fc5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052155 May 28 05:03:55.336476 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2847/5805] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:03:56.133080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7bb7171d-3592-47c0-a330-e382b9c6ea1e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:56.134279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7bb7171d-3592-47c0-a330-e382b9c6ea1e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:56.150905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7bb7171d-3592-47c0-a330-e382b9c6ea1e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:56.151393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7bb7171d-3592-47c0-a330-e382b9c6ea1e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:56.152193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7bb7171d-3592-47c0-a330-e382b9c6ea1e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:56.154893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7bb7171d-3592-47c0-a330-e382b9c6ea1e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:56.344626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7bb7171d-3592-47c0-a330-e382b9c6ea1e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:56.358577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7bb7171d-3592-47c0-a330-e382b9c6ea1e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:56.364217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7bb7171d-3592-47c0-a330-e382b9c6ea1e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:56.369533 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7bb7171d-3592-47c0-a330-e382b9c6ea1e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.238418 May 28 05:03:56.370708 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2959/5806] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:03:56 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:03:57.395167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0434226e-e56c-47ce-8eea-d5bbc72871ed tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:57.395886 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0434226e-e56c-47ce-8eea-d5bbc72871ed tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:57.415860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0434226e-e56c-47ce-8eea-d5bbc72871ed tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:57.416323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0434226e-e56c-47ce-8eea-d5bbc72871ed tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:57.417117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0434226e-e56c-47ce-8eea-d5bbc72871ed tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:57.417562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0434226e-e56c-47ce-8eea-d5bbc72871ed tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:57.580109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0434226e-e56c-47ce-8eea-d5bbc72871ed tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:57.603724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0434226e-e56c-47ce-8eea-d5bbc72871ed tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:57.605580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0434226e-e56c-47ce-8eea-d5bbc72871ed tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:57.608769 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0434226e-e56c-47ce-8eea-d5bbc72871ed tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.219200 May 28 05:03:57.610443 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2848/5807] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:03:57 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:03:58.627451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-98e73c7d-0a6d-490a-adf9-9845fa9b7a15 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:58.627961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-98e73c7d-0a6d-490a-adf9-9845fa9b7a15 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:58.643005 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-98e73c7d-0a6d-490a-adf9-9845fa9b7a15 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:58.645736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-98e73c7d-0a6d-490a-adf9-9845fa9b7a15 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:58.648832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-98e73c7d-0a6d-490a-adf9-9845fa9b7a15 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:58.649435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-98e73c7d-0a6d-490a-adf9-9845fa9b7a15 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:58.793008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-98e73c7d-0a6d-490a-adf9-9845fa9b7a15 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:58.802377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-98e73c7d-0a6d-490a-adf9-9845fa9b7a15 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:58.803910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-98e73c7d-0a6d-490a-adf9-9845fa9b7a15 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:03:58.805093 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-98e73c7d-0a6d-490a-adf9-9845fa9b7a15 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.181602 May 28 05:03:58.816040 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2960/5808] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:03:58 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:03:59.830791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2ed39f83-6b0d-46e8-9018-9f0405722a5e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:03:59.832641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2ed39f83-6b0d-46e8-9018-9f0405722a5e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:03:59.850858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2ed39f83-6b0d-46e8-9018-9f0405722a5e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:59.851701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2ed39f83-6b0d-46e8-9018-9f0405722a5e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:03:59.862571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2ed39f83-6b0d-46e8-9018-9f0405722a5e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:03:59.866973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2ed39f83-6b0d-46e8-9018-9f0405722a5e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:00.096457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2ed39f83-6b0d-46e8-9018-9f0405722a5e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:00.107877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2ed39f83-6b0d-46e8-9018-9f0405722a5e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:00.124436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2ed39f83-6b0d-46e8-9018-9f0405722a5e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:00.143853 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2ed39f83-6b0d-46e8-9018-9f0405722a5e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.322972 May 28 05:04:00.160125 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2849/5809] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:03:59 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:01.165990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7e0f1386-a32b-4c93-8785-d74b7ffc7aaf tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:01.166533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7e0f1386-a32b-4c93-8785-d74b7ffc7aaf tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:01.178318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e0f1386-a32b-4c93-8785-d74b7ffc7aaf tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:01.182173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e0f1386-a32b-4c93-8785-d74b7ffc7aaf tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:01.183206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e0f1386-a32b-4c93-8785-d74b7ffc7aaf tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:01.187583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e0f1386-a32b-4c93-8785-d74b7ffc7aaf tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:01.359264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7e0f1386-a32b-4c93-8785-d74b7ffc7aaf tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:01.374062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7e0f1386-a32b-4c93-8785-d74b7ffc7aaf tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:01.375897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7e0f1386-a32b-4c93-8785-d74b7ffc7aaf tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:01.388605 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7e0f1386-a32b-4c93-8785-d74b7ffc7aaf tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.227075 May 28 05:04:01.400088 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2961/5810] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:01 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:01.422439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-54062ee5-d1e8-4389-91e4-e90218257f10 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:01.423583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-54062ee5-d1e8-4389-91e4-e90218257f10 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:01.433971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54062ee5-d1e8-4389-91e4-e90218257f10 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:01.439645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54062ee5-d1e8-4389-91e4-e90218257f10 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:01.440802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54062ee5-d1e8-4389-91e4-e90218257f10 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:01.442120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54062ee5-d1e8-4389-91e4-e90218257f10 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:01.584830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-54062ee5-d1e8-4389-91e4-e90218257f10 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lazy-loading 'services' on Instance uuid 3b28a05b-9b15-4b95-995f-88592e01319e {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:04:01.854716 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-54062ee5-d1e8-4389-91e4-e90218257f10 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e/os-volume_attachments/e5a13890-3300-41e5-a21a-610fe13abe33" status: 202 len: 0 microversion: 2.1 time: 0.435793 May 28 05:04:01.862755 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2850/5811] 10.222.0.58 () {58 vars in 1415 bytes} [Sat May 28 05:04:01 2022] DELETE /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e/os-volume_attachments/e5a13890-3300-41e5-a21a-610fe13abe33 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:04:02.407654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7fb45346-21aa-43e9-b106-5050590e4ae5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:02.408413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7fb45346-21aa-43e9-b106-5050590e4ae5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:02.426424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fb45346-21aa-43e9-b106-5050590e4ae5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:02.426882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fb45346-21aa-43e9-b106-5050590e4ae5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:02.432622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fb45346-21aa-43e9-b106-5050590e4ae5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:02.433028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fb45346-21aa-43e9-b106-5050590e4ae5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:02.591712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7fb45346-21aa-43e9-b106-5050590e4ae5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:02.608478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7fb45346-21aa-43e9-b106-5050590e4ae5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:02.610721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7fb45346-21aa-43e9-b106-5050590e4ae5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:02.616382 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7fb45346-21aa-43e9-b106-5050590e4ae5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.213416 May 28 05:04:02.629715 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2962/5812] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:02 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:03.638912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3410d8a0-51e1-4447-bd6b-eeb31af0615b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:03.638912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3410d8a0-51e1-4447-bd6b-eeb31af0615b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:03.659382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3410d8a0-51e1-4447-bd6b-eeb31af0615b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:03.660858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3410d8a0-51e1-4447-bd6b-eeb31af0615b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:03.662107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3410d8a0-51e1-4447-bd6b-eeb31af0615b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:03.664607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3410d8a0-51e1-4447-bd6b-eeb31af0615b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:03.926642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3410d8a0-51e1-4447-bd6b-eeb31af0615b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:03.943681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3410d8a0-51e1-4447-bd6b-eeb31af0615b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:03.946971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3410d8a0-51e1-4447-bd6b-eeb31af0615b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:03.951343 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3410d8a0-51e1-4447-bd6b-eeb31af0615b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.319309 May 28 05:04:03.965105 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2851/5813] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:03 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:04.975832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8918832d-c024-4984-ae41-8d95cc012f5c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:04.977716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8918832d-c024-4984-ae41-8d95cc012f5c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:04.988769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8918832d-c024-4984-ae41-8d95cc012f5c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:04.989553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8918832d-c024-4984-ae41-8d95cc012f5c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:04.990704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8918832d-c024-4984-ae41-8d95cc012f5c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:04.991447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8918832d-c024-4984-ae41-8d95cc012f5c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:05.112685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8918832d-c024-4984-ae41-8d95cc012f5c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:05.133703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8918832d-c024-4984-ae41-8d95cc012f5c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:05.144081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8918832d-c024-4984-ae41-8d95cc012f5c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:05.149301 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8918832d-c024-4984-ae41-8d95cc012f5c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.180171 May 28 05:04:05.151586 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2963/5814] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:04 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:06.173047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-19f737d1-ada4-448f-8aec-cc7e18bdbc20 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:06.173856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-19f737d1-ada4-448f-8aec-cc7e18bdbc20 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:06.187405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-19f737d1-ada4-448f-8aec-cc7e18bdbc20 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:06.188011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-19f737d1-ada4-448f-8aec-cc7e18bdbc20 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:06.192603 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-19f737d1-ada4-448f-8aec-cc7e18bdbc20 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:06.193464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-19f737d1-ada4-448f-8aec-cc7e18bdbc20 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:06.480403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-19f737d1-ada4-448f-8aec-cc7e18bdbc20 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:06.493759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-19f737d1-ada4-448f-8aec-cc7e18bdbc20 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:06.495654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-19f737d1-ada4-448f-8aec-cc7e18bdbc20 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:06.497711 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-19f737d1-ada4-448f-8aec-cc7e18bdbc20 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.329194 May 28 05:04:06.500638 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2852/5815] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:06 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:07.518080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ba5c5c3e-6e78-4166-a7fc-62194ee9634e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:07.519701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ba5c5c3e-6e78-4166-a7fc-62194ee9634e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:07.537054 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba5c5c3e-6e78-4166-a7fc-62194ee9634e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:07.537584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba5c5c3e-6e78-4166-a7fc-62194ee9634e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:07.538442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba5c5c3e-6e78-4166-a7fc-62194ee9634e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:07.538890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba5c5c3e-6e78-4166-a7fc-62194ee9634e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:07.679206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ba5c5c3e-6e78-4166-a7fc-62194ee9634e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:07.689431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ba5c5c3e-6e78-4166-a7fc-62194ee9634e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:07.691788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ba5c5c3e-6e78-4166-a7fc-62194ee9634e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:07.694057 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ba5c5c3e-6e78-4166-a7fc-62194ee9634e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.180033 May 28 05:04:07.695274 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2964/5816] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:07 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:08.715071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f2d4bf64-ca02-4e0b-ba38-d0b52faa8cd0 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:08.715700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f2d4bf64-ca02-4e0b-ba38-d0b52faa8cd0 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:08.722836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2d4bf64-ca02-4e0b-ba38-d0b52faa8cd0 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:08.723357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2d4bf64-ca02-4e0b-ba38-d0b52faa8cd0 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:08.724142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2d4bf64-ca02-4e0b-ba38-d0b52faa8cd0 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:08.724577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2d4bf64-ca02-4e0b-ba38-d0b52faa8cd0 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:08.850165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f2d4bf64-ca02-4e0b-ba38-d0b52faa8cd0 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:08.861564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f2d4bf64-ca02-4e0b-ba38-d0b52faa8cd0 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:08.863657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f2d4bf64-ca02-4e0b-ba38-d0b52faa8cd0 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:08.871090 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f2d4bf64-ca02-4e0b-ba38-d0b52faa8cd0 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.159885 May 28 05:04:08.872278 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2853/5817] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:08 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:09.895387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9700758e-f7cb-430e-8104-02e765e8aa87 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:09.896714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9700758e-f7cb-430e-8104-02e765e8aa87 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:09.900083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:04:09.906580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9700758e-f7cb-430e-8104-02e765e8aa87 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:09.907568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9700758e-f7cb-430e-8104-02e765e8aa87 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:09.909818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9700758e-f7cb-430e-8104-02e765e8aa87 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:09.910540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9700758e-f7cb-430e-8104-02e765e8aa87 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:10.001544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9700758e-f7cb-430e-8104-02e765e8aa87 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:10.012876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9700758e-f7cb-430e-8104-02e765e8aa87 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:10.014605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9700758e-f7cb-430e-8104-02e765e8aa87 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:10.016028 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9700758e-f7cb-430e-8104-02e765e8aa87 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.126280 May 28 05:04:10.017136 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2965/5818] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:09 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:11.033977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c56e0203-7f69-4e75-9f4c-8c634dbefc9c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:11.034795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c56e0203-7f69-4e75-9f4c-8c634dbefc9c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:11.037867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=33 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:04:11.052957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c56e0203-7f69-4e75-9f4c-8c634dbefc9c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:11.053495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c56e0203-7f69-4e75-9f4c-8c634dbefc9c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:11.054312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c56e0203-7f69-4e75-9f4c-8c634dbefc9c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:11.054767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c56e0203-7f69-4e75-9f4c-8c634dbefc9c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:11.063442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:04:11.145393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c56e0203-7f69-4e75-9f4c-8c634dbefc9c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:11.175938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c56e0203-7f69-4e75-9f4c-8c634dbefc9c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:11.179745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c56e0203-7f69-4e75-9f4c-8c634dbefc9c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:11.182285 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c56e0203-7f69-4e75-9f4c-8c634dbefc9c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.152350 May 28 05:04:11.183668 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2854/5819] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:11 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:12.203257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-90fd3b86-28f4-42c9-8d59-71b766e16d56 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:12.204800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-90fd3b86-28f4-42c9-8d59-71b766e16d56 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:12.227264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90fd3b86-28f4-42c9-8d59-71b766e16d56 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:12.235877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90fd3b86-28f4-42c9-8d59-71b766e16d56 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:12.241671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90fd3b86-28f4-42c9-8d59-71b766e16d56 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:12.246846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90fd3b86-28f4-42c9-8d59-71b766e16d56 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:12.250904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:04:12.339176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-90fd3b86-28f4-42c9-8d59-71b766e16d56 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:12.352425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-90fd3b86-28f4-42c9-8d59-71b766e16d56 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:12.354275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-90fd3b86-28f4-42c9-8d59-71b766e16d56 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:12.355563 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-90fd3b86-28f4-42c9-8d59-71b766e16d56 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.157824 May 28 05:04:12.368164 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2966/5820] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:12 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:13.375261 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cfd4af7f-3179-40c3-8dd8-4cf7b42059ab tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:13.376465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cfd4af7f-3179-40c3-8dd8-4cf7b42059ab tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:13.391566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfd4af7f-3179-40c3-8dd8-4cf7b42059ab tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:13.400545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfd4af7f-3179-40c3-8dd8-4cf7b42059ab tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:13.402657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfd4af7f-3179-40c3-8dd8-4cf7b42059ab tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:13.403679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfd4af7f-3179-40c3-8dd8-4cf7b42059ab tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:13.523742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cfd4af7f-3179-40c3-8dd8-4cf7b42059ab tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:13.537917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cfd4af7f-3179-40c3-8dd8-4cf7b42059ab tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:13.539740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cfd4af7f-3179-40c3-8dd8-4cf7b42059ab tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:13.541889 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cfd4af7f-3179-40c3-8dd8-4cf7b42059ab tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.171528 May 28 05:04:13.543117 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2855/5821] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:13 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:14.560907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8031380a-4b86-44b0-b535-a40210aff95a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:14.562082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8031380a-4b86-44b0-b535-a40210aff95a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:14.570125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8031380a-4b86-44b0-b535-a40210aff95a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:14.570771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8031380a-4b86-44b0-b535-a40210aff95a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:14.571727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8031380a-4b86-44b0-b535-a40210aff95a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:14.572311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8031380a-4b86-44b0-b535-a40210aff95a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:14.656272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8031380a-4b86-44b0-b535-a40210aff95a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:14.668102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8031380a-4b86-44b0-b535-a40210aff95a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:14.669632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8031380a-4b86-44b0-b535-a40210aff95a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:14.671151 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8031380a-4b86-44b0-b535-a40210aff95a tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.114357 May 28 05:04:14.671725 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2967/5822] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:14 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:15.689844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9d4b1dbc-4b3e-4693-b93e-1ddf782af0db tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:15.690515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9d4b1dbc-4b3e-4693-b93e-1ddf782af0db tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:15.697722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d4b1dbc-4b3e-4693-b93e-1ddf782af0db tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:15.698349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d4b1dbc-4b3e-4693-b93e-1ddf782af0db tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:15.699291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d4b1dbc-4b3e-4693-b93e-1ddf782af0db tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:15.699915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d4b1dbc-4b3e-4693-b93e-1ddf782af0db tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:15.777283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9d4b1dbc-4b3e-4693-b93e-1ddf782af0db tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:15.787228 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9d4b1dbc-4b3e-4693-b93e-1ddf782af0db tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:15.788856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9d4b1dbc-4b3e-4693-b93e-1ddf782af0db tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:15.790045 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9d4b1dbc-4b3e-4693-b93e-1ddf782af0db tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.104235 May 28 05:04:15.790616 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2856/5823] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:15 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:16.809575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d7094f88-43d7-4f66-979f-acea2cb08b11 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:16.810671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d7094f88-43d7-4f66-979f-acea2cb08b11 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:16.819536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7094f88-43d7-4f66-979f-acea2cb08b11 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:16.820210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7094f88-43d7-4f66-979f-acea2cb08b11 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:16.821323 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7094f88-43d7-4f66-979f-acea2cb08b11 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:16.822096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7094f88-43d7-4f66-979f-acea2cb08b11 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:16.889771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d7094f88-43d7-4f66-979f-acea2cb08b11 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:16.899818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d7094f88-43d7-4f66-979f-acea2cb08b11 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:16.901590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d7094f88-43d7-4f66-979f-acea2cb08b11 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:16.902967 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d7094f88-43d7-4f66-979f-acea2cb08b11 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.097624 May 28 05:04:16.903571 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2968/5824] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:16 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:17.924158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-41102c2b-2677-40c3-b4aa-139b32d94e90 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:17.926059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-41102c2b-2677-40c3-b4aa-139b32d94e90 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:17.935742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41102c2b-2677-40c3-b4aa-139b32d94e90 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:17.936605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41102c2b-2677-40c3-b4aa-139b32d94e90 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:17.937618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41102c2b-2677-40c3-b4aa-139b32d94e90 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:17.938294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41102c2b-2677-40c3-b4aa-139b32d94e90 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:18.021301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-41102c2b-2677-40c3-b4aa-139b32d94e90 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:18.036313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-41102c2b-2677-40c3-b4aa-139b32d94e90 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:18.038297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-41102c2b-2677-40c3-b4aa-139b32d94e90 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:18.040682 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-41102c2b-2677-40c3-b4aa-139b32d94e90 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.122496 May 28 05:04:18.059207 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2857/5825] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:17 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:19.067062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f939eee4-2483-48e4-90a5-58262dfb3ff2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:19.069190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f939eee4-2483-48e4-90a5-58262dfb3ff2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:19.080225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f939eee4-2483-48e4-90a5-58262dfb3ff2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:19.080936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f939eee4-2483-48e4-90a5-58262dfb3ff2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:19.082050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f939eee4-2483-48e4-90a5-58262dfb3ff2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:19.082961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f939eee4-2483-48e4-90a5-58262dfb3ff2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:19.197250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f939eee4-2483-48e4-90a5-58262dfb3ff2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:19.211082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f939eee4-2483-48e4-90a5-58262dfb3ff2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:19.213391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f939eee4-2483-48e4-90a5-58262dfb3ff2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:19.215040 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f939eee4-2483-48e4-90a5-58262dfb3ff2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.153066 May 28 05:04:19.224191 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2969/5826] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:19 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:20.237842 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a1772bf4-34f9-4213-a56a-56657b9c6f2e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:20.246932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a1772bf4-34f9-4213-a56a-56657b9c6f2e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:20.258146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1772bf4-34f9-4213-a56a-56657b9c6f2e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:20.258604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1772bf4-34f9-4213-a56a-56657b9c6f2e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:20.259428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1772bf4-34f9-4213-a56a-56657b9c6f2e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:20.259875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1772bf4-34f9-4213-a56a-56657b9c6f2e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:20.354658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a1772bf4-34f9-4213-a56a-56657b9c6f2e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:20.368524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a1772bf4-34f9-4213-a56a-56657b9c6f2e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:20.370121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a1772bf4-34f9-4213-a56a-56657b9c6f2e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:20.371382 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a1772bf4-34f9-4213-a56a-56657b9c6f2e tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.139425 May 28 05:04:20.372081 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2858/5827] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:20 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:20.849913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-58588cc7-8bdc-4493-ad2c-9e22b4608ca3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:04:20.858095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58588cc7-8bdc-4493-ad2c-9e22b4608ca3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:20.859765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58588cc7-8bdc-4493-ad2c-9e22b4608ca3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:20.888462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-58588cc7-8bdc-4493-ad2c-9e22b4608ca3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Going to try to stop instance {{(pid=126044) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 05:04:21.139593 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-58588cc7-8bdc-4493-ad2c-9e22b4608ca3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "POST /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e/action" status: 202 len: 0 microversion: 2.1 time: 0.293553 May 28 05:04:21.140774 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2970/5828] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:04:20 2022] POST /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:04:21.150032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6f7c5c05-d9d3-4b6d-a480-84f06be77c11 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:21.150934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6f7c5c05-d9d3-4b6d-a480-84f06be77c11 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:21.160207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f7c5c05-d9d3-4b6d-a480-84f06be77c11 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:21.165288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f7c5c05-d9d3-4b6d-a480-84f06be77c11 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:21.165288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f7c5c05-d9d3-4b6d-a480-84f06be77c11 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:21.165288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f7c5c05-d9d3-4b6d-a480-84f06be77c11 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:21.392165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d67d7b3e-31e0-4a80-a8b3-96319df73c09 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:21.393133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d67d7b3e-31e0-4a80-a8b3-96319df73c09 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:21.405348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d67d7b3e-31e0-4a80-a8b3-96319df73c09 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:21.405550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6f7c5c05-d9d3-4b6d-a480-84f06be77c11 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:21.407923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d67d7b3e-31e0-4a80-a8b3-96319df73c09 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:21.412154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d67d7b3e-31e0-4a80-a8b3-96319df73c09 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:21.412154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d67d7b3e-31e0-4a80-a8b3-96319df73c09 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:21.422068 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6f7c5c05-d9d3-4b6d-a480-84f06be77c11 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1676 microversion: 2.1 time: 0.276853 May 28 05:04:21.427154 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2859/5829] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:04:21 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1676 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:04:21.552290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d67d7b3e-31e0-4a80-a8b3-96319df73c09 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:21.564622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d67d7b3e-31e0-4a80-a8b3-96319df73c09 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:21.567597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d67d7b3e-31e0-4a80-a8b3-96319df73c09 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:21.569187 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d67d7b3e-31e0-4a80-a8b3-96319df73c09 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.181776 May 28 05:04:21.570820 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2971/5830] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:21 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:04:22.444761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7d74fae7-0834-434c-b905-074c29e26836 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:22.446218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7d74fae7-0834-434c-b905-074c29e26836 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:22.461571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d74fae7-0834-434c-b905-074c29e26836 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:22.464644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d74fae7-0834-434c-b905-074c29e26836 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:22.467895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d74fae7-0834-434c-b905-074c29e26836 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:22.468601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d74fae7-0834-434c-b905-074c29e26836 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:22.589309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4d72820d-cf58-4c60-98e1-d05889dd8413 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:22.590008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4d72820d-cf58-4c60-98e1-d05889dd8413 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:22.614539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d72820d-cf58-4c60-98e1-d05889dd8413 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:22.615271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d72820d-cf58-4c60-98e1-d05889dd8413 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:22.622007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d72820d-cf58-4c60-98e1-d05889dd8413 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:22.623882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d72820d-cf58-4c60-98e1-d05889dd8413 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:22.828668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4d72820d-cf58-4c60-98e1-d05889dd8413 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:22.860405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4d72820d-cf58-4c60-98e1-d05889dd8413 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:22.865909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4d72820d-cf58-4c60-98e1-d05889dd8413 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:22.870255 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4d72820d-cf58-4c60-98e1-d05889dd8413 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.285174 May 28 05:04:22.884650 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2972/5831] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:22 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:04:22.922399 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7d74fae7-0834-434c-b905-074c29e26836 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:22.931581 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7d74fae7-0834-434c-b905-074c29e26836 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1676 microversion: 2.1 time: 0.491962 May 28 05:04:22.937070 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2860/5832] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:04:22 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1676 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:04:23.898342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b2e985f7-341d-4f17-807e-728d81210e18 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:23.901416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b2e985f7-341d-4f17-807e-728d81210e18 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:23.921942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b2e985f7-341d-4f17-807e-728d81210e18 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:23.922646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b2e985f7-341d-4f17-807e-728d81210e18 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:23.924663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b2e985f7-341d-4f17-807e-728d81210e18 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:23.928910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b2e985f7-341d-4f17-807e-728d81210e18 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:23.956466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8783413a-9210-4b7a-a39c-8d4f66ecc9d9 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:23.958096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8783413a-9210-4b7a-a39c-8d4f66ecc9d9 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:23.976009 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8783413a-9210-4b7a-a39c-8d4f66ecc9d9 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:23.982843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8783413a-9210-4b7a-a39c-8d4f66ecc9d9 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:23.986182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8783413a-9210-4b7a-a39c-8d4f66ecc9d9 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:23.986597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8783413a-9210-4b7a-a39c-8d4f66ecc9d9 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:24.330705 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b2e985f7-341d-4f17-807e-728d81210e18 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:24.340697 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b2e985f7-341d-4f17-807e-728d81210e18 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:24.347645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b2e985f7-341d-4f17-807e-728d81210e18 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:24.351421 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b2e985f7-341d-4f17-807e-728d81210e18 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.463897 May 28 05:04:24.365226 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2973/5833] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:23 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:24.434581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8783413a-9210-4b7a-a39c-8d4f66ecc9d9 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:24.443373 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8783413a-9210-4b7a-a39c-8d4f66ecc9d9 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1676 microversion: 2.1 time: 0.493146 May 28 05:04:24.449179 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2861/5834] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:04:23 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1676 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:04:25.371603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1479fd56-ff72-45cb-95ed-03cca0669e1c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:25.373394 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1479fd56-ff72-45cb-95ed-03cca0669e1c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:25.389376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1479fd56-ff72-45cb-95ed-03cca0669e1c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:25.390161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1479fd56-ff72-45cb-95ed-03cca0669e1c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:25.391313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1479fd56-ff72-45cb-95ed-03cca0669e1c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:25.391950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1479fd56-ff72-45cb-95ed-03cca0669e1c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:25.461073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5c87e1bc-aeac-4eb5-b8fe-57aeebedcfee tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:25.463270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5c87e1bc-aeac-4eb5-b8fe-57aeebedcfee tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:25.476540 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c87e1bc-aeac-4eb5-b8fe-57aeebedcfee tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:25.483539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c87e1bc-aeac-4eb5-b8fe-57aeebedcfee tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:25.484420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c87e1bc-aeac-4eb5-b8fe-57aeebedcfee tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:25.485050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c87e1bc-aeac-4eb5-b8fe-57aeebedcfee tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:25.548884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1479fd56-ff72-45cb-95ed-03cca0669e1c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:25.561723 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1479fd56-ff72-45cb-95ed-03cca0669e1c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:25.566856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1479fd56-ff72-45cb-95ed-03cca0669e1c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:25.568419 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1479fd56-ff72-45cb-95ed-03cca0669e1c tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.202579 May 28 05:04:25.569574 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2974/5835] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:25 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:04:25.773061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5c87e1bc-aeac-4eb5-b8fe-57aeebedcfee tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:25.783570 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5c87e1bc-aeac-4eb5-b8fe-57aeebedcfee tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1676 microversion: 2.1 time: 0.326563 May 28 05:04:25.785639 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2862/5836] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:04:25 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1676 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:04:26.592792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ffaadd4d-d1ee-4f28-9e42-7cd9359fb358 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:26.595531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ffaadd4d-d1ee-4f28-9e42-7cd9359fb358 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:26.608897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ffaadd4d-d1ee-4f28-9e42-7cd9359fb358 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:26.611678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ffaadd4d-d1ee-4f28-9e42-7cd9359fb358 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:26.616516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ffaadd4d-d1ee-4f28-9e42-7cd9359fb358 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:26.617454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ffaadd4d-d1ee-4f28-9e42-7cd9359fb358 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:26.811853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-061f9d6a-96d1-4596-8a9b-2f2f798f24ab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:26.813135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-061f9d6a-96d1-4596-8a9b-2f2f798f24ab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:26.828684 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-061f9d6a-96d1-4596-8a9b-2f2f798f24ab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:26.829150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-061f9d6a-96d1-4596-8a9b-2f2f798f24ab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:26.832912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-061f9d6a-96d1-4596-8a9b-2f2f798f24ab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:26.833387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-061f9d6a-96d1-4596-8a9b-2f2f798f24ab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:26.884121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ffaadd4d-d1ee-4f28-9e42-7cd9359fb358 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:26.902280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ffaadd4d-d1ee-4f28-9e42-7cd9359fb358 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:26.907937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ffaadd4d-d1ee-4f28-9e42-7cd9359fb358 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:26.911516 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ffaadd4d-d1ee-4f28-9e42-7cd9359fb358 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.326590 May 28 05:04:26.912446 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2975/5837] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:26 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:27.244898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-061f9d6a-96d1-4596-8a9b-2f2f798f24ab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:27.263996 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-061f9d6a-96d1-4596-8a9b-2f2f798f24ab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1676 microversion: 2.1 time: 0.458934 May 28 05:04:27.264922 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2863/5838] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:04:26 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1676 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:04:27.931126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-53d9ef02-90ef-430f-80a5-5bfee5e5de6f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:27.932963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-53d9ef02-90ef-430f-80a5-5bfee5e5de6f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:27.942277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53d9ef02-90ef-430f-80a5-5bfee5e5de6f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:27.943025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53d9ef02-90ef-430f-80a5-5bfee5e5de6f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:27.944978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53d9ef02-90ef-430f-80a5-5bfee5e5de6f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:27.945597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-53d9ef02-90ef-430f-80a5-5bfee5e5de6f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:28.109331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-53d9ef02-90ef-430f-80a5-5bfee5e5de6f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:28.126913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-53d9ef02-90ef-430f-80a5-5bfee5e5de6f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:28.134909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-53d9ef02-90ef-430f-80a5-5bfee5e5de6f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:28.137485 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-53d9ef02-90ef-430f-80a5-5bfee5e5de6f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.211172 May 28 05:04:28.141736 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2976/5839] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:27 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:28.281990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-df7f98e4-98c3-402a-837a-a4fe0c23b54e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:28.282776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-df7f98e4-98c3-402a-837a-a4fe0c23b54e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:28.296530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df7f98e4-98c3-402a-837a-a4fe0c23b54e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:28.299061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df7f98e4-98c3-402a-837a-a4fe0c23b54e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:28.314955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df7f98e4-98c3-402a-837a-a4fe0c23b54e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:28.316165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df7f98e4-98c3-402a-837a-a4fe0c23b54e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:28.705319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-df7f98e4-98c3-402a-837a-a4fe0c23b54e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:28.721100 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-df7f98e4-98c3-402a-837a-a4fe0c23b54e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1676 microversion: 2.1 time: 0.443114 May 28 05:04:28.727635 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2864/5840] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:04:28 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1676 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:04:29.161986 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a96084d7-ab49-4e92-8190-89fddfd3c6d9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:29.162826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a96084d7-ab49-4e92-8190-89fddfd3c6d9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:29.176651 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a96084d7-ab49-4e92-8190-89fddfd3c6d9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:29.178279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a96084d7-ab49-4e92-8190-89fddfd3c6d9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:29.182351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a96084d7-ab49-4e92-8190-89fddfd3c6d9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:29.184082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a96084d7-ab49-4e92-8190-89fddfd3c6d9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:29.359505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a96084d7-ab49-4e92-8190-89fddfd3c6d9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:29.370584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a96084d7-ab49-4e92-8190-89fddfd3c6d9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:29.372562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a96084d7-ab49-4e92-8190-89fddfd3c6d9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:29.374070 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a96084d7-ab49-4e92-8190-89fddfd3c6d9 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.217109 May 28 05:04:29.375729 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2977/5841] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:29 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:29.510416 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:04:29.510870 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 05:04:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:04:29.650296 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:04:29.650494 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 05:04:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:04:29.744090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bb114e19-47bf-45c3-a415-ef783baef0b2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:29.745126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bb114e19-47bf-45c3-a415-ef783baef0b2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:29.763526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb114e19-47bf-45c3-a415-ef783baef0b2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:29.765263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb114e19-47bf-45c3-a415-ef783baef0b2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:29.766137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb114e19-47bf-45c3-a415-ef783baef0b2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:29.769219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb114e19-47bf-45c3-a415-ef783baef0b2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:30.130593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bb114e19-47bf-45c3-a415-ef783baef0b2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:30.139138 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bb114e19-47bf-45c3-a415-ef783baef0b2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1676 microversion: 2.1 time: 0.398802 May 28 05:04:30.142885 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2865/5842] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:04:29 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1676 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:04:30.406416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fd8666d2-fa0d-49ee-855c-e93ec4f38d8b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:30.409672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fd8666d2-fa0d-49ee-855c-e93ec4f38d8b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:30.435454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd8666d2-fa0d-49ee-855c-e93ec4f38d8b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:30.436996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd8666d2-fa0d-49ee-855c-e93ec4f38d8b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:30.440069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd8666d2-fa0d-49ee-855c-e93ec4f38d8b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:30.443478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd8666d2-fa0d-49ee-855c-e93ec4f38d8b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:30.582503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fd8666d2-fa0d-49ee-855c-e93ec4f38d8b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:30.601766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fd8666d2-fa0d-49ee-855c-e93ec4f38d8b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:30.605626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fd8666d2-fa0d-49ee-855c-e93ec4f38d8b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:30.607994 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fd8666d2-fa0d-49ee-855c-e93ec4f38d8b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.217235 May 28 05:04:30.609733 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2978/5843] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:30 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:31.172936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-41488737-1c13-4d19-9ede-8fb367000384 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:31.173454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-41488737-1c13-4d19-9ede-8fb367000384 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:31.199182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41488737-1c13-4d19-9ede-8fb367000384 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:31.220855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41488737-1c13-4d19-9ede-8fb367000384 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:31.224222 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41488737-1c13-4d19-9ede-8fb367000384 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:31.225593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41488737-1c13-4d19-9ede-8fb367000384 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:31.525232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-41488737-1c13-4d19-9ede-8fb367000384 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:31.541129 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-41488737-1c13-4d19-9ede-8fb367000384 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1676 microversion: 2.1 time: 0.385669 May 28 05:04:31.547044 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2866/5844] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:04:31 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1676 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:04:31.630601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-931430e5-faf7-4b69-a300-9bc957247235 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:31.630601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-931430e5-faf7-4b69-a300-9bc957247235 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:31.637745 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-931430e5-faf7-4b69-a300-9bc957247235 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:31.641934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-931430e5-faf7-4b69-a300-9bc957247235 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:31.647686 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-931430e5-faf7-4b69-a300-9bc957247235 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:31.648275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-931430e5-faf7-4b69-a300-9bc957247235 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:31.879608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-931430e5-faf7-4b69-a300-9bc957247235 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:31.912249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-931430e5-faf7-4b69-a300-9bc957247235 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:31.917896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-931430e5-faf7-4b69-a300-9bc957247235 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:31.924086 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-931430e5-faf7-4b69-a300-9bc957247235 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.300880 May 28 05:04:31.926183 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2979/5845] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:31 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:32.494118 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:04:32.498137 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 05:04:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:04:32.560728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8a13e8e1-49bb-4356-af63-2f66cd893bab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:32.561266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8a13e8e1-49bb-4356-af63-2f66cd893bab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:32.578118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a13e8e1-49bb-4356-af63-2f66cd893bab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:32.578648 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a13e8e1-49bb-4356-af63-2f66cd893bab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:32.579502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a13e8e1-49bb-4356-af63-2f66cd893bab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:32.579953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a13e8e1-49bb-4356-af63-2f66cd893bab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:32.930037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8a13e8e1-49bb-4356-af63-2f66cd893bab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:32.945075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-593c5fc2-b9dc-406d-bcb9-7c16ab5e3f55 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:32.945803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-593c5fc2-b9dc-406d-bcb9-7c16ab5e3f55 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:32.948097 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8a13e8e1-49bb-4356-af63-2f66cd893bab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1653 microversion: 2.1 time: 0.389747 May 28 05:04:32.949747 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2867/5846] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:04:32 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1653 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:04:32.956713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-593c5fc2-b9dc-406d-bcb9-7c16ab5e3f55 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:32.957174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-593c5fc2-b9dc-406d-bcb9-7c16ab5e3f55 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:32.964066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-593c5fc2-b9dc-406d-bcb9-7c16ab5e3f55 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:32.964726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-593c5fc2-b9dc-406d-bcb9-7c16ab5e3f55 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:32.965518 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-959202dc-3c9d-4039-9245-1ce8739754e3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:04:32.973622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-959202dc-3c9d-4039-9245-1ce8739754e3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:32.974263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-959202dc-3c9d-4039-9245-1ce8739754e3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:33.011464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-959202dc-3c9d-4039-9245-1ce8739754e3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Going to try to start instance {{(pid=126043) start /opt/stack/nova/nova/compute/api.py:2730}} May 28 05:04:33.254861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-593c5fc2-b9dc-406d-bcb9-7c16ab5e3f55 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:33.267922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-593c5fc2-b9dc-406d-bcb9-7c16ab5e3f55 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:33.276352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-593c5fc2-b9dc-406d-bcb9-7c16ab5e3f55 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:33.280422 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-593c5fc2-b9dc-406d-bcb9-7c16ab5e3f55 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.339368 May 28 05:04:33.294302 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2980/5847] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:32 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:33.349208 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-959202dc-3c9d-4039-9245-1ce8739754e3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "POST /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e/action" status: 202 len: 0 microversion: 2.1 time: 0.388078 May 28 05:04:33.351723 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2868/5848] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:04:32 2022] POST /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:04:33.363356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-069f2ae9-804f-497d-a74b-062396ed2f36 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:33.364045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-069f2ae9-804f-497d-a74b-062396ed2f36 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:33.404172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-069f2ae9-804f-497d-a74b-062396ed2f36 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:33.404762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-069f2ae9-804f-497d-a74b-062396ed2f36 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:33.409077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-069f2ae9-804f-497d-a74b-062396ed2f36 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:33.411614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-069f2ae9-804f-497d-a74b-062396ed2f36 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:33.908253 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:04:33.909333 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 05:04:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e (ip 10.222.0.58) !!! May 28 05:04:34.303149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a5b81dc2-5d78-43dc-a0e2-b6fe2fb11b24 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:34.304019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a5b81dc2-5d78-43dc-a0e2-b6fe2fb11b24 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:34.318717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5b81dc2-5d78-43dc-a0e2-b6fe2fb11b24 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:34.319597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5b81dc2-5d78-43dc-a0e2-b6fe2fb11b24 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:34.323949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5b81dc2-5d78-43dc-a0e2-b6fe2fb11b24 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:34.324627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5b81dc2-5d78-43dc-a0e2-b6fe2fb11b24 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:35.086736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a5b81dc2-5d78-43dc-a0e2-b6fe2fb11b24 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:35.091237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:04:35.170080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-069f2ae9-804f-497d-a74b-062396ed2f36 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:35.202772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:04:35.203267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a5b81dc2-5d78-43dc-a0e2-b6fe2fb11b24 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:35.206894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a5b81dc2-5d78-43dc-a0e2-b6fe2fb11b24 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:35.217543 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-069f2ae9-804f-497d-a74b-062396ed2f36 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1662 microversion: 2.1 time: 1.849611 May 28 05:04:35.217543 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2981/5849] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:04:33 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1662 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:04:35.217749 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a5b81dc2-5d78-43dc-a0e2-b6fe2fb11b24 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.912532 May 28 05:04:35.230406 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2869/5850] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:34 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:04:36.233240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-248465f7-621c-4307-9e08-349fcbf2a267 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:36.234213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-09845520-c665-456a-b802-fd99cf27ff9b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:36.235132 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-09845520-c665-456a-b802-fd99cf27ff9b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:36.240941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-248465f7-621c-4307-9e08-349fcbf2a267 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:36.266381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-248465f7-621c-4307-9e08-349fcbf2a267 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:36.266826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09845520-c665-456a-b802-fd99cf27ff9b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:36.267458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09845520-c665-456a-b802-fd99cf27ff9b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:36.268995 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09845520-c665-456a-b802-fd99cf27ff9b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:36.269536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-248465f7-621c-4307-9e08-349fcbf2a267 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:36.271456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09845520-c665-456a-b802-fd99cf27ff9b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:36.271743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-248465f7-621c-4307-9e08-349fcbf2a267 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:36.274222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-248465f7-621c-4307-9e08-349fcbf2a267 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:36.450544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-09845520-c665-456a-b802-fd99cf27ff9b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:36.467114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-09845520-c665-456a-b802-fd99cf27ff9b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:36.469128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-09845520-c665-456a-b802-fd99cf27ff9b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:36.472364 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-09845520-c665-456a-b802-fd99cf27ff9b tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.246780 May 28 05:04:36.473210 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2870/5851] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:36 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:36.870782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-248465f7-621c-4307-9e08-349fcbf2a267 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:36.879359 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-248465f7-621c-4307-9e08-349fcbf2a267 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1666 microversion: 2.1 time: 0.654207 May 28 05:04:36.882368 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2982/5852] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:04:36 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1666 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:04:37.492875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2b65620a-6dd7-4ba1-9714-432fa6fee2b4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:37.493851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2b65620a-6dd7-4ba1-9714-432fa6fee2b4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:37.516387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b65620a-6dd7-4ba1-9714-432fa6fee2b4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:37.517626 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b65620a-6dd7-4ba1-9714-432fa6fee2b4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:37.518963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b65620a-6dd7-4ba1-9714-432fa6fee2b4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:37.540998 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2b65620a-6dd7-4ba1-9714-432fa6fee2b4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:37.794367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2b65620a-6dd7-4ba1-9714-432fa6fee2b4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:37.814496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2b65620a-6dd7-4ba1-9714-432fa6fee2b4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:37.822910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2b65620a-6dd7-4ba1-9714-432fa6fee2b4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:37.828495 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2b65620a-6dd7-4ba1-9714-432fa6fee2b4 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.340564 May 28 05:04:37.831276 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2871/5853] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:37 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:38.849970 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-50d5d259-98c7-46c2-ac2d-060ef57c3ca7 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:38.850407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-50d5d259-98c7-46c2-ac2d-060ef57c3ca7 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:38.873176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50d5d259-98c7-46c2-ac2d-060ef57c3ca7 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:38.873886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50d5d259-98c7-46c2-ac2d-060ef57c3ca7 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:38.907775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50d5d259-98c7-46c2-ac2d-060ef57c3ca7 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:38.909617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50d5d259-98c7-46c2-ac2d-060ef57c3ca7 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:39.523677 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-50d5d259-98c7-46c2-ac2d-060ef57c3ca7 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:39.552080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-50d5d259-98c7-46c2-ac2d-060ef57c3ca7 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:39.554529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-50d5d259-98c7-46c2-ac2d-060ef57c3ca7 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:39.562021 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-50d5d259-98c7-46c2-ac2d-060ef57c3ca7 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.716670 May 28 05:04:39.565616 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2983/5854] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:38 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:40.583030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1ed0feb1-11f3-465f-b086-dfa59fb599e8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:40.583661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1ed0feb1-11f3-465f-b086-dfa59fb599e8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:40.596756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ed0feb1-11f3-465f-b086-dfa59fb599e8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:40.597469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ed0feb1-11f3-465f-b086-dfa59fb599e8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:40.602615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ed0feb1-11f3-465f-b086-dfa59fb599e8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:40.603285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ed0feb1-11f3-465f-b086-dfa59fb599e8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:41.344596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1ed0feb1-11f3-465f-b086-dfa59fb599e8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:41.356606 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1ed0feb1-11f3-465f-b086-dfa59fb599e8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:41.358139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1ed0feb1-11f3-465f-b086-dfa59fb599e8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:41.359398 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1ed0feb1-11f3-465f-b086-dfa59fb599e8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.780812 May 28 05:04:41.366833 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2872/5855] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:40 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:42.384914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fa13b487-1d18-4acd-b569-f65ebadb9b9f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:42.385537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fa13b487-1d18-4acd-b569-f65ebadb9b9f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:42.389349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=38 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:04:42.393275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa13b487-1d18-4acd-b569-f65ebadb9b9f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:42.393497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa13b487-1d18-4acd-b569-f65ebadb9b9f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:42.394087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa13b487-1d18-4acd-b569-f65ebadb9b9f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:42.394525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa13b487-1d18-4acd-b569-f65ebadb9b9f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:42.526799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fa13b487-1d18-4acd-b569-f65ebadb9b9f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:42.541335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fa13b487-1d18-4acd-b569-f65ebadb9b9f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:42.543197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fa13b487-1d18-4acd-b569-f65ebadb9b9f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:42.544964 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fa13b487-1d18-4acd-b569-f65ebadb9b9f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.166406 May 28 05:04:42.545256 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2984/5856] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:42 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:43.567056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b1eba100-3220-4ae9-98e5-472413796d20 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:43.567833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b1eba100-3220-4ae9-98e5-472413796d20 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:43.575602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=38 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:04:43.598941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b1eba100-3220-4ae9-98e5-472413796d20 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:43.604899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b1eba100-3220-4ae9-98e5-472413796d20 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:43.609045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b1eba100-3220-4ae9-98e5-472413796d20 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:43.610980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b1eba100-3220-4ae9-98e5-472413796d20 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:43.827892 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b1eba100-3220-4ae9-98e5-472413796d20 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:43.854850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b1eba100-3220-4ae9-98e5-472413796d20 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:43.871964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b1eba100-3220-4ae9-98e5-472413796d20 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:43.871964 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b1eba100-3220-4ae9-98e5-472413796d20 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.307126 May 28 05:04:43.872227 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2873/5857] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:43 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:44.890037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b69b8dc9-4e35-4a9f-bd41-5a56bb791d05 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:44.891307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b69b8dc9-4e35-4a9f-bd41-5a56bb791d05 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:44.899302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b69b8dc9-4e35-4a9f-bd41-5a56bb791d05 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:44.899748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b69b8dc9-4e35-4a9f-bd41-5a56bb791d05 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:44.900759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b69b8dc9-4e35-4a9f-bd41-5a56bb791d05 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:44.901203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b69b8dc9-4e35-4a9f-bd41-5a56bb791d05 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:45.015620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b69b8dc9-4e35-4a9f-bd41-5a56bb791d05 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:45.051219 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b69b8dc9-4e35-4a9f-bd41-5a56bb791d05 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:45.056153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b69b8dc9-4e35-4a9f-bd41-5a56bb791d05 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:45.065611 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b69b8dc9-4e35-4a9f-bd41-5a56bb791d05 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.176975 May 28 05:04:45.066476 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2985/5858] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:44 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:46.088547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-751068aa-52f0-4ecd-b4da-c3841bafa7fa tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:46.089337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-751068aa-52f0-4ecd-b4da-c3841bafa7fa tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:46.101960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-751068aa-52f0-4ecd-b4da-c3841bafa7fa tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:46.102419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-751068aa-52f0-4ecd-b4da-c3841bafa7fa tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:46.105981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-751068aa-52f0-4ecd-b4da-c3841bafa7fa tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:46.106467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-751068aa-52f0-4ecd-b4da-c3841bafa7fa tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:46.226207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-751068aa-52f0-4ecd-b4da-c3841bafa7fa tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:46.247969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-751068aa-52f0-4ecd-b4da-c3841bafa7fa tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:46.251533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-751068aa-52f0-4ecd-b4da-c3841bafa7fa tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:46.254234 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-751068aa-52f0-4ecd-b4da-c3841bafa7fa tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.173023 May 28 05:04:46.256696 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2874/5859] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:46 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:47.277528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-30ea0152-bcb8-46ac-b750-ccd2b64c6fb8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:47.281639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-30ea0152-bcb8-46ac-b750-ccd2b64c6fb8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:47.292810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30ea0152-bcb8-46ac-b750-ccd2b64c6fb8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:47.293362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30ea0152-bcb8-46ac-b750-ccd2b64c6fb8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:47.294106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30ea0152-bcb8-46ac-b750-ccd2b64c6fb8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:47.295234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30ea0152-bcb8-46ac-b750-ccd2b64c6fb8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:47.393467 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-30ea0152-bcb8-46ac-b750-ccd2b64c6fb8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:47.412169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-30ea0152-bcb8-46ac-b750-ccd2b64c6fb8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:47.413649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-30ea0152-bcb8-46ac-b750-ccd2b64c6fb8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:47.419482 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-30ea0152-bcb8-46ac-b750-ccd2b64c6fb8 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.141664 May 28 05:04:47.421138 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2986/5860] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:47 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:48.442674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0b7af138-7f86-4049-8076-815f44b91e9f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:48.443543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0b7af138-7f86-4049-8076-815f44b91e9f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:48.467928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b7af138-7f86-4049-8076-815f44b91e9f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:48.468378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b7af138-7f86-4049-8076-815f44b91e9f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:48.473722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b7af138-7f86-4049-8076-815f44b91e9f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:48.474336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b7af138-7f86-4049-8076-815f44b91e9f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:48.657424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0b7af138-7f86-4049-8076-815f44b91e9f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:48.694693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0b7af138-7f86-4049-8076-815f44b91e9f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:48.708110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0b7af138-7f86-4049-8076-815f44b91e9f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:48.710630 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0b7af138-7f86-4049-8076-815f44b91e9f tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.272733 May 28 05:04:48.727950 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2875/5861] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:48 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:49.733498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-379dd674-b8a4-411d-b661-22bc4b163b03 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:49.734158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-379dd674-b8a4-411d-b661-22bc4b163b03 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:49.764374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-379dd674-b8a4-411d-b661-22bc4b163b03 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:49.764374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-379dd674-b8a4-411d-b661-22bc4b163b03 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:49.769020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-379dd674-b8a4-411d-b661-22bc4b163b03 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:49.769521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-379dd674-b8a4-411d-b661-22bc4b163b03 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:49.966506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-379dd674-b8a4-411d-b661-22bc4b163b03 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:49.979699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-379dd674-b8a4-411d-b661-22bc4b163b03 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:49.985011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-379dd674-b8a4-411d-b661-22bc4b163b03 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:49.991905 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-379dd674-b8a4-411d-b661-22bc4b163b03 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.262956 May 28 05:04:49.994233 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2987/5862] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:49 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:51.021761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7e1ed045-8ed8-41a6-84c4-ec3af37c3eb5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:51.023710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7e1ed045-8ed8-41a6-84c4-ec3af37c3eb5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:51.040546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e1ed045-8ed8-41a6-84c4-ec3af37c3eb5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:51.041598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e1ed045-8ed8-41a6-84c4-ec3af37c3eb5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:51.053715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e1ed045-8ed8-41a6-84c4-ec3af37c3eb5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:51.053715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e1ed045-8ed8-41a6-84c4-ec3af37c3eb5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:51.247269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7e1ed045-8ed8-41a6-84c4-ec3af37c3eb5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:51.259687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7e1ed045-8ed8-41a6-84c4-ec3af37c3eb5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:51.262015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7e1ed045-8ed8-41a6-84c4-ec3af37c3eb5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:51.268430 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7e1ed045-8ed8-41a6-84c4-ec3af37c3eb5 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1604 microversion: 2.32 time: 0.248724 May 28 05:04:51.272091 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2876/5863] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:51 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1604 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:52.290915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1957441b-7992-41c5-a591-515433b1ab44 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:52.292493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1957441b-7992-41c5-a591-515433b1ab44 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:52.321186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1957441b-7992-41c5-a591-515433b1ab44 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:52.325916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1957441b-7992-41c5-a591-515433b1ab44 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:52.332005 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1957441b-7992-41c5-a591-515433b1ab44 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:52.336564 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1957441b-7992-41c5-a591-515433b1ab44 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:52.421763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1957441b-7992-41c5-a591-515433b1ab44 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:52.423111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1957441b-7992-41c5-a591-515433b1ab44 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:52.423111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-1957441b-7992-41c5-a591-515433b1ab44 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lazy-loading 'fault' on Instance uuid abd212dc-4ad7-49ff-add2-fb073ee8c3ce {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:04:52.494795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1957441b-7992-41c5-a591-515433b1ab44 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:52.506356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1957441b-7992-41c5-a591-515433b1ab44 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:52.508490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1957441b-7992-41c5-a591-515433b1ab44 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc426b7992084b8ca99e20a7f9ce297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8d40a350e64704ae9e918d236df9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:04:52.510187 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1957441b-7992-41c5-a591-515433b1ab44 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 200 len: 1609 microversion: 2.32 time: 0.224475 May 28 05:04:52.510909 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2988/5864] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:52 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 1609 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:04:53.533586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0b6ad6fd-ad73-4b71-9c00-7c53fccb9ba1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:53.534409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0b6ad6fd-ad73-4b71-9c00-7c53fccb9ba1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:04:53.565223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b6ad6fd-ad73-4b71-9c00-7c53fccb9ba1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:53.565691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b6ad6fd-ad73-4b71-9c00-7c53fccb9ba1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:53.566898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b6ad6fd-ad73-4b71-9c00-7c53fccb9ba1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:04:53.567544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b6ad6fd-ad73-4b71-9c00-7c53fccb9ba1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:04:53.621770 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-0b6ad6fd-ad73-4b71-9c00-7c53fccb9ba1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] HTTP exception thrown: Instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce could not be found. May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0b6ad6fd-ad73-4b71-9c00-7c53fccb9ba1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Request method failure captured: May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce HTTP/1.1 May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikatshwd7tNVY21tGFOdB7RpPzedSHkNqyww7Gm3cw8O5l4CezWyo5pGvFzEmFArRYH60T7npd1V2QNhcWjYRWMbsYB4YBuf2voVVWtCOfmX98RnV2xz5sexRPQUmT_D9e3cDW_7drYswhJlHUfCS93BeBcqVsnaDmcaWxyOFZLJZKPE May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-Openstack-Nova-Api-Version: 2.32 May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 5d8d40a350e64704ae9e918d236df9d2 May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TaggedBootDevicesTest-1799884054 May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5d8d40a350e64704ae9e918d236df9d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5d8d40a350e64704ae9e918d236df9d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5d8d40a350e64704ae9e918d236df9d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5d8d40a350e64704ae9e918d236df9d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TaggedBootDevicesTest-1799884054 May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 5d8d40a350e64704ae9e918d236df9d2 May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1799884054 May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TaggedBootDevicesTest-1799884054-project May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: fc426b7992084b8ca99e20a7f9ce297f May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TaggedBootDevicesTest-1799884054-project May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce could not be found. May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'abd212dc-4ad7-49ff-add2-fb073ee8c3ce'} May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce could not be found. May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce could not be found. May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:04:53.627391 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:04:53.631275 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:04:53.631275 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:04:53.631275 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:04:53.631275 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:04:53.631275 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:04:53.631275 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce could not be found. May 28 05:04:53.631275 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:04:53.631275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0b6ad6fd-ad73-4b71-9c00-7c53fccb9ba1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Returning 404 to user: Instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:04:53.631275 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0b6ad6fd-ad73-4b71-9c00-7c53fccb9ba1 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 404 len: 111 microversion: 2.32 time: 0.097977 May 28 05:04:53.631275 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2877/5865] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:04:53 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 05:04:53.641298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ccedf3d1-2e20-4130-99fb-18052be658c3 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '.version_select at 0x7f77006ca940>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:04:53.871523 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ccedf3d1-2e20-4130-99fb-18052be658c3 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1082304735" status: 204 len: 0 microversion: 2.32 time: 0.234776 May 28 05:04:53.873394 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2989/5866] 10.222.0.58 () {60 vars in 1261 bytes} [Sat May 28 05:04:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1082304735 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 05:05:01.703207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53122d3c-9498-47d4-bdd8-6f51f9d37eaf tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:01.703724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-53122d3c-9498-47d4-bdd8-6f51f9d37eaf tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:01.716556 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53122d3c-9498-47d4-bdd8-6f51f9d37eaf tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:01.717257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53122d3c-9498-47d4-bdd8-6f51f9d37eaf tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:01.718336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53122d3c-9498-47d4-bdd8-6f51f9d37eaf tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:01.719054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53122d3c-9498-47d4-bdd8-6f51f9d37eaf tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:01.734297 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-53122d3c-9498-47d4-bdd8-6f51f9d37eaf tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] HTTP exception thrown: Instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce could not be found. May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53122d3c-9498-47d4-bdd8-6f51f9d37eaf tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Request method failure captured: May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce HTTP/1.1 May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikatshwd7tNVY21tGFOdB7RpPzedSHkNqyww7Gm3cw8O5l4CezWyo5pGvFzEmFArRYH60T7npd1V2QNhcWjYRWMbsYB4YBuf2voVVWtCOfmX98RnV2xz5sexRPQUmT_D9e3cDW_7drYswhJlHUfCS93BeBcqVsnaDmcaWxyOFZLJZKPE May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-Openstack-Nova-Api-Version: 2.32 May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 5d8d40a350e64704ae9e918d236df9d2 May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TaggedBootDevicesTest-1799884054 May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5d8d40a350e64704ae9e918d236df9d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5d8d40a350e64704ae9e918d236df9d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5d8d40a350e64704ae9e918d236df9d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5d8d40a350e64704ae9e918d236df9d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TaggedBootDevicesTest-1799884054 May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 5d8d40a350e64704ae9e918d236df9d2 May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1799884054 May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TaggedBootDevicesTest-1799884054-project May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: fc426b7992084b8ca99e20a7f9ce297f May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TaggedBootDevicesTest-1799884054-project May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce could not be found. May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'abd212dc-4ad7-49ff-add2-fb073ee8c3ce'} May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce could not be found. May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:05:01.738022 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:05:01.741393 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce could not be found. May 28 05:05:01.741393 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:05:01.741393 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:05:01.741393 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:05:01.741393 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:05:01.741393 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:05:01.741393 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:05:01.741393 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:05:01.741393 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:05:01.741393 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce could not be found. May 28 05:05:01.741393 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:05:01.743496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53122d3c-9498-47d4-bdd8-6f51f9d37eaf tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Returning 404 to user: Instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:05:01.744824 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-53122d3c-9498-47d4-bdd8-6f51f9d37eaf tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "DELETE /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 404 len: 111 microversion: 2.32 time: 0.045968 May 28 05:05:01.746046 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2878/5867] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 05:05:01 2022] DELETE /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 05:05:01.755279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8f4cc4ef-d117-4742-8100-47e022b3acf2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:01.759511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8f4cc4ef-d117-4742-8100-47e022b3acf2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] [instance: abd212dc-4ad7-49ff-add2-fb073ee8c3ce] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:01.766330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f4cc4ef-d117-4742-8100-47e022b3acf2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:01.767644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f4cc4ef-d117-4742-8100-47e022b3acf2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:01.768636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f4cc4ef-d117-4742-8100-47e022b3acf2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:01.769279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f4cc4ef-d117-4742-8100-47e022b3acf2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:01.796421 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-8f4cc4ef-d117-4742-8100-47e022b3acf2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] HTTP exception thrown: Instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce could not be found. May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8f4cc4ef-d117-4742-8100-47e022b3acf2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Request method failure captured: May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce HTTP/1.1 May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikatshwd7tNVY21tGFOdB7RpPzedSHkNqyww7Gm3cw8O5l4CezWyo5pGvFzEmFArRYH60T7npd1V2QNhcWjYRWMbsYB4YBuf2voVVWtCOfmX98RnV2xz5sexRPQUmT_D9e3cDW_7drYswhJlHUfCS93BeBcqVsnaDmcaWxyOFZLJZKPE May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-Openstack-Nova-Api-Version: 2.32 May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 5d8d40a350e64704ae9e918d236df9d2 May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TaggedBootDevicesTest-1799884054 May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5d8d40a350e64704ae9e918d236df9d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5d8d40a350e64704ae9e918d236df9d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5d8d40a350e64704ae9e918d236df9d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5d8d40a350e64704ae9e918d236df9d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TaggedBootDevicesTest-1799884054 May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 5d8d40a350e64704ae9e918d236df9d2 May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1799884054 May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TaggedBootDevicesTest-1799884054-project May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: fc426b7992084b8ca99e20a7f9ce297f May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TaggedBootDevicesTest-1799884054-project May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce could not be found. May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'abd212dc-4ad7-49ff-add2-fb073ee8c3ce'} May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce could not be found. May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce could not be found. May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:05:01.798642 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:05:01.802033 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:05:01.802033 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:05:01.802033 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:05:01.802033 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:05:01.802033 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:05:01.802033 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce could not be found. May 28 05:05:01.802033 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:05:01.813532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8f4cc4ef-d117-4742-8100-47e022b3acf2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] Returning 404 to user: Instance abd212dc-4ad7-49ff-add2-fb073ee8c3ce could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:05:01.815231 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8f4cc4ef-d117-4742-8100-47e022b3acf2 tempest-TaggedBootDevicesTest-1799884054 tempest-TaggedBootDevicesTest-1799884054-project] 10.222.0.58 "GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce" status: 404 len: 111 microversion: 2.32 time: 0.065465 May 28 05:05:01.815980 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2990/5868] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:05:01 2022] GET /compute/v2.1/servers/abd212dc-4ad7-49ff-add2-fb073ee8c3ce => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 05:05:09.931624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a338b8ed-05ff-4420-8e5a-d854baeaf488 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:09.933229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a338b8ed-05ff-4420-8e5a-d854baeaf488 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:09.946969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a338b8ed-05ff-4420-8e5a-d854baeaf488 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:09.947739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a338b8ed-05ff-4420-8e5a-d854baeaf488 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:09.959397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a338b8ed-05ff-4420-8e5a-d854baeaf488 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:09.960041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a338b8ed-05ff-4420-8e5a-d854baeaf488 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:09.992691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=48 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:05:10.070372 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a338b8ed-05ff-4420-8e5a-d854baeaf488 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.142765 May 28 05:05:10.070968 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2879/5869] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:05:09 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e/os-volume_attachments => generated 25 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 05:05:10.239099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-68b351fa-03a3-42c8-8f60-d2260a772042 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:10.243755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-68b351fa-03a3-42c8-8f60-d2260a772042 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:10.265130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68b351fa-03a3-42c8-8f60-d2260a772042 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:10.268035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68b351fa-03a3-42c8-8f60-d2260a772042 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:10.270164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68b351fa-03a3-42c8-8f60-d2260a772042 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:10.271219 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68b351fa-03a3-42c8-8f60-d2260a772042 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:10.353478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=48 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:05:10.361409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-68b351fa-03a3-42c8-8f60-d2260a772042 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:05:10.933865 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-68b351fa-03a3-42c8-8f60-d2260a772042 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 204 len: 0 microversion: 2.1 time: 0.699783 May 28 05:05:10.934645 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2991/5870] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:05:10 2022] DELETE /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 0 bytes in 701 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:05:10.944515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8a9c0834-3a49-4ef9-937d-0175dbdb627b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:10.945317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8a9c0834-3a49-4ef9-937d-0175dbdb627b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:10.969412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a9c0834-3a49-4ef9-937d-0175dbdb627b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:10.979715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a9c0834-3a49-4ef9-937d-0175dbdb627b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:10.981015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a9c0834-3a49-4ef9-937d-0175dbdb627b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:10.984095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a9c0834-3a49-4ef9-937d-0175dbdb627b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:11.464574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8a9c0834-3a49-4ef9-937d-0175dbdb627b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:05:11.474185 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8a9c0834-3a49-4ef9-937d-0175dbdb627b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1672 microversion: 2.1 time: 0.533637 May 28 05:05:11.476406 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2880/5871] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:05:10 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1672 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:05:12.493316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ddd75fd3-f26e-486a-ada6-bb69702f1c34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:12.494689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ddd75fd3-f26e-486a-ada6-bb69702f1c34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:12.505923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddd75fd3-f26e-486a-ada6-bb69702f1c34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:12.511801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddd75fd3-f26e-486a-ada6-bb69702f1c34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:12.512997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddd75fd3-f26e-486a-ada6-bb69702f1c34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:12.513653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ddd75fd3-f26e-486a-ada6-bb69702f1c34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:12.847415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ddd75fd3-f26e-486a-ada6-bb69702f1c34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:05:12.858820 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ddd75fd3-f26e-486a-ada6-bb69702f1c34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1672 microversion: 2.1 time: 0.369651 May 28 05:05:12.860045 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2992/5872] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:05:12 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1672 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:05:13.879048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8b854e64-f061-455b-bb4c-5240798f4db6 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:13.880583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8b854e64-f061-455b-bb4c-5240798f4db6 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:13.892553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=16 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:05:13.896651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b854e64-f061-455b-bb4c-5240798f4db6 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:13.899348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b854e64-f061-455b-bb4c-5240798f4db6 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:13.901086 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b854e64-f061-455b-bb4c-5240798f4db6 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:13.907589 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b854e64-f061-455b-bb4c-5240798f4db6 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:14.779668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8b854e64-f061-455b-bb4c-5240798f4db6 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:05:14.793863 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8b854e64-f061-455b-bb4c-5240798f4db6 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1672 microversion: 2.1 time: 0.919372 May 28 05:05:14.820865 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2881/5873] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:05:13 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1672 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:05:15.827536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-31fb4233-eb71-4347-aef7-736cfbafdaf9 req-16bf02df-0142-43aa-b7f1-5e7edb3b2576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b28a05b-9b15-4b95-995f-88592e01319e", "name": "network-vif-deleted", "tag": "84e61710-b29e-45a1-881b-41db16e2042f"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:05:15.835380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7ea14543-32af-4d58-b1f5-75b8f7c4f64e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:15.836016 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7ea14543-32af-4d58-b1f5-75b8f7c4f64e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:15.880177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:05:15.881799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ea14543-32af-4d58-b1f5-75b8f7c4f64e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:15.890899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-31fb4233-eb71-4347-aef7-736cfbafdaf9 req-16bf02df-0142-43aa-b7f1-5e7edb3b2576 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:15.895945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-31fb4233-eb71-4347-aef7-736cfbafdaf9 req-16bf02df-0142-43aa-b7f1-5e7edb3b2576 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:15.896048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ea14543-32af-4d58-b1f5-75b8f7c4f64e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:15.896048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ea14543-32af-4d58-b1f5-75b8f7c4f64e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:15.896648 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7ea14543-32af-4d58-b1f5-75b8f7c4f64e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:15.943513 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-31fb4233-eb71-4347-aef7-736cfbafdaf9 req-16bf02df-0142-43aa-b7f1-5e7edb3b2576 service nova] Creating event network-vif-deleted:84e61710-b29e-45a1-881b-41db16e2042f for instance 3b28a05b-9b15-4b95-995f-88592e01319e on n-h2-843700-1 May 28 05:05:15.970601 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-31fb4233-eb71-4347-aef7-736cfbafdaf9 req-16bf02df-0142-43aa-b7f1-5e7edb3b2576 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150111 May 28 05:05:15.979220 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2882/5874] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:05:16.511792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7ea14543-32af-4d58-b1f5-75b8f7c4f64e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:05:16.523247 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7ea14543-32af-4d58-b1f5-75b8f7c4f64e tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 200 len: 1605 microversion: 2.1 time: 0.706497 May 28 05:05:16.541352 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2993/5875] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:05:15 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 1605 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:05:17.557570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b309e740-2e2e-4c2f-a84d-d9c496cefd9b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:17.566282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b309e740-2e2e-4c2f-a84d-d9c496cefd9b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:17.628746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b309e740-2e2e-4c2f-a84d-d9c496cefd9b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:17.629935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b309e740-2e2e-4c2f-a84d-d9c496cefd9b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:17.639534 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b309e740-2e2e-4c2f-a84d-d9c496cefd9b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:17.640450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b309e740-2e2e-4c2f-a84d-d9c496cefd9b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:17.731147 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-b309e740-2e2e-4c2f-a84d-d9c496cefd9b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] HTTP exception thrown: Instance 3b28a05b-9b15-4b95-995f-88592e01319e could not be found. May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b309e740-2e2e-4c2f-a84d-d9c496cefd9b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Request method failure captured: May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e HTTP/1.1 May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikayX49ChvGgQpdxx6QCZpss1arw8is0ElbdxquXzH-B75VpugcrVejk4biMuUTxGKAZhs1IafiyiN7X5PGMIdJojekf1m26YqEHj26nV3GYykZmnq2EvsErgFMveGTJOzFmGvVmOQjuc2Nve0H3qarRu36CRjqOxRlpc5jL72NVq8b4 May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 844635ce88914d628f312550a4b128ba May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AttachVolumeTestJSON-1986626318 May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_844635ce88914d628f312550a4b128ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/844635ce88914d628f312550a4b128ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/844635ce88914d628f312550a4b128ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/844635ce88914d628f312550a4b128ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AttachVolumeTestJSON-1986626318 May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 844635ce88914d628f312550a4b128ba May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1986626318 May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AttachVolumeTestJSON-1986626318-project May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c09d2cdac73148e3ac1f118e2de31365 May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AttachVolumeTestJSON-1986626318-project May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 3b28a05b-9b15-4b95-995f-88592e01319e could not be found. May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '3b28a05b-9b15-4b95-995f-88592e01319e'} May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b28a05b-9b15-4b95-995f-88592e01319e could not be found. May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b28a05b-9b15-4b95-995f-88592e01319e could not be found. May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:05:17.737928 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:05:17.746337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:05:17.746337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:05:17.746337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:05:17.746337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:05:17.746337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:05:17.746337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b28a05b-9b15-4b95-995f-88592e01319e could not be found. May 28 05:05:17.746337 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:05:17.752470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b309e740-2e2e-4c2f-a84d-d9c496cefd9b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Returning 404 to user: Instance 3b28a05b-9b15-4b95-995f-88592e01319e could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:05:17.763781 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b309e740-2e2e-4c2f-a84d-d9c496cefd9b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 404 len: 111 microversion: 2.1 time: 0.209569 May 28 05:05:17.768743 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2883/5876] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:05:17 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:05:17.773704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7bc54a32-dcf7-4438-afd1-4bcdc1040c01 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '.version_select at 0x7f770065f790>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:17.922967 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7bc54a32-dcf7-4438-afd1-4bcdc1040c01 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805764625" status: 202 len: 0 microversion: 2.1 time: 0.153108 May 28 05:05:17.928357 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2994/5877] 10.222.0.58 () {58 vars in 1220 bytes} [Sat May 28 05:05:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805764625 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:05:20.306840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8421d5a4-896c-4350-a21f-3396f0948091 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Action: 'create', calling method: .version_select at 0x7f7701d8bd30>, body: {"keypair": {"name": "tempest-keypair-1906678317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKb3L+aNzkOZ8Jl1fr6x+Z6M6l4NuaoepRULtApdM1rE9yhjhLrzZ5VLgVUEJFZ+8GdtNVMQNVm14gb2sVWO4Hg0Z4KUobK8BHOlg95lWJT6TL/qhvSsplXQvDXKQNFdgg=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:05:20.358156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-8421d5a4-896c-4350-a21f-3396f0948091 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Getting quotas for project 844635ce88914d628f312550a4b128ba. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:05:20.380056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-8421d5a4-896c-4350-a21f-3396f0948091 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Getting quotas for user c09d2cdac73148e3ac1f118e2de31365 and project 844635ce88914d628f312550a4b128ba. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:05:20.564262 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8421d5a4-896c-4350-a21f-3396f0948091 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.261530 May 28 05:05:20.576671 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2884/5878] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 05:05:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:05:25.704884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-78a21e89-d023-4650-a6c9-81ac3d361e34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-213789485", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee3f40bc-ca82-4c59-b6b9-c9598eb48b69"}], "security_groups": [{"name": "tempest-securitygroup--1721359498"}], "key_name": "tempest-keypair-1906678317", "user_data": "}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:05:26.026181 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-78a21e89-d023-4650-a6c9-81ac3d361e34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] validate_networks() for [('ee3f40bc-ca82-4c59-b6b9-c9598eb48b69', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:05:26.516947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:05:27.169280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-78a21e89-d023-4650-a6c9-81ac3d361e34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:05:27.169841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-78a21e89-d023-4650-a6c9-81ac3d361e34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:05:27.170772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-78a21e89-d023-4650-a6c9-81ac3d361e34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:05:27.171413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-78a21e89-d023-4650-a6c9-81ac3d361e34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:05:27.171930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-78a21e89-d023-4650-a6c9-81ac3d361e34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:05:27.195537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78a21e89-d023-4650-a6c9-81ac3d361e34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:27.197513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78a21e89-d023-4650-a6c9-81ac3d361e34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:27.199943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78a21e89-d023-4650-a6c9-81ac3d361e34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:27.204006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78a21e89-d023-4650-a6c9-81ac3d361e34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:27.256596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-78a21e89-d023-4650-a6c9-81ac3d361e34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Getting quotas for project 844635ce88914d628f312550a4b128ba. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:05:27.271032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-78a21e89-d023-4650-a6c9-81ac3d361e34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Getting quotas for user c09d2cdac73148e3ac1f118e2de31365 and project 844635ce88914d628f312550a4b128ba. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:05:27.305158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-78a21e89-d023-4650-a6c9-81ac3d361e34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:05:27.307870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-78a21e89-d023-4650-a6c9-81ac3d361e34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:05:27.652328 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-78a21e89-d023-4650-a6c9-81ac3d361e34 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.953999 May 28 05:05:27.653415 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2995/5879] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:05:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:05:27.665141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f8109174-111e-4fec-aefb-3ad444a3e835 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:27.666901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f8109174-111e-4fec-aefb-3ad444a3e835 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:27.731868 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=21 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:05:27.889441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f8109174-111e-4fec-aefb-3ad444a3e835 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:05:27.904021 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f8109174-111e-4fec-aefb-3ad444a3e835 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 200 len: 1237 microversion: 2.1 time: 0.242441 May 28 05:05:27.906200 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2885/5880] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:05:27 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 1237 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:05:28.943380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-43f54f94-affc-4ed5-b93a-74587cccdc44 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:28.944002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-43f54f94-affc-4ed5-b93a-74587cccdc44 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:29.069867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-43f54f94-affc-4ed5-b93a-74587cccdc44 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:05:29.080687 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-43f54f94-affc-4ed5-b93a-74587cccdc44 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 200 len: 1237 microversion: 2.1 time: 0.153745 May 28 05:05:29.084403 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2996/5881] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:05:28 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 1237 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:05:30.127828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7fd06890-9b24-47e9-89fb-67c2b23fec41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:30.129494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7fd06890-9b24-47e9-89fb-67c2b23fec41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:30.143594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7fd06890-9b24-47e9-89fb-67c2b23fec41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:30.147949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7fd06890-9b24-47e9-89fb-67c2b23fec41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:30.149658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7fd06890-9b24-47e9-89fb-67c2b23fec41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:30.151867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7fd06890-9b24-47e9-89fb-67c2b23fec41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:30.283470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7fd06890-9b24-47e9-89fb-67c2b23fec41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:05:30.296537 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7fd06890-9b24-47e9-89fb-67c2b23fec41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 200 len: 1289 microversion: 2.1 time: 0.187451 May 28 05:05:30.298216 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2886/5882] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:05:30 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 1289 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:05:31.318158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a7476991-8f06-4fda-b266-18eccc440d41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:31.319870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a7476991-8f06-4fda-b266-18eccc440d41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:31.355393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7476991-8f06-4fda-b266-18eccc440d41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:31.356841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7476991-8f06-4fda-b266-18eccc440d41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:31.364607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7476991-8f06-4fda-b266-18eccc440d41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:31.365282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7476991-8f06-4fda-b266-18eccc440d41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:31.774548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a7476991-8f06-4fda-b266-18eccc440d41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:05:31.792467 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a7476991-8f06-4fda-b266-18eccc440d41 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 200 len: 1295 microversion: 2.1 time: 0.480451 May 28 05:05:31.795841 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2997/5883] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:05:31 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 1295 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:05:32.809919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cc3eacd8-dcb3-4c3b-8179-4fd401c4510f tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:32.811301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cc3eacd8-dcb3-4c3b-8179-4fd401c4510f tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:32.835578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc3eacd8-dcb3-4c3b-8179-4fd401c4510f tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:32.837847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc3eacd8-dcb3-4c3b-8179-4fd401c4510f tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:32.840883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc3eacd8-dcb3-4c3b-8179-4fd401c4510f tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:32.845965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc3eacd8-dcb3-4c3b-8179-4fd401c4510f tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:33.193386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cc3eacd8-dcb3-4c3b-8179-4fd401c4510f tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:05:33.214973 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cc3eacd8-dcb3-4c3b-8179-4fd401c4510f tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 200 len: 1295 microversion: 2.1 time: 0.409133 May 28 05:05:33.229253 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2887/5884] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:05:32 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 1295 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:05:34.233345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-207f59db-2035-482c-9a64-ab0259423e01 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:34.234035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-207f59db-2035-482c-9a64-ab0259423e01 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:34.251035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-207f59db-2035-482c-9a64-ab0259423e01 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:34.251819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-207f59db-2035-482c-9a64-ab0259423e01 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:34.252856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-207f59db-2035-482c-9a64-ab0259423e01 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:34.254785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-207f59db-2035-482c-9a64-ab0259423e01 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:35.103381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-207f59db-2035-482c-9a64-ab0259423e01 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:05:35.112063 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-207f59db-2035-482c-9a64-ab0259423e01 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 200 len: 1363 microversion: 2.1 time: 0.883342 May 28 05:05:35.125276 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2998/5885] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:05:34 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 1363 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:05:36.132285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2d9ac77a-3163-4645-97b7-ba1662627f45 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:36.133451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2d9ac77a-3163-4645-97b7-ba1662627f45 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:36.145412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d9ac77a-3163-4645-97b7-ba1662627f45 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:36.152979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d9ac77a-3163-4645-97b7-ba1662627f45 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:36.154230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d9ac77a-3163-4645-97b7-ba1662627f45 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:36.154917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d9ac77a-3163-4645-97b7-ba1662627f45 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:36.318586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-a9fb5328-e5df-43f0-a8c2-27d0574769ba req-da11e149-e420-4588-8e85-3a353becafa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54892188-1116-41fc-a42e-20850995d769", "tag": "addb9a17-3534-49f8-bb69-db3516e24c57"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:05:36.352909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a9fb5328-e5df-43f0-a8c2-27d0574769ba req-da11e149-e420-4588-8e85-3a353becafa2 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:36.353439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a9fb5328-e5df-43f0-a8c2-27d0574769ba req-da11e149-e420-4588-8e85-3a353becafa2 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:36.405400 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-a9fb5328-e5df-43f0-a8c2-27d0574769ba req-da11e149-e420-4588-8e85-3a353becafa2 service nova] Creating event network-changed:addb9a17-3534-49f8-bb69-db3516e24c57 for instance 54892188-1116-41fc-a42e-20850995d769 on n-h1-843700-1 May 28 05:05:36.428210 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-a9fb5328-e5df-43f0-a8c2-27d0574769ba req-da11e149-e420-4588-8e85-3a353becafa2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110883 May 28 05:05:36.431063 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 2999/5886] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:05:36.927217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2d9ac77a-3163-4645-97b7-ba1662627f45 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:05:36.935257 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2d9ac77a-3163-4645-97b7-ba1662627f45 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 200 len: 1363 microversion: 2.1 time: 0.807536 May 28 05:05:36.941929 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2888/5887] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:05:36 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 1363 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:05:37.961260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-24282133-15c3-49a6-870f-6f42a9bd53f7 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:37.961833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-24282133-15c3-49a6-870f-6f42a9bd53f7 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:37.985866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:05:37.995554 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24282133-15c3-49a6-870f-6f42a9bd53f7 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:38.001228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24282133-15c3-49a6-870f-6f42a9bd53f7 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:38.002027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24282133-15c3-49a6-870f-6f42a9bd53f7 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:38.002027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24282133-15c3-49a6-870f-6f42a9bd53f7 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:38.362639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-24282133-15c3-49a6-870f-6f42a9bd53f7 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:05:38.370902 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-24282133-15c3-49a6-870f-6f42a9bd53f7 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 200 len: 1363 microversion: 2.1 time: 0.416253 May 28 05:05:38.382658 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3000/5888] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:05:37 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 1363 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:05:39.401157 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-64931490-06d3-44f4-a981-3204cae43e38 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:39.401157 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-64931490-06d3-44f4-a981-3204cae43e38 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:39.401157 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:05:39.411055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-64931490-06d3-44f4-a981-3204cae43e38 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:39.411527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-64931490-06d3-44f4-a981-3204cae43e38 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:39.413508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-64931490-06d3-44f4-a981-3204cae43e38 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:39.416951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-64931490-06d3-44f4-a981-3204cae43e38 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:40.315562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-64931490-06d3-44f4-a981-3204cae43e38 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:05:40.326843 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-64931490-06d3-44f4-a981-3204cae43e38 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 200 len: 1363 microversion: 2.1 time: 0.938222 May 28 05:05:40.329894 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2889/5889] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:05:39 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 1363 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:05:41.346146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5be22adf-106a-4bf8-b57a-98bf024d9d88 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:41.347588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5be22adf-106a-4bf8-b57a-98bf024d9d88 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:41.350810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=8 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:05:41.362652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5be22adf-106a-4bf8-b57a-98bf024d9d88 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:41.362908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5be22adf-106a-4bf8-b57a-98bf024d9d88 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:41.363741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5be22adf-106a-4bf8-b57a-98bf024d9d88 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:41.364189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5be22adf-106a-4bf8-b57a-98bf024d9d88 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:41.930123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5be22adf-106a-4bf8-b57a-98bf024d9d88 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:05:41.942043 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5be22adf-106a-4bf8-b57a-98bf024d9d88 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 200 len: 1363 microversion: 2.1 time: 0.599858 May 28 05:05:41.947998 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3001/5890] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:05:41 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 1363 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:05:42.964927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d21b25a0-81c8-4b24-8465-9428b83c90f7 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:42.965559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d21b25a0-81c8-4b24-8465-9428b83c90f7 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:43.043615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d21b25a0-81c8-4b24-8465-9428b83c90f7 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:43.044146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d21b25a0-81c8-4b24-8465-9428b83c90f7 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:43.045105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d21b25a0-81c8-4b24-8465-9428b83c90f7 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:43.045442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d21b25a0-81c8-4b24-8465-9428b83c90f7 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:43.554481 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-2e74657c-98de-46f5-92fc-671f0b470dee req-ec116572-55d5-4583-b0f0-cea84bb8da68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54892188-1116-41fc-a42e-20850995d769", "name": "network-vif-plugged", "status": "completed", "tag": "addb9a17-3534-49f8-bb69-db3516e24c57"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:05:43.569729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2e74657c-98de-46f5-92fc-671f0b470dee req-ec116572-55d5-4583-b0f0-cea84bb8da68 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:43.570187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2e74657c-98de-46f5-92fc-671f0b470dee req-ec116572-55d5-4583-b0f0-cea84bb8da68 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:43.637809 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-2e74657c-98de-46f5-92fc-671f0b470dee req-ec116572-55d5-4583-b0f0-cea84bb8da68 service nova] Creating event network-vif-plugged:addb9a17-3534-49f8-bb69-db3516e24c57 for instance 54892188-1116-41fc-a42e-20850995d769 on n-h1-843700-1 May 28 05:05:43.652515 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-2e74657c-98de-46f5-92fc-671f0b470dee req-ec116572-55d5-4583-b0f0-cea84bb8da68 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.574870 May 28 05:05:43.653423 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3002/5891] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:05:44.797590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d21b25a0-81c8-4b24-8465-9428b83c90f7 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:05:44.850435 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d21b25a0-81c8-4b24-8465-9428b83c90f7 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 200 len: 1363 microversion: 2.1 time: 1.889205 May 28 05:05:44.856308 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2890/5892] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:05:42 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 1363 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:05:45.873812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7687ce82-b3dc-409e-b00c-c689e014378b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:45.875413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7687ce82-b3dc-409e-b00c-c689e014378b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:45.935746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7687ce82-b3dc-409e-b00c-c689e014378b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:45.943538 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7687ce82-b3dc-409e-b00c-c689e014378b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:45.944700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7687ce82-b3dc-409e-b00c-c689e014378b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:45.945356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7687ce82-b3dc-409e-b00c-c689e014378b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:46.736278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7687ce82-b3dc-409e-b00c-c689e014378b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:05:46.748755 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7687ce82-b3dc-409e-b00c-c689e014378b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 200 len: 1363 microversion: 2.1 time: 0.879366 May 28 05:05:46.750968 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3003/5893] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:05:45 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 1363 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:05:47.779311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ec2da728-6b84-4db8-b07e-173133f59dad tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:47.781104 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ec2da728-6b84-4db8-b07e-173133f59dad tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:47.785228 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:05:47.800831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec2da728-6b84-4db8-b07e-173133f59dad tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:47.801223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec2da728-6b84-4db8-b07e-173133f59dad tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:47.802014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec2da728-6b84-4db8-b07e-173133f59dad tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:47.802632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec2da728-6b84-4db8-b07e-173133f59dad tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:48.272156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ec2da728-6b84-4db8-b07e-173133f59dad tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:05:48.291300 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ec2da728-6b84-4db8-b07e-173133f59dad tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 200 len: 1547 microversion: 2.1 time: 0.523191 May 28 05:05:48.296050 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2891/5894] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:05:47 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 1547 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:05:48.318757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9849d39f-879e-49c5-ae7a-8f4271443ba3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:05:48.325638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9849d39f-879e-49c5-ae7a-8f4271443ba3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:05:48.331565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:05:48.337897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9849d39f-879e-49c5-ae7a-8f4271443ba3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:48.342909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9849d39f-879e-49c5-ae7a-8f4271443ba3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:48.348407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9849d39f-879e-49c5-ae7a-8f4271443ba3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:48.348887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9849d39f-879e-49c5-ae7a-8f4271443ba3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:48.612902 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9849d39f-879e-49c5-ae7a-8f4271443ba3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.298741 May 28 05:05:48.613556 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3004/5895] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 05:05:48 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-interface => generated 284 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:05:52.967528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-bc86a1b0-782c-4d00-840a-825f4c0420c8 req-3b59b22d-9cd7-4474-8802-ee50a6fa3e60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54892188-1116-41fc-a42e-20850995d769", "tag": "addb9a17-3534-49f8-bb69-db3516e24c57"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:05:52.994057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-bc86a1b0-782c-4d00-840a-825f4c0420c8 req-3b59b22d-9cd7-4474-8802-ee50a6fa3e60 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:05:52.996937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-bc86a1b0-782c-4d00-840a-825f4c0420c8 req-3b59b22d-9cd7-4474-8802-ee50a6fa3e60 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:05:53.035731 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-bc86a1b0-782c-4d00-840a-825f4c0420c8 req-3b59b22d-9cd7-4474-8802-ee50a6fa3e60 service nova] Creating event network-changed:addb9a17-3534-49f8-bb69-db3516e24c57 for instance 54892188-1116-41fc-a42e-20850995d769 on n-h1-843700-1 May 28 05:05:53.046506 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-bc86a1b0-782c-4d00-840a-825f4c0420c8 req-3b59b22d-9cd7-4474-8802-ee50a6fa3e60 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083073 May 28 05:05:53.050241 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2892/5896] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:05:55.916021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-33a8b52a-5320-4034-89b6-e6abec840c68 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Action: 'create', calling method: .version_select at 0x7f770066f550>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-199357320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOqeT1r5cMonmDymuAKVGot8ektwCP+9LzBLWVG+F81HHXo0H3jHMHisGBjJZMmNtrds+nhnaTGhFOylymTNfMydFtlo6Gk3sqoFRCvgv3dyJnw3rrd091OvNOfHVOVbw=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:05:55.957302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-33a8b52a-5320-4034-89b6-e6abec840c68 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Getting quotas for project 831c7c287df6450c92a8103d2c1a6521. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:05:55.984157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-33a8b52a-5320-4034-89b6-e6abec840c68 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Getting quotas for user 72e8b077e13842ebb336a8d0861373f5 and project 831c7c287df6450c92a8103d2c1a6521. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:05:56.138117 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-33a8b52a-5320-4034-89b6-e6abec840c68 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.847399 May 28 05:05:56.139046 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3005/5897] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 05:05:55 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:06:12.743421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8c00f6fd-250a-484f-846d-6ce629c9d82e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1416118784-access_point-975453126", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "d2e4f688-191f-41c1-9c7b-00ce3b192cd2"}], "key_name": "tempest-TestSecurityGroupsBasicOps-199357320", "security_groups": [{"name": "tempest-secgroup_access--1483123971"}, {"name": "tempest-secgroup_general--908087324"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:06:12.756697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:06:12.757709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=38 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:06:12.781648 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=40 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:06:12.782541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:06:12.783304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:06:13.138596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-8c00f6fd-250a-484f-846d-6ce629c9d82e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] validate_networks() for [('d2e4f688-191f-41c1-9c7b-00ce3b192cd2', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:06:13.147534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e1449dba-a55c-49fa-a7d6-2fb76edf805a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-8464826", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": "none"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:06:13.244667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-e1449dba-a55c-49fa-a7d6-2fb76edf805a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:06:13.246712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-e1449dba-a55c-49fa-a7d6-2fb76edf805a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:06:13.247652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-e1449dba-a55c-49fa-a7d6-2fb76edf805a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:06:13.254072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-e1449dba-a55c-49fa-a7d6-2fb76edf805a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:06:13.254072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-e1449dba-a55c-49fa-a7d6-2fb76edf805a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:06:13.285489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1449dba-a55c-49fa-a7d6-2fb76edf805a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:13.285610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1449dba-a55c-49fa-a7d6-2fb76edf805a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:13.286392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1449dba-a55c-49fa-a7d6-2fb76edf805a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:13.287141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1449dba-a55c-49fa-a7d6-2fb76edf805a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:13.320806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-e1449dba-a55c-49fa-a7d6-2fb76edf805a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Getting quotas for project 52f75635fa9148b4a4210710ab76b5c8. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:06:13.346495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-e1449dba-a55c-49fa-a7d6-2fb76edf805a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Getting quotas for user 1705425a29ff413b9cf2ff39ff929a8f and project 52f75635fa9148b4a4210710ab76b5c8. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:06:13.388373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e1449dba-a55c-49fa-a7d6-2fb76edf805a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:06:13.402071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e1449dba-a55c-49fa-a7d6-2fb76edf805a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:06:13.568251 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e1449dba-a55c-49fa-a7d6-2fb76edf805a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.788272 May 28 05:06:13.574022 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3006/5898] 10.222.0.58 () {62 vars in 1187 bytes} [Sat May 28 05:06:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 28 05:06:13.595498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ee84ec1a-6175-4715-8ed8-0797d6106dd2 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:13.596464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ee84ec1a-6175-4715-8ed8-0797d6106dd2 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:13.728519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ee84ec1a-6175-4715-8ed8-0797d6106dd2 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:13.739317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ee84ec1a-6175-4715-8ed8-0797d6106dd2 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:13.747817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ee84ec1a-6175-4715-8ed8-0797d6106dd2 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:13.747817 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ee84ec1a-6175-4715-8ed8-0797d6106dd2 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1275 microversion: 2.54 time: 0.163796 May 28 05:06:13.747817 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3007/5899] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:13 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:14.209468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-8c00f6fd-250a-484f-846d-6ce629c9d82e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:06:14.210486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-8c00f6fd-250a-484f-846d-6ce629c9d82e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:06:14.211203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-8c00f6fd-250a-484f-846d-6ce629c9d82e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:06:14.211924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-8c00f6fd-250a-484f-846d-6ce629c9d82e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:06:14.212534 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-8c00f6fd-250a-484f-846d-6ce629c9d82e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:06:14.231814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c00f6fd-250a-484f-846d-6ce629c9d82e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:14.233186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c00f6fd-250a-484f-846d-6ce629c9d82e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:14.237584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c00f6fd-250a-484f-846d-6ce629c9d82e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:14.238258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c00f6fd-250a-484f-846d-6ce629c9d82e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:14.297315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-8c00f6fd-250a-484f-846d-6ce629c9d82e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Getting quotas for project 831c7c287df6450c92a8103d2c1a6521. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:06:14.303895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-8c00f6fd-250a-484f-846d-6ce629c9d82e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Getting quotas for user 72e8b077e13842ebb336a8d0861373f5 and project 831c7c287df6450c92a8103d2c1a6521. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:06:14.322779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8c00f6fd-250a-484f-846d-6ce629c9d82e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:06:14.325651 n-d-843700-1 devstack@n-api.service[126043]: WARNING nova.utils [None req-8c00f6fd-250a-484f-846d-6ce629c9d82e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1416118784-access_point-975453126 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1416118784-ac May 28 05:06:14.327116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8c00f6fd-250a-484f-846d-6ce629c9d82e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:06:14.529975 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8c00f6fd-250a-484f-846d-6ce629c9d82e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.796552 May 28 05:06:14.531640 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2893/5900] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:06:12 2022] POST /compute/v2.1/servers => generated 457 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:06:14.542225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d98993de-27b9-467f-92d6-ccba1337c84c tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:14.544163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d98993de-27b9-467f-92d6-ccba1337c84c tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:14.684358 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d98993de-27b9-467f-92d6-ccba1337c84c tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:14.693826 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d98993de-27b9-467f-92d6-ccba1337c84c tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1293 microversion: 2.1 time: 0.155971 May 28 05:06:14.707944 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3008/5901] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:06:14 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1293 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:06:14.770625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-056de00d-2406-4f0d-9c13-7e2169c55755 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:14.776038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-056de00d-2406-4f0d-9c13-7e2169c55755 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:14.978059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-056de00d-2406-4f0d-9c13-7e2169c55755 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:14.999663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-056de00d-2406-4f0d-9c13-7e2169c55755 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:15.008225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-056de00d-2406-4f0d-9c13-7e2169c55755 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:15.011477 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-056de00d-2406-4f0d-9c13-7e2169c55755 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1275 microversion: 2.54 time: 0.249623 May 28 05:06:15.016167 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2894/5902] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:14 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1275 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:15.723138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-783695de-f742-487e-b9e6-51fa9864b5ca tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:15.723138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-783695de-f742-487e-b9e6-51fa9864b5ca tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:15.952917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-783695de-f742-487e-b9e6-51fa9864b5ca tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:15.967242 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-783695de-f742-487e-b9e6-51fa9864b5ca tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1293 microversion: 2.1 time: 0.255716 May 28 05:06:15.987244 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3009/5903] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:06:15 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1293 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:06:16.042459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1b0a1f5c-cc9f-434d-89f7-e87559e95b0d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:16.043200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1b0a1f5c-cc9f-434d-89f7-e87559e95b0d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:16.248558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1b0a1f5c-cc9f-434d-89f7-e87559e95b0d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:16.266591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1b0a1f5c-cc9f-434d-89f7-e87559e95b0d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:16.275948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1b0a1f5c-cc9f-434d-89f7-e87559e95b0d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:16.277640 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1b0a1f5c-cc9f-434d-89f7-e87559e95b0d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1275 microversion: 2.54 time: 0.244788 May 28 05:06:16.286713 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2895/5904] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:16 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1275 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:16.985237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f3f7d5ab-af2d-4d34-9356-8ff7751387f3 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:16.991494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f3f7d5ab-af2d-4d34-9356-8ff7751387f3 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:17.090421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f3f7d5ab-af2d-4d34-9356-8ff7751387f3 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:17.187697 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f3f7d5ab-af2d-4d34-9356-8ff7751387f3 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1293 microversion: 2.1 time: 0.181463 May 28 05:06:17.187697 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3010/5905] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:06:16 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1293 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:06:17.305979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a1cf3949-3fad-45d8-9c8b-622bb4ebf237 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:17.307269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a1cf3949-3fad-45d8-9c8b-622bb4ebf237 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:17.317903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1cf3949-3fad-45d8-9c8b-622bb4ebf237 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:17.318645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1cf3949-3fad-45d8-9c8b-622bb4ebf237 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:17.319728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1cf3949-3fad-45d8-9c8b-622bb4ebf237 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:17.320401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1cf3949-3fad-45d8-9c8b-622bb4ebf237 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:17.431356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a1cf3949-3fad-45d8-9c8b-622bb4ebf237 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:17.431356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a1cf3949-3fad-45d8-9c8b-622bb4ebf237 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:17.431356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a1cf3949-3fad-45d8-9c8b-622bb4ebf237 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:17.431356 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a1cf3949-3fad-45d8-9c8b-622bb4ebf237 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1279 microversion: 2.54 time: 0.131020 May 28 05:06:17.432249 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2896/5906] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:17 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1279 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:18.189388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-677d7f69-99fb-4c94-bdac-c9f511f1dced tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:18.189388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-677d7f69-99fb-4c94-bdac-c9f511f1dced tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:18.392065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-677d7f69-99fb-4c94-bdac-c9f511f1dced tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:18.399465 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-677d7f69-99fb-4c94-bdac-c9f511f1dced tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1293 microversion: 2.1 time: 0.217303 May 28 05:06:18.400058 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3011/5907] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:06:18 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1293 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:06:18.450127 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d3b26a32-868d-40c0-bcdd-67ec3c379b5a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:18.450768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d3b26a32-868d-40c0-bcdd-67ec3c379b5a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:18.480500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3b26a32-868d-40c0-bcdd-67ec3c379b5a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:18.483285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3b26a32-868d-40c0-bcdd-67ec3c379b5a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:18.488446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3b26a32-868d-40c0-bcdd-67ec3c379b5a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:18.491086 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3b26a32-868d-40c0-bcdd-67ec3c379b5a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:18.686028 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d3b26a32-868d-40c0-bcdd-67ec3c379b5a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:18.695783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d3b26a32-868d-40c0-bcdd-67ec3c379b5a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:18.699973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d3b26a32-868d-40c0-bcdd-67ec3c379b5a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:18.701996 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d3b26a32-868d-40c0-bcdd-67ec3c379b5a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1327 microversion: 2.54 time: 0.255672 May 28 05:06:18.714307 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2897/5908] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:18 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1327 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:19.439163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-84d14f05-4c53-4813-b143-59525696bfbd tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:19.440649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-84d14f05-4c53-4813-b143-59525696bfbd tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:19.461635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84d14f05-4c53-4813-b143-59525696bfbd tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:19.463111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84d14f05-4c53-4813-b143-59525696bfbd tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:19.463993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84d14f05-4c53-4813-b143-59525696bfbd tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:19.467941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84d14f05-4c53-4813-b143-59525696bfbd tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:19.726870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3a9831bf-2812-41dd-9cd5-8a55325cb2d3 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:19.728220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3a9831bf-2812-41dd-9cd5-8a55325cb2d3 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:19.741874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a9831bf-2812-41dd-9cd5-8a55325cb2d3 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:19.748105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a9831bf-2812-41dd-9cd5-8a55325cb2d3 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:19.748105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a9831bf-2812-41dd-9cd5-8a55325cb2d3 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:19.748105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a9831bf-2812-41dd-9cd5-8a55325cb2d3 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:19.748376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-84d14f05-4c53-4813-b143-59525696bfbd tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:19.756737 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-84d14f05-4c53-4813-b143-59525696bfbd tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1345 microversion: 2.1 time: 0.332215 May 28 05:06:19.757361 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3012/5909] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:06:19 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1345 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:06:19.907455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3a9831bf-2812-41dd-9cd5-8a55325cb2d3 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:19.917166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3a9831bf-2812-41dd-9cd5-8a55325cb2d3 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:19.918676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3a9831bf-2812-41dd-9cd5-8a55325cb2d3 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:19.920601 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3a9831bf-2812-41dd-9cd5-8a55325cb2d3 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1333 microversion: 2.54 time: 0.202965 May 28 05:06:19.921973 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2898/5910] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:19 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1333 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:20.774381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fb075a31-b516-4e0d-9029-aae16922882d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:20.775412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fb075a31-b516-4e0d-9029-aae16922882d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:20.794491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fb075a31-b516-4e0d-9029-aae16922882d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:20.804828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fb075a31-b516-4e0d-9029-aae16922882d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:20.806239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fb075a31-b516-4e0d-9029-aae16922882d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:20.806714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fb075a31-b516-4e0d-9029-aae16922882d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:20.942137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a711c302-3f1d-4f9f-b2ad-71442f5c7f80 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:20.943467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a711c302-3f1d-4f9f-b2ad-71442f5c7f80 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:20.974664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a711c302-3f1d-4f9f-b2ad-71442f5c7f80 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:20.975154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a711c302-3f1d-4f9f-b2ad-71442f5c7f80 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:20.981514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a711c302-3f1d-4f9f-b2ad-71442f5c7f80 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:20.981990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a711c302-3f1d-4f9f-b2ad-71442f5c7f80 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:21.159548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fb075a31-b516-4e0d-9029-aae16922882d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:21.169333 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fb075a31-b516-4e0d-9029-aae16922882d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1353 microversion: 2.1 time: 0.399232 May 28 05:06:21.169960 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3013/5911] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:06:20 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1353 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:06:21.210632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a711c302-3f1d-4f9f-b2ad-71442f5c7f80 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:21.222954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a711c302-3f1d-4f9f-b2ad-71442f5c7f80 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:21.227235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a711c302-3f1d-4f9f-b2ad-71442f5c7f80 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:21.230284 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a711c302-3f1d-4f9f-b2ad-71442f5c7f80 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1333 microversion: 2.54 time: 0.292253 May 28 05:06:21.233339 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2899/5912] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:20 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1333 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:06:22.187055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e14d69c5-a9ae-47d2-bb3f-e08cfc7afdfc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:22.188394 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e14d69c5-a9ae-47d2-bb3f-e08cfc7afdfc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:22.200637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e14d69c5-a9ae-47d2-bb3f-e08cfc7afdfc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:22.203116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e14d69c5-a9ae-47d2-bb3f-e08cfc7afdfc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:22.203116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e14d69c5-a9ae-47d2-bb3f-e08cfc7afdfc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:22.203116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e14d69c5-a9ae-47d2-bb3f-e08cfc7afdfc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:22.253705 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a49349b9-b792-4a99-8c69-9cc63cd2ce6a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:22.254505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a49349b9-b792-4a99-8c69-9cc63cd2ce6a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:22.270368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a49349b9-b792-4a99-8c69-9cc63cd2ce6a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:22.279642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a49349b9-b792-4a99-8c69-9cc63cd2ce6a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:22.283505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a49349b9-b792-4a99-8c69-9cc63cd2ce6a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:22.283505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a49349b9-b792-4a99-8c69-9cc63cd2ce6a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:22.383758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e14d69c5-a9ae-47d2-bb3f-e08cfc7afdfc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:22.392306 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e14d69c5-a9ae-47d2-bb3f-e08cfc7afdfc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1351 microversion: 2.1 time: 0.209221 May 28 05:06:22.396022 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3014/5913] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:06:22 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1351 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:06:22.452947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a49349b9-b792-4a99-8c69-9cc63cd2ce6a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:22.467936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a49349b9-b792-4a99-8c69-9cc63cd2ce6a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:22.469741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a49349b9-b792-4a99-8c69-9cc63cd2ce6a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:22.475235 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a49349b9-b792-4a99-8c69-9cc63cd2ce6a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1333 microversion: 2.54 time: 0.221497 May 28 05:06:22.475235 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2900/5914] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:22 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1333 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:22.834392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eca7c840-be2d-490d-9574-6bbac2cd5678 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:22.834908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-eca7c840-be2d-490d-9574-6bbac2cd5678 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:22.847633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eca7c840-be2d-490d-9574-6bbac2cd5678 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:22.848091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eca7c840-be2d-490d-9574-6bbac2cd5678 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:22.849137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eca7c840-be2d-490d-9574-6bbac2cd5678 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:22.849584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eca7c840-be2d-490d-9574-6bbac2cd5678 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:22.916270 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-eca7c840-be2d-490d-9574-6bbac2cd5678 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/ips" status: 200 len: 143 microversion: 2.1 time: 0.255533 May 28 05:06:22.917547 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3015/5915] 10.222.0.58 () {58 vars in 1247 bytes} [Sat May 28 05:06:22 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/ips => generated 143 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:06:23.421756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-946f0378-e838-4979-9215-9a5939273049 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:23.425974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-946f0378-e838-4979-9215-9a5939273049 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:23.450221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-946f0378-e838-4979-9215-9a5939273049 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:23.450221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-946f0378-e838-4979-9215-9a5939273049 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:23.451789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-946f0378-e838-4979-9215-9a5939273049 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:23.453850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-946f0378-e838-4979-9215-9a5939273049 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:23.490111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ea48a83e-4e2a-4e4a-8c7c-4a54ccbe187d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:23.490893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ea48a83e-4e2a-4e4a-8c7c-4a54ccbe187d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:23.494728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:06:23.511241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea48a83e-4e2a-4e4a-8c7c-4a54ccbe187d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:23.530883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea48a83e-4e2a-4e4a-8c7c-4a54ccbe187d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:23.531452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea48a83e-4e2a-4e4a-8c7c-4a54ccbe187d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:23.532076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea48a83e-4e2a-4e4a-8c7c-4a54ccbe187d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:23.792864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ea48a83e-4e2a-4e4a-8c7c-4a54ccbe187d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:23.803970 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ea48a83e-4e2a-4e4a-8c7c-4a54ccbe187d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:23.824049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ea48a83e-4e2a-4e4a-8c7c-4a54ccbe187d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:23.837360 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ea48a83e-4e2a-4e4a-8c7c-4a54ccbe187d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1354 microversion: 2.54 time: 0.351193 May 28 05:06:23.842517 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3016/5916] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:23 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1354 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:23.868183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fe31978a-e686-4596-94d0-df55afdafd73 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Action: 'create', calling method: .version_select at 0x7f77006f4430>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-158207692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBltlMFbTquJ4js5HktH84BmB6UX7cWCd7QqesGaDTd1PB0OqGe3XLKCmsx9UDF5S9Owm+7n4U34uDz7RZvM0awwje0655WOh29Z0ZNjmRYxlTImsZjeSM8Q8v+CZicmg=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:06:23.917930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-fe31978a-e686-4596-94d0-df55afdafd73 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Getting quotas for project 52f75635fa9148b4a4210710ab76b5c8. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:06:23.937907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-fe31978a-e686-4596-94d0-df55afdafd73 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Getting quotas for user 1705425a29ff413b9cf2ff39ff929a8f and project 52f75635fa9148b4a4210710ab76b5c8. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:06:23.990971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-946f0378-e838-4979-9215-9a5939273049 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:24.004182 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-946f0378-e838-4979-9215-9a5939273049 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1470 microversion: 2.1 time: 0.591429 May 28 05:06:24.016021 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2901/5917] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:06:23 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1470 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:06:24.092484 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fe31978a-e686-4596-94d0-df55afdafd73 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.228899 May 28 05:06:24.093280 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3017/5918] 10.222.0.58 () {62 vars in 1199 bytes} [Sat May 28 05:06:23 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 231 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 28 05:06:24.104946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fdd2ba9e-a58b-4b50-bc75-8c6732e5208b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-158207692", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:06:24.106896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fdd2ba9e-a58b-4b50-bc75-8c6732e5208b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:24.130391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdd2ba9e-a58b-4b50-bc75-8c6732e5208b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:24.131331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdd2ba9e-a58b-4b50-bc75-8c6732e5208b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:24.132345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdd2ba9e-a58b-4b50-bc75-8c6732e5208b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:24.134923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdd2ba9e-a58b-4b50-bc75-8c6732e5208b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:24.263192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:06:24.342300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-fdd2ba9e-a58b-4b50-bc75-8c6732e5208b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:06:24.347573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-fdd2ba9e-a58b-4b50-bc75-8c6732e5208b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:06:24.347573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-fdd2ba9e-a58b-4b50-bc75-8c6732e5208b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:06:24.347573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-fdd2ba9e-a58b-4b50-bc75-8c6732e5208b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:06:24.347573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-fdd2ba9e-a58b-4b50-bc75-8c6732e5208b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:06:24.709609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fdd2ba9e-a58b-4b50-bc75-8c6732e5208b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:24.742588 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdd2ba9e-a58b-4b50-bc75-8c6732e5208b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:24.743083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdd2ba9e-a58b-4b50-bc75-8c6732e5208b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:24.743897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdd2ba9e-a58b-4b50-bc75-8c6732e5208b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:24.744344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fdd2ba9e-a58b-4b50-bc75-8c6732e5208b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:24.851515 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fdd2ba9e-a58b-4b50-bc75-8c6732e5208b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "POST /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7/action" status: 202 len: 1136 microversion: 2.54 time: 0.750675 May 28 05:06:24.854007 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2902/5919] 10.222.0.58 () {62 vars in 1319 bytes} [Sat May 28 05:06:24 2022] POST /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7/action => generated 1136 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 28 05:06:24.873823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-86a92439-76a9-4873-99d5-2565b642c40e tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:24.875103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-86a92439-76a9-4873-99d5-2565b642c40e tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:24.882605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-86a92439-76a9-4873-99d5-2565b642c40e tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:24.884410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-86a92439-76a9-4873-99d5-2565b642c40e tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:24.885387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-86a92439-76a9-4873-99d5-2565b642c40e tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:24.885989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-86a92439-76a9-4873-99d5-2565b642c40e tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:25.021878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-46eb4166-2620-4419-a23d-bae3c6d29463 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:25.022498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-46eb4166-2620-4419-a23d-bae3c6d29463 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:25.038526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46eb4166-2620-4419-a23d-bae3c6d29463 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:25.039567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46eb4166-2620-4419-a23d-bae3c6d29463 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:25.045344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46eb4166-2620-4419-a23d-bae3c6d29463 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:25.045344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46eb4166-2620-4419-a23d-bae3c6d29463 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:25.085293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-86a92439-76a9-4873-99d5-2565b642c40e tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:25.103964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-86a92439-76a9-4873-99d5-2565b642c40e tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:25.108793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-86a92439-76a9-4873-99d5-2565b642c40e tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:25.110201 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-86a92439-76a9-4873-99d5-2565b642c40e tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.242886 May 28 05:06:25.116230 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3018/5920] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:24 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:25.276579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-016185e8-f15f-4b3c-98d5-f3584ebd26fb req-0e5681ff-7887-4c62-b0b4-8b3da4825819 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb4191f6-3ae0-4b2d-bfe8-2af221bfa115", "tag": "e7e980dd-9d32-410b-a22c-b9f4e80fdf41"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:06:25.293492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-016185e8-f15f-4b3c-98d5-f3584ebd26fb req-0e5681ff-7887-4c62-b0b4-8b3da4825819 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:25.298944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-016185e8-f15f-4b3c-98d5-f3584ebd26fb req-0e5681ff-7887-4c62-b0b4-8b3da4825819 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:25.340472 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-016185e8-f15f-4b3c-98d5-f3584ebd26fb req-0e5681ff-7887-4c62-b0b4-8b3da4825819 service nova] Creating event network-changed:e7e980dd-9d32-410b-a22c-b9f4e80fdf41 for instance fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 on n-h2-843700-1 May 28 05:06:25.360081 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-016185e8-f15f-4b3c-98d5-f3584ebd26fb req-0e5681ff-7887-4c62-b0b4-8b3da4825819 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087240 May 28 05:06:25.362511 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3019/5921] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:06:25.490207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-46eb4166-2620-4419-a23d-bae3c6d29463 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:25.503894 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-46eb4166-2620-4419-a23d-bae3c6d29463 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1470 microversion: 2.1 time: 0.483347 May 28 05:06:25.519501 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2903/5922] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:06:25 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1470 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:06:26.135263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4069d04b-801e-47e1-bef4-81bfe209aae5 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:26.135989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4069d04b-801e-47e1-bef4-81bfe209aae5 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:26.156047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4069d04b-801e-47e1-bef4-81bfe209aae5 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:26.160286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4069d04b-801e-47e1-bef4-81bfe209aae5 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:26.160286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4069d04b-801e-47e1-bef4-81bfe209aae5 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:26.163798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4069d04b-801e-47e1-bef4-81bfe209aae5 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:26.328030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4069d04b-801e-47e1-bef4-81bfe209aae5 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:26.335525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4069d04b-801e-47e1-bef4-81bfe209aae5 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:26.340099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4069d04b-801e-47e1-bef4-81bfe209aae5 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:26.343768 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4069d04b-801e-47e1-bef4-81bfe209aae5 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.212296 May 28 05:06:26.344403 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3020/5923] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:26 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:26.532050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-54671140-891d-43cd-9a9b-b6bfd9c1f604 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:26.533639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-54671140-891d-43cd-9a9b-b6bfd9c1f604 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:26.549511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=10 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:06:26.556805 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54671140-891d-43cd-9a9b-b6bfd9c1f604 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:26.558296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54671140-891d-43cd-9a9b-b6bfd9c1f604 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:26.559314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54671140-891d-43cd-9a9b-b6bfd9c1f604 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:26.563232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54671140-891d-43cd-9a9b-b6bfd9c1f604 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:26.946142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-54671140-891d-43cd-9a9b-b6bfd9c1f604 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:26.960534 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-54671140-891d-43cd-9a9b-b6bfd9c1f604 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1470 microversion: 2.1 time: 0.438171 May 28 05:06:26.968447 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2904/5924] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:06:26 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1470 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:06:27.363473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7368603d-140a-479e-a59f-415d3b085012 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:27.364020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7368603d-140a-479e-a59f-415d3b085012 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:27.378049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7368603d-140a-479e-a59f-415d3b085012 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:27.380686 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7368603d-140a-479e-a59f-415d3b085012 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:27.382213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7368603d-140a-479e-a59f-415d3b085012 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:27.382682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7368603d-140a-479e-a59f-415d3b085012 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:27.500828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7368603d-140a-479e-a59f-415d3b085012 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:27.512813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7368603d-140a-479e-a59f-415d3b085012 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:27.520090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7368603d-140a-479e-a59f-415d3b085012 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:27.523618 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7368603d-140a-479e-a59f-415d3b085012 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.163491 May 28 05:06:27.537515 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3021/5925] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:27 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:27.985273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0168d147-5b85-49c4-8ff8-e427f0d44313 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:27.986737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0168d147-5b85-49c4-8ff8-e427f0d44313 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:27.994647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0168d147-5b85-49c4-8ff8-e427f0d44313 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:27.995619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0168d147-5b85-49c4-8ff8-e427f0d44313 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:27.996485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0168d147-5b85-49c4-8ff8-e427f0d44313 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:27.997169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0168d147-5b85-49c4-8ff8-e427f0d44313 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:28.196983 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-098e2d88-aec7-4244-838e-b0616dc28720 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c69b71af-00f8-472f-8f38-6fdc1ebec5d3"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:06:28.203808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-098e2d88-aec7-4244-838e-b0616dc28720 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:28.205789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-098e2d88-aec7-4244-838e-b0616dc28720 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:28.206431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-098e2d88-aec7-4244-838e-b0616dc28720 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:28.207417 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-098e2d88-aec7-4244-838e-b0616dc28720 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:28.208032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-098e2d88-aec7-4244-838e-b0616dc28720 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:28.280692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0168d147-5b85-49c4-8ff8-e427f0d44313 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:28.293368 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0168d147-5b85-49c4-8ff8-e427f0d44313 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1470 microversion: 2.1 time: 0.311816 May 28 05:06:28.296177 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2905/5926] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:06:27 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1470 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:06:28.544349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4608bf91-f400-49f1-8814-77bee2181e50 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:28.545855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4608bf91-f400-49f1-8814-77bee2181e50 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:28.555340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4608bf91-f400-49f1-8814-77bee2181e50 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:28.561510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4608bf91-f400-49f1-8814-77bee2181e50 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:28.562519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4608bf91-f400-49f1-8814-77bee2181e50 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:28.563158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4608bf91-f400-49f1-8814-77bee2181e50 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:28.690694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4608bf91-f400-49f1-8814-77bee2181e50 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:28.700170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4608bf91-f400-49f1-8814-77bee2181e50 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:28.702747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4608bf91-f400-49f1-8814-77bee2181e50 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:28.704277 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4608bf91-f400-49f1-8814-77bee2181e50 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.165233 May 28 05:06:28.705374 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2906/5927] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:28 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:06:29.309444 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-098e2d88-aec7-4244-838e-b0616dc28720 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "POST /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.116141 May 28 05:06:29.310773 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3022/5928] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 05:06:28 2022] POST /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments => generated 194 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:06:29.324972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-48927c6a-4cdb-4e1b-95b1-2723c6fe3e55 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:29.326219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-48927c6a-4cdb-4e1b-95b1-2723c6fe3e55 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:29.343600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48927c6a-4cdb-4e1b-95b1-2723c6fe3e55 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:29.345351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48927c6a-4cdb-4e1b-95b1-2723c6fe3e55 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:29.348165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48927c6a-4cdb-4e1b-95b1-2723c6fe3e55 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:29.348828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48927c6a-4cdb-4e1b-95b1-2723c6fe3e55 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:29.714902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-48927c6a-4cdb-4e1b-95b1-2723c6fe3e55 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:29.724927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1b907e84-6689-46a0-af09-0f8fcf01ef22 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:29.725800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1b907e84-6689-46a0-af09-0f8fcf01ef22 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:29.727252 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-48927c6a-4cdb-4e1b-95b1-2723c6fe3e55 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1470 microversion: 2.1 time: 0.418127 May 28 05:06:29.729963 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2907/5929] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:06:29 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1470 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:06:29.744201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b907e84-6689-46a0-af09-0f8fcf01ef22 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:29.744948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b907e84-6689-46a0-af09-0f8fcf01ef22 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:29.745993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b907e84-6689-46a0-af09-0f8fcf01ef22 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:29.747319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b907e84-6689-46a0-af09-0f8fcf01ef22 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:30.006283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1b907e84-6689-46a0-af09-0f8fcf01ef22 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:30.024091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1b907e84-6689-46a0-af09-0f8fcf01ef22 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:30.027602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1b907e84-6689-46a0-af09-0f8fcf01ef22 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:30.028921 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1b907e84-6689-46a0-af09-0f8fcf01ef22 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.309888 May 28 05:06:30.045871 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3023/5930] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:29 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:06:30.750340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b87ebbf0-cf29-4b27-a01f-8ab56de0dea5 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:30.750340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b87ebbf0-cf29-4b27-a01f-8ab56de0dea5 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:30.766008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b87ebbf0-cf29-4b27-a01f-8ab56de0dea5 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:30.766495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b87ebbf0-cf29-4b27-a01f-8ab56de0dea5 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:30.767343 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b87ebbf0-cf29-4b27-a01f-8ab56de0dea5 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:30.767849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b87ebbf0-cf29-4b27-a01f-8ab56de0dea5 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:31.045926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b87ebbf0-cf29-4b27-a01f-8ab56de0dea5 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:31.049770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-660edd9c-02df-4050-9d24-7d8e23352a37 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:31.051050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-660edd9c-02df-4050-9d24-7d8e23352a37 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:31.059321 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b87ebbf0-cf29-4b27-a01f-8ab56de0dea5 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1470 microversion: 2.1 time: 0.317049 May 28 05:06:31.060749 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2908/5931] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:06:30 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1470 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:06:31.070395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-660edd9c-02df-4050-9d24-7d8e23352a37 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:31.070919 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-660edd9c-02df-4050-9d24-7d8e23352a37 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:31.071818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-660edd9c-02df-4050-9d24-7d8e23352a37 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:31.072260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-660edd9c-02df-4050-9d24-7d8e23352a37 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:31.197533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-660edd9c-02df-4050-9d24-7d8e23352a37 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:31.208254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-660edd9c-02df-4050-9d24-7d8e23352a37 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:31.211173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-660edd9c-02df-4050-9d24-7d8e23352a37 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:31.214096 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-660edd9c-02df-4050-9d24-7d8e23352a37 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.168545 May 28 05:06:31.214741 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3024/5932] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:31 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:06:31.732796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-0d7d633d-c795-4563-9170-a7ec02585428 req-1ab736b8-ef7e-4076-93a1-4fe7d9dce61c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4191f6-3ae0-4b2d-bfe8-2af221bfa115", "name": "network-vif-plugged", "status": "completed", "tag": "e7e980dd-9d32-410b-a22c-b9f4e80fdf41"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:06:31.751768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0d7d633d-c795-4563-9170-a7ec02585428 req-1ab736b8-ef7e-4076-93a1-4fe7d9dce61c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:31.752886 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0d7d633d-c795-4563-9170-a7ec02585428 req-1ab736b8-ef7e-4076-93a1-4fe7d9dce61c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:31.779601 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-0d7d633d-c795-4563-9170-a7ec02585428 req-1ab736b8-ef7e-4076-93a1-4fe7d9dce61c service nova] Creating event network-vif-plugged:e7e980dd-9d32-410b-a22c-b9f4e80fdf41 for instance fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 on n-h2-843700-1 May 28 05:06:31.788140 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-0d7d633d-c795-4563-9170-a7ec02585428 req-1ab736b8-ef7e-4076-93a1-4fe7d9dce61c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059906 May 28 05:06:31.789825 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2909/5933] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:06:32.082847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5597ecc3-dc7b-4695-9311-8d9a7a5b4615 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:32.085224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5597ecc3-dc7b-4695-9311-8d9a7a5b4615 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:32.096843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5597ecc3-dc7b-4695-9311-8d9a7a5b4615 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:32.099499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5597ecc3-dc7b-4695-9311-8d9a7a5b4615 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:32.100674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5597ecc3-dc7b-4695-9311-8d9a7a5b4615 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:32.103078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5597ecc3-dc7b-4695-9311-8d9a7a5b4615 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:32.240693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-63024305-4297-4abe-8b2b-6a187fa6be26 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:32.241750 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-63024305-4297-4abe-8b2b-6a187fa6be26 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:32.258707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63024305-4297-4abe-8b2b-6a187fa6be26 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:32.259481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63024305-4297-4abe-8b2b-6a187fa6be26 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:32.260508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63024305-4297-4abe-8b2b-6a187fa6be26 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:32.261118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63024305-4297-4abe-8b2b-6a187fa6be26 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:32.340154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:06:32.417086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5597ecc3-dc7b-4695-9311-8d9a7a5b4615 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:32.418934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-63024305-4297-4abe-8b2b-6a187fa6be26 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:32.429293 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5597ecc3-dc7b-4695-9311-8d9a7a5b4615 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1470 microversion: 2.1 time: 0.356053 May 28 05:06:32.432909 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3025/5934] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:06:32 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1470 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:06:32.444484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-63024305-4297-4abe-8b2b-6a187fa6be26 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:32.450956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-63024305-4297-4abe-8b2b-6a187fa6be26 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:32.455451 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-63024305-4297-4abe-8b2b-6a187fa6be26 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.226788 May 28 05:06:32.456174 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2910/5935] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:32 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:33.483911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-47c6ed5f-54c4-48b5-a3b4-d057d75b6c16 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:33.483911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-47c6ed5f-54c4-48b5-a3b4-d057d75b6c16 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:33.483911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47c6ed5f-54c4-48b5-a3b4-d057d75b6c16 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:33.483911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47c6ed5f-54c4-48b5-a3b4-d057d75b6c16 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:33.483911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47c6ed5f-54c4-48b5-a3b4-d057d75b6c16 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:33.483911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47c6ed5f-54c4-48b5-a3b4-d057d75b6c16 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:33.579764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cc324767-3921-4aa8-9b4a-9a68484b2629 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:33.579764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cc324767-3921-4aa8-9b4a-9a68484b2629 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:33.579764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc324767-3921-4aa8-9b4a-9a68484b2629 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:33.579764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc324767-3921-4aa8-9b4a-9a68484b2629 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:33.579764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc324767-3921-4aa8-9b4a-9a68484b2629 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:33.579764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc324767-3921-4aa8-9b4a-9a68484b2629 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:33.768328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cc324767-3921-4aa8-9b4a-9a68484b2629 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:33.812582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cc324767-3921-4aa8-9b4a-9a68484b2629 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:33.816221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cc324767-3921-4aa8-9b4a-9a68484b2629 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:33.821631 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cc324767-3921-4aa8-9b4a-9a68484b2629 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.348623 May 28 05:06:33.822718 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2911/5936] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:33 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:06:33.960169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=20 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:06:34.022561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-47c6ed5f-54c4-48b5-a3b4-d057d75b6c16 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:34.048579 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-47c6ed5f-54c4-48b5-a3b4-d057d75b6c16 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1641 microversion: 2.1 time: 0.602833 May 28 05:06:34.049215 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3026/5937] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:06:33 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1641 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:06:34.066667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-79be2eea-f550-473c-a64b-cf47cbdc525f tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:34.067490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-79be2eea-f550-473c-a64b-cf47cbdc525f tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:34.074187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-79be2eea-f550-473c-a64b-cf47cbdc525f tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:34.074919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-79be2eea-f550-473c-a64b-cf47cbdc525f tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:34.076712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-79be2eea-f550-473c-a64b-cf47cbdc525f tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:34.077358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-79be2eea-f550-473c-a64b-cf47cbdc525f tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:34.517151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-79be2eea-f550-473c-a64b-cf47cbdc525f tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:34.526251 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-79be2eea-f550-473c-a64b-cf47cbdc525f tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1641 microversion: 2.1 time: 0.463494 May 28 05:06:34.529769 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2912/5938] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:06:34 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1641 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:06:34.548753 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d715910d-b7e6-415e-a0d4-f4eb0789d1b7 tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:34.549474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d715910d-b7e6-415e-a0d4-f4eb0789d1b7 tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:34.556482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d715910d-b7e6-415e-a0d4-f4eb0789d1b7 tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:34.557200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d715910d-b7e6-415e-a0d4-f4eb0789d1b7 tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:34.558138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d715910d-b7e6-415e-a0d4-f4eb0789d1b7 tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:34.558733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d715910d-b7e6-415e-a0d4-f4eb0789d1b7 tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:34.842966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a0e607eb-c586-42bb-bd59-28ce152f9347 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:34.844387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a0e607eb-c586-42bb-bd59-28ce152f9347 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:34.854358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a0e607eb-c586-42bb-bd59-28ce152f9347 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:34.855657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a0e607eb-c586-42bb-bd59-28ce152f9347 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:34.856966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a0e607eb-c586-42bb-bd59-28ce152f9347 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:34.857616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a0e607eb-c586-42bb-bd59-28ce152f9347 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:34.976761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a0e607eb-c586-42bb-bd59-28ce152f9347 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:34.989467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a0e607eb-c586-42bb-bd59-28ce152f9347 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:34.998501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a0e607eb-c586-42bb-bd59-28ce152f9347 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:35.000326 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a0e607eb-c586-42bb-bd59-28ce152f9347 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.163020 May 28 05:06:35.024413 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2913/5939] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:34 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:35.172931 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d715910d-b7e6-415e-a0d4-f4eb0789d1b7 tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1792 microversion: 2.1 time: 0.628529 May 28 05:06:35.174110 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3027/5940] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:06:34 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1792 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:06:36.032579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d8cb75fa-2ac7-472e-84d4-b52971347f1d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:36.033202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d8cb75fa-2ac7-472e-84d4-b52971347f1d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:36.065078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8cb75fa-2ac7-472e-84d4-b52971347f1d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:36.065768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8cb75fa-2ac7-472e-84d4-b52971347f1d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:36.066836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8cb75fa-2ac7-472e-84d4-b52971347f1d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:36.067472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8cb75fa-2ac7-472e-84d4-b52971347f1d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:36.220220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d8cb75fa-2ac7-472e-84d4-b52971347f1d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:36.231672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d8cb75fa-2ac7-472e-84d4-b52971347f1d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:36.234584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d8cb75fa-2ac7-472e-84d4-b52971347f1d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:36.236169 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d8cb75fa-2ac7-472e-84d4-b52971347f1d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.209391 May 28 05:06:36.236916 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2914/5941] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:36 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:37.261267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5701bc1c-0d7b-4f62-875a-cc505ed7c2dc tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:37.263696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5701bc1c-0d7b-4f62-875a-cc505ed7c2dc tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:37.276260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5701bc1c-0d7b-4f62-875a-cc505ed7c2dc tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:37.277047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5701bc1c-0d7b-4f62-875a-cc505ed7c2dc tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:37.278090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5701bc1c-0d7b-4f62-875a-cc505ed7c2dc tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:37.279702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5701bc1c-0d7b-4f62-875a-cc505ed7c2dc tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:37.400607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5701bc1c-0d7b-4f62-875a-cc505ed7c2dc tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:37.405006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:06:37.416719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5701bc1c-0d7b-4f62-875a-cc505ed7c2dc tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:37.420017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5701bc1c-0d7b-4f62-875a-cc505ed7c2dc tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:37.422945 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5701bc1c-0d7b-4f62-875a-cc505ed7c2dc tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.169829 May 28 05:06:37.424996 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3028/5942] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:37 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:38.444635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-22ba0894-cbbc-4c82-9cf6-2b8f1255aa8a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:38.445908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-22ba0894-cbbc-4c82-9cf6-2b8f1255aa8a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:38.471029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22ba0894-cbbc-4c82-9cf6-2b8f1255aa8a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:38.471763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22ba0894-cbbc-4c82-9cf6-2b8f1255aa8a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:38.472732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22ba0894-cbbc-4c82-9cf6-2b8f1255aa8a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:38.474069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22ba0894-cbbc-4c82-9cf6-2b8f1255aa8a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:38.680542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-22ba0894-cbbc-4c82-9cf6-2b8f1255aa8a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:38.691578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-22ba0894-cbbc-4c82-9cf6-2b8f1255aa8a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:38.696387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-22ba0894-cbbc-4c82-9cf6-2b8f1255aa8a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:38.696387 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-22ba0894-cbbc-4c82-9cf6-2b8f1255aa8a tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.254473 May 28 05:06:38.696758 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2915/5943] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:38 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:39.191944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-62140a28-b0b8-4d86-bfac-67a3e05812f7 req-4a68cb41-bae1-4749-bf38-df87e427c9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb4191f6-3ae0-4b2d-bfe8-2af221bfa115", "tag": "e7e980dd-9d32-410b-a22c-b9f4e80fdf41"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:06:39.209607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-62140a28-b0b8-4d86-bfac-67a3e05812f7 req-4a68cb41-bae1-4749-bf38-df87e427c9b7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:39.210218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-62140a28-b0b8-4d86-bfac-67a3e05812f7 req-4a68cb41-bae1-4749-bf38-df87e427c9b7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:39.235811 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-62140a28-b0b8-4d86-bfac-67a3e05812f7 req-4a68cb41-bae1-4749-bf38-df87e427c9b7 service nova] Creating event network-changed:e7e980dd-9d32-410b-a22c-b9f4e80fdf41 for instance fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 on n-h2-843700-1 May 28 05:06:39.251535 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-62140a28-b0b8-4d86-bfac-67a3e05812f7 req-4a68cb41-bae1-4749-bf38-df87e427c9b7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180741 May 28 05:06:39.252816 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3029/5944] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:06:39.715144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fffc1969-0318-4945-807f-d548b1770a55 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:39.715787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fffc1969-0318-4945-807f-d548b1770a55 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:39.726347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fffc1969-0318-4945-807f-d548b1770a55 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:39.731455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fffc1969-0318-4945-807f-d548b1770a55 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:39.732833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fffc1969-0318-4945-807f-d548b1770a55 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:39.733291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fffc1969-0318-4945-807f-d548b1770a55 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:39.957940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fffc1969-0318-4945-807f-d548b1770a55 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:39.967481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fffc1969-0318-4945-807f-d548b1770a55 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:39.980695 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fffc1969-0318-4945-807f-d548b1770a55 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:39.982158 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fffc1969-0318-4945-807f-d548b1770a55 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.271589 May 28 05:06:39.983304 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2916/5945] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:39 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:41.003510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9f61f1e9-9ce5-4237-8a09-b9bdd9d94998 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:41.004971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9f61f1e9-9ce5-4237-8a09-b9bdd9d94998 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:41.029463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f61f1e9-9ce5-4237-8a09-b9bdd9d94998 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:41.029934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f61f1e9-9ce5-4237-8a09-b9bdd9d94998 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:41.030769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f61f1e9-9ce5-4237-8a09-b9bdd9d94998 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:41.031246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f61f1e9-9ce5-4237-8a09-b9bdd9d94998 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:41.544073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9f61f1e9-9ce5-4237-8a09-b9bdd9d94998 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:41.562520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9f61f1e9-9ce5-4237-8a09-b9bdd9d94998 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:41.564102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9f61f1e9-9ce5-4237-8a09-b9bdd9d94998 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:41.565304 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9f61f1e9-9ce5-4237-8a09-b9bdd9d94998 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.568155 May 28 05:06:41.566337 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3030/5946] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:40 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:42.584953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f46abf07-fd56-48bc-bcef-3fcd5da1ee22 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:42.585583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f46abf07-fd56-48bc-bcef-3fcd5da1ee22 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:42.596444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f46abf07-fd56-48bc-bcef-3fcd5da1ee22 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:42.601693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f46abf07-fd56-48bc-bcef-3fcd5da1ee22 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:42.602764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f46abf07-fd56-48bc-bcef-3fcd5da1ee22 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:42.603394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f46abf07-fd56-48bc-bcef-3fcd5da1ee22 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:43.002129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f46abf07-fd56-48bc-bcef-3fcd5da1ee22 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:43.022815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f46abf07-fd56-48bc-bcef-3fcd5da1ee22 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:43.032176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f46abf07-fd56-48bc-bcef-3fcd5da1ee22 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:43.032176 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f46abf07-fd56-48bc-bcef-3fcd5da1ee22 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.445316 May 28 05:06:43.032176 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2917/5947] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:42 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:44.052186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c8aba995-93aa-43e5-9b31-e654648925a2 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:44.056465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c8aba995-93aa-43e5-9b31-e654648925a2 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:44.059879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:06:44.082509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8aba995-93aa-43e5-9b31-e654648925a2 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:44.086325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8aba995-93aa-43e5-9b31-e654648925a2 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:44.089590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8aba995-93aa-43e5-9b31-e654648925a2 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:44.090277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8aba995-93aa-43e5-9b31-e654648925a2 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:44.242385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c8aba995-93aa-43e5-9b31-e654648925a2 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:44.255131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c8aba995-93aa-43e5-9b31-e654648925a2 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:44.256760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c8aba995-93aa-43e5-9b31-e654648925a2 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:44.263087 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c8aba995-93aa-43e5-9b31-e654648925a2 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.214904 May 28 05:06:44.279017 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3031/5948] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:44 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:45.285487 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-62590a6e-4a97-43ad-ae7b-7429552de88d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:45.286734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-62590a6e-4a97-43ad-ae7b-7429552de88d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:45.302518 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:06:45.304694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-62590a6e-4a97-43ad-ae7b-7429552de88d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:45.305173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-62590a6e-4a97-43ad-ae7b-7429552de88d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:45.306004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-62590a6e-4a97-43ad-ae7b-7429552de88d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:45.306457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-62590a6e-4a97-43ad-ae7b-7429552de88d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:45.449145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-62590a6e-4a97-43ad-ae7b-7429552de88d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:45.459966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-62590a6e-4a97-43ad-ae7b-7429552de88d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:45.461936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-62590a6e-4a97-43ad-ae7b-7429552de88d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:45.464438 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-62590a6e-4a97-43ad-ae7b-7429552de88d tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.183191 May 28 05:06:45.465540 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2918/5949] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:45 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:46.484704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d131ca5c-ce5f-4397-95c2-5e410194861b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:46.485345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d131ca5c-ce5f-4397-95c2-5e410194861b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:46.496400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d131ca5c-ce5f-4397-95c2-5e410194861b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:46.496915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d131ca5c-ce5f-4397-95c2-5e410194861b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:46.503771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d131ca5c-ce5f-4397-95c2-5e410194861b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:46.504726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d131ca5c-ce5f-4397-95c2-5e410194861b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:46.647661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d131ca5c-ce5f-4397-95c2-5e410194861b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:46.666336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d131ca5c-ce5f-4397-95c2-5e410194861b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:46.669568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d131ca5c-ce5f-4397-95c2-5e410194861b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:46.674085 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d131ca5c-ce5f-4397-95c2-5e410194861b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.194572 May 28 05:06:46.690847 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3032/5950] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:46 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:47.693640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9e2ebf21-ccf8-4ea7-be10-006056bfa499 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:47.695168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9e2ebf21-ccf8-4ea7-be10-006056bfa499 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:47.703425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e2ebf21-ccf8-4ea7-be10-006056bfa499 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:47.704152 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e2ebf21-ccf8-4ea7-be10-006056bfa499 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:47.705042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e2ebf21-ccf8-4ea7-be10-006056bfa499 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:47.705607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e2ebf21-ccf8-4ea7-be10-006056bfa499 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:47.810950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9e2ebf21-ccf8-4ea7-be10-006056bfa499 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:47.828717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9e2ebf21-ccf8-4ea7-be10-006056bfa499 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:47.830254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9e2ebf21-ccf8-4ea7-be10-006056bfa499 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:47.833285 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9e2ebf21-ccf8-4ea7-be10-006056bfa499 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.142940 May 28 05:06:47.834294 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2919/5951] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:47 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:48.851691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef2e9a18-3a40-4ece-ab77-ee27cb37180f tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:48.852933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ef2e9a18-3a40-4ece-ab77-ee27cb37180f tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:48.870221 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef2e9a18-3a40-4ece-ab77-ee27cb37180f tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:48.871228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef2e9a18-3a40-4ece-ab77-ee27cb37180f tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:48.872865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef2e9a18-3a40-4ece-ab77-ee27cb37180f tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:48.873627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef2e9a18-3a40-4ece-ab77-ee27cb37180f tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:48.994966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef2e9a18-3a40-4ece-ab77-ee27cb37180f tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:49.009520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef2e9a18-3a40-4ece-ab77-ee27cb37180f tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:49.013570 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef2e9a18-3a40-4ece-ab77-ee27cb37180f tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:49.014971 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ef2e9a18-3a40-4ece-ab77-ee27cb37180f tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.167535 May 28 05:06:49.020475 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3033/5952] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:48 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:50.035316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cf0d9a02-0774-4071-b357-986f93fd58ad tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:50.037090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cf0d9a02-0774-4071-b357-986f93fd58ad tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:50.053548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf0d9a02-0774-4071-b357-986f93fd58ad tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:50.053548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf0d9a02-0774-4071-b357-986f93fd58ad tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:50.053548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf0d9a02-0774-4071-b357-986f93fd58ad tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:50.053548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf0d9a02-0774-4071-b357-986f93fd58ad tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:50.160180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cf0d9a02-0774-4071-b357-986f93fd58ad tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:50.171451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cf0d9a02-0774-4071-b357-986f93fd58ad tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:50.191954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cf0d9a02-0774-4071-b357-986f93fd58ad tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:50.195221 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cf0d9a02-0774-4071-b357-986f93fd58ad tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.164127 May 28 05:06:50.198171 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2920/5953] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:50 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:51.216565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-317ca2e5-6fab-42e5-bf00-37c5f49eab38 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:51.217230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-317ca2e5-6fab-42e5-bf00-37c5f49eab38 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:51.229893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-317ca2e5-6fab-42e5-bf00-37c5f49eab38 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:51.230360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-317ca2e5-6fab-42e5-bf00-37c5f49eab38 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:51.231222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-317ca2e5-6fab-42e5-bf00-37c5f49eab38 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:51.231666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-317ca2e5-6fab-42e5-bf00-37c5f49eab38 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:51.553792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-317ca2e5-6fab-42e5-bf00-37c5f49eab38 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:51.566953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-317ca2e5-6fab-42e5-bf00-37c5f49eab38 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:51.580027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-317ca2e5-6fab-42e5-bf00-37c5f49eab38 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:51.584066 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-317ca2e5-6fab-42e5-bf00-37c5f49eab38 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1405 microversion: 2.54 time: 0.371333 May 28 05:06:51.592255 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3034/5954] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:51 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1405 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:52.610389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7aa5c6cf-3207-4b20-96c6-20ca7fe11e64 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:52.611068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7aa5c6cf-3207-4b20-96c6-20ca7fe11e64 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:52.637885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7aa5c6cf-3207-4b20-96c6-20ca7fe11e64 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:52.637885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7aa5c6cf-3207-4b20-96c6-20ca7fe11e64 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:52.637885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7aa5c6cf-3207-4b20-96c6-20ca7fe11e64 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:52.637885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7aa5c6cf-3207-4b20-96c6-20ca7fe11e64 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:52.714662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7aa5c6cf-3207-4b20-96c6-20ca7fe11e64 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:52.732689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7aa5c6cf-3207-4b20-96c6-20ca7fe11e64 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:52.735053 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7aa5c6cf-3207-4b20-96c6-20ca7fe11e64 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:52.737258 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7aa5c6cf-3207-4b20-96c6-20ca7fe11e64 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1411 microversion: 2.54 time: 0.130637 May 28 05:06:52.744063 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2921/5955] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:52 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1411 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:53.757007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-761e5e42-72f1-4540-be5d-137e5401679b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:53.757683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-761e5e42-72f1-4540-be5d-137e5401679b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:53.765257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-761e5e42-72f1-4540-be5d-137e5401679b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:53.765718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-761e5e42-72f1-4540-be5d-137e5401679b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:53.766492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-761e5e42-72f1-4540-be5d-137e5401679b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:53.766939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-761e5e42-72f1-4540-be5d-137e5401679b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:53.881346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-761e5e42-72f1-4540-be5d-137e5401679b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:53.894079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-761e5e42-72f1-4540-be5d-137e5401679b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:53.895654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-761e5e42-72f1-4540-be5d-137e5401679b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:53.901142 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-761e5e42-72f1-4540-be5d-137e5401679b tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1411 microversion: 2.54 time: 0.148019 May 28 05:06:53.922797 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3035/5956] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:53 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1411 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:54.937827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-52d4278a-4c80-4951-95e1-9d8d82ed0c93 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:54.940585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-52d4278a-4c80-4951-95e1-9d8d82ed0c93 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:54.963317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52d4278a-4c80-4951-95e1-9d8d82ed0c93 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:54.966563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52d4278a-4c80-4951-95e1-9d8d82ed0c93 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:54.969131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52d4278a-4c80-4951-95e1-9d8d82ed0c93 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:54.972002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52d4278a-4c80-4951-95e1-9d8d82ed0c93 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:55.137812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-52d4278a-4c80-4951-95e1-9d8d82ed0c93 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:55.151726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-52d4278a-4c80-4951-95e1-9d8d82ed0c93 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:55.153603 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-52d4278a-4c80-4951-95e1-9d8d82ed0c93 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:55.156456 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-52d4278a-4c80-4951-95e1-9d8d82ed0c93 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1396 microversion: 2.54 time: 0.225623 May 28 05:06:55.168744 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2922/5957] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:54 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1396 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:55.187430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-afd9a952-c71c-4af9-b4d9-1fc152aa62ec tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '.version_select at 0x7f7700737820>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:55.296948 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-afd9a952-c71c-4af9-b4d9-1fc152aa62ec tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-158207692" status: 204 len: 0 microversion: 2.54 time: 0.114258 May 28 05:06:55.297650 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3036/5958] 10.222.0.58 () {60 vars in 1315 bytes} [Sat May 28 05:06:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-158207692 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 05:06:55.315866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5101aa39-eff8-458a-9e9d-3c8c6d27943c tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:55.316467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5101aa39-eff8-458a-9e9d-3c8c6d27943c tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:55.337062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5101aa39-eff8-458a-9e9d-3c8c6d27943c tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:55.340029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5101aa39-eff8-458a-9e9d-3c8c6d27943c tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:55.341599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5101aa39-eff8-458a-9e9d-3c8c6d27943c tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:55.346673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5101aa39-eff8-458a-9e9d-3c8c6d27943c tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:55.390976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5101aa39-eff8-458a-9e9d-3c8c6d27943c tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:06:55.896449 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5101aa39-eff8-458a-9e9d-3c8c6d27943c tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "DELETE /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 204 len: 0 microversion: 2.54 time: 0.584507 May 28 05:06:55.900655 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2923/5959] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 05:06:55 2022] DELETE /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 05:06:55.907801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0f4ac162-f864-47e1-a9fa-b292703a1311 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:55.908738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0f4ac162-f864-47e1-a9fa-b292703a1311 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:55.935569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f4ac162-f864-47e1-a9fa-b292703a1311 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:55.935569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f4ac162-f864-47e1-a9fa-b292703a1311 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:55.953891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f4ac162-f864-47e1-a9fa-b292703a1311 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:55.954734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f4ac162-f864-47e1-a9fa-b292703a1311 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:56.097701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0f4ac162-f864-47e1-a9fa-b292703a1311 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:56.110922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0f4ac162-f864-47e1-a9fa-b292703a1311 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:56.112668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0f4ac162-f864-47e1-a9fa-b292703a1311 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:56.114121 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0f4ac162-f864-47e1-a9fa-b292703a1311 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1402 microversion: 2.54 time: 0.211837 May 28 05:06:56.126344 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3037/5960] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:55 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1402 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:57.138402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d01af613-63f2-412b-a5a0-bfb080008ff8 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:57.139168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d01af613-63f2-412b-a5a0-bfb080008ff8 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:57.173237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d01af613-63f2-412b-a5a0-bfb080008ff8 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:57.173698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d01af613-63f2-412b-a5a0-bfb080008ff8 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:57.174507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d01af613-63f2-412b-a5a0-bfb080008ff8 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:57.174945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d01af613-63f2-412b-a5a0-bfb080008ff8 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:57.347023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d01af613-63f2-412b-a5a0-bfb080008ff8 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:57.358975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d01af613-63f2-412b-a5a0-bfb080008ff8 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:57.362740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d01af613-63f2-412b-a5a0-bfb080008ff8 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:57.364452 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d01af613-63f2-412b-a5a0-bfb080008ff8 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1402 microversion: 2.54 time: 0.233153 May 28 05:06:57.377379 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2924/5961] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:57 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1402 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:58.383799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-73d21732-9c71-40a4-8b31-5f31a7dfb575 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:58.389060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-73d21732-9c71-40a4-8b31-5f31a7dfb575 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:58.394056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73d21732-9c71-40a4-8b31-5f31a7dfb575 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:58.407507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73d21732-9c71-40a4-8b31-5f31a7dfb575 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:58.415736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73d21732-9c71-40a4-8b31-5f31a7dfb575 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:58.416196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73d21732-9c71-40a4-8b31-5f31a7dfb575 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:58.483704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73d21732-9c71-40a4-8b31-5f31a7dfb575 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:58.484259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73d21732-9c71-40a4-8b31-5f31a7dfb575 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:58.484800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-73d21732-9c71-40a4-8b31-5f31a7dfb575 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lazy-loading 'fault' on Instance uuid 52e41961-c710-4a9d-aed2-d26e72a46fc7 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:06:58.531691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a4400b7d-7050-4120-b27f-37914642cb59 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:58.533362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a4400b7d-7050-4120-b27f-37914642cb59 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:58.541267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4400b7d-7050-4120-b27f-37914642cb59 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:58.542140 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4400b7d-7050-4120-b27f-37914642cb59 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:58.543337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4400b7d-7050-4120-b27f-37914642cb59 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:58.544261 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4400b7d-7050-4120-b27f-37914642cb59 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:58.546832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-73d21732-9c71-40a4-8b31-5f31a7dfb575 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:58.560815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-73d21732-9c71-40a4-8b31-5f31a7dfb575 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:58.576557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:06:58.577024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-73d21732-9c71-40a4-8b31-5f31a7dfb575 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1705425a29ff413b9cf2ff39ff929a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f75635fa9148b4a4210710ab76b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:06:58.578327 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-73d21732-9c71-40a4-8b31-5f31a7dfb575 tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 200 len: 1407 microversion: 2.54 time: 0.198693 May 28 05:06:58.580414 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3038/5962] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:58 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:06:58.606817 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a4400b7d-7050-4120-b27f-37914642cb59 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078882 May 28 05:06:58.612895 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2925/5963] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:06:58 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:06:58.619616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f128ca91-cdeb-437c-b43a-97baaa1e657f tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:58.620142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f128ca91-cdeb-437c-b43a-97baaa1e657f tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:58.648750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f128ca91-cdeb-437c-b43a-97baaa1e657f tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:58.650483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f128ca91-cdeb-437c-b43a-97baaa1e657f tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:58.654013 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f128ca91-cdeb-437c-b43a-97baaa1e657f tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:58.654476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f128ca91-cdeb-437c-b43a-97baaa1e657f tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:58.702619 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f128ca91-cdeb-437c-b43a-97baaa1e657f tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments/c69b71af-00f8-472f-8f38-6fdc1ebec5d3" status: 200 len: 194 microversion: 2.1 time: 0.086794 May 28 05:06:58.703204 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3039/5964] 10.222.0.58 () {58 vars in 1412 bytes} [Sat May 28 05:06:58 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments/c69b71af-00f8-472f-8f38-6fdc1ebec5d3 => generated 194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:06:59.598200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3e7ecdb6-20b9-4c43-97c7-78be487b66cd tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:06:59.598827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3e7ecdb6-20b9-4c43-97c7-78be487b66cd tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] [instance: 52e41961-c710-4a9d-aed2-d26e72a46fc7] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:06:59.606944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e7ecdb6-20b9-4c43-97c7-78be487b66cd tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:59.607417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e7ecdb6-20b9-4c43-97c7-78be487b66cd tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:59.608238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e7ecdb6-20b9-4c43-97c7-78be487b66cd tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:06:59.608688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e7ecdb6-20b9-4c43-97c7-78be487b66cd tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-3e7ecdb6-20b9-4c43-97c7-78be487b66cd tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] HTTP exception thrown: Instance 52e41961-c710-4a9d-aed2-d26e72a46fc7 could not be found. May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3e7ecdb6-20b9-4c43-97c7-78be487b66cd tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Request method failure captured: May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 HTTP/1.1 May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABika3EQVV9eJGps379C9XYax2qD4C_YdLm12yUINqejJf8r8wVUUKuw7pSSA0zZDjVhLMzkgub1UaKJtV0vE_oGECKzLhDAqmA04VTprdniMHgi3L5bmQIyHQWEEmliC68V1-sMaKag2IwAh4GKnXLXHxdZqQVtYOWpeAz7UbTGaLVBTE May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-Openstack-Nova-Api-Version: 2.54 May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 52f75635fa9148b4a4210710ab76b5c8 May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerShowV254Test-577026320 May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_52f75635fa9148b4a4210710ab76b5c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/52f75635fa9148b4a4210710ab76b5c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/52f75635fa9148b4a4210710ab76b5c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/52f75635fa9148b4a4210710ab76b5c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerShowV254Test-577026320 May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 52f75635fa9148b4a4210710ab76b5c8 May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerShowV254Test-577026320 May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerShowV254Test-577026320-project May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 1705425a29ff413b9cf2ff39ff929a8f May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerShowV254Test-577026320-project May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 52e41961-c710-4a9d-aed2-d26e72a46fc7 could not be found. May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '52e41961-c710-4a9d-aed2-d26e72a46fc7'} May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52e41961-c710-4a9d-aed2-d26e72a46fc7 could not be found. May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:06:59.627779 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:06:59.633059 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52e41961-c710-4a9d-aed2-d26e72a46fc7 could not be found. May 28 05:06:59.633059 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:06:59.633059 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:06:59.633059 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:06:59.633059 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:06:59.633059 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:06:59.633059 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:06:59.633059 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:06:59.633059 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:06:59.633059 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52e41961-c710-4a9d-aed2-d26e72a46fc7 could not be found. May 28 05:06:59.633059 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:06:59.633059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3e7ecdb6-20b9-4c43-97c7-78be487b66cd tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] Returning 404 to user: Instance 52e41961-c710-4a9d-aed2-d26e72a46fc7 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:06:59.633059 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3e7ecdb6-20b9-4c43-97c7-78be487b66cd tempest-ServerShowV254Test-577026320 tempest-ServerShowV254Test-577026320-project] 10.222.0.58 "GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7" status: 404 len: 111 microversion: 2.54 time: 0.034153 May 28 05:06:59.635401 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2926/5965] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:06:59 2022] GET /compute/v2.1/servers/52e41961-c710-4a9d-aed2-d26e72a46fc7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 05:07:02.877204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-43d8e5ef-6023-4d1d-9e43-22b96db0faa1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a603cdf-2c79-49c4-901f-caceb3a1d390"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:07:02.879423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-43d8e5ef-6023-4d1d-9e43-22b96db0faa1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:02.905659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43d8e5ef-6023-4d1d-9e43-22b96db0faa1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:02.906126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43d8e5ef-6023-4d1d-9e43-22b96db0faa1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:02.906913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43d8e5ef-6023-4d1d-9e43-22b96db0faa1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:02.907375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43d8e5ef-6023-4d1d-9e43-22b96db0faa1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:03.982610 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-43d8e5ef-6023-4d1d-9e43-22b96db0faa1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "POST /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.109118 May 28 05:07:03.983462 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3040/5966] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 05:07:02 2022] POST /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments => generated 194 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:07:04.160339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-22b5a8b4-a901-4dd4-b5e4-fc8f5ce686ec tempest-ExtensionsTest-269753101 tempest-ExtensionsTest-269753101-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:04.163473 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-22b5a8b4-a901-4dd4-b5e4-fc8f5ce686ec tempest-ExtensionsTest-269753101 tempest-ExtensionsTest-269753101-project] 10.222.0.58 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.339229 May 28 05:07:04.168984 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2927/5967] 10.222.0.58 () {58 vars in 1169 bytes} [Sat May 28 05:07:03 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:07:04.179210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-40ce5d92-52a9-4c4c-976b-b266f1803eaf tempest-ExtensionsTest-269753101 tempest-ExtensionsTest-269753101-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:04.185511 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-40ce5d92-52a9-4c4c-976b-b266f1803eaf tempest-ExtensionsTest-269753101 tempest-ExtensionsTest-269753101-project] 10.222.0.58 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.014293 May 28 05:07:04.188375 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3041/5968] 10.222.0.58 () {58 vars in 1133 bytes} [Sat May 28 05:07:04 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:07:14.408067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:07:14.409646 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:07:14.415372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-183c5179-917e-4ddb-938e-b137c5d9fdba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1580763524", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "7299b1cb-835b-44d1-90be-110b92b5e089"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:07:14.507583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-183c5179-917e-4ddb-938e-b137c5d9fdba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] validate_networks() for [('7299b1cb-835b-44d1-90be-110b92b5e089', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:07:15.241115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-183c5179-917e-4ddb-938e-b137c5d9fdba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:07:15.241708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-183c5179-917e-4ddb-938e-b137c5d9fdba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:07:15.242309 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-183c5179-917e-4ddb-938e-b137c5d9fdba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:07:15.243131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-183c5179-917e-4ddb-938e-b137c5d9fdba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:07:15.249011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-183c5179-917e-4ddb-938e-b137c5d9fdba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:07:15.260334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-183c5179-917e-4ddb-938e-b137c5d9fdba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:15.264574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-183c5179-917e-4ddb-938e-b137c5d9fdba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:15.265649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-183c5179-917e-4ddb-938e-b137c5d9fdba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:15.266108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-183c5179-917e-4ddb-938e-b137c5d9fdba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:15.354822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-183c5179-917e-4ddb-938e-b137c5d9fdba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Getting quotas for project 3833032727344d68b18149e6fdc20bde. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:07:15.371995 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-183c5179-917e-4ddb-938e-b137c5d9fdba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Getting quotas for user 0313b050ae35491e830a4adce40453ed and project 3833032727344d68b18149e6fdc20bde. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:07:15.401125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-183c5179-917e-4ddb-938e-b137c5d9fdba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:07:15.404068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-183c5179-917e-4ddb-938e-b137c5d9fdba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:07:15.619440 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-183c5179-917e-4ddb-938e-b137c5d9fdba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.213109 May 28 05:07:15.623043 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2928/5969] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:07:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:07:15.630980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d6d287a5-e4ca-4b9f-b8b6-48ce306fa010 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:15.631857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d6d287a5-e4ca-4b9f-b8b6-48ce306fa010 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:15.644732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:07:15.645989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:07:15.840296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d6d287a5-e4ca-4b9f-b8b6-48ce306fa010 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:15.859236 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d6d287a5-e4ca-4b9f-b8b6-48ce306fa010 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd" status: 200 len: 1219 microversion: 2.1 time: 0.230923 May 28 05:07:15.862611 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3042/5970] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:15 2022] GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd => generated 1219 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:16.882949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53a83017-0c03-4754-b90a-9b3b3ec01907 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:16.885488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-53a83017-0c03-4754-b90a-9b3b3ec01907 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:17.052457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-53a83017-0c03-4754-b90a-9b3b3ec01907 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:17.066367 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-53a83017-0c03-4754-b90a-9b3b3ec01907 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd" status: 200 len: 1219 microversion: 2.1 time: 0.188415 May 28 05:07:17.089350 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2929/5971] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:16 2022] GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd => generated 1219 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:18.089212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-52862e9c-83b7-4ec9-8d17-f16148252e8f tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:18.101985 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-52862e9c-83b7-4ec9-8d17-f16148252e8f tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:18.166541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52862e9c-83b7-4ec9-8d17-f16148252e8f tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:18.169420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52862e9c-83b7-4ec9-8d17-f16148252e8f tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:18.174699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52862e9c-83b7-4ec9-8d17-f16148252e8f tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:18.178043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52862e9c-83b7-4ec9-8d17-f16148252e8f tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:18.340556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-52862e9c-83b7-4ec9-8d17-f16148252e8f tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:18.349329 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-52862e9c-83b7-4ec9-8d17-f16148252e8f tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd" status: 200 len: 1215 microversion: 2.1 time: 0.269202 May 28 05:07:18.351913 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3043/5972] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:18 2022] GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd => generated 1215 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:19.377594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f038b2b8-5e16-41d7-ab00-3b2958fa6f72 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:19.379575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f038b2b8-5e16-41d7-ab00-3b2958fa6f72 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:19.403871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f038b2b8-5e16-41d7-ab00-3b2958fa6f72 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:19.404343 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f038b2b8-5e16-41d7-ab00-3b2958fa6f72 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:19.407027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f038b2b8-5e16-41d7-ab00-3b2958fa6f72 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:19.418612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f038b2b8-5e16-41d7-ab00-3b2958fa6f72 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:20.010284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6b62b6c6-7930-4225-829f-216cb4962884 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Action: 'create', calling method: .version_select at 0x7f77006b45e0>, body: {"keypair": {"name": "tempest-keypair-751984870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXwatMZ13GMrm+T1FdwI+TWe+sFk+8YJx7tCNPUhtHwfDgVyBzjVHNia3mVLrskp9s7wMtmQtk6rruOtp4CVXEy2zHxItgjVC50VY+6iQS88lO+PFMETvuu4uQ/F5Fn5g=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:07:20.041153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-6b62b6c6-7930-4225-829f-216cb4962884 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Getting quotas for project ecff011ab9254460a5f9d4c27f1b1932. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:07:20.056439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-6b62b6c6-7930-4225-829f-216cb4962884 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Getting quotas for user 72e4a9ee07a848248029dfa7bf78192c and project ecff011ab9254460a5f9d4c27f1b1932. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:07:20.139691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f038b2b8-5e16-41d7-ab00-3b2958fa6f72 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:20.158851 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f038b2b8-5e16-41d7-ab00-3b2958fa6f72 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd" status: 200 len: 1289 microversion: 2.1 time: 0.794244 May 28 05:07:20.161827 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2930/5973] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:19 2022] GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd => generated 1289 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:20.177335 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6b62b6c6-7930-4225-829f-216cb4962884 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.487843 May 28 05:07:20.178277 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3044/5974] 10.222.0.58 () {62 vars in 1199 bytes} [Sat May 28 05:07:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 490 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 28 05:07:21.180884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9b0f3702-dd8b-4491-80b5-64a8a7ae8fad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:21.182027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9b0f3702-dd8b-4491-80b5-64a8a7ae8fad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:21.197595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b0f3702-dd8b-4491-80b5-64a8a7ae8fad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:21.198464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b0f3702-dd8b-4491-80b5-64a8a7ae8fad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:21.202321 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b0f3702-dd8b-4491-80b5-64a8a7ae8fad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:21.203634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b0f3702-dd8b-4491-80b5-64a8a7ae8fad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:21.908140 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9b0f3702-dd8b-4491-80b5-64a8a7ae8fad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:21.917936 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9b0f3702-dd8b-4491-80b5-64a8a7ae8fad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd" status: 200 len: 1319 microversion: 2.1 time: 0.740980 May 28 05:07:21.919335 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2931/5975] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:21 2022] GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd => generated 1319 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:22.935508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-39a6690b-3f38-4727-a96c-e883823c9308 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:22.936846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-39a6690b-3f38-4727-a96c-e883823c9308 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:22.949062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39a6690b-3f38-4727-a96c-e883823c9308 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:22.950028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39a6690b-3f38-4727-a96c-e883823c9308 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:22.951034 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39a6690b-3f38-4727-a96c-e883823c9308 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:22.955556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39a6690b-3f38-4727-a96c-e883823c9308 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:23.586042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-39a6690b-3f38-4727-a96c-e883823c9308 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:23.605935 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-39a6690b-3f38-4727-a96c-e883823c9308 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd" status: 200 len: 1319 microversion: 2.1 time: 0.671327 May 28 05:07:23.609480 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3045/5976] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:22 2022] GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd => generated 1319 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:24.625870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a1c781e3-7a9b-472c-9c8d-fc2199c235ba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:24.627277 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a1c781e3-7a9b-472c-9c8d-fc2199c235ba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:24.642115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1c781e3-7a9b-472c-9c8d-fc2199c235ba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:24.642958 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1c781e3-7a9b-472c-9c8d-fc2199c235ba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:24.655916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1c781e3-7a9b-472c-9c8d-fc2199c235ba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:24.657885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1c781e3-7a9b-472c-9c8d-fc2199c235ba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:25.308855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:07:25.540132 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a1c781e3-7a9b-472c-9c8d-fc2199c235ba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:25.572949 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a1c781e3-7a9b-472c-9c8d-fc2199c235ba tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd" status: 200 len: 1319 microversion: 2.1 time: 0.950870 May 28 05:07:25.576423 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2932/5977] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:24 2022] GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd => generated 1319 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:25.796781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-b070fb84-c10d-4006-bb6e-2e3d5aae85e9 req-0e33d878-f559-40b9-9919-7758d7eabf1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57622bb5-3fad-45a7-b416-7954ff7434fd", "tag": "4406b18a-8ae4-4b5c-ad57-c07d834eb7c1"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:07:25.822504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b070fb84-c10d-4006-bb6e-2e3d5aae85e9 req-0e33d878-f559-40b9-9919-7758d7eabf1d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:25.823042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b070fb84-c10d-4006-bb6e-2e3d5aae85e9 req-0e33d878-f559-40b9-9919-7758d7eabf1d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:25.866737 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-b070fb84-c10d-4006-bb6e-2e3d5aae85e9 req-0e33d878-f559-40b9-9919-7758d7eabf1d service nova] Creating event network-changed:4406b18a-8ae4-4b5c-ad57-c07d834eb7c1 for instance 57622bb5-3fad-45a7-b416-7954ff7434fd on n-h1-843700-1 May 28 05:07:25.907716 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-b070fb84-c10d-4006-bb6e-2e3d5aae85e9 req-0e33d878-f559-40b9-9919-7758d7eabf1d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.474045 May 28 05:07:25.907716 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3046/5978] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:07:26.592827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f5b68cfe-5fe9-49d6-9568-9960a71285a1 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:26.594424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f5b68cfe-5fe9-49d6-9568-9960a71285a1 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:26.634906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5b68cfe-5fe9-49d6-9568-9960a71285a1 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:26.635696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5b68cfe-5fe9-49d6-9568-9960a71285a1 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:26.641495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5b68cfe-5fe9-49d6-9568-9960a71285a1 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:26.642024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5b68cfe-5fe9-49d6-9568-9960a71285a1 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:27.056976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=8 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:07:27.156271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cc3aa20d-9a87-4a60-b8d8-f584c08833c4 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Action: 'create', calling method: .version_select at 0x7f77006b40d0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2144436971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNBR3OkVa50a45KdPjoqAYmgXMhi9mWhHRMf7JOzMJFFpjySB9To4pFvS+NsUZHBDQJEGWx7cfnt4GqPlIiygiFGHfV7HI175L2bhLwnnHe+ysxzjXGWwInMaIwslL9KA=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:07:27.190122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-cc3aa20d-9a87-4a60-b8d8-f584c08833c4 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Getting quotas for project 7216e0203810449f94f6da658c532406. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:07:27.205482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-cc3aa20d-9a87-4a60-b8d8-f584c08833c4 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Getting quotas for user 2e045790caa7421b86d3d3a8075cdaa7 and project 7216e0203810449f94f6da658c532406. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:07:27.332584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f5b68cfe-5fe9-49d6-9568-9960a71285a1 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:27.342922 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f5b68cfe-5fe9-49d6-9568-9960a71285a1 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd" status: 200 len: 1319 microversion: 2.1 time: 0.755030 May 28 05:07:27.343741 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2933/5979] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:26 2022] GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd => generated 1319 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:27.349942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-80e6e643-1b9c-472d-9630-e2f486d67d2d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1157048738", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0740421f-fd38-4d67-bd2f-b0385e3493a3"}], "security_groups": [{"name": "tempest-securitygroup--655533250"}], "key_name": "tempest-keypair-751984870", "user_data": "}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:07:27.361983 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cc3aa20d-9a87-4a60-b8d8-f584c08833c4 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.210960 May 28 05:07:27.370404 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3047/5980] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 05:07:27 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:07:27.581276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-80e6e643-1b9c-472d-9630-e2f486d67d2d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] validate_networks() for [('0740421f-fd38-4d67-bd2f-b0385e3493a3', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:07:28.362166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ed25ca7c-76dc-4c53-b4d4-42aa49a933e9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:28.362908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ed25ca7c-76dc-4c53-b4d4-42aa49a933e9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:28.379247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed25ca7c-76dc-4c53-b4d4-42aa49a933e9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:28.379710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed25ca7c-76dc-4c53-b4d4-42aa49a933e9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:28.380494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed25ca7c-76dc-4c53-b4d4-42aa49a933e9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:28.380931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ed25ca7c-76dc-4c53-b4d4-42aa49a933e9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:28.714107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ed25ca7c-76dc-4c53-b4d4-42aa49a933e9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:28.723573 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ed25ca7c-76dc-4c53-b4d4-42aa49a933e9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd" status: 200 len: 1319 microversion: 2.1 time: 0.366395 May 28 05:07:28.733737 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3048/5981] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:28 2022] GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:07:29.415442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-80e6e643-1b9c-472d-9630-e2f486d67d2d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:07:29.417931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-80e6e643-1b9c-472d-9630-e2f486d67d2d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:07:29.418593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-80e6e643-1b9c-472d-9630-e2f486d67d2d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:07:29.419212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-80e6e643-1b9c-472d-9630-e2f486d67d2d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:07:29.420069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-80e6e643-1b9c-472d-9630-e2f486d67d2d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:07:29.447853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80e6e643-1b9c-472d-9630-e2f486d67d2d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:29.461667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80e6e643-1b9c-472d-9630-e2f486d67d2d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:29.462746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80e6e643-1b9c-472d-9630-e2f486d67d2d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:29.471656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80e6e643-1b9c-472d-9630-e2f486d67d2d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:29.519648 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-80e6e643-1b9c-472d-9630-e2f486d67d2d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Getting quotas for project ecff011ab9254460a5f9d4c27f1b1932. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:07:29.527183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-80e6e643-1b9c-472d-9630-e2f486d67d2d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Getting quotas for user 72e4a9ee07a848248029dfa7bf78192c and project ecff011ab9254460a5f9d4c27f1b1932. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:07:29.572909 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-80e6e643-1b9c-472d-9630-e2f486d67d2d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:07:29.575908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-80e6e643-1b9c-472d-9630-e2f486d67d2d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:07:29.742197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-20b7efd9-54c2-419e-9270-7934032be457 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:29.743417 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-20b7efd9-54c2-419e-9270-7934032be457 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:29.761661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-20b7efd9-54c2-419e-9270-7934032be457 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:29.762621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-20b7efd9-54c2-419e-9270-7934032be457 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:29.763692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-20b7efd9-54c2-419e-9270-7934032be457 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:29.765111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-20b7efd9-54c2-419e-9270-7934032be457 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:30.051986 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-20b7efd9-54c2-419e-9270-7934032be457 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:30.063815 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-20b7efd9-54c2-419e-9270-7934032be457 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd" status: 200 len: 1319 microversion: 2.1 time: 0.326750 May 28 05:07:30.065742 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3049/5982] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:29 2022] GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:07:30.155890 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-80e6e643-1b9c-472d-9630-e2f486d67d2d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.810464 May 28 05:07:30.156576 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2934/5983] 10.222.0.58 () {62 vars in 1187 bytes} [Sat May 28 05:07:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 2812 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 05:07:30.167575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ca5eb068-c688-4849-b7dd-f801ade76316 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:30.168487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ca5eb068-c688-4849-b7dd-f801ade76316 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:30.186218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-db7a74f3-3fb1-4807-8fa2-bad50d1ee79d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1555456536", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "a19f0a08-afae-4656-a38a-786e667e7b1b"}], "key_name": "tempest-TestSecurityGroupsBasicOps-199357320", "security_groups": []}, "os:scheduler_hints": {"different_host": ["fb4191f6-3ae0-4b2d-bfe8-2af221bfa115"]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:07:30.335720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-db7a74f3-3fb1-4807-8fa2-bad50d1ee79d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] validate_networks() for [('a19f0a08-afae-4656-a38a-786e667e7b1b', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:07:30.398201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ca5eb068-c688-4849-b7dd-f801ade76316 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:30.409454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ca5eb068-c688-4849-b7dd-f801ade76316 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:30.413833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ca5eb068-c688-4849-b7dd-f801ade76316 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:30.428557 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ca5eb068-c688-4849-b7dd-f801ade76316 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1281 microversion: 2.20 time: 0.265407 May 28 05:07:30.429163 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3050/5984] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:07:30 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1281 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:07:31.013046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-db7a74f3-3fb1-4807-8fa2-bad50d1ee79d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:07:31.013588 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-db7a74f3-3fb1-4807-8fa2-bad50d1ee79d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:07:31.013958 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-db7a74f3-3fb1-4807-8fa2-bad50d1ee79d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:07:31.014377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-db7a74f3-3fb1-4807-8fa2-bad50d1ee79d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:07:31.014864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-db7a74f3-3fb1-4807-8fa2-bad50d1ee79d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:07:31.033694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db7a74f3-3fb1-4807-8fa2-bad50d1ee79d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:31.035532 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db7a74f3-3fb1-4807-8fa2-bad50d1ee79d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:31.036412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db7a74f3-3fb1-4807-8fa2-bad50d1ee79d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:31.036867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db7a74f3-3fb1-4807-8fa2-bad50d1ee79d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:31.082071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e915da1b-dc94-49a6-88fc-0e545ebb7e94 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:31.085029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-db7a74f3-3fb1-4807-8fa2-bad50d1ee79d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Getting quotas for project 831c7c287df6450c92a8103d2c1a6521. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:07:31.085957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e915da1b-dc94-49a6-88fc-0e545ebb7e94 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:31.100497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e915da1b-dc94-49a6-88fc-0e545ebb7e94 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:31.100963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e915da1b-dc94-49a6-88fc-0e545ebb7e94 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:31.101753 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e915da1b-dc94-49a6-88fc-0e545ebb7e94 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:31.102197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e915da1b-dc94-49a6-88fc-0e545ebb7e94 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:31.102930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-db7a74f3-3fb1-4807-8fa2-bad50d1ee79d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Getting quotas for user 72e8b077e13842ebb336a8d0861373f5 and project 831c7c287df6450c92a8103d2c1a6521. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:07:31.142954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-db7a74f3-3fb1-4807-8fa2-bad50d1ee79d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:07:31.152290 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-db7a74f3-3fb1-4807-8fa2-bad50d1ee79d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:07:31.375153 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-db7a74f3-3fb1-4807-8fa2-bad50d1ee79d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.198609 May 28 05:07:31.379382 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2935/5985] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:07:30 2022] POST /compute/v2.1/servers => generated 361 bytes in 1203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:07:31.397334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6b454015-8fcc-4802-ae7d-da73cdaa020d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:31.398241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6b454015-8fcc-4802-ae7d-da73cdaa020d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:31.782911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6b454015-8fcc-4802-ae7d-da73cdaa020d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:31.791935 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6b454015-8fcc-4802-ae7d-da73cdaa020d tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 200 len: 1241 microversion: 2.1 time: 0.402087 May 28 05:07:31.813354 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2936/5986] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:31 2022] GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 1241 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:31.818709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-39e134fc-d04f-4b65-ab53-72dbda64f168 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:31.819284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-39e134fc-d04f-4b65-ab53-72dbda64f168 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:31.972837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-39e134fc-d04f-4b65-ab53-72dbda64f168 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:31.980873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-39e134fc-d04f-4b65-ab53-72dbda64f168 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:31.987294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-39e134fc-d04f-4b65-ab53-72dbda64f168 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:31.988224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e915da1b-dc94-49a6-88fc-0e545ebb7e94 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:31.988873 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-39e134fc-d04f-4b65-ab53-72dbda64f168 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1281 microversion: 2.20 time: 0.174212 May 28 05:07:31.991024 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2937/5987] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:07:31 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1281 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:07:32.013740 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e915da1b-dc94-49a6-88fc-0e545ebb7e94 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd" status: 200 len: 1319 microversion: 2.1 time: 0.934265 May 28 05:07:32.022435 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3051/5988] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:31 2022] GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd => generated 1319 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:32.811277 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1a7ba457-d716-4781-97a4-66dde5c1e328 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:32.812658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1a7ba457-d716-4781-97a4-66dde5c1e328 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:32.829095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a7ba457-d716-4781-97a4-66dde5c1e328 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:32.843355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a7ba457-d716-4781-97a4-66dde5c1e328 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:32.844436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a7ba457-d716-4781-97a4-66dde5c1e328 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:32.845385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a7ba457-d716-4781-97a4-66dde5c1e328 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:33.014361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-871d3d6c-694a-447d-955d-a015a9dc0207 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:33.015744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-871d3d6c-694a-447d-955d-a015a9dc0207 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:33.021110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1a7ba457-d716-4781-97a4-66dde5c1e328 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:33.036792 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1a7ba457-d716-4781-97a4-66dde5c1e328 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 200 len: 1245 microversion: 2.1 time: 0.231241 May 28 05:07:33.047496 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2938/5989] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:32 2022] GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 1245 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:33.056008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-871d3d6c-694a-447d-955d-a015a9dc0207 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:33.056887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-871d3d6c-694a-447d-955d-a015a9dc0207 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:33.057953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-871d3d6c-694a-447d-955d-a015a9dc0207 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:33.058600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-871d3d6c-694a-447d-955d-a015a9dc0207 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:33.065309 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-93220b4f-2711-45bc-ab33-37d77cf52190 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:33.068660 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-93220b4f-2711-45bc-ab33-37d77cf52190 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:33.078225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93220b4f-2711-45bc-ab33-37d77cf52190 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:33.078772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93220b4f-2711-45bc-ab33-37d77cf52190 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:33.080067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93220b4f-2711-45bc-ab33-37d77cf52190 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:33.080709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93220b4f-2711-45bc-ab33-37d77cf52190 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:33.205090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-871d3d6c-694a-447d-955d-a015a9dc0207 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:33.218513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-871d3d6c-694a-447d-955d-a015a9dc0207 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:33.222636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-871d3d6c-694a-447d-955d-a015a9dc0207 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:33.224394 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-871d3d6c-694a-447d-955d-a015a9dc0207 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1333 microversion: 2.20 time: 0.215322 May 28 05:07:33.228372 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3052/5990] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:07:33 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1333 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:07:33.292813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-a9294316-23a8-418c-a349-002838182836 req-02c2af8e-e709-4de2-bc0f-2aa1a2cb6cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57622bb5-3fad-45a7-b416-7954ff7434fd", "name": "network-vif-plugged", "status": "completed", "tag": "4406b18a-8ae4-4b5c-ad57-c07d834eb7c1"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:07:33.323972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a9294316-23a8-418c-a349-002838182836 req-02c2af8e-e709-4de2-bc0f-2aa1a2cb6cf7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:33.326302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a9294316-23a8-418c-a349-002838182836 req-02c2af8e-e709-4de2-bc0f-2aa1a2cb6cf7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:33.378737 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-a9294316-23a8-418c-a349-002838182836 req-02c2af8e-e709-4de2-bc0f-2aa1a2cb6cf7 service nova] Creating event network-vif-plugged:4406b18a-8ae4-4b5c-ad57-c07d834eb7c1 for instance 57622bb5-3fad-45a7-b416-7954ff7434fd on n-h1-843700-1 May 28 05:07:33.386285 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-a9294316-23a8-418c-a349-002838182836 req-02c2af8e-e709-4de2-bc0f-2aa1a2cb6cf7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099066 May 28 05:07:33.389230 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3053/5991] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:07:33.629044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-93220b4f-2711-45bc-ab33-37d77cf52190 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:33.647890 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-93220b4f-2711-45bc-ab33-37d77cf52190 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd" status: 200 len: 1319 microversion: 2.1 time: 0.598876 May 28 05:07:33.649315 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2939/5992] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:33 2022] GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd => generated 1319 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:34.056425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5bc5b4f6-632a-4fcb-8da1-8b88f89b42bb tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:34.057992 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5bc5b4f6-632a-4fcb-8da1-8b88f89b42bb tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:34.083565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5bc5b4f6-632a-4fcb-8da1-8b88f89b42bb tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:34.087326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5bc5b4f6-632a-4fcb-8da1-8b88f89b42bb tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:34.088356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5bc5b4f6-632a-4fcb-8da1-8b88f89b42bb tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:34.089502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5bc5b4f6-632a-4fcb-8da1-8b88f89b42bb tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:34.249902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-60564005-37c4-4f6f-bdef-5ea66132b415 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:34.250535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-60564005-37c4-4f6f-bdef-5ea66132b415 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:34.262477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60564005-37c4-4f6f-bdef-5ea66132b415 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:34.262935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60564005-37c4-4f6f-bdef-5ea66132b415 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:34.270867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60564005-37c4-4f6f-bdef-5ea66132b415 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:34.281303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60564005-37c4-4f6f-bdef-5ea66132b415 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:34.329957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5bc5b4f6-632a-4fcb-8da1-8b88f89b42bb tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:34.348810 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5bc5b4f6-632a-4fcb-8da1-8b88f89b42bb tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 200 len: 1293 microversion: 2.1 time: 0.296478 May 28 05:07:34.349464 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3054/5993] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:34 2022] GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 1293 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:34.411663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-04c7dce7-b8ae-4262-8f4e-71c2cfbfa7c3 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1014279427", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d8ce646c-e31f-4455-a1cb-69d60adfa383", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2144436971", "security_groups": [{"name": "tempest-secgroup-smoke-1708567440"}], "networks": [{"uuid": "d54e89b0-e8a5-45e6-8b0f-5da12edcdc0c"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:07:34.703013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-60564005-37c4-4f6f-bdef-5ea66132b415 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:34.714564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-60564005-37c4-4f6f-bdef-5ea66132b415 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:34.716233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-60564005-37c4-4f6f-bdef-5ea66132b415 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:34.720830 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-60564005-37c4-4f6f-bdef-5ea66132b415 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1339 microversion: 2.20 time: 0.475820 May 28 05:07:34.724458 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2940/5994] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:07:34 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1339 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:07:34.738621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bc3ffddc-dfac-49f5-84cb-34e5282584fd tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:34.739562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bc3ffddc-dfac-49f5-84cb-34e5282584fd tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:34.748927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc3ffddc-dfac-49f5-84cb-34e5282584fd tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:34.755847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc3ffddc-dfac-49f5-84cb-34e5282584fd tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:34.755847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc3ffddc-dfac-49f5-84cb-34e5282584fd tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:34.755847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bc3ffddc-dfac-49f5-84cb-34e5282584fd tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:35.137935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-04c7dce7-b8ae-4262-8f4e-71c2cfbfa7c3 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] validate_networks() for [('d54e89b0-e8a5-45e6-8b0f-5da12edcdc0c', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:07:35.556994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bc3ffddc-dfac-49f5-84cb-34e5282584fd tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:35.568036 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bc3ffddc-dfac-49f5-84cb-34e5282584fd tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd" status: 200 len: 1319 microversion: 2.1 time: 0.842142 May 28 05:07:35.568655 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2941/5995] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:34 2022] GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd => generated 1319 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:35.583264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3e808c26-63aa-40a6-a70c-1f2f200f2e49 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:35.584096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3e808c26-63aa-40a6-a70c-1f2f200f2e49 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:35.597666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e808c26-63aa-40a6-a70c-1f2f200f2e49 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:35.598429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e808c26-63aa-40a6-a70c-1f2f200f2e49 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:35.599497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e808c26-63aa-40a6-a70c-1f2f200f2e49 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:35.600348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3e808c26-63aa-40a6-a70c-1f2f200f2e49 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:35.786031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3e808c26-63aa-40a6-a70c-1f2f200f2e49 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:35.790144 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3e808c26-63aa-40a6-a70c-1f2f200f2e49 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 200 len: 1299 microversion: 2.1 time: 0.210695 May 28 05:07:35.800532 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2942/5996] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:35 2022] GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 1299 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:35.805701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f6cca97b-5960-4ef8-ace0-b6a5c0cf63fa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:35.806371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f6cca97b-5960-4ef8-ace0-b6a5c0cf63fa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:35.813662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6cca97b-5960-4ef8-ace0-b6a5c0cf63fa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:35.814395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6cca97b-5960-4ef8-ace0-b6a5c0cf63fa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:35.816060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6cca97b-5960-4ef8-ace0-b6a5c0cf63fa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:35.816677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6cca97b-5960-4ef8-ace0-b6a5c0cf63fa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:36.297444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f6cca97b-5960-4ef8-ace0-b6a5c0cf63fa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:36.312401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f6cca97b-5960-4ef8-ace0-b6a5c0cf63fa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:36.317951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f6cca97b-5960-4ef8-ace0-b6a5c0cf63fa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:36.319283 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f6cca97b-5960-4ef8-ace0-b6a5c0cf63fa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1339 microversion: 2.20 time: 0.517568 May 28 05:07:36.320217 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2943/5997] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:07:35 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1339 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:07:36.585850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2f9183a8-7560-4a6d-a21e-a29e6f2a1e4d tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:36.586553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2f9183a8-7560-4a6d-a21e-a29e6f2a1e4d tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:36.599403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f9183a8-7560-4a6d-a21e-a29e6f2a1e4d tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:36.600283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f9183a8-7560-4a6d-a21e-a29e6f2a1e4d tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:36.601168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f9183a8-7560-4a6d-a21e-a29e6f2a1e4d tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:36.601624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f9183a8-7560-4a6d-a21e-a29e6f2a1e4d tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:37.194105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-04c7dce7-b8ae-4262-8f4e-71c2cfbfa7c3 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:07:37.194630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-04c7dce7-b8ae-4262-8f4e-71c2cfbfa7c3 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:07:37.195852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-04c7dce7-b8ae-4262-8f4e-71c2cfbfa7c3 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:07:37.196275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-04c7dce7-b8ae-4262-8f4e-71c2cfbfa7c3 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:07:37.197097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-04c7dce7-b8ae-4262-8f4e-71c2cfbfa7c3 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:07:37.209546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-04c7dce7-b8ae-4262-8f4e-71c2cfbfa7c3 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:37.215401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-04c7dce7-b8ae-4262-8f4e-71c2cfbfa7c3 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:37.216393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-04c7dce7-b8ae-4262-8f4e-71c2cfbfa7c3 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:37.216891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-04c7dce7-b8ae-4262-8f4e-71c2cfbfa7c3 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:37.231939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2f9183a8-7560-4a6d-a21e-a29e6f2a1e4d tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:37.245587 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2f9183a8-7560-4a6d-a21e-a29e6f2a1e4d tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd" status: 200 len: 1509 microversion: 2.1 time: 0.662773 May 28 05:07:37.246750 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2944/5998] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:36 2022] GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd => generated 1509 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:37.248950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-04c7dce7-b8ae-4262-8f4e-71c2cfbfa7c3 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Getting quotas for project 7216e0203810449f94f6da658c532406. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:07:37.251879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7118c661-cc42-4b8e-8744-691a3ba9d1ef tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:37.252930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7118c661-cc42-4b8e-8744-691a3ba9d1ef tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:37.254634 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-04c7dce7-b8ae-4262-8f4e-71c2cfbfa7c3 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Getting quotas for user 2e045790caa7421b86d3d3a8075cdaa7 and project 7216e0203810449f94f6da658c532406. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:07:37.277994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7118c661-cc42-4b8e-8744-691a3ba9d1ef tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:37.279628 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7118c661-cc42-4b8e-8744-691a3ba9d1ef tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:37.280691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7118c661-cc42-4b8e-8744-691a3ba9d1ef tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:37.281371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7118c661-cc42-4b8e-8744-691a3ba9d1ef tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:37.358761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-04c7dce7-b8ae-4262-8f4e-71c2cfbfa7c3 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:07:37.361710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-04c7dce7-b8ae-4262-8f4e-71c2cfbfa7c3 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d8ce646c-e31f-4455-a1cb-69d60adfa383',volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:07:37.543894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7118c661-cc42-4b8e-8744-691a3ba9d1ef tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:37.559289 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7118c661-cc42-4b8e-8744-691a3ba9d1ef tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 200 len: 1299 microversion: 2.1 time: 0.311253 May 28 05:07:37.581018 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2945/5999] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:37 2022] GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 1299 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:37.581018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d504db35-85de-4cf6-9ac8-dfea80c671e3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:37.581900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d504db35-85de-4cf6-9ac8-dfea80c671e3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:37.590023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d504db35-85de-4cf6-9ac8-dfea80c671e3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:37.591430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d504db35-85de-4cf6-9ac8-dfea80c671e3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:37.592444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d504db35-85de-4cf6-9ac8-dfea80c671e3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:37.593202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d504db35-85de-4cf6-9ac8-dfea80c671e3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:37.961582 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-04c7dce7-b8ae-4262-8f4e-71c2cfbfa7c3 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.554800 May 28 05:07:37.967821 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3055/6000] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:07:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 3562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 05:07:37.973318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6156b0a1-b0bf-4011-882d-77b96257bdac tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:37.974190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6156b0a1-b0bf-4011-882d-77b96257bdac tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:38.361073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6156b0a1-b0bf-4011-882d-77b96257bdac tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:38.371566 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6156b0a1-b0bf-4011-882d-77b96257bdac tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1099 microversion: 2.1 time: 0.402244 May 28 05:07:38.381124 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3056/6001] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:37 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1099 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:38.386725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d504db35-85de-4cf6-9ac8-dfea80c671e3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:38.396280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d504db35-85de-4cf6-9ac8-dfea80c671e3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:38.403437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d504db35-85de-4cf6-9ac8-dfea80c671e3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:38.403437 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d504db35-85de-4cf6-9ac8-dfea80c671e3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1406 microversion: 2.20 time: 0.823975 May 28 05:07:38.403437 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2946/6002] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:07:37 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1406 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:07:38.587797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-67ed3706-68e2-4853-9616-240868363434 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:38.589025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-67ed3706-68e2-4853-9616-240868363434 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:38.595933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67ed3706-68e2-4853-9616-240868363434 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:38.596465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67ed3706-68e2-4853-9616-240868363434 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:38.601613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67ed3706-68e2-4853-9616-240868363434 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:38.601613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67ed3706-68e2-4853-9616-240868363434 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:38.820710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-67ed3706-68e2-4853-9616-240868363434 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:38.831821 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-67ed3706-68e2-4853-9616-240868363434 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 200 len: 1299 microversion: 2.1 time: 0.248052 May 28 05:07:38.835149 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3057/6003] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:38 2022] GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 1299 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:39.392964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3b515908-9626-404b-aaaa-658faad401fa tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:39.396294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3b515908-9626-404b-aaaa-658faad401fa tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:39.415810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b515908-9626-404b-aaaa-658faad401fa tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:39.417790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b515908-9626-404b-aaaa-658faad401fa tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:39.419712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b515908-9626-404b-aaaa-658faad401fa tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:39.420664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3b515908-9626-404b-aaaa-658faad401fa tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:39.426766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0cd20db8-91cf-42fa-91c6-98e8a4d21ee2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:39.429591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0cd20db8-91cf-42fa-91c6-98e8a4d21ee2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:39.446486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0cd20db8-91cf-42fa-91c6-98e8a4d21ee2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:39.455418 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0cd20db8-91cf-42fa-91c6-98e8a4d21ee2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:39.457480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0cd20db8-91cf-42fa-91c6-98e8a4d21ee2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:39.457940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0cd20db8-91cf-42fa-91c6-98e8a4d21ee2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:39.579731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3b515908-9626-404b-aaaa-658faad401fa tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:39.592414 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3b515908-9626-404b-aaaa-658faad401fa tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1149 microversion: 2.1 time: 0.207776 May 28 05:07:39.593712 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2947/6004] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:39 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1149 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:39.850381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-973633b2-0bc8-4dda-9101-a7e0573b5bbc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:39.851151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-973633b2-0bc8-4dda-9101-a7e0573b5bbc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:39.863523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-973633b2-0bc8-4dda-9101-a7e0573b5bbc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:39.864044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-973633b2-0bc8-4dda-9101-a7e0573b5bbc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:39.868932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-973633b2-0bc8-4dda-9101-a7e0573b5bbc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:39.868932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-973633b2-0bc8-4dda-9101-a7e0573b5bbc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:40.074972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0cd20db8-91cf-42fa-91c6-98e8a4d21ee2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:40.087311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0cd20db8-91cf-42fa-91c6-98e8a4d21ee2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:40.101307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0cd20db8-91cf-42fa-91c6-98e8a4d21ee2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:40.102520 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0cd20db8-91cf-42fa-91c6-98e8a4d21ee2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1406 microversion: 2.20 time: 0.687259 May 28 05:07:40.103238 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3058/6005] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:07:39 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1406 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:07:40.124059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-adcc9ea4-600a-4a4c-b911-edca01135c70 req-afd8c244-60e3-4cc5-91b4-2468ed6426df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed9c976c-7828-4df6-95e7-39aeed297c77", "tag": "ab8d50ca-2c4e-459c-853d-eb715cbb013e"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:07:40.144089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-adcc9ea4-600a-4a4c-b911-edca01135c70 req-afd8c244-60e3-4cc5-91b4-2468ed6426df service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:40.151935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-adcc9ea4-600a-4a4c-b911-edca01135c70 req-afd8c244-60e3-4cc5-91b4-2468ed6426df service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:40.178223 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-adcc9ea4-600a-4a4c-b911-edca01135c70 req-afd8c244-60e3-4cc5-91b4-2468ed6426df service nova] Creating event network-changed:ab8d50ca-2c4e-459c-853d-eb715cbb013e for instance ed9c976c-7828-4df6-95e7-39aeed297c77 on n-h1-843700-1 May 28 05:07:40.190424 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-adcc9ea4-600a-4a4c-b911-edca01135c70 req-afd8c244-60e3-4cc5-91b4-2468ed6426df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084224 May 28 05:07:40.193387 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3059/6006] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:07:40.249555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-973633b2-0bc8-4dda-9101-a7e0573b5bbc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:40.277688 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-973633b2-0bc8-4dda-9101-a7e0573b5bbc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 200 len: 1299 microversion: 2.1 time: 0.431677 May 28 05:07:40.280641 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2948/6007] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:39 2022] GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 1299 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:07:40.513960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1bccc2b1-eb40-4f68-ac08-9840be87e41a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:40.520018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1bccc2b1-eb40-4f68-ac08-9840be87e41a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:40.549928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1bccc2b1-eb40-4f68-ac08-9840be87e41a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:40.553544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1bccc2b1-eb40-4f68-ac08-9840be87e41a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:40.554605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1bccc2b1-eb40-4f68-ac08-9840be87e41a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:40.555665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1bccc2b1-eb40-4f68-ac08-9840be87e41a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:40.613231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-11cf2494-a878-45df-9aba-0bbed5cc0305 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:40.616731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-11cf2494-a878-45df-9aba-0bbed5cc0305 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:40.632644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11cf2494-a878-45df-9aba-0bbed5cc0305 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:40.633577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11cf2494-a878-45df-9aba-0bbed5cc0305 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:40.634556 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11cf2494-a878-45df-9aba-0bbed5cc0305 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:40.634685 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1bccc2b1-eb40-4f68-ac08-9840be87e41a tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.138338 May 28 05:07:40.635825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11cf2494-a878-45df-9aba-0bbed5cc0305 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:40.636769 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3060/6008] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:07:40 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments => generated 371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:07:40.704567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:07:40.777453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2e61a974-2dbf-4151-ad1b-d0005a738bb3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:40.778399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2e61a974-2dbf-4151-ad1b-d0005a738bb3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:40.785473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e61a974-2dbf-4151-ad1b-d0005a738bb3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:40.786247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e61a974-2dbf-4151-ad1b-d0005a738bb3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:40.787299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e61a974-2dbf-4151-ad1b-d0005a738bb3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:40.787959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e61a974-2dbf-4151-ad1b-d0005a738bb3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:40.825712 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2e61a974-2dbf-4151-ad1b-d0005a738bb3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments/c69b71af-00f8-472f-8f38-6fdc1ebec5d3" status: 200 len: 194 microversion: 2.1 time: 0.052277 May 28 05:07:40.831735 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3061/6009] 10.222.0.58 () {58 vars in 1412 bytes} [Sat May 28 05:07:40 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments/c69b71af-00f8-472f-8f38-6fdc1ebec5d3 => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:07:40.837580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-251131ac-7244-4d3c-8937-4269560d3540 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:40.838406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-251131ac-7244-4d3c-8937-4269560d3540 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:40.847977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-251131ac-7244-4d3c-8937-4269560d3540 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:40.848777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-251131ac-7244-4d3c-8937-4269560d3540 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:40.849834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-251131ac-7244-4d3c-8937-4269560d3540 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:40.850564 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-251131ac-7244-4d3c-8937-4269560d3540 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:40.887313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-11cf2494-a878-45df-9aba-0bbed5cc0305 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:40.902035 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-11cf2494-a878-45df-9aba-0bbed5cc0305 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1197 microversion: 2.1 time: 0.292824 May 28 05:07:40.903984 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2949/6010] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:40 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1197 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:07:41.027849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-251131ac-7244-4d3c-8937-4269560d3540 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lazy-loading 'services' on Instance uuid 54892188-1116-41fc-a42e-20850995d769 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:07:41.121884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-605f7c26-ed50-44ce-9726-8526c846acce tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:41.122514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-605f7c26-ed50-44ce-9726-8526c846acce tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:41.131262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:07:41.145203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-605f7c26-ed50-44ce-9726-8526c846acce tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:41.145872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-605f7c26-ed50-44ce-9726-8526c846acce tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:41.147379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-605f7c26-ed50-44ce-9726-8526c846acce tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:41.148116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-605f7c26-ed50-44ce-9726-8526c846acce tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:41.319171 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-251131ac-7244-4d3c-8937-4269560d3540 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "DELETE /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments/c69b71af-00f8-472f-8f38-6fdc1ebec5d3" status: 202 len: 0 microversion: 2.1 time: 0.482422 May 28 05:07:41.331240 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3062/6011] 10.222.0.58 () {58 vars in 1415 bytes} [Sat May 28 05:07:40 2022] DELETE /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments/c69b71af-00f8-472f-8f38-6fdc1ebec5d3 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:07:41.363919 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-215ddf30-801c-4d95-9c16-1335f4759c2b tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:41.363919 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-215ddf30-801c-4d95-9c16-1335f4759c2b tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:41.392721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-215ddf30-801c-4d95-9c16-1335f4759c2b tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:41.394386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-215ddf30-801c-4d95-9c16-1335f4759c2b tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:41.395273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-215ddf30-801c-4d95-9c16-1335f4759c2b tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:41.395714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-215ddf30-801c-4d95-9c16-1335f4759c2b tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:41.683235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-215ddf30-801c-4d95-9c16-1335f4759c2b tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:41.696726 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-215ddf30-801c-4d95-9c16-1335f4759c2b tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 200 len: 1299 microversion: 2.1 time: 0.360098 May 28 05:07:41.705831 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3063/6012] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:41 2022] GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 1299 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:41.923827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9f2a1309-aab7-428c-beb4-83cb363cd36d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:41.924864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9f2a1309-aab7-428c-beb4-83cb363cd36d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:41.942276 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f2a1309-aab7-428c-beb4-83cb363cd36d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:41.944896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f2a1309-aab7-428c-beb4-83cb363cd36d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:41.946642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f2a1309-aab7-428c-beb4-83cb363cd36d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:41.948881 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9f2a1309-aab7-428c-beb4-83cb363cd36d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:41.980177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=16 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:07:42.098590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9f2a1309-aab7-428c-beb4-83cb363cd36d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:42.105457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-605f7c26-ed50-44ce-9726-8526c846acce tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:42.113968 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9f2a1309-aab7-428c-beb4-83cb363cd36d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1215 microversion: 2.1 time: 0.192909 May 28 05:07:42.116143 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3064/6013] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:41 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1215 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:07:42.131312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-605f7c26-ed50-44ce-9726-8526c846acce tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:42.132943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-605f7c26-ed50-44ce-9726-8526c846acce tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:42.138230 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-605f7c26-ed50-44ce-9726-8526c846acce tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1406 microversion: 2.20 time: 1.019357 May 28 05:07:42.138966 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2950/6014] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:07:41 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1406 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:07:42.240606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-222505b0-e791-49f5-a141-6691f7fd3cbe req-cc87b90c-70be-43f0-959b-1c1b3f357bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "334654f9-2ad8-4cef-b4e8-bf45eb69f937", "tag": "9efbcbd3-4d06-4190-8016-20cbfae73fe4"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:07:42.258459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-222505b0-e791-49f5-a141-6691f7fd3cbe req-cc87b90c-70be-43f0-959b-1c1b3f357bf2 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:42.259557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-222505b0-e791-49f5-a141-6691f7fd3cbe req-cc87b90c-70be-43f0-959b-1c1b3f357bf2 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:42.288464 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-222505b0-e791-49f5-a141-6691f7fd3cbe req-cc87b90c-70be-43f0-959b-1c1b3f357bf2 service nova] Creating event network-changed:9efbcbd3-4d06-4190-8016-20cbfae73fe4 for instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 on n-h2-843700-1 May 28 05:07:42.300984 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-222505b0-e791-49f5-a141-6691f7fd3cbe req-cc87b90c-70be-43f0-959b-1c1b3f357bf2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066080 May 28 05:07:42.301616 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3065/6015] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:07:42.720937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-17729a09-85d0-4e37-9f56-620bdf648ae2 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:42.721924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-17729a09-85d0-4e37-9f56-620bdf648ae2 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:42.732049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:07:42.746734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17729a09-85d0-4e37-9f56-620bdf648ae2 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:42.751071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17729a09-85d0-4e37-9f56-620bdf648ae2 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:42.752504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17729a09-85d0-4e37-9f56-620bdf648ae2 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:42.757621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17729a09-85d0-4e37-9f56-620bdf648ae2 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:43.097323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-17729a09-85d0-4e37-9f56-620bdf648ae2 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:43.106899 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-17729a09-85d0-4e37-9f56-620bdf648ae2 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 200 len: 1299 microversion: 2.1 time: 0.390322 May 28 05:07:43.108186 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2951/6016] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:42 2022] GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 1299 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:43.139374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4a8e4007-7c3c-440e-ada9-82c52f8a729e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:43.143796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4a8e4007-7c3c-440e-ada9-82c52f8a729e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:43.166048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3cad5358-f7cc-4bf5-a6aa-dcbdbf996135 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:43.168786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3cad5358-f7cc-4bf5-a6aa-dcbdbf996135 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:43.204042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a8e4007-7c3c-440e-ada9-82c52f8a729e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:43.208046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a8e4007-7c3c-440e-ada9-82c52f8a729e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:43.213068 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a8e4007-7c3c-440e-ada9-82c52f8a729e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:43.223040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a8e4007-7c3c-440e-ada9-82c52f8a729e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:43.228407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3cad5358-f7cc-4bf5-a6aa-dcbdbf996135 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:43.228944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3cad5358-f7cc-4bf5-a6aa-dcbdbf996135 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:43.230318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3cad5358-f7cc-4bf5-a6aa-dcbdbf996135 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:43.230764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3cad5358-f7cc-4bf5-a6aa-dcbdbf996135 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:43.239113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:07:43.645793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3cad5358-f7cc-4bf5-a6aa-dcbdbf996135 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:43.656911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3cad5358-f7cc-4bf5-a6aa-dcbdbf996135 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:43.665621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3cad5358-f7cc-4bf5-a6aa-dcbdbf996135 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:43.667712 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3cad5358-f7cc-4bf5-a6aa-dcbdbf996135 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1406 microversion: 2.20 time: 0.512803 May 28 05:07:43.668719 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2952/6017] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:07:43 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1406 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:07:43.770768 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4a8e4007-7c3c-440e-ada9-82c52f8a729e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:43.786317 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4a8e4007-7c3c-440e-ada9-82c52f8a729e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.650155 May 28 05:07:43.787020 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3066/6018] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:43 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:44.126423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b511a467-7d5b-4262-9442-883ddeaea1ab tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:44.127617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b511a467-7d5b-4262-9442-883ddeaea1ab tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:44.141592 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b511a467-7d5b-4262-9442-883ddeaea1ab tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:44.142758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b511a467-7d5b-4262-9442-883ddeaea1ab tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:44.143786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b511a467-7d5b-4262-9442-883ddeaea1ab tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:44.144407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b511a467-7d5b-4262-9442-883ddeaea1ab tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:44.366298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b511a467-7d5b-4262-9442-883ddeaea1ab tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:44.392681 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b511a467-7d5b-4262-9442-883ddeaea1ab tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 200 len: 1299 microversion: 2.1 time: 0.271097 May 28 05:07:44.396350 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2953/6019] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:44 2022] GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 1299 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:44.687512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1e076bf6-622b-4cc8-9894-c3db66d9caeb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:44.688829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1e076bf6-622b-4cc8-9894-c3db66d9caeb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:44.699906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e076bf6-622b-4cc8-9894-c3db66d9caeb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:44.703783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e076bf6-622b-4cc8-9894-c3db66d9caeb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:44.705084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e076bf6-622b-4cc8-9894-c3db66d9caeb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:44.705759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e076bf6-622b-4cc8-9894-c3db66d9caeb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:44.806556 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3522443a-86cf-4959-9e61-a1a85e49a1ec tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:44.808028 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3522443a-86cf-4959-9e61-a1a85e49a1ec tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:44.819822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3522443a-86cf-4959-9e61-a1a85e49a1ec tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:44.820551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3522443a-86cf-4959-9e61-a1a85e49a1ec tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:44.821581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3522443a-86cf-4959-9e61-a1a85e49a1ec tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:44.826045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3522443a-86cf-4959-9e61-a1a85e49a1ec tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:45.500507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1e076bf6-622b-4cc8-9894-c3db66d9caeb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:45.514599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1e076bf6-622b-4cc8-9894-c3db66d9caeb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:45.519493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1e076bf6-622b-4cc8-9894-c3db66d9caeb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:45.520883 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1e076bf6-622b-4cc8-9894-c3db66d9caeb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1406 microversion: 2.20 time: 0.838230 May 28 05:07:45.537490 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3067/6020] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:07:44 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1406 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:07:45.545542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1b6493e5-31b1-4784-a93b-3f57aa219d76 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:45.548415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1b6493e5-31b1-4784-a93b-3f57aa219d76 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:45.566704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b6493e5-31b1-4784-a93b-3f57aa219d76 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:45.567440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b6493e5-31b1-4784-a93b-3f57aa219d76 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:45.568380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b6493e5-31b1-4784-a93b-3f57aa219d76 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:45.568971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b6493e5-31b1-4784-a93b-3f57aa219d76 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:45.592852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3522443a-86cf-4959-9e61-a1a85e49a1ec tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:45.602252 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3522443a-86cf-4959-9e61-a1a85e49a1ec tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.799556 May 28 05:07:45.611878 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2954/6021] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:44 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:45.756789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1b6493e5-31b1-4784-a93b-3f57aa219d76 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:45.770319 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1b6493e5-31b1-4784-a93b-3f57aa219d76 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 200 len: 1299 microversion: 2.1 time: 0.231378 May 28 05:07:45.777920 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3068/6022] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:45 2022] GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 1299 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:46.225355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-2604c05d-1045-4060-adfe-547d2e600be6 req-98f3d531-6c9d-4c59-8e84-3900c299b9fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12106ac-a8a7-44cc-a111-c5599a29c137", "tag": "80bb8c1a-4a40-4b48-948f-08b18f123ea5"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:07:46.239764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2604c05d-1045-4060-adfe-547d2e600be6 req-98f3d531-6c9d-4c59-8e84-3900c299b9fa service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:46.240220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2604c05d-1045-4060-adfe-547d2e600be6 req-98f3d531-6c9d-4c59-8e84-3900c299b9fa service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:46.279974 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-2604c05d-1045-4060-adfe-547d2e600be6 req-98f3d531-6c9d-4c59-8e84-3900c299b9fa service nova] Creating event network-changed:80bb8c1a-4a40-4b48-948f-08b18f123ea5 for instance c12106ac-a8a7-44cc-a111-c5599a29c137 on n-h2-843700-1 May 28 05:07:46.293565 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-2604c05d-1045-4060-adfe-547d2e600be6 req-98f3d531-6c9d-4c59-8e84-3900c299b9fa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071791 May 28 05:07:46.294187 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2955/6023] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:07:46.548026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3d8a17db-3968-425a-b35e-a24082ad7bdc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:46.550065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3d8a17db-3968-425a-b35e-a24082ad7bdc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:46.564338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d8a17db-3968-425a-b35e-a24082ad7bdc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:46.565245 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d8a17db-3968-425a-b35e-a24082ad7bdc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:46.566509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d8a17db-3968-425a-b35e-a24082ad7bdc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:46.567198 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d8a17db-3968-425a-b35e-a24082ad7bdc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:46.629369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2deb6a7c-170a-4a82-b246-57bcd827265c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:46.630077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2deb6a7c-170a-4a82-b246-57bcd827265c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:46.642865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2deb6a7c-170a-4a82-b246-57bcd827265c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:46.643728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2deb6a7c-170a-4a82-b246-57bcd827265c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:46.645410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2deb6a7c-170a-4a82-b246-57bcd827265c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:46.645989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2deb6a7c-170a-4a82-b246-57bcd827265c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:47.123601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3d8a17db-3968-425a-b35e-a24082ad7bdc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:47.137089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3d8a17db-3968-425a-b35e-a24082ad7bdc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:47.138964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3d8a17db-3968-425a-b35e-a24082ad7bdc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:47.142856 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3d8a17db-3968-425a-b35e-a24082ad7bdc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1406 microversion: 2.20 time: 0.599673 May 28 05:07:47.153118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2deb6a7c-170a-4a82-b246-57bcd827265c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:47.156374 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3069/6024] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:07:46 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1406 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:07:47.162112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-56b333e3-2c02-4276-b36d-4b09c565f353 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:47.163200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-56b333e3-2c02-4276-b36d-4b09c565f353 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:47.165769 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2deb6a7c-170a-4a82-b246-57bcd827265c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.539743 May 28 05:07:47.170683 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2956/6025] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:46 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:47.170812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:07:47.171993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56b333e3-2c02-4276-b36d-4b09c565f353 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:47.172589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56b333e3-2c02-4276-b36d-4b09c565f353 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:47.173507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56b333e3-2c02-4276-b36d-4b09c565f353 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:47.174086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56b333e3-2c02-4276-b36d-4b09c565f353 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:47.326863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-1239db48-5d3f-4764-9f59-61aa5d7fda27 req-75da2c1d-d0a6-4399-a6bb-316ef82cacbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9c976c-7828-4df6-95e7-39aeed297c77", "name": "network-vif-plugged", "status": "completed", "tag": "ab8d50ca-2c4e-459c-853d-eb715cbb013e"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:07:47.475275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1239db48-5d3f-4764-9f59-61aa5d7fda27 req-75da2c1d-d0a6-4399-a6bb-316ef82cacbf service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:47.475275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1239db48-5d3f-4764-9f59-61aa5d7fda27 req-75da2c1d-d0a6-4399-a6bb-316ef82cacbf service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:47.475275 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-1239db48-5d3f-4764-9f59-61aa5d7fda27 req-75da2c1d-d0a6-4399-a6bb-316ef82cacbf service nova] Creating event network-vif-plugged:ab8d50ca-2c4e-459c-853d-eb715cbb013e for instance ed9c976c-7828-4df6-95e7-39aeed297c77 on n-h1-843700-1 May 28 05:07:47.475275 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-1239db48-5d3f-4764-9f59-61aa5d7fda27 req-75da2c1d-d0a6-4399-a6bb-316ef82cacbf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113374 May 28 05:07:47.475275 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2957/6026] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:07:47.729308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:07:47.856017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-56b333e3-2c02-4276-b36d-4b09c565f353 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:47.856017 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-56b333e3-2c02-4276-b36d-4b09c565f353 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 200 len: 1299 microversion: 2.1 time: 0.686370 May 28 05:07:47.856017 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3070/6027] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:47 2022] GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 1299 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:48.162098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3dbb6424-2371-43e7-9b03-fe4b07b70bca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:48.163034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3dbb6424-2371-43e7-9b03-fe4b07b70bca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:48.174606 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3dbb6424-2371-43e7-9b03-fe4b07b70bca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:48.175104 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3dbb6424-2371-43e7-9b03-fe4b07b70bca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:48.176083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3dbb6424-2371-43e7-9b03-fe4b07b70bca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:48.176676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3dbb6424-2371-43e7-9b03-fe4b07b70bca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:48.186957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4521d4b9-aa40-40bc-b427-7916e6529e45 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:48.195913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4521d4b9-aa40-40bc-b427-7916e6529e45 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:48.203547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4521d4b9-aa40-40bc-b427-7916e6529e45 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:48.208605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4521d4b9-aa40-40bc-b427-7916e6529e45 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:48.209123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4521d4b9-aa40-40bc-b427-7916e6529e45 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:48.209671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4521d4b9-aa40-40bc-b427-7916e6529e45 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:48.370506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=20 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:07:48.487878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4521d4b9-aa40-40bc-b427-7916e6529e45 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:48.495701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3dbb6424-2371-43e7-9b03-fe4b07b70bca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:48.502195 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4521d4b9-aa40-40bc-b427-7916e6529e45 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.320195 May 28 05:07:48.507323 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3071/6028] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:48 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:07:48.517283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3dbb6424-2371-43e7-9b03-fe4b07b70bca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:48.517579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3dbb6424-2371-43e7-9b03-fe4b07b70bca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:48.524075 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3dbb6424-2371-43e7-9b03-fe4b07b70bca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1406 microversion: 2.20 time: 0.364396 May 28 05:07:48.524921 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2958/6029] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:07:48 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1406 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:07:48.863361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5de90ae9-850f-482f-a027-a576ff804c60 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:48.866263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5de90ae9-850f-482f-a027-a576ff804c60 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:48.894599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5de90ae9-850f-482f-a027-a576ff804c60 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:48.895324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5de90ae9-850f-482f-a027-a576ff804c60 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:48.896718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5de90ae9-850f-482f-a027-a576ff804c60 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:48.898804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5de90ae9-850f-482f-a027-a576ff804c60 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:49.125569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5de90ae9-850f-482f-a027-a576ff804c60 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:49.140595 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5de90ae9-850f-482f-a027-a576ff804c60 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 200 len: 1472 microversion: 2.1 time: 0.282264 May 28 05:07:49.151410 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3072/6030] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:48 2022] GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 1472 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:49.163585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f8474d08-d370-47e5-a608-fbea0bb3bde8 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:49.170606 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f8474d08-d370-47e5-a608-fbea0bb3bde8 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:49.173137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8474d08-d370-47e5-a608-fbea0bb3bde8 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:49.173607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8474d08-d370-47e5-a608-fbea0bb3bde8 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:49.174398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8474d08-d370-47e5-a608-fbea0bb3bde8 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:49.174846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8474d08-d370-47e5-a608-fbea0bb3bde8 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:49.338197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f8474d08-d370-47e5-a608-fbea0bb3bde8 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:49.351058 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f8474d08-d370-47e5-a608-fbea0bb3bde8 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 200 len: 1472 microversion: 2.1 time: 0.189998 May 28 05:07:49.354604 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2959/6031] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:49 2022] GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 1472 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:49.371246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ec4301c7-b421-4c31-8877-604965d79b7e tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:49.372534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ec4301c7-b421-4c31-8877-604965d79b7e tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:49.387164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec4301c7-b421-4c31-8877-604965d79b7e tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:49.397336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec4301c7-b421-4c31-8877-604965d79b7e tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:49.400284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec4301c7-b421-4c31-8877-604965d79b7e tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:49.402946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec4301c7-b421-4c31-8877-604965d79b7e tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:49.461111 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-d37d87ed-5dfa-49ec-9ca0-b5874db1b157 req-118e9851-cf64-47df-bd20-6fa106c5057b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334654f9-2ad8-4cef-b4e8-bf45eb69f937", "name": "network-vif-plugged", "status": "completed", "tag": "9efbcbd3-4d06-4190-8016-20cbfae73fe4"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:07:49.478533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d37d87ed-5dfa-49ec-9ca0-b5874db1b157 req-118e9851-cf64-47df-bd20-6fa106c5057b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:49.479342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d37d87ed-5dfa-49ec-9ca0-b5874db1b157 req-118e9851-cf64-47df-bd20-6fa106c5057b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:49.496680 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-d37d87ed-5dfa-49ec-9ca0-b5874db1b157 req-118e9851-cf64-47df-bd20-6fa106c5057b service nova] Creating event network-vif-plugged:9efbcbd3-4d06-4190-8016-20cbfae73fe4 for instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 on n-h2-843700-1 May 28 05:07:49.503602 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-d37d87ed-5dfa-49ec-9ca0-b5874db1b157 req-118e9851-cf64-47df-bd20-6fa106c5057b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047502 May 28 05:07:49.504938 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2960/6032] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:07:49.520662 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:07:49.520844 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 05:07:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:07:49.565452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-24f8b2a0-2b80-4dde-a535-4f856d25f7cc tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:49.571040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-24f8b2a0-2b80-4dde-a535-4f856d25f7cc tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:49.593159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24f8b2a0-2b80-4dde-a535-4f856d25f7cc tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:49.596589 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24f8b2a0-2b80-4dde-a535-4f856d25f7cc tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:49.598511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24f8b2a0-2b80-4dde-a535-4f856d25f7cc tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:49.599940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24f8b2a0-2b80-4dde-a535-4f856d25f7cc tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:49.645861 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ec4301c7-b421-4c31-8877-604965d79b7e tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 200 len: 1623 microversion: 2.1 time: 0.279210 May 28 05:07:49.660817 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3073/6033] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:49 2022] GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 1623 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:49.670915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c9ba8487-f81b-442a-b21d-01bd476ee91a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:49.678935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c9ba8487-f81b-442a-b21d-01bd476ee91a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:49.702455 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9ba8487-f81b-442a-b21d-01bd476ee91a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:49.703048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9ba8487-f81b-442a-b21d-01bd476ee91a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:49.705679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9ba8487-f81b-442a-b21d-01bd476ee91a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:49.706369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9ba8487-f81b-442a-b21d-01bd476ee91a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:50.005094 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-24f8b2a0-2b80-4dde-a535-4f856d25f7cc tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:50.021911 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-24f8b2a0-2b80-4dde-a535-4f856d25f7cc tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.488248 May 28 05:07:50.022757 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2961/6034] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:49 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:50.034731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5a98ded6-7dd3-4240-be7e-edea92f6794d tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:50.035703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5a98ded6-7dd3-4240-be7e-edea92f6794d tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:50.049485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a98ded6-7dd3-4240-be7e-edea92f6794d tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:50.049951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a98ded6-7dd3-4240-be7e-edea92f6794d tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:50.059448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c9ba8487-f81b-442a-b21d-01bd476ee91a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:50.065541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a98ded6-7dd3-4240-be7e-edea92f6794d tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:50.066039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a98ded6-7dd3-4240-be7e-edea92f6794d tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:50.072985 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c9ba8487-f81b-442a-b21d-01bd476ee91a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:50.080641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c9ba8487-f81b-442a-b21d-01bd476ee91a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:50.085491 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c9ba8487-f81b-442a-b21d-01bd476ee91a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1406 microversion: 2.20 time: 0.418828 May 28 05:07:50.104372 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3074/6035] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:07:49 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1406 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:07:50.321924 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5a98ded6-7dd3-4240-be7e-edea92f6794d tempest-TestSecurityGroupsBasicOps-1128090304 tempest-TestSecurityGroupsBasicOps-1128090304-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1911 microversion: 2.1 time: 0.297045 May 28 05:07:50.322906 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2962/6036] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:50 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1911 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:50.440607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7bcfcd6e-9a7c-493e-9933-12a52c2165cc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:50.441864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7bcfcd6e-9a7c-493e-9933-12a52c2165cc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:50.449850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7bcfcd6e-9a7c-493e-9933-12a52c2165cc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:50.451023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7bcfcd6e-9a7c-493e-9933-12a52c2165cc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:50.452508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7bcfcd6e-9a7c-493e-9933-12a52c2165cc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:50.453118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7bcfcd6e-9a7c-493e-9933-12a52c2165cc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:50.491268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7bcfcd6e-9a7c-493e-9933-12a52c2165cc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:07:50.815730 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7bcfcd6e-9a7c-493e-9933-12a52c2165cc tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 204 len: 0 microversion: 2.1 time: 0.378697 May 28 05:07:50.816468 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3075/6037] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:07:50 2022] DELETE /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:07:50.825378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2bbc0e3e-f905-44c9-b3d4-4701ef4cc29b tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:50.826320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2bbc0e3e-f905-44c9-b3d4-4701ef4cc29b tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:50.838872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2bbc0e3e-f905-44c9-b3d4-4701ef4cc29b tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:50.850171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2bbc0e3e-f905-44c9-b3d4-4701ef4cc29b tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:50.851329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2bbc0e3e-f905-44c9-b3d4-4701ef4cc29b tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:50.851945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2bbc0e3e-f905-44c9-b3d4-4701ef4cc29b tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:50.970692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2bbc0e3e-f905-44c9-b3d4-4701ef4cc29b tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:50.987733 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2bbc0e3e-f905-44c9-b3d4-4701ef4cc29b tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 200 len: 1478 microversion: 2.1 time: 0.161995 May 28 05:07:50.989102 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2963/6038] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:50 2022] GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 1478 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:51.044841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c6426396-4be8-4b58-813e-c2fecd8f7b01 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:51.046083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c6426396-4be8-4b58-813e-c2fecd8f7b01 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:51.057713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c6426396-4be8-4b58-813e-c2fecd8f7b01 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:51.062288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c6426396-4be8-4b58-813e-c2fecd8f7b01 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:51.066302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c6426396-4be8-4b58-813e-c2fecd8f7b01 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:51.067043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c6426396-4be8-4b58-813e-c2fecd8f7b01 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:51.105049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c9dfd46a-5f94-4bce-ac7d-6a610b6b0603 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:51.106067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c9dfd46a-5f94-4bce-ac7d-6a610b6b0603 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:51.122081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9dfd46a-5f94-4bce-ac7d-6a610b6b0603 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:51.126835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9dfd46a-5f94-4bce-ac7d-6a610b6b0603 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:51.127964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9dfd46a-5f94-4bce-ac7d-6a610b6b0603 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:51.128619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9dfd46a-5f94-4bce-ac7d-6a610b6b0603 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:51.406755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c6426396-4be8-4b58-813e-c2fecd8f7b01 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:51.419720 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c6426396-4be8-4b58-813e-c2fecd8f7b01 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.383522 May 28 05:07:51.421854 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3076/6039] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:51 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:51.425924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c9dfd46a-5f94-4bce-ac7d-6a610b6b0603 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:51.440538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c9dfd46a-5f94-4bce-ac7d-6a610b6b0603 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:51.440538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c9dfd46a-5f94-4bce-ac7d-6a610b6b0603 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:51.440538 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c9dfd46a-5f94-4bce-ac7d-6a610b6b0603 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1406 microversion: 2.20 time: 0.339218 May 28 05:07:51.440538 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2964/6040] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:07:51 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:07:52.007425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-50422b71-a8d3-425c-8041-9e385f20d34a tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:52.010478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-50422b71-a8d3-425c-8041-9e385f20d34a tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:52.030392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50422b71-a8d3-425c-8041-9e385f20d34a tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:52.031228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50422b71-a8d3-425c-8041-9e385f20d34a tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:52.032795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50422b71-a8d3-425c-8041-9e385f20d34a tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:52.033869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50422b71-a8d3-425c-8041-9e385f20d34a tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:52.213851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-50422b71-a8d3-425c-8041-9e385f20d34a tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:52.223665 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-50422b71-a8d3-425c-8041-9e385f20d34a tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 200 len: 1478 microversion: 2.1 time: 0.221720 May 28 05:07:52.238902 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3077/6041] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:52 2022] GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 1478 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:52.438966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f7d537f2-3ca6-4f7e-9f06-c60186842650 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:52.440118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f7d537f2-3ca6-4f7e-9f06-c60186842650 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:52.456930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e1515c0b-fecc-43f1-9374-7700698efa56 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:52.458461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e1515c0b-fecc-43f1-9374-7700698efa56 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:52.468747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1515c0b-fecc-43f1-9374-7700698efa56 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:52.473081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1515c0b-fecc-43f1-9374-7700698efa56 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:52.475914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7d537f2-3ca6-4f7e-9f06-c60186842650 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:52.476519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7d537f2-3ca6-4f7e-9f06-c60186842650 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:52.477114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1515c0b-fecc-43f1-9374-7700698efa56 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:52.479221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7d537f2-3ca6-4f7e-9f06-c60186842650 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:52.479780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e1515c0b-fecc-43f1-9374-7700698efa56 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:52.485812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7d537f2-3ca6-4f7e-9f06-c60186842650 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:52.966092 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e1515c0b-fecc-43f1-9374-7700698efa56 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:52.977952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e1515c0b-fecc-43f1-9374-7700698efa56 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:52.982490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e1515c0b-fecc-43f1-9374-7700698efa56 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:52.984865 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e1515c0b-fecc-43f1-9374-7700698efa56 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1599 microversion: 2.20 time: 0.532501 May 28 05:07:52.988866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f7d537f2-3ca6-4f7e-9f06-c60186842650 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:53.000857 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3078/6042] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:07:52 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1599 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:07:53.013102 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f7d537f2-3ca6-4f7e-9f06-c60186842650 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.579002 May 28 05:07:53.014978 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2965/6043] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:52 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:53.017683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9a368d99-c424-4984-a007-21d0b568873f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:53.018183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9a368d99-c424-4984-a007-21d0b568873f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:53.036585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a368d99-c424-4984-a007-21d0b568873f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:53.038421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a368d99-c424-4984-a007-21d0b568873f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:53.040049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a368d99-c424-4984-a007-21d0b568873f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:53.041965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a368d99-c424-4984-a007-21d0b568873f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:53.214180 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9a368d99-c424-4984-a007-21d0b568873f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.199400 May 28 05:07:53.226256 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3079/6044] 10.222.0.58 () {60 vars in 1315 bytes} [Sat May 28 05:07:53 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-interface => generated 285 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 05:07:53.246833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-779c8ec7-e2be-4f0f-944f-e739a2916344 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:53.247821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-779c8ec7-e2be-4f0f-944f-e739a2916344 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:53.257351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-779c8ec7-e2be-4f0f-944f-e739a2916344 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:53.259136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-779c8ec7-e2be-4f0f-944f-e739a2916344 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:53.259136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-779c8ec7-e2be-4f0f-944f-e739a2916344 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:53.259136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-779c8ec7-e2be-4f0f-944f-e739a2916344 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:53.464242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-779c8ec7-e2be-4f0f-944f-e739a2916344 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:53.480735 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-779c8ec7-e2be-4f0f-944f-e739a2916344 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 200 len: 1478 microversion: 2.1 time: 0.236436 May 28 05:07:53.485365 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2966/6045] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:53 2022] GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 1478 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:53.624464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e0fe7341-e92f-42d5-8a56-63018966daff req-ea970933-39a1-4b44-bb1e-ee6bf0a9653d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9c976c-7828-4df6-95e7-39aeed297c77", "name": "network-vif-deleted", "tag": "ab8d50ca-2c4e-459c-853d-eb715cbb013e"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:07:53.644959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e0fe7341-e92f-42d5-8a56-63018966daff req-ea970933-39a1-4b44-bb1e-ee6bf0a9653d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:53.648205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e0fe7341-e92f-42d5-8a56-63018966daff req-ea970933-39a1-4b44-bb1e-ee6bf0a9653d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:53.675305 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e0fe7341-e92f-42d5-8a56-63018966daff req-ea970933-39a1-4b44-bb1e-ee6bf0a9653d service nova] Creating event network-vif-deleted:ab8d50ca-2c4e-459c-853d-eb715cbb013e for instance ed9c976c-7828-4df6-95e7-39aeed297c77 on n-h1-843700-1 May 28 05:07:53.706253 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e0fe7341-e92f-42d5-8a56-63018966daff req-ea970933-39a1-4b44-bb1e-ee6bf0a9653d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086037 May 28 05:07:53.713216 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3080/6046] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:07:54.037162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0f180fb0-4039-4148-afb2-431c1de6f4be tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:54.046487 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0f180fb0-4039-4148-afb2-431c1de6f4be tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:54.050602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f180fb0-4039-4148-afb2-431c1de6f4be tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:54.051329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f180fb0-4039-4148-afb2-431c1de6f4be tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:54.052292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f180fb0-4039-4148-afb2-431c1de6f4be tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:54.054073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f180fb0-4039-4148-afb2-431c1de6f4be tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:54.297229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0f180fb0-4039-4148-afb2-431c1de6f4be tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:54.307633 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0f180fb0-4039-4148-afb2-431c1de6f4be tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.277246 May 28 05:07:54.311046 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2967/6047] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:54 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:54.501977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-048a496b-8bbe-4229-9e85-bf8aa0d1a77e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:54.502805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-048a496b-8bbe-4229-9e85-bf8aa0d1a77e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:54.530907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-048a496b-8bbe-4229-9e85-bf8aa0d1a77e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:54.531414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-048a496b-8bbe-4229-9e85-bf8aa0d1a77e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:54.545085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-048a496b-8bbe-4229-9e85-bf8aa0d1a77e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:54.545085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-048a496b-8bbe-4229-9e85-bf8aa0d1a77e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:54.668744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-048a496b-8bbe-4229-9e85-bf8aa0d1a77e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:54.670132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-048a496b-8bbe-4229-9e85-bf8aa0d1a77e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:54.670628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-048a496b-8bbe-4229-9e85-bf8aa0d1a77e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lazy-loading 'fault' on Instance uuid ed9c976c-7828-4df6-95e7-39aeed297c77 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:07:54.760702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-048a496b-8bbe-4229-9e85-bf8aa0d1a77e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:54.765304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:07:54.777697 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-048a496b-8bbe-4229-9e85-bf8aa0d1a77e tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 200 len: 1331 microversion: 2.1 time: 0.282173 May 28 05:07:54.779571 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3081/6048] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:54 2022] GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 1331 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:55.328691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a0462f93-ba82-477b-98ff-b307bd3e70f8 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:55.331631 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a0462f93-ba82-477b-98ff-b307bd3e70f8 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:55.344686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a0462f93-ba82-477b-98ff-b307bd3e70f8 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:55.348437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a0462f93-ba82-477b-98ff-b307bd3e70f8 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:55.349764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a0462f93-ba82-477b-98ff-b307bd3e70f8 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:55.350217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a0462f93-ba82-477b-98ff-b307bd3e70f8 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:55.356076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:07:55.621183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a0462f93-ba82-477b-98ff-b307bd3e70f8 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:55.630047 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a0462f93-ba82-477b-98ff-b307bd3e70f8 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.306279 May 28 05:07:55.643380 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2968/6049] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:55 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:55.674387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-0f156423-7e13-4240-a23f-1d2d1aa0d9a8 req-f7bcd9e3-4da9-4b2b-bc47-7b2213469e87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "334654f9-2ad8-4cef-b4e8-bf45eb69f937", "tag": "9efbcbd3-4d06-4190-8016-20cbfae73fe4"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:07:55.687231 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-0f156423-7e13-4240-a23f-1d2d1aa0d9a8 req-f7bcd9e3-4da9-4b2b-bc47-7b2213469e87 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:55.687691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-0f156423-7e13-4240-a23f-1d2d1aa0d9a8 req-f7bcd9e3-4da9-4b2b-bc47-7b2213469e87 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:55.711195 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-0f156423-7e13-4240-a23f-1d2d1aa0d9a8 req-f7bcd9e3-4da9-4b2b-bc47-7b2213469e87 service nova] Creating event network-changed:9efbcbd3-4d06-4190-8016-20cbfae73fe4 for instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 on n-h2-843700-1 May 28 05:07:55.718379 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-0f156423-7e13-4240-a23f-1d2d1aa0d9a8 req-f7bcd9e3-4da9-4b2b-bc47-7b2213469e87 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047914 May 28 05:07:55.719583 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3082/6050] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:07:55.802129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2e51a20f-76d3-4ac6-948a-b71d3504b6b2 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:55.802687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2e51a20f-76d3-4ac6-948a-b71d3504b6b2 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: ed9c976c-7828-4df6-95e7-39aeed297c77] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:55.812707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2e51a20f-76d3-4ac6-948a-b71d3504b6b2 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:55.813177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2e51a20f-76d3-4ac6-948a-b71d3504b6b2 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:55.813974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2e51a20f-76d3-4ac6-948a-b71d3504b6b2 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:55.822002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2e51a20f-76d3-4ac6-948a-b71d3504b6b2 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:55.869534 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-2e51a20f-76d3-4ac6-948a-b71d3504b6b2 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] HTTP exception thrown: Instance ed9c976c-7828-4df6-95e7-39aeed297c77 could not be found. May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2e51a20f-76d3-4ac6-948a-b71d3504b6b2 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Request method failure captured: May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 HTTP/1.1 May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABika2vC5Ey0aIdcZ00KX7WXgXqAVkVtcRpskmv5kUs0YDMhYACY11pyEQvsc_AOsdn0c_zhww3dG2oJnQNa6C4w-4jkwZO1-e_N5g_52CpZ-eMiRhDWSwzq53XDRr8PIfbD_gQmsCfEPJR6VRtIL2iKbqVDLsaYd3nq_mbJT9xy74G9o4 May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 831c7c287df6450c92a8103d2c1a6521 May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1416118784 May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_831c7c287df6450c92a8103d2c1a6521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/831c7c287df6450c92a8103d2c1a6521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/831c7c287df6450c92a8103d2c1a6521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/831c7c287df6450c92a8103d2c1a6521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1416118784 May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 831c7c287df6450c92a8103d2c1a6521 May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1416118784 May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestSecurityGroupsBasicOps-1416118784-project May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 72e8b077e13842ebb336a8d0861373f5 May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1416118784-project May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance ed9c976c-7828-4df6-95e7-39aeed297c77 could not be found. May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'ed9c976c-7828-4df6-95e7-39aeed297c77'} May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed9c976c-7828-4df6-95e7-39aeed297c77 could not be found. May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed9c976c-7828-4df6-95e7-39aeed297c77 could not be found. May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:07:55.878760 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:07:55.884708 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:07:55.884708 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:07:55.884708 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:07:55.884708 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:07:55.884708 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:07:55.884708 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed9c976c-7828-4df6-95e7-39aeed297c77 could not be found. May 28 05:07:55.884708 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:07:55.884708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2e51a20f-76d3-4ac6-948a-b71d3504b6b2 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Returning 404 to user: Instance ed9c976c-7828-4df6-95e7-39aeed297c77 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:07:55.884708 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2e51a20f-76d3-4ac6-948a-b71d3504b6b2 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77" status: 404 len: 111 microversion: 2.1 time: 0.082423 May 28 05:07:55.886266 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2969/6051] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:55 2022] GET /compute/v2.1/servers/ed9c976c-7828-4df6-95e7-39aeed297c77 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:07:56.186709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-17ea42b8-a8f9-4a88-956c-82ae9aacbc22 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:56.193877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-17ea42b8-a8f9-4a88-956c-82ae9aacbc22 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:56.234896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-17ea42b8-a8f9-4a88-956c-82ae9aacbc22 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:56.237119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-17ea42b8-a8f9-4a88-956c-82ae9aacbc22 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:56.238838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-17ea42b8-a8f9-4a88-956c-82ae9aacbc22 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:56.241233 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-17ea42b8-a8f9-4a88-956c-82ae9aacbc22 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:56.347044 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-17ea42b8-a8f9-4a88-956c-82ae9aacbc22 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments/8a603cdf-2c79-49c4-901f-caceb3a1d390" status: 200 len: 194 microversion: 2.1 time: 0.181583 May 28 05:07:56.365498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-09a46536-7456-45e3-b567-9ebac023de6b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:56.367235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-09a46536-7456-45e3-b567-9ebac023de6b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:56.370532 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3083/6052] 10.222.0.58 () {58 vars in 1412 bytes} [Sat May 28 05:07:56 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments/8a603cdf-2c79-49c4-901f-caceb3a1d390 => generated 194 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:07:56.382700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09a46536-7456-45e3-b567-9ebac023de6b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:56.383607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09a46536-7456-45e3-b567-9ebac023de6b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:56.386847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09a46536-7456-45e3-b567-9ebac023de6b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:56.389519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09a46536-7456-45e3-b567-9ebac023de6b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:56.650631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d905e97f-2076-4e5f-9ffc-5a9e3dda923e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:56.651634 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d905e97f-2076-4e5f-9ffc-5a9e3dda923e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:56.670253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d905e97f-2076-4e5f-9ffc-5a9e3dda923e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:56.675494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d905e97f-2076-4e5f-9ffc-5a9e3dda923e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:56.681282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d905e97f-2076-4e5f-9ffc-5a9e3dda923e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:56.685901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d905e97f-2076-4e5f-9ffc-5a9e3dda923e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:56.764740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-09a46536-7456-45e3-b567-9ebac023de6b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lazy-loading 'services' on Instance uuid 54892188-1116-41fc-a42e-20850995d769 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:07:57.165826 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-09a46536-7456-45e3-b567-9ebac023de6b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "DELETE /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments/8a603cdf-2c79-49c4-901f-caceb3a1d390" status: 202 len: 0 microversion: 2.1 time: 0.809759 May 28 05:07:57.169816 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2970/6053] 10.222.0.58 () {58 vars in 1415 bytes} [Sat May 28 05:07:56 2022] DELETE /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments/8a603cdf-2c79-49c4-901f-caceb3a1d390 => generated 0 bytes in 812 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:07:57.280897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d905e97f-2076-4e5f-9ffc-5a9e3dda923e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:57.302676 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d905e97f-2076-4e5f-9ffc-5a9e3dda923e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.646192 May 28 05:07:57.304908 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3084/6054] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:56 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:07:58.332608 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3a684a62-165a-4256-9a3b-00380ebaa0a2 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:58.333936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3a684a62-165a-4256-9a3b-00380ebaa0a2 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:58.358366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a684a62-165a-4256-9a3b-00380ebaa0a2 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:58.362087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a684a62-165a-4256-9a3b-00380ebaa0a2 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:58.363837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a684a62-165a-4256-9a3b-00380ebaa0a2 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:58.364481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a684a62-165a-4256-9a3b-00380ebaa0a2 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:58.623704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3a684a62-165a-4256-9a3b-00380ebaa0a2 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:07:58.634200 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3a684a62-165a-4256-9a3b-00380ebaa0a2 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.306680 May 28 05:07:58.635589 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2971/6055] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:58 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:07:59.653286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-557cb1ed-665f-4216-aa4b-b957717d2e33 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:07:59.654026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-557cb1ed-665f-4216-aa4b-b957717d2e33 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:07:59.672288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-557cb1ed-665f-4216-aa4b-b957717d2e33 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:59.672770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-557cb1ed-665f-4216-aa4b-b957717d2e33 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:07:59.674134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-557cb1ed-665f-4216-aa4b-b957717d2e33 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:07:59.674759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-557cb1ed-665f-4216-aa4b-b957717d2e33 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:00.046856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-557cb1ed-665f-4216-aa4b-b957717d2e33 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:00.056218 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-557cb1ed-665f-4216-aa4b-b957717d2e33 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.408431 May 28 05:08:00.059607 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3085/6056] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:07:59 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:01.072943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-09abc250-7072-47d9-89aa-4645ee911b46 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:01.074965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-09abc250-7072-47d9-89aa-4645ee911b46 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:01.094612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09abc250-7072-47d9-89aa-4645ee911b46 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:01.095126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09abc250-7072-47d9-89aa-4645ee911b46 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:01.095941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09abc250-7072-47d9-89aa-4645ee911b46 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:01.096394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09abc250-7072-47d9-89aa-4645ee911b46 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:01.522350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-09abc250-7072-47d9-89aa-4645ee911b46 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:01.543440 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-09abc250-7072-47d9-89aa-4645ee911b46 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.473336 May 28 05:08:01.546544 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2972/6057] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:01 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:02.562131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-00448c64-f24d-42d2-9ba9-f1fb2bee4a68 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:02.564632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-00448c64-f24d-42d2-9ba9-f1fb2bee4a68 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:02.590610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00448c64-f24d-42d2-9ba9-f1fb2bee4a68 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:02.591589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00448c64-f24d-42d2-9ba9-f1fb2bee4a68 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:02.592536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00448c64-f24d-42d2-9ba9-f1fb2bee4a68 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:02.593075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00448c64-f24d-42d2-9ba9-f1fb2bee4a68 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:02.845747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-00448c64-f24d-42d2-9ba9-f1fb2bee4a68 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:02.856068 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-00448c64-f24d-42d2-9ba9-f1fb2bee4a68 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.299361 May 28 05:08:02.857403 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3086/6058] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:02 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:03.873373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dc2c17a1-1bf0-4b4d-8c71-dfc716875fe1 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:03.873980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dc2c17a1-1bf0-4b4d-8c71-dfc716875fe1 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:03.898906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc2c17a1-1bf0-4b4d-8c71-dfc716875fe1 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:03.899386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc2c17a1-1bf0-4b4d-8c71-dfc716875fe1 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:03.900731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc2c17a1-1bf0-4b4d-8c71-dfc716875fe1 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:03.901174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc2c17a1-1bf0-4b4d-8c71-dfc716875fe1 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:04.404623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dc2c17a1-1bf0-4b4d-8c71-dfc716875fe1 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:04.415555 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dc2c17a1-1bf0-4b4d-8c71-dfc716875fe1 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.545706 May 28 05:08:04.443930 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2973/6059] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:03 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:05.434531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-408591b4-d80e-446c-838a-e2b451cd3341 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:05.434980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-408591b4-d80e-446c-838a-e2b451cd3341 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:05.458742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-408591b4-d80e-446c-838a-e2b451cd3341 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:05.459310 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-408591b4-d80e-446c-838a-e2b451cd3341 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:05.460090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-408591b4-d80e-446c-838a-e2b451cd3341 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:05.460533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-408591b4-d80e-446c-838a-e2b451cd3341 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:06.667996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-408591b4-d80e-446c-838a-e2b451cd3341 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:06.688798 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-408591b4-d80e-446c-838a-e2b451cd3341 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 1.258796 May 28 05:08:06.699605 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3087/6060] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:05 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:06.755259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-c625eaa9-3bb0-458f-bcc8-8ee63b2e3699 req-22bcd3d4-0321-432f-b67f-8e369be464aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb4191f6-3ae0-4b2d-bfe8-2af221bfa115", "tag": "e7e980dd-9d32-410b-a22c-b9f4e80fdf41"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:08:06.759931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2fe9d427-4df8-4f25-b24f-8be992805a46 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:06.759931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2fe9d427-4df8-4f25-b24f-8be992805a46 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:06.779046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2fe9d427-4df8-4f25-b24f-8be992805a46 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:06.783451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2fe9d427-4df8-4f25-b24f-8be992805a46 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:06.785207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c625eaa9-3bb0-458f-bcc8-8ee63b2e3699 req-22bcd3d4-0321-432f-b67f-8e369be464aa service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:06.785670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c625eaa9-3bb0-458f-bcc8-8ee63b2e3699 req-22bcd3d4-0321-432f-b67f-8e369be464aa service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:06.787576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2fe9d427-4df8-4f25-b24f-8be992805a46 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:06.788237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2fe9d427-4df8-4f25-b24f-8be992805a46 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:06.804012 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-c625eaa9-3bb0-458f-bcc8-8ee63b2e3699 req-22bcd3d4-0321-432f-b67f-8e369be464aa service nova] Creating event network-changed:e7e980dd-9d32-410b-a22c-b9f4e80fdf41 for instance fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 on n-h2-843700-1 May 28 05:08:06.831834 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-c625eaa9-3bb0-458f-bcc8-8ee63b2e3699 req-22bcd3d4-0321-432f-b67f-8e369be464aa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082436 May 28 05:08:06.832783 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3088/6061] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:08:06.860388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2fe9d427-4df8-4f25-b24f-8be992805a46 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:08:07.238299 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2fe9d427-4df8-4f25-b24f-8be992805a46 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 204 len: 0 microversion: 2.1 time: 0.492723 May 28 05:08:07.240314 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2974/6062] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:08:06 2022] DELETE /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:08:07.249596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-05d8570f-3458-4e53-9266-edece60b2655 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:07.250352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-05d8570f-3458-4e53-9266-edece60b2655 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:07.267404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05d8570f-3458-4e53-9266-edece60b2655 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:07.267404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05d8570f-3458-4e53-9266-edece60b2655 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:07.267404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05d8570f-3458-4e53-9266-edece60b2655 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:07.267404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05d8570f-3458-4e53-9266-edece60b2655 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:07.626500 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-05d8570f-3458-4e53-9266-edece60b2655 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:07.634949 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-05d8570f-3458-4e53-9266-edece60b2655 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1766 microversion: 2.1 time: 0.389051 May 28 05:08:07.636905 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3089/6063] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:07 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1766 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:07.706719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0893bec8-6602-409a-9122-e0d6b5d04b5d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:07.707599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0893bec8-6602-409a-9122-e0d6b5d04b5d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:07.722108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0893bec8-6602-409a-9122-e0d6b5d04b5d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:07.723010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0893bec8-6602-409a-9122-e0d6b5d04b5d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:07.726526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0893bec8-6602-409a-9122-e0d6b5d04b5d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:07.727147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0893bec8-6602-409a-9122-e0d6b5d04b5d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:07.984247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0893bec8-6602-409a-9122-e0d6b5d04b5d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:07.994074 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0893bec8-6602-409a-9122-e0d6b5d04b5d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.291320 May 28 05:08:07.995160 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2975/6064] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:07 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:08.653533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6f07e60b-f462-4ac6-801b-1f3f823f7eba tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:08.654714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6f07e60b-f462-4ac6-801b-1f3f823f7eba tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:08.673900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f07e60b-f462-4ac6-801b-1f3f823f7eba tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:08.674474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f07e60b-f462-4ac6-801b-1f3f823f7eba tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:08.675347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f07e60b-f462-4ac6-801b-1f3f823f7eba tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:08.675799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f07e60b-f462-4ac6-801b-1f3f823f7eba tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:09.014513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d9493b99-ff53-4617-b124-7c0e8d205347 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:09.015395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d9493b99-ff53-4617-b124-7c0e8d205347 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:09.036167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d9493b99-ff53-4617-b124-7c0e8d205347 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:09.037085 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d9493b99-ff53-4617-b124-7c0e8d205347 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:09.038060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d9493b99-ff53-4617-b124-7c0e8d205347 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:09.038670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d9493b99-ff53-4617-b124-7c0e8d205347 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:09.489904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d9493b99-ff53-4617-b124-7c0e8d205347 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:09.501993 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d9493b99-ff53-4617-b124-7c0e8d205347 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.494729 May 28 05:08:09.502608 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2976/6065] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:09 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:09.509412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6f07e60b-f462-4ac6-801b-1f3f823f7eba tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:09.518387 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6f07e60b-f462-4ac6-801b-1f3f823f7eba tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1766 microversion: 2.1 time: 0.869830 May 28 05:08:09.522880 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3090/6066] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:08 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1766 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:09.995820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-2766f5d2-0daa-4a27-b6b5-d2f5c30bca0e req-cdd8b0bb-37c0-4ec9-a4ae-3c5c03787ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4191f6-3ae0-4b2d-bfe8-2af221bfa115", "name": "network-vif-deleted", "tag": "e7e980dd-9d32-410b-a22c-b9f4e80fdf41"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:08:10.011185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2766f5d2-0daa-4a27-b6b5-d2f5c30bca0e req-cdd8b0bb-37c0-4ec9-a4ae-3c5c03787ee9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:10.012030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2766f5d2-0daa-4a27-b6b5-d2f5c30bca0e req-cdd8b0bb-37c0-4ec9-a4ae-3c5c03787ee9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:10.029713 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-2766f5d2-0daa-4a27-b6b5-d2f5c30bca0e req-cdd8b0bb-37c0-4ec9-a4ae-3c5c03787ee9 service nova] Creating event network-vif-deleted:e7e980dd-9d32-410b-a22c-b9f4e80fdf41 for instance fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 on n-h2-843700-1 May 28 05:08:10.041161 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-2766f5d2-0daa-4a27-b6b5-d2f5c30bca0e req-cdd8b0bb-37c0-4ec9-a4ae-3c5c03787ee9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054688 May 28 05:08:10.055486 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2977/6067] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:08:10.517909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-96960d5e-da26-420b-b542-3badddc19a13 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:10.518531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-96960d5e-da26-420b-b542-3badddc19a13 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:10.534270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96960d5e-da26-420b-b542-3badddc19a13 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:10.534728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96960d5e-da26-420b-b542-3badddc19a13 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:10.535546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96960d5e-da26-420b-b542-3badddc19a13 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:10.535991 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96960d5e-da26-420b-b542-3badddc19a13 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:10.544287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-100c3211-21ef-4864-bc7f-b4b51201c697 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:10.545106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-100c3211-21ef-4864-bc7f-b4b51201c697 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:10.560081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-100c3211-21ef-4864-bc7f-b4b51201c697 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:10.560849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-100c3211-21ef-4864-bc7f-b4b51201c697 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:10.561838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-100c3211-21ef-4864-bc7f-b4b51201c697 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:10.562451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-100c3211-21ef-4864-bc7f-b4b51201c697 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:10.619206 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-100c3211-21ef-4864-bc7f-b4b51201c697 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:10.619671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-100c3211-21ef-4864-bc7f-b4b51201c697 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:10.620130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-100c3211-21ef-4864-bc7f-b4b51201c697 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lazy-loading 'fault' on Instance uuid fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:08:10.782682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-100c3211-21ef-4864-bc7f-b4b51201c697 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e8b077e13842ebb336a8d0861373f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831c7c287df6450c92a8103d2c1a6521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:10.792989 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-100c3211-21ef-4864-bc7f-b4b51201c697 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 200 len: 1383 microversion: 2.1 time: 0.254354 May 28 05:08:10.804340 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2978/6068] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:10 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 1383 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:10.835627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-96960d5e-da26-420b-b542-3badddc19a13 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:10.844593 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-96960d5e-da26-420b-b542-3badddc19a13 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.330490 May 28 05:08:10.849003 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3091/6069] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:10 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:11.812405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7b264ae8-9814-4e71-bbc1-29a50be787d0 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:11.813049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7b264ae8-9814-4e71-bbc1-29a50be787d0 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] [instance: fb4191f6-3ae0-4b2d-bfe8-2af221bfa115] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:11.820525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b264ae8-9814-4e71-bbc1-29a50be787d0 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:11.821220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b264ae8-9814-4e71-bbc1-29a50be787d0 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:11.822553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b264ae8-9814-4e71-bbc1-29a50be787d0 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:11.823099 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b264ae8-9814-4e71-bbc1-29a50be787d0 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:11.853638 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-7b264ae8-9814-4e71-bbc1-29a50be787d0 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] HTTP exception thrown: Instance fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 could not be found. May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7b264ae8-9814-4e71-bbc1-29a50be787d0 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Request method failure captured: May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 HTTP/1.1 May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABika2vC5Ey0aIdcZ00KX7WXgXqAVkVtcRpskmv5kUs0YDMhYACY11pyEQvsc_AOsdn0c_zhww3dG2oJnQNa6C4w-4jkwZO1-e_N5g_52CpZ-eMiRhDWSwzq53XDRr8PIfbD_gQmsCfEPJR6VRtIL2iKbqVDLsaYd3nq_mbJT9xy74G9o4 May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 831c7c287df6450c92a8103d2c1a6521 May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1416118784 May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_831c7c287df6450c92a8103d2c1a6521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/831c7c287df6450c92a8103d2c1a6521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/831c7c287df6450c92a8103d2c1a6521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/831c7c287df6450c92a8103d2c1a6521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1416118784 May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 831c7c287df6450c92a8103d2c1a6521 May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1416118784 May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestSecurityGroupsBasicOps-1416118784-project May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 72e8b077e13842ebb336a8d0861373f5 May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1416118784-project May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 could not be found. May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'fb4191f6-3ae0-4b2d-bfe8-2af221bfa115'} May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 could not be found. May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 could not be found. May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:08:11.855370 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:08:11.860614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:08:11.860614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:08:11.860614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:08:11.860614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:08:11.860614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:08:11.860614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 could not be found. May 28 05:08:11.860614 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:08:11.860614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7b264ae8-9814-4e71-bbc1-29a50be787d0 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Returning 404 to user: Instance fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:08:11.860614 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7b264ae8-9814-4e71-bbc1-29a50be787d0 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115" status: 404 len: 111 microversion: 2.1 time: 0.048477 May 28 05:08:11.861973 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2979/6070] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:11 2022] GET /compute/v2.1/servers/fb4191f6-3ae0-4b2d-bfe8-2af221bfa115 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:08:11.865976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-89482d8b-52c3-4036-bfc8-850a6aa8f0fe tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:11.866594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-89482d8b-52c3-4036-bfc8-850a6aa8f0fe tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:11.879953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89482d8b-52c3-4036-bfc8-850a6aa8f0fe tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:11.880416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89482d8b-52c3-4036-bfc8-850a6aa8f0fe tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:11.881208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89482d8b-52c3-4036-bfc8-850a6aa8f0fe tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:11.884644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89482d8b-52c3-4036-bfc8-850a6aa8f0fe tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:12.117716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-89482d8b-52c3-4036-bfc8-850a6aa8f0fe tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:12.130431 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-89482d8b-52c3-4036-bfc8-850a6aa8f0fe tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.268295 May 28 05:08:12.132759 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3092/6071] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:11 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:13.149772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a68aa546-9659-44a1-a7c2-a41e075824b8 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:13.150613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a68aa546-9659-44a1-a7c2-a41e075824b8 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:13.162092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:08:13.165934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a68aa546-9659-44a1-a7c2-a41e075824b8 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:13.169861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a68aa546-9659-44a1-a7c2-a41e075824b8 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:13.169861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a68aa546-9659-44a1-a7c2-a41e075824b8 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:13.169861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a68aa546-9659-44a1-a7c2-a41e075824b8 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:13.566605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a68aa546-9659-44a1-a7c2-a41e075824b8 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:13.578333 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a68aa546-9659-44a1-a7c2-a41e075824b8 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.432521 May 28 05:08:13.590363 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2980/6072] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:13 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:14.597110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7698f9cd-fa4f-4278-97e5-43b1902b16a0 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:14.598551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7698f9cd-fa4f-4278-97e5-43b1902b16a0 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:14.609253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7698f9cd-fa4f-4278-97e5-43b1902b16a0 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:14.609953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7698f9cd-fa4f-4278-97e5-43b1902b16a0 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:14.611706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7698f9cd-fa4f-4278-97e5-43b1902b16a0 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:14.612377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7698f9cd-fa4f-4278-97e5-43b1902b16a0 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:14.947766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7698f9cd-fa4f-4278-97e5-43b1902b16a0 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:14.960654 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7698f9cd-fa4f-4278-97e5-43b1902b16a0 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.365140 May 28 05:08:14.960654 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3093/6073] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:14 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:15.974144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-437154db-595b-478e-a76b-481f7da7f9f1 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:15.974776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-437154db-595b-478e-a76b-481f7da7f9f1 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:15.987333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-437154db-595b-478e-a76b-481f7da7f9f1 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:15.997893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-437154db-595b-478e-a76b-481f7da7f9f1 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:15.997893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-437154db-595b-478e-a76b-481f7da7f9f1 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:15.997893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-437154db-595b-478e-a76b-481f7da7f9f1 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:16.357422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-437154db-595b-478e-a76b-481f7da7f9f1 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:16.365896 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-437154db-595b-478e-a76b-481f7da7f9f1 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.396127 May 28 05:08:16.366498 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2981/6074] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:15 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:17.027088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2e3452ee-f711-43b3-9972-52f6e65c99be tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:17.028748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2e3452ee-f711-43b3-9972-52f6e65c99be tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:17.046449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e3452ee-f711-43b3-9972-52f6e65c99be tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:17.046998 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e3452ee-f711-43b3-9972-52f6e65c99be tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:17.051404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e3452ee-f711-43b3-9972-52f6e65c99be tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:17.051404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e3452ee-f711-43b3-9972-52f6e65c99be tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:17.091269 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2e3452ee-f711-43b3-9972-52f6e65c99be tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068609 May 28 05:08:17.102584 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3094/6075] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:08:17 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 05:08:17.327291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-85d0517c-8cc6-4ab8-a514-b4fb125a5796 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:17.328298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-85d0517c-8cc6-4ab8-a514-b4fb125a5796 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:17.338537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85d0517c-8cc6-4ab8-a514-b4fb125a5796 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:17.339037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85d0517c-8cc6-4ab8-a514-b4fb125a5796 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:17.351742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85d0517c-8cc6-4ab8-a514-b4fb125a5796 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:17.352216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85d0517c-8cc6-4ab8-a514-b4fb125a5796 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:17.382354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b0f941fe-a2ec-4741-9cd9-051a8d41b098 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:17.383389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b0f941fe-a2ec-4741-9cd9-051a8d41b098 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:17.390433 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0f941fe-a2ec-4741-9cd9-051a8d41b098 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:17.393454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0f941fe-a2ec-4741-9cd9-051a8d41b098 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:17.395485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0f941fe-a2ec-4741-9cd9-051a8d41b098 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:17.396122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0f941fe-a2ec-4741-9cd9-051a8d41b098 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:17.421477 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-85d0517c-8cc6-4ab8-a514-b4fb125a5796 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.098203 May 28 05:08:17.425406 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2982/6076] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:08:17 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 05:08:17.563620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4f1ccf82-c79d-4ec9-abfa-0192ba0df3ab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:17.564310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4f1ccf82-c79d-4ec9-abfa-0192ba0df3ab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:17.570889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4f1ccf82-c79d-4ec9-abfa-0192ba0df3ab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:17.572297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4f1ccf82-c79d-4ec9-abfa-0192ba0df3ab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:17.573373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4f1ccf82-c79d-4ec9-abfa-0192ba0df3ab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:17.574071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4f1ccf82-c79d-4ec9-abfa-0192ba0df3ab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:17.662972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4f1ccf82-c79d-4ec9-abfa-0192ba0df3ab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:08:17.751986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:08:17.757357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b0f941fe-a2ec-4741-9cd9-051a8d41b098 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:17.775918 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b0f941fe-a2ec-4741-9cd9-051a8d41b098 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.396884 May 28 05:08:17.779973 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3095/6077] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:17 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:08:18.076675 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4f1ccf82-c79d-4ec9-abfa-0192ba0df3ab tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "DELETE /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 204 len: 0 microversion: 2.1 time: 0.517024 May 28 05:08:18.078150 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2983/6078] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:08:17 2022] DELETE /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 05:08:18.086826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7f7c5286-a0c6-451c-88bb-6c954f71aa84 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:18.088203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7f7c5286-a0c6-451c-88bb-6c954f71aa84 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:18.103478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f7c5286-a0c6-451c-88bb-6c954f71aa84 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:18.104024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f7c5286-a0c6-451c-88bb-6c954f71aa84 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:18.111376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f7c5286-a0c6-451c-88bb-6c954f71aa84 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:18.111376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f7c5286-a0c6-451c-88bb-6c954f71aa84 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:18.367505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7f7c5286-a0c6-451c-88bb-6c954f71aa84 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:18.378383 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7f7c5286-a0c6-451c-88bb-6c954f71aa84 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 200 len: 1671 microversion: 2.1 time: 0.295382 May 28 05:08:18.380250 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3096/6079] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:18 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 1671 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:18.782308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-281d837d-7aca-4807-b5c7-b7a35e3bae94 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] Calling method '.version_select at 0x7f7700c9dc10>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:18.799398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f148a52b-1fe4-4903-b820-04a2855a3b8d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:18.801274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f148a52b-1fe4-4903-b820-04a2855a3b8d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:18.804841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:08:18.816048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f148a52b-1fe4-4903-b820-04a2855a3b8d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:18.821963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f148a52b-1fe4-4903-b820-04a2855a3b8d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:18.821963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f148a52b-1fe4-4903-b820-04a2855a3b8d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:18.821963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f148a52b-1fe4-4903-b820-04a2855a3b8d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:18.919106 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-281d837d-7aca-4807-b5c7-b7a35e3bae94 tempest-TestSecurityGroupsBasicOps-1416118784 tempest-TestSecurityGroupsBasicOps-1416118784-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-199357320" status: 202 len: 0 microversion: 2.1 time: 0.141881 May 28 05:08:18.919678 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2984/6080] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 05:08:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-199357320 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:08:19.000752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f148a52b-1fe4-4903-b820-04a2855a3b8d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:19.028873 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f148a52b-1fe4-4903-b820-04a2855a3b8d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.236182 May 28 05:08:19.029523 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3097/6081] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:18 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:19.400145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8ef9f46d-fd50-445e-91b3-48b6b7972bd1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:19.403115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8ef9f46d-fd50-445e-91b3-48b6b7972bd1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:19.417614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ef9f46d-fd50-445e-91b3-48b6b7972bd1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:19.421379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ef9f46d-fd50-445e-91b3-48b6b7972bd1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:19.425274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ef9f46d-fd50-445e-91b3-48b6b7972bd1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:19.426040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ef9f46d-fd50-445e-91b3-48b6b7972bd1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:19.613661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8ef9f46d-fd50-445e-91b3-48b6b7972bd1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:19.621706 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8ef9f46d-fd50-445e-91b3-48b6b7972bd1 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 200 len: 1671 microversion: 2.1 time: 0.228062 May 28 05:08:19.623891 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2985/6082] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:19 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 1671 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:20.046838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-26f80b19-c475-4830-aed7-e71b0a55cfd9 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:20.047503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-26f80b19-c475-4830-aed7-e71b0a55cfd9 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:20.060260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26f80b19-c475-4830-aed7-e71b0a55cfd9 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:20.060260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26f80b19-c475-4830-aed7-e71b0a55cfd9 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:20.060260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26f80b19-c475-4830-aed7-e71b0a55cfd9 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:20.060260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26f80b19-c475-4830-aed7-e71b0a55cfd9 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:20.190033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b0d6c2c4-066b-43e9-9e87-494c6ef4c1ce tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d43dbf0f-56b9-45bf-b606-3a8c23c7718b", "device": "/dev/sdb"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:08:20.192011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b0d6c2c4-066b-43e9-9e87-494c6ef4c1ce tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:20.202436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0d6c2c4-066b-43e9-9e87-494c6ef4c1ce tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:20.203335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0d6c2c4-066b-43e9-9e87-494c6ef4c1ce tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:20.204359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0d6c2c4-066b-43e9-9e87-494c6ef4c1ce tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:20.205024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0d6c2c4-066b-43e9-9e87-494c6ef4c1ce tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:20.517431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-26f80b19-c475-4830-aed7-e71b0a55cfd9 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:20.528715 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-26f80b19-c475-4830-aed7-e71b0a55cfd9 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.483637 May 28 05:08:20.537564 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3098/6083] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:20 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:20.641674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-846fb37e-33f5-4ce0-b811-98d4e67fbd99 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:20.643209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-846fb37e-33f5-4ce0-b811-98d4e67fbd99 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:20.669538 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-846fb37e-33f5-4ce0-b811-98d4e67fbd99 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:20.669920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-846fb37e-33f5-4ce0-b811-98d4e67fbd99 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:20.670727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-846fb37e-33f5-4ce0-b811-98d4e67fbd99 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:20.675112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-846fb37e-33f5-4ce0-b811-98d4e67fbd99 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:21.012826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-846fb37e-33f5-4ce0-b811-98d4e67fbd99 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:21.017345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:08:21.026548 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-846fb37e-33f5-4ce0-b811-98d4e67fbd99 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 200 len: 1671 microversion: 2.1 time: 0.389190 May 28 05:08:21.029100 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3099/6084] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:20 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 1671 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:21.406848 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b0d6c2c4-066b-43e9-9e87-494c6ef4c1ce tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "POST /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.207729 May 28 05:08:21.421443 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2986/6085] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 05:08:20 2022] POST /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd/os-volume_attachments => generated 194 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:08:21.448151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-748edd88-6cd7-463a-9c18-31ac24fa3ba0 req-9f2cc14c-3a99-44ff-b3b7-15a49bfe4b7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54892188-1116-41fc-a42e-20850995d769", "name": "network-vif-deleted", "tag": "addb9a17-3534-49f8-bb69-db3516e24c57"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:08:21.477179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-748edd88-6cd7-463a-9c18-31ac24fa3ba0 req-9f2cc14c-3a99-44ff-b3b7-15a49bfe4b7b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:21.481206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-748edd88-6cd7-463a-9c18-31ac24fa3ba0 req-9f2cc14c-3a99-44ff-b3b7-15a49bfe4b7b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:21.519869 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-748edd88-6cd7-463a-9c18-31ac24fa3ba0 req-9f2cc14c-3a99-44ff-b3b7-15a49bfe4b7b service nova] Creating event network-vif-deleted:addb9a17-3534-49f8-bb69-db3516e24c57 for instance 54892188-1116-41fc-a42e-20850995d769 on n-h1-843700-1 May 28 05:08:21.553503 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-748edd88-6cd7-463a-9c18-31ac24fa3ba0 req-9f2cc14c-3a99-44ff-b3b7-15a49bfe4b7b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108002 May 28 05:08:21.565999 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3100/6086] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:08:21.566087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-43f2d7d7-c2b3-4839-80ee-f87df9cb7bbf tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:21.571921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-43f2d7d7-c2b3-4839-80ee-f87df9cb7bbf tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:21.619931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43f2d7d7-c2b3-4839-80ee-f87df9cb7bbf tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:21.622542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43f2d7d7-c2b3-4839-80ee-f87df9cb7bbf tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:21.627526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43f2d7d7-c2b3-4839-80ee-f87df9cb7bbf tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:21.630890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43f2d7d7-c2b3-4839-80ee-f87df9cb7bbf tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:22.049219 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fd730c96-c5d1-4661-8bcd-8b69c9f3bc57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:22.050208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fd730c96-c5d1-4661-8bcd-8b69c9f3bc57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:22.062032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd730c96-c5d1-4661-8bcd-8b69c9f3bc57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:22.074824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd730c96-c5d1-4661-8bcd-8b69c9f3bc57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:22.074824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd730c96-c5d1-4661-8bcd-8b69c9f3bc57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:22.074824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd730c96-c5d1-4661-8bcd-8b69c9f3bc57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:22.142142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-43f2d7d7-c2b3-4839-80ee-f87df9cb7bbf tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:22.145125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd730c96-c5d1-4661-8bcd-8b69c9f3bc57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:22.145857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd730c96-c5d1-4661-8bcd-8b69c9f3bc57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:22.146540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-fd730c96-c5d1-4661-8bcd-8b69c9f3bc57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lazy-loading 'fault' on Instance uuid 54892188-1116-41fc-a42e-20850995d769 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:08:22.150982 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-43f2d7d7-c2b3-4839-80ee-f87df9cb7bbf tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.607687 May 28 05:08:22.151601 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2987/6087] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:21 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:08:22.246416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fd730c96-c5d1-4661-8bcd-8b69c9f3bc57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09d2cdac73148e3ac1f118e2de31365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844635ce88914d628f312550a4b128ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:22.259679 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fd730c96-c5d1-4661-8bcd-8b69c9f3bc57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 200 len: 1327 microversion: 2.1 time: 0.212722 May 28 05:08:22.269692 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3101/6088] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:22 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 1327 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:08:23.169178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eb5ff88d-eea6-4299-abc8-b370ec02823d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:23.169867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eb5ff88d-eea6-4299-abc8-b370ec02823d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:23.186463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb5ff88d-eea6-4299-abc8-b370ec02823d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:23.186463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb5ff88d-eea6-4299-abc8-b370ec02823d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:23.186463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb5ff88d-eea6-4299-abc8-b370ec02823d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:23.186463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb5ff88d-eea6-4299-abc8-b370ec02823d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:23.277769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bfe3720c-eb4a-4dbc-9b25-44fb8e62b5d3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:23.278246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bfe3720c-eb4a-4dbc-9b25-44fb8e62b5d3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:23.297305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfe3720c-eb4a-4dbc-9b25-44fb8e62b5d3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:23.297814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfe3720c-eb4a-4dbc-9b25-44fb8e62b5d3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:23.298934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfe3720c-eb4a-4dbc-9b25-44fb8e62b5d3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:23.299613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfe3720c-eb4a-4dbc-9b25-44fb8e62b5d3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:23.341031 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-bfe3720c-eb4a-4dbc-9b25-44fb8e62b5d3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] HTTP exception thrown: Instance 54892188-1116-41fc-a42e-20850995d769 could not be found. May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bfe3720c-eb4a-4dbc-9b25-44fb8e62b5d3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Request method failure captured: May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 HTTP/1.1 May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikayX49ChvGgQpdxx6QCZpss1arw8is0ElbdxquXzH-B75VpugcrVejk4biMuUTxGKAZhs1IafiyiN7X5PGMIdJojekf1m26YqEHj26nV3GYykZmnq2EvsErgFMveGTJOzFmGvVmOQjuc2Nve0H3qarRu36CRjqOxRlpc5jL72NVq8b4 May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 844635ce88914d628f312550a4b128ba May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AttachVolumeTestJSON-1986626318 May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_844635ce88914d628f312550a4b128ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/844635ce88914d628f312550a4b128ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/844635ce88914d628f312550a4b128ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/844635ce88914d628f312550a4b128ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AttachVolumeTestJSON-1986626318 May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 844635ce88914d628f312550a4b128ba May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1986626318 May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AttachVolumeTestJSON-1986626318-project May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: c09d2cdac73148e3ac1f118e2de31365 May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AttachVolumeTestJSON-1986626318-project May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 54892188-1116-41fc-a42e-20850995d769 could not be found. May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '54892188-1116-41fc-a42e-20850995d769'} May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54892188-1116-41fc-a42e-20850995d769 could not be found. May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54892188-1116-41fc-a42e-20850995d769 could not be found. May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:08:23.348246 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:08:23.352939 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:08:23.352939 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:08:23.352939 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:08:23.352939 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:08:23.352939 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:08:23.352939 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54892188-1116-41fc-a42e-20850995d769 could not be found. May 28 05:08:23.352939 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:08:23.355921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bfe3720c-eb4a-4dbc-9b25-44fb8e62b5d3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Returning 404 to user: Instance 54892188-1116-41fc-a42e-20850995d769 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:08:23.361862 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bfe3720c-eb4a-4dbc-9b25-44fb8e62b5d3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 404 len: 111 microversion: 2.1 time: 0.085140 May 28 05:08:23.368990 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3102/6089] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:23 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:08:23.381322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7a39b2a2-03d4-4fd9-a955-00e2482701dd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '.version_select at 0x7f7700ed99d0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:23.516065 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7a39b2a2-03d4-4fd9-a955-00e2482701dd tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906678317" status: 202 len: 0 microversion: 2.1 time: 0.144942 May 28 05:08:23.520074 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3103/6090] 10.222.0.58 () {58 vars in 1220 bytes} [Sat May 28 05:08:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906678317 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:08:23.592493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eb5ff88d-eea6-4299-abc8-b370ec02823d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:23.601953 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eb5ff88d-eea6-4299-abc8-b370ec02823d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1283 microversion: 2.1 time: 0.437364 May 28 05:08:23.604007 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2988/6091] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:23 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1283 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:24.622087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-da1eae83-d412-43d1-b473-f08c0601229e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:24.623378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-da1eae83-d412-43d1-b473-f08c0601229e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:24.635460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da1eae83-d412-43d1-b473-f08c0601229e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:24.636131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da1eae83-d412-43d1-b473-f08c0601229e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:24.637178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da1eae83-d412-43d1-b473-f08c0601229e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:24.637995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da1eae83-d412-43d1-b473-f08c0601229e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:24.886157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-da1eae83-d412-43d1-b473-f08c0601229e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:24.901705 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-da1eae83-d412-43d1-b473-f08c0601229e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1271 microversion: 2.1 time: 0.285314 May 28 05:08:24.904822 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3104/6092] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:24 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1271 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:08:25.921400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f98701e2-4cff-425a-bd66-60927de1b03d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:25.922200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f98701e2-4cff-425a-bd66-60927de1b03d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:25.929322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f98701e2-4cff-425a-bd66-60927de1b03d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:25.929897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f98701e2-4cff-425a-bd66-60927de1b03d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:25.931057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f98701e2-4cff-425a-bd66-60927de1b03d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:25.931712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f98701e2-4cff-425a-bd66-60927de1b03d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:26.095023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f98701e2-4cff-425a-bd66-60927de1b03d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:26.111734 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f98701e2-4cff-425a-bd66-60927de1b03d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1271 microversion: 2.1 time: 0.194402 May 28 05:08:26.112352 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2989/6093] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:25 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1271 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:08:27.135137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7c6de1de-8208-4902-b26e-9d0a456aea83 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:27.137117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7c6de1de-8208-4902-b26e-9d0a456aea83 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:27.148207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7c6de1de-8208-4902-b26e-9d0a456aea83 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:27.159346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7c6de1de-8208-4902-b26e-9d0a456aea83 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:27.160351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7c6de1de-8208-4902-b26e-9d0a456aea83 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:27.161057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7c6de1de-8208-4902-b26e-9d0a456aea83 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:27.321260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7c6de1de-8208-4902-b26e-9d0a456aea83 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:27.326941 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7c6de1de-8208-4902-b26e-9d0a456aea83 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1271 microversion: 2.1 time: 0.200126 May 28 05:08:27.328103 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3105/6094] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:27 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1271 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:27.746330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8696dc31-9bfa-4037-8c2f-50e8a46ecc3c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:27.746935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8696dc31-9bfa-4037-8c2f-50e8a46ecc3c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:27.754100 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8696dc31-9bfa-4037-8c2f-50e8a46ecc3c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:27.754703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8696dc31-9bfa-4037-8c2f-50e8a46ecc3c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:27.755591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8696dc31-9bfa-4037-8c2f-50e8a46ecc3c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:27.756109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8696dc31-9bfa-4037-8c2f-50e8a46ecc3c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:27.782090 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8696dc31-9bfa-4037-8c2f-50e8a46ecc3c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/ips" status: 200 len: 153 microversion: 2.20 time: 0.039778 May 28 05:08:27.782811 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2990/6095] 10.222.0.58 () {60 vars in 1288 bytes} [Sat May 28 05:08:27 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/ips => generated 153 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:08:28.344978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d71446fc-ebde-4469-aa9c-d38b801824cd tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:28.346282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d71446fc-ebde-4469-aa9c-d38b801824cd tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:28.354353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d71446fc-ebde-4469-aa9c-d38b801824cd tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:28.355158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d71446fc-ebde-4469-aa9c-d38b801824cd tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:28.356196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d71446fc-ebde-4469-aa9c-d38b801824cd tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:28.357182 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d71446fc-ebde-4469-aa9c-d38b801824cd tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:28.643414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d71446fc-ebde-4469-aa9c-d38b801824cd tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:28.659328 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d71446fc-ebde-4469-aa9c-d38b801824cd tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1271 microversion: 2.1 time: 0.315864 May 28 05:08:28.660176 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3106/6096] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:28 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1271 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:08:29.677464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5b6fdb1c-aa86-40dd-8383-d2c5f18f90ed tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:29.678619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5b6fdb1c-aa86-40dd-8383-d2c5f18f90ed tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:29.686850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5b6fdb1c-aa86-40dd-8383-d2c5f18f90ed tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:29.687747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5b6fdb1c-aa86-40dd-8383-d2c5f18f90ed tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:29.688765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5b6fdb1c-aa86-40dd-8383-d2c5f18f90ed tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:29.689440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5b6fdb1c-aa86-40dd-8383-d2c5f18f90ed tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:30.068085 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5b6fdb1c-aa86-40dd-8383-d2c5f18f90ed tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:30.077006 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5b6fdb1c-aa86-40dd-8383-d2c5f18f90ed tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1271 microversion: 2.1 time: 0.404406 May 28 05:08:30.091524 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2991/6097] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:29 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1271 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:31.098052 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7024d517-cc7c-4c6e-a743-873b91c01906 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:31.099497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7024d517-cc7c-4c6e-a743-873b91c01906 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:31.118384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7024d517-cc7c-4c6e-a743-873b91c01906 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:31.126238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7024d517-cc7c-4c6e-a743-873b91c01906 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:31.126238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7024d517-cc7c-4c6e-a743-873b91c01906 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:31.130299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7024d517-cc7c-4c6e-a743-873b91c01906 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:31.302750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7024d517-cc7c-4c6e-a743-873b91c01906 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:31.316192 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7024d517-cc7c-4c6e-a743-873b91c01906 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1271 microversion: 2.1 time: 0.222172 May 28 05:08:31.317181 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3107/6098] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:31 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1271 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:32.230213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-3a07802f-d6d1-4e3c-9dd9-da4cc15b9b0c req-3c64d8f7-ad1a-4b9e-bf08-fe02703c77d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12106ac-a8a7-44cc-a111-c5599a29c137", "name": "network-vif-plugged", "status": "completed", "tag": "80bb8c1a-4a40-4b48-948f-08b18f123ea5"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:08:32.247334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3a07802f-d6d1-4e3c-9dd9-da4cc15b9b0c req-3c64d8f7-ad1a-4b9e-bf08-fe02703c77d5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:32.247910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3a07802f-d6d1-4e3c-9dd9-da4cc15b9b0c req-3c64d8f7-ad1a-4b9e-bf08-fe02703c77d5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:32.261998 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8b8799d1-7a90-4808-b679-3ef7573258d1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:08:32.263840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8b8799d1-7a90-4808-b679-3ef7573258d1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:32.276914 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-3a07802f-d6d1-4e3c-9dd9-da4cc15b9b0c req-3c64d8f7-ad1a-4b9e-bf08-fe02703c77d5 service nova] Creating event network-vif-plugged:80bb8c1a-4a40-4b48-948f-08b18f123ea5 for instance c12106ac-a8a7-44cc-a111-c5599a29c137 on n-h2-843700-1 May 28 05:08:32.278763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b8799d1-7a90-4808-b679-3ef7573258d1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:32.282528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b8799d1-7a90-4808-b679-3ef7573258d1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:32.284125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b8799d1-7a90-4808-b679-3ef7573258d1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:32.284605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8b8799d1-7a90-4808-b679-3ef7573258d1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:32.288183 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-3a07802f-d6d1-4e3c-9dd9-da4cc15b9b0c req-3c64d8f7-ad1a-4b9e-bf08-fe02703c77d5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063488 May 28 05:08:32.299514 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2992/6099] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:08:32.336074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-71c76706-e3f5-4825-8370-9e7c072328a4 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:32.337161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-8b8799d1-7a90-4808-b679-3ef7573258d1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lazy-loading 'flavor' on Instance uuid 334654f9-2ad8-4cef-b4e8-bf45eb69f937 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:08:32.337537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-71c76706-e3f5-4825-8370-9e7c072328a4 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:32.356142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71c76706-e3f5-4825-8370-9e7c072328a4 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:32.357378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71c76706-e3f5-4825-8370-9e7c072328a4 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:32.359439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71c76706-e3f5-4825-8370-9e7c072328a4 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:32.360844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71c76706-e3f5-4825-8370-9e7c072328a4 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:32.817952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-71c76706-e3f5-4825-8370-9e7c072328a4 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:32.838979 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-71c76706-e3f5-4825-8370-9e7c072328a4 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1271 microversion: 2.1 time: 0.508097 May 28 05:08:32.840845 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2993/6100] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:32 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1271 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:33.256798 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8b8799d1-7a90-4808-b679-3ef7573258d1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "POST /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/action" status: 202 len: 0 microversion: 2.20 time: 1.000254 May 28 05:08:33.262154 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3108/6101] 10.222.0.58 () {62 vars in 1318 bytes} [Sat May 28 05:08:32 2022] POST /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/action => generated 0 bytes in 1006 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 28 05:08:33.269666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-591be100-f9e3-4a29-a25e-3f173ad16a2e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:33.270881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-591be100-f9e3-4a29-a25e-3f173ad16a2e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:33.284027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-591be100-f9e3-4a29-a25e-3f173ad16a2e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:33.284493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-591be100-f9e3-4a29-a25e-3f173ad16a2e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:33.285289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-591be100-f9e3-4a29-a25e-3f173ad16a2e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:33.285734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-591be100-f9e3-4a29-a25e-3f173ad16a2e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:33.518792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-591be100-f9e3-4a29-a25e-3f173ad16a2e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:33.532542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-591be100-f9e3-4a29-a25e-3f173ad16a2e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:33.534128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-591be100-f9e3-4a29-a25e-3f173ad16a2e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:33.539886 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-591be100-f9e3-4a29-a25e-3f173ad16a2e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1724 microversion: 2.20 time: 0.274071 May 28 05:08:33.551353 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2994/6102] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:08:33 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:08:33.861033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c0388c22-3965-4a86-918d-ccaac6c0216e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:33.862341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c0388c22-3965-4a86-918d-ccaac6c0216e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:33.884332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0388c22-3965-4a86-918d-ccaac6c0216e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:33.892553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0388c22-3965-4a86-918d-ccaac6c0216e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:33.893476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0388c22-3965-4a86-918d-ccaac6c0216e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:33.893942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0388c22-3965-4a86-918d-ccaac6c0216e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:34.204910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c0388c22-3965-4a86-918d-ccaac6c0216e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:34.213131 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c0388c22-3965-4a86-918d-ccaac6c0216e tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1271 microversion: 2.1 time: 0.359247 May 28 05:08:34.213709 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3109/6103] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:33 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1271 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:34.558242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3f745659-69d1-4be9-8e3c-acbccaa7acf1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:34.558823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3f745659-69d1-4be9-8e3c-acbccaa7acf1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:34.569723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f745659-69d1-4be9-8e3c-acbccaa7acf1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:34.570187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f745659-69d1-4be9-8e3c-acbccaa7acf1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:34.571522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f745659-69d1-4be9-8e3c-acbccaa7acf1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:34.572055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f745659-69d1-4be9-8e3c-acbccaa7acf1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:34.872028 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3f745659-69d1-4be9-8e3c-acbccaa7acf1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:34.888381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3f745659-69d1-4be9-8e3c-acbccaa7acf1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:34.891181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3f745659-69d1-4be9-8e3c-acbccaa7acf1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:34.892585 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3f745659-69d1-4be9-8e3c-acbccaa7acf1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1724 microversion: 2.20 time: 0.338748 May 28 05:08:34.895152 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2995/6104] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:08:34 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1724 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:08:35.231688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-66a3ede2-474a-4c26-86c6-d7ff6c04beca tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:35.232370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-66a3ede2-474a-4c26-86c6-d7ff6c04beca tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:35.261038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66a3ede2-474a-4c26-86c6-d7ff6c04beca tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:35.261536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66a3ede2-474a-4c26-86c6-d7ff6c04beca tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:35.262425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66a3ede2-474a-4c26-86c6-d7ff6c04beca tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:35.262873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66a3ede2-474a-4c26-86c6-d7ff6c04beca tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:35.569170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-66a3ede2-474a-4c26-86c6-d7ff6c04beca tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:35.583104 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-66a3ede2-474a-4c26-86c6-d7ff6c04beca tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1460 microversion: 2.1 time: 0.357079 May 28 05:08:35.590950 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3110/6105] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:35 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1460 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:35.614918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-29cfa355-b983-4b5a-96f3-defe4ec9d895 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:35.615603 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-29cfa355-b983-4b5a-96f3-defe4ec9d895 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:35.624920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29cfa355-b983-4b5a-96f3-defe4ec9d895 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:35.625708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29cfa355-b983-4b5a-96f3-defe4ec9d895 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:35.627479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29cfa355-b983-4b5a-96f3-defe4ec9d895 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:35.628132 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29cfa355-b983-4b5a-96f3-defe4ec9d895 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:35.913945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6a539ae4-c3f1-4795-b0ac-26897c0c4d0e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:35.915081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6a539ae4-c3f1-4795-b0ac-26897c0c4d0e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:35.935227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a539ae4-c3f1-4795-b0ac-26897c0c4d0e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:35.935946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a539ae4-c3f1-4795-b0ac-26897c0c4d0e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:35.937714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a539ae4-c3f1-4795-b0ac-26897c0c4d0e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:35.941638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a539ae4-c3f1-4795-b0ac-26897c0c4d0e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:35.995330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-29cfa355-b983-4b5a-96f3-defe4ec9d895 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:36.013282 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-29cfa355-b983-4b5a-96f3-defe4ec9d895 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1460 microversion: 2.1 time: 0.402536 May 28 05:08:36.014018 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2996/6106] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:35 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1460 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:08:36.249576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6a539ae4-c3f1-4795-b0ac-26897c0c4d0e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:36.262665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6a539ae4-c3f1-4795-b0ac-26897c0c4d0e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:36.264621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6a539ae4-c3f1-4795-b0ac-26897c0c4d0e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:36.266036 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6a539ae4-c3f1-4795-b0ac-26897c0c4d0e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1724 microversion: 2.20 time: 0.356615 May 28 05:08:36.278980 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3111/6107] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:08:35 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1724 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:08:37.287491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5aa1a4b8-79ef-42fe-9a29-c1189e5a2b80 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:37.288926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5aa1a4b8-79ef-42fe-9a29-c1189e5a2b80 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:37.304035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5aa1a4b8-79ef-42fe-9a29-c1189e5a2b80 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:37.306273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5aa1a4b8-79ef-42fe-9a29-c1189e5a2b80 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:37.307251 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5aa1a4b8-79ef-42fe-9a29-c1189e5a2b80 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:37.310137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5aa1a4b8-79ef-42fe-9a29-c1189e5a2b80 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:37.690708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5aa1a4b8-79ef-42fe-9a29-c1189e5a2b80 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:37.700934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5aa1a4b8-79ef-42fe-9a29-c1189e5a2b80 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:37.704858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5aa1a4b8-79ef-42fe-9a29-c1189e5a2b80 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:37.708656 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5aa1a4b8-79ef-42fe-9a29-c1189e5a2b80 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1724 microversion: 2.20 time: 0.427459 May 28 05:08:37.709745 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2997/6108] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:08:37 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1724 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:08:38.734898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7e078e21-9601-4fbc-a793-37a5857879c2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:38.734898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7e078e21-9601-4fbc-a793-37a5857879c2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:38.740285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e078e21-9601-4fbc-a793-37a5857879c2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:38.740760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e078e21-9601-4fbc-a793-37a5857879c2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:38.741689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e078e21-9601-4fbc-a793-37a5857879c2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:38.742255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e078e21-9601-4fbc-a793-37a5857879c2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:38.991131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7e078e21-9601-4fbc-a793-37a5857879c2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:39.020451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7e078e21-9601-4fbc-a793-37a5857879c2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:39.029495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7e078e21-9601-4fbc-a793-37a5857879c2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:39.050533 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7e078e21-9601-4fbc-a793-37a5857879c2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1724 microversion: 2.20 time: 0.327256 May 28 05:08:39.063249 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3112/6109] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:08:38 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1724 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:08:40.070162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-24d2ebee-fb26-4c4d-9ced-38115054670b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:40.072075 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-24d2ebee-fb26-4c4d-9ced-38115054670b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:40.087586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24d2ebee-fb26-4c4d-9ced-38115054670b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:40.088169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24d2ebee-fb26-4c4d-9ced-38115054670b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:40.089036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24d2ebee-fb26-4c4d-9ced-38115054670b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:40.089507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24d2ebee-fb26-4c4d-9ced-38115054670b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:40.524738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-24d2ebee-fb26-4c4d-9ced-38115054670b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:40.534143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-24d2ebee-fb26-4c4d-9ced-38115054670b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:40.547563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-24d2ebee-fb26-4c4d-9ced-38115054670b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:40.549817 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-24d2ebee-fb26-4c4d-9ced-38115054670b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1724 microversion: 2.20 time: 0.484279 May 28 05:08:40.556356 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2998/6110] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:08:40 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1724 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:08:40.575205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-994c3fbf-7318-45dd-b5cf-e82079252735 req-49279017-8f0d-468a-aeeb-d81677f7b626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12106ac-a8a7-44cc-a111-c5599a29c137", "tag": "80bb8c1a-4a40-4b48-948f-08b18f123ea5"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:08:40.606779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-994c3fbf-7318-45dd-b5cf-e82079252735 req-49279017-8f0d-468a-aeeb-d81677f7b626 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:40.607268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-994c3fbf-7318-45dd-b5cf-e82079252735 req-49279017-8f0d-468a-aeeb-d81677f7b626 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:40.637240 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-994c3fbf-7318-45dd-b5cf-e82079252735 req-49279017-8f0d-468a-aeeb-d81677f7b626 service nova] Creating event network-changed:80bb8c1a-4a40-4b48-948f-08b18f123ea5 for instance c12106ac-a8a7-44cc-a111-c5599a29c137 on n-h2-843700-1 May 28 05:08:40.647678 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-994c3fbf-7318-45dd-b5cf-e82079252735 req-49279017-8f0d-468a-aeeb-d81677f7b626 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076931 May 28 05:08:40.654483 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3113/6111] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:08:41.574893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-edc0cb7d-e59d-40c6-8d25-c7f173ddbda7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:41.576299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-edc0cb7d-e59d-40c6-8d25-c7f173ddbda7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:41.583695 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-edc0cb7d-e59d-40c6-8d25-c7f173ddbda7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:41.587774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-edc0cb7d-e59d-40c6-8d25-c7f173ddbda7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:41.588639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-edc0cb7d-e59d-40c6-8d25-c7f173ddbda7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:41.589090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-edc0cb7d-e59d-40c6-8d25-c7f173ddbda7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:42.337935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-edc0cb7d-e59d-40c6-8d25-c7f173ddbda7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:42.346811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:08:42.365218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-edc0cb7d-e59d-40c6-8d25-c7f173ddbda7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:42.373715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-edc0cb7d-e59d-40c6-8d25-c7f173ddbda7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:42.388574 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-edc0cb7d-e59d-40c6-8d25-c7f173ddbda7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1724 microversion: 2.20 time: 0.805459 May 28 05:08:42.389795 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 2999/6112] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:08:41 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1724 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:08:43.411935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7572dde9-ce93-4f61-a783-667723c076f9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:43.412770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7572dde9-ce93-4f61-a783-667723c076f9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:43.413847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-a9c7d9d5-5191-46fc-a2ac-f8ec58bc1fbf req-27d26620-53e1-4925-b73f-c4b7985ae891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12106ac-a8a7-44cc-a111-c5599a29c137", "tag": "80bb8c1a-4a40-4b48-948f-08b18f123ea5"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:08:43.432133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:08:43.436541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7572dde9-ce93-4f61-a783-667723c076f9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:43.437400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a9c7d9d5-5191-46fc-a2ac-f8ec58bc1fbf req-27d26620-53e1-4925-b73f-c4b7985ae891 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:43.437856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a9c7d9d5-5191-46fc-a2ac-f8ec58bc1fbf req-27d26620-53e1-4925-b73f-c4b7985ae891 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:43.439915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7572dde9-ce93-4f61-a783-667723c076f9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:43.442842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7572dde9-ce93-4f61-a783-667723c076f9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:43.444372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7572dde9-ce93-4f61-a783-667723c076f9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:43.470242 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-a9c7d9d5-5191-46fc-a2ac-f8ec58bc1fbf req-27d26620-53e1-4925-b73f-c4b7985ae891 service nova] Creating event network-changed:80bb8c1a-4a40-4b48-948f-08b18f123ea5 for instance c12106ac-a8a7-44cc-a111-c5599a29c137 on n-h2-843700-1 May 28 05:08:43.485121 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-a9c7d9d5-5191-46fc-a2ac-f8ec58bc1fbf req-27d26620-53e1-4925-b73f-c4b7985ae891 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074521 May 28 05:08:43.486725 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3000/6113] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:08:43.939190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7572dde9-ce93-4f61-a783-667723c076f9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:43.952894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7572dde9-ce93-4f61-a783-667723c076f9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:43.958959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7572dde9-ce93-4f61-a783-667723c076f9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:43.960419 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7572dde9-ce93-4f61-a783-667723c076f9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1724 microversion: 2.20 time: 0.554503 May 28 05:08:43.961013 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3114/6114] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:08:43 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1724 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:08:44.984027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e9a3a911-f529-4ab1-8750-b1585845917e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:44.985549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e9a3a911-f529-4ab1-8750-b1585845917e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:45.003358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9a3a911-f529-4ab1-8750-b1585845917e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:45.007860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9a3a911-f529-4ab1-8750-b1585845917e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:45.009364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9a3a911-f529-4ab1-8750-b1585845917e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:45.011610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e9a3a911-f529-4ab1-8750-b1585845917e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:45.388738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e9a3a911-f529-4ab1-8750-b1585845917e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:45.407406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e9a3a911-f529-4ab1-8750-b1585845917e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:45.407406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e9a3a911-f529-4ab1-8750-b1585845917e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:45.411366 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e9a3a911-f529-4ab1-8750-b1585845917e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1745 microversion: 2.20 time: 0.434786 May 28 05:08:45.412023 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3001/6115] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:08:44 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1745 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:08:45.526799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-c006492c-269c-49dd-8ea0-4c33671bba65 req-9480985e-5e8a-454a-be00-9bb75fbb942b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12106ac-a8a7-44cc-a111-c5599a29c137", "tag": "80bb8c1a-4a40-4b48-948f-08b18f123ea5"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:08:45.551839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c006492c-269c-49dd-8ea0-4c33671bba65 req-9480985e-5e8a-454a-be00-9bb75fbb942b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:45.554912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c006492c-269c-49dd-8ea0-4c33671bba65 req-9480985e-5e8a-454a-be00-9bb75fbb942b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:45.585647 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-c006492c-269c-49dd-8ea0-4c33671bba65 req-9480985e-5e8a-454a-be00-9bb75fbb942b service nova] Creating event network-changed:80bb8c1a-4a40-4b48-948f-08b18f123ea5 for instance c12106ac-a8a7-44cc-a111-c5599a29c137 on n-h2-843700-1 May 28 05:08:45.599493 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-c006492c-269c-49dd-8ea0-4c33671bba65 req-9480985e-5e8a-454a-be00-9bb75fbb942b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078099 May 28 05:08:45.601897 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3115/6116] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:08:46.432519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9737c0de-768a-4439-a604-2dec8158922a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:46.433136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9737c0de-768a-4439-a604-2dec8158922a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:46.451514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9737c0de-768a-4439-a604-2dec8158922a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:46.454338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9737c0de-768a-4439-a604-2dec8158922a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:46.457181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9737c0de-768a-4439-a604-2dec8158922a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:46.461682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9737c0de-768a-4439-a604-2dec8158922a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:46.895627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9737c0de-768a-4439-a604-2dec8158922a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:46.932273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9737c0de-768a-4439-a604-2dec8158922a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:46.938124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9737c0de-768a-4439-a604-2dec8158922a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:46.942702 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9737c0de-768a-4439-a604-2dec8158922a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1740 microversion: 2.20 time: 0.515524 May 28 05:08:46.945837 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3002/6117] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:08:46 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1740 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:08:47.970749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8c5a6f12-e67f-42e6-8e40-2626c426d0d4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:47.971632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8c5a6f12-e67f-42e6-8e40-2626c426d0d4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:47.995507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8c5a6f12-e67f-42e6-8e40-2626c426d0d4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:48.000075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8c5a6f12-e67f-42e6-8e40-2626c426d0d4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:48.001190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8c5a6f12-e67f-42e6-8e40-2626c426d0d4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:48.004172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8c5a6f12-e67f-42e6-8e40-2626c426d0d4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:48.414472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8c5a6f12-e67f-42e6-8e40-2626c426d0d4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:48.436149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8c5a6f12-e67f-42e6-8e40-2626c426d0d4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:48.443598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8c5a6f12-e67f-42e6-8e40-2626c426d0d4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:48.447913 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8c5a6f12-e67f-42e6-8e40-2626c426d0d4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1740 microversion: 2.20 time: 0.481069 May 28 05:08:48.451886 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3116/6118] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:08:47 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1740 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:08:49.223915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-afc010a1-2951-44f6-88e7-3da6c2bdd2d2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:49.224620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-afc010a1-2951-44f6-88e7-3da6c2bdd2d2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:49.247693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-afc010a1-2951-44f6-88e7-3da6c2bdd2d2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:49.250763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-afc010a1-2951-44f6-88e7-3da6c2bdd2d2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:49.253800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-afc010a1-2951-44f6-88e7-3da6c2bdd2d2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:49.255066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-afc010a1-2951-44f6-88e7-3da6c2bdd2d2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:49.317675 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-afc010a1-2951-44f6-88e7-3da6c2bdd2d2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] HTTP exception thrown: Instance 54892188-1116-41fc-a42e-20850995d769 could not be found. May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-afc010a1-2951-44f6-88e7-3da6c2bdd2d2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Request method failure captured: May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 HTTP/1.1 May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikayX49ChvGgQpdxx6QCZpss1arw8is0ElbdxquXzH-B75VpugcrVejk4biMuUTxGKAZhs1IafiyiN7X5PGMIdJojekf1m26YqEHj26nV3GYykZmnq2EvsErgFMveGTJOzFmGvVmOQjuc2Nve0H3qarRu36CRjqOxRlpc5jL72NVq8b4 May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 844635ce88914d628f312550a4b128ba May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AttachVolumeTestJSON-1986626318 May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_844635ce88914d628f312550a4b128ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/844635ce88914d628f312550a4b128ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/844635ce88914d628f312550a4b128ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/844635ce88914d628f312550a4b128ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AttachVolumeTestJSON-1986626318 May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 844635ce88914d628f312550a4b128ba May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1986626318 May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AttachVolumeTestJSON-1986626318-project May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c09d2cdac73148e3ac1f118e2de31365 May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AttachVolumeTestJSON-1986626318-project May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 54892188-1116-41fc-a42e-20850995d769 could not be found. May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '54892188-1116-41fc-a42e-20850995d769'} May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54892188-1116-41fc-a42e-20850995d769 could not be found. May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:08:49.322615 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:08:49.327420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54892188-1116-41fc-a42e-20850995d769 could not be found. May 28 05:08:49.327420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:08:49.327420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:08:49.327420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:08:49.327420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:08:49.327420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:08:49.327420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:08:49.327420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:08:49.327420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:08:49.327420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54892188-1116-41fc-a42e-20850995d769 could not be found. May 28 05:08:49.327420 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:08:49.333205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-afc010a1-2951-44f6-88e7-3da6c2bdd2d2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Returning 404 to user: Instance 54892188-1116-41fc-a42e-20850995d769 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:08:49.337319 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-afc010a1-2951-44f6-88e7-3da6c2bdd2d2 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "DELETE /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 404 len: 111 microversion: 2.1 time: 0.117715 May 28 05:08:49.340006 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3003/6119] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:08:49 2022] DELETE /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:08:49.348209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9a966b90-54ff-480c-a42d-5baa4a78de57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:49.349779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9a966b90-54ff-480c-a42d-5baa4a78de57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 54892188-1116-41fc-a42e-20850995d769] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:49.372791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-9e01e345-76b9-4ad2-947a-19b7734cad4d req-d0137acb-1261-4428-b785-3c73cf0db036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334654f9-2ad8-4cef-b4e8-bf45eb69f937", "name": "network-vif-plugged", "status": "completed", "tag": "9efbcbd3-4d06-4190-8016-20cbfae73fe4"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:08:49.376723 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a966b90-54ff-480c-a42d-5baa4a78de57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:49.377435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a966b90-54ff-480c-a42d-5baa4a78de57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:49.378403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a966b90-54ff-480c-a42d-5baa4a78de57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:49.382542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a966b90-54ff-480c-a42d-5baa4a78de57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:49.400807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9e01e345-76b9-4ad2-947a-19b7734cad4d req-d0137acb-1261-4428-b785-3c73cf0db036 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:49.402126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9e01e345-76b9-4ad2-947a-19b7734cad4d req-d0137acb-1261-4428-b785-3c73cf0db036 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:49.430112 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-9e01e345-76b9-4ad2-947a-19b7734cad4d req-d0137acb-1261-4428-b785-3c73cf0db036 service nova] Creating event network-vif-plugged:9efbcbd3-4d06-4190-8016-20cbfae73fe4 for instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 on n-h2-843700-1 May 28 05:08:49.436964 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-9a966b90-54ff-480c-a42d-5baa4a78de57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] HTTP exception thrown: Instance 54892188-1116-41fc-a42e-20850995d769 could not be found. May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9a966b90-54ff-480c-a42d-5baa4a78de57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Request method failure captured: May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 HTTP/1.1 May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikayX49ChvGgQpdxx6QCZpss1arw8is0ElbdxquXzH-B75VpugcrVejk4biMuUTxGKAZhs1IafiyiN7X5PGMIdJojekf1m26YqEHj26nV3GYykZmnq2EvsErgFMveGTJOzFmGvVmOQjuc2Nve0H3qarRu36CRjqOxRlpc5jL72NVq8b4 May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 844635ce88914d628f312550a4b128ba May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AttachVolumeTestJSON-1986626318 May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_844635ce88914d628f312550a4b128ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/844635ce88914d628f312550a4b128ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/844635ce88914d628f312550a4b128ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/844635ce88914d628f312550a4b128ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AttachVolumeTestJSON-1986626318 May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 844635ce88914d628f312550a4b128ba May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1986626318 May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AttachVolumeTestJSON-1986626318-project May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: c09d2cdac73148e3ac1f118e2de31365 May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AttachVolumeTestJSON-1986626318-project May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 54892188-1116-41fc-a42e-20850995d769 could not be found. May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '54892188-1116-41fc-a42e-20850995d769'} May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54892188-1116-41fc-a42e-20850995d769 could not be found. May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54892188-1116-41fc-a42e-20850995d769 could not be found. May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:08:49.441176 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:08:49.446744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:08:49.446744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:08:49.446744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:08:49.446744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:08:49.446744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:08:49.446744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54892188-1116-41fc-a42e-20850995d769 could not be found. May 28 05:08:49.446744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:08:49.448387 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-9e01e345-76b9-4ad2-947a-19b7734cad4d req-d0137acb-1261-4428-b785-3c73cf0db036 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090355 May 28 05:08:49.449406 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3004/6120] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:08:49.454138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9a966b90-54ff-480c-a42d-5baa4a78de57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Returning 404 to user: Instance 54892188-1116-41fc-a42e-20850995d769 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:08:49.456965 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9a966b90-54ff-480c-a42d-5baa4a78de57 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769" status: 404 len: 111 microversion: 2.1 time: 0.112735 May 28 05:08:49.458597 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3117/6121] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:08:49 2022] GET /compute/v2.1/servers/54892188-1116-41fc-a42e-20850995d769 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:08:49.478672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3289af8e-fa93-45de-8d04-74bbe07c5091 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:49.480585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3289af8e-fa93-45de-8d04-74bbe07c5091 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:49.498243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3289af8e-fa93-45de-8d04-74bbe07c5091 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:49.498707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3289af8e-fa93-45de-8d04-74bbe07c5091 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:49.527779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3289af8e-fa93-45de-8d04-74bbe07c5091 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:49.529895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3289af8e-fa93-45de-8d04-74bbe07c5091 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:49.949887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3289af8e-fa93-45de-8d04-74bbe07c5091 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:49.964250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3289af8e-fa93-45de-8d04-74bbe07c5091 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:49.968639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3289af8e-fa93-45de-8d04-74bbe07c5091 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:49.974221 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3289af8e-fa93-45de-8d04-74bbe07c5091 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1740 microversion: 2.20 time: 0.506419 May 28 05:08:49.977885 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3005/6122] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:08:49 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1740 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:08:50.998285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-68ae4681-9cf3-43d3-a5f3-da94b3225f9d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:51.006870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-68ae4681-9cf3-43d3-a5f3-da94b3225f9d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:51.045023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:08:51.061295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68ae4681-9cf3-43d3-a5f3-da94b3225f9d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:51.061809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68ae4681-9cf3-43d3-a5f3-da94b3225f9d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:51.074790 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68ae4681-9cf3-43d3-a5f3-da94b3225f9d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:51.075653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68ae4681-9cf3-43d3-a5f3-da94b3225f9d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:51.170381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:08:51.806340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-68ae4681-9cf3-43d3-a5f3-da94b3225f9d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:51.820814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-68ae4681-9cf3-43d3-a5f3-da94b3225f9d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:51.830795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-68ae4681-9cf3-43d3-a5f3-da94b3225f9d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:51.839662 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-68ae4681-9cf3-43d3-a5f3-da94b3225f9d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1740 microversion: 2.20 time: 0.848824 May 28 05:08:51.843166 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3118/6123] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:08:50 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1740 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:08:52.862535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2ed5d694-c662-4f82-bcde-096d0c2df630 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:52.863793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2ed5d694-c662-4f82-bcde-096d0c2df630 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:52.874833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2ed5d694-c662-4f82-bcde-096d0c2df630 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:52.874833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2ed5d694-c662-4f82-bcde-096d0c2df630 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:52.881136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2ed5d694-c662-4f82-bcde-096d0c2df630 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:52.881797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2ed5d694-c662-4f82-bcde-096d0c2df630 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:53.215501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2ed5d694-c662-4f82-bcde-096d0c2df630 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:53.228960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2ed5d694-c662-4f82-bcde-096d0c2df630 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:53.243840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2ed5d694-c662-4f82-bcde-096d0c2df630 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:53.257004 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2ed5d694-c662-4f82-bcde-096d0c2df630 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1740 microversion: 2.20 time: 0.399045 May 28 05:08:53.263753 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3006/6124] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:08:52 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1740 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:08:54.282385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f21b7060-709b-460b-921d-4accd7295efa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:54.283093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f21b7060-709b-460b-921d-4accd7295efa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:54.313338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f21b7060-709b-460b-921d-4accd7295efa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:54.313997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f21b7060-709b-460b-921d-4accd7295efa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:54.315987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f21b7060-709b-460b-921d-4accd7295efa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:54.316491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f21b7060-709b-460b-921d-4accd7295efa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:55.392084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f21b7060-709b-460b-921d-4accd7295efa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:55.423283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f21b7060-709b-460b-921d-4accd7295efa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:55.425785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f21b7060-709b-460b-921d-4accd7295efa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:55.427865 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f21b7060-709b-460b-921d-4accd7295efa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1740 microversion: 2.20 time: 1.151308 May 28 05:08:55.434224 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3119/6125] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:08:54 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1740 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:08:56.452673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-981dd41e-271d-4ac5-a892-6678727182c3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:56.453933 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-981dd41e-271d-4ac5-a892-6678727182c3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:56.473457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-981dd41e-271d-4ac5-a892-6678727182c3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:56.473457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-981dd41e-271d-4ac5-a892-6678727182c3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:56.473457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-981dd41e-271d-4ac5-a892-6678727182c3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:56.473457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-981dd41e-271d-4ac5-a892-6678727182c3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:56.856663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-981dd41e-271d-4ac5-a892-6678727182c3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:56.870802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-981dd41e-271d-4ac5-a892-6678727182c3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:56.873035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-981dd41e-271d-4ac5-a892-6678727182c3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:56.874761 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-981dd41e-271d-4ac5-a892-6678727182c3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1740 microversion: 2.20 time: 0.426544 May 28 05:08:56.875996 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3007/6126] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:08:56 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1740 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:08:57.894008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c1e26e14-adbc-49e5-9de7-d6427314b2bd tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:57.895373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c1e26e14-adbc-49e5-9de7-d6427314b2bd tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:57.918191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1e26e14-adbc-49e5-9de7-d6427314b2bd tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:57.920634 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1e26e14-adbc-49e5-9de7-d6427314b2bd tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:57.921511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1e26e14-adbc-49e5-9de7-d6427314b2bd tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:57.921900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1e26e14-adbc-49e5-9de7-d6427314b2bd tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:58.831226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c1e26e14-adbc-49e5-9de7-d6427314b2bd tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:58.840905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c1e26e14-adbc-49e5-9de7-d6427314b2bd tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:58.842770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c1e26e14-adbc-49e5-9de7-d6427314b2bd tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:08:58.844280 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c1e26e14-adbc-49e5-9de7-d6427314b2bd tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1740 microversion: 2.20 time: 0.955102 May 28 05:08:58.845314 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3120/6127] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:08:57 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1740 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:08:59.869450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-876b8406-38d6-4101-aab8-c322b397129f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:08:59.870271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-876b8406-38d6-4101-aab8-c322b397129f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:08:59.884329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-876b8406-38d6-4101-aab8-c322b397129f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:59.885885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-876b8406-38d6-4101-aab8-c322b397129f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:08:59.887942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-876b8406-38d6-4101-aab8-c322b397129f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:08:59.888598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-876b8406-38d6-4101-aab8-c322b397129f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:00.112833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-876b8406-38d6-4101-aab8-c322b397129f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:00.136107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-876b8406-38d6-4101-aab8-c322b397129f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:00.138130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-876b8406-38d6-4101-aab8-c322b397129f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:00.139817 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-876b8406-38d6-4101-aab8-c322b397129f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1740 microversion: 2.20 time: 0.275673 May 28 05:09:00.146363 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3008/6128] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:08:59 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1740 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:01.182359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-87f50308-2e0e-47ff-985d-ad835467ce30 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:01.184212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-87f50308-2e0e-47ff-985d-ad835467ce30 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:01.207009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87f50308-2e0e-47ff-985d-ad835467ce30 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:01.209892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87f50308-2e0e-47ff-985d-ad835467ce30 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:01.214668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87f50308-2e0e-47ff-985d-ad835467ce30 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:01.215362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87f50308-2e0e-47ff-985d-ad835467ce30 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:01.457836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-87f50308-2e0e-47ff-985d-ad835467ce30 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:01.470137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-87f50308-2e0e-47ff-985d-ad835467ce30 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:01.471827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-87f50308-2e0e-47ff-985d-ad835467ce30 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:01.473165 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-87f50308-2e0e-47ff-985d-ad835467ce30 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1740 microversion: 2.20 time: 0.310496 May 28 05:09:01.473703 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3121/6129] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:01 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1740 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:02.324715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a4a276f4-af09-4656-a4bb-a1128c2e8dc3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:02.326421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a4a276f4-af09-4656-a4bb-a1128c2e8dc3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:02.334241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4a276f4-af09-4656-a4bb-a1128c2e8dc3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:02.338145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4a276f4-af09-4656-a4bb-a1128c2e8dc3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:02.338853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4a276f4-af09-4656-a4bb-a1128c2e8dc3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:02.339683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4a276f4-af09-4656-a4bb-a1128c2e8dc3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:02.361098 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-a4a276f4-af09-4656-a4bb-a1128c2e8dc3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] HTTP exception thrown: Instance 3b28a05b-9b15-4b95-995f-88592e01319e could not be found. May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a4a276f4-af09-4656-a4bb-a1128c2e8dc3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Request method failure captured: May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e HTTP/1.1 May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikayX49ChvGgQpdxx6QCZpss1arw8is0ElbdxquXzH-B75VpugcrVejk4biMuUTxGKAZhs1IafiyiN7X5PGMIdJojekf1m26YqEHj26nV3GYykZmnq2EvsErgFMveGTJOzFmGvVmOQjuc2Nve0H3qarRu36CRjqOxRlpc5jL72NVq8b4 May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 844635ce88914d628f312550a4b128ba May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AttachVolumeTestJSON-1986626318 May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_844635ce88914d628f312550a4b128ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/844635ce88914d628f312550a4b128ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/844635ce88914d628f312550a4b128ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/844635ce88914d628f312550a4b128ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AttachVolumeTestJSON-1986626318 May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 844635ce88914d628f312550a4b128ba May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1986626318 May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AttachVolumeTestJSON-1986626318-project May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c09d2cdac73148e3ac1f118e2de31365 May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AttachVolumeTestJSON-1986626318-project May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 3b28a05b-9b15-4b95-995f-88592e01319e could not be found. May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '3b28a05b-9b15-4b95-995f-88592e01319e'} May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b28a05b-9b15-4b95-995f-88592e01319e could not be found. May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:09:02.363237 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:09:02.368956 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b28a05b-9b15-4b95-995f-88592e01319e could not be found. May 28 05:09:02.368956 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:09:02.368956 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:09:02.368956 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:09:02.368956 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:09:02.368956 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:09:02.368956 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:09:02.368956 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:09:02.368956 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:09:02.368956 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b28a05b-9b15-4b95-995f-88592e01319e could not be found. May 28 05:09:02.368956 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:09:02.371328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a4a276f4-af09-4656-a4bb-a1128c2e8dc3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Returning 404 to user: Instance 3b28a05b-9b15-4b95-995f-88592e01319e could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:09:02.373060 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a4a276f4-af09-4656-a4bb-a1128c2e8dc3 tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 404 len: 111 microversion: 2.1 time: 0.052481 May 28 05:09:02.374368 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3009/6130] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:09:02 2022] DELETE /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:09:02.389624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-44dda8bf-f7d4-424a-ad52-90f65092f97b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:02.391300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-44dda8bf-f7d4-424a-ad52-90f65092f97b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] [instance: 3b28a05b-9b15-4b95-995f-88592e01319e] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:02.404452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-44dda8bf-f7d4-424a-ad52-90f65092f97b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:02.407149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-44dda8bf-f7d4-424a-ad52-90f65092f97b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:02.407149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-44dda8bf-f7d4-424a-ad52-90f65092f97b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:02.407149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-44dda8bf-f7d4-424a-ad52-90f65092f97b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:02.435922 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-44dda8bf-f7d4-424a-ad52-90f65092f97b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] HTTP exception thrown: Instance 3b28a05b-9b15-4b95-995f-88592e01319e could not be found. May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-44dda8bf-f7d4-424a-ad52-90f65092f97b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Request method failure captured: May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e HTTP/1.1 May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikayX49ChvGgQpdxx6QCZpss1arw8is0ElbdxquXzH-B75VpugcrVejk4biMuUTxGKAZhs1IafiyiN7X5PGMIdJojekf1m26YqEHj26nV3GYykZmnq2EvsErgFMveGTJOzFmGvVmOQjuc2Nve0H3qarRu36CRjqOxRlpc5jL72NVq8b4 May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 844635ce88914d628f312550a4b128ba May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AttachVolumeTestJSON-1986626318 May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_844635ce88914d628f312550a4b128ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/844635ce88914d628f312550a4b128ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/844635ce88914d628f312550a4b128ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/844635ce88914d628f312550a4b128ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AttachVolumeTestJSON-1986626318 May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 844635ce88914d628f312550a4b128ba May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1986626318 May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AttachVolumeTestJSON-1986626318-project May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: c09d2cdac73148e3ac1f118e2de31365 May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AttachVolumeTestJSON-1986626318-project May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 3b28a05b-9b15-4b95-995f-88592e01319e could not be found. May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '3b28a05b-9b15-4b95-995f-88592e01319e'} May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b28a05b-9b15-4b95-995f-88592e01319e could not be found. May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b28a05b-9b15-4b95-995f-88592e01319e could not be found. May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:09:02.436494 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:09:02.440895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:09:02.440895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:09:02.440895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:09:02.440895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:09:02.440895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:09:02.440895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b28a05b-9b15-4b95-995f-88592e01319e could not be found. May 28 05:09:02.440895 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:09:02.442700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-44dda8bf-f7d4-424a-ad52-90f65092f97b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] Returning 404 to user: Instance 3b28a05b-9b15-4b95-995f-88592e01319e could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:09:02.444109 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-44dda8bf-f7d4-424a-ad52-90f65092f97b tempest-AttachVolumeTestJSON-1986626318 tempest-AttachVolumeTestJSON-1986626318-project] 10.222.0.58 "GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e" status: 404 len: 111 microversion: 2.1 time: 0.064878 May 28 05:09:02.446455 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3122/6131] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:09:02 2022] GET /compute/v2.1/servers/3b28a05b-9b15-4b95-995f-88592e01319e => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:09:02.498392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f52c5eea-3358-42c0-9dcf-cf074ead1b65 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:02.499982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f52c5eea-3358-42c0-9dcf-cf074ead1b65 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:02.512136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f52c5eea-3358-42c0-9dcf-cf074ead1b65 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:02.513398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f52c5eea-3358-42c0-9dcf-cf074ead1b65 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:02.514528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f52c5eea-3358-42c0-9dcf-cf074ead1b65 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:02.515450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f52c5eea-3358-42c0-9dcf-cf074ead1b65 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:02.824176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f52c5eea-3358-42c0-9dcf-cf074ead1b65 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:02.836746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f52c5eea-3358-42c0-9dcf-cf074ead1b65 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:02.838485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f52c5eea-3358-42c0-9dcf-cf074ead1b65 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:02.839921 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f52c5eea-3358-42c0-9dcf-cf074ead1b65 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1740 microversion: 2.20 time: 0.345572 May 28 05:09:02.841113 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3010/6132] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:02 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1740 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:03.859325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-21b08a66-4820-43bd-b5ea-84d163884603 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:03.860906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-21b08a66-4820-43bd-b5ea-84d163884603 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:03.887525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21b08a66-4820-43bd-b5ea-84d163884603 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:03.889133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21b08a66-4820-43bd-b5ea-84d163884603 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:03.890806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21b08a66-4820-43bd-b5ea-84d163884603 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:03.897625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21b08a66-4820-43bd-b5ea-84d163884603 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:04.319520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-21b08a66-4820-43bd-b5ea-84d163884603 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:04.335324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-21b08a66-4820-43bd-b5ea-84d163884603 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:04.335324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-21b08a66-4820-43bd-b5ea-84d163884603 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:04.335527 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-21b08a66-4820-43bd-b5ea-84d163884603 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1740 microversion: 2.20 time: 0.480524 May 28 05:09:04.346233 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3123/6133] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:03 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1740 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:05.355641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c9814d56-a437-43d3-ae55-484aa78a6cb3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:05.356457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c9814d56-a437-43d3-ae55-484aa78a6cb3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:05.388811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9814d56-a437-43d3-ae55-484aa78a6cb3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:05.397700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9814d56-a437-43d3-ae55-484aa78a6cb3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:05.412865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9814d56-a437-43d3-ae55-484aa78a6cb3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:05.412865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9814d56-a437-43d3-ae55-484aa78a6cb3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:05.865642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c9814d56-a437-43d3-ae55-484aa78a6cb3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:05.886747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c9814d56-a437-43d3-ae55-484aa78a6cb3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:05.896771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c9814d56-a437-43d3-ae55-484aa78a6cb3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:05.903964 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c9814d56-a437-43d3-ae55-484aa78a6cb3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1740 microversion: 2.20 time: 0.548464 May 28 05:09:05.910495 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3011/6134] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:05 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1740 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:06.928593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3a530d6c-9659-4cf2-895d-ab0a0e9bd7ae tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:06.929375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3a530d6c-9659-4cf2-895d-ab0a0e9bd7ae tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:06.951717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a530d6c-9659-4cf2-895d-ab0a0e9bd7ae tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:06.956710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a530d6c-9659-4cf2-895d-ab0a0e9bd7ae tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:06.957711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a530d6c-9659-4cf2-895d-ab0a0e9bd7ae tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:06.958279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a530d6c-9659-4cf2-895d-ab0a0e9bd7ae tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:07.632040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3a530d6c-9659-4cf2-895d-ab0a0e9bd7ae tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:07.642199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3a530d6c-9659-4cf2-895d-ab0a0e9bd7ae tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:07.654717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3a530d6c-9659-4cf2-895d-ab0a0e9bd7ae tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:07.661401 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3a530d6c-9659-4cf2-895d-ab0a0e9bd7ae tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1740 microversion: 2.20 time: 0.734965 May 28 05:09:07.662734 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3124/6135] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:06 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1740 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:08.680936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8f1f4db7-c715-4bc9-a7ef-85c36ca9ae98 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:08.682559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8f1f4db7-c715-4bc9-a7ef-85c36ca9ae98 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:08.697554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f1f4db7-c715-4bc9-a7ef-85c36ca9ae98 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:08.698390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f1f4db7-c715-4bc9-a7ef-85c36ca9ae98 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:08.699564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f1f4db7-c715-4bc9-a7ef-85c36ca9ae98 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:08.700239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f1f4db7-c715-4bc9-a7ef-85c36ca9ae98 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:08.949387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8f1f4db7-c715-4bc9-a7ef-85c36ca9ae98 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:08.957871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8f1f4db7-c715-4bc9-a7ef-85c36ca9ae98 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:08.967426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8f1f4db7-c715-4bc9-a7ef-85c36ca9ae98 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:08.968841 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8f1f4db7-c715-4bc9-a7ef-85c36ca9ae98 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1740 microversion: 2.20 time: 0.292379 May 28 05:09:08.995389 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3012/6136] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:08 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1740 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:09.990813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-da2eecb6-07c0-4964-bba4-957a122fdaaa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:10.017336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-da2eecb6-07c0-4964-bba4-957a122fdaaa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:10.046682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da2eecb6-07c0-4964-bba4-957a122fdaaa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:10.055422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da2eecb6-07c0-4964-bba4-957a122fdaaa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:10.056397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da2eecb6-07c0-4964-bba4-957a122fdaaa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:10.056862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da2eecb6-07c0-4964-bba4-957a122fdaaa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:10.340982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-da2eecb6-07c0-4964-bba4-957a122fdaaa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:10.354820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-da2eecb6-07c0-4964-bba4-957a122fdaaa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:10.356510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-da2eecb6-07c0-4964-bba4-957a122fdaaa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:10.358154 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-da2eecb6-07c0-4964-bba4-957a122fdaaa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1740 microversion: 2.20 time: 0.372836 May 28 05:09:10.370201 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3125/6137] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:09 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1740 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:11.377214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-964be679-f9e0-4b08-b5e3-f5e82c919d02 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:11.378029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-964be679-f9e0-4b08-b5e3-f5e82c919d02 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:11.385381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-964be679-f9e0-4b08-b5e3-f5e82c919d02 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:11.386008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-964be679-f9e0-4b08-b5e3-f5e82c919d02 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:11.487438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-964be679-f9e0-4b08-b5e3-f5e82c919d02 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:11.487438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-964be679-f9e0-4b08-b5e3-f5e82c919d02 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:11.527989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-964be679-f9e0-4b08-b5e3-f5e82c919d02 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:11.536179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-964be679-f9e0-4b08-b5e3-f5e82c919d02 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:11.537685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-964be679-f9e0-4b08-b5e3-f5e82c919d02 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:11.538855 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-964be679-f9e0-4b08-b5e3-f5e82c919d02 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1740 microversion: 2.20 time: 0.165997 May 28 05:09:11.539838 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3013/6138] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:11 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:12.558314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2c7e20eb-0c23-4727-aa1e-c7ec10a9a85d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:12.559614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2c7e20eb-0c23-4727-aa1e-c7ec10a9a85d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:12.576755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c7e20eb-0c23-4727-aa1e-c7ec10a9a85d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:12.577469 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c7e20eb-0c23-4727-aa1e-c7ec10a9a85d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:12.578596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c7e20eb-0c23-4727-aa1e-c7ec10a9a85d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:12.579189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c7e20eb-0c23-4727-aa1e-c7ec10a9a85d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:12.826347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2c7e20eb-0c23-4727-aa1e-c7ec10a9a85d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:12.838505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2c7e20eb-0c23-4727-aa1e-c7ec10a9a85d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:12.840638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2c7e20eb-0c23-4727-aa1e-c7ec10a9a85d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:12.842739 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2c7e20eb-0c23-4727-aa1e-c7ec10a9a85d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1740 microversion: 2.20 time: 0.289217 May 28 05:09:12.860001 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3126/6139] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:12 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:13.864484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b46787f2-663b-40da-92f0-0c4a7a651a31 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:13.866095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b46787f2-663b-40da-92f0-0c4a7a651a31 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:13.886267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b46787f2-663b-40da-92f0-0c4a7a651a31 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:13.888873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b46787f2-663b-40da-92f0-0c4a7a651a31 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:13.892613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b46787f2-663b-40da-92f0-0c4a7a651a31 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:13.896508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b46787f2-663b-40da-92f0-0c4a7a651a31 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:14.160190 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b46787f2-663b-40da-92f0-0c4a7a651a31 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:14.176040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b46787f2-663b-40da-92f0-0c4a7a651a31 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:14.180274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b46787f2-663b-40da-92f0-0c4a7a651a31 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:14.181450 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b46787f2-663b-40da-92f0-0c4a7a651a31 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1740 microversion: 2.20 time: 0.323411 May 28 05:09:14.182056 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3014/6140] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:13 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1740 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:15.200968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-23da97ac-65fe-45c7-bcfd-c909e23a065c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:15.201743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-23da97ac-65fe-45c7-bcfd-c909e23a065c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:15.218425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-23da97ac-65fe-45c7-bcfd-c909e23a065c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:15.219167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-23da97ac-65fe-45c7-bcfd-c909e23a065c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:15.220059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-23da97ac-65fe-45c7-bcfd-c909e23a065c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:15.220605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-23da97ac-65fe-45c7-bcfd-c909e23a065c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:15.445435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-23da97ac-65fe-45c7-bcfd-c909e23a065c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:15.457117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-23da97ac-65fe-45c7-bcfd-c909e23a065c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:15.459643 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-23da97ac-65fe-45c7-bcfd-c909e23a065c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:15.462780 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-23da97ac-65fe-45c7-bcfd-c909e23a065c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1722 microversion: 2.20 time: 0.266230 May 28 05:09:15.474625 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3127/6141] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:15 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:16.179914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-0ecfa0dd-e02c-46b6-ba8c-7ef0c8703af6 req-85ff4b1e-ae77-41db-935b-853006d19058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334654f9-2ad8-4cef-b4e8-bf45eb69f937", "name": "network-vif-unplugged", "status": "completed", "tag": "9efbcbd3-4d06-4190-8016-20cbfae73fe4"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:09:16.191233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=30 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:09:16.193635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0ecfa0dd-e02c-46b6-ba8c-7ef0c8703af6 req-85ff4b1e-ae77-41db-935b-853006d19058 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:16.194363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0ecfa0dd-e02c-46b6-ba8c-7ef0c8703af6 req-85ff4b1e-ae77-41db-935b-853006d19058 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:16.199225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=75 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:09:16.209807 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-0ecfa0dd-e02c-46b6-ba8c-7ef0c8703af6 req-85ff4b1e-ae77-41db-935b-853006d19058 service nova] Creating event network-vif-unplugged:9efbcbd3-4d06-4190-8016-20cbfae73fe4 for instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 on n-h2-843700-1 May 28 05:09:16.215783 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-0ecfa0dd-e02c-46b6-ba8c-7ef0c8703af6 req-85ff4b1e-ae77-41db-935b-853006d19058 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040792 May 28 05:09:16.224158 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3015/6142] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:09:16.480981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0209f520-89c4-4e96-a668-96f9128831c6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:16.481596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0209f520-89c4-4e96-a668-96f9128831c6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:16.514010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0209f520-89c4-4e96-a668-96f9128831c6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:16.514860 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0209f520-89c4-4e96-a668-96f9128831c6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:16.516056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0209f520-89c4-4e96-a668-96f9128831c6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:16.516309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0209f520-89c4-4e96-a668-96f9128831c6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:16.732106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0209f520-89c4-4e96-a668-96f9128831c6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:16.741539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0209f520-89c4-4e96-a668-96f9128831c6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:16.744897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0209f520-89c4-4e96-a668-96f9128831c6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:16.746269 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0209f520-89c4-4e96-a668-96f9128831c6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1722 microversion: 2.20 time: 0.269730 May 28 05:09:16.746923 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3128/6143] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:16 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:17.767254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c7d08d0f-792b-4f56-adac-0e03971f0ea5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:17.768260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c7d08d0f-792b-4f56-adac-0e03971f0ea5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:17.778383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7d08d0f-792b-4f56-adac-0e03971f0ea5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:17.779133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7d08d0f-792b-4f56-adac-0e03971f0ea5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:17.780126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7d08d0f-792b-4f56-adac-0e03971f0ea5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:17.780760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7d08d0f-792b-4f56-adac-0e03971f0ea5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:17.965873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c7d08d0f-792b-4f56-adac-0e03971f0ea5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:17.975486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c7d08d0f-792b-4f56-adac-0e03971f0ea5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:17.977632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c7d08d0f-792b-4f56-adac-0e03971f0ea5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:17.979232 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c7d08d0f-792b-4f56-adac-0e03971f0ea5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1665 microversion: 2.20 time: 0.217287 May 28 05:09:17.980017 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3016/6144] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:17 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1665 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:18.008514 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9a24b528-228d-45f8-832b-64f52608b145 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15234513-8d1b-405c-b034-f0abb16ee100"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:09:18.010150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9a24b528-228d-45f8-832b-64f52608b145 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:18.030977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a24b528-228d-45f8-832b-64f52608b145 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:18.035315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a24b528-228d-45f8-832b-64f52608b145 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:18.036361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a24b528-228d-45f8-832b-64f52608b145 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:18.036976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a24b528-228d-45f8-832b-64f52608b145 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:19.340034 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9a24b528-228d-45f8-832b-64f52608b145 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "POST /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.335578 May 28 05:09:19.341454 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3129/6145] 10.222.0.58 () {62 vars in 1363 bytes} [Sat May 28 05:09:18 2022] POST /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments => generated 188 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:09:19.488039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-43af8b94-c782-49ff-a24b-52ee0373951a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:09:19.488585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-43af8b94-c782-49ff-a24b-52ee0373951a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:19.501230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43af8b94-c782-49ff-a24b-52ee0373951a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:19.501344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43af8b94-c782-49ff-a24b-52ee0373951a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:19.502242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43af8b94-c782-49ff-a24b-52ee0373951a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:19.502651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43af8b94-c782-49ff-a24b-52ee0373951a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:19.756195 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-43af8b94-c782-49ff-a24b-52ee0373951a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "POST /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/action" status: 202 len: 0 microversion: 2.20 time: 0.272144 May 28 05:09:19.759590 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3017/6146] 10.222.0.58 () {62 vars in 1318 bytes} [Sat May 28 05:09:19 2022] POST /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 05:09:19.767982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3cf61b3c-9c65-41f6-b35f-ca995b4d7fd7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:19.768906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3cf61b3c-9c65-41f6-b35f-ca995b4d7fd7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:19.776037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3cf61b3c-9c65-41f6-b35f-ca995b4d7fd7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:19.776937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3cf61b3c-9c65-41f6-b35f-ca995b4d7fd7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:19.777968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3cf61b3c-9c65-41f6-b35f-ca995b4d7fd7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:19.778769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3cf61b3c-9c65-41f6-b35f-ca995b4d7fd7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:19.975125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3cf61b3c-9c65-41f6-b35f-ca995b4d7fd7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:19.985081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3cf61b3c-9c65-41f6-b35f-ca995b4d7fd7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:19.986901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3cf61b3c-9c65-41f6-b35f-ca995b4d7fd7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:19.988539 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3cf61b3c-9c65-41f6-b35f-ca995b4d7fd7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1751 microversion: 2.20 time: 0.226388 May 28 05:09:19.989322 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3130/6147] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:19 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1751 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:09:20.702166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-04c07126-18c7-4a37-b749-4268501f9362 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:20.703346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-04c07126-18c7-4a37-b749-4268501f9362 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:20.711714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-04c07126-18c7-4a37-b749-4268501f9362 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:20.712173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-04c07126-18c7-4a37-b749-4268501f9362 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:20.713153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-04c07126-18c7-4a37-b749-4268501f9362 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:20.713596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-04c07126-18c7-4a37-b749-4268501f9362 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:20.839406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-04c07126-18c7-4a37-b749-4268501f9362 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lazy-loading 'services' on Instance uuid 57622bb5-3fad-45a7-b416-7954ff7434fd {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:09:21.008730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bf03f2d7-5d22-4ef4-9b93-b3a67bf71dff tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:21.010146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bf03f2d7-5d22-4ef4-9b93-b3a67bf71dff tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:21.019355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf03f2d7-5d22-4ef4-9b93-b3a67bf71dff tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:21.021376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf03f2d7-5d22-4ef4-9b93-b3a67bf71dff tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:21.021776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf03f2d7-5d22-4ef4-9b93-b3a67bf71dff tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:21.022387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf03f2d7-5d22-4ef4-9b93-b3a67bf71dff tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:21.046354 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-04c07126-18c7-4a37-b749-4268501f9362 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "DELETE /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd/os-volume_attachments/d43dbf0f-56b9-45bf-b606-3a8c23c7718b" status: 202 len: 0 microversion: 2.1 time: 0.351249 May 28 05:09:21.047164 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3018/6148] 10.222.0.58 () {58 vars in 1415 bytes} [Sat May 28 05:09:20 2022] DELETE /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd/os-volume_attachments/d43dbf0f-56b9-45bf-b606-3a8c23c7718b => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:09:21.226197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bf03f2d7-5d22-4ef4-9b93-b3a67bf71dff tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:21.243923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bf03f2d7-5d22-4ef4-9b93-b3a67bf71dff tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:21.247058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bf03f2d7-5d22-4ef4-9b93-b3a67bf71dff tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:21.250920 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bf03f2d7-5d22-4ef4-9b93-b3a67bf71dff tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1751 microversion: 2.20 time: 0.248508 May 28 05:09:21.253319 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3131/6149] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:21 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1751 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:22.277070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53149cf1-d092-4bf8-a366-d57fabaf189e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:22.279089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-53149cf1-d092-4bf8-a366-d57fabaf189e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:22.292464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53149cf1-d092-4bf8-a366-d57fabaf189e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:22.293177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53149cf1-d092-4bf8-a366-d57fabaf189e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:22.294588 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53149cf1-d092-4bf8-a366-d57fabaf189e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:22.295283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53149cf1-d092-4bf8-a366-d57fabaf189e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:22.482012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-53149cf1-d092-4bf8-a366-d57fabaf189e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:22.491744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-53149cf1-d092-4bf8-a366-d57fabaf189e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:22.494276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-53149cf1-d092-4bf8-a366-d57fabaf189e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:22.496003 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-53149cf1-d092-4bf8-a366-d57fabaf189e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1751 microversion: 2.20 time: 0.226427 May 28 05:09:22.497854 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3019/6150] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:22 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1751 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:23.515629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c86b99e1-d089-45ce-8755-32a65e700f8a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:23.516415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c86b99e1-d089-45ce-8755-32a65e700f8a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:23.522422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=28 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:09:23.524980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c86b99e1-d089-45ce-8755-32a65e700f8a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:23.525549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c86b99e1-d089-45ce-8755-32a65e700f8a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:23.526446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c86b99e1-d089-45ce-8755-32a65e700f8a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:23.527022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c86b99e1-d089-45ce-8755-32a65e700f8a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:23.530407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:09:23.767295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c86b99e1-d089-45ce-8755-32a65e700f8a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:23.778632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c86b99e1-d089-45ce-8755-32a65e700f8a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:23.781287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c86b99e1-d089-45ce-8755-32a65e700f8a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:23.782506 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c86b99e1-d089-45ce-8755-32a65e700f8a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1753 microversion: 2.20 time: 0.270889 May 28 05:09:23.787604 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3132/6151] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:23 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1753 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:24.801667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7a7e8b47-a81f-49a9-a0b5-272926d89575 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:24.802393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7a7e8b47-a81f-49a9-a0b5-272926d89575 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:24.809964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a7e8b47-a81f-49a9-a0b5-272926d89575 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:24.810727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a7e8b47-a81f-49a9-a0b5-272926d89575 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:24.813556 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a7e8b47-a81f-49a9-a0b5-272926d89575 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:24.814409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a7e8b47-a81f-49a9-a0b5-272926d89575 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:24.949979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7a7e8b47-a81f-49a9-a0b5-272926d89575 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:24.958913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7a7e8b47-a81f-49a9-a0b5-272926d89575 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:24.961395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7a7e8b47-a81f-49a9-a0b5-272926d89575 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:24.962733 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7a7e8b47-a81f-49a9-a0b5-272926d89575 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1753 microversion: 2.20 time: 0.165093 May 28 05:09:24.963550 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3020/6152] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:24 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:09:25.982196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4b7d8aaa-a829-4483-b7cb-d7ba1bedad47 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:25.982816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4b7d8aaa-a829-4483-b7cb-d7ba1bedad47 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:25.990754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4b7d8aaa-a829-4483-b7cb-d7ba1bedad47 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:25.991247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4b7d8aaa-a829-4483-b7cb-d7ba1bedad47 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:25.992078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4b7d8aaa-a829-4483-b7cb-d7ba1bedad47 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:25.992520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4b7d8aaa-a829-4483-b7cb-d7ba1bedad47 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:26.155262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4b7d8aaa-a829-4483-b7cb-d7ba1bedad47 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:26.165167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4b7d8aaa-a829-4483-b7cb-d7ba1bedad47 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:26.168885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4b7d8aaa-a829-4483-b7cb-d7ba1bedad47 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:26.170284 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4b7d8aaa-a829-4483-b7cb-d7ba1bedad47 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1753 microversion: 2.20 time: 0.192438 May 28 05:09:26.171115 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3133/6153] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:25 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1753 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:27.189192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bd1d0e0d-88d7-4672-8328-141247b9995e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:27.190563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bd1d0e0d-88d7-4672-8328-141247b9995e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:27.198022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd1d0e0d-88d7-4672-8328-141247b9995e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:27.198460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd1d0e0d-88d7-4672-8328-141247b9995e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:27.199320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd1d0e0d-88d7-4672-8328-141247b9995e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:27.199759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd1d0e0d-88d7-4672-8328-141247b9995e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:27.375639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bd1d0e0d-88d7-4672-8328-141247b9995e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:27.387376 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bd1d0e0d-88d7-4672-8328-141247b9995e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:27.389422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bd1d0e0d-88d7-4672-8328-141247b9995e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:27.391418 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bd1d0e0d-88d7-4672-8328-141247b9995e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1753 microversion: 2.20 time: 0.206013 May 28 05:09:27.391999 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3021/6154] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:27 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1753 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:28.414759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-74595b26-9566-4fd6-95ae-95d24260532c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:28.415725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-74595b26-9566-4fd6-95ae-95d24260532c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:28.424858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74595b26-9566-4fd6-95ae-95d24260532c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:28.425383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74595b26-9566-4fd6-95ae-95d24260532c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:28.426288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74595b26-9566-4fd6-95ae-95d24260532c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:28.426805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74595b26-9566-4fd6-95ae-95d24260532c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:28.592169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-74595b26-9566-4fd6-95ae-95d24260532c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:28.601925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-74595b26-9566-4fd6-95ae-95d24260532c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:28.603601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-74595b26-9566-4fd6-95ae-95d24260532c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:28.604994 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-74595b26-9566-4fd6-95ae-95d24260532c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1753 microversion: 2.20 time: 0.195475 May 28 05:09:28.605625 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3134/6155] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:28 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1753 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:29.624691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9dd75297-92d8-473f-af69-58dfcce3e116 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:29.625313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9dd75297-92d8-473f-af69-58dfcce3e116 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:29.632527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9dd75297-92d8-473f-af69-58dfcce3e116 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:29.632993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9dd75297-92d8-473f-af69-58dfcce3e116 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:29.633895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9dd75297-92d8-473f-af69-58dfcce3e116 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:29.634350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9dd75297-92d8-473f-af69-58dfcce3e116 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:29.839468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9dd75297-92d8-473f-af69-58dfcce3e116 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:29.848770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9dd75297-92d8-473f-af69-58dfcce3e116 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:29.850412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9dd75297-92d8-473f-af69-58dfcce3e116 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:29.852566 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9dd75297-92d8-473f-af69-58dfcce3e116 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1753 microversion: 2.20 time: 0.231768 May 28 05:09:29.853351 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3022/6156] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:29 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1753 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:30.874401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9e508282-4fdd-4fd4-82b1-abac9248fc99 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:30.875238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9e508282-4fdd-4fd4-82b1-abac9248fc99 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:30.882218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e508282-4fdd-4fd4-82b1-abac9248fc99 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:30.882660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e508282-4fdd-4fd4-82b1-abac9248fc99 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:30.883465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e508282-4fdd-4fd4-82b1-abac9248fc99 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:30.883910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e508282-4fdd-4fd4-82b1-abac9248fc99 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:31.037116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9e508282-4fdd-4fd4-82b1-abac9248fc99 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:31.048767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9e508282-4fdd-4fd4-82b1-abac9248fc99 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:31.048901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9e508282-4fdd-4fd4-82b1-abac9248fc99 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:31.050121 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9e508282-4fdd-4fd4-82b1-abac9248fc99 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1753 microversion: 2.20 time: 0.180055 May 28 05:09:31.050717 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3135/6157] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:30 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:31.483140 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-10dadccd-583c-4fee-bd06-8c190567b3c3 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:31.484719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-10dadccd-583c-4fee-bd06-8c190567b3c3 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:31.494248 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10dadccd-583c-4fee-bd06-8c190567b3c3 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:31.495516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10dadccd-583c-4fee-bd06-8c190567b3c3 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:31.496501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10dadccd-583c-4fee-bd06-8c190567b3c3 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:31.497100 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10dadccd-583c-4fee-bd06-8c190567b3c3 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:31.533102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-10dadccd-583c-4fee-bd06-8c190567b3c3 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:09:32.068356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ac19a500-212f-4a45-ab0e-3e03c067687c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:32.069039 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ac19a500-212f-4a45-ab0e-3e03c067687c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:32.076864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac19a500-212f-4a45-ab0e-3e03c067687c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:32.077327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac19a500-212f-4a45-ab0e-3e03c067687c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:32.078164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac19a500-212f-4a45-ab0e-3e03c067687c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:32.078674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac19a500-212f-4a45-ab0e-3e03c067687c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:32.225567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ac19a500-212f-4a45-ab0e-3e03c067687c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:32.234663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ac19a500-212f-4a45-ab0e-3e03c067687c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:32.236437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ac19a500-212f-4a45-ab0e-3e03c067687c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:32.237650 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ac19a500-212f-4a45-ab0e-3e03c067687c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1753 microversion: 2.20 time: 0.173340 May 28 05:09:32.238222 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3136/6158] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:32 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:32.356270 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-10dadccd-583c-4fee-bd06-8c190567b3c3 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "DELETE /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd" status: 204 len: 0 microversion: 2.1 time: 0.881201 May 28 05:09:32.360993 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3023/6159] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:09:31 2022] DELETE /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd => generated 0 bytes in 888 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:09:32.366285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ea7647fc-f87e-4bea-97b7-5ea9553fa97e tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:32.367517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ea7647fc-f87e-4bea-97b7-5ea9553fa97e tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:32.386433 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea7647fc-f87e-4bea-97b7-5ea9553fa97e tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:32.387172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea7647fc-f87e-4bea-97b7-5ea9553fa97e tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:32.388307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea7647fc-f87e-4bea-97b7-5ea9553fa97e tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:32.388928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ea7647fc-f87e-4bea-97b7-5ea9553fa97e tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:32.598897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ea7647fc-f87e-4bea-97b7-5ea9553fa97e tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:32.634514 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ea7647fc-f87e-4bea-97b7-5ea9553fa97e tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd" status: 200 len: 1515 microversion: 2.1 time: 0.270701 May 28 05:09:32.636004 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3137/6160] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:09:32 2022] GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd => generated 1515 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:09:33.259871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3df1fa6e-c432-458b-ac23-af6dc93fd6fe tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:33.260746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3df1fa6e-c432-458b-ac23-af6dc93fd6fe tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:33.269921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3df1fa6e-c432-458b-ac23-af6dc93fd6fe tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:33.270600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3df1fa6e-c432-458b-ac23-af6dc93fd6fe tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:33.271713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3df1fa6e-c432-458b-ac23-af6dc93fd6fe tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:33.272312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3df1fa6e-c432-458b-ac23-af6dc93fd6fe tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:33.459389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3df1fa6e-c432-458b-ac23-af6dc93fd6fe tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:33.473012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3df1fa6e-c432-458b-ac23-af6dc93fd6fe tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:33.474861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3df1fa6e-c432-458b-ac23-af6dc93fd6fe tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:33.476944 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3df1fa6e-c432-458b-ac23-af6dc93fd6fe tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1753 microversion: 2.20 time: 0.224043 May 28 05:09:33.488690 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3024/6161] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:33 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1753 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:33.653748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b8e0ccf8-5531-4265-adac-907b9d410ae0 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:33.654374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b8e0ccf8-5531-4265-adac-907b9d410ae0 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:33.662348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8e0ccf8-5531-4265-adac-907b9d410ae0 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:33.675946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8e0ccf8-5531-4265-adac-907b9d410ae0 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:33.676750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8e0ccf8-5531-4265-adac-907b9d410ae0 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:33.677210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8e0ccf8-5531-4265-adac-907b9d410ae0 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:33.856291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b8e0ccf8-5531-4265-adac-907b9d410ae0 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:33.864944 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b8e0ccf8-5531-4265-adac-907b9d410ae0 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd" status: 200 len: 1515 microversion: 2.1 time: 0.215105 May 28 05:09:33.865544 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3138/6162] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:09:33 2022] GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd => generated 1515 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:09:34.496874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cf26f424-2175-4769-bb29-5df40ea34124 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:34.498044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cf26f424-2175-4769-bb29-5df40ea34124 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:34.515301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf26f424-2175-4769-bb29-5df40ea34124 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:34.516455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf26f424-2175-4769-bb29-5df40ea34124 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:34.518956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf26f424-2175-4769-bb29-5df40ea34124 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:34.522069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf26f424-2175-4769-bb29-5df40ea34124 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:34.714733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-89a5a3fa-ea4c-4af9-b5a7-2a580da8bbba req-3f0818bb-b425-4e82-9176-1a35260472ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57622bb5-3fad-45a7-b416-7954ff7434fd", "name": "network-vif-deleted", "tag": "4406b18a-8ae4-4b5c-ad57-c07d834eb7c1"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:09:34.725843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-89a5a3fa-ea4c-4af9-b5a7-2a580da8bbba req-3f0818bb-b425-4e82-9176-1a35260472ee service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:34.730886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-89a5a3fa-ea4c-4af9-b5a7-2a580da8bbba req-3f0818bb-b425-4e82-9176-1a35260472ee service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:34.738543 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-89a5a3fa-ea4c-4af9-b5a7-2a580da8bbba req-3f0818bb-b425-4e82-9176-1a35260472ee service nova] Creating event network-vif-deleted:4406b18a-8ae4-4b5c-ad57-c07d834eb7c1 for instance 57622bb5-3fad-45a7-b416-7954ff7434fd on n-h1-843700-1 May 28 05:09:34.745075 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-89a5a3fa-ea4c-4af9-b5a7-2a580da8bbba req-3f0818bb-b425-4e82-9176-1a35260472ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034512 May 28 05:09:34.746530 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3139/6163] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:09:34.770301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cf26f424-2175-4769-bb29-5df40ea34124 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:34.788612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cf26f424-2175-4769-bb29-5df40ea34124 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:34.790145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cf26f424-2175-4769-bb29-5df40ea34124 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:34.791425 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cf26f424-2175-4769-bb29-5df40ea34124 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1753 microversion: 2.20 time: 0.300086 May 28 05:09:34.799158 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3025/6164] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:34 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1753 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:34.886476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3b8ca514-aded-42e2-be39-517f62975283 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:34.887596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3b8ca514-aded-42e2-be39-517f62975283 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:34.895545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b8ca514-aded-42e2-be39-517f62975283 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:34.896354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b8ca514-aded-42e2-be39-517f62975283 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:34.897329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b8ca514-aded-42e2-be39-517f62975283 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:34.898006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b8ca514-aded-42e2-be39-517f62975283 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:34.998471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3b8ca514-aded-42e2-be39-517f62975283 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:35.013267 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3b8ca514-aded-42e2-be39-517f62975283 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd" status: 200 len: 1304 microversion: 2.1 time: 0.128846 May 28 05:09:35.013267 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3140/6165] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:09:34 2022] GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd => generated 1304 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:09:35.815271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-58838397-cb31-498d-8d07-d045e5bb23c0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:35.816564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-58838397-cb31-498d-8d07-d045e5bb23c0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:35.826272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-58838397-cb31-498d-8d07-d045e5bb23c0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:35.827087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-58838397-cb31-498d-8d07-d045e5bb23c0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:35.828089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-58838397-cb31-498d-8d07-d045e5bb23c0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:35.828740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-58838397-cb31-498d-8d07-d045e5bb23c0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:36.026936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ec41faa1-4b81-4f57-b7ea-7ca01f0ebfb0 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:36.027581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ec41faa1-4b81-4f57-b7ea-7ca01f0ebfb0 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 57622bb5-3fad-45a7-b416-7954ff7434fd] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:36.057163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec41faa1-4b81-4f57-b7ea-7ca01f0ebfb0 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:36.058599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec41faa1-4b81-4f57-b7ea-7ca01f0ebfb0 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:36.059202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-58838397-cb31-498d-8d07-d045e5bb23c0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:36.059461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec41faa1-4b81-4f57-b7ea-7ca01f0ebfb0 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:36.059917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ec41faa1-4b81-4f57-b7ea-7ca01f0ebfb0 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:36.068224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-58838397-cb31-498d-8d07-d045e5bb23c0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:36.069794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-58838397-cb31-498d-8d07-d045e5bb23c0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:36.088571 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-ec41faa1-4b81-4f57-b7ea-7ca01f0ebfb0 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] HTTP exception thrown: Instance 57622bb5-3fad-45a7-b416-7954ff7434fd could not be found. May 28 05:09:36.089383 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-58838397-cb31-498d-8d07-d045e5bb23c0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1753 microversion: 2.20 time: 0.281508 May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ec41faa1-4b81-4f57-b7ea-7ca01f0ebfb0 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Request method failure captured: May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd HTTP/1.1 May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABika1HeStVElVQJ72LxtOaCypBRwok9KC8ehHmBtoE4ge-FF-ZMiewNMctXMlqe3Upsdmz7qzPkbkJ_WgFZAVy7giq_HlmNERtr06agJ8Tq3kRuGmxHUqtCyvWt_UhBY8JQf-Pfhzwxgka5_tQnqH7ANBSu7nV6J4fjllSPPW_XmsLxYg May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 3833032727344d68b18149e6fdc20bde May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1102046578 May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3833032727344d68b18149e6fdc20bde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3833032727344d68b18149e6fdc20bde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3833032727344d68b18149e6fdc20bde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3833032727344d68b18149e6fdc20bde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-VolumesSnapshotTestJSON-1102046578 May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 3833032727344d68b18149e6fdc20bde May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1102046578 May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-VolumesSnapshotTestJSON-1102046578-project May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 0313b050ae35491e830a4adce40453ed May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-VolumesSnapshotTestJSON-1102046578-project May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 57622bb5-3fad-45a7-b416-7954ff7434fd could not be found. May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '57622bb5-3fad-45a7-b416-7954ff7434fd'} May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57622bb5-3fad-45a7-b416-7954ff7434fd could not be found. May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57622bb5-3fad-45a7-b416-7954ff7434fd could not be found. May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:09:36.091502 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:09:36.101465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:09:36.101465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:09:36.101465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:09:36.101465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:09:36.101465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:09:36.101465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57622bb5-3fad-45a7-b416-7954ff7434fd could not be found. May 28 05:09:36.101465 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:09:36.102021 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3026/6166] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:35 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1753 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:36.102115 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ec41faa1-4b81-4f57-b7ea-7ca01f0ebfb0 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Returning 404 to user: Instance 57622bb5-3fad-45a7-b416-7954ff7434fd could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:09:36.102115 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ec41faa1-4b81-4f57-b7ea-7ca01f0ebfb0 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd" status: 404 len: 111 microversion: 2.1 time: 0.074795 May 28 05:09:36.102115 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3141/6167] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:09:36 2022] GET /compute/v2.1/servers/57622bb5-3fad-45a7-b416-7954ff7434fd => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 05:09:37.110528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f1ce6b31-8840-4f53-87e3-bd408d049e9b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:37.112113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f1ce6b31-8840-4f53-87e3-bd408d049e9b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:37.123520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1ce6b31-8840-4f53-87e3-bd408d049e9b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:37.125628 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1ce6b31-8840-4f53-87e3-bd408d049e9b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:37.126609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1ce6b31-8840-4f53-87e3-bd408d049e9b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:37.127724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1ce6b31-8840-4f53-87e3-bd408d049e9b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:37.417693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f1ce6b31-8840-4f53-87e3-bd408d049e9b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:37.431378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f1ce6b31-8840-4f53-87e3-bd408d049e9b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:37.433023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f1ce6b31-8840-4f53-87e3-bd408d049e9b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:37.434919 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f1ce6b31-8840-4f53-87e3-bd408d049e9b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1753 microversion: 2.20 time: 0.330408 May 28 05:09:37.435845 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3027/6168] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:37 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1753 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:38.456923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-41e03b19-9a3b-48bb-85b2-8bedca859096 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:38.458980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-41e03b19-9a3b-48bb-85b2-8bedca859096 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:38.479660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41e03b19-9a3b-48bb-85b2-8bedca859096 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:38.480241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41e03b19-9a3b-48bb-85b2-8bedca859096 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:38.481058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41e03b19-9a3b-48bb-85b2-8bedca859096 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:38.481514 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41e03b19-9a3b-48bb-85b2-8bedca859096 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:38.693023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-41e03b19-9a3b-48bb-85b2-8bedca859096 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:38.708468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-41e03b19-9a3b-48bb-85b2-8bedca859096 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:38.711515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-41e03b19-9a3b-48bb-85b2-8bedca859096 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:38.715191 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-41e03b19-9a3b-48bb-85b2-8bedca859096 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1753 microversion: 2.20 time: 0.265586 May 28 05:09:38.726548 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3142/6169] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:38 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1753 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:39.735953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-03887c0f-45e4-41e6-aad6-e06ace3f5a31 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:39.737323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-03887c0f-45e4-41e6-aad6-e06ace3f5a31 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:39.747579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03887c0f-45e4-41e6-aad6-e06ace3f5a31 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:39.748294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03887c0f-45e4-41e6-aad6-e06ace3f5a31 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:39.749253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03887c0f-45e4-41e6-aad6-e06ace3f5a31 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:39.749857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03887c0f-45e4-41e6-aad6-e06ace3f5a31 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:40.058941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-03887c0f-45e4-41e6-aad6-e06ace3f5a31 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:40.072112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-03887c0f-45e4-41e6-aad6-e06ace3f5a31 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:40.073662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-03887c0f-45e4-41e6-aad6-e06ace3f5a31 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:40.080187 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-03887c0f-45e4-41e6-aad6-e06ace3f5a31 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1753 microversion: 2.20 time: 0.350052 May 28 05:09:40.086077 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3028/6170] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:39 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1753 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:41.106696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b49ba4a9-bca5-40b9-acb6-e80ce3e9169d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:41.107496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b49ba4a9-bca5-40b9-acb6-e80ce3e9169d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:41.123814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b49ba4a9-bca5-40b9-acb6-e80ce3e9169d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:41.125529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b49ba4a9-bca5-40b9-acb6-e80ce3e9169d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:41.128283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b49ba4a9-bca5-40b9-acb6-e80ce3e9169d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:41.129066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b49ba4a9-bca5-40b9-acb6-e80ce3e9169d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:41.640870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b49ba4a9-bca5-40b9-acb6-e80ce3e9169d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:41.652784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b49ba4a9-bca5-40b9-acb6-e80ce3e9169d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:41.665118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b49ba4a9-bca5-40b9-acb6-e80ce3e9169d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:41.672993 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b49ba4a9-bca5-40b9-acb6-e80ce3e9169d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1753 microversion: 2.20 time: 0.566371 May 28 05:09:41.672993 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3143/6171] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:41 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1753 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:42.685504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eed08cba-a729-4360-bbfc-25cffd06279f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:42.687021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eed08cba-a729-4360-bbfc-25cffd06279f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:42.695047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eed08cba-a729-4360-bbfc-25cffd06279f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:42.700073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eed08cba-a729-4360-bbfc-25cffd06279f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:42.700073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eed08cba-a729-4360-bbfc-25cffd06279f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:42.700073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eed08cba-a729-4360-bbfc-25cffd06279f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:42.701483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:09:43.313488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eed08cba-a729-4360-bbfc-25cffd06279f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:43.323970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eed08cba-a729-4360-bbfc-25cffd06279f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:43.325848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eed08cba-a729-4360-bbfc-25cffd06279f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:43.327328 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eed08cba-a729-4360-bbfc-25cffd06279f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1753 microversion: 2.20 time: 0.646118 May 28 05:09:43.328104 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3029/6172] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:42 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1753 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:44.345769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ab5d573d-a995-4358-9592-bca1d9d0d11e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:44.347200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ab5d573d-a995-4358-9592-bca1d9d0d11e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:44.358694 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab5d573d-a995-4358-9592-bca1d9d0d11e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:44.359210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab5d573d-a995-4358-9592-bca1d9d0d11e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:44.359989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab5d573d-a995-4358-9592-bca1d9d0d11e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:44.360429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab5d573d-a995-4358-9592-bca1d9d0d11e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:44.644248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ab5d573d-a995-4358-9592-bca1d9d0d11e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:44.658865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ab5d573d-a995-4358-9592-bca1d9d0d11e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:44.660791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ab5d573d-a995-4358-9592-bca1d9d0d11e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:44.662227 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ab5d573d-a995-4358-9592-bca1d9d0d11e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.320330 May 28 05:09:44.667344 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3144/6173] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:44 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:45.689557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-71f6809b-71b0-442b-8037-05508b58cf02 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:45.691519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-71f6809b-71b0-442b-8037-05508b58cf02 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:45.721782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71f6809b-71b0-442b-8037-05508b58cf02 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:45.723401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71f6809b-71b0-442b-8037-05508b58cf02 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:45.725163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71f6809b-71b0-442b-8037-05508b58cf02 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:45.726406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71f6809b-71b0-442b-8037-05508b58cf02 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:46.013244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-71f6809b-71b0-442b-8037-05508b58cf02 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:46.027836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-71f6809b-71b0-442b-8037-05508b58cf02 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:46.030238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-71f6809b-71b0-442b-8037-05508b58cf02 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:46.032484 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-71f6809b-71b0-442b-8037-05508b58cf02 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.351691 May 28 05:09:46.034096 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3030/6174] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:45 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:46.310603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-ad08502c-b416-4b88-9518-151b55244de7 req-c3fa291c-e027-4f06-9e40-bf9693590c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "334654f9-2ad8-4cef-b4e8-bf45eb69f937", "tag": "9efbcbd3-4d06-4190-8016-20cbfae73fe4"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:09:46.336600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ad08502c-b416-4b88-9518-151b55244de7 req-c3fa291c-e027-4f06-9e40-bf9693590c83 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:46.337250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ad08502c-b416-4b88-9518-151b55244de7 req-c3fa291c-e027-4f06-9e40-bf9693590c83 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:46.359829 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-ad08502c-b416-4b88-9518-151b55244de7 req-c3fa291c-e027-4f06-9e40-bf9693590c83 service nova] Creating event network-changed:9efbcbd3-4d06-4190-8016-20cbfae73fe4 for instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 on n-h1-843700-1 May 28 05:09:46.372893 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-ad08502c-b416-4b88-9518-151b55244de7 req-c3fa291c-e027-4f06-9e40-bf9693590c83 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065931 May 28 05:09:46.378597 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3145/6175] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:09:47.056756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3a9148dc-b52c-44b0-9d1e-e7f1b350e252 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:47.057587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3a9148dc-b52c-44b0-9d1e-e7f1b350e252 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:47.089330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a9148dc-b52c-44b0-9d1e-e7f1b350e252 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:47.091308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a9148dc-b52c-44b0-9d1e-e7f1b350e252 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:47.092795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a9148dc-b52c-44b0-9d1e-e7f1b350e252 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:47.095175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a9148dc-b52c-44b0-9d1e-e7f1b350e252 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:47.515678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3a9148dc-b52c-44b0-9d1e-e7f1b350e252 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:47.548923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3a9148dc-b52c-44b0-9d1e-e7f1b350e252 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:47.552042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3a9148dc-b52c-44b0-9d1e-e7f1b350e252 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:47.563939 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3a9148dc-b52c-44b0-9d1e-e7f1b350e252 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.507595 May 28 05:09:47.563939 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3031/6176] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:47 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:47.955786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cca3551e-280d-4e9e-8fdc-2991c86e0a5d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:47.957527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-3702a9d3-5a28-41b5-bb92-56dd934d0ce8 req-bb5e69f9-a5d1-4ddf-be6b-f0c9d20d9fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12106ac-a8a7-44cc-a111-c5599a29c137", "tag": "80bb8c1a-4a40-4b48-948f-08b18f123ea5"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:09:47.958283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cca3551e-280d-4e9e-8fdc-2991c86e0a5d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:47.972202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cca3551e-280d-4e9e-8fdc-2991c86e0a5d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:47.974637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cca3551e-280d-4e9e-8fdc-2991c86e0a5d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:47.977533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cca3551e-280d-4e9e-8fdc-2991c86e0a5d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:47.978186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cca3551e-280d-4e9e-8fdc-2991c86e0a5d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:47.980880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:09:47.990671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3702a9d3-5a28-41b5-bb92-56dd934d0ce8 req-bb5e69f9-a5d1-4ddf-be6b-f0c9d20d9fd3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:47.991165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3702a9d3-5a28-41b5-bb92-56dd934d0ce8 req-bb5e69f9-a5d1-4ddf-be6b-f0c9d20d9fd3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:48.037974 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-3702a9d3-5a28-41b5-bb92-56dd934d0ce8 req-bb5e69f9-a5d1-4ddf-be6b-f0c9d20d9fd3 service nova] Creating event network-changed:80bb8c1a-4a40-4b48-948f-08b18f123ea5 for instance c12106ac-a8a7-44cc-a111-c5599a29c137 on n-h2-843700-1 May 28 05:09:48.043955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cca3551e-280d-4e9e-8fdc-2991c86e0a5d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:09:48.059472 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-3702a9d3-5a28-41b5-bb92-56dd934d0ce8 req-bb5e69f9-a5d1-4ddf-be6b-f0c9d20d9fd3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107112 May 28 05:09:48.064251 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3032/6177] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:09:48.471716 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cca3551e-280d-4e9e-8fdc-2991c86e0a5d tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 204 len: 0 microversion: 2.1 time: 0.520591 May 28 05:09:48.473707 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3146/6178] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:09:47 2022] DELETE /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:09:48.485726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-841d3dc7-8aa7-4aba-8fa6-f59c8331a90b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:48.487580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-841d3dc7-8aa7-4aba-8fa6-f59c8331a90b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:48.516263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-841d3dc7-8aa7-4aba-8fa6-f59c8331a90b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:48.517488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-841d3dc7-8aa7-4aba-8fa6-f59c8331a90b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:48.519224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-841d3dc7-8aa7-4aba-8fa6-f59c8331a90b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:48.521836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-841d3dc7-8aa7-4aba-8fa6-f59c8331a90b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:48.576322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f419d30f-531d-402e-a285-6b779a31f19f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:48.577784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f419d30f-531d-402e-a285-6b779a31f19f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:48.599588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f419d30f-531d-402e-a285-6b779a31f19f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:48.603516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f419d30f-531d-402e-a285-6b779a31f19f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:48.604469 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f419d30f-531d-402e-a285-6b779a31f19f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:48.604853 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f419d30f-531d-402e-a285-6b779a31f19f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:49.427955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-841d3dc7-8aa7-4aba-8fa6-f59c8331a90b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:49.445192 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-841d3dc7-8aa7-4aba-8fa6-f59c8331a90b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1585 microversion: 2.1 time: 0.966507 May 28 05:09:49.447959 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3033/6179] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:09:48 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1585 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:09:49.478530 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f419d30f-531d-402e-a285-6b779a31f19f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:49.490371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f419d30f-531d-402e-a285-6b779a31f19f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:49.496720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f419d30f-531d-402e-a285-6b779a31f19f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:49.500203 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f419d30f-531d-402e-a285-6b779a31f19f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.928964 May 28 05:09:49.511196 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3147/6180] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:48 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:50.465445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6ef34d9f-5e05-4b87-b525-ac6ca2279086 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:50.466403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6ef34d9f-5e05-4b87-b525-ac6ca2279086 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:50.480008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ef34d9f-5e05-4b87-b525-ac6ca2279086 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:50.481866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ef34d9f-5e05-4b87-b525-ac6ca2279086 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:50.482734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ef34d9f-5e05-4b87-b525-ac6ca2279086 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:50.483959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ef34d9f-5e05-4b87-b525-ac6ca2279086 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:50.530161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1695bbf8-30aa-4391-b79e-170347a22a50 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:50.534939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1695bbf8-30aa-4391-b79e-170347a22a50 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:50.556604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1695bbf8-30aa-4391-b79e-170347a22a50 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:50.557403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1695bbf8-30aa-4391-b79e-170347a22a50 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:50.561534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1695bbf8-30aa-4391-b79e-170347a22a50 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:50.563524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1695bbf8-30aa-4391-b79e-170347a22a50 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:51.582656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6ef34d9f-5e05-4b87-b525-ac6ca2279086 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:51.594340 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6ef34d9f-5e05-4b87-b525-ac6ca2279086 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1585 microversion: 2.1 time: 1.133807 May 28 05:09:51.606579 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3034/6181] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:09:50 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1585 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:09:51.625334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-770994ff-8986-47dd-ae26-ab13206ce458 req-8436ccce-301e-4164-8192-2aab4904b826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12106ac-a8a7-44cc-a111-c5599a29c137", "name": "network-vif-deleted", "tag": "80bb8c1a-4a40-4b48-948f-08b18f123ea5"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:09:51.639804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-770994ff-8986-47dd-ae26-ab13206ce458 req-8436ccce-301e-4164-8192-2aab4904b826 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:51.640196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-770994ff-8986-47dd-ae26-ab13206ce458 req-8436ccce-301e-4164-8192-2aab4904b826 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:51.658090 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-770994ff-8986-47dd-ae26-ab13206ce458 req-8436ccce-301e-4164-8192-2aab4904b826 service nova] Creating event network-vif-deleted:80bb8c1a-4a40-4b48-948f-08b18f123ea5 for instance c12106ac-a8a7-44cc-a111-c5599a29c137 on n-h2-843700-1 May 28 05:09:51.666852 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-770994ff-8986-47dd-ae26-ab13206ce458 req-8436ccce-301e-4164-8192-2aab4904b826 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053889 May 28 05:09:51.667867 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3035/6182] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:09:51.772369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1695bbf8-30aa-4391-b79e-170347a22a50 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:51.790796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1695bbf8-30aa-4391-b79e-170347a22a50 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:51.797377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1695bbf8-30aa-4391-b79e-170347a22a50 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:51.800042 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1695bbf8-30aa-4391-b79e-170347a22a50 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 1.274221 May 28 05:09:51.811459 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3148/6183] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:50 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:09:51.811648 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b9322a88-fa6d-40ef-9f28-1ed7e7e777ad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-290389610", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "7299b1cb-835b-44d1-90be-110b92b5e089"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:09:52.612979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c7395716-563c-4ba4-b19d-c6d1d0645c56 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:52.613605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c7395716-563c-4ba4-b19d-c6d1d0645c56 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:52.642728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c7395716-563c-4ba4-b19d-c6d1d0645c56 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:52.643216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c7395716-563c-4ba4-b19d-c6d1d0645c56 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:52.650470 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c7395716-563c-4ba4-b19d-c6d1d0645c56 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:52.652498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c7395716-563c-4ba4-b19d-c6d1d0645c56 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:52.656586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:09:52.849625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c7395716-563c-4ba4-b19d-c6d1d0645c56 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:52.862904 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c7395716-563c-4ba4-b19d-c6d1d0645c56 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1230 microversion: 2.1 time: 0.253809 May 28 05:09:52.866055 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3149/6184] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:09:52 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1230 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:09:52.870608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d256482f-7723-429b-b4b4-281fd914c152 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:52.871510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d256482f-7723-429b-b4b4-281fd914c152 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:52.888488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d256482f-7723-429b-b4b4-281fd914c152 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:52.889862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d256482f-7723-429b-b4b4-281fd914c152 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:52.892905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d256482f-7723-429b-b4b4-281fd914c152 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:52.896618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d256482f-7723-429b-b4b4-281fd914c152 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:53.104916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-b9322a88-fa6d-40ef-9f28-1ed7e7e777ad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] validate_networks() for [('7299b1cb-835b-44d1-90be-110b92b5e089', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:09:53.660371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d256482f-7723-429b-b4b4-281fd914c152 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:53.684616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d256482f-7723-429b-b4b4-281fd914c152 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:53.689048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d256482f-7723-429b-b4b4-281fd914c152 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:53.695268 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d256482f-7723-429b-b4b4-281fd914c152 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.824563 May 28 05:09:53.696089 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3150/6185] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:52 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:53.881776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-874f35c1-c2e3-44ba-b916-d16023613276 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:53.883272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-874f35c1-c2e3-44ba-b916-d16023613276 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:53.889933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-874f35c1-c2e3-44ba-b916-d16023613276 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:53.891362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-874f35c1-c2e3-44ba-b916-d16023613276 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:53.892367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-874f35c1-c2e3-44ba-b916-d16023613276 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:53.893017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-874f35c1-c2e3-44ba-b916-d16023613276 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:54.008954 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-874f35c1-c2e3-44ba-b916-d16023613276 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:54.029220 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-874f35c1-c2e3-44ba-b916-d16023613276 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1230 microversion: 2.1 time: 0.149724 May 28 05:09:54.033240 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3151/6186] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:09:53 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1230 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:09:54.079377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-b9322a88-fa6d-40ef-9f28-1ed7e7e777ad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:09:54.080204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-b9322a88-fa6d-40ef-9f28-1ed7e7e777ad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:09:54.081126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-b9322a88-fa6d-40ef-9f28-1ed7e7e777ad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:09:54.081742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-b9322a88-fa6d-40ef-9f28-1ed7e7e777ad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:09:54.082349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-b9322a88-fa6d-40ef-9f28-1ed7e7e777ad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:09:54.105570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9322a88-fa6d-40ef-9f28-1ed7e7e777ad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:54.106822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9322a88-fa6d-40ef-9f28-1ed7e7e777ad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:54.107713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9322a88-fa6d-40ef-9f28-1ed7e7e777ad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:54.108167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9322a88-fa6d-40ef-9f28-1ed7e7e777ad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:54.150528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-b9322a88-fa6d-40ef-9f28-1ed7e7e777ad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Getting quotas for project 3833032727344d68b18149e6fdc20bde. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:09:54.156687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-b9322a88-fa6d-40ef-9f28-1ed7e7e777ad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Getting quotas for user 0313b050ae35491e830a4adce40453ed and project 3833032727344d68b18149e6fdc20bde. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:09:54.201732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b9322a88-fa6d-40ef-9f28-1ed7e7e777ad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:09:54.209762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b9322a88-fa6d-40ef-9f28-1ed7e7e777ad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:09:54.342058 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b9322a88-fa6d-40ef-9f28-1ed7e7e777ad tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.543770 May 28 05:09:54.360914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-afc0ef0d-ba88-4bb5-a6b5-26691829421b tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:54.361824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-afc0ef0d-ba88-4bb5-a6b5-26691829421b tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:54.393371 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3036/6187] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:09:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:09:54.581768 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-afc0ef0d-ba88-4bb5-a6b5-26691829421b tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:54.592834 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-afc0ef0d-ba88-4bb5-a6b5-26691829421b tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee" status: 200 len: 1218 microversion: 2.1 time: 0.233803 May 28 05:09:54.604949 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3152/6188] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:09:54 2022] GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee => generated 1218 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:09:54.718203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a34fe516-8830-4835-9654-e8ed8c759735 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:54.719362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a34fe516-8830-4835-9654-e8ed8c759735 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:54.741065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a34fe516-8830-4835-9654-e8ed8c759735 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:54.767107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a34fe516-8830-4835-9654-e8ed8c759735 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:54.767974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a34fe516-8830-4835-9654-e8ed8c759735 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:54.768426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a34fe516-8830-4835-9654-e8ed8c759735 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:55.043094 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a34fe516-8830-4835-9654-e8ed8c759735 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:55.051216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f6bebda4-9dc6-4447-bb02-d6334e073b98 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:55.052382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f6bebda4-9dc6-4447-bb02-d6334e073b98 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:55.054977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a34fe516-8830-4835-9654-e8ed8c759735 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:55.057078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a34fe516-8830-4835-9654-e8ed8c759735 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:55.058867 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a34fe516-8830-4835-9654-e8ed8c759735 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.344697 May 28 05:09:55.070698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6bebda4-9dc6-4447-bb02-d6334e073b98 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:55.070915 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3037/6189] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:54 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:55.071602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6bebda4-9dc6-4447-bb02-d6334e073b98 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:55.072839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6bebda4-9dc6-4447-bb02-d6334e073b98 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:55.073532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6bebda4-9dc6-4447-bb02-d6334e073b98 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:55.206126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f6bebda4-9dc6-4447-bb02-d6334e073b98 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:55.229550 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f6bebda4-9dc6-4447-bb02-d6334e073b98 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1230 microversion: 2.1 time: 0.183032 May 28 05:09:55.231143 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3153/6190] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:09:55 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1230 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:09:55.615496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f2eefde0-3c3c-4546-8b22-a0cbf12ad160 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:55.617752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f2eefde0-3c3c-4546-8b22-a0cbf12ad160 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:55.631388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2eefde0-3c3c-4546-8b22-a0cbf12ad160 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:55.634359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2eefde0-3c3c-4546-8b22-a0cbf12ad160 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:55.638394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2eefde0-3c3c-4546-8b22-a0cbf12ad160 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:55.638394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2eefde0-3c3c-4546-8b22-a0cbf12ad160 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:55.831311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f2eefde0-3c3c-4546-8b22-a0cbf12ad160 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:55.845125 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f2eefde0-3c3c-4546-8b22-a0cbf12ad160 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee" status: 200 len: 1222 microversion: 2.1 time: 0.235593 May 28 05:09:55.848174 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3038/6191] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:09:55 2022] GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee => generated 1222 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:09:56.078616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aa821b85-9727-47ab-a661-2d965d327aee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:56.079516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aa821b85-9727-47ab-a661-2d965d327aee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:56.090375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:09:56.099080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aa821b85-9727-47ab-a661-2d965d327aee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:56.099080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aa821b85-9727-47ab-a661-2d965d327aee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:56.100014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aa821b85-9727-47ab-a661-2d965d327aee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:56.100918 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aa821b85-9727-47ab-a661-2d965d327aee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:56.248999 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f60d66d3-0b9a-4cb6-976e-b22de1936f4b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:56.249717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f60d66d3-0b9a-4cb6-976e-b22de1936f4b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:56.273123 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f60d66d3-0b9a-4cb6-976e-b22de1936f4b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:56.273834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f60d66d3-0b9a-4cb6-976e-b22de1936f4b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:56.274764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f60d66d3-0b9a-4cb6-976e-b22de1936f4b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:56.275423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f60d66d3-0b9a-4cb6-976e-b22de1936f4b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:56.531293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f60d66d3-0b9a-4cb6-976e-b22de1936f4b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:56.557971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aa821b85-9727-47ab-a661-2d965d327aee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:56.569083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aa821b85-9727-47ab-a661-2d965d327aee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:56.571622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aa821b85-9727-47ab-a661-2d965d327aee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:56.573399 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aa821b85-9727-47ab-a661-2d965d327aee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.499314 May 28 05:09:56.575307 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3154/6192] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:56 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:56.588988 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f60d66d3-0b9a-4cb6-976e-b22de1936f4b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1230 microversion: 2.1 time: 0.328959 May 28 05:09:56.590020 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3039/6193] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:09:56 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1230 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:09:56.868626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e2b3f340-b1d3-47bd-9b27-52cead430a87 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:56.869445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e2b3f340-b1d3-47bd-9b27-52cead430a87 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:56.886704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2b3f340-b1d3-47bd-9b27-52cead430a87 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:56.887551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2b3f340-b1d3-47bd-9b27-52cead430a87 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:56.889808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2b3f340-b1d3-47bd-9b27-52cead430a87 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:56.892408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2b3f340-b1d3-47bd-9b27-52cead430a87 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:57.052695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e2b3f340-b1d3-47bd-9b27-52cead430a87 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:57.067787 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e2b3f340-b1d3-47bd-9b27-52cead430a87 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee" status: 200 len: 1270 microversion: 2.1 time: 0.206638 May 28 05:09:57.080876 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3155/6194] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:09:56 2022] GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee => generated 1270 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:09:57.593289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f830210e-8441-4d29-b512-8bc0c1e307a5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:57.593865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f830210e-8441-4d29-b512-8bc0c1e307a5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:57.606711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3d72740b-fb0a-40b6-bc8a-4c2f838482d2 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:57.607370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3d72740b-fb0a-40b6-bc8a-4c2f838482d2 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:57.618409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f830210e-8441-4d29-b512-8bc0c1e307a5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:57.619489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f830210e-8441-4d29-b512-8bc0c1e307a5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:57.620452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f830210e-8441-4d29-b512-8bc0c1e307a5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:57.621062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f830210e-8441-4d29-b512-8bc0c1e307a5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:57.626668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d72740b-fb0a-40b6-bc8a-4c2f838482d2 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:57.628616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d72740b-fb0a-40b6-bc8a-4c2f838482d2 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:57.631113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d72740b-fb0a-40b6-bc8a-4c2f838482d2 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:57.633575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d72740b-fb0a-40b6-bc8a-4c2f838482d2 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:57.950401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3d72740b-fb0a-40b6-bc8a-4c2f838482d2 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:57.962077 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3d72740b-fb0a-40b6-bc8a-4c2f838482d2 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1230 microversion: 2.1 time: 0.359470 May 28 05:09:57.971827 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3156/6195] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:09:57 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1230 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:09:58.089631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e7aa1377-8894-4134-ad87-07a457feb179 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:58.091916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e7aa1377-8894-4134-ad87-07a457feb179 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:58.097699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f830210e-8441-4d29-b512-8bc0c1e307a5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:58.103994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e7aa1377-8894-4134-ad87-07a457feb179 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:58.104828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e7aa1377-8894-4134-ad87-07a457feb179 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:58.106875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e7aa1377-8894-4134-ad87-07a457feb179 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:58.110308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f830210e-8441-4d29-b512-8bc0c1e307a5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:58.110907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e7aa1377-8894-4134-ad87-07a457feb179 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:58.113128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f830210e-8441-4d29-b512-8bc0c1e307a5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:58.115849 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f830210e-8441-4d29-b512-8bc0c1e307a5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.527148 May 28 05:09:58.132719 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3040/6196] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:57 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:09:58.342414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e7aa1377-8894-4134-ad87-07a457feb179 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:58.353842 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e7aa1377-8894-4134-ad87-07a457feb179 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee" status: 200 len: 1276 microversion: 2.1 time: 0.270344 May 28 05:09:58.362954 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3157/6197] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:09:58 2022] GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee => generated 1276 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:09:58.980058 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-81288e16-59ea-44df-b776-fc5082980108 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:58.981432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-81288e16-59ea-44df-b776-fc5082980108 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:58.994858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81288e16-59ea-44df-b776-fc5082980108 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:58.995718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81288e16-59ea-44df-b776-fc5082980108 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:58.996676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81288e16-59ea-44df-b776-fc5082980108 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:58.997281 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81288e16-59ea-44df-b776-fc5082980108 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:59.101729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-81288e16-59ea-44df-b776-fc5082980108 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:59.113416 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-81288e16-59ea-44df-b776-fc5082980108 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1230 microversion: 2.1 time: 0.138554 May 28 05:09:59.125592 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3041/6198] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:09:58 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1230 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:09:59.136257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-49e0de91-e211-4ed9-b2bc-36a8fbdd5c8f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:59.139133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-49e0de91-e211-4ed9-b2bc-36a8fbdd5c8f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:59.144945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49e0de91-e211-4ed9-b2bc-36a8fbdd5c8f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:59.145698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49e0de91-e211-4ed9-b2bc-36a8fbdd5c8f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:59.146798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49e0de91-e211-4ed9-b2bc-36a8fbdd5c8f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:59.148141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49e0de91-e211-4ed9-b2bc-36a8fbdd5c8f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:59.373399 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-34668796-6039-4b9d-aa81-5035fd0dded9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:09:59.374386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-34668796-6039-4b9d-aa81-5035fd0dded9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:09:59.381679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34668796-6039-4b9d-aa81-5035fd0dded9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:59.382180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34668796-6039-4b9d-aa81-5035fd0dded9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:59.383052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34668796-6039-4b9d-aa81-5035fd0dded9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:09:59.383512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34668796-6039-4b9d-aa81-5035fd0dded9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:09:59.667814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-49e0de91-e211-4ed9-b2bc-36a8fbdd5c8f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:59.684007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-49e0de91-e211-4ed9-b2bc-36a8fbdd5c8f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:59.686120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-49e0de91-e211-4ed9-b2bc-36a8fbdd5c8f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:09:59.687857 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-49e0de91-e211-4ed9-b2bc-36a8fbdd5c8f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.556367 May 28 05:09:59.699911 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3158/6199] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:09:59 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:10:00.020555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-34668796-6039-4b9d-aa81-5035fd0dded9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:00.045710 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-34668796-6039-4b9d-aa81-5035fd0dded9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee" status: 200 len: 1318 microversion: 2.1 time: 0.676126 May 28 05:10:00.050377 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3042/6200] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:09:59 2022] GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee => generated 1318 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:10:00.132303 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-266c6a13-e417-4018-91c0-0cf7c9b5d330 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:00.132973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-266c6a13-e417-4018-91c0-0cf7c9b5d330 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:00.150314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-266c6a13-e417-4018-91c0-0cf7c9b5d330 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:00.160145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-266c6a13-e417-4018-91c0-0cf7c9b5d330 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:00.162461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-266c6a13-e417-4018-91c0-0cf7c9b5d330 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:00.165156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-266c6a13-e417-4018-91c0-0cf7c9b5d330 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:00.462316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-266c6a13-e417-4018-91c0-0cf7c9b5d330 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:00.486762 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-266c6a13-e417-4018-91c0-0cf7c9b5d330 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1230 microversion: 2.1 time: 0.358938 May 28 05:10:00.491826 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3159/6201] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:10:00 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1230 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:10:00.710409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3dac9011-d14e-497f-8fa6-678c3c818334 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:00.710409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3dac9011-d14e-497f-8fa6-678c3c818334 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:00.722403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3dac9011-d14e-497f-8fa6-678c3c818334 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:00.724299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3dac9011-d14e-497f-8fa6-678c3c818334 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:00.724299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3dac9011-d14e-497f-8fa6-678c3c818334 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:00.724299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3dac9011-d14e-497f-8fa6-678c3c818334 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:01.071543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bcd54dbb-947c-4ccd-9bba-6ebb462b0282 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:01.075128 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bcd54dbb-947c-4ccd-9bba-6ebb462b0282 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:01.084147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bcd54dbb-947c-4ccd-9bba-6ebb462b0282 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:01.085540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bcd54dbb-947c-4ccd-9bba-6ebb462b0282 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:01.086680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bcd54dbb-947c-4ccd-9bba-6ebb462b0282 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:01.087428 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bcd54dbb-947c-4ccd-9bba-6ebb462b0282 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:01.416539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3dac9011-d14e-497f-8fa6-678c3c818334 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:01.452334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3dac9011-d14e-497f-8fa6-678c3c818334 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:01.455339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3dac9011-d14e-497f-8fa6-678c3c818334 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:01.465571 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3dac9011-d14e-497f-8fa6-678c3c818334 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.757869 May 28 05:10:01.479042 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3043/6202] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:10:00 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:10:01.513993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-47d7dae0-6b61-4f5f-9516-df02e4bb7651 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:01.516651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-47d7dae0-6b61-4f5f-9516-df02e4bb7651 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:01.530539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47d7dae0-6b61-4f5f-9516-df02e4bb7651 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:01.533963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47d7dae0-6b61-4f5f-9516-df02e4bb7651 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:01.539429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47d7dae0-6b61-4f5f-9516-df02e4bb7651 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:01.540333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47d7dae0-6b61-4f5f-9516-df02e4bb7651 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:01.696023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bcd54dbb-947c-4ccd-9bba-6ebb462b0282 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:01.711059 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bcd54dbb-947c-4ccd-9bba-6ebb462b0282 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee" status: 200 len: 1318 microversion: 2.1 time: 0.643771 May 28 05:10:01.713739 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3160/6203] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:10:01 2022] GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee => generated 1318 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:10:01.784242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-47d7dae0-6b61-4f5f-9516-df02e4bb7651 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:01.797812 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-47d7dae0-6b61-4f5f-9516-df02e4bb7651 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1230 microversion: 2.1 time: 0.285619 May 28 05:10:01.801105 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3044/6204] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:10:01 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1230 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:10:02.486734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f3a7b74e-22da-4b0c-947b-0c4d25a8e599 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:02.487580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f3a7b74e-22da-4b0c-947b-0c4d25a8e599 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:02.507279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f3a7b74e-22da-4b0c-947b-0c4d25a8e599 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:02.513542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f3a7b74e-22da-4b0c-947b-0c4d25a8e599 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:02.518471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f3a7b74e-22da-4b0c-947b-0c4d25a8e599 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:02.518471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f3a7b74e-22da-4b0c-947b-0c4d25a8e599 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:02.614438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-f84a8091-c712-4961-9a08-f4a3fd874d65 req-6cc3d7de-ae82-4885-9476-ca45b73eded0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "038f7c26-89d5-45e6-8122-bb601c3ca3ee", "tag": "753ba9de-76ea-4196-bb31-9ffad3026a32"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:10:02.643713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f84a8091-c712-4961-9a08-f4a3fd874d65 req-6cc3d7de-ae82-4885-9476-ca45b73eded0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:02.645634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f84a8091-c712-4961-9a08-f4a3fd874d65 req-6cc3d7de-ae82-4885-9476-ca45b73eded0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:02.720662 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-f84a8091-c712-4961-9a08-f4a3fd874d65 req-6cc3d7de-ae82-4885-9476-ca45b73eded0 service nova] Creating event network-changed:753ba9de-76ea-4196-bb31-9ffad3026a32 for instance 038f7c26-89d5-45e6-8122-bb601c3ca3ee on n-h1-843700-1 May 28 05:10:02.748126 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-f84a8091-c712-4961-9a08-f4a3fd874d65 req-6cc3d7de-ae82-4885-9476-ca45b73eded0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138107 May 28 05:10:02.752012 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3045/6205] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:10:02.781644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7a5f835b-d624-4cae-9f4c-94ac37498868 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:02.791652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7a5f835b-d624-4cae-9f4c-94ac37498868 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:02.831359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a5f835b-d624-4cae-9f4c-94ac37498868 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:02.841200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a5f835b-d624-4cae-9f4c-94ac37498868 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:02.843834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a5f835b-d624-4cae-9f4c-94ac37498868 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:02.849195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a5f835b-d624-4cae-9f4c-94ac37498868 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:03.181019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f3a7b74e-22da-4b0c-947b-0c4d25a8e599 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:03.201525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f3a7b74e-22da-4b0c-947b-0c4d25a8e599 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:03.204028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f3a7b74e-22da-4b0c-947b-0c4d25a8e599 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:03.205531 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f3a7b74e-22da-4b0c-947b-0c4d25a8e599 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.725217 May 28 05:10:03.206801 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3161/6206] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:10:02 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:10:03.220100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cd56a86a-8aa6-4cbb-b3e9-0dc6c55a4290 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:03.221040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cd56a86a-8aa6-4cbb-b3e9-0dc6c55a4290 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:03.235949 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cd56a86a-8aa6-4cbb-b3e9-0dc6c55a4290 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:03.237285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cd56a86a-8aa6-4cbb-b3e9-0dc6c55a4290 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:03.239426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cd56a86a-8aa6-4cbb-b3e9-0dc6c55a4290 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:03.241263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cd56a86a-8aa6-4cbb-b3e9-0dc6c55a4290 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:03.408937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cd56a86a-8aa6-4cbb-b3e9-0dc6c55a4290 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:03.421005 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cd56a86a-8aa6-4cbb-b3e9-0dc6c55a4290 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1230 microversion: 2.1 time: 0.212893 May 28 05:10:03.436401 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3162/6207] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:10:03 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1230 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:10:03.581298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7a5f835b-d624-4cae-9f4c-94ac37498868 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:03.591743 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7a5f835b-d624-4cae-9f4c-94ac37498868 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee" status: 200 len: 1318 microversion: 2.1 time: 0.837948 May 28 05:10:03.599681 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3046/6208] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:10:02 2022] GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee => generated 1318 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:10:04.229915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9d81b062-dee2-47a0-9fa1-fa972674894d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:04.231294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9d81b062-dee2-47a0-9fa1-fa972674894d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:04.244653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d81b062-dee2-47a0-9fa1-fa972674894d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:04.247621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d81b062-dee2-47a0-9fa1-fa972674894d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:04.251314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d81b062-dee2-47a0-9fa1-fa972674894d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:04.251984 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d81b062-dee2-47a0-9fa1-fa972674894d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:04.438060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3a6a93c4-3e39-4e62-b61e-d3405959348c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:04.438650 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3a6a93c4-3e39-4e62-b61e-d3405959348c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:04.441690 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:10:04.442482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:10:04.445419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9d81b062-dee2-47a0-9fa1-fa972674894d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:04.454045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a6a93c4-3e39-4e62-b61e-d3405959348c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:04.454591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a6a93c4-3e39-4e62-b61e-d3405959348c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:04.455484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a6a93c4-3e39-4e62-b61e-d3405959348c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:04.457197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9d81b062-dee2-47a0-9fa1-fa972674894d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:04.457799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a6a93c4-3e39-4e62-b61e-d3405959348c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:04.459511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9d81b062-dee2-47a0-9fa1-fa972674894d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:04.461486 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9d81b062-dee2-47a0-9fa1-fa972674894d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.236579 May 28 05:10:04.462585 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3163/6209] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:10:04 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:10:04.547800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3a6a93c4-3e39-4e62-b61e-d3405959348c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:04.559130 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3a6a93c4-3e39-4e62-b61e-d3405959348c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1230 microversion: 2.1 time: 0.124933 May 28 05:10:04.571086 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3047/6210] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:10:04 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1230 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:10:04.608945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-801aab21-f529-4699-81c5-e5f6c536b244 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:04.614644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-801aab21-f529-4699-81c5-e5f6c536b244 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:04.617993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:10:04.620810 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-801aab21-f529-4699-81c5-e5f6c536b244 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:04.621787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-801aab21-f529-4699-81c5-e5f6c536b244 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:04.622801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-801aab21-f529-4699-81c5-e5f6c536b244 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:04.623463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-801aab21-f529-4699-81c5-e5f6c536b244 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:04.785916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-801aab21-f529-4699-81c5-e5f6c536b244 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:04.794072 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-801aab21-f529-4699-81c5-e5f6c536b244 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee" status: 200 len: 1318 microversion: 2.1 time: 0.189106 May 28 05:10:04.796051 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3164/6211] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:10:04 2022] GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:10:05.482296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5068e0d1-4080-45e4-b069-bb9e4faff00c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:05.483717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5068e0d1-4080-45e4-b069-bb9e4faff00c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:05.507442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5068e0d1-4080-45e4-b069-bb9e4faff00c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:05.507442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5068e0d1-4080-45e4-b069-bb9e4faff00c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:05.507442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5068e0d1-4080-45e4-b069-bb9e4faff00c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:05.512828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5068e0d1-4080-45e4-b069-bb9e4faff00c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:05.576782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e3459249-f8c5-4683-8da2-6d18eac259bd tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:05.577396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e3459249-f8c5-4683-8da2-6d18eac259bd tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:05.584339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:10:05.607319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3459249-f8c5-4683-8da2-6d18eac259bd tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:05.607782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3459249-f8c5-4683-8da2-6d18eac259bd tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:05.608708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3459249-f8c5-4683-8da2-6d18eac259bd tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:05.609151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e3459249-f8c5-4683-8da2-6d18eac259bd tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:05.871044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e3459249-f8c5-4683-8da2-6d18eac259bd tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:05.886321 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e3459249-f8c5-4683-8da2-6d18eac259bd tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1230 microversion: 2.1 time: 0.313650 May 28 05:10:05.889531 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3165/6212] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:10:05 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1230 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:10:05.903843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a733518e-37e2-47d1-80ce-cb979832b5c9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:05.905747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a733518e-37e2-47d1-80ce-cb979832b5c9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:05.919956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5068e0d1-4080-45e4-b069-bb9e4faff00c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:05.920701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a733518e-37e2-47d1-80ce-cb979832b5c9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:05.921268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a733518e-37e2-47d1-80ce-cb979832b5c9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:05.922140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a733518e-37e2-47d1-80ce-cb979832b5c9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:05.922688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a733518e-37e2-47d1-80ce-cb979832b5c9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:05.931914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5068e0d1-4080-45e4-b069-bb9e4faff00c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:05.935659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5068e0d1-4080-45e4-b069-bb9e4faff00c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:05.937847 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5068e0d1-4080-45e4-b069-bb9e4faff00c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.460355 May 28 05:10:05.940105 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3048/6213] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:10:05 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:10:06.140312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a733518e-37e2-47d1-80ce-cb979832b5c9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:06.142751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:10:06.151883 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a733518e-37e2-47d1-80ce-cb979832b5c9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee" status: 200 len: 1318 microversion: 2.1 time: 0.259504 May 28 05:10:06.156131 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3166/6214] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:10:05 2022] GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:10:06.906558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f84f1182-9cdd-4317-be76-7a2c5054ba5c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:06.907491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f84f1182-9cdd-4317-be76-7a2c5054ba5c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:06.917536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f84f1182-9cdd-4317-be76-7a2c5054ba5c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:06.923809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f84f1182-9cdd-4317-be76-7a2c5054ba5c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:06.924846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f84f1182-9cdd-4317-be76-7a2c5054ba5c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:06.925487 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f84f1182-9cdd-4317-be76-7a2c5054ba5c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:06.957689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7af29b7b-6f37-488d-ae91-bd92b52144d2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:06.959033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7af29b7b-6f37-488d-ae91-bd92b52144d2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:06.972516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7af29b7b-6f37-488d-ae91-bd92b52144d2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:06.973844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7af29b7b-6f37-488d-ae91-bd92b52144d2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:06.978475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7af29b7b-6f37-488d-ae91-bd92b52144d2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:06.978880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7af29b7b-6f37-488d-ae91-bd92b52144d2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:07.041991 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f84f1182-9cdd-4317-be76-7a2c5054ba5c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:07.051274 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f84f1182-9cdd-4317-be76-7a2c5054ba5c tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1230 microversion: 2.1 time: 0.148739 May 28 05:10:07.061010 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3049/6215] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:10:06 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1230 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:10:07.171296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-10989d12-6285-4f7a-8a43-885fcd5aaeb1 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:07.172323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-10989d12-6285-4f7a-8a43-885fcd5aaeb1 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:07.190155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10989d12-6285-4f7a-8a43-885fcd5aaeb1 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:07.190608 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10989d12-6285-4f7a-8a43-885fcd5aaeb1 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:07.191431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10989d12-6285-4f7a-8a43-885fcd5aaeb1 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:07.191900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10989d12-6285-4f7a-8a43-885fcd5aaeb1 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:07.204786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7af29b7b-6f37-488d-ae91-bd92b52144d2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:07.223445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7af29b7b-6f37-488d-ae91-bd92b52144d2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:07.236305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7af29b7b-6f37-488d-ae91-bd92b52144d2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:07.237925 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7af29b7b-6f37-488d-ae91-bd92b52144d2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.284808 May 28 05:10:07.238708 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3167/6216] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:10:06 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:10:07.387161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-10989d12-6285-4f7a-8a43-885fcd5aaeb1 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:07.401058 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-10989d12-6285-4f7a-8a43-885fcd5aaeb1 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee" status: 200 len: 1318 microversion: 2.1 time: 0.229984 May 28 05:10:07.406263 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3050/6217] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:10:07 2022] GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:10:08.068795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6edfe55e-65d7-4df7-9ced-c943eabe3f72 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:08.070566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6edfe55e-65d7-4df7-9ced-c943eabe3f72 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:08.077500 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6edfe55e-65d7-4df7-9ced-c943eabe3f72 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:08.078335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6edfe55e-65d7-4df7-9ced-c943eabe3f72 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:08.079436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6edfe55e-65d7-4df7-9ced-c943eabe3f72 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:08.080107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6edfe55e-65d7-4df7-9ced-c943eabe3f72 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:08.162628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6edfe55e-65d7-4df7-9ced-c943eabe3f72 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:08.178226 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6edfe55e-65d7-4df7-9ced-c943eabe3f72 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1230 microversion: 2.1 time: 0.113269 May 28 05:10:08.180641 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3168/6218] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:10:08 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1230 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:10:08.260119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-afe47339-7011-4823-b124-3e4c3b8e3399 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:08.262734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-afe47339-7011-4823-b124-3e4c3b8e3399 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:08.271087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-afe47339-7011-4823-b124-3e4c3b8e3399 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:08.271966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-afe47339-7011-4823-b124-3e4c3b8e3399 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:08.273090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-afe47339-7011-4823-b124-3e4c3b8e3399 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:08.273975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-afe47339-7011-4823-b124-3e4c3b8e3399 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:08.423765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dd4e73a4-3a8e-4433-bbcf-1fe65da54911 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:08.425352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dd4e73a4-3a8e-4433-bbcf-1fe65da54911 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:08.441679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd4e73a4-3a8e-4433-bbcf-1fe65da54911 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:08.442144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd4e73a4-3a8e-4433-bbcf-1fe65da54911 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:08.442950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd4e73a4-3a8e-4433-bbcf-1fe65da54911 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:08.443659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dd4e73a4-3a8e-4433-bbcf-1fe65da54911 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:08.502379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-afe47339-7011-4823-b124-3e4c3b8e3399 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:08.511405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-afe47339-7011-4823-b124-3e4c3b8e3399 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:08.513351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-afe47339-7011-4823-b124-3e4c3b8e3399 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:08.514554 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-afe47339-7011-4823-b124-3e4c3b8e3399 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.259677 May 28 05:10:08.515458 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3051/6219] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:10:08 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:10:08.610644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dd4e73a4-3a8e-4433-bbcf-1fe65da54911 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:08.621469 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dd4e73a4-3a8e-4433-bbcf-1fe65da54911 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee" status: 200 len: 1318 microversion: 2.1 time: 0.210660 May 28 05:10:08.632449 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3169/6220] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:10:08 2022] GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:10:09.197993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f32cbb07-2f67-4f5a-a2f2-8d25a164e96b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:09.199242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f32cbb07-2f67-4f5a-a2f2-8d25a164e96b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:09.209254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f32cbb07-2f67-4f5a-a2f2-8d25a164e96b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:09.210945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f32cbb07-2f67-4f5a-a2f2-8d25a164e96b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:09.212138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f32cbb07-2f67-4f5a-a2f2-8d25a164e96b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:09.213314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f32cbb07-2f67-4f5a-a2f2-8d25a164e96b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:09.278933 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f32cbb07-2f67-4f5a-a2f2-8d25a164e96b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:09.280051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f32cbb07-2f67-4f5a-a2f2-8d25a164e96b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:09.280539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-f32cbb07-2f67-4f5a-a2f2-8d25a164e96b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lazy-loading 'fault' on Instance uuid c12106ac-a8a7-44cc-a111-c5599a29c137 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:10:09.340164 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f32cbb07-2f67-4f5a-a2f2-8d25a164e96b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e045790caa7421b86d3d3a8075cdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7216e0203810449f94f6da658c532406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:09.348859 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f32cbb07-2f67-4f5a-a2f2-8d25a164e96b tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 200 len: 1235 microversion: 2.1 time: 0.156652 May 28 05:10:09.349448 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3052/6221] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:10:09 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 1235 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:10:09.535110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-215776da-f704-425b-adf9-e97b2e6456ea tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:09.536439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-215776da-f704-425b-adf9-e97b2e6456ea tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:09.576324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-215776da-f704-425b-adf9-e97b2e6456ea tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:09.577280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-215776da-f704-425b-adf9-e97b2e6456ea tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:09.580188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-215776da-f704-425b-adf9-e97b2e6456ea tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:09.583117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-215776da-f704-425b-adf9-e97b2e6456ea tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:09.637647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9e54a864-b9a2-412e-8b3d-93e2e148c726 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:09.638272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9e54a864-b9a2-412e-8b3d-93e2e148c726 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:09.650843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e54a864-b9a2-412e-8b3d-93e2e148c726 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:09.651584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e54a864-b9a2-412e-8b3d-93e2e148c726 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:09.652569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e54a864-b9a2-412e-8b3d-93e2e148c726 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:09.653178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e54a864-b9a2-412e-8b3d-93e2e148c726 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:09.837050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-215776da-f704-425b-adf9-e97b2e6456ea tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:09.853940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-215776da-f704-425b-adf9-e97b2e6456ea tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:09.857647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-215776da-f704-425b-adf9-e97b2e6456ea tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:09.859239 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-215776da-f704-425b-adf9-e97b2e6456ea tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.329501 May 28 05:10:09.861663 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3170/6222] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:10:09 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:10:09.978497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9e54a864-b9a2-412e-8b3d-93e2e148c726 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:09.987395 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9e54a864-b9a2-412e-8b3d-93e2e148c726 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee" status: 200 len: 1318 microversion: 2.1 time: 0.353512 May 28 05:10:09.988721 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3053/6223] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:10:09 2022] GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:10:10.368317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-25d04040-e859-4a0f-a297-7187151d0006 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:10.369049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-25d04040-e859-4a0f-a297-7187151d0006 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] [instance: c12106ac-a8a7-44cc-a111-c5599a29c137] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:10.375372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25d04040-e859-4a0f-a297-7187151d0006 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:10.375833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25d04040-e859-4a0f-a297-7187151d0006 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:10.376671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25d04040-e859-4a0f-a297-7187151d0006 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:10.377110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25d04040-e859-4a0f-a297-7187151d0006 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:10.391514 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-25d04040-e859-4a0f-a297-7187151d0006 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] HTTP exception thrown: Instance c12106ac-a8a7-44cc-a111-c5599a29c137 could not be found. May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-25d04040-e859-4a0f-a297-7187151d0006 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Request method failure captured: May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 HTTP/1.1 May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikazQB3BEs-x9uiHHefWhOoGK8CVMT1VOR4xTDKU9wt-Z-1CaQrjGWZzyUQGkCYY0M25vKwSePsn_pcb7SKUfOUdQFLf_E9L5D_npdUvQgji5J-Vu0-RoDmnTF5iusdPff-Kj_xlEdI2DJMIsEqr66XmY6aeGJUZckdKhK20joY7zGoY May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 7216e0203810449f94f6da658c532406 May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TestVolumeBackupRestore-866282257 May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7216e0203810449f94f6da658c532406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7216e0203810449f94f6da658c532406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7216e0203810449f94f6da658c532406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7216e0203810449f94f6da658c532406"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TestVolumeBackupRestore-866282257 May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 7216e0203810449f94f6da658c532406 May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TestVolumeBackupRestore-866282257 May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TestVolumeBackupRestore-866282257-project May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 2e045790caa7421b86d3d3a8075cdaa7 May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TestVolumeBackupRestore-866282257-project May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance c12106ac-a8a7-44cc-a111-c5599a29c137 could not be found. May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'c12106ac-a8a7-44cc-a111-c5599a29c137'} May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c12106ac-a8a7-44cc-a111-c5599a29c137 could not be found. May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c12106ac-a8a7-44cc-a111-c5599a29c137 could not be found. May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:10:10.393113 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:10:10.401781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:10:10.401781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:10:10.401781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:10:10.401781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:10:10.401781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:10:10.401781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c12106ac-a8a7-44cc-a111-c5599a29c137 could not be found. May 28 05:10:10.401781 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:10:10.401781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-25d04040-e859-4a0f-a297-7187151d0006 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Returning 404 to user: Instance c12106ac-a8a7-44cc-a111-c5599a29c137 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:10:10.401781 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-25d04040-e859-4a0f-a297-7187151d0006 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137" status: 404 len: 111 microversion: 2.1 time: 0.030833 May 28 05:10:10.401781 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3171/6224] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:10:10 2022] GET /compute/v2.1/servers/c12106ac-a8a7-44cc-a111-c5599a29c137 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:10:10.684226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-de4211ab-29e6-4128-8e21-68a974ec18e2 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] Calling method '.version_select at 0x7f77002cd430>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:10.826614 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-de4211ab-29e6-4128-8e21-68a974ec18e2 tempest-TestVolumeBackupRestore-866282257 tempest-TestVolumeBackupRestore-866282257-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2144436971" status: 202 len: 0 microversion: 2.1 time: 0.148043 May 28 05:10:10.827237 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3054/6225] 10.222.0.58 () {58 vars in 1268 bytes} [Sat May 28 05:10:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2144436971 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:10:10.878979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4e6fb6d1-5e3e-4fc1-9d36-245fc6a80385 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:10.880732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4e6fb6d1-5e3e-4fc1-9d36-245fc6a80385 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:10.893492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e6fb6d1-5e3e-4fc1-9d36-245fc6a80385 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:10.893956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e6fb6d1-5e3e-4fc1-9d36-245fc6a80385 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:10.896115 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e6fb6d1-5e3e-4fc1-9d36-245fc6a80385 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:10.896642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e6fb6d1-5e3e-4fc1-9d36-245fc6a80385 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:11.008867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-28108da3-c878-4a2c-90fa-378534173e46 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:11.009655 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-28108da3-c878-4a2c-90fa-378534173e46 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:11.018407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-28108da3-c878-4a2c-90fa-378534173e46 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:11.019038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-28108da3-c878-4a2c-90fa-378534173e46 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:11.020016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-28108da3-c878-4a2c-90fa-378534173e46 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:11.020541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-28108da3-c878-4a2c-90fa-378534173e46 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:11.046906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4e6fb6d1-5e3e-4fc1-9d36-245fc6a80385 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:11.059083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4e6fb6d1-5e3e-4fc1-9d36-245fc6a80385 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:11.059083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4e6fb6d1-5e3e-4fc1-9d36-245fc6a80385 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:11.059083 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4e6fb6d1-5e3e-4fc1-9d36-245fc6a80385 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.184126 May 28 05:10:11.059569 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3172/6226] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:10:10 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:10:11.183918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-28108da3-c878-4a2c-90fa-378534173e46 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:11.199169 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-28108da3-c878-4a2c-90fa-378534173e46 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee" status: 200 len: 1318 microversion: 2.1 time: 0.190311 May 28 05:10:11.199169 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3055/6227] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:10:10 2022] GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:10:11.702654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-9602600a-00aa-437b-8225-76a7015427c1 req-160007ec-4416-4cb4-ae0c-c36026a00169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038f7c26-89d5-45e6-8122-bb601c3ca3ee", "name": "network-vif-plugged", "status": "completed", "tag": "753ba9de-76ea-4196-bb31-9ffad3026a32"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:10:11.711923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-9602600a-00aa-437b-8225-76a7015427c1 req-160007ec-4416-4cb4-ae0c-c36026a00169 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:11.712381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-9602600a-00aa-437b-8225-76a7015427c1 req-160007ec-4416-4cb4-ae0c-c36026a00169 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:11.726730 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-9602600a-00aa-437b-8225-76a7015427c1 req-160007ec-4416-4cb4-ae0c-c36026a00169 service nova] Creating event network-vif-plugged:753ba9de-76ea-4196-bb31-9ffad3026a32 for instance 038f7c26-89d5-45e6-8122-bb601c3ca3ee on n-h1-843700-1 May 28 05:10:11.732188 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-9602600a-00aa-437b-8225-76a7015427c1 req-160007ec-4416-4cb4-ae0c-c36026a00169 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033706 May 28 05:10:11.733106 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3173/6228] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:10:12.078138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-78c3b698-ebb6-4dbe-a418-42591da1279b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:12.079441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-78c3b698-ebb6-4dbe-a418-42591da1279b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:12.086456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78c3b698-ebb6-4dbe-a418-42591da1279b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:12.087383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78c3b698-ebb6-4dbe-a418-42591da1279b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:12.088371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78c3b698-ebb6-4dbe-a418-42591da1279b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:12.089194 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78c3b698-ebb6-4dbe-a418-42591da1279b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:12.210464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-61f7650c-979d-4645-9763-1674b334828c tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:12.211960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-61f7650c-979d-4645-9763-1674b334828c tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:12.220278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-61f7650c-979d-4645-9763-1674b334828c tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:12.220974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-61f7650c-979d-4645-9763-1674b334828c tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:12.221928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-61f7650c-979d-4645-9763-1674b334828c tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:12.222577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-61f7650c-979d-4645-9763-1674b334828c tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:12.301815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-78c3b698-ebb6-4dbe-a418-42591da1279b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:12.324371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-78c3b698-ebb6-4dbe-a418-42591da1279b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:12.330566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-78c3b698-ebb6-4dbe-a418-42591da1279b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:12.331707 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-78c3b698-ebb6-4dbe-a418-42591da1279b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.257738 May 28 05:10:12.349391 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3056/6229] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:10:12 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:10:12.430485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-61f7650c-979d-4645-9763-1674b334828c tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:12.438917 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-61f7650c-979d-4645-9763-1674b334828c tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee" status: 200 len: 1318 microversion: 2.1 time: 0.233305 May 28 05:10:12.439941 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3174/6230] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:10:12 2022] GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:10:13.357306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-17f4939b-6b56-4e3e-9a83-63e86f1f321f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:13.359807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-17f4939b-6b56-4e3e-9a83-63e86f1f321f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:13.369459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17f4939b-6b56-4e3e-9a83-63e86f1f321f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:13.370219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17f4939b-6b56-4e3e-9a83-63e86f1f321f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:13.372003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17f4939b-6b56-4e3e-9a83-63e86f1f321f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:13.372967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17f4939b-6b56-4e3e-9a83-63e86f1f321f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:13.457879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e67a52ba-76a7-4d02-9f95-3a162f46d425 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:13.460310 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e67a52ba-76a7-4d02-9f95-3a162f46d425 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:13.468542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e67a52ba-76a7-4d02-9f95-3a162f46d425 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:13.469197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e67a52ba-76a7-4d02-9f95-3a162f46d425 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:13.470171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e67a52ba-76a7-4d02-9f95-3a162f46d425 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:13.471453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e67a52ba-76a7-4d02-9f95-3a162f46d425 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:13.665231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-17f4939b-6b56-4e3e-9a83-63e86f1f321f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:13.702214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e67a52ba-76a7-4d02-9f95-3a162f46d425 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:13.715331 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e67a52ba-76a7-4d02-9f95-3a162f46d425 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee" status: 200 len: 1507 microversion: 2.1 time: 0.261395 May 28 05:10:13.727392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-17f4939b-6b56-4e3e-9a83-63e86f1f321f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:13.729394 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3175/6231] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:10:13 2022] GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:10:13.729910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-17f4939b-6b56-4e3e-9a83-63e86f1f321f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:13.732465 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-17f4939b-6b56-4e3e-9a83-63e86f1f321f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.379109 May 28 05:10:13.734240 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3057/6232] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:10:13 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:10:13.757745 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c9a81c46-926e-4f1a-8b94-7d3e4ac964be tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b3a28e1-5cb1-45f1-a006-c94520e31e21", "device": "/dev/sdb"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:10:13.759262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c9a81c46-926e-4f1a-8b94-7d3e4ac964be tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:13.767384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9a81c46-926e-4f1a-8b94-7d3e4ac964be tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:13.768140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9a81c46-926e-4f1a-8b94-7d3e4ac964be tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:13.769070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9a81c46-926e-4f1a-8b94-7d3e4ac964be tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:13.769833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9a81c46-926e-4f1a-8b94-7d3e4ac964be tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:14.771176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b27117ae-730c-4abf-8281-f811fd24617b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:14.773021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b27117ae-730c-4abf-8281-f811fd24617b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:14.791952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b27117ae-730c-4abf-8281-f811fd24617b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:14.796804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b27117ae-730c-4abf-8281-f811fd24617b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:14.796804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b27117ae-730c-4abf-8281-f811fd24617b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:14.796804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b27117ae-730c-4abf-8281-f811fd24617b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:15.043025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b27117ae-730c-4abf-8281-f811fd24617b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:15.052462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b27117ae-730c-4abf-8281-f811fd24617b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:15.057426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b27117ae-730c-4abf-8281-f811fd24617b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:15.059983 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b27117ae-730c-4abf-8281-f811fd24617b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.309953 May 28 05:10:15.063886 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3058/6233] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:10:14 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:10:15.217217 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c9a81c46-926e-4f1a-8b94-7d3e4ac964be tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "POST /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.466574 May 28 05:10:15.257775 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3176/6234] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 05:10:13 2022] POST /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee/os-volume_attachments => generated 194 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:10:16.079050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a8535641-e7b0-4b57-a2b2-a81e01dc3f11 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:16.089285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a8535641-e7b0-4b57-a2b2-a81e01dc3f11 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:16.089285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a8535641-e7b0-4b57-a2b2-a81e01dc3f11 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:16.089285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a8535641-e7b0-4b57-a2b2-a81e01dc3f11 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:16.089285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a8535641-e7b0-4b57-a2b2-a81e01dc3f11 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:16.090328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a8535641-e7b0-4b57-a2b2-a81e01dc3f11 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:16.367992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a8535641-e7b0-4b57-a2b2-a81e01dc3f11 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:16.371634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a8535641-e7b0-4b57-a2b2-a81e01dc3f11 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:16.373421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a8535641-e7b0-4b57-a2b2-a81e01dc3f11 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:16.374847 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a8535641-e7b0-4b57-a2b2-a81e01dc3f11 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.299953 May 28 05:10:16.375957 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3059/6235] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:10:16 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:10:17.394359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-90985c5b-e1f0-483f-9644-27a4aa84e59b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:17.396462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-90985c5b-e1f0-483f-9644-27a4aa84e59b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:17.405090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90985c5b-e1f0-483f-9644-27a4aa84e59b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:17.405917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90985c5b-e1f0-483f-9644-27a4aa84e59b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:17.407035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90985c5b-e1f0-483f-9644-27a4aa84e59b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:17.407697 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90985c5b-e1f0-483f-9644-27a4aa84e59b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:17.698837 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-90985c5b-e1f0-483f-9644-27a4aa84e59b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:17.709038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-90985c5b-e1f0-483f-9644-27a4aa84e59b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:17.726793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-90985c5b-e1f0-483f-9644-27a4aa84e59b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:17.733214 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-90985c5b-e1f0-483f-9644-27a4aa84e59b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.338450 May 28 05:10:17.733214 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3177/6236] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:10:17 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:10:17.761968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-88f6ca47-f489-436c-bfe3-ca7363342925 req-f6c359f3-f332-4256-ad62-cb2a1531f3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334654f9-2ad8-4cef-b4e8-bf45eb69f937", "name": "network-vif-plugged", "status": "completed", "tag": "9efbcbd3-4d06-4190-8016-20cbfae73fe4"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:10:17.789573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-88f6ca47-f489-436c-bfe3-ca7363342925 req-f6c359f3-f332-4256-ad62-cb2a1531f3d9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:17.790358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-88f6ca47-f489-436c-bfe3-ca7363342925 req-f6c359f3-f332-4256-ad62-cb2a1531f3d9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:17.812740 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-88f6ca47-f489-436c-bfe3-ca7363342925 req-f6c359f3-f332-4256-ad62-cb2a1531f3d9 service nova] Creating event network-vif-plugged:9efbcbd3-4d06-4190-8016-20cbfae73fe4 for instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 on n-h1-843700-1 May 28 05:10:17.819872 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-88f6ca47-f489-436c-bfe3-ca7363342925 req-f6c359f3-f332-4256-ad62-cb2a1531f3d9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060877 May 28 05:10:17.820682 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3060/6237] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:10:18.749917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7f3ac2c4-a689-4197-a17e-77a8cd654f6b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:18.750658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7f3ac2c4-a689-4197-a17e-77a8cd654f6b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:18.764153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f3ac2c4-a689-4197-a17e-77a8cd654f6b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:18.764153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f3ac2c4-a689-4197-a17e-77a8cd654f6b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:18.767920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f3ac2c4-a689-4197-a17e-77a8cd654f6b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:18.768614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f3ac2c4-a689-4197-a17e-77a8cd654f6b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:19.037959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7f3ac2c4-a689-4197-a17e-77a8cd654f6b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:19.040186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7f3ac2c4-a689-4197-a17e-77a8cd654f6b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:19.042053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7f3ac2c4-a689-4197-a17e-77a8cd654f6b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:19.043794 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7f3ac2c4-a689-4197-a17e-77a8cd654f6b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.297781 May 28 05:10:19.045195 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3178/6238] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:10:18 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:10:20.063569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-27d1d88f-b033-42ef-bf2f-05e015c742c4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:20.064275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-27d1d88f-b033-42ef-bf2f-05e015c742c4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:20.089855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:10:20.091775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-27d1d88f-b033-42ef-bf2f-05e015c742c4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:20.092234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-27d1d88f-b033-42ef-bf2f-05e015c742c4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:20.093147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-27d1d88f-b033-42ef-bf2f-05e015c742c4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:20.093459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-27d1d88f-b033-42ef-bf2f-05e015c742c4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:20.398917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-27d1d88f-b033-42ef-bf2f-05e015c742c4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:20.410410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-27d1d88f-b033-42ef-bf2f-05e015c742c4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:20.412202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-27d1d88f-b033-42ef-bf2f-05e015c742c4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:20.415197 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-27d1d88f-b033-42ef-bf2f-05e015c742c4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.355964 May 28 05:10:20.427159 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3061/6239] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:10:20 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:10:21.435741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9243d151-2225-42cb-8df9-5f85edd17a45 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:21.446559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9243d151-2225-42cb-8df9-5f85edd17a45 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:21.471734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9243d151-2225-42cb-8df9-5f85edd17a45 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:21.477450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9243d151-2225-42cb-8df9-5f85edd17a45 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:21.481561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9243d151-2225-42cb-8df9-5f85edd17a45 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:21.482231 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9243d151-2225-42cb-8df9-5f85edd17a45 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:21.938728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9243d151-2225-42cb-8df9-5f85edd17a45 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:21.946057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9243d151-2225-42cb-8df9-5f85edd17a45 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:21.947882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9243d151-2225-42cb-8df9-5f85edd17a45 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:21.949303 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9243d151-2225-42cb-8df9-5f85edd17a45 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1809 microversion: 2.20 time: 0.518690 May 28 05:10:21.950460 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3179/6240] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:10:21 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1809 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:10:22.972293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-76dc8014-33ae-4fe4-ada1-46a001e3aff8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:22.975889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-76dc8014-33ae-4fe4-ada1-46a001e3aff8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:22.988544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76dc8014-33ae-4fe4-ada1-46a001e3aff8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:22.991507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76dc8014-33ae-4fe4-ada1-46a001e3aff8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:22.993307 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76dc8014-33ae-4fe4-ada1-46a001e3aff8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:22.993853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76dc8014-33ae-4fe4-ada1-46a001e3aff8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:23.196740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-76dc8014-33ae-4fe4-ada1-46a001e3aff8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:23.208383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-76dc8014-33ae-4fe4-ada1-46a001e3aff8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:23.211014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-76dc8014-33ae-4fe4-ada1-46a001e3aff8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:10:23.212593 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-76dc8014-33ae-4fe4-ada1-46a001e3aff8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1796 microversion: 2.20 time: 0.246680 May 28 05:10:23.230774 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3062/6241] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:10:22 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1796 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:10:55.982553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9062df50-c463-44d0-9b9c-80e867fdd314 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:55.986335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9062df50-c463-44d0-9b9c-80e867fdd314 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:55.998471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=51 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:10:56.000867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:10:56.018867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9062df50-c463-44d0-9b9c-80e867fdd314 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:56.020877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9062df50-c463-44d0-9b9c-80e867fdd314 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:56.025638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9062df50-c463-44d0-9b9c-80e867fdd314 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:56.027375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9062df50-c463-44d0-9b9c-80e867fdd314 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:56.129350 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9062df50-c463-44d0-9b9c-80e867fdd314 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments/15234513-8d1b-405c-b034-f0abb16ee100" status: 200 len: 194 microversion: 2.20 time: 0.154041 May 28 05:10:56.135630 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3180/6242] 10.222.0.58 () {60 vars in 1453 bytes} [Sat May 28 05:10:55 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments/15234513-8d1b-405c-b034-f0abb16ee100 => generated 194 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:10:56.265721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-68c4d6f1-068b-47bf-8175-7949d28c55cb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:56.266976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-68c4d6f1-068b-47bf-8175-7949d28c55cb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:56.277169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:10:56.282202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=79 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:10:56.282202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68c4d6f1-068b-47bf-8175-7949d28c55cb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:56.293850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68c4d6f1-068b-47bf-8175-7949d28c55cb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:56.299037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68c4d6f1-068b-47bf-8175-7949d28c55cb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:56.301438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68c4d6f1-068b-47bf-8175-7949d28c55cb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:56.462103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-68c4d6f1-068b-47bf-8175-7949d28c55cb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lazy-loading 'services' on Instance uuid 334654f9-2ad8-4cef-b4e8-bf45eb69f937 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:10:56.826838 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-68c4d6f1-068b-47bf-8175-7949d28c55cb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "DELETE /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments/15234513-8d1b-405c-b034-f0abb16ee100" status: 202 len: 0 microversion: 2.20 time: 0.557842 May 28 05:10:56.832138 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3063/6243] 10.222.0.58 () {60 vars in 1456 bytes} [Sat May 28 05:10:56 2022] DELETE /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments/15234513-8d1b-405c-b034-f0abb16ee100 => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 05:10:56.840609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8786a3f1-8406-4acb-b7da-e9b7c1f2d4ff tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:56.841611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8786a3f1-8406-4acb-b7da-e9b7c1f2d4ff tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:56.863636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8786a3f1-8406-4acb-b7da-e9b7c1f2d4ff tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:56.864102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8786a3f1-8406-4acb-b7da-e9b7c1f2d4ff tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:56.864899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8786a3f1-8406-4acb-b7da-e9b7c1f2d4ff tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:56.865947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8786a3f1-8406-4acb-b7da-e9b7c1f2d4ff tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:56.984857 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8786a3f1-8406-4acb-b7da-e9b7c1f2d4ff tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.148421 May 28 05:10:56.985461 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3181/6244] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 05:10:56 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 05:10:58.008012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3ddf46dc-e548-4b60-ab53-36173bf8aa4c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:58.015290 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3ddf46dc-e548-4b60-ab53-36173bf8aa4c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:58.033025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ddf46dc-e548-4b60-ab53-36173bf8aa4c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:58.044062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ddf46dc-e548-4b60-ab53-36173bf8aa4c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:58.047139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ddf46dc-e548-4b60-ab53-36173bf8aa4c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:58.056219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ddf46dc-e548-4b60-ab53-36173bf8aa4c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:58.148507 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3ddf46dc-e548-4b60-ab53-36173bf8aa4c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.154510 May 28 05:10:58.149026 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3064/6245] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 05:10:57 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:10:59.161030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5ca5e7a0-13d1-42d5-9481-d47dc991f3fb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:10:59.162511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5ca5e7a0-13d1-42d5-9481-d47dc991f3fb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:10:59.172003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ca5e7a0-13d1-42d5-9481-d47dc991f3fb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:59.174744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ca5e7a0-13d1-42d5-9481-d47dc991f3fb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:59.176224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ca5e7a0-13d1-42d5-9481-d47dc991f3fb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:10:59.176864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ca5e7a0-13d1-42d5-9481-d47dc991f3fb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:10:59.224200 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5ca5e7a0-13d1-42d5-9481-d47dc991f3fb tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067864 May 28 05:10:59.226473 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3182/6246] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 05:10:59 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:11:00.237941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-549c9392-e8b2-4bde-8094-b3e0432c2733 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:00.238870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-549c9392-e8b2-4bde-8094-b3e0432c2733 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:00.257093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-549c9392-e8b2-4bde-8094-b3e0432c2733 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:00.257559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-549c9392-e8b2-4bde-8094-b3e0432c2733 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:00.258354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-549c9392-e8b2-4bde-8094-b3e0432c2733 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:00.272467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-549c9392-e8b2-4bde-8094-b3e0432c2733 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:00.322673 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-549c9392-e8b2-4bde-8094-b3e0432c2733 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088611 May 28 05:11:00.324453 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3065/6247] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 05:11:00 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:11:00.878564 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2b9d9a3c-67fe-4b22-a8b2-6e1af849155c tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:00.879699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2b9d9a3c-67fe-4b22-a8b2-6e1af849155c tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:00.902932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b9d9a3c-67fe-4b22-a8b2-6e1af849155c tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:00.903689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b9d9a3c-67fe-4b22-a8b2-6e1af849155c tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:00.904644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b9d9a3c-67fe-4b22-a8b2-6e1af849155c tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:00.905253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b9d9a3c-67fe-4b22-a8b2-6e1af849155c tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:01.154005 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-2b9d9a3c-67fe-4b22-a8b2-6e1af849155c tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lazy-loading 'services' on Instance uuid 038f7c26-89d5-45e6-8122-bb601c3ca3ee {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:11:01.334635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5416b1c2-6cce-46a0-8236-a49684ae004d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:01.342080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5416b1c2-6cce-46a0-8236-a49684ae004d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:01.352403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5416b1c2-6cce-46a0-8236-a49684ae004d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:01.352866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5416b1c2-6cce-46a0-8236-a49684ae004d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:01.353691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5416b1c2-6cce-46a0-8236-a49684ae004d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:01.354139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5416b1c2-6cce-46a0-8236-a49684ae004d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:01.418785 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5416b1c2-6cce-46a0-8236-a49684ae004d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087849 May 28 05:11:01.419450 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3066/6248] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 05:11:01 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 05:11:01.477605 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2b9d9a3c-67fe-4b22-a8b2-6e1af849155c tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "DELETE /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee/os-volume_attachments/0b3a28e1-5cb1-45f1-a006-c94520e31e21" status: 202 len: 0 microversion: 2.1 time: 0.605315 May 28 05:11:01.478837 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3183/6249] 10.222.0.58 () {58 vars in 1415 bytes} [Sat May 28 05:11:00 2022] DELETE /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee/os-volume_attachments/0b3a28e1-5cb1-45f1-a006-c94520e31e21 => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:11:02.430939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2d977031-373c-40b5-a663-4f4d8d09d38a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:02.432043 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2d977031-373c-40b5-a663-4f4d8d09d38a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:02.441563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d977031-373c-40b5-a663-4f4d8d09d38a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:02.443877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d977031-373c-40b5-a663-4f4d8d09d38a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:02.444912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d977031-373c-40b5-a663-4f4d8d09d38a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:02.452503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d977031-373c-40b5-a663-4f4d8d09d38a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:02.513967 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2d977031-373c-40b5-a663-4f4d8d09d38a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087632 May 28 05:11:02.518189 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3067/6250] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 05:11:02 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:11:03.527937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-60788288-de88-4d0a-946c-30cba0b64ddc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:03.528958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-60788288-de88-4d0a-946c-30cba0b64ddc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:03.536026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60788288-de88-4d0a-946c-30cba0b64ddc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:03.536478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60788288-de88-4d0a-946c-30cba0b64ddc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:03.537840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60788288-de88-4d0a-946c-30cba0b64ddc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:03.538275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60788288-de88-4d0a-946c-30cba0b64ddc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:03.570666 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-60788288-de88-4d0a-946c-30cba0b64ddc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048024 May 28 05:11:03.571523 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3184/6251] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 05:11:03 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:11:04.583440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-338f7da0-28c8-4302-9096-0fcbe456e3df tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:04.585611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-338f7da0-28c8-4302-9096-0fcbe456e3df tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:04.596095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-338f7da0-28c8-4302-9096-0fcbe456e3df tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:04.596701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-338f7da0-28c8-4302-9096-0fcbe456e3df tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:04.597509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-338f7da0-28c8-4302-9096-0fcbe456e3df tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:04.597956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-338f7da0-28c8-4302-9096-0fcbe456e3df tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:04.630022 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-338f7da0-28c8-4302-9096-0fcbe456e3df tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051989 May 28 05:11:04.634622 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3068/6252] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 05:11:04 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:11:05.642138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e11faedc-8ff4-4227-9aa0-1c19f33cb311 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:05.643159 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e11faedc-8ff4-4227-9aa0-1c19f33cb311 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:05.650899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e11faedc-8ff4-4227-9aa0-1c19f33cb311 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:05.651382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e11faedc-8ff4-4227-9aa0-1c19f33cb311 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:05.652350 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e11faedc-8ff4-4227-9aa0-1c19f33cb311 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:05.652791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e11faedc-8ff4-4227-9aa0-1c19f33cb311 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:05.683523 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e11faedc-8ff4-4227-9aa0-1c19f33cb311 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045374 May 28 05:11:05.684094 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3185/6253] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 05:11:05 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 05:11:06.696209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a12cf5ab-5d72-4732-a37f-cd4fbb1ec152 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:06.697201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a12cf5ab-5d72-4732-a37f-cd4fbb1ec152 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:06.704692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a12cf5ab-5d72-4732-a37f-cd4fbb1ec152 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:06.705399 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a12cf5ab-5d72-4732-a37f-cd4fbb1ec152 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:06.706269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a12cf5ab-5d72-4732-a37f-cd4fbb1ec152 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:06.706834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a12cf5ab-5d72-4732-a37f-cd4fbb1ec152 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:06.736957 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a12cf5ab-5d72-4732-a37f-cd4fbb1ec152 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045430 May 28 05:11:06.741668 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3069/6254] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 05:11:06 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:11:07.749614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1710f2d3-5583-4277-ba8e-5de4772ad99e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:07.750765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1710f2d3-5583-4277-ba8e-5de4772ad99e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:07.757930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1710f2d3-5583-4277-ba8e-5de4772ad99e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:07.758515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1710f2d3-5583-4277-ba8e-5de4772ad99e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:07.759621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1710f2d3-5583-4277-ba8e-5de4772ad99e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:07.760182 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1710f2d3-5583-4277-ba8e-5de4772ad99e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:07.794019 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1710f2d3-5583-4277-ba8e-5de4772ad99e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048482 May 28 05:11:07.794662 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3186/6255] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 05:11:07 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:11:08.805400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9d63ce93-51e3-4072-a38d-33e00d0082e6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:08.807517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9d63ce93-51e3-4072-a38d-33e00d0082e6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:08.815586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d63ce93-51e3-4072-a38d-33e00d0082e6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:08.816543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d63ce93-51e3-4072-a38d-33e00d0082e6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:08.817571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d63ce93-51e3-4072-a38d-33e00d0082e6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:08.818675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d63ce93-51e3-4072-a38d-33e00d0082e6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:08.854470 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9d63ce93-51e3-4072-a38d-33e00d0082e6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053115 May 28 05:11:08.855160 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3070/6256] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 05:11:08 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:11:09.522046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d8ec142c-c9a9-4d5f-88e0-b7b9576a4d70 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:09.524101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d8ec142c-c9a9-4d5f-88e0-b7b9576a4d70 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:09.537632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8ec142c-c9a9-4d5f-88e0-b7b9576a4d70 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:09.538456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8ec142c-c9a9-4d5f-88e0-b7b9576a4d70 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:09.542517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8ec142c-c9a9-4d5f-88e0-b7b9576a4d70 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:09.543325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8ec142c-c9a9-4d5f-88e0-b7b9576a4d70 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:09.596138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d8ec142c-c9a9-4d5f-88e0-b7b9576a4d70 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:11:09.966756 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d8ec142c-c9a9-4d5f-88e0-b7b9576a4d70 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "DELETE /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 204 len: 0 microversion: 2.20 time: 0.447845 May 28 05:11:09.967737 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3187/6257] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 05:11:09 2022] DELETE /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 05:11:09.976236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9d5ade2e-40cf-4278-9148-f3f983fe9a9e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:09.976940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9d5ade2e-40cf-4278-9148-f3f983fe9a9e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:09.994938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d5ade2e-40cf-4278-9148-f3f983fe9a9e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:09.995455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d5ade2e-40cf-4278-9148-f3f983fe9a9e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:09.996266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d5ade2e-40cf-4278-9148-f3f983fe9a9e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:09.996715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d5ade2e-40cf-4278-9148-f3f983fe9a9e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:10.259913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9d5ade2e-40cf-4278-9148-f3f983fe9a9e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:10.268273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9d5ade2e-40cf-4278-9148-f3f983fe9a9e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:10.269807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9d5ade2e-40cf-4278-9148-f3f983fe9a9e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:10.271574 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9d5ade2e-40cf-4278-9148-f3f983fe9a9e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1724 microversion: 2.20 time: 0.298892 May 28 05:11:10.272539 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3071/6258] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:11:09 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:11:11.291014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-85cf9c45-276d-4d2b-b741-8125974ae692 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:11.291649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-85cf9c45-276d-4d2b-b741-8125974ae692 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:11.299500 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-85cf9c45-276d-4d2b-b741-8125974ae692 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:11.300185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-85cf9c45-276d-4d2b-b741-8125974ae692 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:11.301138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-85cf9c45-276d-4d2b-b741-8125974ae692 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:11.301743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-85cf9c45-276d-4d2b-b741-8125974ae692 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:11.531846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-85cf9c45-276d-4d2b-b741-8125974ae692 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:11.549321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-85cf9c45-276d-4d2b-b741-8125974ae692 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:11.559739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-85cf9c45-276d-4d2b-b741-8125974ae692 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:11.563203 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-85cf9c45-276d-4d2b-b741-8125974ae692 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1724 microversion: 2.20 time: 0.277062 May 28 05:11:11.566879 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3188/6259] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:11:11 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:11:12.527776 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:11:12.528350 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 05:11:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:11:12.585314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-96250da0-bba9-42ae-95dd-c976ea3a30ee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:12.585945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-96250da0-bba9-42ae-95dd-c976ea3a30ee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:12.596330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-96250da0-bba9-42ae-95dd-c976ea3a30ee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:12.596788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-96250da0-bba9-42ae-95dd-c976ea3a30ee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:12.600597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-96250da0-bba9-42ae-95dd-c976ea3a30ee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:12.604165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-96250da0-bba9-42ae-95dd-c976ea3a30ee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:12.912664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-96250da0-bba9-42ae-95dd-c976ea3a30ee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:12.930583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-96250da0-bba9-42ae-95dd-c976ea3a30ee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:12.937220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-96250da0-bba9-42ae-95dd-c976ea3a30ee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:12.941097 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-96250da0-bba9-42ae-95dd-c976ea3a30ee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1657 microversion: 2.20 time: 0.359766 May 28 05:11:12.941707 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3072/6260] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:11:12 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1657 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:11:13.217747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-458d516c-f49a-4616-a865-037f4fb1106e req-8ccbb0b2-9a66-42d6-8811-f97d7444100a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334654f9-2ad8-4cef-b4e8-bf45eb69f937", "name": "network-vif-deleted", "tag": "9efbcbd3-4d06-4190-8016-20cbfae73fe4"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:11:13.235745 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-458d516c-f49a-4616-a865-037f4fb1106e req-8ccbb0b2-9a66-42d6-8811-f97d7444100a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:13.240685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-458d516c-f49a-4616-a865-037f4fb1106e req-8ccbb0b2-9a66-42d6-8811-f97d7444100a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:13.265956 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-458d516c-f49a-4616-a865-037f4fb1106e req-8ccbb0b2-9a66-42d6-8811-f97d7444100a service nova] Creating event network-vif-deleted:9efbcbd3-4d06-4190-8016-20cbfae73fe4 for instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 on n-h1-843700-1 May 28 05:11:13.276139 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-458d516c-f49a-4616-a865-037f4fb1106e req-8ccbb0b2-9a66-42d6-8811-f97d7444100a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060114 May 28 05:11:13.277401 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3189/6261] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:11:13.961543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eabc82a5-0063-44f1-b70c-513942491788 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:13.967100 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eabc82a5-0063-44f1-b70c-513942491788 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:13.982746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eabc82a5-0063-44f1-b70c-513942491788 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:13.984180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eabc82a5-0063-44f1-b70c-513942491788 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:13.985576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eabc82a5-0063-44f1-b70c-513942491788 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:13.988690 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eabc82a5-0063-44f1-b70c-513942491788 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:14.077600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eabc82a5-0063-44f1-b70c-513942491788 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:14.081542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eabc82a5-0063-44f1-b70c-513942491788 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:14.082193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-eabc82a5-0063-44f1-b70c-513942491788 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lazy-loading 'fault' on Instance uuid 334654f9-2ad8-4cef-b4e8-bf45eb69f937 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:11:14.181017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eabc82a5-0063-44f1-b70c-513942491788 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:14.194530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eabc82a5-0063-44f1-b70c-513942491788 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:14.202635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eabc82a5-0063-44f1-b70c-513942491788 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:14.204022 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eabc82a5-0063-44f1-b70c-513942491788 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 200 len: 1371 microversion: 2.20 time: 0.247447 May 28 05:11:14.204608 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3073/6262] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:11:13 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:11:15.238015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ffe85fe0-0864-4a8d-b83d-b4d1416d2821 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:15.238807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ffe85fe0-0864-4a8d-b83d-b4d1416d2821 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:15.259626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ffe85fe0-0864-4a8d-b83d-b4d1416d2821 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:15.260088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ffe85fe0-0864-4a8d-b83d-b4d1416d2821 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:15.260879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ffe85fe0-0864-4a8d-b83d-b4d1416d2821 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:15.261322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ffe85fe0-0864-4a8d-b83d-b4d1416d2821 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:15.287294 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-ffe85fe0-0864-4a8d-b83d-b4d1416d2821 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] HTTP exception thrown: Instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 could not be found. May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ffe85fe0-0864-4a8d-b83d-b4d1416d2821 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Request method failure captured: May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 HTTP/1.1 May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABika4HRAt51MepdVqeqitZHJxFBdujD3Iq_iTBBRhxUxRYc5RHtx-gWaIhwF4x6CpEY2qk8Vu3iSoSw70i7KPkat47IrQRS-xQMhLSpn6dBapbTlfPydWJR0HQwfIlXMQyZT3r3numa2ETn7yh4TMkiOmGrKGNvBzEYd_M7lWyAlfB46U May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-Openstack-Nova-Api-Version: 2.20 May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: ecff011ab9254460a5f9d4c27f1b1932 May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1819630171 May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1819630171 May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: ecff011ab9254460a5f9d4c27f1b1932 May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1819630171 May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AttachVolumeShelveTestJSON-1819630171-project May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 72e4a9ee07a848248029dfa7bf78192c May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1819630171-project May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 could not be found. May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '334654f9-2ad8-4cef-b4e8-bf45eb69f937'} May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 could not be found. May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 could not be found. May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:11:15.289522 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:11:15.294128 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:11:15.294128 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:11:15.294128 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:11:15.294128 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:11:15.294128 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:11:15.294128 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:11:15.294128 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 could not be found. May 28 05:11:15.294128 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:11:15.294128 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ffe85fe0-0864-4a8d-b83d-b4d1416d2821 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Returning 404 to user: Instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:11:15.294128 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ffe85fe0-0864-4a8d-b83d-b4d1416d2821 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 404 len: 111 microversion: 2.20 time: 0.074423 May 28 05:11:15.296391 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3190/6263] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:11:15 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 05:11:15.310686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-503bef08-9f20-401a-8458-4b0eb639066d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '.version_select at 0x7f77002cdb80>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:15.409249 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-503bef08-9f20-401a-8458-4b0eb639066d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-751984870" status: 204 len: 0 microversion: 2.20 time: 0.107245 May 28 05:11:15.413767 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3074/6264] 10.222.0.58 () {60 vars in 1258 bytes} [Sat May 28 05:11:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-751984870 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 05:11:16.835314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9e5ccff6-ceb9-41d4-9f85-70ca673b9039 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Action: 'create', calling method: .version_select at 0x7f770207dd30>, body: {"keypair": {"name": "tempest-keypair-198925294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpa/fQKQ0PHT+byBYBeXLMG+lZyznnfISsLSP2/AVXwtIzEPdoHsuC6XKUU8OelChgj1xAsL7lE+nMOHWHJ/Vfsj8KgznbnomkbqEhuAAZPSWkqvXNgwh9ZhmS0MK0l/Q=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:11:16.864352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-9e5ccff6-ceb9-41d4-9f85-70ca673b9039 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Getting quotas for project ecff011ab9254460a5f9d4c27f1b1932. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:11:16.887455 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-9e5ccff6-ceb9-41d4-9f85-70ca673b9039 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Getting quotas for user 72e4a9ee07a848248029dfa7bf78192c and project ecff011ab9254460a5f9d4c27f1b1932. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:11:17.066715 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9e5ccff6-ceb9-41d4-9f85-70ca673b9039 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.239840 May 28 05:11:17.067294 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3191/6265] 10.222.0.58 () {62 vars in 1199 bytes} [Sat May 28 05:11:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 242 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 28 05:11:20.357672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-37f1a2a2-3ac6-4440-8b66-28bd47223488 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-665658227", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0740421f-fd38-4d67-bd2f-b0385e3493a3"}], "security_groups": [{"name": "tempest-securitygroup--852919913"}], "key_name": "tempest-keypair-198925294", "user_data": "}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:11:20.482374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-37f1a2a2-3ac6-4440-8b66-28bd47223488 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] validate_networks() for [('0740421f-fd38-4d67-bd2f-b0385e3493a3', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:11:21.061461 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-37f1a2a2-3ac6-4440-8b66-28bd47223488 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:11:21.062244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-37f1a2a2-3ac6-4440-8b66-28bd47223488 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:11:21.062883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-37f1a2a2-3ac6-4440-8b66-28bd47223488 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:11:21.063503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-37f1a2a2-3ac6-4440-8b66-28bd47223488 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:11:21.073216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-37f1a2a2-3ac6-4440-8b66-28bd47223488 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:11:21.073836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-37f1a2a2-3ac6-4440-8b66-28bd47223488 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:21.074481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-37f1a2a2-3ac6-4440-8b66-28bd47223488 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:21.075637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-37f1a2a2-3ac6-4440-8b66-28bd47223488 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:21.076432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-37f1a2a2-3ac6-4440-8b66-28bd47223488 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:21.095673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-37f1a2a2-3ac6-4440-8b66-28bd47223488 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Getting quotas for project ecff011ab9254460a5f9d4c27f1b1932. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:11:21.101537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-37f1a2a2-3ac6-4440-8b66-28bd47223488 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Getting quotas for user 72e4a9ee07a848248029dfa7bf78192c and project ecff011ab9254460a5f9d4c27f1b1932. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:11:21.122187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-37f1a2a2-3ac6-4440-8b66-28bd47223488 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:11:21.130761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-37f1a2a2-3ac6-4440-8b66-28bd47223488 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:11:21.226351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-670b07eb-b486-49f0-b625-3cdba3481e91 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:21.227442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-670b07eb-b486-49f0-b625-3cdba3481e91 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:21.236844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-670b07eb-b486-49f0-b625-3cdba3481e91 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:21.237581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-670b07eb-b486-49f0-b625-3cdba3481e91 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:21.238892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-670b07eb-b486-49f0-b625-3cdba3481e91 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:21.240129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-670b07eb-b486-49f0-b625-3cdba3481e91 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:21.279001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-670b07eb-b486-49f0-b625-3cdba3481e91 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:11:21.299863 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-37f1a2a2-3ac6-4440-8b66-28bd47223488 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.948201 May 28 05:11:21.313035 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3075/6266] 10.222.0.58 () {62 vars in 1187 bytes} [Sat May 28 05:11:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 05:11:21.319760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53b2224b-eeec-4528-ba69-62d5e3c9f6ca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:21.319760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-53b2224b-eeec-4528-ba69-62d5e3c9f6ca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:21.444125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-53b2224b-eeec-4528-ba69-62d5e3c9f6ca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:21.458365 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-53b2224b-eeec-4528-ba69-62d5e3c9f6ca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:21.459333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-53b2224b-eeec-4528-ba69-62d5e3c9f6ca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:21.464637 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-53b2224b-eeec-4528-ba69-62d5e3c9f6ca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1280 microversion: 2.20 time: 0.146579 May 28 05:11:21.465736 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3076/6267] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:11:21 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1280 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:11:21.785157 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-670b07eb-b486-49f0-b625-3cdba3481e91 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "DELETE /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee" status: 204 len: 0 microversion: 2.1 time: 0.562384 May 28 05:11:21.786223 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3192/6268] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:11:21 2022] DELETE /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee => generated 0 bytes in 564 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 05:11:21.795673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b440d000-a74c-4dd8-bb74-28d851a8e270 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:21.796481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b440d000-a74c-4dd8-bb74-28d851a8e270 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:21.815224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b440d000-a74c-4dd8-bb74-28d851a8e270 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:21.816122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b440d000-a74c-4dd8-bb74-28d851a8e270 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:21.817813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b440d000-a74c-4dd8-bb74-28d851a8e270 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:21.818931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b440d000-a74c-4dd8-bb74-28d851a8e270 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:22.045119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b440d000-a74c-4dd8-bb74-28d851a8e270 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:22.059925 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b440d000-a74c-4dd8-bb74-28d851a8e270 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee" status: 200 len: 1513 microversion: 2.1 time: 0.268585 May 28 05:11:22.070529 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3077/6269] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:11:21 2022] GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee => generated 1513 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:11:22.482693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6cb229fa-6a84-47e6-b940-d92311a197cf tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:22.487647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6cb229fa-6a84-47e6-b940-d92311a197cf tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:22.575087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6cb229fa-6a84-47e6-b940-d92311a197cf tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:22.600887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6cb229fa-6a84-47e6-b940-d92311a197cf tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:22.600887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6cb229fa-6a84-47e6-b940-d92311a197cf tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:22.600887 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6cb229fa-6a84-47e6-b940-d92311a197cf tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1280 microversion: 2.20 time: 0.120917 May 28 05:11:22.609859 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3193/6270] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:11:22 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1280 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:11:23.080748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-98b9b5af-64be-4b8d-b344-145b963b7f50 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:23.081492 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-98b9b5af-64be-4b8d-b344-145b963b7f50 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:23.090762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98b9b5af-64be-4b8d-b344-145b963b7f50 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:23.091566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98b9b5af-64be-4b8d-b344-145b963b7f50 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:23.092811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98b9b5af-64be-4b8d-b344-145b963b7f50 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:23.093473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98b9b5af-64be-4b8d-b344-145b963b7f50 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:23.412048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-98b9b5af-64be-4b8d-b344-145b963b7f50 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:23.428788 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-98b9b5af-64be-4b8d-b344-145b963b7f50 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee" status: 200 len: 1513 microversion: 2.1 time: 0.353954 May 28 05:11:23.435930 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3078/6271] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:11:23 2022] GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee => generated 1513 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:11:23.618616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-546a1b85-6bdb-40c5-ba21-39f9ef4a7748 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:23.619588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-546a1b85-6bdb-40c5-ba21-39f9ef4a7748 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:23.629032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-546a1b85-6bdb-40c5-ba21-39f9ef4a7748 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:23.632793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-546a1b85-6bdb-40c5-ba21-39f9ef4a7748 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:23.632793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-546a1b85-6bdb-40c5-ba21-39f9ef4a7748 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:23.633954 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-546a1b85-6bdb-40c5-ba21-39f9ef4a7748 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:23.771454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-546a1b85-6bdb-40c5-ba21-39f9ef4a7748 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:23.785370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-546a1b85-6bdb-40c5-ba21-39f9ef4a7748 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:23.789695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-546a1b85-6bdb-40c5-ba21-39f9ef4a7748 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:23.789695 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-546a1b85-6bdb-40c5-ba21-39f9ef4a7748 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1332 microversion: 2.20 time: 0.174300 May 28 05:11:23.789695 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3194/6272] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:11:23 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1332 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:11:24.163660 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-4a0a0bb7-dd4a-4e75-8b84-3061c73c4b00 req-8a154edc-5f41-435e-9bf8-d17efb092d71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038f7c26-89d5-45e6-8122-bb601c3ca3ee", "name": "network-vif-deleted", "tag": "753ba9de-76ea-4196-bb31-9ffad3026a32"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:11:24.195036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4a0a0bb7-dd4a-4e75-8b84-3061c73c4b00 req-8a154edc-5f41-435e-9bf8-d17efb092d71 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:24.195036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4a0a0bb7-dd4a-4e75-8b84-3061c73c4b00 req-8a154edc-5f41-435e-9bf8-d17efb092d71 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:24.195036 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-4a0a0bb7-dd4a-4e75-8b84-3061c73c4b00 req-8a154edc-5f41-435e-9bf8-d17efb092d71 service nova] Creating event network-vif-deleted:753ba9de-76ea-4196-bb31-9ffad3026a32 for instance 038f7c26-89d5-45e6-8122-bb601c3ca3ee on n-h1-843700-1 May 28 05:11:24.195036 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-4a0a0bb7-dd4a-4e75-8b84-3061c73c4b00 req-8a154edc-5f41-435e-9bf8-d17efb092d71 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036488 May 28 05:11:24.195900 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3079/6273] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:11:24.446425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e2958d8d-de0c-42a4-af6b-d9ebd4424946 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:24.447331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e2958d8d-de0c-42a4-af6b-d9ebd4424946 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:24.458926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2958d8d-de0c-42a4-af6b-d9ebd4424946 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:24.467017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2958d8d-de0c-42a4-af6b-d9ebd4424946 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:24.467880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2958d8d-de0c-42a4-af6b-d9ebd4424946 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:24.468337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2958d8d-de0c-42a4-af6b-d9ebd4424946 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:24.603855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e2958d8d-de0c-42a4-af6b-d9ebd4424946 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0313b050ae35491e830a4adce40453ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3833032727344d68b18149e6fdc20bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:24.608972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:11:24.613966 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e2958d8d-de0c-42a4-af6b-d9ebd4424946 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee" status: 200 len: 1303 microversion: 2.1 time: 0.171927 May 28 05:11:24.618287 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3195/6274] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:11:24 2022] GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee => generated 1303 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:11:24.807069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4854afbe-a031-447c-81c6-c3c346adebab tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:24.807895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4854afbe-a031-447c-81c6-c3c346adebab tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:24.816730 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4854afbe-a031-447c-81c6-c3c346adebab tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:24.818061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4854afbe-a031-447c-81c6-c3c346adebab tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:24.818615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4854afbe-a031-447c-81c6-c3c346adebab tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:24.818615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4854afbe-a031-447c-81c6-c3c346adebab tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:24.903264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4854afbe-a031-447c-81c6-c3c346adebab tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:24.925561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4854afbe-a031-447c-81c6-c3c346adebab tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:24.930864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4854afbe-a031-447c-81c6-c3c346adebab tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:24.932050 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4854afbe-a031-447c-81c6-c3c346adebab tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1338 microversion: 2.20 time: 0.129932 May 28 05:11:24.935777 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3080/6275] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:11:24 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1338 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:11:25.644687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-127bdedb-2faf-4a96-b670-39800ac84bf9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:25.645633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-127bdedb-2faf-4a96-b670-39800ac84bf9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] [instance: 038f7c26-89d5-45e6-8122-bb601c3ca3ee] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:25.667846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-127bdedb-2faf-4a96-b670-39800ac84bf9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:25.670209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-127bdedb-2faf-4a96-b670-39800ac84bf9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:25.671075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-127bdedb-2faf-4a96-b670-39800ac84bf9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:25.671553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-127bdedb-2faf-4a96-b670-39800ac84bf9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-127bdedb-2faf-4a96-b670-39800ac84bf9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] HTTP exception thrown: Instance 038f7c26-89d5-45e6-8122-bb601c3ca3ee could not be found. May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-127bdedb-2faf-4a96-b670-39800ac84bf9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Request method failure captured: May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee HTTP/1.1 May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABika1HeStVElVQJ72LxtOaCypBRwok9KC8ehHmBtoE4ge-FF-ZMiewNMctXMlqe3Upsdmz7qzPkbkJ_WgFZAVy7giq_HlmNERtr06agJ8Tq3kRuGmxHUqtCyvWt_UhBY8JQf-Pfhzwxgka5_tQnqH7ANBSu7nV6J4fjllSPPW_XmsLxYg May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 3833032727344d68b18149e6fdc20bde May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1102046578 May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3833032727344d68b18149e6fdc20bde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3833032727344d68b18149e6fdc20bde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3833032727344d68b18149e6fdc20bde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3833032727344d68b18149e6fdc20bde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-VolumesSnapshotTestJSON-1102046578 May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 3833032727344d68b18149e6fdc20bde May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1102046578 May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-VolumesSnapshotTestJSON-1102046578-project May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 0313b050ae35491e830a4adce40453ed May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-VolumesSnapshotTestJSON-1102046578-project May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 038f7c26-89d5-45e6-8122-bb601c3ca3ee could not be found. May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '038f7c26-89d5-45e6-8122-bb601c3ca3ee'} May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 038f7c26-89d5-45e6-8122-bb601c3ca3ee could not be found. May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:11:25.709652 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:11:25.720839 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 038f7c26-89d5-45e6-8122-bb601c3ca3ee could not be found. May 28 05:11:25.720839 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:11:25.720839 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:11:25.720839 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:11:25.720839 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:11:25.720839 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:11:25.720839 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:11:25.720839 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:11:25.720839 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:11:25.720839 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 038f7c26-89d5-45e6-8122-bb601c3ca3ee could not be found. May 28 05:11:25.720839 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:11:25.720839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-127bdedb-2faf-4a96-b670-39800ac84bf9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] Returning 404 to user: Instance 038f7c26-89d5-45e6-8122-bb601c3ca3ee could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:11:25.720839 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-127bdedb-2faf-4a96-b670-39800ac84bf9 tempest-VolumesSnapshotTestJSON-1102046578 tempest-VolumesSnapshotTestJSON-1102046578-project] 10.222.0.58 "GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee" status: 404 len: 111 microversion: 2.1 time: 0.067101 May 28 05:11:25.720839 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3196/6276] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:11:25 2022] GET /compute/v2.1/servers/038f7c26-89d5-45e6-8122-bb601c3ca3ee => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:11:25.956590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-db747408-79a3-44a8-8f19-1aa25a8fcff9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:25.967149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-db747408-79a3-44a8-8f19-1aa25a8fcff9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:25.967487 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db747408-79a3-44a8-8f19-1aa25a8fcff9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:25.968139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db747408-79a3-44a8-8f19-1aa25a8fcff9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:25.969110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db747408-79a3-44a8-8f19-1aa25a8fcff9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:25.969701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db747408-79a3-44a8-8f19-1aa25a8fcff9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:26.301074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-db747408-79a3-44a8-8f19-1aa25a8fcff9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:26.307894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:11:26.310810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-db747408-79a3-44a8-8f19-1aa25a8fcff9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:26.312348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-db747408-79a3-44a8-8f19-1aa25a8fcff9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:26.316659 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-db747408-79a3-44a8-8f19-1aa25a8fcff9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1405 microversion: 2.20 time: 0.363719 May 28 05:11:26.316659 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3081/6277] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:11:25 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1405 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:11:27.331432 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-acc207c9-7c0c-4312-bcdb-c5fd42f3f930 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:27.332609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-acc207c9-7c0c-4312-bcdb-c5fd42f3f930 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:27.337569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:11:27.354266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-acc207c9-7c0c-4312-bcdb-c5fd42f3f930 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:27.354545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-acc207c9-7c0c-4312-bcdb-c5fd42f3f930 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:27.355483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-acc207c9-7c0c-4312-bcdb-c5fd42f3f930 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:27.355943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-acc207c9-7c0c-4312-bcdb-c5fd42f3f930 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:27.419120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-4652e43a-463d-4f65-a896-befaeee34eb5 req-9896a692-7c03-48b4-ab4b-65c19cef1e41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03d6e344-40d2-4d47-95b5-c3be216f08d8", "tag": "e3181171-bf41-4341-bf54-3e1757a628c1"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:11:27.431583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:11:27.450308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4652e43a-463d-4f65-a896-befaeee34eb5 req-9896a692-7c03-48b4-ab4b-65c19cef1e41 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:27.450308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4652e43a-463d-4f65-a896-befaeee34eb5 req-9896a692-7c03-48b4-ab4b-65c19cef1e41 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:27.464888 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-4652e43a-463d-4f65-a896-befaeee34eb5 req-9896a692-7c03-48b4-ab4b-65c19cef1e41 service nova] Creating event network-changed:e3181171-bf41-4341-bf54-3e1757a628c1 for instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 on n-h2-843700-1 May 28 05:11:27.471108 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-4652e43a-463d-4f65-a896-befaeee34eb5 req-9896a692-7c03-48b4-ab4b-65c19cef1e41 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066122 May 28 05:11:27.472423 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3082/6278] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:11:28.517931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-acc207c9-7c0c-4312-bcdb-c5fd42f3f930 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:28.529171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-acc207c9-7c0c-4312-bcdb-c5fd42f3f930 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:28.531079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-acc207c9-7c0c-4312-bcdb-c5fd42f3f930 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:28.542658 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-acc207c9-7c0c-4312-bcdb-c5fd42f3f930 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1405 microversion: 2.20 time: 1.205042 May 28 05:11:28.545085 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3197/6279] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:11:27 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1405 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:11:29.554089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-790afaf9-5fa2-4fe2-b6eb-d9343a6b06f0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:29.555741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-790afaf9-5fa2-4fe2-b6eb-d9343a6b06f0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:29.564294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-790afaf9-5fa2-4fe2-b6eb-d9343a6b06f0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:29.564998 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-790afaf9-5fa2-4fe2-b6eb-d9343a6b06f0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:29.566131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-790afaf9-5fa2-4fe2-b6eb-d9343a6b06f0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:29.566734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-790afaf9-5fa2-4fe2-b6eb-d9343a6b06f0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:29.747285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-790afaf9-5fa2-4fe2-b6eb-d9343a6b06f0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:29.757254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-790afaf9-5fa2-4fe2-b6eb-d9343a6b06f0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:29.758911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-790afaf9-5fa2-4fe2-b6eb-d9343a6b06f0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:29.760076 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-790afaf9-5fa2-4fe2-b6eb-d9343a6b06f0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1405 microversion: 2.20 time: 0.211581 May 28 05:11:29.760648 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3083/6280] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:11:29 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1405 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:11:30.778797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eafc017a-1b16-466b-b3e2-677981a61818 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:30.778797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-eafc017a-1b16-466b-b3e2-677981a61818 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:30.785874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eafc017a-1b16-466b-b3e2-677981a61818 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:30.786887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eafc017a-1b16-466b-b3e2-677981a61818 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:30.787708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eafc017a-1b16-466b-b3e2-677981a61818 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:30.788156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eafc017a-1b16-466b-b3e2-677981a61818 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:30.952919 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-eafc017a-1b16-466b-b3e2-677981a61818 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:30.967514 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-eafc017a-1b16-466b-b3e2-677981a61818 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:30.970461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-eafc017a-1b16-466b-b3e2-677981a61818 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:30.971907 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-eafc017a-1b16-466b-b3e2-677981a61818 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1405 microversion: 2.20 time: 0.198298 May 28 05:11:30.983926 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3198/6281] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:11:30 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:11:31.992881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-78cac003-cad5-4041-9f50-00aefea2f2f8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:31.994273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-78cac003-cad5-4041-9f50-00aefea2f2f8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:32.000937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:11:32.001619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=8 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:11:32.005901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78cac003-cad5-4041-9f50-00aefea2f2f8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:32.006367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78cac003-cad5-4041-9f50-00aefea2f2f8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:32.010137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78cac003-cad5-4041-9f50-00aefea2f2f8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:32.010918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78cac003-cad5-4041-9f50-00aefea2f2f8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:32.273926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-78cac003-cad5-4041-9f50-00aefea2f2f8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:32.290026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-78cac003-cad5-4041-9f50-00aefea2f2f8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:32.291639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-78cac003-cad5-4041-9f50-00aefea2f2f8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:32.292832 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-78cac003-cad5-4041-9f50-00aefea2f2f8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1405 microversion: 2.20 time: 0.306757 May 28 05:11:32.296789 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3084/6282] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:11:31 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1405 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:11:33.316148 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-33e454e9-07d7-4b2a-8f5f-5cb7788e747a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:33.316766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-33e454e9-07d7-4b2a-8f5f-5cb7788e747a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:33.327380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:11:33.329747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-33e454e9-07d7-4b2a-8f5f-5cb7788e747a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:33.331224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-33e454e9-07d7-4b2a-8f5f-5cb7788e747a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:33.334078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-33e454e9-07d7-4b2a-8f5f-5cb7788e747a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:33.334735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-33e454e9-07d7-4b2a-8f5f-5cb7788e747a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:33.667290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-33e454e9-07d7-4b2a-8f5f-5cb7788e747a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:33.683948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-33e454e9-07d7-4b2a-8f5f-5cb7788e747a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:33.686416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-33e454e9-07d7-4b2a-8f5f-5cb7788e747a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:33.689786 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-33e454e9-07d7-4b2a-8f5f-5cb7788e747a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1405 microversion: 2.20 time: 0.377848 May 28 05:11:33.690924 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3199/6283] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:11:33 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1405 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:11:34.709736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aa597c09-2a7d-4df9-aa01-cc5e5e0ed96b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:34.711360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-aa597c09-2a7d-4df9-aa01-cc5e5e0ed96b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:34.727333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa597c09-2a7d-4df9-aa01-cc5e5e0ed96b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:34.729517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa597c09-2a7d-4df9-aa01-cc5e5e0ed96b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:34.731884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa597c09-2a7d-4df9-aa01-cc5e5e0ed96b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:34.739814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa597c09-2a7d-4df9-aa01-cc5e5e0ed96b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:35.146379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-aa597c09-2a7d-4df9-aa01-cc5e5e0ed96b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:35.157658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-aa597c09-2a7d-4df9-aa01-cc5e5e0ed96b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:35.162052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-aa597c09-2a7d-4df9-aa01-cc5e5e0ed96b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:35.165745 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aa597c09-2a7d-4df9-aa01-cc5e5e0ed96b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1405 microversion: 2.20 time: 0.461966 May 28 05:11:35.170931 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3085/6284] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:11:34 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:11:35.432545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-b8390bd7-86ef-40a1-ae5a-86c175dee933 req-e9d3cf11-9bed-4ad4-befd-f2a270df3d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d6e344-40d2-4d47-95b5-c3be216f08d8", "name": "network-vif-plugged", "status": "completed", "tag": "e3181171-bf41-4341-bf54-3e1757a628c1"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:11:35.442526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b8390bd7-86ef-40a1-ae5a-86c175dee933 req-e9d3cf11-9bed-4ad4-befd-f2a270df3d9e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:35.443116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b8390bd7-86ef-40a1-ae5a-86c175dee933 req-e9d3cf11-9bed-4ad4-befd-f2a270df3d9e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:35.459335 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-b8390bd7-86ef-40a1-ae5a-86c175dee933 req-e9d3cf11-9bed-4ad4-befd-f2a270df3d9e service nova] Creating event network-vif-plugged:e3181171-bf41-4341-bf54-3e1757a628c1 for instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 on n-h2-843700-1 May 28 05:11:35.465560 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-b8390bd7-86ef-40a1-ae5a-86c175dee933 req-e9d3cf11-9bed-4ad4-befd-f2a270df3d9e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.273887 May 28 05:11:35.466186 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3200/6285] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:11:36.184539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-645dddf0-6efd-45b4-a88e-5a50031f7f2e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:36.185907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-645dddf0-6efd-45b4-a88e-5a50031f7f2e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:36.215578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-645dddf0-6efd-45b4-a88e-5a50031f7f2e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:36.217165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-645dddf0-6efd-45b4-a88e-5a50031f7f2e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:36.218345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-645dddf0-6efd-45b4-a88e-5a50031f7f2e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:36.219324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-645dddf0-6efd-45b4-a88e-5a50031f7f2e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:36.473105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-645dddf0-6efd-45b4-a88e-5a50031f7f2e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:36.495208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-645dddf0-6efd-45b4-a88e-5a50031f7f2e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:36.498121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-645dddf0-6efd-45b4-a88e-5a50031f7f2e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:36.502514 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-645dddf0-6efd-45b4-a88e-5a50031f7f2e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1405 microversion: 2.20 time: 0.322715 May 28 05:11:36.515331 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3086/6286] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:11:36 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1405 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:11:37.524124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-99505f5a-32df-43c1-88c1-c92a898a3e82 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:37.525431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-99505f5a-32df-43c1-88c1-c92a898a3e82 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:37.539371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-99505f5a-32df-43c1-88c1-c92a898a3e82 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:37.541844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-99505f5a-32df-43c1-88c1-c92a898a3e82 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:37.543977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-99505f5a-32df-43c1-88c1-c92a898a3e82 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:37.549369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-99505f5a-32df-43c1-88c1-c92a898a3e82 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:37.814455 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-99505f5a-32df-43c1-88c1-c92a898a3e82 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:37.835118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-99505f5a-32df-43c1-88c1-c92a898a3e82 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:37.835118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-99505f5a-32df-43c1-88c1-c92a898a3e82 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:11:37.835118 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-99505f5a-32df-43c1-88c1-c92a898a3e82 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1597 microversion: 2.20 time: 0.317273 May 28 05:11:37.847172 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3201/6287] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:11:37 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1597 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:11:37.852533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-86bf7f00-5637-4e39-8f9b-7d889bd1f8b0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:11:37.853032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-86bf7f00-5637-4e39-8f9b-7d889bd1f8b0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:11:37.865902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-86bf7f00-5637-4e39-8f9b-7d889bd1f8b0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:37.866421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-86bf7f00-5637-4e39-8f9b-7d889bd1f8b0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:37.867248 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-86bf7f00-5637-4e39-8f9b-7d889bd1f8b0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:37.867858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-86bf7f00-5637-4e39-8f9b-7d889bd1f8b0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:38.102771 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-86bf7f00-5637-4e39-8f9b-7d889bd1f8b0 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.254122 May 28 05:11:38.103900 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3087/6288] 10.222.0.58 () {60 vars in 1315 bytes} [Sat May 28 05:11:37 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8/os-interface => generated 284 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:11:40.374062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-a0bf4caf-1538-4150-9897-b6d312f30e0b req-b3757fb1-7fb1-47df-a3b0-8fc0ae3582bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03d6e344-40d2-4d47-95b5-c3be216f08d8", "tag": "e3181171-bf41-4341-bf54-3e1757a628c1"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:11:40.389155 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a0bf4caf-1538-4150-9897-b6d312f30e0b req-b3757fb1-7fb1-47df-a3b0-8fc0ae3582bf service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:11:40.389608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a0bf4caf-1538-4150-9897-b6d312f30e0b req-b3757fb1-7fb1-47df-a3b0-8fc0ae3582bf service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:11:40.441830 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-a0bf4caf-1538-4150-9897-b6d312f30e0b req-b3757fb1-7fb1-47df-a3b0-8fc0ae3582bf service nova] Creating event network-changed:e3181171-bf41-4341-bf54-3e1757a628c1 for instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 on n-h2-843700-1 May 28 05:11:40.459445 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-a0bf4caf-1538-4150-9897-b6d312f30e0b req-b3757fb1-7fb1-47df-a3b0-8fc0ae3582bf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219856 May 28 05:11:40.474557 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3202/6289] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:12:14.301555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53a1a8b0-a003-48d5-a958-b52a752539ca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:14.303403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-53a1a8b0-a003-48d5-a958-b52a752539ca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:14.306772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=11 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:12:14.308673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=30 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:12:14.324101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53a1a8b0-a003-48d5-a958-b52a752539ca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:14.325238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53a1a8b0-a003-48d5-a958-b52a752539ca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:14.329346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53a1a8b0-a003-48d5-a958-b52a752539ca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:14.329960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53a1a8b0-a003-48d5-a958-b52a752539ca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:14.373917 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-53a1a8b0-a003-48d5-a958-b52a752539ca tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8/ips" status: 200 len: 151 microversion: 2.20 time: 0.070506 May 28 05:12:14.375230 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3088/6290] 10.222.0.58 () {60 vars in 1288 bytes} [Sat May 28 05:12:14 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8/ips => generated 151 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:12:19.312586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b023dc90-6b3a-4c18-9069-75ab6aeaaaa8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:12:19.313223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b023dc90-6b3a-4c18-9069-75ab6aeaaaa8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:19.318590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=11 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:12:19.319675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=30 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:12:19.328487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b023dc90-6b3a-4c18-9069-75ab6aeaaaa8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:19.331440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b023dc90-6b3a-4c18-9069-75ab6aeaaaa8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:19.333312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b023dc90-6b3a-4c18-9069-75ab6aeaaaa8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:19.333312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b023dc90-6b3a-4c18-9069-75ab6aeaaaa8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:19.367381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-b023dc90-6b3a-4c18-9069-75ab6aeaaaa8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lazy-loading 'flavor' on Instance uuid 03d6e344-40d2-4d47-95b5-c3be216f08d8 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:12:20.892682 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b023dc90-6b3a-4c18-9069-75ab6aeaaaa8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "POST /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8/action" status: 202 len: 0 microversion: 2.20 time: 1.590104 May 28 05:12:20.892682 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3203/6291] 10.222.0.58 () {62 vars in 1318 bytes} [Sat May 28 05:12:19 2022] POST /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8/action => generated 0 bytes in 1595 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 05:12:20.903126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-84bd96f4-3560-4e30-924f-0bb1d1c09dc3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:20.903758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-84bd96f4-3560-4e30-924f-0bb1d1c09dc3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:20.921528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84bd96f4-3560-4e30-924f-0bb1d1c09dc3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:20.921971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84bd96f4-3560-4e30-924f-0bb1d1c09dc3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:20.922763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84bd96f4-3560-4e30-924f-0bb1d1c09dc3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:20.923231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84bd96f4-3560-4e30-924f-0bb1d1c09dc3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:21.135674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-84bd96f4-3560-4e30-924f-0bb1d1c09dc3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:21.145529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-84bd96f4-3560-4e30-924f-0bb1d1c09dc3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:21.153108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-84bd96f4-3560-4e30-924f-0bb1d1c09dc3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:21.156576 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-84bd96f4-3560-4e30-924f-0bb1d1c09dc3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1721 microversion: 2.20 time: 0.259538 May 28 05:12:21.162501 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3089/6292] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:20 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:22.182259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9d275e14-50bc-4ddd-a18a-7d84fd2aeffe tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:22.183923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9d275e14-50bc-4ddd-a18a-7d84fd2aeffe tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:22.198765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d275e14-50bc-4ddd-a18a-7d84fd2aeffe tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:22.199702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d275e14-50bc-4ddd-a18a-7d84fd2aeffe tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:22.200704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d275e14-50bc-4ddd-a18a-7d84fd2aeffe tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:22.201685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9d275e14-50bc-4ddd-a18a-7d84fd2aeffe tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:22.509004 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9d275e14-50bc-4ddd-a18a-7d84fd2aeffe tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:22.529722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9d275e14-50bc-4ddd-a18a-7d84fd2aeffe tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:22.535473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9d275e14-50bc-4ddd-a18a-7d84fd2aeffe tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:22.545180 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9d275e14-50bc-4ddd-a18a-7d84fd2aeffe tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1721 microversion: 2.20 time: 0.366233 May 28 05:12:22.547826 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3204/6293] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:22 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1721 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:23.565744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-73e17f80-8e9b-44c9-868d-32ee1d1d00cf tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:23.567075 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-73e17f80-8e9b-44c9-868d-32ee1d1d00cf tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:23.577381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73e17f80-8e9b-44c9-868d-32ee1d1d00cf tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:23.579065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73e17f80-8e9b-44c9-868d-32ee1d1d00cf tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:23.579065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73e17f80-8e9b-44c9-868d-32ee1d1d00cf tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:23.579919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73e17f80-8e9b-44c9-868d-32ee1d1d00cf tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:23.873953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-73e17f80-8e9b-44c9-868d-32ee1d1d00cf tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:23.902845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-73e17f80-8e9b-44c9-868d-32ee1d1d00cf tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:23.905981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-73e17f80-8e9b-44c9-868d-32ee1d1d00cf tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:23.907673 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-73e17f80-8e9b-44c9-868d-32ee1d1d00cf tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1721 microversion: 2.20 time: 0.346593 May 28 05:12:23.910336 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3090/6294] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:23 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1721 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:24.874335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5fbaa146-aac7-472e-8f0e-24b635c58619 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:24.875211 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 05:12:24.875211 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 05:12:24.876523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5fbaa146-aac7-472e-8f0e-24b635c58619 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:24.876980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5fbaa146-aac7-472e-8f0e-24b635c58619 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:24.877818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5fbaa146-aac7-472e-8f0e-24b635c58619 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:24.878262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5fbaa146-aac7-472e-8f0e-24b635c58619 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:24.910436 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5fbaa146-aac7-472e-8f0e-24b635c58619 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.214792 May 28 05:12:24.911712 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3205/6295] 10.222.0.58 () {58 vars in 1184 bytes} [Sat May 28 05:12:24 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:12:24.927743 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-41568b59-bd16-4799-ba80-6ee17da03ab7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:24.928426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-41568b59-bd16-4799-ba80-6ee17da03ab7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:24.939417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41568b59-bd16-4799-ba80-6ee17da03ab7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:24.943598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41568b59-bd16-4799-ba80-6ee17da03ab7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:24.944808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41568b59-bd16-4799-ba80-6ee17da03ab7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:24.945424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41568b59-bd16-4799-ba80-6ee17da03ab7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:25.117710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-496107e5-55cb-4acd-8917-94bf3b9d25b8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1330914349", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "availability_zone": "nova:n-h1-843700-1", "networks": [{"uuid": "5e99ce4f-3e92-4723-a596-fefb6ac97fba"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:12:25.166839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-41568b59-bd16-4799-ba80-6ee17da03ab7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:25.176275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-41568b59-bd16-4799-ba80-6ee17da03ab7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:25.178384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-41568b59-bd16-4799-ba80-6ee17da03ab7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:25.180662 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-41568b59-bd16-4799-ba80-6ee17da03ab7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1721 microversion: 2.20 time: 0.258033 May 28 05:12:25.182842 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3091/6296] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:24 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:25.201628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-496107e5-55cb-4acd-8917-94bf3b9d25b8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] validate_networks() for [('5e99ce4f-3e92-4723-a596-fefb6ac97fba', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:12:25.885294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-496107e5-55cb-4acd-8917-94bf3b9d25b8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:12:25.885922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-496107e5-55cb-4acd-8917-94bf3b9d25b8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:12:25.887046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-496107e5-55cb-4acd-8917-94bf3b9d25b8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:12:25.887569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-496107e5-55cb-4acd-8917-94bf3b9d25b8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:12:25.888104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-496107e5-55cb-4acd-8917-94bf3b9d25b8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:12:25.899559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-496107e5-55cb-4acd-8917-94bf3b9d25b8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:25.900466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-496107e5-55cb-4acd-8917-94bf3b9d25b8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:25.913526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-496107e5-55cb-4acd-8917-94bf3b9d25b8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:25.914755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-496107e5-55cb-4acd-8917-94bf3b9d25b8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:25.945584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-496107e5-55cb-4acd-8917-94bf3b9d25b8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Getting quotas for project b0b82c906a4948ec9a7bb03b72afdeb8. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:12:25.958413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-496107e5-55cb-4acd-8917-94bf3b9d25b8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Getting quotas for user 2d95fb8ce10e415583f40baa36b6bec9 and project b0b82c906a4948ec9a7bb03b72afdeb8. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:12:25.978656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-496107e5-55cb-4acd-8917-94bf3b9d25b8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:12:25.982552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-496107e5-55cb-4acd-8917-94bf3b9d25b8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:12:26.163321 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-496107e5-55cb-4acd-8917-94bf3b9d25b8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.049884 May 28 05:12:26.172402 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3206/6297] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:12:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 05:12:26.177188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2b637781-0c56-40ba-9660-b9e2400d9b80 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:26.177829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2b637781-0c56-40ba-9660-b9e2400d9b80 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:26.200355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ff2bb0d2-b470-499b-970e-1084707ea4f7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:26.200970 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ff2bb0d2-b470-499b-970e-1084707ea4f7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:26.212145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff2bb0d2-b470-499b-970e-1084707ea4f7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:26.212895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff2bb0d2-b470-499b-970e-1084707ea4f7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:26.214685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff2bb0d2-b470-499b-970e-1084707ea4f7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:26.219730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff2bb0d2-b470-499b-970e-1084707ea4f7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:26.309747 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2b637781-0c56-40ba-9660-b9e2400d9b80 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1329 microversion: 2.1 time: 0.136567 May 28 05:12:26.313823 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3092/6298] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:26 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1329 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:26.464315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ff2bb0d2-b470-499b-970e-1084707ea4f7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:26.478841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ff2bb0d2-b470-499b-970e-1084707ea4f7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:26.480472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ff2bb0d2-b470-499b-970e-1084707ea4f7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:26.482064 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ff2bb0d2-b470-499b-970e-1084707ea4f7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1721 microversion: 2.20 time: 0.285714 May 28 05:12:26.482703 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3207/6299] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:26 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1721 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:27.327114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9a09dd51-8983-4a7f-a83f-cef73b56facc tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:27.327824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9a09dd51-8983-4a7f-a83f-cef73b56facc tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:27.416783 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9a09dd51-8983-4a7f-a83f-cef73b56facc tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1329 microversion: 2.1 time: 0.093564 May 28 05:12:27.418212 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3093/6300] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:27 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1329 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:27.502071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bcddc08c-66fe-4d79-b5bc-86344eb77f20 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:27.502821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bcddc08c-66fe-4d79-b5bc-86344eb77f20 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:27.511211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bcddc08c-66fe-4d79-b5bc-86344eb77f20 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:27.511674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bcddc08c-66fe-4d79-b5bc-86344eb77f20 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:27.512492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bcddc08c-66fe-4d79-b5bc-86344eb77f20 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:27.512939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bcddc08c-66fe-4d79-b5bc-86344eb77f20 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:27.764272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bcddc08c-66fe-4d79-b5bc-86344eb77f20 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:27.773927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bcddc08c-66fe-4d79-b5bc-86344eb77f20 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:27.775624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bcddc08c-66fe-4d79-b5bc-86344eb77f20 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:27.777393 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bcddc08c-66fe-4d79-b5bc-86344eb77f20 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1721 microversion: 2.20 time: 0.280027 May 28 05:12:27.778037 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3208/6301] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:27 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1721 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:28.437014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-047e7c19-de28-4cf0-ab03-bdacd25d7ce2 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:28.437648 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-047e7c19-de28-4cf0-ab03-bdacd25d7ce2 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:28.508332 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-047e7c19-de28-4cf0-ab03-bdacd25d7ce2 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1329 microversion: 2.1 time: 0.077191 May 28 05:12:28.508941 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3094/6302] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:28 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1329 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:28.801240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d9fc4b94-b90d-40de-a762-3f73887e0e5b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:28.802578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d9fc4b94-b90d-40de-a762-3f73887e0e5b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:28.811946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9fc4b94-b90d-40de-a762-3f73887e0e5b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:28.812756 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9fc4b94-b90d-40de-a762-3f73887e0e5b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:28.813731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9fc4b94-b90d-40de-a762-3f73887e0e5b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:28.814658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9fc4b94-b90d-40de-a762-3f73887e0e5b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:29.096002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d9fc4b94-b90d-40de-a762-3f73887e0e5b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:29.104279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d9fc4b94-b90d-40de-a762-3f73887e0e5b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:29.105792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d9fc4b94-b90d-40de-a762-3f73887e0e5b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:29.107627 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d9fc4b94-b90d-40de-a762-3f73887e0e5b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1721 microversion: 2.20 time: 0.311627 May 28 05:12:29.126156 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3209/6303] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:28 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1721 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:29.526774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b0e76f1e-3357-4e10-8051-629377ea0785 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:29.527580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b0e76f1e-3357-4e10-8051-629377ea0785 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:29.541732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0e76f1e-3357-4e10-8051-629377ea0785 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:29.543518 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0e76f1e-3357-4e10-8051-629377ea0785 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:29.546294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0e76f1e-3357-4e10-8051-629377ea0785 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:29.546874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0e76f1e-3357-4e10-8051-629377ea0785 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:29.708842 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b0e76f1e-3357-4e10-8051-629377ea0785 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1346 microversion: 2.1 time: 0.186118 May 28 05:12:29.710302 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3095/6304] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:29 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1346 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:30.125778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-24507b80-f6a6-47de-a3c9-4d5eb12159de tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:30.126966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-24507b80-f6a6-47de-a3c9-4d5eb12159de tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:30.145001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24507b80-f6a6-47de-a3c9-4d5eb12159de tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:30.145819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24507b80-f6a6-47de-a3c9-4d5eb12159de tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:30.146856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24507b80-f6a6-47de-a3c9-4d5eb12159de tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:30.147551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24507b80-f6a6-47de-a3c9-4d5eb12159de tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:30.475043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-24507b80-f6a6-47de-a3c9-4d5eb12159de tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:30.484130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-24507b80-f6a6-47de-a3c9-4d5eb12159de tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:30.487974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-24507b80-f6a6-47de-a3c9-4d5eb12159de tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:30.492419 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-24507b80-f6a6-47de-a3c9-4d5eb12159de tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1721 microversion: 2.20 time: 0.370651 May 28 05:12:30.494670 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3210/6305] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:30 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1721 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:30.725905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3d0af035-22ca-4291-8a5a-2a4bbc6ac457 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:30.726691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3d0af035-22ca-4291-8a5a-2a4bbc6ac457 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:30.740845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3d0af035-22ca-4291-8a5a-2a4bbc6ac457 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:30.744645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3d0af035-22ca-4291-8a5a-2a4bbc6ac457 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:30.744645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3d0af035-22ca-4291-8a5a-2a4bbc6ac457 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:30.744645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3d0af035-22ca-4291-8a5a-2a4bbc6ac457 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:30.871015 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3d0af035-22ca-4291-8a5a-2a4bbc6ac457 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1338 microversion: 2.1 time: 0.142671 May 28 05:12:30.871015 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3096/6306] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:30 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1338 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:31.513928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e5a68a72-df03-4b0e-a90f-e11f2ef346c9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:31.514720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e5a68a72-df03-4b0e-a90f-e11f2ef346c9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:31.525183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5a68a72-df03-4b0e-a90f-e11f2ef346c9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:31.532817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5a68a72-df03-4b0e-a90f-e11f2ef346c9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:31.533714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5a68a72-df03-4b0e-a90f-e11f2ef346c9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:31.536594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5a68a72-df03-4b0e-a90f-e11f2ef346c9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:31.882627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f1d8b6e4-6771-4c17-80bf-f2d9554301a0 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:31.883293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f1d8b6e4-6771-4c17-80bf-f2d9554301a0 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:31.896485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1d8b6e4-6771-4c17-80bf-f2d9554301a0 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:31.897218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1d8b6e4-6771-4c17-80bf-f2d9554301a0 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:31.898199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1d8b6e4-6771-4c17-80bf-f2d9554301a0 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:31.898885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1d8b6e4-6771-4c17-80bf-f2d9554301a0 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:32.078038 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f1d8b6e4-6771-4c17-80bf-f2d9554301a0 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1416 microversion: 2.1 time: 0.200006 May 28 05:12:32.078608 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3097/6307] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:31 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1416 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:12:32.258898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e5a68a72-df03-4b0e-a90f-e11f2ef346c9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:32.278125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e5a68a72-df03-4b0e-a90f-e11f2ef346c9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:32.280111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e5a68a72-df03-4b0e-a90f-e11f2ef346c9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:32.282014 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e5a68a72-df03-4b0e-a90f-e11f2ef346c9 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1721 microversion: 2.20 time: 0.772941 May 28 05:12:32.288571 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3211/6308] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:31 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1721 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:12:33.095921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-03e47996-aca6-4451-a4b4-83bfd3166dc6 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:33.097132 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-03e47996-aca6-4451-a4b4-83bfd3166dc6 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:33.105830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03e47996-aca6-4451-a4b4-83bfd3166dc6 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:33.106303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03e47996-aca6-4451-a4b4-83bfd3166dc6 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:33.108263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03e47996-aca6-4451-a4b4-83bfd3166dc6 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:33.108263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03e47996-aca6-4451-a4b4-83bfd3166dc6 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:33.306712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-25bdd64e-8965-4b29-80af-4a480f4e68d6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:33.308603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-25bdd64e-8965-4b29-80af-4a480f4e68d6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:33.315798 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-03e47996-aca6-4451-a4b4-83bfd3166dc6 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1464 microversion: 2.1 time: 0.224496 May 28 05:12:33.334585 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3098/6309] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:33 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1464 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:33.334848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25bdd64e-8965-4b29-80af-4a480f4e68d6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:33.334848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25bdd64e-8965-4b29-80af-4a480f4e68d6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:33.334848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25bdd64e-8965-4b29-80af-4a480f4e68d6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:33.334848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25bdd64e-8965-4b29-80af-4a480f4e68d6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:33.685208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-25bdd64e-8965-4b29-80af-4a480f4e68d6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:33.693822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-25bdd64e-8965-4b29-80af-4a480f4e68d6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:33.695643 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-25bdd64e-8965-4b29-80af-4a480f4e68d6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:33.704416 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-25bdd64e-8965-4b29-80af-4a480f4e68d6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1721 microversion: 2.20 time: 0.400415 May 28 05:12:33.706918 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3212/6310] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:33 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1721 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:34.341675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8613ace7-7221-4f15-922c-961b247b4c47 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:34.343138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8613ace7-7221-4f15-922c-961b247b4c47 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:34.351935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8613ace7-7221-4f15-922c-961b247b4c47 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:34.352664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8613ace7-7221-4f15-922c-961b247b4c47 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:34.353460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8613ace7-7221-4f15-922c-961b247b4c47 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:34.354403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8613ace7-7221-4f15-922c-961b247b4c47 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:34.686728 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8613ace7-7221-4f15-922c-961b247b4c47 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1464 microversion: 2.1 time: 0.347429 May 28 05:12:34.688568 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3099/6311] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:34 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1464 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:34.725211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-feb23ed2-91f9-4275-a370-6b1ee9c4e078 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:34.726072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-feb23ed2-91f9-4275-a370-6b1ee9c4e078 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:34.739680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-feb23ed2-91f9-4275-a370-6b1ee9c4e078 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:34.740356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-feb23ed2-91f9-4275-a370-6b1ee9c4e078 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:34.744117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-feb23ed2-91f9-4275-a370-6b1ee9c4e078 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:34.746604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-feb23ed2-91f9-4275-a370-6b1ee9c4e078 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:34.933430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-feb23ed2-91f9-4275-a370-6b1ee9c4e078 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:34.943379 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-feb23ed2-91f9-4275-a370-6b1ee9c4e078 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:34.945770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-feb23ed2-91f9-4275-a370-6b1ee9c4e078 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:34.947549 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-feb23ed2-91f9-4275-a370-6b1ee9c4e078 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1721 microversion: 2.20 time: 0.226484 May 28 05:12:34.948143 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3213/6312] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:34 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:35.173409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-1366765d-e817-405f-88c6-f9ee267664f4 req-08b27949-38e3-4829-aea0-16bd99d05432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a9fae4-6e78-4825-abed-c2dabb885814", "tag": "cdb65ee2-58da-4347-b35a-2df3e1f8c6cc"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:12:35.185637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1366765d-e817-405f-88c6-f9ee267664f4 req-08b27949-38e3-4829-aea0-16bd99d05432 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:35.186406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1366765d-e817-405f-88c6-f9ee267664f4 req-08b27949-38e3-4829-aea0-16bd99d05432 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:35.212924 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-1366765d-e817-405f-88c6-f9ee267664f4 req-08b27949-38e3-4829-aea0-16bd99d05432 service nova] Creating event network-changed:cdb65ee2-58da-4347-b35a-2df3e1f8c6cc for instance 13a9fae4-6e78-4825-abed-c2dabb885814 on n-h1-843700-1 May 28 05:12:35.219882 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-1366765d-e817-405f-88c6-f9ee267664f4 req-08b27949-38e3-4829-aea0-16bd99d05432 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169080 May 28 05:12:35.239219 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3100/6313] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:12:35.707115 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-259c7575-1b23-413a-92a7-0180ef6672e4 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:35.708079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-259c7575-1b23-413a-92a7-0180ef6672e4 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:35.715305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-259c7575-1b23-413a-92a7-0180ef6672e4 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:35.716029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-259c7575-1b23-413a-92a7-0180ef6672e4 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:35.717148 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-259c7575-1b23-413a-92a7-0180ef6672e4 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:35.717766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-259c7575-1b23-413a-92a7-0180ef6672e4 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:35.901041 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-259c7575-1b23-413a-92a7-0180ef6672e4 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1464 microversion: 2.1 time: 0.199999 May 28 05:12:35.915244 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3214/6314] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:35 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1464 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:35.967250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7768c5f3-30af-48d4-bf83-cc5f2a05f710 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:35.968543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7768c5f3-30af-48d4-bf83-cc5f2a05f710 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:35.976038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7768c5f3-30af-48d4-bf83-cc5f2a05f710 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:35.978684 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7768c5f3-30af-48d4-bf83-cc5f2a05f710 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:35.978684 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7768c5f3-30af-48d4-bf83-cc5f2a05f710 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:35.978684 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7768c5f3-30af-48d4-bf83-cc5f2a05f710 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:36.154360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7768c5f3-30af-48d4-bf83-cc5f2a05f710 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:36.177781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7768c5f3-30af-48d4-bf83-cc5f2a05f710 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:36.179766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7768c5f3-30af-48d4-bf83-cc5f2a05f710 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:36.181157 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7768c5f3-30af-48d4-bf83-cc5f2a05f710 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1721 microversion: 2.20 time: 0.219132 May 28 05:12:36.202845 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3101/6315] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:35 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:36.921922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b883d4a3-a2ea-4fa3-be28-36a30a0bc77b tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:36.922527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b883d4a3-a2ea-4fa3-be28-36a30a0bc77b tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:36.924651 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:12:36.930917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:12:36.942186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b883d4a3-a2ea-4fa3-be28-36a30a0bc77b tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:36.945816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b883d4a3-a2ea-4fa3-be28-36a30a0bc77b tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:36.947035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b883d4a3-a2ea-4fa3-be28-36a30a0bc77b tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:36.947672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b883d4a3-a2ea-4fa3-be28-36a30a0bc77b tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:37.202763 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b883d4a3-a2ea-4fa3-be28-36a30a0bc77b tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1464 microversion: 2.1 time: 0.284752 May 28 05:12:37.203404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-48abd877-fc63-4d00-b092-0636e1211727 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:37.204042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-48abd877-fc63-4d00-b092-0636e1211727 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:37.205997 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3215/6316] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:36 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1464 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:37.229070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48abd877-fc63-4d00-b092-0636e1211727 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:37.229070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48abd877-fc63-4d00-b092-0636e1211727 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:37.229070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48abd877-fc63-4d00-b092-0636e1211727 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:37.229070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48abd877-fc63-4d00-b092-0636e1211727 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:37.535754 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-48abd877-fc63-4d00-b092-0636e1211727 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:37.546427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-48abd877-fc63-4d00-b092-0636e1211727 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:37.549329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-48abd877-fc63-4d00-b092-0636e1211727 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:37.552491 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-48abd877-fc63-4d00-b092-0636e1211727 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1721 microversion: 2.20 time: 0.352482 May 28 05:12:37.553854 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3102/6317] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:37 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1721 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:38.221588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-873ca604-ae3d-4452-9d14-ca63ddeacffc tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:38.222924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-873ca604-ae3d-4452-9d14-ca63ddeacffc tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:38.230438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-873ca604-ae3d-4452-9d14-ca63ddeacffc tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:38.230897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-873ca604-ae3d-4452-9d14-ca63ddeacffc tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:38.231695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-873ca604-ae3d-4452-9d14-ca63ddeacffc tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:38.232763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-873ca604-ae3d-4452-9d14-ca63ddeacffc tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:38.379112 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-873ca604-ae3d-4452-9d14-ca63ddeacffc tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1464 microversion: 2.1 time: 0.160525 May 28 05:12:38.379711 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3216/6318] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:38 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:38.574252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-629739cc-e41f-4e3d-9751-241cf2fcd6e2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:38.575383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-629739cc-e41f-4e3d-9751-241cf2fcd6e2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:38.585762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:12:38.587681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-629739cc-e41f-4e3d-9751-241cf2fcd6e2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:38.588735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-629739cc-e41f-4e3d-9751-241cf2fcd6e2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:38.589619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-629739cc-e41f-4e3d-9751-241cf2fcd6e2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:38.590101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-629739cc-e41f-4e3d-9751-241cf2fcd6e2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:38.770166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-629739cc-e41f-4e3d-9751-241cf2fcd6e2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:38.776255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-629739cc-e41f-4e3d-9751-241cf2fcd6e2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:38.777788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-629739cc-e41f-4e3d-9751-241cf2fcd6e2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:38.778970 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-629739cc-e41f-4e3d-9751-241cf2fcd6e2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1721 microversion: 2.20 time: 0.209854 May 28 05:12:38.779682 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3103/6319] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:38 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:39.398921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6597ccbf-9021-435e-a0fc-24610b6e5622 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:39.399995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6597ccbf-9021-435e-a0fc-24610b6e5622 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:39.408683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6597ccbf-9021-435e-a0fc-24610b6e5622 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:39.409260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6597ccbf-9021-435e-a0fc-24610b6e5622 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:39.411038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6597ccbf-9021-435e-a0fc-24610b6e5622 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:39.411605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6597ccbf-9021-435e-a0fc-24610b6e5622 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:39.571974 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6597ccbf-9021-435e-a0fc-24610b6e5622 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1464 microversion: 2.1 time: 0.179256 May 28 05:12:39.572827 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3217/6320] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:39 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1464 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:39.797582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-988524d4-1750-4453-803f-74ac02b5706e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:39.798203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-988524d4-1750-4453-803f-74ac02b5706e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:39.817002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-988524d4-1750-4453-803f-74ac02b5706e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:39.818467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-988524d4-1750-4453-803f-74ac02b5706e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:39.819837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-988524d4-1750-4453-803f-74ac02b5706e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:39.820462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-988524d4-1750-4453-803f-74ac02b5706e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:40.285446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-988524d4-1750-4453-803f-74ac02b5706e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:40.294713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-988524d4-1750-4453-803f-74ac02b5706e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:40.296678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-988524d4-1750-4453-803f-74ac02b5706e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:40.298070 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-988524d4-1750-4453-803f-74ac02b5706e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1721 microversion: 2.20 time: 0.504789 May 28 05:12:40.308962 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3104/6321] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:39 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1721 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:40.589242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-10a40ff6-5f77-4c55-be22-281a26ad02ee tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:40.596207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-10a40ff6-5f77-4c55-be22-281a26ad02ee tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:40.602309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-10a40ff6-5f77-4c55-be22-281a26ad02ee tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:40.602787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-10a40ff6-5f77-4c55-be22-281a26ad02ee tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:40.603621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-10a40ff6-5f77-4c55-be22-281a26ad02ee tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:40.604862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-10a40ff6-5f77-4c55-be22-281a26ad02ee tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:40.874843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:12:40.882691 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-10a40ff6-5f77-4c55-be22-281a26ad02ee tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1464 microversion: 2.1 time: 0.297223 May 28 05:12:40.883898 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3218/6322] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:40 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1464 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:41.317253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-418567ce-c6c1-47cc-978a-782b5add8965 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:41.317888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-418567ce-c6c1-47cc-978a-782b5add8965 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:41.325057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-418567ce-c6c1-47cc-978a-782b5add8965 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:41.325517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-418567ce-c6c1-47cc-978a-782b5add8965 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:41.326308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-418567ce-c6c1-47cc-978a-782b5add8965 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:41.326958 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-418567ce-c6c1-47cc-978a-782b5add8965 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:41.613722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-418567ce-c6c1-47cc-978a-782b5add8965 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:41.624313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-418567ce-c6c1-47cc-978a-782b5add8965 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:41.628573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-418567ce-c6c1-47cc-978a-782b5add8965 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:41.632620 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-418567ce-c6c1-47cc-978a-782b5add8965 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1721 microversion: 2.20 time: 0.317322 May 28 05:12:41.633625 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3105/6323] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:41 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1721 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:41.904910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4ae24dea-f35f-4d09-87f1-abcc091ecd27 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:41.904910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4ae24dea-f35f-4d09-87f1-abcc091ecd27 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:41.910076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ae24dea-f35f-4d09-87f1-abcc091ecd27 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:41.910616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ae24dea-f35f-4d09-87f1-abcc091ecd27 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:41.911620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ae24dea-f35f-4d09-87f1-abcc091ecd27 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:41.912140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ae24dea-f35f-4d09-87f1-abcc091ecd27 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:42.057401 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4ae24dea-f35f-4d09-87f1-abcc091ecd27 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1464 microversion: 2.1 time: 0.160806 May 28 05:12:42.067222 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3219/6324] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:41 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1464 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:42.258391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-053154df-65c1-4967-aaba-ef8b19fb8944 req-70c94e24-e23f-41a9-ab2e-29505589b291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a9fae4-6e78-4825-abed-c2dabb885814", "name": "network-vif-plugged", "status": "completed", "tag": "cdb65ee2-58da-4347-b35a-2df3e1f8c6cc"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:12:42.269325 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-053154df-65c1-4967-aaba-ef8b19fb8944 req-70c94e24-e23f-41a9-ab2e-29505589b291 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:42.270181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-053154df-65c1-4967-aaba-ef8b19fb8944 req-70c94e24-e23f-41a9-ab2e-29505589b291 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:42.298369 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-053154df-65c1-4967-aaba-ef8b19fb8944 req-70c94e24-e23f-41a9-ab2e-29505589b291 service nova] Creating event network-vif-plugged:cdb65ee2-58da-4347-b35a-2df3e1f8c6cc for instance 13a9fae4-6e78-4825-abed-c2dabb885814 on n-h1-843700-1 May 28 05:12:42.315916 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-053154df-65c1-4967-aaba-ef8b19fb8944 req-70c94e24-e23f-41a9-ab2e-29505589b291 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058176 May 28 05:12:42.316877 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3106/6325] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:12:42.652986 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-452ad5c9-86f4-4429-9558-bd7516085fee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:42.653615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-452ad5c9-86f4-4429-9558-bd7516085fee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:42.660446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-452ad5c9-86f4-4429-9558-bd7516085fee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:42.662468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-452ad5c9-86f4-4429-9558-bd7516085fee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:42.662468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-452ad5c9-86f4-4429-9558-bd7516085fee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:42.662468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-452ad5c9-86f4-4429-9558-bd7516085fee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:42.892671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-452ad5c9-86f4-4429-9558-bd7516085fee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:42.901608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-452ad5c9-86f4-4429-9558-bd7516085fee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:42.903394 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-452ad5c9-86f4-4429-9558-bd7516085fee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:42.904736 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-452ad5c9-86f4-4429-9558-bd7516085fee tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1742 microversion: 2.20 time: 0.256809 May 28 05:12:42.905414 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3220/6326] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:42 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1742 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:43.074885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0d0f2402-6845-4791-bad1-ed3d23597246 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:43.075626 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0d0f2402-6845-4791-bad1-ed3d23597246 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:43.083572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d0f2402-6845-4791-bad1-ed3d23597246 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:43.088531 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d0f2402-6845-4791-bad1-ed3d23597246 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:43.088531 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d0f2402-6845-4791-bad1-ed3d23597246 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:43.088531 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d0f2402-6845-4791-bad1-ed3d23597246 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:43.620158 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0d0f2402-6845-4791-bad1-ed3d23597246 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1464 microversion: 2.1 time: 0.545687 May 28 05:12:43.631624 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3107/6327] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:43 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1464 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:43.928753 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9ed4de01-d05e-447e-a135-4c018fb91bc8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:43.930101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9ed4de01-d05e-447e-a135-4c018fb91bc8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:43.940144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ed4de01-d05e-447e-a135-4c018fb91bc8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:43.942611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ed4de01-d05e-447e-a135-4c018fb91bc8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:43.944864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ed4de01-d05e-447e-a135-4c018fb91bc8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:43.945429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ed4de01-d05e-447e-a135-4c018fb91bc8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:44.137744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9ed4de01-d05e-447e-a135-4c018fb91bc8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:44.149295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9ed4de01-d05e-447e-a135-4c018fb91bc8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:44.151257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9ed4de01-d05e-447e-a135-4c018fb91bc8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:44.152977 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9ed4de01-d05e-447e-a135-4c018fb91bc8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1737 microversion: 2.20 time: 0.231612 May 28 05:12:44.153765 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3221/6328] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:43 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:44.640671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8dc537f4-9f40-45da-b0fe-d80ec14ac940 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:44.642133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8dc537f4-9f40-45da-b0fe-d80ec14ac940 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:44.651833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8dc537f4-9f40-45da-b0fe-d80ec14ac940 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:44.657090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8dc537f4-9f40-45da-b0fe-d80ec14ac940 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:44.657090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8dc537f4-9f40-45da-b0fe-d80ec14ac940 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:44.657090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8dc537f4-9f40-45da-b0fe-d80ec14ac940 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:45.174064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-830b73e3-971b-4932-ac69-76a51f5a0647 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:45.174700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-830b73e3-971b-4932-ac69-76a51f5a0647 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:45.191899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-830b73e3-971b-4932-ac69-76a51f5a0647 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:45.192381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-830b73e3-971b-4932-ac69-76a51f5a0647 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:45.195559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-830b73e3-971b-4932-ac69-76a51f5a0647 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:45.197513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-830b73e3-971b-4932-ac69-76a51f5a0647 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:45.211038 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8dc537f4-9f40-45da-b0fe-d80ec14ac940 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1649 microversion: 2.1 time: 0.574883 May 28 05:12:45.227628 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3108/6329] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:44 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1649 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:45.257438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-34c1a0de-7527-4b8f-aa92-446e09335b3c tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:45.258153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-34c1a0de-7527-4b8f-aa92-446e09335b3c tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:45.276540 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34c1a0de-7527-4b8f-aa92-446e09335b3c tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:45.277011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34c1a0de-7527-4b8f-aa92-446e09335b3c tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:45.283515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34c1a0de-7527-4b8f-aa92-446e09335b3c tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:45.283983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34c1a0de-7527-4b8f-aa92-446e09335b3c tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:45.310083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:12:45.573382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-830b73e3-971b-4932-ac69-76a51f5a0647 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:45.585288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-830b73e3-971b-4932-ac69-76a51f5a0647 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:45.588895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-830b73e3-971b-4932-ac69-76a51f5a0647 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:45.591949 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-830b73e3-971b-4932-ac69-76a51f5a0647 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1737 microversion: 2.20 time: 0.421528 May 28 05:12:45.599846 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3222/6330] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:45 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1737 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:45.639109 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-34c1a0de-7527-4b8f-aa92-446e09335b3c tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1649 microversion: 2.1 time: 0.407366 May 28 05:12:45.639712 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3109/6331] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:45 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1649 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:45.658550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bb48832f-91b3-4177-baed-88e7a101cde5 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:45.660208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bb48832f-91b3-4177-baed-88e7a101cde5 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:45.669870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb48832f-91b3-4177-baed-88e7a101cde5 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:45.688246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb48832f-91b3-4177-baed-88e7a101cde5 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:45.689109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb48832f-91b3-4177-baed-88e7a101cde5 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:45.689557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb48832f-91b3-4177-baed-88e7a101cde5 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:45.964197 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bb48832f-91b3-4177-baed-88e7a101cde5 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1649 microversion: 2.1 time: 0.309271 May 28 05:12:45.965672 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3223/6332] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:45 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1649 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:12:46.048677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9803bd81-f22f-4aea-bb4b-b1c0b7c7d566 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-420237650", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "availability_zone": "nova:n-h2-843700-1", "networks": [{"uuid": "5e99ce4f-3e92-4723-a596-fefb6ac97fba"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:12:46.168448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-9803bd81-f22f-4aea-bb4b-b1c0b7c7d566 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] validate_networks() for [('5e99ce4f-3e92-4723-a596-fefb6ac97fba', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:12:46.616703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-950178d5-075c-4b9b-bfed-9a7f0f4b6314 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:46.617332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-950178d5-075c-4b9b-bfed-9a7f0f4b6314 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:46.632534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-950178d5-075c-4b9b-bfed-9a7f0f4b6314 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:46.633273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-950178d5-075c-4b9b-bfed-9a7f0f4b6314 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:46.634250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-950178d5-075c-4b9b-bfed-9a7f0f4b6314 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:46.634861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-950178d5-075c-4b9b-bfed-9a7f0f4b6314 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:47.154945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-9803bd81-f22f-4aea-bb4b-b1c0b7c7d566 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:12:47.155948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-9803bd81-f22f-4aea-bb4b-b1c0b7c7d566 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:12:47.156722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-9803bd81-f22f-4aea-bb4b-b1c0b7c7d566 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:12:47.157322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-9803bd81-f22f-4aea-bb4b-b1c0b7c7d566 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:12:47.157913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-9803bd81-f22f-4aea-bb4b-b1c0b7c7d566 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:12:47.178523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9803bd81-f22f-4aea-bb4b-b1c0b7c7d566 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:47.179202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9803bd81-f22f-4aea-bb4b-b1c0b7c7d566 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:47.180189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9803bd81-f22f-4aea-bb4b-b1c0b7c7d566 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:47.180838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9803bd81-f22f-4aea-bb4b-b1c0b7c7d566 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:47.213355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-9803bd81-f22f-4aea-bb4b-b1c0b7c7d566 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Getting quotas for project b0b82c906a4948ec9a7bb03b72afdeb8. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:12:47.232962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-9803bd81-f22f-4aea-bb4b-b1c0b7c7d566 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Getting quotas for user 2d95fb8ce10e415583f40baa36b6bec9 and project b0b82c906a4948ec9a7bb03b72afdeb8. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:12:47.268675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9803bd81-f22f-4aea-bb4b-b1c0b7c7d566 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:12:47.274085 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9803bd81-f22f-4aea-bb4b-b1c0b7c7d566 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:12:47.511232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-950178d5-075c-4b9b-bfed-9a7f0f4b6314 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:47.511232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-950178d5-075c-4b9b-bfed-9a7f0f4b6314 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:47.511232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-950178d5-075c-4b9b-bfed-9a7f0f4b6314 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:47.511232 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-950178d5-075c-4b9b-bfed-9a7f0f4b6314 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1737 microversion: 2.20 time: 0.851656 May 28 05:12:47.511232 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3224/6333] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:46 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1737 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:12:47.628920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-39c2374d-5b44-45ab-9865-354bc0a7d128 req-660c170f-3f5e-40bc-bce1-bc75f62ffaf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d6e344-40d2-4d47-95b5-c3be216f08d8", "name": "network-vif-plugged", "status": "completed", "tag": "e3181171-bf41-4341-bf54-3e1757a628c1"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:12:47.633365 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9803bd81-f22f-4aea-bb4b-b1c0b7c7d566 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.588953 May 28 05:12:47.639015 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3110/6334] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:12:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 05:12:47.639203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-39c2374d-5b44-45ab-9865-354bc0a7d128 req-660c170f-3f5e-40bc-bce1-bc75f62ffaf4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:47.639824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-39c2374d-5b44-45ab-9865-354bc0a7d128 req-660c170f-3f5e-40bc-bce1-bc75f62ffaf4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:47.650969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-565c83b9-e267-42a8-9769-8ab3f7da65d0 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:47.654699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-565c83b9-e267-42a8-9769-8ab3f7da65d0 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:47.686857 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-39c2374d-5b44-45ab-9865-354bc0a7d128 req-660c170f-3f5e-40bc-bce1-bc75f62ffaf4 service nova] Creating event network-vif-plugged:e3181171-bf41-4341-bf54-3e1757a628c1 for instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 on n-h2-843700-1 May 28 05:12:47.710471 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-39c2374d-5b44-45ab-9865-354bc0a7d128 req-660c170f-3f5e-40bc-bce1-bc75f62ffaf4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082419 May 28 05:12:47.713835 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3225/6335] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:12:47.783765 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-565c83b9-e267-42a8-9769-8ab3f7da65d0 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2" status: 200 len: 1328 microversion: 2.1 time: 0.136470 May 28 05:12:47.784394 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3111/6336] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:47 2022] GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 => generated 1328 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:48.484468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1bdb1d20-2f0c-4a8f-9a3d-e3de6f7495d1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:48.485254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1bdb1d20-2f0c-4a8f-9a3d-e3de6f7495d1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:48.513063 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1bdb1d20-2f0c-4a8f-9a3d-e3de6f7495d1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:48.517641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1bdb1d20-2f0c-4a8f-9a3d-e3de6f7495d1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:48.526707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1bdb1d20-2f0c-4a8f-9a3d-e3de6f7495d1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:48.527910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1bdb1d20-2f0c-4a8f-9a3d-e3de6f7495d1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:48.802554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fbcaf7cb-29dc-40fd-bb72-cbeaf7de88d9 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:48.804855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fbcaf7cb-29dc-40fd-bb72-cbeaf7de88d9 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:49.087111 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fbcaf7cb-29dc-40fd-bb72-cbeaf7de88d9 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2" status: 200 len: 1328 microversion: 2.1 time: 0.289151 May 28 05:12:49.092288 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3112/6337] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:48 2022] GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 => generated 1328 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:12:49.269857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1bdb1d20-2f0c-4a8f-9a3d-e3de6f7495d1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:49.283610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1bdb1d20-2f0c-4a8f-9a3d-e3de6f7495d1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:49.289541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1bdb1d20-2f0c-4a8f-9a3d-e3de6f7495d1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:49.290930 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1bdb1d20-2f0c-4a8f-9a3d-e3de6f7495d1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1737 microversion: 2.20 time: 0.812825 May 28 05:12:49.293751 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3226/6338] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:48 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1737 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:50.111210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-78acaa5d-0f7b-4458-a36d-2fda10562762 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:50.113145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-78acaa5d-0f7b-4458-a36d-2fda10562762 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:50.141297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78acaa5d-0f7b-4458-a36d-2fda10562762 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:50.147346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78acaa5d-0f7b-4458-a36d-2fda10562762 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:50.155707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78acaa5d-0f7b-4458-a36d-2fda10562762 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:50.156532 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78acaa5d-0f7b-4458-a36d-2fda10562762 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:50.315992 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d0360223-e6a3-46b0-a2fc-a49e338e41aa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:50.316976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d0360223-e6a3-46b0-a2fc-a49e338e41aa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:50.332011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:12:50.341654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d0360223-e6a3-46b0-a2fc-a49e338e41aa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:50.348062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d0360223-e6a3-46b0-a2fc-a49e338e41aa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:50.349774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d0360223-e6a3-46b0-a2fc-a49e338e41aa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:50.357917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d0360223-e6a3-46b0-a2fc-a49e338e41aa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:50.379510 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-78acaa5d-0f7b-4458-a36d-2fda10562762 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2" status: 200 len: 1415 microversion: 2.1 time: 0.269766 May 28 05:12:50.379510 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3113/6339] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:50 2022] GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 => generated 1415 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:50.796792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d0360223-e6a3-46b0-a2fc-a49e338e41aa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:50.806719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d0360223-e6a3-46b0-a2fc-a49e338e41aa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:50.874315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d0360223-e6a3-46b0-a2fc-a49e338e41aa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:50.883697 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d0360223-e6a3-46b0-a2fc-a49e338e41aa tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1737 microversion: 2.20 time: 0.568603 May 28 05:12:50.886314 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3227/6340] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:50 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1737 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:12:51.395498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4408a3dd-4aaa-4ca5-9db9-22f7b8bf17b2 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:51.397333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4408a3dd-4aaa-4ca5-9db9-22f7b8bf17b2 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:51.400694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:12:51.420485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4408a3dd-4aaa-4ca5-9db9-22f7b8bf17b2 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:51.424284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4408a3dd-4aaa-4ca5-9db9-22f7b8bf17b2 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:51.428911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4408a3dd-4aaa-4ca5-9db9-22f7b8bf17b2 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:51.429718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4408a3dd-4aaa-4ca5-9db9-22f7b8bf17b2 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:51.915006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ac6e38af-845f-427c-9717-8e1fac648f34 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:51.916688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ac6e38af-845f-427c-9717-8e1fac648f34 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:51.947208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac6e38af-845f-427c-9717-8e1fac648f34 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:51.948728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac6e38af-845f-427c-9717-8e1fac648f34 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:51.951132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac6e38af-845f-427c-9717-8e1fac648f34 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:51.951762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac6e38af-845f-427c-9717-8e1fac648f34 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:52.010183 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4408a3dd-4aaa-4ca5-9db9-22f7b8bf17b2 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2" status: 200 len: 1421 microversion: 2.1 time: 0.614131 May 28 05:12:52.011319 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3114/6341] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:51 2022] GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 => generated 1421 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:53.026584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-669bcd3e-9ae6-4f9f-a32e-885b223ea969 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:53.028448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-669bcd3e-9ae6-4f9f-a32e-885b223ea969 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:53.064585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-669bcd3e-9ae6-4f9f-a32e-885b223ea969 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:53.065084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-669bcd3e-9ae6-4f9f-a32e-885b223ea969 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:53.068888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-669bcd3e-9ae6-4f9f-a32e-885b223ea969 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:53.074140 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-669bcd3e-9ae6-4f9f-a32e-885b223ea969 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:53.264904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ac6e38af-845f-427c-9717-8e1fac648f34 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:53.338772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ac6e38af-845f-427c-9717-8e1fac648f34 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:53.340519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ac6e38af-845f-427c-9717-8e1fac648f34 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:53.342258 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ac6e38af-845f-427c-9717-8e1fac648f34 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1737 microversion: 2.20 time: 1.434129 May 28 05:12:53.343318 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3228/6342] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:51 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1737 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:12:53.480324 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-669bcd3e-9ae6-4f9f-a32e-885b223ea969 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2" status: 200 len: 1421 microversion: 2.1 time: 0.456095 May 28 05:12:53.481711 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3115/6343] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:53 2022] GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 => generated 1421 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:54.377479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3f0b444b-863c-4890-a3f0-9cac268bfc3b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:54.379485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3f0b444b-863c-4890-a3f0-9cac268bfc3b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:54.408718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f0b444b-863c-4890-a3f0-9cac268bfc3b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:54.417879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f0b444b-863c-4890-a3f0-9cac268bfc3b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:54.417879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f0b444b-863c-4890-a3f0-9cac268bfc3b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:54.417879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f0b444b-863c-4890-a3f0-9cac268bfc3b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:54.497629 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-68fa2e45-4b8b-4fef-8cd2-88fcbd0bc103 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:54.498232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-68fa2e45-4b8b-4fef-8cd2-88fcbd0bc103 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:54.527525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68fa2e45-4b8b-4fef-8cd2-88fcbd0bc103 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:54.528244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68fa2e45-4b8b-4fef-8cd2-88fcbd0bc103 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:54.529562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68fa2e45-4b8b-4fef-8cd2-88fcbd0bc103 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:54.531324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68fa2e45-4b8b-4fef-8cd2-88fcbd0bc103 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:55.339297 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-68fa2e45-4b8b-4fef-8cd2-88fcbd0bc103 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2" status: 200 len: 1463 microversion: 2.1 time: 0.845294 May 28 05:12:55.348707 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3116/6344] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:54 2022] GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 => generated 1463 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:55.591435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3f0b444b-863c-4890-a3f0-9cac268bfc3b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:55.608400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3f0b444b-863c-4890-a3f0-9cac268bfc3b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:55.626626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3f0b444b-863c-4890-a3f0-9cac268bfc3b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:55.634143 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3f0b444b-863c-4890-a3f0-9cac268bfc3b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1737 microversion: 2.20 time: 1.271541 May 28 05:12:55.637193 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3229/6345] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:54 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1737 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:56.358587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-25674d6d-0990-4971-b289-d2b31f1efa15 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:56.361082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-25674d6d-0990-4971-b289-d2b31f1efa15 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:56.380522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25674d6d-0990-4971-b289-d2b31f1efa15 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:56.383093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25674d6d-0990-4971-b289-d2b31f1efa15 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:56.390269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25674d6d-0990-4971-b289-d2b31f1efa15 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:56.393288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25674d6d-0990-4971-b289-d2b31f1efa15 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:56.653589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-78b943c4-8f46-4061-aad5-6593ac85d15a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:56.654212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-78b943c4-8f46-4061-aad5-6593ac85d15a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:56.671140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78b943c4-8f46-4061-aad5-6593ac85d15a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:56.676963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78b943c4-8f46-4061-aad5-6593ac85d15a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:56.678191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78b943c4-8f46-4061-aad5-6593ac85d15a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:56.678659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-78b943c4-8f46-4061-aad5-6593ac85d15a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:57.203065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:12:57.694684 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-25674d6d-0990-4971-b289-d2b31f1efa15 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2" status: 200 len: 1463 microversion: 2.1 time: 1.341182 May 28 05:12:57.698448 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3117/6346] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:56 2022] GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 => generated 1463 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:57.709871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-116e8b15-ec48-49a3-b422-98f2e737a3f6 req-263b30e3-c642-4c17-b056-2a0f4dc85aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da29584d-5950-4b52-b9c4-e86ae22b02d2", "tag": "cd6ce50c-d596-429b-8d66-b75bfb5fceeb"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:12:57.731115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-116e8b15-ec48-49a3-b422-98f2e737a3f6 req-263b30e3-c642-4c17-b056-2a0f4dc85aa9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:57.731802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-116e8b15-ec48-49a3-b422-98f2e737a3f6 req-263b30e3-c642-4c17-b056-2a0f4dc85aa9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:57.757382 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-116e8b15-ec48-49a3-b422-98f2e737a3f6 req-263b30e3-c642-4c17-b056-2a0f4dc85aa9 service nova] Creating event network-changed:cd6ce50c-d596-429b-8d66-b75bfb5fceeb for instance da29584d-5950-4b52-b9c4-e86ae22b02d2 on n-h2-843700-1 May 28 05:12:57.770886 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-116e8b15-ec48-49a3-b422-98f2e737a3f6 req-263b30e3-c642-4c17-b056-2a0f4dc85aa9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066549 May 28 05:12:57.773208 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3118/6347] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:12:57.837921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-78b943c4-8f46-4061-aad5-6593ac85d15a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:57.845097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-78b943c4-8f46-4061-aad5-6593ac85d15a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:57.847704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-78b943c4-8f46-4061-aad5-6593ac85d15a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:57.849314 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-78b943c4-8f46-4061-aad5-6593ac85d15a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1737 microversion: 2.20 time: 1.199614 May 28 05:12:57.850981 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3230/6348] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:56 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1737 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:12:58.716197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e1e4078a-af77-493b-b5ba-529547ba95d7 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:58.716933 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e1e4078a-af77-493b-b5ba-529547ba95d7 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:58.730982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e1e4078a-af77-493b-b5ba-529547ba95d7 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:58.731472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e1e4078a-af77-493b-b5ba-529547ba95d7 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:58.732285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e1e4078a-af77-493b-b5ba-529547ba95d7 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:58.732730 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e1e4078a-af77-493b-b5ba-529547ba95d7 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:58.867969 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-432ad867-fc57-4c5a-8424-cb9b00cd3a4b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:12:58.868615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-432ad867-fc57-4c5a-8424-cb9b00cd3a4b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:12:58.879148 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-432ad867-fc57-4c5a-8424-cb9b00cd3a4b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:58.891285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-432ad867-fc57-4c5a-8424-cb9b00cd3a4b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:58.892307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-432ad867-fc57-4c5a-8424-cb9b00cd3a4b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:12:58.892775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-432ad867-fc57-4c5a-8424-cb9b00cd3a4b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:12:59.086478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=10 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:12:59.211686 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e1e4078a-af77-493b-b5ba-529547ba95d7 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2" status: 200 len: 1463 microversion: 2.1 time: 0.500278 May 28 05:12:59.225344 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3119/6349] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:12:58 2022] GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 => generated 1463 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:12:59.354382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-432ad867-fc57-4c5a-8424-cb9b00cd3a4b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:59.386318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-432ad867-fc57-4c5a-8424-cb9b00cd3a4b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:59.388859 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-432ad867-fc57-4c5a-8424-cb9b00cd3a4b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:12:59.394338 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-432ad867-fc57-4c5a-8424-cb9b00cd3a4b tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1737 microversion: 2.20 time: 0.530205 May 28 05:12:59.394976 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3231/6350] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:12:58 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1737 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:13:00.230755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-be6e8030-3b6e-4f76-a3cf-6bd63a65e721 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:00.231516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-be6e8030-3b6e-4f76-a3cf-6bd63a65e721 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:00.245538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-be6e8030-3b6e-4f76-a3cf-6bd63a65e721 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:00.250563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-be6e8030-3b6e-4f76-a3cf-6bd63a65e721 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:00.259072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-be6e8030-3b6e-4f76-a3cf-6bd63a65e721 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:00.259814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-be6e8030-3b6e-4f76-a3cf-6bd63a65e721 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:00.413739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-96295019-ae1d-4cd1-902c-0811694f1bc7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:00.415604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-96295019-ae1d-4cd1-902c-0811694f1bc7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:00.430165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96295019-ae1d-4cd1-902c-0811694f1bc7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:00.431596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96295019-ae1d-4cd1-902c-0811694f1bc7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:00.434664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96295019-ae1d-4cd1-902c-0811694f1bc7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:00.435332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96295019-ae1d-4cd1-902c-0811694f1bc7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:00.890067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-96295019-ae1d-4cd1-902c-0811694f1bc7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:00.911130 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-be6e8030-3b6e-4f76-a3cf-6bd63a65e721 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2" status: 200 len: 1463 microversion: 2.1 time: 0.684277 May 28 05:13:00.926134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-96295019-ae1d-4cd1-902c-0811694f1bc7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:00.926715 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3120/6351] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:13:00 2022] GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 => generated 1463 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:13:00.928758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-96295019-ae1d-4cd1-902c-0811694f1bc7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:00.933436 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-96295019-ae1d-4cd1-902c-0811694f1bc7 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1737 microversion: 2.20 time: 0.524912 May 28 05:13:00.938927 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3232/6352] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:00 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1737 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:01.933923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6e41ac88-d773-4526-9fbb-310bd93b8081 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:01.934552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6e41ac88-d773-4526-9fbb-310bd93b8081 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:01.964352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d417dc51-60f7-48bf-bb97-a2e08f47789f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:01.966628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d417dc51-60f7-48bf-bb97-a2e08f47789f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:01.970219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6e41ac88-d773-4526-9fbb-310bd93b8081 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:01.970686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6e41ac88-d773-4526-9fbb-310bd93b8081 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:01.978774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6e41ac88-d773-4526-9fbb-310bd93b8081 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:01.979277 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6e41ac88-d773-4526-9fbb-310bd93b8081 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:01.999712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d417dc51-60f7-48bf-bb97-a2e08f47789f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:02.000564 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d417dc51-60f7-48bf-bb97-a2e08f47789f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:02.008132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d417dc51-60f7-48bf-bb97-a2e08f47789f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:02.008826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d417dc51-60f7-48bf-bb97-a2e08f47789f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:02.340891 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6e41ac88-d773-4526-9fbb-310bd93b8081 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2" status: 200 len: 1463 microversion: 2.1 time: 0.411453 May 28 05:13:02.342069 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3121/6353] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:13:01 2022] GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 => generated 1463 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:13:02.356643 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d417dc51-60f7-48bf-bb97-a2e08f47789f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:02.372518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d417dc51-60f7-48bf-bb97-a2e08f47789f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:02.374162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d417dc51-60f7-48bf-bb97-a2e08f47789f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:02.375409 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d417dc51-60f7-48bf-bb97-a2e08f47789f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1737 microversion: 2.20 time: 0.416587 May 28 05:13:02.381978 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3233/6354] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:01 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1737 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:13:03.365413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b29d039e-059d-4963-b07f-0a1f8d1a40cb tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:03.366129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b29d039e-059d-4963-b07f-0a1f8d1a40cb tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:03.378957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b29d039e-059d-4963-b07f-0a1f8d1a40cb tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:03.382642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b29d039e-059d-4963-b07f-0a1f8d1a40cb tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:03.384221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b29d039e-059d-4963-b07f-0a1f8d1a40cb tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:03.387618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b29d039e-059d-4963-b07f-0a1f8d1a40cb tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:03.400275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-499e0106-9773-4350-86ed-e654cd0f58f8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:03.400980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-499e0106-9773-4350-86ed-e654cd0f58f8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:03.417856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-499e0106-9773-4350-86ed-e654cd0f58f8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:03.423463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-499e0106-9773-4350-86ed-e654cd0f58f8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:03.425574 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-499e0106-9773-4350-86ed-e654cd0f58f8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:03.430123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-499e0106-9773-4350-86ed-e654cd0f58f8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:03.963217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-499e0106-9773-4350-86ed-e654cd0f58f8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:03.977673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-499e0106-9773-4350-86ed-e654cd0f58f8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:03.980674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-499e0106-9773-4350-86ed-e654cd0f58f8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:03.981904 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-499e0106-9773-4350-86ed-e654cd0f58f8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1737 microversion: 2.20 time: 0.585912 May 28 05:13:03.992272 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3234/6355] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:03 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1737 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:04.004883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-58abc2f2-f3be-4f69-8f3e-0f159f6fa00b req-ad97071f-e438-43a0-acf1-10d4a1b766fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da29584d-5950-4b52-b9c4-e86ae22b02d2", "name": "network-vif-plugged", "status": "completed", "tag": "cd6ce50c-d596-429b-8d66-b75bfb5fceeb"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:13:04.038432 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b29d039e-059d-4963-b07f-0a1f8d1a40cb tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2" status: 200 len: 1463 microversion: 2.1 time: 0.681833 May 28 05:13:04.052866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-58abc2f2-f3be-4f69-8f3e-0f159f6fa00b req-ad97071f-e438-43a0-acf1-10d4a1b766fa service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:04.053161 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3122/6356] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:13:03 2022] GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 => generated 1463 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:13:04.054482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-58abc2f2-f3be-4f69-8f3e-0f159f6fa00b req-ad97071f-e438-43a0-acf1-10d4a1b766fa service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:04.075483 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-58abc2f2-f3be-4f69-8f3e-0f159f6fa00b req-ad97071f-e438-43a0-acf1-10d4a1b766fa service nova] Creating event network-vif-plugged:cd6ce50c-d596-429b-8d66-b75bfb5fceeb for instance da29584d-5950-4b52-b9c4-e86ae22b02d2 on n-h2-843700-1 May 28 05:13:04.087203 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-58abc2f2-f3be-4f69-8f3e-0f159f6fa00b req-ad97071f-e438-43a0-acf1-10d4a1b766fa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093633 May 28 05:13:04.088010 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3235/6357] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:13:05.012116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9ea3c471-30e5-47f5-8fde-db64670fd174 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:05.012800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9ea3c471-30e5-47f5-8fde-db64670fd174 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:05.031308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ea3c471-30e5-47f5-8fde-db64670fd174 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:05.031780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ea3c471-30e5-47f5-8fde-db64670fd174 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:05.032593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ea3c471-30e5-47f5-8fde-db64670fd174 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:05.037306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ea3c471-30e5-47f5-8fde-db64670fd174 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:05.056580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2d0fdc89-f98a-42f5-9475-ae4fdd00fa02 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:05.057302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2d0fdc89-f98a-42f5-9475-ae4fdd00fa02 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:05.072595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d0fdc89-f98a-42f5-9475-ae4fdd00fa02 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:05.073079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d0fdc89-f98a-42f5-9475-ae4fdd00fa02 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:05.073898 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d0fdc89-f98a-42f5-9475-ae4fdd00fa02 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:05.074360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d0fdc89-f98a-42f5-9475-ae4fdd00fa02 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:05.526897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:13:05.529471 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2d0fdc89-f98a-42f5-9475-ae4fdd00fa02 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2" status: 200 len: 1463 microversion: 2.1 time: 0.477465 May 28 05:13:05.533621 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3236/6358] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:13:05 2022] GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 => generated 1463 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:13:05.536244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9ea3c471-30e5-47f5-8fde-db64670fd174 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:05.572340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9ea3c471-30e5-47f5-8fde-db64670fd174 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:05.578132 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9ea3c471-30e5-47f5-8fde-db64670fd174 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:05.579685 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9ea3c471-30e5-47f5-8fde-db64670fd174 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1737 microversion: 2.20 time: 0.573381 May 28 05:13:05.586649 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3123/6359] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:05 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1737 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:06.551610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-165c313f-7a2b-428a-ac7d-93a1a84a9ebe tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:06.552778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-165c313f-7a2b-428a-ac7d-93a1a84a9ebe tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:06.564254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-165c313f-7a2b-428a-ac7d-93a1a84a9ebe tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:06.575747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-165c313f-7a2b-428a-ac7d-93a1a84a9ebe tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:06.576891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-165c313f-7a2b-428a-ac7d-93a1a84a9ebe tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:06.577515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-165c313f-7a2b-428a-ac7d-93a1a84a9ebe tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:06.598322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-59946da3-455d-4500-b7aa-10fca163a825 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:06.599605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-59946da3-455d-4500-b7aa-10fca163a825 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:06.610577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59946da3-455d-4500-b7aa-10fca163a825 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:06.615697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59946da3-455d-4500-b7aa-10fca163a825 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:06.616752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59946da3-455d-4500-b7aa-10fca163a825 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:06.617401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59946da3-455d-4500-b7aa-10fca163a825 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:07.073509 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-165c313f-7a2b-428a-ac7d-93a1a84a9ebe tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2" status: 200 len: 1649 microversion: 2.1 time: 0.518360 May 28 05:13:07.073509 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3237/6360] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:13:06 2022] GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 => generated 1649 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:13:07.092118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8fb569f5-54be-4709-823e-84ebd1f7c3d5 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:07.092968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8fb569f5-54be-4709-823e-84ebd1f7c3d5 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:07.099353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8fb569f5-54be-4709-823e-84ebd1f7c3d5 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:07.100105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8fb569f5-54be-4709-823e-84ebd1f7c3d5 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:07.100959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8fb569f5-54be-4709-823e-84ebd1f7c3d5 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:07.101615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8fb569f5-54be-4709-823e-84ebd1f7c3d5 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:07.113207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-59946da3-455d-4500-b7aa-10fca163a825 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:07.138201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-59946da3-455d-4500-b7aa-10fca163a825 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:07.148130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-59946da3-455d-4500-b7aa-10fca163a825 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:07.148130 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-59946da3-455d-4500-b7aa-10fca163a825 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1737 microversion: 2.20 time: 0.548733 May 28 05:13:07.159413 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3124/6361] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:06 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1737 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:07.478017 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8fb569f5-54be-4709-823e-84ebd1f7c3d5 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2" status: 200 len: 1649 microversion: 2.1 time: 0.392001 May 28 05:13:07.479083 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3238/6362] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:13:07 2022] GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 => generated 1649 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:13:07.497005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b53dc8e3-af12-49cc-996c-c7963a349753 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:07.497561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b53dc8e3-af12-49cc-996c-c7963a349753 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:07.512931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b53dc8e3-af12-49cc-996c-c7963a349753 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:07.513404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b53dc8e3-af12-49cc-996c-c7963a349753 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:07.519600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b53dc8e3-af12-49cc-996c-c7963a349753 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:07.520141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b53dc8e3-af12-49cc-996c-c7963a349753 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:07.934792 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b53dc8e3-af12-49cc-996c-c7963a349753 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2" status: 200 len: 1649 microversion: 2.1 time: 0.442858 May 28 05:13:07.937468 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3125/6363] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:13:07 2022] GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 => generated 1649 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:13:07.956375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-500d0e04-52e0-4706-961a-44c98fb6f8d0 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:07.957046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-500d0e04-52e0-4706-961a-44c98fb6f8d0 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:07.977496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-500d0e04-52e0-4706-961a-44c98fb6f8d0 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:07.987555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-500d0e04-52e0-4706-961a-44c98fb6f8d0 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:07.987555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-500d0e04-52e0-4706-961a-44c98fb6f8d0 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:07.987555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-500d0e04-52e0-4706-961a-44c98fb6f8d0 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:08.059361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-500d0e04-52e0-4706-961a-44c98fb6f8d0 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:13:08.166666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-de7a5cd6-7e36-4248-81a3-d11e6b8c15a3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:08.166666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-de7a5cd6-7e36-4248-81a3-d11e6b8c15a3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:08.175982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de7a5cd6-7e36-4248-81a3-d11e6b8c15a3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:08.177937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de7a5cd6-7e36-4248-81a3-d11e6b8c15a3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:08.213896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de7a5cd6-7e36-4248-81a3-d11e6b8c15a3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:08.214404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-de7a5cd6-7e36-4248-81a3-d11e6b8c15a3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:08.427761 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-500d0e04-52e0-4706-961a-44c98fb6f8d0 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "DELETE /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2" status: 204 len: 0 microversion: 2.1 time: 0.472365 May 28 05:13:08.429132 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3239/6364] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:13:07 2022] DELETE /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:13:08.443140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7f4d0953-edb2-4e2a-abf3-faca8764a7da tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:08.448211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7f4d0953-edb2-4e2a-abf3-faca8764a7da tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:08.467082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f4d0953-edb2-4e2a-abf3-faca8764a7da tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:08.469130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f4d0953-edb2-4e2a-abf3-faca8764a7da tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:08.469997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f4d0953-edb2-4e2a-abf3-faca8764a7da tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:08.470456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f4d0953-edb2-4e2a-abf3-faca8764a7da tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:08.619087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-de7a5cd6-7e36-4248-81a3-d11e6b8c15a3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:08.633405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-de7a5cd6-7e36-4248-81a3-d11e6b8c15a3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:08.640319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-de7a5cd6-7e36-4248-81a3-d11e6b8c15a3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:08.646426 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-de7a5cd6-7e36-4248-81a3-d11e6b8c15a3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1737 microversion: 2.20 time: 0.489882 May 28 05:13:08.657455 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3126/6365] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:08 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1737 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:08.869421 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7f4d0953-edb2-4e2a-abf3-faca8764a7da tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2" status: 200 len: 1655 microversion: 2.1 time: 0.434729 May 28 05:13:08.882029 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3240/6366] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:13:08 2022] GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 => generated 1655 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:13:09.678895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9a67cd46-1916-4b00-98f8-3228f87b8913 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:09.680239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9a67cd46-1916-4b00-98f8-3228f87b8913 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:09.697156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9a67cd46-1916-4b00-98f8-3228f87b8913 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:09.700087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9a67cd46-1916-4b00-98f8-3228f87b8913 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:09.701275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9a67cd46-1916-4b00-98f8-3228f87b8913 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:09.703852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9a67cd46-1916-4b00-98f8-3228f87b8913 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:09.888877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2ead78ca-6517-48d2-8ead-9c8d86b62175 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:09.889980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2ead78ca-6517-48d2-8ead-9c8d86b62175 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:09.904313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2ead78ca-6517-48d2-8ead-9c8d86b62175 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:09.906886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2ead78ca-6517-48d2-8ead-9c8d86b62175 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:09.908011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2ead78ca-6517-48d2-8ead-9c8d86b62175 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:09.909743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2ead78ca-6517-48d2-8ead-9c8d86b62175 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:10.594056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9a67cd46-1916-4b00-98f8-3228f87b8913 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:10.608086 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9a67cd46-1916-4b00-98f8-3228f87b8913 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:10.617272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9a67cd46-1916-4b00-98f8-3228f87b8913 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:10.620516 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9a67cd46-1916-4b00-98f8-3228f87b8913 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1737 microversion: 2.20 time: 0.946571 May 28 05:13:10.625782 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3127/6367] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:09 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1737 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:10.684159 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2ead78ca-6517-48d2-8ead-9c8d86b62175 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2" status: 200 len: 1655 microversion: 2.1 time: 0.800105 May 28 05:13:10.699449 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3241/6368] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:13:09 2022] GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 => generated 1655 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:13:10.856571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-6407f2fe-ad98-40f1-b3c8-c34d3048404d req-b8a6590e-dd6d-47fc-927b-279d72ff734b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da29584d-5950-4b52-b9c4-e86ae22b02d2", "name": "network-vif-deleted", "tag": "cd6ce50c-d596-429b-8d66-b75bfb5fceeb"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:13:10.905803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-6407f2fe-ad98-40f1-b3c8-c34d3048404d req-b8a6590e-dd6d-47fc-927b-279d72ff734b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:10.906278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-6407f2fe-ad98-40f1-b3c8-c34d3048404d req-b8a6590e-dd6d-47fc-927b-279d72ff734b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:10.943890 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-6407f2fe-ad98-40f1-b3c8-c34d3048404d req-b8a6590e-dd6d-47fc-927b-279d72ff734b service nova] Creating event network-vif-deleted:cd6ce50c-d596-429b-8d66-b75bfb5fceeb for instance da29584d-5950-4b52-b9c4-e86ae22b02d2 on n-h2-843700-1 May 28 05:13:11.021684 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-6407f2fe-ad98-40f1-b3c8-c34d3048404d req-b8a6590e-dd6d-47fc-927b-279d72ff734b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168620 May 28 05:13:11.068694 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3128/6369] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:13:11.644451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-796b7f83-8f63-4d5c-9274-dcbc49bd339e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:11.647175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-796b7f83-8f63-4d5c-9274-dcbc49bd339e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:11.655008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-796b7f83-8f63-4d5c-9274-dcbc49bd339e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:11.657929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-796b7f83-8f63-4d5c-9274-dcbc49bd339e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:11.659129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-796b7f83-8f63-4d5c-9274-dcbc49bd339e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:11.659795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-796b7f83-8f63-4d5c-9274-dcbc49bd339e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:11.708277 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b4ce0150-5496-45cd-b4bc-8a49170a22a2 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:11.709490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b4ce0150-5496-45cd-b4bc-8a49170a22a2 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:11.719035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b4ce0150-5496-45cd-b4bc-8a49170a22a2 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:11.726301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b4ce0150-5496-45cd-b4bc-8a49170a22a2 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:11.726301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b4ce0150-5496-45cd-b4bc-8a49170a22a2 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:11.726301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b4ce0150-5496-45cd-b4bc-8a49170a22a2 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:11.772542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b4ce0150-5496-45cd-b4bc-8a49170a22a2 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:11.773820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b4ce0150-5496-45cd-b4bc-8a49170a22a2 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:11.774630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-b4ce0150-5496-45cd-b4bc-8a49170a22a2 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lazy-loading 'fault' on Instance uuid da29584d-5950-4b52-b9c4-e86ae22b02d2 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:13:11.778944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:13:11.836930 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b4ce0150-5496-45cd-b4bc-8a49170a22a2 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2" status: 200 len: 1453 microversion: 2.1 time: 0.135682 May 28 05:13:11.852570 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3129/6370] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:13:11 2022] GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:13:11.863955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-796b7f83-8f63-4d5c-9274-dcbc49bd339e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:11.877062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-796b7f83-8f63-4d5c-9274-dcbc49bd339e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:11.880825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-796b7f83-8f63-4d5c-9274-dcbc49bd339e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:11.882959 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-796b7f83-8f63-4d5c-9274-dcbc49bd339e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1737 microversion: 2.20 time: 0.243289 May 28 05:13:11.885750 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3242/6371] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:11 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1737 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:12.861549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-20e24db9-bb8e-4204-9437-2d6db728bc8f tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:12.862882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-20e24db9-bb8e-4204-9437-2d6db728bc8f tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: da29584d-5950-4b52-b9c4-e86ae22b02d2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:12.878970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20e24db9-bb8e-4204-9437-2d6db728bc8f tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:12.880358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20e24db9-bb8e-4204-9437-2d6db728bc8f tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:12.881449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20e24db9-bb8e-4204-9437-2d6db728bc8f tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:12.882161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20e24db9-bb8e-4204-9437-2d6db728bc8f tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:12.900239 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-20e24db9-bb8e-4204-9437-2d6db728bc8f tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] HTTP exception thrown: Instance da29584d-5950-4b52-b9c4-e86ae22b02d2 could not be found. May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-20e24db9-bb8e-4204-9437-2d6db728bc8f tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Request method failure captured: May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 HTTP/1.1 May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABika84NFMDYhrxIXxQox6eIeigBUKop5nMNU45yNCrdgzeWyQ3dOQ8ZPVq9wZiskKA4maf31Y6JEryfgfFvFEshZxCcuFaLvxBnATWq2Uf2OQb3_buo673FItv7QcFp-P3jiobfQYgVBz99aajClmkvO6l3k2c8scax0RcAQ3nkBuyYcE May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: b0b82c906a4948ec9a7bb03b72afdeb8 May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestServerMultinode-696913159 May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: X-Role: admin,reader,member May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: admin,reader,member May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b0b82c906a4948ec9a7bb03b72afdeb8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b0b82c906a4948ec9a7bb03b72afdeb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b0b82c906a4948ec9a7bb03b72afdeb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b0b82c906a4948ec9a7bb03b72afdeb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestServerMultinode-696913159 May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: b0b82c906a4948ec9a7bb03b72afdeb8 May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestServerMultinode-696913159 May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestServerMultinode-696913159-project-admin May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 2d95fb8ce10e415583f40baa36b6bec9 May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestServerMultinode-696913159-project-admin May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance da29584d-5950-4b52-b9c4-e86ae22b02d2 could not be found. May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'da29584d-5950-4b52-b9c4-e86ae22b02d2'} May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da29584d-5950-4b52-b9c4-e86ae22b02d2 could not be found. May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da29584d-5950-4b52-b9c4-e86ae22b02d2 could not be found. May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:13:12.902709 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:13:12.908968 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:13:12.908968 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:13:12.908968 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:13:12.908968 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:13:12.908968 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:13:12.908968 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da29584d-5950-4b52-b9c4-e86ae22b02d2 could not be found. May 28 05:13:12.908968 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:13:12.910572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ca178434-5e68-40d9-aa59-a02a02de8368 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:12.910572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ca178434-5e68-40d9-aa59-a02a02de8368 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:12.912815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-20e24db9-bb8e-4204-9437-2d6db728bc8f tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Returning 404 to user: Instance da29584d-5950-4b52-b9c4-e86ae22b02d2 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:13:12.914505 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-20e24db9-bb8e-4204-9437-2d6db728bc8f tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2" status: 404 len: 111 microversion: 2.1 time: 0.058029 May 28 05:13:12.915451 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3130/6372] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:13:12 2022] GET /compute/v2.1/servers/da29584d-5950-4b52-b9c4-e86ae22b02d2 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:13:12.918423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca178434-5e68-40d9-aa59-a02a02de8368 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:12.918887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca178434-5e68-40d9-aa59-a02a02de8368 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:12.920464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca178434-5e68-40d9-aa59-a02a02de8368 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:12.920909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ca178434-5e68-40d9-aa59-a02a02de8368 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:12.927808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0e356b5d-ab74-4765-a9de-667a2d7e8b7d tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:12.929870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0e356b5d-ab74-4765-a9de-667a2d7e8b7d tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:12.941982 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e356b5d-ab74-4765-a9de-667a2d7e8b7d tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:12.944401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e356b5d-ab74-4765-a9de-667a2d7e8b7d tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:12.945360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e356b5d-ab74-4765-a9de-667a2d7e8b7d tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:12.945966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e356b5d-ab74-4765-a9de-667a2d7e8b7d tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:12.973758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0e356b5d-ab74-4765-a9de-667a2d7e8b7d tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:13:13.114882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ca178434-5e68-40d9-aa59-a02a02de8368 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:13.126439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ca178434-5e68-40d9-aa59-a02a02de8368 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:13.129431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ca178434-5e68-40d9-aa59-a02a02de8368 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:13.131780 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ca178434-5e68-40d9-aa59-a02a02de8368 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1719 microversion: 2.20 time: 0.232580 May 28 05:13:13.133185 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3243/6373] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:12 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1719 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:13:13.355830 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0e356b5d-ab74-4765-a9de-667a2d7e8b7d tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "DELETE /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 204 len: 0 microversion: 2.1 time: 0.435188 May 28 05:13:13.360117 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3131/6374] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:13:12 2022] DELETE /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:13:13.365407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-11b249b6-89d0-40fe-b165-c7ab82690433 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:13.366225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-11b249b6-89d0-40fe-b165-c7ab82690433 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:13.374519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11b249b6-89d0-40fe-b165-c7ab82690433 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:13.375219 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11b249b6-89d0-40fe-b165-c7ab82690433 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:13.376202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11b249b6-89d0-40fe-b165-c7ab82690433 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:13.376820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-11b249b6-89d0-40fe-b165-c7ab82690433 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:13.545316 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-11b249b6-89d0-40fe-b165-c7ab82690433 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1655 microversion: 2.1 time: 0.183653 May 28 05:13:13.545917 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3244/6375] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:13:13 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1655 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:13:14.151545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ac934573-f82c-48af-b666-fda70706a77d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:14.152313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ac934573-f82c-48af-b666-fda70706a77d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:14.164553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ac934573-f82c-48af-b666-fda70706a77d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:14.165313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ac934573-f82c-48af-b666-fda70706a77d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:14.166184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ac934573-f82c-48af-b666-fda70706a77d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:14.166808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ac934573-f82c-48af-b666-fda70706a77d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:14.333522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ac934573-f82c-48af-b666-fda70706a77d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:14.343809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ac934573-f82c-48af-b666-fda70706a77d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:14.345671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ac934573-f82c-48af-b666-fda70706a77d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:14.347814 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ac934573-f82c-48af-b666-fda70706a77d tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1719 microversion: 2.20 time: 0.200484 May 28 05:13:14.349532 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3132/6376] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:14 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1719 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:14.563969 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2d35a73f-dcc1-457c-a032-3b4716ff93c6 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:14.564636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2d35a73f-dcc1-457c-a032-3b4716ff93c6 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:14.578404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d35a73f-dcc1-457c-a032-3b4716ff93c6 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:14.578896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d35a73f-dcc1-457c-a032-3b4716ff93c6 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:14.581557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d35a73f-dcc1-457c-a032-3b4716ff93c6 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:14.582058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2d35a73f-dcc1-457c-a032-3b4716ff93c6 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:14.934749 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2d35a73f-dcc1-457c-a032-3b4716ff93c6 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1655 microversion: 2.1 time: 0.375628 May 28 05:13:14.935386 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3245/6377] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:13:14 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1655 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:13:15.366808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4ce1e5de-7f46-40bd-94da-37da585c6245 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:15.367445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4ce1e5de-7f46-40bd-94da-37da585c6245 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:15.384105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4ce1e5de-7f46-40bd-94da-37da585c6245 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:15.384885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4ce1e5de-7f46-40bd-94da-37da585c6245 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:15.385846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4ce1e5de-7f46-40bd-94da-37da585c6245 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:15.386450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4ce1e5de-7f46-40bd-94da-37da585c6245 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:15.583350 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e3bc1e75-fe01-4db2-9bcc-2f3040961804 req-63e684fd-366a-4d7f-86bd-adcb4302c58b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a9fae4-6e78-4825-abed-c2dabb885814", "name": "network-vif-deleted", "tag": "cdb65ee2-58da-4347-b35a-2df3e1f8c6cc"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:13:15.624343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e3bc1e75-fe01-4db2-9bcc-2f3040961804 req-63e684fd-366a-4d7f-86bd-adcb4302c58b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:15.624803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e3bc1e75-fe01-4db2-9bcc-2f3040961804 req-63e684fd-366a-4d7f-86bd-adcb4302c58b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:15.644798 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e3bc1e75-fe01-4db2-9bcc-2f3040961804 req-63e684fd-366a-4d7f-86bd-adcb4302c58b service nova] Creating event network-vif-deleted:cdb65ee2-58da-4347-b35a-2df3e1f8c6cc for instance 13a9fae4-6e78-4825-abed-c2dabb885814 on n-h1-843700-1 May 28 05:13:15.656046 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e3bc1e75-fe01-4db2-9bcc-2f3040961804 req-63e684fd-366a-4d7f-86bd-adcb4302c58b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077197 May 28 05:13:15.662983 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3246/6378] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:13:15.799397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4ce1e5de-7f46-40bd-94da-37da585c6245 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:15.810061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4ce1e5de-7f46-40bd-94da-37da585c6245 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:15.818003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4ce1e5de-7f46-40bd-94da-37da585c6245 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:15.822884 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4ce1e5de-7f46-40bd-94da-37da585c6245 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1722 microversion: 2.20 time: 0.456519 May 28 05:13:15.825119 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3133/6379] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:15 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1722 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:15.843487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ad0661c1-572c-4598-bc94-ee13e320c461 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b0b7f2b-4930-4b42-a38e-25f1514f9ff7"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:13:15.844964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ad0661c1-572c-4598-bc94-ee13e320c461 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:15.858586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad0661c1-572c-4598-bc94-ee13e320c461 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:15.859415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad0661c1-572c-4598-bc94-ee13e320c461 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:15.860415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad0661c1-572c-4598-bc94-ee13e320c461 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:15.861040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad0661c1-572c-4598-bc94-ee13e320c461 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:15.954006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5ee4952a-c573-4e77-af92-7b4909abbdd8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:15.954901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5ee4952a-c573-4e77-af92-7b4909abbdd8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:15.963743 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ee4952a-c573-4e77-af92-7b4909abbdd8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:15.965997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ee4952a-c573-4e77-af92-7b4909abbdd8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:15.967963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ee4952a-c573-4e77-af92-7b4909abbdd8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:15.970666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ee4952a-c573-4e77-af92-7b4909abbdd8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:16.059272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ee4952a-c573-4e77-af92-7b4909abbdd8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:16.059730 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ee4952a-c573-4e77-af92-7b4909abbdd8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:16.060191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-5ee4952a-c573-4e77-af92-7b4909abbdd8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lazy-loading 'fault' on Instance uuid 13a9fae4-6e78-4825-abed-c2dabb885814 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:13:16.318060 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5ee4952a-c573-4e77-af92-7b4909abbdd8 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 200 len: 1454 microversion: 2.1 time: 0.368007 May 28 05:13:16.318695 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3134/6380] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:13:15 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 1454 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:13:17.160777 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ad0661c1-572c-4598-bc94-ee13e320c461 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "POST /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.321736 May 28 05:13:17.168993 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3247/6381] 10.222.0.58 () {62 vars in 1363 bytes} [Sat May 28 05:13:15 2022] POST /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8/os-volume_attachments => generated 188 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:13:17.273358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-72d618f0-824e-4047-b8df-c0e7f6af3b41 req-9f2c2a9c-c357-491c-bd3f-523c460b9404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d6e344-40d2-4d47-95b5-c3be216f08d8", "name": "network-vif-unplugged", "status": "completed", "tag": "e3181171-bf41-4341-bf54-3e1757a628c1"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:13:17.300498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-72d618f0-824e-4047-b8df-c0e7f6af3b41 req-9f2c2a9c-c357-491c-bd3f-523c460b9404 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:17.304409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-72d618f0-824e-4047-b8df-c0e7f6af3b41 req-9f2c2a9c-c357-491c-bd3f-523c460b9404 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:17.324968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.compute.server_external_events [req-72d618f0-824e-4047-b8df-c0e7f6af3b41 req-9f2c2a9c-c357-491c-bd3f-523c460b9404 service nova] Unable to find a host for instance 03d6e344-40d2-4d47-95b5-c3be216f08d8. Dropping event network-vif-unplugged {{(pid=126043) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 28 05:13:17.324968 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-72d618f0-824e-4047-b8df-c0e7f6af3b41 req-9f2c2a9c-c357-491c-bd3f-523c460b9404 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.055539 May 28 05:13:17.327118 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3135/6382] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 62 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 28 05:13:17.339282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-51b60b08-b01a-439e-ba54-1ab095967991 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:17.340043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-51b60b08-b01a-439e-ba54-1ab095967991 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] [instance: 13a9fae4-6e78-4825-abed-c2dabb885814] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:17.351033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51b60b08-b01a-439e-ba54-1ab095967991 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:17.355542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51b60b08-b01a-439e-ba54-1ab095967991 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:17.356227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51b60b08-b01a-439e-ba54-1ab095967991 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:17.356771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51b60b08-b01a-439e-ba54-1ab095967991 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:17.396119 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-51b60b08-b01a-439e-ba54-1ab095967991 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] HTTP exception thrown: Instance 13a9fae4-6e78-4825-abed-c2dabb885814 could not be found. May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-51b60b08-b01a-439e-ba54-1ab095967991 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Request method failure captured: May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 HTTP/1.1 May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABika84NFMDYhrxIXxQox6eIeigBUKop5nMNU45yNCrdgzeWyQ3dOQ8ZPVq9wZiskKA4maf31Y6JEryfgfFvFEshZxCcuFaLvxBnATWq2Uf2OQb3_buo673FItv7QcFp-P3jiobfQYgVBz99aajClmkvO6l3k2c8scax0RcAQ3nkBuyYcE May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: b0b82c906a4948ec9a7bb03b72afdeb8 May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TestServerMultinode-696913159 May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b0b82c906a4948ec9a7bb03b72afdeb8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b0b82c906a4948ec9a7bb03b72afdeb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b0b82c906a4948ec9a7bb03b72afdeb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b0b82c906a4948ec9a7bb03b72afdeb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TestServerMultinode-696913159 May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: b0b82c906a4948ec9a7bb03b72afdeb8 May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TestServerMultinode-696913159 May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TestServerMultinode-696913159-project-admin May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 2d95fb8ce10e415583f40baa36b6bec9 May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TestServerMultinode-696913159-project-admin May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 13a9fae4-6e78-4825-abed-c2dabb885814 could not be found. May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '13a9fae4-6e78-4825-abed-c2dabb885814'} May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a9fae4-6e78-4825-abed-c2dabb885814 could not be found. May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a9fae4-6e78-4825-abed-c2dabb885814 could not be found. May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:13:17.397803 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:13:17.403284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:13:17.403284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:13:17.403284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:13:17.403284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:13:17.403284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:13:17.403284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a9fae4-6e78-4825-abed-c2dabb885814 could not be found. May 28 05:13:17.403284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:13:17.403284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-51b60b08-b01a-439e-ba54-1ab095967991 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] Returning 404 to user: Instance 13a9fae4-6e78-4825-abed-c2dabb885814 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:13:17.403284 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-51b60b08-b01a-439e-ba54-1ab095967991 tempest-TestServerMultinode-696913159 tempest-TestServerMultinode-696913159-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814" status: 404 len: 111 microversion: 2.1 time: 0.065576 May 28 05:13:17.404616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c9f30409-aaf0-4847-a7ad-bbac94714800 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:17.406246 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3248/6383] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:13:17 2022] GET /compute/v2.1/servers/13a9fae4-6e78-4825-abed-c2dabb885814 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:13:17.420737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c9f30409-aaf0-4847-a7ad-bbac94714800 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:17.430591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9f30409-aaf0-4847-a7ad-bbac94714800 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:17.430591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9f30409-aaf0-4847-a7ad-bbac94714800 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:17.431247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9f30409-aaf0-4847-a7ad-bbac94714800 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:17.431741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9f30409-aaf0-4847-a7ad-bbac94714800 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:18.362389 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c9f30409-aaf0-4847-a7ad-bbac94714800 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "DELETE /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8/os-volume_attachments/7b0b7f2b-4930-4b42-a38e-25f1514f9ff7" status: 202 len: 0 microversion: 2.20 time: 0.965837 May 28 05:13:18.365176 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3136/6384] 10.222.0.58 () {60 vars in 1456 bytes} [Sat May 28 05:13:17 2022] DELETE /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8/os-volume_attachments/7b0b7f2b-4930-4b42-a38e-25f1514f9ff7 => generated 0 bytes in 969 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 28 05:13:18.466388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f5b79817-8334-412f-a4fb-d8dff8548e6a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:13:18.466951 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f5b79817-8334-412f-a4fb-d8dff8548e6a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:18.477131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5b79817-8334-412f-a4fb-d8dff8548e6a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:18.477592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5b79817-8334-412f-a4fb-d8dff8548e6a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:18.478379 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5b79817-8334-412f-a4fb-d8dff8548e6a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:18.478827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5b79817-8334-412f-a4fb-d8dff8548e6a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:18.726646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:13:18.932312 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f5b79817-8334-412f-a4fb-d8dff8548e6a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "POST /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8/action" status: 202 len: 0 microversion: 2.20 time: 0.469747 May 28 05:13:18.941657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-50289c7c-05ad-4287-8449-0ea13654a56e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:18.943070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-50289c7c-05ad-4287-8449-0ea13654a56e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:18.948027 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3249/6385] 10.222.0.58 () {62 vars in 1318 bytes} [Sat May 28 05:13:18 2022] POST /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 05:13:18.951039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50289c7c-05ad-4287-8449-0ea13654a56e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:18.951039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50289c7c-05ad-4287-8449-0ea13654a56e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:18.953199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50289c7c-05ad-4287-8449-0ea13654a56e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:18.953835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50289c7c-05ad-4287-8449-0ea13654a56e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:19.279712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-50289c7c-05ad-4287-8449-0ea13654a56e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:19.291557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-50289c7c-05ad-4287-8449-0ea13654a56e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:19.293671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-50289c7c-05ad-4287-8449-0ea13654a56e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:19.295288 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-50289c7c-05ad-4287-8449-0ea13654a56e tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1670 microversion: 2.20 time: 0.357768 May 28 05:13:19.313133 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3137/6386] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:18 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1670 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:20.321873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1f77611f-2087-4e60-8ff5-15b893b8a5e3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:20.322488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1f77611f-2087-4e60-8ff5-15b893b8a5e3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:20.336016 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f77611f-2087-4e60-8ff5-15b893b8a5e3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:20.336705 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f77611f-2087-4e60-8ff5-15b893b8a5e3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:20.337660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f77611f-2087-4e60-8ff5-15b893b8a5e3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:20.340422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f77611f-2087-4e60-8ff5-15b893b8a5e3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:20.646027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1f77611f-2087-4e60-8ff5-15b893b8a5e3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:20.663223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1f77611f-2087-4e60-8ff5-15b893b8a5e3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:20.686624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1f77611f-2087-4e60-8ff5-15b893b8a5e3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:20.686624 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1f77611f-2087-4e60-8ff5-15b893b8a5e3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1670 microversion: 2.20 time: 0.349807 May 28 05:13:20.686624 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3250/6387] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:20 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1670 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 05:13:21.701787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6b7809d4-a614-46f9-8aaf-46d3bea6a889 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:21.703070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6b7809d4-a614-46f9-8aaf-46d3bea6a889 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:21.729757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b7809d4-a614-46f9-8aaf-46d3bea6a889 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:21.730225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b7809d4-a614-46f9-8aaf-46d3bea6a889 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:21.733286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b7809d4-a614-46f9-8aaf-46d3bea6a889 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:21.733756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b7809d4-a614-46f9-8aaf-46d3bea6a889 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:22.057761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6b7809d4-a614-46f9-8aaf-46d3bea6a889 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:22.067204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6b7809d4-a614-46f9-8aaf-46d3bea6a889 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:22.069758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6b7809d4-a614-46f9-8aaf-46d3bea6a889 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:22.070824 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6b7809d4-a614-46f9-8aaf-46d3bea6a889 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1672 microversion: 2.20 time: 0.375425 May 28 05:13:22.072502 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3138/6388] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:21 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1672 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:23.090637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3b2aa549-8039-4349-b012-12ca5f5a2cfc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:23.090637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3b2aa549-8039-4349-b012-12ca5f5a2cfc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:23.113139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:13:23.117160 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b2aa549-8039-4349-b012-12ca5f5a2cfc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:23.118355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b2aa549-8039-4349-b012-12ca5f5a2cfc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:23.123174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b2aa549-8039-4349-b012-12ca5f5a2cfc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:23.124327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3b2aa549-8039-4349-b012-12ca5f5a2cfc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:23.447909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3b2aa549-8039-4349-b012-12ca5f5a2cfc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:23.463691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3b2aa549-8039-4349-b012-12ca5f5a2cfc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:23.465268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3b2aa549-8039-4349-b012-12ca5f5a2cfc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:23.466499 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3b2aa549-8039-4349-b012-12ca5f5a2cfc tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1728 microversion: 2.20 time: 0.380958 May 28 05:13:23.469225 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3251/6389] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:23 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1728 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:24.487848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a36bcb77-6386-471b-873f-2e505c37cd8c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:24.489742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a36bcb77-6386-471b-873f-2e505c37cd8c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:24.500878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:13:24.508312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a36bcb77-6386-471b-873f-2e505c37cd8c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:24.509862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a36bcb77-6386-471b-873f-2e505c37cd8c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:24.511825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a36bcb77-6386-471b-873f-2e505c37cd8c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:24.511825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a36bcb77-6386-471b-873f-2e505c37cd8c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:24.937522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a36bcb77-6386-471b-873f-2e505c37cd8c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:24.955327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a36bcb77-6386-471b-873f-2e505c37cd8c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:24.958515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a36bcb77-6386-471b-873f-2e505c37cd8c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:24.962579 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a36bcb77-6386-471b-873f-2e505c37cd8c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1728 microversion: 2.20 time: 0.479179 May 28 05:13:24.977215 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3139/6390] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:24 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1728 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:25.988386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ad6a9009-47de-4b4b-8207-9ec54455ed18 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:25.995631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ad6a9009-47de-4b4b-8207-9ec54455ed18 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:26.004296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad6a9009-47de-4b4b-8207-9ec54455ed18 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:26.004940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad6a9009-47de-4b4b-8207-9ec54455ed18 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:26.005763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad6a9009-47de-4b4b-8207-9ec54455ed18 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:26.006389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad6a9009-47de-4b4b-8207-9ec54455ed18 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:26.756703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ad6a9009-47de-4b4b-8207-9ec54455ed18 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:26.772261 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ad6a9009-47de-4b4b-8207-9ec54455ed18 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:26.774409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ad6a9009-47de-4b4b-8207-9ec54455ed18 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:26.783360 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ad6a9009-47de-4b4b-8207-9ec54455ed18 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1728 microversion: 2.20 time: 0.805312 May 28 05:13:26.784001 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3252/6391] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:25 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1728 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:27.805509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-16ca24d8-1b84-4ca4-950e-e1b43470c17a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:27.806719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-16ca24d8-1b84-4ca4-950e-e1b43470c17a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:27.832560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16ca24d8-1b84-4ca4-950e-e1b43470c17a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:27.833130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16ca24d8-1b84-4ca4-950e-e1b43470c17a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:27.834224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16ca24d8-1b84-4ca4-950e-e1b43470c17a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:27.835446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16ca24d8-1b84-4ca4-950e-e1b43470c17a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:28.242974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-16ca24d8-1b84-4ca4-950e-e1b43470c17a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:28.261638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-16ca24d8-1b84-4ca4-950e-e1b43470c17a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:28.276006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-16ca24d8-1b84-4ca4-950e-e1b43470c17a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:28.279673 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-16ca24d8-1b84-4ca4-950e-e1b43470c17a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1728 microversion: 2.20 time: 0.479755 May 28 05:13:28.284258 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3140/6392] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:27 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1728 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:29.298661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-90e7469d-e253-4230-b431-6f85e7178e2a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:29.301857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-90e7469d-e253-4230-b431-6f85e7178e2a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:29.339673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90e7469d-e253-4230-b431-6f85e7178e2a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:29.343105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90e7469d-e253-4230-b431-6f85e7178e2a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:29.344258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90e7469d-e253-4230-b431-6f85e7178e2a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:29.345632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90e7469d-e253-4230-b431-6f85e7178e2a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:30.450021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-90e7469d-e253-4230-b431-6f85e7178e2a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:30.468846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-90e7469d-e253-4230-b431-6f85e7178e2a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:30.477978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-90e7469d-e253-4230-b431-6f85e7178e2a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:30.479742 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-90e7469d-e253-4230-b431-6f85e7178e2a tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1728 microversion: 2.20 time: 1.185031 May 28 05:13:30.481543 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3253/6393] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:29 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1728 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:31.498420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a4428f8e-d914-4b60-b7ed-3e1eba96c6e5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:31.500097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a4428f8e-d914-4b60-b7ed-3e1eba96c6e5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:31.513377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4428f8e-d914-4b60-b7ed-3e1eba96c6e5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:31.514145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4428f8e-d914-4b60-b7ed-3e1eba96c6e5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:31.517933 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4428f8e-d914-4b60-b7ed-3e1eba96c6e5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:31.518783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4428f8e-d914-4b60-b7ed-3e1eba96c6e5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:32.491469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a4428f8e-d914-4b60-b7ed-3e1eba96c6e5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:32.511494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a4428f8e-d914-4b60-b7ed-3e1eba96c6e5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:32.521212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a4428f8e-d914-4b60-b7ed-3e1eba96c6e5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:32.534511 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a4428f8e-d914-4b60-b7ed-3e1eba96c6e5 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1728 microversion: 2.20 time: 1.040339 May 28 05:13:32.540028 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3141/6394] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:31 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1728 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:33.575002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-54fd85b3-dcdf-4b2e-b0ea-80b0fbb32414 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:33.580362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-54fd85b3-dcdf-4b2e-b0ea-80b0fbb32414 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:33.588667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-54fd85b3-dcdf-4b2e-b0ea-80b0fbb32414 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:33.589497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-54fd85b3-dcdf-4b2e-b0ea-80b0fbb32414 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:33.590492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-54fd85b3-dcdf-4b2e-b0ea-80b0fbb32414 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:33.591119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-54fd85b3-dcdf-4b2e-b0ea-80b0fbb32414 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:34.369178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-54fd85b3-dcdf-4b2e-b0ea-80b0fbb32414 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:34.378423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-54fd85b3-dcdf-4b2e-b0ea-80b0fbb32414 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:34.381447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-54fd85b3-dcdf-4b2e-b0ea-80b0fbb32414 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:34.382784 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-54fd85b3-dcdf-4b2e-b0ea-80b0fbb32414 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1728 microversion: 2.20 time: 0.814386 May 28 05:13:34.383448 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3254/6395] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:33 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1728 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:35.402112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7fb626de-43af-4cfc-84b9-f6cd541f2bf6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:35.402853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7fb626de-43af-4cfc-84b9-f6cd541f2bf6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:35.434103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7fb626de-43af-4cfc-84b9-f6cd541f2bf6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:35.434103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7fb626de-43af-4cfc-84b9-f6cd541f2bf6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:35.438789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7fb626de-43af-4cfc-84b9-f6cd541f2bf6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:35.438789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7fb626de-43af-4cfc-84b9-f6cd541f2bf6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:35.750551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7fb626de-43af-4cfc-84b9-f6cd541f2bf6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:35.762950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7fb626de-43af-4cfc-84b9-f6cd541f2bf6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:35.764508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7fb626de-43af-4cfc-84b9-f6cd541f2bf6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:35.765731 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7fb626de-43af-4cfc-84b9-f6cd541f2bf6 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1728 microversion: 2.20 time: 0.367679 May 28 05:13:35.766303 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3142/6396] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:35 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1728 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:36.785943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b4136c1e-b908-4ef4-86e7-1f10248a1800 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:36.786590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b4136c1e-b908-4ef4-86e7-1f10248a1800 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:36.795163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4136c1e-b908-4ef4-86e7-1f10248a1800 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:36.795875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4136c1e-b908-4ef4-86e7-1f10248a1800 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:36.796850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4136c1e-b908-4ef4-86e7-1f10248a1800 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:36.797463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4136c1e-b908-4ef4-86e7-1f10248a1800 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:37.085342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b4136c1e-b908-4ef4-86e7-1f10248a1800 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:37.101300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b4136c1e-b908-4ef4-86e7-1f10248a1800 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:37.103952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b4136c1e-b908-4ef4-86e7-1f10248a1800 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:37.108772 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b4136c1e-b908-4ef4-86e7-1f10248a1800 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1728 microversion: 2.20 time: 0.326479 May 28 05:13:37.111547 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3255/6397] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:36 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1728 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:38.134354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-632542f4-e37d-4737-a236-09aa51efc456 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:38.134983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-632542f4-e37d-4737-a236-09aa51efc456 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:38.143157 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-632542f4-e37d-4737-a236-09aa51efc456 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:38.143627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-632542f4-e37d-4737-a236-09aa51efc456 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:38.144428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-632542f4-e37d-4737-a236-09aa51efc456 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:38.144875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-632542f4-e37d-4737-a236-09aa51efc456 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:38.149806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:13:38.361250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-632542f4-e37d-4737-a236-09aa51efc456 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:38.370961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-632542f4-e37d-4737-a236-09aa51efc456 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:38.372569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-632542f4-e37d-4737-a236-09aa51efc456 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:38.374003 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-632542f4-e37d-4737-a236-09aa51efc456 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1728 microversion: 2.20 time: 0.243594 May 28 05:13:38.374788 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3143/6398] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:38 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1728 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:39.399474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f6b162e2-cd7f-4367-a5d7-06eb6801dbac tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:39.399474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f6b162e2-cd7f-4367-a5d7-06eb6801dbac tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:39.411488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6b162e2-cd7f-4367-a5d7-06eb6801dbac tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:39.412242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6b162e2-cd7f-4367-a5d7-06eb6801dbac tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:39.413298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6b162e2-cd7f-4367-a5d7-06eb6801dbac tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:39.413955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f6b162e2-cd7f-4367-a5d7-06eb6801dbac tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:39.629844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f6b162e2-cd7f-4367-a5d7-06eb6801dbac tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:39.643073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f6b162e2-cd7f-4367-a5d7-06eb6801dbac tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:39.647100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f6b162e2-cd7f-4367-a5d7-06eb6801dbac tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:39.657397 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f6b162e2-cd7f-4367-a5d7-06eb6801dbac tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1728 microversion: 2.20 time: 0.259071 May 28 05:13:39.657397 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3256/6399] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:39 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1728 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:40.671985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e67fa3ea-294c-4c65-afac-d45fa0ee2eb3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:40.672604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e67fa3ea-294c-4c65-afac-d45fa0ee2eb3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:40.682224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e67fa3ea-294c-4c65-afac-d45fa0ee2eb3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:40.682697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e67fa3ea-294c-4c65-afac-d45fa0ee2eb3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:40.683574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e67fa3ea-294c-4c65-afac-d45fa0ee2eb3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:40.684265 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e67fa3ea-294c-4c65-afac-d45fa0ee2eb3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:40.844459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e67fa3ea-294c-4c65-afac-d45fa0ee2eb3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:40.858587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e67fa3ea-294c-4c65-afac-d45fa0ee2eb3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:40.860764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e67fa3ea-294c-4c65-afac-d45fa0ee2eb3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:40.862800 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e67fa3ea-294c-4c65-afac-d45fa0ee2eb3 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1728 microversion: 2.20 time: 0.194796 May 28 05:13:40.863911 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3144/6400] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:40 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:41.887859 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8ebd7445-1b28-44f0-9294-68f234e0b4b2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:41.889985 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8ebd7445-1b28-44f0-9294-68f234e0b4b2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:41.903188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ebd7445-1b28-44f0-9294-68f234e0b4b2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:41.904218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ebd7445-1b28-44f0-9294-68f234e0b4b2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:41.905455 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ebd7445-1b28-44f0-9294-68f234e0b4b2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:41.906009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ebd7445-1b28-44f0-9294-68f234e0b4b2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:42.139889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8ebd7445-1b28-44f0-9294-68f234e0b4b2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:42.155377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8ebd7445-1b28-44f0-9294-68f234e0b4b2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:42.156849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8ebd7445-1b28-44f0-9294-68f234e0b4b2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:42.160688 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8ebd7445-1b28-44f0-9294-68f234e0b4b2 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1728 microversion: 2.20 time: 0.279818 May 28 05:13:42.161354 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3257/6401] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:41 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1728 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:43.179531 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cfbd0a4d-3496-4994-a27c-73f89e201fec tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:43.184092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cfbd0a4d-3496-4994-a27c-73f89e201fec tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:43.193617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfbd0a4d-3496-4994-a27c-73f89e201fec tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:43.194147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfbd0a4d-3496-4994-a27c-73f89e201fec tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:43.195230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfbd0a4d-3496-4994-a27c-73f89e201fec tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:43.196139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfbd0a4d-3496-4994-a27c-73f89e201fec tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:43.407709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-ed419f8e-3219-4fa8-9b25-4a78af58d3d7 req-f1c5c6d2-0fea-416a-a931-4ba4ea319a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d6e344-40d2-4d47-95b5-c3be216f08d8", "name": "network-vif-plugged", "status": "completed", "tag": "e3181171-bf41-4341-bf54-3e1757a628c1"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:13:43.425867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ed419f8e-3219-4fa8-9b25-4a78af58d3d7 req-f1c5c6d2-0fea-416a-a931-4ba4ea319a75 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:43.427655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ed419f8e-3219-4fa8-9b25-4a78af58d3d7 req-f1c5c6d2-0fea-416a-a931-4ba4ea319a75 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:43.442368 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-ed419f8e-3219-4fa8-9b25-4a78af58d3d7 req-f1c5c6d2-0fea-416a-a931-4ba4ea319a75 service nova] Creating event network-vif-plugged:e3181171-bf41-4341-bf54-3e1757a628c1 for instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 on n-h2-843700-1 May 28 05:13:43.448343 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-ed419f8e-3219-4fa8-9b25-4a78af58d3d7 req-f1c5c6d2-0fea-416a-a931-4ba4ea319a75 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044557 May 28 05:13:43.449618 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3258/6402] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:13:43.690010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cfbd0a4d-3496-4994-a27c-73f89e201fec tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:43.702549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cfbd0a4d-3496-4994-a27c-73f89e201fec tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:43.707083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cfbd0a4d-3496-4994-a27c-73f89e201fec tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:43.710174 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cfbd0a4d-3496-4994-a27c-73f89e201fec tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1728 microversion: 2.20 time: 0.534811 May 28 05:13:43.721913 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3145/6403] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:43 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1728 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:44.027517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-76d52900-9ad7-461a-aa91-5f0c6d53062a tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-846419223", "availability_zone": "foo_zone"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:13:44.029069 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 05:13:44.029069 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 05:13:44.030003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.aggregate [None req-76d52900-9ad7-461a-aa91-5f0c6d53062a tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] Generated uuid 331e39f3-6fd5-410f-9975-9d9ff3bd7ebe for aggregate {{(pid=126044) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 05:13:44.143985 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-76d52900-9ad7-461a-aa91-5f0c6d53062a tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.248480 May 28 05:13:44.144613 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3259/6404] 10.222.0.58 () {60 vars in 1163 bytes} [Sat May 28 05:13:43 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:13:44.154551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8d2c44a6-9589-4e96-9ad2-2d57f3f49a0d tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:13:44.155982 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 05:13:44.155982 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 05:13:44.257772 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8d2c44a6-9589-4e96-9ad2-2d57f3f49a0d tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.106706 May 28 05:13:44.259329 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3146/6405] 10.222.0.58 () {60 vars in 1193 bytes} [Sat May 28 05:13:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:13:44.268882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-44537bc0-afee-4ac8-a7a3-92e355097755 tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:44.273228 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 05:13:44.273228 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 05:13:44.273228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-44537bc0-afee-4ac8-a7a3-92e355097755 tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:44.273228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-44537bc0-afee-4ac8-a7a3-92e355097755 tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:44.273228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-44537bc0-afee-4ac8-a7a3-92e355097755 tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:44.273228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-44537bc0-afee-4ac8-a7a3-92e355097755 tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:44.297532 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-44537bc0-afee-4ac8-a7a3-92e355097755 tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.032966 May 28 05:13:44.301924 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3260/6406] 10.222.0.58 () {58 vars in 1175 bytes} [Sat May 28 05:13:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:13:44.308538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b4f71e2e-be62-4657-9a49-d5d3803ff1d8 tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:44.309296 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 05:13:44.309296 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 05:13:44.317279 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b4f71e2e-be62-4657-9a49-d5d3803ff1d8 tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.012481 May 28 05:13:44.317829 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3147/6407] 10.222.0.58 () {58 vars in 1142 bytes} [Sat May 28 05:13:44 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:13:44.327847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b433311a-77bd-4a81-8d2c-1587dd066744 tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843700-1"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:13:44.330716 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 05:13:44.330716 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 05:13:44.338063 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b433311a-77bd-4a81-8d2c-1587dd066744 tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:44.338522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b433311a-77bd-4a81-8d2c-1587dd066744 tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:44.734968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1d95280a-a843-4e45-9e9b-8f1f15987d5f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:44.734968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1d95280a-a843-4e45-9e9b-8f1f15987d5f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:44.747535 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b433311a-77bd-4a81-8d2c-1587dd066744 tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.423277 May 28 05:13:44.754610 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3261/6408] 10.222.0.58 () {60 vars in 1193 bytes} [Sat May 28 05:13:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:13:44.763766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5f16633c-079e-48fa-ab84-41acb72c3e3e tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:44.766170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d95280a-a843-4e45-9e9b-8f1f15987d5f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:44.766698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d95280a-a843-4e45-9e9b-8f1f15987d5f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:44.767591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d95280a-a843-4e45-9e9b-8f1f15987d5f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:44.777609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d95280a-a843-4e45-9e9b-8f1f15987d5f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:44.777848 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 05:13:44.777848 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 05:13:44.780583 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5f16633c-079e-48fa-ab84-41acb72c3e3e tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.020440 May 28 05:13:44.781476 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3262/6409] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 05:13:44 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:13:44.791573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6d91424c-403a-4506-8fc8-20bef8c3e48a tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1780422850", "availability_zone": "foo_zone"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:13:44.793242 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 05:13:44.793242 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 05:13:44.941913 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6d91424c-403a-4506-8fc8-20bef8c3e48a tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.153966 May 28 05:13:44.948826 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3263/6410] 10.222.0.58 () {60 vars in 1172 bytes} [Sat May 28 05:13:44 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:13:44.957708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1130cefd-fb05-49f0-a6f2-1a4da15c9ab4 tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:13:44.959457 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 05:13:44.959457 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 05:13:45.000968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1d95280a-a843-4e45-9e9b-8f1f15987d5f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:45.009293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1d95280a-a843-4e45-9e9b-8f1f15987d5f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:45.010807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1d95280a-a843-4e45-9e9b-8f1f15987d5f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:45.012032 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1d95280a-a843-4e45-9e9b-8f1f15987d5f tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1728 microversion: 2.20 time: 0.284795 May 28 05:13:45.012601 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3148/6411] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:44 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1728 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:45.063724 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1130cefd-fb05-49f0-a6f2-1a4da15c9ab4 tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.106775 May 28 05:13:45.063724 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3264/6412] 10.222.0.58 () {60 vars in 1193 bytes} [Sat May 28 05:13:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:13:45.076915 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-07380b1e-d18c-4b60-be74-1782ea73842d tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:45.078354 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 05:13:45.078354 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 05:13:45.093389 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-07380b1e-d18c-4b60-be74-1782ea73842d tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.017844 May 28 05:13:45.093389 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3149/6413] 10.222.0.58 () {58 vars in 1151 bytes} [Sat May 28 05:13:45 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:13:45.102425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-69601b66-a422-4845-a9ec-a1fed895103d tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843700-1"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:13:45.104944 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 05:13:45.104944 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 05:13:45.134672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-69601b66-a422-4845-a9ec-a1fed895103d tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:45.135194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-69601b66-a422-4845-a9ec-a1fed895103d tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:45.528040 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-69601b66-a422-4845-a9ec-a1fed895103d tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.429550 May 28 05:13:45.528657 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3265/6414] 10.222.0.58 () {60 vars in 1193 bytes} [Sat May 28 05:13:45 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:13:45.539715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-072db314-9077-4e2a-af66-3acd1ebfc0bf tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:45.540475 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 05:13:45.540475 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 05:13:45.659160 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-072db314-9077-4e2a-af66-3acd1ebfc0bf tempest-TestAggregatesBasicOps-450455613 tempest-TestAggregatesBasicOps-450455613-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.123106 May 28 05:13:45.660050 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3150/6415] 10.222.0.58 () {58 vars in 1154 bytes} [Sat May 28 05:13:45 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 05:13:46.032268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-074aa741-1a33-4528-a303-fc6c38cb0353 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:46.035932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-074aa741-1a33-4528-a303-fc6c38cb0353 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:46.044009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-074aa741-1a33-4528-a303-fc6c38cb0353 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:46.044940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-074aa741-1a33-4528-a303-fc6c38cb0353 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:46.046032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-074aa741-1a33-4528-a303-fc6c38cb0353 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:46.047264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-074aa741-1a33-4528-a303-fc6c38cb0353 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:46.280448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-074aa741-1a33-4528-a303-fc6c38cb0353 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:46.290039 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-074aa741-1a33-4528-a303-fc6c38cb0353 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:46.291744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-074aa741-1a33-4528-a303-fc6c38cb0353 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:46.293348 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-074aa741-1a33-4528-a303-fc6c38cb0353 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1728 microversion: 2.20 time: 0.266277 May 28 05:13:46.295026 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3266/6416] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:46 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1728 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:13:47.313249 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a388aadc-6253-480c-baef-10a9b7e382c8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:13:47.314796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a388aadc-6253-480c-baef-10a9b7e382c8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:13:47.336715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a388aadc-6253-480c-baef-10a9b7e382c8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:47.341391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a388aadc-6253-480c-baef-10a9b7e382c8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:47.342559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a388aadc-6253-480c-baef-10a9b7e382c8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:13:47.345156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a388aadc-6253-480c-baef-10a9b7e382c8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:13:47.671520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a388aadc-6253-480c-baef-10a9b7e382c8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:47.680979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a388aadc-6253-480c-baef-10a9b7e382c8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:47.687867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a388aadc-6253-480c-baef-10a9b7e382c8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:13:47.691487 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a388aadc-6253-480c-baef-10a9b7e382c8 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1715 microversion: 2.20 time: 0.382960 May 28 05:13:47.703779 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3151/6417] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:13:47 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1715 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:14:10.906653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:14:10.908394 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:14:10.909043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:14:11.108220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4e4daf9e-8642-4a9f-b8d8-29d67839b275 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Action: 'create', calling method: .version_select at 0x7f7701f01a60>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1696705096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQRb31DQgqMy6irz8roTohCp9usV7j7Yq02kR0cmH781qoWBno0xyo406kVuSt2lyD3HKmVkzU/0Hmd3ZdelYHw8OWxmRRp8Q+6HgzJY+ZspwZGZTYsEc46Rr1mtYKATA=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:14:11.124284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-4e4daf9e-8642-4a9f-b8d8-29d67839b275 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Getting quotas for project ce83b3e204724e2080ae1303f1a527a8. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:14:11.133396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-4e4daf9e-8642-4a9f-b8d8-29d67839b275 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Getting quotas for user d0c88ceaa1824d0c9f140709320898dc and project ce83b3e204724e2080ae1303f1a527a8. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:14:11.226401 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4e4daf9e-8642-4a9f-b8d8-29d67839b275 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.327024 May 28 05:14:11.227242 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3267/6418] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 05:14:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:14:13.883802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e351f412-8d3f-4687-9adf-cfb6fd39d1ed tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1084126947", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1696705096", "security_groups": [{"name": "tempest-secgroup-smoke-603836091"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "13bcba29-ab55-4654-b2d8-983f41c1ed01"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:14:13.892803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:14:13.893776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=29 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:14:13.993273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-e351f412-8d3f-4687-9adf-cfb6fd39d1ed tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] validate_networks() for [('13bcba29-ab55-4654-b2d8-983f41c1ed01', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:14:14.410701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-e351f412-8d3f-4687-9adf-cfb6fd39d1ed tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Getting quotas for project ce83b3e204724e2080ae1303f1a527a8. Resources: dict_keys(['metadata_items']) {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:14:14.417551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-e351f412-8d3f-4687-9adf-cfb6fd39d1ed tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Getting quotas for user d0c88ceaa1824d0c9f140709320898dc and project ce83b3e204724e2080ae1303f1a527a8. Resources: dict_keys(['metadata_items']) {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:14:14.432947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-e351f412-8d3f-4687-9adf-cfb6fd39d1ed tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:14:14.433450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-e351f412-8d3f-4687-9adf-cfb6fd39d1ed tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:14:14.433875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-e351f412-8d3f-4687-9adf-cfb6fd39d1ed tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:14:14.434524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-e351f412-8d3f-4687-9adf-cfb6fd39d1ed tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:14:14.434811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-e351f412-8d3f-4687-9adf-cfb6fd39d1ed tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:14:14.445947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e351f412-8d3f-4687-9adf-cfb6fd39d1ed tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:14.446407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e351f412-8d3f-4687-9adf-cfb6fd39d1ed tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:14.447260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e351f412-8d3f-4687-9adf-cfb6fd39d1ed tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:14.447736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e351f412-8d3f-4687-9adf-cfb6fd39d1ed tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:14.468809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-e351f412-8d3f-4687-9adf-cfb6fd39d1ed tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Getting quotas for project ce83b3e204724e2080ae1303f1a527a8. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:14:14.473928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-e351f412-8d3f-4687-9adf-cfb6fd39d1ed tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Getting quotas for user d0c88ceaa1824d0c9f140709320898dc and project ce83b3e204724e2080ae1303f1a527a8. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:14:14.487707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e351f412-8d3f-4687-9adf-cfb6fd39d1ed tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:14:14.490448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e351f412-8d3f-4687-9adf-cfb6fd39d1ed tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:14:14.609363 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e351f412-8d3f-4687-9adf-cfb6fd39d1ed tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.729501 May 28 05:14:14.611018 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3152/6419] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:14:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 05:14:14.622072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fbe468de-fcd2-46e5-a052-71b5f56f7030 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:14.623429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fbe468de-fcd2-46e5-a052-71b5f56f7030 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:14.683743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fbe468de-fcd2-46e5-a052-71b5f56f7030 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c88ceaa1824d0c9f140709320898dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce83b3e204724e2080ae1303f1a527a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:14.692855 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fbe468de-fcd2-46e5-a052-71b5f56f7030 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 200 len: 1303 microversion: 2.1 time: 0.075903 May 28 05:14:14.693752 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3268/6420] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:14 2022] GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 1303 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:14:15.712324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-55cb589a-0516-48fe-b164-ec34ca7fb6ce tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:15.714255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-55cb589a-0516-48fe-b164-ec34ca7fb6ce tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:15.806697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-55cb589a-0516-48fe-b164-ec34ca7fb6ce tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c88ceaa1824d0c9f140709320898dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce83b3e204724e2080ae1303f1a527a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:15.817560 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-55cb589a-0516-48fe-b164-ec34ca7fb6ce tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 200 len: 1303 microversion: 2.1 time: 0.110818 May 28 05:14:15.818642 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3153/6421] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:15 2022] GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:16.834594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-213327bb-cdcc-47d8-96fa-092459a44b0b tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:16.835161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-213327bb-cdcc-47d8-96fa-092459a44b0b tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:16.843991 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-213327bb-cdcc-47d8-96fa-092459a44b0b tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:16.844889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-213327bb-cdcc-47d8-96fa-092459a44b0b tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:16.845716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-213327bb-cdcc-47d8-96fa-092459a44b0b tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:16.846161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-213327bb-cdcc-47d8-96fa-092459a44b0b tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:16.934501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-213327bb-cdcc-47d8-96fa-092459a44b0b tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c88ceaa1824d0c9f140709320898dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce83b3e204724e2080ae1303f1a527a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:16.944543 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-213327bb-cdcc-47d8-96fa-092459a44b0b tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 200 len: 1363 microversion: 2.1 time: 0.114003 May 28 05:14:16.945509 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3269/6422] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:16 2022] GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 1363 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:17.078374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-34756ee6-0b36-451d-8f09-39bf4b2e9756 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:17.080654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-34756ee6-0b36-451d-8f09-39bf4b2e9756 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:17.090060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34756ee6-0b36-451d-8f09-39bf4b2e9756 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:17.090825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34756ee6-0b36-451d-8f09-39bf4b2e9756 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:17.092548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34756ee6-0b36-451d-8f09-39bf4b2e9756 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:17.094058 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-34756ee6-0b36-451d-8f09-39bf4b2e9756 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:17.139607 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-34756ee6-0b36-451d-8f09-39bf4b2e9756 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.065291 May 28 05:14:17.141276 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3154/6423] 10.222.0.58 () {60 vars in 1342 bytes} [Sat May 28 05:14:17 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:17.212080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4e211376-86bb-4d98-b75d-9fc2bf1d1df4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:17.213949 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4e211376-86bb-4d98-b75d-9fc2bf1d1df4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:17.220830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e211376-86bb-4d98-b75d-9fc2bf1d1df4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:17.221348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e211376-86bb-4d98-b75d-9fc2bf1d1df4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:17.222326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e211376-86bb-4d98-b75d-9fc2bf1d1df4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:17.223012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e211376-86bb-4d98-b75d-9fc2bf1d1df4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:17.248625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4e211376-86bb-4d98-b75d-9fc2bf1d1df4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:14:17.510172 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4e211376-86bb-4d98-b75d-9fc2bf1d1df4 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "DELETE /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 204 len: 0 microversion: 2.20 time: 0.301948 May 28 05:14:17.511415 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3270/6424] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 05:14:17 2022] DELETE /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 05:14:17.520706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cdd76a16-7f70-4818-9145-2e122db7df12 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:17.521397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cdd76a16-7f70-4818-9145-2e122db7df12 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:17.528994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdd76a16-7f70-4818-9145-2e122db7df12 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:17.529735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdd76a16-7f70-4818-9145-2e122db7df12 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:17.531234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdd76a16-7f70-4818-9145-2e122db7df12 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:17.531686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdd76a16-7f70-4818-9145-2e122db7df12 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:17.738311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cdd76a16-7f70-4818-9145-2e122db7df12 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:17.746714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cdd76a16-7f70-4818-9145-2e122db7df12 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:17.748299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cdd76a16-7f70-4818-9145-2e122db7df12 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:17.749475 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cdd76a16-7f70-4818-9145-2e122db7df12 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1721 microversion: 2.20 time: 0.233669 May 28 05:14:17.750044 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3155/6425] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:14:17 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:14:17.962210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6956ec93-5d87-4670-8129-39b3a6f0a5cc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:17.962910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6956ec93-5d87-4670-8129-39b3a6f0a5cc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:17.970598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6956ec93-5d87-4670-8129-39b3a6f0a5cc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:17.971071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6956ec93-5d87-4670-8129-39b3a6f0a5cc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:17.974463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6956ec93-5d87-4670-8129-39b3a6f0a5cc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:17.974463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6956ec93-5d87-4670-8129-39b3a6f0a5cc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:18.217079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6956ec93-5d87-4670-8129-39b3a6f0a5cc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c88ceaa1824d0c9f140709320898dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce83b3e204724e2080ae1303f1a527a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:18.230080 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6956ec93-5d87-4670-8129-39b3a6f0a5cc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 200 len: 1428 microversion: 2.1 time: 0.271835 May 28 05:14:18.239826 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3271/6426] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:17 2022] GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 1428 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:18.770310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4f4bd27c-eeaf-4db7-8564-084833800428 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:18.772049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4f4bd27c-eeaf-4db7-8564-084833800428 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:18.780091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4f4bd27c-eeaf-4db7-8564-084833800428 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:18.780781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4f4bd27c-eeaf-4db7-8564-084833800428 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:18.781938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4f4bd27c-eeaf-4db7-8564-084833800428 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:18.783162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4f4bd27c-eeaf-4db7-8564-084833800428 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:18.960760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-8d40e10b-19d4-47d3-bb30-4ab027db1fc8 req-cbf73ef4-14d3-4500-ba78-b9b1613bd325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e58a6607-22eb-4fef-b228-278d25a44280", "tag": "909db0c8-313c-4054-a8f6-c8c245172d1f"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:14:18.972802 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8d40e10b-19d4-47d3-bb30-4ab027db1fc8 req-cbf73ef4-14d3-4500-ba78-b9b1613bd325 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:18.973927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8d40e10b-19d4-47d3-bb30-4ab027db1fc8 req-cbf73ef4-14d3-4500-ba78-b9b1613bd325 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:18.988637 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-8d40e10b-19d4-47d3-bb30-4ab027db1fc8 req-cbf73ef4-14d3-4500-ba78-b9b1613bd325 service nova] Creating event network-changed:909db0c8-313c-4054-a8f6-c8c245172d1f for instance e58a6607-22eb-4fef-b228-278d25a44280 on n-h1-843700-1 May 28 05:14:18.994037 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-8d40e10b-19d4-47d3-bb30-4ab027db1fc8 req-cbf73ef4-14d3-4500-ba78-b9b1613bd325 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036911 May 28 05:14:18.995215 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3272/6427] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:14:19.206470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4f4bd27c-eeaf-4db7-8564-084833800428 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:19.214817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4f4bd27c-eeaf-4db7-8564-084833800428 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:19.216349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4f4bd27c-eeaf-4db7-8564-084833800428 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:19.217723 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4f4bd27c-eeaf-4db7-8564-084833800428 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1721 microversion: 2.20 time: 0.452776 May 28 05:14:19.228684 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3156/6428] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:14:18 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1721 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:14:19.248062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-571c45a2-8af6-4261-a83a-b254c8ff0f0f tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:19.248913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-571c45a2-8af6-4261-a83a-b254c8ff0f0f tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:19.256041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-571c45a2-8af6-4261-a83a-b254c8ff0f0f tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:19.256497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-571c45a2-8af6-4261-a83a-b254c8ff0f0f tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:19.257268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-571c45a2-8af6-4261-a83a-b254c8ff0f0f tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:19.257704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-571c45a2-8af6-4261-a83a-b254c8ff0f0f tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:19.604064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-571c45a2-8af6-4261-a83a-b254c8ff0f0f tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c88ceaa1824d0c9f140709320898dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce83b3e204724e2080ae1303f1a527a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:19.614874 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-571c45a2-8af6-4261-a83a-b254c8ff0f0f tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 200 len: 1428 microversion: 2.1 time: 0.370944 May 28 05:14:19.615976 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3273/6429] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:19 2022] GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 1428 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:20.236598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-433917b7-7cf8-438b-a159-d72ebcf96de1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:20.238118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-433917b7-7cf8-438b-a159-d72ebcf96de1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:20.246211 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-433917b7-7cf8-438b-a159-d72ebcf96de1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:20.246683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-433917b7-7cf8-438b-a159-d72ebcf96de1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:20.247796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-433917b7-7cf8-438b-a159-d72ebcf96de1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:20.248442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-433917b7-7cf8-438b-a159-d72ebcf96de1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:20.522205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-433917b7-7cf8-438b-a159-d72ebcf96de1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:20.535022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-433917b7-7cf8-438b-a159-d72ebcf96de1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:20.538413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-433917b7-7cf8-438b-a159-d72ebcf96de1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72e4a9ee07a848248029dfa7bf78192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecff011ab9254460a5f9d4c27f1b1932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:20.542709 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-433917b7-7cf8-438b-a159-d72ebcf96de1 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 200 len: 1654 microversion: 2.20 time: 0.310149 May 28 05:14:20.543612 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3157/6430] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:14:20 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 1654 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 05:14:20.632857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3d8a5e8e-9ed9-498b-8cde-9da8f0483f16 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:20.637852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3d8a5e8e-9ed9-498b-8cde-9da8f0483f16 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:20.640545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d8a5e8e-9ed9-498b-8cde-9da8f0483f16 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:20.641023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d8a5e8e-9ed9-498b-8cde-9da8f0483f16 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:20.642064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d8a5e8e-9ed9-498b-8cde-9da8f0483f16 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:20.642668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3d8a5e8e-9ed9-498b-8cde-9da8f0483f16 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:20.913979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3d8a5e8e-9ed9-498b-8cde-9da8f0483f16 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c88ceaa1824d0c9f140709320898dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce83b3e204724e2080ae1303f1a527a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:20.933854 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3d8a5e8e-9ed9-498b-8cde-9da8f0483f16 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 200 len: 1428 microversion: 2.1 time: 0.305124 May 28 05:14:20.934455 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3274/6431] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:20 2022] GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 1428 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:21.019452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-62943390-f7bb-436b-94b4-05bad1f1163a req-e449abcf-69c5-471b-9da1-f7cb5b2c65fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d6e344-40d2-4d47-95b5-c3be216f08d8", "name": "network-vif-deleted", "tag": "e3181171-bf41-4341-bf54-3e1757a628c1"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:14:21.029771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-62943390-f7bb-436b-94b4-05bad1f1163a req-e449abcf-69c5-471b-9da1-f7cb5b2c65fe service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:21.030496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-62943390-f7bb-436b-94b4-05bad1f1163a req-e449abcf-69c5-471b-9da1-f7cb5b2c65fe service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:21.043639 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-62943390-f7bb-436b-94b4-05bad1f1163a req-e449abcf-69c5-471b-9da1-f7cb5b2c65fe service nova] Creating event network-vif-deleted:e3181171-bf41-4341-bf54-3e1757a628c1 for instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 on n-h2-843700-1 May 28 05:14:21.049890 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-62943390-f7bb-436b-94b4-05bad1f1163a req-e449abcf-69c5-471b-9da1-f7cb5b2c65fe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035194 May 28 05:14:21.050752 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3158/6432] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:14:21.561854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a6030910-9c76-44ec-864a-1d002ac8c044 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:21.563967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a6030910-9c76-44ec-864a-1d002ac8c044 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:21.569832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6030910-9c76-44ec-864a-1d002ac8c044 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:21.569955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6030910-9c76-44ec-864a-1d002ac8c044 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:21.570771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6030910-9c76-44ec-864a-1d002ac8c044 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:21.571250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6030910-9c76-44ec-864a-1d002ac8c044 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:21.585859 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-a6030910-9c76-44ec-864a-1d002ac8c044 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] HTTP exception thrown: Instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 could not be found. May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a6030910-9c76-44ec-864a-1d002ac8c044 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Request method failure captured: May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 HTTP/1.1 May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABika4HRAt51MepdVqeqitZHJxFBdujD3Iq_iTBBRhxUxRYc5RHtx-gWaIhwF4x6CpEY2qk8Vu3iSoSw70i7KPkat47IrQRS-xQMhLSpn6dBapbTlfPydWJR0HQwfIlXMQyZT3r3numa2ETn7yh4TMkiOmGrKGNvBzEYd_M7lWyAlfB46U May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-Openstack-Nova-Api-Version: 2.20 May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: ecff011ab9254460a5f9d4c27f1b1932 May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1819630171 May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1819630171 May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: ecff011ab9254460a5f9d4c27f1b1932 May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1819630171 May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AttachVolumeShelveTestJSON-1819630171-project May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 72e4a9ee07a848248029dfa7bf78192c May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1819630171-project May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 could not be found. May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '03d6e344-40d2-4d47-95b5-c3be216f08d8'} May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 could not be found. May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 could not be found. May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:21.587809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:14:21.593412 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:21.593412 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:21.593412 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:14:21.593412 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:14:21.593412 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:14:21.593412 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:14:21.593412 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 could not be found. May 28 05:14:21.593412 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:21.593412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a6030910-9c76-44ec-864a-1d002ac8c044 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Returning 404 to user: Instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:14:21.593412 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a6030910-9c76-44ec-864a-1d002ac8c044 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 404 len: 111 microversion: 2.20 time: 0.031429 May 28 05:14:21.593412 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3275/6433] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:14:21 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 05:14:21.600550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0478b55a-c5fe-49fe-9c95-967ddb549c6c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '.version_select at 0x7f770025e160>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:21.717164 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0478b55a-c5fe-49fe-9c95-967ddb549c6c tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-198925294" status: 204 len: 0 microversion: 2.20 time: 0.122305 May 28 05:14:21.718179 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3159/6434] 10.222.0.58 () {60 vars in 1258 bytes} [Sat May 28 05:14:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-198925294 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 28 05:14:21.951498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d7d9e644-64b9-40b7-8aec-d43bf33181b7 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:21.952120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d7d9e644-64b9-40b7-8aec-d43bf33181b7 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:21.959813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7d9e644-64b9-40b7-8aec-d43bf33181b7 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:21.960271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7d9e644-64b9-40b7-8aec-d43bf33181b7 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:21.961150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7d9e644-64b9-40b7-8aec-d43bf33181b7 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:21.961609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7d9e644-64b9-40b7-8aec-d43bf33181b7 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:22.240394 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d7d9e644-64b9-40b7-8aec-d43bf33181b7 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c88ceaa1824d0c9f140709320898dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce83b3e204724e2080ae1303f1a527a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:22.252327 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d7d9e644-64b9-40b7-8aec-d43bf33181b7 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 200 len: 1428 microversion: 2.1 time: 0.304629 May 28 05:14:22.253202 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3276/6435] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:21 2022] GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 1428 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:23.269515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-52197f0d-0e51-44ea-bb4d-e8276345cbbc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:23.270875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-52197f0d-0e51-44ea-bb4d-e8276345cbbc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:23.279361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52197f0d-0e51-44ea-bb4d-e8276345cbbc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:23.280073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52197f0d-0e51-44ea-bb4d-e8276345cbbc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:23.281047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52197f0d-0e51-44ea-bb4d-e8276345cbbc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:23.281715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52197f0d-0e51-44ea-bb4d-e8276345cbbc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:23.461661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-52197f0d-0e51-44ea-bb4d-e8276345cbbc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c88ceaa1824d0c9f140709320898dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce83b3e204724e2080ae1303f1a527a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:23.474424 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-52197f0d-0e51-44ea-bb4d-e8276345cbbc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 200 len: 1428 microversion: 2.1 time: 0.208919 May 28 05:14:23.479022 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3160/6436] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:23 2022] GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 1428 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:24.492000 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-812b5b53-ae09-429e-a8c8-ddcb84b08793 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:24.492628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-812b5b53-ae09-429e-a8c8-ddcb84b08793 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:24.504191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-812b5b53-ae09-429e-a8c8-ddcb84b08793 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:24.504662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-812b5b53-ae09-429e-a8c8-ddcb84b08793 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:24.505456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-812b5b53-ae09-429e-a8c8-ddcb84b08793 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:24.506097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-812b5b53-ae09-429e-a8c8-ddcb84b08793 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:24.669659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-812b5b53-ae09-429e-a8c8-ddcb84b08793 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c88ceaa1824d0c9f140709320898dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce83b3e204724e2080ae1303f1a527a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:24.677578 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-812b5b53-ae09-429e-a8c8-ddcb84b08793 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 200 len: 1428 microversion: 2.1 time: 0.189775 May 28 05:14:24.681944 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3277/6437] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:24 2022] GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 1428 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:25.694779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3f5fef72-f262-4e34-89a2-873494799822 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:25.695441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3f5fef72-f262-4e34-89a2-873494799822 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:25.698512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:14:25.703542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f5fef72-f262-4e34-89a2-873494799822 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:25.704027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f5fef72-f262-4e34-89a2-873494799822 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:25.704794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f5fef72-f262-4e34-89a2-873494799822 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:25.707745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f5fef72-f262-4e34-89a2-873494799822 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:25.811738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=12 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:14:25.849887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3f5fef72-f262-4e34-89a2-873494799822 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c88ceaa1824d0c9f140709320898dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce83b3e204724e2080ae1303f1a527a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:25.858162 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3f5fef72-f262-4e34-89a2-873494799822 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 200 len: 1428 microversion: 2.1 time: 0.167308 May 28 05:14:25.858746 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3161/6438] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:25 2022] GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 1428 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:26.547233 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-aadc3c0a-9815-48a8-b772-a5335d5e60d9 req-244879b6-7098-4afd-b52c-1bb1dea4aa7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58a6607-22eb-4fef-b228-278d25a44280", "name": "network-vif-plugged", "status": "completed", "tag": "909db0c8-313c-4054-a8f6-c8c245172d1f"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:14:26.552206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:14:26.558552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-aadc3c0a-9815-48a8-b772-a5335d5e60d9 req-244879b6-7098-4afd-b52c-1bb1dea4aa7b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:26.559024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-aadc3c0a-9815-48a8-b772-a5335d5e60d9 req-244879b6-7098-4afd-b52c-1bb1dea4aa7b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:26.570660 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-aadc3c0a-9815-48a8-b772-a5335d5e60d9 req-244879b6-7098-4afd-b52c-1bb1dea4aa7b service nova] Creating event network-vif-plugged:909db0c8-313c-4054-a8f6-c8c245172d1f for instance e58a6607-22eb-4fef-b228-278d25a44280 on n-h1-843700-1 May 28 05:14:26.575760 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-aadc3c0a-9815-48a8-b772-a5335d5e60d9 req-244879b6-7098-4afd-b52c-1bb1dea4aa7b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032381 May 28 05:14:26.576354 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3278/6439] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:14:26.876095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-48402e8b-a995-4c3c-b408-401adb6b3507 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:26.876720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-48402e8b-a995-4c3c-b408-401adb6b3507 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:26.884480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48402e8b-a995-4c3c-b408-401adb6b3507 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:26.884939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48402e8b-a995-4c3c-b408-401adb6b3507 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:26.885721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48402e8b-a995-4c3c-b408-401adb6b3507 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:26.886169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-48402e8b-a995-4c3c-b408-401adb6b3507 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:27.028653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-48402e8b-a995-4c3c-b408-401adb6b3507 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c88ceaa1824d0c9f140709320898dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce83b3e204724e2080ae1303f1a527a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:27.037891 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-48402e8b-a995-4c3c-b408-401adb6b3507 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 200 len: 1428 microversion: 2.1 time: 0.166146 May 28 05:14:27.038478 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3162/6440] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:26 2022] GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 1428 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:27.106097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cb0712a8-1d0f-4b2d-adaf-464e21fec101 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:27.106892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cb0712a8-1d0f-4b2d-adaf-464e21fec101 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:27.115206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb0712a8-1d0f-4b2d-adaf-464e21fec101 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:27.115950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb0712a8-1d0f-4b2d-adaf-464e21fec101 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:27.116971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb0712a8-1d0f-4b2d-adaf-464e21fec101 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:27.120068 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb0712a8-1d0f-4b2d-adaf-464e21fec101 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:27.134602 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-cb0712a8-1d0f-4b2d-adaf-464e21fec101 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] HTTP exception thrown: Instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 could not be found. May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cb0712a8-1d0f-4b2d-adaf-464e21fec101 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Request method failure captured: May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 HTTP/1.1 May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABika4HRAt51MepdVqeqitZHJxFBdujD3Iq_iTBBRhxUxRYc5RHtx-gWaIhwF4x6CpEY2qk8Vu3iSoSw70i7KPkat47IrQRS-xQMhLSpn6dBapbTlfPydWJR0HQwfIlXMQyZT3r3numa2ETn7yh4TMkiOmGrKGNvBzEYd_M7lWyAlfB46U May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-Openstack-Nova-Api-Version: 2.20 May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: ecff011ab9254460a5f9d4c27f1b1932 May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1819630171 May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1819630171 May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: ecff011ab9254460a5f9d4c27f1b1932 May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1819630171 May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AttachVolumeShelveTestJSON-1819630171-project May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 72e4a9ee07a848248029dfa7bf78192c May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1819630171-project May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 could not be found. May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '03d6e344-40d2-4d47-95b5-c3be216f08d8'} May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 could not be found. May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:14:27.136278 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:14:27.142330 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 could not be found. May 28 05:14:27.142330 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:27.142330 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:14:27.142330 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:27.142330 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:27.142330 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:14:27.142330 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:14:27.142330 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:14:27.142330 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:14:27.142330 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 could not be found. May 28 05:14:27.142330 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:27.142330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cb0712a8-1d0f-4b2d-adaf-464e21fec101 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Returning 404 to user: Instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:14:27.142330 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cb0712a8-1d0f-4b2d-adaf-464e21fec101 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "DELETE /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 404 len: 111 microversion: 2.20 time: 0.035936 May 28 05:14:27.142330 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3279/6441] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 05:14:27 2022] DELETE /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 05:14:27.147470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f4ce3480-e4e2-4425-a263-dd4e5be2a7af tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:27.148083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f4ce3480-e4e2-4425-a263-dd4e5be2a7af tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 03d6e344-40d2-4d47-95b5-c3be216f08d8] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:27.154087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4ce3480-e4e2-4425-a263-dd4e5be2a7af tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:27.154554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4ce3480-e4e2-4425-a263-dd4e5be2a7af tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:27.155360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4ce3480-e4e2-4425-a263-dd4e5be2a7af tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:27.155786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4ce3480-e4e2-4425-a263-dd4e5be2a7af tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:27.169858 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-f4ce3480-e4e2-4425-a263-dd4e5be2a7af tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] HTTP exception thrown: Instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 could not be found. May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f4ce3480-e4e2-4425-a263-dd4e5be2a7af tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Request method failure captured: May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 HTTP/1.1 May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABika4HRAt51MepdVqeqitZHJxFBdujD3Iq_iTBBRhxUxRYc5RHtx-gWaIhwF4x6CpEY2qk8Vu3iSoSw70i7KPkat47IrQRS-xQMhLSpn6dBapbTlfPydWJR0HQwfIlXMQyZT3r3numa2ETn7yh4TMkiOmGrKGNvBzEYd_M7lWyAlfB46U May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-Openstack-Nova-Api-Version: 2.20 May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: ecff011ab9254460a5f9d4c27f1b1932 May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1819630171 May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1819630171 May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: ecff011ab9254460a5f9d4c27f1b1932 May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1819630171 May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AttachVolumeShelveTestJSON-1819630171-project May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 72e4a9ee07a848248029dfa7bf78192c May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1819630171-project May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 could not be found. May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '03d6e344-40d2-4d47-95b5-c3be216f08d8'} May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 could not be found. May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 could not be found. May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:14:27.171477 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:14:27.177681 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:14:27.177681 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:27.177681 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:14:27.177681 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:14:27.177681 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:14:27.177681 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:14:27.177681 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 could not be found. May 28 05:14:27.177681 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:14:27.177681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f4ce3480-e4e2-4425-a263-dd4e5be2a7af tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Returning 404 to user: Instance 03d6e344-40d2-4d47-95b5-c3be216f08d8 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:14:27.177681 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f4ce3480-e4e2-4425-a263-dd4e5be2a7af tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8" status: 404 len: 111 microversion: 2.20 time: 0.030500 May 28 05:14:27.177681 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3163/6442] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:14:27 2022] GET /compute/v2.1/servers/03d6e344-40d2-4d47-95b5-c3be216f08d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 05:14:28.056027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-94f02ea4-3132-471b-a94f-e41e0c6c0b14 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:28.056582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-94f02ea4-3132-471b-a94f-e41e0c6c0b14 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:28.067670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-94f02ea4-3132-471b-a94f-e41e0c6c0b14 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:28.068377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-94f02ea4-3132-471b-a94f-e41e0c6c0b14 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:28.069441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-94f02ea4-3132-471b-a94f-e41e0c6c0b14 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:28.070053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-94f02ea4-3132-471b-a94f-e41e0c6c0b14 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:28.217578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-94f02ea4-3132-471b-a94f-e41e0c6c0b14 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c88ceaa1824d0c9f140709320898dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce83b3e204724e2080ae1303f1a527a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:28.230490 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-94f02ea4-3132-471b-a94f-e41e0c6c0b14 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 200 len: 1608 microversion: 2.1 time: 0.174788 May 28 05:14:28.230490 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3280/6443] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:28 2022] GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 1608 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:28.242768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a40daa6c-a532-4c3c-b511-901ad41f58bc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:28.243412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a40daa6c-a532-4c3c-b511-901ad41f58bc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:28.253430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a40daa6c-a532-4c3c-b511-901ad41f58bc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:28.253905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a40daa6c-a532-4c3c-b511-901ad41f58bc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:28.254811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a40daa6c-a532-4c3c-b511-901ad41f58bc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:28.255338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a40daa6c-a532-4c3c-b511-901ad41f58bc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:28.402173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a40daa6c-a532-4c3c-b511-901ad41f58bc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c88ceaa1824d0c9f140709320898dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce83b3e204724e2080ae1303f1a527a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:28.410300 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a40daa6c-a532-4c3c-b511-901ad41f58bc tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 200 len: 1608 microversion: 2.1 time: 0.171411 May 28 05:14:28.410925 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3164/6444] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:28 2022] GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 1608 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:28.428170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-023cce20-77a1-4cf8-87f0-8618f8e3eac6 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:28.428170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-023cce20-77a1-4cf8-87f0-8618f8e3eac6 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:28.434912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-023cce20-77a1-4cf8-87f0-8618f8e3eac6 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:28.435514 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-023cce20-77a1-4cf8-87f0-8618f8e3eac6 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:28.436523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-023cce20-77a1-4cf8-87f0-8618f8e3eac6 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:28.437221 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-023cce20-77a1-4cf8-87f0-8618f8e3eac6 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:28.616940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-023cce20-77a1-4cf8-87f0-8618f8e3eac6 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c88ceaa1824d0c9f140709320898dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce83b3e204724e2080ae1303f1a527a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:28.626258 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-023cce20-77a1-4cf8-87f0-8618f8e3eac6 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 200 len: 1608 microversion: 2.1 time: 0.202606 May 28 05:14:28.626866 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3281/6445] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:28 2022] GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 1608 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:14:31.173859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-5790e974-1111-4b29-bc70-ecb226c279fb req-7e92426b-0959-43f7-95d0-0264a2f8958c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e58a6607-22eb-4fef-b228-278d25a44280", "tag": "909db0c8-313c-4054-a8f6-c8c245172d1f"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:14:31.185890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5790e974-1111-4b29-bc70-ecb226c279fb req-7e92426b-0959-43f7-95d0-0264a2f8958c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:31.187477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5790e974-1111-4b29-bc70-ecb226c279fb req-7e92426b-0959-43f7-95d0-0264a2f8958c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:31.205504 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-5790e974-1111-4b29-bc70-ecb226c279fb req-7e92426b-0959-43f7-95d0-0264a2f8958c service nova] Creating event network-changed:909db0c8-313c-4054-a8f6-c8c245172d1f for instance e58a6607-22eb-4fef-b228-278d25a44280 on n-h1-843700-1 May 28 05:14:31.211794 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-5790e974-1111-4b29-bc70-ecb226c279fb req-7e92426b-0959-43f7-95d0-0264a2f8958c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042045 May 28 05:14:31.212852 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3165/6446] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:14:33.853672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-abbacac2-a657-4088-b06c-e8901124d574 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:33.854777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-abbacac2-a657-4088-b06c-e8901124d574 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:33.862467 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abbacac2-a657-4088-b06c-e8901124d574 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:33.863201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abbacac2-a657-4088-b06c-e8901124d574 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:33.864188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abbacac2-a657-4088-b06c-e8901124d574 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:33.864802 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abbacac2-a657-4088-b06c-e8901124d574 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:33.881482 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-abbacac2-a657-4088-b06c-e8901124d574 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] HTTP exception thrown: Instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 could not be found. May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-abbacac2-a657-4088-b06c-e8901124d574 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Request method failure captured: May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 HTTP/1.1 May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABika4HRAt51MepdVqeqitZHJxFBdujD3Iq_iTBBRhxUxRYc5RHtx-gWaIhwF4x6CpEY2qk8Vu3iSoSw70i7KPkat47IrQRS-xQMhLSpn6dBapbTlfPydWJR0HQwfIlXMQyZT3r3numa2ETn7yh4TMkiOmGrKGNvBzEYd_M7lWyAlfB46U May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-Openstack-Nova-Api-Version: 2.20 May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: ecff011ab9254460a5f9d4c27f1b1932 May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1819630171 May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1819630171 May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: ecff011ab9254460a5f9d4c27f1b1932 May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1819630171 May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-AttachVolumeShelveTestJSON-1819630171-project May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 72e4a9ee07a848248029dfa7bf78192c May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1819630171-project May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 could not be found. May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '334654f9-2ad8-4cef-b4e8-bf45eb69f937'} May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 could not be found. May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:14:33.883186 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:14:33.889068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 could not be found. May 28 05:14:33.889068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:33.889068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:14:33.889068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:33.889068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:33.889068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:14:33.889068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:14:33.889068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:14:33.889068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:14:33.889068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 could not be found. May 28 05:14:33.889068 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:33.891839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-abbacac2-a657-4088-b06c-e8901124d574 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Returning 404 to user: Instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:14:33.893247 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-abbacac2-a657-4088-b06c-e8901124d574 tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "DELETE /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 404 len: 111 microversion: 2.20 time: 0.043694 May 28 05:14:33.894741 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3282/6447] 10.222.0.58 () {60 vars in 1279 bytes} [Sat May 28 05:14:33 2022] DELETE /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 05:14:33.904490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8e11460d-8066-4c8c-8aee-dacaae8832ef tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:33.905203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8e11460d-8066-4c8c-8aee-dacaae8832ef tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] [instance: 334654f9-2ad8-4cef-b4e8-bf45eb69f937] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:33.912768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e11460d-8066-4c8c-8aee-dacaae8832ef tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:33.913534 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e11460d-8066-4c8c-8aee-dacaae8832ef tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:33.914518 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e11460d-8066-4c8c-8aee-dacaae8832ef tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:33.915170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e11460d-8066-4c8c-8aee-dacaae8832ef tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:33.930964 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-8e11460d-8066-4c8c-8aee-dacaae8832ef tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] HTTP exception thrown: Instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 could not be found. May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8e11460d-8066-4c8c-8aee-dacaae8832ef tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Request method failure captured: May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 HTTP/1.1 May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABika4HRAt51MepdVqeqitZHJxFBdujD3Iq_iTBBRhxUxRYc5RHtx-gWaIhwF4x6CpEY2qk8Vu3iSoSw70i7KPkat47IrQRS-xQMhLSpn6dBapbTlfPydWJR0HQwfIlXMQyZT3r3numa2ETn7yh4TMkiOmGrKGNvBzEYd_M7lWyAlfB46U May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-Openstack-Nova-Api-Version: 2.20 May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: ecff011ab9254460a5f9d4c27f1b1932 May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1819630171 May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecff011ab9254460a5f9d4c27f1b1932"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1819630171 May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: ecff011ab9254460a5f9d4c27f1b1932 May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1819630171 May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-AttachVolumeShelveTestJSON-1819630171-project May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 72e4a9ee07a848248029dfa7bf78192c May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1819630171-project May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 could not be found. May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '334654f9-2ad8-4cef-b4e8-bf45eb69f937'} May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 could not be found. May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 could not be found. May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:14:33.933003 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:14:33.937695 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:14:33.937695 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:33.937695 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:14:33.937695 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:14:33.937695 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:14:33.937695 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:14:33.937695 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 could not be found. May 28 05:14:33.937695 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:14:33.940059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8e11460d-8066-4c8c-8aee-dacaae8832ef tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] Returning 404 to user: Instance 334654f9-2ad8-4cef-b4e8-bf45eb69f937 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:14:33.941222 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8e11460d-8066-4c8c-8aee-dacaae8832ef tempest-AttachVolumeShelveTestJSON-1819630171 tempest-AttachVolumeShelveTestJSON-1819630171-project] 10.222.0.58 "GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937" status: 404 len: 111 microversion: 2.20 time: 0.042339 May 28 05:14:33.942022 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3166/6448] 10.222.0.58 () {60 vars in 1276 bytes} [Sat May 28 05:14:33 2022] GET /compute/v2.1/servers/334654f9-2ad8-4cef-b4e8-bf45eb69f937 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 05:14:40.098331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e065bc83-2ba3-4d53-b6ee-badb436cfd82 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] Action: 'create', calling method: .version_select at 0x7f7700ebc280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-316647597", "metadata": {"Type": "work"}}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:14:40.929513 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e065bc83-2ba3-4d53-b6ee-badb436cfd82 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.964070 May 28 05:14:40.930349 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3283/6449] 10.222.0.58 () {60 vars in 1155 bytes} [Sat May 28 05:14:39 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 966 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 28 05:14:40.942256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-09e61159-6f44-483f-a987-4ceff30c6cb8 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] Calling method '.version_select at 0x7f7700d62c10>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:40.994241 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-09e61159-6f44-483f-a987-4ceff30c6cb8 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb" status: 200 len: 352 microversion: 2.1 time: 0.056344 May 28 05:14:40.996056 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3167/6450] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 05:14:40 2022] GET /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:14:41.504912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ee153353-69ea-480c-ac11-f357f6c814c6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1799522647", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "f3d501eb-e570-4db5-b706-77386dbf4ef7"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:14:41.556416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-ee153353-69ea-480c-ac11-f357f6c814c6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] validate_networks() for [('f3d501eb-e570-4db5-b706-77386dbf4ef7', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:14:41.902203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-ee153353-69ea-480c-ac11-f357f6c814c6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:14:41.902705 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-ee153353-69ea-480c-ac11-f357f6c814c6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:14:41.903227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-ee153353-69ea-480c-ac11-f357f6c814c6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:14:41.903648 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-ee153353-69ea-480c-ac11-f357f6c814c6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:14:41.904072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-ee153353-69ea-480c-ac11-f357f6c814c6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:14:41.914028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ee153353-69ea-480c-ac11-f357f6c814c6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:41.914492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ee153353-69ea-480c-ac11-f357f6c814c6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:41.915337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ee153353-69ea-480c-ac11-f357f6c814c6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:41.915791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ee153353-69ea-480c-ac11-f357f6c814c6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:41.924158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:14:41.935784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-ee153353-69ea-480c-ac11-f357f6c814c6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Getting quotas for project d88f34952ae149ddaf9341e57072b625. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:14:41.941062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-ee153353-69ea-480c-ac11-f357f6c814c6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Getting quotas for user 7c4b987afe454cc181d8457c840344d4 and project d88f34952ae149ddaf9341e57072b625. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:14:41.953776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ee153353-69ea-480c-ac11-f357f6c814c6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:14:41.956086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ee153353-69ea-480c-ac11-f357f6c814c6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: ad293723-d8e7-4a82-943c-660269306806] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:14:42.008866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-de7c0684-ffed-4bfa-b6f2-71d6ee4cc015 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] Calling method '.version_select at 0x7f770025f8b0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:42.122512 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ee153353-69ea-480c-ac11-f357f6c814c6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620138 May 28 05:14:42.122512 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3284/6451] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:14:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:14:42.130488 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-de7c0684-ffed-4bfa-b6f2-71d6ee4cc015 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb" status: 200 len: 352 microversion: 2.1 time: 0.122069 May 28 05:14:42.132386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-adfd6626-cf8a-4de9-bbb5-e3a925436def tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:42.133187 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3168/6452] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 05:14:42 2022] GET /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb => generated 352 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:14:42.135118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-adfd6626-cf8a-4de9-bbb5-e3a925436def tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: ad293723-d8e7-4a82-943c-660269306806] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:42.191179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-adfd6626-cf8a-4de9-bbb5-e3a925436def tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:42.198149 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-adfd6626-cf8a-4de9-bbb5-e3a925436def tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806" status: 200 len: 1214 microversion: 2.1 time: 0.070537 May 28 05:14:42.199149 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3285/6453] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:42 2022] GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:14:43.145949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-29b11599-96c9-40bf-9198-f0142259a735 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] Calling method '.version_select at 0x7f7700309160>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:43.193545 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-29b11599-96c9-40bf-9198-f0142259a735 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb" status: 200 len: 353 microversion: 2.1 time: 0.052521 May 28 05:14:43.194116 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3169/6454] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 05:14:43 2022] GET /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:14:43.205420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e2f86e32-81b5-413a-a7c0-7d0883480106 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] Calling method '.version_select at 0x7f7700ebca60>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:43.215945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b3a0f4d3-b7f4-4feb-bcfd-290f5213c365 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:43.216587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b3a0f4d3-b7f4-4feb-bcfd-290f5213c365 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: ad293723-d8e7-4a82-943c-660269306806] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:43.223522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b3a0f4d3-b7f4-4feb-bcfd-290f5213c365 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:43.223970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b3a0f4d3-b7f4-4feb-bcfd-290f5213c365 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:43.224737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b3a0f4d3-b7f4-4feb-bcfd-290f5213c365 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:43.225203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b3a0f4d3-b7f4-4feb-bcfd-290f5213c365 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:43.254444 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e2f86e32-81b5-413a-a7c0-7d0883480106 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb" status: 200 len: 353 microversion: 2.1 time: 0.053357 May 28 05:14:43.255042 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3286/6455] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 05:14:43 2022] GET /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:14:43.266164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bc2b030d-7068-4e88-a25c-dd297edc0f81 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] Calling method '.version_select at 0x7f77074234c0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:43.289906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b3a0f4d3-b7f4-4feb-bcfd-290f5213c365 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:43.297787 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b3a0f4d3-b7f4-4feb-bcfd-290f5213c365 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806" status: 200 len: 1218 microversion: 2.1 time: 0.086066 May 28 05:14:43.299011 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3170/6456] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:43 2022] GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:14:43.464283 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bc2b030d-7068-4e88-a25c-dd297edc0f81 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb" status: 202 len: 0 microversion: 2.1 time: 0.201722 May 28 05:14:43.464979 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3287/6457] 10.222.0.58 () {58 vars in 1247 bytes} [Sat May 28 05:14:43 2022] DELETE /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 05:14:43.474703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b36c48de-2bf5-4a12-b2f8-55f514629226 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] Calling method '.version_select at 0x7f7700348e50>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:43.521499 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b36c48de-2bf5-4a12-b2f8-55f514629226 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb" status: 200 len: 352 microversion: 2.1 time: 0.051225 May 28 05:14:43.522091 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3171/6458] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 05:14:43 2022] GET /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:14:44.319234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6c63bdf0-45ec-4d6b-903d-c1892ee1b691 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:44.320745 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6c63bdf0-45ec-4d6b-903d-c1892ee1b691 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: ad293723-d8e7-4a82-943c-660269306806] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:44.328601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c63bdf0-45ec-4d6b-903d-c1892ee1b691 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:44.329308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c63bdf0-45ec-4d6b-903d-c1892ee1b691 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:44.330091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c63bdf0-45ec-4d6b-903d-c1892ee1b691 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:44.331309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6c63bdf0-45ec-4d6b-903d-c1892ee1b691 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:44.417703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6c63bdf0-45ec-4d6b-903d-c1892ee1b691 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:44.428621 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6c63bdf0-45ec-4d6b-903d-c1892ee1b691 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806" status: 200 len: 1274 microversion: 2.1 time: 0.116878 May 28 05:14:44.429220 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3288/6459] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:44 2022] GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806 => generated 1274 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:44.534826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1525fdb9-3561-40da-ab20-b9e2ca5c0768 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] Calling method '.version_select at 0x7f77004a4670>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:44.587374 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1525fdb9-3561-40da-ab20-b9e2ca5c0768 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb" status: 200 len: 352 microversion: 2.1 time: 0.057045 May 28 05:14:44.587975 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3172/6460] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 05:14:44 2022] GET /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:14:45.445812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c0fbe409-82df-4537-b498-777cb07c9917 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:45.446373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c0fbe409-82df-4537-b498-777cb07c9917 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: ad293723-d8e7-4a82-943c-660269306806] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:45.449175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:14:45.455183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0fbe409-82df-4537-b498-777cb07c9917 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:45.456212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0fbe409-82df-4537-b498-777cb07c9917 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:45.457229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0fbe409-82df-4537-b498-777cb07c9917 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:45.457850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0fbe409-82df-4537-b498-777cb07c9917 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:45.604677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c326d220-f86d-483b-a803-00f5568ba21c tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] Calling method '.version_select at 0x7f7700307790>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:45.655521 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c326d220-f86d-483b-a803-00f5568ba21c tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb" status: 200 len: 352 microversion: 2.1 time: 0.059511 May 28 05:14:45.661621 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3173/6461] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 05:14:45 2022] GET /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:14:45.681602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c0fbe409-82df-4537-b498-777cb07c9917 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:45.696355 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c0fbe409-82df-4537-b498-777cb07c9917 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806" status: 200 len: 1314 microversion: 2.1 time: 0.254281 May 28 05:14:45.697148 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3289/6462] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:45 2022] GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:46.106295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-99662fb2-888f-4f73-8900-26ec4744c076 req-b332655a-6650-4dba-a52e-ad19daa42afd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad293723-d8e7-4a82-943c-660269306806", "tag": "8a6287ba-bd42-41cb-b66b-b9b63ff34b46"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:14:46.117128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:14:46.119631 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-99662fb2-888f-4f73-8900-26ec4744c076 req-b332655a-6650-4dba-a52e-ad19daa42afd service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:46.120991 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-99662fb2-888f-4f73-8900-26ec4744c076 req-b332655a-6650-4dba-a52e-ad19daa42afd service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:46.125388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=65 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:14:46.133140 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-99662fb2-888f-4f73-8900-26ec4744c076 req-b332655a-6650-4dba-a52e-ad19daa42afd service nova] Creating event network-changed:8a6287ba-bd42-41cb-b66b-b9b63ff34b46 for instance ad293723-d8e7-4a82-943c-660269306806 on n-h2-843700-1 May 28 05:14:46.144390 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-99662fb2-888f-4f73-8900-26ec4744c076 req-b332655a-6650-4dba-a52e-ad19daa42afd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042209 May 28 05:14:46.145008 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3174/6463] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:14:46.669763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-61566cb8-9606-4fc6-8ad2-099daed41e92 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] Calling method '.version_select at 0x7f770754cee0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:46.717700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f38c020d-503e-4744-9640-bba6faa39943 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:46.718406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f38c020d-503e-4744-9640-bba6faa39943 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: ad293723-d8e7-4a82-943c-660269306806] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:46.726906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f38c020d-503e-4744-9640-bba6faa39943 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:46.727385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f38c020d-503e-4744-9640-bba6faa39943 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:46.728367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f38c020d-503e-4744-9640-bba6faa39943 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:46.728571 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-61566cb8-9606-4fc6-8ad2-099daed41e92 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb" status: 200 len: 352 microversion: 2.1 time: 0.062983 May 28 05:14:46.728979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f38c020d-503e-4744-9640-bba6faa39943 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:46.729207 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3290/6464] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 05:14:46 2022] GET /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:14:46.901132 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f38c020d-503e-4744-9640-bba6faa39943 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:46.910780 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f38c020d-503e-4744-9640-bba6faa39943 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806" status: 200 len: 1314 microversion: 2.1 time: 0.198072 May 28 05:14:46.911437 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3175/6465] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:46 2022] GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:14:47.741672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b467ec18-6e41-4f43-ac35-70f5d6b4b202 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] Calling method '.version_select at 0x7f7700ebe670>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:47.770794 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-b467ec18-6e41-4f43-ac35-70f5d6b4b202 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] HTTP exception thrown: Volume 6d072908-8a31-457f-bce4-8b610f491afb could not be found. May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b467ec18-6e41-4f43-ac35-70f5d6b4b202 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] Request method failure captured: May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb HTTP/1.1 May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABika-_k5nAZP5NViaI3qVMZXcuTXDdjAbvf8xFGRGwB2BBwCi5HeKjriRQTx_PMSWSU5i1ztwYbrCoQxqjHdTheK2vxkyQvrlFvweY_gz03OklyANcgr8-k-XCYTCEwvB10KKSMrTC82I7p-Y6sHpBfdmIogWBNLWuvuXYbF-jm1mjxD8 May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: a741efa7f86546d8bd601c6598f217df May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-VolumesGetTestJSON-734760692 May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a741efa7f86546d8bd601c6598f217df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a741efa7f86546d8bd601c6598f217df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a741efa7f86546d8bd601c6598f217df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a741efa7f86546d8bd601c6598f217df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-VolumesGetTestJSON-734760692 May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: a741efa7f86546d8bd601c6598f217df May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-VolumesGetTestJSON-734760692 May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-VolumesGetTestJSON-734760692-project May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: aabb3e99ec1c440ea46331addfb45856 May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-VolumesGetTestJSON-734760692-project May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: method: May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: exception: Volume 6d072908-8a31-457f-bce4-8b610f491afb could not be found. May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '6d072908-8a31-457f-bce4-8b610f491afb'} May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6d072908-8a31-457f-bce4-8b610f491afb could not be found. (HTTP 404) (Request-ID: req-b37e7065-0ad3-4426-a5aa-7e008079737c) May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 05:14:47.777395 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6d072908-8a31-457f-bce4-8b610f491afb could not be found. May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6d072908-8a31-457f-bce4-8b610f491afb could not be found. May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6d072908-8a31-457f-bce4-8b610f491afb could not be found. May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b467ec18-6e41-4f43-ac35-70f5d6b4b202 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] Returning 404 to user: Volume 6d072908-8a31-457f-bce4-8b610f491afb could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b467ec18-6e41-4f43-ac35-70f5d6b4b202 tempest-VolumesGetTestJSON-734760692 tempest-VolumesGetTestJSON-734760692-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb" status: 404 len: 109 microversion: 2.1 time: 0.042445 May 28 05:14:47.783301 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3291/6466] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 05:14:47 2022] GET /compute/v2.1/os-volumes/6d072908-8a31-457f-bce4-8b610f491afb => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:14:47.929938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-508d533c-e853-4f42-8275-da082141f8b6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:47.930495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-508d533c-e853-4f42-8275-da082141f8b6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: ad293723-d8e7-4a82-943c-660269306806] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:47.937609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-508d533c-e853-4f42-8275-da082141f8b6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:47.939635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-508d533c-e853-4f42-8275-da082141f8b6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:47.939635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-508d533c-e853-4f42-8275-da082141f8b6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:47.939635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-508d533c-e853-4f42-8275-da082141f8b6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:48.073783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-508d533c-e853-4f42-8275-da082141f8b6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:48.081701 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-508d533c-e853-4f42-8275-da082141f8b6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806" status: 200 len: 1314 microversion: 2.1 time: 0.157338 May 28 05:14:48.082918 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3176/6467] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:47 2022] GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:14:49.099164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-19ffd044-b075-442c-81a5-fa24fe4aa8a8 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:49.100020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-19ffd044-b075-442c-81a5-fa24fe4aa8a8 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: ad293723-d8e7-4a82-943c-660269306806] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:49.116408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19ffd044-b075-442c-81a5-fa24fe4aa8a8 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:49.117156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19ffd044-b075-442c-81a5-fa24fe4aa8a8 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:49.120153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19ffd044-b075-442c-81a5-fa24fe4aa8a8 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:49.120794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19ffd044-b075-442c-81a5-fa24fe4aa8a8 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:49.326968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-19ffd044-b075-442c-81a5-fa24fe4aa8a8 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:49.335893 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-19ffd044-b075-442c-81a5-fa24fe4aa8a8 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806" status: 200 len: 1314 microversion: 2.1 time: 0.242105 May 28 05:14:49.336848 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3292/6468] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:49 2022] GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:50.353435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-675727c1-b09f-4c55-9dd6-21c73961494c tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:50.354056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-675727c1-b09f-4c55-9dd6-21c73961494c tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: ad293723-d8e7-4a82-943c-660269306806] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:50.361309 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-675727c1-b09f-4c55-9dd6-21c73961494c tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:50.361792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-675727c1-b09f-4c55-9dd6-21c73961494c tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:50.362580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-675727c1-b09f-4c55-9dd6-21c73961494c tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:50.363040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-675727c1-b09f-4c55-9dd6-21c73961494c tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:50.508712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-675727c1-b09f-4c55-9dd6-21c73961494c tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:50.516407 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-675727c1-b09f-4c55-9dd6-21c73961494c tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806" status: 200 len: 1314 microversion: 2.1 time: 0.167052 May 28 05:14:50.516997 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3177/6469] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:50 2022] GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:51.534301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-59b3e23b-0607-4a06-8e90-fb289c00650e tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:51.534947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-59b3e23b-0607-4a06-8e90-fb289c00650e tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: ad293723-d8e7-4a82-943c-660269306806] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:51.542065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-59b3e23b-0607-4a06-8e90-fb289c00650e tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:51.542515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-59b3e23b-0607-4a06-8e90-fb289c00650e tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:51.543314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-59b3e23b-0607-4a06-8e90-fb289c00650e tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:51.545550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-59b3e23b-0607-4a06-8e90-fb289c00650e tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:51.684026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-028d7d47-18d1-40c9-b913-4e532f41ca3e req-59bca1a2-e5d8-4f80-bece-c6fefc454a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad293723-d8e7-4a82-943c-660269306806", "name": "network-vif-plugged", "status": "completed", "tag": "8a6287ba-bd42-41cb-b66b-b9b63ff34b46"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:14:51.695476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-59b3e23b-0607-4a06-8e90-fb289c00650e tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:51.699863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-028d7d47-18d1-40c9-b913-4e532f41ca3e req-59bca1a2-e5d8-4f80-bece-c6fefc454a37 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:51.700358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-028d7d47-18d1-40c9-b913-4e532f41ca3e req-59bca1a2-e5d8-4f80-bece-c6fefc454a37 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:51.711274 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-59b3e23b-0607-4a06-8e90-fb289c00650e tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806" status: 200 len: 1314 microversion: 2.1 time: 0.179322 May 28 05:14:51.711274 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3293/6470] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:51 2022] GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:14:51.718258 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-028d7d47-18d1-40c9-b913-4e532f41ca3e req-59bca1a2-e5d8-4f80-bece-c6fefc454a37 service nova] Creating event network-vif-plugged:8a6287ba-bd42-41cb-b66b-b9b63ff34b46 for instance ad293723-d8e7-4a82-943c-660269306806 on n-h2-843700-1 May 28 05:14:51.724103 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-028d7d47-18d1-40c9-b913-4e532f41ca3e req-59bca1a2-e5d8-4f80-bece-c6fefc454a37 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048342 May 28 05:14:51.724700 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3178/6471] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:14:52.726625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6daf3dc1-a0ec-4d83-b029-495b7baf3265 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:52.727278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6daf3dc1-a0ec-4d83-b029-495b7baf3265 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: ad293723-d8e7-4a82-943c-660269306806] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:52.729114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:14:52.729825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=8 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:14:52.735592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6daf3dc1-a0ec-4d83-b029-495b7baf3265 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:52.742963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6daf3dc1-a0ec-4d83-b029-495b7baf3265 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:52.742963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6daf3dc1-a0ec-4d83-b029-495b7baf3265 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:52.742963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6daf3dc1-a0ec-4d83-b029-495b7baf3265 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:52.848307 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e8c2ba86-7d6e-4ff4-a817-75d6f92f6e5f tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] Calling method '.version_select at 0x7f7701a80e50>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:52.898491 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e8c2ba86-7d6e-4ff4-a817-75d6f92f6e5f tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/0d23220e-99d2-4357-92c0-150ce4b95d3c" status: 200 len: 350 microversion: 2.1 time: 0.055034 May 28 05:14:52.899751 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3179/6472] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 05:14:52 2022] GET /compute/v2.1/os-volumes/0d23220e-99d2-4357-92c0-150ce4b95d3c => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:14:52.903201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6daf3dc1-a0ec-4d83-b029-495b7baf3265 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:52.912681 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6daf3dc1-a0ec-4d83-b029-495b7baf3265 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806" status: 200 len: 1314 microversion: 2.1 time: 0.189849 May 28 05:14:52.914052 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3294/6473] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:52 2022] GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:53.931360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-abd7e6ce-6c29-4c6a-8ddb-ffd3c74465d4 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:53.932099 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-abd7e6ce-6c29-4c6a-8ddb-ffd3c74465d4 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: ad293723-d8e7-4a82-943c-660269306806] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:53.938956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abd7e6ce-6c29-4c6a-8ddb-ffd3c74465d4 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:53.939444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abd7e6ce-6c29-4c6a-8ddb-ffd3c74465d4 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:53.940882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abd7e6ce-6c29-4c6a-8ddb-ffd3c74465d4 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:53.941317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-abd7e6ce-6c29-4c6a-8ddb-ffd3c74465d4 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:54.071465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-abd7e6ce-6c29-4c6a-8ddb-ffd3c74465d4 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:54.079038 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-abd7e6ce-6c29-4c6a-8ddb-ffd3c74465d4 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806" status: 200 len: 1499 microversion: 2.1 time: 0.152451 May 28 05:14:54.079623 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3180/6474] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:53 2022] GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806 => generated 1499 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:54.911438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-be51e5fe-817a-4420-b19a-48cd3cdbaa03 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:54.912022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-be51e5fe-817a-4420-b19a-48cd3cdbaa03 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: ad293723-d8e7-4a82-943c-660269306806] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:54.919673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-be51e5fe-817a-4420-b19a-48cd3cdbaa03 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:54.920137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-be51e5fe-817a-4420-b19a-48cd3cdbaa03 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:54.921962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-be51e5fe-817a-4420-b19a-48cd3cdbaa03 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:54.921962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-be51e5fe-817a-4420-b19a-48cd3cdbaa03 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:54.949839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-be51e5fe-817a-4420-b19a-48cd3cdbaa03 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: ad293723-d8e7-4a82-943c-660269306806] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:14:55.293133 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-be51e5fe-817a-4420-b19a-48cd3cdbaa03 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806" status: 204 len: 0 microversion: 2.1 time: 0.386196 May 28 05:14:55.293921 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3295/6475] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:14:54 2022] DELETE /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:14:55.302673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f5858f57-409c-490d-8ddf-0a9f8e845a8a tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:55.303318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f5858f57-409c-490d-8ddf-0a9f8e845a8a tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: ad293723-d8e7-4a82-943c-660269306806] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:55.310257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5858f57-409c-490d-8ddf-0a9f8e845a8a tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:55.310712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5858f57-409c-490d-8ddf-0a9f8e845a8a tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:55.311509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5858f57-409c-490d-8ddf-0a9f8e845a8a tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:55.311953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5858f57-409c-490d-8ddf-0a9f8e845a8a tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:55.445386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f5858f57-409c-490d-8ddf-0a9f8e845a8a tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:55.453275 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f5858f57-409c-490d-8ddf-0a9f8e845a8a tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806" status: 200 len: 1505 microversion: 2.1 time: 0.155140 May 28 05:14:55.453851 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3181/6476] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:55 2022] GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:55.506383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d3b686c9-2cae-4c60-8eab-29062e31bb1c tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] Calling method '.version_select at 0x7f7700ea3670>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:55.554007 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d3b686c9-2cae-4c60-8eab-29062e31bb1c tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/bd6b08d0-d0ae-4d98-8849-43f94cd1c7bb" status: 200 len: 351 microversion: 2.1 time: 0.052321 May 28 05:14:55.554592 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3296/6477] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 05:14:55 2022] GET /compute/v2.1/os-volumes/bd6b08d0-d0ae-4d98-8849-43f94cd1c7bb => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:14:56.469661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ad500c78-d8be-42b9-afee-0f7e4323a95b tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:56.470550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ad500c78-d8be-42b9-afee-0f7e4323a95b tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: ad293723-d8e7-4a82-943c-660269306806] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:56.477739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ad500c78-d8be-42b9-afee-0f7e4323a95b tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:56.478290 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ad500c78-d8be-42b9-afee-0f7e4323a95b tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:56.479084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ad500c78-d8be-42b9-afee-0f7e4323a95b tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:56.479524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ad500c78-d8be-42b9-afee-0f7e4323a95b tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:57.026493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ad500c78-d8be-42b9-afee-0f7e4323a95b tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:57.036934 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ad500c78-d8be-42b9-afee-0f7e4323a95b tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806" status: 200 len: 1505 microversion: 2.1 time: 0.571085 May 28 05:14:57.038093 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3182/6478] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:56 2022] GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806 => generated 1505 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:57.461324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-71908dcf-35ef-4c65-a4d2-e21708ed0576 req-0f5e50c9-5bfb-48a7-8865-3efa4e279aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad293723-d8e7-4a82-943c-660269306806", "name": "network-vif-deleted", "tag": "8a6287ba-bd42-41cb-b66b-b9b63ff34b46"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:14:57.475169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-71908dcf-35ef-4c65-a4d2-e21708ed0576 req-0f5e50c9-5bfb-48a7-8865-3efa4e279aac service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:57.475623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-71908dcf-35ef-4c65-a4d2-e21708ed0576 req-0f5e50c9-5bfb-48a7-8865-3efa4e279aac service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:57.491033 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-71908dcf-35ef-4c65-a4d2-e21708ed0576 req-0f5e50c9-5bfb-48a7-8865-3efa4e279aac service nova] Creating event network-vif-deleted:8a6287ba-bd42-41cb-b66b-b9b63ff34b46 for instance ad293723-d8e7-4a82-943c-660269306806 on n-h2-843700-1 May 28 05:14:57.497141 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-71908dcf-35ef-4c65-a4d2-e21708ed0576 req-0f5e50c9-5bfb-48a7-8865-3efa4e279aac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042058 May 28 05:14:57.497785 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3297/6479] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:14:58.054445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-84923957-c077-414d-9630-75c9b4dbfb70 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:58.055092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-84923957-c077-414d-9630-75c9b4dbfb70 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: ad293723-d8e7-4a82-943c-660269306806] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:58.062693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84923957-c077-414d-9630-75c9b4dbfb70 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:58.063177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84923957-c077-414d-9630-75c9b4dbfb70 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:58.063951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84923957-c077-414d-9630-75c9b4dbfb70 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:58.064393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84923957-c077-414d-9630-75c9b4dbfb70 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:58.099019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84923957-c077-414d-9630-75c9b4dbfb70 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:58.099484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84923957-c077-414d-9630-75c9b4dbfb70 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:58.099938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-84923957-c077-414d-9630-75c9b4dbfb70 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lazy-loading 'fault' on Instance uuid ad293723-d8e7-4a82-943c-660269306806 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:14:58.144925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7b547bc9-e0b5-4fc9-bc1e-38738bb788c0 tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] Calling method '.version_select at 0x7f770156ae50>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:58.158705 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-84923957-c077-414d-9630-75c9b4dbfb70 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:58.167172 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-84923957-c077-414d-9630-75c9b4dbfb70 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806" status: 200 len: 1304 microversion: 2.1 time: 0.116536 May 28 05:14:58.167765 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3183/6480] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:58 2022] GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:14:58.198711 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7b547bc9-e0b5-4fc9-bc1e-38738bb788c0 tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/8d92a7e0-4b94-4aa5-af99-b6b13d21dcea" status: 200 len: 351 microversion: 2.1 time: 0.059694 May 28 05:14:58.206451 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3298/6481] 10.222.0.58 () {58 vars in 1244 bytes} [Sat May 28 05:14:58 2022] GET /compute/v2.1/os-volumes/8d92a7e0-4b94-4aa5-af99-b6b13d21dcea => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:14:58.212193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-472690a5-a174-4513-915d-bc191f7064e9 tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] Calling method '.version_select at 0x7f770021a0d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:58.298648 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-472690a5-a174-4513-915d-bc191f7064e9 tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090775 May 28 05:14:58.299348 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3184/6482] 10.222.0.58 () {58 vars in 1133 bytes} [Sat May 28 05:14:58 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:58.311718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3a63020a-141c-41b2-b27c-41f295dc363d tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] Calling method '.version_select at 0x7f7700f46ee0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:58.393321 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3a63020a-141c-41b2-b27c-41f295dc363d tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085412 May 28 05:14:58.394193 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3299/6483] 10.222.0.58 () {58 vars in 1148 bytes} [Sat May 28 05:14:58 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:14:58.405864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bae36519-1849-496b-863b-7c560a72ac66 tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] Calling method '.version_select at 0x7f770034fdc0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:58.484007 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bae36519-1849-496b-863b-7c560a72ac66 tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.082046 May 28 05:14:58.484582 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3185/6484] 10.222.0.58 () {58 vars in 1133 bytes} [Sat May 28 05:14:58 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:58.497216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3aede714-8f6e-4251-a831-7efb7da62c2d tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] Calling method '.version_select at 0x7f7700ebcb80>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:58.577862 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3aede714-8f6e-4251-a831-7efb7da62c2d tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085189 May 28 05:14:58.578448 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3300/6485] 10.222.0.58 () {58 vars in 1166 bytes} [Sat May 28 05:14:58 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:14:58.590274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c487a4f6-866d-42cb-80d6-8459ca82fa8d tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] Calling method '.version_select at 0x7f7700348af0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:58.671882 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c487a4f6-866d-42cb-80d6-8459ca82fa8d tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085249 May 28 05:14:58.672503 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3186/6486] 10.222.0.58 () {58 vars in 1169 bytes} [Sat May 28 05:14:58 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:14:58.684604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1acfc499-42f6-48ef-92a1-510722609932 tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] Calling method '.version_select at 0x7f7701e7ba60>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:58.764889 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1acfc499-42f6-48ef-92a1-510722609932 tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084157 May 28 05:14:58.765485 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3301/6487] 10.222.0.58 () {58 vars in 1154 bytes} [Sat May 28 05:14:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:58.777226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f018c37a-094b-4cce-b4ca-87632cc7538a tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] Calling method '.version_select at 0x7f77003483a0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:58.856641 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f018c37a-094b-4cce-b4ca-87632cc7538a tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083210 May 28 05:14:58.858305 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3187/6488] 10.222.0.58 () {58 vars in 1187 bytes} [Sat May 28 05:14:58 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:14:58.868788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c352935c-996a-4e53-a5ac-38177578e1d0 tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] Calling method '.version_select at 0x7f77074e91f0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:58.951354 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c352935c-996a-4e53-a5ac-38177578e1d0 tempest-VolumesTestJSON-804218375 tempest-VolumesTestJSON-804218375-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086335 May 28 05:14:58.951937 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3302/6489] 10.222.0.58 () {58 vars in 1154 bytes} [Sat May 28 05:14:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:14:59.184963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c89f28ea-ed89-4b0e-ba4e-e183ef3d0924 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:59.185612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c89f28ea-ed89-4b0e-ba4e-e183ef3d0924 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: ad293723-d8e7-4a82-943c-660269306806] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:59.193033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c89f28ea-ed89-4b0e-ba4e-e183ef3d0924 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:59.193489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c89f28ea-ed89-4b0e-ba4e-e183ef3d0924 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:59.194257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c89f28ea-ed89-4b0e-ba4e-e183ef3d0924 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:59.194700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c89f28ea-ed89-4b0e-ba4e-e183ef3d0924 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:59.207922 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-c89f28ea-ed89-4b0e-ba4e-e183ef3d0924 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] HTTP exception thrown: Instance ad293723-d8e7-4a82-943c-660269306806 could not be found. May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c89f28ea-ed89-4b0e-ba4e-e183ef3d0924 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Request method failure captured: May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806 HTTP/1.1 May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABika--9K8ryiEF_kS4RRi6XFDVcu_i43RmdKD5DeEG2tFMiz9f-CEGquYnf2ymHKhcEdjgQPb_3nboIM0JNnW95rqGjMCwwPR9-tn-nGi2ElZCuxFCA3SzvHLVmZukg6NMEkh0B_3IjzzdYua_6c1ZY6NJFa-ZtG5VB0cGygqGoDY8R8U May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: d88f34952ae149ddaf9341e57072b625 May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-VolumesActionsTest-1814966332 May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d88f34952ae149ddaf9341e57072b625"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d88f34952ae149ddaf9341e57072b625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d88f34952ae149ddaf9341e57072b625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d88f34952ae149ddaf9341e57072b625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-VolumesActionsTest-1814966332 May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: d88f34952ae149ddaf9341e57072b625 May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-VolumesActionsTest-1814966332 May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-VolumesActionsTest-1814966332-project May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 7c4b987afe454cc181d8457c840344d4 May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-VolumesActionsTest-1814966332-project May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance ad293723-d8e7-4a82-943c-660269306806 could not be found. May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'ad293723-d8e7-4a82-943c-660269306806'} May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad293723-d8e7-4a82-943c-660269306806 could not be found. May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad293723-d8e7-4a82-943c-660269306806 could not be found. May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:14:59.209595 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:14:59.214904 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:14:59.214904 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:14:59.214904 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:14:59.214904 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:14:59.214904 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:14:59.214904 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad293723-d8e7-4a82-943c-660269306806 could not be found. May 28 05:14:59.214904 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:14:59.214904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c89f28ea-ed89-4b0e-ba4e-e183ef3d0924 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Returning 404 to user: Instance ad293723-d8e7-4a82-943c-660269306806 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:14:59.214904 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c89f28ea-ed89-4b0e-ba4e-e183ef3d0924 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806" status: 404 len: 111 microversion: 2.1 time: 0.030795 May 28 05:14:59.214904 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3188/6490] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:59 2022] GET /compute/v2.1/servers/ad293723-d8e7-4a82-943c-660269306806 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:14:59.314738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-07335208-31f2-4dc6-a595-f4694b49c5d2 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-275506134", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "f3d501eb-e570-4db5-b706-77386dbf4ef7"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:14:59.368601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-07335208-31f2-4dc6-a595-f4694b49c5d2 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] validate_networks() for [('f3d501eb-e570-4db5-b706-77386dbf4ef7', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:14:59.714682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-07335208-31f2-4dc6-a595-f4694b49c5d2 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:14:59.715325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-07335208-31f2-4dc6-a595-f4694b49c5d2 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:14:59.715846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-07335208-31f2-4dc6-a595-f4694b49c5d2 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:14:59.716264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-07335208-31f2-4dc6-a595-f4694b49c5d2 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:14:59.716686 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-07335208-31f2-4dc6-a595-f4694b49c5d2 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:14:59.725643 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07335208-31f2-4dc6-a595-f4694b49c5d2 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:59.726096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07335208-31f2-4dc6-a595-f4694b49c5d2 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:59.726902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07335208-31f2-4dc6-a595-f4694b49c5d2 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:14:59.727374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07335208-31f2-4dc6-a595-f4694b49c5d2 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:14:59.745306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-07335208-31f2-4dc6-a595-f4694b49c5d2 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Getting quotas for project d88f34952ae149ddaf9341e57072b625. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:14:59.750755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-07335208-31f2-4dc6-a595-f4694b49c5d2 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Getting quotas for user 7c4b987afe454cc181d8457c840344d4 and project d88f34952ae149ddaf9341e57072b625. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:14:59.763766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-07335208-31f2-4dc6-a595-f4694b49c5d2 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:14:59.766132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-07335208-31f2-4dc6-a595-f4694b49c5d2 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: a42e1497-1c79-461c-92c8-c3bd0edf82b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:14:59.897704 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-07335208-31f2-4dc6-a595-f4694b49c5d2 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586711 May 28 05:14:59.898474 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3303/6491] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:14:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:14:59.908271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-830f4207-e48e-4be9-9d34-b40f36544789 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:14:59.908942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-830f4207-e48e-4be9-9d34-b40f36544789 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: a42e1497-1c79-461c-92c8-c3bd0edf82b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:14:59.985346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-830f4207-e48e-4be9-9d34-b40f36544789 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:14:59.992985 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-830f4207-e48e-4be9-9d34-b40f36544789 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0" status: 200 len: 1213 microversion: 2.1 time: 0.088596 May 28 05:14:59.998839 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3189/6492] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:14:59 2022] GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:15:01.011015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8f9a6784-75ec-4875-bb46-84fac57218ee tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:01.011610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8f9a6784-75ec-4875-bb46-84fac57218ee tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: a42e1497-1c79-461c-92c8-c3bd0edf82b0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:01.019249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f9a6784-75ec-4875-bb46-84fac57218ee tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:01.020304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f9a6784-75ec-4875-bb46-84fac57218ee tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:01.021088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f9a6784-75ec-4875-bb46-84fac57218ee tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:01.021532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f9a6784-75ec-4875-bb46-84fac57218ee tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:01.085238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8f9a6784-75ec-4875-bb46-84fac57218ee tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:01.093032 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8f9a6784-75ec-4875-bb46-84fac57218ee tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0" status: 200 len: 1209 microversion: 2.1 time: 0.086561 May 28 05:15:01.093841 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3304/6493] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:01 2022] GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0 => generated 1209 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:15:02.119560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53165627-7c3f-45e5-a658-525e92b84004 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:02.121293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-53165627-7c3f-45e5-a658-525e92b84004 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: a42e1497-1c79-461c-92c8-c3bd0edf82b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:02.134897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53165627-7c3f-45e5-a658-525e92b84004 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:02.135689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53165627-7c3f-45e5-a658-525e92b84004 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:02.136511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53165627-7c3f-45e5-a658-525e92b84004 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:02.136963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53165627-7c3f-45e5-a658-525e92b84004 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:02.211171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-53165627-7c3f-45e5-a658-525e92b84004 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:02.219072 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-53165627-7c3f-45e5-a658-525e92b84004 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0" status: 200 len: 1271 microversion: 2.1 time: 0.108687 May 28 05:15:02.219555 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3190/6494] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:02 2022] GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0 => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:15:03.237996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f5e40af6-8e69-430d-a12c-6bbe9796fb63 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:03.239800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f5e40af6-8e69-430d-a12c-6bbe9796fb63 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: a42e1497-1c79-461c-92c8-c3bd0edf82b0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:03.248023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5e40af6-8e69-430d-a12c-6bbe9796fb63 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:03.248619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5e40af6-8e69-430d-a12c-6bbe9796fb63 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:03.249659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5e40af6-8e69-430d-a12c-6bbe9796fb63 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:03.250218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5e40af6-8e69-430d-a12c-6bbe9796fb63 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:03.451976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f5e40af6-8e69-430d-a12c-6bbe9796fb63 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:03.460412 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f5e40af6-8e69-430d-a12c-6bbe9796fb63 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0" status: 200 len: 1313 microversion: 2.1 time: 0.226699 May 28 05:15:03.461021 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3305/6495] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:03 2022] GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:15:03.576771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-8d83bad3-a182-4c1c-a781-f085117cbecf req-967e8e7a-44b8-43f0-b696-2cf17a15edcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a42e1497-1c79-461c-92c8-c3bd0edf82b0", "tag": "4b9d7253-2cc0-4272-a538-92f0f706b982"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:15:03.589729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8d83bad3-a182-4c1c-a781-f085117cbecf req-967e8e7a-44b8-43f0-b696-2cf17a15edcf service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:03.592565 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8d83bad3-a182-4c1c-a781-f085117cbecf req-967e8e7a-44b8-43f0-b696-2cf17a15edcf service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:03.620746 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-8d83bad3-a182-4c1c-a781-f085117cbecf req-967e8e7a-44b8-43f0-b696-2cf17a15edcf service nova] Creating event network-changed:4b9d7253-2cc0-4272-a538-92f0f706b982 for instance a42e1497-1c79-461c-92c8-c3bd0edf82b0 on n-h2-843700-1 May 28 05:15:03.631203 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-8d83bad3-a182-4c1c-a781-f085117cbecf req-967e8e7a-44b8-43f0-b696-2cf17a15edcf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058058 May 28 05:15:03.635268 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3191/6496] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:15:04.612946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6e70690b-9bcb-4a5c-a740-e58db2b559ac tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:04.612946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6e70690b-9bcb-4a5c-a740-e58db2b559ac tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: a42e1497-1c79-461c-92c8-c3bd0edf82b0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:04.612946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e70690b-9bcb-4a5c-a740-e58db2b559ac tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:04.612946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e70690b-9bcb-4a5c-a740-e58db2b559ac tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:04.612946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e70690b-9bcb-4a5c-a740-e58db2b559ac tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:04.612946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e70690b-9bcb-4a5c-a740-e58db2b559ac tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:04.629791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6e70690b-9bcb-4a5c-a740-e58db2b559ac tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:04.638431 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6e70690b-9bcb-4a5c-a740-e58db2b559ac tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0" status: 200 len: 1313 microversion: 2.1 time: 0.164368 May 28 05:15:04.639137 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3306/6497] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:04 2022] GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:15:05.657262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-89800857-e057-474d-83aa-731af443102a tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:05.658105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-89800857-e057-474d-83aa-731af443102a tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: a42e1497-1c79-461c-92c8-c3bd0edf82b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:05.665044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-89800857-e057-474d-83aa-731af443102a tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:05.665509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-89800857-e057-474d-83aa-731af443102a tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:05.666557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-89800857-e057-474d-83aa-731af443102a tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:05.667020 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-89800857-e057-474d-83aa-731af443102a tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:05.808057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-89800857-e057-474d-83aa-731af443102a tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:05.815638 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-89800857-e057-474d-83aa-731af443102a tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0" status: 200 len: 1313 microversion: 2.1 time: 0.163626 May 28 05:15:05.816217 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3192/6498] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:05 2022] GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:15:06.331627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9e78168f-831e-4536-9823-1d86c58416ad tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:06.332168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9e78168f-831e-4536-9823-1d86c58416ad tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:06.339397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e78168f-831e-4536-9823-1d86c58416ad tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:06.340088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e78168f-831e-4536-9823-1d86c58416ad tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:06.340866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e78168f-831e-4536-9823-1d86c58416ad tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:06.341313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e78168f-831e-4536-9823-1d86c58416ad tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:06.366396 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9e78168f-831e-4536-9823-1d86c58416ad tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.039136 May 28 05:15:06.367035 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3307/6499] 10.222.0.58 () {58 vars in 1292 bytes} [Sat May 28 05:15:06 2022] GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280/os-server-password => generated 116 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:15:06.833622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-073e2681-5215-4bd7-bd3b-88833465cb49 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:06.841031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-073e2681-5215-4bd7-bd3b-88833465cb49 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: a42e1497-1c79-461c-92c8-c3bd0edf82b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:06.841357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-073e2681-5215-4bd7-bd3b-88833465cb49 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:06.841811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-073e2681-5215-4bd7-bd3b-88833465cb49 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:06.842585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-073e2681-5215-4bd7-bd3b-88833465cb49 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:06.843043 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-073e2681-5215-4bd7-bd3b-88833465cb49 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:06.981554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-073e2681-5215-4bd7-bd3b-88833465cb49 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:06.989775 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-073e2681-5215-4bd7-bd3b-88833465cb49 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0" status: 200 len: 1313 microversion: 2.1 time: 0.161386 May 28 05:15:06.990361 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3193/6500] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:06 2022] GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:15:08.007273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1c280ab2-515e-4bb4-a44f-d1ff89705976 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:08.008719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1c280ab2-515e-4bb4-a44f-d1ff89705976 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: a42e1497-1c79-461c-92c8-c3bd0edf82b0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:08.015650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1c280ab2-515e-4bb4-a44f-d1ff89705976 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:08.016354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1c280ab2-515e-4bb4-a44f-d1ff89705976 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:08.017226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1c280ab2-515e-4bb4-a44f-d1ff89705976 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:08.017743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1c280ab2-515e-4bb4-a44f-d1ff89705976 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:08.179293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1c280ab2-515e-4bb4-a44f-d1ff89705976 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:08.187782 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1c280ab2-515e-4bb4-a44f-d1ff89705976 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0" status: 200 len: 1313 microversion: 2.1 time: 0.184775 May 28 05:15:08.188368 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3308/6501] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:08 2022] GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:15:09.205596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d21dfab2-1595-426b-9fbc-7eee882d9cfe tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:09.208270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d21dfab2-1595-426b-9fbc-7eee882d9cfe tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: a42e1497-1c79-461c-92c8-c3bd0edf82b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:09.216523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d21dfab2-1595-426b-9fbc-7eee882d9cfe tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:09.217574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d21dfab2-1595-426b-9fbc-7eee882d9cfe tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:09.218549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d21dfab2-1595-426b-9fbc-7eee882d9cfe tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:09.219024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d21dfab2-1595-426b-9fbc-7eee882d9cfe tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:09.367958 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d21dfab2-1595-426b-9fbc-7eee882d9cfe tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:09.374660 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d21dfab2-1595-426b-9fbc-7eee882d9cfe tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0" status: 200 len: 1313 microversion: 2.1 time: 0.173435 May 28 05:15:09.375197 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3194/6502] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:09 2022] GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:15:09.792598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-fb5ba8ff-63c1-4887-9b89-aa37b4bc475c req-2d409c6a-3d12-417f-bcfd-ad2388179167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42e1497-1c79-461c-92c8-c3bd0edf82b0", "name": "network-vif-plugged", "status": "completed", "tag": "4b9d7253-2cc0-4272-a538-92f0f706b982"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:15:09.806263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:15:09.806920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:15:09.810947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-fb5ba8ff-63c1-4887-9b89-aa37b4bc475c req-2d409c6a-3d12-417f-bcfd-ad2388179167 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:09.816980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-fb5ba8ff-63c1-4887-9b89-aa37b4bc475c req-2d409c6a-3d12-417f-bcfd-ad2388179167 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:09.828278 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-fb5ba8ff-63c1-4887-9b89-aa37b4bc475c req-2d409c6a-3d12-417f-bcfd-ad2388179167 service nova] Creating event network-vif-plugged:4b9d7253-2cc0-4272-a538-92f0f706b982 for instance a42e1497-1c79-461c-92c8-c3bd0edf82b0 on n-h2-843700-1 May 28 05:15:09.833400 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-fb5ba8ff-63c1-4887-9b89-aa37b4bc475c req-2d409c6a-3d12-417f-bcfd-ad2388179167 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044861 May 28 05:15:09.834008 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3309/6503] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:15:10.392073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4855b2e8-c0ae-4105-be90-73de6744f5e6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:10.392686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4855b2e8-c0ae-4105-be90-73de6744f5e6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: a42e1497-1c79-461c-92c8-c3bd0edf82b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:10.394782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:15:10.401356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4855b2e8-c0ae-4105-be90-73de6744f5e6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:10.401864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4855b2e8-c0ae-4105-be90-73de6744f5e6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:10.402699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4855b2e8-c0ae-4105-be90-73de6744f5e6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:10.403180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4855b2e8-c0ae-4105-be90-73de6744f5e6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:10.534608 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4855b2e8-c0ae-4105-be90-73de6744f5e6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:10.542605 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4855b2e8-c0ae-4105-be90-73de6744f5e6 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0" status: 200 len: 1313 microversion: 2.1 time: 0.154472 May 28 05:15:10.551689 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3195/6504] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:10 2022] GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:15:11.561887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2e0cd2b9-1374-47f6-a50f-ed09ef4d0b80 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:11.562526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2e0cd2b9-1374-47f6-a50f-ed09ef4d0b80 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: a42e1497-1c79-461c-92c8-c3bd0edf82b0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:11.570248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e0cd2b9-1374-47f6-a50f-ed09ef4d0b80 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:11.570699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e0cd2b9-1374-47f6-a50f-ed09ef4d0b80 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:11.571506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e0cd2b9-1374-47f6-a50f-ed09ef4d0b80 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:11.571955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2e0cd2b9-1374-47f6-a50f-ed09ef4d0b80 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:11.704615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2e0cd2b9-1374-47f6-a50f-ed09ef4d0b80 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:11.712709 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2e0cd2b9-1374-47f6-a50f-ed09ef4d0b80 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0" status: 200 len: 1497 microversion: 2.1 time: 0.156511 May 28 05:15:11.713472 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3310/6505] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:11 2022] GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0 => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:15:12.513568 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c9402c1d-1644-4e19-b40e-e761e80cb2e8 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:12.514141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c9402c1d-1644-4e19-b40e-e761e80cb2e8 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: a42e1497-1c79-461c-92c8-c3bd0edf82b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:12.521661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9402c1d-1644-4e19-b40e-e761e80cb2e8 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:12.522159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9402c1d-1644-4e19-b40e-e761e80cb2e8 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:12.522981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9402c1d-1644-4e19-b40e-e761e80cb2e8 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:12.523444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c9402c1d-1644-4e19-b40e-e761e80cb2e8 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:12.549849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c9402c1d-1644-4e19-b40e-e761e80cb2e8 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: a42e1497-1c79-461c-92c8-c3bd0edf82b0] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:15:12.835808 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c9402c1d-1644-4e19-b40e-e761e80cb2e8 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0" status: 204 len: 0 microversion: 2.1 time: 0.325838 May 28 05:15:12.836431 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3196/6506] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:15:12 2022] DELETE /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 05:15:12.844477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0aed0adf-dae9-4ca3-9e7e-212b14f096a4 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:12.845101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0aed0adf-dae9-4ca3-9e7e-212b14f096a4 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: a42e1497-1c79-461c-92c8-c3bd0edf82b0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:12.852526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0aed0adf-dae9-4ca3-9e7e-212b14f096a4 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:12.852986 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0aed0adf-dae9-4ca3-9e7e-212b14f096a4 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:12.853760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0aed0adf-dae9-4ca3-9e7e-212b14f096a4 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:12.854204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0aed0adf-dae9-4ca3-9e7e-212b14f096a4 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:12.858381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:15:13.037539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0aed0adf-dae9-4ca3-9e7e-212b14f096a4 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:13.046303 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0aed0adf-dae9-4ca3-9e7e-212b14f096a4 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0" status: 200 len: 1503 microversion: 2.1 time: 0.205625 May 28 05:15:13.046898 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3311/6507] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:12 2022] GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0 => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:15:14.064753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8e5b2bb4-7f47-44cb-b1b9-b3a843999453 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:14.066917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8e5b2bb4-7f47-44cb-b1b9-b3a843999453 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: a42e1497-1c79-461c-92c8-c3bd0edf82b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:14.072195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e5b2bb4-7f47-44cb-b1b9-b3a843999453 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:14.073105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e5b2bb4-7f47-44cb-b1b9-b3a843999453 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:14.074108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e5b2bb4-7f47-44cb-b1b9-b3a843999453 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:14.074553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e5b2bb4-7f47-44cb-b1b9-b3a843999453 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:14.093573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:15:14.311739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8e5b2bb4-7f47-44cb-b1b9-b3a843999453 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:14.320283 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8e5b2bb4-7f47-44cb-b1b9-b3a843999453 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0" status: 200 len: 1503 microversion: 2.1 time: 0.259784 May 28 05:15:14.323365 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3197/6508] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:14 2022] GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0 => generated 1503 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:15:14.726867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-1da0679b-1cb2-47b2-98b1-f97854dcbca7 req-35027235-084b-4df2-bac3-ff715aaa1b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42e1497-1c79-461c-92c8-c3bd0edf82b0", "name": "network-vif-deleted", "tag": "4b9d7253-2cc0-4272-a538-92f0f706b982"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:15:14.737191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-1da0679b-1cb2-47b2-98b1-f97854dcbca7 req-35027235-084b-4df2-bac3-ff715aaa1b2e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:14.737812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-1da0679b-1cb2-47b2-98b1-f97854dcbca7 req-35027235-084b-4df2-bac3-ff715aaa1b2e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:14.760162 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-1da0679b-1cb2-47b2-98b1-f97854dcbca7 req-35027235-084b-4df2-bac3-ff715aaa1b2e service nova] Creating event network-vif-deleted:4b9d7253-2cc0-4272-a538-92f0f706b982 for instance a42e1497-1c79-461c-92c8-c3bd0edf82b0 on n-h2-843700-1 May 28 05:15:14.760162 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-1da0679b-1cb2-47b2-98b1-f97854dcbca7 req-35027235-084b-4df2-bac3-ff715aaa1b2e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034603 May 28 05:15:14.760162 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3312/6509] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:15:15.337722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-63fa3e95-a0ad-4aad-9aef-ed7ebaab9942 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:15.338363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-63fa3e95-a0ad-4aad-9aef-ed7ebaab9942 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: a42e1497-1c79-461c-92c8-c3bd0edf82b0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:15.345434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63fa3e95-a0ad-4aad-9aef-ed7ebaab9942 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:15.345890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63fa3e95-a0ad-4aad-9aef-ed7ebaab9942 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:15.346659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63fa3e95-a0ad-4aad-9aef-ed7ebaab9942 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:15.347162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63fa3e95-a0ad-4aad-9aef-ed7ebaab9942 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:15.386373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63fa3e95-a0ad-4aad-9aef-ed7ebaab9942 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:15.386827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-63fa3e95-a0ad-4aad-9aef-ed7ebaab9942 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:15.387307 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-63fa3e95-a0ad-4aad-9aef-ed7ebaab9942 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lazy-loading 'fault' on Instance uuid a42e1497-1c79-461c-92c8-c3bd0edf82b0 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:15:15.430968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-63fa3e95-a0ad-4aad-9aef-ed7ebaab9942 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4b987afe454cc181d8457c840344d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88f34952ae149ddaf9341e57072b625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:15.441569 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-63fa3e95-a0ad-4aad-9aef-ed7ebaab9942 tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0" status: 200 len: 1303 microversion: 2.1 time: 0.107009 May 28 05:15:15.442161 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3198/6510] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:15 2022] GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0 => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:15:16.463027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1db73e1c-70a3-4009-a515-e0ca372498eb tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:16.463027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1db73e1c-70a3-4009-a515-e0ca372498eb tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] [instance: a42e1497-1c79-461c-92c8-c3bd0edf82b0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:16.463613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:15:16.468159 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1db73e1c-70a3-4009-a515-e0ca372498eb tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:16.468616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1db73e1c-70a3-4009-a515-e0ca372498eb tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:16.469416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1db73e1c-70a3-4009-a515-e0ca372498eb tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:16.469853 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1db73e1c-70a3-4009-a515-e0ca372498eb tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:16.487499 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-1db73e1c-70a3-4009-a515-e0ca372498eb tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] HTTP exception thrown: Instance a42e1497-1c79-461c-92c8-c3bd0edf82b0 could not be found. May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1db73e1c-70a3-4009-a515-e0ca372498eb tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Request method failure captured: May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0 HTTP/1.1 May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABika--9K8ryiEF_kS4RRi6XFDVcu_i43RmdKD5DeEG2tFMiz9f-CEGquYnf2ymHKhcEdjgQPb_3nboIM0JNnW95rqGjMCwwPR9-tn-nGi2ElZCuxFCA3SzvHLVmZukg6NMEkh0B_3IjzzdYua_6c1ZY6NJFa-ZtG5VB0cGygqGoDY8R8U May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: d88f34952ae149ddaf9341e57072b625 May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-VolumesActionsTest-1814966332 May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d88f34952ae149ddaf9341e57072b625"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d88f34952ae149ddaf9341e57072b625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d88f34952ae149ddaf9341e57072b625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d88f34952ae149ddaf9341e57072b625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-VolumesActionsTest-1814966332 May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: d88f34952ae149ddaf9341e57072b625 May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-VolumesActionsTest-1814966332 May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-VolumesActionsTest-1814966332-project May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 7c4b987afe454cc181d8457c840344d4 May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-VolumesActionsTest-1814966332-project May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance a42e1497-1c79-461c-92c8-c3bd0edf82b0 could not be found. May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'a42e1497-1c79-461c-92c8-c3bd0edf82b0'} May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a42e1497-1c79-461c-92c8-c3bd0edf82b0 could not be found. May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a42e1497-1c79-461c-92c8-c3bd0edf82b0 could not be found. May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:15:16.489663 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:15:16.495381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:15:16.495381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:15:16.495381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:15:16.495381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:15:16.495381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:15:16.495381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a42e1497-1c79-461c-92c8-c3bd0edf82b0 could not be found. May 28 05:15:16.495381 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:15:16.495381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1db73e1c-70a3-4009-a515-e0ca372498eb tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] Returning 404 to user: Instance a42e1497-1c79-461c-92c8-c3bd0edf82b0 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:15:16.495381 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1db73e1c-70a3-4009-a515-e0ca372498eb tempest-VolumesActionsTest-1814966332 tempest-VolumesActionsTest-1814966332-project] 10.222.0.58 "GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0" status: 404 len: 111 microversion: 2.1 time: 0.035944 May 28 05:15:16.496529 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3313/6511] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:16 2022] GET /compute/v2.1/servers/a42e1497-1c79-461c-92c8-c3bd0edf82b0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:15:49.787340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-faf3cf74-74b9-4da6-b0bf-c372a7c67c13 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1528721765", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:15:49.795014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:15:49.796136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=11 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:15:49.841749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-faf3cf74-74b9-4da6-b0bf-c372a7c67c13 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] validate_networks() for None {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:15:50.196137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-faf3cf74-74b9-4da6-b0bf-c372a7c67c13 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:15:50.196564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-faf3cf74-74b9-4da6-b0bf-c372a7c67c13 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:15:50.197044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-faf3cf74-74b9-4da6-b0bf-c372a7c67c13 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:15:50.197457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-faf3cf74-74b9-4da6-b0bf-c372a7c67c13 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:15:50.197875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-faf3cf74-74b9-4da6-b0bf-c372a7c67c13 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:15:50.207396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-faf3cf74-74b9-4da6-b0bf-c372a7c67c13 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:50.207909 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-faf3cf74-74b9-4da6-b0bf-c372a7c67c13 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:50.209070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-faf3cf74-74b9-4da6-b0bf-c372a7c67c13 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:50.209641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-faf3cf74-74b9-4da6-b0bf-c372a7c67c13 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:50.229101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-faf3cf74-74b9-4da6-b0bf-c372a7c67c13 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Getting quotas for project 34362d3f1b454640998eaa762acb1662. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:15:50.237921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-faf3cf74-74b9-4da6-b0bf-c372a7c67c13 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Getting quotas for user 79d5d5fcd76e47639e705d316fab1aac and project 34362d3f1b454640998eaa762acb1662. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:15:50.255420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-faf3cf74-74b9-4da6-b0bf-c372a7c67c13 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:15:50.257723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-faf3cf74-74b9-4da6-b0bf-c372a7c67c13 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:15:50.402291 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-faf3cf74-74b9-4da6-b0bf-c372a7c67c13 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619537 May 28 05:15:50.403580 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3199/6512] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:15:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:15:50.415571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9ae5bf7c-d3f1-4d38-a1e6-077b49d3a080 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:50.417285 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9ae5bf7c-d3f1-4d38-a1e6-077b49d3a080 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:50.423460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=9 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:15:50.489695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9ae5bf7c-d3f1-4d38-a1e6-077b49d3a080 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d5d5fcd76e47639e705d316fab1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34362d3f1b454640998eaa762acb1662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:50.497195 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9ae5bf7c-d3f1-4d38-a1e6-077b49d3a080 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] 10.222.0.58 "GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f" status: 200 len: 1214 microversion: 2.1 time: 0.087568 May 28 05:15:50.498164 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3314/6513] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:50 2022] GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:15:51.515284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-84c4a5c4-c38d-47b1-a3aa-d314e87ae62d tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:51.515895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-84c4a5c4-c38d-47b1-a3aa-d314e87ae62d tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:51.522040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84c4a5c4-c38d-47b1-a3aa-d314e87ae62d tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:51.522507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84c4a5c4-c38d-47b1-a3aa-d314e87ae62d tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:51.523295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84c4a5c4-c38d-47b1-a3aa-d314e87ae62d tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:51.523733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-84c4a5c4-c38d-47b1-a3aa-d314e87ae62d tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:51.584873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-84c4a5c4-c38d-47b1-a3aa-d314e87ae62d tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d5d5fcd76e47639e705d316fab1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34362d3f1b454640998eaa762acb1662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:51.593704 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-84c4a5c4-c38d-47b1-a3aa-d314e87ae62d tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] 10.222.0.58 "GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f" status: 200 len: 1218 microversion: 2.1 time: 0.083467 May 28 05:15:51.594289 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3200/6514] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:51 2022] GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:15:52.611380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1774d5c2-493a-4324-9440-e636405d6823 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:52.612005 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1774d5c2-493a-4324-9440-e636405d6823 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:52.620584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1774d5c2-493a-4324-9440-e636405d6823 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:52.621114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1774d5c2-493a-4324-9440-e636405d6823 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:52.621901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1774d5c2-493a-4324-9440-e636405d6823 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:52.622346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1774d5c2-493a-4324-9440-e636405d6823 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:52.685027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1774d5c2-493a-4324-9440-e636405d6823 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d5d5fcd76e47639e705d316fab1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34362d3f1b454640998eaa762acb1662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:52.693581 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1774d5c2-493a-4324-9440-e636405d6823 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] 10.222.0.58 "GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f" status: 200 len: 1274 microversion: 2.1 time: 0.087093 May 28 05:15:52.694217 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3315/6515] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:52 2022] GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:15:53.713450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-76ed4bf1-d67e-4d99-8fad-1ffce329047e tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:53.714080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-76ed4bf1-d67e-4d99-8fad-1ffce329047e tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:53.729970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76ed4bf1-d67e-4d99-8fad-1ffce329047e tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:53.730436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76ed4bf1-d67e-4d99-8fad-1ffce329047e tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:53.731269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76ed4bf1-d67e-4d99-8fad-1ffce329047e tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:53.731719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76ed4bf1-d67e-4d99-8fad-1ffce329047e tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:53.976044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-76ed4bf1-d67e-4d99-8fad-1ffce329047e tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d5d5fcd76e47639e705d316fab1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34362d3f1b454640998eaa762acb1662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:53.986026 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-76ed4bf1-d67e-4d99-8fad-1ffce329047e tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] 10.222.0.58 "GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f" status: 200 len: 1314 microversion: 2.1 time: 0.276529 May 28 05:15:53.987287 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3201/6516] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:53 2022] GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:15:55.005562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-621d52fe-8c07-4c4b-92a6-f0735340f1c0 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:55.020827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-621d52fe-8c07-4c4b-92a6-f0735340f1c0 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:55.021011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-1f2b63dc-78f4-4447-a304-804b974e823b req-098806c3-f55e-4a83-82e8-702b8bc5dd55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f26c7438-3c8e-4272-8c1d-862e5cb5e79f", "tag": "2e806be2-1b5f-4a3d-9219-dec5aa7194cd"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:15:55.021446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-621d52fe-8c07-4c4b-92a6-f0735340f1c0 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:55.021446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-621d52fe-8c07-4c4b-92a6-f0735340f1c0 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:55.021446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-621d52fe-8c07-4c4b-92a6-f0735340f1c0 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:55.021446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-621d52fe-8c07-4c4b-92a6-f0735340f1c0 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:55.032076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1f2b63dc-78f4-4447-a304-804b974e823b req-098806c3-f55e-4a83-82e8-702b8bc5dd55 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:55.032724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1f2b63dc-78f4-4447-a304-804b974e823b req-098806c3-f55e-4a83-82e8-702b8bc5dd55 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:55.059573 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-1f2b63dc-78f4-4447-a304-804b974e823b req-098806c3-f55e-4a83-82e8-702b8bc5dd55 service nova] Creating event network-changed:2e806be2-1b5f-4a3d-9219-dec5aa7194cd for instance f26c7438-3c8e-4272-8c1d-862e5cb5e79f on n-h2-843700-1 May 28 05:15:55.070000 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-1f2b63dc-78f4-4447-a304-804b974e823b req-098806c3-f55e-4a83-82e8-702b8bc5dd55 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061617 May 28 05:15:55.070959 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3202/6517] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:15:55.328186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-621d52fe-8c07-4c4b-92a6-f0735340f1c0 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d5d5fcd76e47639e705d316fab1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34362d3f1b454640998eaa762acb1662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:55.339836 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-621d52fe-8c07-4c4b-92a6-f0735340f1c0 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] 10.222.0.58 "GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f" status: 200 len: 1314 microversion: 2.1 time: 0.339912 May 28 05:15:55.341245 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3316/6518] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:54 2022] GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:15:56.358596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-273fe180-7147-4bcb-862c-fca2867fdab3 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:56.359253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-273fe180-7147-4bcb-862c-fca2867fdab3 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:56.366384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-273fe180-7147-4bcb-862c-fca2867fdab3 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:56.366848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-273fe180-7147-4bcb-862c-fca2867fdab3 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:56.367653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-273fe180-7147-4bcb-862c-fca2867fdab3 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:56.368104 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-273fe180-7147-4bcb-862c-fca2867fdab3 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:56.506306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-273fe180-7147-4bcb-862c-fca2867fdab3 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d5d5fcd76e47639e705d316fab1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34362d3f1b454640998eaa762acb1662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:56.514694 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-273fe180-7147-4bcb-862c-fca2867fdab3 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] 10.222.0.58 "GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f" status: 200 len: 1314 microversion: 2.1 time: 0.160371 May 28 05:15:56.515377 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3203/6519] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:56 2022] GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:15:57.533207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-30d7f723-8a79-464d-8b66-ff18d45c0a6d tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:57.533817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-30d7f723-8a79-464d-8b66-ff18d45c0a6d tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:57.540989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30d7f723-8a79-464d-8b66-ff18d45c0a6d tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:57.541473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30d7f723-8a79-464d-8b66-ff18d45c0a6d tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:57.542235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30d7f723-8a79-464d-8b66-ff18d45c0a6d tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:57.542676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30d7f723-8a79-464d-8b66-ff18d45c0a6d tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:57.679258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-30d7f723-8a79-464d-8b66-ff18d45c0a6d tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d5d5fcd76e47639e705d316fab1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34362d3f1b454640998eaa762acb1662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:57.687299 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-30d7f723-8a79-464d-8b66-ff18d45c0a6d tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] 10.222.0.58 "GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f" status: 200 len: 1314 microversion: 2.1 time: 0.158027 May 28 05:15:57.687888 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3317/6520] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:57 2022] GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:15:58.704031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3ea794be-29eb-4494-9ed4-d0e08a04e13c tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:58.705959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3ea794be-29eb-4494-9ed4-d0e08a04e13c tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:58.712021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ea794be-29eb-4494-9ed4-d0e08a04e13c tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:58.712480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ea794be-29eb-4494-9ed4-d0e08a04e13c tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:58.713302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ea794be-29eb-4494-9ed4-d0e08a04e13c tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:58.713742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ea794be-29eb-4494-9ed4-d0e08a04e13c tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:58.845370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3ea794be-29eb-4494-9ed4-d0e08a04e13c tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d5d5fcd76e47639e705d316fab1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34362d3f1b454640998eaa762acb1662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:15:58.853241 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3ea794be-29eb-4494-9ed4-d0e08a04e13c tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] 10.222.0.58 "GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f" status: 200 len: 1314 microversion: 2.1 time: 0.153072 May 28 05:15:58.853815 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3204/6521] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:58 2022] GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:15:59.869977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d5a9673b-d9fd-4821-a20d-e20e0e4c9db3 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:15:59.870605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d5a9673b-d9fd-4821-a20d-e20e0e4c9db3 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:15:59.877237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5a9673b-d9fd-4821-a20d-e20e0e4c9db3 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:59.882485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5a9673b-d9fd-4821-a20d-e20e0e4c9db3 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:15:59.883356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5a9673b-d9fd-4821-a20d-e20e0e4c9db3 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:15:59.884088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5a9673b-d9fd-4821-a20d-e20e0e4c9db3 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:00.082623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d5a9673b-d9fd-4821-a20d-e20e0e4c9db3 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d5d5fcd76e47639e705d316fab1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34362d3f1b454640998eaa762acb1662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:16:00.090210 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d5a9673b-d9fd-4821-a20d-e20e0e4c9db3 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] 10.222.0.58 "GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f" status: 200 len: 1314 microversion: 2.1 time: 0.224419 May 28 05:16:00.090793 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3318/6522] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:15:59 2022] GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:16:01.108505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-03724dec-ad4a-4490-abe7-c42e9056dd7c tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:16:01.109138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-03724dec-ad4a-4490-abe7-c42e9056dd7c tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:16:01.111649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:16:01.112362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:16:01.120896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03724dec-ad4a-4490-abe7-c42e9056dd7c tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:01.121884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03724dec-ad4a-4490-abe7-c42e9056dd7c tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:01.122330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03724dec-ad4a-4490-abe7-c42e9056dd7c tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:01.123233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-03724dec-ad4a-4490-abe7-c42e9056dd7c tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:01.302789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-03724dec-ad4a-4490-abe7-c42e9056dd7c tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d5d5fcd76e47639e705d316fab1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34362d3f1b454640998eaa762acb1662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:16:01.310496 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-03724dec-ad4a-4490-abe7-c42e9056dd7c tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] 10.222.0.58 "GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f" status: 200 len: 1314 microversion: 2.1 time: 0.206570 May 28 05:16:01.311119 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3205/6523] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:16:01 2022] GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:16:02.019338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-8ca50aa7-10b7-4a00-abd8-71f798b3694f req-f95b7f9b-958d-4e03-ab96-ff0d8a90dd92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f26c7438-3c8e-4272-8c1d-862e5cb5e79f", "name": "network-vif-plugged", "status": "completed", "tag": "2e806be2-1b5f-4a3d-9219-dec5aa7194cd"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:16:02.022842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:16:02.028929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8ca50aa7-10b7-4a00-abd8-71f798b3694f req-f95b7f9b-958d-4e03-ab96-ff0d8a90dd92 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:02.029377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8ca50aa7-10b7-4a00-abd8-71f798b3694f req-f95b7f9b-958d-4e03-ab96-ff0d8a90dd92 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:02.040215 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-8ca50aa7-10b7-4a00-abd8-71f798b3694f req-f95b7f9b-958d-4e03-ab96-ff0d8a90dd92 service nova] Creating event network-vif-plugged:2e806be2-1b5f-4a3d-9219-dec5aa7194cd for instance f26c7438-3c8e-4272-8c1d-862e5cb5e79f on n-h2-843700-1 May 28 05:16:02.045505 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-8ca50aa7-10b7-4a00-abd8-71f798b3694f req-f95b7f9b-958d-4e03-ab96-ff0d8a90dd92 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029973 May 28 05:16:02.046100 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3319/6524] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:16:02.328917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c374ce83-7b06-4f64-bd39-cd0a55453197 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:16:02.329552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c374ce83-7b06-4f64-bd39-cd0a55453197 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:16:02.336713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c374ce83-7b06-4f64-bd39-cd0a55453197 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:02.337170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c374ce83-7b06-4f64-bd39-cd0a55453197 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:02.337948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c374ce83-7b06-4f64-bd39-cd0a55453197 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:02.338382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c374ce83-7b06-4f64-bd39-cd0a55453197 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:02.468489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c374ce83-7b06-4f64-bd39-cd0a55453197 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d5d5fcd76e47639e705d316fab1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34362d3f1b454640998eaa762acb1662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:16:02.481638 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c374ce83-7b06-4f64-bd39-cd0a55453197 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] 10.222.0.58 "GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f" status: 200 len: 1314 microversion: 2.1 time: 0.157296 May 28 05:16:02.482306 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3206/6525] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:16:02 2022] GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:16:03.500649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-380d17b5-070f-4b58-a59d-b28377de2a0f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:16:03.501368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-380d17b5-070f-4b58-a59d-b28377de2a0f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:16:03.508700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-380d17b5-070f-4b58-a59d-b28377de2a0f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:03.509192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-380d17b5-070f-4b58-a59d-b28377de2a0f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:03.509962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-380d17b5-070f-4b58-a59d-b28377de2a0f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:03.510408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-380d17b5-070f-4b58-a59d-b28377de2a0f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:03.647129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-380d17b5-070f-4b58-a59d-b28377de2a0f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d5d5fcd76e47639e705d316fab1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34362d3f1b454640998eaa762acb1662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:16:03.655395 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-380d17b5-070f-4b58-a59d-b28377de2a0f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] 10.222.0.58 "GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f" status: 200 len: 1463 microversion: 2.1 time: 0.159922 May 28 05:16:03.655987 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3320/6526] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:16:03 2022] GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f => generated 1463 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:16:03.672985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4c14d48c-803c-49f8-841a-5c0b49702a3f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73265fce-48bc-4b13-9e0b-da122994e0f7", "device": "/dev/sdb"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:16:03.674191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4c14d48c-803c-49f8-841a-5c0b49702a3f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:16:03.681663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c14d48c-803c-49f8-841a-5c0b49702a3f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:03.682116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c14d48c-803c-49f8-841a-5c0b49702a3f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:03.682885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c14d48c-803c-49f8-841a-5c0b49702a3f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:03.683347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c14d48c-803c-49f8-841a-5c0b49702a3f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:04.525386 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4c14d48c-803c-49f8-841a-5c0b49702a3f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] 10.222.0.58 "POST /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.856346 May 28 05:16:04.529853 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3207/6527] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 05:16:03 2022] POST /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f/os-volume_attachments => generated 194 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:16:12.542838 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:16:12.543425 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 05:16:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:16:53.064330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=17 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:16:53.065368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=32 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:16:53.211909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7766d5fd-db4b-4c70-a162-9a8f5a65e476 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1629667325", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "fba470bc-27e6-48aa-acdd-4550a68fbd73"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:16:53.263444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-7766d5fd-db4b-4c70-a162-9a8f5a65e476 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] validate_networks() for [('fba470bc-27e6-48aa-acdd-4550a68fbd73', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:16:53.622434 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-7766d5fd-db4b-4c70-a162-9a8f5a65e476 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:16:53.623018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-7766d5fd-db4b-4c70-a162-9a8f5a65e476 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:16:53.623575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-7766d5fd-db4b-4c70-a162-9a8f5a65e476 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:16:53.624031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-7766d5fd-db4b-4c70-a162-9a8f5a65e476 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:16:53.624451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-7766d5fd-db4b-4c70-a162-9a8f5a65e476 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:16:53.634480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7766d5fd-db4b-4c70-a162-9a8f5a65e476 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:53.634868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7766d5fd-db4b-4c70-a162-9a8f5a65e476 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:53.635763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7766d5fd-db4b-4c70-a162-9a8f5a65e476 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:53.639946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7766d5fd-db4b-4c70-a162-9a8f5a65e476 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:53.654788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-7766d5fd-db4b-4c70-a162-9a8f5a65e476 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Getting quotas for project 6e355edab3ea46ce95be6332a235e171. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:16:53.660321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-7766d5fd-db4b-4c70-a162-9a8f5a65e476 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Getting quotas for user f747f4d657614eea8bf60727a1ac6d6e and project 6e355edab3ea46ce95be6332a235e171. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:16:53.673419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7766d5fd-db4b-4c70-a162-9a8f5a65e476 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:16:53.675778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7766d5fd-db4b-4c70-a162-9a8f5a65e476 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] [instance: 963f6c22-1911-4ed6-a562-fdc909fa2b20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:16:53.834862 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7766d5fd-db4b-4c70-a162-9a8f5a65e476 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.775550 May 28 05:16:53.835834 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3321/6528] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:16:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 05:16:53.844808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:16:53.846150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:16:53.863826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ab515cf4-16c7-4e6e-8080-f8fdb4213bc7 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:16:53.865341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ab515cf4-16c7-4e6e-8080-f8fdb4213bc7 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] [instance: 963f6c22-1911-4ed6-a562-fdc909fa2b20] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:16:53.925839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ab515cf4-16c7-4e6e-8080-f8fdb4213bc7 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747f4d657614eea8bf60727a1ac6d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e355edab3ea46ce95be6332a235e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:16:53.934477 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ab515cf4-16c7-4e6e-8080-f8fdb4213bc7 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] 10.222.0.58 "GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20" status: 200 len: 1214 microversion: 2.1 time: 0.092159 May 28 05:16:53.935499 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3208/6529] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:16:53 2022] GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:16:54.952170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-df39aad6-ab8e-4a16-aa0d-4964b997ab51 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:16:54.952842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-df39aad6-ab8e-4a16-aa0d-4964b997ab51 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] [instance: 963f6c22-1911-4ed6-a562-fdc909fa2b20] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:16:54.961040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df39aad6-ab8e-4a16-aa0d-4964b997ab51 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:54.961496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df39aad6-ab8e-4a16-aa0d-4964b997ab51 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:54.962258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df39aad6-ab8e-4a16-aa0d-4964b997ab51 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:54.962692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df39aad6-ab8e-4a16-aa0d-4964b997ab51 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:55.026440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-df39aad6-ab8e-4a16-aa0d-4964b997ab51 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747f4d657614eea8bf60727a1ac6d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e355edab3ea46ce95be6332a235e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:16:55.036426 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-df39aad6-ab8e-4a16-aa0d-4964b997ab51 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] 10.222.0.58 "GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20" status: 200 len: 1218 microversion: 2.1 time: 0.087543 May 28 05:16:55.037008 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3322/6530] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:16:54 2022] GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:16:56.055607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9f51c377-11fb-4b9d-8a1e-e50d8e40b4ea tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:16:56.057163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9f51c377-11fb-4b9d-8a1e-e50d8e40b4ea tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] [instance: 963f6c22-1911-4ed6-a562-fdc909fa2b20] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:16:56.066793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f51c377-11fb-4b9d-8a1e-e50d8e40b4ea tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:56.072992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f51c377-11fb-4b9d-8a1e-e50d8e40b4ea tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:56.072992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f51c377-11fb-4b9d-8a1e-e50d8e40b4ea tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:56.072992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f51c377-11fb-4b9d-8a1e-e50d8e40b4ea tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:56.162425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9f51c377-11fb-4b9d-8a1e-e50d8e40b4ea tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747f4d657614eea8bf60727a1ac6d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e355edab3ea46ce95be6332a235e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:16:56.173625 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9f51c377-11fb-4b9d-8a1e-e50d8e40b4ea tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] 10.222.0.58 "GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20" status: 200 len: 1284 microversion: 2.1 time: 0.123969 May 28 05:16:56.183694 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3209/6531] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:16:56 2022] GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20 => generated 1284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:16:57.191390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-989a7fe4-9a31-4dcd-af66-9d2dffa0dd59 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:16:57.192017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-989a7fe4-9a31-4dcd-af66-9d2dffa0dd59 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] [instance: 963f6c22-1911-4ed6-a562-fdc909fa2b20] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:16:57.199717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-989a7fe4-9a31-4dcd-af66-9d2dffa0dd59 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:57.200185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-989a7fe4-9a31-4dcd-af66-9d2dffa0dd59 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:57.200966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-989a7fe4-9a31-4dcd-af66-9d2dffa0dd59 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:57.201415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-989a7fe4-9a31-4dcd-af66-9d2dffa0dd59 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:57.420379 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-989a7fe4-9a31-4dcd-af66-9d2dffa0dd59 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747f4d657614eea8bf60727a1ac6d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e355edab3ea46ce95be6332a235e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:16:57.429263 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-989a7fe4-9a31-4dcd-af66-9d2dffa0dd59 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] 10.222.0.58 "GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20" status: 200 len: 1314 microversion: 2.1 time: 0.241810 May 28 05:16:57.429859 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3323/6532] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:16:57 2022] GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:16:57.623652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-5e5b793f-78a0-4059-9df9-323919752161 req-3e431676-7235-4d8e-8052-75316ade9fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "963f6c22-1911-4ed6-a562-fdc909fa2b20", "tag": "44181173-c1ff-4739-8891-68aa11686841"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:16:57.634190 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5e5b793f-78a0-4059-9df9-323919752161 req-3e431676-7235-4d8e-8052-75316ade9fc4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:57.634885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5e5b793f-78a0-4059-9df9-323919752161 req-3e431676-7235-4d8e-8052-75316ade9fc4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:57.646663 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-5e5b793f-78a0-4059-9df9-323919752161 req-3e431676-7235-4d8e-8052-75316ade9fc4 service nova] Creating event network-changed:44181173-c1ff-4739-8891-68aa11686841 for instance 963f6c22-1911-4ed6-a562-fdc909fa2b20 on n-h1-843700-1 May 28 05:16:57.652345 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-5e5b793f-78a0-4059-9df9-323919752161 req-3e431676-7235-4d8e-8052-75316ade9fc4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032434 May 28 05:16:57.653220 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3210/6533] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:16:58.446067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d5d5b0bc-8aef-40b6-a88f-33eb8b05772b tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:16:58.446686 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d5d5b0bc-8aef-40b6-a88f-33eb8b05772b tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] [instance: 963f6c22-1911-4ed6-a562-fdc909fa2b20] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:16:58.453951 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5d5b0bc-8aef-40b6-a88f-33eb8b05772b tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:58.454406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5d5b0bc-8aef-40b6-a88f-33eb8b05772b tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:58.455213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5d5b0bc-8aef-40b6-a88f-33eb8b05772b tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:58.455652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d5d5b0bc-8aef-40b6-a88f-33eb8b05772b tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:58.600127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d5d5b0bc-8aef-40b6-a88f-33eb8b05772b tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747f4d657614eea8bf60727a1ac6d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e355edab3ea46ce95be6332a235e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:16:58.608671 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d5d5b0bc-8aef-40b6-a88f-33eb8b05772b tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] 10.222.0.58 "GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20" status: 200 len: 1314 microversion: 2.1 time: 0.166697 May 28 05:16:58.609424 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3324/6534] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:16:58 2022] GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:16:59.626609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b0c60303-f0d0-4ca1-a87a-4ff2912396de tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:16:59.627334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b0c60303-f0d0-4ca1-a87a-4ff2912396de tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] [instance: 963f6c22-1911-4ed6-a562-fdc909fa2b20] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:16:59.634113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0c60303-f0d0-4ca1-a87a-4ff2912396de tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:59.634570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0c60303-f0d0-4ca1-a87a-4ff2912396de tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:59.635344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0c60303-f0d0-4ca1-a87a-4ff2912396de tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:16:59.635783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0c60303-f0d0-4ca1-a87a-4ff2912396de tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:16:59.769498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b0c60303-f0d0-4ca1-a87a-4ff2912396de tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747f4d657614eea8bf60727a1ac6d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e355edab3ea46ce95be6332a235e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:16:59.777315 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b0c60303-f0d0-4ca1-a87a-4ff2912396de tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] 10.222.0.58 "GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20" status: 200 len: 1314 microversion: 2.1 time: 0.155774 May 28 05:16:59.777983 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3211/6535] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:16:59 2022] GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:17:00.794277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a548dc5a-2b55-455b-b5aa-3ddbc30c4dba tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:17:00.794915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a548dc5a-2b55-455b-b5aa-3ddbc30c4dba tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] [instance: 963f6c22-1911-4ed6-a562-fdc909fa2b20] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:17:00.801515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a548dc5a-2b55-455b-b5aa-3ddbc30c4dba tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:00.801972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a548dc5a-2b55-455b-b5aa-3ddbc30c4dba tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:00.802771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a548dc5a-2b55-455b-b5aa-3ddbc30c4dba tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:00.803222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a548dc5a-2b55-455b-b5aa-3ddbc30c4dba tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:00.932194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a548dc5a-2b55-455b-b5aa-3ddbc30c4dba tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747f4d657614eea8bf60727a1ac6d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e355edab3ea46ce95be6332a235e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:17:00.940421 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a548dc5a-2b55-455b-b5aa-3ddbc30c4dba tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] 10.222.0.58 "GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20" status: 200 len: 1314 microversion: 2.1 time: 0.150438 May 28 05:17:00.941016 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3325/6536] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:17:00 2022] GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:17:01.957838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4c97f3bb-cf9f-4b42-86ec-620227346702 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:17:01.958378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4c97f3bb-cf9f-4b42-86ec-620227346702 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] [instance: 963f6c22-1911-4ed6-a562-fdc909fa2b20] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:17:01.965345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c97f3bb-cf9f-4b42-86ec-620227346702 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:01.965797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c97f3bb-cf9f-4b42-86ec-620227346702 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:01.966559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c97f3bb-cf9f-4b42-86ec-620227346702 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:01.967008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4c97f3bb-cf9f-4b42-86ec-620227346702 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:02.098281 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4c97f3bb-cf9f-4b42-86ec-620227346702 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747f4d657614eea8bf60727a1ac6d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e355edab3ea46ce95be6332a235e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:17:02.105983 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4c97f3bb-cf9f-4b42-86ec-620227346702 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] 10.222.0.58 "GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20" status: 200 len: 1314 microversion: 2.1 time: 0.152225 May 28 05:17:02.106697 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3212/6537] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:17:01 2022] GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:17:03.123533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c9cc16c5-8288-49e8-b306-8b6980e6a128 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:17:03.124161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c9cc16c5-8288-49e8-b306-8b6980e6a128 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] [instance: 963f6c22-1911-4ed6-a562-fdc909fa2b20] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:17:03.132032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9cc16c5-8288-49e8-b306-8b6980e6a128 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:03.132492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9cc16c5-8288-49e8-b306-8b6980e6a128 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:03.133327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9cc16c5-8288-49e8-b306-8b6980e6a128 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:03.133772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9cc16c5-8288-49e8-b306-8b6980e6a128 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:03.263895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c9cc16c5-8288-49e8-b306-8b6980e6a128 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747f4d657614eea8bf60727a1ac6d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e355edab3ea46ce95be6332a235e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:17:03.272345 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c9cc16c5-8288-49e8-b306-8b6980e6a128 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] 10.222.0.58 "GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20" status: 200 len: 1314 microversion: 2.1 time: 0.152743 May 28 05:17:03.272885 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3326/6538] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:17:03 2022] GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:17:03.465058 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-1c0df7fe-b7e2-4d87-839d-309dbb2daec8 req-a42f1ffc-3497-49ee-8518-dc51ed7d4948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "963f6c22-1911-4ed6-a562-fdc909fa2b20", "name": "network-vif-plugged", "status": "completed", "tag": "44181173-c1ff-4739-8891-68aa11686841"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:17:03.474125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1c0df7fe-b7e2-4d87-839d-309dbb2daec8 req-a42f1ffc-3497-49ee-8518-dc51ed7d4948 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:03.474590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1c0df7fe-b7e2-4d87-839d-309dbb2daec8 req-a42f1ffc-3497-49ee-8518-dc51ed7d4948 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:03.486239 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-1c0df7fe-b7e2-4d87-839d-309dbb2daec8 req-a42f1ffc-3497-49ee-8518-dc51ed7d4948 service nova] Creating event network-vif-plugged:44181173-c1ff-4739-8891-68aa11686841 for instance 963f6c22-1911-4ed6-a562-fdc909fa2b20 on n-h1-843700-1 May 28 05:17:03.492275 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-1c0df7fe-b7e2-4d87-839d-309dbb2daec8 req-a42f1ffc-3497-49ee-8518-dc51ed7d4948 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102791 May 28 05:17:03.492876 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3213/6539] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:17:04.294918 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7fb92b8c-f83f-47de-bbaf-321fe5546988 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:17:04.295752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7fb92b8c-f83f-47de-bbaf-321fe5546988 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] [instance: 963f6c22-1911-4ed6-a562-fdc909fa2b20] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:17:04.297723 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:17:04.298470 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:17:04.304824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fb92b8c-f83f-47de-bbaf-321fe5546988 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:04.305354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fb92b8c-f83f-47de-bbaf-321fe5546988 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:04.306226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fb92b8c-f83f-47de-bbaf-321fe5546988 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:04.306731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fb92b8c-f83f-47de-bbaf-321fe5546988 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:04.441297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7fb92b8c-f83f-47de-bbaf-321fe5546988 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747f4d657614eea8bf60727a1ac6d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e355edab3ea46ce95be6332a235e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:17:04.449577 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7fb92b8c-f83f-47de-bbaf-321fe5546988 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] 10.222.0.58 "GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20" status: 200 len: 1314 microversion: 2.1 time: 0.164165 May 28 05:17:04.450226 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3327/6540] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:17:04 2022] GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:17:05.465310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:17:05.470690 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e64a277d-339d-4c41-a714-58c1b86f8687 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:17:05.471422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e64a277d-339d-4c41-a714-58c1b86f8687 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] [instance: 963f6c22-1911-4ed6-a562-fdc909fa2b20] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:17:05.477709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e64a277d-339d-4c41-a714-58c1b86f8687 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:05.478171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e64a277d-339d-4c41-a714-58c1b86f8687 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:05.478946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e64a277d-339d-4c41-a714-58c1b86f8687 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:05.479415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e64a277d-339d-4c41-a714-58c1b86f8687 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:05.614585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e64a277d-339d-4c41-a714-58c1b86f8687 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747f4d657614eea8bf60727a1ac6d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e355edab3ea46ce95be6332a235e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:17:05.623282 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e64a277d-339d-4c41-a714-58c1b86f8687 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] 10.222.0.58 "GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20" status: 200 len: 1498 microversion: 2.1 time: 0.158942 May 28 05:17:05.623875 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3214/6541] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:17:05 2022] GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20 => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:17:09.799668 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-df809434-3d3f-44f4-879d-85ee83b205a2 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:17:09.800217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-df809434-3d3f-44f4-879d-85ee83b205a2 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] [instance: 963f6c22-1911-4ed6-a562-fdc909fa2b20] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:17:09.807288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df809434-3d3f-44f4-879d-85ee83b205a2 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:09.807746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df809434-3d3f-44f4-879d-85ee83b205a2 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:09.808513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df809434-3d3f-44f4-879d-85ee83b205a2 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:09.808952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df809434-3d3f-44f4-879d-85ee83b205a2 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:09.839310 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-df809434-3d3f-44f4-879d-85ee83b205a2 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] [instance: 963f6c22-1911-4ed6-a562-fdc909fa2b20] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:17:10.089830 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-df809434-3d3f-44f4-879d-85ee83b205a2 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] 10.222.0.58 "DELETE /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20" status: 204 len: 0 microversion: 2.1 time: 0.293737 May 28 05:17:10.090469 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3328/6542] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:17:09 2022] DELETE /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:17:10.098904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ebd5da39-f99a-498e-9b12-f456fd93ec80 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:17:10.099536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ebd5da39-f99a-498e-9b12-f456fd93ec80 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] [instance: 963f6c22-1911-4ed6-a562-fdc909fa2b20] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:17:10.106749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebd5da39-f99a-498e-9b12-f456fd93ec80 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:10.107257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebd5da39-f99a-498e-9b12-f456fd93ec80 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:10.108057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebd5da39-f99a-498e-9b12-f456fd93ec80 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:10.108472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ebd5da39-f99a-498e-9b12-f456fd93ec80 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:10.245905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ebd5da39-f99a-498e-9b12-f456fd93ec80 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747f4d657614eea8bf60727a1ac6d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e355edab3ea46ce95be6332a235e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:17:10.253681 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ebd5da39-f99a-498e-9b12-f456fd93ec80 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] 10.222.0.58 "GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20" status: 200 len: 1504 microversion: 2.1 time: 0.158758 May 28 05:17:10.254266 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3215/6543] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:17:10 2022] GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:17:11.272360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3a166228-d6af-40b3-bc5e-4acee2bccd27 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:17:11.273218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3a166228-d6af-40b3-bc5e-4acee2bccd27 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] [instance: 963f6c22-1911-4ed6-a562-fdc909fa2b20] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:17:11.279994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a166228-d6af-40b3-bc5e-4acee2bccd27 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:11.281101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a166228-d6af-40b3-bc5e-4acee2bccd27 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:11.282302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a166228-d6af-40b3-bc5e-4acee2bccd27 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:11.282768 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a166228-d6af-40b3-bc5e-4acee2bccd27 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:11.494606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3a166228-d6af-40b3-bc5e-4acee2bccd27 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747f4d657614eea8bf60727a1ac6d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e355edab3ea46ce95be6332a235e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:17:11.502588 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3a166228-d6af-40b3-bc5e-4acee2bccd27 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] 10.222.0.58 "GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20" status: 200 len: 1504 microversion: 2.1 time: 0.235193 May 28 05:17:11.511725 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3329/6544] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:17:11 2022] GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20 => generated 1504 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:17:12.213074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b26ef7e3-4244-408b-8875-a87f371e0f45 req-22ac3df5-4f81-4eb9-a4f9-8647cce80632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "963f6c22-1911-4ed6-a562-fdc909fa2b20", "name": "network-vif-deleted", "tag": "44181173-c1ff-4739-8891-68aa11686841"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:17:12.222652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b26ef7e3-4244-408b-8875-a87f371e0f45 req-22ac3df5-4f81-4eb9-a4f9-8647cce80632 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:12.223166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b26ef7e3-4244-408b-8875-a87f371e0f45 req-22ac3df5-4f81-4eb9-a4f9-8647cce80632 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:12.234118 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b26ef7e3-4244-408b-8875-a87f371e0f45 req-22ac3df5-4f81-4eb9-a4f9-8647cce80632 service nova] Creating event network-vif-deleted:44181173-c1ff-4739-8891-68aa11686841 for instance 963f6c22-1911-4ed6-a562-fdc909fa2b20 on n-h1-843700-1 May 28 05:17:12.239165 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b26ef7e3-4244-408b-8875-a87f371e0f45 req-22ac3df5-4f81-4eb9-a4f9-8647cce80632 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035355 May 28 05:17:12.239809 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3216/6545] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:17:12.520423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-963fd221-69f5-413c-a22c-5c1c51d45d0a tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:17:12.521209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-963fd221-69f5-413c-a22c-5c1c51d45d0a tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] [instance: 963f6c22-1911-4ed6-a562-fdc909fa2b20] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:17:12.528438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-963fd221-69f5-413c-a22c-5c1c51d45d0a tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:12.529031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-963fd221-69f5-413c-a22c-5c1c51d45d0a tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:12.529900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-963fd221-69f5-413c-a22c-5c1c51d45d0a tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:12.530437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-963fd221-69f5-413c-a22c-5c1c51d45d0a tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:12.563153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-963fd221-69f5-413c-a22c-5c1c51d45d0a tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:12.563600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-963fd221-69f5-413c-a22c-5c1c51d45d0a tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:12.564056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-963fd221-69f5-413c-a22c-5c1c51d45d0a tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lazy-loading 'fault' on Instance uuid 963f6c22-1911-4ed6-a562-fdc909fa2b20 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:17:12.620092 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-963fd221-69f5-413c-a22c-5c1c51d45d0a tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747f4d657614eea8bf60727a1ac6d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e355edab3ea46ce95be6332a235e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:17:12.620092 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-963fd221-69f5-413c-a22c-5c1c51d45d0a tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] 10.222.0.58 "GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20" status: 200 len: 1304 microversion: 2.1 time: 0.097511 May 28 05:17:12.620092 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3330/6546] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:17:12 2022] GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:17:13.633526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9259f996-7104-4e41-b857-c8afe58690c7 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:17:13.634259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9259f996-7104-4e41-b857-c8afe58690c7 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] [instance: 963f6c22-1911-4ed6-a562-fdc909fa2b20] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:17:13.640641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9259f996-7104-4e41-b857-c8afe58690c7 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:13.641101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9259f996-7104-4e41-b857-c8afe58690c7 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:13.641875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9259f996-7104-4e41-b857-c8afe58690c7 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:17:13.642315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9259f996-7104-4e41-b857-c8afe58690c7 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:17:13.656157 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-9259f996-7104-4e41-b857-c8afe58690c7 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] HTTP exception thrown: Instance 963f6c22-1911-4ed6-a562-fdc909fa2b20 could not be found. May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9259f996-7104-4e41-b857-c8afe58690c7 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Request method failure captured: May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20 HTTP/1.1 May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbBC8XlLtyY0Kv6hFV2_WO7Koq-bmuI5PMZg1vqc_AfADOhzEWSlHeIB6_DdrOriALmGjA6Lo-xYqhVQMdyol6NfkmhqKPK-OGNFBCX9-Jol_O9u0EPvkijh9B5k7u-tKW_A0Azf30PQVp2vGWSbGR3Vbz8maLk4wq3AP1YYVF_Vxhc May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 6e355edab3ea46ce95be6332a235e171 May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-VolumesActionsTest-1337450904 May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6e355edab3ea46ce95be6332a235e171"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6e355edab3ea46ce95be6332a235e171"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6e355edab3ea46ce95be6332a235e171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6e355edab3ea46ce95be6332a235e171"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-VolumesActionsTest-1337450904 May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 6e355edab3ea46ce95be6332a235e171 May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-VolumesActionsTest-1337450904 May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-VolumesActionsTest-1337450904-project May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: f747f4d657614eea8bf60727a1ac6d6e May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-VolumesActionsTest-1337450904-project May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 963f6c22-1911-4ed6-a562-fdc909fa2b20 could not be found. May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '963f6c22-1911-4ed6-a562-fdc909fa2b20'} May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 963f6c22-1911-4ed6-a562-fdc909fa2b20 could not be found. May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 963f6c22-1911-4ed6-a562-fdc909fa2b20 could not be found. May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:17:13.657797 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:17:13.662143 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:17:13.662143 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:17:13.662143 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:17:13.662143 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:17:13.662143 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:17:13.662143 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 963f6c22-1911-4ed6-a562-fdc909fa2b20 could not be found. May 28 05:17:13.662143 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:17:13.662143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9259f996-7104-4e41-b857-c8afe58690c7 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] Returning 404 to user: Instance 963f6c22-1911-4ed6-a562-fdc909fa2b20 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:17:13.662143 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9259f996-7104-4e41-b857-c8afe58690c7 tempest-VolumesActionsTest-1337450904 tempest-VolumesActionsTest-1337450904-project] 10.222.0.58 "GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20" status: 404 len: 111 microversion: 2.1 time: 0.031392 May 28 05:17:13.662143 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3217/6547] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:17:13 2022] GET /compute/v2.1/servers/963f6c22-1911-4ed6-a562-fdc909fa2b20 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:18:03.148385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fa6f0401-9b4c-43e9-bd61-d5572a67dda8 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:18:03.148889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fa6f0401-9b4c-43e9-bd61-d5572a67dda8 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:18:03.151292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:18:03.152082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:18:03.156792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa6f0401-9b4c-43e9-bd61-d5572a67dda8 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:18:03.157253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa6f0401-9b4c-43e9-bd61-d5572a67dda8 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:18:03.158023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa6f0401-9b4c-43e9-bd61-d5572a67dda8 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:18:03.158468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa6f0401-9b4c-43e9-bd61-d5572a67dda8 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:18:03.240444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-fa6f0401-9b4c-43e9-bd61-d5572a67dda8 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lazy-loading 'services' on Instance uuid f26c7438-3c8e-4272-8c1d-862e5cb5e79f {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:18:03.453262 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fa6f0401-9b4c-43e9-bd61-d5572a67dda8 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f/os-volume_attachments/73265fce-48bc-4b13-9e0b-da122994e0f7" status: 202 len: 0 microversion: 2.1 time: 0.309397 May 28 05:18:03.453793 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3331/6548] 10.222.0.58 () {58 vars in 1415 bytes} [Sat May 28 05:18:03 2022] DELETE /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f/os-volume_attachments/73265fce-48bc-4b13-9e0b-da122994e0f7 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:18:13.001929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7387a44a-abc0-4f7f-b583-6596424f91cf tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:18:13.003010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7387a44a-abc0-4f7f-b583-6596424f91cf tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:18:13.005056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=22 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:18:13.005701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=38 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:18:13.010418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7387a44a-abc0-4f7f-b583-6596424f91cf tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:18:13.010877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7387a44a-abc0-4f7f-b583-6596424f91cf tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:18:13.011656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7387a44a-abc0-4f7f-b583-6596424f91cf tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:18:13.012092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7387a44a-abc0-4f7f-b583-6596424f91cf tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:18:13.037521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7387a44a-abc0-4f7f-b583-6596424f91cf tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:18:13.340782 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7387a44a-abc0-4f7f-b583-6596424f91cf tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f" status: 204 len: 0 microversion: 2.1 time: 0.342812 May 28 05:18:13.341403 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3218/6549] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:18:12 2022] DELETE /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:18:13.350250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d766b9ed-734f-43f9-b5fb-b8f4f709424e tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:18:13.351031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d766b9ed-734f-43f9-b5fb-b8f4f709424e tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:18:13.354069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:18:13.359256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d766b9ed-734f-43f9-b5fb-b8f4f709424e tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:18:13.359716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d766b9ed-734f-43f9-b5fb-b8f4f709424e tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:18:13.360497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d766b9ed-734f-43f9-b5fb-b8f4f709424e tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:18:13.360962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d766b9ed-734f-43f9-b5fb-b8f4f709424e tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:18:13.501324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d766b9ed-734f-43f9-b5fb-b8f4f709424e tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d5d5fcd76e47639e705d316fab1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34362d3f1b454640998eaa762acb1662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:18:13.510152 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d766b9ed-734f-43f9-b5fb-b8f4f709424e tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] 10.222.0.58 "GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f" status: 200 len: 1469 microversion: 2.1 time: 0.164053 May 28 05:18:13.510752 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3332/6550] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:18:13 2022] GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f => generated 1469 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:18:14.528689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-757baaa0-100f-4ebc-936f-9b7e1acf3577 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:18:14.529547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-757baaa0-100f-4ebc-936f-9b7e1acf3577 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:18:14.537924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-757baaa0-100f-4ebc-936f-9b7e1acf3577 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:18:14.538384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-757baaa0-100f-4ebc-936f-9b7e1acf3577 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:18:14.539427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-757baaa0-100f-4ebc-936f-9b7e1acf3577 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:18:14.539870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-757baaa0-100f-4ebc-936f-9b7e1acf3577 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:18:14.670090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-757baaa0-100f-4ebc-936f-9b7e1acf3577 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d5d5fcd76e47639e705d316fab1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34362d3f1b454640998eaa762acb1662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:18:14.678415 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-757baaa0-100f-4ebc-936f-9b7e1acf3577 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] 10.222.0.58 "GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f" status: 200 len: 1469 microversion: 2.1 time: 0.154414 May 28 05:18:14.679004 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3219/6551] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:18:14 2022] GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:18:15.449739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-14ff0faf-327c-4082-bfcb-8a4f42a61696 req-a5ca9a38-9688-4039-910d-b9fa0c353952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f26c7438-3c8e-4272-8c1d-862e5cb5e79f", "name": "network-vif-deleted", "tag": "2e806be2-1b5f-4a3d-9219-dec5aa7194cd"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:18:15.458393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-14ff0faf-327c-4082-bfcb-8a4f42a61696 req-a5ca9a38-9688-4039-910d-b9fa0c353952 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:18:15.458844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-14ff0faf-327c-4082-bfcb-8a4f42a61696 req-a5ca9a38-9688-4039-910d-b9fa0c353952 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:18:15.470561 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-14ff0faf-327c-4082-bfcb-8a4f42a61696 req-a5ca9a38-9688-4039-910d-b9fa0c353952 service nova] Creating event network-vif-deleted:2e806be2-1b5f-4a3d-9219-dec5aa7194cd for instance f26c7438-3c8e-4272-8c1d-862e5cb5e79f on n-h2-843700-1 May 28 05:18:15.476468 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-14ff0faf-327c-4082-bfcb-8a4f42a61696 req-a5ca9a38-9688-4039-910d-b9fa0c353952 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163260 May 28 05:18:15.477574 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3333/6552] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:18:15.695743 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9b2e1ff6-5f21-4a02-a2c6-05482fdd1ab6 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:18:15.697010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9b2e1ff6-5f21-4a02-a2c6-05482fdd1ab6 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:18:15.718308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b2e1ff6-5f21-4a02-a2c6-05482fdd1ab6 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:18:15.718768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b2e1ff6-5f21-4a02-a2c6-05482fdd1ab6 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:18:15.719582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b2e1ff6-5f21-4a02-a2c6-05482fdd1ab6 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:18:15.720024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b2e1ff6-5f21-4a02-a2c6-05482fdd1ab6 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:18:15.755449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b2e1ff6-5f21-4a02-a2c6-05482fdd1ab6 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:18:15.755898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b2e1ff6-5f21-4a02-a2c6-05482fdd1ab6 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:18:15.756354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-9b2e1ff6-5f21-4a02-a2c6-05482fdd1ab6 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lazy-loading 'fault' on Instance uuid f26c7438-3c8e-4272-8c1d-862e5cb5e79f {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:18:15.799635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9b2e1ff6-5f21-4a02-a2c6-05482fdd1ab6 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d5d5fcd76e47639e705d316fab1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34362d3f1b454640998eaa762acb1662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:18:15.807945 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9b2e1ff6-5f21-4a02-a2c6-05482fdd1ab6 tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] 10.222.0.58 "GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f" status: 200 len: 1304 microversion: 2.1 time: 0.116516 May 28 05:18:15.809312 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3220/6553] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:18:15 2022] GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:18:16.827101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e361940d-4cc6-4f8f-989e-e521ae9a053f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:18:16.827811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e361940d-4cc6-4f8f-989e-e521ae9a053f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] [instance: f26c7438-3c8e-4272-8c1d-862e5cb5e79f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:18:16.834152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e361940d-4cc6-4f8f-989e-e521ae9a053f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:18:16.834609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e361940d-4cc6-4f8f-989e-e521ae9a053f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:18:16.835411 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e361940d-4cc6-4f8f-989e-e521ae9a053f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:18:16.835853 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e361940d-4cc6-4f8f-989e-e521ae9a053f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:18:16.849809 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-e361940d-4cc6-4f8f-989e-e521ae9a053f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] HTTP exception thrown: Instance f26c7438-3c8e-4272-8c1d-862e5cb5e79f could not be found. May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e361940d-4cc6-4f8f-989e-e521ae9a053f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Request method failure captured: May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f HTTP/1.1 May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbACd3Y5WNzKVPk6QmqaR9tVOZL9c92JzuQy4ykx-Pxd-zDk4kpvjRuSuubFZ7F1hRWlR-hAWJANLL3X2EKpbct62gECC8gSeVwOJX1cGUSwiXw3Hsz_RYiadgQ_bTi4_Vt042TYs__SDxQ_ds_UGommwegcZpQe21W2LPC-864Kxjk May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 34362d3f1b454640998eaa762acb1662 May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-VolumesBackupsTest-976230526 May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_34362d3f1b454640998eaa762acb1662"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/34362d3f1b454640998eaa762acb1662"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/34362d3f1b454640998eaa762acb1662"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/34362d3f1b454640998eaa762acb1662"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-VolumesBackupsTest-976230526 May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 34362d3f1b454640998eaa762acb1662 May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-VolumesBackupsTest-976230526 May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-VolumesBackupsTest-976230526-project May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 79d5d5fcd76e47639e705d316fab1aac May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-VolumesBackupsTest-976230526-project May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance f26c7438-3c8e-4272-8c1d-862e5cb5e79f could not be found. May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'f26c7438-3c8e-4272-8c1d-862e5cb5e79f'} May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f26c7438-3c8e-4272-8c1d-862e5cb5e79f could not be found. May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f26c7438-3c8e-4272-8c1d-862e5cb5e79f could not be found. May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:18:16.851507 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:18:16.855890 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:18:16.855890 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:18:16.855890 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:18:16.855890 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:18:16.855890 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:18:16.855890 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f26c7438-3c8e-4272-8c1d-862e5cb5e79f could not be found. May 28 05:18:16.855890 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:18:16.855890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e361940d-4cc6-4f8f-989e-e521ae9a053f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] Returning 404 to user: Instance f26c7438-3c8e-4272-8c1d-862e5cb5e79f could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:18:16.855890 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e361940d-4cc6-4f8f-989e-e521ae9a053f tempest-VolumesBackupsTest-976230526 tempest-VolumesBackupsTest-976230526-project] 10.222.0.58 "GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f" status: 404 len: 111 microversion: 2.1 time: 0.031013 May 28 05:18:16.856760 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3334/6554] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:18:16 2022] GET /compute/v2.1/servers/f26c7438-3c8e-4272-8c1d-862e5cb5e79f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:19:09.769372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-20cf4b7c-d864-4af1-961a-5cfbcad93181 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:19:09.769986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-20cf4b7c-d864-4af1-961a-5cfbcad93181 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:19:09.773377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:19:09.774054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:19:09.777812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20cf4b7c-d864-4af1-961a-5cfbcad93181 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:09.778270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20cf4b7c-d864-4af1-961a-5cfbcad93181 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:09.779240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20cf4b7c-d864-4af1-961a-5cfbcad93181 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:09.779703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20cf4b7c-d864-4af1-961a-5cfbcad93181 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:09.810264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-20cf4b7c-d864-4af1-961a-5cfbcad93181 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:19:10.168717 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-20cf4b7c-d864-4af1-961a-5cfbcad93181 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 204 len: 0 microversion: 2.1 time: 0.403381 May 28 05:19:10.169592 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3221/6555] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:19:09 2022] DELETE /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:19:10.186466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:19:10.186466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:19:10.294277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3a64f82c-6b41-4cb5-8ab5-0685d2d61dfd tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:19:10.294904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3a64f82c-6b41-4cb5-8ab5-0685d2d61dfd tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:19:10.301829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a64f82c-6b41-4cb5-8ab5-0685d2d61dfd tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:10.302286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a64f82c-6b41-4cb5-8ab5-0685d2d61dfd tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:10.303726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a64f82c-6b41-4cb5-8ab5-0685d2d61dfd tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:10.308465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a64f82c-6b41-4cb5-8ab5-0685d2d61dfd tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:10.466850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3a64f82c-6b41-4cb5-8ab5-0685d2d61dfd tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c88ceaa1824d0c9f140709320898dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce83b3e204724e2080ae1303f1a527a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:19:10.475507 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3a64f82c-6b41-4cb5-8ab5-0685d2d61dfd tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 200 len: 1732 microversion: 2.1 time: 0.300243 May 28 05:19:10.476080 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3335/6556] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:19:10 2022] GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 1732 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:19:11.496316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cd0c82b8-8500-4358-8d6d-422360fd78c1 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:19:11.498921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cd0c82b8-8500-4358-8d6d-422360fd78c1 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:19:11.508670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd0c82b8-8500-4358-8d6d-422360fd78c1 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:11.509329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd0c82b8-8500-4358-8d6d-422360fd78c1 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:11.510525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd0c82b8-8500-4358-8d6d-422360fd78c1 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:11.511280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd0c82b8-8500-4358-8d6d-422360fd78c1 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:11.727571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cd0c82b8-8500-4358-8d6d-422360fd78c1 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c88ceaa1824d0c9f140709320898dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce83b3e204724e2080ae1303f1a527a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:19:11.738922 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cd0c82b8-8500-4358-8d6d-422360fd78c1 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 200 len: 1732 microversion: 2.1 time: 0.249094 May 28 05:19:11.749886 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3222/6557] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:19:11 2022] GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 1732 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:19:12.509572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-d8ea410d-8a11-46e4-b508-d5734c1cd664 req-f7d3eb83-87a7-4e40-8561-06d3e49c7625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58a6607-22eb-4fef-b228-278d25a44280", "name": "network-vif-deleted", "tag": "909db0c8-313c-4054-a8f6-c8c245172d1f"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:19:12.524881 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d8ea410d-8a11-46e4-b508-d5734c1cd664 req-f7d3eb83-87a7-4e40-8561-06d3e49c7625 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:12.525822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d8ea410d-8a11-46e4-b508-d5734c1cd664 req-f7d3eb83-87a7-4e40-8561-06d3e49c7625 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:12.550153 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-d8ea410d-8a11-46e4-b508-d5734c1cd664 req-f7d3eb83-87a7-4e40-8561-06d3e49c7625 service nova] Creating event network-vif-deleted:909db0c8-313c-4054-a8f6-c8c245172d1f for instance e58a6607-22eb-4fef-b228-278d25a44280 on n-h1-843700-1 May 28 05:19:12.558218 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-d8ea410d-8a11-46e4-b508-d5734c1cd664 req-f7d3eb83-87a7-4e40-8561-06d3e49c7625 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050158 May 28 05:19:12.558218 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3336/6558] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:19:12.757375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4e1de06d-30f4-4bf6-95fb-cc58baba0cd4 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:19:12.758858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4e1de06d-30f4-4bf6-95fb-cc58baba0cd4 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:19:12.774750 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e1de06d-30f4-4bf6-95fb-cc58baba0cd4 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:12.777383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e1de06d-30f4-4bf6-95fb-cc58baba0cd4 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:12.778414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e1de06d-30f4-4bf6-95fb-cc58baba0cd4 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:12.779900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e1de06d-30f4-4bf6-95fb-cc58baba0cd4 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:12.872218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4e1de06d-30f4-4bf6-95fb-cc58baba0cd4 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c88ceaa1824d0c9f140709320898dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce83b3e204724e2080ae1303f1a527a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:19:12.882168 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4e1de06d-30f4-4bf6-95fb-cc58baba0cd4 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 200 len: 1384 microversion: 2.1 time: 0.129956 May 28 05:19:12.893799 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3223/6559] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:19:12 2022] GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 1384 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:19:13.900234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b3a11b65-6943-431a-a661-b610a905fb83 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:19:13.900996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b3a11b65-6943-431a-a661-b610a905fb83 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:19:13.909200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b3a11b65-6943-431a-a661-b610a905fb83 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:13.909784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b3a11b65-6943-431a-a661-b610a905fb83 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:13.910637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b3a11b65-6943-431a-a661-b610a905fb83 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:13.912288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b3a11b65-6943-431a-a661-b610a905fb83 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:13.924892 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-b3a11b65-6943-431a-a661-b610a905fb83 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] HTTP exception thrown: Instance e58a6607-22eb-4fef-b228-278d25a44280 could not be found. May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b3a11b65-6943-431a-a661-b610a905fb83 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Request method failure captured: May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 HTTP/1.1 May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABika-bncV_9gaHE8FrtIc_MImmvA2Dz_vDdNmsZF-hNuACTyd1j0eUud5T8Ywwl08-JARtSqD4upIItEeRCulGnf2aP0gjMbGX3oU9OpE0AaYTW-9RcoZoFRHaCOHzPu9Eq2lPJIf6nSBmei9RKt630x4Vn-Yv87bom_WBmxq8FG2bres May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: ce83b3e204724e2080ae1303f1a527a8 May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TestServerBasicOps-1940838160 May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ce83b3e204724e2080ae1303f1a527a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ce83b3e204724e2080ae1303f1a527a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce83b3e204724e2080ae1303f1a527a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce83b3e204724e2080ae1303f1a527a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TestServerBasicOps-1940838160 May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: ce83b3e204724e2080ae1303f1a527a8 May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TestServerBasicOps-1940838160 May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TestServerBasicOps-1940838160-project May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: d0c88ceaa1824d0c9f140709320898dc May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TestServerBasicOps-1940838160-project May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance e58a6607-22eb-4fef-b228-278d25a44280 could not be found. May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'e58a6607-22eb-4fef-b228-278d25a44280'} May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58a6607-22eb-4fef-b228-278d25a44280 could not be found. May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58a6607-22eb-4fef-b228-278d25a44280 could not be found. May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:19:13.926612 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:19:13.931227 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:19:13.931227 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:19:13.931227 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:19:13.931227 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:19:13.931227 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:19:13.931227 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58a6607-22eb-4fef-b228-278d25a44280 could not be found. May 28 05:19:13.931227 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:19:13.931227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b3a11b65-6943-431a-a661-b610a905fb83 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Returning 404 to user: Instance e58a6607-22eb-4fef-b228-278d25a44280 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:19:13.931975 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b3a11b65-6943-431a-a661-b610a905fb83 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 404 len: 111 microversion: 2.1 time: 0.035319 May 28 05:19:13.934314 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3337/6560] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:19:13 2022] GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:19:14.513348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-49d02979-fef6-4ac8-b0c4-13f23940774c tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:19:14.514004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-49d02979-fef6-4ac8-b0c4-13f23940774c tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:19:14.521288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49d02979-fef6-4ac8-b0c4-13f23940774c tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:14.521863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49d02979-fef6-4ac8-b0c4-13f23940774c tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:14.522649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49d02979-fef6-4ac8-b0c4-13f23940774c tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:14.523127 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49d02979-fef6-4ac8-b0c4-13f23940774c tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:14.539975 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-49d02979-fef6-4ac8-b0c4-13f23940774c tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] HTTP exception thrown: Instance e58a6607-22eb-4fef-b228-278d25a44280 could not be found. May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-49d02979-fef6-4ac8-b0c4-13f23940774c tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Request method failure captured: May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 HTTP/1.1 May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABika-bncV_9gaHE8FrtIc_MImmvA2Dz_vDdNmsZF-hNuACTyd1j0eUud5T8Ywwl08-JARtSqD4upIItEeRCulGnf2aP0gjMbGX3oU9OpE0AaYTW-9RcoZoFRHaCOHzPu9Eq2lPJIf6nSBmei9RKt630x4Vn-Yv87bom_WBmxq8FG2bres May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: ce83b3e204724e2080ae1303f1a527a8 May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestServerBasicOps-1940838160 May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ce83b3e204724e2080ae1303f1a527a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ce83b3e204724e2080ae1303f1a527a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce83b3e204724e2080ae1303f1a527a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce83b3e204724e2080ae1303f1a527a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestServerBasicOps-1940838160 May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: ce83b3e204724e2080ae1303f1a527a8 May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestServerBasicOps-1940838160 May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestServerBasicOps-1940838160-project May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: d0c88ceaa1824d0c9f140709320898dc May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestServerBasicOps-1940838160-project May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance e58a6607-22eb-4fef-b228-278d25a44280 could not be found. May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'e58a6607-22eb-4fef-b228-278d25a44280'} May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58a6607-22eb-4fef-b228-278d25a44280 could not be found. May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:19:14.541656 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58a6607-22eb-4fef-b228-278d25a44280 could not be found. May 28 05:19:14.545702 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:19:14.545702 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:19:14.545702 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:19:14.545702 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:19:14.545702 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:19:14.545702 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:19:14.545702 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:19:14.545702 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:19:14.545702 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58a6607-22eb-4fef-b228-278d25a44280 could not be found. May 28 05:19:14.545702 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:19:14.545702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-49d02979-fef6-4ac8-b0c4-13f23940774c tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Returning 404 to user: Instance e58a6607-22eb-4fef-b228-278d25a44280 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:19:14.545702 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-49d02979-fef6-4ac8-b0c4-13f23940774c tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 404 len: 111 microversion: 2.1 time: 0.034684 May 28 05:19:14.545702 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3224/6561] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:19:14 2022] DELETE /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:19:14.553348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0a292e2b-731e-4060-b1fd-52cfb06f7ffa tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:19:14.554050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0a292e2b-731e-4060-b1fd-52cfb06f7ffa tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [instance: e58a6607-22eb-4fef-b228-278d25a44280] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:19:14.561343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0a292e2b-731e-4060-b1fd-52cfb06f7ffa tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:14.561973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0a292e2b-731e-4060-b1fd-52cfb06f7ffa tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:14.562841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0a292e2b-731e-4060-b1fd-52cfb06f7ffa tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:14.563385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0a292e2b-731e-4060-b1fd-52cfb06f7ffa tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:14.580880 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-0a292e2b-731e-4060-b1fd-52cfb06f7ffa tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] HTTP exception thrown: Instance e58a6607-22eb-4fef-b228-278d25a44280 could not be found. May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0a292e2b-731e-4060-b1fd-52cfb06f7ffa tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Request method failure captured: May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 HTTP/1.1 May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABika-bncV_9gaHE8FrtIc_MImmvA2Dz_vDdNmsZF-hNuACTyd1j0eUud5T8Ywwl08-JARtSqD4upIItEeRCulGnf2aP0gjMbGX3oU9OpE0AaYTW-9RcoZoFRHaCOHzPu9Eq2lPJIf6nSBmei9RKt630x4Vn-Yv87bom_WBmxq8FG2bres May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: ce83b3e204724e2080ae1303f1a527a8 May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TestServerBasicOps-1940838160 May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ce83b3e204724e2080ae1303f1a527a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ce83b3e204724e2080ae1303f1a527a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce83b3e204724e2080ae1303f1a527a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce83b3e204724e2080ae1303f1a527a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TestServerBasicOps-1940838160 May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: ce83b3e204724e2080ae1303f1a527a8 May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TestServerBasicOps-1940838160 May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TestServerBasicOps-1940838160-project May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: d0c88ceaa1824d0c9f140709320898dc May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TestServerBasicOps-1940838160-project May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance e58a6607-22eb-4fef-b228-278d25a44280 could not be found. May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'e58a6607-22eb-4fef-b228-278d25a44280'} May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58a6607-22eb-4fef-b228-278d25a44280 could not be found. May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58a6607-22eb-4fef-b228-278d25a44280 could not be found. May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:19:14.582767 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:19:14.586129 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:19:14.586129 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:19:14.586129 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:19:14.586129 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:19:14.586129 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:19:14.586129 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58a6607-22eb-4fef-b228-278d25a44280 could not be found. May 28 05:19:14.586129 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:19:14.586129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0a292e2b-731e-4060-b1fd-52cfb06f7ffa tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Returning 404 to user: Instance e58a6607-22eb-4fef-b228-278d25a44280 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:19:14.586129 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0a292e2b-731e-4060-b1fd-52cfb06f7ffa tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280" status: 404 len: 111 microversion: 2.1 time: 0.036869 May 28 05:19:14.586129 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3338/6562] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:19:14 2022] GET /compute/v2.1/servers/e58a6607-22eb-4fef-b228-278d25a44280 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:19:14.816654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5bed0883-1134-4baa-87db-84cd130a88e3 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] Calling method '.version_select at 0x7f77002110d0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:19:14.824071 n-d-843700-1 devstack@n-api.service[126043]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5bed0883-1134-4baa-87db-84cd130a88e3 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [53a08edb-8440-4d2a-9ebb-f50b8f6a6d4c] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 05:19:15.828747 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [None req-5bed0883-1134-4baa-87db-84cd130a88e3 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] [53a08edb-8440-4d2a-9ebb-f50b8f6a6d4c] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 49934. May 28 05:19:15.930327 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5bed0883-1134-4baa-87db-84cd130a88e3 tempest-TestServerBasicOps-1940838160 tempest-TestServerBasicOps-1940838160-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1696705096" status: 202 len: 0 microversion: 2.1 time: 1.118379 May 28 05:19:15.931602 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3225/6563] 10.222.0.58 () {58 vars in 1253 bytes} [Sat May 28 05:19:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1696705096 => generated 0 bytes in 1120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:19:32.574120 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:19:32.576321 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 05:19:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:19:33.934896 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:19:33.935561 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 05:19:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:19:46.501741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-96e12777-731c-4deb-9b0a-0ad0c4c21a0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-47994328", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5b949717-cb7e-4ef1-bcad-ef8f710edb21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f8631f0f-218a-4dd3-ad6e-75d0627c5194"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:19:46.510840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=8 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:19:46.511533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=12 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:19:46.702403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-96e12777-731c-4deb-9b0a-0ad0c4c21a0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] validate_networks() for [('f8631f0f-218a-4dd3-ad6e-75d0627c5194', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:19:47.239826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-96e12777-731c-4deb-9b0a-0ad0c4c21a0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:19:47.240253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-96e12777-731c-4deb-9b0a-0ad0c4c21a0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:19:47.240729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-96e12777-731c-4deb-9b0a-0ad0c4c21a0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:19:47.241135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-96e12777-731c-4deb-9b0a-0ad0c4c21a0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:19:47.241544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-96e12777-731c-4deb-9b0a-0ad0c4c21a0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:19:47.261541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96e12777-731c-4deb-9b0a-0ad0c4c21a0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:47.262299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96e12777-731c-4deb-9b0a-0ad0c4c21a0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:47.263156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96e12777-731c-4deb-9b0a-0ad0c4c21a0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:47.263736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96e12777-731c-4deb-9b0a-0ad0c4c21a0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:47.285563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-96e12777-731c-4deb-9b0a-0ad0c4c21a0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Getting quotas for project e45163cf20a447a0a60bc0c0f075fa78. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:19:47.291511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-96e12777-731c-4deb-9b0a-0ad0c4c21a0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Getting quotas for user a33708c760574b0698fc16ddfebad05b and project e45163cf20a447a0a60bc0c0f075fa78. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:19:47.357535 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-96e12777-731c-4deb-9b0a-0ad0c4c21a0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:19:47.359691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-96e12777-731c-4deb-9b0a-0ad0c4c21a0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5b949717-cb7e-4ef1-bcad-ef8f710edb21',volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:19:47.815375 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-96e12777-731c-4deb-9b0a-0ad0c4c21a0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.318717 May 28 05:19:47.816047 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3339/6564] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:19:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:19:47.826318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bb35031d-9bff-4946-ad22-24390666d7bd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:19:47.827820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bb35031d-9bff-4946-ad22-24390666d7bd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:19:47.831673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:19:47.833210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:19:47.988936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bb35031d-9bff-4946-ad22-24390666d7bd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:19:47.996526 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bb35031d-9bff-4946-ad22-24390666d7bd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1055 microversion: 2.1 time: 0.174466 May 28 05:19:47.997175 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3226/6565] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:19:47 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1055 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:19:49.014883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-617ade74-d359-4ba7-9fa0-be8f7ae5e1c8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:19:49.016061 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-617ade74-d359-4ba7-9fa0-be8f7ae5e1c8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:19:49.092386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-617ade74-d359-4ba7-9fa0-be8f7ae5e1c8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:19:49.102586 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-617ade74-d359-4ba7-9fa0-be8f7ae5e1c8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1055 microversion: 2.1 time: 0.092615 May 28 05:19:49.103209 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3340/6566] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:19:49 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1055 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:19:50.129947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-20708e8b-1276-4aaf-adb0-1cd4c2d91c31 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:19:50.129947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-20708e8b-1276-4aaf-adb0-1cd4c2d91c31 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:19:50.142850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20708e8b-1276-4aaf-adb0-1cd4c2d91c31 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:50.142850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20708e8b-1276-4aaf-adb0-1cd4c2d91c31 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:50.142850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20708e8b-1276-4aaf-adb0-1cd4c2d91c31 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:50.144224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20708e8b-1276-4aaf-adb0-1cd4c2d91c31 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:50.241310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-20708e8b-1276-4aaf-adb0-1cd4c2d91c31 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:19:50.250422 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-20708e8b-1276-4aaf-adb0-1cd4c2d91c31 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1153 microversion: 2.1 time: 0.134548 May 28 05:19:50.251289 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3227/6567] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:19:50 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1153 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:19:51.268551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e13dbf64-3fa3-4dfb-b055-b39c1832157c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:19:51.270089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e13dbf64-3fa3-4dfb-b055-b39c1832157c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:19:51.279282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e13dbf64-3fa3-4dfb-b055-b39c1832157c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:51.279737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e13dbf64-3fa3-4dfb-b055-b39c1832157c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:51.280688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e13dbf64-3fa3-4dfb-b055-b39c1832157c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:51.281265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e13dbf64-3fa3-4dfb-b055-b39c1832157c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:51.372060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e13dbf64-3fa3-4dfb-b055-b39c1832157c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:19:51.385013 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e13dbf64-3fa3-4dfb-b055-b39c1832157c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1171 microversion: 2.1 time: 0.120245 May 28 05:19:51.385990 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3341/6568] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:19:51 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1171 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:19:52.403477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4cf509fe-5548-4b2f-9d7d-9abaea099fa2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:19:52.404707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4cf509fe-5548-4b2f-9d7d-9abaea099fa2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:19:52.413430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4cf509fe-5548-4b2f-9d7d-9abaea099fa2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:52.414067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4cf509fe-5548-4b2f-9d7d-9abaea099fa2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:52.415017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4cf509fe-5548-4b2f-9d7d-9abaea099fa2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:52.415903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4cf509fe-5548-4b2f-9d7d-9abaea099fa2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:52.784436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4cf509fe-5548-4b2f-9d7d-9abaea099fa2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:19:52.814019 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4cf509fe-5548-4b2f-9d7d-9abaea099fa2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1213 microversion: 2.1 time: 0.414132 May 28 05:19:52.830296 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3228/6569] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:19:52 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1213 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:19:53.038403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-85cb8abc-9d36-4901-af3e-1b62c1809138 req-84053d4a-cc11-47bc-b868-6019185f16bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3a83a0c-711a-4e1a-9448-a8a502083af4", "tag": "9895196f-4cb7-41f1-a818-5751968fe634"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:19:53.073802 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-85cb8abc-9d36-4901-af3e-1b62c1809138 req-84053d4a-cc11-47bc-b868-6019185f16bb service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:53.075004 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-85cb8abc-9d36-4901-af3e-1b62c1809138 req-84053d4a-cc11-47bc-b868-6019185f16bb service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:53.104813 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-85cb8abc-9d36-4901-af3e-1b62c1809138 req-84053d4a-cc11-47bc-b868-6019185f16bb service nova] Creating event network-changed:9895196f-4cb7-41f1-a818-5751968fe634 for instance f3a83a0c-711a-4e1a-9448-a8a502083af4 on n-h2-843700-1 May 28 05:19:53.110704 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-85cb8abc-9d36-4901-af3e-1b62c1809138 req-84053d4a-cc11-47bc-b868-6019185f16bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076311 May 28 05:19:53.111361 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3342/6570] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:19:53.836947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-458a1b51-a26d-47d2-8051-68f343e9e73c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:19:53.837668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-458a1b51-a26d-47d2-8051-68f343e9e73c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:19:53.852674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-458a1b51-a26d-47d2-8051-68f343e9e73c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:53.853146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-458a1b51-a26d-47d2-8051-68f343e9e73c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:53.853952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-458a1b51-a26d-47d2-8051-68f343e9e73c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:53.854403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-458a1b51-a26d-47d2-8051-68f343e9e73c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:54.103054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-458a1b51-a26d-47d2-8051-68f343e9e73c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:19:54.113131 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-458a1b51-a26d-47d2-8051-68f343e9e73c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1213 microversion: 2.1 time: 0.280489 May 28 05:19:54.114041 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3229/6571] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:19:53 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1213 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:19:55.139686 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-00c265cc-a3f5-4ccf-9e5e-c49859634264 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:19:55.140422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-00c265cc-a3f5-4ccf-9e5e-c49859634264 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:19:55.156716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00c265cc-a3f5-4ccf-9e5e-c49859634264 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:55.157200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00c265cc-a3f5-4ccf-9e5e-c49859634264 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:55.157989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00c265cc-a3f5-4ccf-9e5e-c49859634264 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:55.158453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00c265cc-a3f5-4ccf-9e5e-c49859634264 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:55.323904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-00c265cc-a3f5-4ccf-9e5e-c49859634264 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:19:55.323904 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-00c265cc-a3f5-4ccf-9e5e-c49859634264 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1213 microversion: 2.1 time: 0.187300 May 28 05:19:55.323904 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3343/6572] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:19:55 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1213 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:19:56.342770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-715b4248-9434-4f17-9b6f-33de4a5525fe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:19:56.367679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-715b4248-9434-4f17-9b6f-33de4a5525fe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:19:56.367679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-715b4248-9434-4f17-9b6f-33de4a5525fe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:56.367679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-715b4248-9434-4f17-9b6f-33de4a5525fe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:56.367679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-715b4248-9434-4f17-9b6f-33de4a5525fe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:56.367679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-715b4248-9434-4f17-9b6f-33de4a5525fe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:56.510477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-715b4248-9434-4f17-9b6f-33de4a5525fe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:19:56.519730 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-715b4248-9434-4f17-9b6f-33de4a5525fe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1213 microversion: 2.1 time: 0.185185 May 28 05:19:56.520978 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3230/6573] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:19:56 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1213 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:19:57.537728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-13ffb499-5033-45b6-b06e-5a3e0443a931 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:19:57.538506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-13ffb499-5033-45b6-b06e-5a3e0443a931 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:19:57.541611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:19:57.546674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13ffb499-5033-45b6-b06e-5a3e0443a931 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:57.547272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13ffb499-5033-45b6-b06e-5a3e0443a931 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:57.548167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13ffb499-5033-45b6-b06e-5a3e0443a931 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:57.548699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13ffb499-5033-45b6-b06e-5a3e0443a931 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:57.686815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-13ffb499-5033-45b6-b06e-5a3e0443a931 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:19:57.694358 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-13ffb499-5033-45b6-b06e-5a3e0443a931 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1213 microversion: 2.1 time: 0.160803 May 28 05:19:57.694935 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3344/6574] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:19:57 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1213 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:19:58.708572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:19:58.713516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fbc65efd-f9e1-42b2-825c-a7ce6433f05f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:19:58.714178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fbc65efd-f9e1-42b2-825c-a7ce6433f05f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:19:58.722082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbc65efd-f9e1-42b2-825c-a7ce6433f05f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:58.722549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbc65efd-f9e1-42b2-825c-a7ce6433f05f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:58.727209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbc65efd-f9e1-42b2-825c-a7ce6433f05f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:58.727209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbc65efd-f9e1-42b2-825c-a7ce6433f05f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:58.864438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fbc65efd-f9e1-42b2-825c-a7ce6433f05f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:19:58.872025 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fbc65efd-f9e1-42b2-825c-a7ce6433f05f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1213 microversion: 2.1 time: 0.165400 May 28 05:19:58.883826 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3231/6575] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:19:58 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1213 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:19:59.892964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-76309c16-2460-4175-9920-27ff9e37b2d2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:19:59.893700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-76309c16-2460-4175-9920-27ff9e37b2d2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:19:59.896595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=8 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:19:59.902471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76309c16-2460-4175-9920-27ff9e37b2d2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:59.903040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76309c16-2460-4175-9920-27ff9e37b2d2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:19:59.903945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76309c16-2460-4175-9920-27ff9e37b2d2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:19:59.904486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-76309c16-2460-4175-9920-27ff9e37b2d2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:00.047717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-76309c16-2460-4175-9920-27ff9e37b2d2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:00.056172 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-76309c16-2460-4175-9920-27ff9e37b2d2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1213 microversion: 2.1 time: 0.167650 May 28 05:20:00.056831 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3345/6576] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:19:59 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1213 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:01.073363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7a08b4b8-f28b-4d33-acc5-bcf6cf5f7f43 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:01.074266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7a08b4b8-f28b-4d33-acc5-bcf6cf5f7f43 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:01.081376 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a08b4b8-f28b-4d33-acc5-bcf6cf5f7f43 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:01.081955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a08b4b8-f28b-4d33-acc5-bcf6cf5f7f43 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:01.082818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a08b4b8-f28b-4d33-acc5-bcf6cf5f7f43 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:01.083389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7a08b4b8-f28b-4d33-acc5-bcf6cf5f7f43 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:01.219429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7a08b4b8-f28b-4d33-acc5-bcf6cf5f7f43 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:01.229761 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7a08b4b8-f28b-4d33-acc5-bcf6cf5f7f43 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1213 microversion: 2.1 time: 0.160333 May 28 05:20:01.230345 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3232/6577] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:01 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1213 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:02.247498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-988fa97a-f978-4552-b484-d71eae5428b0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:02.248365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-988fa97a-f978-4552-b484-d71eae5428b0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:02.256050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-988fa97a-f978-4552-b484-d71eae5428b0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:02.256617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-988fa97a-f978-4552-b484-d71eae5428b0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:02.257506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-988fa97a-f978-4552-b484-d71eae5428b0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:02.258078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-988fa97a-f978-4552-b484-d71eae5428b0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:02.414197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-988fa97a-f978-4552-b484-d71eae5428b0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:02.422789 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-988fa97a-f978-4552-b484-d71eae5428b0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1213 microversion: 2.1 time: 0.179339 May 28 05:20:02.427124 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3346/6578] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:02 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1213 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:03.439933 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0d40ef6a-fe6a-491a-9234-8d7d78d2c42c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:03.440574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0d40ef6a-fe6a-491a-9234-8d7d78d2c42c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:03.447722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d40ef6a-fe6a-491a-9234-8d7d78d2c42c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:03.448311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d40ef6a-fe6a-491a-9234-8d7d78d2c42c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:03.449088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d40ef6a-fe6a-491a-9234-8d7d78d2c42c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:03.449536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d40ef6a-fe6a-491a-9234-8d7d78d2c42c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:03.602694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0d40ef6a-fe6a-491a-9234-8d7d78d2c42c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:03.611594 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0d40ef6a-fe6a-491a-9234-8d7d78d2c42c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1213 microversion: 2.1 time: 0.175727 May 28 05:20:03.612194 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3233/6579] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:03 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1213 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:20:04.628264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-84d61246-f747-4269-a444-13692486c225 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:04.629023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-84d61246-f747-4269-a444-13692486c225 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:04.636080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84d61246-f747-4269-a444-13692486c225 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:04.636540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84d61246-f747-4269-a444-13692486c225 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:04.637314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84d61246-f747-4269-a444-13692486c225 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:04.637761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84d61246-f747-4269-a444-13692486c225 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:04.775358 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-84d61246-f747-4269-a444-13692486c225 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:04.784115 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-84d61246-f747-4269-a444-13692486c225 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1213 microversion: 2.1 time: 0.159791 May 28 05:20:04.784791 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3347/6580] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:04 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1213 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:05.802046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-15029c79-a204-4e62-b010-98677b9aa4a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:05.802678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-15029c79-a204-4e62-b010-98677b9aa4a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:05.810202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15029c79-a204-4e62-b010-98677b9aa4a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:05.810686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15029c79-a204-4e62-b010-98677b9aa4a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:05.811497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15029c79-a204-4e62-b010-98677b9aa4a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:05.811943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-15029c79-a204-4e62-b010-98677b9aa4a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:05.986436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-15029c79-a204-4e62-b010-98677b9aa4a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:05.994958 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-15029c79-a204-4e62-b010-98677b9aa4a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1213 microversion: 2.1 time: 0.197348 May 28 05:20:05.996240 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3234/6581] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:05 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1213 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:07.012651 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2b83f491-8d5f-41b1-b93a-ccd8230fed1f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:07.013270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2b83f491-8d5f-41b1-b93a-ccd8230fed1f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:07.021074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b83f491-8d5f-41b1-b93a-ccd8230fed1f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:07.021531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b83f491-8d5f-41b1-b93a-ccd8230fed1f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:07.022322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b83f491-8d5f-41b1-b93a-ccd8230fed1f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:07.022748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2b83f491-8d5f-41b1-b93a-ccd8230fed1f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:07.172971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2b83f491-8d5f-41b1-b93a-ccd8230fed1f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:07.180867 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2b83f491-8d5f-41b1-b93a-ccd8230fed1f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1201 microversion: 2.1 time: 0.172271 May 28 05:20:07.181952 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3348/6582] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:07 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1201 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:08.199354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1fb8b123-a8bb-4929-940a-77157002350e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:08.200014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1fb8b123-a8bb-4929-940a-77157002350e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:08.209911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1fb8b123-a8bb-4929-940a-77157002350e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:08.210372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1fb8b123-a8bb-4929-940a-77157002350e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:08.211195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1fb8b123-a8bb-4929-940a-77157002350e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:08.211638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1fb8b123-a8bb-4929-940a-77157002350e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:08.351567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1fb8b123-a8bb-4929-940a-77157002350e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:08.360434 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1fb8b123-a8bb-4929-940a-77157002350e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1201 microversion: 2.1 time: 0.164745 May 28 05:20:08.361358 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3235/6583] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:08 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1201 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:09.378182 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d8769ae3-43bc-4004-9194-cf345ea0b86c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:09.378799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d8769ae3-43bc-4004-9194-cf345ea0b86c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:09.385814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8769ae3-43bc-4004-9194-cf345ea0b86c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:09.386272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8769ae3-43bc-4004-9194-cf345ea0b86c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:09.387073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8769ae3-43bc-4004-9194-cf345ea0b86c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:09.387519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8769ae3-43bc-4004-9194-cf345ea0b86c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:09.524042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d8769ae3-43bc-4004-9194-cf345ea0b86c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:09.532344 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d8769ae3-43bc-4004-9194-cf345ea0b86c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1201 microversion: 2.1 time: 0.158564 May 28 05:20:09.533234 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3349/6584] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:09 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1201 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:10.549671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7c2e8f97-83ae-4720-a0a8-403178134a1e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:10.552565 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7c2e8f97-83ae-4720-a0a8-403178134a1e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:10.557321 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c2e8f97-83ae-4720-a0a8-403178134a1e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:10.557785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c2e8f97-83ae-4720-a0a8-403178134a1e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:10.558641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c2e8f97-83ae-4720-a0a8-403178134a1e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:10.559150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c2e8f97-83ae-4720-a0a8-403178134a1e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:10.702592 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7c2e8f97-83ae-4720-a0a8-403178134a1e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:10.711313 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7c2e8f97-83ae-4720-a0a8-403178134a1e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1201 microversion: 2.1 time: 0.165302 May 28 05:20:10.712451 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3236/6585] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:10 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1201 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:11.728011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-746276fa-2f46-466c-b776-20fc56c8ddd8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:11.728640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-746276fa-2f46-466c-b776-20fc56c8ddd8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:11.736093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-746276fa-2f46-466c-b776-20fc56c8ddd8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:11.736574 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-746276fa-2f46-466c-b776-20fc56c8ddd8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:11.737362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-746276fa-2f46-466c-b776-20fc56c8ddd8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:11.737809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-746276fa-2f46-466c-b776-20fc56c8ddd8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:11.919795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-746276fa-2f46-466c-b776-20fc56c8ddd8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:11.929188 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-746276fa-2f46-466c-b776-20fc56c8ddd8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1201 microversion: 2.1 time: 0.204710 May 28 05:20:11.938567 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3350/6586] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:11 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1201 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:12.946587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ce94535b-a899-4922-8fbe-9a2a8984d665 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:12.947753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ce94535b-a899-4922-8fbe-9a2a8984d665 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:12.955861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce94535b-a899-4922-8fbe-9a2a8984d665 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:12.963410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce94535b-a899-4922-8fbe-9a2a8984d665 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:12.963410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce94535b-a899-4922-8fbe-9a2a8984d665 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:12.963410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce94535b-a899-4922-8fbe-9a2a8984d665 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:13.131950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ce94535b-a899-4922-8fbe-9a2a8984d665 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:13.140261 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ce94535b-a899-4922-8fbe-9a2a8984d665 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1201 microversion: 2.1 time: 0.197615 May 28 05:20:13.146137 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3237/6587] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:12 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1201 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:14.157419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ae96d74b-26c5-4d7e-b905-20906923cb5b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:14.158172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ae96d74b-26c5-4d7e-b905-20906923cb5b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:14.166109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae96d74b-26c5-4d7e-b905-20906923cb5b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:14.166643 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae96d74b-26c5-4d7e-b905-20906923cb5b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:14.167523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae96d74b-26c5-4d7e-b905-20906923cb5b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:14.168044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae96d74b-26c5-4d7e-b905-20906923cb5b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:14.309083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ae96d74b-26c5-4d7e-b905-20906923cb5b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:14.317317 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ae96d74b-26c5-4d7e-b905-20906923cb5b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1201 microversion: 2.1 time: 0.163830 May 28 05:20:14.317997 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3351/6588] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:14 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1201 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:15.214857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-23d4bcc0-52ef-421a-925f-eb0f5ba0b8a1 req-aba51c10-d8e7-420c-83ce-ea4183652b39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a83a0c-711a-4e1a-9448-a8a502083af4", "name": "network-vif-plugged", "status": "completed", "tag": "9895196f-4cb7-41f1-a818-5751968fe634"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:20:15.224629 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-23d4bcc0-52ef-421a-925f-eb0f5ba0b8a1 req-aba51c10-d8e7-420c-83ce-ea4183652b39 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:15.225432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-23d4bcc0-52ef-421a-925f-eb0f5ba0b8a1 req-aba51c10-d8e7-420c-83ce-ea4183652b39 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:15.237989 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-23d4bcc0-52ef-421a-925f-eb0f5ba0b8a1 req-aba51c10-d8e7-420c-83ce-ea4183652b39 service nova] Creating event network-vif-plugged:9895196f-4cb7-41f1-a818-5751968fe634 for instance f3a83a0c-711a-4e1a-9448-a8a502083af4 on n-h2-843700-1 May 28 05:20:15.243416 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-23d4bcc0-52ef-421a-925f-eb0f5ba0b8a1 req-aba51c10-d8e7-420c-83ce-ea4183652b39 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032298 May 28 05:20:15.244513 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3238/6589] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:20:15.334575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-69980933-2fa2-4ae1-b9e9-63f8326b0724 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:15.335967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-69980933-2fa2-4ae1-b9e9-63f8326b0724 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:15.351759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-69980933-2fa2-4ae1-b9e9-63f8326b0724 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:15.352482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-69980933-2fa2-4ae1-b9e9-63f8326b0724 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:15.353286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-69980933-2fa2-4ae1-b9e9-63f8326b0724 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:15.353781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-69980933-2fa2-4ae1-b9e9-63f8326b0724 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:15.541019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-69980933-2fa2-4ae1-b9e9-63f8326b0724 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:15.549513 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-69980933-2fa2-4ae1-b9e9-63f8326b0724 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1201 microversion: 2.1 time: 0.218763 May 28 05:20:15.552415 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3352/6590] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:15 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1201 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:16.566951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f03dce84-7cd8-47b1-8a0a-212ed8150043 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:16.567977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f03dce84-7cd8-47b1-8a0a-212ed8150043 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:16.576692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f03dce84-7cd8-47b1-8a0a-212ed8150043 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:16.577407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f03dce84-7cd8-47b1-8a0a-212ed8150043 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:16.579272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f03dce84-7cd8-47b1-8a0a-212ed8150043 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:16.580604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f03dce84-7cd8-47b1-8a0a-212ed8150043 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:16.738084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f03dce84-7cd8-47b1-8a0a-212ed8150043 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:16.747243 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f03dce84-7cd8-47b1-8a0a-212ed8150043 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1201 microversion: 2.1 time: 0.185229 May 28 05:20:16.747820 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3239/6591] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:16 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1201 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:17.772889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a7d707d4-2094-4986-96ce-d83afa8d0b4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:17.772889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a7d707d4-2094-4986-96ce-d83afa8d0b4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:17.772889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:20:17.778340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7d707d4-2094-4986-96ce-d83afa8d0b4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:17.778906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7d707d4-2094-4986-96ce-d83afa8d0b4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:17.779790 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7d707d4-2094-4986-96ce-d83afa8d0b4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:17.780357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7d707d4-2094-4986-96ce-d83afa8d0b4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:17.783781 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=71 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:20:17.934374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a7d707d4-2094-4986-96ce-d83afa8d0b4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:17.942344 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a7d707d4-2094-4986-96ce-d83afa8d0b4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1387 microversion: 2.1 time: 0.181413 May 28 05:20:17.943036 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3353/6592] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:17 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1387 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:17.960167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0f38ee7b-cdb6-4f39-a5c7-449e5848b8d2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:17.960796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0f38ee7b-cdb6-4f39-a5c7-449e5848b8d2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:17.971377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f38ee7b-cdb6-4f39-a5c7-449e5848b8d2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:17.971377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f38ee7b-cdb6-4f39-a5c7-449e5848b8d2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:17.971377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f38ee7b-cdb6-4f39-a5c7-449e5848b8d2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:17.971377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f38ee7b-cdb6-4f39-a5c7-449e5848b8d2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:18.155054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0f38ee7b-cdb6-4f39-a5c7-449e5848b8d2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:18.164765 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0f38ee7b-cdb6-4f39-a5c7-449e5848b8d2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1387 microversion: 2.1 time: 0.208615 May 28 05:20:18.165816 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3240/6593] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:17 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1387 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:18.180868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5a7cbb5d-92d7-4997-ac51-ae115b5b49f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:18.181485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5a7cbb5d-92d7-4997-ac51-ae115b5b49f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:18.188509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a7cbb5d-92d7-4997-ac51-ae115b5b49f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:18.188965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a7cbb5d-92d7-4997-ac51-ae115b5b49f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:18.189800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a7cbb5d-92d7-4997-ac51-ae115b5b49f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:18.190241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a7cbb5d-92d7-4997-ac51-ae115b5b49f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:18.329239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5a7cbb5d-92d7-4997-ac51-ae115b5b49f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:18.337083 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5a7cbb5d-92d7-4997-ac51-ae115b5b49f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1387 microversion: 2.1 time: 0.160101 May 28 05:20:18.337678 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3354/6594] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:18 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1387 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:18.354722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0db9cdf3-eae7-4381-898a-6f3a10f95b7d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:18.355258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0db9cdf3-eae7-4381-898a-6f3a10f95b7d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:18.362700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0db9cdf3-eae7-4381-898a-6f3a10f95b7d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:18.363199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0db9cdf3-eae7-4381-898a-6f3a10f95b7d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:18.363999 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0db9cdf3-eae7-4381-898a-6f3a10f95b7d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:18.364470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0db9cdf3-eae7-4381-898a-6f3a10f95b7d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:18.391693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0db9cdf3-eae7-4381-898a-6f3a10f95b7d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:20:18.713261 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0db9cdf3-eae7-4381-898a-6f3a10f95b7d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 204 len: 0 microversion: 2.1 time: 0.362424 May 28 05:20:18.716455 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3241/6595] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:20:18 2022] DELETE /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:20:18.722819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2009fe92-efe7-451d-9b79-eb518377d929 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:18.723483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2009fe92-efe7-451d-9b79-eb518377d929 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:18.729944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2009fe92-efe7-451d-9b79-eb518377d929 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:18.730410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2009fe92-efe7-451d-9b79-eb518377d929 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:18.731223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2009fe92-efe7-451d-9b79-eb518377d929 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:18.731669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2009fe92-efe7-451d-9b79-eb518377d929 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:18.874439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2009fe92-efe7-451d-9b79-eb518377d929 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:18.883637 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2009fe92-efe7-451d-9b79-eb518377d929 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1393 microversion: 2.1 time: 0.165055 May 28 05:20:18.892134 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3355/6596] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:18 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:19.901649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-532041ac-1476-4a63-9ac4-9b19d55a2ef2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:19.902280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-532041ac-1476-4a63-9ac4-9b19d55a2ef2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:19.910094 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-532041ac-1476-4a63-9ac4-9b19d55a2ef2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:19.910553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-532041ac-1476-4a63-9ac4-9b19d55a2ef2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:19.911362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-532041ac-1476-4a63-9ac4-9b19d55a2ef2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:19.912063 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-532041ac-1476-4a63-9ac4-9b19d55a2ef2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:19.932596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:20:20.048072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-532041ac-1476-4a63-9ac4-9b19d55a2ef2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:20.058973 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-532041ac-1476-4a63-9ac4-9b19d55a2ef2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1393 microversion: 2.1 time: 0.161452 May 28 05:20:20.059669 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3242/6597] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:19 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:20.753820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-2ee258af-563f-49be-b6f6-761450a579d9 req-f1bebd44-e188-40f6-8a2b-0367347019e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a83a0c-711a-4e1a-9448-a8a502083af4", "name": "network-vif-deleted", "tag": "9895196f-4cb7-41f1-a818-5751968fe634"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:20:20.765158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2ee258af-563f-49be-b6f6-761450a579d9 req-f1bebd44-e188-40f6-8a2b-0367347019e7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:20.766415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2ee258af-563f-49be-b6f6-761450a579d9 req-f1bebd44-e188-40f6-8a2b-0367347019e7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:20.784948 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-2ee258af-563f-49be-b6f6-761450a579d9 req-f1bebd44-e188-40f6-8a2b-0367347019e7 service nova] Creating event network-vif-deleted:9895196f-4cb7-41f1-a818-5751968fe634 for instance f3a83a0c-711a-4e1a-9448-a8a502083af4 on n-h2-843700-1 May 28 05:20:20.789412 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-2ee258af-563f-49be-b6f6-761450a579d9 req-f1bebd44-e188-40f6-8a2b-0367347019e7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039497 May 28 05:20:20.794652 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3356/6598] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:20:21.077259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d14645af-7bf1-455b-8bf7-266863f1f9a5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:21.077745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d14645af-7bf1-455b-8bf7-266863f1f9a5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:21.087582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d14645af-7bf1-455b-8bf7-266863f1f9a5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:21.088037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d14645af-7bf1-455b-8bf7-266863f1f9a5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:21.089458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d14645af-7bf1-455b-8bf7-266863f1f9a5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:21.089918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d14645af-7bf1-455b-8bf7-266863f1f9a5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:21.157602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d14645af-7bf1-455b-8bf7-266863f1f9a5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:21.168614 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d14645af-7bf1-455b-8bf7-266863f1f9a5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1186 microversion: 2.1 time: 0.093938 May 28 05:20:21.178488 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3243/6599] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:21 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1186 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:22.185832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-02b1ea3b-ad3f-4944-860b-ee79c5ea7fbf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:22.186549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-02b1ea3b-ad3f-4944-860b-ee79c5ea7fbf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:22.194809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02b1ea3b-ad3f-4944-860b-ee79c5ea7fbf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:22.195343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02b1ea3b-ad3f-4944-860b-ee79c5ea7fbf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:22.196246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02b1ea3b-ad3f-4944-860b-ee79c5ea7fbf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:22.196565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02b1ea3b-ad3f-4944-860b-ee79c5ea7fbf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:22.263210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-02b1ea3b-ad3f-4944-860b-ee79c5ea7fbf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:22.271564 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-02b1ea3b-ad3f-4944-860b-ee79c5ea7fbf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1186 microversion: 2.1 time: 0.090106 May 28 05:20:22.272154 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3357/6600] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:22 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:23.289203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-19835fcd-9299-487a-9308-8627c79899a7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:23.289990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-19835fcd-9299-487a-9308-8627c79899a7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:23.292912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:20:23.298623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-19835fcd-9299-487a-9308-8627c79899a7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:23.299108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-19835fcd-9299-487a-9308-8627c79899a7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:23.300256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-19835fcd-9299-487a-9308-8627c79899a7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:23.300432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-19835fcd-9299-487a-9308-8627c79899a7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:23.364505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-19835fcd-9299-487a-9308-8627c79899a7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:23.372849 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-19835fcd-9299-487a-9308-8627c79899a7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1186 microversion: 2.1 time: 0.088299 May 28 05:20:23.373423 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3244/6601] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:23 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:24.390351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a9953fb3-b128-42f4-893a-58e7c313afb2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:24.392343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a9953fb3-b128-42f4-893a-58e7c313afb2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:24.400277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a9953fb3-b128-42f4-893a-58e7c313afb2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:24.400814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a9953fb3-b128-42f4-893a-58e7c313afb2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:24.401961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a9953fb3-b128-42f4-893a-58e7c313afb2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:24.402665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a9953fb3-b128-42f4-893a-58e7c313afb2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:24.472653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a9953fb3-b128-42f4-893a-58e7c313afb2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:24.482444 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a9953fb3-b128-42f4-893a-58e7c313afb2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1186 microversion: 2.1 time: 0.096179 May 28 05:20:24.483063 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3358/6602] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:24 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1186 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:25.500663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f2fd250f-65a5-4932-bef2-4eb9eae44daf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:25.501266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f2fd250f-65a5-4932-bef2-4eb9eae44daf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:25.508856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2fd250f-65a5-4932-bef2-4eb9eae44daf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:25.509321 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2fd250f-65a5-4932-bef2-4eb9eae44daf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:25.510107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2fd250f-65a5-4932-bef2-4eb9eae44daf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:25.510557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2fd250f-65a5-4932-bef2-4eb9eae44daf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:25.582473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f2fd250f-65a5-4932-bef2-4eb9eae44daf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:25.590565 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f2fd250f-65a5-4932-bef2-4eb9eae44daf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1186 microversion: 2.1 time: 0.094867 May 28 05:20:25.591172 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3245/6603] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:25 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1186 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:26.607488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-90fa7cb1-aa8b-4261-b730-c58680e70434 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:26.608320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-90fa7cb1-aa8b-4261-b730-c58680e70434 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:26.615451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90fa7cb1-aa8b-4261-b730-c58680e70434 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:26.615917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90fa7cb1-aa8b-4261-b730-c58680e70434 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:26.616691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90fa7cb1-aa8b-4261-b730-c58680e70434 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:26.617138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90fa7cb1-aa8b-4261-b730-c58680e70434 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:26.680183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-90fa7cb1-aa8b-4261-b730-c58680e70434 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:26.688177 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-90fa7cb1-aa8b-4261-b730-c58680e70434 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1186 microversion: 2.1 time: 0.084771 May 28 05:20:26.688977 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3359/6604] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:26 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1186 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:27.704789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-65ac66f2-f108-47db-bf81-3d36d7576aa0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:27.705609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-65ac66f2-f108-47db-bf81-3d36d7576aa0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:27.712574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65ac66f2-f108-47db-bf81-3d36d7576aa0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:27.713030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65ac66f2-f108-47db-bf81-3d36d7576aa0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:27.713804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65ac66f2-f108-47db-bf81-3d36d7576aa0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:27.714241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-65ac66f2-f108-47db-bf81-3d36d7576aa0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:27.779021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-65ac66f2-f108-47db-bf81-3d36d7576aa0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:27.787722 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-65ac66f2-f108-47db-bf81-3d36d7576aa0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1186 microversion: 2.1 time: 0.087017 May 28 05:20:27.788307 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3246/6605] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:27 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:28.805091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b0f364c6-ea51-4d81-9bd5-0aa45e00b0b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:28.806040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b0f364c6-ea51-4d81-9bd5-0aa45e00b0b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:28.814429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0f364c6-ea51-4d81-9bd5-0aa45e00b0b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:28.814892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0f364c6-ea51-4d81-9bd5-0aa45e00b0b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:28.815700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0f364c6-ea51-4d81-9bd5-0aa45e00b0b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:28.816145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0f364c6-ea51-4d81-9bd5-0aa45e00b0b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:28.884943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b0f364c6-ea51-4d81-9bd5-0aa45e00b0b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:28.894239 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b0f364c6-ea51-4d81-9bd5-0aa45e00b0b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1186 microversion: 2.1 time: 0.093092 May 28 05:20:28.903990 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3360/6606] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:28 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1186 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:29.912261 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-719c7b35-1bf7-4d34-a665-886bc97d0500 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:29.912998 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-719c7b35-1bf7-4d34-a665-886bc97d0500 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:29.920138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-719c7b35-1bf7-4d34-a665-886bc97d0500 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:29.920603 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-719c7b35-1bf7-4d34-a665-886bc97d0500 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:29.921383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-719c7b35-1bf7-4d34-a665-886bc97d0500 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:29.921928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-719c7b35-1bf7-4d34-a665-886bc97d0500 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:29.986015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-719c7b35-1bf7-4d34-a665-886bc97d0500 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:20:29.994275 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-719c7b35-1bf7-4d34-a665-886bc97d0500 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 200 len: 1186 microversion: 2.1 time: 0.086100 May 28 05:20:29.995951 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3247/6607] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:29 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 1186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:20:31.011617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fd27dff2-1cda-4724-9084-54f4916ebeb0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:20:31.012165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fd27dff2-1cda-4724-9084-54f4916ebeb0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: f3a83a0c-711a-4e1a-9448-a8a502083af4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:20:31.018856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd27dff2-1cda-4724-9084-54f4916ebeb0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:31.019366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd27dff2-1cda-4724-9084-54f4916ebeb0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:31.020142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd27dff2-1cda-4724-9084-54f4916ebeb0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:20:31.020587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd27dff2-1cda-4724-9084-54f4916ebeb0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:20:31.034434 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-fd27dff2-1cda-4724-9084-54f4916ebeb0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] HTTP exception thrown: Instance f3a83a0c-711a-4e1a-9448-a8a502083af4 could not be found. May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fd27dff2-1cda-4724-9084-54f4916ebeb0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Request method failure captured: May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 HTTP/1.1 May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbDlrqJvsw-Bj4hemx4XscPzQgI57Oj0DhtZ0WItt0VxFXFIUFqzN1b2sr7MK3BjOGQZJbLNmoClfshSjagkFRTmogQaQpoLYEaPQkaSagOXWAKjyAlGGxZFI9I-y-IJo4VhS_mMCbBct4nVbcF58kjzhMiK5F2slw20hRu7zD2W154 May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TestVolumeBootPattern-934660757 May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TestVolumeBootPattern-934660757-project May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: a33708c760574b0698fc16ddfebad05b May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TestVolumeBootPattern-934660757-project May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance f3a83a0c-711a-4e1a-9448-a8a502083af4 could not be found. May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'f3a83a0c-711a-4e1a-9448-a8a502083af4'} May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3a83a0c-711a-4e1a-9448-a8a502083af4 could not be found. May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3a83a0c-711a-4e1a-9448-a8a502083af4 could not be found. May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:20:31.036100 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:20:31.040809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:20:31.040809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:20:31.040809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:20:31.040809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:20:31.040809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:20:31.040809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3a83a0c-711a-4e1a-9448-a8a502083af4 could not be found. May 28 05:20:31.040809 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:20:31.040809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fd27dff2-1cda-4724-9084-54f4916ebeb0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Returning 404 to user: Instance f3a83a0c-711a-4e1a-9448-a8a502083af4 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:20:31.040809 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fd27dff2-1cda-4724-9084-54f4916ebeb0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4" status: 404 len: 111 microversion: 2.1 time: 0.030529 May 28 05:20:31.040809 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3361/6608] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:20:31 2022] GET /compute/v2.1/servers/f3a83a0c-711a-4e1a-9448-a8a502083af4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:21:09.676598 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:21:09.677127 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 05:21:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:21:11.126520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7e97de31-99f0-4860-bbb0-84760c52f663 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1868876303", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "bf8fd466-00be-4b27-9398-fb91d33ffed0", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f8631f0f-218a-4dd3-ad6e-75d0627c5194"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:21:11.135327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=7 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:21:11.136542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=32 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:21:11.241654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-7e97de31-99f0-4860-bbb0-84760c52f663 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] validate_networks() for [('f8631f0f-218a-4dd3-ad6e-75d0627c5194', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:21:11.719410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7e97de31-99f0-4860-bbb0-84760c52f663 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:21:11.719939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7e97de31-99f0-4860-bbb0-84760c52f663 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:21:11.720478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7e97de31-99f0-4860-bbb0-84760c52f663 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:21:11.720948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7e97de31-99f0-4860-bbb0-84760c52f663 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:21:11.721425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7e97de31-99f0-4860-bbb0-84760c52f663 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:21:11.730744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e97de31-99f0-4860-bbb0-84760c52f663 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:11.731242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e97de31-99f0-4860-bbb0-84760c52f663 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:11.732067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e97de31-99f0-4860-bbb0-84760c52f663 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:11.732515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e97de31-99f0-4860-bbb0-84760c52f663 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:11.750857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-7e97de31-99f0-4860-bbb0-84760c52f663 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Getting quotas for project e45163cf20a447a0a60bc0c0f075fa78. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:21:11.756263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-7e97de31-99f0-4860-bbb0-84760c52f663 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Getting quotas for user a33708c760574b0698fc16ddfebad05b and project e45163cf20a447a0a60bc0c0f075fa78. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:21:11.769951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7e97de31-99f0-4860-bbb0-84760c52f663 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:21:11.772001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7e97de31-99f0-4860-bbb0-84760c52f663 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='bf8fd466-00be-4b27-9398-fb91d33ffed0',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:21:11.946748 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7e97de31-99f0-4860-bbb0-84760c52f663 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.825717 May 28 05:21:11.947449 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3248/6609] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:21:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:21:11.964193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-92e97ec6-2f02-4c08-aed6-6472582c6581 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:11.964193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-92e97ec6-2f02-4c08-aed6-6472582c6581 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:11.964193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=17 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:21:11.964193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=45 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:21:12.018018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-92e97ec6-2f02-4c08-aed6-6472582c6581 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:12.025367 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-92e97ec6-2f02-4c08-aed6-6472582c6581 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1057 microversion: 2.1 time: 0.071282 May 28 05:21:12.027046 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3362/6610] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:11 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1057 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:13.044292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8b949350-c1fe-4a6e-bd0e-a16d7fbc948f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:13.045143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8b949350-c1fe-4a6e-bd0e-a16d7fbc948f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:13.053828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b949350-c1fe-4a6e-bd0e-a16d7fbc948f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:13.054409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b949350-c1fe-4a6e-bd0e-a16d7fbc948f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:13.055317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b949350-c1fe-4a6e-bd0e-a16d7fbc948f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:13.055886 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b949350-c1fe-4a6e-bd0e-a16d7fbc948f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:13.126025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8b949350-c1fe-4a6e-bd0e-a16d7fbc948f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:13.134627 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8b949350-c1fe-4a6e-bd0e-a16d7fbc948f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1061 microversion: 2.1 time: 0.096419 May 28 05:21:13.135320 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3249/6611] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:13 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1061 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:14.153100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4f6fb0c4-09e3-4413-a449-666c69babb3c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:14.154308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4f6fb0c4-09e3-4413-a449-666c69babb3c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:14.166760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f6fb0c4-09e3-4413-a449-666c69babb3c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:14.167316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f6fb0c4-09e3-4413-a449-666c69babb3c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:14.168095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f6fb0c4-09e3-4413-a449-666c69babb3c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:14.168537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f6fb0c4-09e3-4413-a449-666c69babb3c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:14.249778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4f6fb0c4-09e3-4413-a449-666c69babb3c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:14.257615 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4f6fb0c4-09e3-4413-a449-666c69babb3c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1117 microversion: 2.1 time: 0.109563 May 28 05:21:14.258201 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3363/6612] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:14 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1117 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:15.277142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0639d284-425f-420e-80ba-5aa8bcbdfbeb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:15.277142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0639d284-425f-420e-80ba-5aa8bcbdfbeb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:15.291383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0639d284-425f-420e-80ba-5aa8bcbdfbeb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:15.293543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0639d284-425f-420e-80ba-5aa8bcbdfbeb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:15.296115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0639d284-425f-420e-80ba-5aa8bcbdfbeb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:15.296820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0639d284-425f-420e-80ba-5aa8bcbdfbeb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:15.597821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0639d284-425f-420e-80ba-5aa8bcbdfbeb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:15.607622 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0639d284-425f-420e-80ba-5aa8bcbdfbeb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.336552 May 28 05:21:15.608866 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3250/6613] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:15 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:16.609571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-45c9e321-16be-4808-80fc-26cdb8adbbb7 req-a553ba3a-62f4-4683-a34e-adf493e218d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "590e4eb1-e9e5-4cb2-8c46-44d696748b58", "tag": "b1b68cff-07ba-4fd1-8712-75c40195305f"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:21:16.637347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-33c2067d-a562-4460-b45c-1c799e598c9c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:16.639524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-33c2067d-a562-4460-b45c-1c799e598c9c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:16.654301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-45c9e321-16be-4808-80fc-26cdb8adbbb7 req-a553ba3a-62f4-4683-a34e-adf493e218d8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:16.658183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33c2067d-a562-4460-b45c-1c799e598c9c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:16.658345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-45c9e321-16be-4808-80fc-26cdb8adbbb7 req-a553ba3a-62f4-4683-a34e-adf493e218d8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:16.667719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33c2067d-a562-4460-b45c-1c799e598c9c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:16.668892 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33c2067d-a562-4460-b45c-1c799e598c9c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:16.674549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33c2067d-a562-4460-b45c-1c799e598c9c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:16.690340 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-45c9e321-16be-4808-80fc-26cdb8adbbb7 req-a553ba3a-62f4-4683-a34e-adf493e218d8 service nova] Creating event network-changed:b1b68cff-07ba-4fd1-8712-75c40195305f for instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 on n-h1-843700-1 May 28 05:21:16.710301 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-45c9e321-16be-4808-80fc-26cdb8adbbb7 req-a553ba3a-62f4-4683-a34e-adf493e218d8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104481 May 28 05:21:16.713877 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3364/6614] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:21:16.963042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-33c2067d-a562-4460-b45c-1c799e598c9c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:16.973657 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-33c2067d-a562-4460-b45c-1c799e598c9c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.349927 May 28 05:21:16.974949 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3251/6615] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:16 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:17.992693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-574aff16-2e98-4d31-ae08-0c923d8591cc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:17.993497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-574aff16-2e98-4d31-ae08-0c923d8591cc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:18.000512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-574aff16-2e98-4d31-ae08-0c923d8591cc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:18.001064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-574aff16-2e98-4d31-ae08-0c923d8591cc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:18.001952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-574aff16-2e98-4d31-ae08-0c923d8591cc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:18.002465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-574aff16-2e98-4d31-ae08-0c923d8591cc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:18.161381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-574aff16-2e98-4d31-ae08-0c923d8591cc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:18.170614 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-574aff16-2e98-4d31-ae08-0c923d8591cc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.182786 May 28 05:21:18.182041 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3365/6616] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:17 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:19.192031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-39f8cacb-77ef-4b1a-83ac-3b50bb830a61 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:19.193843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-39f8cacb-77ef-4b1a-83ac-3b50bb830a61 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:19.220316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-39f8cacb-77ef-4b1a-83ac-3b50bb830a61 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:19.220701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-39f8cacb-77ef-4b1a-83ac-3b50bb830a61 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:19.221510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-39f8cacb-77ef-4b1a-83ac-3b50bb830a61 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:19.222010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-39f8cacb-77ef-4b1a-83ac-3b50bb830a61 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:19.378396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-39f8cacb-77ef-4b1a-83ac-3b50bb830a61 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:19.387913 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-39f8cacb-77ef-4b1a-83ac-3b50bb830a61 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.203024 May 28 05:21:19.397441 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3252/6617] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:19 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:20.409440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9477ecdb-1778-4274-84be-a4e2c7e4f1e2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:20.410213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9477ecdb-1778-4274-84be-a4e2c7e4f1e2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:20.419857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9477ecdb-1778-4274-84be-a4e2c7e4f1e2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:20.419857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9477ecdb-1778-4274-84be-a4e2c7e4f1e2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:20.420641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9477ecdb-1778-4274-84be-a4e2c7e4f1e2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:20.420920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9477ecdb-1778-4274-84be-a4e2c7e4f1e2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:20.640407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9477ecdb-1778-4274-84be-a4e2c7e4f1e2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:20.648904 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9477ecdb-1778-4274-84be-a4e2c7e4f1e2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.247840 May 28 05:21:20.649591 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3366/6618] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:20 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:21.668299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-038f52ba-4dcd-4c7c-ada9-e74ace87d5f3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:21.669263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-038f52ba-4dcd-4c7c-ada9-e74ace87d5f3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:21.677672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-038f52ba-4dcd-4c7c-ada9-e74ace87d5f3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:21.678129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-038f52ba-4dcd-4c7c-ada9-e74ace87d5f3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:21.678892 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-038f52ba-4dcd-4c7c-ada9-e74ace87d5f3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:21.679453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-038f52ba-4dcd-4c7c-ada9-e74ace87d5f3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:21.745859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:21:21.764658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:21:21.827931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-038f52ba-4dcd-4c7c-ada9-e74ace87d5f3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:21.836366 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-038f52ba-4dcd-4c7c-ada9-e74ace87d5f3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.172829 May 28 05:21:21.837234 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3253/6619] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:21 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:22.862072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-36a1d0ee-3631-444a-bc9a-846d87a18e45 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:22.862072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-36a1d0ee-3631-444a-bc9a-846d87a18e45 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:22.862072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:21:22.866185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36a1d0ee-3631-444a-bc9a-846d87a18e45 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:22.868190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36a1d0ee-3631-444a-bc9a-846d87a18e45 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:22.869355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36a1d0ee-3631-444a-bc9a-846d87a18e45 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:22.869966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36a1d0ee-3631-444a-bc9a-846d87a18e45 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:23.030465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-36a1d0ee-3631-444a-bc9a-846d87a18e45 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:23.039289 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-36a1d0ee-3631-444a-bc9a-846d87a18e45 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.187960 May 28 05:21:23.040153 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3367/6620] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:22 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:24.058549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0ca7cd2e-bc55-4c55-8359-f91a74bc9c4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:24.059684 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0ca7cd2e-bc55-4c55-8359-f91a74bc9c4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:24.069825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ca7cd2e-bc55-4c55-8359-f91a74bc9c4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:24.074495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ca7cd2e-bc55-4c55-8359-f91a74bc9c4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:24.074495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ca7cd2e-bc55-4c55-8359-f91a74bc9c4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:24.074495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ca7cd2e-bc55-4c55-8359-f91a74bc9c4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:24.230382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0ca7cd2e-bc55-4c55-8359-f91a74bc9c4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:24.238942 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0ca7cd2e-bc55-4c55-8359-f91a74bc9c4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.185238 May 28 05:21:24.239863 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3254/6621] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:24 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:25.256610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a3c3ef36-9b44-4d60-86f9-020e9ce7e903 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:25.258002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a3c3ef36-9b44-4d60-86f9-020e9ce7e903 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:25.268361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3c3ef36-9b44-4d60-86f9-020e9ce7e903 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:25.268825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3c3ef36-9b44-4d60-86f9-020e9ce7e903 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:25.269646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3c3ef36-9b44-4d60-86f9-020e9ce7e903 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:25.270092 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3c3ef36-9b44-4d60-86f9-020e9ce7e903 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:25.423250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a3c3ef36-9b44-4d60-86f9-020e9ce7e903 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:25.431395 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a3c3ef36-9b44-4d60-86f9-020e9ce7e903 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.179002 May 28 05:21:25.431989 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3368/6622] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:25 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:21:26.449763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-35b446e8-dbbe-493f-bccf-808044197db9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:26.450538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-35b446e8-dbbe-493f-bccf-808044197db9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:26.462195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-35b446e8-dbbe-493f-bccf-808044197db9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:26.462663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-35b446e8-dbbe-493f-bccf-808044197db9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:26.463493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-35b446e8-dbbe-493f-bccf-808044197db9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:26.463989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-35b446e8-dbbe-493f-bccf-808044197db9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:26.641261 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-35b446e8-dbbe-493f-bccf-808044197db9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:26.656049 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-35b446e8-dbbe-493f-bccf-808044197db9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.203808 May 28 05:21:26.656373 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3255/6623] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:26 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:27.675035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a1d955b3-bdd2-41f0-9fa8-27b23f14215a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:27.676125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a1d955b3-bdd2-41f0-9fa8-27b23f14215a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:27.684081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1d955b3-bdd2-41f0-9fa8-27b23f14215a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:27.684536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1d955b3-bdd2-41f0-9fa8-27b23f14215a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:27.685331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1d955b3-bdd2-41f0-9fa8-27b23f14215a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:27.685779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1d955b3-bdd2-41f0-9fa8-27b23f14215a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:27.849443 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a1d955b3-bdd2-41f0-9fa8-27b23f14215a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:27.863431 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a1d955b3-bdd2-41f0-9fa8-27b23f14215a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.194869 May 28 05:21:27.874776 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3369/6624] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:27 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:28.882539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5d8bfc79-4f0f-43f0-91f4-189b09a219db tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:28.883315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5d8bfc79-4f0f-43f0-91f4-189b09a219db tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:28.910160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d8bfc79-4f0f-43f0-91f4-189b09a219db tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:28.910160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d8bfc79-4f0f-43f0-91f4-189b09a219db tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:28.910160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d8bfc79-4f0f-43f0-91f4-189b09a219db tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:28.910160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d8bfc79-4f0f-43f0-91f4-189b09a219db tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:29.061252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5d8bfc79-4f0f-43f0-91f4-189b09a219db tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:29.066660 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5d8bfc79-4f0f-43f0-91f4-189b09a219db tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.188481 May 28 05:21:29.067462 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3256/6625] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:28 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:30.086611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5951f31a-f5e7-4512-8af2-b382fe335438 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:30.087247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5951f31a-f5e7-4512-8af2-b382fe335438 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:30.112653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5951f31a-f5e7-4512-8af2-b382fe335438 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:30.113384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5951f31a-f5e7-4512-8af2-b382fe335438 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:30.114327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5951f31a-f5e7-4512-8af2-b382fe335438 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:30.114936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5951f31a-f5e7-4512-8af2-b382fe335438 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:30.275396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5951f31a-f5e7-4512-8af2-b382fe335438 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:30.288583 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5951f31a-f5e7-4512-8af2-b382fe335438 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.206321 May 28 05:21:30.289171 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3370/6626] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:30 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:31.308870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6faaf142-5332-41d8-bcd5-fb26bbb4a0db tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:31.310279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6faaf142-5332-41d8-bcd5-fb26bbb4a0db tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:31.317753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6faaf142-5332-41d8-bcd5-fb26bbb4a0db tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:31.318167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6faaf142-5332-41d8-bcd5-fb26bbb4a0db tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:31.319049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6faaf142-5332-41d8-bcd5-fb26bbb4a0db tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:31.319717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6faaf142-5332-41d8-bcd5-fb26bbb4a0db tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:31.487411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6faaf142-5332-41d8-bcd5-fb26bbb4a0db tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:31.495944 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6faaf142-5332-41d8-bcd5-fb26bbb4a0db tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.193764 May 28 05:21:31.496526 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3257/6627] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:31 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:32.521290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6b4ad59a-70af-44d3-82f1-de796af2b21d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:32.527972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6b4ad59a-70af-44d3-82f1-de796af2b21d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:32.542032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6b4ad59a-70af-44d3-82f1-de796af2b21d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:32.542911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6b4ad59a-70af-44d3-82f1-de796af2b21d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:32.545630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6b4ad59a-70af-44d3-82f1-de796af2b21d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:32.545630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6b4ad59a-70af-44d3-82f1-de796af2b21d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:32.693703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6b4ad59a-70af-44d3-82f1-de796af2b21d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:32.705247 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6b4ad59a-70af-44d3-82f1-de796af2b21d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.188033 May 28 05:21:32.706134 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3371/6628] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:32 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:33.722299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7741a17a-3f76-444c-8a3d-9f6272bb74a6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:33.722906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7741a17a-3f76-444c-8a3d-9f6272bb74a6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:33.730060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7741a17a-3f76-444c-8a3d-9f6272bb74a6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:33.730513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7741a17a-3f76-444c-8a3d-9f6272bb74a6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:33.731309 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7741a17a-3f76-444c-8a3d-9f6272bb74a6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:33.732204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7741a17a-3f76-444c-8a3d-9f6272bb74a6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:33.882054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7741a17a-3f76-444c-8a3d-9f6272bb74a6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:33.890699 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7741a17a-3f76-444c-8a3d-9f6272bb74a6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.172304 May 28 05:21:33.891325 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3258/6629] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:33 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:34.910001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-34b1e45c-5f72-41e0-9610-4e7110f98d79 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:34.910951 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-34b1e45c-5f72-41e0-9610-4e7110f98d79 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:34.933457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-34b1e45c-5f72-41e0-9610-4e7110f98d79 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:34.935945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-34b1e45c-5f72-41e0-9610-4e7110f98d79 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:34.938509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-34b1e45c-5f72-41e0-9610-4e7110f98d79 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:34.939228 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-34b1e45c-5f72-41e0-9610-4e7110f98d79 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:35.096201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-34b1e45c-5f72-41e0-9610-4e7110f98d79 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:35.104419 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-34b1e45c-5f72-41e0-9610-4e7110f98d79 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.199831 May 28 05:21:35.109215 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3372/6630] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:34 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:36.126366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f975eb72-79e3-4185-bb4d-eab55faa3bcb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:36.127027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f975eb72-79e3-4185-bb4d-eab55faa3bcb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:36.140313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f975eb72-79e3-4185-bb4d-eab55faa3bcb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:36.141156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f975eb72-79e3-4185-bb4d-eab55faa3bcb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:36.142757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f975eb72-79e3-4185-bb4d-eab55faa3bcb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:36.143470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f975eb72-79e3-4185-bb4d-eab55faa3bcb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:36.288589 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f975eb72-79e3-4185-bb4d-eab55faa3bcb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:36.297229 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f975eb72-79e3-4185-bb4d-eab55faa3bcb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.175795 May 28 05:21:36.297814 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3259/6631] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:36 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:37.313782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1ddc4a37-22f6-4d64-8ac7-0b62bf392b4f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:37.314408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1ddc4a37-22f6-4d64-8ac7-0b62bf392b4f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:37.323410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ddc4a37-22f6-4d64-8ac7-0b62bf392b4f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:37.323410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ddc4a37-22f6-4d64-8ac7-0b62bf392b4f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:37.323645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ddc4a37-22f6-4d64-8ac7-0b62bf392b4f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:37.323965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ddc4a37-22f6-4d64-8ac7-0b62bf392b4f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:37.489054 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1ddc4a37-22f6-4d64-8ac7-0b62bf392b4f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:37.499287 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1ddc4a37-22f6-4d64-8ac7-0b62bf392b4f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.189019 May 28 05:21:37.499880 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3373/6632] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:37 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:38.517443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ff4bda8b-3f24-4c75-95b9-d12db92ff5af tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:38.518397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ff4bda8b-3f24-4c75-95b9-d12db92ff5af tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:38.528458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff4bda8b-3f24-4c75-95b9-d12db92ff5af tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:38.529159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff4bda8b-3f24-4c75-95b9-d12db92ff5af tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:38.530516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff4bda8b-3f24-4c75-95b9-d12db92ff5af tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:38.531144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff4bda8b-3f24-4c75-95b9-d12db92ff5af tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:38.718036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ff4bda8b-3f24-4c75-95b9-d12db92ff5af tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:38.725862 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ff4bda8b-3f24-4c75-95b9-d12db92ff5af tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.213546 May 28 05:21:38.736268 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3260/6633] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:38 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:39.743516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ad89ee27-f02f-4305-a5fb-05204c86e534 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:39.744257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ad89ee27-f02f-4305-a5fb-05204c86e534 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:39.764322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad89ee27-f02f-4305-a5fb-05204c86e534 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:39.767985 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad89ee27-f02f-4305-a5fb-05204c86e534 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:39.769269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad89ee27-f02f-4305-a5fb-05204c86e534 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:39.804967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad89ee27-f02f-4305-a5fb-05204c86e534 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:40.073696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ad89ee27-f02f-4305-a5fb-05204c86e534 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:40.082830 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ad89ee27-f02f-4305-a5fb-05204c86e534 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.343239 May 28 05:21:40.083645 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3374/6634] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:39 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:41.100434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-582843d0-c91e-4893-851b-581933daebb1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:41.101831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-582843d0-c91e-4893-851b-581933daebb1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:41.110057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-582843d0-c91e-4893-851b-581933daebb1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:41.110811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-582843d0-c91e-4893-851b-581933daebb1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:41.112007 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-582843d0-c91e-4893-851b-581933daebb1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:41.112667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-582843d0-c91e-4893-851b-581933daebb1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:41.259217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-582843d0-c91e-4893-851b-581933daebb1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:41.265774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=79 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:21:41.268191 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-582843d0-c91e-4893-851b-581933daebb1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.171668 May 28 05:21:41.278540 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3261/6635] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:41 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:42.286024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aa1fda2f-6a01-424c-af6d-caa72fd464c9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:42.286547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aa1fda2f-6a01-424c-af6d-caa72fd464c9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:42.293742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aa1fda2f-6a01-424c-af6d-caa72fd464c9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:42.294197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aa1fda2f-6a01-424c-af6d-caa72fd464c9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:42.294959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aa1fda2f-6a01-424c-af6d-caa72fd464c9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:42.295913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aa1fda2f-6a01-424c-af6d-caa72fd464c9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:42.439183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aa1fda2f-6a01-424c-af6d-caa72fd464c9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:42.447233 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aa1fda2f-6a01-424c-af6d-caa72fd464c9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.165346 May 28 05:21:42.448070 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3375/6636] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:42 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:43.464909 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-08965259-dd17-429c-b206-04d9b14c2b45 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:43.465755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-08965259-dd17-429c-b206-04d9b14c2b45 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:43.470005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:21:43.477248 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-08965259-dd17-429c-b206-04d9b14c2b45 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:43.477890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-08965259-dd17-429c-b206-04d9b14c2b45 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:43.478806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-08965259-dd17-429c-b206-04d9b14c2b45 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:43.479427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-08965259-dd17-429c-b206-04d9b14c2b45 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:43.637034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-08965259-dd17-429c-b206-04d9b14c2b45 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:43.647306 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-08965259-dd17-429c-b206-04d9b14c2b45 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.186465 May 28 05:21:43.658043 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3262/6637] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:43 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:44.664987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6131b4b5-cebd-48b5-b64a-0c618f5411b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:44.665807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6131b4b5-cebd-48b5-b64a-0c618f5411b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:44.668776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=31 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:21:44.674177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6131b4b5-cebd-48b5-b64a-0c618f5411b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:44.675024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6131b4b5-cebd-48b5-b64a-0c618f5411b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:44.675975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6131b4b5-cebd-48b5-b64a-0c618f5411b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:44.676563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6131b4b5-cebd-48b5-b64a-0c618f5411b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:44.679646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=75 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:21:44.841672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6131b4b5-cebd-48b5-b64a-0c618f5411b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:44.851249 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6131b4b5-cebd-48b5-b64a-0c618f5411b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.190520 May 28 05:21:44.851906 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3376/6638] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:44 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:45.871661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c1d629ef-bba1-4357-973c-ba8cb7b3bf64 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:45.872990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c1d629ef-bba1-4357-973c-ba8cb7b3bf64 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:45.881138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1d629ef-bba1-4357-973c-ba8cb7b3bf64 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:45.882400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1d629ef-bba1-4357-973c-ba8cb7b3bf64 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:45.883308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1d629ef-bba1-4357-973c-ba8cb7b3bf64 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:45.883750 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1d629ef-bba1-4357-973c-ba8cb7b3bf64 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:46.044723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c1d629ef-bba1-4357-973c-ba8cb7b3bf64 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:46.053436 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c1d629ef-bba1-4357-973c-ba8cb7b3bf64 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.187345 May 28 05:21:46.062772 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3263/6639] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:45 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:47.069694 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f79d8fe2-6ed3-4900-933b-693f37773ba0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:47.070316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f79d8fe2-6ed3-4900-933b-693f37773ba0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:47.077936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f79d8fe2-6ed3-4900-933b-693f37773ba0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:47.078387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f79d8fe2-6ed3-4900-933b-693f37773ba0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:47.079222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f79d8fe2-6ed3-4900-933b-693f37773ba0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:47.079660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f79d8fe2-6ed3-4900-933b-693f37773ba0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:47.218194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f79d8fe2-6ed3-4900-933b-693f37773ba0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:47.226119 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f79d8fe2-6ed3-4900-933b-693f37773ba0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.160379 May 28 05:21:47.226707 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3377/6640] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:47 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:48.243663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9507e6f0-0e22-424a-985d-929aadece4b1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:48.244279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9507e6f0-0e22-424a-985d-929aadece4b1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:48.252049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9507e6f0-0e22-424a-985d-929aadece4b1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:48.252500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9507e6f0-0e22-424a-985d-929aadece4b1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:48.253262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9507e6f0-0e22-424a-985d-929aadece4b1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:48.253749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9507e6f0-0e22-424a-985d-929aadece4b1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:48.385929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9507e6f0-0e22-424a-985d-929aadece4b1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:48.394290 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9507e6f0-0e22-424a-985d-929aadece4b1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.154524 May 28 05:21:48.394968 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3264/6641] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:48 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:49.412249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bef43a34-1527-4f2b-9fdd-d221845fbb11 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:49.415869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bef43a34-1527-4f2b-9fdd-d221845fbb11 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:49.420108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bef43a34-1527-4f2b-9fdd-d221845fbb11 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:49.420563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bef43a34-1527-4f2b-9fdd-d221845fbb11 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:49.421338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bef43a34-1527-4f2b-9fdd-d221845fbb11 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:49.421805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bef43a34-1527-4f2b-9fdd-d221845fbb11 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:49.567188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bef43a34-1527-4f2b-9fdd-d221845fbb11 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:49.574847 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bef43a34-1527-4f2b-9fdd-d221845fbb11 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.166955 May 28 05:21:49.579771 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3378/6642] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:49 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:50.593129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e3145830-f4c7-4df7-94a1-ea54e7faddd0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:50.593779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e3145830-f4c7-4df7-94a1-ea54e7faddd0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:50.600552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3145830-f4c7-4df7-94a1-ea54e7faddd0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:50.601010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3145830-f4c7-4df7-94a1-ea54e7faddd0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:50.601780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3145830-f4c7-4df7-94a1-ea54e7faddd0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:50.602226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3145830-f4c7-4df7-94a1-ea54e7faddd0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:50.750888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e3145830-f4c7-4df7-94a1-ea54e7faddd0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:50.758806 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e3145830-f4c7-4df7-94a1-ea54e7faddd0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.169599 May 28 05:21:50.759544 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3265/6643] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:50 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:51.775888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a0fdf55b-eb95-469d-971b-b5782a143c09 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:51.776566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a0fdf55b-eb95-469d-971b-b5782a143c09 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:51.783877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0fdf55b-eb95-469d-971b-b5782a143c09 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:51.784520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0fdf55b-eb95-469d-971b-b5782a143c09 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:51.785707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0fdf55b-eb95-469d-971b-b5782a143c09 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:51.786223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0fdf55b-eb95-469d-971b-b5782a143c09 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:51.925562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a0fdf55b-eb95-469d-971b-b5782a143c09 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:51.933850 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a0fdf55b-eb95-469d-971b-b5782a143c09 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.162421 May 28 05:21:51.934443 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3379/6644] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:51 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:52.950791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f4b51616-0194-4ea9-af8f-bde9d21b5482 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:52.951936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f4b51616-0194-4ea9-af8f-bde9d21b5482 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:52.958541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4b51616-0194-4ea9-af8f-bde9d21b5482 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:52.959000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4b51616-0194-4ea9-af8f-bde9d21b5482 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:52.965446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4b51616-0194-4ea9-af8f-bde9d21b5482 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:52.965446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4b51616-0194-4ea9-af8f-bde9d21b5482 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:53.092366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f4b51616-0194-4ea9-af8f-bde9d21b5482 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:53.099955 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f4b51616-0194-4ea9-af8f-bde9d21b5482 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.153033 May 28 05:21:53.102644 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3266/6645] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:52 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:54.123040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-159e667e-0ccc-4900-a836-a814477019ea tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:54.125957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-159e667e-0ccc-4900-a836-a814477019ea tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:54.135735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-159e667e-0ccc-4900-a836-a814477019ea tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:54.139716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-159e667e-0ccc-4900-a836-a814477019ea tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:54.139716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-159e667e-0ccc-4900-a836-a814477019ea tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:54.139716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-159e667e-0ccc-4900-a836-a814477019ea tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:54.284423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-159e667e-0ccc-4900-a836-a814477019ea tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:54.296083 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-159e667e-0ccc-4900-a836-a814477019ea tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.181823 May 28 05:21:54.304116 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3380/6646] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:54 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:55.313952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a7d030d8-0548-46b0-a34f-fad130d516cf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:55.314755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a7d030d8-0548-46b0-a34f-fad130d516cf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:55.323067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a7d030d8-0548-46b0-a34f-fad130d516cf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:55.323735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a7d030d8-0548-46b0-a34f-fad130d516cf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:55.326599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a7d030d8-0548-46b0-a34f-fad130d516cf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:55.326599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a7d030d8-0548-46b0-a34f-fad130d516cf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:55.463615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a7d030d8-0548-46b0-a34f-fad130d516cf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:55.471845 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a7d030d8-0548-46b0-a34f-fad130d516cf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.162666 May 28 05:21:55.472422 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3267/6647] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:55 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:56.490969 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-67a6276e-b51e-4eb1-9a77-90822406c88d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:56.492083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-67a6276e-b51e-4eb1-9a77-90822406c88d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:56.498811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67a6276e-b51e-4eb1-9a77-90822406c88d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:56.499429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67a6276e-b51e-4eb1-9a77-90822406c88d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:56.500341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67a6276e-b51e-4eb1-9a77-90822406c88d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:56.500787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67a6276e-b51e-4eb1-9a77-90822406c88d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:56.634535 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-67a6276e-b51e-4eb1-9a77-90822406c88d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:56.643654 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-67a6276e-b51e-4eb1-9a77-90822406c88d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.157748 May 28 05:21:56.653319 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3381/6648] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:56 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:57.661445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bad3ca84-1e24-4a68-9d08-32e5b0ea0216 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:57.662376 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bad3ca84-1e24-4a68-9d08-32e5b0ea0216 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:57.669422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bad3ca84-1e24-4a68-9d08-32e5b0ea0216 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:57.670583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bad3ca84-1e24-4a68-9d08-32e5b0ea0216 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:57.671486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bad3ca84-1e24-4a68-9d08-32e5b0ea0216 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:57.672027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bad3ca84-1e24-4a68-9d08-32e5b0ea0216 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:57.830163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bad3ca84-1e24-4a68-9d08-32e5b0ea0216 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:57.839231 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bad3ca84-1e24-4a68-9d08-32e5b0ea0216 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.181847 May 28 05:21:57.840026 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3268/6649] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:57 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:21:58.856712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-614972ee-1e33-4229-91e6-3790cc371963 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:21:58.857833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-614972ee-1e33-4229-91e6-3790cc371963 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:21:58.864844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-614972ee-1e33-4229-91e6-3790cc371963 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:58.865324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-614972ee-1e33-4229-91e6-3790cc371963 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:58.866282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-614972ee-1e33-4229-91e6-3790cc371963 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:21:58.866726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-614972ee-1e33-4229-91e6-3790cc371963 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:21:59.020698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-614972ee-1e33-4229-91e6-3790cc371963 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:21:59.028429 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-614972ee-1e33-4229-91e6-3790cc371963 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1169 microversion: 2.1 time: 0.175760 May 28 05:21:59.029036 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3382/6650] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:21:58 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1169 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:00.049657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-13fb2ba3-e932-4224-8c66-a9bff161f662 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:00.050434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-13fb2ba3-e932-4224-8c66-a9bff161f662 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:00.062355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13fb2ba3-e932-4224-8c66-a9bff161f662 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:00.063184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13fb2ba3-e932-4224-8c66-a9bff161f662 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:00.065609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13fb2ba3-e932-4224-8c66-a9bff161f662 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:00.066267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13fb2ba3-e932-4224-8c66-a9bff161f662 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:00.246806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-13fb2ba3-e932-4224-8c66-a9bff161f662 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:00.259603 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-13fb2ba3-e932-4224-8c66-a9bff161f662 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1203 microversion: 2.1 time: 0.217458 May 28 05:22:00.271407 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3269/6651] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:00 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1203 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:01.277734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-96e624dd-91c0-4965-a22e-0bf43490961c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:01.278355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-96e624dd-91c0-4965-a22e-0bf43490961c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:01.286787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96e624dd-91c0-4965-a22e-0bf43490961c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:01.287274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96e624dd-91c0-4965-a22e-0bf43490961c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:01.289375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96e624dd-91c0-4965-a22e-0bf43490961c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:01.289876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96e624dd-91c0-4965-a22e-0bf43490961c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:01.430038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-96e624dd-91c0-4965-a22e-0bf43490961c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:01.438034 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-96e624dd-91c0-4965-a22e-0bf43490961c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1203 microversion: 2.1 time: 0.164212 May 28 05:22:01.438618 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3383/6652] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:01 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1203 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:02.455092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f6252d71-ae12-4a1c-8d90-8e21fac8bfd4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:02.455668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f6252d71-ae12-4a1c-8d90-8e21fac8bfd4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:02.462671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6252d71-ae12-4a1c-8d90-8e21fac8bfd4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:02.463257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6252d71-ae12-4a1c-8d90-8e21fac8bfd4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:02.464207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6252d71-ae12-4a1c-8d90-8e21fac8bfd4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:02.464869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6252d71-ae12-4a1c-8d90-8e21fac8bfd4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:02.601362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f6252d71-ae12-4a1c-8d90-8e21fac8bfd4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:02.609338 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f6252d71-ae12-4a1c-8d90-8e21fac8bfd4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1203 microversion: 2.1 time: 0.158298 May 28 05:22:02.609929 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3270/6653] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:02 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:03.626838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7619d6f5-846d-4051-ba08-7788b2fe1080 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:03.627498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7619d6f5-846d-4051-ba08-7788b2fe1080 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:03.634770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7619d6f5-846d-4051-ba08-7788b2fe1080 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:03.635302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7619d6f5-846d-4051-ba08-7788b2fe1080 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:03.636241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7619d6f5-846d-4051-ba08-7788b2fe1080 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:03.636686 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7619d6f5-846d-4051-ba08-7788b2fe1080 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:03.780093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7619d6f5-846d-4051-ba08-7788b2fe1080 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:03.788957 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7619d6f5-846d-4051-ba08-7788b2fe1080 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1203 microversion: 2.1 time: 0.166424 May 28 05:22:03.793851 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3384/6654] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:03 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:04.807032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-41342038-e852-4486-a924-d87811b1b62d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:04.807864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-41342038-e852-4486-a924-d87811b1b62d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:04.815795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41342038-e852-4486-a924-d87811b1b62d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:04.816248 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41342038-e852-4486-a924-d87811b1b62d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:04.817016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41342038-e852-4486-a924-d87811b1b62d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:04.817485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41342038-e852-4486-a924-d87811b1b62d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:04.954049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-41342038-e852-4486-a924-d87811b1b62d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:04.962308 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-41342038-e852-4486-a924-d87811b1b62d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1203 microversion: 2.1 time: 0.159225 May 28 05:22:04.962902 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3271/6655] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:04 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:05.979355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aecb9b67-3ca5-4541-ba7c-9dea01c27885 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:05.980031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aecb9b67-3ca5-4541-ba7c-9dea01c27885 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:05.987589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aecb9b67-3ca5-4541-ba7c-9dea01c27885 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:05.988066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aecb9b67-3ca5-4541-ba7c-9dea01c27885 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:05.988846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aecb9b67-3ca5-4541-ba7c-9dea01c27885 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:05.989288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aecb9b67-3ca5-4541-ba7c-9dea01c27885 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:06.131709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aecb9b67-3ca5-4541-ba7c-9dea01c27885 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:06.139906 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aecb9b67-3ca5-4541-ba7c-9dea01c27885 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1203 microversion: 2.1 time: 0.164490 May 28 05:22:06.140750 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3385/6656] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:05 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:07.159554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e5ba1661-65a1-4fe4-96c6-32c3980c56f1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:07.160427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e5ba1661-65a1-4fe4-96c6-32c3980c56f1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:07.167397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e5ba1661-65a1-4fe4-96c6-32c3980c56f1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:07.167851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e5ba1661-65a1-4fe4-96c6-32c3980c56f1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:07.168619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e5ba1661-65a1-4fe4-96c6-32c3980c56f1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:07.169055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e5ba1661-65a1-4fe4-96c6-32c3980c56f1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:07.299786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e5ba1661-65a1-4fe4-96c6-32c3980c56f1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:07.307969 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e5ba1661-65a1-4fe4-96c6-32c3980c56f1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1203 microversion: 2.1 time: 0.152267 May 28 05:22:07.308572 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3272/6657] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:07 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:08.324514 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1b4bb72a-2f00-4fc1-bccb-9457ee74804d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:08.325233 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1b4bb72a-2f00-4fc1-bccb-9457ee74804d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:08.332221 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b4bb72a-2f00-4fc1-bccb-9457ee74804d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:08.332671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b4bb72a-2f00-4fc1-bccb-9457ee74804d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:08.333430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b4bb72a-2f00-4fc1-bccb-9457ee74804d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:08.333866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b4bb72a-2f00-4fc1-bccb-9457ee74804d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:08.462816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1b4bb72a-2f00-4fc1-bccb-9457ee74804d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:08.470659 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1b4bb72a-2f00-4fc1-bccb-9457ee74804d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1203 microversion: 2.1 time: 0.150024 May 28 05:22:08.471276 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3386/6658] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:08 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:09.487714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d3c6998e-18d1-4100-a140-8523df15689c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:09.488987 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d3c6998e-18d1-4100-a140-8523df15689c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:09.496676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3c6998e-18d1-4100-a140-8523df15689c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:09.497142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3c6998e-18d1-4100-a140-8523df15689c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:09.498039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3c6998e-18d1-4100-a140-8523df15689c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:09.498675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3c6998e-18d1-4100-a140-8523df15689c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:09.641067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d3c6998e-18d1-4100-a140-8523df15689c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:09.649292 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d3c6998e-18d1-4100-a140-8523df15689c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1203 microversion: 2.1 time: 0.165608 May 28 05:22:09.649887 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3273/6659] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:09 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:10.667910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1822aa2e-64cf-467c-b4a3-10a84877f971 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:10.669819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1822aa2e-64cf-467c-b4a3-10a84877f971 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:10.676804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1822aa2e-64cf-467c-b4a3-10a84877f971 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:10.677278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1822aa2e-64cf-467c-b4a3-10a84877f971 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:10.678134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1822aa2e-64cf-467c-b4a3-10a84877f971 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:10.678925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1822aa2e-64cf-467c-b4a3-10a84877f971 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:10.838314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1822aa2e-64cf-467c-b4a3-10a84877f971 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:10.847678 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1822aa2e-64cf-467c-b4a3-10a84877f971 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1203 microversion: 2.1 time: 0.183814 May 28 05:22:10.848602 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3387/6660] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:10 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1203 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:10.879826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-cae43dc8-c72b-4ea8-8d58-382029438e6d req-ff1adce0-f5ba-4df7-81e3-873dc76603db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590e4eb1-e9e5-4cb2-8c46-44d696748b58", "name": "network-vif-plugged", "status": "completed", "tag": "b1b68cff-07ba-4fd1-8712-75c40195305f"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:22:10.913134 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-cae43dc8-c72b-4ea8-8d58-382029438e6d req-ff1adce0-f5ba-4df7-81e3-873dc76603db service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:10.913948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-cae43dc8-c72b-4ea8-8d58-382029438e6d req-ff1adce0-f5ba-4df7-81e3-873dc76603db service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:10.934717 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-cae43dc8-c72b-4ea8-8d58-382029438e6d req-ff1adce0-f5ba-4df7-81e3-873dc76603db service nova] Creating event network-vif-plugged:b1b68cff-07ba-4fd1-8712-75c40195305f for instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 on n-h1-843700-1 May 28 05:22:10.940326 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-cae43dc8-c72b-4ea8-8d58-382029438e6d req-ff1adce0-f5ba-4df7-81e3-873dc76603db service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189659 May 28 05:22:10.944262 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3274/6661] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:22:11.864565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-397ee562-1f6e-4dad-8850-f4b149d8d0de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:11.865185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-397ee562-1f6e-4dad-8850-f4b149d8d0de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:11.872943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-397ee562-1f6e-4dad-8850-f4b149d8d0de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:11.873400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-397ee562-1f6e-4dad-8850-f4b149d8d0de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:11.874221 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-397ee562-1f6e-4dad-8850-f4b149d8d0de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:11.874663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-397ee562-1f6e-4dad-8850-f4b149d8d0de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:12.055515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-397ee562-1f6e-4dad-8850-f4b149d8d0de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:12.055515 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-397ee562-1f6e-4dad-8850-f4b149d8d0de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1203 microversion: 2.1 time: 0.177098 May 28 05:22:12.055515 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3388/6662] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:11 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1203 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:13.056317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-62c3c9b0-a6ee-435b-8baa-944d9c7874c6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:13.057158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-62c3c9b0-a6ee-435b-8baa-944d9c7874c6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:13.063572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-62c3c9b0-a6ee-435b-8baa-944d9c7874c6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:13.064124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-62c3c9b0-a6ee-435b-8baa-944d9c7874c6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:13.064966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-62c3c9b0-a6ee-435b-8baa-944d9c7874c6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:13.065480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-62c3c9b0-a6ee-435b-8baa-944d9c7874c6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:13.224064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-62c3c9b0-a6ee-435b-8baa-944d9c7874c6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:13.232979 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-62c3c9b0-a6ee-435b-8baa-944d9c7874c6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1389 microversion: 2.1 time: 0.181762 May 28 05:22:13.245482 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3275/6663] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:13 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1389 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:13.249736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4c44e7a3-eb56-4721-93a0-079a7aa3423b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:13.251164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4c44e7a3-eb56-4721-93a0-079a7aa3423b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:13.259059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c44e7a3-eb56-4721-93a0-079a7aa3423b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:13.259664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c44e7a3-eb56-4721-93a0-079a7aa3423b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:13.260569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c44e7a3-eb56-4721-93a0-079a7aa3423b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:13.261123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c44e7a3-eb56-4721-93a0-079a7aa3423b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:13.419131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4c44e7a3-eb56-4721-93a0-079a7aa3423b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:13.428072 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4c44e7a3-eb56-4721-93a0-079a7aa3423b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1389 microversion: 2.1 time: 0.182358 May 28 05:22:13.428867 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3389/6664] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:13 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1389 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:22:13.444340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-967b3be6-1500-42f4-b860-ef456d3077d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:13.444961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-967b3be6-1500-42f4-b860-ef456d3077d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:13.451660 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-967b3be6-1500-42f4-b860-ef456d3077d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:13.452113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-967b3be6-1500-42f4-b860-ef456d3077d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:13.452882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-967b3be6-1500-42f4-b860-ef456d3077d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:13.453324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-967b3be6-1500-42f4-b860-ef456d3077d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:13.617770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-967b3be6-1500-42f4-b860-ef456d3077d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:13.620813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=86 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:22:13.628141 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-967b3be6-1500-42f4-b860-ef456d3077d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1389 microversion: 2.1 time: 0.187621 May 28 05:22:13.629722 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3276/6665] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:13 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1389 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:13.705086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e4d24806-52be-4100-ad50-8b9909c4cba6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:13.705895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e4d24806-52be-4100-ad50-8b9909c4cba6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:13.713337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e4d24806-52be-4100-ad50-8b9909c4cba6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:13.713955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e4d24806-52be-4100-ad50-8b9909c4cba6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:13.714915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e4d24806-52be-4100-ad50-8b9909c4cba6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:13.715541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e4d24806-52be-4100-ad50-8b9909c4cba6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:13.743911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e4d24806-52be-4100-ad50-8b9909c4cba6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:22:14.011123 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e4d24806-52be-4100-ad50-8b9909c4cba6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "DELETE /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 204 len: 0 microversion: 2.1 time: 0.309903 May 28 05:22:14.011483 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3390/6666] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:22:13 2022] DELETE /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:22:14.021074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b7a6dea8-5093-4781-8400-7f9b200a4955 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:14.021986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b7a6dea8-5093-4781-8400-7f9b200a4955 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:14.027932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=30 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:22:14.029772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7a6dea8-5093-4781-8400-7f9b200a4955 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:14.030416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7a6dea8-5093-4781-8400-7f9b200a4955 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:14.031434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7a6dea8-5093-4781-8400-7f9b200a4955 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:14.032025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7a6dea8-5093-4781-8400-7f9b200a4955 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:14.222689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b7a6dea8-5093-4781-8400-7f9b200a4955 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:14.237594 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b7a6dea8-5093-4781-8400-7f9b200a4955 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1395 microversion: 2.1 time: 0.221765 May 28 05:22:14.240047 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3277/6667] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:14 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1395 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:15.263828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8f666f55-7a4c-4bb4-aa2e-126e53eca9a3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:15.267664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8f666f55-7a4c-4bb4-aa2e-126e53eca9a3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:15.276357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:22:15.283588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f666f55-7a4c-4bb4-aa2e-126e53eca9a3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:15.284630 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f666f55-7a4c-4bb4-aa2e-126e53eca9a3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:15.286082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f666f55-7a4c-4bb4-aa2e-126e53eca9a3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:15.286766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f666f55-7a4c-4bb4-aa2e-126e53eca9a3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:15.290346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:22:15.472375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8f666f55-7a4c-4bb4-aa2e-126e53eca9a3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:15.493634 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8f666f55-7a4c-4bb4-aa2e-126e53eca9a3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1395 microversion: 2.1 time: 0.237453 May 28 05:22:15.494565 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3391/6668] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:15 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1395 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:16.051033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-2027f31e-f741-4d7f-b4be-dc39d2e44dab req-d4c5480c-5eac-47b9-848b-a1ddf26922ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590e4eb1-e9e5-4cb2-8c46-44d696748b58", "name": "network-vif-deleted", "tag": "b1b68cff-07ba-4fd1-8712-75c40195305f"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:22:16.060613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2027f31e-f741-4d7f-b4be-dc39d2e44dab req-d4c5480c-5eac-47b9-848b-a1ddf26922ac service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:16.061061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2027f31e-f741-4d7f-b4be-dc39d2e44dab req-d4c5480c-5eac-47b9-848b-a1ddf26922ac service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:16.073366 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-2027f31e-f741-4d7f-b4be-dc39d2e44dab req-d4c5480c-5eac-47b9-848b-a1ddf26922ac service nova] Creating event network-vif-deleted:b1b68cff-07ba-4fd1-8712-75c40195305f for instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 on n-h1-843700-1 May 28 05:22:16.079211 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-2027f31e-f741-4d7f-b4be-dc39d2e44dab req-d4c5480c-5eac-47b9-848b-a1ddf26922ac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031880 May 28 05:22:16.079830 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3278/6669] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:22:16.513486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d9222805-0cec-48d4-9f48-2b1ca23f1048 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:16.515239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d9222805-0cec-48d4-9f48-2b1ca23f1048 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:16.526762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9222805-0cec-48d4-9f48-2b1ca23f1048 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:16.527882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9222805-0cec-48d4-9f48-2b1ca23f1048 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:16.529215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9222805-0cec-48d4-9f48-2b1ca23f1048 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:16.529872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d9222805-0cec-48d4-9f48-2b1ca23f1048 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:16.611516 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d9222805-0cec-48d4-9f48-2b1ca23f1048 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:16.620187 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d9222805-0cec-48d4-9f48-2b1ca23f1048 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1188 microversion: 2.1 time: 0.112471 May 28 05:22:16.620771 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3392/6670] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:16 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1188 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:17.639171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8188875a-ccb3-46cc-b168-b279952c08f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:17.640721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8188875a-ccb3-46cc-b168-b279952c08f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:17.648434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8188875a-ccb3-46cc-b168-b279952c08f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:17.649136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8188875a-ccb3-46cc-b168-b279952c08f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:17.650131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8188875a-ccb3-46cc-b168-b279952c08f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:17.650808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8188875a-ccb3-46cc-b168-b279952c08f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:17.716584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8188875a-ccb3-46cc-b168-b279952c08f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:17.725998 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8188875a-ccb3-46cc-b168-b279952c08f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1188 microversion: 2.1 time: 0.091817 May 28 05:22:17.735584 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3279/6671] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:17 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1188 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:18.747363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6b6beb42-bba3-4b29-b948-c41643ff9fae tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:18.748428 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6b6beb42-bba3-4b29-b948-c41643ff9fae tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:18.757183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6b6beb42-bba3-4b29-b948-c41643ff9fae tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:18.757799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6b6beb42-bba3-4b29-b948-c41643ff9fae tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:18.758660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6b6beb42-bba3-4b29-b948-c41643ff9fae tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:18.759203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6b6beb42-bba3-4b29-b948-c41643ff9fae tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:18.830635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6b6beb42-bba3-4b29-b948-c41643ff9fae tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:18.839456 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6b6beb42-bba3-4b29-b948-c41643ff9fae tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1188 microversion: 2.1 time: 0.100094 May 28 05:22:18.840310 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3393/6672] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:18 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1188 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:19.859446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2805fe08-f96e-4f09-9989-2bff2cdde250 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:19.860868 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2805fe08-f96e-4f09-9989-2bff2cdde250 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:19.871596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2805fe08-f96e-4f09-9989-2bff2cdde250 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:19.871596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2805fe08-f96e-4f09-9989-2bff2cdde250 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:19.873173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2805fe08-f96e-4f09-9989-2bff2cdde250 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:19.873674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2805fe08-f96e-4f09-9989-2bff2cdde250 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:19.955125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2805fe08-f96e-4f09-9989-2bff2cdde250 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:19.964189 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2805fe08-f96e-4f09-9989-2bff2cdde250 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1188 microversion: 2.1 time: 0.110900 May 28 05:22:19.971320 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3280/6673] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:19 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1188 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:20.981436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3be763bb-9d3d-4505-bbb6-51631773a397 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:20.982195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3be763bb-9d3d-4505-bbb6-51631773a397 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:20.991922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3be763bb-9d3d-4505-bbb6-51631773a397 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:20.992385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3be763bb-9d3d-4505-bbb6-51631773a397 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:20.993172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3be763bb-9d3d-4505-bbb6-51631773a397 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:20.993621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3be763bb-9d3d-4505-bbb6-51631773a397 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:21.073556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3be763bb-9d3d-4505-bbb6-51631773a397 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:21.084291 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3be763bb-9d3d-4505-bbb6-51631773a397 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1188 microversion: 2.1 time: 0.106616 May 28 05:22:21.095868 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3394/6674] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:20 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1188 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:22.104628 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7fe3fc41-c3bf-4637-948f-504afaa0948a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:22.105434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7fe3fc41-c3bf-4637-948f-504afaa0948a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:22.121751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7fe3fc41-c3bf-4637-948f-504afaa0948a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:22.122247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7fe3fc41-c3bf-4637-948f-504afaa0948a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:22.127288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7fe3fc41-c3bf-4637-948f-504afaa0948a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:22.128450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7fe3fc41-c3bf-4637-948f-504afaa0948a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:22.201613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7fe3fc41-c3bf-4637-948f-504afaa0948a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:22.209526 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7fe3fc41-c3bf-4637-948f-504afaa0948a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1188 microversion: 2.1 time: 0.111607 May 28 05:22:22.210118 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3281/6675] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:22 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1188 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:23.230342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fb059ab6-e4fc-44c2-8726-7cf06ee29ce6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:23.231166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fb059ab6-e4fc-44c2-8726-7cf06ee29ce6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:23.239186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fb059ab6-e4fc-44c2-8726-7cf06ee29ce6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:23.239771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fb059ab6-e4fc-44c2-8726-7cf06ee29ce6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:23.240847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fb059ab6-e4fc-44c2-8726-7cf06ee29ce6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:23.241332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fb059ab6-e4fc-44c2-8726-7cf06ee29ce6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:23.311666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fb059ab6-e4fc-44c2-8726-7cf06ee29ce6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:23.320115 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fb059ab6-e4fc-44c2-8726-7cf06ee29ce6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1188 microversion: 2.1 time: 0.096675 May 28 05:22:23.326881 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3395/6676] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:23 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1188 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:24.337175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-df3d98dc-9e24-4fd3-b5f8-07e34bc5d6eb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:24.338339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-df3d98dc-9e24-4fd3-b5f8-07e34bc5d6eb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:24.347440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df3d98dc-9e24-4fd3-b5f8-07e34bc5d6eb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:24.352359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df3d98dc-9e24-4fd3-b5f8-07e34bc5d6eb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:24.352359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df3d98dc-9e24-4fd3-b5f8-07e34bc5d6eb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:24.352359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df3d98dc-9e24-4fd3-b5f8-07e34bc5d6eb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:24.419296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-df3d98dc-9e24-4fd3-b5f8-07e34bc5d6eb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:24.427494 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-df3d98dc-9e24-4fd3-b5f8-07e34bc5d6eb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1188 microversion: 2.1 time: 0.094177 May 28 05:22:24.445425 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3282/6677] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:24 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1188 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:22:25.445189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-87a730a8-89b7-4bfd-a14b-ec2c2391d095 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:25.447437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-87a730a8-89b7-4bfd-a14b-ec2c2391d095 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:25.455652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87a730a8-89b7-4bfd-a14b-ec2c2391d095 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:25.456287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87a730a8-89b7-4bfd-a14b-ec2c2391d095 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:25.457242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87a730a8-89b7-4bfd-a14b-ec2c2391d095 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:25.457780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87a730a8-89b7-4bfd-a14b-ec2c2391d095 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:25.538001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-87a730a8-89b7-4bfd-a14b-ec2c2391d095 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:25.546761 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-87a730a8-89b7-4bfd-a14b-ec2c2391d095 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1188 microversion: 2.1 time: 0.105780 May 28 05:22:25.547823 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3396/6678] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:25 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1188 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:26.564028 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fcd7d844-39da-4520-a634-740269a8bfcd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:26.564657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fcd7d844-39da-4520-a634-740269a8bfcd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:26.578295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcd7d844-39da-4520-a634-740269a8bfcd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:26.578634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcd7d844-39da-4520-a634-740269a8bfcd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:26.579459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcd7d844-39da-4520-a634-740269a8bfcd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:26.579900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcd7d844-39da-4520-a634-740269a8bfcd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:26.616859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcd7d844-39da-4520-a634-740269a8bfcd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:26.617514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fcd7d844-39da-4520-a634-740269a8bfcd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:26.618017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-fcd7d844-39da-4520-a634-740269a8bfcd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lazy-loading 'fault' on Instance uuid 590e4eb1-e9e5-4cb2-8c46-44d696748b58 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:22:26.659572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fcd7d844-39da-4520-a634-740269a8bfcd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:22:26.668991 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fcd7d844-39da-4520-a634-740269a8bfcd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 200 len: 1193 microversion: 2.1 time: 0.108767 May 28 05:22:26.669701 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3283/6679] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:26 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 1193 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:22:27.686456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a7d2574f-4ea0-4fc7-bb9c-5e642fb1687d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:27.687008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a7d2574f-4ea0-4fc7-bb9c-5e642fb1687d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:27.694414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7d2574f-4ea0-4fc7-bb9c-5e642fb1687d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:27.694871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7d2574f-4ea0-4fc7-bb9c-5e642fb1687d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:27.695736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7d2574f-4ea0-4fc7-bb9c-5e642fb1687d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:27.696203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7d2574f-4ea0-4fc7-bb9c-5e642fb1687d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:27.710167 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-a7d2574f-4ea0-4fc7-bb9c-5e642fb1687d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] HTTP exception thrown: Instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 could not be found. May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a7d2574f-4ea0-4fc7-bb9c-5e642fb1687d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Request method failure captured: May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 HTTP/1.1 May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbDlrqJvsw-Bj4hemx4XscPzQgI57Oj0DhtZ0WItt0VxFXFIUFqzN1b2sr7MK3BjOGQZJbLNmoClfshSjagkFRTmogQaQpoLYEaPQkaSagOXWAKjyAlGGxZFI9I-y-IJo4VhS_mMCbBct4nVbcF58kjzhMiK5F2slw20hRu7zD2W154 May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TestVolumeBootPattern-934660757 May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TestVolumeBootPattern-934660757-project May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: a33708c760574b0698fc16ddfebad05b May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TestVolumeBootPattern-934660757-project May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 could not be found. May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '590e4eb1-e9e5-4cb2-8c46-44d696748b58'} May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 could not be found. May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 could not be found. May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:22:27.711899 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:22:27.717442 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:22:27.717442 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:22:27.717442 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:22:27.717442 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:22:27.717442 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:22:27.717442 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 could not be found. May 28 05:22:27.717442 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:22:27.717442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a7d2574f-4ea0-4fc7-bb9c-5e642fb1687d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Returning 404 to user: Instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:22:27.717442 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a7d2574f-4ea0-4fc7-bb9c-5e642fb1687d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 404 len: 111 microversion: 2.1 time: 0.031511 May 28 05:22:27.721145 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3397/6680] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:27 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:22:31.992188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5cf68d88-2919-4f34-8258-29d12722c5d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:31.993235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5cf68d88-2919-4f34-8258-29d12722c5d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:32.001072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5cf68d88-2919-4f34-8258-29d12722c5d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:32.001733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5cf68d88-2919-4f34-8258-29d12722c5d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:32.002687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5cf68d88-2919-4f34-8258-29d12722c5d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:32.003310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5cf68d88-2919-4f34-8258-29d12722c5d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:32.017435 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-5cf68d88-2919-4f34-8258-29d12722c5d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] HTTP exception thrown: Instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 could not be found. May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5cf68d88-2919-4f34-8258-29d12722c5d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Request method failure captured: May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 HTTP/1.1 May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbDlrqJvsw-Bj4hemx4XscPzQgI57Oj0DhtZ0WItt0VxFXFIUFqzN1b2sr7MK3BjOGQZJbLNmoClfshSjagkFRTmogQaQpoLYEaPQkaSagOXWAKjyAlGGxZFI9I-y-IJo4VhS_mMCbBct4nVbcF58kjzhMiK5F2slw20hRu7zD2W154 May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestVolumeBootPattern-934660757 May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestVolumeBootPattern-934660757-project May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: a33708c760574b0698fc16ddfebad05b May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestVolumeBootPattern-934660757-project May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 could not be found. May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '590e4eb1-e9e5-4cb2-8c46-44d696748b58'} May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 could not be found. May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:22:32.019356 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:22:32.023627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 could not be found. May 28 05:22:32.023627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:22:32.023627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:22:32.023627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:22:32.023627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:22:32.023627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:22:32.023627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:22:32.023627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:22:32.023627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:22:32.023627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 could not be found. May 28 05:22:32.023627 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:22:32.025001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5cf68d88-2919-4f34-8258-29d12722c5d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Returning 404 to user: Instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:22:32.026007 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5cf68d88-2919-4f34-8258-29d12722c5d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "DELETE /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 404 len: 111 microversion: 2.1 time: 0.037721 May 28 05:22:32.026721 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3284/6681] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:22:31 2022] DELETE /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:22:32.035659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-980c9da3-6e3f-4177-a0da-a618c3c7e12b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:22:32.036286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-980c9da3-6e3f-4177-a0da-a618c3c7e12b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 590e4eb1-e9e5-4cb2-8c46-44d696748b58] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:22:32.044160 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-980c9da3-6e3f-4177-a0da-a618c3c7e12b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:32.045497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-980c9da3-6e3f-4177-a0da-a618c3c7e12b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:32.046499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-980c9da3-6e3f-4177-a0da-a618c3c7e12b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:22:32.047191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-980c9da3-6e3f-4177-a0da-a618c3c7e12b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:22:32.062708 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-980c9da3-6e3f-4177-a0da-a618c3c7e12b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] HTTP exception thrown: Instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 could not be found. May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-980c9da3-6e3f-4177-a0da-a618c3c7e12b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Request method failure captured: May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 HTTP/1.1 May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbDlrqJvsw-Bj4hemx4XscPzQgI57Oj0DhtZ0WItt0VxFXFIUFqzN1b2sr7MK3BjOGQZJbLNmoClfshSjagkFRTmogQaQpoLYEaPQkaSagOXWAKjyAlGGxZFI9I-y-IJo4VhS_mMCbBct4nVbcF58kjzhMiK5F2slw20hRu7zD2W154 May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TestVolumeBootPattern-934660757 May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TestVolumeBootPattern-934660757-project May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: a33708c760574b0698fc16ddfebad05b May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TestVolumeBootPattern-934660757-project May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 could not be found. May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '590e4eb1-e9e5-4cb2-8c46-44d696748b58'} May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 could not be found. May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 could not be found. May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:22:32.064635 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:22:32.069117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:22:32.069117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:22:32.069117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:22:32.069117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:22:32.069117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:22:32.069117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 could not be found. May 28 05:22:32.069117 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:22:32.070356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-980c9da3-6e3f-4177-a0da-a618c3c7e12b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Returning 404 to user: Instance 590e4eb1-e9e5-4cb2-8c46-44d696748b58 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:22:32.071261 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-980c9da3-6e3f-4177-a0da-a618c3c7e12b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58" status: 404 len: 111 microversion: 2.1 time: 0.039915 May 28 05:22:32.072159 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3398/6682] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:22:32 2022] GET /compute/v2.1/servers/590e4eb1-e9e5-4cb2-8c46-44d696748b58 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:22:52.585718 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:22:52.586435 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 05:22:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:22:53.944613 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:22:53.945289 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 05:22:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:23:05.340089 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cf69207c-8e23-4039-96a3-94317154c1e9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Action: 'create', calling method: .version_select at 0x7f770012dee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1650594430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5Lj7lFghwZFnHCETUrD4iSRP2gVrfBkQYS6RJ+XS+kmgVTDfPrCa37BnAdFFEVvNJY6MRq8z28m4/CBPQKzkJaoiypATLwKE2tbPqhMo0s0isZ0Wm/YvIrttkM2B9nIA=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:23:05.344695 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=17 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:23:05.345964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=43 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:23:05.357760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-cf69207c-8e23-4039-96a3-94317154c1e9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Getting quotas for project c609cfd8212b4ae4aeee1213a373e579. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:23:05.364211 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-cf69207c-8e23-4039-96a3-94317154c1e9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Getting quotas for user 6dd6c7cc6c46484ca5964c4ed1affafb and project c609cfd8212b4ae4aeee1213a373e579. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:23:05.452176 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cf69207c-8e23-4039-96a3-94317154c1e9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.116277 May 28 05:23:05.452886 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3285/6683] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 05:23:05 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:23:08.848041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4262a092-2b1c-42d1-a538-729d77db94a5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1281777866", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "d26f19a5-7677-48a4-a967-06c11de2285f"}], "key_name": "tempest-TestNetworkBasicOps-1650594430", "security_groups": [{"name": "tempest-secgroup-smoke-1770440706"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:23:08.855267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=15 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:23:08.855921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=39 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:23:08.956538 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-4262a092-2b1c-42d1-a538-729d77db94a5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] validate_networks() for [('d26f19a5-7677-48a4-a967-06c11de2285f', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:23:09.347275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4262a092-2b1c-42d1-a538-729d77db94a5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:23:09.347703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4262a092-2b1c-42d1-a538-729d77db94a5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:23:09.348203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4262a092-2b1c-42d1-a538-729d77db94a5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:23:09.348611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4262a092-2b1c-42d1-a538-729d77db94a5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:23:09.349023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4262a092-2b1c-42d1-a538-729d77db94a5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:23:09.360397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4262a092-2b1c-42d1-a538-729d77db94a5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:09.360857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4262a092-2b1c-42d1-a538-729d77db94a5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:09.361659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4262a092-2b1c-42d1-a538-729d77db94a5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:09.362096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4262a092-2b1c-42d1-a538-729d77db94a5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:09.380237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-4262a092-2b1c-42d1-a538-729d77db94a5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Getting quotas for project c609cfd8212b4ae4aeee1213a373e579. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:23:09.385575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-4262a092-2b1c-42d1-a538-729d77db94a5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Getting quotas for user 6dd6c7cc6c46484ca5964c4ed1affafb and project c609cfd8212b4ae4aeee1213a373e579. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:23:09.399608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4262a092-2b1c-42d1-a538-729d77db94a5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:23:09.402026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4262a092-2b1c-42d1-a538-729d77db94a5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:23:09.590046 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4262a092-2b1c-42d1-a538-729d77db94a5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.745904 May 28 05:23:09.592046 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3399/6684] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:23:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:23:09.602783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dab19cad-8d3e-495f-a222-c86c28d890e8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:09.604130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dab19cad-8d3e-495f-a222-c86c28d890e8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:09.670523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dab19cad-8d3e-495f-a222-c86c28d890e8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:09.679347 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dab19cad-8d3e-495f-a222-c86c28d890e8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2" status: 200 len: 1249 microversion: 2.1 time: 0.081321 May 28 05:23:09.679944 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3286/6685] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:09 2022] GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:10.701592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-da97bc9d-4f41-439f-85dd-037f7a0e0d3d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:10.702234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-da97bc9d-4f41-439f-85dd-037f7a0e0d3d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:10.762354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-da97bc9d-4f41-439f-85dd-037f7a0e0d3d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:10.770260 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-da97bc9d-4f41-439f-85dd-037f7a0e0d3d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2" status: 200 len: 1249 microversion: 2.1 time: 0.075111 May 28 05:23:10.771002 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3400/6686] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:10 2022] GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2 => generated 1249 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:11.788253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2c9c6c72-6503-4e39-9aa5-47ba5526492e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:11.788868 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2c9c6c72-6503-4e39-9aa5-47ba5526492e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:11.796871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c9c6c72-6503-4e39-9aa5-47ba5526492e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:11.800441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c9c6c72-6503-4e39-9aa5-47ba5526492e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:11.800441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c9c6c72-6503-4e39-9aa5-47ba5526492e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:11.800441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c9c6c72-6503-4e39-9aa5-47ba5526492e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:11.872078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2c9c6c72-6503-4e39-9aa5-47ba5526492e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:11.882399 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2c9c6c72-6503-4e39-9aa5-47ba5526492e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2" status: 200 len: 1301 microversion: 2.1 time: 0.098376 May 28 05:23:11.883148 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3287/6687] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:11 2022] GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2 => generated 1301 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:23:12.901325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0d22dcc4-9b64-40bd-a672-bfb3e79dea31 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:12.903302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0d22dcc4-9b64-40bd-a672-bfb3e79dea31 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:12.915680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0d22dcc4-9b64-40bd-a672-bfb3e79dea31 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:12.920464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0d22dcc4-9b64-40bd-a672-bfb3e79dea31 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:12.921298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0d22dcc4-9b64-40bd-a672-bfb3e79dea31 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:12.921736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0d22dcc4-9b64-40bd-a672-bfb3e79dea31 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:13.003273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0d22dcc4-9b64-40bd-a672-bfb3e79dea31 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:13.013066 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0d22dcc4-9b64-40bd-a672-bfb3e79dea31 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2" status: 200 len: 1307 microversion: 2.1 time: 0.116804 May 28 05:23:13.023853 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3401/6688] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:12 2022] GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2 => generated 1307 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:14.029730 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e56a93a1-f5d1-40e9-8614-1be3bef35caf tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:14.030940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e56a93a1-f5d1-40e9-8614-1be3bef35caf tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:14.038334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e56a93a1-f5d1-40e9-8614-1be3bef35caf tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:14.039020 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e56a93a1-f5d1-40e9-8614-1be3bef35caf tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:14.039962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e56a93a1-f5d1-40e9-8614-1be3bef35caf tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:14.040599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e56a93a1-f5d1-40e9-8614-1be3bef35caf tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:14.752432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e56a93a1-f5d1-40e9-8614-1be3bef35caf tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:14.761580 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e56a93a1-f5d1-40e9-8614-1be3bef35caf tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2" status: 200 len: 1375 microversion: 2.1 time: 0.735078 May 28 05:23:14.762107 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3288/6689] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:14 2022] GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2 => generated 1375 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:14.899087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-54a6ddb2-20bf-4fda-ae64-06464b94bd80 req-d970b437-763d-46db-92e9-96c61936397c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "973209fd-736b-4663-bc57-5413a41c5bc2", "tag": "fe3ffa12-3b81-41b7-9a68-783dd918e7a9"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:23:14.909449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-54a6ddb2-20bf-4fda-ae64-06464b94bd80 req-d970b437-763d-46db-92e9-96c61936397c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:14.913273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-54a6ddb2-20bf-4fda-ae64-06464b94bd80 req-d970b437-763d-46db-92e9-96c61936397c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:14.935145 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-54a6ddb2-20bf-4fda-ae64-06464b94bd80 req-d970b437-763d-46db-92e9-96c61936397c service nova] Creating event network-changed:fe3ffa12-3b81-41b7-9a68-783dd918e7a9 for instance 973209fd-736b-4663-bc57-5413a41c5bc2 on n-h1-843700-1 May 28 05:23:14.947500 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-54a6ddb2-20bf-4fda-ae64-06464b94bd80 req-d970b437-763d-46db-92e9-96c61936397c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.323439 May 28 05:23:14.949581 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3402/6690] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:23:15.778310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ffcc7cf2-3d10-4a3d-9419-8236b1f5fcf9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:15.778928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ffcc7cf2-3d10-4a3d-9419-8236b1f5fcf9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:15.786450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ffcc7cf2-3d10-4a3d-9419-8236b1f5fcf9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:15.786912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ffcc7cf2-3d10-4a3d-9419-8236b1f5fcf9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:15.787712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ffcc7cf2-3d10-4a3d-9419-8236b1f5fcf9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:15.788149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ffcc7cf2-3d10-4a3d-9419-8236b1f5fcf9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:15.945577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ffcc7cf2-3d10-4a3d-9419-8236b1f5fcf9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:15.953220 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ffcc7cf2-3d10-4a3d-9419-8236b1f5fcf9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2" status: 200 len: 1375 microversion: 2.1 time: 0.179207 May 28 05:23:15.953927 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3289/6691] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:15 2022] GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2 => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:15.971704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-43e4d820-94f6-4ea8-b1b3-1d2d9b17e1b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1505912617", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "72be5618-e8c9-4099-a3ec-8735d997878e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f8631f0f-218a-4dd3-ad6e-75d0627c5194"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:23:16.035512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-43e4d820-94f6-4ea8-b1b3-1d2d9b17e1b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] validate_networks() for [('f8631f0f-218a-4dd3-ad6e-75d0627c5194', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:23:16.679135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-43e4d820-94f6-4ea8-b1b3-1d2d9b17e1b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:23:16.679671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-43e4d820-94f6-4ea8-b1b3-1d2d9b17e1b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:23:16.680254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-43e4d820-94f6-4ea8-b1b3-1d2d9b17e1b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:23:16.680870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-43e4d820-94f6-4ea8-b1b3-1d2d9b17e1b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:23:16.681361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-43e4d820-94f6-4ea8-b1b3-1d2d9b17e1b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:23:16.693576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43e4d820-94f6-4ea8-b1b3-1d2d9b17e1b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:16.694118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43e4d820-94f6-4ea8-b1b3-1d2d9b17e1b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:16.695244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43e4d820-94f6-4ea8-b1b3-1d2d9b17e1b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:16.695769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43e4d820-94f6-4ea8-b1b3-1d2d9b17e1b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:16.717782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-43e4d820-94f6-4ea8-b1b3-1d2d9b17e1b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Getting quotas for project e45163cf20a447a0a60bc0c0f075fa78. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:23:16.724310 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-43e4d820-94f6-4ea8-b1b3-1d2d9b17e1b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Getting quotas for user a33708c760574b0698fc16ddfebad05b and project e45163cf20a447a0a60bc0c0f075fa78. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:23:16.791431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-43e4d820-94f6-4ea8-b1b3-1d2d9b17e1b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:23:16.794133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-43e4d820-94f6-4ea8-b1b3-1d2d9b17e1b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72be5618-e8c9-4099-a3ec-8735d997878e',volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:23:16.969981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d3170dfa-6908-4ca5-903d-479193259d4d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:16.970595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d3170dfa-6908-4ca5-903d-479193259d4d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:16.978118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3170dfa-6908-4ca5-903d-479193259d4d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:16.978573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3170dfa-6908-4ca5-903d-479193259d4d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:16.979858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3170dfa-6908-4ca5-903d-479193259d4d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:16.980305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d3170dfa-6908-4ca5-903d-479193259d4d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:17.124519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d3170dfa-6908-4ca5-903d-479193259d4d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:17.132817 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d3170dfa-6908-4ca5-903d-479193259d4d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2" status: 200 len: 1375 microversion: 2.1 time: 0.166854 May 28 05:23:17.134284 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3290/6692] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:16 2022] GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2 => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:17.287502 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-43e4d820-94f6-4ea8-b1b3-1d2d9b17e1b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.320107 May 28 05:23:17.288173 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3403/6693] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:23:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:23:17.306079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3f0af241-ffbe-4455-9bb3-bb2a61361746 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:17.306079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3f0af241-ffbe-4455-9bb3-bb2a61361746 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:17.373329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3f0af241-ffbe-4455-9bb3-bb2a61361746 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:17.380649 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3f0af241-ffbe-4455-9bb3-bb2a61361746 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1071 microversion: 2.1 time: 0.085725 May 28 05:23:17.381322 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3291/6694] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:17 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1071 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:18.150338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e0913013-9bd2-4fb3-9e71-d4f054c2b3cd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:18.154093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e0913013-9bd2-4fb3-9e71-d4f054c2b3cd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:18.158261 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0913013-9bd2-4fb3-9e71-d4f054c2b3cd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:18.158717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0913013-9bd2-4fb3-9e71-d4f054c2b3cd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:18.159760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0913013-9bd2-4fb3-9e71-d4f054c2b3cd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:18.160230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0913013-9bd2-4fb3-9e71-d4f054c2b3cd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:18.294754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e0913013-9bd2-4fb3-9e71-d4f054c2b3cd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:18.302431 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e0913013-9bd2-4fb3-9e71-d4f054c2b3cd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2" status: 200 len: 1375 microversion: 2.1 time: 0.156065 May 28 05:23:18.303075 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3404/6695] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:18 2022] GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:18.397103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-21771cb7-d7fd-4dba-900b-f1492e45396c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:18.397844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-21771cb7-d7fd-4dba-900b-f1492e45396c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:18.405907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21771cb7-d7fd-4dba-900b-f1492e45396c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:18.406440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21771cb7-d7fd-4dba-900b-f1492e45396c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:18.407329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21771cb7-d7fd-4dba-900b-f1492e45396c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:18.407852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-21771cb7-d7fd-4dba-900b-f1492e45396c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:18.472881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-21771cb7-d7fd-4dba-900b-f1492e45396c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:18.481073 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-21771cb7-d7fd-4dba-900b-f1492e45396c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1121 microversion: 2.1 time: 0.088050 May 28 05:23:18.481751 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3292/6696] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:18 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1121 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:19.320004 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0503f8b0-00ee-4122-9e57-4ea6cb5018c1 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:19.322483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0503f8b0-00ee-4122-9e57-4ea6cb5018c1 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:19.343636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0503f8b0-00ee-4122-9e57-4ea6cb5018c1 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:19.347836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0503f8b0-00ee-4122-9e57-4ea6cb5018c1 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:19.347836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0503f8b0-00ee-4122-9e57-4ea6cb5018c1 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:19.347836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0503f8b0-00ee-4122-9e57-4ea6cb5018c1 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:19.498493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c7f400c2-81b7-46e0-8672-d51452c063bd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:19.499161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c7f400c2-81b7-46e0-8672-d51452c063bd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:19.506935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7f400c2-81b7-46e0-8672-d51452c063bd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:19.507508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7f400c2-81b7-46e0-8672-d51452c063bd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:19.509482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7f400c2-81b7-46e0-8672-d51452c063bd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:19.513988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c7f400c2-81b7-46e0-8672-d51452c063bd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:19.579608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0503f8b0-00ee-4122-9e57-4ea6cb5018c1 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:19.587652 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0503f8b0-00ee-4122-9e57-4ea6cb5018c1 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2" status: 200 len: 1375 microversion: 2.1 time: 0.271653 May 28 05:23:19.588815 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3405/6697] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:19 2022] GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2 => generated 1375 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:19.624240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c7f400c2-81b7-46e0-8672-d51452c063bd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:19.631218 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c7f400c2-81b7-46e0-8672-d51452c063bd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1177 microversion: 2.1 time: 0.137476 May 28 05:23:19.631899 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3293/6698] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:19 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1177 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:23:20.604238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-73b97caf-5391-494f-9901-9a7bf3a54bdd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:20.604814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-73b97caf-5391-494f-9901-9a7bf3a54bdd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:20.615191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73b97caf-5391-494f-9901-9a7bf3a54bdd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:20.615750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73b97caf-5391-494f-9901-9a7bf3a54bdd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:20.620069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73b97caf-5391-494f-9901-9a7bf3a54bdd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:20.620553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73b97caf-5391-494f-9901-9a7bf3a54bdd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:20.662795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-23aa7248-200d-4c98-9aa5-02a09090e141 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:20.662795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-23aa7248-200d-4c98-9aa5-02a09090e141 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:20.671579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23aa7248-200d-4c98-9aa5-02a09090e141 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:20.672062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23aa7248-200d-4c98-9aa5-02a09090e141 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:20.672886 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23aa7248-200d-4c98-9aa5-02a09090e141 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:20.673346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23aa7248-200d-4c98-9aa5-02a09090e141 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:20.991362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-73b97caf-5391-494f-9901-9a7bf3a54bdd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:20.998121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-23aa7248-200d-4c98-9aa5-02a09090e141 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:21.012292 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-23aa7248-200d-4c98-9aa5-02a09090e141 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1229 microversion: 2.1 time: 0.360703 May 28 05:23:21.012740 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-73b97caf-5391-494f-9901-9a7bf3a54bdd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2" status: 200 len: 1375 microversion: 2.1 time: 0.406295 May 28 05:23:21.013208 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3294/6699] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:20 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1229 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:21.013793 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3406/6700] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:20 2022] GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2 => generated 1375 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:21.144330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-5cfa8421-7767-4dfc-8af5-09a76e3de7d8 req-a500b20d-8c58-4d07-bb72-9084155fdc60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "973209fd-736b-4663-bc57-5413a41c5bc2", "name": "network-vif-plugged", "status": "completed", "tag": "fe3ffa12-3b81-41b7-9a68-783dd918e7a9"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:23:21.164802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5cfa8421-7767-4dfc-8af5-09a76e3de7d8 req-a500b20d-8c58-4d07-bb72-9084155fdc60 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:21.165581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5cfa8421-7767-4dfc-8af5-09a76e3de7d8 req-a500b20d-8c58-4d07-bb72-9084155fdc60 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:21.183829 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-5cfa8421-7767-4dfc-8af5-09a76e3de7d8 req-a500b20d-8c58-4d07-bb72-9084155fdc60 service nova] Creating event network-vif-plugged:fe3ffa12-3b81-41b7-9a68-783dd918e7a9 for instance 973209fd-736b-4663-bc57-5413a41c5bc2 on n-h1-843700-1 May 28 05:23:21.189846 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-5cfa8421-7767-4dfc-8af5-09a76e3de7d8 req-a500b20d-8c58-4d07-bb72-9084155fdc60 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049951 May 28 05:23:21.191145 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3295/6701] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:23:21.901030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-7cea9caa-b340-48f4-94a0-9ba104ef2b4b req-903f8ca6-79b3-4fe9-b4a0-d79dd9f7d63f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4658f0c2-79f1-4d18-b563-7e1f50d68a3c", "tag": "adf0a6ae-02fd-4ec6-9b68-8fdcb6f7033e"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:23:21.912650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-7cea9caa-b340-48f4-94a0-9ba104ef2b4b req-903f8ca6-79b3-4fe9-b4a0-d79dd9f7d63f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:21.913094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-7cea9caa-b340-48f4-94a0-9ba104ef2b4b req-903f8ca6-79b3-4fe9-b4a0-d79dd9f7d63f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:21.925699 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-7cea9caa-b340-48f4-94a0-9ba104ef2b4b req-903f8ca6-79b3-4fe9-b4a0-d79dd9f7d63f service nova] Creating event network-changed:adf0a6ae-02fd-4ec6-9b68-8fdcb6f7033e for instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c on n-h2-843700-1 May 28 05:23:21.931733 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-7cea9caa-b340-48f4-94a0-9ba104ef2b4b req-903f8ca6-79b3-4fe9-b4a0-d79dd9f7d63f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036268 May 28 05:23:21.935650 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3407/6702] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:23:22.037550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a76302fb-d031-4ff6-bb80-86debf59d0dc tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:22.039049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fc82cb82-9971-4630-a215-962d7e305d83 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:22.042424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fc82cb82-9971-4630-a215-962d7e305d83 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:22.057218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc82cb82-9971-4630-a215-962d7e305d83 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:22.058726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc82cb82-9971-4630-a215-962d7e305d83 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:22.059482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a76302fb-d031-4ff6-bb80-86debf59d0dc tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:22.060749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc82cb82-9971-4630-a215-962d7e305d83 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:22.062299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc82cb82-9971-4630-a215-962d7e305d83 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:22.075349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a76302fb-d031-4ff6-bb80-86debf59d0dc tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:22.076100 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a76302fb-d031-4ff6-bb80-86debf59d0dc tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:22.077119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a76302fb-d031-4ff6-bb80-86debf59d0dc tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:22.077801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a76302fb-d031-4ff6-bb80-86debf59d0dc tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:22.395454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fc82cb82-9971-4630-a215-962d7e305d83 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:22.404310 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fc82cb82-9971-4630-a215-962d7e305d83 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1229 microversion: 2.1 time: 0.370309 May 28 05:23:22.405050 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3408/6703] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:22 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1229 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:23:22.448597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a76302fb-d031-4ff6-bb80-86debf59d0dc tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:22.460620 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a76302fb-d031-4ff6-bb80-86debf59d0dc tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2" status: 200 len: 1375 microversion: 2.1 time: 0.434208 May 28 05:23:22.461803 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3296/6704] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:22 2022] GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2 => generated 1375 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:23.421560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3164c0ec-afac-4dd6-8a5d-723877396a9d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:23.422214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3164c0ec-afac-4dd6-8a5d-723877396a9d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:23.429577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3164c0ec-afac-4dd6-8a5d-723877396a9d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:23.430042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3164c0ec-afac-4dd6-8a5d-723877396a9d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:23.430822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3164c0ec-afac-4dd6-8a5d-723877396a9d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:23.431331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3164c0ec-afac-4dd6-8a5d-723877396a9d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:23.477633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aeca8478-d48c-4148-b456-5b50d08164d7 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:23.483219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-aeca8478-d48c-4148-b456-5b50d08164d7 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:23.486274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aeca8478-d48c-4148-b456-5b50d08164d7 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:23.486746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aeca8478-d48c-4148-b456-5b50d08164d7 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:23.487568 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aeca8478-d48c-4148-b456-5b50d08164d7 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:23.488158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aeca8478-d48c-4148-b456-5b50d08164d7 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:23.653264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3164c0ec-afac-4dd6-8a5d-723877396a9d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:23.675671 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3164c0ec-afac-4dd6-8a5d-723877396a9d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1229 microversion: 2.1 time: 0.258039 May 28 05:23:23.676277 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3409/6705] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:23 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1229 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:23.685698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-aeca8478-d48c-4148-b456-5b50d08164d7 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:23.693389 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aeca8478-d48c-4148-b456-5b50d08164d7 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2" status: 200 len: 1548 microversion: 2.1 time: 0.219582 May 28 05:23:23.693906 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3297/6706] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:23 2022] GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2 => generated 1548 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:23:23.710832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-00fa7a0f-aaaf-4f8c-8cbd-cda34f03b0ce tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:23.711804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-00fa7a0f-aaaf-4f8c-8cbd-cda34f03b0ce tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:23.718162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00fa7a0f-aaaf-4f8c-8cbd-cda34f03b0ce tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:23.718626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00fa7a0f-aaaf-4f8c-8cbd-cda34f03b0ce tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:23.719450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00fa7a0f-aaaf-4f8c-8cbd-cda34f03b0ce tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:23.720122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00fa7a0f-aaaf-4f8c-8cbd-cda34f03b0ce tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:23.874492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-00fa7a0f-aaaf-4f8c-8cbd-cda34f03b0ce tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:23.883200 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-00fa7a0f-aaaf-4f8c-8cbd-cda34f03b0ce tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2" status: 200 len: 1548 microversion: 2.1 time: 0.176027 May 28 05:23:23.884084 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3410/6707] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:23 2022] GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2 => generated 1548 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:24.693718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-70d0353a-efad-460d-8a1f-d558fc4d6644 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:24.694377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-70d0353a-efad-460d-8a1f-d558fc4d6644 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:24.702707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70d0353a-efad-460d-8a1f-d558fc4d6644 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:24.703395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70d0353a-efad-460d-8a1f-d558fc4d6644 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:24.704422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70d0353a-efad-460d-8a1f-d558fc4d6644 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:24.705034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70d0353a-efad-460d-8a1f-d558fc4d6644 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:25.266044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-70d0353a-efad-460d-8a1f-d558fc4d6644 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:25.275625 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-70d0353a-efad-460d-8a1f-d558fc4d6644 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1229 microversion: 2.1 time: 0.586073 May 28 05:23:25.277304 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3298/6708] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:24 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1229 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:23:26.294298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d7fda98b-1cf3-4686-8c0b-59cbb62fd82b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:26.295829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d7fda98b-1cf3-4686-8c0b-59cbb62fd82b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:26.315192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7fda98b-1cf3-4686-8c0b-59cbb62fd82b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:26.315854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7fda98b-1cf3-4686-8c0b-59cbb62fd82b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:26.316995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7fda98b-1cf3-4686-8c0b-59cbb62fd82b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:26.317531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7fda98b-1cf3-4686-8c0b-59cbb62fd82b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:26.577558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d7fda98b-1cf3-4686-8c0b-59cbb62fd82b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:26.598530 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d7fda98b-1cf3-4686-8c0b-59cbb62fd82b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1229 microversion: 2.1 time: 0.309294 May 28 05:23:26.601006 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3411/6709] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:26 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1229 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:26.774724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-4f1bee99-1cc4-4a5c-812a-901c359db4cd req-459043dd-f0b6-4437-9c96-1d43d45d9b4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "973209fd-736b-4663-bc57-5413a41c5bc2", "tag": "fe3ffa12-3b81-41b7-9a68-783dd918e7a9"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:23:26.785068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4f1bee99-1cc4-4a5c-812a-901c359db4cd req-459043dd-f0b6-4437-9c96-1d43d45d9b4b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:26.785755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4f1bee99-1cc4-4a5c-812a-901c359db4cd req-459043dd-f0b6-4437-9c96-1d43d45d9b4b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:26.797741 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-4f1bee99-1cc4-4a5c-812a-901c359db4cd req-459043dd-f0b6-4437-9c96-1d43d45d9b4b service nova] Creating event network-changed:fe3ffa12-3b81-41b7-9a68-783dd918e7a9 for instance 973209fd-736b-4663-bc57-5413a41c5bc2 on n-h1-843700-1 May 28 05:23:26.803470 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-4f1bee99-1cc4-4a5c-812a-901c359db4cd req-459043dd-f0b6-4437-9c96-1d43d45d9b4b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165507 May 28 05:23:26.804561 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3299/6710] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:23:27.616429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9257ff14-7519-4c9b-8d72-b8a8b51d00c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:27.617089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9257ff14-7519-4c9b-8d72-b8a8b51d00c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:27.619088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:23:27.620505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=14 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:23:27.626464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9257ff14-7519-4c9b-8d72-b8a8b51d00c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:27.626925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9257ff14-7519-4c9b-8d72-b8a8b51d00c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:27.627727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9257ff14-7519-4c9b-8d72-b8a8b51d00c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:27.628176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9257ff14-7519-4c9b-8d72-b8a8b51d00c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:27.783253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9257ff14-7519-4c9b-8d72-b8a8b51d00c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:27.800728 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9257ff14-7519-4c9b-8d72-b8a8b51d00c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1229 microversion: 2.1 time: 0.187727 May 28 05:23:27.803049 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3412/6711] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:27 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1229 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:28.816566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=8 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:23:28.822362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a4eee30a-fd7a-4599-af5f-9455fabbd242 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:28.823314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a4eee30a-fd7a-4599-af5f-9455fabbd242 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:28.830375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4eee30a-fd7a-4599-af5f-9455fabbd242 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:28.830887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4eee30a-fd7a-4599-af5f-9455fabbd242 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:28.832048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4eee30a-fd7a-4599-af5f-9455fabbd242 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:28.832512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4eee30a-fd7a-4599-af5f-9455fabbd242 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:28.985717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a4eee30a-fd7a-4599-af5f-9455fabbd242 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:28.993805 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a4eee30a-fd7a-4599-af5f-9455fabbd242 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1229 microversion: 2.1 time: 0.178093 May 28 05:23:28.994405 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3300/6712] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:28 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1229 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:30.012428 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4fefc75d-d474-49f0-8a79-2cb6974133c1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:30.013202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4fefc75d-d474-49f0-8a79-2cb6974133c1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:30.020485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fefc75d-d474-49f0-8a79-2cb6974133c1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:30.021068 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fefc75d-d474-49f0-8a79-2cb6974133c1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:30.021997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fefc75d-d474-49f0-8a79-2cb6974133c1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:30.022539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fefc75d-d474-49f0-8a79-2cb6974133c1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:30.208006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4fefc75d-d474-49f0-8a79-2cb6974133c1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:30.215673 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4fefc75d-d474-49f0-8a79-2cb6974133c1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1229 microversion: 2.1 time: 0.208002 May 28 05:23:30.216260 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3413/6713] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:30 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1229 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:23:31.232124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-213d648f-206a-408d-9df1-3dba26e55436 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:31.232884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-213d648f-206a-408d-9df1-3dba26e55436 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:31.240067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-213d648f-206a-408d-9df1-3dba26e55436 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:31.240538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-213d648f-206a-408d-9df1-3dba26e55436 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:31.241495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-213d648f-206a-408d-9df1-3dba26e55436 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:31.241952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-213d648f-206a-408d-9df1-3dba26e55436 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:31.379703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-213d648f-206a-408d-9df1-3dba26e55436 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:31.388171 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-213d648f-206a-408d-9df1-3dba26e55436 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1229 microversion: 2.1 time: 0.160002 May 28 05:23:31.388762 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3301/6714] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:31 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1229 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:23:32.405843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0568de4b-eeca-4b75-9b15-c9388a48041e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:32.406399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0568de4b-eeca-4b75-9b15-c9388a48041e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:32.413595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0568de4b-eeca-4b75-9b15-c9388a48041e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:32.414060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0568de4b-eeca-4b75-9b15-c9388a48041e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:32.414840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0568de4b-eeca-4b75-9b15-c9388a48041e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:32.415318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0568de4b-eeca-4b75-9b15-c9388a48041e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:32.553711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0568de4b-eeca-4b75-9b15-c9388a48041e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:32.561338 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0568de4b-eeca-4b75-9b15-c9388a48041e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1217 microversion: 2.1 time: 0.160339 May 28 05:23:32.561921 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3414/6715] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:32 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:33.577753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-32a96049-bc76-4197-8f75-079bb3b85d6a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:33.578357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-32a96049-bc76-4197-8f75-079bb3b85d6a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:33.585345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-32a96049-bc76-4197-8f75-079bb3b85d6a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:33.585802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-32a96049-bc76-4197-8f75-079bb3b85d6a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:33.586569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-32a96049-bc76-4197-8f75-079bb3b85d6a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:33.587034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-32a96049-bc76-4197-8f75-079bb3b85d6a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:33.719519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-32a96049-bc76-4197-8f75-079bb3b85d6a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:33.727296 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-32a96049-bc76-4197-8f75-079bb3b85d6a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1217 microversion: 2.1 time: 0.153464 May 28 05:23:33.728057 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3302/6716] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:33 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:34.745108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fe4bc990-a13d-4e1f-a5c2-90b6151b047c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:34.745750 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fe4bc990-a13d-4e1f-a5c2-90b6151b047c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:34.752955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe4bc990-a13d-4e1f-a5c2-90b6151b047c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:34.753410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe4bc990-a13d-4e1f-a5c2-90b6151b047c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:34.754587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe4bc990-a13d-4e1f-a5c2-90b6151b047c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:34.755045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe4bc990-a13d-4e1f-a5c2-90b6151b047c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:34.894260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fe4bc990-a13d-4e1f-a5c2-90b6151b047c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:34.903618 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fe4bc990-a13d-4e1f-a5c2-90b6151b047c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1217 microversion: 2.1 time: 0.162854 May 28 05:23:34.904238 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3415/6717] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:34 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:35.920793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1161782b-245c-4e55-abf9-5916841dbb4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:35.921413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1161782b-245c-4e55-abf9-5916841dbb4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:35.929147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1161782b-245c-4e55-abf9-5916841dbb4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:35.929614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1161782b-245c-4e55-abf9-5916841dbb4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:35.930423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1161782b-245c-4e55-abf9-5916841dbb4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:35.930875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1161782b-245c-4e55-abf9-5916841dbb4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:36.070144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1161782b-245c-4e55-abf9-5916841dbb4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:36.078474 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1161782b-245c-4e55-abf9-5916841dbb4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1217 microversion: 2.1 time: 0.161712 May 28 05:23:36.079073 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3303/6718] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:35 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:23:37.095602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d78b980c-33e1-42a9-82b7-7dd71e2a4e94 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:37.096210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d78b980c-33e1-42a9-82b7-7dd71e2a4e94 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:37.103163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d78b980c-33e1-42a9-82b7-7dd71e2a4e94 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:37.103624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d78b980c-33e1-42a9-82b7-7dd71e2a4e94 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:37.104397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d78b980c-33e1-42a9-82b7-7dd71e2a4e94 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:37.104844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d78b980c-33e1-42a9-82b7-7dd71e2a4e94 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:37.232412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d78b980c-33e1-42a9-82b7-7dd71e2a4e94 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:37.240089 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d78b980c-33e1-42a9-82b7-7dd71e2a4e94 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1217 microversion: 2.1 time: 0.148531 May 28 05:23:37.240669 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3416/6719] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:37 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:38.256521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1dd9ebc9-2693-48f9-aeed-19c9567c9386 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:38.257180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1dd9ebc9-2693-48f9-aeed-19c9567c9386 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:38.264932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1dd9ebc9-2693-48f9-aeed-19c9567c9386 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:38.265400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1dd9ebc9-2693-48f9-aeed-19c9567c9386 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:38.266191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1dd9ebc9-2693-48f9-aeed-19c9567c9386 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:38.266642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1dd9ebc9-2693-48f9-aeed-19c9567c9386 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:38.402615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1dd9ebc9-2693-48f9-aeed-19c9567c9386 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:38.410579 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1dd9ebc9-2693-48f9-aeed-19c9567c9386 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1217 microversion: 2.1 time: 0.158139 May 28 05:23:38.411174 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3304/6720] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:38 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:39.428303 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d6d90631-271f-4703-bc4b-94fb02930c7b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:39.428867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d6d90631-271f-4703-bc4b-94fb02930c7b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:39.432515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:23:39.437917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d6d90631-271f-4703-bc4b-94fb02930c7b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:39.441861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d6d90631-271f-4703-bc4b-94fb02930c7b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:39.441861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d6d90631-271f-4703-bc4b-94fb02930c7b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:39.441861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d6d90631-271f-4703-bc4b-94fb02930c7b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:39.444171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=87 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:23:39.576015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d6d90631-271f-4703-bc4b-94fb02930c7b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:39.583687 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d6d90631-271f-4703-bc4b-94fb02930c7b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1217 microversion: 2.1 time: 0.159552 May 28 05:23:39.584281 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3417/6721] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:39 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:40.600864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f29832d1-8cbe-445c-8397-7116817bdcbb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:40.601392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f29832d1-8cbe-445c-8397-7116817bdcbb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:40.604233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:23:40.609178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f29832d1-8cbe-445c-8397-7116817bdcbb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:40.609641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f29832d1-8cbe-445c-8397-7116817bdcbb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:40.610423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f29832d1-8cbe-445c-8397-7116817bdcbb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:40.610869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f29832d1-8cbe-445c-8397-7116817bdcbb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:40.614846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=95 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:23:40.751899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f29832d1-8cbe-445c-8397-7116817bdcbb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:40.759683 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f29832d1-8cbe-445c-8397-7116817bdcbb tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1217 microversion: 2.1 time: 0.162657 May 28 05:23:40.760812 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3305/6722] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:40 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1217 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:41.777937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-57d16530-d1e7-4ae0-9489-c692f2a27c7f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:41.778480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-57d16530-d1e7-4ae0-9489-c692f2a27c7f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:41.785658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57d16530-d1e7-4ae0-9489-c692f2a27c7f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:41.786128 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57d16530-d1e7-4ae0-9489-c692f2a27c7f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:41.786871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57d16530-d1e7-4ae0-9489-c692f2a27c7f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:41.787338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57d16530-d1e7-4ae0-9489-c692f2a27c7f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:41.923490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-57d16530-d1e7-4ae0-9489-c692f2a27c7f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:41.932514 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-57d16530-d1e7-4ae0-9489-c692f2a27c7f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1217 microversion: 2.1 time: 0.158628 May 28 05:23:41.933114 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3418/6723] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:41 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:42.171031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-a03c6bab-30d9-40bd-bd93-b45a23a5f4d5 req-0ec7dd12-406a-4822-b698-e2867ff90e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4658f0c2-79f1-4d18-b563-7e1f50d68a3c", "name": "network-vif-plugged", "status": "completed", "tag": "adf0a6ae-02fd-4ec6-9b68-8fdcb6f7033e"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:23:42.180509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a03c6bab-30d9-40bd-bd93-b45a23a5f4d5 req-0ec7dd12-406a-4822-b698-e2867ff90e04 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:42.181140 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a03c6bab-30d9-40bd-bd93-b45a23a5f4d5 req-0ec7dd12-406a-4822-b698-e2867ff90e04 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:42.192822 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-a03c6bab-30d9-40bd-bd93-b45a23a5f4d5 req-0ec7dd12-406a-4822-b698-e2867ff90e04 service nova] Creating event network-vif-plugged:adf0a6ae-02fd-4ec6-9b68-8fdcb6f7033e for instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c on n-h2-843700-1 May 28 05:23:42.198874 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-a03c6bab-30d9-40bd-bd93-b45a23a5f4d5 req-0ec7dd12-406a-4822-b698-e2867ff90e04 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031782 May 28 05:23:42.199602 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3306/6724] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:23:42.949725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bf94e8ec-6c1c-47fe-880b-e2cae5fa65de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:42.950371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bf94e8ec-6c1c-47fe-880b-e2cae5fa65de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:42.957778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf94e8ec-6c1c-47fe-880b-e2cae5fa65de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:42.958239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf94e8ec-6c1c-47fe-880b-e2cae5fa65de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:42.959037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf94e8ec-6c1c-47fe-880b-e2cae5fa65de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:42.959485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf94e8ec-6c1c-47fe-880b-e2cae5fa65de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:43.093429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bf94e8ec-6c1c-47fe-880b-e2cae5fa65de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:43.101115 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bf94e8ec-6c1c-47fe-880b-e2cae5fa65de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1217 microversion: 2.1 time: 0.155323 May 28 05:23:43.101701 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3419/6725] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:42 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:44.120298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4f3edc5b-0553-4fad-9ee9-2b88f67ab824 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:44.120744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4f3edc5b-0553-4fad-9ee9-2b88f67ab824 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:44.127516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4f3edc5b-0553-4fad-9ee9-2b88f67ab824 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:44.127978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4f3edc5b-0553-4fad-9ee9-2b88f67ab824 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:44.128765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4f3edc5b-0553-4fad-9ee9-2b88f67ab824 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:44.129210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4f3edc5b-0553-4fad-9ee9-2b88f67ab824 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:44.257477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4f3edc5b-0553-4fad-9ee9-2b88f67ab824 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:44.265035 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4f3edc5b-0553-4fad-9ee9-2b88f67ab824 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1403 microversion: 2.1 time: 0.151049 May 28 05:23:44.265611 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3307/6726] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:44 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1403 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:44.281249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-22d7a7f0-8a9b-4dee-83df-e22eefb42cf9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:44.281871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-22d7a7f0-8a9b-4dee-83df-e22eefb42cf9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:44.289023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22d7a7f0-8a9b-4dee-83df-e22eefb42cf9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:44.289480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22d7a7f0-8a9b-4dee-83df-e22eefb42cf9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:44.290251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22d7a7f0-8a9b-4dee-83df-e22eefb42cf9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:44.290695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22d7a7f0-8a9b-4dee-83df-e22eefb42cf9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:44.422045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-22d7a7f0-8a9b-4dee-83df-e22eefb42cf9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:44.429686 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-22d7a7f0-8a9b-4dee-83df-e22eefb42cf9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1403 microversion: 2.1 time: 0.152267 May 28 05:23:44.430264 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3420/6727] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:44 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1403 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:44.446015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-23eea380-375a-44ae-a2e5-54bdcfbc9b52 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-939151040"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:23:44.447083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-23eea380-375a-44ae-a2e5-54bdcfbc9b52 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:44.453174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23eea380-375a-44ae-a2e5-54bdcfbc9b52 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:44.453633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23eea380-375a-44ae-a2e5-54bdcfbc9b52 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:44.454413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23eea380-375a-44ae-a2e5-54bdcfbc9b52 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:44.454861 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23eea380-375a-44ae-a2e5-54bdcfbc9b52 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:44.550236 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.compute.api [None req-23eea380-375a-44ae-a2e5-54bdcfbc9b52 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Attempting to quiesce instance before volume snapshot. May 28 05:23:44.609672 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.compute.api [None req-23eea380-375a-44ae-a2e5-54bdcfbc9b52 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Skipping quiescing instance because the operation is not supported by the underlying compute driver. May 28 05:23:44.824440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-23eea380-375a-44ae-a2e5-54bdcfbc9b52 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Creating snapshot from volume 72be5618-e8c9-4099-a3ec-8735d997878e. {{(pid=126043) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} May 28 05:23:45.963248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-784c65ac-cfea-4f1e-8d98-bd3e4cc550e6 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:23:45.964175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-784c65ac-cfea-4f1e-8d98-bd3e4cc550e6 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:45.972942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-784c65ac-cfea-4f1e-8d98-bd3e4cc550e6 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:45.972942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-784c65ac-cfea-4f1e-8d98-bd3e4cc550e6 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:45.973546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-784c65ac-cfea-4f1e-8d98-bd3e4cc550e6 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:45.973999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-784c65ac-cfea-4f1e-8d98-bd3e4cc550e6 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:46.027376 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-784c65ac-cfea-4f1e-8d98-bd3e4cc550e6 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "POST /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2/action" status: 200 len: 24577 microversion: 2.1 time: 0.067364 May 28 05:23:46.028077 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3421/6728] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:23:45 2022] POST /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2/action => generated 24577 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 05:23:46.563981 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-23eea380-375a-44ae-a2e5-54bdcfbc9b52 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "POST /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c/action" status: 202 len: 0 microversion: 2.1 time: 2.121698 May 28 05:23:46.569467 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3308/6729] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:23:44 2022] POST /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c/action => generated 0 bytes in 2123 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 05:23:48.753646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-77eb2e8d-2721-4865-9fcd-dfe72ec64af5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-766062794", "imageRef": "fae258d2-c8ae-476d-940e-d2285cf9c232", "flavorRef": "452", "networks": [{"uuid": "f8631f0f-218a-4dd3-ad6e-75d0627c5194"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:23:48.809441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-77eb2e8d-2721-4865-9fcd-dfe72ec64af5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] validate_networks() for [('f8631f0f-218a-4dd3-ad6e-75d0627c5194', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:23:49.221533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-77eb2e8d-2721-4865-9fcd-dfe72ec64af5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:23:49.221962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-77eb2e8d-2721-4865-9fcd-dfe72ec64af5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:23:49.222832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-77eb2e8d-2721-4865-9fcd-dfe72ec64af5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:23:49.223283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-77eb2e8d-2721-4865-9fcd-dfe72ec64af5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:23:49.223881 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-77eb2e8d-2721-4865-9fcd-dfe72ec64af5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:23:49.233625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77eb2e8d-2721-4865-9fcd-dfe72ec64af5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:49.234336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77eb2e8d-2721-4865-9fcd-dfe72ec64af5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:49.235172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77eb2e8d-2721-4865-9fcd-dfe72ec64af5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:49.235613 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77eb2e8d-2721-4865-9fcd-dfe72ec64af5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:49.254077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-77eb2e8d-2721-4865-9fcd-dfe72ec64af5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Getting quotas for project e45163cf20a447a0a60bc0c0f075fa78. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:23:49.259740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-77eb2e8d-2721-4865-9fcd-dfe72ec64af5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Getting quotas for user a33708c760574b0698fc16ddfebad05b and project e45163cf20a447a0a60bc0c0f075fa78. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:23:49.273920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-77eb2e8d-2721-4865-9fcd-dfe72ec64af5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:23:49.276605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-77eb2e8d-2721-4865-9fcd-dfe72ec64af5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='5ce54419-6e9d-47b8-9f83-45060a4657f5',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:23:49.436109 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-77eb2e8d-2721-4865-9fcd-dfe72ec64af5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686423 May 28 05:23:49.437587 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3422/6730] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:23:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:23:49.449904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9c47fcd5-8e9b-4018-849c-96650dbc44bd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:49.451377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9c47fcd5-8e9b-4018-849c-96650dbc44bd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:49.523542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9c47fcd5-8e9b-4018-849c-96650dbc44bd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:49.531316 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9c47fcd5-8e9b-4018-849c-96650dbc44bd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1229 microversion: 2.1 time: 0.088089 May 28 05:23:49.532531 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3309/6731] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:49 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1229 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:23:50.549219 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-19f46578-f1dd-4330-887b-435bbfbfa2d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:50.549852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-19f46578-f1dd-4330-887b-435bbfbfa2d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:50.557381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19f46578-f1dd-4330-887b-435bbfbfa2d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:50.557843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19f46578-f1dd-4330-887b-435bbfbfa2d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:50.558619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19f46578-f1dd-4330-887b-435bbfbfa2d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:50.559087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19f46578-f1dd-4330-887b-435bbfbfa2d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:50.627054 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-19f46578-f1dd-4330-887b-435bbfbfa2d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:50.635015 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-19f46578-f1dd-4330-887b-435bbfbfa2d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1233 microversion: 2.1 time: 0.090705 May 28 05:23:50.635602 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3423/6732] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:50 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1233 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:51.656253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-522cb9df-49c0-44cd-8ff3-b601ac8f1011 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:51.658095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-522cb9df-49c0-44cd-8ff3-b601ac8f1011 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:51.667300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-522cb9df-49c0-44cd-8ff3-b601ac8f1011 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:51.670313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-522cb9df-49c0-44cd-8ff3-b601ac8f1011 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:51.670313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-522cb9df-49c0-44cd-8ff3-b601ac8f1011 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:51.670313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-522cb9df-49c0-44cd-8ff3-b601ac8f1011 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:51.756606 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-522cb9df-49c0-44cd-8ff3-b601ac8f1011 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:51.765448 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-522cb9df-49c0-44cd-8ff3-b601ac8f1011 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1299 microversion: 2.1 time: 0.116365 May 28 05:23:51.766115 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3310/6733] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:51 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:52.784348 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ff15774d-0d2a-4173-9a99-7eb8c7b1c32d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:52.785838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ff15774d-0d2a-4173-9a99-7eb8c7b1c32d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:52.800254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff15774d-0d2a-4173-9a99-7eb8c7b1c32d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:52.800825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff15774d-0d2a-4173-9a99-7eb8c7b1c32d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:52.803496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff15774d-0d2a-4173-9a99-7eb8c7b1c32d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:52.804161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff15774d-0d2a-4173-9a99-7eb8c7b1c32d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:53.040247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ff15774d-0d2a-4173-9a99-7eb8c7b1c32d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:53.054963 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ff15774d-0d2a-4173-9a99-7eb8c7b1c32d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.274498 May 28 05:23:53.056133 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3424/6734] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:52 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:53.579868 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-190ada84-06fe-46e2-99ea-a6c83bddb70b req-8172ba49-95cf-489a-bd1f-a03a412bc022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f9da76-6315-495f-a8e5-0bfa20d2e6cf", "tag": "53999afb-7435-4948-86fa-40c0d3cef2ca"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:23:53.594047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-190ada84-06fe-46e2-99ea-a6c83bddb70b req-8172ba49-95cf-489a-bd1f-a03a412bc022 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:53.595415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-190ada84-06fe-46e2-99ea-a6c83bddb70b req-8172ba49-95cf-489a-bd1f-a03a412bc022 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:53.615440 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-190ada84-06fe-46e2-99ea-a6c83bddb70b req-8172ba49-95cf-489a-bd1f-a03a412bc022 service nova] Creating event network-changed:53999afb-7435-4948-86fa-40c0d3cef2ca for instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf on n-h1-843700-1 May 28 05:23:53.625722 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-190ada84-06fe-46e2-99ea-a6c83bddb70b req-8172ba49-95cf-489a-bd1f-a03a412bc022 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050691 May 28 05:23:53.626970 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3311/6735] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:23:54.072481 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b1f2d7ed-e742-4113-8b96-cd17ca529b88 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:54.074060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b1f2d7ed-e742-4113-8b96-cd17ca529b88 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:54.081653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1f2d7ed-e742-4113-8b96-cd17ca529b88 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:54.082120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1f2d7ed-e742-4113-8b96-cd17ca529b88 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:54.082921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1f2d7ed-e742-4113-8b96-cd17ca529b88 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:54.083674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b1f2d7ed-e742-4113-8b96-cd17ca529b88 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:54.247928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b1f2d7ed-e742-4113-8b96-cd17ca529b88 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:54.256688 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b1f2d7ed-e742-4113-8b96-cd17ca529b88 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.188104 May 28 05:23:54.257791 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3425/6736] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:54 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:55.275174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-893c09e2-0b07-43ab-8247-5546d32b7e72 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:55.276126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-893c09e2-0b07-43ab-8247-5546d32b7e72 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:55.284892 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-893c09e2-0b07-43ab-8247-5546d32b7e72 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:55.285372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-893c09e2-0b07-43ab-8247-5546d32b7e72 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:55.286293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-893c09e2-0b07-43ab-8247-5546d32b7e72 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:55.286765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-893c09e2-0b07-43ab-8247-5546d32b7e72 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:55.430678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-893c09e2-0b07-43ab-8247-5546d32b7e72 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:55.439256 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-893c09e2-0b07-43ab-8247-5546d32b7e72 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.168477 May 28 05:23:55.439846 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3312/6737] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:55 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:56.456252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-91490b93-bee9-4fb7-98ae-f1ec8d5e174f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:56.456911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-91490b93-bee9-4fb7-98ae-f1ec8d5e174f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:56.464692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-91490b93-bee9-4fb7-98ae-f1ec8d5e174f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:56.465157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-91490b93-bee9-4fb7-98ae-f1ec8d5e174f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:56.465943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-91490b93-bee9-4fb7-98ae-f1ec8d5e174f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:56.466462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-91490b93-bee9-4fb7-98ae-f1ec8d5e174f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:56.623822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-91490b93-bee9-4fb7-98ae-f1ec8d5e174f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:56.631705 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-91490b93-bee9-4fb7-98ae-f1ec8d5e174f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.179413 May 28 05:23:56.632365 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3426/6738] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:56 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:57.649807 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1cf15c64-1b37-4250-987d-6dfd3a9efc85 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:57.650443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1cf15c64-1b37-4250-987d-6dfd3a9efc85 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:57.658417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cf15c64-1b37-4250-987d-6dfd3a9efc85 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:57.660606 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cf15c64-1b37-4250-987d-6dfd3a9efc85 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:57.660606 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cf15c64-1b37-4250-987d-6dfd3a9efc85 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:57.660606 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cf15c64-1b37-4250-987d-6dfd3a9efc85 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:57.793428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1cf15c64-1b37-4250-987d-6dfd3a9efc85 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:57.801767 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1cf15c64-1b37-4250-987d-6dfd3a9efc85 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.155928 May 28 05:23:57.802414 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3313/6739] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:57 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:58.818852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-42e8dd5b-5972-438e-b0e8-d41497e4fd4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:58.819503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-42e8dd5b-5972-438e-b0e8-d41497e4fd4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:23:58.826480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42e8dd5b-5972-438e-b0e8-d41497e4fd4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:58.826941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42e8dd5b-5972-438e-b0e8-d41497e4fd4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:58.827755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42e8dd5b-5972-438e-b0e8-d41497e4fd4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:23:58.828243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42e8dd5b-5972-438e-b0e8-d41497e4fd4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:23:58.970664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-42e8dd5b-5972-438e-b0e8-d41497e4fd4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:23:58.978534 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-42e8dd5b-5972-438e-b0e8-d41497e4fd4e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.163773 May 28 05:23:58.979203 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3427/6740] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:58 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:23:59.997788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6d0f021f-0d7c-449a-98bd-61b9bf844ca1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:23:59.998342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6d0f021f-0d7c-449a-98bd-61b9bf844ca1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:00.001388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:24:00.006430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6d0f021f-0d7c-449a-98bd-61b9bf844ca1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:00.006902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6d0f021f-0d7c-449a-98bd-61b9bf844ca1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:00.007721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6d0f021f-0d7c-449a-98bd-61b9bf844ca1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:00.008181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6d0f021f-0d7c-449a-98bd-61b9bf844ca1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:00.223454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6d0f021f-0d7c-449a-98bd-61b9bf844ca1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:00.231841 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6d0f021f-0d7c-449a-98bd-61b9bf844ca1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.238443 May 28 05:24:00.232443 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3314/6741] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:23:59 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:01.250450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-02ba6480-28b8-45c2-8ef3-d276064b8805 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:01.251210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-02ba6480-28b8-45c2-8ef3-d276064b8805 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:01.254942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:24:01.255870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:24:01.260977 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02ba6480-28b8-45c2-8ef3-d276064b8805 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:01.261434 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02ba6480-28b8-45c2-8ef3-d276064b8805 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:01.262725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02ba6480-28b8-45c2-8ef3-d276064b8805 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:01.263344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02ba6480-28b8-45c2-8ef3-d276064b8805 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:01.432945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-02ba6480-28b8-45c2-8ef3-d276064b8805 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:01.441718 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-02ba6480-28b8-45c2-8ef3-d276064b8805 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.195777 May 28 05:24:01.442299 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3428/6742] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:01 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:01.944591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-20a0f14d-48cd-46b4-9158-ebd6801621eb tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Action: 'create', calling method: .version_select at 0x7f77002113a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1645051389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn7hjv4y3mfeRtn06HntUUfFHZIDvqzjQfAV5srvUuyutjvXA2UCcXyqdd10WPk0zpea+ch6yGfxBkD+3bOpVHaqFitohlOFdbESgAASFvAN1TYy339lJMB3d0eFLEhnw=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:24:01.961874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-20a0f14d-48cd-46b4-9158-ebd6801621eb tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Getting quotas for project c609cfd8212b4ae4aeee1213a373e579. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:24:01.967562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-20a0f14d-48cd-46b4-9158-ebd6801621eb tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Getting quotas for user 6dd6c7cc6c46484ca5964c4ed1affafb and project c609cfd8212b4ae4aeee1213a373e579. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:24:02.072951 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-20a0f14d-48cd-46b4-9158-ebd6801621eb tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.132331 May 28 05:24:02.078778 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3315/6743] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 05:24:01 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:24:02.465349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-29b768c7-bb4d-42d2-b7eb-2fb6d0ee9f96 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:02.466642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-29b768c7-bb4d-42d2-b7eb-2fb6d0ee9f96 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:02.475649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-29b768c7-bb4d-42d2-b7eb-2fb6d0ee9f96 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:02.476120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-29b768c7-bb4d-42d2-b7eb-2fb6d0ee9f96 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:02.477106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-29b768c7-bb4d-42d2-b7eb-2fb6d0ee9f96 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:02.478493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-29b768c7-bb4d-42d2-b7eb-2fb6d0ee9f96 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:02.633167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-29b768c7-bb4d-42d2-b7eb-2fb6d0ee9f96 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:02.641495 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-29b768c7-bb4d-42d2-b7eb-2fb6d0ee9f96 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.185550 May 28 05:24:02.652445 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3429/6744] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:02 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:03.662387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-82763fcb-1f9a-4367-8927-051a820f350b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:03.664082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-82763fcb-1f9a-4367-8927-051a820f350b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:03.675618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-82763fcb-1f9a-4367-8927-051a820f350b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:03.676104 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-82763fcb-1f9a-4367-8927-051a820f350b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:03.676929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-82763fcb-1f9a-4367-8927-051a820f350b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:03.677393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-82763fcb-1f9a-4367-8927-051a820f350b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:03.877033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-82763fcb-1f9a-4367-8927-051a820f350b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:03.892827 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-82763fcb-1f9a-4367-8927-051a820f350b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.235762 May 28 05:24:03.894053 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3316/6745] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:03 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:04.910479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5cbc7899-d5b6-41d7-8f56-1ee4d6c1e8e1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:04.911133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5cbc7899-d5b6-41d7-8f56-1ee4d6c1e8e1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:04.918138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5cbc7899-d5b6-41d7-8f56-1ee4d6c1e8e1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:04.918605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5cbc7899-d5b6-41d7-8f56-1ee4d6c1e8e1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:04.919539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5cbc7899-d5b6-41d7-8f56-1ee4d6c1e8e1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:04.919979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5cbc7899-d5b6-41d7-8f56-1ee4d6c1e8e1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:05.069617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5cbc7899-d5b6-41d7-8f56-1ee4d6c1e8e1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:05.079871 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5cbc7899-d5b6-41d7-8f56-1ee4d6c1e8e1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.173432 May 28 05:24:05.080583 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3430/6746] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:04 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:06.064299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f2b80674-61f0-457c-a405-cce0e68ef970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-36922620", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "2ba8bc47-6357-4ac7-b937-b74e79c4152b"}], "key_name": "tempest-TestNetworkBasicOps-1645051389", "security_groups": [{"name": "tempest-secgroup-smoke-1164816406"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:24:06.098006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cb0501f6-942f-4c3b-9a58-41e9332bfeb4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:06.098700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cb0501f6-942f-4c3b-9a58-41e9332bfeb4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:06.108508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb0501f6-942f-4c3b-9a58-41e9332bfeb4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:06.108960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb0501f6-942f-4c3b-9a58-41e9332bfeb4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:06.110108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb0501f6-942f-4c3b-9a58-41e9332bfeb4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:06.110582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb0501f6-942f-4c3b-9a58-41e9332bfeb4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:06.297208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-f2b80674-61f0-457c-a405-cce0e68ef970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] validate_networks() for [('2ba8bc47-6357-4ac7-b937-b74e79c4152b', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:24:06.360671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cb0501f6-942f-4c3b-9a58-41e9332bfeb4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:06.368810 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cb0501f6-942f-4c3b-9a58-41e9332bfeb4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.274845 May 28 05:24:06.371083 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3431/6747] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:06 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:24:06.718160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f2b80674-61f0-457c-a405-cce0e68ef970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:24:06.718611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f2b80674-61f0-457c-a405-cce0e68ef970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:24:06.719139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f2b80674-61f0-457c-a405-cce0e68ef970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:24:06.719676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f2b80674-61f0-457c-a405-cce0e68ef970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:24:06.720153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-f2b80674-61f0-457c-a405-cce0e68ef970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:24:06.729135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2b80674-61f0-457c-a405-cce0e68ef970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:06.729603 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2b80674-61f0-457c-a405-cce0e68ef970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:06.730593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2b80674-61f0-457c-a405-cce0e68ef970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:06.731073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2b80674-61f0-457c-a405-cce0e68ef970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:06.749708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-f2b80674-61f0-457c-a405-cce0e68ef970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Getting quotas for project c609cfd8212b4ae4aeee1213a373e579. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:24:06.755246 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-f2b80674-61f0-457c-a405-cce0e68ef970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Getting quotas for user 6dd6c7cc6c46484ca5964c4ed1affafb and project c609cfd8212b4ae4aeee1213a373e579. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:24:06.768230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f2b80674-61f0-457c-a405-cce0e68ef970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:24:06.770797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f2b80674-61f0-457c-a405-cce0e68ef970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 7406931e-2ff5-4337-922d-1ea46ee53651] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:24:06.902348 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f2b80674-61f0-457c-a405-cce0e68ef970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.842618 May 28 05:24:06.903534 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3317/6748] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:24:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:24:06.913753 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-413f830b-c6a4-439c-bfd4-cda7d21d8e09 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:06.918970 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-413f830b-c6a4-439c-bfd4-cda7d21d8e09 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 7406931e-2ff5-4337-922d-1ea46ee53651] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:06.975078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-413f830b-c6a4-439c-bfd4-cda7d21d8e09 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:06.982891 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-413f830b-c6a4-439c-bfd4-cda7d21d8e09 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651" status: 200 len: 1247 microversion: 2.1 time: 0.073161 May 28 05:24:06.983717 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3432/6749] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:06 2022] GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651 => generated 1247 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:07.394834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5625b2fd-ecbe-42b3-a79c-bf36e8d693c0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:07.395567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5625b2fd-ecbe-42b3-a79c-bf36e8d693c0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:07.402909 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5625b2fd-ecbe-42b3-a79c-bf36e8d693c0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:07.404060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5625b2fd-ecbe-42b3-a79c-bf36e8d693c0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:07.404920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5625b2fd-ecbe-42b3-a79c-bf36e8d693c0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:07.405405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5625b2fd-ecbe-42b3-a79c-bf36e8d693c0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:07.557774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5625b2fd-ecbe-42b3-a79c-bf36e8d693c0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:07.566356 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5625b2fd-ecbe-42b3-a79c-bf36e8d693c0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.176249 May 28 05:24:07.566972 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3318/6750] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:07 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:08.002143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-417c7970-8070-475f-8e0b-31a4970b832b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:08.003472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-417c7970-8070-475f-8e0b-31a4970b832b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 7406931e-2ff5-4337-922d-1ea46ee53651] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:08.011342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-417c7970-8070-475f-8e0b-31a4970b832b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:08.013951 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-417c7970-8070-475f-8e0b-31a4970b832b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:08.014906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-417c7970-8070-475f-8e0b-31a4970b832b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:08.015609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-417c7970-8070-475f-8e0b-31a4970b832b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:08.084794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-417c7970-8070-475f-8e0b-31a4970b832b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:08.093192 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-417c7970-8070-475f-8e0b-31a4970b832b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651" status: 200 len: 1251 microversion: 2.1 time: 0.096632 May 28 05:24:08.093787 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3433/6751] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:07 2022] GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651 => generated 1251 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:08.583136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8b2eec07-e0b1-43be-98a9-abbc39b9734e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:08.583857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8b2eec07-e0b1-43be-98a9-abbc39b9734e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:08.591969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b2eec07-e0b1-43be-98a9-abbc39b9734e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:08.592442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b2eec07-e0b1-43be-98a9-abbc39b9734e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:08.593233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b2eec07-e0b1-43be-98a9-abbc39b9734e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:08.593722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b2eec07-e0b1-43be-98a9-abbc39b9734e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:08.742526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8b2eec07-e0b1-43be-98a9-abbc39b9734e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:08.750156 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8b2eec07-e0b1-43be-98a9-abbc39b9734e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.171147 May 28 05:24:08.750740 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3319/6752] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:08 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:09.109936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8a677397-a7c2-4b55-8efb-eff587efb6ef tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:09.110562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8a677397-a7c2-4b55-8efb-eff587efb6ef tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 7406931e-2ff5-4337-922d-1ea46ee53651] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:09.124442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a677397-a7c2-4b55-8efb-eff587efb6ef tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:09.132411 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a677397-a7c2-4b55-8efb-eff587efb6ef tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:09.132411 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a677397-a7c2-4b55-8efb-eff587efb6ef tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:09.132411 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a677397-a7c2-4b55-8efb-eff587efb6ef tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:09.236287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8a677397-a7c2-4b55-8efb-eff587efb6ef tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:09.256057 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8a677397-a7c2-4b55-8efb-eff587efb6ef tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651" status: 200 len: 1307 microversion: 2.1 time: 0.149904 May 28 05:24:09.260497 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3434/6753] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:09 2022] GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651 => generated 1307 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:09.768301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-da03de77-df2b-4aa6-b66a-a3fc728b593e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:09.769016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-da03de77-df2b-4aa6-b66a-a3fc728b593e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:09.775363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-da03de77-df2b-4aa6-b66a-a3fc728b593e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:09.775921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-da03de77-df2b-4aa6-b66a-a3fc728b593e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:09.776729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-da03de77-df2b-4aa6-b66a-a3fc728b593e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:09.777182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-da03de77-df2b-4aa6-b66a-a3fc728b593e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:10.019041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-da03de77-df2b-4aa6-b66a-a3fc728b593e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:10.033862 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-da03de77-df2b-4aa6-b66a-a3fc728b593e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.270198 May 28 05:24:10.035503 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3320/6754] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:09 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:10.273330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7927167e-9743-4dc1-bc0a-37a6899d3493 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:10.273949 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7927167e-9743-4dc1-bc0a-37a6899d3493 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 7406931e-2ff5-4337-922d-1ea46ee53651] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:10.276893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:24:10.288286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7927167e-9743-4dc1-bc0a-37a6899d3493 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:10.293674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7927167e-9743-4dc1-bc0a-37a6899d3493 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:10.293674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7927167e-9743-4dc1-bc0a-37a6899d3493 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:10.293674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7927167e-9743-4dc1-bc0a-37a6899d3493 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:10.304626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=96 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:24:10.535664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7927167e-9743-4dc1-bc0a-37a6899d3493 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:10.544549 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7927167e-9743-4dc1-bc0a-37a6899d3493 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651" status: 200 len: 1373 microversion: 2.1 time: 0.274462 May 28 05:24:10.554469 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3435/6755] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:10 2022] GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651 => generated 1373 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:11.051242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dec4b3b5-0e49-47c2-ac35-409897f401d1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:11.053923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dec4b3b5-0e49-47c2-ac35-409897f401d1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:11.059345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:24:11.061723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dec4b3b5-0e49-47c2-ac35-409897f401d1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:11.062383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dec4b3b5-0e49-47c2-ac35-409897f401d1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:11.063473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dec4b3b5-0e49-47c2-ac35-409897f401d1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:11.064148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dec4b3b5-0e49-47c2-ac35-409897f401d1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:11.067456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:24:11.223931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dec4b3b5-0e49-47c2-ac35-409897f401d1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:11.231735 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dec4b3b5-0e49-47c2-ac35-409897f401d1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.184404 May 28 05:24:11.232341 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3321/6756] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:11 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:11.562699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c6f5dce1-5c7e-4990-a4ee-daf054dec793 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:11.563344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c6f5dce1-5c7e-4990-a4ee-daf054dec793 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 7406931e-2ff5-4337-922d-1ea46ee53651] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:11.571757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c6f5dce1-5c7e-4990-a4ee-daf054dec793 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:11.572539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c6f5dce1-5c7e-4990-a4ee-daf054dec793 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:11.573549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c6f5dce1-5c7e-4990-a4ee-daf054dec793 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:11.574212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c6f5dce1-5c7e-4990-a4ee-daf054dec793 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:11.728251 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-8fba84cc-af6a-4b7c-89b6-fdfcd328087c req-114f3b93-4f58-4128-9d6e-224b2de87b34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7406931e-2ff5-4337-922d-1ea46ee53651", "tag": "4ec6a71d-12d2-450b-82e5-79ec323dc46e"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:24:11.768186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8fba84cc-af6a-4b7c-89b6-fdfcd328087c req-114f3b93-4f58-4128-9d6e-224b2de87b34 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:11.770209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-8fba84cc-af6a-4b7c-89b6-fdfcd328087c req-114f3b93-4f58-4128-9d6e-224b2de87b34 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:11.812088 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-8fba84cc-af6a-4b7c-89b6-fdfcd328087c req-114f3b93-4f58-4128-9d6e-224b2de87b34 service nova] Creating event network-changed:4ec6a71d-12d2-450b-82e5-79ec323dc46e for instance 7406931e-2ff5-4337-922d-1ea46ee53651 on n-h2-843700-1 May 28 05:24:11.819554 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-8fba84cc-af6a-4b7c-89b6-fdfcd328087c req-114f3b93-4f58-4128-9d6e-224b2de87b34 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100726 May 28 05:24:11.830462 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3322/6757] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:24:11.857806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c6f5dce1-5c7e-4990-a4ee-daf054dec793 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:11.875285 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c6f5dce1-5c7e-4990-a4ee-daf054dec793 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651" status: 200 len: 1373 microversion: 2.1 time: 0.314819 May 28 05:24:11.875936 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3436/6758] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:11 2022] GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651 => generated 1373 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:12.251646 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-20ad08a3-3802-42e7-8aec-328f65fd83f6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:12.252421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-20ad08a3-3802-42e7-8aec-328f65fd83f6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:12.259586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20ad08a3-3802-42e7-8aec-328f65fd83f6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:12.262955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20ad08a3-3802-42e7-8aec-328f65fd83f6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:12.262955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20ad08a3-3802-42e7-8aec-328f65fd83f6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:12.262955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20ad08a3-3802-42e7-8aec-328f65fd83f6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:12.410348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-20ad08a3-3802-42e7-8aec-328f65fd83f6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:12.418461 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-20ad08a3-3802-42e7-8aec-328f65fd83f6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.173261 May 28 05:24:12.419651 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3323/6759] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:12 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:24:12.893426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e74c4bd2-8144-4f94-84f0-688c1bf9351c tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:12.894046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e74c4bd2-8144-4f94-84f0-688c1bf9351c tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 7406931e-2ff5-4337-922d-1ea46ee53651] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:12.901296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e74c4bd2-8144-4f94-84f0-688c1bf9351c tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:12.903800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e74c4bd2-8144-4f94-84f0-688c1bf9351c tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:12.903800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e74c4bd2-8144-4f94-84f0-688c1bf9351c tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:12.903800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e74c4bd2-8144-4f94-84f0-688c1bf9351c tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:13.064922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e74c4bd2-8144-4f94-84f0-688c1bf9351c tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:13.073636 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e74c4bd2-8144-4f94-84f0-688c1bf9351c tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651" status: 200 len: 1373 microversion: 2.1 time: 0.184216 May 28 05:24:13.074221 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3437/6760] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:12 2022] GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651 => generated 1373 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:24:13.437325 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2c99d365-42c3-46fc-8d91-d5e099fb49d1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:13.437956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2c99d365-42c3-46fc-8d91-d5e099fb49d1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:13.445140 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c99d365-42c3-46fc-8d91-d5e099fb49d1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:13.445622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c99d365-42c3-46fc-8d91-d5e099fb49d1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:13.446412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c99d365-42c3-46fc-8d91-d5e099fb49d1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:13.447135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2c99d365-42c3-46fc-8d91-d5e099fb49d1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:13.677979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2c99d365-42c3-46fc-8d91-d5e099fb49d1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:13.689393 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2c99d365-42c3-46fc-8d91-d5e099fb49d1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.256633 May 28 05:24:13.690207 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3324/6761] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:13 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:14.093093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-28d8515d-4821-4ac8-aed8-375735f25ff3 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:14.093727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-28d8515d-4821-4ac8-aed8-375735f25ff3 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 7406931e-2ff5-4337-922d-1ea46ee53651] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:14.108361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-28d8515d-4821-4ac8-aed8-375735f25ff3 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:14.108361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-28d8515d-4821-4ac8-aed8-375735f25ff3 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:14.108361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-28d8515d-4821-4ac8-aed8-375735f25ff3 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:14.108361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-28d8515d-4821-4ac8-aed8-375735f25ff3 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:14.258485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-28d8515d-4821-4ac8-aed8-375735f25ff3 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:14.267553 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-28d8515d-4821-4ac8-aed8-375735f25ff3 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651" status: 200 len: 1373 microversion: 2.1 time: 0.179204 May 28 05:24:14.268402 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3438/6762] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:14 2022] GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651 => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:24:14.705733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1d251d35-58e5-4b95-a590-ad9ed1d4bd84 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:14.707018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1d251d35-58e5-4b95-a590-ad9ed1d4bd84 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:14.714545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d251d35-58e5-4b95-a590-ad9ed1d4bd84 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:14.715056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d251d35-58e5-4b95-a590-ad9ed1d4bd84 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:14.715868 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d251d35-58e5-4b95-a590-ad9ed1d4bd84 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:14.716331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1d251d35-58e5-4b95-a590-ad9ed1d4bd84 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:14.866192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1d251d35-58e5-4b95-a590-ad9ed1d4bd84 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:14.874396 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1d251d35-58e5-4b95-a590-ad9ed1d4bd84 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.172580 May 28 05:24:14.875010 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3325/6763] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:14 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:15.285582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3108d649-ff86-4330-ae66-356763b0467a tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:15.286233 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3108d649-ff86-4330-ae66-356763b0467a tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 7406931e-2ff5-4337-922d-1ea46ee53651] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:15.293315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3108d649-ff86-4330-ae66-356763b0467a tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:15.293804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3108d649-ff86-4330-ae66-356763b0467a tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:15.294611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3108d649-ff86-4330-ae66-356763b0467a tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:15.295085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3108d649-ff86-4330-ae66-356763b0467a tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:15.430570 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3108d649-ff86-4330-ae66-356763b0467a tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:15.438296 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3108d649-ff86-4330-ae66-356763b0467a tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651" status: 200 len: 1373 microversion: 2.1 time: 0.156859 May 28 05:24:15.439384 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3439/6764] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:15 2022] GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:15.896443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b2eda54c-b4c7-4a12-bad4-55d90ce17ffe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:15.897297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b2eda54c-b4c7-4a12-bad4-55d90ce17ffe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:15.905337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b2eda54c-b4c7-4a12-bad4-55d90ce17ffe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:15.905746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b2eda54c-b4c7-4a12-bad4-55d90ce17ffe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:15.906554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b2eda54c-b4c7-4a12-bad4-55d90ce17ffe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:15.907457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b2eda54c-b4c7-4a12-bad4-55d90ce17ffe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:16.049054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b2eda54c-b4c7-4a12-bad4-55d90ce17ffe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:16.060963 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b2eda54c-b4c7-4a12-bad4-55d90ce17ffe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.169464 May 28 05:24:16.062044 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3326/6765] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:15 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:16.401751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-49811f91-5466-40f1-a47e-bc2236ca0be8 req-e44ee4d6-30e0-49d4-a6fb-bb2c721b8feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7406931e-2ff5-4337-922d-1ea46ee53651", "name": "network-vif-plugged", "status": "completed", "tag": "4ec6a71d-12d2-450b-82e5-79ec323dc46e"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:24:16.412415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-49811f91-5466-40f1-a47e-bc2236ca0be8 req-e44ee4d6-30e0-49d4-a6fb-bb2c721b8feb service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:16.413168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-49811f91-5466-40f1-a47e-bc2236ca0be8 req-e44ee4d6-30e0-49d4-a6fb-bb2c721b8feb service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:16.425272 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-49811f91-5466-40f1-a47e-bc2236ca0be8 req-e44ee4d6-30e0-49d4-a6fb-bb2c721b8feb service nova] Creating event network-vif-plugged:4ec6a71d-12d2-450b-82e5-79ec323dc46e for instance 7406931e-2ff5-4337-922d-1ea46ee53651 on n-h2-843700-1 May 28 05:24:16.432061 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-49811f91-5466-40f1-a47e-bc2236ca0be8 req-e44ee4d6-30e0-49d4-a6fb-bb2c721b8feb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034375 May 28 05:24:16.432677 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3440/6766] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:24:16.455815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e598d783-ec9d-4c0d-9801-651573a9bb98 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:16.456596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e598d783-ec9d-4c0d-9801-651573a9bb98 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 7406931e-2ff5-4337-922d-1ea46ee53651] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:16.462916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e598d783-ec9d-4c0d-9801-651573a9bb98 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:16.463536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e598d783-ec9d-4c0d-9801-651573a9bb98 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:16.464429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e598d783-ec9d-4c0d-9801-651573a9bb98 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:16.465092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e598d783-ec9d-4c0d-9801-651573a9bb98 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:16.670116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e598d783-ec9d-4c0d-9801-651573a9bb98 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:16.678103 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e598d783-ec9d-4c0d-9801-651573a9bb98 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651" status: 200 len: 1373 microversion: 2.1 time: 0.226539 May 28 05:24:16.678687 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3327/6767] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:16 2022] GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651 => generated 1373 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:17.078462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b5c635b8-b682-4b2e-9739-7e42bbf335ac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:17.079141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b5c635b8-b682-4b2e-9739-7e42bbf335ac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:17.081274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:24:17.086691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b5c635b8-b682-4b2e-9739-7e42bbf335ac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:17.091210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b5c635b8-b682-4b2e-9739-7e42bbf335ac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:17.091210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b5c635b8-b682-4b2e-9739-7e42bbf335ac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:17.091210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b5c635b8-b682-4b2e-9739-7e42bbf335ac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:17.255327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b5c635b8-b682-4b2e-9739-7e42bbf335ac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:17.263398 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b5c635b8-b682-4b2e-9739-7e42bbf335ac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.189357 May 28 05:24:17.264064 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3441/6768] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:17 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:17.696378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-82cb8be4-e47c-49c2-b6b2-781d363cf2cd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:17.697862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-82cb8be4-e47c-49c2-b6b2-781d363cf2cd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 7406931e-2ff5-4337-922d-1ea46ee53651] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:17.700676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:24:17.701579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=10 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:24:17.708404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-82cb8be4-e47c-49c2-b6b2-781d363cf2cd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:17.708923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-82cb8be4-e47c-49c2-b6b2-781d363cf2cd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:17.709936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-82cb8be4-e47c-49c2-b6b2-781d363cf2cd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:17.710397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-82cb8be4-e47c-49c2-b6b2-781d363cf2cd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:17.872668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-82cb8be4-e47c-49c2-b6b2-781d363cf2cd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:17.880426 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-82cb8be4-e47c-49c2-b6b2-781d363cf2cd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651" status: 200 len: 1373 microversion: 2.1 time: 0.188743 May 28 05:24:17.881085 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3328/6769] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:17 2022] GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651 => generated 1373 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:18.279864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1aaad4d0-b806-47f4-88cc-9d4931922488 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:18.280418 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1aaad4d0-b806-47f4-88cc-9d4931922488 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:18.287770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1aaad4d0-b806-47f4-88cc-9d4931922488 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:18.288225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1aaad4d0-b806-47f4-88cc-9d4931922488 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:18.288993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1aaad4d0-b806-47f4-88cc-9d4931922488 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:18.289430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1aaad4d0-b806-47f4-88cc-9d4931922488 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:18.429312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1aaad4d0-b806-47f4-88cc-9d4931922488 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:18.437983 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1aaad4d0-b806-47f4-88cc-9d4931922488 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.162066 May 28 05:24:18.439138 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3442/6770] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:18 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:18.898670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-28d7fe28-7dac-49fd-8509-de2cb52d8ddb tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:18.899461 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-28d7fe28-7dac-49fd-8509-de2cb52d8ddb tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 7406931e-2ff5-4337-922d-1ea46ee53651] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:18.909461 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-28d7fe28-7dac-49fd-8509-de2cb52d8ddb tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:18.909937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-28d7fe28-7dac-49fd-8509-de2cb52d8ddb tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:18.910949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-28d7fe28-7dac-49fd-8509-de2cb52d8ddb tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:18.911588 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-28d7fe28-7dac-49fd-8509-de2cb52d8ddb tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:19.049088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-28d7fe28-7dac-49fd-8509-de2cb52d8ddb tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:19.057692 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-28d7fe28-7dac-49fd-8509-de2cb52d8ddb tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651" status: 200 len: 1546 microversion: 2.1 time: 0.164177 May 28 05:24:19.058267 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3329/6771] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:18 2022] GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651 => generated 1546 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:19.074370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c6c6b4fd-92a3-4899-80a1-1fb227073f8d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:19.075631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c6c6b4fd-92a3-4899-80a1-1fb227073f8d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 7406931e-2ff5-4337-922d-1ea46ee53651] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:19.081848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c6c6b4fd-92a3-4899-80a1-1fb227073f8d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:19.082305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c6c6b4fd-92a3-4899-80a1-1fb227073f8d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:19.083100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c6c6b4fd-92a3-4899-80a1-1fb227073f8d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:19.083540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c6c6b4fd-92a3-4899-80a1-1fb227073f8d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:19.221869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c6c6b4fd-92a3-4899-80a1-1fb227073f8d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:19.229929 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c6c6b4fd-92a3-4899-80a1-1fb227073f8d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651" status: 200 len: 1546 microversion: 2.1 time: 0.159442 May 28 05:24:19.230523 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3443/6772] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:19 2022] GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651 => generated 1546 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:19.455462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-668c866a-af19-4746-9d0a-1500ec594a27 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:19.456015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-668c866a-af19-4746-9d0a-1500ec594a27 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:19.462108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-668c866a-af19-4746-9d0a-1500ec594a27 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:19.462567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-668c866a-af19-4746-9d0a-1500ec594a27 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:19.463383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-668c866a-af19-4746-9d0a-1500ec594a27 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:19.463905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-668c866a-af19-4746-9d0a-1500ec594a27 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:19.603519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-668c866a-af19-4746-9d0a-1500ec594a27 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:19.611229 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-668c866a-af19-4746-9d0a-1500ec594a27 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.159661 May 28 05:24:19.611938 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3330/6773] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:19 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:20.628607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d56909b6-1085-4a11-87b8-e8bcc31c90f5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:20.629446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d56909b6-1085-4a11-87b8-e8bcc31c90f5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:20.636337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d56909b6-1085-4a11-87b8-e8bcc31c90f5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:20.636797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d56909b6-1085-4a11-87b8-e8bcc31c90f5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:20.638078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d56909b6-1085-4a11-87b8-e8bcc31c90f5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:20.638540 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d56909b6-1085-4a11-87b8-e8bcc31c90f5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:20.876066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d56909b6-1085-4a11-87b8-e8bcc31c90f5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:20.884868 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d56909b6-1085-4a11-87b8-e8bcc31c90f5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.260063 May 28 05:24:20.895024 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3444/6774] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:20 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:21.901786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-98cd37f0-d160-40bc-885f-f62dc4699743 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:21.903414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-98cd37f0-d160-40bc-885f-f62dc4699743 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:21.911165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98cd37f0-d160-40bc-885f-f62dc4699743 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:21.911655 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98cd37f0-d160-40bc-885f-f62dc4699743 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:21.912515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98cd37f0-d160-40bc-885f-f62dc4699743 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:21.913169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98cd37f0-d160-40bc-885f-f62dc4699743 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:22.087952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-98cd37f0-d160-40bc-885f-f62dc4699743 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:22.097178 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-98cd37f0-d160-40bc-885f-f62dc4699743 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.199235 May 28 05:24:22.098702 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3331/6775] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:21 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:23.118341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e247bb3f-eda7-493d-a912-62a2b0598bd7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:23.119012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e247bb3f-eda7-493d-a912-62a2b0598bd7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:23.129229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e247bb3f-eda7-493d-a912-62a2b0598bd7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:23.131301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e247bb3f-eda7-493d-a912-62a2b0598bd7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:23.133352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e247bb3f-eda7-493d-a912-62a2b0598bd7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:23.134091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e247bb3f-eda7-493d-a912-62a2b0598bd7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:23.353449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e247bb3f-eda7-493d-a912-62a2b0598bd7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:23.362164 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e247bb3f-eda7-493d-a912-62a2b0598bd7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.251372 May 28 05:24:23.366723 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3445/6776] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:23 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:24.382394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c0b0d2e3-1c62-4abe-95b2-9c59c1406508 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:24.385230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c0b0d2e3-1c62-4abe-95b2-9c59c1406508 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:24.393559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c0b0d2e3-1c62-4abe-95b2-9c59c1406508 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:24.394031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c0b0d2e3-1c62-4abe-95b2-9c59c1406508 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:24.394836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c0b0d2e3-1c62-4abe-95b2-9c59c1406508 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:24.395326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c0b0d2e3-1c62-4abe-95b2-9c59c1406508 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:24.572647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c0b0d2e3-1c62-4abe-95b2-9c59c1406508 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:24.581682 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c0b0d2e3-1c62-4abe-95b2-9c59c1406508 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.205163 May 28 05:24:24.583562 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3332/6777] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:24 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:25.598923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-204a348f-4398-42e1-9362-65a14b3eba6a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:25.599614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-204a348f-4398-42e1-9362-65a14b3eba6a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:25.608244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-204a348f-4398-42e1-9362-65a14b3eba6a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:25.609165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-204a348f-4398-42e1-9362-65a14b3eba6a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:25.609744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-204a348f-4398-42e1-9362-65a14b3eba6a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:25.610279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-204a348f-4398-42e1-9362-65a14b3eba6a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:25.755562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-204a348f-4398-42e1-9362-65a14b3eba6a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:25.767472 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-204a348f-4398-42e1-9362-65a14b3eba6a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.172061 May 28 05:24:25.776784 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3446/6778] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:25 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:26.784453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f25f5371-4719-4f2b-a5a2-928451eaf6b3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:26.785024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f25f5371-4719-4f2b-a5a2-928451eaf6b3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:26.792678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f25f5371-4719-4f2b-a5a2-928451eaf6b3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:26.793158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f25f5371-4719-4f2b-a5a2-928451eaf6b3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:26.793973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f25f5371-4719-4f2b-a5a2-928451eaf6b3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:26.794431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f25f5371-4719-4f2b-a5a2-928451eaf6b3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:26.947472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f25f5371-4719-4f2b-a5a2-928451eaf6b3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:26.956900 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f25f5371-4719-4f2b-a5a2-928451eaf6b3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.176745 May 28 05:24:26.957638 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3333/6779] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:26 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:24:27.973520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7b34666a-45af-40c1-bd3c-5d9f8d3f290a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:27.974209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7b34666a-45af-40c1-bd3c-5d9f8d3f290a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:27.983901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b34666a-45af-40c1-bd3c-5d9f8d3f290a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:27.984737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b34666a-45af-40c1-bd3c-5d9f8d3f290a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:27.985636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b34666a-45af-40c1-bd3c-5d9f8d3f290a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:27.986125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b34666a-45af-40c1-bd3c-5d9f8d3f290a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:28.143380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7b34666a-45af-40c1-bd3c-5d9f8d3f290a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:28.151076 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7b34666a-45af-40c1-bd3c-5d9f8d3f290a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.181452 May 28 05:24:28.151661 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3447/6780] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:27 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:29.170411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-293bfb59-2007-4059-b240-16ef17d9747d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:29.171286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-293bfb59-2007-4059-b240-16ef17d9747d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:29.177449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-293bfb59-2007-4059-b240-16ef17d9747d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:29.177922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-293bfb59-2007-4059-b240-16ef17d9747d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:29.178720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-293bfb59-2007-4059-b240-16ef17d9747d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:29.179218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-293bfb59-2007-4059-b240-16ef17d9747d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:29.321166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-293bfb59-2007-4059-b240-16ef17d9747d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:29.329462 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-293bfb59-2007-4059-b240-16ef17d9747d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.164390 May 28 05:24:29.330147 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3334/6781] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:29 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:30.347667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3f357945-8b25-41c1-b2de-128ea0a036d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:30.349033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3f357945-8b25-41c1-b2de-128ea0a036d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:30.357011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f357945-8b25-41c1-b2de-128ea0a036d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:30.357849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f357945-8b25-41c1-b2de-128ea0a036d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:30.358152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f357945-8b25-41c1-b2de-128ea0a036d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:30.358907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f357945-8b25-41c1-b2de-128ea0a036d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:30.499995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3f357945-8b25-41c1-b2de-128ea0a036d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:30.508063 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3f357945-8b25-41c1-b2de-128ea0a036d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.164450 May 28 05:24:30.508657 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3448/6782] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:30 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:31.568420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bf1732b8-4dcb-4c49-a190-e7144e3feb69 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:31.569913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bf1732b8-4dcb-4c49-a190-e7144e3feb69 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:31.579233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf1732b8-4dcb-4c49-a190-e7144e3feb69 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:31.579622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf1732b8-4dcb-4c49-a190-e7144e3feb69 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:31.580886 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf1732b8-4dcb-4c49-a190-e7144e3feb69 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:31.581663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf1732b8-4dcb-4c49-a190-e7144e3feb69 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:31.744233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bf1732b8-4dcb-4c49-a190-e7144e3feb69 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:31.751810 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bf1732b8-4dcb-4c49-a190-e7144e3feb69 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.187510 May 28 05:24:31.752388 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3335/6783] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:31 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:32.769514 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-32886f90-9e6a-423e-b9d5-ba7be36185a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:32.770035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-32886f90-9e6a-423e-b9d5-ba7be36185a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:32.777019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-32886f90-9e6a-423e-b9d5-ba7be36185a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:32.777473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-32886f90-9e6a-423e-b9d5-ba7be36185a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:32.778241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-32886f90-9e6a-423e-b9d5-ba7be36185a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:32.778681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-32886f90-9e6a-423e-b9d5-ba7be36185a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:32.917911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-32886f90-9e6a-423e-b9d5-ba7be36185a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:32.926274 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-32886f90-9e6a-423e-b9d5-ba7be36185a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.160608 May 28 05:24:32.926897 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3449/6784] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:32 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:33.943691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-907d8b2d-4ec0-43f0-8f4a-66c8f54890e2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:33.944344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-907d8b2d-4ec0-43f0-8f4a-66c8f54890e2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:33.952227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-907d8b2d-4ec0-43f0-8f4a-66c8f54890e2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:33.952701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-907d8b2d-4ec0-43f0-8f4a-66c8f54890e2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:33.953519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-907d8b2d-4ec0-43f0-8f4a-66c8f54890e2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:33.953976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-907d8b2d-4ec0-43f0-8f4a-66c8f54890e2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:34.089148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-907d8b2d-4ec0-43f0-8f4a-66c8f54890e2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:34.098089 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-907d8b2d-4ec0-43f0-8f4a-66c8f54890e2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.158255 May 28 05:24:34.098703 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3336/6785] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:33 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:35.116487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-787f15e4-ee77-44e3-b2dd-a271935fbbbc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:35.117211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-787f15e4-ee77-44e3-b2dd-a271935fbbbc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:35.124849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-787f15e4-ee77-44e3-b2dd-a271935fbbbc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:35.125313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-787f15e4-ee77-44e3-b2dd-a271935fbbbc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:35.126114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-787f15e4-ee77-44e3-b2dd-a271935fbbbc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:35.126552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-787f15e4-ee77-44e3-b2dd-a271935fbbbc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:35.265698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-787f15e4-ee77-44e3-b2dd-a271935fbbbc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:35.273459 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-787f15e4-ee77-44e3-b2dd-a271935fbbbc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.160968 May 28 05:24:35.274134 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3450/6786] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:35 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:36.290015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-00dd1f12-b797-47b3-b327-85158504449f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:36.290608 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-00dd1f12-b797-47b3-b327-85158504449f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:36.298626 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-00dd1f12-b797-47b3-b327-85158504449f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:36.299134 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-00dd1f12-b797-47b3-b327-85158504449f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:36.299945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-00dd1f12-b797-47b3-b327-85158504449f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:36.300406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-00dd1f12-b797-47b3-b327-85158504449f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:36.443276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-00dd1f12-b797-47b3-b327-85158504449f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:36.456534 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-00dd1f12-b797-47b3-b327-85158504449f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.170612 May 28 05:24:36.457934 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3337/6787] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:36 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:37.476006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-25a714c5-0fa2-474c-9104-d1e810a432b7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:37.481807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-25a714c5-0fa2-474c-9104-d1e810a432b7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:37.484593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25a714c5-0fa2-474c-9104-d1e810a432b7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:37.485430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25a714c5-0fa2-474c-9104-d1e810a432b7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:37.486442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25a714c5-0fa2-474c-9104-d1e810a432b7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:37.487144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25a714c5-0fa2-474c-9104-d1e810a432b7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:37.645286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-25a714c5-0fa2-474c-9104-d1e810a432b7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:37.653665 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-25a714c5-0fa2-474c-9104-d1e810a432b7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.182009 May 28 05:24:37.654842 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3451/6788] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:37 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:38.672206 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3c4e746c-fb65-4887-928f-399e3e8d4488 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:38.672840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3c4e746c-fb65-4887-928f-399e3e8d4488 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:38.680339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c4e746c-fb65-4887-928f-399e3e8d4488 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:38.681178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c4e746c-fb65-4887-928f-399e3e8d4488 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:38.682088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c4e746c-fb65-4887-928f-399e3e8d4488 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:38.682619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c4e746c-fb65-4887-928f-399e3e8d4488 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:38.698333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:24:38.826930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3c4e746c-fb65-4887-928f-399e3e8d4488 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:38.835004 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3c4e746c-fb65-4887-928f-399e3e8d4488 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.166909 May 28 05:24:38.837800 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3338/6789] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:38 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:39.852566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b4b76252-9eae-4f73-af80-e7ae031935d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:39.853220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b4b76252-9eae-4f73-af80-e7ae031935d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:39.860873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4b76252-9eae-4f73-af80-e7ae031935d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:39.861329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4b76252-9eae-4f73-af80-e7ae031935d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:39.862104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4b76252-9eae-4f73-af80-e7ae031935d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:39.862544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4b76252-9eae-4f73-af80-e7ae031935d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:39.878593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:24:40.008057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b4b76252-9eae-4f73-af80-e7ae031935d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:40.015929 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b4b76252-9eae-4f73-af80-e7ae031935d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.167934 May 28 05:24:40.016518 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3452/6790] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:39 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:24:41.034281 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-87a98743-58fe-42a1-b1b3-7b40aad7c625 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:41.034822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-87a98743-58fe-42a1-b1b3-7b40aad7c625 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:41.042299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87a98743-58fe-42a1-b1b3-7b40aad7c625 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:41.042768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87a98743-58fe-42a1-b1b3-7b40aad7c625 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:41.043581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87a98743-58fe-42a1-b1b3-7b40aad7c625 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:41.044040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87a98743-58fe-42a1-b1b3-7b40aad7c625 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:41.186310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-87a98743-58fe-42a1-b1b3-7b40aad7c625 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:41.194156 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-87a98743-58fe-42a1-b1b3-7b40aad7c625 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.164822 May 28 05:24:41.195041 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3339/6791] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:41 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:42.211633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7e0eff65-3bd6-4d9b-b963-25391c7ee298 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:42.212258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7e0eff65-3bd6-4d9b-b963-25391c7ee298 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:42.215247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=36 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:24:42.220294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e0eff65-3bd6-4d9b-b963-25391c7ee298 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:42.220819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e0eff65-3bd6-4d9b-b963-25391c7ee298 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:42.221605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e0eff65-3bd6-4d9b-b963-25391c7ee298 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:42.222057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e0eff65-3bd6-4d9b-b963-25391c7ee298 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:42.699587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7e0eff65-3bd6-4d9b-b963-25391c7ee298 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:42.707704 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7e0eff65-3bd6-4d9b-b963-25391c7ee298 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.499975 May 28 05:24:42.708592 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3453/6792] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:42 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:43.469718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-76aeda50-2c66-461c-b91e-0537b0aab8a9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:43.474618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-76aeda50-2c66-461c-b91e-0537b0aab8a9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 7406931e-2ff5-4337-922d-1ea46ee53651] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:43.476644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=38 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:24:43.478119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76aeda50-2c66-461c-b91e-0537b0aab8a9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:43.478588 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76aeda50-2c66-461c-b91e-0537b0aab8a9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:43.479515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76aeda50-2c66-461c-b91e-0537b0aab8a9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:43.479929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76aeda50-2c66-461c-b91e-0537b0aab8a9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:43.508199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-76aeda50-2c66-461c-b91e-0537b0aab8a9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 7406931e-2ff5-4337-922d-1ea46ee53651] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:24:43.725360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-49d304e1-3916-426f-8932-6fe06ec95de1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:43.725910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-49d304e1-3916-426f-8932-6fe06ec95de1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:43.733525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49d304e1-3916-426f-8932-6fe06ec95de1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:43.733987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49d304e1-3916-426f-8932-6fe06ec95de1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:43.734773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49d304e1-3916-426f-8932-6fe06ec95de1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:43.735245 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49d304e1-3916-426f-8932-6fe06ec95de1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:43.912214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-49d304e1-3916-426f-8932-6fe06ec95de1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:43.920963 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-49d304e1-3916-426f-8932-6fe06ec95de1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.199846 May 28 05:24:43.922093 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3454/6793] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:43 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:24:43.934061 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-76aeda50-2c66-461c-b91e-0537b0aab8a9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651" status: 204 len: 0 microversion: 2.1 time: 0.468044 May 28 05:24:43.935657 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3340/6794] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:24:43 2022] DELETE /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:24:43.952618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-06f59610-1844-4f71-834d-a97297447b26 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:43.953240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-06f59610-1844-4f71-834d-a97297447b26 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 7406931e-2ff5-4337-922d-1ea46ee53651] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:43.960194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-06f59610-1844-4f71-834d-a97297447b26 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:43.960653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-06f59610-1844-4f71-834d-a97297447b26 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:43.961654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-06f59610-1844-4f71-834d-a97297447b26 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:43.962459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-06f59610-1844-4f71-834d-a97297447b26 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:44.173105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-06f59610-1844-4f71-834d-a97297447b26 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:44.179974 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-06f59610-1844-4f71-834d-a97297447b26 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651" status: 200 len: 1552 microversion: 2.1 time: 0.231502 May 28 05:24:44.180745 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3455/6795] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:43 2022] GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651 => generated 1552 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:44.938525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cbc03235-9c7b-40c2-9de9-9485c072d263 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:44.939367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cbc03235-9c7b-40c2-9de9-9485c072d263 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:44.950846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cbc03235-9c7b-40c2-9de9-9485c072d263 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:44.950846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cbc03235-9c7b-40c2-9de9-9485c072d263 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:44.950846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cbc03235-9c7b-40c2-9de9-9485c072d263 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:44.950846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cbc03235-9c7b-40c2-9de9-9485c072d263 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:45.088830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cbc03235-9c7b-40c2-9de9-9485c072d263 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:45.097105 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cbc03235-9c7b-40c2-9de9-9485c072d263 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.162983 May 28 05:24:45.097902 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3341/6796] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:44 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:45.198519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b5d054a7-2a63-4137-806d-b25a101a5970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:45.199295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b5d054a7-2a63-4137-806d-b25a101a5970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 7406931e-2ff5-4337-922d-1ea46ee53651] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:45.207452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b5d054a7-2a63-4137-806d-b25a101a5970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:45.210504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b5d054a7-2a63-4137-806d-b25a101a5970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:45.210504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b5d054a7-2a63-4137-806d-b25a101a5970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:45.210504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b5d054a7-2a63-4137-806d-b25a101a5970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:45.410529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b5d054a7-2a63-4137-806d-b25a101a5970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:45.418982 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b5d054a7-2a63-4137-806d-b25a101a5970 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651" status: 200 len: 1552 microversion: 2.1 time: 0.224728 May 28 05:24:45.419730 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3456/6797] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:45 2022] GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651 => generated 1552 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:45.976608 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-3f1baedc-462e-44dc-a109-cdf48c175af4 req-202514aa-e77a-4513-9145-f49be1096aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7406931e-2ff5-4337-922d-1ea46ee53651", "name": "network-vif-deleted", "tag": "4ec6a71d-12d2-450b-82e5-79ec323dc46e"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:24:45.986352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3f1baedc-462e-44dc-a109-cdf48c175af4 req-202514aa-e77a-4513-9145-f49be1096aea service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:45.986819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3f1baedc-462e-44dc-a109-cdf48c175af4 req-202514aa-e77a-4513-9145-f49be1096aea service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:45.998813 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-3f1baedc-462e-44dc-a109-cdf48c175af4 req-202514aa-e77a-4513-9145-f49be1096aea service nova] Creating event network-vif-deleted:4ec6a71d-12d2-450b-82e5-79ec323dc46e for instance 7406931e-2ff5-4337-922d-1ea46ee53651 on n-h2-843700-1 May 28 05:24:46.003849 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-3f1baedc-462e-44dc-a109-cdf48c175af4 req-202514aa-e77a-4513-9145-f49be1096aea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031250 May 28 05:24:46.004449 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3342/6798] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:24:46.114741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2dbe7ff4-ea1f-49a1-b8a8-c9a3407814d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:46.115388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2dbe7ff4-ea1f-49a1-b8a8-c9a3407814d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:46.121712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2dbe7ff4-ea1f-49a1-b8a8-c9a3407814d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:46.122278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2dbe7ff4-ea1f-49a1-b8a8-c9a3407814d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:46.123737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2dbe7ff4-ea1f-49a1-b8a8-c9a3407814d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:46.125624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2dbe7ff4-ea1f-49a1-b8a8-c9a3407814d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:46.266680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2dbe7ff4-ea1f-49a1-b8a8-c9a3407814d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:46.274783 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2dbe7ff4-ea1f-49a1-b8a8-c9a3407814d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1341 microversion: 2.1 time: 0.163982 May 28 05:24:46.275411 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3457/6799] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:46 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:46.438294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bfa2362e-2fd4-42f7-af7c-61864cffd080 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:46.439216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bfa2362e-2fd4-42f7-af7c-61864cffd080 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 7406931e-2ff5-4337-922d-1ea46ee53651] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:46.445835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bfa2362e-2fd4-42f7-af7c-61864cffd080 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:46.446316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bfa2362e-2fd4-42f7-af7c-61864cffd080 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:46.447141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bfa2362e-2fd4-42f7-af7c-61864cffd080 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:46.447605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bfa2362e-2fd4-42f7-af7c-61864cffd080 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:46.481142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bfa2362e-2fd4-42f7-af7c-61864cffd080 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:46.481634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bfa2362e-2fd4-42f7-af7c-61864cffd080 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:46.482108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-bfa2362e-2fd4-42f7-af7c-61864cffd080 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lazy-loading 'fault' on Instance uuid 7406931e-2ff5-4337-922d-1ea46ee53651 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:24:46.851117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bfa2362e-2fd4-42f7-af7c-61864cffd080 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:46.858957 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bfa2362e-2fd4-42f7-af7c-61864cffd080 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651" status: 200 len: 1337 microversion: 2.1 time: 0.425739 May 28 05:24:46.859563 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3343/6800] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:46 2022] GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651 => generated 1337 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:47.292968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-371983e5-8efd-4c2f-af89-23bff3ec2880 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:47.293589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-371983e5-8efd-4c2f-af89-23bff3ec2880 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:47.300513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-371983e5-8efd-4c2f-af89-23bff3ec2880 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:47.302297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-371983e5-8efd-4c2f-af89-23bff3ec2880 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:47.302297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-371983e5-8efd-4c2f-af89-23bff3ec2880 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:47.302297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-371983e5-8efd-4c2f-af89-23bff3ec2880 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:47.563424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-371983e5-8efd-4c2f-af89-23bff3ec2880 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:47.571060 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-371983e5-8efd-4c2f-af89-23bff3ec2880 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1375 microversion: 2.1 time: 0.282201 May 28 05:24:47.571666 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3458/6801] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:47 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1375 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:47.881151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f00768b7-2ad9-4eaa-9e6e-713142e74abd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:47.881702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f00768b7-2ad9-4eaa-9e6e-713142e74abd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 7406931e-2ff5-4337-922d-1ea46ee53651] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:47.888870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f00768b7-2ad9-4eaa-9e6e-713142e74abd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:47.889346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f00768b7-2ad9-4eaa-9e6e-713142e74abd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:47.890223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f00768b7-2ad9-4eaa-9e6e-713142e74abd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:47.890596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f00768b7-2ad9-4eaa-9e6e-713142e74abd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:47.905055 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-f00768b7-2ad9-4eaa-9e6e-713142e74abd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] HTTP exception thrown: Instance 7406931e-2ff5-4337-922d-1ea46ee53651 could not be found. May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f00768b7-2ad9-4eaa-9e6e-713142e74abd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Request method failure captured: May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651 HTTP/1.1 May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbGwf5SXDCEYMtTRRD7q5dVqM-a7jCcqyYry-_1lHhSrbjuGGjmLxeJ-3oZJccUjTu9fBNDbTnf1SeIKxALYXBHJ1Bebnd7p2lniuqtGvVznXKXJ6xl2EIFje_waRl_iWHqIT9WRdca-1LoCgcnfEB6ScxdtBeW_WVeTIfKhpbFBVEE May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: c609cfd8212b4ae4aeee1213a373e579 May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestNetworkBasicOps-1416696730 May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c609cfd8212b4ae4aeee1213a373e579"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c609cfd8212b4ae4aeee1213a373e579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c609cfd8212b4ae4aeee1213a373e579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c609cfd8212b4ae4aeee1213a373e579"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestNetworkBasicOps-1416696730 May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: c609cfd8212b4ae4aeee1213a373e579 May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestNetworkBasicOps-1416696730 May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestNetworkBasicOps-1416696730-project May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 6dd6c7cc6c46484ca5964c4ed1affafb May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestNetworkBasicOps-1416696730-project May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 7406931e-2ff5-4337-922d-1ea46ee53651 could not be found. May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '7406931e-2ff5-4337-922d-1ea46ee53651'} May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7406931e-2ff5-4337-922d-1ea46ee53651 could not be found. May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7406931e-2ff5-4337-922d-1ea46ee53651 could not be found. May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:24:47.906780 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:24:47.912105 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:24:47.912105 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:24:47.912105 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:24:47.912105 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:24:47.912105 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:24:47.912105 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7406931e-2ff5-4337-922d-1ea46ee53651 could not be found. May 28 05:24:47.912105 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:24:47.912105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f00768b7-2ad9-4eaa-9e6e-713142e74abd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Returning 404 to user: Instance 7406931e-2ff5-4337-922d-1ea46ee53651 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:24:47.912105 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f00768b7-2ad9-4eaa-9e6e-713142e74abd tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651" status: 404 len: 111 microversion: 2.1 time: 0.031936 May 28 05:24:47.912105 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3344/6802] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:47 2022] GET /compute/v2.1/servers/7406931e-2ff5-4337-922d-1ea46ee53651 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:24:48.179207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2956bc4a-e3e2-454e-9ccd-ff9b8e7972f8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '.version_select at 0x7f7700ea3a60>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:48.283960 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2956bc4a-e3e2-454e-9ccd-ff9b8e7972f8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1645051389" status: 202 len: 0 microversion: 2.1 time: 0.109041 May 28 05:24:48.284564 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3459/6803] 10.222.0.58 () {58 vars in 1256 bytes} [Sat May 28 05:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1645051389 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:24:48.588898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ba95fa1b-fd8f-4c92-852b-fa6bdd4bcba7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:48.589653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ba95fa1b-fd8f-4c92-852b-fa6bdd4bcba7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:48.596134 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba95fa1b-fd8f-4c92-852b-fa6bdd4bcba7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:48.596669 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba95fa1b-fd8f-4c92-852b-fa6bdd4bcba7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:48.597513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba95fa1b-fd8f-4c92-852b-fa6bdd4bcba7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:48.597967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba95fa1b-fd8f-4c92-852b-fa6bdd4bcba7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:48.827984 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ba95fa1b-fd8f-4c92-852b-fa6bdd4bcba7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:48.836147 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ba95fa1b-fd8f-4c92-852b-fa6bdd4bcba7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1375 microversion: 2.1 time: 0.251120 May 28 05:24:48.846508 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3345/6804] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:48 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1375 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:49.855318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-96249176-ec1d-42c3-b5ac-61502e3c9dd1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:49.856101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-96249176-ec1d-42c3-b5ac-61502e3c9dd1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:49.865347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96249176-ec1d-42c3-b5ac-61502e3c9dd1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:49.865931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96249176-ec1d-42c3-b5ac-61502e3c9dd1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:49.866857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96249176-ec1d-42c3-b5ac-61502e3c9dd1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:49.867825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96249176-ec1d-42c3-b5ac-61502e3c9dd1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:50.056316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-96249176-ec1d-42c3-b5ac-61502e3c9dd1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:50.065008 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-96249176-ec1d-42c3-b5ac-61502e3c9dd1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1375 microversion: 2.1 time: 0.215096 May 28 05:24:50.065600 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3460/6805] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:49 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1375 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:50.595710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e2fd7e2f-fc73-4a7a-89a3-7e52924c499e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:50.596285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e2fd7e2f-fc73-4a7a-89a3-7e52924c499e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:50.598282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-a14ea1fa-9432-4a20-a5f1-7c25b2aceebe req-dc797960-a6a7-4f45-9fa7-419de59fa693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "973209fd-736b-4663-bc57-5413a41c5bc2", "tag": "fe3ffa12-3b81-41b7-9a68-783dd918e7a9"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:24:50.604614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2fd7e2f-fc73-4a7a-89a3-7e52924c499e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:50.605086 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2fd7e2f-fc73-4a7a-89a3-7e52924c499e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:50.605927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2fd7e2f-fc73-4a7a-89a3-7e52924c499e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:50.606378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2fd7e2f-fc73-4a7a-89a3-7e52924c499e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:50.608873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a14ea1fa-9432-4a20-a5f1-7c25b2aceebe req-dc797960-a6a7-4f45-9fa7-419de59fa693 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:50.609489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a14ea1fa-9432-4a20-a5f1-7c25b2aceebe req-dc797960-a6a7-4f45-9fa7-419de59fa693 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:50.623769 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-a14ea1fa-9432-4a20-a5f1-7c25b2aceebe req-dc797960-a6a7-4f45-9fa7-419de59fa693 service nova] Creating event network-changed:fe3ffa12-3b81-41b7-9a68-783dd918e7a9 for instance 973209fd-736b-4663-bc57-5413a41c5bc2 on n-h1-843700-1 May 28 05:24:50.630494 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-a14ea1fa-9432-4a20-a5f1-7c25b2aceebe req-dc797960-a6a7-4f45-9fa7-419de59fa693 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036864 May 28 05:24:50.631196 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3461/6806] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:24:50.642108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e2fd7e2f-fc73-4a7a-89a3-7e52924c499e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:24:50.995971 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e2fd7e2f-fc73-4a7a-89a3-7e52924c499e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "DELETE /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2" status: 204 len: 0 microversion: 2.1 time: 0.400471 May 28 05:24:50.995971 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3346/6807] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:24:50 2022] DELETE /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:24:51.003270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5e45b130-70b6-40fc-b3e7-3c41a0711eab tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:51.004151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5e45b130-70b6-40fc-b3e7-3c41a0711eab tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:51.011534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5e45b130-70b6-40fc-b3e7-3c41a0711eab tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:51.012105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5e45b130-70b6-40fc-b3e7-3c41a0711eab tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:51.013187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5e45b130-70b6-40fc-b3e7-3c41a0711eab tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:51.013641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5e45b130-70b6-40fc-b3e7-3c41a0711eab tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:51.083586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ea827fb4-7fc3-4e21-905e-5c090c34c830 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:51.084338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ea827fb4-7fc3-4e21-905e-5c090c34c830 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:51.092331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea827fb4-7fc3-4e21-905e-5c090c34c830 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:51.093218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea827fb4-7fc3-4e21-905e-5c090c34c830 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:51.094072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea827fb4-7fc3-4e21-905e-5c090c34c830 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:51.094536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea827fb4-7fc3-4e21-905e-5c090c34c830 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:51.199247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5e45b130-70b6-40fc-b3e7-3c41a0711eab tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:51.217692 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5e45b130-70b6-40fc-b3e7-3c41a0711eab tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2" status: 200 len: 1673 microversion: 2.1 time: 0.218249 May 28 05:24:51.218860 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3462/6808] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:50 2022] GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2 => generated 1673 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:51.267948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ea827fb4-7fc3-4e21-905e-5c090c34c830 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:51.276325 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ea827fb4-7fc3-4e21-905e-5c090c34c830 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1375 microversion: 2.1 time: 0.197834 May 28 05:24:51.277053 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3347/6809] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:51 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1375 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:52.235941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e0d21273-6f01-4772-98ac-21d02858ee9d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:52.236557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e0d21273-6f01-4772-98ac-21d02858ee9d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:52.243580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0d21273-6f01-4772-98ac-21d02858ee9d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:52.244028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0d21273-6f01-4772-98ac-21d02858ee9d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:52.244794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0d21273-6f01-4772-98ac-21d02858ee9d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:52.245384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0d21273-6f01-4772-98ac-21d02858ee9d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:52.293799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d826a7f9-4d7e-4448-9f4f-4c8e261c85e0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:52.294467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d826a7f9-4d7e-4448-9f4f-4c8e261c85e0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:52.301734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d826a7f9-4d7e-4448-9f4f-4c8e261c85e0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:52.302255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d826a7f9-4d7e-4448-9f4f-4c8e261c85e0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:52.303090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d826a7f9-4d7e-4448-9f4f-4c8e261c85e0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:52.303553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d826a7f9-4d7e-4448-9f4f-4c8e261c85e0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:52.584647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e0d21273-6f01-4772-98ac-21d02858ee9d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:52.592103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d826a7f9-4d7e-4448-9f4f-4c8e261c85e0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:52.593056 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e0d21273-6f01-4772-98ac-21d02858ee9d tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2" status: 200 len: 1554 microversion: 2.1 time: 0.361057 May 28 05:24:52.603705 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3463/6810] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:52 2022] GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2 => generated 1554 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:52.609484 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d826a7f9-4d7e-4448-9f4f-4c8e261c85e0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1375 microversion: 2.1 time: 0.312997 May 28 05:24:52.609484 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3348/6811] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:52 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1375 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:24:52.949946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-7c0c989e-92af-44dd-8434-3345387b78b1 req-72f58b76-587a-423f-ba3c-bfa26590abfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "973209fd-736b-4663-bc57-5413a41c5bc2", "name": "network-vif-deleted", "tag": "fe3ffa12-3b81-41b7-9a68-783dd918e7a9"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:24:52.958691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-7c0c989e-92af-44dd-8434-3345387b78b1 req-72f58b76-587a-423f-ba3c-bfa26590abfe service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:52.959357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-7c0c989e-92af-44dd-8434-3345387b78b1 req-72f58b76-587a-423f-ba3c-bfa26590abfe service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:52.971165 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-7c0c989e-92af-44dd-8434-3345387b78b1 req-72f58b76-587a-423f-ba3c-bfa26590abfe service nova] Creating event network-vif-deleted:fe3ffa12-3b81-41b7-9a68-783dd918e7a9 for instance 973209fd-736b-4663-bc57-5413a41c5bc2 on n-h1-843700-1 May 28 05:24:52.976192 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-7c0c989e-92af-44dd-8434-3345387b78b1 req-72f58b76-587a-423f-ba3c-bfa26590abfe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030060 May 28 05:24:52.976783 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3464/6812] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:24:53.612734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-42c84b8a-108a-4079-a10e-2fa715121e87 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:53.613368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-42c84b8a-108a-4079-a10e-2fa715121e87 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:53.628259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-af947aab-bcd0-4393-8694-a29d41e13ca2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:53.628890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42c84b8a-108a-4079-a10e-2fa715121e87 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:53.628890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42c84b8a-108a-4079-a10e-2fa715121e87 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:53.629529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42c84b8a-108a-4079-a10e-2fa715121e87 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:53.630164 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42c84b8a-108a-4079-a10e-2fa715121e87 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:53.630311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-af947aab-bcd0-4393-8694-a29d41e13ca2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:53.640351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-af947aab-bcd0-4393-8694-a29d41e13ca2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:53.641084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-af947aab-bcd0-4393-8694-a29d41e13ca2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:53.642057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-af947aab-bcd0-4393-8694-a29d41e13ca2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:53.642714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-af947aab-bcd0-4393-8694-a29d41e13ca2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:53.667686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42c84b8a-108a-4079-a10e-2fa715121e87 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:53.668156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42c84b8a-108a-4079-a10e-2fa715121e87 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:53.668638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-42c84b8a-108a-4079-a10e-2fa715121e87 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lazy-loading 'fault' on Instance uuid 973209fd-736b-4663-bc57-5413a41c5bc2 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:24:53.741172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-42c84b8a-108a-4079-a10e-2fa715121e87 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:53.753514 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-42c84b8a-108a-4079-a10e-2fa715121e87 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2" status: 200 len: 1339 microversion: 2.1 time: 0.144671 May 28 05:24:53.754119 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3349/6813] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:53 2022] GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2 => generated 1339 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:53.812190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-af947aab-bcd0-4393-8694-a29d41e13ca2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:53.820230 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-af947aab-bcd0-4393-8694-a29d41e13ca2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1375 microversion: 2.1 time: 0.199333 May 28 05:24:53.820809 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3465/6814] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:53 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1375 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:24:54.770895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ad68569f-eb0a-4c3c-9c70-a6cc1091d42e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:54.771628 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ad68569f-eb0a-4c3c-9c70-a6cc1091d42e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 973209fd-736b-4663-bc57-5413a41c5bc2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:54.779285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ad68569f-eb0a-4c3c-9c70-a6cc1091d42e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:54.779774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ad68569f-eb0a-4c3c-9c70-a6cc1091d42e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:54.780548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ad68569f-eb0a-4c3c-9c70-a6cc1091d42e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:54.781005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ad68569f-eb0a-4c3c-9c70-a6cc1091d42e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:54.795864 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-ad68569f-eb0a-4c3c-9c70-a6cc1091d42e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] HTTP exception thrown: Instance 973209fd-736b-4663-bc57-5413a41c5bc2 could not be found. May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ad68569f-eb0a-4c3c-9c70-a6cc1091d42e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Request method failure captured: May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2 HTTP/1.1 May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbGwf5SXDCEYMtTRRD7q5dVqM-a7jCcqyYry-_1lHhSrbjuGGjmLxeJ-3oZJccUjTu9fBNDbTnf1SeIKxALYXBHJ1Bebnd7p2lniuqtGvVznXKXJ6xl2EIFje_waRl_iWHqIT9WRdca-1LoCgcnfEB6ScxdtBeW_WVeTIfKhpbFBVEE May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: c609cfd8212b4ae4aeee1213a373e579 May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestNetworkBasicOps-1416696730 May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c609cfd8212b4ae4aeee1213a373e579"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c609cfd8212b4ae4aeee1213a373e579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c609cfd8212b4ae4aeee1213a373e579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c609cfd8212b4ae4aeee1213a373e579"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestNetworkBasicOps-1416696730 May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: c609cfd8212b4ae4aeee1213a373e579 May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestNetworkBasicOps-1416696730 May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestNetworkBasicOps-1416696730-project May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 6dd6c7cc6c46484ca5964c4ed1affafb May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestNetworkBasicOps-1416696730-project May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 973209fd-736b-4663-bc57-5413a41c5bc2 could not be found. May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '973209fd-736b-4663-bc57-5413a41c5bc2'} May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 973209fd-736b-4663-bc57-5413a41c5bc2 could not be found. May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 973209fd-736b-4663-bc57-5413a41c5bc2 could not be found. May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:24:54.797568 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:24:54.801816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:24:54.801816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:24:54.801816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:24:54.801816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:24:54.801816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:24:54.801816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 973209fd-736b-4663-bc57-5413a41c5bc2 could not be found. May 28 05:24:54.801816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:24:54.801816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ad68569f-eb0a-4c3c-9c70-a6cc1091d42e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Returning 404 to user: Instance 973209fd-736b-4663-bc57-5413a41c5bc2 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:24:54.801816 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ad68569f-eb0a-4c3c-9c70-a6cc1091d42e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2" status: 404 len: 111 microversion: 2.1 time: 0.032245 May 28 05:24:54.801816 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3350/6815] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:54 2022] GET /compute/v2.1/servers/973209fd-736b-4663-bc57-5413a41c5bc2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:24:54.837850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-21df95bd-efb0-4242-9f77-b8f3cbd1e96d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:54.838800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-21df95bd-efb0-4242-9f77-b8f3cbd1e96d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:54.846838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21df95bd-efb0-4242-9f77-b8f3cbd1e96d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:54.847337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21df95bd-efb0-4242-9f77-b8f3cbd1e96d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:54.848141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21df95bd-efb0-4242-9f77-b8f3cbd1e96d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:54.848848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21df95bd-efb0-4242-9f77-b8f3cbd1e96d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:54.990824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-21df95bd-efb0-4242-9f77-b8f3cbd1e96d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:54.998740 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-21df95bd-efb0-4242-9f77-b8f3cbd1e96d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1375 microversion: 2.1 time: 0.164877 May 28 05:24:54.999387 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3466/6816] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:54 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:55.046393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-01111a72-3ae2-4861-bbb4-3d3a3b082d3b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '.version_select at 0x7f7700309790>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:55.162515 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-01111a72-3ae2-4861-bbb4-3d3a3b082d3b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1650594430" status: 202 len: 0 microversion: 2.1 time: 0.120050 May 28 05:24:55.163144 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3351/6817] 10.222.0.58 () {58 vars in 1256 bytes} [Sat May 28 05:24:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1650594430 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:24:56.015892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-79965f55-3d01-45c8-9d0c-b7c58adcd2e7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:56.017146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-79965f55-3d01-45c8-9d0c-b7c58adcd2e7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:56.024495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-79965f55-3d01-45c8-9d0c-b7c58adcd2e7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:56.024958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-79965f55-3d01-45c8-9d0c-b7c58adcd2e7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:56.025741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-79965f55-3d01-45c8-9d0c-b7c58adcd2e7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:56.026180 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-79965f55-3d01-45c8-9d0c-b7c58adcd2e7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:56.174133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-79965f55-3d01-45c8-9d0c-b7c58adcd2e7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:56.186929 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-79965f55-3d01-45c8-9d0c-b7c58adcd2e7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1375 microversion: 2.1 time: 0.174763 May 28 05:24:56.187958 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3467/6818] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:56 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:57.212025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5d2c3cdd-b831-4ba9-9957-7a5df477d581 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:57.212801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5d2c3cdd-b831-4ba9-9957-7a5df477d581 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:57.247650 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d2c3cdd-b831-4ba9-9957-7a5df477d581 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:57.251988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d2c3cdd-b831-4ba9-9957-7a5df477d581 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:57.254350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d2c3cdd-b831-4ba9-9957-7a5df477d581 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:57.258611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d2c3cdd-b831-4ba9-9957-7a5df477d581 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:57.555505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5d2c3cdd-b831-4ba9-9957-7a5df477d581 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:57.578977 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5d2c3cdd-b831-4ba9-9957-7a5df477d581 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1375 microversion: 2.1 time: 0.374506 May 28 05:24:57.590136 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3352/6819] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:57 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1375 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:57.855799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-c38f3ca5-f01d-4038-8b7b-12797e87fdcd req-6d191744-3b7d-42b0-9d40-937d295493ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f9da76-6315-495f-a8e5-0bfa20d2e6cf", "name": "network-vif-plugged", "status": "completed", "tag": "53999afb-7435-4948-86fa-40c0d3cef2ca"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:24:57.873283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c38f3ca5-f01d-4038-8b7b-12797e87fdcd req-6d191744-3b7d-42b0-9d40-937d295493ae service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:57.873948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c38f3ca5-f01d-4038-8b7b-12797e87fdcd req-6d191744-3b7d-42b0-9d40-937d295493ae service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:57.892894 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-c38f3ca5-f01d-4038-8b7b-12797e87fdcd req-6d191744-3b7d-42b0-9d40-937d295493ae service nova] Creating event network-vif-plugged:53999afb-7435-4948-86fa-40c0d3cef2ca for instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf on n-h1-843700-1 May 28 05:24:57.898702 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-c38f3ca5-f01d-4038-8b7b-12797e87fdcd req-6d191744-3b7d-42b0-9d40-937d295493ae service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047533 May 28 05:24:57.899906 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3468/6820] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:24:58.597270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-11759537-4dc0-45e9-a27f-1eabcc3bbb36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:58.599802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-11759537-4dc0-45e9-a27f-1eabcc3bbb36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:58.607937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11759537-4dc0-45e9-a27f-1eabcc3bbb36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:58.608627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11759537-4dc0-45e9-a27f-1eabcc3bbb36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:58.610433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11759537-4dc0-45e9-a27f-1eabcc3bbb36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:58.611098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11759537-4dc0-45e9-a27f-1eabcc3bbb36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:58.846263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-11759537-4dc0-45e9-a27f-1eabcc3bbb36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:24:58.860775 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-11759537-4dc0-45e9-a27f-1eabcc3bbb36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1375 microversion: 2.1 time: 0.267355 May 28 05:24:58.861386 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3353/6821] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:58 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1375 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:24:59.878899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f874bffa-ae20-499a-b3a3-2ab911a89cac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:24:59.879770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f874bffa-ae20-499a-b3a3-2ab911a89cac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:24:59.886330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f874bffa-ae20-499a-b3a3-2ab911a89cac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:59.886779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f874bffa-ae20-499a-b3a3-2ab911a89cac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:24:59.887603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f874bffa-ae20-499a-b3a3-2ab911a89cac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:24:59.888057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f874bffa-ae20-499a-b3a3-2ab911a89cac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:00.027379 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f874bffa-ae20-499a-b3a3-2ab911a89cac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:00.043928 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f874bffa-ae20-499a-b3a3-2ab911a89cac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1561 microversion: 2.1 time: 0.162788 May 28 05:25:00.043928 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3469/6822] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:24:59 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:00.053304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cdf1cf51-56da-4bd3-9de3-b4c7a1b98bb5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:00.054022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cdf1cf51-56da-4bd3-9de3-b4c7a1b98bb5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:00.063375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdf1cf51-56da-4bd3-9de3-b4c7a1b98bb5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:00.063375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdf1cf51-56da-4bd3-9de3-b4c7a1b98bb5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:00.063722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdf1cf51-56da-4bd3-9de3-b4c7a1b98bb5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:00.064188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cdf1cf51-56da-4bd3-9de3-b4c7a1b98bb5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:00.067163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:25:00.215051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cdf1cf51-56da-4bd3-9de3-b4c7a1b98bb5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:00.225024 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cdf1cf51-56da-4bd3-9de3-b4c7a1b98bb5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1561 microversion: 2.1 time: 0.175772 May 28 05:25:00.225635 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3354/6823] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:00 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:00.318499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3301819c-9be5-424c-8ebb-5141eb842267 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:00.319027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3301819c-9be5-424c-8ebb-5141eb842267 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:00.327103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3301819c-9be5-424c-8ebb-5141eb842267 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:00.328868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3301819c-9be5-424c-8ebb-5141eb842267 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:00.332160 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3301819c-9be5-424c-8ebb-5141eb842267 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:00.333106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3301819c-9be5-424c-8ebb-5141eb842267 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:00.371396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3301819c-9be5-424c-8ebb-5141eb842267 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:25:00.505587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:25:00.743045 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3301819c-9be5-424c-8ebb-5141eb842267 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 204 len: 0 microversion: 2.1 time: 0.427234 May 28 05:25:00.744803 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3470/6824] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:25:00 2022] DELETE /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:25:00.754374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d16dee30-a8d3-4f77-9bb3-249ed491c8fa tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:00.755195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d16dee30-a8d3-4f77-9bb3-249ed491c8fa tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:00.765275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d16dee30-a8d3-4f77-9bb3-249ed491c8fa tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:00.765275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d16dee30-a8d3-4f77-9bb3-249ed491c8fa tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:00.765275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d16dee30-a8d3-4f77-9bb3-249ed491c8fa tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:00.766007 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d16dee30-a8d3-4f77-9bb3-249ed491c8fa tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:00.913249 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d16dee30-a8d3-4f77-9bb3-249ed491c8fa tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:00.925988 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d16dee30-a8d3-4f77-9bb3-249ed491c8fa tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1567 microversion: 2.1 time: 0.176256 May 28 05:25:00.926788 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3355/6825] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:00 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:25:01.949336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5d174fcd-e105-4153-afcc-9e1c1404abfe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:01.950653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5d174fcd-e105-4153-afcc-9e1c1404abfe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:01.970776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d174fcd-e105-4153-afcc-9e1c1404abfe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:01.973021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d174fcd-e105-4153-afcc-9e1c1404abfe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:01.973841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d174fcd-e105-4153-afcc-9e1c1404abfe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:01.976551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d174fcd-e105-4153-afcc-9e1c1404abfe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:02.229437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5d174fcd-e105-4153-afcc-9e1c1404abfe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:02.238651 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5d174fcd-e105-4153-afcc-9e1c1404abfe tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1567 microversion: 2.1 time: 0.299168 May 28 05:25:02.243786 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3471/6826] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:01 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1567 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:02.838978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-1b9fe580-a664-4c45-96e4-780149c71104 req-1881caee-bfa2-4096-92fe-d07a808e1d93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f9da76-6315-495f-a8e5-0bfa20d2e6cf", "name": "network-vif-deleted", "tag": "53999afb-7435-4948-86fa-40c0d3cef2ca"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:25:02.865251 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1b9fe580-a664-4c45-96e4-780149c71104 req-1881caee-bfa2-4096-92fe-d07a808e1d93 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:02.867229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-1b9fe580-a664-4c45-96e4-780149c71104 req-1881caee-bfa2-4096-92fe-d07a808e1d93 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:02.881589 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-1b9fe580-a664-4c45-96e4-780149c71104 req-1881caee-bfa2-4096-92fe-d07a808e1d93 service nova] Creating event network-vif-deleted:53999afb-7435-4948-86fa-40c0d3cef2ca for instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf on n-h1-843700-1 May 28 05:25:02.887770 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-1b9fe580-a664-4c45-96e4-780149c71104 req-1881caee-bfa2-4096-92fe-d07a808e1d93 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052936 May 28 05:25:02.888953 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3356/6827] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:25:03.260488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-80fb8e08-e0f6-44d4-a75c-6b156247a248 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:03.261190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-80fb8e08-e0f6-44d4-a75c-6b156247a248 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:03.275867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80fb8e08-e0f6-44d4-a75c-6b156247a248 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:03.282261 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80fb8e08-e0f6-44d4-a75c-6b156247a248 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:03.283381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80fb8e08-e0f6-44d4-a75c-6b156247a248 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:03.284150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-80fb8e08-e0f6-44d4-a75c-6b156247a248 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:03.426902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-80fb8e08-e0f6-44d4-a75c-6b156247a248 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:03.439857 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-80fb8e08-e0f6-44d4-a75c-6b156247a248 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1360 microversion: 2.1 time: 0.185102 May 28 05:25:03.448317 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3472/6828] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:03 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1360 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:04.457417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a6a5d712-d199-4007-a0da-b66b64eb6ec5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:04.458877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a6a5d712-d199-4007-a0da-b66b64eb6ec5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:04.476964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6a5d712-d199-4007-a0da-b66b64eb6ec5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:04.477454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6a5d712-d199-4007-a0da-b66b64eb6ec5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:04.478276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6a5d712-d199-4007-a0da-b66b64eb6ec5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:04.478739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6a5d712-d199-4007-a0da-b66b64eb6ec5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:04.581509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a6a5d712-d199-4007-a0da-b66b64eb6ec5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:04.611829 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a6a5d712-d199-4007-a0da-b66b64eb6ec5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1360 microversion: 2.1 time: 0.156703 May 28 05:25:04.614964 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3357/6829] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:04 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:05.632086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d063e2de-56fd-457e-9405-07a04e32e5c5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:05.633799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d063e2de-56fd-457e-9405-07a04e32e5c5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:05.648302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d063e2de-56fd-457e-9405-07a04e32e5c5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:05.649689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d063e2de-56fd-457e-9405-07a04e32e5c5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:05.661269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d063e2de-56fd-457e-9405-07a04e32e5c5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:05.661269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d063e2de-56fd-457e-9405-07a04e32e5c5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:05.748956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d063e2de-56fd-457e-9405-07a04e32e5c5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:05.763610 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d063e2de-56fd-457e-9405-07a04e32e5c5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1360 microversion: 2.1 time: 0.135533 May 28 05:25:05.765388 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3473/6830] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:05 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1360 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:06.782551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7bf68232-5cd4-4645-86ac-d1439f7014c4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:06.783231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7bf68232-5cd4-4645-86ac-d1439f7014c4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:06.795269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7bf68232-5cd4-4645-86ac-d1439f7014c4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:06.803001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7bf68232-5cd4-4645-86ac-d1439f7014c4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:06.808706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7bf68232-5cd4-4645-86ac-d1439f7014c4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:06.809610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7bf68232-5cd4-4645-86ac-d1439f7014c4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:06.875641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-404153ee-8a9c-47d7-a918-b36c60c9c2f4 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Action: 'create', calling method: .version_select at 0x7f7700844820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-573833239", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrbWTsarthCAv+1VpgfcD0YmcUi+F3//9iXHc63oWQpxCT3jygpF459RcsxsDABTfwNn3COe3VXG4OvPbz1w9AnKZqpkPwM19wrUGe7x8xUWHf2ZdUmk8d+kU0r6Uvezw=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:25:06.896725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-404153ee-8a9c-47d7-a918-b36c60c9c2f4 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Getting quotas for project c609cfd8212b4ae4aeee1213a373e579. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:25:06.907734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-404153ee-8a9c-47d7-a918-b36c60c9c2f4 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Getting quotas for user 6dd6c7cc6c46484ca5964c4ed1affafb and project c609cfd8212b4ae4aeee1213a373e579. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:25:06.929596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7bf68232-5cd4-4645-86ac-d1439f7014c4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:06.939350 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7bf68232-5cd4-4645-86ac-d1439f7014c4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1360 microversion: 2.1 time: 0.161141 May 28 05:25:06.942434 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3358/6831] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:06 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1360 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:07.062974 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-404153ee-8a9c-47d7-a918-b36c60c9c2f4 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.193040 May 28 05:25:07.071061 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3474/6832] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 05:25:06 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:25:07.957184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2bd412f3-adbd-4a0c-b4ec-f181aee08e11 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:07.957828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2bd412f3-adbd-4a0c-b4ec-f181aee08e11 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:07.977857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2bd412f3-adbd-4a0c-b4ec-f181aee08e11 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:07.983494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2bd412f3-adbd-4a0c-b4ec-f181aee08e11 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:07.983494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2bd412f3-adbd-4a0c-b4ec-f181aee08e11 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:07.983494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2bd412f3-adbd-4a0c-b4ec-f181aee08e11 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:08.153331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2bd412f3-adbd-4a0c-b4ec-f181aee08e11 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:08.167390 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2bd412f3-adbd-4a0c-b4ec-f181aee08e11 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1360 microversion: 2.1 time: 0.208476 May 28 05:25:08.167390 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3359/6833] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:07 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1360 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:09.180568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f25b3990-c0e7-4868-b7fc-4659dbab00f3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:09.181839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f25b3990-c0e7-4868-b7fc-4659dbab00f3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:09.204429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f25b3990-c0e7-4868-b7fc-4659dbab00f3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:09.206567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f25b3990-c0e7-4868-b7fc-4659dbab00f3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:09.207653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f25b3990-c0e7-4868-b7fc-4659dbab00f3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:09.210398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f25b3990-c0e7-4868-b7fc-4659dbab00f3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:09.328584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f25b3990-c0e7-4868-b7fc-4659dbab00f3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:09.343104 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f25b3990-c0e7-4868-b7fc-4659dbab00f3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1360 microversion: 2.1 time: 0.165392 May 28 05:25:09.343659 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3475/6834] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:09 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1360 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:10.361051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-716066c1-1ac9-4457-814d-29761cf4c3e7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:10.362246 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-716066c1-1ac9-4457-814d-29761cf4c3e7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:10.373033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-716066c1-1ac9-4457-814d-29761cf4c3e7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:10.375571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-716066c1-1ac9-4457-814d-29761cf4c3e7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:10.382044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-716066c1-1ac9-4457-814d-29761cf4c3e7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:10.384397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-716066c1-1ac9-4457-814d-29761cf4c3e7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:10.463775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-716066c1-1ac9-4457-814d-29761cf4c3e7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:10.477986 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-716066c1-1ac9-4457-814d-29761cf4c3e7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1360 microversion: 2.1 time: 0.121274 May 28 05:25:10.479074 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3360/6835] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:10 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1360 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:10.569971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-51e751c7-8f5c-4f80-9f97-c7779edde395 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1465521909", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "8c86783f-e491-4eae-92b2-0ae859aeeb91"}], "key_name": "tempest-TestNetworkBasicOps-573833239", "security_groups": [{"name": "tempest-secgroup-smoke-1632039689"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:25:10.680735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-51e751c7-8f5c-4f80-9f97-c7779edde395 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] validate_networks() for [('8c86783f-e491-4eae-92b2-0ae859aeeb91', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:25:11.471896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-51e751c7-8f5c-4f80-9f97-c7779edde395 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:25:11.473009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-51e751c7-8f5c-4f80-9f97-c7779edde395 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:25:11.473604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-51e751c7-8f5c-4f80-9f97-c7779edde395 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:25:11.474121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-51e751c7-8f5c-4f80-9f97-c7779edde395 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:25:11.474697 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-51e751c7-8f5c-4f80-9f97-c7779edde395 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:25:11.485338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51e751c7-8f5c-4f80-9f97-c7779edde395 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:11.490542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51e751c7-8f5c-4f80-9f97-c7779edde395 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:11.490542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51e751c7-8f5c-4f80-9f97-c7779edde395 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:11.490542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-51e751c7-8f5c-4f80-9f97-c7779edde395 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:11.498921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-055b53d7-23b7-421a-9be2-a85975776a8f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:11.499737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-055b53d7-23b7-421a-9be2-a85975776a8f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:11.510682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-055b53d7-23b7-421a-9be2-a85975776a8f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:11.513818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-055b53d7-23b7-421a-9be2-a85975776a8f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:11.516345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-055b53d7-23b7-421a-9be2-a85975776a8f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:11.519792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-055b53d7-23b7-421a-9be2-a85975776a8f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:11.529504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-51e751c7-8f5c-4f80-9f97-c7779edde395 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Getting quotas for project c609cfd8212b4ae4aeee1213a373e579. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:25:11.537014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-51e751c7-8f5c-4f80-9f97-c7779edde395 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Getting quotas for user 6dd6c7cc6c46484ca5964c4ed1affafb and project c609cfd8212b4ae4aeee1213a373e579. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:25:11.559772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-51e751c7-8f5c-4f80-9f97-c7779edde395 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:25:11.562318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-51e751c7-8f5c-4f80-9f97-c7779edde395 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:25:11.595310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-055b53d7-23b7-421a-9be2-a85975776a8f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:11.606779 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-055b53d7-23b7-421a-9be2-a85975776a8f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1360 microversion: 2.1 time: 0.111128 May 28 05:25:11.608068 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3361/6836] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:11 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1360 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:25:11.703324 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-51e751c7-8f5c-4f80-9f97-c7779edde395 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.137990 May 28 05:25:11.704812 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3476/6837] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:25:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:25:11.725451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-12b98153-1099-4507-badb-d48f0eb35962 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:11.725451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-12b98153-1099-4507-badb-d48f0eb35962 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:11.805348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-12b98153-1099-4507-badb-d48f0eb35962 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:11.813543 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-12b98153-1099-4507-badb-d48f0eb35962 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626" status: 200 len: 1248 microversion: 2.1 time: 0.101596 May 28 05:25:11.823072 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3362/6838] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:11 2022] GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626 => generated 1248 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:12.625404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9a7790d2-4349-45e7-a4c9-886a27b476b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:12.626038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9a7790d2-4349-45e7-a4c9-886a27b476b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:12.628062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:25:12.633278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a7790d2-4349-45e7-a4c9-886a27b476b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:12.633742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a7790d2-4349-45e7-a4c9-886a27b476b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:12.634522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a7790d2-4349-45e7-a4c9-886a27b476b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:12.634975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a7790d2-4349-45e7-a4c9-886a27b476b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:12.706398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9a7790d2-4349-45e7-a4c9-886a27b476b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:12.714240 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9a7790d2-4349-45e7-a4c9-886a27b476b2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1360 microversion: 2.1 time: 0.094099 May 28 05:25:12.714903 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3477/6839] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:12 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1360 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:12.831613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3a2bd46f-eab3-4381-b1e0-e07d20e06bf3 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:12.832251 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3a2bd46f-eab3-4381-b1e0-e07d20e06bf3 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:12.841309 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a2bd46f-eab3-4381-b1e0-e07d20e06bf3 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:12.844697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a2bd46f-eab3-4381-b1e0-e07d20e06bf3 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:12.844697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a2bd46f-eab3-4381-b1e0-e07d20e06bf3 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:12.844697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a2bd46f-eab3-4381-b1e0-e07d20e06bf3 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:12.913629 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3a2bd46f-eab3-4381-b1e0-e07d20e06bf3 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:12.922898 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3a2bd46f-eab3-4381-b1e0-e07d20e06bf3 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626" status: 200 len: 1252 microversion: 2.1 time: 0.095715 May 28 05:25:12.923547 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3363/6840] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:12 2022] GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626 => generated 1252 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:13.731681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-205b4a5a-73c2-4f27-905c-8d79761c9699 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:13.732907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-205b4a5a-73c2-4f27-905c-8d79761c9699 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:13.745641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-205b4a5a-73c2-4f27-905c-8d79761c9699 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:13.747253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-205b4a5a-73c2-4f27-905c-8d79761c9699 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:13.750283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-205b4a5a-73c2-4f27-905c-8d79761c9699 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:13.750908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-205b4a5a-73c2-4f27-905c-8d79761c9699 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:13.830308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-205b4a5a-73c2-4f27-905c-8d79761c9699 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:13.839401 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-205b4a5a-73c2-4f27-905c-8d79761c9699 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1360 microversion: 2.1 time: 0.111881 May 28 05:25:13.852533 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3478/6841] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:13 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1360 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:13.942088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1e232f66-2299-4723-9009-721c05370f1b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:13.942736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1e232f66-2299-4723-9009-721c05370f1b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:13.951359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:25:13.970363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e232f66-2299-4723-9009-721c05370f1b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:13.971456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e232f66-2299-4723-9009-721c05370f1b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:13.972550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e232f66-2299-4723-9009-721c05370f1b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:13.973232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e232f66-2299-4723-9009-721c05370f1b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:14.101879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1e232f66-2299-4723-9009-721c05370f1b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:14.111073 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1e232f66-2299-4723-9009-721c05370f1b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626" status: 200 len: 1308 microversion: 2.1 time: 0.173126 May 28 05:25:14.111840 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3364/6842] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:13 2022] GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626 => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:14.859422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e5050c60-e7c1-4d34-828f-063ac1c876fd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:14.860046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e5050c60-e7c1-4d34-828f-063ac1c876fd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:14.873620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5050c60-e7c1-4d34-828f-063ac1c876fd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:14.873620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5050c60-e7c1-4d34-828f-063ac1c876fd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:14.873620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5050c60-e7c1-4d34-828f-063ac1c876fd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:14.873620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5050c60-e7c1-4d34-828f-063ac1c876fd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:14.921292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5050c60-e7c1-4d34-828f-063ac1c876fd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:14.922062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e5050c60-e7c1-4d34-828f-063ac1c876fd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:14.922743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-e5050c60-e7c1-4d34-828f-063ac1c876fd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lazy-loading 'fault' on Instance uuid d5f9da76-6315-495f-a8e5-0bfa20d2e6cf {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:25:14.998938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e5050c60-e7c1-4d34-828f-063ac1c876fd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:15.006907 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e5050c60-e7c1-4d34-828f-063ac1c876fd tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 200 len: 1365 microversion: 2.1 time: 0.152175 May 28 05:25:15.007779 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3479/6843] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:14 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:15.133755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-409e6387-4135-4436-8515-7f6d0f6ac5d6 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:15.134460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-409e6387-4135-4436-8515-7f6d0f6ac5d6 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:15.149306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-409e6387-4135-4436-8515-7f6d0f6ac5d6 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:15.149306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-409e6387-4135-4436-8515-7f6d0f6ac5d6 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:15.149306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-409e6387-4135-4436-8515-7f6d0f6ac5d6 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:15.149306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-409e6387-4135-4436-8515-7f6d0f6ac5d6 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:15.358752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-409e6387-4135-4436-8515-7f6d0f6ac5d6 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:15.371591 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-409e6387-4135-4436-8515-7f6d0f6ac5d6 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626" status: 200 len: 1374 microversion: 2.1 time: 0.240685 May 28 05:25:15.381588 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3365/6844] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:15 2022] GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626 => generated 1374 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:16.025065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-87d3019e-b46b-4cea-9139-a4d1495d9f71 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:16.025984 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-87d3019e-b46b-4cea-9139-a4d1495d9f71 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:16.039342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87d3019e-b46b-4cea-9139-a4d1495d9f71 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:16.039950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87d3019e-b46b-4cea-9139-a4d1495d9f71 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:16.040902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87d3019e-b46b-4cea-9139-a4d1495d9f71 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:16.043678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87d3019e-b46b-4cea-9139-a4d1495d9f71 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:16.076185 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-87d3019e-b46b-4cea-9139-a4d1495d9f71 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] HTTP exception thrown: Instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf could not be found. May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-87d3019e-b46b-4cea-9139-a4d1495d9f71 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Request method failure captured: May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf HTTP/1.1 May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbDlrqJvsw-Bj4hemx4XscPzQgI57Oj0DhtZ0WItt0VxFXFIUFqzN1b2sr7MK3BjOGQZJbLNmoClfshSjagkFRTmogQaQpoLYEaPQkaSagOXWAKjyAlGGxZFI9I-y-IJo4VhS_mMCbBct4nVbcF58kjzhMiK5F2slw20hRu7zD2W154 May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TestVolumeBootPattern-934660757 May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TestVolumeBootPattern-934660757-project May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: a33708c760574b0698fc16ddfebad05b May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TestVolumeBootPattern-934660757-project May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf could not be found. May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'd5f9da76-6315-495f-a8e5-0bfa20d2e6cf'} May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf could not be found. May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf could not be found. May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:25:16.078477 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:25:16.083804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:16.083804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:25:16.083804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:25:16.083804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:25:16.083804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:25:16.083804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf could not be found. May 28 05:25:16.083804 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:25:16.085375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-87d3019e-b46b-4cea-9139-a4d1495d9f71 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Returning 404 to user: Instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:25:16.086492 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-87d3019e-b46b-4cea-9139-a4d1495d9f71 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 404 len: 111 microversion: 2.1 time: 0.065339 May 28 05:25:16.087605 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3480/6845] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:16 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:25:16.213015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-a120098d-13c4-43b4-9e26-632ee22fa51d req-7929409a-7470-41f9-b7e9-fed20557bc31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e3f7410-7e84-4cfc-8202-92b0c4009626", "tag": "2a59e7f7-3185-4668-9adc-3c816f900e01"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:25:16.237650 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a120098d-13c4-43b4-9e26-632ee22fa51d req-7929409a-7470-41f9-b7e9-fed20557bc31 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:16.238116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a120098d-13c4-43b4-9e26-632ee22fa51d req-7929409a-7470-41f9-b7e9-fed20557bc31 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:16.251789 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-a120098d-13c4-43b4-9e26-632ee22fa51d req-7929409a-7470-41f9-b7e9-fed20557bc31 service nova] Creating event network-changed:2a59e7f7-3185-4668-9adc-3c816f900e01 for instance 3e3f7410-7e84-4cfc-8202-92b0c4009626 on n-h2-843700-1 May 28 05:25:16.258424 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-a120098d-13c4-43b4-9e26-632ee22fa51d req-7929409a-7470-41f9-b7e9-fed20557bc31 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051971 May 28 05:25:16.259747 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3366/6846] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:25:16.389468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-724562c8-8d95-436b-a68a-1ed2ec906130 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:16.393667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-724562c8-8d95-436b-a68a-1ed2ec906130 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:16.398017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-724562c8-8d95-436b-a68a-1ed2ec906130 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:16.398504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-724562c8-8d95-436b-a68a-1ed2ec906130 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:16.404119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-724562c8-8d95-436b-a68a-1ed2ec906130 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:16.404507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-724562c8-8d95-436b-a68a-1ed2ec906130 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:16.662169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-724562c8-8d95-436b-a68a-1ed2ec906130 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:16.670744 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-724562c8-8d95-436b-a68a-1ed2ec906130 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626" status: 200 len: 1374 microversion: 2.1 time: 0.285725 May 28 05:25:16.671940 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3481/6847] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:16 2022] GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626 => generated 1374 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:17.690438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-846c984d-589a-4a5a-beba-ab9388b0b3d8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:17.691126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-846c984d-589a-4a5a-beba-ab9388b0b3d8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:17.698176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-846c984d-589a-4a5a-beba-ab9388b0b3d8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:17.698654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-846c984d-589a-4a5a-beba-ab9388b0b3d8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:17.699516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-846c984d-589a-4a5a-beba-ab9388b0b3d8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:17.699980 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-846c984d-589a-4a5a-beba-ab9388b0b3d8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:17.872090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-846c984d-589a-4a5a-beba-ab9388b0b3d8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:17.881552 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-846c984d-589a-4a5a-beba-ab9388b0b3d8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626" status: 200 len: 1374 microversion: 2.1 time: 0.196356 May 28 05:25:17.882356 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3367/6848] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:17 2022] GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626 => generated 1374 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:18.899338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-713c6afb-6ce9-47c5-897a-05792f8ec1ea tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:18.901116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-713c6afb-6ce9-47c5-897a-05792f8ec1ea tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:18.909468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-713c6afb-6ce9-47c5-897a-05792f8ec1ea tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:18.910463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-713c6afb-6ce9-47c5-897a-05792f8ec1ea tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:18.911453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-713c6afb-6ce9-47c5-897a-05792f8ec1ea tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:18.912003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-713c6afb-6ce9-47c5-897a-05792f8ec1ea tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:19.054552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-713c6afb-6ce9-47c5-897a-05792f8ec1ea tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:19.064021 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-713c6afb-6ce9-47c5-897a-05792f8ec1ea tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626" status: 200 len: 1374 microversion: 2.1 time: 0.168806 May 28 05:25:19.064842 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3482/6849] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:18 2022] GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:20.081396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-19b8c77a-b979-49f3-b7e3-4d3c5673e7d9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:20.082962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-19b8c77a-b979-49f3-b7e3-4d3c5673e7d9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:20.091409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-19b8c77a-b979-49f3-b7e3-4d3c5673e7d9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:20.091883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-19b8c77a-b979-49f3-b7e3-4d3c5673e7d9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:20.092692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-19b8c77a-b979-49f3-b7e3-4d3c5673e7d9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:20.093151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-19b8c77a-b979-49f3-b7e3-4d3c5673e7d9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:20.244146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-19b8c77a-b979-49f3-b7e3-4d3c5673e7d9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:20.251916 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-19b8c77a-b979-49f3-b7e3-4d3c5673e7d9 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626" status: 200 len: 1374 microversion: 2.1 time: 0.174678 May 28 05:25:20.252499 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3368/6850] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:20 2022] GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626 => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:21.268795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-df64eadf-f674-45d8-8210-b1ad3a84dba4 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:21.269467 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-df64eadf-f674-45d8-8210-b1ad3a84dba4 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:21.279051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df64eadf-f674-45d8-8210-b1ad3a84dba4 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:21.284815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df64eadf-f674-45d8-8210-b1ad3a84dba4 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:21.284815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df64eadf-f674-45d8-8210-b1ad3a84dba4 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:21.284815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df64eadf-f674-45d8-8210-b1ad3a84dba4 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:21.432127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-df64eadf-f674-45d8-8210-b1ad3a84dba4 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:21.441063 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-df64eadf-f674-45d8-8210-b1ad3a84dba4 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626" status: 200 len: 1374 microversion: 2.1 time: 0.176100 May 28 05:25:21.443138 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3483/6851] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:21 2022] GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626 => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:22.460199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-53585453-3e97-4169-85ef-2d3b4ea8b5e7 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:22.463224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-53585453-3e97-4169-85ef-2d3b4ea8b5e7 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:22.480124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:25:22.485531 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53585453-3e97-4169-85ef-2d3b4ea8b5e7 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:22.486499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53585453-3e97-4169-85ef-2d3b4ea8b5e7 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:22.489423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53585453-3e97-4169-85ef-2d3b4ea8b5e7 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:22.490159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-53585453-3e97-4169-85ef-2d3b4ea8b5e7 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:22.704030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-53585453-3e97-4169-85ef-2d3b4ea8b5e7 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:22.713807 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-53585453-3e97-4169-85ef-2d3b4ea8b5e7 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626" status: 200 len: 1374 microversion: 2.1 time: 0.257709 May 28 05:25:22.715419 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3369/6852] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:22 2022] GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626 => generated 1374 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:22.813459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-64464e25-86ef-445a-8ac3-f94e16798f8f req-7134038b-c28f-4b07-bc08-6e31e6d18ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3f7410-7e84-4cfc-8202-92b0c4009626", "name": "network-vif-plugged", "status": "completed", "tag": "2a59e7f7-3185-4668-9adc-3c816f900e01"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:25:22.826247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:25:22.828775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=10 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:25:22.836780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-64464e25-86ef-445a-8ac3-f94e16798f8f req-7134038b-c28f-4b07-bc08-6e31e6d18ef9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:22.837339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-64464e25-86ef-445a-8ac3-f94e16798f8f req-7134038b-c28f-4b07-bc08-6e31e6d18ef9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:22.854385 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-64464e25-86ef-445a-8ac3-f94e16798f8f req-7134038b-c28f-4b07-bc08-6e31e6d18ef9 service nova] Creating event network-vif-plugged:2a59e7f7-3185-4668-9adc-3c816f900e01 for instance 3e3f7410-7e84-4cfc-8202-92b0c4009626 on n-h2-843700-1 May 28 05:25:22.861689 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-64464e25-86ef-445a-8ac3-f94e16798f8f req-7134038b-c28f-4b07-bc08-6e31e6d18ef9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054481 May 28 05:25:22.864084 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3484/6853] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:25:23.732623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f2d74736-676f-427d-8b88-f092f755f97b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:23.734221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f2d74736-676f-427d-8b88-f092f755f97b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:23.743021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2d74736-676f-427d-8b88-f092f755f97b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:23.743811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2d74736-676f-427d-8b88-f092f755f97b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:23.744964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2d74736-676f-427d-8b88-f092f755f97b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:23.745571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2d74736-676f-427d-8b88-f092f755f97b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:23.910175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f2d74736-676f-427d-8b88-f092f755f97b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:23.927943 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f2d74736-676f-427d-8b88-f092f755f97b tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626" status: 200 len: 1374 microversion: 2.1 time: 0.200646 May 28 05:25:23.929180 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3370/6854] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:23 2022] GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626 => generated 1374 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:24.946927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8f956a23-fa5e-480b-8ac0-36c89c604e41 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:24.947671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8f956a23-fa5e-480b-8ac0-36c89c604e41 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:24.954520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f956a23-fa5e-480b-8ac0-36c89c604e41 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:24.954979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f956a23-fa5e-480b-8ac0-36c89c604e41 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:24.958068 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f956a23-fa5e-480b-8ac0-36c89c604e41 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:24.958068 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f956a23-fa5e-480b-8ac0-36c89c604e41 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:25.098130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8f956a23-fa5e-480b-8ac0-36c89c604e41 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:25.106686 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8f956a23-fa5e-480b-8ac0-36c89c604e41 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626" status: 200 len: 1545 microversion: 2.1 time: 0.165724 May 28 05:25:25.107628 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3485/6855] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:24 2022] GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626 => generated 1545 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:25:25.123925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-824c695d-f3bf-4391-92a7-5a6190cd1e44 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:25.124600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-824c695d-f3bf-4391-92a7-5a6190cd1e44 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:25.131833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-824c695d-f3bf-4391-92a7-5a6190cd1e44 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:25.132303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-824c695d-f3bf-4391-92a7-5a6190cd1e44 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:25.133101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-824c695d-f3bf-4391-92a7-5a6190cd1e44 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:25.133553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-824c695d-f3bf-4391-92a7-5a6190cd1e44 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:25.270438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-824c695d-f3bf-4391-92a7-5a6190cd1e44 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:25.279416 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-824c695d-f3bf-4391-92a7-5a6190cd1e44 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626" status: 200 len: 1545 microversion: 2.1 time: 0.160590 May 28 05:25:25.280279 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3371/6856] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:25 2022] GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626 => generated 1545 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:25.696717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1c3d7acd-d6c4-4020-a44d-fe6968b6a248 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:25.698374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1c3d7acd-d6c4-4020-a44d-fe6968b6a248 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:25.706204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1c3d7acd-d6c4-4020-a44d-fe6968b6a248 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:25.707061 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1c3d7acd-d6c4-4020-a44d-fe6968b6a248 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:25.708893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1c3d7acd-d6c4-4020-a44d-fe6968b6a248 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:25.709649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1c3d7acd-d6c4-4020-a44d-fe6968b6a248 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:25.737589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1c3d7acd-d6c4-4020-a44d-fe6968b6a248 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:25:26.047080 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1c3d7acd-d6c4-4020-a44d-fe6968b6a248 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 204 len: 0 microversion: 2.1 time: 0.354158 May 28 05:25:26.048488 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3486/6857] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:25:25 2022] DELETE /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:25:26.060208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-83c8ced3-f919-4740-90ba-c84b31ebeb97 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:26.060970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-83c8ced3-f919-4740-90ba-c84b31ebeb97 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:26.071368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-83c8ced3-f919-4740-90ba-c84b31ebeb97 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:26.072521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-83c8ced3-f919-4740-90ba-c84b31ebeb97 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:26.075360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-83c8ced3-f919-4740-90ba-c84b31ebeb97 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:26.075903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-83c8ced3-f919-4740-90ba-c84b31ebeb97 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:26.237691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-83c8ced3-f919-4740-90ba-c84b31ebeb97 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:26.248164 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-83c8ced3-f919-4740-90ba-c84b31ebeb97 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1409 microversion: 2.1 time: 0.195323 May 28 05:25:26.251080 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3372/6858] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:26 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1409 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:27.267868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-247a6c96-b8af-4d06-80cc-c206d5c6f718 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:27.269344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-247a6c96-b8af-4d06-80cc-c206d5c6f718 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:27.276720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-247a6c96-b8af-4d06-80cc-c206d5c6f718 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:27.278116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-247a6c96-b8af-4d06-80cc-c206d5c6f718 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:27.286014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-247a6c96-b8af-4d06-80cc-c206d5c6f718 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:27.286014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-247a6c96-b8af-4d06-80cc-c206d5c6f718 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:27.403654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-d86502a3-dfd6-41ef-ada6-880791417124 req-496220b4-a324-43c1-b9e8-3038b43d6ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e3f7410-7e84-4cfc-8202-92b0c4009626", "tag": "2a59e7f7-3185-4668-9adc-3c816f900e01"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:25:27.422177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d86502a3-dfd6-41ef-ada6-880791417124 req-496220b4-a324-43c1-b9e8-3038b43d6ed7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:27.423135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d86502a3-dfd6-41ef-ada6-880791417124 req-496220b4-a324-43c1-b9e8-3038b43d6ed7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:27.429287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=100 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:25:27.454361 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-d86502a3-dfd6-41ef-ada6-880791417124 req-496220b4-a324-43c1-b9e8-3038b43d6ed7 service nova] Creating event network-changed:2a59e7f7-3185-4668-9adc-3c816f900e01 for instance 3e3f7410-7e84-4cfc-8202-92b0c4009626 on n-h2-843700-1 May 28 05:25:27.466475 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-d86502a3-dfd6-41ef-ada6-880791417124 req-496220b4-a324-43c1-b9e8-3038b43d6ed7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065664 May 28 05:25:27.467134 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3373/6859] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:25:27.482927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-247a6c96-b8af-4d06-80cc-c206d5c6f718 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:27.495291 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-247a6c96-b8af-4d06-80cc-c206d5c6f718 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1409 microversion: 2.1 time: 0.230621 May 28 05:25:27.497309 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3487/6860] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:27 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1409 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:28.516688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ec0cd954-5391-453b-b7f1-35f3b2fead3e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:28.518362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ec0cd954-5391-453b-b7f1-35f3b2fead3e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:28.531334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec0cd954-5391-453b-b7f1-35f3b2fead3e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:28.532550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec0cd954-5391-453b-b7f1-35f3b2fead3e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:28.534369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec0cd954-5391-453b-b7f1-35f3b2fead3e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:28.535011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec0cd954-5391-453b-b7f1-35f3b2fead3e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:28.632993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ec0cd954-5391-453b-b7f1-35f3b2fead3e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:28.643852 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ec0cd954-5391-453b-b7f1-35f3b2fead3e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1367 microversion: 2.1 time: 0.133904 May 28 05:25:28.645366 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3374/6861] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:28 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1367 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:29.519105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-18208d01-1fa7-4475-9ada-c624c0d42a81 req-7ecc80e2-4f19-406a-90ed-a57e29068b81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4658f0c2-79f1-4d18-b563-7e1f50d68a3c", "name": "network-vif-deleted", "tag": "adf0a6ae-02fd-4ec6-9b68-8fdcb6f7033e"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:25:29.528408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-18208d01-1fa7-4475-9ada-c624c0d42a81 req-7ecc80e2-4f19-406a-90ed-a57e29068b81 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:29.528854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-18208d01-1fa7-4475-9ada-c624c0d42a81 req-7ecc80e2-4f19-406a-90ed-a57e29068b81 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:29.531948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:25:29.541501 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-18208d01-1fa7-4475-9ada-c624c0d42a81 req-7ecc80e2-4f19-406a-90ed-a57e29068b81 service nova] Creating event network-vif-deleted:adf0a6ae-02fd-4ec6-9b68-8fdcb6f7033e for instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c on n-h2-843700-1 May 28 05:25:29.547720 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-18208d01-1fa7-4475-9ada-c624c0d42a81 req-7ecc80e2-4f19-406a-90ed-a57e29068b81 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032309 May 28 05:25:29.548688 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3488/6862] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:25:29.661563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4156a223-f379-4a9d-b6c5-12fcd66a58ca tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:29.662674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4156a223-f379-4a9d-b6c5-12fcd66a58ca tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:29.670916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4156a223-f379-4a9d-b6c5-12fcd66a58ca tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:29.671530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4156a223-f379-4a9d-b6c5-12fcd66a58ca tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:29.672393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4156a223-f379-4a9d-b6c5-12fcd66a58ca tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:29.672990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4156a223-f379-4a9d-b6c5-12fcd66a58ca tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:29.742271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4156a223-f379-4a9d-b6c5-12fcd66a58ca tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:29.752374 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4156a223-f379-4a9d-b6c5-12fcd66a58ca tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1202 microversion: 2.1 time: 0.094693 May 28 05:25:29.753182 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3375/6863] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:29 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1202 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:30.777140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dfbfa530-c1ea-498b-b8f0-682230fd93ec tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:30.777140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dfbfa530-c1ea-498b-b8f0-682230fd93ec tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:30.785498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dfbfa530-c1ea-498b-b8f0-682230fd93ec tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:30.785498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dfbfa530-c1ea-498b-b8f0-682230fd93ec tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:30.785498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dfbfa530-c1ea-498b-b8f0-682230fd93ec tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:30.785498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dfbfa530-c1ea-498b-b8f0-682230fd93ec tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:30.861828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dfbfa530-c1ea-498b-b8f0-682230fd93ec tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:30.870075 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dfbfa530-c1ea-498b-b8f0-682230fd93ec tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1202 microversion: 2.1 time: 0.103822 May 28 05:25:30.870653 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3489/6864] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:30 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1202 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:31.888037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-972d2698-3b1b-4935-b1df-949f9e2da920 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:31.888910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-972d2698-3b1b-4935-b1df-949f9e2da920 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:31.896553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-972d2698-3b1b-4935-b1df-949f9e2da920 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:31.897154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-972d2698-3b1b-4935-b1df-949f9e2da920 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:31.898053 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-972d2698-3b1b-4935-b1df-949f9e2da920 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:31.899066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-972d2698-3b1b-4935-b1df-949f9e2da920 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:31.967665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-972d2698-3b1b-4935-b1df-949f9e2da920 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:31.975951 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-972d2698-3b1b-4935-b1df-949f9e2da920 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1202 microversion: 2.1 time: 0.092560 May 28 05:25:31.976833 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3376/6865] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:31 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1202 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:32.977615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-670a7bab-33a8-4ccc-b344-475058cd7e10 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-542123429", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:25:32.993041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e09dd329-1dac-4df9-8b71-41a2b97f4ad1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:32.993680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e09dd329-1dac-4df9-8b71-41a2b97f4ad1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:33.001656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e09dd329-1dac-4df9-8b71-41a2b97f4ad1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:33.002266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e09dd329-1dac-4df9-8b71-41a2b97f4ad1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:33.003464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e09dd329-1dac-4df9-8b71-41a2b97f4ad1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:33.004225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e09dd329-1dac-4df9-8b71-41a2b97f4ad1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:33.041312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-670a7bab-33a8-4ccc-b344-475058cd7e10 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] validate_networks() for None {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:25:33.085770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e09dd329-1dac-4df9-8b71-41a2b97f4ad1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:33.094119 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e09dd329-1dac-4df9-8b71-41a2b97f4ad1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1202 microversion: 2.1 time: 0.104993 May 28 05:25:33.094707 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3377/6866] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:32 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1202 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:25:33.252409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-670a7bab-33a8-4ccc-b344-475058cd7e10 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:25:33.253105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-670a7bab-33a8-4ccc-b344-475058cd7e10 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:25:33.253623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-670a7bab-33a8-4ccc-b344-475058cd7e10 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:25:33.254036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-670a7bab-33a8-4ccc-b344-475058cd7e10 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:25:33.254454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-670a7bab-33a8-4ccc-b344-475058cd7e10 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:25:33.263993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-670a7bab-33a8-4ccc-b344-475058cd7e10 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:33.264447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-670a7bab-33a8-4ccc-b344-475058cd7e10 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:33.265253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-670a7bab-33a8-4ccc-b344-475058cd7e10 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:33.265695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-670a7bab-33a8-4ccc-b344-475058cd7e10 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:33.283489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-670a7bab-33a8-4ccc-b344-475058cd7e10 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Getting quotas for project 8101f92a2e854d8a92139f444973b858. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:25:33.288788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-670a7bab-33a8-4ccc-b344-475058cd7e10 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Getting quotas for user 53f6b09a39ed4421811b0331fd09fba4 and project 8101f92a2e854d8a92139f444973b858. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:25:33.301840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-670a7bab-33a8-4ccc-b344-475058cd7e10 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:25:33.304155 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-670a7bab-33a8-4ccc-b344-475058cd7e10 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] [instance: f212189d-2ac3-49a5-8971-41d68a403b16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:25:33.459264 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-670a7bab-33a8-4ccc-b344-475058cd7e10 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.485429 May 28 05:25:33.460326 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3490/6867] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:25:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:25:33.471403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d7248858-11d1-42be-9c2f-cf392ba801bd tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:33.472041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d7248858-11d1-42be-9c2f-cf392ba801bd tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] [instance: f212189d-2ac3-49a5-8971-41d68a403b16] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:33.530506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d7248858-11d1-42be-9c2f-cf392ba801bd tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f6b09a39ed4421811b0331fd09fba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8101f92a2e854d8a92139f444973b858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:33.539376 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d7248858-11d1-42be-9c2f-cf392ba801bd tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] 10.222.0.58 "GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16" status: 200 len: 1214 microversion: 2.1 time: 0.071711 May 28 05:25:33.540571 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3378/6868] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:33 2022] GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:34.111826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6a798a0a-949b-4b2a-ae5a-5cbc94af9ddf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:34.112525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6a798a0a-949b-4b2a-ae5a-5cbc94af9ddf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:34.123166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a798a0a-949b-4b2a-ae5a-5cbc94af9ddf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:34.123694 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a798a0a-949b-4b2a-ae5a-5cbc94af9ddf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:34.124648 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a798a0a-949b-4b2a-ae5a-5cbc94af9ddf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:34.125177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a798a0a-949b-4b2a-ae5a-5cbc94af9ddf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:34.187734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6a798a0a-949b-4b2a-ae5a-5cbc94af9ddf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:34.196056 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6a798a0a-949b-4b2a-ae5a-5cbc94af9ddf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1202 microversion: 2.1 time: 0.089357 May 28 05:25:34.196654 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3491/6869] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:34 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:34.556666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e4be5c7e-bcbd-468b-866f-bf81f938883e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:34.557689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e4be5c7e-bcbd-468b-866f-bf81f938883e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] [instance: f212189d-2ac3-49a5-8971-41d68a403b16] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:34.566937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4be5c7e-bcbd-468b-866f-bf81f938883e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:34.567437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4be5c7e-bcbd-468b-866f-bf81f938883e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:34.568354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4be5c7e-bcbd-468b-866f-bf81f938883e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:34.568810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4be5c7e-bcbd-468b-866f-bf81f938883e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:34.635439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e4be5c7e-bcbd-468b-866f-bf81f938883e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f6b09a39ed4421811b0331fd09fba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8101f92a2e854d8a92139f444973b858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:34.643916 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e4be5c7e-bcbd-468b-866f-bf81f938883e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] 10.222.0.58 "GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16" status: 200 len: 1218 microversion: 2.1 time: 0.091267 May 28 05:25:34.644725 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3379/6870] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:34 2022] GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:35.213501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a73cfb0e-e5ff-4408-9136-561d67d72759 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:35.214210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a73cfb0e-e5ff-4408-9136-561d67d72759 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:35.222689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a73cfb0e-e5ff-4408-9136-561d67d72759 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:35.223172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a73cfb0e-e5ff-4408-9136-561d67d72759 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:35.223941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a73cfb0e-e5ff-4408-9136-561d67d72759 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:35.224379 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a73cfb0e-e5ff-4408-9136-561d67d72759 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:35.306092 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a73cfb0e-e5ff-4408-9136-561d67d72759 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:35.321064 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a73cfb0e-e5ff-4408-9136-561d67d72759 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1202 microversion: 2.1 time: 0.111336 May 28 05:25:35.323024 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3492/6871] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:35 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1202 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:25:35.661322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-df0dbb08-70e6-4540-82ab-a984031d85f9 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:35.661969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-df0dbb08-70e6-4540-82ab-a984031d85f9 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] [instance: f212189d-2ac3-49a5-8971-41d68a403b16] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:35.669063 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df0dbb08-70e6-4540-82ab-a984031d85f9 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:35.670405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df0dbb08-70e6-4540-82ab-a984031d85f9 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:35.671280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df0dbb08-70e6-4540-82ab-a984031d85f9 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:35.671746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-df0dbb08-70e6-4540-82ab-a984031d85f9 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:35.800926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-df0dbb08-70e6-4540-82ab-a984031d85f9 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f6b09a39ed4421811b0331fd09fba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8101f92a2e854d8a92139f444973b858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:35.814690 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-df0dbb08-70e6-4540-82ab-a984031d85f9 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] 10.222.0.58 "GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16" status: 200 len: 1272 microversion: 2.1 time: 0.156487 May 28 05:25:35.823081 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3380/6872] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:35 2022] GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16 => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:36.339137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8ae3065b-f25f-43aa-8ed8-ecee63dbf6f6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:36.340512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8ae3065b-f25f-43aa-8ed8-ecee63dbf6f6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:36.348274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ae3065b-f25f-43aa-8ed8-ecee63dbf6f6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:36.349115 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ae3065b-f25f-43aa-8ed8-ecee63dbf6f6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:36.350121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ae3065b-f25f-43aa-8ed8-ecee63dbf6f6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:36.350805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ae3065b-f25f-43aa-8ed8-ecee63dbf6f6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:36.431159 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8ae3065b-f25f-43aa-8ed8-ecee63dbf6f6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:36.440158 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8ae3065b-f25f-43aa-8ed8-ecee63dbf6f6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1202 microversion: 2.1 time: 0.104969 May 28 05:25:36.441498 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3493/6873] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:36 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1202 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:36.833077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-22b34083-cb6a-4253-bf20-d8aa493b98f1 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:36.835105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-22b34083-cb6a-4253-bf20-d8aa493b98f1 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] [instance: f212189d-2ac3-49a5-8971-41d68a403b16] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:36.851048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22b34083-cb6a-4253-bf20-d8aa493b98f1 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:36.851048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22b34083-cb6a-4253-bf20-d8aa493b98f1 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:36.851048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22b34083-cb6a-4253-bf20-d8aa493b98f1 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:36.851048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22b34083-cb6a-4253-bf20-d8aa493b98f1 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:37.080442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-22b34083-cb6a-4253-bf20-d8aa493b98f1 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f6b09a39ed4421811b0331fd09fba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8101f92a2e854d8a92139f444973b858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:37.096918 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-22b34083-cb6a-4253-bf20-d8aa493b98f1 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] 10.222.0.58 "GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16" status: 200 len: 1314 microversion: 2.1 time: 0.265599 May 28 05:25:37.098046 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3381/6874] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:36 2022] GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:37.294935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-24ab0a17-683b-414b-8607-ca16a3ba39b8 req-d7ba807b-c3f8-4922-a829-ede8d826b9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f212189d-2ac3-49a5-8971-41d68a403b16", "tag": "1b0e0319-71da-4d51-a523-3519a0cc6d35"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:25:37.303797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-24ab0a17-683b-414b-8607-ca16a3ba39b8 req-d7ba807b-c3f8-4922-a829-ede8d826b9f6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:37.304526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-24ab0a17-683b-414b-8607-ca16a3ba39b8 req-d7ba807b-c3f8-4922-a829-ede8d826b9f6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:37.317108 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-24ab0a17-683b-414b-8607-ca16a3ba39b8 req-d7ba807b-c3f8-4922-a829-ede8d826b9f6 service nova] Creating event network-changed:1b0e0319-71da-4d51-a523-3519a0cc6d35 for instance f212189d-2ac3-49a5-8971-41d68a403b16 on n-h1-843700-1 May 28 05:25:37.322431 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-24ab0a17-683b-414b-8607-ca16a3ba39b8 req-d7ba807b-c3f8-4922-a829-ede8d826b9f6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033470 May 28 05:25:37.323789 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3494/6875] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:25:37.458397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b02cb023-e61b-4239-a52f-33bd9fdd232f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:37.460709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b02cb023-e61b-4239-a52f-33bd9fdd232f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:37.468159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b02cb023-e61b-4239-a52f-33bd9fdd232f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:37.469569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b02cb023-e61b-4239-a52f-33bd9fdd232f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:37.470754 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b02cb023-e61b-4239-a52f-33bd9fdd232f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:37.471475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b02cb023-e61b-4239-a52f-33bd9fdd232f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:37.545763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b02cb023-e61b-4239-a52f-33bd9fdd232f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:37.563136 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b02cb023-e61b-4239-a52f-33bd9fdd232f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1202 microversion: 2.1 time: 0.109330 May 28 05:25:37.563752 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3382/6876] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:37 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1202 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:38.115260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-836b3837-864e-4f0a-aaa9-828ebf46a6b1 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:38.115974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-836b3837-864e-4f0a-aaa9-828ebf46a6b1 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] [instance: f212189d-2ac3-49a5-8971-41d68a403b16] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:38.123147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-836b3837-864e-4f0a-aaa9-828ebf46a6b1 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:38.123841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-836b3837-864e-4f0a-aaa9-828ebf46a6b1 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:38.124649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-836b3837-864e-4f0a-aaa9-828ebf46a6b1 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:38.125088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-836b3837-864e-4f0a-aaa9-828ebf46a6b1 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:38.581320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-23d43de3-c058-4acb-a99f-c074d33501fa tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:38.582509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-23d43de3-c058-4acb-a99f-c074d33501fa tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:38.591938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-836b3837-864e-4f0a-aaa9-828ebf46a6b1 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f6b09a39ed4421811b0331fd09fba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8101f92a2e854d8a92139f444973b858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:38.597232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23d43de3-c058-4acb-a99f-c074d33501fa tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:38.600686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23d43de3-c058-4acb-a99f-c074d33501fa tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:38.600686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23d43de3-c058-4acb-a99f-c074d33501fa tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:38.601209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23d43de3-c058-4acb-a99f-c074d33501fa tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:38.609586 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-836b3837-864e-4f0a-aaa9-828ebf46a6b1 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] 10.222.0.58 "GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16" status: 200 len: 1314 microversion: 2.1 time: 0.498972 May 28 05:25:38.610064 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3495/6877] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:38 2022] GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16 => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:38.648673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23d43de3-c058-4acb-a99f-c074d33501fa tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:38.649158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-23d43de3-c058-4acb-a99f-c074d33501fa tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:38.649669 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-23d43de3-c058-4acb-a99f-c074d33501fa tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lazy-loading 'fault' on Instance uuid 4658f0c2-79f1-4d18-b563-7e1f50d68a3c {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:25:38.692210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-23d43de3-c058-4acb-a99f-c074d33501fa tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:38.700957 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-23d43de3-c058-4acb-a99f-c074d33501fa tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 200 len: 1207 microversion: 2.1 time: 0.124429 May 28 05:25:38.701863 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3383/6878] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:38 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 1207 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:39.626043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5d1ffde2-89cd-4e10-8877-971eb0b71ab0 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:39.626755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5d1ffde2-89cd-4e10-8877-971eb0b71ab0 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] [instance: f212189d-2ac3-49a5-8971-41d68a403b16] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:39.633974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d1ffde2-89cd-4e10-8877-971eb0b71ab0 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:39.634662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d1ffde2-89cd-4e10-8877-971eb0b71ab0 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:39.635474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d1ffde2-89cd-4e10-8877-971eb0b71ab0 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:39.635924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d1ffde2-89cd-4e10-8877-971eb0b71ab0 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:39.718364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-76b7a3af-ad2d-4c53-baf2-e2f1db1d10d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:39.719107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-76b7a3af-ad2d-4c53-baf2-e2f1db1d10d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:39.727517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76b7a3af-ad2d-4c53-baf2-e2f1db1d10d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:39.727986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76b7a3af-ad2d-4c53-baf2-e2f1db1d10d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:39.728787 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76b7a3af-ad2d-4c53-baf2-e2f1db1d10d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:39.729239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76b7a3af-ad2d-4c53-baf2-e2f1db1d10d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:39.745991 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-76b7a3af-ad2d-4c53-baf2-e2f1db1d10d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] HTTP exception thrown: Instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c could not be found. May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-76b7a3af-ad2d-4c53-baf2-e2f1db1d10d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Request method failure captured: May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c HTTP/1.1 May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbDlrqJvsw-Bj4hemx4XscPzQgI57Oj0DhtZ0WItt0VxFXFIUFqzN1b2sr7MK3BjOGQZJbLNmoClfshSjagkFRTmogQaQpoLYEaPQkaSagOXWAKjyAlGGxZFI9I-y-IJo4VhS_mMCbBct4nVbcF58kjzhMiK5F2slw20hRu7zD2W154 May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestVolumeBootPattern-934660757 May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestVolumeBootPattern-934660757-project May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: a33708c760574b0698fc16ddfebad05b May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestVolumeBootPattern-934660757-project May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c could not be found. May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '4658f0c2-79f1-4d18-b563-7e1f50d68a3c'} May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c could not be found. May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c could not be found. May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:25:39.747748 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:25:39.752808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:39.752808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:25:39.752808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:25:39.752808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:25:39.752808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:25:39.752808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c could not be found. May 28 05:25:39.752808 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:25:39.752808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-76b7a3af-ad2d-4c53-baf2-e2f1db1d10d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Returning 404 to user: Instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:25:39.752808 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-76b7a3af-ad2d-4c53-baf2-e2f1db1d10d5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 404 len: 111 microversion: 2.1 time: 0.035412 May 28 05:25:39.752808 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3384/6879] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:39 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:25:39.802294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5d1ffde2-89cd-4e10-8877-971eb0b71ab0 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f6b09a39ed4421811b0331fd09fba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8101f92a2e854d8a92139f444973b858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:39.811050 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5d1ffde2-89cd-4e10-8877-971eb0b71ab0 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] 10.222.0.58 "GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16" status: 200 len: 1314 microversion: 2.1 time: 0.188974 May 28 05:25:39.811676 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3496/6880] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:39 2022] GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:40.830287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5aa45d69-b351-467e-985d-9ef3b012ed5d tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:40.830950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5aa45d69-b351-467e-985d-9ef3b012ed5d tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] [instance: f212189d-2ac3-49a5-8971-41d68a403b16] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:40.837922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5aa45d69-b351-467e-985d-9ef3b012ed5d tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:40.838579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5aa45d69-b351-467e-985d-9ef3b012ed5d tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:40.840235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5aa45d69-b351-467e-985d-9ef3b012ed5d tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:40.840780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5aa45d69-b351-467e-985d-9ef3b012ed5d tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:40.981667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5aa45d69-b351-467e-985d-9ef3b012ed5d tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f6b09a39ed4421811b0331fd09fba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8101f92a2e854d8a92139f444973b858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:40.990636 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5aa45d69-b351-467e-985d-9ef3b012ed5d tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] 10.222.0.58 "GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16" status: 200 len: 1314 microversion: 2.1 time: 0.164428 May 28 05:25:40.991828 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3385/6881] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:40 2022] GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:41.746964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-b4d7e0ba-34d4-46c9-acfe-346da41adece req-ff18c108-79ea-4456-b8eb-54406e84ad1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f212189d-2ac3-49a5-8971-41d68a403b16", "name": "network-vif-plugged", "status": "completed", "tag": "1b0e0319-71da-4d51-a523-3519a0cc6d35"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:25:41.755897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b4d7e0ba-34d4-46c9-acfe-346da41adece req-ff18c108-79ea-4456-b8eb-54406e84ad1d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:41.756341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b4d7e0ba-34d4-46c9-acfe-346da41adece req-ff18c108-79ea-4456-b8eb-54406e84ad1d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:41.767465 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-b4d7e0ba-34d4-46c9-acfe-346da41adece req-ff18c108-79ea-4456-b8eb-54406e84ad1d service nova] Creating event network-vif-plugged:1b0e0319-71da-4d51-a523-3519a0cc6d35 for instance f212189d-2ac3-49a5-8971-41d68a403b16 on n-h1-843700-1 May 28 05:25:41.772924 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-b4d7e0ba-34d4-46c9-acfe-346da41adece req-ff18c108-79ea-4456-b8eb-54406e84ad1d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030931 May 28 05:25:41.773550 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3497/6882] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:25:42.008406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8957f706-9b8a-4a26-ac1b-95a1338f3e1a tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:42.009217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8957f706-9b8a-4a26-ac1b-95a1338f3e1a tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] [instance: f212189d-2ac3-49a5-8971-41d68a403b16] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:42.016776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8957f706-9b8a-4a26-ac1b-95a1338f3e1a tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:42.020391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8957f706-9b8a-4a26-ac1b-95a1338f3e1a tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:42.020391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8957f706-9b8a-4a26-ac1b-95a1338f3e1a tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:42.020391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8957f706-9b8a-4a26-ac1b-95a1338f3e1a tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:42.158536 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8957f706-9b8a-4a26-ac1b-95a1338f3e1a tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f6b09a39ed4421811b0331fd09fba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8101f92a2e854d8a92139f444973b858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:42.166263 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8957f706-9b8a-4a26-ac1b-95a1338f3e1a tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] 10.222.0.58 "GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16" status: 200 len: 1314 microversion: 2.1 time: 0.162486 May 28 05:25:42.166850 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3386/6883] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:42 2022] GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:43.185244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1f455556-96bc-416f-be91-76ffb0c6526e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:43.186611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1f455556-96bc-416f-be91-76ffb0c6526e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] [instance: f212189d-2ac3-49a5-8971-41d68a403b16] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:43.193571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f455556-96bc-416f-be91-76ffb0c6526e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:43.194039 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f455556-96bc-416f-be91-76ffb0c6526e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:43.194839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f455556-96bc-416f-be91-76ffb0c6526e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:43.195316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f455556-96bc-416f-be91-76ffb0c6526e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:43.273195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:25:43.295821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:25:43.332710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1f455556-96bc-416f-be91-76ffb0c6526e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f6b09a39ed4421811b0331fd09fba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8101f92a2e854d8a92139f444973b858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:43.340930 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1f455556-96bc-416f-be91-76ffb0c6526e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] 10.222.0.58 "GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16" status: 200 len: 1464 microversion: 2.1 time: 0.161784 May 28 05:25:43.341508 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3498/6884] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:43 2022] GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16 => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:43.380185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bed0516b-6611-45ec-a709-9b80e6038b38 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:43.380710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bed0516b-6611-45ec-a709-9b80e6038b38 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] [instance: f212189d-2ac3-49a5-8971-41d68a403b16] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:43.387897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bed0516b-6611-45ec-a709-9b80e6038b38 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:43.388376 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bed0516b-6611-45ec-a709-9b80e6038b38 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:43.389167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bed0516b-6611-45ec-a709-9b80e6038b38 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:43.389629 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bed0516b-6611-45ec-a709-9b80e6038b38 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:43.416224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bed0516b-6611-45ec-a709-9b80e6038b38 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] [instance: f212189d-2ac3-49a5-8971-41d68a403b16] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:25:43.535763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:25:43.646794 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bed0516b-6611-45ec-a709-9b80e6038b38 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16" status: 204 len: 0 microversion: 2.1 time: 0.270190 May 28 05:25:43.647435 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3387/6885] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:25:43 2022] DELETE /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:25:43.658766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-98c8bf94-a5ff-49b2-bf08-64d63799bf75 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:43.659415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-98c8bf94-a5ff-49b2-bf08-64d63799bf75 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] [instance: f212189d-2ac3-49a5-8971-41d68a403b16] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:43.666757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-98c8bf94-a5ff-49b2-bf08-64d63799bf75 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:43.667864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-98c8bf94-a5ff-49b2-bf08-64d63799bf75 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:43.668642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-98c8bf94-a5ff-49b2-bf08-64d63799bf75 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:43.669078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-98c8bf94-a5ff-49b2-bf08-64d63799bf75 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:43.801856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-98c8bf94-a5ff-49b2-bf08-64d63799bf75 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f6b09a39ed4421811b0331fd09fba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8101f92a2e854d8a92139f444973b858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:43.813349 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-98c8bf94-a5ff-49b2-bf08-64d63799bf75 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] 10.222.0.58 "GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16" status: 200 len: 1470 microversion: 2.1 time: 0.155559 May 28 05:25:43.813349 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3499/6886] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:43 2022] GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:44.002638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b65dca2e-389e-41ab-97d3-aae981a40a9e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:44.003398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b65dca2e-389e-41ab-97d3-aae981a40a9e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:44.009624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b65dca2e-389e-41ab-97d3-aae981a40a9e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:44.010157 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b65dca2e-389e-41ab-97d3-aae981a40a9e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:44.011743 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b65dca2e-389e-41ab-97d3-aae981a40a9e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:44.012301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b65dca2e-389e-41ab-97d3-aae981a40a9e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:44.026128 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-b65dca2e-389e-41ab-97d3-aae981a40a9e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] HTTP exception thrown: Instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf could not be found. May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b65dca2e-389e-41ab-97d3-aae981a40a9e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Request method failure captured: May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf HTTP/1.1 May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbDlrqJvsw-Bj4hemx4XscPzQgI57Oj0DhtZ0WItt0VxFXFIUFqzN1b2sr7MK3BjOGQZJbLNmoClfshSjagkFRTmogQaQpoLYEaPQkaSagOXWAKjyAlGGxZFI9I-y-IJo4VhS_mMCbBct4nVbcF58kjzhMiK5F2slw20hRu7zD2W154 May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestVolumeBootPattern-934660757 May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestVolumeBootPattern-934660757-project May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: a33708c760574b0698fc16ddfebad05b May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestVolumeBootPattern-934660757-project May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf could not be found. May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'd5f9da76-6315-495f-a8e5-0bfa20d2e6cf'} May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf could not be found. May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:25:44.028486 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:25:44.033262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf could not be found. May 28 05:25:44.033262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:25:44.033262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:25:44.033262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:25:44.033262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:44.033262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:25:44.033262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:25:44.033262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:25:44.033262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:25:44.033262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf could not be found. May 28 05:25:44.033262 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:25:44.033262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b65dca2e-389e-41ab-97d3-aae981a40a9e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Returning 404 to user: Instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:25:44.033262 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b65dca2e-389e-41ab-97d3-aae981a40a9e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 404 len: 111 microversion: 2.1 time: 0.031683 May 28 05:25:44.033262 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3388/6887] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:25:43 2022] DELETE /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:25:44.039334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1bf0e341-cb4e-4a38-8d59-57416e970a64 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:44.040082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1bf0e341-cb4e-4a38-8d59-57416e970a64 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d5f9da76-6315-495f-a8e5-0bfa20d2e6cf] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:44.046444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1bf0e341-cb4e-4a38-8d59-57416e970a64 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:44.046970 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1bf0e341-cb4e-4a38-8d59-57416e970a64 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:44.047838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1bf0e341-cb4e-4a38-8d59-57416e970a64 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:44.048344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1bf0e341-cb4e-4a38-8d59-57416e970a64 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:44.064605 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-1bf0e341-cb4e-4a38-8d59-57416e970a64 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] HTTP exception thrown: Instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf could not be found. May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1bf0e341-cb4e-4a38-8d59-57416e970a64 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Request method failure captured: May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf HTTP/1.1 May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbDlrqJvsw-Bj4hemx4XscPzQgI57Oj0DhtZ0WItt0VxFXFIUFqzN1b2sr7MK3BjOGQZJbLNmoClfshSjagkFRTmogQaQpoLYEaPQkaSagOXWAKjyAlGGxZFI9I-y-IJo4VhS_mMCbBct4nVbcF58kjzhMiK5F2slw20hRu7zD2W154 May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TestVolumeBootPattern-934660757 May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TestVolumeBootPattern-934660757-project May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: a33708c760574b0698fc16ddfebad05b May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TestVolumeBootPattern-934660757-project May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf could not be found. May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'd5f9da76-6315-495f-a8e5-0bfa20d2e6cf'} May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf could not be found. May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf could not be found. May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:25:44.066284 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:25:44.070306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:44.070306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:25:44.070306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:25:44.070306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:25:44.070306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:25:44.070306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf could not be found. May 28 05:25:44.070306 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:25:44.070306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1bf0e341-cb4e-4a38-8d59-57416e970a64 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Returning 404 to user: Instance d5f9da76-6315-495f-a8e5-0bfa20d2e6cf could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:25:44.070306 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1bf0e341-cb4e-4a38-8d59-57416e970a64 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf" status: 404 len: 111 microversion: 2.1 time: 0.032254 May 28 05:25:44.072085 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3500/6888] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:44 2022] GET /compute/v2.1/servers/d5f9da76-6315-495f-a8e5-0bfa20d2e6cf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:25:44.827382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-057c6c4a-1941-4d0d-9267-f79c6bdc5a9c tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:44.828021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-057c6c4a-1941-4d0d-9267-f79c6bdc5a9c tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] [instance: f212189d-2ac3-49a5-8971-41d68a403b16] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:44.835615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-057c6c4a-1941-4d0d-9267-f79c6bdc5a9c tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:44.837187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-057c6c4a-1941-4d0d-9267-f79c6bdc5a9c tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:44.837187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-057c6c4a-1941-4d0d-9267-f79c6bdc5a9c tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:44.837423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-057c6c4a-1941-4d0d-9267-f79c6bdc5a9c tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:45.019792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-39ca3222-e3bb-4e32-958b-6856813ec460 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:45.021374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-39ca3222-e3bb-4e32-958b-6856813ec460 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:45.022856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-057c6c4a-1941-4d0d-9267-f79c6bdc5a9c tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f6b09a39ed4421811b0331fd09fba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8101f92a2e854d8a92139f444973b858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:45.029017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:25:45.031580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39ca3222-e3bb-4e32-958b-6856813ec460 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:45.032400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39ca3222-e3bb-4e32-958b-6856813ec460 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:45.033040 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-057c6c4a-1941-4d0d-9267-f79c6bdc5a9c tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] 10.222.0.58 "GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16" status: 200 len: 1470 microversion: 2.1 time: 0.209423 May 28 05:25:45.033339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39ca3222-e3bb-4e32-958b-6856813ec460 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:45.033844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39ca3222-e3bb-4e32-958b-6856813ec460 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:45.034160 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3389/6889] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:44 2022] GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16 => generated 1470 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:25:45.049434 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-39ca3222-e3bb-4e32-958b-6856813ec460 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] HTTP exception thrown: Instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c could not be found. May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-39ca3222-e3bb-4e32-958b-6856813ec460 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Request method failure captured: May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c HTTP/1.1 May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbDlrqJvsw-Bj4hemx4XscPzQgI57Oj0DhtZ0WItt0VxFXFIUFqzN1b2sr7MK3BjOGQZJbLNmoClfshSjagkFRTmogQaQpoLYEaPQkaSagOXWAKjyAlGGxZFI9I-y-IJo4VhS_mMCbBct4nVbcF58kjzhMiK5F2slw20hRu7zD2W154 May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TestVolumeBootPattern-934660757 May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TestVolumeBootPattern-934660757-project May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: a33708c760574b0698fc16ddfebad05b May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TestVolumeBootPattern-934660757-project May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c could not be found. May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '4658f0c2-79f1-4d18-b563-7e1f50d68a3c'} May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c could not be found. May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:25:45.051025 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:25:45.055501 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c could not be found. May 28 05:25:45.055501 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:25:45.055501 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:25:45.055501 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:25:45.055501 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:45.055501 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:25:45.055501 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:25:45.055501 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:25:45.055501 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:25:45.055501 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c could not be found. May 28 05:25:45.055501 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:25:45.057037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-39ca3222-e3bb-4e32-958b-6856813ec460 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Returning 404 to user: Instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:25:45.057942 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-39ca3222-e3bb-4e32-958b-6856813ec460 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 404 len: 111 microversion: 2.1 time: 0.043281 May 28 05:25:45.058657 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3501/6890] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:25:45 2022] DELETE /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:25:45.067095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-31852465-59de-4af8-8fb9-c8562344f9b4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:45.067857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-31852465-59de-4af8-8fb9-c8562344f9b4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 4658f0c2-79f1-4d18-b563-7e1f50d68a3c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:45.074352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31852465-59de-4af8-8fb9-c8562344f9b4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:45.074830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31852465-59de-4af8-8fb9-c8562344f9b4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:45.075656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31852465-59de-4af8-8fb9-c8562344f9b4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:45.076288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31852465-59de-4af8-8fb9-c8562344f9b4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:45.097794 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-31852465-59de-4af8-8fb9-c8562344f9b4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] HTTP exception thrown: Instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c could not be found. May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-31852465-59de-4af8-8fb9-c8562344f9b4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Request method failure captured: May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c HTTP/1.1 May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbDlrqJvsw-Bj4hemx4XscPzQgI57Oj0DhtZ0WItt0VxFXFIUFqzN1b2sr7MK3BjOGQZJbLNmoClfshSjagkFRTmogQaQpoLYEaPQkaSagOXWAKjyAlGGxZFI9I-y-IJo4VhS_mMCbBct4nVbcF58kjzhMiK5F2slw20hRu7zD2W154 May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestVolumeBootPattern-934660757 May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestVolumeBootPattern-934660757-project May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: a33708c760574b0698fc16ddfebad05b May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestVolumeBootPattern-934660757-project May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c could not be found. May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '4658f0c2-79f1-4d18-b563-7e1f50d68a3c'} May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c could not be found. May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c could not be found. May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:25:45.099814 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:25:45.105280 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:45.105280 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:25:45.105280 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:25:45.105280 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:25:45.105280 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:25:45.105280 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c could not be found. May 28 05:25:45.105280 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:25:45.107178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-31852465-59de-4af8-8fb9-c8562344f9b4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Returning 404 to user: Instance 4658f0c2-79f1-4d18-b563-7e1f50d68a3c could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:25:45.108375 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-31852465-59de-4af8-8fb9-c8562344f9b4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c" status: 404 len: 111 microversion: 2.1 time: 0.045410 May 28 05:25:45.112465 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3390/6891] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:45 2022] GET /compute/v2.1/servers/4658f0c2-79f1-4d18-b563-7e1f50d68a3c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:25:45.217624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2a6f880a-fef9-4daf-a7dc-67f7d854f8ed tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Action: 'create', calling method: .version_select at 0x7f77007b9940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1662296462", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoBNtM0t956pFUr6WkTRn2k6Rb1Vf0kHyIia7u0SLX4KTZdTZcV4g875E/945QeJW/RXsdCizRkANQ06/wdoZqstfdpnsd0lbi7EKNtFyCGdz+txDMbDfVqMfo05NfTIg=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:25:45.232364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-2a6f880a-fef9-4daf-a7dc-67f7d854f8ed tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Getting quotas for project e45163cf20a447a0a60bc0c0f075fa78. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:25:45.238095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-2a6f880a-fef9-4daf-a7dc-67f7d854f8ed tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Getting quotas for user a33708c760574b0698fc16ddfebad05b and project e45163cf20a447a0a60bc0c0f075fa78. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:25:45.299420 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2a6f880a-fef9-4daf-a7dc-67f7d854f8ed tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.086541 May 28 05:25:45.305144 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3502/6892] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 05:25:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:25:45.575925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-fadd0e87-a752-43e0-ab81-f19fcbe5b446 req-7109aa13-dcb0-4e1d-9a40-f7788b15f464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f212189d-2ac3-49a5-8971-41d68a403b16", "name": "network-vif-deleted", "tag": "1b0e0319-71da-4d51-a523-3519a0cc6d35"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:25:45.581419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:25:45.586079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-fadd0e87-a752-43e0-ab81-f19fcbe5b446 req-7109aa13-dcb0-4e1d-9a40-f7788b15f464 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:45.586887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-fadd0e87-a752-43e0-ab81-f19fcbe5b446 req-7109aa13-dcb0-4e1d-9a40-f7788b15f464 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:45.600374 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-fadd0e87-a752-43e0-ab81-f19fcbe5b446 req-7109aa13-dcb0-4e1d-9a40-f7788b15f464 service nova] Creating event network-vif-deleted:1b0e0319-71da-4d51-a523-3519a0cc6d35 for instance f212189d-2ac3-49a5-8971-41d68a403b16 on n-h1-843700-1 May 28 05:25:45.606106 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-fadd0e87-a752-43e0-ab81-f19fcbe5b446 req-7109aa13-dcb0-4e1d-9a40-f7788b15f464 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034382 May 28 05:25:45.607988 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3391/6893] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:25:46.054666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bdb27618-a66f-4470-8d30-a2bb4a1cc619 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:46.055304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bdb27618-a66f-4470-8d30-a2bb4a1cc619 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] [instance: f212189d-2ac3-49a5-8971-41d68a403b16] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:46.062536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdb27618-a66f-4470-8d30-a2bb4a1cc619 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:46.063085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdb27618-a66f-4470-8d30-a2bb4a1cc619 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:46.063856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdb27618-a66f-4470-8d30-a2bb4a1cc619 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:46.064302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdb27618-a66f-4470-8d30-a2bb4a1cc619 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:46.096110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdb27618-a66f-4470-8d30-a2bb4a1cc619 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:46.096575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdb27618-a66f-4470-8d30-a2bb4a1cc619 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:46.097030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-bdb27618-a66f-4470-8d30-a2bb4a1cc619 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lazy-loading 'fault' on Instance uuid f212189d-2ac3-49a5-8971-41d68a403b16 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:25:46.141913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bdb27618-a66f-4470-8d30-a2bb4a1cc619 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f6b09a39ed4421811b0331fd09fba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8101f92a2e854d8a92139f444973b858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:46.149584 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bdb27618-a66f-4470-8d30-a2bb4a1cc619 tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] 10.222.0.58 "GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16" status: 200 len: 1304 microversion: 2.1 time: 0.099784 May 28 05:25:46.150168 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3503/6894] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:46 2022] GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:47.170497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8886bb2b-0734-4abb-b8e6-8d3ace73154e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:47.172571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8886bb2b-0734-4abb-b8e6-8d3ace73154e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] [instance: f212189d-2ac3-49a5-8971-41d68a403b16] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:47.177901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8886bb2b-0734-4abb-b8e6-8d3ace73154e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:47.178370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8886bb2b-0734-4abb-b8e6-8d3ace73154e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:47.179233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8886bb2b-0734-4abb-b8e6-8d3ace73154e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:47.179684 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8886bb2b-0734-4abb-b8e6-8d3ace73154e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:47.183881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:25:47.193250 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-8886bb2b-0734-4abb-b8e6-8d3ace73154e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] HTTP exception thrown: Instance f212189d-2ac3-49a5-8971-41d68a403b16 could not be found. May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8886bb2b-0734-4abb-b8e6-8d3ace73154e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Request method failure captured: May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16 HTTP/1.1 May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbJJOs1L1nZwM_GVoGnPrBhOfWn7xQUSsiKLoUVUh1ZTsRCqUgNDl-sR_RwjP7rrCkzJhWYAWZWBd9acKlUrcgiBcgSY33Dpg6xcMsMElCxrkScrNaib--NXLVl-ME2HnzAWr2uw8rXvs_J8Px7Bgs-9dcUipKtW4aHlkU3cMqumUoE May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 8101f92a2e854d8a92139f444973b858 May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-VolumesNegativeTest-1860584726 May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8101f92a2e854d8a92139f444973b858"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8101f92a2e854d8a92139f444973b858"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8101f92a2e854d8a92139f444973b858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8101f92a2e854d8a92139f444973b858"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-VolumesNegativeTest-1860584726 May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 8101f92a2e854d8a92139f444973b858 May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-VolumesNegativeTest-1860584726 May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-VolumesNegativeTest-1860584726-project May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 53f6b09a39ed4421811b0331fd09fba4 May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-VolumesNegativeTest-1860584726-project May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance f212189d-2ac3-49a5-8971-41d68a403b16 could not be found. May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'f212189d-2ac3-49a5-8971-41d68a403b16'} May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f212189d-2ac3-49a5-8971-41d68a403b16 could not be found. May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f212189d-2ac3-49a5-8971-41d68a403b16 could not be found. May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:25:47.194935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:25:47.200030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:25:47.200030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:25:47.200030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:25:47.200030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:25:47.200030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:25:47.200030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f212189d-2ac3-49a5-8971-41d68a403b16 could not be found. May 28 05:25:47.200030 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:25:47.200030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8886bb2b-0734-4abb-b8e6-8d3ace73154e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] Returning 404 to user: Instance f212189d-2ac3-49a5-8971-41d68a403b16 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:25:47.200030 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8886bb2b-0734-4abb-b8e6-8d3ace73154e tempest-VolumesNegativeTest-1860584726 tempest-VolumesNegativeTest-1860584726-project] 10.222.0.58 "GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16" status: 404 len: 111 microversion: 2.1 time: 0.032309 May 28 05:25:47.200030 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3392/6895] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:47 2022] GET /compute/v2.1/servers/f212189d-2ac3-49a5-8971-41d68a403b16 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:25:49.756890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e7d2e7f4-0542-4fef-be57-e847ead9537c tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:25:49.758423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e7d2e7f4-0542-4fef-be57-e847ead9537c tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:49.767414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e7d2e7f4-0542-4fef-be57-e847ead9537c tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:49.768508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e7d2e7f4-0542-4fef-be57-e847ead9537c tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:49.769815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e7d2e7f4-0542-4fef-be57-e847ead9537c tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:49.770674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e7d2e7f4-0542-4fef-be57-e847ead9537c tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:49.830360 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e7d2e7f4-0542-4fef-be57-e847ead9537c tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "POST /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626/action" status: 200 len: 24569 microversion: 2.1 time: 0.077931 May 28 05:25:49.832282 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3504/6896] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:25:49 2022] POST /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626/action => generated 24569 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 05:25:56.317006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4a4b334e-9d5e-47a1-953e-f447065431ff tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:25:56.318894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4a4b334e-9d5e-47a1-953e-f447065431ff tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:56.329908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4a4b334e-9d5e-47a1-953e-f447065431ff tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:56.330710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4a4b334e-9d5e-47a1-953e-f447065431ff tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:56.331769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4a4b334e-9d5e-47a1-953e-f447065431ff tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:56.332284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4a4b334e-9d5e-47a1-953e-f447065431ff tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:56.394917 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4a4b334e-9d5e-47a1-953e-f447065431ff tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "POST /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626/action" status: 200 len: 32642 microversion: 2.1 time: 0.081968 May 28 05:25:56.396788 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3393/6897] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:25:56 2022] POST /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626/action => generated 32642 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:25:57.741807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef026e4f-8867-4c29-8e5a-5b98ab8b8fdc tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:57.743053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ef026e4f-8867-4c29-8e5a-5b98ab8b8fdc tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:57.746858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:25:57.759496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef026e4f-8867-4c29-8e5a-5b98ab8b8fdc tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:57.759496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef026e4f-8867-4c29-8e5a-5b98ab8b8fdc tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:57.759496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef026e4f-8867-4c29-8e5a-5b98ab8b8fdc tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:57.759496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef026e4f-8867-4c29-8e5a-5b98ab8b8fdc tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:57.767804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-2e526ace-ef96-4fb5-b76e-1ea950bb0085 req-98270c88-7fcb-4462-b088-1f41a48dea31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e3f7410-7e84-4cfc-8202-92b0c4009626", "tag": "2a59e7f7-3185-4668-9adc-3c816f900e01"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:25:57.796534 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2e526ace-ef96-4fb5-b76e-1ea950bb0085 req-98270c88-7fcb-4462-b088-1f41a48dea31 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:57.797400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2e526ace-ef96-4fb5-b76e-1ea950bb0085 req-98270c88-7fcb-4462-b088-1f41a48dea31 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:57.819080 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-2e526ace-ef96-4fb5-b76e-1ea950bb0085 req-98270c88-7fcb-4462-b088-1f41a48dea31 service nova] Creating event network-changed:2a59e7f7-3185-4668-9adc-3c816f900e01 for instance 3e3f7410-7e84-4cfc-8202-92b0c4009626 on n-h2-843700-1 May 28 05:25:57.819618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ef026e4f-8867-4c29-8e5a-5b98ab8b8fdc tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:25:57.841890 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-2e526ace-ef96-4fb5-b76e-1ea950bb0085 req-98270c88-7fcb-4462-b088-1f41a48dea31 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084154 May 28 05:25:57.846700 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3394/6898] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:25:58.184127 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ef026e4f-8867-4c29-8e5a-5b98ab8b8fdc tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626" status: 204 len: 0 microversion: 2.1 time: 0.446954 May 28 05:25:58.185023 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3505/6899] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:25:57 2022] DELETE /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:25:58.194647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d391980c-bfc2-4d94-bcc6-fccf04362e8e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:58.195408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d391980c-bfc2-4d94-bcc6-fccf04362e8e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:58.203796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d391980c-bfc2-4d94-bcc6-fccf04362e8e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:58.204275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d391980c-bfc2-4d94-bcc6-fccf04362e8e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:58.205127 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d391980c-bfc2-4d94-bcc6-fccf04362e8e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:58.205595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d391980c-bfc2-4d94-bcc6-fccf04362e8e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:58.356122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d391980c-bfc2-4d94-bcc6-fccf04362e8e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:58.363991 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d391980c-bfc2-4d94-bcc6-fccf04362e8e tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626" status: 200 len: 1670 microversion: 2.1 time: 0.174399 May 28 05:25:58.368203 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3395/6900] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:58 2022] GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626 => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:25:59.383382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-10e646be-e9a5-49b8-a4e5-77b1986053e8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:25:59.384203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-10e646be-e9a5-49b8-a4e5-77b1986053e8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:25:59.393946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-10e646be-e9a5-49b8-a4e5-77b1986053e8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:59.394398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-10e646be-e9a5-49b8-a4e5-77b1986053e8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:59.395409 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-10e646be-e9a5-49b8-a4e5-77b1986053e8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:25:59.395843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-10e646be-e9a5-49b8-a4e5-77b1986053e8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:25:59.645110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-10e646be-e9a5-49b8-a4e5-77b1986053e8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:25:59.645110 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-10e646be-e9a5-49b8-a4e5-77b1986053e8 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626" status: 200 len: 1670 microversion: 2.1 time: 0.215218 May 28 05:25:59.645110 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3506/6901] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:25:59 2022] GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626 => generated 1670 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:00.138616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-ca5d022d-93bf-4765-8842-18105911f425 req-a43a4f8d-4ffe-49e7-b027-33e374ca0fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3f7410-7e84-4cfc-8202-92b0c4009626", "name": "network-vif-deleted", "tag": "2a59e7f7-3185-4668-9adc-3c816f900e01"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:26:00.149029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ca5d022d-93bf-4765-8842-18105911f425 req-a43a4f8d-4ffe-49e7-b027-33e374ca0fd7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:00.149499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ca5d022d-93bf-4765-8842-18105911f425 req-a43a4f8d-4ffe-49e7-b027-33e374ca0fd7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:00.161441 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-ca5d022d-93bf-4765-8842-18105911f425 req-a43a4f8d-4ffe-49e7-b027-33e374ca0fd7 service nova] Creating event network-vif-deleted:2a59e7f7-3185-4668-9adc-3c816f900e01 for instance 3e3f7410-7e84-4cfc-8202-92b0c4009626 on n-h2-843700-1 May 28 05:26:00.168254 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-ca5d022d-93bf-4765-8842-18105911f425 req-a43a4f8d-4ffe-49e7-b027-33e374ca0fd7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033533 May 28 05:26:00.172504 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3396/6902] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:26:00.611710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-47052c32-94be-4875-853f-84374056aaa5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:00.614118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-47052c32-94be-4875-853f-84374056aaa5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:00.620486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47052c32-94be-4875-853f-84374056aaa5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:00.620946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47052c32-94be-4875-853f-84374056aaa5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:00.621832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47052c32-94be-4875-853f-84374056aaa5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:00.622277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47052c32-94be-4875-853f-84374056aaa5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:00.656181 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47052c32-94be-4875-853f-84374056aaa5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:00.656645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47052c32-94be-4875-853f-84374056aaa5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:00.657104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-47052c32-94be-4875-853f-84374056aaa5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lazy-loading 'fault' on Instance uuid 3e3f7410-7e84-4cfc-8202-92b0c4009626 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:26:00.702930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-47052c32-94be-4875-853f-84374056aaa5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dd6c7cc6c46484ca5964c4ed1affafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609cfd8212b4ae4aeee1213a373e579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:00.705932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:26:00.711502 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-47052c32-94be-4875-853f-84374056aaa5 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626" status: 200 len: 1338 microversion: 2.1 time: 0.103818 May 28 05:26:00.712080 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3507/6903] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:00 2022] GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626 => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:01.731061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eb1bae43-f652-411f-9604-2cc88c0b4523 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:01.732413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eb1bae43-f652-411f-9604-2cc88c0b4523 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] [instance: 3e3f7410-7e84-4cfc-8202-92b0c4009626] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:01.740929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb1bae43-f652-411f-9604-2cc88c0b4523 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:01.741407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb1bae43-f652-411f-9604-2cc88c0b4523 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:01.742207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb1bae43-f652-411f-9604-2cc88c0b4523 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:01.742671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb1bae43-f652-411f-9604-2cc88c0b4523 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:01.760307 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-eb1bae43-f652-411f-9604-2cc88c0b4523 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] HTTP exception thrown: Instance 3e3f7410-7e84-4cfc-8202-92b0c4009626 could not be found. May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eb1bae43-f652-411f-9604-2cc88c0b4523 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Request method failure captured: May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626 HTTP/1.1 May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbGwf5SXDCEYMtTRRD7q5dVqM-a7jCcqyYry-_1lHhSrbjuGGjmLxeJ-3oZJccUjTu9fBNDbTnf1SeIKxALYXBHJ1Bebnd7p2lniuqtGvVznXKXJ6xl2EIFje_waRl_iWHqIT9WRdca-1LoCgcnfEB6ScxdtBeW_WVeTIfKhpbFBVEE May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: c609cfd8212b4ae4aeee1213a373e579 May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestNetworkBasicOps-1416696730 May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c609cfd8212b4ae4aeee1213a373e579"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c609cfd8212b4ae4aeee1213a373e579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c609cfd8212b4ae4aeee1213a373e579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c609cfd8212b4ae4aeee1213a373e579"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestNetworkBasicOps-1416696730 May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: c609cfd8212b4ae4aeee1213a373e579 May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestNetworkBasicOps-1416696730 May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestNetworkBasicOps-1416696730-project May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 6dd6c7cc6c46484ca5964c4ed1affafb May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestNetworkBasicOps-1416696730-project May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 3e3f7410-7e84-4cfc-8202-92b0c4009626 could not be found. May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '3e3f7410-7e84-4cfc-8202-92b0c4009626'} May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e3f7410-7e84-4cfc-8202-92b0c4009626 could not be found. May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e3f7410-7e84-4cfc-8202-92b0c4009626 could not be found. May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:26:01.762559 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:26:01.766721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:26:01.766721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:26:01.766721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:26:01.766721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:26:01.766721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:26:01.766721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e3f7410-7e84-4cfc-8202-92b0c4009626 could not be found. May 28 05:26:01.766721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:26:01.766721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eb1bae43-f652-411f-9604-2cc88c0b4523 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Returning 404 to user: Instance 3e3f7410-7e84-4cfc-8202-92b0c4009626 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:26:01.766721 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eb1bae43-f652-411f-9604-2cc88c0b4523 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626" status: 404 len: 111 microversion: 2.1 time: 0.038679 May 28 05:26:01.766721 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3397/6904] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:01 2022] GET /compute/v2.1/servers/3e3f7410-7e84-4cfc-8202-92b0c4009626 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:26:02.012958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e98d6442-5790-4de0-ba79-5ce2f7af2d56 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] Calling method '.version_select at 0x7f7700810ca0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:02.150194 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e98d6442-5790-4de0-ba79-5ce2f7af2d56 tempest-TestNetworkBasicOps-1416696730 tempest-TestNetworkBasicOps-1416696730-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-573833239" status: 202 len: 0 microversion: 2.1 time: 0.143006 May 28 05:26:02.150902 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3508/6905] 10.222.0.58 () {58 vars in 1253 bytes} [Sat May 28 05:26:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-573833239 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:26:09.688327 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:26:09.688901 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 05:26:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:26:14.854084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-09d8ef72-72ea-4d87-9afa-34d31d2bf8ad tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-162059182", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1662296462", "security_groups": [{"name": "tempest-secgroup-smoke-1334421779"}], "block_device_mapping_v2": [{"uuid": "03fb10f4-54d3-42f5-91d1-1957e7e54c98", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f8631f0f-218a-4dd3-ad6e-75d0627c5194"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:26:14.863776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=13 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:26:14.864436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=17 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:26:14.969725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-09d8ef72-72ea-4d87-9afa-34d31d2bf8ad tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] validate_networks() for [('f8631f0f-218a-4dd3-ad6e-75d0627c5194', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:26:15.432578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-09d8ef72-72ea-4d87-9afa-34d31d2bf8ad tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:26:15.433139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-09d8ef72-72ea-4d87-9afa-34d31d2bf8ad tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:26:15.433638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-09d8ef72-72ea-4d87-9afa-34d31d2bf8ad tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:26:15.434068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-09d8ef72-72ea-4d87-9afa-34d31d2bf8ad tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:26:15.434498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-09d8ef72-72ea-4d87-9afa-34d31d2bf8ad tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:26:15.443570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09d8ef72-72ea-4d87-9afa-34d31d2bf8ad tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:15.444040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09d8ef72-72ea-4d87-9afa-34d31d2bf8ad tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:15.444860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09d8ef72-72ea-4d87-9afa-34d31d2bf8ad tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:15.445341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09d8ef72-72ea-4d87-9afa-34d31d2bf8ad tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:15.462622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-09d8ef72-72ea-4d87-9afa-34d31d2bf8ad tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Getting quotas for project e45163cf20a447a0a60bc0c0f075fa78. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:26:15.468584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-09d8ef72-72ea-4d87-9afa-34d31d2bf8ad tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Getting quotas for user a33708c760574b0698fc16ddfebad05b and project e45163cf20a447a0a60bc0c0f075fa78. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:26:15.526577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-09d8ef72-72ea-4d87-9afa-34d31d2bf8ad tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:26:15.529202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-09d8ef72-72ea-4d87-9afa-34d31d2bf8ad tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='03fb10f4-54d3-42f5-91d1-1957e7e54c98',volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:26:15.888565 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-09d8ef72-72ea-4d87-9afa-34d31d2bf8ad tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.038541 May 28 05:26:15.889451 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3398/6906] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:26:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:26:15.897059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:26:15.902260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2d79d61d-42df-4bfa-8956-eaccc6d2b5ea tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:15.908018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2d79d61d-42df-4bfa-8956-eaccc6d2b5ea tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:15.958336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2d79d61d-42df-4bfa-8956-eaccc6d2b5ea tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:15.965939 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2d79d61d-42df-4bfa-8956-eaccc6d2b5ea tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1094 microversion: 2.1 time: 0.070397 May 28 05:26:15.966542 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3509/6907] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:15 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:16.984176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1b2d870c-c6f6-4dec-92b0-4375a93f2eae tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:16.984808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1b2d870c-c6f6-4dec-92b0-4375a93f2eae tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:16.991151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b2d870c-c6f6-4dec-92b0-4375a93f2eae tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:16.991683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b2d870c-c6f6-4dec-92b0-4375a93f2eae tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:16.992396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b2d870c-c6f6-4dec-92b0-4375a93f2eae tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:16.992851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b2d870c-c6f6-4dec-92b0-4375a93f2eae tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:17.061441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1b2d870c-c6f6-4dec-92b0-4375a93f2eae tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:17.069321 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1b2d870c-c6f6-4dec-92b0-4375a93f2eae tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1136 microversion: 2.1 time: 0.090592 May 28 05:26:17.069893 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3399/6908] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:16 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1136 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:18.086398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4d05b03b-dc9a-439f-96af-c8a8cf2f5994 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:18.087060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4d05b03b-dc9a-439f-96af-c8a8cf2f5994 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:18.096920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d05b03b-dc9a-439f-96af-c8a8cf2f5994 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:18.096920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d05b03b-dc9a-439f-96af-c8a8cf2f5994 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:18.096920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d05b03b-dc9a-439f-96af-c8a8cf2f5994 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:18.096920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d05b03b-dc9a-439f-96af-c8a8cf2f5994 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:18.173127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4d05b03b-dc9a-439f-96af-c8a8cf2f5994 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:18.180717 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4d05b03b-dc9a-439f-96af-c8a8cf2f5994 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1210 microversion: 2.1 time: 0.098868 May 28 05:26:18.181539 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3510/6909] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:18 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:19.199824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d1e5d705-1bfd-4fdc-bd9c-590fd5b33a4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:19.200205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d1e5d705-1bfd-4fdc-bd9c-590fd5b33a4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:19.207679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d1e5d705-1bfd-4fdc-bd9c-590fd5b33a4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:19.208449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d1e5d705-1bfd-4fdc-bd9c-590fd5b33a4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:19.209462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d1e5d705-1bfd-4fdc-bd9c-590fd5b33a4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:19.209855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d1e5d705-1bfd-4fdc-bd9c-590fd5b33a4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:19.470181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d1e5d705-1bfd-4fdc-bd9c-590fd5b33a4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:19.478060 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d1e5d705-1bfd-4fdc-bd9c-590fd5b33a4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1278 microversion: 2.1 time: 0.283418 May 28 05:26:19.478713 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3400/6910] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:19 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1278 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:19.651853 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-80d9d222-2e4c-473b-9535-4fb4c93836a7 req-c0d8993e-3dad-47d4-b5be-537fb486bfc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d859f477-09df-4195-9b46-0f7c574942bb", "tag": "2214bc2e-15ad-4ad9-845c-67c3ef0b5cdc"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:26:19.664451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-80d9d222-2e4c-473b-9535-4fb4c93836a7 req-c0d8993e-3dad-47d4-b5be-537fb486bfc9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:19.664908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-80d9d222-2e4c-473b-9535-4fb4c93836a7 req-c0d8993e-3dad-47d4-b5be-537fb486bfc9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:19.684902 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-80d9d222-2e4c-473b-9535-4fb4c93836a7 req-c0d8993e-3dad-47d4-b5be-537fb486bfc9 service nova] Creating event network-changed:2214bc2e-15ad-4ad9-845c-67c3ef0b5cdc for instance d859f477-09df-4195-9b46-0f7c574942bb on n-h1-843700-1 May 28 05:26:19.690719 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-80d9d222-2e4c-473b-9535-4fb4c93836a7 req-c0d8993e-3dad-47d4-b5be-537fb486bfc9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045851 May 28 05:26:19.691917 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3511/6911] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:26:20.494640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-95b9ea78-17da-4bcf-95ba-b5d7495c40a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:20.496301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-95b9ea78-17da-4bcf-95ba-b5d7495c40a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:20.502714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-95b9ea78-17da-4bcf-95ba-b5d7495c40a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:20.503241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-95b9ea78-17da-4bcf-95ba-b5d7495c40a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:20.504045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-95b9ea78-17da-4bcf-95ba-b5d7495c40a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:20.504509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-95b9ea78-17da-4bcf-95ba-b5d7495c40a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:20.640440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-95b9ea78-17da-4bcf-95ba-b5d7495c40a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:20.648240 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-95b9ea78-17da-4bcf-95ba-b5d7495c40a9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1278 microversion: 2.1 time: 0.157589 May 28 05:26:20.648831 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3401/6912] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:20 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:21.667130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9435bea0-bc1c-4609-bcd7-b3de452decb0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:21.668398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9435bea0-bc1c-4609-bcd7-b3de452decb0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:21.674849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9435bea0-bc1c-4609-bcd7-b3de452decb0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:21.675346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9435bea0-bc1c-4609-bcd7-b3de452decb0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:21.676123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9435bea0-bc1c-4609-bcd7-b3de452decb0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:21.676568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9435bea0-bc1c-4609-bcd7-b3de452decb0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:21.808392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9435bea0-bc1c-4609-bcd7-b3de452decb0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:21.816248 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9435bea0-bc1c-4609-bcd7-b3de452decb0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1278 microversion: 2.1 time: 0.154295 May 28 05:26:21.816925 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3512/6913] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:21 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:22.833356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e99ac2e9-e037-4dc6-a3f3-389226480ca1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:22.833994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e99ac2e9-e037-4dc6-a3f3-389226480ca1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:22.841152 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e99ac2e9-e037-4dc6-a3f3-389226480ca1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:22.841623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e99ac2e9-e037-4dc6-a3f3-389226480ca1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:22.842416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e99ac2e9-e037-4dc6-a3f3-389226480ca1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:22.842875 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e99ac2e9-e037-4dc6-a3f3-389226480ca1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:22.974052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e99ac2e9-e037-4dc6-a3f3-389226480ca1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:22.982354 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e99ac2e9-e037-4dc6-a3f3-389226480ca1 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1278 microversion: 2.1 time: 0.153002 May 28 05:26:22.982930 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3402/6914] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:22 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:23.999845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-48281d92-2681-4945-9ff8-e92f71dc6bac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:24.000603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-48281d92-2681-4945-9ff8-e92f71dc6bac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:24.007930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48281d92-2681-4945-9ff8-e92f71dc6bac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:24.008391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48281d92-2681-4945-9ff8-e92f71dc6bac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:24.009170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48281d92-2681-4945-9ff8-e92f71dc6bac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:24.009617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48281d92-2681-4945-9ff8-e92f71dc6bac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:24.146205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-48281d92-2681-4945-9ff8-e92f71dc6bac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:24.153998 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-48281d92-2681-4945-9ff8-e92f71dc6bac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1278 microversion: 2.1 time: 0.158676 May 28 05:26:24.154584 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3513/6915] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:23 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:25.171765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d61680ff-f3f2-4106-8ca6-71252d32e8dc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:25.172411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d61680ff-f3f2-4106-8ca6-71252d32e8dc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:25.179715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d61680ff-f3f2-4106-8ca6-71252d32e8dc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:25.180181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d61680ff-f3f2-4106-8ca6-71252d32e8dc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:25.180990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d61680ff-f3f2-4106-8ca6-71252d32e8dc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:25.181444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d61680ff-f3f2-4106-8ca6-71252d32e8dc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:25.316957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d61680ff-f3f2-4106-8ca6-71252d32e8dc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:25.325542 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d61680ff-f3f2-4106-8ca6-71252d32e8dc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1278 microversion: 2.1 time: 0.158262 May 28 05:26:25.326138 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3403/6916] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:25 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:26:26.342447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c8582b12-50e6-4335-a65f-c0e4b0843bb3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:26.343130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c8582b12-50e6-4335-a65f-c0e4b0843bb3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:26.346329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:26:26.351299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8582b12-50e6-4335-a65f-c0e4b0843bb3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:26.355914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8582b12-50e6-4335-a65f-c0e4b0843bb3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:26.355914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8582b12-50e6-4335-a65f-c0e4b0843bb3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:26.355914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8582b12-50e6-4335-a65f-c0e4b0843bb3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:26.489979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c8582b12-50e6-4335-a65f-c0e4b0843bb3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:26.498096 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c8582b12-50e6-4335-a65f-c0e4b0843bb3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1278 microversion: 2.1 time: 0.159682 May 28 05:26:26.498682 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3514/6917] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:26 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:27.515627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9458b688-b4d6-4327-ac22-e63d8ce15f01 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:27.516265 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9458b688-b4d6-4327-ac22-e63d8ce15f01 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:27.518205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:26:27.519065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:26:27.524718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9458b688-b4d6-4327-ac22-e63d8ce15f01 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:27.528760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9458b688-b4d6-4327-ac22-e63d8ce15f01 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:27.528760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9458b688-b4d6-4327-ac22-e63d8ce15f01 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:27.528760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9458b688-b4d6-4327-ac22-e63d8ce15f01 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:27.659154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9458b688-b4d6-4327-ac22-e63d8ce15f01 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:27.666817 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9458b688-b4d6-4327-ac22-e63d8ce15f01 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1278 microversion: 2.1 time: 0.155780 May 28 05:26:27.667459 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3404/6918] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:27 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:28.683905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9fb47d53-b897-47da-a096-c65940a9426b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:28.684524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9fb47d53-b897-47da-a096-c65940a9426b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:28.691444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fb47d53-b897-47da-a096-c65940a9426b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:28.691905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fb47d53-b897-47da-a096-c65940a9426b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:28.692674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fb47d53-b897-47da-a096-c65940a9426b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:28.693130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9fb47d53-b897-47da-a096-c65940a9426b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:28.824771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9fb47d53-b897-47da-a096-c65940a9426b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:28.832204 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9fb47d53-b897-47da-a096-c65940a9426b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1266 microversion: 2.1 time: 0.152287 May 28 05:26:28.832777 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3515/6919] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:28 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:29.849856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-30dc135a-2697-459a-ad32-936d832913c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:29.850395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-30dc135a-2697-459a-ad32-936d832913c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:29.858243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-30dc135a-2697-459a-ad32-936d832913c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:29.858712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-30dc135a-2697-459a-ad32-936d832913c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:29.859511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-30dc135a-2697-459a-ad32-936d832913c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:29.859964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-30dc135a-2697-459a-ad32-936d832913c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:29.988492 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-30dc135a-2697-459a-ad32-936d832913c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:29.996137 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-30dc135a-2697-459a-ad32-936d832913c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1266 microversion: 2.1 time: 0.150274 May 28 05:26:29.996717 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3405/6920] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:29 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:31.013536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a3267c22-8673-410d-96c3-fb76ce67af4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:31.014075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a3267c22-8673-410d-96c3-fb76ce67af4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:31.020607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3267c22-8673-410d-96c3-fb76ce67af4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:31.021059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3267c22-8673-410d-96c3-fb76ce67af4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:31.021811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3267c22-8673-410d-96c3-fb76ce67af4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:31.022251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3267c22-8673-410d-96c3-fb76ce67af4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:31.154574 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a3267c22-8673-410d-96c3-fb76ce67af4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:31.162313 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a3267c22-8673-410d-96c3-fb76ce67af4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1266 microversion: 2.1 time: 0.153429 May 28 05:26:31.162890 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3516/6921] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:31 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:32.179218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-02ab0ea1-0a9e-4db5-b9fb-be18a2cc954f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:32.179886 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-02ab0ea1-0a9e-4db5-b9fb-be18a2cc954f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:32.186719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02ab0ea1-0a9e-4db5-b9fb-be18a2cc954f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:32.187226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02ab0ea1-0a9e-4db5-b9fb-be18a2cc954f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:32.188023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02ab0ea1-0a9e-4db5-b9fb-be18a2cc954f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:32.188481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02ab0ea1-0a9e-4db5-b9fb-be18a2cc954f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:32.324724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-02ab0ea1-0a9e-4db5-b9fb-be18a2cc954f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:32.332379 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-02ab0ea1-0a9e-4db5-b9fb-be18a2cc954f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1266 microversion: 2.1 time: 0.157149 May 28 05:26:32.332958 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3406/6922] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:32 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:33.350539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9ff1c744-aee8-46b9-ac2a-fff37cbd415b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:33.351197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9ff1c744-aee8-46b9-ac2a-fff37cbd415b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:33.358714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ff1c744-aee8-46b9-ac2a-fff37cbd415b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:33.359214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ff1c744-aee8-46b9-ac2a-fff37cbd415b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:33.359984 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ff1c744-aee8-46b9-ac2a-fff37cbd415b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:33.360423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ff1c744-aee8-46b9-ac2a-fff37cbd415b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:33.490439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9ff1c744-aee8-46b9-ac2a-fff37cbd415b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:33.498519 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9ff1c744-aee8-46b9-ac2a-fff37cbd415b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1266 microversion: 2.1 time: 0.151878 May 28 05:26:33.499115 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3517/6923] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:33 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:34.516235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-31e82ad5-6833-4d5d-a568-6bc98dc85034 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:34.516781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-31e82ad5-6833-4d5d-a568-6bc98dc85034 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:34.523798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31e82ad5-6833-4d5d-a568-6bc98dc85034 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:34.524271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31e82ad5-6833-4d5d-a568-6bc98dc85034 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:34.525057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31e82ad5-6833-4d5d-a568-6bc98dc85034 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:34.525513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-31e82ad5-6833-4d5d-a568-6bc98dc85034 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:34.656592 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-31e82ad5-6833-4d5d-a568-6bc98dc85034 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:34.664240 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-31e82ad5-6833-4d5d-a568-6bc98dc85034 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1266 microversion: 2.1 time: 0.152137 May 28 05:26:34.664823 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3407/6924] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:34 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:26:35.681066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0ce2715c-8478-4202-ba8d-e909a7893b2e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:35.681701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0ce2715c-8478-4202-ba8d-e909a7893b2e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:35.689426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ce2715c-8478-4202-ba8d-e909a7893b2e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:35.689885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ce2715c-8478-4202-ba8d-e909a7893b2e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:35.690662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ce2715c-8478-4202-ba8d-e909a7893b2e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:35.691132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ce2715c-8478-4202-ba8d-e909a7893b2e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:35.820110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0ce2715c-8478-4202-ba8d-e909a7893b2e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:35.827666 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0ce2715c-8478-4202-ba8d-e909a7893b2e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1266 microversion: 2.1 time: 0.150538 May 28 05:26:35.828245 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3518/6925] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:35 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:36.844161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2eb61f3a-b641-44e3-8742-ce6b9546b4c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:36.844795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2eb61f3a-b641-44e3-8742-ce6b9546b4c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:36.851777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2eb61f3a-b641-44e3-8742-ce6b9546b4c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:36.852244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2eb61f3a-b641-44e3-8742-ce6b9546b4c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:36.853022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2eb61f3a-b641-44e3-8742-ce6b9546b4c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:36.853471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2eb61f3a-b641-44e3-8742-ce6b9546b4c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:36.983453 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2eb61f3a-b641-44e3-8742-ce6b9546b4c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:36.991239 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2eb61f3a-b641-44e3-8742-ce6b9546b4c3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1266 microversion: 2.1 time: 0.150959 May 28 05:26:36.992275 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3408/6926] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:36 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:38.007100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e7a372a4-d733-46ee-a144-9912b300c8e6 req-6d536d43-0b9e-413b-9235-ed29804f8c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d859f477-09df-4195-9b46-0f7c574942bb", "name": "network-vif-plugged", "status": "completed", "tag": "2214bc2e-15ad-4ad9-845c-67c3ef0b5cdc"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:26:38.009483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c2eaa8ff-318c-4f3f-a5d4-7fe0ae0df0de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:38.016080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c2eaa8ff-318c-4f3f-a5d4-7fe0ae0df0de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:38.017788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e7a372a4-d733-46ee-a144-9912b300c8e6 req-6d536d43-0b9e-413b-9235-ed29804f8c22 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:38.018320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e7a372a4-d733-46ee-a144-9912b300c8e6 req-6d536d43-0b9e-413b-9235-ed29804f8c22 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:38.026250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c2eaa8ff-318c-4f3f-a5d4-7fe0ae0df0de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:38.026250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c2eaa8ff-318c-4f3f-a5d4-7fe0ae0df0de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:38.026250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c2eaa8ff-318c-4f3f-a5d4-7fe0ae0df0de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:38.026622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c2eaa8ff-318c-4f3f-a5d4-7fe0ae0df0de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:38.030655 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e7a372a4-d733-46ee-a144-9912b300c8e6 req-6d536d43-0b9e-413b-9235-ed29804f8c22 service nova] Creating event network-vif-plugged:2214bc2e-15ad-4ad9-845c-67c3ef0b5cdc for instance d859f477-09df-4195-9b46-0f7c574942bb on n-h1-843700-1 May 28 05:26:38.036142 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e7a372a4-d733-46ee-a144-9912b300c8e6 req-6d536d43-0b9e-413b-9235-ed29804f8c22 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032986 May 28 05:26:38.036836 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3519/6927] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:26:38.224523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c2eaa8ff-318c-4f3f-a5d4-7fe0ae0df0de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:38.232573 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c2eaa8ff-318c-4f3f-a5d4-7fe0ae0df0de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1266 microversion: 2.1 time: 0.227634 May 28 05:26:38.233173 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3409/6928] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:38 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:26:39.252303 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2504cba1-cb84-439d-9cde-4942891a4dc4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:39.253061 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2504cba1-cb84-439d-9cde-4942891a4dc4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:39.259342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2504cba1-cb84-439d-9cde-4942891a4dc4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:39.259807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2504cba1-cb84-439d-9cde-4942891a4dc4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:39.260621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2504cba1-cb84-439d-9cde-4942891a4dc4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:39.261064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2504cba1-cb84-439d-9cde-4942891a4dc4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:39.396793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2504cba1-cb84-439d-9cde-4942891a4dc4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:39.404854 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2504cba1-cb84-439d-9cde-4942891a4dc4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1266 microversion: 2.1 time: 0.159247 May 28 05:26:39.405682 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3520/6929] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:39 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:40.422594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-393ae754-1484-43e3-81f5-085e1091922b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:40.423196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-393ae754-1484-43e3-81f5-085e1091922b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:40.430274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-393ae754-1484-43e3-81f5-085e1091922b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:40.430750 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-393ae754-1484-43e3-81f5-085e1091922b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:40.431570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-393ae754-1484-43e3-81f5-085e1091922b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:40.432034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-393ae754-1484-43e3-81f5-085e1091922b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:40.563278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-393ae754-1484-43e3-81f5-085e1091922b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:40.571136 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-393ae754-1484-43e3-81f5-085e1091922b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1453 microversion: 2.1 time: 0.153196 May 28 05:26:40.571721 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3410/6930] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:40 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:40.587534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f5acd6b6-f478-47c2-9ef4-cc6cee8d2647 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:26:40.588177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f5acd6b6-f478-47c2-9ef4-cc6cee8d2647 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:26:40.595699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5acd6b6-f478-47c2-9ef4-cc6cee8d2647 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:40.596157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5acd6b6-f478-47c2-9ef4-cc6cee8d2647 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:40.596918 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5acd6b6-f478-47c2-9ef4-cc6cee8d2647 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:40.597360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5acd6b6-f478-47c2-9ef4-cc6cee8d2647 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:40.732448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f5acd6b6-f478-47c2-9ef4-cc6cee8d2647 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:26:40.740390 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f5acd6b6-f478-47c2-9ef4-cc6cee8d2647 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1453 microversion: 2.1 time: 0.156658 May 28 05:26:40.740981 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3521/6931] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:26:40 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:26:43.057293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-0983d367-4400-4672-a382-3655a2d1aef4 req-1d15d055-1cb9-43f6-a4e3-d723ad57dff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d859f477-09df-4195-9b46-0f7c574942bb", "tag": "2214bc2e-15ad-4ad9-845c-67c3ef0b5cdc"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:26:43.067157 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0983d367-4400-4672-a382-3655a2d1aef4 req-1d15d055-1cb9-43f6-a4e3-d723ad57dff7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:26:43.067625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0983d367-4400-4672-a382-3655a2d1aef4 req-1d15d055-1cb9-43f6-a4e3-d723ad57dff7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:26:43.078575 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-0983d367-4400-4672-a382-3655a2d1aef4 req-1d15d055-1cb9-43f6-a4e3-d723ad57dff7 service nova] Creating event network-changed:2214bc2e-15ad-4ad9-845c-67c3ef0b5cdc for instance d859f477-09df-4195-9b46-0f7c574942bb on n-h1-843700-1 May 28 05:26:43.083669 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-0983d367-4400-4672-a382-3655a2d1aef4 req-1d15d055-1cb9-43f6-a4e3-d723ad57dff7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030078 May 28 05:26:43.084505 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3411/6932] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:27:49.579209 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:27:49.579918 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 05:27:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:27:53.955897 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:27:53.956463 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 05:27:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:29:07.300351 n-d-843700-1 devstack@n-api.service[126044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7fb7b4e8-8c85-4700-986d-4cff401b6421] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 05:29:07.301577 n-d-843700-1 devstack@n-api.service[126044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a1992b24-c6ca-47ed-a310-b37951ac973c] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 05:29:07.302176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=28 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:29:07.302941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=65 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:29:07.306894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e8db2985-d1eb-430d-b010-83d6430d4439 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:07.307527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e8db2985-d1eb-430d-b010-83d6430d4439 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:07.313398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e8db2985-d1eb-430d-b010-83d6430d4439 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:07.315831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e8db2985-d1eb-430d-b010-83d6430d4439 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:07.315831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e8db2985-d1eb-430d-b010-83d6430d4439 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:07.315831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e8db2985-d1eb-430d-b010-83d6430d4439 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:07.340554 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e8db2985-d1eb-430d-b010-83d6430d4439 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:29:07.537609 n-d-843700-1 devstack@n-api.service[126044]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e8db2985-d1eb-430d-b010-83d6430d4439 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [b4886c98-9a6e-4e0f-b132-3c1ae5f8f3df] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 05:29:08.309193 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] [7fb7b4e8-8c85-4700-986d-4cff401b6421] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 57562. May 28 05:29:08.309909 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] [a1992b24-c6ca-47ed-a310-b37951ac973c] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 57564. May 28 05:29:08.543844 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [None req-e8db2985-d1eb-430d-b010-83d6430d4439 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [b4886c98-9a6e-4e0f-b132-3c1ae5f8f3df] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 57566. May 28 05:29:08.624720 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e8db2985-d1eb-430d-b010-83d6430d4439 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 204 len: 0 microversion: 2.1 time: 1.326156 May 28 05:29:08.625345 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3522/6933] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:29:07 2022] DELETE /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 0 bytes in 1328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 05:29:08.633463 n-d-843700-1 devstack@n-api.service[126043]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9cedd376-8074-49f5-962c-429331dc3c26] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 05:29:08.636173 n-d-843700-1 devstack@n-api.service[126043]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7b68896-232d-4c87-8179-08a432c034dc] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 28 05:29:08.636173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:29:08.636173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=76 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:29:08.640203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d93027aa-aef6-47e8-8282-b3818e2fe52b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:08.640925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d93027aa-aef6-47e8-8282-b3818e2fe52b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:08.647599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d93027aa-aef6-47e8-8282-b3818e2fe52b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:08.648068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d93027aa-aef6-47e8-8282-b3818e2fe52b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:08.648863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d93027aa-aef6-47e8-8282-b3818e2fe52b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:08.649317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d93027aa-aef6-47e8-8282-b3818e2fe52b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:08.788824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d93027aa-aef6-47e8-8282-b3818e2fe52b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:08.796497 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d93027aa-aef6-47e8-8282-b3818e2fe52b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1578 microversion: 2.1 time: 0.166726 May 28 05:29:08.797013 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3412/6934] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:08 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:09.815137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-74065e00-ccac-44a8-94c7-3e364c2951e8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:09.815873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-74065e00-ccac-44a8-94c7-3e364c2951e8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:09.823296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74065e00-ccac-44a8-94c7-3e364c2951e8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:09.823761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74065e00-ccac-44a8-94c7-3e364c2951e8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:09.824541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74065e00-ccac-44a8-94c7-3e364c2951e8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:09.824986 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-74065e00-ccac-44a8-94c7-3e364c2951e8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:09.954359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-74065e00-ccac-44a8-94c7-3e364c2951e8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:09.962740 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-74065e00-ccac-44a8-94c7-3e364c2951e8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1578 microversion: 2.1 time: 0.152589 May 28 05:29:09.963349 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3523/6935] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:09 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:10.980289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dbd4f8c5-4c5b-47fd-8d5f-f4c7b5e15d2d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:10.980925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dbd4f8c5-4c5b-47fd-8d5f-f4c7b5e15d2d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:10.991633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dbd4f8c5-4c5b-47fd-8d5f-f4c7b5e15d2d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:10.992124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dbd4f8c5-4c5b-47fd-8d5f-f4c7b5e15d2d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:10.992927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dbd4f8c5-4c5b-47fd-8d5f-f4c7b5e15d2d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:10.993573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dbd4f8c5-4c5b-47fd-8d5f-f4c7b5e15d2d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:10.998176 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7b68896-232d-4c87-8179-08a432c034dc] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 57580. May 28 05:29:11.002647 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] [9cedd376-8074-49f5-962c-429331dc3c26] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 57578. May 28 05:29:11.392651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dbd4f8c5-4c5b-47fd-8d5f-f4c7b5e15d2d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:11.403483 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dbd4f8c5-4c5b-47fd-8d5f-f4c7b5e15d2d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1510 microversion: 2.1 time: 0.427152 May 28 05:29:11.404325 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3413/6936] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:10 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1510 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:11.565672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-00a1428d-5620-4bb3-b735-f6a14273af15 req-fe6facf9-860f-44fe-93a6-f48f76330ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d859f477-09df-4195-9b46-0f7c574942bb", "name": "network-vif-deleted", "tag": "2214bc2e-15ad-4ad9-845c-67c3ef0b5cdc"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:29:11.574021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-00a1428d-5620-4bb3-b735-f6a14273af15 req-fe6facf9-860f-44fe-93a6-f48f76330ce7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:11.574472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-00a1428d-5620-4bb3-b735-f6a14273af15 req-fe6facf9-860f-44fe-93a6-f48f76330ce7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:11.586246 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-00a1428d-5620-4bb3-b735-f6a14273af15 req-fe6facf9-860f-44fe-93a6-f48f76330ce7 service nova] Creating event network-vif-deleted:2214bc2e-15ad-4ad9-845c-67c3ef0b5cdc for instance d859f477-09df-4195-9b46-0f7c574942bb on n-h1-843700-1 May 28 05:29:11.591317 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-00a1428d-5620-4bb3-b735-f6a14273af15 req-fe6facf9-860f-44fe-93a6-f48f76330ce7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191220 May 28 05:29:11.591927 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3524/6937] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:29:12.421503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7e55efda-d45f-48c6-a9a0-c6e81b1d513e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:12.422801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7e55efda-d45f-48c6-a9a0-c6e81b1d513e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:12.430219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e55efda-d45f-48c6-a9a0-c6e81b1d513e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:12.430686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e55efda-d45f-48c6-a9a0-c6e81b1d513e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:12.431511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e55efda-d45f-48c6-a9a0-c6e81b1d513e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:12.431962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7e55efda-d45f-48c6-a9a0-c6e81b1d513e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:12.494135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7e55efda-d45f-48c6-a9a0-c6e81b1d513e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:12.504079 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7e55efda-d45f-48c6-a9a0-c6e81b1d513e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1225 microversion: 2.1 time: 0.086835 May 28 05:29:12.504761 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3414/6938] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:12 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:13.523416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-77478988-5517-428b-b366-a93b2db8b039 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:13.524038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-77478988-5517-428b-b366-a93b2db8b039 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:13.531263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77478988-5517-428b-b366-a93b2db8b039 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:13.531883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77478988-5517-428b-b366-a93b2db8b039 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:13.533157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77478988-5517-428b-b366-a93b2db8b039 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:13.533607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77478988-5517-428b-b366-a93b2db8b039 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:13.597168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-77478988-5517-428b-b366-a93b2db8b039 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:13.604934 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-77478988-5517-428b-b366-a93b2db8b039 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1225 microversion: 2.1 time: 0.087637 May 28 05:29:13.605510 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3525/6939] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:13 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:14.622758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5e61c895-05e5-460b-bf22-d2b2f8c6a9c0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:14.623557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5e61c895-05e5-460b-bf22-d2b2f8c6a9c0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:14.631165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e61c895-05e5-460b-bf22-d2b2f8c6a9c0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:14.631641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e61c895-05e5-460b-bf22-d2b2f8c6a9c0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:14.632435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e61c895-05e5-460b-bf22-d2b2f8c6a9c0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:14.632901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e61c895-05e5-460b-bf22-d2b2f8c6a9c0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:14.695263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5e61c895-05e5-460b-bf22-d2b2f8c6a9c0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:14.703086 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5e61c895-05e5-460b-bf22-d2b2f8c6a9c0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1225 microversion: 2.1 time: 0.084246 May 28 05:29:14.703671 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3415/6940] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:14 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:15.719181 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-44731a36-217d-47f6-b2ea-aa4dbaa1ba78 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:15.719804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-44731a36-217d-47f6-b2ea-aa4dbaa1ba78 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:15.727304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-44731a36-217d-47f6-b2ea-aa4dbaa1ba78 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:15.727765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-44731a36-217d-47f6-b2ea-aa4dbaa1ba78 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:15.728539 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-44731a36-217d-47f6-b2ea-aa4dbaa1ba78 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:15.728982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-44731a36-217d-47f6-b2ea-aa4dbaa1ba78 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:15.792837 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-44731a36-217d-47f6-b2ea-aa4dbaa1ba78 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:15.800533 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-44731a36-217d-47f6-b2ea-aa4dbaa1ba78 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1225 microversion: 2.1 time: 0.085273 May 28 05:29:15.801114 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3526/6941] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:15 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:16.816842 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f0397c38-7142-491f-a15e-0c3d7b1867d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:16.817475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f0397c38-7142-491f-a15e-0c3d7b1867d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:16.824599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0397c38-7142-491f-a15e-0c3d7b1867d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:16.825068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0397c38-7142-491f-a15e-0c3d7b1867d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:16.825855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0397c38-7142-491f-a15e-0c3d7b1867d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:16.826311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0397c38-7142-491f-a15e-0c3d7b1867d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:16.891174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f0397c38-7142-491f-a15e-0c3d7b1867d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:16.899384 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f0397c38-7142-491f-a15e-0c3d7b1867d4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1225 microversion: 2.1 time: 0.086479 May 28 05:29:16.900375 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3416/6942] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:16 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:17.916955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-956cea87-be6c-4311-bf26-4e3cc357c373 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:17.917673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-956cea87-be6c-4311-bf26-4e3cc357c373 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:17.925489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-956cea87-be6c-4311-bf26-4e3cc357c373 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:17.925952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-956cea87-be6c-4311-bf26-4e3cc357c373 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:17.926714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-956cea87-be6c-4311-bf26-4e3cc357c373 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:17.927184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-956cea87-be6c-4311-bf26-4e3cc357c373 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:17.991813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-956cea87-be6c-4311-bf26-4e3cc357c373 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:17.999444 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-956cea87-be6c-4311-bf26-4e3cc357c373 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1225 microversion: 2.1 time: 0.086348 May 28 05:29:18.000041 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3527/6943] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:17 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:19.016729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-706c50fb-8a97-4618-8ed0-164e97132db2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:19.017271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-706c50fb-8a97-4618-8ed0-164e97132db2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:19.024606 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-706c50fb-8a97-4618-8ed0-164e97132db2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:19.025086 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-706c50fb-8a97-4618-8ed0-164e97132db2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:19.025889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-706c50fb-8a97-4618-8ed0-164e97132db2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:19.026350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-706c50fb-8a97-4618-8ed0-164e97132db2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:19.088147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-706c50fb-8a97-4618-8ed0-164e97132db2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:19.096322 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-706c50fb-8a97-4618-8ed0-164e97132db2 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1225 microversion: 2.1 time: 0.083774 May 28 05:29:19.096909 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3417/6944] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:19 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:20.113276 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3a34afd4-febd-4e45-9b39-f58e26fb806e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:20.114017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3a34afd4-febd-4e45-9b39-f58e26fb806e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:20.122655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a34afd4-febd-4e45-9b39-f58e26fb806e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:20.123146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a34afd4-febd-4e45-9b39-f58e26fb806e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:20.123943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a34afd4-febd-4e45-9b39-f58e26fb806e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:20.124391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a34afd4-febd-4e45-9b39-f58e26fb806e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:20.189875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3a34afd4-febd-4e45-9b39-f58e26fb806e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:20.197955 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3a34afd4-febd-4e45-9b39-f58e26fb806e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 200 len: 1225 microversion: 2.1 time: 0.088500 May 28 05:29:20.198684 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3528/6945] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:20 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:21.215587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0bdf084d-caae-4d3f-86ae-bee4152864b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:21.216246 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0bdf084d-caae-4d3f-86ae-bee4152864b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:21.223810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0bdf084d-caae-4d3f-86ae-bee4152864b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:21.227253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0bdf084d-caae-4d3f-86ae-bee4152864b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:21.227253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0bdf084d-caae-4d3f-86ae-bee4152864b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:21.227253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0bdf084d-caae-4d3f-86ae-bee4152864b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:21.238769 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-0bdf084d-caae-4d3f-86ae-bee4152864b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] HTTP exception thrown: Instance d859f477-09df-4195-9b46-0f7c574942bb could not be found. May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0bdf084d-caae-4d3f-86ae-bee4152864b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Request method failure captured: May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb HTTP/1.1 May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbDlrqJvsw-Bj4hemx4XscPzQgI57Oj0DhtZ0WItt0VxFXFIUFqzN1b2sr7MK3BjOGQZJbLNmoClfshSjagkFRTmogQaQpoLYEaPQkaSagOXWAKjyAlGGxZFI9I-y-IJo4VhS_mMCbBct4nVbcF58kjzhMiK5F2slw20hRu7zD2W154 May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestVolumeBootPattern-934660757 May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestVolumeBootPattern-934660757-project May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: a33708c760574b0698fc16ddfebad05b May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestVolumeBootPattern-934660757-project May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance d859f477-09df-4195-9b46-0f7c574942bb could not be found. May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'd859f477-09df-4195-9b46-0f7c574942bb'} May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d859f477-09df-4195-9b46-0f7c574942bb could not be found. May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d859f477-09df-4195-9b46-0f7c574942bb could not be found. May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:29:21.240490 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:29:21.245936 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:29:21.245936 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:29:21.245936 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:29:21.245936 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:29:21.245936 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:29:21.245936 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d859f477-09df-4195-9b46-0f7c574942bb could not be found. May 28 05:29:21.245936 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:29:21.245936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0bdf084d-caae-4d3f-86ae-bee4152864b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Returning 404 to user: Instance d859f477-09df-4195-9b46-0f7c574942bb could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:29:21.245936 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0bdf084d-caae-4d3f-86ae-bee4152864b9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 404 len: 111 microversion: 2.1 time: 0.030391 May 28 05:29:21.245936 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3418/6946] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:21 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:29:21.289252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9839e6a6-a5d5-4edd-922d-59a8af8c3e36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-138169782", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1662296462", "security_groups": [{"name": "tempest-secgroup-smoke-1334421779"}], "block_device_mapping_v2": [{"uuid": "03fb10f4-54d3-42f5-91d1-1957e7e54c98", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f8631f0f-218a-4dd3-ad6e-75d0627c5194"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:29:21.399148 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-9839e6a6-a5d5-4edd-922d-59a8af8c3e36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] validate_networks() for [('f8631f0f-218a-4dd3-ad6e-75d0627c5194', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:29:21.758954 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-9839e6a6-a5d5-4edd-922d-59a8af8c3e36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:29:21.759421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-9839e6a6-a5d5-4edd-922d-59a8af8c3e36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:29:21.759908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-9839e6a6-a5d5-4edd-922d-59a8af8c3e36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:29:21.760327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-9839e6a6-a5d5-4edd-922d-59a8af8c3e36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:29:21.760746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-9839e6a6-a5d5-4edd-922d-59a8af8c3e36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:29:21.770316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9839e6a6-a5d5-4edd-922d-59a8af8c3e36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:21.770776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9839e6a6-a5d5-4edd-922d-59a8af8c3e36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:21.771622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9839e6a6-a5d5-4edd-922d-59a8af8c3e36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:21.772065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9839e6a6-a5d5-4edd-922d-59a8af8c3e36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:21.789318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-9839e6a6-a5d5-4edd-922d-59a8af8c3e36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Getting quotas for project e45163cf20a447a0a60bc0c0f075fa78. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:29:21.794817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-9839e6a6-a5d5-4edd-922d-59a8af8c3e36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Getting quotas for user a33708c760574b0698fc16ddfebad05b and project e45163cf20a447a0a60bc0c0f075fa78. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:29:21.853501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9839e6a6-a5d5-4edd-922d-59a8af8c3e36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:29:21.855672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9839e6a6-a5d5-4edd-922d-59a8af8c3e36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='03fb10f4-54d3-42f5-91d1-1957e7e54c98',volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:29:22.245528 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9839e6a6-a5d5-4edd-922d-59a8af8c3e36 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.960115 May 28 05:29:22.246198 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3529/6947] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:29:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:29:22.256826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0b387fcc-6f13-4b6a-a408-6dd6a5e5872f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:22.257482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0b387fcc-6f13-4b6a-a408-6dd6a5e5872f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:22.315771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0b387fcc-6f13-4b6a-a408-6dd6a5e5872f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:22.323475 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0b387fcc-6f13-4b6a-a408-6dd6a5e5872f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1094 microversion: 2.1 time: 0.070509 May 28 05:29:22.324037 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3419/6948] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:22 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:23.341294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c8b31fdf-4170-4104-bf9b-f7b6a851fe0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:23.342071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c8b31fdf-4170-4104-bf9b-f7b6a851fe0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:23.348504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8b31fdf-4170-4104-bf9b-f7b6a851fe0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:23.348962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8b31fdf-4170-4104-bf9b-f7b6a851fe0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:23.349731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8b31fdf-4170-4104-bf9b-f7b6a851fe0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:23.350171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8b31fdf-4170-4104-bf9b-f7b6a851fe0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:23.410941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c8b31fdf-4170-4104-bf9b-f7b6a851fe0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:23.418669 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c8b31fdf-4170-4104-bf9b-f7b6a851fe0b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1144 microversion: 2.1 time: 0.082264 May 28 05:29:23.419281 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3530/6949] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:23 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:24.435772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-66e84af4-cdc5-4845-8a50-2634f702e038 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:24.436773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-66e84af4-cdc5-4845-8a50-2634f702e038 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:24.443922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-66e84af4-cdc5-4845-8a50-2634f702e038 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:24.444407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-66e84af4-cdc5-4845-8a50-2634f702e038 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:24.445236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-66e84af4-cdc5-4845-8a50-2634f702e038 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:24.445697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-66e84af4-cdc5-4845-8a50-2634f702e038 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:24.543015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-66e84af4-cdc5-4845-8a50-2634f702e038 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:24.551597 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-66e84af4-cdc5-4845-8a50-2634f702e038 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1210 microversion: 2.1 time: 0.119750 May 28 05:29:24.552198 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3420/6950] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:24 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1210 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:25.569021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fba745b8-48de-42d7-870d-c8c6fe3f3237 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:25.569641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fba745b8-48de-42d7-870d-c8c6fe3f3237 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:25.577313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fba745b8-48de-42d7-870d-c8c6fe3f3237 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:25.577772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fba745b8-48de-42d7-870d-c8c6fe3f3237 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:25.578747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fba745b8-48de-42d7-870d-c8c6fe3f3237 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:25.579226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fba745b8-48de-42d7-870d-c8c6fe3f3237 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:25.804590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fba745b8-48de-42d7-870d-c8c6fe3f3237 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:25.814788 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fba745b8-48de-42d7-870d-c8c6fe3f3237 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1278 microversion: 2.1 time: 0.249830 May 28 05:29:25.815829 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3531/6951] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:25 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1278 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:25.987197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-2e1c9a24-dd46-4534-9b8c-eabe3403d22c req-f2f84037-f822-45d4-b8ba-297a6d1c113e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "567cdb73-6b1f-4385-b17a-acd2b3fef0aa", "tag": "b6d4d0ae-f61d-44fa-b4ab-6ecdcb558296"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:29:25.996963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2e1c9a24-dd46-4534-9b8c-eabe3403d22c req-f2f84037-f822-45d4-b8ba-297a6d1c113e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:25.997715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2e1c9a24-dd46-4534-9b8c-eabe3403d22c req-f2f84037-f822-45d4-b8ba-297a6d1c113e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:26.014180 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-2e1c9a24-dd46-4534-9b8c-eabe3403d22c req-f2f84037-f822-45d4-b8ba-297a6d1c113e service nova] Creating event network-changed:b6d4d0ae-f61d-44fa-b4ab-6ecdcb558296 for instance 567cdb73-6b1f-4385-b17a-acd2b3fef0aa on n-h2-843700-1 May 28 05:29:26.018272 n-d-843700-1 devstack@n-api.service[126043]: ERROR oslo.messaging._drivers.impl_rabbit [req-2e1c9a24-dd46-4534-9b8c-eabe3403d22c req-f2f84037-f822-45d4-b8ba-297a6d1c113e service nova] [20773a24-39e0-4623-ab12-cee0ec3ebabe] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 05:29:26.831946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0997097c-c64c-4b26-8c61-a088861e0ce3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:26.832591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0997097c-c64c-4b26-8c61-a088861e0ce3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:26.839665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0997097c-c64c-4b26-8c61-a088861e0ce3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:26.840117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0997097c-c64c-4b26-8c61-a088861e0ce3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:26.840881 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0997097c-c64c-4b26-8c61-a088861e0ce3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:26.841321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0997097c-c64c-4b26-8c61-a088861e0ce3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:26.977354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0997097c-c64c-4b26-8c61-a088861e0ce3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:26.985199 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0997097c-c64c-4b26-8c61-a088861e0ce3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1278 microversion: 2.1 time: 0.157132 May 28 05:29:26.986615 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3532/6952] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:26 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:29:27.025647 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [req-2e1c9a24-dd46-4534-9b8c-eabe3403d22c req-f2f84037-f822-45d4-b8ba-297a6d1c113e service nova] [20773a24-39e0-4623-ab12-cee0ec3ebabe] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 57644. May 28 05:29:27.029689 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-2e1c9a24-dd46-4534-9b8c-eabe3403d22c req-f2f84037-f822-45d4-b8ba-297a6d1c113e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.046455 May 28 05:29:27.030313 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3421/6953] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:29:28.002730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e9a811c8-9fa9-4bcf-9046-59398e910562 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:28.003387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e9a811c8-9fa9-4bcf-9046-59398e910562 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:28.010429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9a811c8-9fa9-4bcf-9046-59398e910562 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:28.010891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9a811c8-9fa9-4bcf-9046-59398e910562 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:28.011695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9a811c8-9fa9-4bcf-9046-59398e910562 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:28.012144 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9a811c8-9fa9-4bcf-9046-59398e910562 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:28.405083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e9a811c8-9fa9-4bcf-9046-59398e910562 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:28.413165 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e9a811c8-9fa9-4bcf-9046-59398e910562 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1278 microversion: 2.1 time: 0.414927 May 28 05:29:28.413742 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3533/6954] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:27 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1278 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:29.431877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e3a83992-da2c-46f6-990b-d712106138ac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:29.432618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e3a83992-da2c-46f6-990b-d712106138ac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:29.439067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3a83992-da2c-46f6-990b-d712106138ac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:29.439546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3a83992-da2c-46f6-990b-d712106138ac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:29.440338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3a83992-da2c-46f6-990b-d712106138ac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:29.440797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3a83992-da2c-46f6-990b-d712106138ac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:29.576966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e3a83992-da2c-46f6-990b-d712106138ac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:29.585386 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e3a83992-da2c-46f6-990b-d712106138ac tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1278 microversion: 2.1 time: 0.158837 May 28 05:29:29.585981 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3422/6955] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:29 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:29.696057 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:29:29.696282 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 05:29:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:29:30.602384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-be3ad699-78b2-433e-ba1a-efa25d3f6f4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:30.603071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-be3ad699-78b2-433e-ba1a-efa25d3f6f4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:30.609699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-be3ad699-78b2-433e-ba1a-efa25d3f6f4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:30.615095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-be3ad699-78b2-433e-ba1a-efa25d3f6f4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:30.615095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-be3ad699-78b2-433e-ba1a-efa25d3f6f4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:30.615095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-be3ad699-78b2-433e-ba1a-efa25d3f6f4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:30.755876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-be3ad699-78b2-433e-ba1a-efa25d3f6f4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:30.764182 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-be3ad699-78b2-433e-ba1a-efa25d3f6f4a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1278 microversion: 2.1 time: 0.165952 May 28 05:29:30.764777 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3534/6956] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:30 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:31.781685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3faab5dc-967b-4d45-aefd-1f65a38a0ab5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:31.782349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3faab5dc-967b-4d45-aefd-1f65a38a0ab5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:31.789325 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3faab5dc-967b-4d45-aefd-1f65a38a0ab5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:31.789792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3faab5dc-967b-4d45-aefd-1f65a38a0ab5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:31.790578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3faab5dc-967b-4d45-aefd-1f65a38a0ab5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:31.791047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3faab5dc-967b-4d45-aefd-1f65a38a0ab5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:31.929748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3faab5dc-967b-4d45-aefd-1f65a38a0ab5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:31.937726 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3faab5dc-967b-4d45-aefd-1f65a38a0ab5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1278 microversion: 2.1 time: 0.159765 May 28 05:29:31.938093 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3423/6957] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:31 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:32.955982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-43a3016b-e0a6-41aa-a188-d7ceadf81e5c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:32.956611 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-43a3016b-e0a6-41aa-a188-d7ceadf81e5c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:32.959471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:29:32.960146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:29:32.965291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43a3016b-e0a6-41aa-a188-d7ceadf81e5c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:32.965760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43a3016b-e0a6-41aa-a188-d7ceadf81e5c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:32.966533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43a3016b-e0a6-41aa-a188-d7ceadf81e5c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:32.966975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-43a3016b-e0a6-41aa-a188-d7ceadf81e5c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:33.099447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-43a3016b-e0a6-41aa-a188-d7ceadf81e5c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:33.107210 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-43a3016b-e0a6-41aa-a188-d7ceadf81e5c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1278 microversion: 2.1 time: 0.155821 May 28 05:29:33.107789 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3535/6958] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:32 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:34.124659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-25ccb6ef-1f36-489c-ab2d-f3105f3e5333 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:34.125293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-25ccb6ef-1f36-489c-ab2d-f3105f3e5333 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:34.127868 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:29:34.133869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25ccb6ef-1f36-489c-ab2d-f3105f3e5333 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:34.134344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25ccb6ef-1f36-489c-ab2d-f3105f3e5333 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:34.135182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25ccb6ef-1f36-489c-ab2d-f3105f3e5333 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:34.135644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25ccb6ef-1f36-489c-ab2d-f3105f3e5333 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:34.279234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-25ccb6ef-1f36-489c-ab2d-f3105f3e5333 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:34.288067 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-25ccb6ef-1f36-489c-ab2d-f3105f3e5333 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1278 microversion: 2.1 time: 0.167059 May 28 05:29:34.288675 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3424/6959] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:34 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:35.304931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-75eb7020-cd67-4afb-a8e7-f5a6dc13a64a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:35.305561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-75eb7020-cd67-4afb-a8e7-f5a6dc13a64a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:35.312519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75eb7020-cd67-4afb-a8e7-f5a6dc13a64a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:35.313010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75eb7020-cd67-4afb-a8e7-f5a6dc13a64a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:35.314278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75eb7020-cd67-4afb-a8e7-f5a6dc13a64a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:35.314727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75eb7020-cd67-4afb-a8e7-f5a6dc13a64a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:35.441785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-75eb7020-cd67-4afb-a8e7-f5a6dc13a64a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:35.449440 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-75eb7020-cd67-4afb-a8e7-f5a6dc13a64a tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1266 microversion: 2.1 time: 0.148509 May 28 05:29:35.450015 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3536/6960] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:35 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:36.466286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-35d1a06c-f252-4a26-83ea-abeccba8ab65 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:36.466898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-35d1a06c-f252-4a26-83ea-abeccba8ab65 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:36.474607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-35d1a06c-f252-4a26-83ea-abeccba8ab65 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:36.475107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-35d1a06c-f252-4a26-83ea-abeccba8ab65 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:36.475894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-35d1a06c-f252-4a26-83ea-abeccba8ab65 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:36.476350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-35d1a06c-f252-4a26-83ea-abeccba8ab65 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:36.604958 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-35d1a06c-f252-4a26-83ea-abeccba8ab65 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:36.612809 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-35d1a06c-f252-4a26-83ea-abeccba8ab65 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1266 microversion: 2.1 time: 0.150528 May 28 05:29:36.613393 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3425/6961] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:36 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:37.629604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-817db64c-8359-4a30-9842-0105b3d467d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:37.630222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-817db64c-8359-4a30-9842-0105b3d467d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:37.632903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:29:37.637652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-817db64c-8359-4a30-9842-0105b3d467d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:37.638103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-817db64c-8359-4a30-9842-0105b3d467d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:37.638865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-817db64c-8359-4a30-9842-0105b3d467d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:37.639349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-817db64c-8359-4a30-9842-0105b3d467d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:37.641857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:29:37.774261 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-817db64c-8359-4a30-9842-0105b3d467d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:37.782056 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-817db64c-8359-4a30-9842-0105b3d467d6 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1266 microversion: 2.1 time: 0.156421 May 28 05:29:37.783243 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3537/6962] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:37 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:38.799659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cb97b19e-8eb3-4d41-9e05-b67a59269d92 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:38.800286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cb97b19e-8eb3-4d41-9e05-b67a59269d92 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:38.802960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=31 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:29:38.807804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb97b19e-8eb3-4d41-9e05-b67a59269d92 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:38.808269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb97b19e-8eb3-4d41-9e05-b67a59269d92 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:38.809050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb97b19e-8eb3-4d41-9e05-b67a59269d92 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:38.809550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb97b19e-8eb3-4d41-9e05-b67a59269d92 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:38.812137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=71 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:29:38.940144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cb97b19e-8eb3-4d41-9e05-b67a59269d92 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:38.947813 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cb97b19e-8eb3-4d41-9e05-b67a59269d92 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1266 microversion: 2.1 time: 0.152160 May 28 05:29:38.948837 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3426/6963] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:38 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:39.966361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-321983f1-9d1b-4b2d-a924-e2aeb9567326 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:39.967126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-321983f1-9d1b-4b2d-a924-e2aeb9567326 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:39.973278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-321983f1-9d1b-4b2d-a924-e2aeb9567326 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:39.973743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-321983f1-9d1b-4b2d-a924-e2aeb9567326 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:39.974518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-321983f1-9d1b-4b2d-a924-e2aeb9567326 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:39.974972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-321983f1-9d1b-4b2d-a924-e2aeb9567326 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:40.108309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-321983f1-9d1b-4b2d-a924-e2aeb9567326 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:40.116415 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-321983f1-9d1b-4b2d-a924-e2aeb9567326 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1266 microversion: 2.1 time: 0.154640 May 28 05:29:40.117016 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3538/6964] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:39 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:41.133743 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6c3aa4a6-2d5d-42fd-b6be-aececc62608b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:41.134384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6c3aa4a6-2d5d-42fd-b6be-aececc62608b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:41.140716 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c3aa4a6-2d5d-42fd-b6be-aececc62608b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:41.141217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c3aa4a6-2d5d-42fd-b6be-aececc62608b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:41.142663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c3aa4a6-2d5d-42fd-b6be-aececc62608b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:41.143230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c3aa4a6-2d5d-42fd-b6be-aececc62608b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:41.270171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6c3aa4a6-2d5d-42fd-b6be-aececc62608b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:41.278013 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6c3aa4a6-2d5d-42fd-b6be-aececc62608b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1266 microversion: 2.1 time: 0.148588 May 28 05:29:41.278586 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3427/6965] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:41 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:42.294840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c246cc32-0351-403b-98fd-f307848200fc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:42.295495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c246cc32-0351-403b-98fd-f307848200fc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:42.302282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c246cc32-0351-403b-98fd-f307848200fc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:42.302738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c246cc32-0351-403b-98fd-f307848200fc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:42.303543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c246cc32-0351-403b-98fd-f307848200fc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:42.303984 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c246cc32-0351-403b-98fd-f307848200fc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:42.433771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c246cc32-0351-403b-98fd-f307848200fc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:42.442016 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c246cc32-0351-403b-98fd-f307848200fc tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1266 microversion: 2.1 time: 0.151071 May 28 05:29:42.442600 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3539/6966] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:42 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:43.549354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ba45e7f6-d460-463d-b4d1-0ab33f383938 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:43.549985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ba45e7f6-d460-463d-b4d1-0ab33f383938 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:43.556076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba45e7f6-d460-463d-b4d1-0ab33f383938 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:43.556567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba45e7f6-d460-463d-b4d1-0ab33f383938 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:43.557329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba45e7f6-d460-463d-b4d1-0ab33f383938 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:43.557780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba45e7f6-d460-463d-b4d1-0ab33f383938 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:43.691194 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ba45e7f6-d460-463d-b4d1-0ab33f383938 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:43.698701 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ba45e7f6-d460-463d-b4d1-0ab33f383938 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1266 microversion: 2.1 time: 0.243733 May 28 05:29:43.699297 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3428/6967] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:43 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:44.016997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-ff5bc22c-cdb7-4611-96fb-254a80e64540 req-048daf37-7102-44e2-b221-79501816662b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "567cdb73-6b1f-4385-b17a-acd2b3fef0aa", "name": "network-vif-plugged", "status": "completed", "tag": "b6d4d0ae-f61d-44fa-b4ab-6ecdcb558296"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:29:44.026114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ff5bc22c-cdb7-4611-96fb-254a80e64540 req-048daf37-7102-44e2-b221-79501816662b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:44.026931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ff5bc22c-cdb7-4611-96fb-254a80e64540 req-048daf37-7102-44e2-b221-79501816662b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:44.038430 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-ff5bc22c-cdb7-4611-96fb-254a80e64540 req-048daf37-7102-44e2-b221-79501816662b service nova] Creating event network-vif-plugged:b6d4d0ae-f61d-44fa-b4ab-6ecdcb558296 for instance 567cdb73-6b1f-4385-b17a-acd2b3fef0aa on n-h2-843700-1 May 28 05:29:44.044212 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-ff5bc22c-cdb7-4611-96fb-254a80e64540 req-048daf37-7102-44e2-b221-79501816662b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095322 May 28 05:29:44.044837 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3540/6968] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:29:44.715951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-62e6244c-76d1-4b30-a630-88afb4265bff tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:44.716578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-62e6244c-76d1-4b30-a630-88afb4265bff tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:44.723652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-62e6244c-76d1-4b30-a630-88afb4265bff tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:44.724121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-62e6244c-76d1-4b30-a630-88afb4265bff tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:44.724896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-62e6244c-76d1-4b30-a630-88afb4265bff tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:44.725349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-62e6244c-76d1-4b30-a630-88afb4265bff tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:44.857143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-62e6244c-76d1-4b30-a630-88afb4265bff tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:44.865374 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-62e6244c-76d1-4b30-a630-88afb4265bff tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1266 microversion: 2.1 time: 0.153385 May 28 05:29:44.865957 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3429/6969] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:44 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:45.883498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-859599f3-37d5-4394-877d-49ef1a0f925c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:45.884200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-859599f3-37d5-4394-877d-49ef1a0f925c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:45.892183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-859599f3-37d5-4394-877d-49ef1a0f925c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:45.892636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-859599f3-37d5-4394-877d-49ef1a0f925c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:45.893414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-859599f3-37d5-4394-877d-49ef1a0f925c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:45.893836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-859599f3-37d5-4394-877d-49ef1a0f925c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:46.022658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-859599f3-37d5-4394-877d-49ef1a0f925c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:46.030475 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-859599f3-37d5-4394-877d-49ef1a0f925c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1452 microversion: 2.1 time: 0.151726 May 28 05:29:46.031063 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3541/6970] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:45 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:46.046457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-06ca5d95-1fa6-42c7-87d7-507160b69db4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:29:46.047122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-06ca5d95-1fa6-42c7-87d7-507160b69db4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:29:46.054395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06ca5d95-1fa6-42c7-87d7-507160b69db4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:46.054863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06ca5d95-1fa6-42c7-87d7-507160b69db4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:46.055676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06ca5d95-1fa6-42c7-87d7-507160b69db4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:46.056123 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06ca5d95-1fa6-42c7-87d7-507160b69db4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:46.190966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-06ca5d95-1fa6-42c7-87d7-507160b69db4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:29:46.198735 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-06ca5d95-1fa6-42c7-87d7-507160b69db4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1452 microversion: 2.1 time: 0.156128 May 28 05:29:46.199365 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3430/6971] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:29:46 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:29:48.108729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-6399f79a-ebaa-4f32-8f14-31011eea6039 req-60421e54-7e6f-4033-bc7e-ee94394474c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "567cdb73-6b1f-4385-b17a-acd2b3fef0aa", "tag": "b6d4d0ae-f61d-44fa-b4ab-6ecdcb558296"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:29:48.125319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-6399f79a-ebaa-4f32-8f14-31011eea6039 req-60421e54-7e6f-4033-bc7e-ee94394474c9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:29:48.125777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-6399f79a-ebaa-4f32-8f14-31011eea6039 req-60421e54-7e6f-4033-bc7e-ee94394474c9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:29:48.137906 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-6399f79a-ebaa-4f32-8f14-31011eea6039 req-60421e54-7e6f-4033-bc7e-ee94394474c9 service nova] Creating event network-changed:b6d4d0ae-f61d-44fa-b4ab-6ecdcb558296 for instance 567cdb73-6b1f-4385-b17a-acd2b3fef0aa on n-h2-843700-1 May 28 05:29:48.143276 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-6399f79a-ebaa-4f32-8f14-31011eea6039 req-60421e54-7e6f-4033-bc7e-ee94394474c9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042553 May 28 05:29:48.143898 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3542/6972] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:31:09.588879 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:31:09.589299 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 05:31:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:31:12.600145 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:31:12.600731 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 05:31:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:32:19.968910 n-d-843700-1 devstack@n-api.service[126043]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9cedd376-8074-49f5-962c-429331dc3c26] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 05:32:19.970003 n-d-843700-1 devstack@n-api.service[126043]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7b68896-232d-4c87-8179-08a432c034dc] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 05:32:19.971014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=9 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:32:19.971922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=29 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:32:19.975964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a5bd1700-228f-43ac-b0d2-c4131873d8bf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-948419217", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1662296462", "security_groups": [{"name": "tempest-secgroup-smoke-1334421779"}], "block_device_mapping_v2": [{"uuid": "140c2055-687d-42de-b792-c166f4ac6a1f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f8631f0f-218a-4dd3-ad6e-75d0627c5194"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:32:20.243218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-a5bd1700-228f-43ac-b0d2-c4131873d8bf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] validate_networks() for [('f8631f0f-218a-4dd3-ad6e-75d0627c5194', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:32:20.667884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a5bd1700-228f-43ac-b0d2-c4131873d8bf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:32:20.668329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a5bd1700-228f-43ac-b0d2-c4131873d8bf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:32:20.668824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a5bd1700-228f-43ac-b0d2-c4131873d8bf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:32:20.669252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a5bd1700-228f-43ac-b0d2-c4131873d8bf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:32:20.670172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-a5bd1700-228f-43ac-b0d2-c4131873d8bf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:32:20.680192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5bd1700-228f-43ac-b0d2-c4131873d8bf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:20.680662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5bd1700-228f-43ac-b0d2-c4131873d8bf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:20.681485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5bd1700-228f-43ac-b0d2-c4131873d8bf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:20.681946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5bd1700-228f-43ac-b0d2-c4131873d8bf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:20.699483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-a5bd1700-228f-43ac-b0d2-c4131873d8bf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Getting quotas for project e45163cf20a447a0a60bc0c0f075fa78. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:32:20.704817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-a5bd1700-228f-43ac-b0d2-c4131873d8bf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Getting quotas for user a33708c760574b0698fc16ddfebad05b and project e45163cf20a447a0a60bc0c0f075fa78. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:32:20.764270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a5bd1700-228f-43ac-b0d2-c4131873d8bf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:32:20.766410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a5bd1700-228f-43ac-b0d2-c4131873d8bf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='140c2055-687d-42de-b792-c166f4ac6a1f',volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:32:20.977541 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7b68896-232d-4c87-8179-08a432c034dc] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 57858. May 28 05:32:20.978197 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] [9cedd376-8074-49f5-962c-429331dc3c26] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 57856. May 28 05:32:21.150389 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a5bd1700-228f-43ac-b0d2-c4131873d8bf tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.183850 May 28 05:32:21.151069 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3431/6973] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:32:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:32:21.159311 n-d-843700-1 devstack@n-api.service[126044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a1992b24-c6ca-47ed-a310-b37951ac973c] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 05:32:21.160131 n-d-843700-1 devstack@n-api.service[126044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7fb7b4e8-8c85-4700-986d-4cff401b6421] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 05:32:21.160733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=11 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:32:21.161487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=27 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:32:21.166035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0615cacf-e53d-4cd5-8cb9-f3750b1a6f3f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:21.166847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0615cacf-e53d-4cd5-8cb9-f3750b1a6f3f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:21.280534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0615cacf-e53d-4cd5-8cb9-f3750b1a6f3f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:21.288808 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0615cacf-e53d-4cd5-8cb9-f3750b1a6f3f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1094 microversion: 2.1 time: 0.131245 May 28 05:32:21.289396 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3543/6974] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:21 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1094 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:22.306666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-39e50423-8b1a-4a71-9aba-18f1cb5d7330 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:22.307331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-39e50423-8b1a-4a71-9aba-18f1cb5d7330 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:22.314172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-39e50423-8b1a-4a71-9aba-18f1cb5d7330 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:22.316788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-39e50423-8b1a-4a71-9aba-18f1cb5d7330 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:22.316788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-39e50423-8b1a-4a71-9aba-18f1cb5d7330 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:22.316788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-39e50423-8b1a-4a71-9aba-18f1cb5d7330 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:22.381024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-39e50423-8b1a-4a71-9aba-18f1cb5d7330 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:22.389573 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-39e50423-8b1a-4a71-9aba-18f1cb5d7330 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1144 microversion: 2.1 time: 0.087745 May 28 05:32:22.390360 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3432/6975] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:22 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:23.407842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-292ad903-0b20-48c2-8478-c43abc7324f8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:23.408495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-292ad903-0b20-48c2-8478-c43abc7324f8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:23.421724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-292ad903-0b20-48c2-8478-c43abc7324f8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:23.421724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-292ad903-0b20-48c2-8478-c43abc7324f8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:23.425330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-292ad903-0b20-48c2-8478-c43abc7324f8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:23.425330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-292ad903-0b20-48c2-8478-c43abc7324f8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:23.427417 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] [a1992b24-c6ca-47ed-a310-b37951ac973c] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 57880. May 28 05:32:23.442770 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] [7fb7b4e8-8c85-4700-986d-4cff401b6421] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 57882. May 28 05:32:23.496358 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-292ad903-0b20-48c2-8478-c43abc7324f8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:23.505110 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-292ad903-0b20-48c2-8478-c43abc7324f8 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1210 microversion: 2.1 time: 0.102149 May 28 05:32:23.505747 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3544/6976] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:23 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:24.523635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d48338c8-c7a3-4139-a8b1-91af40eb57e5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:24.524205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d48338c8-c7a3-4139-a8b1-91af40eb57e5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:24.532112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d48338c8-c7a3-4139-a8b1-91af40eb57e5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:24.532591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d48338c8-c7a3-4139-a8b1-91af40eb57e5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:24.533427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d48338c8-c7a3-4139-a8b1-91af40eb57e5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:24.533887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d48338c8-c7a3-4139-a8b1-91af40eb57e5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:24.746079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d48338c8-c7a3-4139-a8b1-91af40eb57e5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:24.754100 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d48338c8-c7a3-4139-a8b1-91af40eb57e5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1278 microversion: 2.1 time: 0.235134 May 28 05:32:24.754719 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3433/6977] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:24 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1278 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:25.222075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-020076f3-0478-4f05-972f-bc5a85127d84 req-bf110fe5-9dc9-4622-9e81-a4552d6f2950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4", "tag": "ab409d3b-17c3-4a0a-91c8-67b07df928bc"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:32:25.235107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-020076f3-0478-4f05-972f-bc5a85127d84 req-bf110fe5-9dc9-4622-9e81-a4552d6f2950 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:25.236194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-020076f3-0478-4f05-972f-bc5a85127d84 req-bf110fe5-9dc9-4622-9e81-a4552d6f2950 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:25.256153 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-020076f3-0478-4f05-972f-bc5a85127d84 req-bf110fe5-9dc9-4622-9e81-a4552d6f2950 service nova] Creating event network-changed:ab409d3b-17c3-4a0a-91c8-67b07df928bc for instance 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 on n-h1-843700-1 May 28 05:32:25.261321 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-020076f3-0478-4f05-972f-bc5a85127d84 req-bf110fe5-9dc9-4622-9e81-a4552d6f2950 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043130 May 28 05:32:25.261945 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3545/6978] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:32:25.771853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c0e91d83-7784-4946-918f-622595f36c70 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:25.773539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c0e91d83-7784-4946-918f-622595f36c70 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:25.781080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c0e91d83-7784-4946-918f-622595f36c70 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:25.782154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c0e91d83-7784-4946-918f-622595f36c70 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:25.782981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c0e91d83-7784-4946-918f-622595f36c70 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:25.783738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c0e91d83-7784-4946-918f-622595f36c70 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:26.012298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c0e91d83-7784-4946-918f-622595f36c70 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:26.020058 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c0e91d83-7784-4946-918f-622595f36c70 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1278 microversion: 2.1 time: 0.252299 May 28 05:32:26.020846 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3434/6979] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:25 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1278 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:27.039672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8e987048-3555-4fb9-9950-f1e78fed7409 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:27.040490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8e987048-3555-4fb9-9950-f1e78fed7409 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:27.046968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8e987048-3555-4fb9-9950-f1e78fed7409 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:27.047445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8e987048-3555-4fb9-9950-f1e78fed7409 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:27.048204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8e987048-3555-4fb9-9950-f1e78fed7409 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:27.048646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8e987048-3555-4fb9-9950-f1e78fed7409 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:27.187650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8e987048-3555-4fb9-9950-f1e78fed7409 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:27.195552 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8e987048-3555-4fb9-9950-f1e78fed7409 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1278 microversion: 2.1 time: 0.161096 May 28 05:32:27.196303 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3546/6980] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:27 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:28.212382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6ab16d38-ef65-4117-a1fa-31c755117688 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:28.213211 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6ab16d38-ef65-4117-a1fa-31c755117688 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:28.220916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ab16d38-ef65-4117-a1fa-31c755117688 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:28.221389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ab16d38-ef65-4117-a1fa-31c755117688 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:28.222184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ab16d38-ef65-4117-a1fa-31c755117688 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:28.222643 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ab16d38-ef65-4117-a1fa-31c755117688 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:28.414884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6ab16d38-ef65-4117-a1fa-31c755117688 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:28.423321 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6ab16d38-ef65-4117-a1fa-31c755117688 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1278 microversion: 2.1 time: 0.214841 May 28 05:32:28.423947 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3435/6981] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:28 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1278 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:29.440927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a1d8cd86-fb85-4567-8e66-76415fcb5110 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:29.441491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a1d8cd86-fb85-4567-8e66-76415fcb5110 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:29.448673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1d8cd86-fb85-4567-8e66-76415fcb5110 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:29.449717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1d8cd86-fb85-4567-8e66-76415fcb5110 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:29.450649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1d8cd86-fb85-4567-8e66-76415fcb5110 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:29.451160 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1d8cd86-fb85-4567-8e66-76415fcb5110 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:29.619673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a1d8cd86-fb85-4567-8e66-76415fcb5110 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:29.628040 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a1d8cd86-fb85-4567-8e66-76415fcb5110 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1278 microversion: 2.1 time: 0.191108 May 28 05:32:29.628718 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3547/6982] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:29 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:30.648606 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-582f91ed-3358-47b8-a940-da88193ee6f4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:30.649258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-582f91ed-3358-47b8-a940-da88193ee6f4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:30.656880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-582f91ed-3358-47b8-a940-da88193ee6f4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:30.657356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-582f91ed-3358-47b8-a940-da88193ee6f4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:30.658219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-582f91ed-3358-47b8-a940-da88193ee6f4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:30.658678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-582f91ed-3358-47b8-a940-da88193ee6f4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:30.693254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:32:30.712140 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:32:30.797983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-582f91ed-3358-47b8-a940-da88193ee6f4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:30.806060 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-582f91ed-3358-47b8-a940-da88193ee6f4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1278 microversion: 2.1 time: 0.164670 May 28 05:32:30.806678 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3436/6983] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:30 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:31.823774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-75e41fe6-f827-4089-9a69-b53a77946497 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:31.824411 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-75e41fe6-f827-4089-9a69-b53a77946497 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:31.827785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:32:31.832821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75e41fe6-f827-4089-9a69-b53a77946497 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:31.833274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75e41fe6-f827-4089-9a69-b53a77946497 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:31.834041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75e41fe6-f827-4089-9a69-b53a77946497 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:31.834482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75e41fe6-f827-4089-9a69-b53a77946497 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:31.973076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-75e41fe6-f827-4089-9a69-b53a77946497 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:31.980813 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-75e41fe6-f827-4089-9a69-b53a77946497 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1278 microversion: 2.1 time: 0.160943 May 28 05:32:31.981382 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3548/6984] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:31 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:32.998366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f843bed4-4af0-47a4-bf49-2c01c0e0a999 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:32.999024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f843bed4-4af0-47a4-bf49-2c01c0e0a999 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:33.006579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f843bed4-4af0-47a4-bf49-2c01c0e0a999 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:33.007093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f843bed4-4af0-47a4-bf49-2c01c0e0a999 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:33.007888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f843bed4-4af0-47a4-bf49-2c01c0e0a999 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:33.008350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f843bed4-4af0-47a4-bf49-2c01c0e0a999 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:33.142121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f843bed4-4af0-47a4-bf49-2c01c0e0a999 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:33.150344 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f843bed4-4af0-47a4-bf49-2c01c0e0a999 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1278 microversion: 2.1 time: 0.156556 May 28 05:32:33.157023 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3437/6985] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:32 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:34.166637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5ec744d8-53ee-411c-a1ab-9d72a9e88ea0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:34.167203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5ec744d8-53ee-411c-a1ab-9d72a9e88ea0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:34.174187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ec744d8-53ee-411c-a1ab-9d72a9e88ea0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:34.174645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ec744d8-53ee-411c-a1ab-9d72a9e88ea0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:34.175453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ec744d8-53ee-411c-a1ab-9d72a9e88ea0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:34.175901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ec744d8-53ee-411c-a1ab-9d72a9e88ea0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:34.313646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5ec744d8-53ee-411c-a1ab-9d72a9e88ea0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:34.321212 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5ec744d8-53ee-411c-a1ab-9d72a9e88ea0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1278 microversion: 2.1 time: 0.158740 May 28 05:32:34.322269 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3549/6986] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:34 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:35.338659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0ef110b9-e83d-49ae-bf40-6fe32d0b1e7e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:35.339374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0ef110b9-e83d-49ae-bf40-6fe32d0b1e7e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:35.346640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ef110b9-e83d-49ae-bf40-6fe32d0b1e7e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:35.347143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ef110b9-e83d-49ae-bf40-6fe32d0b1e7e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:35.348033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ef110b9-e83d-49ae-bf40-6fe32d0b1e7e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:35.348495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ef110b9-e83d-49ae-bf40-6fe32d0b1e7e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:35.478909 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0ef110b9-e83d-49ae-bf40-6fe32d0b1e7e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:35.487128 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0ef110b9-e83d-49ae-bf40-6fe32d0b1e7e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1266 microversion: 2.1 time: 0.152500 May 28 05:32:35.487715 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3438/6987] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:35 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:36.504517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6d4291e8-fdd8-4430-819b-157424b9125d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:36.505200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6d4291e8-fdd8-4430-819b-157424b9125d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:36.512289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d4291e8-fdd8-4430-819b-157424b9125d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:36.512756 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d4291e8-fdd8-4430-819b-157424b9125d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:36.513533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d4291e8-fdd8-4430-819b-157424b9125d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:36.514031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d4291e8-fdd8-4430-819b-157424b9125d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:36.721670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6d4291e8-fdd8-4430-819b-157424b9125d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:36.729358 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6d4291e8-fdd8-4430-819b-157424b9125d tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1266 microversion: 2.1 time: 0.229091 May 28 05:32:36.730238 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3550/6988] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:36 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:37.746330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-848bef8c-116c-4645-982c-1f9e9db68460 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:37.747671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-848bef8c-116c-4645-982c-1f9e9db68460 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:37.754649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-848bef8c-116c-4645-982c-1f9e9db68460 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:37.755654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-848bef8c-116c-4645-982c-1f9e9db68460 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:37.756043 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-848bef8c-116c-4645-982c-1f9e9db68460 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:37.756512 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-848bef8c-116c-4645-982c-1f9e9db68460 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:37.890199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-848bef8c-116c-4645-982c-1f9e9db68460 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:37.897797 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-848bef8c-116c-4645-982c-1f9e9db68460 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1266 microversion: 2.1 time: 0.155608 May 28 05:32:37.898625 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3439/6989] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:37 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:38.915455 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c18aeeb2-a80c-4b8e-8265-41d2045e85b3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:38.916123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c18aeeb2-a80c-4b8e-8265-41d2045e85b3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:38.923841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c18aeeb2-a80c-4b8e-8265-41d2045e85b3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:38.924263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c18aeeb2-a80c-4b8e-8265-41d2045e85b3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:38.925024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c18aeeb2-a80c-4b8e-8265-41d2045e85b3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:38.925462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c18aeeb2-a80c-4b8e-8265-41d2045e85b3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:39.055727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c18aeeb2-a80c-4b8e-8265-41d2045e85b3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:39.063529 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c18aeeb2-a80c-4b8e-8265-41d2045e85b3 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1266 microversion: 2.1 time: 0.151952 May 28 05:32:39.064150 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3551/6990] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:38 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:40.080561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-22c040f3-4be2-496b-a1bf-f000046f3628 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:40.081208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-22c040f3-4be2-496b-a1bf-f000046f3628 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:40.088372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22c040f3-4be2-496b-a1bf-f000046f3628 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:40.091489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22c040f3-4be2-496b-a1bf-f000046f3628 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:40.091489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22c040f3-4be2-496b-a1bf-f000046f3628 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:40.091489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22c040f3-4be2-496b-a1bf-f000046f3628 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:40.304252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-22c040f3-4be2-496b-a1bf-f000046f3628 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:40.311987 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-22c040f3-4be2-496b-a1bf-f000046f3628 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1266 microversion: 2.1 time: 0.235483 May 28 05:32:40.312600 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3440/6991] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:40 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:41.329952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e64335ca-3c4a-49c9-b639-276ba99379a0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:41.330562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e64335ca-3c4a-49c9-b639-276ba99379a0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:41.337591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e64335ca-3c4a-49c9-b639-276ba99379a0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:41.338054 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e64335ca-3c4a-49c9-b639-276ba99379a0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:41.338825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e64335ca-3c4a-49c9-b639-276ba99379a0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:41.339304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e64335ca-3c4a-49c9-b639-276ba99379a0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:41.470970 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e64335ca-3c4a-49c9-b639-276ba99379a0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:41.484393 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e64335ca-3c4a-49c9-b639-276ba99379a0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1266 microversion: 2.1 time: 0.152738 May 28 05:32:41.484393 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3552/6992] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:41 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:42.496264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6482f925-0510-4fc5-bd48-b189fdafd5f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:42.496993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6482f925-0510-4fc5-bd48-b189fdafd5f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:42.504128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6482f925-0510-4fc5-bd48-b189fdafd5f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:42.504593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6482f925-0510-4fc5-bd48-b189fdafd5f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:42.505366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6482f925-0510-4fc5-bd48-b189fdafd5f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:42.505813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6482f925-0510-4fc5-bd48-b189fdafd5f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:42.639638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6482f925-0510-4fc5-bd48-b189fdafd5f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:42.647336 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6482f925-0510-4fc5-bd48-b189fdafd5f0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1266 microversion: 2.1 time: 0.154930 May 28 05:32:42.648166 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3441/6993] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:42 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:43.664551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-45f7e154-701a-46ca-9b22-63579cf55231 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:43.665266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-45f7e154-701a-46ca-9b22-63579cf55231 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:43.672449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45f7e154-701a-46ca-9b22-63579cf55231 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:43.672911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45f7e154-701a-46ca-9b22-63579cf55231 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:43.673685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45f7e154-701a-46ca-9b22-63579cf55231 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:43.674133 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45f7e154-701a-46ca-9b22-63579cf55231 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:43.734715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-5365ceea-ddf4-4c83-b2c4-4d5704b440db req-ef9da042-952c-4375-8cde-6b62ae107e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4", "name": "network-vif-plugged", "status": "completed", "tag": "ab409d3b-17c3-4a0a-91c8-67b07df928bc"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:32:43.745077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5365ceea-ddf4-4c83-b2c4-4d5704b440db req-ef9da042-952c-4375-8cde-6b62ae107e0c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:43.745483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-5365ceea-ddf4-4c83-b2c4-4d5704b440db req-ef9da042-952c-4375-8cde-6b62ae107e0c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:43.760454 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-5365ceea-ddf4-4c83-b2c4-4d5704b440db req-ef9da042-952c-4375-8cde-6b62ae107e0c service nova] Creating event network-vif-plugged:ab409d3b-17c3-4a0a-91c8-67b07df928bc for instance 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 on n-h1-843700-1 May 28 05:32:43.766305 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-5365ceea-ddf4-4c83-b2c4-4d5704b440db req-ef9da042-952c-4375-8cde-6b62ae107e0c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036884 May 28 05:32:43.767599 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3442/6994] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:32:43.811019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-45f7e154-701a-46ca-9b22-63579cf55231 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:43.818767 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-45f7e154-701a-46ca-9b22-63579cf55231 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1266 microversion: 2.1 time: 0.158337 May 28 05:32:43.819376 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3553/6995] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:43 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:44.838027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a1cc4da8-cc5e-4948-90c4-abb5f7cf236f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:44.838757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a1cc4da8-cc5e-4948-90c4-abb5f7cf236f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:44.846808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1cc4da8-cc5e-4948-90c4-abb5f7cf236f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:44.847319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1cc4da8-cc5e-4948-90c4-abb5f7cf236f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:44.848247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1cc4da8-cc5e-4948-90c4-abb5f7cf236f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:44.848706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1cc4da8-cc5e-4948-90c4-abb5f7cf236f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:44.990119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a1cc4da8-cc5e-4948-90c4-abb5f7cf236f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:44.997991 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a1cc4da8-cc5e-4948-90c4-abb5f7cf236f tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1266 microversion: 2.1 time: 0.165155 May 28 05:32:44.998584 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3443/6996] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:44 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:46.014599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9379e8dd-b22c-42a5-8e50-ba7b35a351de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:46.015272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9379e8dd-b22c-42a5-8e50-ba7b35a351de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:46.022308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9379e8dd-b22c-42a5-8e50-ba7b35a351de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:46.023053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9379e8dd-b22c-42a5-8e50-ba7b35a351de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:46.028956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9379e8dd-b22c-42a5-8e50-ba7b35a351de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:46.028956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9379e8dd-b22c-42a5-8e50-ba7b35a351de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:46.152650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9379e8dd-b22c-42a5-8e50-ba7b35a351de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:46.160307 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9379e8dd-b22c-42a5-8e50-ba7b35a351de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1453 microversion: 2.1 time: 0.149680 May 28 05:32:46.160888 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3554/6997] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:46 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:46.181383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2a8e1aa9-39e8-47e0-a084-89f2db2d79de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:32:46.182021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2a8e1aa9-39e8-47e0-a084-89f2db2d79de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:32:46.189640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a8e1aa9-39e8-47e0-a084-89f2db2d79de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:46.190113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a8e1aa9-39e8-47e0-a084-89f2db2d79de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:46.190901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a8e1aa9-39e8-47e0-a084-89f2db2d79de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:46.191392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a8e1aa9-39e8-47e0-a084-89f2db2d79de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:46.644411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2a8e1aa9-39e8-47e0-a084-89f2db2d79de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:32:46.652430 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2a8e1aa9-39e8-47e0-a084-89f2db2d79de tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1453 microversion: 2.1 time: 0.475025 May 28 05:32:46.653647 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3444/6998] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:32:46 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1453 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:32:48.658475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-22c76c0c-cf8b-4902-8f8f-d1ea97b3a27e req-32e11775-c985-4c4f-803a-45a1a16be139 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4", "tag": "ab409d3b-17c3-4a0a-91c8-67b07df928bc"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:32:48.668512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-22c76c0c-cf8b-4902-8f8f-d1ea97b3a27e req-32e11775-c985-4c4f-803a-45a1a16be139 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:32:48.669208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-22c76c0c-cf8b-4902-8f8f-d1ea97b3a27e req-32e11775-c985-4c4f-803a-45a1a16be139 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:32:48.681350 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-22c76c0c-cf8b-4902-8f8f-d1ea97b3a27e req-32e11775-c985-4c4f-803a-45a1a16be139 service nova] Creating event network-changed:ab409d3b-17c3-4a0a-91c8-67b07df928bc for instance 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 on n-h1-843700-1 May 28 05:32:48.687182 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-22c76c0c-cf8b-4902-8f8f-d1ea97b3a27e req-32e11775-c985-4c4f-803a-45a1a16be139 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032695 May 28 05:32:48.687877 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3555/6999] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:34:29.596821 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:34:29.597266 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 05:34:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:34:29.706339 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:34:29.706531 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 05:34:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:34:32.609087 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:34:32.609656 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 05:34:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:34:33.968089 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:34:33.968751 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 05:34:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:34:51.919346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-adbb352b-b617-4d8e-9063-49254fbc1942 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:34:51.919346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-adbb352b-b617-4d8e-9063-49254fbc1942 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:34:51.919346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:34:51.919346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=76 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:34:51.926680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-adbb352b-b617-4d8e-9063-49254fbc1942 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:34:51.927213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-adbb352b-b617-4d8e-9063-49254fbc1942 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:34:51.928016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-adbb352b-b617-4d8e-9063-49254fbc1942 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:34:51.928483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-adbb352b-b617-4d8e-9063-49254fbc1942 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:34:51.958523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-adbb352b-b617-4d8e-9063-49254fbc1942 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:34:51.983107 n-d-843700-1 devstack@n-api.service[126044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a1992b24-c6ca-47ed-a310-b37951ac973c] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 28 05:34:51.985109 n-d-843700-1 devstack@n-api.service[126044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7fb7b4e8-8c85-4700-986d-4cff401b6421] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 28 05:34:51.985924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=28 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:34:51.986691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=64 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:34:52.044642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-dae31395-8230-4cff-8abb-e08d3bf398c9 req-8123eefa-05a2-4181-9af0-a575cef0a31e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4", "tag": "ab409d3b-17c3-4a0a-91c8-67b07df928bc"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:34:52.054708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-dae31395-8230-4cff-8abb-e08d3bf398c9 req-8123eefa-05a2-4181-9af0-a575cef0a31e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:34:52.055200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-dae31395-8230-4cff-8abb-e08d3bf398c9 req-8123eefa-05a2-4181-9af0-a575cef0a31e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:34:52.068055 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-dae31395-8230-4cff-8abb-e08d3bf398c9 req-8123eefa-05a2-4181-9af0-a575cef0a31e service nova] Creating event network-changed:ab409d3b-17c3-4a0a-91c8-67b07df928bc for instance 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 on n-h1-843700-1 May 28 05:34:52.073751 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-dae31395-8230-4cff-8abb-e08d3bf398c9 req-8123eefa-05a2-4181-9af0-a575cef0a31e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094394 May 28 05:34:52.074467 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3556/7000] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:34:52.246924 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-adbb352b-b617-4d8e-9063-49254fbc1942 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "DELETE /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 204 len: 0 microversion: 2.1 time: 0.338569 May 28 05:34:52.248047 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3445/7001] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:34:51 2022] DELETE /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:34:52.282302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e45630e7-8562-4526-97ac-93bcff5bcb5c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:34:52.282934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e45630e7-8562-4526-97ac-93bcff5bcb5c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:34:52.292353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e45630e7-8562-4526-97ac-93bcff5bcb5c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:34:52.292812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e45630e7-8562-4526-97ac-93bcff5bcb5c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:34:52.293589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e45630e7-8562-4526-97ac-93bcff5bcb5c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:34:52.294033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e45630e7-8562-4526-97ac-93bcff5bcb5c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:34:52.430029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e45630e7-8562-4526-97ac-93bcff5bcb5c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:34:52.438028 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e45630e7-8562-4526-97ac-93bcff5bcb5c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1577 microversion: 2.1 time: 0.160796 May 28 05:34:52.448664 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3557/7002] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:34:52 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:34:53.457818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-41ff27cd-8dd5-4c97-a283-03fe8b1752a5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:34:53.458456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-41ff27cd-8dd5-4c97-a283-03fe8b1752a5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:34:53.465838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41ff27cd-8dd5-4c97-a283-03fe8b1752a5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:34:53.466312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41ff27cd-8dd5-4c97-a283-03fe8b1752a5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:34:53.467175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41ff27cd-8dd5-4c97-a283-03fe8b1752a5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:34:53.467631 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-41ff27cd-8dd5-4c97-a283-03fe8b1752a5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:34:53.664523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-41ff27cd-8dd5-4c97-a283-03fe8b1752a5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:34:53.672199 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-41ff27cd-8dd5-4c97-a283-03fe8b1752a5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1577 microversion: 2.1 time: 0.219422 May 28 05:34:53.672782 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3446/7003] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:34:53 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1577 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:34:54.265442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-26522143-fc63-42b7-9fa6-438b9c7a29c3 req-9973b6a1-b132-43e3-9881-ddbf6d7e589f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4", "name": "network-vif-deleted", "tag": "ab409d3b-17c3-4a0a-91c8-67b07df928bc"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:34:54.277716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-26522143-fc63-42b7-9fa6-438b9c7a29c3 req-9973b6a1-b132-43e3-9881-ddbf6d7e589f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:34:54.278173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-26522143-fc63-42b7-9fa6-438b9c7a29c3 req-9973b6a1-b132-43e3-9881-ddbf6d7e589f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:34:54.284764 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] [7fb7b4e8-8c85-4700-986d-4cff401b6421] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 58048. May 28 05:34:54.291111 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] [a1992b24-c6ca-47ed-a310-b37951ac973c] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 58046. May 28 05:34:54.292740 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-26522143-fc63-42b7-9fa6-438b9c7a29c3 req-9973b6a1-b132-43e3-9881-ddbf6d7e589f service nova] Creating event network-vif-deleted:ab409d3b-17c3-4a0a-91c8-67b07df928bc for instance 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 on n-h1-843700-1 May 28 05:34:54.297484 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-26522143-fc63-42b7-9fa6-438b9c7a29c3 req-9973b6a1-b132-43e3-9881-ddbf6d7e589f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035859 May 28 05:34:54.298080 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3558/7004] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:34:54.690584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ea354576-b9bf-41a8-93f4-73399998d12b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:34:54.691312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ea354576-b9bf-41a8-93f4-73399998d12b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:34:54.698540 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea354576-b9bf-41a8-93f4-73399998d12b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:34:54.699142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea354576-b9bf-41a8-93f4-73399998d12b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:34:54.699990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea354576-b9bf-41a8-93f4-73399998d12b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:34:54.700509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea354576-b9bf-41a8-93f4-73399998d12b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:34:54.761918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ea354576-b9bf-41a8-93f4-73399998d12b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:34:54.770481 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ea354576-b9bf-41a8-93f4-73399998d12b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1225 microversion: 2.1 time: 0.084365 May 28 05:34:54.771155 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3447/7005] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:34:54 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:34:55.789115 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-88030f71-aadc-4866-af45-44216a75ad5e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:34:55.789826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-88030f71-aadc-4866-af45-44216a75ad5e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:34:55.796254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-88030f71-aadc-4866-af45-44216a75ad5e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:34:55.796716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-88030f71-aadc-4866-af45-44216a75ad5e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:34:55.797488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-88030f71-aadc-4866-af45-44216a75ad5e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:34:55.797932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-88030f71-aadc-4866-af45-44216a75ad5e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:34:55.863706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-88030f71-aadc-4866-af45-44216a75ad5e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:34:55.871449 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-88030f71-aadc-4866-af45-44216a75ad5e tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1225 microversion: 2.1 time: 0.088030 May 28 05:34:55.872164 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3559/7006] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:34:55 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:34:56.888671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2ccd7465-4487-4f3c-b8fa-837329a653c4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:34:56.889421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2ccd7465-4487-4f3c-b8fa-837329a653c4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:34:56.896729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2ccd7465-4487-4f3c-b8fa-837329a653c4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:34:56.897233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2ccd7465-4487-4f3c-b8fa-837329a653c4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:34:56.898040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2ccd7465-4487-4f3c-b8fa-837329a653c4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:34:56.898497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2ccd7465-4487-4f3c-b8fa-837329a653c4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:34:56.964316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2ccd7465-4487-4f3c-b8fa-837329a653c4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:34:56.972745 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2ccd7465-4487-4f3c-b8fa-837329a653c4 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1225 microversion: 2.1 time: 0.088237 May 28 05:34:56.973326 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3448/7007] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:34:56 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:34:57.989947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-72277202-c594-43c4-b842-20633d2a1a34 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:34:57.990572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-72277202-c594-43c4-b842-20633d2a1a34 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:34:57.997693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72277202-c594-43c4-b842-20633d2a1a34 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:34:57.998154 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72277202-c594-43c4-b842-20633d2a1a34 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:34:57.998933 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72277202-c594-43c4-b842-20633d2a1a34 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:34:57.999414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72277202-c594-43c4-b842-20633d2a1a34 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:34:58.063723 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-72277202-c594-43c4-b842-20633d2a1a34 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:34:58.071489 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-72277202-c594-43c4-b842-20633d2a1a34 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1225 microversion: 2.1 time: 0.086349 May 28 05:34:58.072067 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3560/7008] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:34:57 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:34:59.089085 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1266459e-b63b-42cf-a6be-1fe0d1f75788 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:34:59.089704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1266459e-b63b-42cf-a6be-1fe0d1f75788 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:34:59.096756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1266459e-b63b-42cf-a6be-1fe0d1f75788 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:34:59.097456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1266459e-b63b-42cf-a6be-1fe0d1f75788 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:34:59.097977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1266459e-b63b-42cf-a6be-1fe0d1f75788 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:34:59.098430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1266459e-b63b-42cf-a6be-1fe0d1f75788 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:34:59.161145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1266459e-b63b-42cf-a6be-1fe0d1f75788 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:34:59.169020 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1266459e-b63b-42cf-a6be-1fe0d1f75788 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1225 microversion: 2.1 time: 0.083979 May 28 05:34:59.171903 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3449/7009] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:34:59 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:35:00.186598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-21801333-a038-4cb6-a5a3-559a14d0d63b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:00.187258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-21801333-a038-4cb6-a5a3-559a14d0d63b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:00.194621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21801333-a038-4cb6-a5a3-559a14d0d63b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:00.195265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21801333-a038-4cb6-a5a3-559a14d0d63b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:00.195877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21801333-a038-4cb6-a5a3-559a14d0d63b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:00.196321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21801333-a038-4cb6-a5a3-559a14d0d63b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:00.261916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-21801333-a038-4cb6-a5a3-559a14d0d63b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:35:00.269629 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-21801333-a038-4cb6-a5a3-559a14d0d63b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1225 microversion: 2.1 time: 0.087170 May 28 05:35:00.270467 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3561/7010] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:00 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:35:01.287357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-719d9142-2b3e-4b5b-b387-14b5dc173127 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:01.288008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-719d9142-2b3e-4b5b-b387-14b5dc173127 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:01.295578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-719d9142-2b3e-4b5b-b387-14b5dc173127 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:01.296052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-719d9142-2b3e-4b5b-b387-14b5dc173127 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:01.296952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-719d9142-2b3e-4b5b-b387-14b5dc173127 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:01.297329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-719d9142-2b3e-4b5b-b387-14b5dc173127 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:01.363515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-719d9142-2b3e-4b5b-b387-14b5dc173127 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:35:01.372174 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-719d9142-2b3e-4b5b-b387-14b5dc173127 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1225 microversion: 2.1 time: 0.088472 May 28 05:35:01.372428 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3450/7011] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:01 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:35:02.389280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-47d04bb4-f990-436d-8b09-af6ffe119d94 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:02.389994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-47d04bb4-f990-436d-8b09-af6ffe119d94 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:02.397994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47d04bb4-f990-436d-8b09-af6ffe119d94 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:02.398527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47d04bb4-f990-436d-8b09-af6ffe119d94 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:02.399384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47d04bb4-f990-436d-8b09-af6ffe119d94 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:02.399848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-47d04bb4-f990-436d-8b09-af6ffe119d94 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:02.460788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-47d04bb4-f990-436d-8b09-af6ffe119d94 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:35:02.468854 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-47d04bb4-f990-436d-8b09-af6ffe119d94 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1225 microversion: 2.1 time: 0.083553 May 28 05:35:02.469436 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3562/7012] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:02 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:35:03.485924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-40597b65-e61c-4940-ae40-accaaa64e84c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:03.486516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-40597b65-e61c-4940-ae40-accaaa64e84c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:03.493784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40597b65-e61c-4940-ae40-accaaa64e84c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:03.494254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40597b65-e61c-4940-ae40-accaaa64e84c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:03.495108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40597b65-e61c-4940-ae40-accaaa64e84c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:03.495569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40597b65-e61c-4940-ae40-accaaa64e84c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:03.527077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40597b65-e61c-4940-ae40-accaaa64e84c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:03.527492 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40597b65-e61c-4940-ae40-accaaa64e84c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:03.527963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-40597b65-e61c-4940-ae40-accaaa64e84c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lazy-loading 'fault' on Instance uuid 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:35:03.567757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-40597b65-e61c-4940-ae40-accaaa64e84c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:35:03.575332 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-40597b65-e61c-4940-ae40-accaaa64e84c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 200 len: 1230 microversion: 2.1 time: 0.093543 May 28 05:35:03.575906 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3451/7013] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:03 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:35:04.592158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1ea1ed90-d691-4306-945a-dddbaf08b0ed tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:04.592773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1ea1ed90-d691-4306-945a-dddbaf08b0ed tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:04.600138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ea1ed90-d691-4306-945a-dddbaf08b0ed tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:04.600591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ea1ed90-d691-4306-945a-dddbaf08b0ed tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:04.601350 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ea1ed90-d691-4306-945a-dddbaf08b0ed tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:04.601785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1ea1ed90-d691-4306-945a-dddbaf08b0ed tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:04.615574 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-1ea1ed90-d691-4306-945a-dddbaf08b0ed tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] HTTP exception thrown: Instance 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 could not be found. May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1ea1ed90-d691-4306-945a-dddbaf08b0ed tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Request method failure captured: May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 HTTP/1.1 May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbDlrqJvsw-Bj4hemx4XscPzQgI57Oj0DhtZ0WItt0VxFXFIUFqzN1b2sr7MK3BjOGQZJbLNmoClfshSjagkFRTmogQaQpoLYEaPQkaSagOXWAKjyAlGGxZFI9I-y-IJo4VhS_mMCbBct4nVbcF58kjzhMiK5F2slw20hRu7zD2W154 May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TestVolumeBootPattern-934660757 May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TestVolumeBootPattern-934660757-project May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: a33708c760574b0698fc16ddfebad05b May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TestVolumeBootPattern-934660757-project May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 could not be found. May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4'} May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 could not be found. May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 could not be found. May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:35:04.617189 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:35:04.622277 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:35:04.622277 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:35:04.622277 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:35:04.622277 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:35:04.622277 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:35:04.622277 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 could not be found. May 28 05:35:04.622277 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:35:04.622277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1ea1ed90-d691-4306-945a-dddbaf08b0ed tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Returning 404 to user: Instance 20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:35:04.622277 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1ea1ed90-d691-4306-945a-dddbaf08b0ed tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4" status: 404 len: 111 microversion: 2.1 time: 0.030360 May 28 05:35:04.622277 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3563/7014] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:04 2022] GET /compute/v2.1/servers/20f093c6-dcd4-4a2b-a6ae-8547c7b63ee4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:35:15.303054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f4a42f5b-1e8e-4df1-a9e6-7b67aeafebf5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:15.303655 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f4a42f5b-1e8e-4df1-a9e6-7b67aeafebf5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:15.306779 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:35:15.307551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:35:15.312583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4a42f5b-1e8e-4df1-a9e6-7b67aeafebf5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:15.313142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4a42f5b-1e8e-4df1-a9e6-7b67aeafebf5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:15.314015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4a42f5b-1e8e-4df1-a9e6-7b67aeafebf5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:15.314696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f4a42f5b-1e8e-4df1-a9e6-7b67aeafebf5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:15.341746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f4a42f5b-1e8e-4df1-a9e6-7b67aeafebf5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:35:15.348188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=16 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:35:15.349588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=36 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:35:15.402576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-68b6163a-1e87-411c-90fe-97381fe4dbeb req-66a91c19-a8c7-461f-bb20-b3bc6c96afc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "567cdb73-6b1f-4385-b17a-acd2b3fef0aa", "tag": "b6d4d0ae-f61d-44fa-b4ab-6ecdcb558296"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:35:15.412330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-68b6163a-1e87-411c-90fe-97381fe4dbeb req-66a91c19-a8c7-461f-bb20-b3bc6c96afc0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:15.412717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-68b6163a-1e87-411c-90fe-97381fe4dbeb req-66a91c19-a8c7-461f-bb20-b3bc6c96afc0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:15.423829 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-68b6163a-1e87-411c-90fe-97381fe4dbeb req-66a91c19-a8c7-461f-bb20-b3bc6c96afc0 service nova] Creating event network-changed:b6d4d0ae-f61d-44fa-b4ab-6ecdcb558296 for instance 567cdb73-6b1f-4385-b17a-acd2b3fef0aa on n-h2-843700-1 May 28 05:35:15.430787 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-68b6163a-1e87-411c-90fe-97381fe4dbeb req-66a91c19-a8c7-461f-bb20-b3bc6c96afc0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088466 May 28 05:35:15.430787 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3564/7015] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:35:15.664757 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f4a42f5b-1e8e-4df1-a9e6-7b67aeafebf5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "DELETE /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 204 len: 0 microversion: 2.1 time: 0.365291 May 28 05:35:15.668969 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3452/7016] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:35:15 2022] DELETE /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:35:15.676487 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9ef1cbbc-9695-4eb7-b48f-dd2c5c524a67 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:15.677387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9ef1cbbc-9695-4eb7-b48f-dd2c5c524a67 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:15.684624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ef1cbbc-9695-4eb7-b48f-dd2c5c524a67 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:15.685318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ef1cbbc-9695-4eb7-b48f-dd2c5c524a67 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:15.686107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ef1cbbc-9695-4eb7-b48f-dd2c5c524a67 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:15.686546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ef1cbbc-9695-4eb7-b48f-dd2c5c524a67 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:15.882934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9ef1cbbc-9695-4eb7-b48f-dd2c5c524a67 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:35:15.890485 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9ef1cbbc-9695-4eb7-b48f-dd2c5c524a67 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1576 microversion: 2.1 time: 0.220433 May 28 05:35:15.891198 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3565/7017] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:15 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:35:16.791569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-3ffc68a5-9306-4816-bd87-1e98a127ed97 req-2dca3c1d-8ec0-4d7e-b019-a8706583d62a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "567cdb73-6b1f-4385-b17a-acd2b3fef0aa", "name": "network-vif-deleted", "tag": "b6d4d0ae-f61d-44fa-b4ab-6ecdcb558296"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:35:16.800548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3ffc68a5-9306-4816-bd87-1e98a127ed97 req-2dca3c1d-8ec0-4d7e-b019-a8706583d62a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:16.801002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-3ffc68a5-9306-4816-bd87-1e98a127ed97 req-2dca3c1d-8ec0-4d7e-b019-a8706583d62a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:16.812238 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-3ffc68a5-9306-4816-bd87-1e98a127ed97 req-2dca3c1d-8ec0-4d7e-b019-a8706583d62a service nova] Creating event network-vif-deleted:b6d4d0ae-f61d-44fa-b4ab-6ecdcb558296 for instance 567cdb73-6b1f-4385-b17a-acd2b3fef0aa on n-h2-843700-1 May 28 05:35:16.817854 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-3ffc68a5-9306-4816-bd87-1e98a127ed97 req-2dca3c1d-8ec0-4d7e-b019-a8706583d62a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030690 May 28 05:35:16.820030 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3453/7018] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:35:16.910020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f8362933-a108-4b32-ac05-3e318a2789b5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:16.910714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f8362933-a108-4b32-ac05-3e318a2789b5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:16.917796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8362933-a108-4b32-ac05-3e318a2789b5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:16.918260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8362933-a108-4b32-ac05-3e318a2789b5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:16.919086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8362933-a108-4b32-ac05-3e318a2789b5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:16.919536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f8362933-a108-4b32-ac05-3e318a2789b5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:16.987248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f8362933-a108-4b32-ac05-3e318a2789b5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:35:17.004269 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f8362933-a108-4b32-ac05-3e318a2789b5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1225 microversion: 2.1 time: 0.089690 May 28 05:35:17.004269 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3566/7019] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:16 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:35:18.013547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8243ad57-d37a-4437-9e94-c477ab9b8f08 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:18.014276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8243ad57-d37a-4437-9e94-c477ab9b8f08 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:18.021505 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8243ad57-d37a-4437-9e94-c477ab9b8f08 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:18.021985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8243ad57-d37a-4437-9e94-c477ab9b8f08 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:18.022778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8243ad57-d37a-4437-9e94-c477ab9b8f08 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:18.023272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8243ad57-d37a-4437-9e94-c477ab9b8f08 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:18.088626 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8243ad57-d37a-4437-9e94-c477ab9b8f08 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:35:18.096544 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8243ad57-d37a-4437-9e94-c477ab9b8f08 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1225 microversion: 2.1 time: 0.088242 May 28 05:35:18.097126 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3454/7020] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:18 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:35:19.113835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9e327164-e86b-4d02-ba7e-0e3b7febba06 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:19.114461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9e327164-e86b-4d02-ba7e-0e3b7febba06 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:19.121821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e327164-e86b-4d02-ba7e-0e3b7febba06 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:19.122286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e327164-e86b-4d02-ba7e-0e3b7febba06 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:19.123131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e327164-e86b-4d02-ba7e-0e3b7febba06 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:19.123581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e327164-e86b-4d02-ba7e-0e3b7febba06 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:19.185907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9e327164-e86b-4d02-ba7e-0e3b7febba06 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:35:19.194351 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9e327164-e86b-4d02-ba7e-0e3b7febba06 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1225 microversion: 2.1 time: 0.084985 May 28 05:35:19.194923 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3567/7021] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:19 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:35:20.211561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-32389085-5f3b-4fc2-9238-4922e363a0ea tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:20.212237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-32389085-5f3b-4fc2-9238-4922e363a0ea tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:20.219202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-32389085-5f3b-4fc2-9238-4922e363a0ea tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:20.219671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-32389085-5f3b-4fc2-9238-4922e363a0ea tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:20.220474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-32389085-5f3b-4fc2-9238-4922e363a0ea tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:20.220934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-32389085-5f3b-4fc2-9238-4922e363a0ea tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:20.284296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-32389085-5f3b-4fc2-9238-4922e363a0ea tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:35:20.292429 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-32389085-5f3b-4fc2-9238-4922e363a0ea tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1225 microversion: 2.1 time: 0.084717 May 28 05:35:20.293031 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3455/7022] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:20 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:35:21.309798 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-151918a2-dc10-45d1-aec6-74424ae7dfa5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:21.310475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-151918a2-dc10-45d1-aec6-74424ae7dfa5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:21.317637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-151918a2-dc10-45d1-aec6-74424ae7dfa5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:21.318097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-151918a2-dc10-45d1-aec6-74424ae7dfa5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:21.318879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-151918a2-dc10-45d1-aec6-74424ae7dfa5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:21.319351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-151918a2-dc10-45d1-aec6-74424ae7dfa5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:21.386544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-151918a2-dc10-45d1-aec6-74424ae7dfa5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:35:21.395330 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-151918a2-dc10-45d1-aec6-74424ae7dfa5 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1225 microversion: 2.1 time: 0.089442 May 28 05:35:21.398007 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3568/7023] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:21 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:35:22.415167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f0c7573c-29c2-4961-a52f-6cce0486b84c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:22.415793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f0c7573c-29c2-4961-a52f-6cce0486b84c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:22.422341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0c7573c-29c2-4961-a52f-6cce0486b84c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:22.423115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0c7573c-29c2-4961-a52f-6cce0486b84c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:22.423919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0c7573c-29c2-4961-a52f-6cce0486b84c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:22.425040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0c7573c-29c2-4961-a52f-6cce0486b84c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:22.487797 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f0c7573c-29c2-4961-a52f-6cce0486b84c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:35:22.495673 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f0c7573c-29c2-4961-a52f-6cce0486b84c tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1225 microversion: 2.1 time: 0.087039 May 28 05:35:22.496255 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3456/7024] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:22 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:35:23.513103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-907c7ffe-a70d-4978-9eef-a7d8192dbe2b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:23.513650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-907c7ffe-a70d-4978-9eef-a7d8192dbe2b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:23.521462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-907c7ffe-a70d-4978-9eef-a7d8192dbe2b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:23.521926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-907c7ffe-a70d-4978-9eef-a7d8192dbe2b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:23.522866 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-907c7ffe-a70d-4978-9eef-a7d8192dbe2b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:23.523338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-907c7ffe-a70d-4978-9eef-a7d8192dbe2b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:23.584734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-907c7ffe-a70d-4978-9eef-a7d8192dbe2b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:35:23.592438 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-907c7ffe-a70d-4978-9eef-a7d8192dbe2b tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1225 microversion: 2.1 time: 0.083453 May 28 05:35:23.593022 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3569/7025] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:23 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:35:24.609839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c1724aaf-4eba-45cd-98fc-aad97b6bcbf7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:24.610469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c1724aaf-4eba-45cd-98fc-aad97b6bcbf7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:24.617633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1724aaf-4eba-45cd-98fc-aad97b6bcbf7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:24.618097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1724aaf-4eba-45cd-98fc-aad97b6bcbf7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:24.618878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1724aaf-4eba-45cd-98fc-aad97b6bcbf7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:24.619355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1724aaf-4eba-45cd-98fc-aad97b6bcbf7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:24.680729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c1724aaf-4eba-45cd-98fc-aad97b6bcbf7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:35:24.688444 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c1724aaf-4eba-45cd-98fc-aad97b6bcbf7 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1225 microversion: 2.1 time: 0.082592 May 28 05:35:24.689027 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3457/7026] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:24 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:35:25.706891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cb9e35c6-ebec-418f-9478-c160a99daed0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:25.707589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cb9e35c6-ebec-418f-9478-c160a99daed0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:25.713707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb9e35c6-ebec-418f-9478-c160a99daed0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:25.714158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb9e35c6-ebec-418f-9478-c160a99daed0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:25.714921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb9e35c6-ebec-418f-9478-c160a99daed0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:25.715384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb9e35c6-ebec-418f-9478-c160a99daed0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:25.779355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cb9e35c6-ebec-418f-9478-c160a99daed0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33708c760574b0698fc16ddfebad05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45163cf20a447a0a60bc0c0f075fa78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:35:25.787584 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cb9e35c6-ebec-418f-9478-c160a99daed0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 200 len: 1225 microversion: 2.1 time: 0.085628 May 28 05:35:25.788171 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3570/7027] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:25 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:35:26.804853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5433566b-afa9-4f0f-b8c9-acb424b4ffc9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:26.805483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5433566b-afa9-4f0f-b8c9-acb424b4ffc9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: 567cdb73-6b1f-4385-b17a-acd2b3fef0aa] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:26.812482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5433566b-afa9-4f0f-b8c9-acb424b4ffc9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:26.812936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5433566b-afa9-4f0f-b8c9-acb424b4ffc9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:26.813708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5433566b-afa9-4f0f-b8c9-acb424b4ffc9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:26.814155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5433566b-afa9-4f0f-b8c9-acb424b4ffc9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:26.828082 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-5433566b-afa9-4f0f-b8c9-acb424b4ffc9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] HTTP exception thrown: Instance 567cdb73-6b1f-4385-b17a-acd2b3fef0aa could not be found. May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5433566b-afa9-4f0f-b8c9-acb424b4ffc9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Request method failure captured: May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa HTTP/1.1 May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbDlrqJvsw-Bj4hemx4XscPzQgI57Oj0DhtZ0WItt0VxFXFIUFqzN1b2sr7MK3BjOGQZJbLNmoClfshSjagkFRTmogQaQpoLYEaPQkaSagOXWAKjyAlGGxZFI9I-y-IJo4VhS_mMCbBct4nVbcF58kjzhMiK5F2slw20hRu7zD2W154 May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestVolumeBootPattern-934660757 May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestVolumeBootPattern-934660757-project May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: a33708c760574b0698fc16ddfebad05b May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestVolumeBootPattern-934660757-project May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 567cdb73-6b1f-4385-b17a-acd2b3fef0aa could not be found. May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '567cdb73-6b1f-4385-b17a-acd2b3fef0aa'} May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 567cdb73-6b1f-4385-b17a-acd2b3fef0aa could not be found. May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 567cdb73-6b1f-4385-b17a-acd2b3fef0aa could not be found. May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:35:26.829721 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:35:26.835410 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:35:26.835410 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:35:26.835410 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:35:26.835410 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:35:26.835410 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:35:26.835410 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 567cdb73-6b1f-4385-b17a-acd2b3fef0aa could not be found. May 28 05:35:26.835410 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:35:26.835410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5433566b-afa9-4f0f-b8c9-acb424b4ffc9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Returning 404 to user: Instance 567cdb73-6b1f-4385-b17a-acd2b3fef0aa could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:35:26.835410 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5433566b-afa9-4f0f-b8c9-acb424b4ffc9 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa" status: 404 len: 111 microversion: 2.1 time: 0.030306 May 28 05:35:26.835410 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3458/7028] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:26 2022] GET /compute/v2.1/servers/567cdb73-6b1f-4385-b17a-acd2b3fef0aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:35:27.328890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f322dfb5-5c4b-4aee-835e-72e81beccf66 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:27.329418 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f322dfb5-5c4b-4aee-835e-72e81beccf66 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:27.336856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f322dfb5-5c4b-4aee-835e-72e81beccf66 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:27.337310 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f322dfb5-5c4b-4aee-835e-72e81beccf66 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:27.338084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f322dfb5-5c4b-4aee-835e-72e81beccf66 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:27.338534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f322dfb5-5c4b-4aee-835e-72e81beccf66 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:27.352672 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-f322dfb5-5c4b-4aee-835e-72e81beccf66 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] HTTP exception thrown: Instance d859f477-09df-4195-9b46-0f7c574942bb could not be found. May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f322dfb5-5c4b-4aee-835e-72e81beccf66 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Request method failure captured: May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb HTTP/1.1 May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbDlrqJvsw-Bj4hemx4XscPzQgI57Oj0DhtZ0WItt0VxFXFIUFqzN1b2sr7MK3BjOGQZJbLNmoClfshSjagkFRTmogQaQpoLYEaPQkaSagOXWAKjyAlGGxZFI9I-y-IJo4VhS_mMCbBct4nVbcF58kjzhMiK5F2slw20hRu7zD2W154 May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TestVolumeBootPattern-934660757 May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TestVolumeBootPattern-934660757-project May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: a33708c760574b0698fc16ddfebad05b May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TestVolumeBootPattern-934660757-project May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance d859f477-09df-4195-9b46-0f7c574942bb could not be found. May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'd859f477-09df-4195-9b46-0f7c574942bb'} May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d859f477-09df-4195-9b46-0f7c574942bb could not be found. May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:35:27.354342 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:35:27.358744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d859f477-09df-4195-9b46-0f7c574942bb could not be found. May 28 05:35:27.358744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:35:27.358744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:35:27.358744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:35:27.358744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:35:27.358744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:35:27.358744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:35:27.358744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:35:27.358744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:35:27.358744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d859f477-09df-4195-9b46-0f7c574942bb could not be found. May 28 05:35:27.358744 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:35:27.358744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f322dfb5-5c4b-4aee-835e-72e81beccf66 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Returning 404 to user: Instance d859f477-09df-4195-9b46-0f7c574942bb could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:35:27.358744 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f322dfb5-5c4b-4aee-835e-72e81beccf66 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 404 len: 111 microversion: 2.1 time: 0.030895 May 28 05:35:27.358744 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3571/7029] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:35:27 2022] DELETE /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:35:27.364302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-47abbd3d-ba0b-4807-b356-17490db5da92 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:27.364935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-47abbd3d-ba0b-4807-b356-17490db5da92 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] [instance: d859f477-09df-4195-9b46-0f7c574942bb] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:27.371102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47abbd3d-ba0b-4807-b356-17490db5da92 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:27.371571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47abbd3d-ba0b-4807-b356-17490db5da92 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:27.372354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47abbd3d-ba0b-4807-b356-17490db5da92 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:27.372810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47abbd3d-ba0b-4807-b356-17490db5da92 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:27.386262 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-47abbd3d-ba0b-4807-b356-17490db5da92 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] HTTP exception thrown: Instance d859f477-09df-4195-9b46-0f7c574942bb could not be found. May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-47abbd3d-ba0b-4807-b356-17490db5da92 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Request method failure captured: May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb HTTP/1.1 May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbDlrqJvsw-Bj4hemx4XscPzQgI57Oj0DhtZ0WItt0VxFXFIUFqzN1b2sr7MK3BjOGQZJbLNmoClfshSjagkFRTmogQaQpoLYEaPQkaSagOXWAKjyAlGGxZFI9I-y-IJo4VhS_mMCbBct4nVbcF58kjzhMiK5F2slw20hRu7zD2W154 May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e45163cf20a447a0a60bc0c0f075fa78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestVolumeBootPattern-934660757 May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: e45163cf20a447a0a60bc0c0f075fa78 May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestVolumeBootPattern-934660757 May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestVolumeBootPattern-934660757-project May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: a33708c760574b0698fc16ddfebad05b May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestVolumeBootPattern-934660757-project May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance d859f477-09df-4195-9b46-0f7c574942bb could not be found. May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'd859f477-09df-4195-9b46-0f7c574942bb'} May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d859f477-09df-4195-9b46-0f7c574942bb could not be found. May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d859f477-09df-4195-9b46-0f7c574942bb could not be found. May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:35:27.387822 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:35:27.392783 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:35:27.392783 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:35:27.392783 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:35:27.392783 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:35:27.392783 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:35:27.392783 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d859f477-09df-4195-9b46-0f7c574942bb could not be found. May 28 05:35:27.392783 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:35:27.392783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-47abbd3d-ba0b-4807-b356-17490db5da92 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Returning 404 to user: Instance d859f477-09df-4195-9b46-0f7c574942bb could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:35:27.392783 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-47abbd3d-ba0b-4807-b356-17490db5da92 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb" status: 404 len: 111 microversion: 2.1 time: 0.028843 May 28 05:35:27.392783 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3459/7030] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:27 2022] GET /compute/v2.1/servers/d859f477-09df-4195-9b46-0f7c574942bb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:35:34.137326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6fe2ecc3-e7cd-4b3a-94fd-244a6d15b7a0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] Calling method '.version_select at 0x7f7700852160>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:34.241957 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6fe2ecc3-e7cd-4b3a-94fd-244a6d15b7a0 tempest-TestVolumeBootPattern-934660757 tempest-TestVolumeBootPattern-934660757-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1662296462" status: 202 len: 0 microversion: 2.1 time: 0.108622 May 28 05:35:34.242656 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3572/7031] 10.222.0.58 () {58 vars in 1262 bytes} [Sat May 28 05:35:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1662296462 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:35:55.212798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:35:55.213572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:35:55.321929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6de389b0-989f-4045-aa4d-16596b989f8f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1627222888", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:35:55.372172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-6de389b0-989f-4045-aa4d-16596b989f8f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] validate_networks() for None {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:35:55.561874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-6de389b0-989f-4045-aa4d-16596b989f8f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:35:55.562323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-6de389b0-989f-4045-aa4d-16596b989f8f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:35:55.562819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-6de389b0-989f-4045-aa4d-16596b989f8f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:35:55.563283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-6de389b0-989f-4045-aa4d-16596b989f8f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:35:55.563724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-6de389b0-989f-4045-aa4d-16596b989f8f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:35:55.575108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6de389b0-989f-4045-aa4d-16596b989f8f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:55.575583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6de389b0-989f-4045-aa4d-16596b989f8f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:55.576413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6de389b0-989f-4045-aa4d-16596b989f8f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:55.576878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6de389b0-989f-4045-aa4d-16596b989f8f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:55.596423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-6de389b0-989f-4045-aa4d-16596b989f8f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Getting quotas for project ddf7418bcf044c258195838373ec2786. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:35:55.602425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-6de389b0-989f-4045-aa4d-16596b989f8f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Getting quotas for user 3a307511fc9e4339aaa3da4093f73767 and project ddf7418bcf044c258195838373ec2786. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:35:55.615192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6de389b0-989f-4045-aa4d-16596b989f8f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:35:55.617486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6de389b0-989f-4045-aa4d-16596b989f8f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:35:55.710114 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6de389b0-989f-4045-aa4d-16596b989f8f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503024 May 28 05:35:55.710696 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3460/7032] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:35:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:35:55.719349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=40 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:35:55.720489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:35:55.725260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-028873c1-44f5-4190-91b2-6e9fe93fe8fd tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:55.726795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-028873c1-44f5-4190-91b2-6e9fe93fe8fd tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:55.779873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-028873c1-44f5-4190-91b2-6e9fe93fe8fd tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a307511fc9e4339aaa3da4093f73767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf7418bcf044c258195838373ec2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:35:55.790327 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-028873c1-44f5-4190-91b2-6e9fe93fe8fd tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] 10.222.0.58 "GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9" status: 200 len: 1222 microversion: 2.1 time: 0.073346 May 28 05:35:55.794276 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3573/7033] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:55 2022] GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9 => generated 1222 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:35:56.808780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-77e6d147-81e9-4101-aea3-f53e75df1de0 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:56.809417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-77e6d147-81e9-4101-aea3-f53e75df1de0 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:56.816449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77e6d147-81e9-4101-aea3-f53e75df1de0 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:56.816919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77e6d147-81e9-4101-aea3-f53e75df1de0 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:56.817720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77e6d147-81e9-4101-aea3-f53e75df1de0 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:56.818160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-77e6d147-81e9-4101-aea3-f53e75df1de0 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:56.881313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-77e6d147-81e9-4101-aea3-f53e75df1de0 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a307511fc9e4339aaa3da4093f73767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf7418bcf044c258195838373ec2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:35:56.889124 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-77e6d147-81e9-4101-aea3-f53e75df1de0 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] 10.222.0.58 "GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9" status: 200 len: 1226 microversion: 2.1 time: 0.085296 May 28 05:35:56.889699 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3461/7034] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:56 2022] GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:35:57.907158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d7f30e30-6fa9-451b-971f-8aae0eeab355 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:57.907922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d7f30e30-6fa9-451b-971f-8aae0eeab355 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:57.915580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7f30e30-6fa9-451b-971f-8aae0eeab355 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:57.916043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7f30e30-6fa9-451b-971f-8aae0eeab355 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:57.916971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7f30e30-6fa9-451b-971f-8aae0eeab355 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:57.917425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7f30e30-6fa9-451b-971f-8aae0eeab355 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:57.999202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d7f30e30-6fa9-451b-971f-8aae0eeab355 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a307511fc9e4339aaa3da4093f73767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf7418bcf044c258195838373ec2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:35:58.007655 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d7f30e30-6fa9-451b-971f-8aae0eeab355 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] 10.222.0.58 "GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9" status: 200 len: 1282 microversion: 2.1 time: 0.105085 May 28 05:35:58.008240 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3574/7035] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:57 2022] GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9 => generated 1282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:35:59.028175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0e0f2473-d8e0-42b3-b840-cebc6905e8d5 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:35:59.028828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0e0f2473-d8e0-42b3-b840-cebc6905e8d5 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:35:59.036412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e0f2473-d8e0-42b3-b840-cebc6905e8d5 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:59.037000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e0f2473-d8e0-42b3-b840-cebc6905e8d5 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:59.037796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e0f2473-d8e0-42b3-b840-cebc6905e8d5 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:59.038258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e0f2473-d8e0-42b3-b840-cebc6905e8d5 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:59.282081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0e0f2473-d8e0-42b3-b840-cebc6905e8d5 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a307511fc9e4339aaa3da4093f73767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf7418bcf044c258195838373ec2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:35:59.289744 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0e0f2473-d8e0-42b3-b840-cebc6905e8d5 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] 10.222.0.58 "GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9" status: 200 len: 1322 microversion: 2.1 time: 0.265608 May 28 05:35:59.290330 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3462/7036] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:35:59 2022] GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9 => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:35:59.754071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-acc374ae-8d57-43f6-84ed-fe0657b51e82 req-f697d8b2-ca3f-4fa4-b17e-2d48e0bec811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3877ff5f-594f-4fde-8ff5-36a537096bf9", "tag": "c6008cd7-13cd-4af9-9f9b-9d1ff43df4ca"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:35:59.765575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-acc374ae-8d57-43f6-84ed-fe0657b51e82 req-f697d8b2-ca3f-4fa4-b17e-2d48e0bec811 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:35:59.766092 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-acc374ae-8d57-43f6-84ed-fe0657b51e82 req-f697d8b2-ca3f-4fa4-b17e-2d48e0bec811 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:35:59.780658 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-acc374ae-8d57-43f6-84ed-fe0657b51e82 req-f697d8b2-ca3f-4fa4-b17e-2d48e0bec811 service nova] Creating event network-changed:c6008cd7-13cd-4af9-9f9b-9d1ff43df4ca for instance 3877ff5f-594f-4fde-8ff5-36a537096bf9 on n-h1-843700-1 May 28 05:35:59.787604 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-acc374ae-8d57-43f6-84ed-fe0657b51e82 req-f697d8b2-ca3f-4fa4-b17e-2d48e0bec811 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037565 May 28 05:35:59.788243 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3575/7037] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:36:00.305921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-daa93224-27e3-4061-9ced-1389baf8e722 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:00.306550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-daa93224-27e3-4061-9ced-1389baf8e722 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:00.313515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-daa93224-27e3-4061-9ced-1389baf8e722 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:00.313986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-daa93224-27e3-4061-9ced-1389baf8e722 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:00.314780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-daa93224-27e3-4061-9ced-1389baf8e722 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:00.315263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-daa93224-27e3-4061-9ced-1389baf8e722 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:00.466008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-daa93224-27e3-4061-9ced-1389baf8e722 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a307511fc9e4339aaa3da4093f73767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf7418bcf044c258195838373ec2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:00.473792 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-daa93224-27e3-4061-9ced-1389baf8e722 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] 10.222.0.58 "GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9" status: 200 len: 1322 microversion: 2.1 time: 0.171798 May 28 05:36:00.475270 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3463/7038] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:00 2022] GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:36:01.492256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7de7193c-d471-43ce-a6cb-9934ac51fbd0 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:01.492880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7de7193c-d471-43ce-a6cb-9934ac51fbd0 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:01.499158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7de7193c-d471-43ce-a6cb-9934ac51fbd0 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:01.499621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7de7193c-d471-43ce-a6cb-9934ac51fbd0 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:01.500392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7de7193c-d471-43ce-a6cb-9934ac51fbd0 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:01.500837 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7de7193c-d471-43ce-a6cb-9934ac51fbd0 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:01.630392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7de7193c-d471-43ce-a6cb-9934ac51fbd0 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a307511fc9e4339aaa3da4093f73767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf7418bcf044c258195838373ec2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:01.637961 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7de7193c-d471-43ce-a6cb-9934ac51fbd0 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] 10.222.0.58 "GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9" status: 200 len: 1322 microversion: 2.1 time: 0.151033 May 28 05:36:01.638533 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3576/7039] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:01 2022] GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:02.655819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8c629745-324d-4a07-8a34-2bcffa1d45fa tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:02.656378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8c629745-324d-4a07-8a34-2bcffa1d45fa tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:02.663906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c629745-324d-4a07-8a34-2bcffa1d45fa tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:02.664382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c629745-324d-4a07-8a34-2bcffa1d45fa tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:02.665169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c629745-324d-4a07-8a34-2bcffa1d45fa tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:02.665635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8c629745-324d-4a07-8a34-2bcffa1d45fa tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:02.796359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8c629745-324d-4a07-8a34-2bcffa1d45fa tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a307511fc9e4339aaa3da4093f73767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf7418bcf044c258195838373ec2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:02.804783 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8c629745-324d-4a07-8a34-2bcffa1d45fa tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] 10.222.0.58 "GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9" status: 200 len: 1322 microversion: 2.1 time: 0.153003 May 28 05:36:02.805364 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3464/7040] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:02 2022] GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:03.822292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2eef8231-594d-4d8c-bd88-5f2dc4f7147c tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:03.822904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2eef8231-594d-4d8c-bd88-5f2dc4f7147c tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:03.829837 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2eef8231-594d-4d8c-bd88-5f2dc4f7147c tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:03.830296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2eef8231-594d-4d8c-bd88-5f2dc4f7147c tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:03.831108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2eef8231-594d-4d8c-bd88-5f2dc4f7147c tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:03.831623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2eef8231-594d-4d8c-bd88-5f2dc4f7147c tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:03.963872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2eef8231-594d-4d8c-bd88-5f2dc4f7147c tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a307511fc9e4339aaa3da4093f73767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf7418bcf044c258195838373ec2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:03.971806 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2eef8231-594d-4d8c-bd88-5f2dc4f7147c tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] 10.222.0.58 "GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9" status: 200 len: 1322 microversion: 2.1 time: 0.153440 May 28 05:36:03.974145 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3577/7041] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:03 2022] GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:04.989393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5d93e459-78c9-478b-ae61-100de0daafc7 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:04.990232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5d93e459-78c9-478b-ae61-100de0daafc7 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:04.997234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d93e459-78c9-478b-ae61-100de0daafc7 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:04.997704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d93e459-78c9-478b-ae61-100de0daafc7 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:04.998495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d93e459-78c9-478b-ae61-100de0daafc7 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:04.998949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5d93e459-78c9-478b-ae61-100de0daafc7 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:05.135404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5d93e459-78c9-478b-ae61-100de0daafc7 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a307511fc9e4339aaa3da4093f73767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf7418bcf044c258195838373ec2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:05.143014 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5d93e459-78c9-478b-ae61-100de0daafc7 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] 10.222.0.58 "GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9" status: 200 len: 1322 microversion: 2.1 time: 0.157714 May 28 05:36:05.143868 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3465/7042] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:04 2022] GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:06.160607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3ef4c864-1eb8-448d-a7b9-88df35b7384e tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:06.161894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3ef4c864-1eb8-448d-a7b9-88df35b7384e tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:06.164859 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:36:06.170033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ef4c864-1eb8-448d-a7b9-88df35b7384e tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:06.170498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ef4c864-1eb8-448d-a7b9-88df35b7384e tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:06.171311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ef4c864-1eb8-448d-a7b9-88df35b7384e tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:06.171788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ef4c864-1eb8-448d-a7b9-88df35b7384e tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:06.300569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3ef4c864-1eb8-448d-a7b9-88df35b7384e tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a307511fc9e4339aaa3da4093f73767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf7418bcf044c258195838373ec2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:06.308319 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3ef4c864-1eb8-448d-a7b9-88df35b7384e tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] 10.222.0.58 "GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9" status: 200 len: 1322 microversion: 2.1 time: 0.151646 May 28 05:36:06.308895 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3578/7043] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:06 2022] GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:06.640624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:36:06.641346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:36:06.691573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-c627184d-1fe9-4497-b749-48c99848cfb9 req-9d950a5d-6de9-4ceb-bee8-e5ce42d5abaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3877ff5f-594f-4fde-8ff5-36a537096bf9", "name": "network-vif-plugged", "status": "completed", "tag": "c6008cd7-13cd-4af9-9f9b-9d1ff43df4ca"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:36:06.700320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c627184d-1fe9-4497-b749-48c99848cfb9 req-9d950a5d-6de9-4ceb-bee8-e5ce42d5abaa service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:06.700784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c627184d-1fe9-4497-b749-48c99848cfb9 req-9d950a5d-6de9-4ceb-bee8-e5ce42d5abaa service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:06.713818 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-c627184d-1fe9-4497-b749-48c99848cfb9 req-9d950a5d-6de9-4ceb-bee8-e5ce42d5abaa service nova] Creating event network-vif-plugged:c6008cd7-13cd-4af9-9f9b-9d1ff43df4ca for instance 3877ff5f-594f-4fde-8ff5-36a537096bf9 on n-h1-843700-1 May 28 05:36:06.719272 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-c627184d-1fe9-4497-b749-48c99848cfb9 req-9d950a5d-6de9-4ceb-bee8-e5ce42d5abaa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083050 May 28 05:36:06.720178 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3466/7044] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:36:07.325682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f628a293-4b74-4357-a009-bee1db617d92 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:07.326308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f628a293-4b74-4357-a009-bee1db617d92 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:07.333378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f628a293-4b74-4357-a009-bee1db617d92 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:07.333841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f628a293-4b74-4357-a009-bee1db617d92 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:07.334612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f628a293-4b74-4357-a009-bee1db617d92 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:07.335086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f628a293-4b74-4357-a009-bee1db617d92 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:07.465918 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f628a293-4b74-4357-a009-bee1db617d92 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a307511fc9e4339aaa3da4093f73767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf7418bcf044c258195838373ec2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:07.474191 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f628a293-4b74-4357-a009-bee1db617d92 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] 10.222.0.58 "GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9" status: 200 len: 1322 microversion: 2.1 time: 0.151835 May 28 05:36:07.474785 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3579/7045] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:07 2022] GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:08.492602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4d1d7f78-975a-4fbc-9c37-b821231a8d9f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:08.493319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4d1d7f78-975a-4fbc-9c37-b821231a8d9f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:08.500804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d1d7f78-975a-4fbc-9c37-b821231a8d9f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:08.501275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d1d7f78-975a-4fbc-9c37-b821231a8d9f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:08.502049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d1d7f78-975a-4fbc-9c37-b821231a8d9f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:08.502503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d1d7f78-975a-4fbc-9c37-b821231a8d9f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:08.632526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4d1d7f78-975a-4fbc-9c37-b821231a8d9f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a307511fc9e4339aaa3da4093f73767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf7418bcf044c258195838373ec2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:08.640127 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4d1d7f78-975a-4fbc-9c37-b821231a8d9f tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] 10.222.0.58 "GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9" status: 200 len: 1472 microversion: 2.1 time: 0.152989 May 28 05:36:08.640710 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3467/7046] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:08 2022] GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9 => generated 1472 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:36:08.713561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6b75c1d8-d52e-48c9-98ad-ba6403999f1f tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Calling method '.version_select at 0x7f7700f8d700>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:08.775773 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6b75c1d8-d52e-48c9-98ad-ba6403999f1f tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/986afdd40b5e41e996bc081656fe5931" status: 200 len: 371 microversion: 2.1 time: 0.117404 May 28 05:36:08.776353 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3580/7047] 10.222.0.58 () {58 vars in 1241 bytes} [Sat May 28 05:36:08 2022] GET /compute/v2.1/os-quota-sets/986afdd40b5e41e996bc081656fe5931 => generated 371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:36:08.787375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fe8c9ff5-428b-4205-b0c4-dfc824053782 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-917284474", "id": 1930828788, "os-flavor-access:is_public": "True"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:36:08.789133 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 05:36:08.789133 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 05:36:08.894800 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fe8c9ff5-428b-4205-b0c4-dfc824053782 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.111711 May 28 05:36:08.895442 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3468/7048] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:36:08 2022] POST /compute/v2.1/flavors => generated 437 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:36:08.906541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5d77807e-46a4-4c02-a543-6f989f9028f5 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1930828788"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:36:08.907552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5d77807e-46a4-4c02-a543-6f989f9028f5 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:08.914329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d77807e-46a4-4c02-a543-6f989f9028f5 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:08.914776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d77807e-46a4-4c02-a543-6f989f9028f5 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:08.915618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d77807e-46a4-4c02-a543-6f989f9028f5 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:08.916002 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d77807e-46a4-4c02-a543-6f989f9028f5 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:09.140021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5d77807e-46a4-4c02-a543-6f989f9028f5 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b41f90971a494ade9ce2fe8abd70cd30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986afdd40b5e41e996bc081656fe5931', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:09.147706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5d77807e-46a4-4c02-a543-6f989f9028f5 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-917284474 {{(pid=126044) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 05:36:09.154158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d77807e-46a4-4c02-a543-6f989f9028f5 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:09.154609 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d77807e-46a4-4c02-a543-6f989f9028f5 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:09.155444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d77807e-46a4-4c02-a543-6f989f9028f5 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:09.155915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5d77807e-46a4-4c02-a543-6f989f9028f5 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:09.179105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-5d77807e-46a4-4c02-a543-6f989f9028f5 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Getting quotas for project ddf7418bcf044c258195838373ec2786. Resources: {'cores', 'ram'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:36:09.184158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-5d77807e-46a4-4c02-a543-6f989f9028f5 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Getting quotas for user 3a307511fc9e4339aaa3da4093f73767 and project ddf7418bcf044c258195838373ec2786. Resources: {'cores', 'ram'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:36:09.196268 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.compute.api [None req-5d77807e-46a4-4c02-a543-6f989f9028f5 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] ram quota exceeded for 986afdd40b5e41e996bc081656fe5931, tried to resize instance. May 28 05:36:09.196810 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-5d77807e-46a4-4c02-a543-6f989f9028f5 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5d77807e-46a4-4c02-a543-6f989f9028f5 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Request method failure captured: May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9/action HTTP/1.1 May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 39 May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbS7-7GPqUCet2XAV5g5mzj54bAwA_87HHaidsNfZFGGAW5MhI2w03x15G2McFC-BPPv7S0lFHUllSLlJuHOQpWHj7q5lj4CqAeC6aoeF-EynP-JdkTm5wN5Ab9RL2xElyBBLwv2l9pb8KaDWI7Pb_k2JsH5pDfnDMlt4lelEbIHJts May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 986afdd40b5e41e996bc081656fe5931 May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1054332661 May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: X-Role: admin,reader,member May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: admin,reader,member May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_986afdd40b5e41e996bc081656fe5931"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/986afdd40b5e41e996bc081656fe5931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/986afdd40b5e41e996bc081656fe5931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/986afdd40b5e41e996bc081656fe5931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1054332661 May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 986afdd40b5e41e996bc081656fe5931 May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1054332661 May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersAdminNegativeTestJSON-1054332661-project-admin May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: b41f90971a494ade9ce2fe8abd70cd30 May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1054332661-project-admin May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: {"resize": {"flavorRef": "1930828788"}} May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '3877ff5f-594f-4fde-8ff5-36a537096bf9', 'body': {'resize': {'flavorRef': '1930828788'}}} May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 05:36:09.198875 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5d77807e-46a4-4c02-a543-6f989f9028f5 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:36:09.203840 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5d77807e-46a4-4c02-a543-6f989f9028f5 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9/action" status: 403 len: 118 microversion: 2.1 time: 0.297721 May 28 05:36:09.206999 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3581/7049] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:36:08 2022] POST /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9/action => generated 118 bytes in 302 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 05:36:09.210101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aa46eff2-9aa7-4a99-89e0-f925f04b1587 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:09.210894 n-d-843700-1 devstack@n-api.service[126043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 05:36:09.210894 n-d-843700-1 devstack@n-api.service[126043]: warnings.warn(msg) May 28 05:36:09.284475 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aa46eff2-9aa7-4a99-89e0-f925f04b1587 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1930828788" status: 202 len: 0 microversion: 2.1 time: 0.079016 May 28 05:36:09.285053 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3469/7050] 10.222.0.58 () {58 vars in 1160 bytes} [Sat May 28 05:36:09 2022] DELETE /compute/v2.1/flavors/1930828788 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:36:09.294263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-20275b87-8acb-4597-b59c-0feb513f9753 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:09.319208 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-20275b87-8acb-4597-b59c-0feb513f9753 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028776 May 28 05:36:09.319932 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3582/7051] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 05:36:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:09.337356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-051e30f0-6c97-4ebc-9fca-957d1152015c tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Calling method '.version_select at 0x7f7701c4a310>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:09.404466 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-051e30f0-6c97-4ebc-9fca-957d1152015c tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/986afdd40b5e41e996bc081656fe5931" status: 200 len: 371 microversion: 2.1 time: 0.071363 May 28 05:36:09.405041 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3470/7052] 10.222.0.58 () {58 vars in 1241 bytes} [Sat May 28 05:36:09 2022] GET /compute/v2.1/os-quota-sets/986afdd40b5e41e996bc081656fe5931 => generated 371 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:36:09.415130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5b5ab9cd-c7fe-4a3e-bff4-318a1d9fb17c tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2146359475", "id": 1878944156, "os-flavor-access:is_public": "True"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:36:09.416720 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 05:36:09.416720 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 05:36:09.490556 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5b5ab9cd-c7fe-4a3e-bff4-318a1d9fb17c tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.079116 May 28 05:36:09.491129 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3583/7053] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:36:09 2022] POST /compute/v2.1/flavors => generated 437 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:36:09.501833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-838f1379-88d5-46d9-bc28-5fd9954773e2 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1878944156"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:36:09.502877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-838f1379-88d5-46d9-bc28-5fd9954773e2 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:09.510255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-838f1379-88d5-46d9-bc28-5fd9954773e2 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:09.510721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-838f1379-88d5-46d9-bc28-5fd9954773e2 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:09.511549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-838f1379-88d5-46d9-bc28-5fd9954773e2 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:09.512004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-838f1379-88d5-46d9-bc28-5fd9954773e2 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:09.673424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-838f1379-88d5-46d9-bc28-5fd9954773e2 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b41f90971a494ade9ce2fe8abd70cd30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986afdd40b5e41e996bc081656fe5931', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:09.680544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-838f1379-88d5-46d9-bc28-5fd9954773e2 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2146359475 {{(pid=126043) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 05:36:09.686884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-838f1379-88d5-46d9-bc28-5fd9954773e2 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:09.687409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-838f1379-88d5-46d9-bc28-5fd9954773e2 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:09.688219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-838f1379-88d5-46d9-bc28-5fd9954773e2 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:09.688670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-838f1379-88d5-46d9-bc28-5fd9954773e2 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:09.709276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-838f1379-88d5-46d9-bc28-5fd9954773e2 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Getting quotas for project ddf7418bcf044c258195838373ec2786. Resources: {'cores', 'ram'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:36:09.714306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-838f1379-88d5-46d9-bc28-5fd9954773e2 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Getting quotas for user 3a307511fc9e4339aaa3da4093f73767 and project ddf7418bcf044c258195838373ec2786. Resources: {'cores', 'ram'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:36:09.726228 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.compute.api [None req-838f1379-88d5-46d9-bc28-5fd9954773e2 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] cores quota exceeded for 986afdd40b5e41e996bc081656fe5931, tried to resize instance. May 28 05:36:09.727080 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-838f1379-88d5-46d9-bc28-5fd9954773e2 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-838f1379-88d5-46d9-bc28-5fd9954773e2 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Request method failure captured: May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9/action HTTP/1.1 May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 39 May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbS7-7GPqUCet2XAV5g5mzj54bAwA_87HHaidsNfZFGGAW5MhI2w03x15G2McFC-BPPv7S0lFHUllSLlJuHOQpWHj7q5lj4CqAeC6aoeF-EynP-JdkTm5wN5Ab9RL2xElyBBLwv2l9pb8KaDWI7Pb_k2JsH5pDfnDMlt4lelEbIHJts May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 986afdd40b5e41e996bc081656fe5931 May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1054332661 May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: X-Role: admin,reader,member May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: admin,reader,member May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_986afdd40b5e41e996bc081656fe5931"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/986afdd40b5e41e996bc081656fe5931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/986afdd40b5e41e996bc081656fe5931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/986afdd40b5e41e996bc081656fe5931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1054332661 May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 986afdd40b5e41e996bc081656fe5931 May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1054332661 May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersAdminNegativeTestJSON-1054332661-project-admin May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: b41f90971a494ade9ce2fe8abd70cd30 May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1054332661-project-admin May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: {"resize": {"flavorRef": "1878944156"}} May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '3877ff5f-594f-4fde-8ff5-36a537096bf9', 'body': {'resize': {'flavorRef': '1878944156'}}} May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 05:36:09.745145 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-838f1379-88d5-46d9-bc28-5fd9954773e2 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-838f1379-88d5-46d9-bc28-5fd9954773e2 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9/action" status: 403 len: 113 microversion: 2.1 time: 0.248755 May 28 05:36:09.750234 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3471/7054] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:36:09 2022] POST /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9/action => generated 113 bytes in 250 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 05:36:09.756105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b6938f4f-52ec-4c46-a6bf-1479b10391a6 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:09.756921 n-d-843700-1 devstack@n-api.service[126044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 05:36:09.756921 n-d-843700-1 devstack@n-api.service[126044]: warnings.warn(msg) May 28 05:36:09.825625 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b6938f4f-52ec-4c46-a6bf-1479b10391a6 tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1878944156" status: 202 len: 0 microversion: 2.1 time: 0.073920 May 28 05:36:09.826210 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3584/7055] 10.222.0.58 () {58 vars in 1160 bytes} [Sat May 28 05:36:09 2022] DELETE /compute/v2.1/flavors/1878944156 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:36:09.834220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-27c6d2ea-c907-4134-b97e-d9b52949e60c tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:09.853756 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-27c6d2ea-c907-4134-b97e-d9b52949e60c tempest-ServersAdminNegativeTestJSON-1054332661 tempest-ServersAdminNegativeTestJSON-1054332661-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023330 May 28 05:36:09.854404 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3472/7056] 10.222.0.58 () {58 vars in 1145 bytes} [Sat May 28 05:36:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:09.871380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-56b28be8-1796-450f-8cf6-57de39bc9490 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:09.871892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-56b28be8-1796-450f-8cf6-57de39bc9490 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:09.878528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56b28be8-1796-450f-8cf6-57de39bc9490 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:09.879017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56b28be8-1796-450f-8cf6-57de39bc9490 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:09.879803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56b28be8-1796-450f-8cf6-57de39bc9490 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:09.880278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56b28be8-1796-450f-8cf6-57de39bc9490 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:09.906505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-56b28be8-1796-450f-8cf6-57de39bc9490 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:36:10.197207 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-56b28be8-1796-450f-8cf6-57de39bc9490 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9" status: 204 len: 0 microversion: 2.1 time: 0.329489 May 28 05:36:10.197820 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3585/7057] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:36:09 2022] DELETE /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:36:10.205996 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1a8058fe-a784-4c3b-9079-1927c3749b10 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:10.206700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1a8058fe-a784-4c3b-9079-1927c3749b10 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:10.214729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a8058fe-a784-4c3b-9079-1927c3749b10 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:10.215240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a8058fe-a784-4c3b-9079-1927c3749b10 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:10.216035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a8058fe-a784-4c3b-9079-1927c3749b10 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:10.216497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a8058fe-a784-4c3b-9079-1927c3749b10 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:10.348333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1a8058fe-a784-4c3b-9079-1927c3749b10 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a307511fc9e4339aaa3da4093f73767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf7418bcf044c258195838373ec2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:10.355835 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1a8058fe-a784-4c3b-9079-1927c3749b10 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] 10.222.0.58 "GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9" status: 200 len: 1478 microversion: 2.1 time: 0.153893 May 28 05:36:10.356406 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3473/7058] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:10 2022] GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9 => generated 1478 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:11.373666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bf8ace21-41e5-4190-b089-b8c882bed388 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:11.374414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bf8ace21-41e5-4190-b089-b8c882bed388 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:11.381440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf8ace21-41e5-4190-b089-b8c882bed388 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:11.381901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf8ace21-41e5-4190-b089-b8c882bed388 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:11.382972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf8ace21-41e5-4190-b089-b8c882bed388 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:11.384604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bf8ace21-41e5-4190-b089-b8c882bed388 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:11.607849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bf8ace21-41e5-4190-b089-b8c882bed388 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a307511fc9e4339aaa3da4093f73767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf7418bcf044c258195838373ec2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:11.615382 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bf8ace21-41e5-4190-b089-b8c882bed388 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] 10.222.0.58 "GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9" status: 200 len: 1478 microversion: 2.1 time: 0.246142 May 28 05:36:11.615967 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3586/7059] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:11 2022] GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9 => generated 1478 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:12.001062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-a5edc032-dbf2-4044-a12c-bcf4b345147a req-40d36050-dca4-4982-add2-b6203a44046e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3877ff5f-594f-4fde-8ff5-36a537096bf9", "name": "network-vif-deleted", "tag": "c6008cd7-13cd-4af9-9f9b-9d1ff43df4ca"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:36:12.011781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a5edc032-dbf2-4044-a12c-bcf4b345147a req-40d36050-dca4-4982-add2-b6203a44046e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:12.012270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a5edc032-dbf2-4044-a12c-bcf4b345147a req-40d36050-dca4-4982-add2-b6203a44046e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:12.025446 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-a5edc032-dbf2-4044-a12c-bcf4b345147a req-40d36050-dca4-4982-add2-b6203a44046e service nova] Creating event network-vif-deleted:c6008cd7-13cd-4af9-9f9b-9d1ff43df4ca for instance 3877ff5f-594f-4fde-8ff5-36a537096bf9 on n-h1-843700-1 May 28 05:36:12.030531 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-a5edc032-dbf2-4044-a12c-bcf4b345147a req-40d36050-dca4-4982-add2-b6203a44046e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033210 May 28 05:36:12.031211 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3474/7060] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:36:12.631848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-538afe7e-a97e-46f4-b2ba-cfe785178065 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:12.632466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-538afe7e-a97e-46f4-b2ba-cfe785178065 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:12.639388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-538afe7e-a97e-46f4-b2ba-cfe785178065 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:12.640624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-538afe7e-a97e-46f4-b2ba-cfe785178065 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:12.640624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-538afe7e-a97e-46f4-b2ba-cfe785178065 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:12.641035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-538afe7e-a97e-46f4-b2ba-cfe785178065 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:12.675038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-538afe7e-a97e-46f4-b2ba-cfe785178065 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:12.675038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-538afe7e-a97e-46f4-b2ba-cfe785178065 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:12.675038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-538afe7e-a97e-46f4-b2ba-cfe785178065 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lazy-loading 'fault' on Instance uuid 3877ff5f-594f-4fde-8ff5-36a537096bf9 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:36:12.714324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-538afe7e-a97e-46f4-b2ba-cfe785178065 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a307511fc9e4339aaa3da4093f73767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf7418bcf044c258195838373ec2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:12.721877 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-538afe7e-a97e-46f4-b2ba-cfe785178065 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] 10.222.0.58 "GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9" status: 200 len: 1312 microversion: 2.1 time: 0.093858 May 28 05:36:12.722455 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3587/7061] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:12 2022] GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:13.747216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8411d28b-421a-4b0a-880a-21a68f960811 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:13.747946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8411d28b-421a-4b0a-880a-21a68f960811 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] [instance: 3877ff5f-594f-4fde-8ff5-36a537096bf9] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:13.754802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8411d28b-421a-4b0a-880a-21a68f960811 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:13.755481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8411d28b-421a-4b0a-880a-21a68f960811 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:13.756281 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8411d28b-421a-4b0a-880a-21a68f960811 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:13.756739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8411d28b-421a-4b0a-880a-21a68f960811 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:13.770162 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-8411d28b-421a-4b0a-880a-21a68f960811 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] HTTP exception thrown: Instance 3877ff5f-594f-4fde-8ff5-36a537096bf9 could not be found. May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8411d28b-421a-4b0a-880a-21a68f960811 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Request method failure captured: May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9 HTTP/1.1 May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbS6tBCLQHmUuF_SC7kOoc57_xhbjWCIze7bsFagN6ERk7dSYYs1xfFytgStc-DGHCUbT4jeckzBBlpq70YQsnkjl03hTa-h4JyEfPWLFH2lWxl02oLxWwk_L4AT9UwgIpb7xIZ4CIvnj1X1LUC2sDkcXUdwFhQYt1OeK6FCO-qKUEE May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: ddf7418bcf044c258195838373ec2786 May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-206195410 May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ddf7418bcf044c258195838373ec2786"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ddf7418bcf044c258195838373ec2786"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ddf7418bcf044c258195838373ec2786"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ddf7418bcf044c258195838373ec2786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersAdminNegativeTestJSON-206195410 May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: ddf7418bcf044c258195838373ec2786 May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-206195410 May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersAdminNegativeTestJSON-206195410-project May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 3a307511fc9e4339aaa3da4093f73767 May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersAdminNegativeTestJSON-206195410-project May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 3877ff5f-594f-4fde-8ff5-36a537096bf9 could not be found. May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '3877ff5f-594f-4fde-8ff5-36a537096bf9'} May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3877ff5f-594f-4fde-8ff5-36a537096bf9 could not be found. May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3877ff5f-594f-4fde-8ff5-36a537096bf9 could not be found. May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:36:13.772312 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:36:13.777469 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:36:13.777469 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:36:13.777469 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:36:13.777469 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:36:13.777469 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:36:13.777469 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3877ff5f-594f-4fde-8ff5-36a537096bf9 could not be found. May 28 05:36:13.777469 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:36:13.777469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8411d28b-421a-4b0a-880a-21a68f960811 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] Returning 404 to user: Instance 3877ff5f-594f-4fde-8ff5-36a537096bf9 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:36:13.777469 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8411d28b-421a-4b0a-880a-21a68f960811 tempest-ServersAdminNegativeTestJSON-206195410 tempest-ServersAdminNegativeTestJSON-206195410-project] 10.222.0.58 "GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9" status: 404 len: 111 microversion: 2.1 time: 0.031755 May 28 05:36:13.777469 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3475/7062] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:13 2022] GET /compute/v2.1/servers/3877ff5f-594f-4fde-8ff5-36a537096bf9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:36:18.081724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-393888be-651c-49e3-b5e7-ab7498c2992e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-285420063", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "44cd1823-3575-4938-9229-1ebfe7b44988"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:36:18.132499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-393888be-651c-49e3-b5e7-ab7498c2992e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] validate_networks() for [('44cd1823-3575-4938-9229-1ebfe7b44988', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:36:18.485512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-393888be-651c-49e3-b5e7-ab7498c2992e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:36:18.485945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-393888be-651c-49e3-b5e7-ab7498c2992e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:36:18.486457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-393888be-651c-49e3-b5e7-ab7498c2992e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:36:18.486872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-393888be-651c-49e3-b5e7-ab7498c2992e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:36:18.487325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-393888be-651c-49e3-b5e7-ab7498c2992e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:36:18.496252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-393888be-651c-49e3-b5e7-ab7498c2992e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:18.496710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-393888be-651c-49e3-b5e7-ab7498c2992e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:18.497522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-393888be-651c-49e3-b5e7-ab7498c2992e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:18.497963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-393888be-651c-49e3-b5e7-ab7498c2992e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:18.515066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-393888be-651c-49e3-b5e7-ab7498c2992e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Getting quotas for project 893b769e1a3f4a2bb1e698994ba46ad4. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:36:18.520691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-393888be-651c-49e3-b5e7-ab7498c2992e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Getting quotas for user 3456cd216199486291dfabda81680edc and project 893b769e1a3f4a2bb1e698994ba46ad4. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:36:18.533523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-393888be-651c-49e3-b5e7-ab7498c2992e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:36:18.535794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-393888be-651c-49e3-b5e7-ab7498c2992e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:36:18.653709 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-393888be-651c-49e3-b5e7-ab7498c2992e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684913 May 28 05:36:18.654290 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3588/7063] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:36:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:36:18.664945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-394cd6c0-887e-48fa-aaab-ec65afe50c05 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:18.665617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-394cd6c0-887e-48fa-aaab-ec65afe50c05 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:18.720831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-394cd6c0-887e-48fa-aaab-ec65afe50c05 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:18.727843 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-394cd6c0-887e-48fa-aaab-ec65afe50c05 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1214 microversion: 2.1 time: 0.067159 May 28 05:36:18.728425 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3476/7064] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:18 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:36:19.746806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9a8bd29b-4608-4f91-8b1d-6771dec43bf0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:19.747460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9a8bd29b-4608-4f91-8b1d-6771dec43bf0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:19.753719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a8bd29b-4608-4f91-8b1d-6771dec43bf0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:19.754178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a8bd29b-4608-4f91-8b1d-6771dec43bf0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:19.755009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a8bd29b-4608-4f91-8b1d-6771dec43bf0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:19.755469 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a8bd29b-4608-4f91-8b1d-6771dec43bf0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:19.819703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9a8bd29b-4608-4f91-8b1d-6771dec43bf0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:19.827374 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9a8bd29b-4608-4f91-8b1d-6771dec43bf0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1218 microversion: 2.1 time: 0.087014 May 28 05:36:19.827952 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3589/7065] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:19 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:20.845027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e2685903-dc73-459d-9f69-1dad9c6e6d7a tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:20.845832 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e2685903-dc73-459d-9f69-1dad9c6e6d7a tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:20.849913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:36:20.855303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2685903-dc73-459d-9f69-1dad9c6e6d7a tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:20.855891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2685903-dc73-459d-9f69-1dad9c6e6d7a tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:20.856811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2685903-dc73-459d-9f69-1dad9c6e6d7a tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:20.857444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2685903-dc73-459d-9f69-1dad9c6e6d7a tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:20.928866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e2685903-dc73-459d-9f69-1dad9c6e6d7a tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:20.936582 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e2685903-dc73-459d-9f69-1dad9c6e6d7a tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1284 microversion: 2.1 time: 0.095842 May 28 05:36:20.937417 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3477/7066] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:20 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:21.964404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cfbabffc-2ebc-415f-91ac-1a4d5640f06f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:21.965150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cfbabffc-2ebc-415f-91ac-1a4d5640f06f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:21.972573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfbabffc-2ebc-415f-91ac-1a4d5640f06f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:21.973038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfbabffc-2ebc-415f-91ac-1a4d5640f06f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:21.973825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfbabffc-2ebc-415f-91ac-1a4d5640f06f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:21.974278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfbabffc-2ebc-415f-91ac-1a4d5640f06f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:22.128770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cfbabffc-2ebc-415f-91ac-1a4d5640f06f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:22.136782 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cfbabffc-2ebc-415f-91ac-1a4d5640f06f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1314 microversion: 2.1 time: 0.176338 May 28 05:36:22.137644 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3590/7067] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:21 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:22.203684 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-016cd473-6125-423e-a4e4-a1831620b99c req-8083559f-8036-4474-962b-18302fe433f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d92dfd87-eb45-4ff0-8c96-be6ee73846f5", "tag": "180ffc58-fd72-4e35-8151-5895742ba0cc"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:36:22.212593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-016cd473-6125-423e-a4e4-a1831620b99c req-8083559f-8036-4474-962b-18302fe433f2 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:22.213869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-016cd473-6125-423e-a4e4-a1831620b99c req-8083559f-8036-4474-962b-18302fe433f2 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:22.226123 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-016cd473-6125-423e-a4e4-a1831620b99c req-8083559f-8036-4474-962b-18302fe433f2 service nova] Creating event network-changed:180ffc58-fd72-4e35-8151-5895742ba0cc for instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 on n-h2-843700-1 May 28 05:36:22.231363 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-016cd473-6125-423e-a4e4-a1831620b99c req-8083559f-8036-4474-962b-18302fe433f2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031915 May 28 05:36:22.231968 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3478/7068] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:36:23.153925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e0587017-1730-41c3-9c0f-cce18d2bbd2c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:23.154548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e0587017-1730-41c3-9c0f-cce18d2bbd2c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:23.161548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0587017-1730-41c3-9c0f-cce18d2bbd2c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:23.162010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0587017-1730-41c3-9c0f-cce18d2bbd2c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:23.163477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0587017-1730-41c3-9c0f-cce18d2bbd2c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:23.163925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0587017-1730-41c3-9c0f-cce18d2bbd2c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:23.621169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e0587017-1730-41c3-9c0f-cce18d2bbd2c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:23.628632 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e0587017-1730-41c3-9c0f-cce18d2bbd2c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1314 microversion: 2.1 time: 0.478639 May 28 05:36:23.629214 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3591/7069] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:23 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:24.647815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ae47b37d-fde2-45b1-a872-7fdd82612e6c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:24.648537 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ae47b37d-fde2-45b1-a872-7fdd82612e6c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:24.655633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae47b37d-fde2-45b1-a872-7fdd82612e6c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:24.656145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae47b37d-fde2-45b1-a872-7fdd82612e6c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:24.656865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae47b37d-fde2-45b1-a872-7fdd82612e6c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:24.657311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae47b37d-fde2-45b1-a872-7fdd82612e6c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:24.787408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ae47b37d-fde2-45b1-a872-7fdd82612e6c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:24.794910 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ae47b37d-fde2-45b1-a872-7fdd82612e6c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1314 microversion: 2.1 time: 0.152483 May 28 05:36:24.795512 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3479/7070] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:24 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:25.812083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-67d91ee0-c9b3-46ec-9877-1ba67aaafbd1 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:25.812729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-67d91ee0-c9b3-46ec-9877-1ba67aaafbd1 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:25.819058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67d91ee0-c9b3-46ec-9877-1ba67aaafbd1 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:25.819546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67d91ee0-c9b3-46ec-9877-1ba67aaafbd1 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:25.820317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67d91ee0-c9b3-46ec-9877-1ba67aaafbd1 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:25.820764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67d91ee0-c9b3-46ec-9877-1ba67aaafbd1 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:25.825071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:36:25.953576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-67d91ee0-c9b3-46ec-9877-1ba67aaafbd1 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:25.960998 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-67d91ee0-c9b3-46ec-9877-1ba67aaafbd1 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1314 microversion: 2.1 time: 0.153113 May 28 05:36:25.961585 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3592/7071] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:25 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:26.977383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-71e74516-82a4-4da0-8787-3eb04755f1d5 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:26.978022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-71e74516-82a4-4da0-8787-3eb04755f1d5 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:26.980876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:36:26.985928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71e74516-82a4-4da0-8787-3eb04755f1d5 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:26.986401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71e74516-82a4-4da0-8787-3eb04755f1d5 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:26.987230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71e74516-82a4-4da0-8787-3eb04755f1d5 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:26.987739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71e74516-82a4-4da0-8787-3eb04755f1d5 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:26.990860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=78 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:36:27.119136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-71e74516-82a4-4da0-8787-3eb04755f1d5 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:27.126519 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-71e74516-82a4-4da0-8787-3eb04755f1d5 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1314 microversion: 2.1 time: 0.153124 May 28 05:36:27.127125 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3480/7072] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:26 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:27.976910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-8e453803-df8a-45cf-b74e-715fb55dd13c req-8e0fb3f3-4b22-4d2b-92c2-0d51e7cbc953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d92dfd87-eb45-4ff0-8c96-be6ee73846f5", "name": "network-vif-plugged", "status": "completed", "tag": "180ffc58-fd72-4e35-8151-5895742ba0cc"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:36:27.981339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:36:27.986621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8e453803-df8a-45cf-b74e-715fb55dd13c req-8e0fb3f3-4b22-4d2b-92c2-0d51e7cbc953 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:27.987103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-8e453803-df8a-45cf-b74e-715fb55dd13c req-8e0fb3f3-4b22-4d2b-92c2-0d51e7cbc953 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:27.998699 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-8e453803-df8a-45cf-b74e-715fb55dd13c req-8e0fb3f3-4b22-4d2b-92c2-0d51e7cbc953 service nova] Creating event network-vif-plugged:180ffc58-fd72-4e35-8151-5895742ba0cc for instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 on n-h2-843700-1 May 28 05:36:28.003951 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-8e453803-df8a-45cf-b74e-715fb55dd13c req-8e0fb3f3-4b22-4d2b-92c2-0d51e7cbc953 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030733 May 28 05:36:28.004482 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3593/7073] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:36:28.145015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-78f70601-9239-4e22-a727-ee0dada7a71a tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:28.145684 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-78f70601-9239-4e22-a727-ee0dada7a71a tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:28.152895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78f70601-9239-4e22-a727-ee0dada7a71a tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:28.153360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78f70601-9239-4e22-a727-ee0dada7a71a tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:28.154156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78f70601-9239-4e22-a727-ee0dada7a71a tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:28.154604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78f70601-9239-4e22-a727-ee0dada7a71a tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:28.283464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-78f70601-9239-4e22-a727-ee0dada7a71a tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:28.291737 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-78f70601-9239-4e22-a727-ee0dada7a71a tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1314 microversion: 2.1 time: 0.151332 May 28 05:36:28.292321 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3481/7074] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:28 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:29.306453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=5 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:36:29.307276 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=8 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:36:29.312485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cbb6549e-9e42-4dda-aa72-13e2fd9aee9f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:29.313191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cbb6549e-9e42-4dda-aa72-13e2fd9aee9f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:29.320209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cbb6549e-9e42-4dda-aa72-13e2fd9aee9f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:29.320670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cbb6549e-9e42-4dda-aa72-13e2fd9aee9f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:29.321468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cbb6549e-9e42-4dda-aa72-13e2fd9aee9f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:29.321915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cbb6549e-9e42-4dda-aa72-13e2fd9aee9f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:29.450461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cbb6549e-9e42-4dda-aa72-13e2fd9aee9f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:29.457916 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cbb6549e-9e42-4dda-aa72-13e2fd9aee9f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1502 microversion: 2.1 time: 0.152507 May 28 05:36:29.458499 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3594/7075] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:29 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:29.474360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0d422caf-ed3f-4c8f-bc88-14e3d88b53f0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:36:29.476458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0d422caf-ed3f-4c8f-bc88-14e3d88b53f0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:29.477323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=4 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:36:29.482975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d422caf-ed3f-4c8f-bc88-14e3d88b53f0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:29.483472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d422caf-ed3f-4c8f-bc88-14e3d88b53f0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:29.484244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d422caf-ed3f-4c8f-bc88-14e3d88b53f0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:29.484721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d422caf-ed3f-4c8f-bc88-14e3d88b53f0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:29.513872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0d422caf-ed3f-4c8f-bc88-14e3d88b53f0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:29.520033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0d422caf-ed3f-4c8f-bc88-14e3d88b53f0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Old instance type m1.heat2, new instance type m1.heat {{(pid=126043) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 05:36:29.526390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0d422caf-ed3f-4c8f-bc88-14e3d88b53f0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:36:29.533834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0d422caf-ed3f-4c8f-bc88-14e3d88b53f0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:36:29.533834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0d422caf-ed3f-4c8f-bc88-14e3d88b53f0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:36:29.533834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0d422caf-ed3f-4c8f-bc88-14e3d88b53f0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:36:29.533834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-0d422caf-ed3f-4c8f-bc88-14e3d88b53f0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:36:29.723258 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0d422caf-ed3f-4c8f-bc88-14e3d88b53f0 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "POST /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5/action" status: 202 len: 0 microversion: 2.1 time: 0.252778 May 28 05:36:29.723874 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3482/7076] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:36:29 2022] POST /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:36:29.733085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4ea2e9f9-6b8e-49ef-9988-0efa6161fa9c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:29.733702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4ea2e9f9-6b8e-49ef-9988-0efa6161fa9c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:29.740097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ea2e9f9-6b8e-49ef-9988-0efa6161fa9c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:29.741173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ea2e9f9-6b8e-49ef-9988-0efa6161fa9c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:29.741966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ea2e9f9-6b8e-49ef-9988-0efa6161fa9c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:29.742392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ea2e9f9-6b8e-49ef-9988-0efa6161fa9c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:29.873188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4ea2e9f9-6b8e-49ef-9988-0efa6161fa9c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:29.880794 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4ea2e9f9-6b8e-49ef-9988-0efa6161fa9c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1511 microversion: 2.1 time: 0.152075 May 28 05:36:29.881389 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3595/7077] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:29 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:30.898640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-20d7fd31-8bfc-4c6e-a0f5-de71b73efd02 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:30.899390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-20d7fd31-8bfc-4c6e-a0f5-de71b73efd02 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:30.905276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20d7fd31-8bfc-4c6e-a0f5-de71b73efd02 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:30.905744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20d7fd31-8bfc-4c6e-a0f5-de71b73efd02 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:30.906521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20d7fd31-8bfc-4c6e-a0f5-de71b73efd02 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:30.906966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-20d7fd31-8bfc-4c6e-a0f5-de71b73efd02 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:31.042971 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-20d7fd31-8bfc-4c6e-a0f5-de71b73efd02 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:31.050671 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-20d7fd31-8bfc-4c6e-a0f5-de71b73efd02 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1511 microversion: 2.1 time: 0.156794 May 28 05:36:31.051287 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3483/7078] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:30 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:32.069468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-70e46c08-2dbf-4f0e-9b5d-4ab70e1af060 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:32.070086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-70e46c08-2dbf-4f0e-9b5d-4ab70e1af060 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:32.077426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70e46c08-2dbf-4f0e-9b5d-4ab70e1af060 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:32.077884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70e46c08-2dbf-4f0e-9b5d-4ab70e1af060 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:32.078664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70e46c08-2dbf-4f0e-9b5d-4ab70e1af060 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:32.079142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70e46c08-2dbf-4f0e-9b5d-4ab70e1af060 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:32.292281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-70e46c08-2dbf-4f0e-9b5d-4ab70e1af060 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:32.299916 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-70e46c08-2dbf-4f0e-9b5d-4ab70e1af060 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1511 microversion: 2.1 time: 0.235259 May 28 05:36:32.300535 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3596/7079] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:32 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1511 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:33.317438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-52b3d7e6-bda5-4645-99e8-7d13afb08f05 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:33.318065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-52b3d7e6-bda5-4645-99e8-7d13afb08f05 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:33.325034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52b3d7e6-bda5-4645-99e8-7d13afb08f05 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:33.325492 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52b3d7e6-bda5-4645-99e8-7d13afb08f05 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:33.326264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52b3d7e6-bda5-4645-99e8-7d13afb08f05 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:33.326712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52b3d7e6-bda5-4645-99e8-7d13afb08f05 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:33.457285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-52b3d7e6-bda5-4645-99e8-7d13afb08f05 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:33.464932 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-52b3d7e6-bda5-4645-99e8-7d13afb08f05 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.151355 May 28 05:36:33.465522 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3484/7080] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:33 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:34.483046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bc4493fe-0bb9-4469-9eaf-556404bc0e94 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:34.483693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bc4493fe-0bb9-4469-9eaf-556404bc0e94 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:34.490661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bc4493fe-0bb9-4469-9eaf-556404bc0e94 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:34.491151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bc4493fe-0bb9-4469-9eaf-556404bc0e94 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:34.491921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bc4493fe-0bb9-4469-9eaf-556404bc0e94 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:34.492363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bc4493fe-0bb9-4469-9eaf-556404bc0e94 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:34.625476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bc4493fe-0bb9-4469-9eaf-556404bc0e94 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:34.633357 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bc4493fe-0bb9-4469-9eaf-556404bc0e94 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.154312 May 28 05:36:34.633942 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3597/7081] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:34 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:35.649945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4b692960-7b95-41ec-8b79-498274b523e3 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:35.650581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4b692960-7b95-41ec-8b79-498274b523e3 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:35.657637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b692960-7b95-41ec-8b79-498274b523e3 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:35.658110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b692960-7b95-41ec-8b79-498274b523e3 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:35.658924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b692960-7b95-41ec-8b79-498274b523e3 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:35.659406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b692960-7b95-41ec-8b79-498274b523e3 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:35.786607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4b692960-7b95-41ec-8b79-498274b523e3 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:35.794709 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4b692960-7b95-41ec-8b79-498274b523e3 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.148761 May 28 05:36:35.795320 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3485/7082] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:35 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:36.812225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1444bc5e-f5f6-4a5c-b336-472a1998a8f4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:36.812848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1444bc5e-f5f6-4a5c-b336-472a1998a8f4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:36.820573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1444bc5e-f5f6-4a5c-b336-472a1998a8f4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:36.821031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1444bc5e-f5f6-4a5c-b336-472a1998a8f4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:36.821806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1444bc5e-f5f6-4a5c-b336-472a1998a8f4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:36.822251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1444bc5e-f5f6-4a5c-b336-472a1998a8f4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:36.952854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1444bc5e-f5f6-4a5c-b336-472a1998a8f4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:36.961049 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1444bc5e-f5f6-4a5c-b336-472a1998a8f4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.152808 May 28 05:36:36.961631 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3598/7083] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:36 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:37.978112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c83ad920-4e74-4192-9e38-8ec6815367d1 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:37.978774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c83ad920-4e74-4192-9e38-8ec6815367d1 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:37.985744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c83ad920-4e74-4192-9e38-8ec6815367d1 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:37.986251 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c83ad920-4e74-4192-9e38-8ec6815367d1 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:37.987330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c83ad920-4e74-4192-9e38-8ec6815367d1 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:37.987795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c83ad920-4e74-4192-9e38-8ec6815367d1 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:38.118375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c83ad920-4e74-4192-9e38-8ec6815367d1 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:38.126130 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c83ad920-4e74-4192-9e38-8ec6815367d1 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.152272 May 28 05:36:38.126718 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3486/7084] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:37 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:39.143992 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c5b0b3d5-f1c9-44a6-a783-abf2c2dcf33b tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:39.144533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c5b0b3d5-f1c9-44a6-a783-abf2c2dcf33b tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:39.152093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c5b0b3d5-f1c9-44a6-a783-abf2c2dcf33b tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:39.152542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c5b0b3d5-f1c9-44a6-a783-abf2c2dcf33b tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:39.153300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c5b0b3d5-f1c9-44a6-a783-abf2c2dcf33b tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:39.153738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c5b0b3d5-f1c9-44a6-a783-abf2c2dcf33b tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:39.282751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c5b0b3d5-f1c9-44a6-a783-abf2c2dcf33b tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:39.291119 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c5b0b3d5-f1c9-44a6-a783-abf2c2dcf33b tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.151274 May 28 05:36:39.291711 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3599/7085] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:39 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:40.308934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-47cab073-3854-44b6-b8d9-9434fa8f4a09 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:40.309556 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-47cab073-3854-44b6-b8d9-9434fa8f4a09 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:40.316687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47cab073-3854-44b6-b8d9-9434fa8f4a09 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:40.317142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47cab073-3854-44b6-b8d9-9434fa8f4a09 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:40.317921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47cab073-3854-44b6-b8d9-9434fa8f4a09 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:40.318719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47cab073-3854-44b6-b8d9-9434fa8f4a09 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:40.452140 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-47cab073-3854-44b6-b8d9-9434fa8f4a09 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:40.460620 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-47cab073-3854-44b6-b8d9-9434fa8f4a09 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.155357 May 28 05:36:40.461219 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3487/7086] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:40 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:41.478424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3664632b-b33c-4f67-8983-4f1371a9f769 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:41.479060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3664632b-b33c-4f67-8983-4f1371a9f769 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:41.486116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3664632b-b33c-4f67-8983-4f1371a9f769 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:41.486569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3664632b-b33c-4f67-8983-4f1371a9f769 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:41.487370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3664632b-b33c-4f67-8983-4f1371a9f769 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:41.487838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3664632b-b33c-4f67-8983-4f1371a9f769 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:41.618843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3664632b-b33c-4f67-8983-4f1371a9f769 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:41.626437 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3664632b-b33c-4f67-8983-4f1371a9f769 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.152617 May 28 05:36:41.627039 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3600/7087] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:41 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:42.643845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0b9ee7c1-bcce-43f9-8d02-e1fcdea0c9fb tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:42.644501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0b9ee7c1-bcce-43f9-8d02-e1fcdea0c9fb tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:42.651483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b9ee7c1-bcce-43f9-8d02-e1fcdea0c9fb tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:42.651957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b9ee7c1-bcce-43f9-8d02-e1fcdea0c9fb tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:42.652747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b9ee7c1-bcce-43f9-8d02-e1fcdea0c9fb tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:42.653206 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b9ee7c1-bcce-43f9-8d02-e1fcdea0c9fb tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:42.785319 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0b9ee7c1-bcce-43f9-8d02-e1fcdea0c9fb tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:42.793044 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0b9ee7c1-bcce-43f9-8d02-e1fcdea0c9fb tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.153430 May 28 05:36:42.793634 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3488/7088] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:42 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:43.809566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-68d8a35d-622d-4f93-8e12-315e1705b652 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:43.810191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-68d8a35d-622d-4f93-8e12-315e1705b652 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:43.817181 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68d8a35d-622d-4f93-8e12-315e1705b652 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:43.817642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68d8a35d-622d-4f93-8e12-315e1705b652 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:43.818414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68d8a35d-622d-4f93-8e12-315e1705b652 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:43.819437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68d8a35d-622d-4f93-8e12-315e1705b652 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:43.947067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-68d8a35d-622d-4f93-8e12-315e1705b652 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:43.954694 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-68d8a35d-622d-4f93-8e12-315e1705b652 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.149085 May 28 05:36:43.955312 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3601/7089] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:43 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:44.972749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3484b0e9-6bd5-458d-ab1f-0bf95add3ed8 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:44.973446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3484b0e9-6bd5-458d-ab1f-0bf95add3ed8 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:44.982094 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3484b0e9-6bd5-458d-ab1f-0bf95add3ed8 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:44.982564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3484b0e9-6bd5-458d-ab1f-0bf95add3ed8 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:44.983389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3484b0e9-6bd5-458d-ab1f-0bf95add3ed8 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:44.983845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3484b0e9-6bd5-458d-ab1f-0bf95add3ed8 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:45.113263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3484b0e9-6bd5-458d-ab1f-0bf95add3ed8 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:45.121111 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3484b0e9-6bd5-458d-ab1f-0bf95add3ed8 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.152462 May 28 05:36:45.121713 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3489/7090] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:44 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:46.138050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1666affa-88fa-484a-a32f-d0699c4a67ad tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:46.138670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1666affa-88fa-484a-a32f-d0699c4a67ad tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:46.145987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1666affa-88fa-484a-a32f-d0699c4a67ad tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:46.146442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1666affa-88fa-484a-a32f-d0699c4a67ad tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:46.147244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1666affa-88fa-484a-a32f-d0699c4a67ad tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:46.147721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1666affa-88fa-484a-a32f-d0699c4a67ad tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:46.281121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1666affa-88fa-484a-a32f-d0699c4a67ad tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:46.289154 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1666affa-88fa-484a-a32f-d0699c4a67ad tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.155029 May 28 05:36:46.289728 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3602/7091] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:46 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:47.306920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5a2f0d82-5135-4f38-8a59-690190b29233 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:47.307576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5a2f0d82-5135-4f38-8a59-690190b29233 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:47.314546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a2f0d82-5135-4f38-8a59-690190b29233 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:47.315036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a2f0d82-5135-4f38-8a59-690190b29233 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:47.315820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a2f0d82-5135-4f38-8a59-690190b29233 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:47.316276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a2f0d82-5135-4f38-8a59-690190b29233 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:47.447379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5a2f0d82-5135-4f38-8a59-690190b29233 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:47.454898 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5a2f0d82-5135-4f38-8a59-690190b29233 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.152477 May 28 05:36:47.455513 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3490/7092] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:47 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:48.472111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8d7510b5-c5d4-4707-9a2f-7729b0fccbf9 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:48.472641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8d7510b5-c5d4-4707-9a2f-7729b0fccbf9 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:48.479796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d7510b5-c5d4-4707-9a2f-7729b0fccbf9 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:48.480259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d7510b5-c5d4-4707-9a2f-7729b0fccbf9 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:48.481086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d7510b5-c5d4-4707-9a2f-7729b0fccbf9 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:48.481536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8d7510b5-c5d4-4707-9a2f-7729b0fccbf9 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:48.614192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8d7510b5-c5d4-4707-9a2f-7729b0fccbf9 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:48.622461 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8d7510b5-c5d4-4707-9a2f-7729b0fccbf9 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.154315 May 28 05:36:48.623039 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3603/7093] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:48 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:36:49.640801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ce732324-2a13-445d-b266-2a8db5ebe7d2 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:49.641427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ce732324-2a13-445d-b266-2a8db5ebe7d2 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:49.649039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce732324-2a13-445d-b266-2a8db5ebe7d2 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:49.649500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce732324-2a13-445d-b266-2a8db5ebe7d2 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:49.650272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce732324-2a13-445d-b266-2a8db5ebe7d2 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:49.650724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce732324-2a13-445d-b266-2a8db5ebe7d2 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:49.780504 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ce732324-2a13-445d-b266-2a8db5ebe7d2 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:49.788863 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ce732324-2a13-445d-b266-2a8db5ebe7d2 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.151392 May 28 05:36:49.789443 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3491/7094] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:49 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:50.805950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a361bfad-2b87-45f0-adba-e873706d378e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:50.806564 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a361bfad-2b87-45f0-adba-e873706d378e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:50.813702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a361bfad-2b87-45f0-adba-e873706d378e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:50.814158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a361bfad-2b87-45f0-adba-e873706d378e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:50.814934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a361bfad-2b87-45f0-adba-e873706d378e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:50.815403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a361bfad-2b87-45f0-adba-e873706d378e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:50.948537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a361bfad-2b87-45f0-adba-e873706d378e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:50.956480 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a361bfad-2b87-45f0-adba-e873706d378e tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.154486 May 28 05:36:50.957057 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3604/7095] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:50 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:51.973933 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-313734b3-bcca-4537-83f4-e63bddcbd821 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:51.974587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-313734b3-bcca-4537-83f4-e63bddcbd821 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:51.981260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-313734b3-bcca-4537-83f4-e63bddcbd821 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:51.981724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-313734b3-bcca-4537-83f4-e63bddcbd821 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:51.982493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-313734b3-bcca-4537-83f4-e63bddcbd821 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:51.982945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-313734b3-bcca-4537-83f4-e63bddcbd821 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:52.113147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-313734b3-bcca-4537-83f4-e63bddcbd821 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:52.121246 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-313734b3-bcca-4537-83f4-e63bddcbd821 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.151531 May 28 05:36:52.121823 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3492/7096] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:51 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:53.138343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1fe972df-de81-489f-880d-56906474de1c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:53.138958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1fe972df-de81-489f-880d-56906474de1c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:53.146227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fe972df-de81-489f-880d-56906474de1c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:53.146682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fe972df-de81-489f-880d-56906474de1c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:53.147477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fe972df-de81-489f-880d-56906474de1c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:53.147919 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1fe972df-de81-489f-880d-56906474de1c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:53.275759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1fe972df-de81-489f-880d-56906474de1c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:53.283240 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1fe972df-de81-489f-880d-56906474de1c tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.148832 May 28 05:36:53.283823 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3605/7097] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:53 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:54.300356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4e4a1b4a-e660-4288-a6fc-edc789a2c913 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:54.300987 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4e4a1b4a-e660-4288-a6fc-edc789a2c913 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:54.307901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e4a1b4a-e660-4288-a6fc-edc789a2c913 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:54.308373 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e4a1b4a-e660-4288-a6fc-edc789a2c913 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:54.309158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e4a1b4a-e660-4288-a6fc-edc789a2c913 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:54.309613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e4a1b4a-e660-4288-a6fc-edc789a2c913 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:54.441119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4e4a1b4a-e660-4288-a6fc-edc789a2c913 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:54.449233 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4e4a1b4a-e660-4288-a6fc-edc789a2c913 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.152870 May 28 05:36:54.449805 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3493/7098] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:54 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:55.467129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-13f50977-a8e6-4f4a-ba0e-f9e52c70c463 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:55.467684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-13f50977-a8e6-4f4a-ba0e-f9e52c70c463 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:55.473941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13f50977-a8e6-4f4a-ba0e-f9e52c70c463 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:55.474398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13f50977-a8e6-4f4a-ba0e-f9e52c70c463 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:55.475187 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13f50977-a8e6-4f4a-ba0e-f9e52c70c463 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:55.476268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13f50977-a8e6-4f4a-ba0e-f9e52c70c463 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:55.606459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-13f50977-a8e6-4f4a-ba0e-f9e52c70c463 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:55.614057 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-13f50977-a8e6-4f4a-ba0e-f9e52c70c463 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.151176 May 28 05:36:55.614629 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3606/7099] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:55 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:56.631564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aad121f4-8828-423c-ae29-e37fd0cb1214 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:56.632296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-aad121f4-8828-423c-ae29-e37fd0cb1214 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:56.639425 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aad121f4-8828-423c-ae29-e37fd0cb1214 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:56.639896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aad121f4-8828-423c-ae29-e37fd0cb1214 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:56.640680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aad121f4-8828-423c-ae29-e37fd0cb1214 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:56.641138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aad121f4-8828-423c-ae29-e37fd0cb1214 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:56.772034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-aad121f4-8828-423c-ae29-e37fd0cb1214 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:56.779660 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aad121f4-8828-423c-ae29-e37fd0cb1214 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.152221 May 28 05:36:56.780246 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3494/7100] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:56 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:57.797457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0b09ef61-a94b-4761-9ec3-e652f8877d0f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:57.798143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0b09ef61-a94b-4761-9ec3-e652f8877d0f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:57.805634 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b09ef61-a94b-4761-9ec3-e652f8877d0f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:57.806093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b09ef61-a94b-4761-9ec3-e652f8877d0f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:57.806859 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b09ef61-a94b-4761-9ec3-e652f8877d0f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:57.807339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b09ef61-a94b-4761-9ec3-e652f8877d0f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:57.809891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=86 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:36:57.940804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0b09ef61-a94b-4761-9ec3-e652f8877d0f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:57.949018 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0b09ef61-a94b-4761-9ec3-e652f8877d0f tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.155601 May 28 05:36:57.949601 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3607/7101] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:57 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:36:58.966794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-60c7843f-c64a-4ffc-b7cb-5bfcc6db9762 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:36:58.967447 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-60c7843f-c64a-4ffc-b7cb-5bfcc6db9762 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:36:58.970126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=34 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:36:58.974900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60c7843f-c64a-4ffc-b7cb-5bfcc6db9762 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:58.975392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60c7843f-c64a-4ffc-b7cb-5bfcc6db9762 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:58.976173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60c7843f-c64a-4ffc-b7cb-5bfcc6db9762 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:36:58.976626 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60c7843f-c64a-4ffc-b7cb-5bfcc6db9762 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:36:58.979238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:36:59.105359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-60c7843f-c64a-4ffc-b7cb-5bfcc6db9762 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:36:59.113210 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-60c7843f-c64a-4ffc-b7cb-5bfcc6db9762 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1516 microversion: 2.1 time: 0.150367 May 28 05:36:59.113799 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3495/7102] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:36:58 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:00.130188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-82309031-9725-41d9-ada3-de3b8a07b7b4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:00.130812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-82309031-9725-41d9-ada3-de3b8a07b7b4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:00.138171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82309031-9725-41d9-ada3-de3b8a07b7b4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:00.138626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82309031-9725-41d9-ada3-de3b8a07b7b4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:00.139456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82309031-9725-41d9-ada3-de3b8a07b7b4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:00.140007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82309031-9725-41d9-ada3-de3b8a07b7b4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:00.339131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-82309031-9725-41d9-ada3-de3b8a07b7b4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:00.346690 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-82309031-9725-41d9-ada3-de3b8a07b7b4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1515 microversion: 2.1 time: 0.220475 May 28 05:37:00.347347 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3608/7103] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:00 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1515 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:00.647642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-fae728f1-5133-4305-be64-c32e0ddb9f71 req-39da0d1e-3d95-4010-a610-80149d4a1c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d92dfd87-eb45-4ff0-8c96-be6ee73846f5", "name": "network-vif-unplugged", "status": "completed", "tag": "180ffc58-fd72-4e35-8151-5895742ba0cc"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:37:00.656637 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-fae728f1-5133-4305-be64-c32e0ddb9f71 req-39da0d1e-3d95-4010-a610-80149d4a1c1e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:00.657182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-fae728f1-5133-4305-be64-c32e0ddb9f71 req-39da0d1e-3d95-4010-a610-80149d4a1c1e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:00.668986 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-fae728f1-5133-4305-be64-c32e0ddb9f71 req-39da0d1e-3d95-4010-a610-80149d4a1c1e service nova] Creating event network-vif-unplugged:180ffc58-fd72-4e35-8151-5895742ba0cc for instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 on n-h1-843700-1 May 28 05:37:00.674171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-fae728f1-5133-4305-be64-c32e0ddb9f71 req-39da0d1e-3d95-4010-a610-80149d4a1c1e service nova] Instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:37:00.685263 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-fae728f1-5133-4305-be64-c32e0ddb9f71 req-39da0d1e-3d95-4010-a610-80149d4a1c1e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041469 May 28 05:37:00.685852 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3496/7104] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:37:01.364291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-184c34b5-b95a-4337-aeb3-078e728cca68 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:01.364903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-184c34b5-b95a-4337-aeb3-078e728cca68 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:01.371811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-184c34b5-b95a-4337-aeb3-078e728cca68 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:01.372264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-184c34b5-b95a-4337-aeb3-078e728cca68 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:01.373029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-184c34b5-b95a-4337-aeb3-078e728cca68 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:01.373468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-184c34b5-b95a-4337-aeb3-078e728cca68 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:01.583997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-184c34b5-b95a-4337-aeb3-078e728cca68 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:01.592281 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-184c34b5-b95a-4337-aeb3-078e728cca68 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1515 microversion: 2.1 time: 0.231843 May 28 05:37:01.595065 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3609/7105] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:01 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1515 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:02.611201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-24a05e91-5075-4e0f-a887-65241d8a6162 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:02.611911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-24a05e91-5075-4e0f-a887-65241d8a6162 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:02.618764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24a05e91-5075-4e0f-a887-65241d8a6162 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:02.619267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24a05e91-5075-4e0f-a887-65241d8a6162 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:02.620043 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24a05e91-5075-4e0f-a887-65241d8a6162 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:02.620494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24a05e91-5075-4e0f-a887-65241d8a6162 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:02.699915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-3431c578-c415-4dee-aa4e-538fc2fc38de req-141dff3f-a01d-4e23-8c7b-e6b0c99b4e84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d92dfd87-eb45-4ff0-8c96-be6ee73846f5", "tag": "180ffc58-fd72-4e35-8151-5895742ba0cc"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:37:02.704143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=34 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:37:02.709331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-3431c578-c415-4dee-aa4e-538fc2fc38de req-141dff3f-a01d-4e23-8c7b-e6b0c99b4e84 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:02.709842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-3431c578-c415-4dee-aa4e-538fc2fc38de req-141dff3f-a01d-4e23-8c7b-e6b0c99b4e84 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:02.721811 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-3431c578-c415-4dee-aa4e-538fc2fc38de req-141dff3f-a01d-4e23-8c7b-e6b0c99b4e84 service nova] Creating event network-changed:180ffc58-fd72-4e35-8151-5895742ba0cc for instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 on n-h1-843700-1 May 28 05:37:02.728196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-3431c578-c415-4dee-aa4e-538fc2fc38de req-141dff3f-a01d-4e23-8c7b-e6b0c99b4e84 service nova] Instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:37:02.739228 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-3431c578-c415-4dee-aa4e-538fc2fc38de req-141dff3f-a01d-4e23-8c7b-e6b0c99b4e84 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043049 May 28 05:37:02.739855 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3610/7106] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:37:02.767038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-24a05e91-5075-4e0f-a887-65241d8a6162 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:02.775087 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-24a05e91-5075-4e0f-a887-65241d8a6162 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1513 microversion: 2.1 time: 0.168975 May 28 05:37:02.775631 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3497/7107] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:02 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:03.794422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c4ae65da-032c-4ddf-b1e0-a9a6d06c39c4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:03.795157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c4ae65da-032c-4ddf-b1e0-a9a6d06c39c4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:03.801321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4ae65da-032c-4ddf-b1e0-a9a6d06c39c4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:03.801782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4ae65da-032c-4ddf-b1e0-a9a6d06c39c4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:03.802575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4ae65da-032c-4ddf-b1e0-a9a6d06c39c4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:03.803038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4ae65da-032c-4ddf-b1e0-a9a6d06c39c4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:03.937989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c4ae65da-032c-4ddf-b1e0-a9a6d06c39c4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:03.946212 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c4ae65da-032c-4ddf-b1e0-a9a6d06c39c4 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1510 microversion: 2.1 time: 0.157568 May 28 05:37:03.946797 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3611/7108] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:03 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:03.962349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-02fd0a7e-36ae-4800-a3ef-0ffed6b93be5 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:03.962868 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-02fd0a7e-36ae-4800-a3ef-0ffed6b93be5 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:03.969742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02fd0a7e-36ae-4800-a3ef-0ffed6b93be5 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:03.970217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02fd0a7e-36ae-4800-a3ef-0ffed6b93be5 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:03.971019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02fd0a7e-36ae-4800-a3ef-0ffed6b93be5 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:03.971478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-02fd0a7e-36ae-4800-a3ef-0ffed6b93be5 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:03.997843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-02fd0a7e-36ae-4800-a3ef-0ffed6b93be5 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:37:04.097373 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.compute.api [None req-02fd0a7e-36ae-4800-a3ef-0ffed6b93be5 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Found an unconfirmed migration during delete, id: 16, status: finished May 28 05:37:06.653313 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-02fd0a7e-36ae-4800-a3ef-0ffed6b93be5 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 204 len: 0 microversion: 2.1 time: 2.694707 May 28 05:37:06.654012 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3498/7109] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:37:03 2022] DELETE /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 0 bytes in 2696 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:37:06.662189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-474e59f0-e14f-4f2a-83dc-4e22d2740755 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:06.663445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-474e59f0-e14f-4f2a-83dc-4e22d2740755 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:06.670491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-474e59f0-e14f-4f2a-83dc-4e22d2740755 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:06.670955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-474e59f0-e14f-4f2a-83dc-4e22d2740755 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:06.671815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-474e59f0-e14f-4f2a-83dc-4e22d2740755 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:06.672265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-474e59f0-e14f-4f2a-83dc-4e22d2740755 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:06.804188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-474e59f0-e14f-4f2a-83dc-4e22d2740755 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:06.811987 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-474e59f0-e14f-4f2a-83dc-4e22d2740755 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1502 microversion: 2.1 time: 0.153885 May 28 05:37:06.812625 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3612/7110] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:06 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:06.930194 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-da58e023-77b0-46b1-9b5e-a7914728ce09 req-92a6ad3e-7c71-44b4-8149-5e32f0d02719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d92dfd87-eb45-4ff0-8c96-be6ee73846f5", "name": "network-vif-plugged", "status": "completed", "tag": "180ffc58-fd72-4e35-8151-5895742ba0cc"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:37:06.939582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-da58e023-77b0-46b1-9b5e-a7914728ce09 req-92a6ad3e-7c71-44b4-8149-5e32f0d02719 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:06.940051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-da58e023-77b0-46b1-9b5e-a7914728ce09 req-92a6ad3e-7c71-44b4-8149-5e32f0d02719 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:06.951226 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-da58e023-77b0-46b1-9b5e-a7914728ce09 req-92a6ad3e-7c71-44b4-8149-5e32f0d02719 service nova] Creating event network-vif-plugged:180ffc58-fd72-4e35-8151-5895742ba0cc for instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 on n-h1-843700-1 May 28 05:37:06.956045 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-da58e023-77b0-46b1-9b5e-a7914728ce09 req-92a6ad3e-7c71-44b4-8149-5e32f0d02719 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030177 May 28 05:37:06.956638 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3499/7111] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:37:07.829353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6094b49c-3802-43cd-abdb-ad9d013dfb1d tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:07.829999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6094b49c-3802-43cd-abdb-ad9d013dfb1d tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:07.839666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6094b49c-3802-43cd-abdb-ad9d013dfb1d tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:07.840130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6094b49c-3802-43cd-abdb-ad9d013dfb1d tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:07.840914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6094b49c-3802-43cd-abdb-ad9d013dfb1d tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:07.841363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6094b49c-3802-43cd-abdb-ad9d013dfb1d tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:07.974744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6094b49c-3802-43cd-abdb-ad9d013dfb1d tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:07.982488 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6094b49c-3802-43cd-abdb-ad9d013dfb1d tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1502 microversion: 2.1 time: 0.157096 May 28 05:37:07.983113 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3613/7112] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:07 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:08.475540 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-27b118b1-7051-47f7-a2f1-affdf8235363 req-b8f9cb83-d0e8-4cc6-a50b-2324e3d091ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d92dfd87-eb45-4ff0-8c96-be6ee73846f5", "name": "network-vif-deleted", "tag": "180ffc58-fd72-4e35-8151-5895742ba0cc"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:37:08.483899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-27b118b1-7051-47f7-a2f1-affdf8235363 req-b8f9cb83-d0e8-4cc6-a50b-2324e3d091ed service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:08.484391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-27b118b1-7051-47f7-a2f1-affdf8235363 req-b8f9cb83-d0e8-4cc6-a50b-2324e3d091ed service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:08.496619 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-27b118b1-7051-47f7-a2f1-affdf8235363 req-b8f9cb83-d0e8-4cc6-a50b-2324e3d091ed service nova] Creating event network-vif-deleted:180ffc58-fd72-4e35-8151-5895742ba0cc for instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 on n-h1-843700-1 May 28 05:37:08.502022 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-27b118b1-7051-47f7-a2f1-affdf8235363 req-b8f9cb83-d0e8-4cc6-a50b-2324e3d091ed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032083 May 28 05:37:08.503262 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3500/7113] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:37:08.999719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-194cd2f7-bdc0-47ba-ac55-05e8487e0703 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:09.000263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-194cd2f7-bdc0-47ba-ac55-05e8487e0703 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:09.008410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-194cd2f7-bdc0-47ba-ac55-05e8487e0703 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:09.009207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-194cd2f7-bdc0-47ba-ac55-05e8487e0703 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:09.010671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-194cd2f7-bdc0-47ba-ac55-05e8487e0703 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:09.011192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-194cd2f7-bdc0-47ba-ac55-05e8487e0703 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:09.045282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-194cd2f7-bdc0-47ba-ac55-05e8487e0703 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:09.046010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-194cd2f7-bdc0-47ba-ac55-05e8487e0703 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:09.046474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-194cd2f7-bdc0-47ba-ac55-05e8487e0703 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lazy-loading 'fault' on Instance uuid d92dfd87-eb45-4ff0-8c96-be6ee73846f5 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:37:09.095031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-194cd2f7-bdc0-47ba-ac55-05e8487e0703 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3456cd216199486291dfabda81680edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893b769e1a3f4a2bb1e698994ba46ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:09.103308 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-194cd2f7-bdc0-47ba-ac55-05e8487e0703 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 200 len: 1304 microversion: 2.1 time: 0.107535 May 28 05:37:09.104037 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3614/7114] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:08 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:10.121962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4cc4c107-65c9-4862-8909-a99ff617c9be tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:10.122721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4cc4c107-65c9-4862-8909-a99ff617c9be tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:10.129969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4cc4c107-65c9-4862-8909-a99ff617c9be tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:10.130434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4cc4c107-65c9-4862-8909-a99ff617c9be tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:10.131248 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4cc4c107-65c9-4862-8909-a99ff617c9be tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:10.131703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4cc4c107-65c9-4862-8909-a99ff617c9be tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:10.145483 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-4cc4c107-65c9-4862-8909-a99ff617c9be tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] HTTP exception thrown: Instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 could not be found. May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4cc4c107-65c9-4862-8909-a99ff617c9be tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Request method failure captured: May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 HTTP/1.1 May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbTRYuLPQW95gMFHe5-uqGzUhHGcBOWxoPTwUGJIndyREOdxNc18c6pRwaU_IFvLgHihzK5cL_uDbvzMXafUDrI3U8ivDpqXoDp_yhwfP_kUG1eD0et98tqEz2jzvKixQkXLboZfSeCQFlGpZxC-yDJWUULxjwrsF9WW-7XLctp2m5M May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 893b769e1a3f4a2bb1e698994ba46ad4 May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersTestJSON-195393896 May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_893b769e1a3f4a2bb1e698994ba46ad4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/893b769e1a3f4a2bb1e698994ba46ad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/893b769e1a3f4a2bb1e698994ba46ad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/893b769e1a3f4a2bb1e698994ba46ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersTestJSON-195393896 May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 893b769e1a3f4a2bb1e698994ba46ad4 May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersTestJSON-195393896 May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersTestJSON-195393896-project May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 3456cd216199486291dfabda81680edc May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersTestJSON-195393896-project May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 could not be found. May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'd92dfd87-eb45-4ff0-8c96-be6ee73846f5'} May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 could not be found. May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 could not be found. May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:37:10.147158 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:37:10.152459 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:37:10.152459 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:37:10.152459 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:37:10.152459 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:37:10.152459 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:37:10.152459 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 could not be found. May 28 05:37:10.152459 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:37:10.152459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4cc4c107-65c9-4862-8909-a99ff617c9be tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Returning 404 to user: Instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:37:10.152459 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4cc4c107-65c9-4862-8909-a99ff617c9be tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 404 len: 111 microversion: 2.1 time: 0.031574 May 28 05:37:10.152459 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3501/7115] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:10 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:37:10.162186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4fe625f1-89da-425b-8d80-d595f237bcb6 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:10.162744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4fe625f1-89da-425b-8d80-d595f237bcb6 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:10.170243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fe625f1-89da-425b-8d80-d595f237bcb6 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:10.178093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fe625f1-89da-425b-8d80-d595f237bcb6 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:10.178093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fe625f1-89da-425b-8d80-d595f237bcb6 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:10.178093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4fe625f1-89da-425b-8d80-d595f237bcb6 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:10.186020 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-4fe625f1-89da-425b-8d80-d595f237bcb6 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] HTTP exception thrown: Instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 could not be found. May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4fe625f1-89da-425b-8d80-d595f237bcb6 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Request method failure captured: May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 HTTP/1.1 May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbTRYuLPQW95gMFHe5-uqGzUhHGcBOWxoPTwUGJIndyREOdxNc18c6pRwaU_IFvLgHihzK5cL_uDbvzMXafUDrI3U8ivDpqXoDp_yhwfP_kUG1eD0et98tqEz2jzvKixQkXLboZfSeCQFlGpZxC-yDJWUULxjwrsF9WW-7XLctp2m5M May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 893b769e1a3f4a2bb1e698994ba46ad4 May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-DeleteServersTestJSON-195393896 May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_893b769e1a3f4a2bb1e698994ba46ad4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/893b769e1a3f4a2bb1e698994ba46ad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/893b769e1a3f4a2bb1e698994ba46ad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/893b769e1a3f4a2bb1e698994ba46ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-DeleteServersTestJSON-195393896 May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 893b769e1a3f4a2bb1e698994ba46ad4 May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-DeleteServersTestJSON-195393896 May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-DeleteServersTestJSON-195393896-project May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 3456cd216199486291dfabda81680edc May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-DeleteServersTestJSON-195393896-project May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 could not be found. May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'd92dfd87-eb45-4ff0-8c96-be6ee73846f5'} May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 could not be found. May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:37:10.187738 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:37:10.192715 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 could not be found. May 28 05:37:10.192715 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:37:10.192715 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:37:10.192715 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:37:10.192715 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:37:10.192715 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:37:10.192715 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:37:10.192715 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:37:10.192715 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:37:10.192715 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 could not be found. May 28 05:37:10.192715 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:37:10.192715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4fe625f1-89da-425b-8d80-d595f237bcb6 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Returning 404 to user: Instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:37:10.192715 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4fe625f1-89da-425b-8d80-d595f237bcb6 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 404 len: 111 microversion: 2.1 time: 0.030955 May 28 05:37:10.192715 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3615/7116] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:37:10 2022] DELETE /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:37:10.197945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e03a6a2c-0633-4d3e-a96e-a0693a6daf75 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:10.198584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e03a6a2c-0633-4d3e-a96e-a0693a6daf75 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] [instance: d92dfd87-eb45-4ff0-8c96-be6ee73846f5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:10.204905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e03a6a2c-0633-4d3e-a96e-a0693a6daf75 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:10.205379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e03a6a2c-0633-4d3e-a96e-a0693a6daf75 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:10.206170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e03a6a2c-0633-4d3e-a96e-a0693a6daf75 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:10.206627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e03a6a2c-0633-4d3e-a96e-a0693a6daf75 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:10.220437 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-e03a6a2c-0633-4d3e-a96e-a0693a6daf75 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] HTTP exception thrown: Instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 could not be found. May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e03a6a2c-0633-4d3e-a96e-a0693a6daf75 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Request method failure captured: May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 HTTP/1.1 May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbTRYuLPQW95gMFHe5-uqGzUhHGcBOWxoPTwUGJIndyREOdxNc18c6pRwaU_IFvLgHihzK5cL_uDbvzMXafUDrI3U8ivDpqXoDp_yhwfP_kUG1eD0et98tqEz2jzvKixQkXLboZfSeCQFlGpZxC-yDJWUULxjwrsF9WW-7XLctp2m5M May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 893b769e1a3f4a2bb1e698994ba46ad4 May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-DeleteServersTestJSON-195393896 May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_893b769e1a3f4a2bb1e698994ba46ad4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/893b769e1a3f4a2bb1e698994ba46ad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/893b769e1a3f4a2bb1e698994ba46ad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/893b769e1a3f4a2bb1e698994ba46ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-DeleteServersTestJSON-195393896 May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 893b769e1a3f4a2bb1e698994ba46ad4 May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-DeleteServersTestJSON-195393896 May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-DeleteServersTestJSON-195393896-project May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 3456cd216199486291dfabda81680edc May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-DeleteServersTestJSON-195393896-project May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 could not be found. May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'd92dfd87-eb45-4ff0-8c96-be6ee73846f5'} May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 could not be found. May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 could not be found. May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:37:10.222005 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:37:10.227545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:37:10.227545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:37:10.227545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:37:10.227545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:37:10.227545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:37:10.227545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 could not be found. May 28 05:37:10.227545 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:37:10.227545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e03a6a2c-0633-4d3e-a96e-a0693a6daf75 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] Returning 404 to user: Instance d92dfd87-eb45-4ff0-8c96-be6ee73846f5 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:37:10.227545 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e03a6a2c-0633-4d3e-a96e-a0693a6daf75 tempest-DeleteServersTestJSON-195393896 tempest-DeleteServersTestJSON-195393896-project] 10.222.0.58 "GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5" status: 404 len: 111 microversion: 2.1 time: 0.029597 May 28 05:37:10.227545 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3502/7117] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:10 2022] GET /compute/v2.1/servers/d92dfd87-eb45-4ff0-8c96-be6ee73846f5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:37:13.995774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d083da2f-0a71-48f3-a582-b9dd94547790 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1021382972", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "8d1b1588-a717-4dff-b1ec-4161131e2139"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:37:14.047541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-d083da2f-0a71-48f3-a582-b9dd94547790 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] validate_networks() for [('8d1b1588-a717-4dff-b1ec-4161131e2139', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:37:14.396004 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d083da2f-0a71-48f3-a582-b9dd94547790 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:37:14.396458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d083da2f-0a71-48f3-a582-b9dd94547790 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:37:14.396939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d083da2f-0a71-48f3-a582-b9dd94547790 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:37:14.397382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d083da2f-0a71-48f3-a582-b9dd94547790 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:37:14.397787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d083da2f-0a71-48f3-a582-b9dd94547790 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:37:14.406747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d083da2f-0a71-48f3-a582-b9dd94547790 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:14.407208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d083da2f-0a71-48f3-a582-b9dd94547790 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:14.408005 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d083da2f-0a71-48f3-a582-b9dd94547790 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:14.408453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d083da2f-0a71-48f3-a582-b9dd94547790 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:14.426076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-d083da2f-0a71-48f3-a582-b9dd94547790 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Getting quotas for project 8f172449ec264570925e6ce663f39f48. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:37:14.432057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-d083da2f-0a71-48f3-a582-b9dd94547790 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Getting quotas for user 24ab05980f96488b94964987b64d41a7 and project 8f172449ec264570925e6ce663f39f48. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:37:14.444958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d083da2f-0a71-48f3-a582-b9dd94547790 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:37:14.447261 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d083da2f-0a71-48f3-a582-b9dd94547790 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:37:14.553433 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d083da2f-0a71-48f3-a582-b9dd94547790 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675097 May 28 05:37:14.554087 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3616/7118] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:37:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:37:14.565034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-565dbeff-31da-4162-8cdb-ce5da846b48d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:14.565674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-565dbeff-31da-4162-8cdb-ce5da846b48d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:14.624417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-565dbeff-31da-4162-8cdb-ce5da846b48d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:14.632376 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-565dbeff-31da-4162-8cdb-ce5da846b48d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1218 microversion: 2.1 time: 0.071327 May 28 05:37:14.632954 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3503/7119] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:14 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:15.650529 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-39f7c0e5-2876-4c8a-a3d3-aaf9b37b1f3a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:15.651218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-39f7c0e5-2876-4c8a-a3d3-aaf9b37b1f3a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:15.658236 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39f7c0e5-2876-4c8a-a3d3-aaf9b37b1f3a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:15.658736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39f7c0e5-2876-4c8a-a3d3-aaf9b37b1f3a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:15.659555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39f7c0e5-2876-4c8a-a3d3-aaf9b37b1f3a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:15.660191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-39f7c0e5-2876-4c8a-a3d3-aaf9b37b1f3a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:15.722653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-39f7c0e5-2876-4c8a-a3d3-aaf9b37b1f3a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:15.730336 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-39f7c0e5-2876-4c8a-a3d3-aaf9b37b1f3a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1222 microversion: 2.1 time: 0.084789 May 28 05:37:15.730905 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3617/7120] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:15 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:16.748001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1304dd51-89e3-4087-a131-e4889b7a9e26 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:16.748752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1304dd51-89e3-4087-a131-e4889b7a9e26 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:16.758256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1304dd51-89e3-4087-a131-e4889b7a9e26 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:16.758734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1304dd51-89e3-4087-a131-e4889b7a9e26 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:16.759645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1304dd51-89e3-4087-a131-e4889b7a9e26 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:16.761948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1304dd51-89e3-4087-a131-e4889b7a9e26 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:16.834159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1304dd51-89e3-4087-a131-e4889b7a9e26 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:16.842447 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1304dd51-89e3-4087-a131-e4889b7a9e26 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1278 microversion: 2.1 time: 0.098401 May 28 05:37:16.845990 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3504/7121] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:16 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1278 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:17.859757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7680fa30-f5b1-4bf4-878a-fa72c0e88fcd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:17.860412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7680fa30-f5b1-4bf4-878a-fa72c0e88fcd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:17.867381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7680fa30-f5b1-4bf4-878a-fa72c0e88fcd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:17.867841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7680fa30-f5b1-4bf4-878a-fa72c0e88fcd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:17.868603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7680fa30-f5b1-4bf4-878a-fa72c0e88fcd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:17.869045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7680fa30-f5b1-4bf4-878a-fa72c0e88fcd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:18.095366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7680fa30-f5b1-4bf4-878a-fa72c0e88fcd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:18.103537 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7680fa30-f5b1-4bf4-878a-fa72c0e88fcd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1318 microversion: 2.1 time: 0.247637 May 28 05:37:18.104138 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3618/7122] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:17 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:18.325528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-14404cee-7979-4831-bb39-9ef6d5c633a9 req-d514b1b2-e26a-444a-b18f-54c9e67d2e66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba5c1936-badd-44aa-af3f-e8b8ee1e9b41", "tag": "22126308-41f0-4a96-b135-d0995a031956"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:37:18.343160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-14404cee-7979-4831-bb39-9ef6d5c633a9 req-d514b1b2-e26a-444a-b18f-54c9e67d2e66 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:18.343889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-14404cee-7979-4831-bb39-9ef6d5c633a9 req-d514b1b2-e26a-444a-b18f-54c9e67d2e66 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:18.358298 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-14404cee-7979-4831-bb39-9ef6d5c633a9 req-d514b1b2-e26a-444a-b18f-54c9e67d2e66 service nova] Creating event network-changed:22126308-41f0-4a96-b135-d0995a031956 for instance ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 on n-h1-843700-1 May 28 05:37:18.363353 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-14404cee-7979-4831-bb39-9ef6d5c633a9 req-d514b1b2-e26a-444a-b18f-54c9e67d2e66 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041389 May 28 05:37:18.363969 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3505/7123] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:37:19.122690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9ffabf73-25da-4719-a8ee-a22e58b1a1d9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:19.131055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9ffabf73-25da-4719-a8ee-a22e58b1a1d9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:19.131055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ffabf73-25da-4719-a8ee-a22e58b1a1d9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:19.131055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ffabf73-25da-4719-a8ee-a22e58b1a1d9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:19.131055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ffabf73-25da-4719-a8ee-a22e58b1a1d9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:19.131512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ffabf73-25da-4719-a8ee-a22e58b1a1d9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:19.264196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9ffabf73-25da-4719-a8ee-a22e58b1a1d9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:19.271928 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9ffabf73-25da-4719-a8ee-a22e58b1a1d9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1318 microversion: 2.1 time: 0.154924 May 28 05:37:19.272502 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3619/7124] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:19 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:37:20.290409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a37ea10f-38f3-4fa6-b706-d2a41e0c7447 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:20.291153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a37ea10f-38f3-4fa6-b706-d2a41e0c7447 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:20.297468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a37ea10f-38f3-4fa6-b706-d2a41e0c7447 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:20.297930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a37ea10f-38f3-4fa6-b706-d2a41e0c7447 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:20.298699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a37ea10f-38f3-4fa6-b706-d2a41e0c7447 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:20.299188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a37ea10f-38f3-4fa6-b706-d2a41e0c7447 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:20.431110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a37ea10f-38f3-4fa6-b706-d2a41e0c7447 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:20.438947 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a37ea10f-38f3-4fa6-b706-d2a41e0c7447 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1318 microversion: 2.1 time: 0.153472 May 28 05:37:20.439641 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3506/7125] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:20 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:21.455819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3024f197-5c64-41ca-a733-0f7d878f7c5d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:21.456350 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3024f197-5c64-41ca-a733-0f7d878f7c5d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:21.464167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3024f197-5c64-41ca-a733-0f7d878f7c5d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:21.464624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3024f197-5c64-41ca-a733-0f7d878f7c5d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:21.465386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3024f197-5c64-41ca-a733-0f7d878f7c5d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:21.466316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3024f197-5c64-41ca-a733-0f7d878f7c5d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:21.598899 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3024f197-5c64-41ca-a733-0f7d878f7c5d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:21.606440 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3024f197-5c64-41ca-a733-0f7d878f7c5d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1318 microversion: 2.1 time: 0.154585 May 28 05:37:21.607045 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3620/7126] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:21 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:22.623570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f0ff6c1b-d9c1-44ea-ab41-e1a96f81c522 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:22.624200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f0ff6c1b-d9c1-44ea-ab41-e1a96f81c522 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:22.630761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0ff6c1b-d9c1-44ea-ab41-e1a96f81c522 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:22.631262 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0ff6c1b-d9c1-44ea-ab41-e1a96f81c522 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:22.632044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0ff6c1b-d9c1-44ea-ab41-e1a96f81c522 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:22.632500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0ff6c1b-d9c1-44ea-ab41-e1a96f81c522 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:22.759849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f0ff6c1b-d9c1-44ea-ab41-e1a96f81c522 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:22.767565 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f0ff6c1b-d9c1-44ea-ab41-e1a96f81c522 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1318 microversion: 2.1 time: 0.147851 May 28 05:37:22.768150 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3507/7127] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:22 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:23.785423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-21df3558-4f78-41d2-91d4-f03650ab21e4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:23.785969 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-21df3558-4f78-41d2-91d4-f03650ab21e4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:23.793414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21df3558-4f78-41d2-91d4-f03650ab21e4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:23.793876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21df3558-4f78-41d2-91d4-f03650ab21e4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:23.794649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21df3558-4f78-41d2-91d4-f03650ab21e4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:23.795129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-21df3558-4f78-41d2-91d4-f03650ab21e4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:23.923049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-21df3558-4f78-41d2-91d4-f03650ab21e4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:23.930624 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-21df3558-4f78-41d2-91d4-f03650ab21e4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1318 microversion: 2.1 time: 0.149298 May 28 05:37:23.931231 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3621/7128] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:23 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:24.947216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e951e8d3-35bd-40c1-8760-cd9185bbcd27 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:24.947859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e951e8d3-35bd-40c1-8760-cd9185bbcd27 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:24.951907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:37:24.955571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e951e8d3-35bd-40c1-8760-cd9185bbcd27 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:24.956034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e951e8d3-35bd-40c1-8760-cd9185bbcd27 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:24.956821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e951e8d3-35bd-40c1-8760-cd9185bbcd27 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:24.957268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e951e8d3-35bd-40c1-8760-cd9185bbcd27 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:25.026062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-fc225a0b-956f-4d1f-ab94-b9fb4bf202c0 req-e94d45e3-bc6a-4e6e-bb27-ab600dc47dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5c1936-badd-44aa-af3f-e8b8ee1e9b41", "name": "network-vif-plugged", "status": "completed", "tag": "22126308-41f0-4a96-b135-d0995a031956"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:37:25.031198 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:37:25.031858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:37:25.036649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-fc225a0b-956f-4d1f-ab94-b9fb4bf202c0 req-e94d45e3-bc6a-4e6e-bb27-ab600dc47dac service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:25.037143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-fc225a0b-956f-4d1f-ab94-b9fb4bf202c0 req-e94d45e3-bc6a-4e6e-bb27-ab600dc47dac service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:25.049825 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-fc225a0b-956f-4d1f-ab94-b9fb4bf202c0 req-e94d45e3-bc6a-4e6e-bb27-ab600dc47dac service nova] Creating event network-vif-plugged:22126308-41f0-4a96-b135-d0995a031956 for instance ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 on n-h1-843700-1 May 28 05:37:25.055663 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-fc225a0b-956f-4d1f-ab94-b9fb4bf202c0 req-e94d45e3-bc6a-4e6e-bb27-ab600dc47dac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033774 May 28 05:37:25.056299 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3622/7129] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:37:25.108421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e951e8d3-35bd-40c1-8760-cd9185bbcd27 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:25.116454 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e951e8d3-35bd-40c1-8760-cd9185bbcd27 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1318 microversion: 2.1 time: 0.173156 May 28 05:37:25.117051 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3508/7130] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:24 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:26.135617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-24667333-ae77-4c0e-956c-9f7b72438def tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:26.136435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-24667333-ae77-4c0e-956c-9f7b72438def tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:26.144300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24667333-ae77-4c0e-956c-9f7b72438def tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:26.144766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24667333-ae77-4c0e-956c-9f7b72438def tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:26.145572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24667333-ae77-4c0e-956c-9f7b72438def tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:26.146018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-24667333-ae77-4c0e-956c-9f7b72438def tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:26.288255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-24667333-ae77-4c0e-956c-9f7b72438def tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:26.296609 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-24667333-ae77-4c0e-956c-9f7b72438def tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1318 microversion: 2.1 time: 0.166907 May 28 05:37:26.297189 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3623/7131] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:26 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:27.313703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e4fb3bb2-ee8f-49f4-a82e-83e44b39339a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:27.314342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e4fb3bb2-ee8f-49f4-a82e-83e44b39339a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:27.322685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4fb3bb2-ee8f-49f4-a82e-83e44b39339a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:27.323199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4fb3bb2-ee8f-49f4-a82e-83e44b39339a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:27.323985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4fb3bb2-ee8f-49f4-a82e-83e44b39339a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:27.324444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4fb3bb2-ee8f-49f4-a82e-83e44b39339a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:27.452143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e4fb3bb2-ee8f-49f4-a82e-83e44b39339a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:27.459755 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e4fb3bb2-ee8f-49f4-a82e-83e44b39339a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1508 microversion: 2.1 time: 0.150033 May 28 05:37:27.460426 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3509/7132] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:27 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:27.476816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3ebae64a-0fa6-40e9-97dd-42769381b11e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:27.477432 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3ebae64a-0fa6-40e9-97dd-42769381b11e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:27.484335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ebae64a-0fa6-40e9-97dd-42769381b11e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:27.484787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ebae64a-0fa6-40e9-97dd-42769381b11e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:27.485545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ebae64a-0fa6-40e9-97dd-42769381b11e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:27.485981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3ebae64a-0fa6-40e9-97dd-42769381b11e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:27.616536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3ebae64a-0fa6-40e9-97dd-42769381b11e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:27.624020 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3ebae64a-0fa6-40e9-97dd-42769381b11e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1508 microversion: 2.1 time: 0.151933 May 28 05:37:27.624598 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3624/7133] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:27 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:27.639923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b825dac6-c573-4939-8408-29a7a6948dbb tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:37:27.641073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b825dac6-c573-4939-8408-29a7a6948dbb tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:27.647391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b825dac6-c573-4939-8408-29a7a6948dbb tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:27.648410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b825dac6-c573-4939-8408-29a7a6948dbb tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:27.649201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b825dac6-c573-4939-8408-29a7a6948dbb tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:27.649658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b825dac6-c573-4939-8408-29a7a6948dbb tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:27.789274 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b825dac6-c573-4939-8408-29a7a6948dbb tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "PUT /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1080 microversion: 2.1 time: 0.152540 May 28 05:37:27.790054 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3510/7134] 10.222.0.58 () {60 vars in 1255 bytes} [Sat May 28 05:37:27 2022] PUT /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1080 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:27.804358 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a1e5af68-b4ff-4d03-a6a9-c613149af6aa tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:27.811334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a1e5af68-b4ff-4d03-a6a9-c613149af6aa tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:27.811334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1e5af68-b4ff-4d03-a6a9-c613149af6aa tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:27.811693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1e5af68-b4ff-4d03-a6a9-c613149af6aa tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:27.812471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1e5af68-b4ff-4d03-a6a9-c613149af6aa tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:27.812921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1e5af68-b4ff-4d03-a6a9-c613149af6aa tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:27.944030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a1e5af68-b4ff-4d03-a6a9-c613149af6aa tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:27.946876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:37:27.952969 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a1e5af68-b4ff-4d03-a6a9-c613149af6aa tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1506 microversion: 2.1 time: 0.152502 May 28 05:37:27.953553 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3625/7135] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:27 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:27.969310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dc30d185-c97d-4955-a950-b3d8f9c12c96 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:27.969943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dc30d185-c97d-4955-a950-b3d8f9c12c96 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:27.976071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc30d185-c97d-4955-a950-b3d8f9c12c96 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:27.976543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc30d185-c97d-4955-a950-b3d8f9c12c96 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:27.977350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc30d185-c97d-4955-a950-b3d8f9c12c96 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:27.977856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc30d185-c97d-4955-a950-b3d8f9c12c96 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:28.107180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dc30d185-c97d-4955-a950-b3d8f9c12c96 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:28.114700 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dc30d185-c97d-4955-a950-b3d8f9c12c96 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1506 microversion: 2.1 time: 0.149352 May 28 05:37:28.115309 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3511/7136] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:27 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:28.130756 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d72c2815-398a-4a5e-a956-fa73e5fbeeae tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:37:28.131796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d72c2815-398a-4a5e-a956-fa73e5fbeeae tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:28.138813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d72c2815-398a-4a5e-a956-fa73e5fbeeae tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:28.139305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d72c2815-398a-4a5e-a956-fa73e5fbeeae tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:28.140185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d72c2815-398a-4a5e-a956-fa73e5fbeeae tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:28.140644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d72c2815-398a-4a5e-a956-fa73e5fbeeae tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:28.214737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d72c2815-398a-4a5e-a956-fa73e5fbeeae tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:28.220792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d72c2815-398a-4a5e-a956-fa73e5fbeeae tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Old instance type m1.heat2, new instance type m1.heat {{(pid=126044) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 05:37:28.227330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d72c2815-398a-4a5e-a956-fa73e5fbeeae tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:37:28.234959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d72c2815-398a-4a5e-a956-fa73e5fbeeae tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:37:28.234959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d72c2815-398a-4a5e-a956-fa73e5fbeeae tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:37:28.234959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d72c2815-398a-4a5e-a956-fa73e5fbeeae tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:37:28.234959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-d72c2815-398a-4a5e-a956-fa73e5fbeeae tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:37:28.446951 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d72c2815-398a-4a5e-a956-fa73e5fbeeae tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "POST /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41/action" status: 202 len: 0 microversion: 2.1 time: 0.320092 May 28 05:37:28.447956 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3626/7137] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:37:28 2022] POST /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 05:37:28.455720 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-feb3becb-165a-46da-8a39-c160300e48b9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:28.456391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-feb3becb-165a-46da-8a39-c160300e48b9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:28.463306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-feb3becb-165a-46da-8a39-c160300e48b9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:28.463781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-feb3becb-165a-46da-8a39-c160300e48b9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:28.464572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-feb3becb-165a-46da-8a39-c160300e48b9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:28.465031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-feb3becb-165a-46da-8a39-c160300e48b9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:28.598382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-feb3becb-165a-46da-8a39-c160300e48b9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:28.606194 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-feb3becb-165a-46da-8a39-c160300e48b9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1517 microversion: 2.1 time: 0.154397 May 28 05:37:28.606774 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3512/7138] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:28 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:29.624490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9658f1d9-f63d-4bc8-84b0-3c726b152441 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:29.625099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9658f1d9-f63d-4bc8-84b0-3c726b152441 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:29.632462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9658f1d9-f63d-4bc8-84b0-3c726b152441 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:29.632922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9658f1d9-f63d-4bc8-84b0-3c726b152441 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:29.634207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9658f1d9-f63d-4bc8-84b0-3c726b152441 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:29.634638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9658f1d9-f63d-4bc8-84b0-3c726b152441 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:29.765110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9658f1d9-f63d-4bc8-84b0-3c726b152441 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:29.773058 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9658f1d9-f63d-4bc8-84b0-3c726b152441 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1517 microversion: 2.1 time: 0.153430 May 28 05:37:29.773684 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3627/7139] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:29 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:37:30.791063 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d8b02195-93e5-49ae-9b7f-05cda21cdb25 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:30.792108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d8b02195-93e5-49ae-9b7f-05cda21cdb25 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:30.795008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:37:30.800260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8b02195-93e5-49ae-9b7f-05cda21cdb25 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:30.800734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8b02195-93e5-49ae-9b7f-05cda21cdb25 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:30.801529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8b02195-93e5-49ae-9b7f-05cda21cdb25 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:30.801987 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8b02195-93e5-49ae-9b7f-05cda21cdb25 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:30.806731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:37:31.015165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d8b02195-93e5-49ae-9b7f-05cda21cdb25 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:31.023021 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d8b02195-93e5-49ae-9b7f-05cda21cdb25 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1517 microversion: 2.1 time: 0.235949 May 28 05:37:31.023635 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3513/7140] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:30 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1517 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:32.040327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ad37a59e-23a7-4cc6-8952-ce86e9417c14 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:32.040951 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ad37a59e-23a7-4cc6-8952-ce86e9417c14 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:32.047955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad37a59e-23a7-4cc6-8952-ce86e9417c14 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:32.048414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad37a59e-23a7-4cc6-8952-ce86e9417c14 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:32.049181 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad37a59e-23a7-4cc6-8952-ce86e9417c14 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:32.049626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad37a59e-23a7-4cc6-8952-ce86e9417c14 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:32.183606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ad37a59e-23a7-4cc6-8952-ce86e9417c14 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:32.191141 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ad37a59e-23a7-4cc6-8952-ce86e9417c14 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.154756 May 28 05:37:32.191726 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3628/7141] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:32 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:33.209212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4930339a-d22b-44cb-a480-c401ad4045bd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:33.209839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4930339a-d22b-44cb-a480-c401ad4045bd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:33.217508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4930339a-d22b-44cb-a480-c401ad4045bd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:33.217969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4930339a-d22b-44cb-a480-c401ad4045bd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:33.218744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4930339a-d22b-44cb-a480-c401ad4045bd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:33.219230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4930339a-d22b-44cb-a480-c401ad4045bd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:33.345867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4930339a-d22b-44cb-a480-c401ad4045bd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:33.353584 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4930339a-d22b-44cb-a480-c401ad4045bd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.148314 May 28 05:37:33.354175 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3514/7142] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:33 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:34.369775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4c88b2bf-8651-43b5-92c8-dd7206540d9a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:34.370330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4c88b2bf-8651-43b5-92c8-dd7206540d9a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:34.373091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:37:34.377882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c88b2bf-8651-43b5-92c8-dd7206540d9a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:34.378342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c88b2bf-8651-43b5-92c8-dd7206540d9a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:34.379151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c88b2bf-8651-43b5-92c8-dd7206540d9a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:34.379600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4c88b2bf-8651-43b5-92c8-dd7206540d9a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:34.510633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4c88b2bf-8651-43b5-92c8-dd7206540d9a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:34.518385 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4c88b2bf-8651-43b5-92c8-dd7206540d9a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.152635 May 28 05:37:34.518958 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3629/7143] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:34 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:35.535773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4de24c34-7812-4444-9f37-8602eb9a06be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:35.536337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4de24c34-7812-4444-9f37-8602eb9a06be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:35.543862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4de24c34-7812-4444-9f37-8602eb9a06be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:35.544322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4de24c34-7812-4444-9f37-8602eb9a06be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:35.545096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4de24c34-7812-4444-9f37-8602eb9a06be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:35.545546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4de24c34-7812-4444-9f37-8602eb9a06be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:35.673071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4de24c34-7812-4444-9f37-8602eb9a06be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:35.681523 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4de24c34-7812-4444-9f37-8602eb9a06be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.149793 May 28 05:37:35.682098 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3515/7144] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:35 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:36.698360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a8534750-dc13-4d33-992d-4835d7bf38ef tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:36.698880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a8534750-dc13-4d33-992d-4835d7bf38ef tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:36.705949 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a8534750-dc13-4d33-992d-4835d7bf38ef tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:36.706407 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a8534750-dc13-4d33-992d-4835d7bf38ef tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:36.707207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a8534750-dc13-4d33-992d-4835d7bf38ef tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:36.707650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a8534750-dc13-4d33-992d-4835d7bf38ef tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:36.886325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a8534750-dc13-4d33-992d-4835d7bf38ef tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:36.894400 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a8534750-dc13-4d33-992d-4835d7bf38ef tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.200694 May 28 05:37:36.894979 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3630/7145] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:36 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:37.911446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6b5d4e5f-a410-4ed5-802b-32b52562b984 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:37.912107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6b5d4e5f-a410-4ed5-802b-32b52562b984 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:37.919235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b5d4e5f-a410-4ed5-802b-32b52562b984 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:37.919701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b5d4e5f-a410-4ed5-802b-32b52562b984 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:37.920476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b5d4e5f-a410-4ed5-802b-32b52562b984 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:37.920926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b5d4e5f-a410-4ed5-802b-32b52562b984 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:38.048613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6b5d4e5f-a410-4ed5-802b-32b52562b984 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:38.056771 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6b5d4e5f-a410-4ed5-802b-32b52562b984 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.149343 May 28 05:37:38.057355 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3516/7146] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:37 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:39.074282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d8027fba-0b5e-4d72-a558-24580c8395b2 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:39.074909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d8027fba-0b5e-4d72-a558-24580c8395b2 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:39.081987 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8027fba-0b5e-4d72-a558-24580c8395b2 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:39.082445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8027fba-0b5e-4d72-a558-24580c8395b2 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:39.083240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8027fba-0b5e-4d72-a558-24580c8395b2 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:39.083683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8027fba-0b5e-4d72-a558-24580c8395b2 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:39.214608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d8027fba-0b5e-4d72-a558-24580c8395b2 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:39.222356 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d8027fba-0b5e-4d72-a558-24580c8395b2 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.152652 May 28 05:37:39.223041 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3631/7147] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:39 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:40.240558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fa17565c-e3d2-4ac0-834f-5e11b10542be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:40.241196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fa17565c-e3d2-4ac0-834f-5e11b10542be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:40.248431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa17565c-e3d2-4ac0-834f-5e11b10542be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:40.248905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa17565c-e3d2-4ac0-834f-5e11b10542be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:40.249696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa17565c-e3d2-4ac0-834f-5e11b10542be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:40.250189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa17565c-e3d2-4ac0-834f-5e11b10542be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:40.429117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fa17565c-e3d2-4ac0-834f-5e11b10542be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:40.437230 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fa17565c-e3d2-4ac0-834f-5e11b10542be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.200654 May 28 05:37:40.437945 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3517/7148] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:40 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:41.454872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eccb06f6-f3a6-4adc-9473-4e6cf5817d16 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:41.455452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-eccb06f6-f3a6-4adc-9473-4e6cf5817d16 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:41.463102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eccb06f6-f3a6-4adc-9473-4e6cf5817d16 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:41.463633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eccb06f6-f3a6-4adc-9473-4e6cf5817d16 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:41.464413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eccb06f6-f3a6-4adc-9473-4e6cf5817d16 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:41.464859 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eccb06f6-f3a6-4adc-9473-4e6cf5817d16 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:41.592059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-eccb06f6-f3a6-4adc-9473-4e6cf5817d16 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:41.599625 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-eccb06f6-f3a6-4adc-9473-4e6cf5817d16 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.148856 May 28 05:37:41.600219 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3632/7149] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:41 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:42.616902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f0429529-a421-497f-830a-8d5533e63c84 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:42.617558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f0429529-a421-497f-830a-8d5533e63c84 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:42.624502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0429529-a421-497f-830a-8d5533e63c84 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:42.624976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0429529-a421-497f-830a-8d5533e63c84 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:42.625763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0429529-a421-497f-830a-8d5533e63c84 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:42.626221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f0429529-a421-497f-830a-8d5533e63c84 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:42.758691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f0429529-a421-497f-830a-8d5533e63c84 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:42.766305 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f0429529-a421-497f-830a-8d5533e63c84 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.153369 May 28 05:37:42.767175 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3518/7150] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:42 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:43.784967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f538bbcb-8f94-47ac-9dc0-d7d005c3bfd3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:43.785582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f538bbcb-8f94-47ac-9dc0-d7d005c3bfd3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:43.792976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f538bbcb-8f94-47ac-9dc0-d7d005c3bfd3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:43.793426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f538bbcb-8f94-47ac-9dc0-d7d005c3bfd3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:43.794178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f538bbcb-8f94-47ac-9dc0-d7d005c3bfd3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:43.794614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f538bbcb-8f94-47ac-9dc0-d7d005c3bfd3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:43.921640 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f538bbcb-8f94-47ac-9dc0-d7d005c3bfd3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:43.929202 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f538bbcb-8f94-47ac-9dc0-d7d005c3bfd3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.148211 May 28 05:37:43.929814 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3633/7151] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:43 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:44.946066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8cb7ad56-0a1d-4864-9acd-5348c3bece77 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:44.947336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8cb7ad56-0a1d-4864-9acd-5348c3bece77 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:44.954414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cb7ad56-0a1d-4864-9acd-5348c3bece77 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:44.954890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cb7ad56-0a1d-4864-9acd-5348c3bece77 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:44.955704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cb7ad56-0a1d-4864-9acd-5348c3bece77 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:44.956163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cb7ad56-0a1d-4864-9acd-5348c3bece77 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:45.087115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8cb7ad56-0a1d-4864-9acd-5348c3bece77 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:45.094715 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8cb7ad56-0a1d-4864-9acd-5348c3bece77 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.152601 May 28 05:37:45.095341 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3519/7152] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:44 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:46.112419 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9ebe16f5-3989-4e4e-9fc1-b9984e73aad4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:46.112983 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9ebe16f5-3989-4e4e-9fc1-b9984e73aad4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:46.120158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ebe16f5-3989-4e4e-9fc1-b9984e73aad4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:46.120615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ebe16f5-3989-4e4e-9fc1-b9984e73aad4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:46.121420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ebe16f5-3989-4e4e-9fc1-b9984e73aad4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:46.121865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ebe16f5-3989-4e4e-9fc1-b9984e73aad4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:46.252964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9ebe16f5-3989-4e4e-9fc1-b9984e73aad4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:46.261192 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9ebe16f5-3989-4e4e-9fc1-b9984e73aad4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.152799 May 28 05:37:46.261781 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3634/7153] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:46 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:47.279639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5280e880-efa1-4a86-bcc8-32aa021a2ada tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:47.280276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5280e880-efa1-4a86-bcc8-32aa021a2ada tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:47.287738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5280e880-efa1-4a86-bcc8-32aa021a2ada tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:47.288210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5280e880-efa1-4a86-bcc8-32aa021a2ada tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:47.288996 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5280e880-efa1-4a86-bcc8-32aa021a2ada tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:47.289459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5280e880-efa1-4a86-bcc8-32aa021a2ada tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:47.415898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5280e880-efa1-4a86-bcc8-32aa021a2ada tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:47.423434 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5280e880-efa1-4a86-bcc8-32aa021a2ada tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.147793 May 28 05:37:47.424023 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3520/7154] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:47 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:48.440525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f04d6353-ab5f-4d71-8e8d-994de32967fe tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:48.441207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f04d6353-ab5f-4d71-8e8d-994de32967fe tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:48.448406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f04d6353-ab5f-4d71-8e8d-994de32967fe tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:48.448799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f04d6353-ab5f-4d71-8e8d-994de32967fe tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:48.449555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f04d6353-ab5f-4d71-8e8d-994de32967fe tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:48.449994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f04d6353-ab5f-4d71-8e8d-994de32967fe tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:48.583383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f04d6353-ab5f-4d71-8e8d-994de32967fe tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:48.591041 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f04d6353-ab5f-4d71-8e8d-994de32967fe tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.154505 May 28 05:37:48.591633 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3635/7155] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:48 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:37:49.605444 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:37:49.607179 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 05:37:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 (ip 10.222.0.58) !!! May 28 05:37:49.609353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-75881559-08e2-44bd-8cdd-02d757ed0000 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:49.610642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-75881559-08e2-44bd-8cdd-02d757ed0000 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:49.622175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75881559-08e2-44bd-8cdd-02d757ed0000 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:49.622966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75881559-08e2-44bd-8cdd-02d757ed0000 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:49.623793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75881559-08e2-44bd-8cdd-02d757ed0000 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:49.624253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-75881559-08e2-44bd-8cdd-02d757ed0000 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:49.752122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-75881559-08e2-44bd-8cdd-02d757ed0000 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:49.760226 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-75881559-08e2-44bd-8cdd-02d757ed0000 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.155618 May 28 05:37:49.760805 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3521/7156] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:49 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:50.779825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-71a628e5-180a-4026-b9b7-59ccd85235e3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:50.780484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-71a628e5-180a-4026-b9b7-59ccd85235e3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:50.787584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71a628e5-180a-4026-b9b7-59ccd85235e3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:50.788054 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71a628e5-180a-4026-b9b7-59ccd85235e3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:50.788831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71a628e5-180a-4026-b9b7-59ccd85235e3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:50.789280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-71a628e5-180a-4026-b9b7-59ccd85235e3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:50.923481 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-71a628e5-180a-4026-b9b7-59ccd85235e3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:50.931108 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-71a628e5-180a-4026-b9b7-59ccd85235e3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.157332 May 28 05:37:50.931699 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3636/7157] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:50 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:51.948378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a6f55193-bf20-4b90-ad5b-7d6c19522c1f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:51.949008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a6f55193-bf20-4b90-ad5b-7d6c19522c1f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:51.955378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6f55193-bf20-4b90-ad5b-7d6c19522c1f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:51.955849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6f55193-bf20-4b90-ad5b-7d6c19522c1f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:51.956630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6f55193-bf20-4b90-ad5b-7d6c19522c1f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:51.957084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6f55193-bf20-4b90-ad5b-7d6c19522c1f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:52.084050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a6f55193-bf20-4b90-ad5b-7d6c19522c1f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:52.091638 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a6f55193-bf20-4b90-ad5b-7d6c19522c1f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.147365 May 28 05:37:52.092228 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3522/7158] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:51 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:53.108699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f7071cba-572a-49e9-84fb-9af3ac3fd4e9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:53.109323 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f7071cba-572a-49e9-84fb-9af3ac3fd4e9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:53.116314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7071cba-572a-49e9-84fb-9af3ac3fd4e9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:53.116783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7071cba-572a-49e9-84fb-9af3ac3fd4e9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:53.117563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7071cba-572a-49e9-84fb-9af3ac3fd4e9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:53.118943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f7071cba-572a-49e9-84fb-9af3ac3fd4e9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:53.248240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f7071cba-572a-49e9-84fb-9af3ac3fd4e9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:53.256065 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f7071cba-572a-49e9-84fb-9af3ac3fd4e9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.151310 May 28 05:37:53.256654 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3637/7159] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:53 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:54.274337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b2875188-e5fd-4a03-89c5-0ae4d3abcc14 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:54.275591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b2875188-e5fd-4a03-89c5-0ae4d3abcc14 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:54.283830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b2875188-e5fd-4a03-89c5-0ae4d3abcc14 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:54.284291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b2875188-e5fd-4a03-89c5-0ae4d3abcc14 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:54.285064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b2875188-e5fd-4a03-89c5-0ae4d3abcc14 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:54.285513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b2875188-e5fd-4a03-89c5-0ae4d3abcc14 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:54.413600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b2875188-e5fd-4a03-89c5-0ae4d3abcc14 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:54.421273 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b2875188-e5fd-4a03-89c5-0ae4d3abcc14 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.150969 May 28 05:37:54.421851 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3523/7160] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:54 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:55.437698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-938f856a-0846-4065-a9e5-499377f6cc63 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:55.438241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-938f856a-0846-4065-a9e5-499377f6cc63 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:55.445049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-938f856a-0846-4065-a9e5-499377f6cc63 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:55.445512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-938f856a-0846-4065-a9e5-499377f6cc63 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:55.446282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-938f856a-0846-4065-a9e5-499377f6cc63 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:55.446731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-938f856a-0846-4065-a9e5-499377f6cc63 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:55.577751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-938f856a-0846-4065-a9e5-499377f6cc63 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:55.585402 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-938f856a-0846-4065-a9e5-499377f6cc63 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.151683 May 28 05:37:55.585979 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3638/7161] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:55 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:56.603163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-851d2f9a-dfc0-4b1c-a037-3789a955fde6 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:56.603799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-851d2f9a-dfc0-4b1c-a037-3789a955fde6 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:56.610755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-851d2f9a-dfc0-4b1c-a037-3789a955fde6 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:56.611266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-851d2f9a-dfc0-4b1c-a037-3789a955fde6 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:56.612055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-851d2f9a-dfc0-4b1c-a037-3789a955fde6 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:56.612513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-851d2f9a-dfc0-4b1c-a037-3789a955fde6 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:56.743511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-851d2f9a-dfc0-4b1c-a037-3789a955fde6 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:56.751076 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-851d2f9a-dfc0-4b1c-a037-3789a955fde6 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.151943 May 28 05:37:56.751654 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3524/7162] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:56 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:57.768984 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bddeb97a-c347-4937-834d-133cfdcc5119 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:57.769603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bddeb97a-c347-4937-834d-133cfdcc5119 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:57.777075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bddeb97a-c347-4937-834d-133cfdcc5119 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:57.777528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bddeb97a-c347-4937-834d-133cfdcc5119 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:57.778291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bddeb97a-c347-4937-834d-133cfdcc5119 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:57.778741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bddeb97a-c347-4937-834d-133cfdcc5119 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:57.908897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bddeb97a-c347-4937-834d-133cfdcc5119 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:57.916671 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bddeb97a-c347-4937-834d-133cfdcc5119 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1522 microversion: 2.1 time: 0.151829 May 28 05:37:57.917291 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3639/7163] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:57 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:58.934515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-59364908-3506-4f05-b9a2-8b4c2c0b4469 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:37:58.935205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-59364908-3506-4f05-b9a2-8b4c2c0b4469 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:37:58.942156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59364908-3506-4f05-b9a2-8b4c2c0b4469 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:58.944124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59364908-3506-4f05-b9a2-8b4c2c0b4469 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:58.944124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59364908-3506-4f05-b9a2-8b4c2c0b4469 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:58.944124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59364908-3506-4f05-b9a2-8b4c2c0b4469 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:59.474543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-59364908-3506-4f05-b9a2-8b4c2c0b4469 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:37:59.482793 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-59364908-3506-4f05-b9a2-8b4c2c0b4469 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1521 microversion: 2.1 time: 0.552980 May 28 05:37:59.492259 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3525/7164] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:37:58 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1521 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:37:59.522744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-d9629e70-b322-421a-b064-b23a16edff4a req-96701298-7575-42a5-ab4e-4abb90abf724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5c1936-badd-44aa-af3f-e8b8ee1e9b41", "name": "network-vif-unplugged", "status": "completed", "tag": "22126308-41f0-4a96-b135-d0995a031956"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:37:59.529530 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d9629e70-b322-421a-b064-b23a16edff4a req-96701298-7575-42a5-ab4e-4abb90abf724 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:37:59.529979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d9629e70-b322-421a-b064-b23a16edff4a req-96701298-7575-42a5-ab4e-4abb90abf724 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:37:59.533773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:37:59.542153 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-d9629e70-b322-421a-b064-b23a16edff4a req-96701298-7575-42a5-ab4e-4abb90abf724 service nova] Creating event network-vif-unplugged:22126308-41f0-4a96-b135-d0995a031956 for instance ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 on n-h2-843700-1 May 28 05:37:59.547972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-d9629e70-b322-421a-b064-b23a16edff4a req-96701298-7575-42a5-ab4e-4abb90abf724 service nova] Instance ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:37:59.560306 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-d9629e70-b322-421a-b064-b23a16edff4a req-96701298-7575-42a5-ab4e-4abb90abf724 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043857 May 28 05:37:59.560952 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3640/7165] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:38:00.500483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0fbb42a9-b5f0-4bab-9497-66cab593ebc9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:00.501124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0fbb42a9-b5f0-4bab-9497-66cab593ebc9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:00.508252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0fbb42a9-b5f0-4bab-9497-66cab593ebc9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:00.513682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0fbb42a9-b5f0-4bab-9497-66cab593ebc9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:00.513682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0fbb42a9-b5f0-4bab-9497-66cab593ebc9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:00.513682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0fbb42a9-b5f0-4bab-9497-66cab593ebc9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:00.640850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0fbb42a9-b5f0-4bab-9497-66cab593ebc9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:00.649286 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0fbb42a9-b5f0-4bab-9497-66cab593ebc9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1521 microversion: 2.1 time: 0.152679 May 28 05:38:00.649877 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3526/7166] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:00 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:01.574879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-300aabfa-d02b-47d7-b8e4-11af48035251 req-59c66c67-3f5c-4680-ac4c-1eaf09e1fdcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba5c1936-badd-44aa-af3f-e8b8ee1e9b41", "tag": "22126308-41f0-4a96-b135-d0995a031956"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:38:01.584900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-300aabfa-d02b-47d7-b8e4-11af48035251 req-59c66c67-3f5c-4680-ac4c-1eaf09e1fdcf service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:01.585357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-300aabfa-d02b-47d7-b8e4-11af48035251 req-59c66c67-3f5c-4680-ac4c-1eaf09e1fdcf service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:01.599771 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-300aabfa-d02b-47d7-b8e4-11af48035251 req-59c66c67-3f5c-4680-ac4c-1eaf09e1fdcf service nova] Creating event network-changed:22126308-41f0-4a96-b135-d0995a031956 for instance ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 on n-h2-843700-1 May 28 05:38:01.605773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-300aabfa-d02b-47d7-b8e4-11af48035251 req-59c66c67-3f5c-4680-ac4c-1eaf09e1fdcf service nova] Instance ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:38:01.616706 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-300aabfa-d02b-47d7-b8e4-11af48035251 req-59c66c67-3f5c-4680-ac4c-1eaf09e1fdcf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045864 May 28 05:38:01.617326 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3641/7167] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:38:01.666566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fe7499ce-de22-4e14-ad38-d175cb40000e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:01.667539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fe7499ce-de22-4e14-ad38-d175cb40000e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:01.670423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=28 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:38:01.675420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe7499ce-de22-4e14-ad38-d175cb40000e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:01.676072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe7499ce-de22-4e14-ad38-d175cb40000e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:01.676874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe7499ce-de22-4e14-ad38-d175cb40000e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:01.677378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe7499ce-de22-4e14-ad38-d175cb40000e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:01.680083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=84 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:38:02.028634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fe7499ce-de22-4e14-ad38-d175cb40000e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:02.036927 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fe7499ce-de22-4e14-ad38-d175cb40000e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1519 microversion: 2.1 time: 0.374242 May 28 05:38:02.037673 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3527/7168] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:01 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1519 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:03.057867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0062960c-e389-40b4-abce-e242f3118359 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:03.058571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0062960c-e389-40b4-abce-e242f3118359 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:03.064689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0062960c-e389-40b4-abce-e242f3118359 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:03.072130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0062960c-e389-40b4-abce-e242f3118359 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:03.072130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0062960c-e389-40b4-abce-e242f3118359 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:03.072130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0062960c-e389-40b4-abce-e242f3118359 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:03.200443 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0062960c-e389-40b4-abce-e242f3118359 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:03.208080 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0062960c-e389-40b4-abce-e242f3118359 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1516 microversion: 2.1 time: 0.156862 May 28 05:38:03.208660 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3642/7169] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:03 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:03.228062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f8364ca4-82ea-426d-9762-741ad48f135d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:38:03.228618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f8364ca4-82ea-426d-9762-741ad48f135d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:03.235596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8364ca4-82ea-426d-9762-741ad48f135d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:03.236064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8364ca4-82ea-426d-9762-741ad48f135d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:03.236849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8364ca4-82ea-426d-9762-741ad48f135d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:03.237300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8364ca4-82ea-426d-9762-741ad48f135d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:03.412625 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f8364ca4-82ea-426d-9762-741ad48f135d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "POST /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41/action" status: 204 len: 0 microversion: 2.1 time: 0.188793 May 28 05:38:03.413284 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3528/7170] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:38:03 2022] POST /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41/action => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:38:03.421937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-07d24504-3632-4db2-8a21-9f3200aa1a68 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:03.422553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-07d24504-3632-4db2-8a21-9f3200aa1a68 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:03.428800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07d24504-3632-4db2-8a21-9f3200aa1a68 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:03.431594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07d24504-3632-4db2-8a21-9f3200aa1a68 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:03.431594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07d24504-3632-4db2-8a21-9f3200aa1a68 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:03.431594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07d24504-3632-4db2-8a21-9f3200aa1a68 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:03.570822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-07d24504-3632-4db2-8a21-9f3200aa1a68 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:03.578504 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-07d24504-3632-4db2-8a21-9f3200aa1a68 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1516 microversion: 2.1 time: 0.160424 May 28 05:38:03.579134 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3643/7171] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:03 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:04.597542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-61568d57-b416-4b2d-95c3-aed649da9ec5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:04.598385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-61568d57-b416-4b2d-95c3-aed649da9ec5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:04.605701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-61568d57-b416-4b2d-95c3-aed649da9ec5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:04.606266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-61568d57-b416-4b2d-95c3-aed649da9ec5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:04.607173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-61568d57-b416-4b2d-95c3-aed649da9ec5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:04.607902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-61568d57-b416-4b2d-95c3-aed649da9ec5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:04.753360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-61568d57-b416-4b2d-95c3-aed649da9ec5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:04.761151 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-61568d57-b416-4b2d-95c3-aed649da9ec5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1516 microversion: 2.1 time: 0.168802 May 28 05:38:04.761747 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3529/7172] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:04 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:05.778019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2f44f5ab-8123-4d57-b36f-831c6f9e4668 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:05.778649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2f44f5ab-8123-4d57-b36f-831c6f9e4668 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:05.781415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=30 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:38:05.786105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f44f5ab-8123-4d57-b36f-831c6f9e4668 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:05.786557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f44f5ab-8123-4d57-b36f-831c6f9e4668 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:05.787346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f44f5ab-8123-4d57-b36f-831c6f9e4668 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:05.787782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f44f5ab-8123-4d57-b36f-831c6f9e4668 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:05.918538 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2f44f5ab-8123-4d57-b36f-831c6f9e4668 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:05.926616 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2f44f5ab-8123-4d57-b36f-831c6f9e4668 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1508 microversion: 2.1 time: 0.152396 May 28 05:38:05.927241 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3644/7173] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:05 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:05.943280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e3763304-6c6a-4a36-a42b-bdbdf612dcbe tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:05.946677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e3763304-6c6a-4a36-a42b-bdbdf612dcbe tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:05.951573 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3763304-6c6a-4a36-a42b-bdbdf612dcbe tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:05.952048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3763304-6c6a-4a36-a42b-bdbdf612dcbe tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:05.952890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3763304-6c6a-4a36-a42b-bdbdf612dcbe tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:05.953349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e3763304-6c6a-4a36-a42b-bdbdf612dcbe tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:06.084108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e3763304-6c6a-4a36-a42b-bdbdf612dcbe tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:06.091740 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e3763304-6c6a-4a36-a42b-bdbdf612dcbe tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1508 microversion: 2.1 time: 0.152382 May 28 05:38:06.092321 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3530/7174] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:05 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:06.107971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-267bb388-50f0-47de-908a-81da7bb99d62 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:06.108583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-267bb388-50f0-47de-908a-81da7bb99d62 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:06.114818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-267bb388-50f0-47de-908a-81da7bb99d62 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:06.115302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-267bb388-50f0-47de-908a-81da7bb99d62 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:06.116076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-267bb388-50f0-47de-908a-81da7bb99d62 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:06.116514 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-267bb388-50f0-47de-908a-81da7bb99d62 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:06.246152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-267bb388-50f0-47de-908a-81da7bb99d62 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:06.253981 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-267bb388-50f0-47de-908a-81da7bb99d62 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 200 len: 1508 microversion: 2.1 time: 0.149771 May 28 05:38:06.254577 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3645/7175] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:06 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:38:06.270588 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1e15df3a-0e1e-419f-9cfe-d3edd925654f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:06.271141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1e15df3a-0e1e-419f-9cfe-d3edd925654f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:06.277489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e15df3a-0e1e-419f-9cfe-d3edd925654f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:06.277968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e15df3a-0e1e-419f-9cfe-d3edd925654f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:06.278760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e15df3a-0e1e-419f-9cfe-d3edd925654f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:06.279250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1e15df3a-0e1e-419f-9cfe-d3edd925654f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:06.305984 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1e15df3a-0e1e-419f-9cfe-d3edd925654f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:38:06.320451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-05b8f4e5-dd48-4310-9bfa-98f4b761208e req-de7c4d0b-dbf2-4139-807f-801240cf5b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5c1936-badd-44aa-af3f-e8b8ee1e9b41", "name": "network-vif-plugged", "status": "completed", "tag": "22126308-41f0-4a96-b135-d0995a031956"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:38:06.328868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-05b8f4e5-dd48-4310-9bfa-98f4b761208e req-de7c4d0b-dbf2-4139-807f-801240cf5b8c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:06.329314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-05b8f4e5-dd48-4310-9bfa-98f4b761208e req-de7c4d0b-dbf2-4139-807f-801240cf5b8c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:06.341663 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-05b8f4e5-dd48-4310-9bfa-98f4b761208e req-de7c4d0b-dbf2-4139-807f-801240cf5b8c service nova] Creating event network-vif-plugged:22126308-41f0-4a96-b135-d0995a031956 for instance ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 on n-h2-843700-1 May 28 05:38:06.347068 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-05b8f4e5-dd48-4310-9bfa-98f4b761208e req-de7c4d0b-dbf2-4139-807f-801240cf5b8c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030279 May 28 05:38:06.347677 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3646/7176] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:38:06.556417 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1e15df3a-0e1e-419f-9cfe-d3edd925654f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 204 len: 0 microversion: 2.1 time: 0.289780 May 28 05:38:06.559578 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3531/7177] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:38:06 2022] DELETE /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:38:06.614749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a17505d3-8963-4cf4-9a76-a5477ceaadfc tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-889479219", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "8d1b1588-a717-4dff-b1ec-4161131e2139"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:38:06.664503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-a17505d3-8963-4cf4-9a76-a5477ceaadfc tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] validate_networks() for [('8d1b1588-a717-4dff-b1ec-4161131e2139', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:38:07.017520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a17505d3-8963-4cf4-9a76-a5477ceaadfc tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:38:07.018091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a17505d3-8963-4cf4-9a76-a5477ceaadfc tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:38:07.018420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a17505d3-8963-4cf4-9a76-a5477ceaadfc tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:38:07.018834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a17505d3-8963-4cf4-9a76-a5477ceaadfc tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:38:07.019284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a17505d3-8963-4cf4-9a76-a5477ceaadfc tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:38:07.028816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a17505d3-8963-4cf4-9a76-a5477ceaadfc tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:07.034425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a17505d3-8963-4cf4-9a76-a5477ceaadfc tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:07.034425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a17505d3-8963-4cf4-9a76-a5477ceaadfc tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:07.034425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a17505d3-8963-4cf4-9a76-a5477ceaadfc tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:07.047170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-a17505d3-8963-4cf4-9a76-a5477ceaadfc tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Getting quotas for project 8f172449ec264570925e6ce663f39f48. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:38:07.052526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-a17505d3-8963-4cf4-9a76-a5477ceaadfc tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Getting quotas for user 24ab05980f96488b94964987b64d41a7 and project 8f172449ec264570925e6ce663f39f48. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:38:07.064773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a17505d3-8963-4cf4-9a76-a5477ceaadfc tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:38:07.067132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a17505d3-8963-4cf4-9a76-a5477ceaadfc tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:38:07.174887 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a17505d3-8963-4cf4-9a76-a5477ceaadfc tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564425 May 28 05:38:07.175606 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3647/7178] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:38:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:38:07.186346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c327611c-bdab-43e9-b51b-7461394de848 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:07.189944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c327611c-bdab-43e9-b51b-7461394de848 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:07.244200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c327611c-bdab-43e9-b51b-7461394de848 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:07.252525 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c327611c-bdab-43e9-b51b-7461394de848 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1217 microversion: 2.1 time: 0.070672 May 28 05:38:07.253228 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3532/7179] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:07 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:08.271699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-521d0f2e-31ed-4a58-8b03-77b56cdcaa6b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:08.272250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-521d0f2e-31ed-4a58-8b03-77b56cdcaa6b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:08.280314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-521d0f2e-31ed-4a58-8b03-77b56cdcaa6b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:08.280774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-521d0f2e-31ed-4a58-8b03-77b56cdcaa6b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:08.281552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-521d0f2e-31ed-4a58-8b03-77b56cdcaa6b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:08.281998 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-521d0f2e-31ed-4a58-8b03-77b56cdcaa6b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:08.395052 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-521d0f2e-31ed-4a58-8b03-77b56cdcaa6b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:08.404067 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-521d0f2e-31ed-4a58-8b03-77b56cdcaa6b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1213 microversion: 2.1 time: 0.137739 May 28 05:38:08.404860 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3648/7180] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:08 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1213 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:08.439189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-d8a69d08-bde8-41a4-9597-7e26dc899fc5 req-7cb8d632-7269-4a60-8cd4-17290b3c2a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5c1936-badd-44aa-af3f-e8b8ee1e9b41", "name": "network-vif-deleted", "tag": "22126308-41f0-4a96-b135-d0995a031956"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:38:08.448496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d8a69d08-bde8-41a4-9597-7e26dc899fc5 req-7cb8d632-7269-4a60-8cd4-17290b3c2a7c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:08.448956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d8a69d08-bde8-41a4-9597-7e26dc899fc5 req-7cb8d632-7269-4a60-8cd4-17290b3c2a7c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:08.459650 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-d8a69d08-bde8-41a4-9597-7e26dc899fc5 req-7cb8d632-7269-4a60-8cd4-17290b3c2a7c service nova] Creating event network-vif-deleted:22126308-41f0-4a96-b135-d0995a031956 for instance ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 on n-h2-843700-1 May 28 05:38:08.465475 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-d8a69d08-bde8-41a4-9597-7e26dc899fc5 req-7cb8d632-7269-4a60-8cd4-17290b3c2a7c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029960 May 28 05:38:08.466350 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3533/7181] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:38:09.421767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8bb2431b-173b-4a17-80b7-f9298048988c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:09.422708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8bb2431b-173b-4a17-80b7-f9298048988c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:09.431159 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8bb2431b-173b-4a17-80b7-f9298048988c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:09.431709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8bb2431b-173b-4a17-80b7-f9298048988c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:09.432491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8bb2431b-173b-4a17-80b7-f9298048988c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:09.433068 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8bb2431b-173b-4a17-80b7-f9298048988c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:09.509079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8bb2431b-173b-4a17-80b7-f9298048988c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:09.516807 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8bb2431b-173b-4a17-80b7-f9298048988c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1287 microversion: 2.1 time: 0.098976 May 28 05:38:09.521539 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3649/7182] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:09 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:10.535768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1a0c38cc-5763-4888-943f-383b095383da tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:10.536483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1a0c38cc-5763-4888-943f-383b095383da tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:10.543645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a0c38cc-5763-4888-943f-383b095383da tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:10.544111 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a0c38cc-5763-4888-943f-383b095383da tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:10.544891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a0c38cc-5763-4888-943f-383b095383da tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:10.545340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1a0c38cc-5763-4888-943f-383b095383da tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:10.736533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1a0c38cc-5763-4888-943f-383b095383da tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:10.748191 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1a0c38cc-5763-4888-943f-383b095383da tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1317 microversion: 2.1 time: 0.218048 May 28 05:38:10.748777 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3534/7183] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:10 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:10.879864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-7df98a66-c367-41cc-9e15-37aeac884443 req-1c1a5c1f-0173-4fb9-9cc6-ebb7db166f33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f7564cd-9eb1-466d-b14b-89e4ead407f3", "tag": "4ed9f2cc-c9b0-433b-914f-f2f93731f97f"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:38:10.889631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-7df98a66-c367-41cc-9e15-37aeac884443 req-1c1a5c1f-0173-4fb9-9cc6-ebb7db166f33 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:10.890097 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-7df98a66-c367-41cc-9e15-37aeac884443 req-1c1a5c1f-0173-4fb9-9cc6-ebb7db166f33 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:10.902175 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-7df98a66-c367-41cc-9e15-37aeac884443 req-1c1a5c1f-0173-4fb9-9cc6-ebb7db166f33 service nova] Creating event network-changed:4ed9f2cc-c9b0-433b-914f-f2f93731f97f for instance 0f7564cd-9eb1-466d-b14b-89e4ead407f3 on n-h2-843700-1 May 28 05:38:10.913106 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-7df98a66-c367-41cc-9e15-37aeac884443 req-1c1a5c1f-0173-4fb9-9cc6-ebb7db166f33 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036950 May 28 05:38:10.913725 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3650/7184] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:38:11.765426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7398143c-a9fd-4465-a723-ac79e1eba557 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:11.766226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7398143c-a9fd-4465-a723-ac79e1eba557 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:11.773217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7398143c-a9fd-4465-a723-ac79e1eba557 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:11.774186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7398143c-a9fd-4465-a723-ac79e1eba557 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:11.774974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7398143c-a9fd-4465-a723-ac79e1eba557 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:11.775481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7398143c-a9fd-4465-a723-ac79e1eba557 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:11.977681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7398143c-a9fd-4465-a723-ac79e1eba557 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:11.983762 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7398143c-a9fd-4465-a723-ac79e1eba557 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1317 microversion: 2.1 time: 0.222326 May 28 05:38:11.984339 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3535/7185] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:11 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:13.002047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-66ba8b92-c5c9-4d95-a225-07e6bcbbcf62 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:13.002759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-66ba8b92-c5c9-4d95-a225-07e6bcbbcf62 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:13.009173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66ba8b92-c5c9-4d95-a225-07e6bcbbcf62 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:13.009635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66ba8b92-c5c9-4d95-a225-07e6bcbbcf62 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:13.010398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66ba8b92-c5c9-4d95-a225-07e6bcbbcf62 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:13.010846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-66ba8b92-c5c9-4d95-a225-07e6bcbbcf62 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:13.139600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-66ba8b92-c5c9-4d95-a225-07e6bcbbcf62 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:13.147433 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-66ba8b92-c5c9-4d95-a225-07e6bcbbcf62 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1317 microversion: 2.1 time: 0.150476 May 28 05:38:13.148013 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3651/7186] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:12 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:14.165108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a1c4bb23-936e-435f-acf6-e43f5959e464 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:14.165759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a1c4bb23-936e-435f-acf6-e43f5959e464 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:14.172908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1c4bb23-936e-435f-acf6-e43f5959e464 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:14.173377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1c4bb23-936e-435f-acf6-e43f5959e464 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:14.174161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1c4bb23-936e-435f-acf6-e43f5959e464 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:14.174665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1c4bb23-936e-435f-acf6-e43f5959e464 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:14.309557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a1c4bb23-936e-435f-acf6-e43f5959e464 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:14.317069 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a1c4bb23-936e-435f-acf6-e43f5959e464 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1317 microversion: 2.1 time: 0.156775 May 28 05:38:14.317650 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3536/7187] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:14 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:15.333938 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-899da6c3-3061-4ea1-bda1-117372ea6bf9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:15.334587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-899da6c3-3061-4ea1-bda1-117372ea6bf9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:15.341617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-899da6c3-3061-4ea1-bda1-117372ea6bf9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:15.342075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-899da6c3-3061-4ea1-bda1-117372ea6bf9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:15.342851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-899da6c3-3061-4ea1-bda1-117372ea6bf9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:15.343332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-899da6c3-3061-4ea1-bda1-117372ea6bf9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:15.471836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-899da6c3-3061-4ea1-bda1-117372ea6bf9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:15.480046 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-899da6c3-3061-4ea1-bda1-117372ea6bf9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1317 microversion: 2.1 time: 0.150018 May 28 05:38:15.480634 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3652/7188] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:15 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:16.497427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ff2e90f6-6421-4565-9320-0627e0638b6c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:16.498061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ff2e90f6-6421-4565-9320-0627e0638b6c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:16.505095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff2e90f6-6421-4565-9320-0627e0638b6c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:16.505568 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff2e90f6-6421-4565-9320-0627e0638b6c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:16.506347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff2e90f6-6421-4565-9320-0627e0638b6c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:16.506799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff2e90f6-6421-4565-9320-0627e0638b6c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:16.637421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ff2e90f6-6421-4565-9320-0627e0638b6c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:16.645579 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ff2e90f6-6421-4565-9320-0627e0638b6c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1317 microversion: 2.1 time: 0.152070 May 28 05:38:16.651944 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3537/7189] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:16 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:17.662534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b4e4ff0f-e095-46d1-a2c8-40e44450566b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:17.663146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b4e4ff0f-e095-46d1-a2c8-40e44450566b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:17.665946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:38:17.666629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:38:17.671496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4e4ff0f-e095-46d1-a2c8-40e44450566b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:17.671952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4e4ff0f-e095-46d1-a2c8-40e44450566b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:17.672721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4e4ff0f-e095-46d1-a2c8-40e44450566b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:17.673166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4e4ff0f-e095-46d1-a2c8-40e44450566b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:17.807147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b4e4ff0f-e095-46d1-a2c8-40e44450566b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:17.814659 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b4e4ff0f-e095-46d1-a2c8-40e44450566b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1317 microversion: 2.1 time: 0.156102 May 28 05:38:17.815315 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3653/7190] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:17 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:18.323719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-f7c3689e-cc7c-4a32-b508-826ce44adfe6 req-0e250e18-956c-417a-9e76-aae31ba46d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f7564cd-9eb1-466d-b14b-89e4ead407f3", "name": "network-vif-plugged", "status": "completed", "tag": "4ed9f2cc-c9b0-433b-914f-f2f93731f97f"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:38:18.327341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:38:18.333482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f7c3689e-cc7c-4a32-b508-826ce44adfe6 req-0e250e18-956c-417a-9e76-aae31ba46d3c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:18.333959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f7c3689e-cc7c-4a32-b508-826ce44adfe6 req-0e250e18-956c-417a-9e76-aae31ba46d3c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:18.345601 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-f7c3689e-cc7c-4a32-b508-826ce44adfe6 req-0e250e18-956c-417a-9e76-aae31ba46d3c service nova] Creating event network-vif-plugged:4ed9f2cc-c9b0-433b-914f-f2f93731f97f for instance 0f7564cd-9eb1-466d-b14b-89e4ead407f3 on n-h2-843700-1 May 28 05:38:18.350653 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-f7c3689e-cc7c-4a32-b508-826ce44adfe6 req-0e250e18-956c-417a-9e76-aae31ba46d3c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031201 May 28 05:38:18.351342 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3538/7191] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:38:18.832331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-88077753-5608-4ae9-bc71-6afcf67c8c09 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:18.832979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-88077753-5608-4ae9-bc71-6afcf67c8c09 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:18.840123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-88077753-5608-4ae9-bc71-6afcf67c8c09 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:18.840583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-88077753-5608-4ae9-bc71-6afcf67c8c09 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:18.841347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-88077753-5608-4ae9-bc71-6afcf67c8c09 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:18.841789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-88077753-5608-4ae9-bc71-6afcf67c8c09 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:18.974637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-88077753-5608-4ae9-bc71-6afcf67c8c09 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:18.982713 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-88077753-5608-4ae9-bc71-6afcf67c8c09 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1317 microversion: 2.1 time: 0.154294 May 28 05:38:18.983331 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3654/7192] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:18 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:20.001044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8f448628-94aa-4f90-bf28-33fdc319adc5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:20.001769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8f448628-94aa-4f90-bf28-33fdc319adc5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:20.009245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f448628-94aa-4f90-bf28-33fdc319adc5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:20.009717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f448628-94aa-4f90-bf28-33fdc319adc5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:20.010499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f448628-94aa-4f90-bf28-33fdc319adc5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:20.010961 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f448628-94aa-4f90-bf28-33fdc319adc5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:20.141921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8f448628-94aa-4f90-bf28-33fdc319adc5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:20.149621 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8f448628-94aa-4f90-bf28-33fdc319adc5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1508 microversion: 2.1 time: 0.153727 May 28 05:38:20.150205 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3539/7193] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:19 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:20.165855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8a4f6e90-f0e9-43fe-8619-b046aa522ee9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:20.166484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8a4f6e90-f0e9-43fe-8619-b046aa522ee9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:20.173537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a4f6e90-f0e9-43fe-8619-b046aa522ee9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:20.173999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a4f6e90-f0e9-43fe-8619-b046aa522ee9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:20.174772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a4f6e90-f0e9-43fe-8619-b046aa522ee9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:20.175260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a4f6e90-f0e9-43fe-8619-b046aa522ee9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:20.305558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8a4f6e90-f0e9-43fe-8619-b046aa522ee9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:20.313074 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8a4f6e90-f0e9-43fe-8619-b046aa522ee9 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1508 microversion: 2.1 time: 0.151235 May 28 05:38:20.313654 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3655/7194] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:20 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:20.329655 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d8fd3168-1b8f-4ff6-b59f-114385cc9711 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:38:20.330668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d8fd3168-1b8f-4ff6-b59f-114385cc9711 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:20.336793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8fd3168-1b8f-4ff6-b59f-114385cc9711 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:20.337265 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8fd3168-1b8f-4ff6-b59f-114385cc9711 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:20.338052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8fd3168-1b8f-4ff6-b59f-114385cc9711 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:20.338507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d8fd3168-1b8f-4ff6-b59f-114385cc9711 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:20.365956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d8fd3168-1b8f-4ff6-b59f-114385cc9711 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:20.372273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d8fd3168-1b8f-4ff6-b59f-114385cc9711 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Old instance type m1.heat2, new instance type m1.heat {{(pid=126043) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 05:38:20.378430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-d8fd3168-1b8f-4ff6-b59f-114385cc9711 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:38:20.378873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-d8fd3168-1b8f-4ff6-b59f-114385cc9711 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:38:20.379396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-d8fd3168-1b8f-4ff6-b59f-114385cc9711 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:38:20.379827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-d8fd3168-1b8f-4ff6-b59f-114385cc9711 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:38:20.380258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-d8fd3168-1b8f-4ff6-b59f-114385cc9711 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:38:20.566165 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d8fd3168-1b8f-4ff6-b59f-114385cc9711 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "POST /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3/action" status: 202 len: 0 microversion: 2.1 time: 0.240358 May 28 05:38:20.566867 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3540/7195] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:38:20 2022] POST /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:38:20.575595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-30b58164-5e67-47b5-a91e-563afaf7a72a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:20.576314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-30b58164-5e67-47b5-a91e-563afaf7a72a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:20.582637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30b58164-5e67-47b5-a91e-563afaf7a72a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:20.583130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30b58164-5e67-47b5-a91e-563afaf7a72a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:20.583911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30b58164-5e67-47b5-a91e-563afaf7a72a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:20.584355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-30b58164-5e67-47b5-a91e-563afaf7a72a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:20.716823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-30b58164-5e67-47b5-a91e-563afaf7a72a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:20.724852 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-30b58164-5e67-47b5-a91e-563afaf7a72a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1515 microversion: 2.1 time: 0.153186 May 28 05:38:20.725502 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3656/7196] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:20 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:21.743229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a1091982-5b96-467f-9166-bfdd40aeb3af tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:21.743893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a1091982-5b96-467f-9166-bfdd40aeb3af tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:21.750018 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1091982-5b96-467f-9166-bfdd40aeb3af tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:21.750485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1091982-5b96-467f-9166-bfdd40aeb3af tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:21.751299 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1091982-5b96-467f-9166-bfdd40aeb3af tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:21.751749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a1091982-5b96-467f-9166-bfdd40aeb3af tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:21.884876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a1091982-5b96-467f-9166-bfdd40aeb3af tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:21.888636 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:38:21.893441 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a1091982-5b96-467f-9166-bfdd40aeb3af tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1515 microversion: 2.1 time: 0.155267 May 28 05:38:21.894020 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3541/7197] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:21 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:38:22.911779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-454f204a-369c-4f09-b9fc-f35cc4e197f4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:22.912400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-454f204a-369c-4f09-b9fc-f35cc4e197f4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:22.919711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-454f204a-369c-4f09-b9fc-f35cc4e197f4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:22.920169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-454f204a-369c-4f09-b9fc-f35cc4e197f4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:22.920935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-454f204a-369c-4f09-b9fc-f35cc4e197f4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:22.921377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-454f204a-369c-4f09-b9fc-f35cc4e197f4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:23.126968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-454f204a-369c-4f09-b9fc-f35cc4e197f4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:23.134771 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-454f204a-369c-4f09-b9fc-f35cc4e197f4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1515 microversion: 2.1 time: 0.226907 May 28 05:38:23.135393 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3657/7198] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:22 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1515 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:24.152878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5698c0bd-c48f-4c11-96ac-adbd2edcb47f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:24.153550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5698c0bd-c48f-4c11-96ac-adbd2edcb47f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:24.160876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5698c0bd-c48f-4c11-96ac-adbd2edcb47f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:24.161349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5698c0bd-c48f-4c11-96ac-adbd2edcb47f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:24.162136 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5698c0bd-c48f-4c11-96ac-adbd2edcb47f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:24.162595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5698c0bd-c48f-4c11-96ac-adbd2edcb47f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:24.295481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5698c0bd-c48f-4c11-96ac-adbd2edcb47f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:24.303093 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5698c0bd-c48f-4c11-96ac-adbd2edcb47f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.154564 May 28 05:38:24.303684 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3542/7199] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:24 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:25.321752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7fed3588-e743-43b9-8007-9c9e92a54b7e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:25.322368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7fed3588-e743-43b9-8007-9c9e92a54b7e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:25.328617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fed3588-e743-43b9-8007-9c9e92a54b7e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:25.329076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fed3588-e743-43b9-8007-9c9e92a54b7e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:25.329840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fed3588-e743-43b9-8007-9c9e92a54b7e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:25.330284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7fed3588-e743-43b9-8007-9c9e92a54b7e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:25.462464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7fed3588-e743-43b9-8007-9c9e92a54b7e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:25.470124 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7fed3588-e743-43b9-8007-9c9e92a54b7e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.153108 May 28 05:38:25.470695 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3658/7200] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:25 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:26.487046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a64d2a36-2c54-4bc6-8861-b235b63382be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:26.487675 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a64d2a36-2c54-4bc6-8861-b235b63382be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:26.494829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a64d2a36-2c54-4bc6-8861-b235b63382be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:26.495337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a64d2a36-2c54-4bc6-8861-b235b63382be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:26.496164 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a64d2a36-2c54-4bc6-8861-b235b63382be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:26.496619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a64d2a36-2c54-4bc6-8861-b235b63382be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:26.624197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a64d2a36-2c54-4bc6-8861-b235b63382be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:26.631963 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a64d2a36-2c54-4bc6-8861-b235b63382be tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.148779 May 28 05:38:26.632591 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3543/7201] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:26 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:27.649605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aaee2b4d-8f1c-45b9-8953-a0157f0c2770 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:27.650229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aaee2b4d-8f1c-45b9-8953-a0157f0c2770 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:27.657142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aaee2b4d-8f1c-45b9-8953-a0157f0c2770 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:27.657599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aaee2b4d-8f1c-45b9-8953-a0157f0c2770 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:27.658361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aaee2b4d-8f1c-45b9-8953-a0157f0c2770 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:27.658806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aaee2b4d-8f1c-45b9-8953-a0157f0c2770 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:27.673610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=100 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:38:27.790282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aaee2b4d-8f1c-45b9-8953-a0157f0c2770 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:27.797793 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aaee2b4d-8f1c-45b9-8953-a0157f0c2770 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.152102 May 28 05:38:27.798372 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3659/7202] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:27 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:28.815775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8cef6461-214f-4268-9561-aa43dcfa3534 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:28.816411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8cef6461-214f-4268-9561-aa43dcfa3534 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:28.823887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cef6461-214f-4268-9561-aa43dcfa3534 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:28.824360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cef6461-214f-4268-9561-aa43dcfa3534 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:28.825144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cef6461-214f-4268-9561-aa43dcfa3534 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:28.825602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cef6461-214f-4268-9561-aa43dcfa3534 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:28.953567 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8cef6461-214f-4268-9561-aa43dcfa3534 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:28.961162 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8cef6461-214f-4268-9561-aa43dcfa3534 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.149385 May 28 05:38:28.962364 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3544/7203] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:28 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:29.979542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ab3de552-fa2c-4e22-81fc-f5778cfc7a74 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:29.980089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ab3de552-fa2c-4e22-81fc-f5778cfc7a74 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:29.987137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab3de552-fa2c-4e22-81fc-f5778cfc7a74 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:29.987598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab3de552-fa2c-4e22-81fc-f5778cfc7a74 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:29.988372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab3de552-fa2c-4e22-81fc-f5778cfc7a74 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:29.988818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab3de552-fa2c-4e22-81fc-f5778cfc7a74 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:30.117227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ab3de552-fa2c-4e22-81fc-f5778cfc7a74 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:30.125358 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ab3de552-fa2c-4e22-81fc-f5778cfc7a74 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.150458 May 28 05:38:30.125947 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3660/7204] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:29 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:31.143112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e6747bb8-088c-4ddf-9f4a-9700a49755a0 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:31.143756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e6747bb8-088c-4ddf-9f4a-9700a49755a0 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:31.150811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6747bb8-088c-4ddf-9f4a-9700a49755a0 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:31.151326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6747bb8-088c-4ddf-9f4a-9700a49755a0 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:31.152124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6747bb8-088c-4ddf-9f4a-9700a49755a0 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:31.152583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e6747bb8-088c-4ddf-9f4a-9700a49755a0 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:31.285669 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e6747bb8-088c-4ddf-9f4a-9700a49755a0 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:31.294014 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e6747bb8-088c-4ddf-9f4a-9700a49755a0 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.155155 May 28 05:38:31.294600 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3545/7205] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:31 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:32.311713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aebc1f8c-6042-41fa-bd21-6fcd3c9e066b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:32.312328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aebc1f8c-6042-41fa-bd21-6fcd3c9e066b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:32.319231 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aebc1f8c-6042-41fa-bd21-6fcd3c9e066b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:32.319684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aebc1f8c-6042-41fa-bd21-6fcd3c9e066b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:32.320446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aebc1f8c-6042-41fa-bd21-6fcd3c9e066b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:32.321495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aebc1f8c-6042-41fa-bd21-6fcd3c9e066b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:32.451864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aebc1f8c-6042-41fa-bd21-6fcd3c9e066b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:32.459646 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aebc1f8c-6042-41fa-bd21-6fcd3c9e066b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.151784 May 28 05:38:32.460239 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3661/7206] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:32 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:33.476327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3da93d99-eb8d-41f9-af99-71ef9861763f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:33.476892 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3da93d99-eb8d-41f9-af99-71ef9861763f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:33.479624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:38:33.484444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3da93d99-eb8d-41f9-af99-71ef9861763f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:33.484914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3da93d99-eb8d-41f9-af99-71ef9861763f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:33.485698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3da93d99-eb8d-41f9-af99-71ef9861763f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:33.486154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3da93d99-eb8d-41f9-af99-71ef9861763f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:33.619466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3da93d99-eb8d-41f9-af99-71ef9861763f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:33.627103 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3da93d99-eb8d-41f9-af99-71ef9861763f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.154819 May 28 05:38:33.627687 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3546/7207] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:33 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:34.644891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-de50fa96-eccc-4e8f-80ca-91ec2c0f7ab3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:34.645538 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-de50fa96-eccc-4e8f-80ca-91ec2c0f7ab3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:34.653062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de50fa96-eccc-4e8f-80ca-91ec2c0f7ab3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:34.653515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de50fa96-eccc-4e8f-80ca-91ec2c0f7ab3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:34.654276 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de50fa96-eccc-4e8f-80ca-91ec2c0f7ab3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:34.654713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de50fa96-eccc-4e8f-80ca-91ec2c0f7ab3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:34.781024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-de50fa96-eccc-4e8f-80ca-91ec2c0f7ab3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:34.788579 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-de50fa96-eccc-4e8f-80ca-91ec2c0f7ab3 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.147549 May 28 05:38:34.789151 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3662/7208] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:34 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:35.807090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d4b04c21-a613-4780-9cca-c056be7ea33f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:35.807722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d4b04c21-a613-4780-9cca-c056be7ea33f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:35.814599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d4b04c21-a613-4780-9cca-c056be7ea33f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:35.815097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d4b04c21-a613-4780-9cca-c056be7ea33f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:35.815872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d4b04c21-a613-4780-9cca-c056be7ea33f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:35.816322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d4b04c21-a613-4780-9cca-c056be7ea33f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:35.943739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d4b04c21-a613-4780-9cca-c056be7ea33f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:35.951747 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d4b04c21-a613-4780-9cca-c056be7ea33f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.149132 May 28 05:38:35.952337 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3547/7209] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:35 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:36.968477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1e165160-3f96-4f5b-a8dc-804404363785 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:36.969104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1e165160-3f96-4f5b-a8dc-804404363785 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:36.971878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:38:36.976725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e165160-3f96-4f5b-a8dc-804404363785 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:36.977191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e165160-3f96-4f5b-a8dc-804404363785 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:36.977962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e165160-3f96-4f5b-a8dc-804404363785 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:36.978408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e165160-3f96-4f5b-a8dc-804404363785 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:37.113755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1e165160-3f96-4f5b-a8dc-804404363785 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:37.121650 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1e165160-3f96-4f5b-a8dc-804404363785 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.157154 May 28 05:38:37.122252 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3663/7210] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:36 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:38.138687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-acd5ea18-fe13-4871-9c33-87f626cec017 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:38.139348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-acd5ea18-fe13-4871-9c33-87f626cec017 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:38.146541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-acd5ea18-fe13-4871-9c33-87f626cec017 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:38.147012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-acd5ea18-fe13-4871-9c33-87f626cec017 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:38.147804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-acd5ea18-fe13-4871-9c33-87f626cec017 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:38.148256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-acd5ea18-fe13-4871-9c33-87f626cec017 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:38.280700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-acd5ea18-fe13-4871-9c33-87f626cec017 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:38.288194 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-acd5ea18-fe13-4871-9c33-87f626cec017 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.153383 May 28 05:38:38.288784 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3548/7211] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:38 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:39.305666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aaf544d5-61ea-40cf-90e8-84ce356e3151 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:39.306295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aaf544d5-61ea-40cf-90e8-84ce356e3151 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:39.313461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aaf544d5-61ea-40cf-90e8-84ce356e3151 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:39.313923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aaf544d5-61ea-40cf-90e8-84ce356e3151 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:39.314693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aaf544d5-61ea-40cf-90e8-84ce356e3151 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:39.315174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aaf544d5-61ea-40cf-90e8-84ce356e3151 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:39.444558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aaf544d5-61ea-40cf-90e8-84ce356e3151 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:39.452068 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aaf544d5-61ea-40cf-90e8-84ce356e3151 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.150977 May 28 05:38:39.452654 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3664/7212] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:39 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:40.469773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0aa98e23-29d2-41a9-953f-cd3d3f0ea49e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:40.470398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0aa98e23-29d2-41a9-953f-cd3d3f0ea49e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:40.477386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0aa98e23-29d2-41a9-953f-cd3d3f0ea49e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:40.477856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0aa98e23-29d2-41a9-953f-cd3d3f0ea49e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:40.478641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0aa98e23-29d2-41a9-953f-cd3d3f0ea49e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:40.479129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0aa98e23-29d2-41a9-953f-cd3d3f0ea49e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:40.606499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0aa98e23-29d2-41a9-953f-cd3d3f0ea49e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:40.614087 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0aa98e23-29d2-41a9-953f-cd3d3f0ea49e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.148406 May 28 05:38:40.614665 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3549/7213] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:40 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:41.632605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-62c395b3-f9ea-438c-a8b8-c97bf347425e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:41.633813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-62c395b3-f9ea-438c-a8b8-c97bf347425e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:41.641124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-62c395b3-f9ea-438c-a8b8-c97bf347425e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:41.641584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-62c395b3-f9ea-438c-a8b8-c97bf347425e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:41.642365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-62c395b3-f9ea-438c-a8b8-c97bf347425e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:41.642844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-62c395b3-f9ea-438c-a8b8-c97bf347425e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:41.776178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-62c395b3-f9ea-438c-a8b8-c97bf347425e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:41.784352 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-62c395b3-f9ea-438c-a8b8-c97bf347425e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.155999 May 28 05:38:41.784931 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3665/7214] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:41 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:42.801569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bf0e46db-9a35-45fe-83af-70f1999daa0c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:42.802210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bf0e46db-9a35-45fe-83af-70f1999daa0c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:42.809433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf0e46db-9a35-45fe-83af-70f1999daa0c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:42.809906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf0e46db-9a35-45fe-83af-70f1999daa0c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:42.810696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf0e46db-9a35-45fe-83af-70f1999daa0c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:42.811191 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf0e46db-9a35-45fe-83af-70f1999daa0c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:42.939840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bf0e46db-9a35-45fe-83af-70f1999daa0c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:42.947824 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bf0e46db-9a35-45fe-83af-70f1999daa0c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.150183 May 28 05:38:42.948407 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3550/7215] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:42 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:43.965337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-360cb555-1076-4130-8cb8-bd5607e4780a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:43.965966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-360cb555-1076-4130-8cb8-bd5607e4780a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:43.972910 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-360cb555-1076-4130-8cb8-bd5607e4780a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:43.973374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-360cb555-1076-4130-8cb8-bd5607e4780a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:43.974142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-360cb555-1076-4130-8cb8-bd5607e4780a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:43.974589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-360cb555-1076-4130-8cb8-bd5607e4780a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:44.104712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-360cb555-1076-4130-8cb8-bd5607e4780a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:44.112368 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-360cb555-1076-4130-8cb8-bd5607e4780a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.151443 May 28 05:38:44.112951 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3666/7216] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:43 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:45.137207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b468fe67-b96a-4b3c-ab7f-2bb96ebcb83f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:45.137836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b468fe67-b96a-4b3c-ab7f-2bb96ebcb83f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:45.144983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b468fe67-b96a-4b3c-ab7f-2bb96ebcb83f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:45.145463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b468fe67-b96a-4b3c-ab7f-2bb96ebcb83f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:45.156864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b468fe67-b96a-4b3c-ab7f-2bb96ebcb83f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:45.156864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b468fe67-b96a-4b3c-ab7f-2bb96ebcb83f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:45.278910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b468fe67-b96a-4b3c-ab7f-2bb96ebcb83f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:45.286472 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b468fe67-b96a-4b3c-ab7f-2bb96ebcb83f tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.153276 May 28 05:38:45.287079 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3551/7217] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:45 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:46.303406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-65c5134c-0eab-45ec-830d-ead96d594d4c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:46.304083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-65c5134c-0eab-45ec-830d-ead96d594d4c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:46.310949 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-65c5134c-0eab-45ec-830d-ead96d594d4c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:46.311446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-65c5134c-0eab-45ec-830d-ead96d594d4c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:46.312206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-65c5134c-0eab-45ec-830d-ead96d594d4c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:46.312647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-65c5134c-0eab-45ec-830d-ead96d594d4c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:46.438791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-65c5134c-0eab-45ec-830d-ead96d594d4c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:46.446540 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-65c5134c-0eab-45ec-830d-ead96d594d4c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.147116 May 28 05:38:46.447149 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3667/7218] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:46 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:47.463696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c05a5864-186a-4859-a4a9-08eb053e772a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:47.464288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c05a5864-186a-4859-a4a9-08eb053e772a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:47.471388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c05a5864-186a-4859-a4a9-08eb053e772a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:47.471860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c05a5864-186a-4859-a4a9-08eb053e772a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:47.472656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c05a5864-186a-4859-a4a9-08eb053e772a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:47.473119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c05a5864-186a-4859-a4a9-08eb053e772a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:47.604930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c05a5864-186a-4859-a4a9-08eb053e772a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:47.613371 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c05a5864-186a-4859-a4a9-08eb053e772a tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.153028 May 28 05:38:47.614141 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3552/7219] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:47 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:48.631241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3afa0fc0-f9d8-4792-8d59-f93d0a8f69d5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:48.631844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3afa0fc0-f9d8-4792-8d59-f93d0a8f69d5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:48.639563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3afa0fc0-f9d8-4792-8d59-f93d0a8f69d5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:48.640271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3afa0fc0-f9d8-4792-8d59-f93d0a8f69d5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:48.641044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3afa0fc0-f9d8-4792-8d59-f93d0a8f69d5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:48.641486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3afa0fc0-f9d8-4792-8d59-f93d0a8f69d5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:48.770851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3afa0fc0-f9d8-4792-8d59-f93d0a8f69d5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:48.779087 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3afa0fc0-f9d8-4792-8d59-f93d0a8f69d5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.151860 May 28 05:38:48.779672 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3668/7220] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:48 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:49.796312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-531df847-94a1-43ad-b379-3cc22f6babe4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:49.802227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-531df847-94a1-43ad-b379-3cc22f6babe4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:49.803994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-531df847-94a1-43ad-b379-3cc22f6babe4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:49.805116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-531df847-94a1-43ad-b379-3cc22f6babe4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:49.805888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-531df847-94a1-43ad-b379-3cc22f6babe4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:49.806346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-531df847-94a1-43ad-b379-3cc22f6babe4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:49.936635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-531df847-94a1-43ad-b379-3cc22f6babe4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:49.944412 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-531df847-94a1-43ad-b379-3cc22f6babe4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1520 microversion: 2.1 time: 0.152097 May 28 05:38:49.945667 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3553/7221] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:49 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:50.934105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-7c5e672a-3cc3-4551-9794-71a0631121d5 req-5fe1be93-9a1a-4a16-b54b-8c61e686e3f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f7564cd-9eb1-466d-b14b-89e4ead407f3", "name": "network-vif-unplugged", "status": "completed", "tag": "4ed9f2cc-c9b0-433b-914f-f2f93731f97f"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:38:50.943215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-7c5e672a-3cc3-4551-9794-71a0631121d5 req-5fe1be93-9a1a-4a16-b54b-8c61e686e3f0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:50.946199 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-7c5e672a-3cc3-4551-9794-71a0631121d5 req-5fe1be93-9a1a-4a16-b54b-8c61e686e3f0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:50.957993 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-7c5e672a-3cc3-4551-9794-71a0631121d5 req-5fe1be93-9a1a-4a16-b54b-8c61e686e3f0 service nova] Creating event network-vif-unplugged:4ed9f2cc-c9b0-433b-914f-f2f93731f97f for instance 0f7564cd-9eb1-466d-b14b-89e4ead407f3 on n-h1-843700-1 May 28 05:38:50.962237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-85455048-8133-48a0-9b38-837bfbdcf880 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:50.963221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-85455048-8133-48a0-9b38-837bfbdcf880 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:50.964896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-7c5e672a-3cc3-4551-9794-71a0631121d5 req-5fe1be93-9a1a-4a16-b54b-8c61e686e3f0 service nova] Instance 0f7564cd-9eb1-466d-b14b-89e4ead407f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:38:50.971108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85455048-8133-48a0-9b38-837bfbdcf880 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:50.971581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85455048-8133-48a0-9b38-837bfbdcf880 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:50.972378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85455048-8133-48a0-9b38-837bfbdcf880 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:50.972835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85455048-8133-48a0-9b38-837bfbdcf880 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:50.975871 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-7c5e672a-3cc3-4551-9794-71a0631121d5 req-5fe1be93-9a1a-4a16-b54b-8c61e686e3f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045557 May 28 05:38:50.979980 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3669/7222] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:38:51.201935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-85455048-8133-48a0-9b38-837bfbdcf880 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:51.210004 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-85455048-8133-48a0-9b38-837bfbdcf880 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1519 microversion: 2.1 time: 0.252168 May 28 05:38:51.211566 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3554/7223] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:50 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1519 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:38:52.233968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-63cee2e0-3a3a-44ae-9c0c-ace55dbd808d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:52.234737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-63cee2e0-3a3a-44ae-9c0c-ace55dbd808d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:52.241230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-63cee2e0-3a3a-44ae-9c0c-ace55dbd808d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:52.241691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-63cee2e0-3a3a-44ae-9c0c-ace55dbd808d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:52.242459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-63cee2e0-3a3a-44ae-9c0c-ace55dbd808d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:52.242901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-63cee2e0-3a3a-44ae-9c0c-ace55dbd808d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:52.372056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-63cee2e0-3a3a-44ae-9c0c-ace55dbd808d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:52.384276 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-63cee2e0-3a3a-44ae-9c0c-ace55dbd808d tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1517 microversion: 2.1 time: 0.150929 May 28 05:38:52.384276 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3670/7224] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:52 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:52.990734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-627890e7-6cc4-4561-8be1-45777cb5c761 req-04ca2e94-7f7b-4171-8b41-82c6c798c524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f7564cd-9eb1-466d-b14b-89e4ead407f3", "tag": "4ed9f2cc-c9b0-433b-914f-f2f93731f97f"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:38:53.000210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-627890e7-6cc4-4561-8be1-45777cb5c761 req-04ca2e94-7f7b-4171-8b41-82c6c798c524 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:53.000674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-627890e7-6cc4-4561-8be1-45777cb5c761 req-04ca2e94-7f7b-4171-8b41-82c6c798c524 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:53.012731 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-627890e7-6cc4-4561-8be1-45777cb5c761 req-04ca2e94-7f7b-4171-8b41-82c6c798c524 service nova] Creating event network-changed:4ed9f2cc-c9b0-433b-914f-f2f93731f97f for instance 0f7564cd-9eb1-466d-b14b-89e4ead407f3 on n-h1-843700-1 May 28 05:38:53.018281 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-627890e7-6cc4-4561-8be1-45777cb5c761 req-04ca2e94-7f7b-4171-8b41-82c6c798c524 service nova] Instance 0f7564cd-9eb1-466d-b14b-89e4ead407f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:38:53.028956 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-627890e7-6cc4-4561-8be1-45777cb5c761 req-04ca2e94-7f7b-4171-8b41-82c6c798c524 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041938 May 28 05:38:53.029555 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3555/7225] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:38:53.396954 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-db510117-9887-4c76-8edb-78dc24033d30 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:53.397796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-db510117-9887-4c76-8edb-78dc24033d30 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:53.405797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db510117-9887-4c76-8edb-78dc24033d30 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:53.406375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db510117-9887-4c76-8edb-78dc24033d30 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:53.407794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db510117-9887-4c76-8edb-78dc24033d30 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:53.408308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-db510117-9887-4c76-8edb-78dc24033d30 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:53.697761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-db510117-9887-4c76-8edb-78dc24033d30 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:53.705895 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-db510117-9887-4c76-8edb-78dc24033d30 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1517 microversion: 2.1 time: 0.312832 May 28 05:38:53.715973 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3671/7226] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:53 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1517 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:54.725130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2febdcb6-59fa-41b6-91d4-06a489a3155b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:54.725857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2febdcb6-59fa-41b6-91d4-06a489a3155b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:54.732851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2febdcb6-59fa-41b6-91d4-06a489a3155b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:54.733330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2febdcb6-59fa-41b6-91d4-06a489a3155b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:54.734114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2febdcb6-59fa-41b6-91d4-06a489a3155b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:54.734599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2febdcb6-59fa-41b6-91d4-06a489a3155b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:54.737308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=83 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:38:54.865146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2febdcb6-59fa-41b6-91d4-06a489a3155b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:54.872839 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2febdcb6-59fa-41b6-91d4-06a489a3155b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1514 microversion: 2.1 time: 0.152851 May 28 05:38:54.873423 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3556/7227] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:54 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:54.889698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3cd2d090-6167-4223-a21e-6e4d61b419e4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:38:54.890513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3cd2d090-6167-4223-a21e-6e4d61b419e4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:54.896931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3cd2d090-6167-4223-a21e-6e4d61b419e4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:54.897390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3cd2d090-6167-4223-a21e-6e4d61b419e4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:54.898758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3cd2d090-6167-4223-a21e-6e4d61b419e4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:54.899273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3cd2d090-6167-4223-a21e-6e4d61b419e4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:55.040320 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3cd2d090-6167-4223-a21e-6e4d61b419e4 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "POST /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3/action" status: 204 len: 0 microversion: 2.1 time: 0.154201 May 28 05:38:55.040907 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3672/7228] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:38:54 2022] POST /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3/action => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:38:55.049322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b9e34d8b-351f-46fe-b3ce-ca2cb478845b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:55.049990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b9e34d8b-351f-46fe-b3ce-ca2cb478845b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:55.056333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9e34d8b-351f-46fe-b3ce-ca2cb478845b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:55.056812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9e34d8b-351f-46fe-b3ce-ca2cb478845b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:55.057655 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9e34d8b-351f-46fe-b3ce-ca2cb478845b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:55.058156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b9e34d8b-351f-46fe-b3ce-ca2cb478845b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:55.265822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b9e34d8b-351f-46fe-b3ce-ca2cb478845b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:55.273665 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b9e34d8b-351f-46fe-b3ce-ca2cb478845b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1514 microversion: 2.1 time: 0.228375 May 28 05:38:55.274462 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3557/7229] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:55 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1514 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:56.291801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-436bb88e-1390-40ac-b822-5d5aede43b29 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:56.292518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-436bb88e-1390-40ac-b822-5d5aede43b29 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:56.298696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-436bb88e-1390-40ac-b822-5d5aede43b29 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:56.299297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-436bb88e-1390-40ac-b822-5d5aede43b29 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:56.300077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-436bb88e-1390-40ac-b822-5d5aede43b29 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:56.300527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-436bb88e-1390-40ac-b822-5d5aede43b29 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:56.430455 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-436bb88e-1390-40ac-b822-5d5aede43b29 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:56.437940 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-436bb88e-1390-40ac-b822-5d5aede43b29 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1514 microversion: 2.1 time: 0.151436 May 28 05:38:56.438513 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3673/7230] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:56 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:57.455306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b34673ae-6df3-45cf-81d3-3678437b0287 req-e33d0a0b-fd9a-4573-a274-8131ab9184bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f7564cd-9eb1-466d-b14b-89e4ead407f3", "name": "network-vif-plugged", "status": "completed", "tag": "4ed9f2cc-c9b0-433b-914f-f2f93731f97f"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:38:57.455857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9300ac64-cf3c-473d-aa53-40fdeca2f0e5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:57.456370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9300ac64-cf3c-473d-aa53-40fdeca2f0e5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:57.464597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9300ac64-cf3c-473d-aa53-40fdeca2f0e5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:57.465156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b34673ae-6df3-45cf-81d3-3678437b0287 req-e33d0a0b-fd9a-4573-a274-8131ab9184bb service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:57.465320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9300ac64-cf3c-473d-aa53-40fdeca2f0e5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:57.465626 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b34673ae-6df3-45cf-81d3-3678437b0287 req-e33d0a0b-fd9a-4573-a274-8131ab9184bb service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:57.466338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9300ac64-cf3c-473d-aa53-40fdeca2f0e5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:57.466925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9300ac64-cf3c-473d-aa53-40fdeca2f0e5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:57.477552 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b34673ae-6df3-45cf-81d3-3678437b0287 req-e33d0a0b-fd9a-4573-a274-8131ab9184bb service nova] Creating event network-vif-plugged:4ed9f2cc-c9b0-433b-914f-f2f93731f97f for instance 0f7564cd-9eb1-466d-b14b-89e4ead407f3 on n-h1-843700-1 May 28 05:38:57.482558 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b34673ae-6df3-45cf-81d3-3678437b0287 req-e33d0a0b-fd9a-4573-a274-8131ab9184bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031061 May 28 05:38:57.487910 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3558/7231] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:38:57.603114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9300ac64-cf3c-473d-aa53-40fdeca2f0e5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:57.610735 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9300ac64-cf3c-473d-aa53-40fdeca2f0e5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1506 microversion: 2.1 time: 0.159434 May 28 05:38:57.613970 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3674/7232] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:57 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:38:57.628458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-787b7f67-0d81-454c-893b-43877e6d371c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:57.629188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-787b7f67-0d81-454c-893b-43877e6d371c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:57.636048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-787b7f67-0d81-454c-893b-43877e6d371c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:57.636525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-787b7f67-0d81-454c-893b-43877e6d371c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:57.637306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-787b7f67-0d81-454c-893b-43877e6d371c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:57.637763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-787b7f67-0d81-454c-893b-43877e6d371c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:57.766187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-787b7f67-0d81-454c-893b-43877e6d371c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:57.773817 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-787b7f67-0d81-454c-893b-43877e6d371c tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1506 microversion: 2.1 time: 0.149877 May 28 05:38:57.774395 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3559/7233] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:57 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:57.790431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-090cfb14-3626-48aa-95c4-2765fa4fe46e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:57.790975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-090cfb14-3626-48aa-95c4-2765fa4fe46e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:57.797235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-090cfb14-3626-48aa-95c4-2765fa4fe46e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:57.797694 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-090cfb14-3626-48aa-95c4-2765fa4fe46e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:57.798499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-090cfb14-3626-48aa-95c4-2765fa4fe46e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:57.798944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-090cfb14-3626-48aa-95c4-2765fa4fe46e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:57.803089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:38:57.928257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-090cfb14-3626-48aa-95c4-2765fa4fe46e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:57.936514 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-090cfb14-3626-48aa-95c4-2765fa4fe46e tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1506 microversion: 2.1 time: 0.150124 May 28 05:38:57.937095 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3675/7234] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:57 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:57.952988 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9880e9e0-0d84-4349-8c61-a6d03acad11b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:57.953511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9880e9e0-0d84-4349-8c61-a6d03acad11b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:57.959707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9880e9e0-0d84-4349-8c61-a6d03acad11b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:57.960189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9880e9e0-0d84-4349-8c61-a6d03acad11b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:57.960976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9880e9e0-0d84-4349-8c61-a6d03acad11b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:57.961438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9880e9e0-0d84-4349-8c61-a6d03acad11b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:57.986045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9880e9e0-0d84-4349-8c61-a6d03acad11b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:38:58.235376 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9880e9e0-0d84-4349-8c61-a6d03acad11b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 204 len: 0 microversion: 2.1 time: 0.286082 May 28 05:38:58.235985 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3560/7235] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:38:57 2022] DELETE /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:38:58.252775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2bad7d94-e8a0-4427-88b7-5dd8d9721fc6 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:58.253286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2bad7d94-e8a0-4427-88b7-5dd8d9721fc6 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:58.259488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bad7d94-e8a0-4427-88b7-5dd8d9721fc6 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:58.259952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bad7d94-e8a0-4427-88b7-5dd8d9721fc6 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:58.260792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bad7d94-e8a0-4427-88b7-5dd8d9721fc6 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:58.261236 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bad7d94-e8a0-4427-88b7-5dd8d9721fc6 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:58.289628 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2bad7d94-e8a0-4427-88b7-5dd8d9721fc6 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:38:58.333308 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.compute.api [None req-2bad7d94-e8a0-4427-88b7-5dd8d9721fc6 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Instance is already in deleting state, ignoring this request May 28 05:38:58.334137 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2bad7d94-e8a0-4427-88b7-5dd8d9721fc6 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 204 len: 0 microversion: 2.1 time: 0.085353 May 28 05:38:58.334716 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3676/7236] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:38:58 2022] DELETE /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:38:58.344037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eb590e3f-9cd6-4db8-87bf-4a4cd3610ca5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:58.344800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eb590e3f-9cd6-4db8-87bf-4a4cd3610ca5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:58.350819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb590e3f-9cd6-4db8-87bf-4a4cd3610ca5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:58.351891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb590e3f-9cd6-4db8-87bf-4a4cd3610ca5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:58.352709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb590e3f-9cd6-4db8-87bf-4a4cd3610ca5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:58.353170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb590e3f-9cd6-4db8-87bf-4a4cd3610ca5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:58.489019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eb590e3f-9cd6-4db8-87bf-4a4cd3610ca5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:58.496883 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eb590e3f-9cd6-4db8-87bf-4a4cd3610ca5 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1512 microversion: 2.1 time: 0.157123 May 28 05:38:58.497565 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3561/7237] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:58 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:38:59.513758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a4bc4ca1-a806-47ab-a3d3-e3dbefe9899b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:38:59.514388 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a4bc4ca1-a806-47ab-a3d3-e3dbefe9899b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:38:59.521571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4bc4ca1-a806-47ab-a3d3-e3dbefe9899b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:59.522024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4bc4ca1-a806-47ab-a3d3-e3dbefe9899b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:59.522793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4bc4ca1-a806-47ab-a3d3-e3dbefe9899b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:38:59.523263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4bc4ca1-a806-47ab-a3d3-e3dbefe9899b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:38:59.741587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a4bc4ca1-a806-47ab-a3d3-e3dbefe9899b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ab05980f96488b94964987b64d41a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f172449ec264570925e6ce663f39f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:38:59.749284 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a4bc4ca1-a806-47ab-a3d3-e3dbefe9899b tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 200 len: 1512 microversion: 2.1 time: 0.239318 May 28 05:38:59.749808 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3677/7238] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:38:59 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 1512 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:00.151386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-6d9d9816-5a28-40c3-88e9-2d320a68ba60 req-bbd71629-c978-470a-af4d-2f09d79dbec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f7564cd-9eb1-466d-b14b-89e4ead407f3", "name": "network-vif-deleted", "tag": "4ed9f2cc-c9b0-433b-914f-f2f93731f97f"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:39:00.160370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-6d9d9816-5a28-40c3-88e9-2d320a68ba60 req-bbd71629-c978-470a-af4d-2f09d79dbec6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:00.162221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-6d9d9816-5a28-40c3-88e9-2d320a68ba60 req-bbd71629-c978-470a-af4d-2f09d79dbec6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:00.172546 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-6d9d9816-5a28-40c3-88e9-2d320a68ba60 req-bbd71629-c978-470a-af4d-2f09d79dbec6 service nova] Creating event network-vif-deleted:4ed9f2cc-c9b0-433b-914f-f2f93731f97f for instance 0f7564cd-9eb1-466d-b14b-89e4ead407f3 on n-h1-843700-1 May 28 05:39:00.177341 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-6d9d9816-5a28-40c3-88e9-2d320a68ba60 req-bbd71629-c978-470a-af4d-2f09d79dbec6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030380 May 28 05:39:00.182198 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3562/7239] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:39:00.766402 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4a698280-728c-486b-9d8c-85238acf6afd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:00.767049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4a698280-728c-486b-9d8c-85238acf6afd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: 0f7564cd-9eb1-466d-b14b-89e4ead407f3] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:00.774045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a698280-728c-486b-9d8c-85238acf6afd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:00.774502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a698280-728c-486b-9d8c-85238acf6afd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:00.775295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a698280-728c-486b-9d8c-85238acf6afd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:00.775891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a698280-728c-486b-9d8c-85238acf6afd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:00.789683 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-4a698280-728c-486b-9d8c-85238acf6afd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] HTTP exception thrown: Instance 0f7564cd-9eb1-466d-b14b-89e4ead407f3 could not be found. May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4a698280-728c-486b-9d8c-85238acf6afd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Request method failure captured: May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 HTTP/1.1 May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbUJo-l4yjxhAnMlmOrjZUwUwcfR3eswmryUC8K4t8ApP6c8Yh-55S-0k2bxl9C1pZG0S9wIS2E6Flk0GoL7rhCOjvmXPo2g8fhv-68LugXtkm61qhVJE2dCWwQoxV8gOJmPm6_B451oZq-3_tuk3eB0T006iGEwj3gIZLm1TyuRlbg May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 8f172449ec264570925e6ce663f39f48 May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerDiskConfigTestJSON-657099713 May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8f172449ec264570925e6ce663f39f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8f172449ec264570925e6ce663f39f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8f172449ec264570925e6ce663f39f48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8f172449ec264570925e6ce663f39f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerDiskConfigTestJSON-657099713 May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 8f172449ec264570925e6ce663f39f48 May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-657099713 May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerDiskConfigTestJSON-657099713-project May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24ab05980f96488b94964987b64d41a7 May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerDiskConfigTestJSON-657099713-project May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 0f7564cd-9eb1-466d-b14b-89e4ead407f3 could not be found. May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '0f7564cd-9eb1-466d-b14b-89e4ead407f3'} May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f7564cd-9eb1-466d-b14b-89e4ead407f3 could not be found. May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f7564cd-9eb1-466d-b14b-89e4ead407f3 could not be found. May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:39:00.791527 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:39:00.797172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:39:00.797172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:39:00.797172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:39:00.797172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:39:00.797172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:39:00.797172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f7564cd-9eb1-466d-b14b-89e4ead407f3 could not be found. May 28 05:39:00.797172 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:39:00.797172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4a698280-728c-486b-9d8c-85238acf6afd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Returning 404 to user: Instance 0f7564cd-9eb1-466d-b14b-89e4ead407f3 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:39:00.797172 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4a698280-728c-486b-9d8c-85238acf6afd tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3" status: 404 len: 111 microversion: 2.1 time: 0.030877 May 28 05:39:00.797172 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3678/7240] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:00 2022] GET /compute/v2.1/servers/0f7564cd-9eb1-466d-b14b-89e4ead407f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:39:00.802795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5988a805-8ecf-4eb2-8330-8f6513192639 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:00.803463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5988a805-8ecf-4eb2-8330-8f6513192639 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:00.810433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5988a805-8ecf-4eb2-8330-8f6513192639 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:00.810904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5988a805-8ecf-4eb2-8330-8f6513192639 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:00.814887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5988a805-8ecf-4eb2-8330-8f6513192639 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:00.814887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5988a805-8ecf-4eb2-8330-8f6513192639 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:00.825973 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-5988a805-8ecf-4eb2-8330-8f6513192639 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] HTTP exception thrown: Instance ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 could not be found. May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5988a805-8ecf-4eb2-8330-8f6513192639 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Request method failure captured: May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 HTTP/1.1 May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbUJo-l4yjxhAnMlmOrjZUwUwcfR3eswmryUC8K4t8ApP6c8Yh-55S-0k2bxl9C1pZG0S9wIS2E6Flk0GoL7rhCOjvmXPo2g8fhv-68LugXtkm61qhVJE2dCWwQoxV8gOJmPm6_B451oZq-3_tuk3eB0T006iGEwj3gIZLm1TyuRlbg May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 8f172449ec264570925e6ce663f39f48 May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerDiskConfigTestJSON-657099713 May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8f172449ec264570925e6ce663f39f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8f172449ec264570925e6ce663f39f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8f172449ec264570925e6ce663f39f48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8f172449ec264570925e6ce663f39f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerDiskConfigTestJSON-657099713 May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 8f172449ec264570925e6ce663f39f48 May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-657099713 May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerDiskConfigTestJSON-657099713-project May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 24ab05980f96488b94964987b64d41a7 May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerDiskConfigTestJSON-657099713-project May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 could not be found. May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'ba5c1936-badd-44aa-af3f-e8b8ee1e9b41'} May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 could not be found. May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:39:00.827650 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:39:00.832914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 could not be found. May 28 05:39:00.832914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:39:00.832914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:39:00.832914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:39:00.832914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:39:00.832914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:39:00.832914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:39:00.832914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:39:00.832914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:39:00.832914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 could not be found. May 28 05:39:00.832914 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:39:00.832914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5988a805-8ecf-4eb2-8330-8f6513192639 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Returning 404 to user: Instance ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:39:00.832914 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5988a805-8ecf-4eb2-8330-8f6513192639 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 404 len: 111 microversion: 2.1 time: 0.030698 May 28 05:39:00.832914 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3563/7241] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:39:00 2022] DELETE /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 05:39:00.837618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8077b86d-eab2-4734-a8de-3e19c260db94 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:00.838242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8077b86d-eab2-4734-a8de-3e19c260db94 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] [instance: ba5c1936-badd-44aa-af3f-e8b8ee1e9b41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:00.844452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8077b86d-eab2-4734-a8de-3e19c260db94 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:00.844908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8077b86d-eab2-4734-a8de-3e19c260db94 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:00.845677 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8077b86d-eab2-4734-a8de-3e19c260db94 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:00.846120 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8077b86d-eab2-4734-a8de-3e19c260db94 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:00.859975 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-8077b86d-eab2-4734-a8de-3e19c260db94 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] HTTP exception thrown: Instance ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 could not be found. May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8077b86d-eab2-4734-a8de-3e19c260db94 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Request method failure captured: May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 HTTP/1.1 May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbUJo-l4yjxhAnMlmOrjZUwUwcfR3eswmryUC8K4t8ApP6c8Yh-55S-0k2bxl9C1pZG0S9wIS2E6Flk0GoL7rhCOjvmXPo2g8fhv-68LugXtkm61qhVJE2dCWwQoxV8gOJmPm6_B451oZq-3_tuk3eB0T006iGEwj3gIZLm1TyuRlbg May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 8f172449ec264570925e6ce663f39f48 May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerDiskConfigTestJSON-657099713 May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8f172449ec264570925e6ce663f39f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8f172449ec264570925e6ce663f39f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8f172449ec264570925e6ce663f39f48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8f172449ec264570925e6ce663f39f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerDiskConfigTestJSON-657099713 May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 8f172449ec264570925e6ce663f39f48 May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-657099713 May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerDiskConfigTestJSON-657099713-project May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 24ab05980f96488b94964987b64d41a7 May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerDiskConfigTestJSON-657099713-project May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 could not be found. May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'ba5c1936-badd-44aa-af3f-e8b8ee1e9b41'} May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 could not be found. May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 could not be found. May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:39:00.861520 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:39:00.870356 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:39:00.870356 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:39:00.870356 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:39:00.870356 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:39:00.870356 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:39:00.870356 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 could not be found. May 28 05:39:00.870356 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:39:00.870356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8077b86d-eab2-4734-a8de-3e19c260db94 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] Returning 404 to user: Instance ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:39:00.870356 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8077b86d-eab2-4734-a8de-3e19c260db94 tempest-ServerDiskConfigTestJSON-657099713 tempest-ServerDiskConfigTestJSON-657099713-project] 10.222.0.58 "GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41" status: 404 len: 111 microversion: 2.1 time: 0.029189 May 28 05:39:00.870356 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3679/7242] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:00 2022] GET /compute/v2.1/servers/ba5c1936-badd-44aa-af3f-e8b8ee1e9b41 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:39:08.310417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-516e20b3-37f7-45b2-9caa-233a45fa9559 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Action: 'create', calling method: .version_select at 0x7f7701e00310>, body: {"keypair": {"name": "tempest-keypair-121898998", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKB6lanYj5e+SyOjp2Lk5MUYMf6Oz5fR516Gk4Opl2oUVl5saRT9hC8ZMei57tmcCPdkbq7dpzwimRq5TcJWcc7rKvaAdj5TQYfA+iOlTDBCVvlspMtK9UHqkkKpPuLqHQ=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:39:08.314664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:39:08.326239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-516e20b3-37f7-45b2-9caa-233a45fa9559 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Getting quotas for project a59090a2c3eb4898a218d26e86807a86. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:39:08.331397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-516e20b3-37f7-45b2-9caa-233a45fa9559 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Getting quotas for user 1ffd8cb46a064f39a7b4468292d57b42 and project a59090a2c3eb4898a218d26e86807a86. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:39:08.414404 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-516e20b3-37f7-45b2-9caa-233a45fa9559 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.230200 May 28 05:39:08.415035 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3564/7243] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 05:39:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:39:10.712216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c8ef9b50-3ef6-4498-acc1-6a82563af815 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1948011589", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "37f5385b-a020-4f12-be61-b8733e663a1f"}], "security_groups": [{"name": "tempest-securitygroup--1050968748"}], "key_name": "tempest-keypair-121898998", "user_data": "}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:39:10.720560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=34 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:39:10.841952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-c8ef9b50-3ef6-4498-acc1-6a82563af815 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] validate_networks() for [('37f5385b-a020-4f12-be61-b8733e663a1f', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:39:10.852446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:39:11.249290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c8ef9b50-3ef6-4498-acc1-6a82563af815 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:39:11.249981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c8ef9b50-3ef6-4498-acc1-6a82563af815 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:39:11.250480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c8ef9b50-3ef6-4498-acc1-6a82563af815 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:39:11.250903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c8ef9b50-3ef6-4498-acc1-6a82563af815 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:39:11.251359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c8ef9b50-3ef6-4498-acc1-6a82563af815 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:39:11.261107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8ef9b50-3ef6-4498-acc1-6a82563af815 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:11.261566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8ef9b50-3ef6-4498-acc1-6a82563af815 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:11.262382 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8ef9b50-3ef6-4498-acc1-6a82563af815 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:11.262835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8ef9b50-3ef6-4498-acc1-6a82563af815 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:11.281235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-c8ef9b50-3ef6-4498-acc1-6a82563af815 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Getting quotas for project a59090a2c3eb4898a218d26e86807a86. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:39:11.286768 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-c8ef9b50-3ef6-4498-acc1-6a82563af815 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Getting quotas for user 1ffd8cb46a064f39a7b4468292d57b42 and project a59090a2c3eb4898a218d26e86807a86. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:39:11.300384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c8ef9b50-3ef6-4498-acc1-6a82563af815 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:39:11.302696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c8ef9b50-3ef6-4498-acc1-6a82563af815 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:39:11.409032 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c8ef9b50-3ef6-4498-acc1-6a82563af815 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.707458 May 28 05:39:11.409872 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3680/7244] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:39:10 2022] POST /compute/v2.1/servers => generated 409 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:39:11.420361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3a231e75-fc27-4e76-98ac-a1a95b056c75 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:11.420844 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3a231e75-fc27-4e76-98ac-a1a95b056c75 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:11.423545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:39:11.488986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3a231e75-fc27-4e76-98ac-a1a95b056c75 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:11.497746 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3a231e75-fc27-4e76-98ac-a1a95b056c75 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1238 microversion: 2.1 time: 0.081660 May 28 05:39:11.498522 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3565/7245] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:11 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:12.516435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e88c80fb-d642-4291-8fcb-5d160de04956 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:12.517055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e88c80fb-d642-4291-8fcb-5d160de04956 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:12.525094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e88c80fb-d642-4291-8fcb-5d160de04956 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:12.525554 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e88c80fb-d642-4291-8fcb-5d160de04956 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:12.533852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e88c80fb-d642-4291-8fcb-5d160de04956 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:12.533852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e88c80fb-d642-4291-8fcb-5d160de04956 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:12.597008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e88c80fb-d642-4291-8fcb-5d160de04956 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:12.605536 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e88c80fb-d642-4291-8fcb-5d160de04956 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1242 microversion: 2.1 time: 0.094283 May 28 05:39:12.614479 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3681/7246] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:12 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1242 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:13.622497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9b603dad-9a22-48a0-897d-c2e914c55210 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:13.625539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9b603dad-9a22-48a0-897d-c2e914c55210 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:13.630653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b603dad-9a22-48a0-897d-c2e914c55210 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:13.631149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b603dad-9a22-48a0-897d-c2e914c55210 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:13.632481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b603dad-9a22-48a0-897d-c2e914c55210 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:13.632937 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9b603dad-9a22-48a0-897d-c2e914c55210 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:13.816366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9b603dad-9a22-48a0-897d-c2e914c55210 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:13.824651 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9b603dad-9a22-48a0-897d-c2e914c55210 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1308 microversion: 2.1 time: 0.206407 May 28 05:39:13.825235 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3566/7247] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:13 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1308 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:14.841370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2a1ebefa-ff01-4905-b2a0-26df9c85261f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:14.842103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2a1ebefa-ff01-4905-b2a0-26df9c85261f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:14.849172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2a1ebefa-ff01-4905-b2a0-26df9c85261f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:14.849737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2a1ebefa-ff01-4905-b2a0-26df9c85261f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:14.850641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2a1ebefa-ff01-4905-b2a0-26df9c85261f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:14.851117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2a1ebefa-ff01-4905-b2a0-26df9c85261f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:14.998289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2a1ebefa-ff01-4905-b2a0-26df9c85261f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:15.006008 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2a1ebefa-ff01-4905-b2a0-26df9c85261f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1364 microversion: 2.1 time: 0.168962 May 28 05:39:15.006627 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3682/7248] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:14 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:15.355722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b023cd89-8004-4d38-9f0a-819fbbbe2731 req-ded80388-2f01-4164-aaa2-6f0efc78a6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c", "tag": "bfbec242-9937-4a55-9b8f-a9402be347d0"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:39:15.370263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b023cd89-8004-4d38-9f0a-819fbbbe2731 req-ded80388-2f01-4164-aaa2-6f0efc78a6e9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:15.370732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b023cd89-8004-4d38-9f0a-819fbbbe2731 req-ded80388-2f01-4164-aaa2-6f0efc78a6e9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:15.382803 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b023cd89-8004-4d38-9f0a-819fbbbe2731 req-ded80388-2f01-4164-aaa2-6f0efc78a6e9 service nova] Creating event network-changed:bfbec242-9937-4a55-9b8f-a9402be347d0 for instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c on n-h2-843700-1 May 28 05:39:15.388167 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b023cd89-8004-4d38-9f0a-819fbbbe2731 req-ded80388-2f01-4164-aaa2-6f0efc78a6e9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036232 May 28 05:39:15.388967 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3567/7249] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:39:16.024135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-40536e68-2d6f-4261-bd8c-dbddbe9fcea2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:16.024764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-40536e68-2d6f-4261-bd8c-dbddbe9fcea2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:16.031728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40536e68-2d6f-4261-bd8c-dbddbe9fcea2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:16.032184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40536e68-2d6f-4261-bd8c-dbddbe9fcea2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:16.033027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40536e68-2d6f-4261-bd8c-dbddbe9fcea2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:16.033469 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-40536e68-2d6f-4261-bd8c-dbddbe9fcea2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:16.171585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-40536e68-2d6f-4261-bd8c-dbddbe9fcea2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:16.179840 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-40536e68-2d6f-4261-bd8c-dbddbe9fcea2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1364 microversion: 2.1 time: 0.159645 May 28 05:39:16.180541 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3683/7250] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:16 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:17.198452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-faf30f2d-23ce-4ba2-8c7c-182475d732f1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:17.199199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-faf30f2d-23ce-4ba2-8c7c-182475d732f1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:17.205519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-faf30f2d-23ce-4ba2-8c7c-182475d732f1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:17.208916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-faf30f2d-23ce-4ba2-8c7c-182475d732f1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:17.208916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-faf30f2d-23ce-4ba2-8c7c-182475d732f1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:17.208916 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-faf30f2d-23ce-4ba2-8c7c-182475d732f1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:17.334315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-faf30f2d-23ce-4ba2-8c7c-182475d732f1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:17.341979 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-faf30f2d-23ce-4ba2-8c7c-182475d732f1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1364 microversion: 2.1 time: 0.149428 May 28 05:39:17.342563 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3568/7251] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:17 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:18.359383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-09577002-9b84-450d-8c1e-f0f96e126587 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:18.360023 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-09577002-9b84-450d-8c1e-f0f96e126587 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:18.366949 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09577002-9b84-450d-8c1e-f0f96e126587 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:18.367439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09577002-9b84-450d-8c1e-f0f96e126587 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:18.368215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09577002-9b84-450d-8c1e-f0f96e126587 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:18.368653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09577002-9b84-450d-8c1e-f0f96e126587 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:18.497746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-09577002-9b84-450d-8c1e-f0f96e126587 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:18.506530 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-09577002-9b84-450d-8c1e-f0f96e126587 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1364 microversion: 2.1 time: 0.151029 May 28 05:39:18.507750 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3684/7252] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:18 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:39:19.524835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d0ebb225-f4ec-4267-a39c-a75071258a82 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:19.525475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d0ebb225-f4ec-4267-a39c-a75071258a82 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:19.532521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0ebb225-f4ec-4267-a39c-a75071258a82 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:19.532994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0ebb225-f4ec-4267-a39c-a75071258a82 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:19.533815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0ebb225-f4ec-4267-a39c-a75071258a82 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:19.534272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d0ebb225-f4ec-4267-a39c-a75071258a82 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:19.666449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d0ebb225-f4ec-4267-a39c-a75071258a82 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:19.674187 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d0ebb225-f4ec-4267-a39c-a75071258a82 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1364 microversion: 2.1 time: 0.153707 May 28 05:39:19.674952 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3569/7253] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:19 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:20.691311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6ab2148e-9372-407e-b375-cdf94b196ac8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:20.691993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6ab2148e-9372-407e-b375-cdf94b196ac8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:20.699147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6ab2148e-9372-407e-b375-cdf94b196ac8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:20.704721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6ab2148e-9372-407e-b375-cdf94b196ac8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:20.704721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6ab2148e-9372-407e-b375-cdf94b196ac8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:20.704721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6ab2148e-9372-407e-b375-cdf94b196ac8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:20.835135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6ab2148e-9372-407e-b375-cdf94b196ac8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:20.842932 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6ab2148e-9372-407e-b375-cdf94b196ac8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1364 microversion: 2.1 time: 0.155749 May 28 05:39:20.843550 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3685/7254] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:20 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:21.860712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5bcd640c-35a1-48b9-8216-9462302a72e2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:21.861284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5bcd640c-35a1-48b9-8216-9462302a72e2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:21.863652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:39:21.869196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5bcd640c-35a1-48b9-8216-9462302a72e2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:21.869719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5bcd640c-35a1-48b9-8216-9462302a72e2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:21.870591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5bcd640c-35a1-48b9-8216-9462302a72e2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:21.871017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5bcd640c-35a1-48b9-8216-9462302a72e2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:22.003954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5bcd640c-35a1-48b9-8216-9462302a72e2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:22.011614 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5bcd640c-35a1-48b9-8216-9462302a72e2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1364 microversion: 2.1 time: 0.154960 May 28 05:39:22.012219 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3570/7255] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:21 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:22.611298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-62c1bf38-ac41-4ad5-8e0b-d286133d868f req-52470665-1514-4ba7-a8b5-84675597d868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c", "name": "network-vif-plugged", "status": "completed", "tag": "bfbec242-9937-4a55-9b8f-a9402be347d0"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:39:22.615756 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:39:22.616433 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:39:22.623194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-62c1bf38-ac41-4ad5-8e0b-d286133d868f req-52470665-1514-4ba7-a8b5-84675597d868 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:22.623652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-62c1bf38-ac41-4ad5-8e0b-d286133d868f req-52470665-1514-4ba7-a8b5-84675597d868 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:22.635165 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-62c1bf38-ac41-4ad5-8e0b-d286133d868f req-52470665-1514-4ba7-a8b5-84675597d868 service nova] Creating event network-vif-plugged:bfbec242-9937-4a55-9b8f-a9402be347d0 for instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c on n-h2-843700-1 May 28 05:39:22.640496 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-62c1bf38-ac41-4ad5-8e0b-d286133d868f req-52470665-1514-4ba7-a8b5-84675597d868 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033333 May 28 05:39:22.641088 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3686/7256] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:39:23.028770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6b0a4486-f14a-4ee8-94f8-850890910117 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:23.029323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6b0a4486-f14a-4ee8-94f8-850890910117 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:23.036257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b0a4486-f14a-4ee8-94f8-850890910117 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:23.036724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b0a4486-f14a-4ee8-94f8-850890910117 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:23.037516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b0a4486-f14a-4ee8-94f8-850890910117 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:23.037968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b0a4486-f14a-4ee8-94f8-850890910117 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:23.167722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6b0a4486-f14a-4ee8-94f8-850890910117 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:23.175244 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6b0a4486-f14a-4ee8-94f8-850890910117 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1364 microversion: 2.1 time: 0.150425 May 28 05:39:23.175818 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3571/7257] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:23 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:24.194832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-60a328be-3eb2-4b13-8391-2e3ee118f0a7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:24.195577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-60a328be-3eb2-4b13-8391-2e3ee118f0a7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:24.202499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60a328be-3eb2-4b13-8391-2e3ee118f0a7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:24.202955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60a328be-3eb2-4b13-8391-2e3ee118f0a7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:24.203749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60a328be-3eb2-4b13-8391-2e3ee118f0a7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:24.204191 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60a328be-3eb2-4b13-8391-2e3ee118f0a7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:24.335724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-60a328be-3eb2-4b13-8391-2e3ee118f0a7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:24.343398 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-60a328be-3eb2-4b13-8391-2e3ee118f0a7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1550 microversion: 2.1 time: 0.154571 May 28 05:39:24.343985 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3687/7258] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:24 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:24.359644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f8ef3b8c-5ec7-4ff1-95e9-6997ebf695cc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:24.360193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f8ef3b8c-5ec7-4ff1-95e9-6997ebf695cc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:24.367175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8ef3b8c-5ec7-4ff1-95e9-6997ebf695cc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:24.367645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8ef3b8c-5ec7-4ff1-95e9-6997ebf695cc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:24.368478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8ef3b8c-5ec7-4ff1-95e9-6997ebf695cc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:24.368881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f8ef3b8c-5ec7-4ff1-95e9-6997ebf695cc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:24.445453 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f8ef3b8c-5ec7-4ff1-95e9-6997ebf695cc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089665 May 28 05:39:24.446073 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3572/7259] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 05:39:24 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:39:25.397635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-dac74996-b26d-4907-b7c9-e4f94513bec6 req-4f025293-cf39-499e-b73f-3562cd7be562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c", "tag": "bfbec242-9937-4a55-9b8f-a9402be347d0"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:39:25.401776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d3c3665f-2992-4f5e-bcd9-8bfc3a009a05 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:25.402396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d3c3665f-2992-4f5e-bcd9-8bfc3a009a05 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:25.411022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-dac74996-b26d-4907-b7c9-e4f94513bec6 req-4f025293-cf39-499e-b73f-3562cd7be562 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:25.411559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-dac74996-b26d-4907-b7c9-e4f94513bec6 req-4f025293-cf39-499e-b73f-3562cd7be562 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:25.415032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3c3665f-2992-4f5e-bcd9-8bfc3a009a05 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:25.415501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3c3665f-2992-4f5e-bcd9-8bfc3a009a05 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:25.416290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3c3665f-2992-4f5e-bcd9-8bfc3a009a05 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:25.417076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3c3665f-2992-4f5e-bcd9-8bfc3a009a05 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:25.424879 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-dac74996-b26d-4907-b7c9-e4f94513bec6 req-4f025293-cf39-499e-b73f-3562cd7be562 service nova] Creating event network-changed:bfbec242-9937-4a55-9b8f-a9402be347d0 for instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c on n-h2-843700-1 May 28 05:39:25.430172 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-dac74996-b26d-4907-b7c9-e4f94513bec6 req-4f025293-cf39-499e-b73f-3562cd7be562 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037612 May 28 05:39:25.431069 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3573/7260] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:39:25.641051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d3c3665f-2992-4f5e-bcd9-8bfc3a009a05 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:25.648963 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d3c3665f-2992-4f5e-bcd9-8bfc3a009a05 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1550 microversion: 2.1 time: 0.257930 May 28 05:39:25.649560 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3688/7261] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:25 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1550 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:25.666680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-52fcfafd-495a-4d20-9a5a-f0c20f3ef8d8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:25.667357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-52fcfafd-495a-4d20-9a5a-f0c20f3ef8d8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:25.674121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52fcfafd-495a-4d20-9a5a-f0c20f3ef8d8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:25.674839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52fcfafd-495a-4d20-9a5a-f0c20f3ef8d8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:25.675661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52fcfafd-495a-4d20-9a5a-f0c20f3ef8d8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:25.676275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52fcfafd-495a-4d20-9a5a-f0c20f3ef8d8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:25.872665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-52fcfafd-495a-4d20-9a5a-f0c20f3ef8d8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:25.880478 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-52fcfafd-495a-4d20-9a5a-f0c20f3ef8d8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1550 microversion: 2.1 time: 0.218593 May 28 05:39:25.882358 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3574/7262] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:25 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1550 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:26.897644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-35c9d4c9-ce62-4535-b6c0-2c62fc7599e3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:26.898268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-35c9d4c9-ce62-4535-b6c0-2c62fc7599e3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:26.905321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35c9d4c9-ce62-4535-b6c0-2c62fc7599e3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:26.905786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35c9d4c9-ce62-4535-b6c0-2c62fc7599e3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:26.906558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35c9d4c9-ce62-4535-b6c0-2c62fc7599e3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:26.907024 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35c9d4c9-ce62-4535-b6c0-2c62fc7599e3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:27.033116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-35c9d4c9-ce62-4535-b6c0-2c62fc7599e3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:27.040721 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-35c9d4c9-ce62-4535-b6c0-2c62fc7599e3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1669 microversion: 2.1 time: 0.147013 May 28 05:39:27.041313 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3689/7263] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:26 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1669 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:27.057043 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-db72bf14-e72d-4864-ac3e-5d5c931fb79b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:27.057669 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-db72bf14-e72d-4864-ac3e-5d5c931fb79b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:27.064541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db72bf14-e72d-4864-ac3e-5d5c931fb79b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:27.065005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db72bf14-e72d-4864-ac3e-5d5c931fb79b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:27.065777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db72bf14-e72d-4864-ac3e-5d5c931fb79b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:27.066231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-db72bf14-e72d-4864-ac3e-5d5c931fb79b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:27.198881 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-db72bf14-e72d-4864-ac3e-5d5c931fb79b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:27.206383 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-db72bf14-e72d-4864-ac3e-5d5c931fb79b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1669 microversion: 2.1 time: 0.153707 May 28 05:39:27.206951 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3575/7264] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:27 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:27.222747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7b3320be-b60f-4aa1-813a-9ae03b4608e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:39:27.223746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7b3320be-b60f-4aa1-813a-9ae03b4608e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:27.230314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b3320be-b60f-4aa1-813a-9ae03b4608e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:27.230767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b3320be-b60f-4aa1-813a-9ae03b4608e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:27.231556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b3320be-b60f-4aa1-813a-9ae03b4608e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:27.232049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b3320be-b60f-4aa1-813a-9ae03b4608e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:27.262299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7b3320be-b60f-4aa1-813a-9ae03b4608e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:27.268212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7b3320be-b60f-4aa1-813a-9ae03b4608e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Old instance type m1.heat2, new instance type m1.heat {{(pid=126044) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 05:39:27.274393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-7b3320be-b60f-4aa1-813a-9ae03b4608e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:39:27.274819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-7b3320be-b60f-4aa1-813a-9ae03b4608e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:39:27.275324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-7b3320be-b60f-4aa1-813a-9ae03b4608e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:39:27.275738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-7b3320be-b60f-4aa1-813a-9ae03b4608e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:39:27.276153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-7b3320be-b60f-4aa1-813a-9ae03b4608e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:39:27.494629 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7b3320be-b60f-4aa1-813a-9ae03b4608e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "POST /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c/action" status: 202 len: 0 microversion: 2.1 time: 0.275681 May 28 05:39:27.495204 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3690/7265] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:39:27 2022] POST /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:39:27.503447 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1ffd7f53-7a70-4260-9e53-a09750162a0c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:27.504082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1ffd7f53-7a70-4260-9e53-a09750162a0c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:27.510256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ffd7f53-7a70-4260-9e53-a09750162a0c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:27.510927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ffd7f53-7a70-4260-9e53-a09750162a0c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:27.511836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ffd7f53-7a70-4260-9e53-a09750162a0c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:27.512491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ffd7f53-7a70-4260-9e53-a09750162a0c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:27.641196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1ffd7f53-7a70-4260-9e53-a09750162a0c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:27.649317 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1ffd7f53-7a70-4260-9e53-a09750162a0c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1678 microversion: 2.1 time: 0.150006 May 28 05:39:27.649899 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3576/7266] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:27 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:28.668255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7b14b7e0-aab5-4c6e-b106-3643ff9935ae tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:28.668822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7b14b7e0-aab5-4c6e-b106-3643ff9935ae tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:28.675234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b14b7e0-aab5-4c6e-b106-3643ff9935ae tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:28.675698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b14b7e0-aab5-4c6e-b106-3643ff9935ae tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:28.676520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b14b7e0-aab5-4c6e-b106-3643ff9935ae tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:28.676965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7b14b7e0-aab5-4c6e-b106-3643ff9935ae tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:28.813018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7b14b7e0-aab5-4c6e-b106-3643ff9935ae tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:28.820618 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7b14b7e0-aab5-4c6e-b106-3643ff9935ae tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1678 microversion: 2.1 time: 0.157202 May 28 05:39:28.821186 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3691/7267] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:28 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:29.838269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-07c89e9e-828d-45b0-918a-534270dec366 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:29.838889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-07c89e9e-828d-45b0-918a-534270dec366 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:29.845814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07c89e9e-828d-45b0-918a-534270dec366 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:29.846278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07c89e9e-828d-45b0-918a-534270dec366 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:29.847084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07c89e9e-828d-45b0-918a-534270dec366 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:29.847538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-07c89e9e-828d-45b0-918a-534270dec366 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:30.355189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-07c89e9e-828d-45b0-918a-534270dec366 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:30.362896 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-07c89e9e-828d-45b0-918a-534270dec366 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1678 microversion: 2.1 time: 0.529052 May 28 05:39:30.363519 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3577/7268] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:29 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1678 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:31.380307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-44be972e-3eb6-4b19-9731-9a73b7c37ae0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:31.380873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-44be972e-3eb6-4b19-9731-9a73b7c37ae0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:31.387795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-44be972e-3eb6-4b19-9731-9a73b7c37ae0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:31.388254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-44be972e-3eb6-4b19-9731-9a73b7c37ae0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:31.389026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-44be972e-3eb6-4b19-9731-9a73b7c37ae0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:31.389725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-44be972e-3eb6-4b19-9731-9a73b7c37ae0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:31.523017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-44be972e-3eb6-4b19-9731-9a73b7c37ae0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:31.530812 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-44be972e-3eb6-4b19-9731-9a73b7c37ae0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1683 microversion: 2.1 time: 0.154491 May 28 05:39:31.531560 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3692/7269] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:31 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:32.548342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-52ebc2ae-fe7e-40dc-acb5-0e1bf86f9cc4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:32.549014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-52ebc2ae-fe7e-40dc-acb5-0e1bf86f9cc4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:32.556079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52ebc2ae-fe7e-40dc-acb5-0e1bf86f9cc4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:32.556555 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52ebc2ae-fe7e-40dc-acb5-0e1bf86f9cc4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:32.557339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52ebc2ae-fe7e-40dc-acb5-0e1bf86f9cc4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:32.557806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52ebc2ae-fe7e-40dc-acb5-0e1bf86f9cc4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:32.686109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-52ebc2ae-fe7e-40dc-acb5-0e1bf86f9cc4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:32.694193 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-52ebc2ae-fe7e-40dc-acb5-0e1bf86f9cc4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1683 microversion: 2.1 time: 0.149350 May 28 05:39:32.694771 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3578/7270] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:32 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:33.712289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9714bf37-9e67-4ffb-b3a6-6c58e1115ebd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:33.712895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9714bf37-9e67-4ffb-b3a6-6c58e1115ebd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:33.720173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9714bf37-9e67-4ffb-b3a6-6c58e1115ebd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:33.720621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9714bf37-9e67-4ffb-b3a6-6c58e1115ebd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:33.721381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9714bf37-9e67-4ffb-b3a6-6c58e1115ebd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:33.721819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9714bf37-9e67-4ffb-b3a6-6c58e1115ebd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:33.852460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9714bf37-9e67-4ffb-b3a6-6c58e1115ebd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:33.860233 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9714bf37-9e67-4ffb-b3a6-6c58e1115ebd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1683 microversion: 2.1 time: 0.152511 May 28 05:39:33.860807 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3693/7271] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:33 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:34.877501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-30508f56-8a5a-4c2a-b3ae-446444637147 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:34.878133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-30508f56-8a5a-4c2a-b3ae-446444637147 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:34.885162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-30508f56-8a5a-4c2a-b3ae-446444637147 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:34.885686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-30508f56-8a5a-4c2a-b3ae-446444637147 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:34.886468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-30508f56-8a5a-4c2a-b3ae-446444637147 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:34.886922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-30508f56-8a5a-4c2a-b3ae-446444637147 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:35.015003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-30508f56-8a5a-4c2a-b3ae-446444637147 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:35.023110 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-30508f56-8a5a-4c2a-b3ae-446444637147 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1683 microversion: 2.1 time: 0.149550 May 28 05:39:35.023690 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3579/7272] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:34 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:36.040738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-998c14fa-f5d1-487f-b507-415b4d69737e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:36.041403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-998c14fa-f5d1-487f-b507-415b4d69737e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:36.048436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-998c14fa-f5d1-487f-b507-415b4d69737e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:36.048885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-998c14fa-f5d1-487f-b507-415b4d69737e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:36.049654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-998c14fa-f5d1-487f-b507-415b4d69737e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:36.050096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-998c14fa-f5d1-487f-b507-415b4d69737e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:36.178751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-998c14fa-f5d1-487f-b507-415b4d69737e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:36.186324 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-998c14fa-f5d1-487f-b507-415b4d69737e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1683 microversion: 2.1 time: 0.149460 May 28 05:39:36.186869 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3694/7273] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:36 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:37.203835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-097a98c3-5bfd-4abb-a35f-6232edadfaa7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:37.204465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-097a98c3-5bfd-4abb-a35f-6232edadfaa7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:37.212320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-097a98c3-5bfd-4abb-a35f-6232edadfaa7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:37.212784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-097a98c3-5bfd-4abb-a35f-6232edadfaa7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:37.213562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-097a98c3-5bfd-4abb-a35f-6232edadfaa7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:37.214012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-097a98c3-5bfd-4abb-a35f-6232edadfaa7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:37.346086 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-097a98c3-5bfd-4abb-a35f-6232edadfaa7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:37.353855 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-097a98c3-5bfd-4abb-a35f-6232edadfaa7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1683 microversion: 2.1 time: 0.154213 May 28 05:39:37.354439 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3580/7274] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:37 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:38.371145 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8af6e39c-4e08-451a-9a42-310bca699f74 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:38.371771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8af6e39c-4e08-451a-9a42-310bca699f74 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:38.378839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8af6e39c-4e08-451a-9a42-310bca699f74 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:38.379335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8af6e39c-4e08-451a-9a42-310bca699f74 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:38.380114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8af6e39c-4e08-451a-9a42-310bca699f74 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:38.380561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8af6e39c-4e08-451a-9a42-310bca699f74 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:38.511550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8af6e39c-4e08-451a-9a42-310bca699f74 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:38.519489 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8af6e39c-4e08-451a-9a42-310bca699f74 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1683 microversion: 2.1 time: 0.152314 May 28 05:39:38.520074 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3695/7275] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:38 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:39.537405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-43cade90-752a-4a9b-94c0-7437b6f89bf0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:39.538041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-43cade90-752a-4a9b-94c0-7437b6f89bf0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:39.540904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:39:39.545775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43cade90-752a-4a9b-94c0-7437b6f89bf0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:39.546247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43cade90-752a-4a9b-94c0-7437b6f89bf0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:39.547081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43cade90-752a-4a9b-94c0-7437b6f89bf0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:39.547523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-43cade90-752a-4a9b-94c0-7437b6f89bf0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:39.681618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-43cade90-752a-4a9b-94c0-7437b6f89bf0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:39.689220 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-43cade90-752a-4a9b-94c0-7437b6f89bf0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1683 microversion: 2.1 time: 0.155818 May 28 05:39:39.689798 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3581/7276] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:39 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:40.706525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0c67c22f-9b68-438d-b1b3-db9b84ff45df tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:40.707175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0c67c22f-9b68-438d-b1b3-db9b84ff45df tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:40.714711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c67c22f-9b68-438d-b1b3-db9b84ff45df tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:40.715212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c67c22f-9b68-438d-b1b3-db9b84ff45df tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:40.717336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c67c22f-9b68-438d-b1b3-db9b84ff45df tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:40.717336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0c67c22f-9b68-438d-b1b3-db9b84ff45df tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:40.735089 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:39:40.847877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0c67c22f-9b68-438d-b1b3-db9b84ff45df tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:40.856723 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0c67c22f-9b68-438d-b1b3-db9b84ff45df tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1683 microversion: 2.1 time: 0.154160 May 28 05:39:40.860320 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3696/7277] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:40 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:41.875053 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d12d21ac-1016-46b9-a7db-32bf96aba643 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:41.875722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d12d21ac-1016-46b9-a7db-32bf96aba643 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:41.883534 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d12d21ac-1016-46b9-a7db-32bf96aba643 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:41.884002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d12d21ac-1016-46b9-a7db-32bf96aba643 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:41.884792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d12d21ac-1016-46b9-a7db-32bf96aba643 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:41.885253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d12d21ac-1016-46b9-a7db-32bf96aba643 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:42.012067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d12d21ac-1016-46b9-a7db-32bf96aba643 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:42.020003 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d12d21ac-1016-46b9-a7db-32bf96aba643 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1683 microversion: 2.1 time: 0.148956 May 28 05:39:42.020582 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3582/7278] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:41 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:43.037590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2593eae8-5ae1-4170-ba82-b62b91a05fa6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:43.038201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2593eae8-5ae1-4170-ba82-b62b91a05fa6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:43.040947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:39:43.045742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2593eae8-5ae1-4170-ba82-b62b91a05fa6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:43.046192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2593eae8-5ae1-4170-ba82-b62b91a05fa6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:43.046948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2593eae8-5ae1-4170-ba82-b62b91a05fa6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:43.047547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2593eae8-5ae1-4170-ba82-b62b91a05fa6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:43.181597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2593eae8-5ae1-4170-ba82-b62b91a05fa6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:43.189287 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2593eae8-5ae1-4170-ba82-b62b91a05fa6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1683 microversion: 2.1 time: 0.155613 May 28 05:39:43.189857 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3697/7279] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:43 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:44.207445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-023e7ce1-26f5-4571-a5c3-42ab18646743 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:44.208080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-023e7ce1-26f5-4571-a5c3-42ab18646743 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:44.216073 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-023e7ce1-26f5-4571-a5c3-42ab18646743 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:44.216545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-023e7ce1-26f5-4571-a5c3-42ab18646743 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:44.217326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-023e7ce1-26f5-4571-a5c3-42ab18646743 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:44.217783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-023e7ce1-26f5-4571-a5c3-42ab18646743 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:44.221774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=93 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:39:44.349812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-023e7ce1-26f5-4571-a5c3-42ab18646743 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:44.357436 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-023e7ce1-26f5-4571-a5c3-42ab18646743 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1683 microversion: 2.1 time: 0.154007 May 28 05:39:44.358035 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3583/7280] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:44 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:45.374765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fba06df9-c3a3-4ce3-bf8c-ef354e1c54cb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:45.375322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fba06df9-c3a3-4ce3-bf8c-ef354e1c54cb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:45.381934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fba06df9-c3a3-4ce3-bf8c-ef354e1c54cb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:45.382391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fba06df9-c3a3-4ce3-bf8c-ef354e1c54cb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:45.383205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fba06df9-c3a3-4ce3-bf8c-ef354e1c54cb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:45.383654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fba06df9-c3a3-4ce3-bf8c-ef354e1c54cb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:45.514246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fba06df9-c3a3-4ce3-bf8c-ef354e1c54cb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:45.522348 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fba06df9-c3a3-4ce3-bf8c-ef354e1c54cb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1683 microversion: 2.1 time: 0.151600 May 28 05:39:45.522931 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3698/7281] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:45 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:46.539831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a24f91ac-eb45-45c1-a043-26c54b633c99 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:46.540510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a24f91ac-eb45-45c1-a043-26c54b633c99 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:46.547562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a24f91ac-eb45-45c1-a043-26c54b633c99 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:46.551164 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a24f91ac-eb45-45c1-a043-26c54b633c99 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:46.551164 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a24f91ac-eb45-45c1-a043-26c54b633c99 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:46.551164 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a24f91ac-eb45-45c1-a043-26c54b633c99 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:46.680109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a24f91ac-eb45-45c1-a043-26c54b633c99 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:46.687723 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a24f91ac-eb45-45c1-a043-26c54b633c99 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1683 microversion: 2.1 time: 0.152012 May 28 05:39:46.688302 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3584/7282] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:46 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:39:47.705096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-608622c3-9f43-4115-837e-d9a3093117a1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:47.705705 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-608622c3-9f43-4115-837e-d9a3093117a1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:47.713510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-608622c3-9f43-4115-837e-d9a3093117a1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:47.713964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-608622c3-9f43-4115-837e-d9a3093117a1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:47.714725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-608622c3-9f43-4115-837e-d9a3093117a1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:47.715209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-608622c3-9f43-4115-837e-d9a3093117a1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:47.844946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-608622c3-9f43-4115-837e-d9a3093117a1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:47.852459 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-608622c3-9f43-4115-837e-d9a3093117a1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1683 microversion: 2.1 time: 0.151352 May 28 05:39:47.853288 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3699/7283] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:47 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:48.870356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c1cdb6ec-cf5c-4b15-a9da-824a73be71b8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:48.871005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c1cdb6ec-cf5c-4b15-a9da-824a73be71b8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:48.878096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1cdb6ec-cf5c-4b15-a9da-824a73be71b8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:48.878560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1cdb6ec-cf5c-4b15-a9da-824a73be71b8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:48.879360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1cdb6ec-cf5c-4b15-a9da-824a73be71b8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:48.879809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c1cdb6ec-cf5c-4b15-a9da-824a73be71b8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:49.011385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c1cdb6ec-cf5c-4b15-a9da-824a73be71b8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:49.020178 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c1cdb6ec-cf5c-4b15-a9da-824a73be71b8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1683 microversion: 2.1 time: 0.153643 May 28 05:39:49.029996 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3585/7284] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:48 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:39:50.038238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b8e383b9-53ff-474a-b8b9-12e6373a22de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:50.038874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b8e383b9-53ff-474a-b8b9-12e6373a22de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:50.045839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8e383b9-53ff-474a-b8b9-12e6373a22de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:50.046290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8e383b9-53ff-474a-b8b9-12e6373a22de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:50.047081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8e383b9-53ff-474a-b8b9-12e6373a22de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:50.047519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8e383b9-53ff-474a-b8b9-12e6373a22de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:50.178212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b8e383b9-53ff-474a-b8b9-12e6373a22de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:50.186254 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b8e383b9-53ff-474a-b8b9-12e6373a22de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1683 microversion: 2.1 time: 0.152612 May 28 05:39:50.192731 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3700/7285] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:50 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:51.203585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8f8ebed3-2495-4248-a719-b3e0113e4c46 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:51.204213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8f8ebed3-2495-4248-a719-b3e0113e4c46 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:51.211377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f8ebed3-2495-4248-a719-b3e0113e4c46 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:51.211845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f8ebed3-2495-4248-a719-b3e0113e4c46 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:51.212612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f8ebed3-2495-4248-a719-b3e0113e4c46 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:51.213101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f8ebed3-2495-4248-a719-b3e0113e4c46 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:51.343601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8f8ebed3-2495-4248-a719-b3e0113e4c46 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:51.351250 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8f8ebed3-2495-4248-a719-b3e0113e4c46 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1683 microversion: 2.1 time: 0.151388 May 28 05:39:51.351669 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3586/7286] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:51 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:52.369508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a2f479be-1eac-4d5f-b645-051ac4fbf792 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:52.370049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a2f479be-1eac-4d5f-b645-051ac4fbf792 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:52.377307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a2f479be-1eac-4d5f-b645-051ac4fbf792 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:52.377760 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a2f479be-1eac-4d5f-b645-051ac4fbf792 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:52.378548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a2f479be-1eac-4d5f-b645-051ac4fbf792 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:52.379007 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a2f479be-1eac-4d5f-b645-051ac4fbf792 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:52.522597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a2f479be-1eac-4d5f-b645-051ac4fbf792 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:52.530531 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a2f479be-1eac-4d5f-b645-051ac4fbf792 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1683 microversion: 2.1 time: 0.165091 May 28 05:39:52.531145 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3701/7287] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:52 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:53.479806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-41cacbab-140f-4e35-b2fd-fbadcbd18b23 req-d3ca9511-3807-4852-abbb-3226ef435555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c", "name": "network-vif-unplugged", "status": "completed", "tag": "bfbec242-9937-4a55-9b8f-a9402be347d0"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:39:53.490169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-41cacbab-140f-4e35-b2fd-fbadcbd18b23 req-d3ca9511-3807-4852-abbb-3226ef435555 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:53.490481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-41cacbab-140f-4e35-b2fd-fbadcbd18b23 req-d3ca9511-3807-4852-abbb-3226ef435555 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:53.504059 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-41cacbab-140f-4e35-b2fd-fbadcbd18b23 req-d3ca9511-3807-4852-abbb-3226ef435555 service nova] Creating event network-vif-unplugged:bfbec242-9937-4a55-9b8f-a9402be347d0 for instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c on n-h1-843700-1 May 28 05:39:53.509789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-41cacbab-140f-4e35-b2fd-fbadcbd18b23 req-d3ca9511-3807-4852-abbb-3226ef435555 service nova] Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:39:53.521601 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-41cacbab-140f-4e35-b2fd-fbadcbd18b23 req-d3ca9511-3807-4852-abbb-3226ef435555 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136451 May 28 05:39:53.523234 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3587/7288] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:39:53.548994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-49dbe051-152d-4e34-bb3f-9eb945c64112 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:53.549619 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-49dbe051-152d-4e34-bb3f-9eb945c64112 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:53.557912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49dbe051-152d-4e34-bb3f-9eb945c64112 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:53.563777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49dbe051-152d-4e34-bb3f-9eb945c64112 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:53.563777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49dbe051-152d-4e34-bb3f-9eb945c64112 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:53.563777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49dbe051-152d-4e34-bb3f-9eb945c64112 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:53.817220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-49dbe051-152d-4e34-bb3f-9eb945c64112 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:53.824952 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-49dbe051-152d-4e34-bb3f-9eb945c64112 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1682 microversion: 2.1 time: 0.280102 May 28 05:39:53.829347 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3702/7289] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:53 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1682 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:54.844023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-59cc6294-572d-491f-b45f-d5ff758b60de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:54.844778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-59cc6294-572d-491f-b45f-d5ff758b60de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:54.852625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59cc6294-572d-491f-b45f-d5ff758b60de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:54.853088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59cc6294-572d-491f-b45f-d5ff758b60de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:54.853873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59cc6294-572d-491f-b45f-d5ff758b60de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:54.854324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59cc6294-572d-491f-b45f-d5ff758b60de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:54.983906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-59cc6294-572d-491f-b45f-d5ff758b60de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:54.992090 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-59cc6294-572d-491f-b45f-d5ff758b60de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1680 microversion: 2.1 time: 0.152449 May 28 05:39:54.992670 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3588/7290] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:54 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:55.570346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-7764aa57-c175-45af-ab07-2700310090cc req-835c7c83-98c1-4958-ac9d-bc76416fb069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c", "tag": "bfbec242-9937-4a55-9b8f-a9402be347d0"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:39:55.578775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-7764aa57-c175-45af-ab07-2700310090cc req-835c7c83-98c1-4958-ac9d-bc76416fb069 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:55.579262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-7764aa57-c175-45af-ab07-2700310090cc req-835c7c83-98c1-4958-ac9d-bc76416fb069 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:55.591498 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-7764aa57-c175-45af-ab07-2700310090cc req-835c7c83-98c1-4958-ac9d-bc76416fb069 service nova] Creating event network-changed:bfbec242-9937-4a55-9b8f-a9402be347d0 for instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c on n-h1-843700-1 May 28 05:39:55.596774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-7764aa57-c175-45af-ab07-2700310090cc req-835c7c83-98c1-4958-ac9d-bc76416fb069 service nova] Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:39:55.607557 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-7764aa57-c175-45af-ab07-2700310090cc req-835c7c83-98c1-4958-ac9d-bc76416fb069 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041560 May 28 05:39:55.608193 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3703/7291] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:39:56.008678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9605029b-ce32-4724-bb42-f8f7df453b40 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:56.009312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9605029b-ce32-4724-bb42-f8f7df453b40 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:56.016624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9605029b-ce32-4724-bb42-f8f7df453b40 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:56.017101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9605029b-ce32-4724-bb42-f8f7df453b40 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:56.017887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9605029b-ce32-4724-bb42-f8f7df453b40 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:56.018342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9605029b-ce32-4724-bb42-f8f7df453b40 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:56.337718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9605029b-ce32-4724-bb42-f8f7df453b40 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:56.347339 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9605029b-ce32-4724-bb42-f8f7df453b40 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1680 microversion: 2.1 time: 0.342606 May 28 05:39:56.348192 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3589/7292] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:56 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1680 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:57.367031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-35f9e30b-6b64-443f-a900-c7f2fe4676d9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:57.367741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-35f9e30b-6b64-443f-a900-c7f2fe4676d9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:57.374018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35f9e30b-6b64-443f-a900-c7f2fe4676d9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:57.374471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35f9e30b-6b64-443f-a900-c7f2fe4676d9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:57.375298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35f9e30b-6b64-443f-a900-c7f2fe4676d9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:57.375744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35f9e30b-6b64-443f-a900-c7f2fe4676d9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:57.506275 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-35f9e30b-6b64-443f-a900-c7f2fe4676d9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:57.514202 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-35f9e30b-6b64-443f-a900-c7f2fe4676d9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1677 microversion: 2.1 time: 0.152536 May 28 05:39:57.514791 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3704/7293] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:57 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:57.530654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3f2d567d-6900-42b8-9e65-92a9beb750bc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:39:57.531314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3f2d567d-6900-42b8-9e65-92a9beb750bc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:57.538304 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f2d567d-6900-42b8-9e65-92a9beb750bc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:57.538764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f2d567d-6900-42b8-9e65-92a9beb750bc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:57.539581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f2d567d-6900-42b8-9e65-92a9beb750bc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:57.540392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3f2d567d-6900-42b8-9e65-92a9beb750bc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:57.776298 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3f2d567d-6900-42b8-9e65-92a9beb750bc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "POST /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c/action" status: 204 len: 0 microversion: 2.1 time: 0.249354 May 28 05:39:57.776983 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3590/7294] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:39:57 2022] POST /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c/action => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:39:57.785621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c0d31fd6-57d0-4e14-894c-e7f156f399af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:57.786320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c0d31fd6-57d0-4e14-894c-e7f156f399af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:57.794211 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0d31fd6-57d0-4e14-894c-e7f156f399af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:57.794699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0d31fd6-57d0-4e14-894c-e7f156f399af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:57.795504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0d31fd6-57d0-4e14-894c-e7f156f399af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:57.795979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0d31fd6-57d0-4e14-894c-e7f156f399af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:57.981156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c0d31fd6-57d0-4e14-894c-e7f156f399af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:57.990083 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c0d31fd6-57d0-4e14-894c-e7f156f399af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1677 microversion: 2.1 time: 0.208014 May 28 05:39:57.990960 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3705/7295] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:57 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1677 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:59.009278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6472a95b-377c-4d8a-991c-6b4a8f815bb2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:39:59.010766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6472a95b-377c-4d8a-991c-6b4a8f815bb2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:39:59.017469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6472a95b-377c-4d8a-991c-6b4a8f815bb2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:59.017938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6472a95b-377c-4d8a-991c-6b4a8f815bb2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:59.018806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6472a95b-377c-4d8a-991c-6b4a8f815bb2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:59.019291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6472a95b-377c-4d8a-991c-6b4a8f815bb2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:59.157197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6472a95b-377c-4d8a-991c-6b4a8f815bb2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:39:59.165172 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6472a95b-377c-4d8a-991c-6b4a8f815bb2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1677 microversion: 2.1 time: 0.160997 May 28 05:39:59.165765 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3591/7296] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:39:59 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:39:59.599992 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e2263b9a-9a13-4a5e-a6b7-8b54b9d3e9d1 req-c119fd81-db61-4a41-9377-76119c4db960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c", "name": "network-vif-plugged", "status": "completed", "tag": "bfbec242-9937-4a55-9b8f-a9402be347d0"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:39:59.609051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e2263b9a-9a13-4a5e-a6b7-8b54b9d3e9d1 req-c119fd81-db61-4a41-9377-76119c4db960 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:39:59.609498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e2263b9a-9a13-4a5e-a6b7-8b54b9d3e9d1 req-c119fd81-db61-4a41-9377-76119c4db960 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:39:59.621298 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e2263b9a-9a13-4a5e-a6b7-8b54b9d3e9d1 req-c119fd81-db61-4a41-9377-76119c4db960 service nova] Creating event network-vif-plugged:bfbec242-9937-4a55-9b8f-a9402be347d0 for instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c on n-h1-843700-1 May 28 05:39:59.626269 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e2263b9a-9a13-4a5e-a6b7-8b54b9d3e9d1 req-c119fd81-db61-4a41-9377-76119c4db960 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030560 May 28 05:39:59.628032 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3706/7297] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:40:00.185860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cfc2dca9-a1f0-4b2e-a575-647fc3fd07df tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:00.190810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cfc2dca9-a1f0-4b2e-a575-647fc3fd07df tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:00.193601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfc2dca9-a1f0-4b2e-a575-647fc3fd07df tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:00.194074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfc2dca9-a1f0-4b2e-a575-647fc3fd07df tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:00.194857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfc2dca9-a1f0-4b2e-a575-647fc3fd07df tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:00.195339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfc2dca9-a1f0-4b2e-a575-647fc3fd07df tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:00.323001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cfc2dca9-a1f0-4b2e-a575-647fc3fd07df tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:00.330550 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cfc2dca9-a1f0-4b2e-a575-647fc3fd07df tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1669 microversion: 2.1 time: 0.148647 May 28 05:40:00.331154 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3592/7298] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:00 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1669 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:00.347184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-730aa53e-8dd9-47c3-87c8-bc69cd56be9e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:00.347923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-730aa53e-8dd9-47c3-87c8-bc69cd56be9e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:00.354872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-730aa53e-8dd9-47c3-87c8-bc69cd56be9e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:00.355371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-730aa53e-8dd9-47c3-87c8-bc69cd56be9e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:00.356139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-730aa53e-8dd9-47c3-87c8-bc69cd56be9e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:00.356586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-730aa53e-8dd9-47c3-87c8-bc69cd56be9e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:00.483615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-730aa53e-8dd9-47c3-87c8-bc69cd56be9e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:00.491345 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-730aa53e-8dd9-47c3-87c8-bc69cd56be9e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1669 microversion: 2.1 time: 0.148377 May 28 05:40:00.491938 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3707/7299] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:00 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1669 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:00.507478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cfdbcfc2-bbf0-467a-899c-308f7bdda1d8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:00.508112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cfdbcfc2-bbf0-467a-899c-308f7bdda1d8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:00.514548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfdbcfc2-bbf0-467a-899c-308f7bdda1d8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:00.515043 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfdbcfc2-bbf0-467a-899c-308f7bdda1d8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:00.515834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfdbcfc2-bbf0-467a-899c-308f7bdda1d8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:00.516294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfdbcfc2-bbf0-467a-899c-308f7bdda1d8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:00.648348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cfdbcfc2-bbf0-467a-899c-308f7bdda1d8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:00.655864 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cfdbcfc2-bbf0-467a-899c-308f7bdda1d8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1669 microversion: 2.1 time: 0.152425 May 28 05:40:00.656442 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3593/7300] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:00 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:00.672448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-96ae1088-47a6-4b71-8c84-69057a314147 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:00.672986 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-96ae1088-47a6-4b71-8c84-69057a314147 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:00.679751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96ae1088-47a6-4b71-8c84-69057a314147 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:00.680210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96ae1088-47a6-4b71-8c84-69057a314147 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:00.680974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96ae1088-47a6-4b71-8c84-69057a314147 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:00.681414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96ae1088-47a6-4b71-8c84-69057a314147 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:00.705960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-96ae1088-47a6-4b71-8c84-69057a314147 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:40:01.022883 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-96ae1088-47a6-4b71-8c84-69057a314147 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "DELETE /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 204 len: 0 microversion: 2.1 time: 0.353874 May 28 05:40:01.023442 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3708/7301] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:40:00 2022] DELETE /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:40:01.031552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-59bb09e6-7aeb-42ae-a43c-5979587177fb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:01.032195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-59bb09e6-7aeb-42ae-a43c-5979587177fb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:01.038332 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59bb09e6-7aeb-42ae-a43c-5979587177fb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:01.038804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59bb09e6-7aeb-42ae-a43c-5979587177fb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:01.039625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59bb09e6-7aeb-42ae-a43c-5979587177fb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:01.040083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59bb09e6-7aeb-42ae-a43c-5979587177fb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:01.167689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-59bb09e6-7aeb-42ae-a43c-5979587177fb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:01.175313 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-59bb09e6-7aeb-42ae-a43c-5979587177fb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1675 microversion: 2.1 time: 0.147593 May 28 05:40:01.175894 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3594/7302] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:01 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:02.193970 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5f40b544-eeee-4773-829a-f1b619d109c0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:02.194684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5f40b544-eeee-4773-829a-f1b619d109c0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:02.201663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f40b544-eeee-4773-829a-f1b619d109c0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:02.204773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f40b544-eeee-4773-829a-f1b619d109c0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:02.204773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f40b544-eeee-4773-829a-f1b619d109c0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:02.204773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f40b544-eeee-4773-829a-f1b619d109c0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:02.362492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5f40b544-eeee-4773-829a-f1b619d109c0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:02.370545 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5f40b544-eeee-4773-829a-f1b619d109c0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1675 microversion: 2.1 time: 0.181424 May 28 05:40:02.371072 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3709/7303] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:02 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:03.388147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-25ed2a46-2abc-4105-b0f7-3224cc173615 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:03.389036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-25ed2a46-2abc-4105-b0f7-3224cc173615 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:03.402052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25ed2a46-2abc-4105-b0f7-3224cc173615 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:03.402518 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25ed2a46-2abc-4105-b0f7-3224cc173615 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:03.403346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25ed2a46-2abc-4105-b0f7-3224cc173615 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:03.403795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-25ed2a46-2abc-4105-b0f7-3224cc173615 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:03.484075 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-25ed2a46-2abc-4105-b0f7-3224cc173615 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:03.493003 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-25ed2a46-2abc-4105-b0f7-3224cc173615 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 200 len: 1607 microversion: 2.1 time: 0.108412 May 28 05:40:03.493996 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3595/7304] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:03 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 1607 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:03.549820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-ae8d1ba9-25ab-435b-950e-85ecdf0642ba req-09a3926c-1f84-428b-8302-82c0000272ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c", "name": "network-vif-deleted", "tag": "bfbec242-9937-4a55-9b8f-a9402be347d0"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:40:03.559544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ae8d1ba9-25ab-435b-950e-85ecdf0642ba req-09a3926c-1f84-428b-8302-82c0000272ab service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:03.562821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ae8d1ba9-25ab-435b-950e-85ecdf0642ba req-09a3926c-1f84-428b-8302-82c0000272ab service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:03.571701 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-ae8d1ba9-25ab-435b-950e-85ecdf0642ba req-09a3926c-1f84-428b-8302-82c0000272ab service nova] Creating event network-vif-deleted:bfbec242-9937-4a55-9b8f-a9402be347d0 for instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c on n-h1-843700-1 May 28 05:40:03.576548 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-ae8d1ba9-25ab-435b-950e-85ecdf0642ba req-09a3926c-1f84-428b-8302-82c0000272ab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030485 May 28 05:40:03.577158 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3710/7305] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:40:04.509956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5a5c5e57-e2c9-4921-8c94-88917d6b7f7b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:04.510594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5a5c5e57-e2c9-4921-8c94-88917d6b7f7b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:04.518078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a5c5e57-e2c9-4921-8c94-88917d6b7f7b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:04.520737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a5c5e57-e2c9-4921-8c94-88917d6b7f7b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:04.520737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a5c5e57-e2c9-4921-8c94-88917d6b7f7b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:04.520737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5a5c5e57-e2c9-4921-8c94-88917d6b7f7b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:04.534529 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-5a5c5e57-e2c9-4921-8c94-88917d6b7f7b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] HTTP exception thrown: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5a5c5e57-e2c9-4921-8c94-88917d6b7f7b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Request method failure captured: May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c HTTP/1.1 May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbV8EVqnsXJ4v8PKLpKbSN-UMKIcSy3KmkP6QXvwdRFm704ALR4cl_gP9SPkmpV3xU_0jRk0mImnS7YmIQnzqGR8Czb30Vc2tEyE75b992FPEefKyODL7t_FCesR9j2FYAAhL0AvtL4GoBrh1ex3V5-HI_FVJL-8Aq7U-X9LX1Ide1Y May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerActionsTestJSON-1722172964 May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerActionsTestJSON-1722172964-project May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 1ffd8cb46a064f39a7b4468292d57b42 May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerActionsTestJSON-1722172964-project May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c'} May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:40:04.537421 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:40:04.546973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:40:04.546973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:40:04.546973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:40:04.546973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:40:04.546973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:40:04.546973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. May 28 05:40:04.546973 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:40:04.546973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5a5c5e57-e2c9-4921-8c94-88917d6b7f7b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Returning 404 to user: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:40:04.546973 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5a5c5e57-e2c9-4921-8c94-88917d6b7f7b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 404 len: 111 microversion: 2.1 time: 0.034501 May 28 05:40:04.546973 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3596/7306] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:04 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:40:04.556610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d09916cb-1e3e-4d95-b72e-f463b7da2012 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:04.557457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d09916cb-1e3e-4d95-b72e-f463b7da2012 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:04.565421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d09916cb-1e3e-4d95-b72e-f463b7da2012 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:04.565948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d09916cb-1e3e-4d95-b72e-f463b7da2012 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:04.566787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d09916cb-1e3e-4d95-b72e-f463b7da2012 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:04.567873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d09916cb-1e3e-4d95-b72e-f463b7da2012 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:04.582118 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-d09916cb-1e3e-4d95-b72e-f463b7da2012 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] HTTP exception thrown: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d09916cb-1e3e-4d95-b72e-f463b7da2012 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Request method failure captured: May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c HTTP/1.1 May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbV8EVqnsXJ4v8PKLpKbSN-UMKIcSy3KmkP6QXvwdRFm704ALR4cl_gP9SPkmpV3xU_0jRk0mImnS7YmIQnzqGR8Czb30Vc2tEyE75b992FPEefKyODL7t_FCesR9j2FYAAhL0AvtL4GoBrh1ex3V5-HI_FVJL-8Aq7U-X9LX1Ide1Y May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerActionsTestJSON-1722172964 May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerActionsTestJSON-1722172964-project May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 1ffd8cb46a064f39a7b4468292d57b42 May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerActionsTestJSON-1722172964-project May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c'} May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:40:04.584460 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:40:04.589833 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:40:04.589833 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:40:04.589833 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:40:04.589833 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:40:04.589833 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:40:04.589833 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. May 28 05:40:04.589833 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:40:04.589833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d09916cb-1e3e-4d95-b72e-f463b7da2012 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Returning 404 to user: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:40:04.589833 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d09916cb-1e3e-4d95-b72e-f463b7da2012 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 404 len: 111 microversion: 2.1 time: 0.033568 May 28 05:40:04.589833 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3711/7307] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:04 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:40:04.632115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-73d08977-9a99-4e8f-8fa3-373e118583ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-744383069", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "37f5385b-a020-4f12-be61-b8733e663a1f"}], "security_groups": [{"name": "tempest-securitygroup--1050968748"}], "key_name": "tempest-keypair-121898998", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:40:04.731883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-73d08977-9a99-4e8f-8fa3-373e118583ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] validate_networks() for [('37f5385b-a020-4f12-be61-b8733e663a1f', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:40:05.100927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-73d08977-9a99-4e8f-8fa3-373e118583ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:40:05.101378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-73d08977-9a99-4e8f-8fa3-373e118583ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:40:05.101882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-73d08977-9a99-4e8f-8fa3-373e118583ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:40:05.102316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-73d08977-9a99-4e8f-8fa3-373e118583ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:40:05.102751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-73d08977-9a99-4e8f-8fa3-373e118583ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:40:05.112148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73d08977-9a99-4e8f-8fa3-373e118583ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:05.112623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73d08977-9a99-4e8f-8fa3-373e118583ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:05.113459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73d08977-9a99-4e8f-8fa3-373e118583ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:05.113911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-73d08977-9a99-4e8f-8fa3-373e118583ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:05.136314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-73d08977-9a99-4e8f-8fa3-373e118583ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Getting quotas for project a59090a2c3eb4898a218d26e86807a86. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:40:05.142155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-73d08977-9a99-4e8f-8fa3-373e118583ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Getting quotas for user 1ffd8cb46a064f39a7b4468292d57b42 and project a59090a2c3eb4898a218d26e86807a86. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:40:05.155414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-73d08977-9a99-4e8f-8fa3-373e118583ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:40:05.160385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-73d08977-9a99-4e8f-8fa3-373e118583ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:40:05.265370 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-73d08977-9a99-4e8f-8fa3-373e118583ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.637679 May 28 05:40:05.266061 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3597/7308] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:40:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:40:05.276169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5a59528a-501f-459a-b51e-187518ef8631 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:05.276788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5a59528a-501f-459a-b51e-187518ef8631 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:05.333652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5a59528a-501f-459a-b51e-187518ef8631 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:05.341709 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5a59528a-501f-459a-b51e-187518ef8631 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1237 microversion: 2.1 time: 0.068799 May 28 05:40:05.342291 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3712/7309] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:05 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:06.359859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4bff83ca-456f-4df0-b3a5-26e8b5a47b1c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:06.360496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4bff83ca-456f-4df0-b3a5-26e8b5a47b1c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:06.368356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4bff83ca-456f-4df0-b3a5-26e8b5a47b1c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:06.368858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4bff83ca-456f-4df0-b3a5-26e8b5a47b1c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:06.369650 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4bff83ca-456f-4df0-b3a5-26e8b5a47b1c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:06.370108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4bff83ca-456f-4df0-b3a5-26e8b5a47b1c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:06.432843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4bff83ca-456f-4df0-b3a5-26e8b5a47b1c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:06.440360 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4bff83ca-456f-4df0-b3a5-26e8b5a47b1c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1233 microversion: 2.1 time: 0.084547 May 28 05:40:06.440930 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3598/7310] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:06 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1233 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:07.461088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ad03462d-3dc5-4a53-9d86-a75279bd5d44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:07.461917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ad03462d-3dc5-4a53-9d86-a75279bd5d44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:07.470446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad03462d-3dc5-4a53-9d86-a75279bd5d44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:07.471042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad03462d-3dc5-4a53-9d86-a75279bd5d44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:07.471836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad03462d-3dc5-4a53-9d86-a75279bd5d44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:07.472311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ad03462d-3dc5-4a53-9d86-a75279bd5d44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:07.561772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ad03462d-3dc5-4a53-9d86-a75279bd5d44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:07.569992 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ad03462d-3dc5-4a53-9d86-a75279bd5d44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1295 microversion: 2.1 time: 0.114913 May 28 05:40:07.570851 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3713/7311] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:07 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1295 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:08.588599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eb7b438b-a676-4abc-b394-da52827b21f9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:08.589227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eb7b438b-a676-4abc-b394-da52827b21f9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:08.596219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb7b438b-a676-4abc-b394-da52827b21f9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:08.596986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb7b438b-a676-4abc-b394-da52827b21f9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:08.597768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb7b438b-a676-4abc-b394-da52827b21f9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:08.598253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb7b438b-a676-4abc-b394-da52827b21f9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:08.726184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-fccb1c99-9383-4610-8d66-4eabd5fb02cb req-04354a8c-e739-4f37-be95-b3c6681a1405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6076a6fa-ff7e-44a6-8924-889f991aeaac", "tag": "2100d119-58f3-406c-9e74-f7d95a4631d8"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:40:08.739682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-fccb1c99-9383-4610-8d66-4eabd5fb02cb req-04354a8c-e739-4f37-be95-b3c6681a1405 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:08.739817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-fccb1c99-9383-4610-8d66-4eabd5fb02cb req-04354a8c-e739-4f37-be95-b3c6681a1405 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:08.751963 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-fccb1c99-9383-4610-8d66-4eabd5fb02cb req-04354a8c-e739-4f37-be95-b3c6681a1405 service nova] Creating event network-changed:2100d119-58f3-406c-9e74-f7d95a4631d8 for instance 6076a6fa-ff7e-44a6-8924-889f991aeaac on n-h1-843700-1 May 28 05:40:08.758647 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-fccb1c99-9383-4610-8d66-4eabd5fb02cb req-04354a8c-e739-4f37-be95-b3c6681a1405 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036809 May 28 05:40:08.759468 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3714/7312] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:40:08.841431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eb7b438b-a676-4abc-b394-da52827b21f9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:08.847929 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eb7b438b-a676-4abc-b394-da52827b21f9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1363 microversion: 2.1 time: 0.263273 May 28 05:40:08.849139 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3599/7313] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:08 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:09.868106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c3c7fb7d-456a-4d2b-9fac-9beb3e7b292f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:09.868820 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c3c7fb7d-456a-4d2b-9fac-9beb3e7b292f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:09.875156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3c7fb7d-456a-4d2b-9fac-9beb3e7b292f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:09.875618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3c7fb7d-456a-4d2b-9fac-9beb3e7b292f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:09.876390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3c7fb7d-456a-4d2b-9fac-9beb3e7b292f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:09.876837 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3c7fb7d-456a-4d2b-9fac-9beb3e7b292f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:09.897678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:40:10.015163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c3c7fb7d-456a-4d2b-9fac-9beb3e7b292f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:10.023580 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c3c7fb7d-456a-4d2b-9fac-9beb3e7b292f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1363 microversion: 2.1 time: 0.161124 May 28 05:40:10.024161 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3715/7314] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:09 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:11.041034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-013dcebc-2430-4a43-883d-313e489c37ed tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:11.041671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-013dcebc-2430-4a43-883d-313e489c37ed tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:11.044585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:40:11.049419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-013dcebc-2430-4a43-883d-313e489c37ed tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:11.049894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-013dcebc-2430-4a43-883d-313e489c37ed tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:11.050683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-013dcebc-2430-4a43-883d-313e489c37ed tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:11.051174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-013dcebc-2430-4a43-883d-313e489c37ed tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:11.055968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:40:11.182382 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-013dcebc-2430-4a43-883d-313e489c37ed tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:11.190087 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-013dcebc-2430-4a43-883d-313e489c37ed tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1363 microversion: 2.1 time: 0.153034 May 28 05:40:11.190698 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3600/7315] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:11 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:12.208280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-14ff0ba4-9f20-4ad1-95a0-130017618c78 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:12.209575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-14ff0ba4-9f20-4ad1-95a0-130017618c78 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:12.216593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14ff0ba4-9f20-4ad1-95a0-130017618c78 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:12.217045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14ff0ba4-9f20-4ad1-95a0-130017618c78 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:12.217812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14ff0ba4-9f20-4ad1-95a0-130017618c78 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:12.218253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14ff0ba4-9f20-4ad1-95a0-130017618c78 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:12.349680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-14ff0ba4-9f20-4ad1-95a0-130017618c78 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:12.357167 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-14ff0ba4-9f20-4ad1-95a0-130017618c78 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1363 microversion: 2.1 time: 0.152894 May 28 05:40:12.357743 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3716/7316] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:12 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:13.374723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0b29fc13-12e7-4644-8dab-c902e2192b45 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:13.375362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0b29fc13-12e7-4644-8dab-c902e2192b45 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:13.382708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b29fc13-12e7-4644-8dab-c902e2192b45 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:13.383225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b29fc13-12e7-4644-8dab-c902e2192b45 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:13.384014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b29fc13-12e7-4644-8dab-c902e2192b45 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:13.384476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b29fc13-12e7-4644-8dab-c902e2192b45 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:13.513075 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0b29fc13-12e7-4644-8dab-c902e2192b45 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:13.521429 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0b29fc13-12e7-4644-8dab-c902e2192b45 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1363 microversion: 2.1 time: 0.150252 May 28 05:40:13.522014 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3601/7317] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:13 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:14.539398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c9a52dec-3437-4941-8263-5dc71fa47693 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:14.540051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c9a52dec-3437-4941-8263-5dc71fa47693 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:14.543604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:40:14.548383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9a52dec-3437-4941-8263-5dc71fa47693 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:14.548843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9a52dec-3437-4941-8263-5dc71fa47693 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:14.549637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9a52dec-3437-4941-8263-5dc71fa47693 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:14.550131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9a52dec-3437-4941-8263-5dc71fa47693 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:14.682982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c9a52dec-3437-4941-8263-5dc71fa47693 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:14.690560 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c9a52dec-3437-4941-8263-5dc71fa47693 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1363 microversion: 2.1 time: 0.155666 May 28 05:40:14.691192 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3717/7318] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:14 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:15.708002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-29d214c6-a806-4c72-9f07-64d766c1930d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:15.708724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-29d214c6-a806-4c72-9f07-64d766c1930d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:15.712112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:40:15.712799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:40:15.718353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29d214c6-a806-4c72-9f07-64d766c1930d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:15.718854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29d214c6-a806-4c72-9f07-64d766c1930d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:15.719737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29d214c6-a806-4c72-9f07-64d766c1930d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:15.720185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29d214c6-a806-4c72-9f07-64d766c1930d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:15.855944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-d43eb0ea-ad18-485c-a1bd-943785c1fa27 req-898e0766-dd9f-4ec0-98ff-0b3ac145633f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6076a6fa-ff7e-44a6-8924-889f991aeaac", "name": "network-vif-plugged", "status": "completed", "tag": "2100d119-58f3-406c-9e74-f7d95a4631d8"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:40:15.860729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:40:15.865545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-29d214c6-a806-4c72-9f07-64d766c1930d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:15.866111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d43eb0ea-ad18-485c-a1bd-943785c1fa27 req-898e0766-dd9f-4ec0-98ff-0b3ac145633f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:15.866568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d43eb0ea-ad18-485c-a1bd-943785c1fa27 req-898e0766-dd9f-4ec0-98ff-0b3ac145633f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:15.872962 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-29d214c6-a806-4c72-9f07-64d766c1930d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1363 microversion: 2.1 time: 0.169067 May 28 05:40:15.873738 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3602/7319] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:15 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:15.878089 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-d43eb0ea-ad18-485c-a1bd-943785c1fa27 req-898e0766-dd9f-4ec0-98ff-0b3ac145633f service nova] Creating event network-vif-plugged:2100d119-58f3-406c-9e74-f7d95a4631d8 for instance 6076a6fa-ff7e-44a6-8924-889f991aeaac on n-h1-843700-1 May 28 05:40:15.885041 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-d43eb0ea-ad18-485c-a1bd-943785c1fa27 req-898e0766-dd9f-4ec0-98ff-0b3ac145633f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034774 May 28 05:40:15.885637 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3718/7320] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:40:16.890013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f3f09b25-c004-44cf-9698-7d05cc3fa43e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:16.890672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f3f09b25-c004-44cf-9698-7d05cc3fa43e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:16.898598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3f09b25-c004-44cf-9698-7d05cc3fa43e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:16.899210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3f09b25-c004-44cf-9698-7d05cc3fa43e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:16.900007 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3f09b25-c004-44cf-9698-7d05cc3fa43e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:16.900460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3f09b25-c004-44cf-9698-7d05cc3fa43e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:17.032804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f3f09b25-c004-44cf-9698-7d05cc3fa43e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:17.040891 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f3f09b25-c004-44cf-9698-7d05cc3fa43e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1363 microversion: 2.1 time: 0.155141 May 28 05:40:17.041480 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3603/7321] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:16 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:18.060239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9aaa837a-6502-40cf-9afb-c74aebac5e15 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:18.060946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9aaa837a-6502-40cf-9afb-c74aebac5e15 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:18.068250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9aaa837a-6502-40cf-9afb-c74aebac5e15 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:18.068708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9aaa837a-6502-40cf-9afb-c74aebac5e15 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:18.069472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9aaa837a-6502-40cf-9afb-c74aebac5e15 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:18.069913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9aaa837a-6502-40cf-9afb-c74aebac5e15 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:18.199314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9aaa837a-6502-40cf-9afb-c74aebac5e15 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:18.206985 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9aaa837a-6502-40cf-9afb-c74aebac5e15 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1548 microversion: 2.1 time: 0.151968 May 28 05:40:18.207580 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3719/7322] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:18 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:18.224496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b03150c6-b9a7-44ad-8515-0a8e9e80f193 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:18.225017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b03150c6-b9a7-44ad-8515-0a8e9e80f193 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:18.232127 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b03150c6-b9a7-44ad-8515-0a8e9e80f193 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:18.232606 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b03150c6-b9a7-44ad-8515-0a8e9e80f193 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:18.233392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b03150c6-b9a7-44ad-8515-0a8e9e80f193 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:18.233850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b03150c6-b9a7-44ad-8515-0a8e9e80f193 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:18.313079 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b03150c6-b9a7-44ad-8515-0a8e9e80f193 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092443 May 28 05:40:18.313737 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3604/7323] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 05:40:18 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:40:19.904576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-6fec08bd-91e0-4afc-9c5f-3babbe0a1e8f req-14692e9f-0952-45fd-bd25-ba2b40e9e3ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6076a6fa-ff7e-44a6-8924-889f991aeaac", "tag": "2100d119-58f3-406c-9e74-f7d95a4631d8"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:40:19.914682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-6fec08bd-91e0-4afc-9c5f-3babbe0a1e8f req-14692e9f-0952-45fd-bd25-ba2b40e9e3ed service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:19.915251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-6fec08bd-91e0-4afc-9c5f-3babbe0a1e8f req-14692e9f-0952-45fd-bd25-ba2b40e9e3ed service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:19.927740 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-6fec08bd-91e0-4afc-9c5f-3babbe0a1e8f req-14692e9f-0952-45fd-bd25-ba2b40e9e3ed service nova] Creating event network-changed:2100d119-58f3-406c-9e74-f7d95a4631d8 for instance 6076a6fa-ff7e-44a6-8924-889f991aeaac on n-h1-843700-1 May 28 05:40:19.932775 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-6fec08bd-91e0-4afc-9c5f-3babbe0a1e8f req-14692e9f-0952-45fd-bd25-ba2b40e9e3ed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032140 May 28 05:40:19.933696 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3720/7324] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:40:54.130237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=9 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:40:54.131175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=26 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:40:54.135152 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-09698088-346e-47b8-9ce2-41372feba684 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:40:54.141363 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09698088-346e-47b8-9ce2-41372feba684 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:54.141826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09698088-346e-47b8-9ce2-41372feba684 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:54.163782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-09698088-346e-47b8-9ce2-41372feba684 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Going to try to stop instance {{(pid=126043) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 05:40:54.344435 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-09698088-346e-47b8-9ce2-41372feba684 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "POST /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac/action" status: 202 len: 0 microversion: 2.1 time: 0.215823 May 28 05:40:54.345153 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3605/7325] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:40:54 2022] POST /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:40:54.352253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=7 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:40:54.353012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=24 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:40:54.357173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bb21f22d-8173-4e0c-b1fa-4956393b2d7b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:54.357886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bb21f22d-8173-4e0c-b1fa-4956393b2d7b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:54.364093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb21f22d-8173-4e0c-b1fa-4956393b2d7b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:54.364557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb21f22d-8173-4e0c-b1fa-4956393b2d7b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:54.365336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb21f22d-8173-4e0c-b1fa-4956393b2d7b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:54.366357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb21f22d-8173-4e0c-b1fa-4956393b2d7b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:54.497031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bb21f22d-8173-4e0c-b1fa-4956393b2d7b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:54.504687 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bb21f22d-8173-4e0c-b1fa-4956393b2d7b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1677 microversion: 2.1 time: 0.155061 May 28 05:40:54.505272 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3721/7326] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:54 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:55.525731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-32b365bc-a945-4c98-8382-b4a0e61b00de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:55.526424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-32b365bc-a945-4c98-8382-b4a0e61b00de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:55.532963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-32b365bc-a945-4c98-8382-b4a0e61b00de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:55.533428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-32b365bc-a945-4c98-8382-b4a0e61b00de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:55.534203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-32b365bc-a945-4c98-8382-b4a0e61b00de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:55.534676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-32b365bc-a945-4c98-8382-b4a0e61b00de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:55.664007 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-32b365bc-a945-4c98-8382-b4a0e61b00de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:55.671645 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-32b365bc-a945-4c98-8382-b4a0e61b00de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1677 microversion: 2.1 time: 0.151795 May 28 05:40:55.672222 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3606/7327] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:55 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:56.689116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-568fa5e5-c466-4105-b6c7-b43e4d33257e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:56.689735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-568fa5e5-c466-4105-b6c7-b43e4d33257e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:56.696736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-568fa5e5-c466-4105-b6c7-b43e4d33257e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:56.697192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-568fa5e5-c466-4105-b6c7-b43e4d33257e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:56.697957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-568fa5e5-c466-4105-b6c7-b43e4d33257e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:56.698406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-568fa5e5-c466-4105-b6c7-b43e4d33257e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:56.829986 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-568fa5e5-c466-4105-b6c7-b43e4d33257e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:56.838076 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-568fa5e5-c466-4105-b6c7-b43e4d33257e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1677 microversion: 2.1 time: 0.152911 May 28 05:40:56.838655 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3722/7328] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:56 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:40:57.856257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6f90d30b-4b0f-4ef3-bcd8-a2d7a2ac31f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:57.856888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6f90d30b-4b0f-4ef3-bcd8-a2d7a2ac31f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:57.863845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f90d30b-4b0f-4ef3-bcd8-a2d7a2ac31f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:57.864320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f90d30b-4b0f-4ef3-bcd8-a2d7a2ac31f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:57.865108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f90d30b-4b0f-4ef3-bcd8-a2d7a2ac31f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:57.865569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f90d30b-4b0f-4ef3-bcd8-a2d7a2ac31f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:57.995131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6f90d30b-4b0f-4ef3-bcd8-a2d7a2ac31f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:58.002639 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6f90d30b-4b0f-4ef3-bcd8-a2d7a2ac31f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1677 microversion: 2.1 time: 0.150338 May 28 05:40:58.003252 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3607/7329] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:57 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:40:59.020222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dcbfdbff-b360-42db-b3e5-2d5e6112cf88 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:40:59.020757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dcbfdbff-b360-42db-b3e5-2d5e6112cf88 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:40:59.027634 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dcbfdbff-b360-42db-b3e5-2d5e6112cf88 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:59.028087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dcbfdbff-b360-42db-b3e5-2d5e6112cf88 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:59.028852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dcbfdbff-b360-42db-b3e5-2d5e6112cf88 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:40:59.029289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dcbfdbff-b360-42db-b3e5-2d5e6112cf88 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:40:59.163486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dcbfdbff-b360-42db-b3e5-2d5e6112cf88 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:40:59.171142 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dcbfdbff-b360-42db-b3e5-2d5e6112cf88 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1677 microversion: 2.1 time: 0.154872 May 28 05:40:59.171717 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3723/7330] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:40:59 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:00.188978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-47b3cd70-de0b-449f-a105-ee06b6fba589 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:00.189634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-47b3cd70-de0b-449f-a105-ee06b6fba589 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:00.197359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47b3cd70-de0b-449f-a105-ee06b6fba589 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:00.197829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47b3cd70-de0b-449f-a105-ee06b6fba589 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:00.198654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47b3cd70-de0b-449f-a105-ee06b6fba589 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:00.199147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47b3cd70-de0b-449f-a105-ee06b6fba589 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:00.330380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-47b3cd70-de0b-449f-a105-ee06b6fba589 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:00.338549 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-47b3cd70-de0b-449f-a105-ee06b6fba589 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1677 microversion: 2.1 time: 0.153544 May 28 05:41:00.339160 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3608/7331] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:00 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:01.356695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3121d4a3-c177-4a92-b35b-9ddedec107e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:01.357322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3121d4a3-c177-4a92-b35b-9ddedec107e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:01.364298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3121d4a3-c177-4a92-b35b-9ddedec107e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:01.364759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3121d4a3-c177-4a92-b35b-9ddedec107e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:01.365528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3121d4a3-c177-4a92-b35b-9ddedec107e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:01.365976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3121d4a3-c177-4a92-b35b-9ddedec107e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:01.496359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3121d4a3-c177-4a92-b35b-9ddedec107e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:01.504026 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3121d4a3-c177-4a92-b35b-9ddedec107e1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1677 microversion: 2.1 time: 0.151524 May 28 05:41:01.504617 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3724/7332] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:01 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:02.521810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e0aa6ad1-2146-4825-b6f5-895a0531d3b5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:02.522394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e0aa6ad1-2146-4825-b6f5-895a0531d3b5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:02.529477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0aa6ad1-2146-4825-b6f5-895a0531d3b5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:02.529953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0aa6ad1-2146-4825-b6f5-895a0531d3b5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:02.530828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0aa6ad1-2146-4825-b6f5-895a0531d3b5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:02.531316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0aa6ad1-2146-4825-b6f5-895a0531d3b5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:02.664482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e0aa6ad1-2146-4825-b6f5-895a0531d3b5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:02.671991 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e0aa6ad1-2146-4825-b6f5-895a0531d3b5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1677 microversion: 2.1 time: 0.154240 May 28 05:41:02.672570 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3609/7333] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:02 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:03.689269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ff255ec4-13fe-4f84-bbec-f8f2c53f8d3d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:03.689889 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ff255ec4-13fe-4f84-bbec-f8f2c53f8d3d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:03.697413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff255ec4-13fe-4f84-bbec-f8f2c53f8d3d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:03.697873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff255ec4-13fe-4f84-bbec-f8f2c53f8d3d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:03.698649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff255ec4-13fe-4f84-bbec-f8f2c53f8d3d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:03.699127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff255ec4-13fe-4f84-bbec-f8f2c53f8d3d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:03.825426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ff255ec4-13fe-4f84-bbec-f8f2c53f8d3d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:03.832999 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ff255ec4-13fe-4f84-bbec-f8f2c53f8d3d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1677 microversion: 2.1 time: 0.147721 May 28 05:41:03.833580 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3725/7334] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:03 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:04.850327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a9130bfa-d499-4083-802c-dd2b881ca13f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:04.850888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a9130bfa-d499-4083-802c-dd2b881ca13f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:04.857970 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a9130bfa-d499-4083-802c-dd2b881ca13f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:04.858439 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a9130bfa-d499-4083-802c-dd2b881ca13f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:04.859249 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a9130bfa-d499-4083-802c-dd2b881ca13f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:04.859703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a9130bfa-d499-4083-802c-dd2b881ca13f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:04.992160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a9130bfa-d499-4083-802c-dd2b881ca13f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:04.999640 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a9130bfa-d499-4083-802c-dd2b881ca13f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1677 microversion: 2.1 time: 0.153398 May 28 05:41:05.000441 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3610/7335] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:04 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:06.017776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d3b80122-33e9-4906-942f-95eb1bd4afd8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:06.018395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d3b80122-33e9-4906-942f-95eb1bd4afd8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:06.026112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3b80122-33e9-4906-942f-95eb1bd4afd8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:06.026570 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3b80122-33e9-4906-942f-95eb1bd4afd8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:06.027380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3b80122-33e9-4906-942f-95eb1bd4afd8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:06.027829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d3b80122-33e9-4906-942f-95eb1bd4afd8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:06.160869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d3b80122-33e9-4906-942f-95eb1bd4afd8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:06.163073 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d3b80122-33e9-4906-942f-95eb1bd4afd8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1677 microversion: 2.1 time: 0.149139 May 28 05:41:06.163655 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3726/7336] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:06 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:07.180316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-549fb92a-9b06-4469-ad53-56c136bbf670 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:07.180945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-549fb92a-9b06-4469-ad53-56c136bbf670 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:07.187919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-549fb92a-9b06-4469-ad53-56c136bbf670 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:07.188381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-549fb92a-9b06-4469-ad53-56c136bbf670 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:07.189149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-549fb92a-9b06-4469-ad53-56c136bbf670 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:07.189595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-549fb92a-9b06-4469-ad53-56c136bbf670 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:07.321330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-549fb92a-9b06-4469-ad53-56c136bbf670 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:07.329066 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-549fb92a-9b06-4469-ad53-56c136bbf670 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1677 microversion: 2.1 time: 0.152702 May 28 05:41:07.329653 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3611/7337] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:07 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:08.348366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7f639b3e-816f-491b-9e59-f048cdcf860e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:08.349008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7f639b3e-816f-491b-9e59-f048cdcf860e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:08.356176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f639b3e-816f-491b-9e59-f048cdcf860e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:08.356754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f639b3e-816f-491b-9e59-f048cdcf860e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:08.357524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f639b3e-816f-491b-9e59-f048cdcf860e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:08.357989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7f639b3e-816f-491b-9e59-f048cdcf860e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:08.485799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7f639b3e-816f-491b-9e59-f048cdcf860e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:08.493482 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7f639b3e-816f-491b-9e59-f048cdcf860e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1677 microversion: 2.1 time: 0.150152 May 28 05:41:08.494031 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3727/7338] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:08 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:09.509693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-85284112-65a5-4564-bd6a-4c544f5b1941 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:09.510334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-85284112-65a5-4564-bd6a-4c544f5b1941 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:09.517587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85284112-65a5-4564-bd6a-4c544f5b1941 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:09.518056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85284112-65a5-4564-bd6a-4c544f5b1941 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:09.518836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85284112-65a5-4564-bd6a-4c544f5b1941 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:09.519317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85284112-65a5-4564-bd6a-4c544f5b1941 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:09.648833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-85284112-65a5-4564-bd6a-4c544f5b1941 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:09.656439 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-85284112-65a5-4564-bd6a-4c544f5b1941 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1677 microversion: 2.1 time: 0.150635 May 28 05:41:09.657023 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3612/7339] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:09 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:10.677800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-918a14e6-5e95-4eaa-abba-ea3cd895e7da tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:10.678425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-918a14e6-5e95-4eaa-abba-ea3cd895e7da tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:10.685416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-918a14e6-5e95-4eaa-abba-ea3cd895e7da tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:10.685877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-918a14e6-5e95-4eaa-abba-ea3cd895e7da tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:10.686642 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-918a14e6-5e95-4eaa-abba-ea3cd895e7da tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:10.687123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-918a14e6-5e95-4eaa-abba-ea3cd895e7da tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:10.819547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-918a14e6-5e95-4eaa-abba-ea3cd895e7da tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:10.827277 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-918a14e6-5e95-4eaa-abba-ea3cd895e7da tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1654 microversion: 2.1 time: 0.153336 May 28 05:41:10.827870 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3728/7340] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:10 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1654 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:10.844782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9edabe15-6316-4d56-a902-03473353cdb0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:41:10.845818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9edabe15-6316-4d56-a902-03473353cdb0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:10.852781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9edabe15-6316-4d56-a902-03473353cdb0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:10.853242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9edabe15-6316-4d56-a902-03473353cdb0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:10.854011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9edabe15-6316-4d56-a902-03473353cdb0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:10.854460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9edabe15-6316-4d56-a902-03473353cdb0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:10.882838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9edabe15-6316-4d56-a902-03473353cdb0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:10.888924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9edabe15-6316-4d56-a902-03473353cdb0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Old instance type m1.heat2, new instance type m1.heat {{(pid=126043) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 05:41:10.895076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-9edabe15-6316-4d56-a902-03473353cdb0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:41:10.898917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-9edabe15-6316-4d56-a902-03473353cdb0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:41:10.898917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-9edabe15-6316-4d56-a902-03473353cdb0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:41:10.898917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-9edabe15-6316-4d56-a902-03473353cdb0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:41:10.898917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-9edabe15-6316-4d56-a902-03473353cdb0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:41:11.059278 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9edabe15-6316-4d56-a902-03473353cdb0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "POST /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac/action" status: 202 len: 0 microversion: 2.1 time: 0.218379 May 28 05:41:11.059896 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3613/7341] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:41:10 2022] POST /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:41:11.068197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-34f627bf-212d-49cd-8f9e-75b2730e0f18 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:11.068794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-34f627bf-212d-49cd-8f9e-75b2730e0f18 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:11.075494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-34f627bf-212d-49cd-8f9e-75b2730e0f18 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:11.076152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-34f627bf-212d-49cd-8f9e-75b2730e0f18 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:11.076946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-34f627bf-212d-49cd-8f9e-75b2730e0f18 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:11.077384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-34f627bf-212d-49cd-8f9e-75b2730e0f18 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:11.209167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-34f627bf-212d-49cd-8f9e-75b2730e0f18 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:11.216972 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-34f627bf-212d-49cd-8f9e-75b2730e0f18 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1677 microversion: 2.1 time: 0.152734 May 28 05:41:11.218026 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3729/7342] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:11 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:41:12.236072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d9236cea-4891-4d37-b080-622299b2afdd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:12.236639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d9236cea-4891-4d37-b080-622299b2afdd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:12.242740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d9236cea-4891-4d37-b080-622299b2afdd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:12.247638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d9236cea-4891-4d37-b080-622299b2afdd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:12.247638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d9236cea-4891-4d37-b080-622299b2afdd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:12.247638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d9236cea-4891-4d37-b080-622299b2afdd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:12.379710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d9236cea-4891-4d37-b080-622299b2afdd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:12.388126 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d9236cea-4891-4d37-b080-622299b2afdd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1677 microversion: 2.1 time: 0.156936 May 28 05:41:12.388718 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3614/7343] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:12 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:12.621361 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:41:12.621946 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 05:41:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:41:13.405612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9bec3c2b-96f9-491d-a725-1149fe6f18c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:13.406149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9bec3c2b-96f9-491d-a725-1149fe6f18c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:13.413108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9bec3c2b-96f9-491d-a725-1149fe6f18c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:13.414140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9bec3c2b-96f9-491d-a725-1149fe6f18c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:13.414924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9bec3c2b-96f9-491d-a725-1149fe6f18c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:13.415397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9bec3c2b-96f9-491d-a725-1149fe6f18c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:13.613719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9bec3c2b-96f9-491d-a725-1149fe6f18c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:13.621453 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9bec3c2b-96f9-491d-a725-1149fe6f18c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1677 microversion: 2.1 time: 0.219921 May 28 05:41:13.625409 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3730/7344] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:13 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:14.638831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bf46690d-937d-4b0e-a441-5492fb4cda6c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:14.639521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bf46690d-937d-4b0e-a441-5492fb4cda6c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:14.646332 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf46690d-937d-4b0e-a441-5492fb4cda6c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:14.646790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf46690d-937d-4b0e-a441-5492fb4cda6c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:14.648096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf46690d-937d-4b0e-a441-5492fb4cda6c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:14.648544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bf46690d-937d-4b0e-a441-5492fb4cda6c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:14.780131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bf46690d-937d-4b0e-a441-5492fb4cda6c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:14.787540 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bf46690d-937d-4b0e-a441-5492fb4cda6c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1682 microversion: 2.1 time: 0.152997 May 28 05:41:14.788111 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3615/7345] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:14 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:15.805502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cf5941fa-a548-4df9-82cb-8ea45760af87 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:15.806119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cf5941fa-a548-4df9-82cb-8ea45760af87 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:15.813357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf5941fa-a548-4df9-82cb-8ea45760af87 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:15.813814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf5941fa-a548-4df9-82cb-8ea45760af87 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:15.814584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf5941fa-a548-4df9-82cb-8ea45760af87 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:15.815050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf5941fa-a548-4df9-82cb-8ea45760af87 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:15.949006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cf5941fa-a548-4df9-82cb-8ea45760af87 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:15.956815 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cf5941fa-a548-4df9-82cb-8ea45760af87 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1682 microversion: 2.1 time: 0.155915 May 28 05:41:15.957395 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3731/7346] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:15 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:16.628837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-f467ce8c-4368-4cd7-9aae-a97e90c32adb req-86ebc0c5-5a5d-4572-9990-df05ba6995eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6076a6fa-ff7e-44a6-8924-889f991aeaac", "name": "network-vif-unplugged", "status": "completed", "tag": "2100d119-58f3-406c-9e74-f7d95a4631d8"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:41:16.638820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f467ce8c-4368-4cd7-9aae-a97e90c32adb req-86ebc0c5-5a5d-4572-9990-df05ba6995eb service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:16.639317 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f467ce8c-4368-4cd7-9aae-a97e90c32adb req-86ebc0c5-5a5d-4572-9990-df05ba6995eb service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:16.654688 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-f467ce8c-4368-4cd7-9aae-a97e90c32adb req-86ebc0c5-5a5d-4572-9990-df05ba6995eb service nova] Creating event network-vif-unplugged:2100d119-58f3-406c-9e74-f7d95a4631d8 for instance 6076a6fa-ff7e-44a6-8924-889f991aeaac on n-h2-843700-1 May 28 05:41:16.660032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-f467ce8c-4368-4cd7-9aae-a97e90c32adb req-86ebc0c5-5a5d-4572-9990-df05ba6995eb service nova] Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:41:16.671114 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-f467ce8c-4368-4cd7-9aae-a97e90c32adb req-86ebc0c5-5a5d-4572-9990-df05ba6995eb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046046 May 28 05:41:16.671738 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3616/7347] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:41:16.973703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-187ded94-7552-4f4f-b40d-ae353aead9fe tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:16.974322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-187ded94-7552-4f4f-b40d-ae353aead9fe tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:16.981776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-187ded94-7552-4f4f-b40d-ae353aead9fe tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:16.982235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-187ded94-7552-4f4f-b40d-ae353aead9fe tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:16.983026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-187ded94-7552-4f4f-b40d-ae353aead9fe tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:16.984043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-187ded94-7552-4f4f-b40d-ae353aead9fe tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:17.161799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-187ded94-7552-4f4f-b40d-ae353aead9fe tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:17.169610 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-187ded94-7552-4f4f-b40d-ae353aead9fe tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1681 microversion: 2.1 time: 0.199843 May 28 05:41:17.170186 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3732/7348] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:16 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1681 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:18.189281 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cd1a9c90-3d06-42bd-8789-4029bdcb0e1a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:18.189928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cd1a9c90-3d06-42bd-8789-4029bdcb0e1a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:18.196216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd1a9c90-3d06-42bd-8789-4029bdcb0e1a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:18.196676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd1a9c90-3d06-42bd-8789-4029bdcb0e1a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:18.197476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd1a9c90-3d06-42bd-8789-4029bdcb0e1a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:18.197922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd1a9c90-3d06-42bd-8789-4029bdcb0e1a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:18.327816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cd1a9c90-3d06-42bd-8789-4029bdcb0e1a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:18.335799 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cd1a9c90-3d06-42bd-8789-4029bdcb0e1a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1679 microversion: 2.1 time: 0.151219 May 28 05:41:18.336367 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3617/7349] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:18 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:18.685084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-f870e6c2-00df-4664-beb2-717a8e9cf21e req-9fa65e71-923d-49f6-a1fb-232e76924609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6076a6fa-ff7e-44a6-8924-889f991aeaac", "tag": "2100d119-58f3-406c-9e74-f7d95a4631d8"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:41:18.693965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f870e6c2-00df-4664-beb2-717a8e9cf21e req-9fa65e71-923d-49f6-a1fb-232e76924609 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:18.694913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f870e6c2-00df-4664-beb2-717a8e9cf21e req-9fa65e71-923d-49f6-a1fb-232e76924609 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:18.706619 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-f870e6c2-00df-4664-beb2-717a8e9cf21e req-9fa65e71-923d-49f6-a1fb-232e76924609 service nova] Creating event network-changed:2100d119-58f3-406c-9e74-f7d95a4631d8 for instance 6076a6fa-ff7e-44a6-8924-889f991aeaac on n-h2-843700-1 May 28 05:41:18.712705 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-f870e6c2-00df-4664-beb2-717a8e9cf21e req-9fa65e71-923d-49f6-a1fb-232e76924609 service nova] Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:41:18.723384 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-f870e6c2-00df-4664-beb2-717a8e9cf21e req-9fa65e71-923d-49f6-a1fb-232e76924609 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041970 May 28 05:41:18.723973 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3733/7350] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:41:19.353050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-389a8876-b80d-4132-811a-c5f3e3b4f3f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:19.353710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-389a8876-b80d-4132-811a-c5f3e3b4f3f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:19.360800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-389a8876-b80d-4132-811a-c5f3e3b4f3f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:19.361288 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-389a8876-b80d-4132-811a-c5f3e3b4f3f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:19.362096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-389a8876-b80d-4132-811a-c5f3e3b4f3f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:19.362557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-389a8876-b80d-4132-811a-c5f3e3b4f3f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:19.546525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-389a8876-b80d-4132-811a-c5f3e3b4f3f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:19.554869 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-389a8876-b80d-4132-811a-c5f3e3b4f3f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1675 microversion: 2.1 time: 0.206283 May 28 05:41:19.555699 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3618/7351] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:19 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1675 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:19.573457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b2be717e-88f4-4f62-a9fe-85a156c84ba1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:41:19.574121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b2be717e-88f4-4f62-a9fe-85a156c84ba1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:19.581224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b2be717e-88f4-4f62-a9fe-85a156c84ba1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:19.581224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b2be717e-88f4-4f62-a9fe-85a156c84ba1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:19.582037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b2be717e-88f4-4f62-a9fe-85a156c84ba1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:19.582494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b2be717e-88f4-4f62-a9fe-85a156c84ba1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:19.774917 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b2be717e-88f4-4f62-a9fe-85a156c84ba1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "POST /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac/action" status: 204 len: 0 microversion: 2.1 time: 0.205620 May 28 05:41:19.776044 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3734/7352] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:41:19 2022] POST /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac/action => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:41:19.784758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ba80cd3c-d485-4886-acff-d5a90099bc29 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:19.785388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ba80cd3c-d485-4886-acff-d5a90099bc29 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:19.796744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba80cd3c-d485-4886-acff-d5a90099bc29 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:19.797223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba80cd3c-d485-4886-acff-d5a90099bc29 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:19.798034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba80cd3c-d485-4886-acff-d5a90099bc29 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:19.798487 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ba80cd3c-d485-4886-acff-d5a90099bc29 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:19.818162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:41:19.968826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ba80cd3c-d485-4886-acff-d5a90099bc29 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:19.977077 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ba80cd3c-d485-4886-acff-d5a90099bc29 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1675 microversion: 2.1 time: 0.196813 May 28 05:41:19.977786 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3619/7353] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:19 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1675 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:20.996341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-92f6f918-abf4-4230-b0a4-45e835c89ae7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:20.997056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-92f6f918-abf4-4230-b0a4-45e835c89ae7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:21.004489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-92f6f918-abf4-4230-b0a4-45e835c89ae7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:21.004956 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-92f6f918-abf4-4230-b0a4-45e835c89ae7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:21.005741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-92f6f918-abf4-4230-b0a4-45e835c89ae7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:21.006186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-92f6f918-abf4-4230-b0a4-45e835c89ae7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:21.139941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-92f6f918-abf4-4230-b0a4-45e835c89ae7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:21.147623 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-92f6f918-abf4-4230-b0a4-45e835c89ae7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1675 microversion: 2.1 time: 0.156433 May 28 05:41:21.148247 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3735/7354] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:20 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:22.164736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0ec400f2-01b9-4fc9-a49f-a46a1714a2c5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:22.165368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0ec400f2-01b9-4fc9-a49f-a46a1714a2c5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:22.172205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ec400f2-01b9-4fc9-a49f-a46a1714a2c5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:22.172708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ec400f2-01b9-4fc9-a49f-a46a1714a2c5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:22.173479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ec400f2-01b9-4fc9-a49f-a46a1714a2c5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:22.173931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ec400f2-01b9-4fc9-a49f-a46a1714a2c5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:22.308451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0ec400f2-01b9-4fc9-a49f-a46a1714a2c5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:22.316314 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0ec400f2-01b9-4fc9-a49f-a46a1714a2c5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1654 microversion: 2.1 time: 0.155697 May 28 05:41:22.316898 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3620/7355] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:22 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:22.333273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-96795a7f-052c-49a9-ba1c-b055a131db47 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:22.333892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-96795a7f-052c-49a9-ba1c-b055a131db47 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:22.341037 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96795a7f-052c-49a9-ba1c-b055a131db47 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:22.341497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96795a7f-052c-49a9-ba1c-b055a131db47 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:22.342266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96795a7f-052c-49a9-ba1c-b055a131db47 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:22.342710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-96795a7f-052c-49a9-ba1c-b055a131db47 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:22.475105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-96795a7f-052c-49a9-ba1c-b055a131db47 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:22.478035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:41:22.484070 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-96795a7f-052c-49a9-ba1c-b055a131db47 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1654 microversion: 2.1 time: 0.154701 May 28 05:41:22.484650 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3736/7356] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:22 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1654 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:22.501379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9a8d49af-9a23-410a-af79-3cd123eab530 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:41:22.507499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9a8d49af-9a23-410a-af79-3cd123eab530 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:22.507975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9a8d49af-9a23-410a-af79-3cd123eab530 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:22.531571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9a8d49af-9a23-410a-af79-3cd123eab530 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Going to try to start instance {{(pid=126043) start /opt/stack/nova/nova/compute/api.py:2730}} May 28 05:41:22.646355 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9a8d49af-9a23-410a-af79-3cd123eab530 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "POST /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac/action" status: 202 len: 0 microversion: 2.1 time: 0.148705 May 28 05:41:22.646982 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3621/7357] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:41:22 2022] POST /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:41:22.655575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d0d81042-7800-4867-a3ae-675193343ec8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:22.656847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d0d81042-7800-4867-a3ae-675193343ec8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:22.663552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d0d81042-7800-4867-a3ae-675193343ec8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:22.664060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d0d81042-7800-4867-a3ae-675193343ec8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:22.664835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d0d81042-7800-4867-a3ae-675193343ec8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:22.665279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d0d81042-7800-4867-a3ae-675193343ec8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:22.804623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d0d81042-7800-4867-a3ae-675193343ec8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:22.812967 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d0d81042-7800-4867-a3ae-675193343ec8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1663 microversion: 2.1 time: 0.161706 May 28 05:41:22.823368 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3737/7358] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:22 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1663 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:41:23.043843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-149f46eb-b346-47df-b14c-ce6e4963ba9e req-4b6c1702-f38d-4a44-bcef-e6a716b4d688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6076a6fa-ff7e-44a6-8924-889f991aeaac", "name": "network-vif-plugged", "status": "completed", "tag": "2100d119-58f3-406c-9e74-f7d95a4631d8"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:41:23.052580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-149f46eb-b346-47df-b14c-ce6e4963ba9e req-4b6c1702-f38d-4a44-bcef-e6a716b4d688 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:23.053125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-149f46eb-b346-47df-b14c-ce6e4963ba9e req-4b6c1702-f38d-4a44-bcef-e6a716b4d688 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:23.064742 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-149f46eb-b346-47df-b14c-ce6e4963ba9e req-4b6c1702-f38d-4a44-bcef-e6a716b4d688 service nova] Creating event network-vif-plugged:2100d119-58f3-406c-9e74-f7d95a4631d8 for instance 6076a6fa-ff7e-44a6-8924-889f991aeaac on n-h2-843700-1 May 28 05:41:23.069952 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-149f46eb-b346-47df-b14c-ce6e4963ba9e req-4b6c1702-f38d-4a44-bcef-e6a716b4d688 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087191 May 28 05:41:23.070602 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3622/7359] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:41:23.831163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-abb4e6b3-6be5-4b0a-bdcc-ac1d5187251a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:23.831769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-abb4e6b3-6be5-4b0a-bdcc-ac1d5187251a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:23.838774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abb4e6b3-6be5-4b0a-bdcc-ac1d5187251a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:23.839260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abb4e6b3-6be5-4b0a-bdcc-ac1d5187251a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:23.840034 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abb4e6b3-6be5-4b0a-bdcc-ac1d5187251a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:23.840477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abb4e6b3-6be5-4b0a-bdcc-ac1d5187251a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:23.973827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-abb4e6b3-6be5-4b0a-bdcc-ac1d5187251a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:23.982076 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-abb4e6b3-6be5-4b0a-bdcc-ac1d5187251a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1663 microversion: 2.1 time: 0.154859 May 28 05:41:23.982654 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3738/7360] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:23 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:25.001802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-66254282-eca5-404a-ab3f-312d416614d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:25.002441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-66254282-eca5-404a-ab3f-312d416614d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:25.004489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=41 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:41:25.010105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-66254282-eca5-404a-ab3f-312d416614d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:25.010578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-66254282-eca5-404a-ab3f-312d416614d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:25.011406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-66254282-eca5-404a-ab3f-312d416614d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:25.012118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-66254282-eca5-404a-ab3f-312d416614d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:25.144824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-66254282-eca5-404a-ab3f-312d416614d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:25.152479 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-66254282-eca5-404a-ab3f-312d416614d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1667 microversion: 2.1 time: 0.155874 May 28 05:41:25.153063 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3623/7361] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:24 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:25.169558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ffdce406-fcc7-4941-80f7-ae6a0d7cf6db tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:25.170100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ffdce406-fcc7-4941-80f7-ae6a0d7cf6db tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:25.171935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=37 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:41:25.176646 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ffdce406-fcc7-4941-80f7-ae6a0d7cf6db tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:25.177091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ffdce406-fcc7-4941-80f7-ae6a0d7cf6db tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:25.177848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ffdce406-fcc7-4941-80f7-ae6a0d7cf6db tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:25.178315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ffdce406-fcc7-4941-80f7-ae6a0d7cf6db tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:25.203877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ffdce406-fcc7-4941-80f7-ae6a0d7cf6db tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:41:25.454851 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ffdce406-fcc7-4941-80f7-ae6a0d7cf6db tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 204 len: 0 microversion: 2.1 time: 0.289199 May 28 05:41:25.455492 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3739/7362] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:41:25 2022] DELETE /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:41:25.463839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-81ffafe6-d0c3-4bee-a03d-7b7489e2e49f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:25.464569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-81ffafe6-d0c3-4bee-a03d-7b7489e2e49f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:25.470766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81ffafe6-d0c3-4bee-a03d-7b7489e2e49f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:25.471278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81ffafe6-d0c3-4bee-a03d-7b7489e2e49f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:25.472064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81ffafe6-d0c3-4bee-a03d-7b7489e2e49f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:25.472525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81ffafe6-d0c3-4bee-a03d-7b7489e2e49f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:25.603256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-81ffafe6-d0c3-4bee-a03d-7b7489e2e49f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:25.610809 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-81ffafe6-d0c3-4bee-a03d-7b7489e2e49f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1673 microversion: 2.1 time: 0.150862 May 28 05:41:25.611422 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3624/7363] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:25 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:26.629550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ceeceba2-8537-4e6e-b612-41621780e1e0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:26.630254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ceeceba2-8537-4e6e-b612-41621780e1e0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:26.638057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ceeceba2-8537-4e6e-b612-41621780e1e0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:26.638513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ceeceba2-8537-4e6e-b612-41621780e1e0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:26.639305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ceeceba2-8537-4e6e-b612-41621780e1e0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:26.639776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ceeceba2-8537-4e6e-b612-41621780e1e0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:26.794920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ceeceba2-8537-4e6e-b612-41621780e1e0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:26.802614 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ceeceba2-8537-4e6e-b612-41621780e1e0 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1673 microversion: 2.1 time: 0.177429 May 28 05:41:26.803222 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3740/7364] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:26 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:41:27.642708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-ff7f51b8-1176-4358-b5ed-902f43c0d6d4 req-14352947-ad50-4d74-8951-f8893ebdee30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6076a6fa-ff7e-44a6-8924-889f991aeaac", "name": "network-vif-deleted", "tag": "2100d119-58f3-406c-9e74-f7d95a4631d8"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:41:27.652275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ff7f51b8-1176-4358-b5ed-902f43c0d6d4 req-14352947-ad50-4d74-8951-f8893ebdee30 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:27.654776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ff7f51b8-1176-4358-b5ed-902f43c0d6d4 req-14352947-ad50-4d74-8951-f8893ebdee30 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:27.663913 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-ff7f51b8-1176-4358-b5ed-902f43c0d6d4 req-14352947-ad50-4d74-8951-f8893ebdee30 service nova] Creating event network-vif-deleted:2100d119-58f3-406c-9e74-f7d95a4631d8 for instance 6076a6fa-ff7e-44a6-8924-889f991aeaac on n-h2-843700-1 May 28 05:41:27.669275 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-ff7f51b8-1176-4358-b5ed-902f43c0d6d4 req-14352947-ad50-4d74-8951-f8893ebdee30 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030064 May 28 05:41:27.669900 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3625/7365] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:41:27.820504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-50693015-ae72-447d-bdd6-d76d37e2458e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:27.821384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-50693015-ae72-447d-bdd6-d76d37e2458e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:27.828694 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50693015-ae72-447d-bdd6-d76d37e2458e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:27.829177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50693015-ae72-447d-bdd6-d76d37e2458e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:27.830216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50693015-ae72-447d-bdd6-d76d37e2458e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:27.830663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-50693015-ae72-447d-bdd6-d76d37e2458e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:27.895901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-50693015-ae72-447d-bdd6-d76d37e2458e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:27.903694 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-50693015-ae72-447d-bdd6-d76d37e2458e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 200 len: 1322 microversion: 2.1 time: 0.087429 May 28 05:41:27.904753 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3741/7366] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:27 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 1322 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:28.922924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5ebee244-2b72-4bfa-b151-d1334440f982 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:28.923854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5ebee244-2b72-4bfa-b151-d1334440f982 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:28.930701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ebee244-2b72-4bfa-b151-d1334440f982 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:28.931201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ebee244-2b72-4bfa-b151-d1334440f982 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:28.931975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ebee244-2b72-4bfa-b151-d1334440f982 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:28.932426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ebee244-2b72-4bfa-b151-d1334440f982 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:28.946698 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-5ebee244-2b72-4bfa-b151-d1334440f982 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] HTTP exception thrown: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5ebee244-2b72-4bfa-b151-d1334440f982 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Request method failure captured: May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac HTTP/1.1 May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbV8EVqnsXJ4v8PKLpKbSN-UMKIcSy3KmkP6QXvwdRFm704ALR4cl_gP9SPkmpV3xU_0jRk0mImnS7YmIQnzqGR8Czb30Vc2tEyE75b992FPEefKyODL7t_FCesR9j2FYAAhL0AvtL4GoBrh1ex3V5-HI_FVJL-8Aq7U-X9LX1Ide1Y May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerActionsTestJSON-1722172964 May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerActionsTestJSON-1722172964-project May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 1ffd8cb46a064f39a7b4468292d57b42 May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerActionsTestJSON-1722172964-project May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '6076a6fa-ff7e-44a6-8924-889f991aeaac'} May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:41:28.948351 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:41:28.953965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:41:28.953965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:41:28.953965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:41:28.953965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:41:28.953965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:41:28.953965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. May 28 05:41:28.953965 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:41:28.953965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5ebee244-2b72-4bfa-b151-d1334440f982 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Returning 404 to user: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:41:28.953965 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5ebee244-2b72-4bfa-b151-d1334440f982 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 404 len: 111 microversion: 2.1 time: 0.032041 May 28 05:41:28.953965 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3626/7367] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:28 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:41:28.967536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e975f67c-e71c-4052-8000-0fb5a44cea83 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:28.968162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e975f67c-e71c-4052-8000-0fb5a44cea83 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:28.975172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e975f67c-e71c-4052-8000-0fb5a44cea83 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:28.975847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e975f67c-e71c-4052-8000-0fb5a44cea83 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:28.976618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e975f67c-e71c-4052-8000-0fb5a44cea83 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:28.977064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e975f67c-e71c-4052-8000-0fb5a44cea83 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:28.990279 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-e975f67c-e71c-4052-8000-0fb5a44cea83 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] HTTP exception thrown: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e975f67c-e71c-4052-8000-0fb5a44cea83 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Request method failure captured: May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac HTTP/1.1 May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbV8EVqnsXJ4v8PKLpKbSN-UMKIcSy3KmkP6QXvwdRFm704ALR4cl_gP9SPkmpV3xU_0jRk0mImnS7YmIQnzqGR8Czb30Vc2tEyE75b992FPEefKyODL7t_FCesR9j2FYAAhL0AvtL4GoBrh1ex3V5-HI_FVJL-8Aq7U-X9LX1Ide1Y May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerActionsTestJSON-1722172964 May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerActionsTestJSON-1722172964-project May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 1ffd8cb46a064f39a7b4468292d57b42 May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerActionsTestJSON-1722172964-project May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '6076a6fa-ff7e-44a6-8924-889f991aeaac'} May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:41:28.992447 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:41:28.997679 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:41:28.997679 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:41:28.997679 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:41:28.997679 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:41:28.997679 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:41:28.997679 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. May 28 05:41:28.997679 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:41:28.997679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e975f67c-e71c-4052-8000-0fb5a44cea83 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Returning 404 to user: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:41:28.997679 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e975f67c-e71c-4052-8000-0fb5a44cea83 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 404 len: 111 microversion: 2.1 time: 0.030465 May 28 05:41:28.997679 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3742/7368] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:28 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:41:29.041285 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c03eb4dc-11c7-4212-9c63-f191a2e919c9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1764784514", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "37f5385b-a020-4f12-be61-b8733e663a1f"}], "security_groups": [{"name": "tempest-securitygroup--1050968748"}], "key_name": "tempest-keypair-121898998", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:41:29.144279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-c03eb4dc-11c7-4212-9c63-f191a2e919c9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] validate_networks() for [('37f5385b-a020-4f12-be61-b8733e663a1f', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:41:29.556353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-c03eb4dc-11c7-4212-9c63-f191a2e919c9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:41:29.556835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-c03eb4dc-11c7-4212-9c63-f191a2e919c9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:41:29.557355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-c03eb4dc-11c7-4212-9c63-f191a2e919c9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:41:29.557763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-c03eb4dc-11c7-4212-9c63-f191a2e919c9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:41:29.558195 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-c03eb4dc-11c7-4212-9c63-f191a2e919c9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:41:29.567183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c03eb4dc-11c7-4212-9c63-f191a2e919c9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:29.567658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c03eb4dc-11c7-4212-9c63-f191a2e919c9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:29.568484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c03eb4dc-11c7-4212-9c63-f191a2e919c9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:29.568946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c03eb4dc-11c7-4212-9c63-f191a2e919c9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:29.586203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-c03eb4dc-11c7-4212-9c63-f191a2e919c9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Getting quotas for project a59090a2c3eb4898a218d26e86807a86. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:41:29.591584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-c03eb4dc-11c7-4212-9c63-f191a2e919c9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Getting quotas for user 1ffd8cb46a064f39a7b4468292d57b42 and project a59090a2c3eb4898a218d26e86807a86. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:41:29.604677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c03eb4dc-11c7-4212-9c63-f191a2e919c9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:41:29.606940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c03eb4dc-11c7-4212-9c63-f191a2e919c9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:41:29.696213 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c03eb4dc-11c7-4212-9c63-f191a2e919c9 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.658888 May 28 05:41:29.696872 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3627/7369] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:41:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:41:29.707059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-64af147c-33b2-4720-a94e-d825c09f3e13 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:29.707684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-64af147c-33b2-4720-a94e-d825c09f3e13 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:29.761393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-64af147c-33b2-4720-a94e-d825c09f3e13 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:29.768679 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-64af147c-33b2-4720-a94e-d825c09f3e13 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1238 microversion: 2.1 time: 0.065581 May 28 05:41:29.769338 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3743/7370] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:29 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:30.788218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2f4bf3da-916a-4957-8354-5c30665f9d7c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:30.788913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2f4bf3da-916a-4957-8354-5c30665f9d7c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:30.796138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f4bf3da-916a-4957-8354-5c30665f9d7c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:30.796612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f4bf3da-916a-4957-8354-5c30665f9d7c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:30.797406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f4bf3da-916a-4957-8354-5c30665f9d7c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:30.797863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f4bf3da-916a-4957-8354-5c30665f9d7c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:30.866346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2f4bf3da-916a-4957-8354-5c30665f9d7c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:30.874448 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2f4bf3da-916a-4957-8354-5c30665f9d7c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1234 microversion: 2.1 time: 0.091543 May 28 05:41:30.875049 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3628/7371] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:30 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1234 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:31.892924 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3dbd7352-b9fd-46e6-8fc5-c3617bddb75c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:31.893617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3dbd7352-b9fd-46e6-8fc5-c3617bddb75c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:31.901403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3dbd7352-b9fd-46e6-8fc5-c3617bddb75c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:31.902008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3dbd7352-b9fd-46e6-8fc5-c3617bddb75c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:31.902787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3dbd7352-b9fd-46e6-8fc5-c3617bddb75c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:31.903255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3dbd7352-b9fd-46e6-8fc5-c3617bddb75c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:31.974769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3dbd7352-b9fd-46e6-8fc5-c3617bddb75c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:31.982579 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3dbd7352-b9fd-46e6-8fc5-c3617bddb75c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1296 microversion: 2.1 time: 0.093929 May 28 05:41:31.983187 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3744/7372] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:31 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:33.001957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f5eff9f2-372d-4f95-84bc-ad6edc9dfca2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:33.003295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f5eff9f2-372d-4f95-84bc-ad6edc9dfca2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:33.012057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5eff9f2-372d-4f95-84bc-ad6edc9dfca2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:33.012534 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5eff9f2-372d-4f95-84bc-ad6edc9dfca2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:33.013340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5eff9f2-372d-4f95-84bc-ad6edc9dfca2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:33.013793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f5eff9f2-372d-4f95-84bc-ad6edc9dfca2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:33.177063 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f5eff9f2-372d-4f95-84bc-ad6edc9dfca2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:33.185293 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f5eff9f2-372d-4f95-84bc-ad6edc9dfca2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1364 microversion: 2.1 time: 0.188577 May 28 05:41:33.185906 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3629/7373] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:32 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:41:33.244941 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-50b1d83a-62e8-4004-8600-3879cd13dca2 req-9e509bb7-370d-4255-af29-6b9be7e3b30d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65a40d51-0250-4b0b-9277-f9dfc97e1720", "tag": "f438e4d4-86e0-434b-9f61-63968f3c8826"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:41:33.254825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-50b1d83a-62e8-4004-8600-3879cd13dca2 req-9e509bb7-370d-4255-af29-6b9be7e3b30d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:33.255312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-50b1d83a-62e8-4004-8600-3879cd13dca2 req-9e509bb7-370d-4255-af29-6b9be7e3b30d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:33.268986 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-50b1d83a-62e8-4004-8600-3879cd13dca2 req-9e509bb7-370d-4255-af29-6b9be7e3b30d service nova] Creating event network-changed:f438e4d4-86e0-434b-9f61-63968f3c8826 for instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 on n-h2-843700-1 May 28 05:41:33.275208 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-50b1d83a-62e8-4004-8600-3879cd13dca2 req-9e509bb7-370d-4255-af29-6b9be7e3b30d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039729 May 28 05:41:33.276397 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3745/7374] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:41:34.202526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cd5c4d4d-fb8a-4a66-b11e-8682fd4af994 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:34.203122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cd5c4d4d-fb8a-4a66-b11e-8682fd4af994 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:34.210733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd5c4d4d-fb8a-4a66-b11e-8682fd4af994 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:34.211238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd5c4d4d-fb8a-4a66-b11e-8682fd4af994 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:34.212026 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd5c4d4d-fb8a-4a66-b11e-8682fd4af994 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:34.212488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cd5c4d4d-fb8a-4a66-b11e-8682fd4af994 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:34.343237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cd5c4d4d-fb8a-4a66-b11e-8682fd4af994 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:34.351389 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cd5c4d4d-fb8a-4a66-b11e-8682fd4af994 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1364 microversion: 2.1 time: 0.152814 May 28 05:41:34.351962 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3630/7375] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:34 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:35.370420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bfd694db-7d38-4ed2-8775-3eb4c8a65f90 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:35.371101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bfd694db-7d38-4ed2-8775-3eb4c8a65f90 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:35.377375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfd694db-7d38-4ed2-8775-3eb4c8a65f90 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:35.377834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfd694db-7d38-4ed2-8775-3eb4c8a65f90 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:35.378599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfd694db-7d38-4ed2-8775-3eb4c8a65f90 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:35.379071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bfd694db-7d38-4ed2-8775-3eb4c8a65f90 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:35.505993 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bfd694db-7d38-4ed2-8775-3eb4c8a65f90 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:35.514271 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bfd694db-7d38-4ed2-8775-3eb4c8a65f90 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1364 microversion: 2.1 time: 0.149130 May 28 05:41:35.514845 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3746/7376] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:35 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:36.532459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-81469813-f93e-430d-b3d6-c0b573488829 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:36.533022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-81469813-f93e-430d-b3d6-c0b573488829 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:36.540820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81469813-f93e-430d-b3d6-c0b573488829 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:36.541295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81469813-f93e-430d-b3d6-c0b573488829 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:36.542086 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81469813-f93e-430d-b3d6-c0b573488829 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:36.542549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-81469813-f93e-430d-b3d6-c0b573488829 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:36.670287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-81469813-f93e-430d-b3d6-c0b573488829 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:36.677708 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-81469813-f93e-430d-b3d6-c0b573488829 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1364 microversion: 2.1 time: 0.149280 May 28 05:41:36.678299 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3631/7377] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:36 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:37.695546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9355373b-d09b-47cb-9190-77ba98981354 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:37.696167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9355373b-d09b-47cb-9190-77ba98981354 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:37.703070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9355373b-d09b-47cb-9190-77ba98981354 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:37.703530 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9355373b-d09b-47cb-9190-77ba98981354 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:37.704294 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9355373b-d09b-47cb-9190-77ba98981354 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:37.704735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9355373b-d09b-47cb-9190-77ba98981354 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:37.836544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9355373b-d09b-47cb-9190-77ba98981354 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:37.844304 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9355373b-d09b-47cb-9190-77ba98981354 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1364 microversion: 2.1 time: 0.153184 May 28 05:41:37.844882 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3747/7378] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:37 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:38.861978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5bcac079-8da7-453c-9e80-a3ecad3b19f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:38.862538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5bcac079-8da7-453c-9e80-a3ecad3b19f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:38.869997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5bcac079-8da7-453c-9e80-a3ecad3b19f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:38.870475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5bcac079-8da7-453c-9e80-a3ecad3b19f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:38.871292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5bcac079-8da7-453c-9e80-a3ecad3b19f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:38.871752 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5bcac079-8da7-453c-9e80-a3ecad3b19f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:39.003543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5bcac079-8da7-453c-9e80-a3ecad3b19f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:39.011180 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5bcac079-8da7-453c-9e80-a3ecad3b19f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1364 microversion: 2.1 time: 0.153157 May 28 05:41:39.021321 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3632/7379] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:38 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:39.086416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-870e56c4-8f4b-4230-9378-817d13ad4087 req-000e0cfc-baaf-4087-8046-976c9b0adc78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a40d51-0250-4b0b-9277-f9dfc97e1720", "name": "network-vif-plugged", "status": "completed", "tag": "f438e4d4-86e0-434b-9f61-63968f3c8826"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:41:39.095177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-870e56c4-8f4b-4230-9378-817d13ad4087 req-000e0cfc-baaf-4087-8046-976c9b0adc78 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:39.101176 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-870e56c4-8f4b-4230-9378-817d13ad4087 req-000e0cfc-baaf-4087-8046-976c9b0adc78 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:39.107249 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-870e56c4-8f4b-4230-9378-817d13ad4087 req-000e0cfc-baaf-4087-8046-976c9b0adc78 service nova] Creating event network-vif-plugged:f438e4d4-86e0-434b-9f61-63968f3c8826 for instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 on n-h2-843700-1 May 28 05:41:39.112270 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-870e56c4-8f4b-4230-9378-817d13ad4087 req-000e0cfc-baaf-4087-8046-976c9b0adc78 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029511 May 28 05:41:39.112801 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3748/7380] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:41:40.028862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a6003f19-68da-4ab9-b412-bd8ad763b99e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:40.029490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a6003f19-68da-4ab9-b412-bd8ad763b99e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:40.031484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:41:40.032182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:41:40.037989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6003f19-68da-4ab9-b412-bd8ad763b99e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:40.038490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6003f19-68da-4ab9-b412-bd8ad763b99e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:40.039291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6003f19-68da-4ab9-b412-bd8ad763b99e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:40.039748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a6003f19-68da-4ab9-b412-bd8ad763b99e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:40.167594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a6003f19-68da-4ab9-b412-bd8ad763b99e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:40.175097 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a6003f19-68da-4ab9-b412-bd8ad763b99e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1364 microversion: 2.1 time: 0.150180 May 28 05:41:40.175668 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3633/7381] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:40 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:41.189908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:41:41.195440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0711742b-402e-416a-93c8-c927564ae30f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:41.196149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0711742b-402e-416a-93c8-c927564ae30f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:41.202511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0711742b-402e-416a-93c8-c927564ae30f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:41.202978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0711742b-402e-416a-93c8-c927564ae30f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:41.203769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0711742b-402e-416a-93c8-c927564ae30f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:41.204216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0711742b-402e-416a-93c8-c927564ae30f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:41.334574 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0711742b-402e-416a-93c8-c927564ae30f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:41:41.343106 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0711742b-402e-416a-93c8-c927564ae30f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1549 microversion: 2.1 time: 0.154115 May 28 05:41:41.343729 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3749/7382] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:41:41 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:41:41.359984 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a3a16215-b2f4-4c8e-b6a7-6ee3aa1fd490 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:41:41.360501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a3a16215-b2f4-4c8e-b6a7-6ee3aa1fd490 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:41:41.367589 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3a16215-b2f4-4c8e-b6a7-6ee3aa1fd490 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:41.368005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3a16215-b2f4-4c8e-b6a7-6ee3aa1fd490 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:41.368792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3a16215-b2f4-4c8e-b6a7-6ee3aa1fd490 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:41.369259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3a16215-b2f4-4c8e-b6a7-6ee3aa1fd490 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:41.448823 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a3a16215-b2f4-4c8e-b6a7-6ee3aa1fd490 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092623 May 28 05:41:41.449465 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3634/7383] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 05:41:41 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:41:42.744495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-b2413d35-17e6-494a-8071-a3929a98cdfb req-789d7325-71b8-4358-8d01-e0541c82b5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65a40d51-0250-4b0b-9277-f9dfc97e1720", "tag": "f438e4d4-86e0-434b-9f61-63968f3c8826"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:41:42.753363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b2413d35-17e6-494a-8071-a3929a98cdfb req-789d7325-71b8-4358-8d01-e0541c82b5c1 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:41:42.753809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-b2413d35-17e6-494a-8071-a3929a98cdfb req-789d7325-71b8-4358-8d01-e0541c82b5c1 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:41:42.765429 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-b2413d35-17e6-494a-8071-a3929a98cdfb req-789d7325-71b8-4358-8d01-e0541c82b5c1 service nova] Creating event network-changed:f438e4d4-86e0-434b-9f61-63968f3c8826 for instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 on n-h2-843700-1 May 28 05:41:42.770326 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-b2413d35-17e6-494a-8071-a3929a98cdfb req-789d7325-71b8-4358-8d01-e0541c82b5c1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030144 May 28 05:41:42.770933 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3750/7384] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:42:16.030312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:42:16.031113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:42:16.035091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-458675d5-7923-455b-b1b2-4c5e4e9a493e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:42:16.036112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-458675d5-7923-455b-b1b2-4c5e4e9a493e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:16.042041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-458675d5-7923-455b-b1b2-4c5e4e9a493e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:16.042503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-458675d5-7923-455b-b1b2-4c5e4e9a493e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:16.043364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-458675d5-7923-455b-b1b2-4c5e4e9a493e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:16.043809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-458675d5-7923-455b-b1b2-4c5e4e9a493e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:16.072431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-458675d5-7923-455b-b1b2-4c5e4e9a493e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:16.078109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-458675d5-7923-455b-b1b2-4c5e4e9a493e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Old instance type m1.heat2, new instance type m1.heat {{(pid=126043) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 05:42:16.085010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-458675d5-7923-455b-b1b2-4c5e4e9a493e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:42:16.085444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-458675d5-7923-455b-b1b2-4c5e4e9a493e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:42:16.085928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-458675d5-7923-455b-b1b2-4c5e4e9a493e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:42:16.086349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-458675d5-7923-455b-b1b2-4c5e4e9a493e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:42:16.086770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-458675d5-7923-455b-b1b2-4c5e4e9a493e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:42:16.246958 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-458675d5-7923-455b-b1b2-4c5e4e9a493e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "POST /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720/action" status: 202 len: 0 microversion: 2.1 time: 0.218478 May 28 05:42:16.247606 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3635/7385] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:42:16 2022] POST /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:42:16.254264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:42:16.255080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:42:16.260048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6548040c-d9f4-4b6d-a5f5-04e599f0f014 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:16.261033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6548040c-d9f4-4b6d-a5f5-04e599f0f014 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:16.267425 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6548040c-d9f4-4b6d-a5f5-04e599f0f014 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:16.267937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6548040c-d9f4-4b6d-a5f5-04e599f0f014 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:16.268707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6548040c-d9f4-4b6d-a5f5-04e599f0f014 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:16.269161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6548040c-d9f4-4b6d-a5f5-04e599f0f014 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:16.401434 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6548040c-d9f4-4b6d-a5f5-04e599f0f014 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:16.409194 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6548040c-d9f4-4b6d-a5f5-04e599f0f014 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1677 microversion: 2.1 time: 0.157054 May 28 05:42:16.409788 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3751/7386] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:16 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:17.428366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ee7fdb58-bcea-435e-8a59-33914cdfa136 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:17.428997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ee7fdb58-bcea-435e-8a59-33914cdfa136 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:17.436166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ee7fdb58-bcea-435e-8a59-33914cdfa136 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:17.436634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ee7fdb58-bcea-435e-8a59-33914cdfa136 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:17.437428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ee7fdb58-bcea-435e-8a59-33914cdfa136 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:17.437885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ee7fdb58-bcea-435e-8a59-33914cdfa136 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:17.574377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ee7fdb58-bcea-435e-8a59-33914cdfa136 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:17.582124 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ee7fdb58-bcea-435e-8a59-33914cdfa136 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1677 microversion: 2.1 time: 0.158556 May 28 05:42:17.582700 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3636/7387] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:17 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:18.600157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-36d999f3-2734-42b8-8cf2-25eb66756887 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:18.600780 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-36d999f3-2734-42b8-8cf2-25eb66756887 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:18.608453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36d999f3-2734-42b8-8cf2-25eb66756887 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:18.608913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36d999f3-2734-42b8-8cf2-25eb66756887 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:18.609685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36d999f3-2734-42b8-8cf2-25eb66756887 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:18.610177 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-36d999f3-2734-42b8-8cf2-25eb66756887 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:18.834203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-36d999f3-2734-42b8-8cf2-25eb66756887 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:18.841846 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-36d999f3-2734-42b8-8cf2-25eb66756887 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1677 microversion: 2.1 time: 0.246193 May 28 05:42:18.842431 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3752/7388] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:18 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1677 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:19.859619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a5a7d972-6872-404e-ae12-efd0a17729bb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:19.860192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a5a7d972-6872-404e-ae12-efd0a17729bb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:19.867809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5a7d972-6872-404e-ae12-efd0a17729bb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:19.868271 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5a7d972-6872-404e-ae12-efd0a17729bb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:19.869040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5a7d972-6872-404e-ae12-efd0a17729bb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:19.869488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a5a7d972-6872-404e-ae12-efd0a17729bb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:20.004455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a5a7d972-6872-404e-ae12-efd0a17729bb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:20.012876 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a5a7d972-6872-404e-ae12-efd0a17729bb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1682 microversion: 2.1 time: 0.157236 May 28 05:42:20.013461 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3637/7389] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:19 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:21.030463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fd288e10-692e-419b-bac7-1e6d69fcae9f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:21.031102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fd288e10-692e-419b-bac7-1e6d69fcae9f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:21.038245 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd288e10-692e-419b-bac7-1e6d69fcae9f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:21.038702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd288e10-692e-419b-bac7-1e6d69fcae9f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:21.039513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd288e10-692e-419b-bac7-1e6d69fcae9f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:21.039957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd288e10-692e-419b-bac7-1e6d69fcae9f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:21.167322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fd288e10-692e-419b-bac7-1e6d69fcae9f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:21.174944 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fd288e10-692e-419b-bac7-1e6d69fcae9f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1682 microversion: 2.1 time: 0.148439 May 28 05:42:21.175544 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3753/7390] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:21 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:22.192591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-52afdf99-37d5-4c39-9119-4340d30f60af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:22.193218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-52afdf99-37d5-4c39-9119-4340d30f60af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:22.199385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52afdf99-37d5-4c39-9119-4340d30f60af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:22.199887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52afdf99-37d5-4c39-9119-4340d30f60af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:22.200634 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52afdf99-37d5-4c39-9119-4340d30f60af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:22.201085 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-52afdf99-37d5-4c39-9119-4340d30f60af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:22.328798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-52afdf99-37d5-4c39-9119-4340d30f60af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:22.336800 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-52afdf99-37d5-4c39-9119-4340d30f60af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1682 microversion: 2.1 time: 0.148405 May 28 05:42:22.337380 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3638/7391] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:22 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:23.354571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-35aa665a-e9a1-455f-8234-56fce42ec496 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:23.355220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-35aa665a-e9a1-455f-8234-56fce42ec496 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:23.362196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35aa665a-e9a1-455f-8234-56fce42ec496 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:23.362650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35aa665a-e9a1-455f-8234-56fce42ec496 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:23.363445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35aa665a-e9a1-455f-8234-56fce42ec496 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:23.363884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-35aa665a-e9a1-455f-8234-56fce42ec496 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:23.495062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-35aa665a-e9a1-455f-8234-56fce42ec496 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:23.502665 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-35aa665a-e9a1-455f-8234-56fce42ec496 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1682 microversion: 2.1 time: 0.152523 May 28 05:42:23.503282 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3754/7392] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:23 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:24.520393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-90e75c92-14ad-4237-9288-d5ebeb24a839 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:24.520958 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-90e75c92-14ad-4237-9288-d5ebeb24a839 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:24.527948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-90e75c92-14ad-4237-9288-d5ebeb24a839 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:24.528414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-90e75c92-14ad-4237-9288-d5ebeb24a839 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:24.529186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-90e75c92-14ad-4237-9288-d5ebeb24a839 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:24.529633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-90e75c92-14ad-4237-9288-d5ebeb24a839 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:24.658524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-90e75c92-14ad-4237-9288-d5ebeb24a839 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:24.666578 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-90e75c92-14ad-4237-9288-d5ebeb24a839 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1682 microversion: 2.1 time: 0.150252 May 28 05:42:24.669376 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3639/7393] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:24 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:25.685166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f064fdc6-68e4-4c03-9595-32d6db974e1b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:25.685947 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f064fdc6-68e4-4c03-9595-32d6db974e1b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:25.692033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f064fdc6-68e4-4c03-9595-32d6db974e1b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:25.692493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f064fdc6-68e4-4c03-9595-32d6db974e1b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:25.693262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f064fdc6-68e4-4c03-9595-32d6db974e1b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:25.693707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f064fdc6-68e4-4c03-9595-32d6db974e1b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:25.823331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f064fdc6-68e4-4c03-9595-32d6db974e1b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:25.830827 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f064fdc6-68e4-4c03-9595-32d6db974e1b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1682 microversion: 2.1 time: 0.150804 May 28 05:42:25.831432 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3755/7394] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:25 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:26.848857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-29b465ac-eb36-464d-85f5-c67ea05f21f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:26.849497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-29b465ac-eb36-464d-85f5-c67ea05f21f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:26.856583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29b465ac-eb36-464d-85f5-c67ea05f21f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:26.857057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29b465ac-eb36-464d-85f5-c67ea05f21f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:26.857869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29b465ac-eb36-464d-85f5-c67ea05f21f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:26.858331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29b465ac-eb36-464d-85f5-c67ea05f21f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:26.985817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-29b465ac-eb36-464d-85f5-c67ea05f21f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:26.994167 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-29b465ac-eb36-464d-85f5-c67ea05f21f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1682 microversion: 2.1 time: 0.149202 May 28 05:42:26.994757 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3640/7395] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:26 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:28.012181 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9e9a7032-38fa-495a-b369-f62b732daa46 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:28.012799 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9e9a7032-38fa-495a-b369-f62b732daa46 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:28.019811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e9a7032-38fa-495a-b369-f62b732daa46 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:28.020264 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e9a7032-38fa-495a-b369-f62b732daa46 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:28.021025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e9a7032-38fa-495a-b369-f62b732daa46 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:28.021468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9e9a7032-38fa-495a-b369-f62b732daa46 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:28.153426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9e9a7032-38fa-495a-b369-f62b732daa46 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:28.160947 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9e9a7032-38fa-495a-b369-f62b732daa46 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1682 microversion: 2.1 time: 0.152935 May 28 05:42:28.161512 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3756/7396] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:28 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:29.178247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2828f741-5378-46f3-a333-52769c691198 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:29.178949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2828f741-5378-46f3-a333-52769c691198 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:29.185999 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2828f741-5378-46f3-a333-52769c691198 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:29.186471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2828f741-5378-46f3-a333-52769c691198 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:29.187284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2828f741-5378-46f3-a333-52769c691198 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:29.187748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2828f741-5378-46f3-a333-52769c691198 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:29.316005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2828f741-5378-46f3-a333-52769c691198 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:29.324225 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2828f741-5378-46f3-a333-52769c691198 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1682 microversion: 2.1 time: 0.150028 May 28 05:42:29.324822 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3641/7397] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:29 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:30.341721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9c51e66c-6ca4-4ede-a866-993d30b956b6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:30.342344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9c51e66c-6ca4-4ede-a866-993d30b956b6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:30.349386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9c51e66c-6ca4-4ede-a866-993d30b956b6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:30.349849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9c51e66c-6ca4-4ede-a866-993d30b956b6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:30.351259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9c51e66c-6ca4-4ede-a866-993d30b956b6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:30.351708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9c51e66c-6ca4-4ede-a866-993d30b956b6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:30.480352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9c51e66c-6ca4-4ede-a866-993d30b956b6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:30.487996 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9c51e66c-6ca4-4ede-a866-993d30b956b6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1682 microversion: 2.1 time: 0.150233 May 28 05:42:30.488575 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3757/7398] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:30 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:31.505727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a15eb695-0730-4547-a249-13985f51d46f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:31.506566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a15eb695-0730-4547-a249-13985f51d46f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:31.513939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a15eb695-0730-4547-a249-13985f51d46f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:31.514409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a15eb695-0730-4547-a249-13985f51d46f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:31.517270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a15eb695-0730-4547-a249-13985f51d46f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:31.517270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a15eb695-0730-4547-a249-13985f51d46f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:31.718914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a15eb695-0730-4547-a249-13985f51d46f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:31.727007 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a15eb695-0730-4547-a249-13985f51d46f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1681 microversion: 2.1 time: 0.225232 May 28 05:42:31.727589 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3642/7399] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:31 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1681 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:31.795826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e4062103-7ea2-4f03-b753-139550b6e930 req-4330edaf-8a66-4f80-8e40-07914136968b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a40d51-0250-4b0b-9277-f9dfc97e1720", "name": "network-vif-unplugged", "status": "completed", "tag": "f438e4d4-86e0-434b-9f61-63968f3c8826"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:42:31.805102 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e4062103-7ea2-4f03-b753-139550b6e930 req-4330edaf-8a66-4f80-8e40-07914136968b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:31.809421 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e4062103-7ea2-4f03-b753-139550b6e930 req-4330edaf-8a66-4f80-8e40-07914136968b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:31.817562 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e4062103-7ea2-4f03-b753-139550b6e930 req-4330edaf-8a66-4f80-8e40-07914136968b service nova] Creating event network-vif-unplugged:f438e4d4-86e0-434b-9f61-63968f3c8826 for instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 on n-h1-843700-1 May 28 05:42:31.822920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-e4062103-7ea2-4f03-b753-139550b6e930 req-4330edaf-8a66-4f80-8e40-07914136968b service nova] Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:42:31.834004 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e4062103-7ea2-4f03-b753-139550b6e930 req-4330edaf-8a66-4f80-8e40-07914136968b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042025 May 28 05:42:31.838188 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3758/7400] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:42:32.745910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ed4acb0a-2f13-44b5-9d58-b0c15dc733d1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:32.746541 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ed4acb0a-2f13-44b5-9d58-b0c15dc733d1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:32.753662 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ed4acb0a-2f13-44b5-9d58-b0c15dc733d1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:32.754132 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ed4acb0a-2f13-44b5-9d58-b0c15dc733d1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:32.754917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ed4acb0a-2f13-44b5-9d58-b0c15dc733d1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:32.755401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ed4acb0a-2f13-44b5-9d58-b0c15dc733d1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:32.930082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ed4acb0a-2f13-44b5-9d58-b0c15dc733d1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:32.937684 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ed4acb0a-2f13-44b5-9d58-b0c15dc733d1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1681 microversion: 2.1 time: 0.195781 May 28 05:42:32.938257 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3643/7401] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:32 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1681 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:33.850506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-57bf28a9-04ae-4064-89ef-90020da01c7f req-a4efba99-08b9-463a-99df-a2fe5fb5eb5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65a40d51-0250-4b0b-9277-f9dfc97e1720", "tag": "f438e4d4-86e0-434b-9f61-63968f3c8826"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:42:33.858729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-57bf28a9-04ae-4064-89ef-90020da01c7f req-a4efba99-08b9-463a-99df-a2fe5fb5eb5b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:33.859205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-57bf28a9-04ae-4064-89ef-90020da01c7f req-a4efba99-08b9-463a-99df-a2fe5fb5eb5b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:33.873442 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-57bf28a9-04ae-4064-89ef-90020da01c7f req-a4efba99-08b9-463a-99df-a2fe5fb5eb5b service nova] Creating event network-changed:f438e4d4-86e0-434b-9f61-63968f3c8826 for instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 on n-h1-843700-1 May 28 05:42:33.878680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-57bf28a9-04ae-4064-89ef-90020da01c7f req-a4efba99-08b9-463a-99df-a2fe5fb5eb5b service nova] Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:42:33.889478 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-57bf28a9-04ae-4064-89ef-90020da01c7f req-a4efba99-08b9-463a-99df-a2fe5fb5eb5b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044488 May 28 05:42:33.890070 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3759/7402] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:42:33.954335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ffd3482c-7ab5-41e5-b390-74befc440bad tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:33.955265 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ffd3482c-7ab5-41e5-b390-74befc440bad tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:33.962556 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ffd3482c-7ab5-41e5-b390-74befc440bad tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:33.963070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ffd3482c-7ab5-41e5-b390-74befc440bad tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:33.963858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ffd3482c-7ab5-41e5-b390-74befc440bad tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:33.964379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ffd3482c-7ab5-41e5-b390-74befc440bad tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:34.168234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ffd3482c-7ab5-41e5-b390-74befc440bad tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:34.175823 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ffd3482c-7ab5-41e5-b390-74befc440bad tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1679 microversion: 2.1 time: 0.225473 May 28 05:42:34.176423 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3644/7403] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:33 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1679 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:35.195050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-97c506dd-7cbe-4dd1-83cd-24a08b4be8c2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:35.195769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-97c506dd-7cbe-4dd1-83cd-24a08b4be8c2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:35.202174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-97c506dd-7cbe-4dd1-83cd-24a08b4be8c2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:35.202635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-97c506dd-7cbe-4dd1-83cd-24a08b4be8c2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:35.203437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-97c506dd-7cbe-4dd1-83cd-24a08b4be8c2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:35.203902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-97c506dd-7cbe-4dd1-83cd-24a08b4be8c2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:35.338836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-97c506dd-7cbe-4dd1-83cd-24a08b4be8c2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:35.346513 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-97c506dd-7cbe-4dd1-83cd-24a08b4be8c2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1676 microversion: 2.1 time: 0.156717 May 28 05:42:35.347167 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3760/7404] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:35 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:35.363593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-427c1341-6516-41b1-99ce-7c688dbdbc5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:42:35.364154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-427c1341-6516-41b1-99ce-7c688dbdbc5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:35.371713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-427c1341-6516-41b1-99ce-7c688dbdbc5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:35.372183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-427c1341-6516-41b1-99ce-7c688dbdbc5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:35.372963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-427c1341-6516-41b1-99ce-7c688dbdbc5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:35.373420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-427c1341-6516-41b1-99ce-7c688dbdbc5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:35.409581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-427c1341-6516-41b1-99ce-7c688dbdbc5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:35.410049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-427c1341-6516-41b1-99ce-7c688dbdbc5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:35.410864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-427c1341-6516-41b1-99ce-7c688dbdbc5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:35.411351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-427c1341-6516-41b1-99ce-7c688dbdbc5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:35.432466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-427c1341-6516-41b1-99ce-7c688dbdbc5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Getting quotas for project a59090a2c3eb4898a218d26e86807a86. Resources: {'cores', 'ram'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:42:35.437549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-427c1341-6516-41b1-99ce-7c688dbdbc5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Getting quotas for user 1ffd8cb46a064f39a7b4468292d57b42 and project a59090a2c3eb4898a218d26e86807a86. Resources: {'cores', 'ram'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:42:35.767146 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-427c1341-6516-41b1-99ce-7c688dbdbc5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "POST /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720/action" status: 202 len: 0 microversion: 2.1 time: 0.407213 May 28 05:42:35.767769 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3645/7405] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:42:35 2022] POST /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:42:35.777091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ae7ec3e1-57f3-4fd2-9efe-0f835fbd045e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:35.777714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ae7ec3e1-57f3-4fd2-9efe-0f835fbd045e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:35.783912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae7ec3e1-57f3-4fd2-9efe-0f835fbd045e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:35.784370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae7ec3e1-57f3-4fd2-9efe-0f835fbd045e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:35.786688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae7ec3e1-57f3-4fd2-9efe-0f835fbd045e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:35.786688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae7ec3e1-57f3-4fd2-9efe-0f835fbd045e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:36.333158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ae7ec3e1-57f3-4fd2-9efe-0f835fbd045e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:36.341119 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ae7ec3e1-57f3-4fd2-9efe-0f835fbd045e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1675 microversion: 2.1 time: 0.568207 May 28 05:42:36.348484 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3761/7406] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:35 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1675 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:37.360576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-214b4223-bbb5-47a2-914c-5782897d5d28 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:37.361298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-214b4223-bbb5-47a2-914c-5782897d5d28 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:37.368727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-214b4223-bbb5-47a2-914c-5782897d5d28 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:37.369144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-214b4223-bbb5-47a2-914c-5782897d5d28 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:37.369930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-214b4223-bbb5-47a2-914c-5782897d5d28 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:37.370407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-214b4223-bbb5-47a2-914c-5782897d5d28 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:37.498338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-214b4223-bbb5-47a2-914c-5782897d5d28 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:37.506443 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-214b4223-bbb5-47a2-914c-5782897d5d28 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1675 microversion: 2.1 time: 0.150657 May 28 05:42:37.507043 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3646/7407] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:37 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:38.392488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e8b04bd4-a26e-4e61-8a5a-9a44d1e724cb req-700bb44f-eb65-45af-b597-7e426c941a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a40d51-0250-4b0b-9277-f9dfc97e1720", "name": "network-vif-plugged", "status": "completed", "tag": "f438e4d4-86e0-434b-9f61-63968f3c8826"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:42:38.402250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e8b04bd4-a26e-4e61-8a5a-9a44d1e724cb req-700bb44f-eb65-45af-b597-7e426c941a64 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:38.404094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e8b04bd4-a26e-4e61-8a5a-9a44d1e724cb req-700bb44f-eb65-45af-b597-7e426c941a64 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:38.415191 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e8b04bd4-a26e-4e61-8a5a-9a44d1e724cb req-700bb44f-eb65-45af-b597-7e426c941a64 service nova] Creating event network-vif-plugged:f438e4d4-86e0-434b-9f61-63968f3c8826 for instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 on n-h1-843700-1 May 28 05:42:38.420522 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-e8b04bd4-a26e-4e61-8a5a-9a44d1e724cb req-700bb44f-eb65-45af-b597-7e426c941a64 service nova] Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:42:38.432054 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e8b04bd4-a26e-4e61-8a5a-9a44d1e724cb req-700bb44f-eb65-45af-b597-7e426c941a64 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043390 May 28 05:42:38.432664 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3762/7408] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:42:38.523953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-689e9276-a986-48f3-8ead-709d3d1ef8d4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:38.524581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-689e9276-a986-48f3-8ead-709d3d1ef8d4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:38.531454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-689e9276-a986-48f3-8ead-709d3d1ef8d4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:38.531918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-689e9276-a986-48f3-8ead-709d3d1ef8d4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:38.532688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-689e9276-a986-48f3-8ead-709d3d1ef8d4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:38.533138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-689e9276-a986-48f3-8ead-709d3d1ef8d4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:38.538139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:42:38.672359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-689e9276-a986-48f3-8ead-709d3d1ef8d4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:38.680092 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-689e9276-a986-48f3-8ead-709d3d1ef8d4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1675 microversion: 2.1 time: 0.160617 May 28 05:42:38.680665 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3647/7409] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:38 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:39.565935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-5f6f54e1-d31c-4798-b26e-0c4cdb112f85 req-40eab94b-7e85-40eb-9d9d-a7df24c7325e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a40d51-0250-4b0b-9277-f9dfc97e1720", "name": "network-vif-unplugged", "status": "completed", "tag": "f438e4d4-86e0-434b-9f61-63968f3c8826"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:42:39.575143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5f6f54e1-d31c-4798-b26e-0c4cdb112f85 req-40eab94b-7e85-40eb-9d9d-a7df24c7325e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:39.575603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5f6f54e1-d31c-4798-b26e-0c4cdb112f85 req-40eab94b-7e85-40eb-9d9d-a7df24c7325e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:39.587511 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-5f6f54e1-d31c-4798-b26e-0c4cdb112f85 req-40eab94b-7e85-40eb-9d9d-a7df24c7325e service nova] Creating event network-vif-unplugged:f438e4d4-86e0-434b-9f61-63968f3c8826 for instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 on n-h2-843700-1 May 28 05:42:39.592896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-5f6f54e1-d31c-4798-b26e-0c4cdb112f85 req-40eab94b-7e85-40eb-9d9d-a7df24c7325e service nova] Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:42:39.603710 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-5f6f54e1-d31c-4798-b26e-0c4cdb112f85 req-40eab94b-7e85-40eb-9d9d-a7df24c7325e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042842 May 28 05:42:39.604318 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3763/7410] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:42:39.697260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-70955a81-9ea2-41b7-8d97-db1d88a1f50b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:39.697876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-70955a81-9ea2-41b7-8d97-db1d88a1f50b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:39.705521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70955a81-9ea2-41b7-8d97-db1d88a1f50b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:39.706097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70955a81-9ea2-41b7-8d97-db1d88a1f50b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:39.707257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70955a81-9ea2-41b7-8d97-db1d88a1f50b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:39.707783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-70955a81-9ea2-41b7-8d97-db1d88a1f50b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:39.998354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-70955a81-9ea2-41b7-8d97-db1d88a1f50b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:40.006419 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-70955a81-9ea2-41b7-8d97-db1d88a1f50b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1675 microversion: 2.1 time: 0.312913 May 28 05:42:40.007143 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3648/7411] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:39 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1675 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:41.026042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1f29ab9a-b657-4d4d-bee7-b13db4af50be tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:41.026671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1f29ab9a-b657-4d4d-bee7-b13db4af50be tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:41.032959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f29ab9a-b657-4d4d-bee7-b13db4af50be tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:41.033423 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f29ab9a-b657-4d4d-bee7-b13db4af50be tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:41.034202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f29ab9a-b657-4d4d-bee7-b13db4af50be tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:41.034649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1f29ab9a-b657-4d4d-bee7-b13db4af50be tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:41.212161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1f29ab9a-b657-4d4d-bee7-b13db4af50be tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:41.219708 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1f29ab9a-b657-4d4d-bee7-b13db4af50be tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1675 microversion: 2.1 time: 0.199380 May 28 05:42:41.220279 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3764/7412] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:41 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1675 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:42:41.618483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-7d00c957-d597-445b-921e-27829c0f53bc req-aaf664d0-5ad3-4e1f-8009-b802396e3a54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65a40d51-0250-4b0b-9277-f9dfc97e1720", "tag": "f438e4d4-86e0-434b-9f61-63968f3c8826"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:42:41.627493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-7d00c957-d597-445b-921e-27829c0f53bc req-aaf664d0-5ad3-4e1f-8009-b802396e3a54 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:41.627952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-7d00c957-d597-445b-921e-27829c0f53bc req-aaf664d0-5ad3-4e1f-8009-b802396e3a54 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:41.640248 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-7d00c957-d597-445b-921e-27829c0f53bc req-aaf664d0-5ad3-4e1f-8009-b802396e3a54 service nova] Creating event network-changed:f438e4d4-86e0-434b-9f61-63968f3c8826 for instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 on n-h2-843700-1 May 28 05:42:41.645577 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-7d00c957-d597-445b-921e-27829c0f53bc req-aaf664d0-5ad3-4e1f-8009-b802396e3a54 service nova] Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:42:41.656429 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-7d00c957-d597-445b-921e-27829c0f53bc req-aaf664d0-5ad3-4e1f-8009-b802396e3a54 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042227 May 28 05:42:41.657045 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3649/7413] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:42:42.237813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fc37685e-c5c0-427b-9536-767abee46548 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:42.238439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fc37685e-c5c0-427b-9536-767abee46548 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:42.246286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc37685e-c5c0-427b-9536-767abee46548 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:42.249885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc37685e-c5c0-427b-9536-767abee46548 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:42.249885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc37685e-c5c0-427b-9536-767abee46548 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:42.249885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fc37685e-c5c0-427b-9536-767abee46548 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:42.541482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fc37685e-c5c0-427b-9536-767abee46548 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:42.549146 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fc37685e-c5c0-427b-9536-767abee46548 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1675 microversion: 2.1 time: 0.315855 May 28 05:42:42.549725 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3765/7414] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:42 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1675 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:43.568175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8f95a160-ac8a-40fd-a742-f5c1bc7ee881 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:43.568885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8f95a160-ac8a-40fd-a742-f5c1bc7ee881 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:43.575254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f95a160-ac8a-40fd-a742-f5c1bc7ee881 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:43.575719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f95a160-ac8a-40fd-a742-f5c1bc7ee881 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:43.576484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f95a160-ac8a-40fd-a742-f5c1bc7ee881 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:43.576934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8f95a160-ac8a-40fd-a742-f5c1bc7ee881 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:43.709753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8f95a160-ac8a-40fd-a742-f5c1bc7ee881 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:43.717524 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8f95a160-ac8a-40fd-a742-f5c1bc7ee881 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1668 microversion: 2.1 time: 0.154517 May 28 05:42:43.718131 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3650/7415] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:43 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:43.734402 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-13d7e4e0-bb82-4654-867c-0fc87e9ab536 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:43.735077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-13d7e4e0-bb82-4654-867c-0fc87e9ab536 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:43.742719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13d7e4e0-bb82-4654-867c-0fc87e9ab536 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:43.743265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13d7e4e0-bb82-4654-867c-0fc87e9ab536 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:43.744042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13d7e4e0-bb82-4654-867c-0fc87e9ab536 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:43.744490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-13d7e4e0-bb82-4654-867c-0fc87e9ab536 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:43.876742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-13d7e4e0-bb82-4654-867c-0fc87e9ab536 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:43.884271 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-13d7e4e0-bb82-4654-867c-0fc87e9ab536 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1668 microversion: 2.1 time: 0.153868 May 28 05:42:43.884852 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3766/7416] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:43 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:43.901109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a84200df-c86d-49c4-8f4e-99c83d7875fd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:43.901736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a84200df-c86d-49c4-8f4e-99c83d7875fd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:43.907839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a84200df-c86d-49c4-8f4e-99c83d7875fd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:43.908308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a84200df-c86d-49c4-8f4e-99c83d7875fd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:43.909084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a84200df-c86d-49c4-8f4e-99c83d7875fd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:43.909538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a84200df-c86d-49c4-8f4e-99c83d7875fd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:44.034338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a84200df-c86d-49c4-8f4e-99c83d7875fd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:44.042450 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a84200df-c86d-49c4-8f4e-99c83d7875fd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1668 microversion: 2.1 time: 0.145208 May 28 05:42:44.043039 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3651/7417] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:43 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1668 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:44.058457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-19404537-2aa2-4e51-8d45-0ed58937ba0d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:44.058964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-19404537-2aa2-4e51-8d45-0ed58937ba0d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:44.065111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19404537-2aa2-4e51-8d45-0ed58937ba0d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:44.066099 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19404537-2aa2-4e51-8d45-0ed58937ba0d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:44.066337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19404537-2aa2-4e51-8d45-0ed58937ba0d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:44.066789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-19404537-2aa2-4e51-8d45-0ed58937ba0d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:44.095210 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-19404537-2aa2-4e51-8d45-0ed58937ba0d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:42:44.130011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:42:44.361817 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-19404537-2aa2-4e51-8d45-0ed58937ba0d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "DELETE /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 204 len: 0 microversion: 2.1 time: 0.306945 May 28 05:42:44.362429 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3767/7418] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:42:44 2022] DELETE /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:42:44.370575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b3753577-316f-4c47-ad4c-13c61e4bef63 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:44.375924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b3753577-316f-4c47-ad4c-13c61e4bef63 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:44.377751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b3753577-316f-4c47-ad4c-13c61e4bef63 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:44.378250 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b3753577-316f-4c47-ad4c-13c61e4bef63 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:44.379189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b3753577-316f-4c47-ad4c-13c61e4bef63 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:44.379640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b3753577-316f-4c47-ad4c-13c61e4bef63 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:44.509960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b3753577-316f-4c47-ad4c-13c61e4bef63 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:44.517867 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b3753577-316f-4c47-ad4c-13c61e4bef63 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1674 microversion: 2.1 time: 0.151169 May 28 05:42:44.518460 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3652/7419] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:44 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:45.362824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-381a3054-f09d-45cf-8232-efe3ddfc90b7 req-bfc86514-7a05-410e-a906-0866e441b9db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a40d51-0250-4b0b-9277-f9dfc97e1720", "name": "network-vif-plugged", "status": "completed", "tag": "f438e4d4-86e0-434b-9f61-63968f3c8826"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:42:45.372033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-381a3054-f09d-45cf-8232-efe3ddfc90b7 req-bfc86514-7a05-410e-a906-0866e441b9db service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:45.372427 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-381a3054-f09d-45cf-8232-efe3ddfc90b7 req-bfc86514-7a05-410e-a906-0866e441b9db service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:45.383732 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-381a3054-f09d-45cf-8232-efe3ddfc90b7 req-bfc86514-7a05-410e-a906-0866e441b9db service nova] Creating event network-vif-plugged:f438e4d4-86e0-434b-9f61-63968f3c8826 for instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 on n-h2-843700-1 May 28 05:42:45.388923 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-381a3054-f09d-45cf-8232-efe3ddfc90b7 req-bfc86514-7a05-410e-a906-0866e441b9db service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030234 May 28 05:42:45.389493 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3768/7420] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:42:45.536596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-60bd2698-0301-4d45-8cd0-116fbe1ec613 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:45.537872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-60bd2698-0301-4d45-8cd0-116fbe1ec613 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:45.540744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:42:45.545708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60bd2698-0301-4d45-8cd0-116fbe1ec613 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:45.546179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60bd2698-0301-4d45-8cd0-116fbe1ec613 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:45.546972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60bd2698-0301-4d45-8cd0-116fbe1ec613 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:45.547454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60bd2698-0301-4d45-8cd0-116fbe1ec613 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:45.677682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-60bd2698-0301-4d45-8cd0-116fbe1ec613 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:45.685223 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-60bd2698-0301-4d45-8cd0-116fbe1ec613 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1674 microversion: 2.1 time: 0.152679 May 28 05:42:45.685797 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3653/7421] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:45 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:46.565974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-a9a4fd2f-bd43-4c5b-82fd-1ce826353d0e req-5ef9cf73-85fe-400e-b2ea-a3baa17aa886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a40d51-0250-4b0b-9277-f9dfc97e1720", "name": "network-vif-deleted", "tag": "f438e4d4-86e0-434b-9f61-63968f3c8826"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:42:46.576262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a9a4fd2f-bd43-4c5b-82fd-1ce826353d0e req-5ef9cf73-85fe-400e-b2ea-a3baa17aa886 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:46.576709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a9a4fd2f-bd43-4c5b-82fd-1ce826353d0e req-5ef9cf73-85fe-400e-b2ea-a3baa17aa886 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:46.588058 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-a9a4fd2f-bd43-4c5b-82fd-1ce826353d0e req-5ef9cf73-85fe-400e-b2ea-a3baa17aa886 service nova] Creating event network-vif-deleted:f438e4d4-86e0-434b-9f61-63968f3c8826 for instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 on n-h2-843700-1 May 28 05:42:46.592903 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-a9a4fd2f-bd43-4c5b-82fd-1ce826353d0e req-5ef9cf73-85fe-400e-b2ea-a3baa17aa886 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031209 May 28 05:42:46.593510 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3769/7422] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:42:46.703821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e36428f8-ee3a-452a-844c-517bbb887800 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:46.704455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e36428f8-ee3a-452a-844c-517bbb887800 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:46.707704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:42:46.713261 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e36428f8-ee3a-452a-844c-517bbb887800 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:46.714003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e36428f8-ee3a-452a-844c-517bbb887800 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:46.714935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e36428f8-ee3a-452a-844c-517bbb887800 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:46.715429 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e36428f8-ee3a-452a-844c-517bbb887800 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:46.781719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e36428f8-ee3a-452a-844c-517bbb887800 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:46.796300 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e36428f8-ee3a-452a-844c-517bbb887800 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 200 len: 1323 microversion: 2.1 time: 0.096697 May 28 05:42:46.796912 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3654/7423] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:46 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 1323 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:47.815125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-73b7d862-1919-4ae5-872e-aa7654b8e3d6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:47.815845 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-73b7d862-1919-4ae5-872e-aa7654b8e3d6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:47.822864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73b7d862-1919-4ae5-872e-aa7654b8e3d6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:47.823360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73b7d862-1919-4ae5-872e-aa7654b8e3d6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:47.824222 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73b7d862-1919-4ae5-872e-aa7654b8e3d6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:47.824673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-73b7d862-1919-4ae5-872e-aa7654b8e3d6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:47.838120 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-73b7d862-1919-4ae5-872e-aa7654b8e3d6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] HTTP exception thrown: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-73b7d862-1919-4ae5-872e-aa7654b8e3d6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Request method failure captured: May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 HTTP/1.1 May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbV8EVqnsXJ4v8PKLpKbSN-UMKIcSy3KmkP6QXvwdRFm704ALR4cl_gP9SPkmpV3xU_0jRk0mImnS7YmIQnzqGR8Czb30Vc2tEyE75b992FPEefKyODL7t_FCesR9j2FYAAhL0AvtL4GoBrh1ex3V5-HI_FVJL-8Aq7U-X9LX1Ide1Y May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerActionsTestJSON-1722172964 May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerActionsTestJSON-1722172964-project May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 1ffd8cb46a064f39a7b4468292d57b42 May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerActionsTestJSON-1722172964-project May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '65a40d51-0250-4b0b-9277-f9dfc97e1720'} May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:42:47.839765 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:42:47.845195 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:42:47.845195 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:42:47.845195 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:42:47.845195 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:42:47.845195 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:42:47.845195 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. May 28 05:42:47.845195 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:42:47.845195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-73b7d862-1919-4ae5-872e-aa7654b8e3d6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Returning 404 to user: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:42:47.845195 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-73b7d862-1919-4ae5-872e-aa7654b8e3d6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 404 len: 111 microversion: 2.1 time: 0.031237 May 28 05:42:47.845195 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3770/7424] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:47 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:42:47.857608 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a201cb8b-2715-4948-a964-b02d59cd6116 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:47.858249 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a201cb8b-2715-4948-a964-b02d59cd6116 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:47.866377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a201cb8b-2715-4948-a964-b02d59cd6116 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:47.866774 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a201cb8b-2715-4948-a964-b02d59cd6116 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:47.867594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a201cb8b-2715-4948-a964-b02d59cd6116 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:47.868056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a201cb8b-2715-4948-a964-b02d59cd6116 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:47.882418 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-a201cb8b-2715-4948-a964-b02d59cd6116 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] HTTP exception thrown: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a201cb8b-2715-4948-a964-b02d59cd6116 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Request method failure captured: May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 HTTP/1.1 May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbV8EVqnsXJ4v8PKLpKbSN-UMKIcSy3KmkP6QXvwdRFm704ALR4cl_gP9SPkmpV3xU_0jRk0mImnS7YmIQnzqGR8Czb30Vc2tEyE75b992FPEefKyODL7t_FCesR9j2FYAAhL0AvtL4GoBrh1ex3V5-HI_FVJL-8Aq7U-X9LX1Ide1Y May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerActionsTestJSON-1722172964 May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerActionsTestJSON-1722172964-project May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 1ffd8cb46a064f39a7b4468292d57b42 May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerActionsTestJSON-1722172964-project May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '65a40d51-0250-4b0b-9277-f9dfc97e1720'} May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:42:47.884141 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:42:47.898428 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:42:47.898428 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:42:47.898428 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:42:47.898428 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:42:47.898428 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:42:47.898428 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. May 28 05:42:47.898428 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:42:47.898428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a201cb8b-2715-4948-a964-b02d59cd6116 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Returning 404 to user: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:42:47.898428 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a201cb8b-2715-4948-a964-b02d59cd6116 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 404 len: 111 microversion: 2.1 time: 0.032573 May 28 05:42:47.898428 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3655/7425] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:47 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:42:48.051570 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-00c579c4-0900-40d7-973e-9a1f7ed2713d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1009819776", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "37f5385b-a020-4f12-be61-b8733e663a1f"}], "security_groups": [{"name": "tempest-securitygroup--1050968748"}], "key_name": "tempest-keypair-121898998", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:42:48.051570 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-00c579c4-0900-40d7-973e-9a1f7ed2713d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] validate_networks() for [('37f5385b-a020-4f12-be61-b8733e663a1f', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:42:48.454442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-00c579c4-0900-40d7-973e-9a1f7ed2713d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:42:48.454942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-00c579c4-0900-40d7-973e-9a1f7ed2713d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:42:48.455537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-00c579c4-0900-40d7-973e-9a1f7ed2713d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:42:48.456026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-00c579c4-0900-40d7-973e-9a1f7ed2713d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:42:48.456519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-00c579c4-0900-40d7-973e-9a1f7ed2713d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:42:48.475473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00c579c4-0900-40d7-973e-9a1f7ed2713d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:48.475935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00c579c4-0900-40d7-973e-9a1f7ed2713d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:48.476749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00c579c4-0900-40d7-973e-9a1f7ed2713d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:48.477196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00c579c4-0900-40d7-973e-9a1f7ed2713d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:48.494267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-00c579c4-0900-40d7-973e-9a1f7ed2713d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Getting quotas for project a59090a2c3eb4898a218d26e86807a86. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:42:48.499587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-00c579c4-0900-40d7-973e-9a1f7ed2713d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Getting quotas for user 1ffd8cb46a064f39a7b4468292d57b42 and project a59090a2c3eb4898a218d26e86807a86. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:42:48.512227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-00c579c4-0900-40d7-973e-9a1f7ed2713d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:42:48.514512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-00c579c4-0900-40d7-973e-9a1f7ed2713d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:42:48.643436 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-00c579c4-0900-40d7-973e-9a1f7ed2713d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.712854 May 28 05:42:48.644393 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3771/7426] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:42:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 05:42:48.657495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b055b773-8b88-4053-8c0d-7535cc3b32ec tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:48.658258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b055b773-8b88-4053-8c0d-7535cc3b32ec tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:48.717344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b055b773-8b88-4053-8c0d-7535cc3b32ec tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:48.726281 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b055b773-8b88-4053-8c0d-7535cc3b32ec tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1238 microversion: 2.1 time: 0.073241 May 28 05:42:48.728370 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3656/7427] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:48 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:49.745512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b523110b-abd7-4a4a-9c9a-5a7b89cf0096 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:49.746139 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b523110b-abd7-4a4a-9c9a-5a7b89cf0096 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:49.748280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:42:49.753906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b523110b-abd7-4a4a-9c9a-5a7b89cf0096 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:49.754367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b523110b-abd7-4a4a-9c9a-5a7b89cf0096 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:49.755378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b523110b-abd7-4a4a-9c9a-5a7b89cf0096 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:49.755830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b523110b-abd7-4a4a-9c9a-5a7b89cf0096 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:49.824884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b523110b-abd7-4a4a-9c9a-5a7b89cf0096 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:49.832793 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b523110b-abd7-4a4a-9c9a-5a7b89cf0096 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1234 microversion: 2.1 time: 0.093201 May 28 05:42:49.839154 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3772/7428] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:49 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1234 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:50.850960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-845da234-8753-4257-8606-955e30d45c9f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:50.851775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-845da234-8753-4257-8606-955e30d45c9f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:50.859870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-845da234-8753-4257-8606-955e30d45c9f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:50.860343 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-845da234-8753-4257-8606-955e30d45c9f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:50.861135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-845da234-8753-4257-8606-955e30d45c9f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:50.861591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-845da234-8753-4257-8606-955e30d45c9f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:51.284394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-845da234-8753-4257-8606-955e30d45c9f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:51.292636 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-845da234-8753-4257-8606-955e30d45c9f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1296 microversion: 2.1 time: 0.445595 May 28 05:42:51.293208 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3657/7429] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:50 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1296 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:52.309808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3a4b9769-f16c-4d9e-b22f-78e240fc2f9a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:52.310459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3a4b9769-f16c-4d9e-b22f-78e240fc2f9a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:52.317969 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a4b9769-f16c-4d9e-b22f-78e240fc2f9a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:52.319042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a4b9769-f16c-4d9e-b22f-78e240fc2f9a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:52.319823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a4b9769-f16c-4d9e-b22f-78e240fc2f9a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:52.320259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3a4b9769-f16c-4d9e-b22f-78e240fc2f9a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:52.439219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-a34b6978-f376-4ce8-98a6-ce10c118d4ee req-38ff5c31-112f-4755-b0fc-ac3e81a34a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bbb3c86-82f6-41bf-ae76-0e34ca7894f0", "tag": "5364bc03-00c4-4482-8f2e-fad0620855fa"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:42:52.449735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a34b6978-f376-4ce8-98a6-ce10c118d4ee req-38ff5c31-112f-4755-b0fc-ac3e81a34a3d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:52.450220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-a34b6978-f376-4ce8-98a6-ce10c118d4ee req-38ff5c31-112f-4755-b0fc-ac3e81a34a3d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:52.463209 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-a34b6978-f376-4ce8-98a6-ce10c118d4ee req-38ff5c31-112f-4755-b0fc-ac3e81a34a3d service nova] Creating event network-changed:5364bc03-00c4-4482-8f2e-fad0620855fa for instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 on n-h1-843700-1 May 28 05:42:52.470406 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-a34b6978-f376-4ce8-98a6-ce10c118d4ee req-38ff5c31-112f-4755-b0fc-ac3e81a34a3d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034900 May 28 05:42:52.472260 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3658/7430] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:42:52.556377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3a4b9769-f16c-4d9e-b22f-78e240fc2f9a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:52.564712 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3a4b9769-f16c-4d9e-b22f-78e240fc2f9a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1364 microversion: 2.1 time: 0.258759 May 28 05:42:52.565313 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3773/7431] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:52 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:53.586607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a637120d-6ccf-4daa-992f-eb5440faff4e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:53.587349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a637120d-6ccf-4daa-992f-eb5440faff4e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:53.593882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a637120d-6ccf-4daa-992f-eb5440faff4e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:53.594347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a637120d-6ccf-4daa-992f-eb5440faff4e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:53.595237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a637120d-6ccf-4daa-992f-eb5440faff4e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:53.595693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a637120d-6ccf-4daa-992f-eb5440faff4e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:53.727090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a637120d-6ccf-4daa-992f-eb5440faff4e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:53.734514 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a637120d-6ccf-4daa-992f-eb5440faff4e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1364 microversion: 2.1 time: 0.153559 May 28 05:42:53.735107 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3659/7432] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:53 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:54.751955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3eb550cc-9561-4975-9ae2-9ba19c845225 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:54.752582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3eb550cc-9561-4975-9ae2-9ba19c845225 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:54.758872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3eb550cc-9561-4975-9ae2-9ba19c845225 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:54.759356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3eb550cc-9561-4975-9ae2-9ba19c845225 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:54.760373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3eb550cc-9561-4975-9ae2-9ba19c845225 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:54.760821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3eb550cc-9561-4975-9ae2-9ba19c845225 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:54.890064 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3eb550cc-9561-4975-9ae2-9ba19c845225 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:54.897501 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3eb550cc-9561-4975-9ae2-9ba19c845225 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1364 microversion: 2.1 time: 0.149666 May 28 05:42:54.898068 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3774/7433] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:54 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:55.914307 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-62dcc378-b56f-461a-8754-a24c7ea2b00a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:55.914939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-62dcc378-b56f-461a-8754-a24c7ea2b00a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:55.921995 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-62dcc378-b56f-461a-8754-a24c7ea2b00a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:55.922456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-62dcc378-b56f-461a-8754-a24c7ea2b00a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:55.923295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-62dcc378-b56f-461a-8754-a24c7ea2b00a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:55.923744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-62dcc378-b56f-461a-8754-a24c7ea2b00a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:56.049827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-62dcc378-b56f-461a-8754-a24c7ea2b00a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:56.057759 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-62dcc378-b56f-461a-8754-a24c7ea2b00a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1364 microversion: 2.1 time: 0.147418 May 28 05:42:56.058330 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3660/7434] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:55 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:57.075100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0a6b8b4d-5181-4801-9621-732122dc4bfe tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:57.085375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0a6b8b4d-5181-4801-9621-732122dc4bfe tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:57.085375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0a6b8b4d-5181-4801-9621-732122dc4bfe tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:57.085375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0a6b8b4d-5181-4801-9621-732122dc4bfe tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:57.085375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0a6b8b4d-5181-4801-9621-732122dc4bfe tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:57.085375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0a6b8b4d-5181-4801-9621-732122dc4bfe tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:57.220753 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0a6b8b4d-5181-4801-9621-732122dc4bfe tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:57.228328 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0a6b8b4d-5181-4801-9621-732122dc4bfe tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1364 microversion: 2.1 time: 0.157187 May 28 05:42:57.228916 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3775/7435] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:57 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:58.246025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ce50cfb6-3ac7-4b7d-972e-80158b150489 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:58.246598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ce50cfb6-3ac7-4b7d-972e-80158b150489 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:58.253638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce50cfb6-3ac7-4b7d-972e-80158b150489 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:58.254113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce50cfb6-3ac7-4b7d-972e-80158b150489 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:58.254897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce50cfb6-3ac7-4b7d-972e-80158b150489 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:58.255381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ce50cfb6-3ac7-4b7d-972e-80158b150489 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:58.386343 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ce50cfb6-3ac7-4b7d-972e-80158b150489 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:58.394086 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ce50cfb6-3ac7-4b7d-972e-80158b150489 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1364 microversion: 2.1 time: 0.152057 May 28 05:42:58.394716 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3661/7436] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:58 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:42:58.517458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-c5b6be11-2ce7-48c1-a39a-1b2c3e631838 req-42d27969-403f-48c9-9f82-62a86b4edfa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbb3c86-82f6-41bf-ae76-0e34ca7894f0", "name": "network-vif-plugged", "status": "completed", "tag": "5364bc03-00c4-4482-8f2e-fad0620855fa"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:42:58.523571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:42:58.524241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:42:58.528246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c5b6be11-2ce7-48c1-a39a-1b2c3e631838 req-42d27969-403f-48c9-9f82-62a86b4edfa9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:58.528702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c5b6be11-2ce7-48c1-a39a-1b2c3e631838 req-42d27969-403f-48c9-9f82-62a86b4edfa9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:58.539697 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-c5b6be11-2ce7-48c1-a39a-1b2c3e631838 req-42d27969-403f-48c9-9f82-62a86b4edfa9 service nova] Creating event network-vif-plugged:5364bc03-00c4-4482-8f2e-fad0620855fa for instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 on n-h1-843700-1 May 28 05:42:58.544588 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-c5b6be11-2ce7-48c1-a39a-1b2c3e631838 req-42d27969-403f-48c9-9f82-62a86b4edfa9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030934 May 28 05:42:58.545173 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3776/7437] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:42:59.412914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-74b35a55-42a0-455b-984d-186401ddd8de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:42:59.413542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-74b35a55-42a0-455b-984d-186401ddd8de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:42:59.415609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:42:59.421324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74b35a55-42a0-455b-984d-186401ddd8de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:59.423161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74b35a55-42a0-455b-984d-186401ddd8de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:59.423161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74b35a55-42a0-455b-984d-186401ddd8de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:42:59.423161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-74b35a55-42a0-455b-984d-186401ddd8de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:42:59.551353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-74b35a55-42a0-455b-984d-186401ddd8de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:42:59.558836 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-74b35a55-42a0-455b-984d-186401ddd8de tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1364 microversion: 2.1 time: 0.150386 May 28 05:42:59.559445 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3662/7438] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:42:59 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:43:00.577667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-06db5c26-f989-4615-ad03-f99ea888ffb5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:43:00.578376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-06db5c26-f989-4615-ad03-f99ea888ffb5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:43:00.585621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-06db5c26-f989-4615-ad03-f99ea888ffb5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:43:00.586078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-06db5c26-f989-4615-ad03-f99ea888ffb5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:43:00.586850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-06db5c26-f989-4615-ad03-f99ea888ffb5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:43:00.587316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-06db5c26-f989-4615-ad03-f99ea888ffb5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:43:00.717183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-06db5c26-f989-4615-ad03-f99ea888ffb5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:43:00.725413 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-06db5c26-f989-4615-ad03-f99ea888ffb5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1549 microversion: 2.1 time: 0.152862 May 28 05:43:00.726004 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3777/7439] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:43:00 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:43:00.742927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a84cb1af-61b6-4bfe-aa39-d8f075060ecd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:43:00.745252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a84cb1af-61b6-4bfe-aa39-d8f075060ecd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:43:00.750279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a84cb1af-61b6-4bfe-aa39-d8f075060ecd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:43:00.750756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a84cb1af-61b6-4bfe-aa39-d8f075060ecd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:43:00.751557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a84cb1af-61b6-4bfe-aa39-d8f075060ecd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:43:00.752011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a84cb1af-61b6-4bfe-aa39-d8f075060ecd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:43:00.833174 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a84cb1af-61b6-4bfe-aa39-d8f075060ecd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094717 May 28 05:43:00.833831 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3663/7440] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 05:43:00 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:43:01.784249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-65ff653a-cc25-4f6b-a84c-4d618e9a77fc req-14eb0272-4cc5-4d01-9647-2daecf34e673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bbb3c86-82f6-41bf-ae76-0e34ca7894f0", "tag": "5364bc03-00c4-4482-8f2e-fad0620855fa"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:43:01.793320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-65ff653a-cc25-4f6b-a84c-4d618e9a77fc req-14eb0272-4cc5-4d01-9647-2daecf34e673 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:43:01.793774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-65ff653a-cc25-4f6b-a84c-4d618e9a77fc req-14eb0272-4cc5-4d01-9647-2daecf34e673 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:43:01.805187 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-65ff653a-cc25-4f6b-a84c-4d618e9a77fc req-14eb0272-4cc5-4d01-9647-2daecf34e673 service nova] Creating event network-changed:5364bc03-00c4-4482-8f2e-fad0620855fa for instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 on n-h1-843700-1 May 28 05:43:01.810530 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-65ff653a-cc25-4f6b-a84c-4d618e9a77fc req-14eb0272-4cc5-4d01-9647-2daecf34e673 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029928 May 28 05:43:01.811172 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3778/7441] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:43:37.494674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=21 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:43:37.495568 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=82 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:43:37.499417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fed57aae-bfd4-44d2-9051-56a4b94cba20 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:43:37.500040 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fed57aae-bfd4-44d2-9051-56a4b94cba20 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:43:37.506498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fed57aae-bfd4-44d2-9051-56a4b94cba20 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:43:37.506958 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fed57aae-bfd4-44d2-9051-56a4b94cba20 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:43:37.507756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fed57aae-bfd4-44d2-9051-56a4b94cba20 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:43:37.508202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fed57aae-bfd4-44d2-9051-56a4b94cba20 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:43:37.636724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fed57aae-bfd4-44d2-9051-56a4b94cba20 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:43:37.644473 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fed57aae-bfd4-44d2-9051-56a4b94cba20 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1668 microversion: 2.1 time: 0.151780 May 28 05:43:37.645730 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3664/7442] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:43:37 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:43:37.660515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=13 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:43:37.661365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:43:37.665617 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c0f65cc8-84f8-46a7-893a-34710ec217af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70870c29-3a3d-472a-b095-2d6ef0ab9034"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:43:37.666856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c0f65cc8-84f8-46a7-893a-34710ec217af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:43:37.672999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0f65cc8-84f8-46a7-893a-34710ec217af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:43:37.673462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0f65cc8-84f8-46a7-893a-34710ec217af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:43:37.674281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0f65cc8-84f8-46a7-893a-34710ec217af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:43:37.674730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0f65cc8-84f8-46a7-893a-34710ec217af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:43:38.245905 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c0f65cc8-84f8-46a7-893a-34710ec217af tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "POST /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.587946 May 28 05:43:38.246546 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3779/7443] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 05:43:37 2022] POST /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0/os-volume_attachments => generated 194 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:43:55.219326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-967fa545-029b-4e2e-bc9b-2fc37425ea44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:43:55.220352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-967fa545-029b-4e2e-bc9b-2fc37425ea44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:43:55.222334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:43:55.223025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:43:55.228435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-967fa545-029b-4e2e-bc9b-2fc37425ea44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:43:55.237345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-967fa545-029b-4e2e-bc9b-2fc37425ea44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:43:55.237345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-967fa545-029b-4e2e-bc9b-2fc37425ea44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:43:55.237345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-967fa545-029b-4e2e-bc9b-2fc37425ea44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:43:55.263527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-967fa545-029b-4e2e-bc9b-2fc37425ea44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:43:55.269911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-967fa545-029b-4e2e-bc9b-2fc37425ea44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Old instance type m1.heat2, new instance type m1.heat {{(pid=126043) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 05:43:55.276905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-967fa545-029b-4e2e-bc9b-2fc37425ea44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:43:55.277322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-967fa545-029b-4e2e-bc9b-2fc37425ea44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:43:55.277812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-967fa545-029b-4e2e-bc9b-2fc37425ea44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:43:55.278241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-967fa545-029b-4e2e-bc9b-2fc37425ea44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:43:55.278666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-967fa545-029b-4e2e-bc9b-2fc37425ea44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:43:55.473441 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-967fa545-029b-4e2e-bc9b-2fc37425ea44 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "POST /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0/action" status: 202 len: 0 microversion: 2.1 time: 0.257905 May 28 05:43:55.474191 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3665/7444] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:43:55 2022] POST /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:43:55.480524 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:43:55.481638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:43:55.485800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0ee6b728-70d2-4404-9819-fa6189ca94c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:43:55.486536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0ee6b728-70d2-4404-9819-fa6189ca94c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:43:55.493600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ee6b728-70d2-4404-9819-fa6189ca94c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:43:55.494056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ee6b728-70d2-4404-9819-fa6189ca94c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:43:55.494842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ee6b728-70d2-4404-9819-fa6189ca94c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:43:55.495332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ee6b728-70d2-4404-9819-fa6189ca94c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:43:55.627680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0ee6b728-70d2-4404-9819-fa6189ca94c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:43:55.635954 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0ee6b728-70d2-4404-9819-fa6189ca94c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1723 microversion: 2.1 time: 0.157482 May 28 05:43:55.636566 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3780/7445] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:43:55 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:43:56.654780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cb33432f-3a0e-4100-9da5-c0ca84571270 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:43:56.655473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cb33432f-3a0e-4100-9da5-c0ca84571270 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:43:56.661732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb33432f-3a0e-4100-9da5-c0ca84571270 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:43:56.666167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb33432f-3a0e-4100-9da5-c0ca84571270 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:43:56.666167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb33432f-3a0e-4100-9da5-c0ca84571270 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:43:56.666167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb33432f-3a0e-4100-9da5-c0ca84571270 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:43:56.792857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cb33432f-3a0e-4100-9da5-c0ca84571270 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:43:56.801643 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cb33432f-3a0e-4100-9da5-c0ca84571270 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1723 microversion: 2.1 time: 0.151823 May 28 05:43:56.802223 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3666/7446] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:43:56 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:43:57.819859 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-df74864e-a024-44ae-8698-17782c27d18c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:43:57.820483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-df74864e-a024-44ae-8698-17782c27d18c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:43:57.828135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df74864e-a024-44ae-8698-17782c27d18c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:43:57.828596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df74864e-a024-44ae-8698-17782c27d18c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:43:57.829366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df74864e-a024-44ae-8698-17782c27d18c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:43:57.829809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df74864e-a024-44ae-8698-17782c27d18c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:43:58.021431 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-df74864e-a024-44ae-8698-17782c27d18c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:43:58.029821 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-df74864e-a024-44ae-8698-17782c27d18c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1723 microversion: 2.1 time: 0.214410 May 28 05:43:58.030416 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3781/7447] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:43:57 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:43:59.047451 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-90a8c72a-bd40-48e6-952e-33641f367f34 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:43:59.048096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-90a8c72a-bd40-48e6-952e-33641f367f34 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:43:59.055084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-90a8c72a-bd40-48e6-952e-33641f367f34 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:43:59.056859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-90a8c72a-bd40-48e6-952e-33641f367f34 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:43:59.056859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-90a8c72a-bd40-48e6-952e-33641f367f34 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:43:59.056859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-90a8c72a-bd40-48e6-952e-33641f367f34 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:43:59.189384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-90a8c72a-bd40-48e6-952e-33641f367f34 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:43:59.197938 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-90a8c72a-bd40-48e6-952e-33641f367f34 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.154390 May 28 05:43:59.198520 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3667/7448] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:43:59 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:00.216255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c42cd613-6bb9-475f-995f-0d3d3bc01d9b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:00.216870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c42cd613-6bb9-475f-995f-0d3d3bc01d9b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:00.224389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c42cd613-6bb9-475f-995f-0d3d3bc01d9b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:00.224838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c42cd613-6bb9-475f-995f-0d3d3bc01d9b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:00.225593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c42cd613-6bb9-475f-995f-0d3d3bc01d9b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:00.226027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c42cd613-6bb9-475f-995f-0d3d3bc01d9b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:00.355318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c42cd613-6bb9-475f-995f-0d3d3bc01d9b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:00.363261 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c42cd613-6bb9-475f-995f-0d3d3bc01d9b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.150927 May 28 05:44:00.363850 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3782/7449] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:00 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:01.381297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fba2460a-245e-4520-8fc8-17e45017d95a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:01.381860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fba2460a-245e-4520-8fc8-17e45017d95a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:01.389056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fba2460a-245e-4520-8fc8-17e45017d95a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:01.389518 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fba2460a-245e-4520-8fc8-17e45017d95a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:01.390289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fba2460a-245e-4520-8fc8-17e45017d95a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:01.390747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fba2460a-245e-4520-8fc8-17e45017d95a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:01.523786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fba2460a-245e-4520-8fc8-17e45017d95a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:01.531944 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fba2460a-245e-4520-8fc8-17e45017d95a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.155117 May 28 05:44:01.532532 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3668/7450] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:01 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:02.549278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d6af4014-c7b0-46f9-ac01-447710464a66 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:02.549886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d6af4014-c7b0-46f9-ac01-447710464a66 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:02.557251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d6af4014-c7b0-46f9-ac01-447710464a66 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:02.557706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d6af4014-c7b0-46f9-ac01-447710464a66 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:02.558468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d6af4014-c7b0-46f9-ac01-447710464a66 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:02.558906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d6af4014-c7b0-46f9-ac01-447710464a66 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:02.686478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d6af4014-c7b0-46f9-ac01-447710464a66 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:02.695156 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d6af4014-c7b0-46f9-ac01-447710464a66 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.149793 May 28 05:44:02.695735 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3783/7451] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:02 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:03.712547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1b9fbaae-6e38-47e9-a428-5b1b59eff84e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:03.713176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1b9fbaae-6e38-47e9-a428-5b1b59eff84e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:03.720202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b9fbaae-6e38-47e9-a428-5b1b59eff84e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:03.720674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b9fbaae-6e38-47e9-a428-5b1b59eff84e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:03.721460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b9fbaae-6e38-47e9-a428-5b1b59eff84e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:03.721918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b9fbaae-6e38-47e9-a428-5b1b59eff84e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:03.859146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1b9fbaae-6e38-47e9-a428-5b1b59eff84e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:03.861996 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1b9fbaae-6e38-47e9-a428-5b1b59eff84e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.153370 May 28 05:44:03.862578 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3669/7452] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:03 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:04.880093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2f6511b6-fafe-49e7-b7f7-d01cfca06836 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:04.880643 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2f6511b6-fafe-49e7-b7f7-d01cfca06836 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:04.887859 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f6511b6-fafe-49e7-b7f7-d01cfca06836 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:04.888317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f6511b6-fafe-49e7-b7f7-d01cfca06836 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:04.889094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f6511b6-fafe-49e7-b7f7-d01cfca06836 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:04.889532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f6511b6-fafe-49e7-b7f7-d01cfca06836 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:05.016011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2f6511b6-fafe-49e7-b7f7-d01cfca06836 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:05.024522 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2f6511b6-fafe-49e7-b7f7-d01cfca06836 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.148436 May 28 05:44:05.025133 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3784/7453] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:04 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:06.042226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-965413e9-25e4-4f2b-9ddd-4170eceff5f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:06.042896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-965413e9-25e4-4f2b-9ddd-4170eceff5f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:06.049997 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-965413e9-25e4-4f2b-9ddd-4170eceff5f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:06.050468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-965413e9-25e4-4f2b-9ddd-4170eceff5f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:06.051936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-965413e9-25e4-4f2b-9ddd-4170eceff5f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:06.052388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-965413e9-25e4-4f2b-9ddd-4170eceff5f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:06.185414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-965413e9-25e4-4f2b-9ddd-4170eceff5f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:06.193673 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-965413e9-25e4-4f2b-9ddd-4170eceff5f3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.155292 May 28 05:44:06.194257 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3670/7454] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:06 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:07.261778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6af65c6b-fee6-49a4-8910-7bf950d856e4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:07.262400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6af65c6b-fee6-49a4-8910-7bf950d856e4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:07.268651 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6af65c6b-fee6-49a4-8910-7bf950d856e4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:07.269101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6af65c6b-fee6-49a4-8910-7bf950d856e4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:07.270356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6af65c6b-fee6-49a4-8910-7bf950d856e4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:07.270817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6af65c6b-fee6-49a4-8910-7bf950d856e4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:07.400666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6af65c6b-fee6-49a4-8910-7bf950d856e4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:07.408664 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6af65c6b-fee6-49a4-8910-7bf950d856e4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.201526 May 28 05:44:07.409245 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3785/7455] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:07 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:08.425737 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f06a2951-37f9-415f-bbf3-805f286b92d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:08.426282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f06a2951-37f9-415f-bbf3-805f286b92d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:08.433214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f06a2951-37f9-415f-bbf3-805f286b92d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:08.433674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f06a2951-37f9-415f-bbf3-805f286b92d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:08.434445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f06a2951-37f9-415f-bbf3-805f286b92d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:08.434890 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f06a2951-37f9-415f-bbf3-805f286b92d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:08.567610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f06a2951-37f9-415f-bbf3-805f286b92d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:08.575684 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f06a2951-37f9-415f-bbf3-805f286b92d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.153971 May 28 05:44:08.576274 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3671/7456] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:08 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:09.592996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-31e11a9e-8c13-443b-b5d5-2271838da45b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:09.593623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-31e11a9e-8c13-443b-b5d5-2271838da45b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:09.601361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31e11a9e-8c13-443b-b5d5-2271838da45b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:09.601819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31e11a9e-8c13-443b-b5d5-2271838da45b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:09.602607 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31e11a9e-8c13-443b-b5d5-2271838da45b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:09.603069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31e11a9e-8c13-443b-b5d5-2271838da45b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:09.730942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-31e11a9e-8c13-443b-b5d5-2271838da45b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:09.739032 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-31e11a9e-8c13-443b-b5d5-2271838da45b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.149922 May 28 05:44:09.739620 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3786/7457] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:09 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:10.756062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dd322d59-b660-4e27-9af8-9100d761cc26 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:10.756683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dd322d59-b660-4e27-9af8-9100d761cc26 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:10.763918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd322d59-b660-4e27-9af8-9100d761cc26 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:10.764384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd322d59-b660-4e27-9af8-9100d761cc26 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:10.765166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd322d59-b660-4e27-9af8-9100d761cc26 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:10.765615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dd322d59-b660-4e27-9af8-9100d761cc26 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:10.893682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dd322d59-b660-4e27-9af8-9100d761cc26 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:10.902416 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dd322d59-b660-4e27-9af8-9100d761cc26 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.150181 May 28 05:44:10.903239 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3672/7458] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:10 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:11.920471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6b8441fb-0ca5-4331-b0aa-7dc7b3cde469 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:11.921119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6b8441fb-0ca5-4331-b0aa-7dc7b3cde469 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:11.928722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6b8441fb-0ca5-4331-b0aa-7dc7b3cde469 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:11.929178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6b8441fb-0ca5-4331-b0aa-7dc7b3cde469 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:11.929949 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6b8441fb-0ca5-4331-b0aa-7dc7b3cde469 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:11.930391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6b8441fb-0ca5-4331-b0aa-7dc7b3cde469 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:12.056778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6b8441fb-0ca5-4331-b0aa-7dc7b3cde469 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:12.064779 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6b8441fb-0ca5-4331-b0aa-7dc7b3cde469 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.148228 May 28 05:44:12.065357 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3787/7459] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:11 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:13.082013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-78eda57c-6b57-423f-a6de-b70e170b7f5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:13.082656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-78eda57c-6b57-423f-a6de-b70e170b7f5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:13.090058 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78eda57c-6b57-423f-a6de-b70e170b7f5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:13.090532 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78eda57c-6b57-423f-a6de-b70e170b7f5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:13.091353 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78eda57c-6b57-423f-a6de-b70e170b7f5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:13.091813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-78eda57c-6b57-423f-a6de-b70e170b7f5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:13.222544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-78eda57c-6b57-423f-a6de-b70e170b7f5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:13.230665 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-78eda57c-6b57-423f-a6de-b70e170b7f5c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.152589 May 28 05:44:13.231279 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3673/7460] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:13 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:14.248545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8db3f7b9-9e63-4ff4-9e59-9cb9939e8142 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:14.249159 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8db3f7b9-9e63-4ff4-9e59-9cb9939e8142 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:14.256637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8db3f7b9-9e63-4ff4-9e59-9cb9939e8142 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:14.257093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8db3f7b9-9e63-4ff4-9e59-9cb9939e8142 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:14.257862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8db3f7b9-9e63-4ff4-9e59-9cb9939e8142 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:14.258301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8db3f7b9-9e63-4ff4-9e59-9cb9939e8142 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:14.389827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8db3f7b9-9e63-4ff4-9e59-9cb9939e8142 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:14.398470 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8db3f7b9-9e63-4ff4-9e59-9cb9939e8142 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.153824 May 28 05:44:14.399070 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3788/7461] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:14 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:15.415833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a3694129-239f-4b79-8695-1dd10f47d932 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:15.416500 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a3694129-239f-4b79-8695-1dd10f47d932 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:15.423448 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3694129-239f-4b79-8695-1dd10f47d932 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:15.423918 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3694129-239f-4b79-8695-1dd10f47d932 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:15.424697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3694129-239f-4b79-8695-1dd10f47d932 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:15.425155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a3694129-239f-4b79-8695-1dd10f47d932 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:15.557726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a3694129-239f-4b79-8695-1dd10f47d932 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:15.565740 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a3694129-239f-4b79-8695-1dd10f47d932 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.153856 May 28 05:44:15.566319 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3674/7462] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:15 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:16.582385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5a31e813-9691-4b42-a0c4-0774932feb45 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:16.583053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5a31e813-9691-4b42-a0c4-0774932feb45 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:16.589962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a31e813-9691-4b42-a0c4-0774932feb45 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:16.590420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a31e813-9691-4b42-a0c4-0774932feb45 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:16.591219 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a31e813-9691-4b42-a0c4-0774932feb45 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:16.591662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a31e813-9691-4b42-a0c4-0774932feb45 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:16.719468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5a31e813-9691-4b42-a0c4-0774932feb45 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:16.727982 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5a31e813-9691-4b42-a0c4-0774932feb45 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.149583 May 28 05:44:16.728596 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3789/7463] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:16 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:17.745165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d580452f-8a05-497f-af9f-d521992824f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:17.745801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d580452f-8a05-497f-af9f-d521992824f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:17.752920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d580452f-8a05-497f-af9f-d521992824f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:17.753392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d580452f-8a05-497f-af9f-d521992824f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:17.754777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d580452f-8a05-497f-af9f-d521992824f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:17.755258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d580452f-8a05-497f-af9f-d521992824f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:17.887167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d580452f-8a05-497f-af9f-d521992824f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:17.896086 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d580452f-8a05-497f-af9f-d521992824f8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.154849 May 28 05:44:17.896669 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3675/7464] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:17 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:18.914112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fa914633-5243-4677-b83d-ba113fd162fa tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:18.914709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fa914633-5243-4677-b83d-ba113fd162fa tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:18.921830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa914633-5243-4677-b83d-ba113fd162fa tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:18.923870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa914633-5243-4677-b83d-ba113fd162fa tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:18.923870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa914633-5243-4677-b83d-ba113fd162fa tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:18.923870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa914633-5243-4677-b83d-ba113fd162fa tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:19.389701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fa914633-5243-4677-b83d-ba113fd162fa tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:19.398774 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fa914633-5243-4677-b83d-ba113fd162fa tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.489167 May 28 05:44:19.399385 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3790/7465] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:18 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:20.416761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b6b07c42-a5c3-4c47-8845-442e522416b7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:20.417337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b6b07c42-a5c3-4c47-8845-442e522416b7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:20.424292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6b07c42-a5c3-4c47-8845-442e522416b7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:20.424769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6b07c42-a5c3-4c47-8845-442e522416b7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:20.426240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6b07c42-a5c3-4c47-8845-442e522416b7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:20.426703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b6b07c42-a5c3-4c47-8845-442e522416b7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:20.566312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b6b07c42-a5c3-4c47-8845-442e522416b7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:20.574506 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b6b07c42-a5c3-4c47-8845-442e522416b7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.161833 May 28 05:44:20.575100 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3676/7466] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:20 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:21.593386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9300f43c-feff-49d3-b3d9-530a257525c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:21.593953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9300f43c-feff-49d3-b3d9-530a257525c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:21.600891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9300f43c-feff-49d3-b3d9-530a257525c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:21.601351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9300f43c-feff-49d3-b3d9-530a257525c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:21.602125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9300f43c-feff-49d3-b3d9-530a257525c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:21.602641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9300f43c-feff-49d3-b3d9-530a257525c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:21.734847 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9300f43c-feff-49d3-b3d9-530a257525c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:21.743367 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9300f43c-feff-49d3-b3d9-530a257525c4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.154134 May 28 05:44:21.743940 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3791/7467] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:21 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:22.761400 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ea2fd2d7-f6ff-4748-8880-4126a36942ca tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:22.761968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ea2fd2d7-f6ff-4748-8880-4126a36942ca tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:22.768181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea2fd2d7-f6ff-4748-8880-4126a36942ca tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:22.768653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea2fd2d7-f6ff-4748-8880-4126a36942ca tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:22.769919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea2fd2d7-f6ff-4748-8880-4126a36942ca tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:22.770369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ea2fd2d7-f6ff-4748-8880-4126a36942ca tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:22.900697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ea2fd2d7-f6ff-4748-8880-4126a36942ca tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:22.908896 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ea2fd2d7-f6ff-4748-8880-4126a36942ca tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.152059 May 28 05:44:22.909481 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3677/7468] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:22 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:23.929067 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7e59d452-c12b-4f1e-99aa-8e47f31e52f5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:23.929693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7e59d452-c12b-4f1e-99aa-8e47f31e52f5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:23.936678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e59d452-c12b-4f1e-99aa-8e47f31e52f5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:23.937149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e59d452-c12b-4f1e-99aa-8e47f31e52f5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:23.937923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e59d452-c12b-4f1e-99aa-8e47f31e52f5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:23.938369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7e59d452-c12b-4f1e-99aa-8e47f31e52f5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:24.069869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7e59d452-c12b-4f1e-99aa-8e47f31e52f5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:24.077804 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7e59d452-c12b-4f1e-99aa-8e47f31e52f5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.153491 May 28 05:44:24.078383 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3792/7469] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:23 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:44:25.095900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b7fa1a11-f033-48df-bf02-2a3a69f2d39f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:25.096542 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b7fa1a11-f033-48df-bf02-2a3a69f2d39f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:25.103592 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7fa1a11-f033-48df-bf02-2a3a69f2d39f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:25.104066 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7fa1a11-f033-48df-bf02-2a3a69f2d39f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:25.104848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7fa1a11-f033-48df-bf02-2a3a69f2d39f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:25.105306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7fa1a11-f033-48df-bf02-2a3a69f2d39f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:25.236726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b7fa1a11-f033-48df-bf02-2a3a69f2d39f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:25.245059 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b7fa1a11-f033-48df-bf02-2a3a69f2d39f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.153050 May 28 05:44:25.245645 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3678/7470] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:25 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:26.262354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-00683340-24ef-4832-bd6f-257fbe076d84 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:26.270968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-00683340-24ef-4832-bd6f-257fbe076d84 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:26.270968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=27 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:44:26.270968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00683340-24ef-4832-bd6f-257fbe076d84 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:26.271424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00683340-24ef-4832-bd6f-257fbe076d84 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:26.272397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00683340-24ef-4832-bd6f-257fbe076d84 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:26.272839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00683340-24ef-4832-bd6f-257fbe076d84 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:26.404047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-00683340-24ef-4832-bd6f-257fbe076d84 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:26.412725 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-00683340-24ef-4832-bd6f-257fbe076d84 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.154561 May 28 05:44:26.413310 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3793/7471] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:26 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:27.429921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6335c9f8-3f6e-4fb1-8013-1f653797e422 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:27.430502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6335c9f8-3f6e-4fb1-8013-1f653797e422 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:27.433251 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=33 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:44:27.438148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6335c9f8-3f6e-4fb1-8013-1f653797e422 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:27.443967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6335c9f8-3f6e-4fb1-8013-1f653797e422 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:27.443967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6335c9f8-3f6e-4fb1-8013-1f653797e422 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:27.443967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6335c9f8-3f6e-4fb1-8013-1f653797e422 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:27.443967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:44:27.576143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6335c9f8-3f6e-4fb1-8013-1f653797e422 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:27.584164 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6335c9f8-3f6e-4fb1-8013-1f653797e422 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.158774 May 28 05:44:27.584743 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3679/7472] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:27 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:28.601662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bd0e70d0-c0df-4234-a1bf-69362d8d03d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:28.602270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bd0e70d0-c0df-4234-a1bf-69362d8d03d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:28.609364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd0e70d0-c0df-4234-a1bf-69362d8d03d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:28.609821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd0e70d0-c0df-4234-a1bf-69362d8d03d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:28.610603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd0e70d0-c0df-4234-a1bf-69362d8d03d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:28.611068 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bd0e70d0-c0df-4234-a1bf-69362d8d03d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:28.613731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=85 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:44:28.747776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bd0e70d0-c0df-4234-a1bf-69362d8d03d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:28.756359 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bd0e70d0-c0df-4234-a1bf-69362d8d03d7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.158613 May 28 05:44:28.756942 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3794/7473] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:28 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:29.628369 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:44:29.628865 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 05:44:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:44:29.774181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cfcbe698-746e-43a9-b409-4ba64ad7429c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:29.774821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cfcbe698-746e-43a9-b409-4ba64ad7429c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:29.781952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfcbe698-746e-43a9-b409-4ba64ad7429c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:29.782426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfcbe698-746e-43a9-b409-4ba64ad7429c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:29.783244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfcbe698-746e-43a9-b409-4ba64ad7429c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:29.783738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cfcbe698-746e-43a9-b409-4ba64ad7429c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:29.949113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cfcbe698-746e-43a9-b409-4ba64ad7429c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:29.958409 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cfcbe698-746e-43a9-b409-4ba64ad7429c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1728 microversion: 2.1 time: 0.188191 May 28 05:44:29.958979 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3680/7474] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:29 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:30.865214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-945bd1ee-58e6-4413-a7e6-dab6f6e21898 req-030b0ae3-fdbd-4222-882a-ed08ab8d4507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbb3c86-82f6-41bf-ae76-0e34ca7894f0", "name": "network-vif-unplugged", "status": "completed", "tag": "5364bc03-00c4-4482-8f2e-fad0620855fa"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:44:30.874620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-945bd1ee-58e6-4413-a7e6-dab6f6e21898 req-030b0ae3-fdbd-4222-882a-ed08ab8d4507 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:30.875149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-945bd1ee-58e6-4413-a7e6-dab6f6e21898 req-030b0ae3-fdbd-4222-882a-ed08ab8d4507 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:30.887077 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-945bd1ee-58e6-4413-a7e6-dab6f6e21898 req-030b0ae3-fdbd-4222-882a-ed08ab8d4507 service nova] Creating event network-vif-unplugged:5364bc03-00c4-4482-8f2e-fad0620855fa for instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 on n-h2-843700-1 May 28 05:44:30.892414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-945bd1ee-58e6-4413-a7e6-dab6f6e21898 req-030b0ae3-fdbd-4222-882a-ed08ab8d4507 service nova] Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:44:30.903866 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-945bd1ee-58e6-4413-a7e6-dab6f6e21898 req-030b0ae3-fdbd-4222-882a-ed08ab8d4507 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043000 May 28 05:44:30.904479 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3795/7475] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:44:30.977096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4b1c27e1-748e-4452-9bea-f5a37c78be8f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:30.978008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4b1c27e1-748e-4452-9bea-f5a37c78be8f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:30.986524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b1c27e1-748e-4452-9bea-f5a37c78be8f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:30.987128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b1c27e1-748e-4452-9bea-f5a37c78be8f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:30.988765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b1c27e1-748e-4452-9bea-f5a37c78be8f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:30.989310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4b1c27e1-748e-4452-9bea-f5a37c78be8f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:31.215478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4b1c27e1-748e-4452-9bea-f5a37c78be8f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:31.225317 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4b1c27e1-748e-4452-9bea-f5a37c78be8f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1727 microversion: 2.1 time: 0.252902 May 28 05:44:31.226040 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3681/7476] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:30 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1727 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:32.245339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c4922b8e-0bef-4519-979e-11f3836397e2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:32.246080 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c4922b8e-0bef-4519-979e-11f3836397e2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:32.253283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4922b8e-0bef-4519-979e-11f3836397e2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:32.253989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4922b8e-0bef-4519-979e-11f3836397e2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:32.254763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4922b8e-0bef-4519-979e-11f3836397e2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:32.255227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4922b8e-0bef-4519-979e-11f3836397e2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:32.395787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c4922b8e-0bef-4519-979e-11f3836397e2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:32.404501 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c4922b8e-0bef-4519-979e-11f3836397e2 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1727 microversion: 2.1 time: 0.164230 May 28 05:44:32.405110 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3796/7477] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:32 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:32.635434 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:44:32.635434 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 05:44:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:44:32.918699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-f31f9f7e-d471-4394-98a5-2f5c94897286 req-7ceeb775-8b7e-4f3a-8d16-eec3b881bb37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bbb3c86-82f6-41bf-ae76-0e34ca7894f0", "tag": "5364bc03-00c4-4482-8f2e-fad0620855fa"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:44:32.927904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f31f9f7e-d471-4394-98a5-2f5c94897286 req-7ceeb775-8b7e-4f3a-8d16-eec3b881bb37 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:32.928370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-f31f9f7e-d471-4394-98a5-2f5c94897286 req-7ceeb775-8b7e-4f3a-8d16-eec3b881bb37 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:32.940087 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-f31f9f7e-d471-4394-98a5-2f5c94897286 req-7ceeb775-8b7e-4f3a-8d16-eec3b881bb37 service nova] Creating event network-changed:5364bc03-00c4-4482-8f2e-fad0620855fa for instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 on n-h2-843700-1 May 28 05:44:32.946530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-f31f9f7e-d471-4394-98a5-2f5c94897286 req-7ceeb775-8b7e-4f3a-8d16-eec3b881bb37 service nova] Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:44:32.959126 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-f31f9f7e-d471-4394-98a5-2f5c94897286 req-7ceeb775-8b7e-4f3a-8d16-eec3b881bb37 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044227 May 28 05:44:32.959734 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3682/7478] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:44:33.421988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-769d139a-a9b9-4df9-8dba-ecec8e0f9642 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:33.422966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-769d139a-a9b9-4df9-8dba-ecec8e0f9642 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:33.430815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-769d139a-a9b9-4df9-8dba-ecec8e0f9642 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:33.431386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-769d139a-a9b9-4df9-8dba-ecec8e0f9642 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:33.432240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-769d139a-a9b9-4df9-8dba-ecec8e0f9642 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:33.432752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-769d139a-a9b9-4df9-8dba-ecec8e0f9642 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:33.726535 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-769d139a-a9b9-4df9-8dba-ecec8e0f9642 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:33.735755 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-769d139a-a9b9-4df9-8dba-ecec8e0f9642 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1725 microversion: 2.1 time: 0.317801 May 28 05:44:33.736319 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3797/7479] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:33 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1725 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:34.755179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e241e2e5-c372-4f50-b618-6c105a31e3bc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:34.755900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e241e2e5-c372-4f50-b618-6c105a31e3bc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:34.763482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e241e2e5-c372-4f50-b618-6c105a31e3bc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:34.763950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e241e2e5-c372-4f50-b618-6c105a31e3bc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:34.764729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e241e2e5-c372-4f50-b618-6c105a31e3bc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:34.765178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e241e2e5-c372-4f50-b618-6c105a31e3bc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:34.897758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e241e2e5-c372-4f50-b618-6c105a31e3bc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:34.905947 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e241e2e5-c372-4f50-b618-6c105a31e3bc tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1725 microversion: 2.1 time: 0.155519 May 28 05:44:34.906524 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3683/7480] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:34 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:35.923586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-deb733cb-30d4-4beb-b329-af1b3b74f410 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:35.924207 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-deb733cb-30d4-4beb-b329-af1b3b74f410 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:35.931253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-deb733cb-30d4-4beb-b329-af1b3b74f410 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:35.931711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-deb733cb-30d4-4beb-b329-af1b3b74f410 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:35.932488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-deb733cb-30d4-4beb-b329-af1b3b74f410 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:35.932932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-deb733cb-30d4-4beb-b329-af1b3b74f410 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:36.069345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-deb733cb-30d4-4beb-b329-af1b3b74f410 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:36.077543 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-deb733cb-30d4-4beb-b329-af1b3b74f410 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1725 microversion: 2.1 time: 0.158025 May 28 05:44:36.078121 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3798/7481] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:35 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:37.095868 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-45125f1f-52c8-4dfa-8f78-b186554c9382 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:37.096611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-45125f1f-52c8-4dfa-8f78-b186554c9382 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:37.104217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45125f1f-52c8-4dfa-8f78-b186554c9382 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:37.104683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45125f1f-52c8-4dfa-8f78-b186554c9382 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:37.105462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45125f1f-52c8-4dfa-8f78-b186554c9382 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:37.105917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45125f1f-52c8-4dfa-8f78-b186554c9382 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:37.239784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-45125f1f-52c8-4dfa-8f78-b186554c9382 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:37.247852 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-45125f1f-52c8-4dfa-8f78-b186554c9382 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1725 microversion: 2.1 time: 0.155945 May 28 05:44:37.248447 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3684/7482] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:37 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:38.265356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9293aa53-919c-4caa-a3ba-a0d762953e6e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:38.265982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9293aa53-919c-4caa-a3ba-a0d762953e6e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:38.273446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9293aa53-919c-4caa-a3ba-a0d762953e6e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:38.273911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9293aa53-919c-4caa-a3ba-a0d762953e6e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:38.274691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9293aa53-919c-4caa-a3ba-a0d762953e6e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:38.275172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9293aa53-919c-4caa-a3ba-a0d762953e6e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:38.404693 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9293aa53-919c-4caa-a3ba-a0d762953e6e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:38.413392 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9293aa53-919c-4caa-a3ba-a0d762953e6e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1725 microversion: 2.1 time: 0.151907 May 28 05:44:38.413990 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3799/7483] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:38 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:39.431465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3594ea64-6142-4bf5-9291-cad5a6c5cf83 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:39.432130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3594ea64-6142-4bf5-9291-cad5a6c5cf83 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:39.439446 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3594ea64-6142-4bf5-9291-cad5a6c5cf83 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:39.439955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3594ea64-6142-4bf5-9291-cad5a6c5cf83 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:39.441362 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3594ea64-6142-4bf5-9291-cad5a6c5cf83 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:39.441813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3594ea64-6142-4bf5-9291-cad5a6c5cf83 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:39.577693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3594ea64-6142-4bf5-9291-cad5a6c5cf83 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:39.585790 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3594ea64-6142-4bf5-9291-cad5a6c5cf83 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1725 microversion: 2.1 time: 0.158268 May 28 05:44:39.586363 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3685/7484] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:39 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:40.603346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-93a9d10f-6867-4477-9bf8-55bc1e2d5ed7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:40.603964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-93a9d10f-6867-4477-9bf8-55bc1e2d5ed7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:40.610968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93a9d10f-6867-4477-9bf8-55bc1e2d5ed7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:40.611454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93a9d10f-6867-4477-9bf8-55bc1e2d5ed7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:40.612224 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93a9d10f-6867-4477-9bf8-55bc1e2d5ed7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:40.612689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93a9d10f-6867-4477-9bf8-55bc1e2d5ed7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:40.743357 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-93a9d10f-6867-4477-9bf8-55bc1e2d5ed7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:40.749655 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-93a9d10f-6867-4477-9bf8-55bc1e2d5ed7 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1725 microversion: 2.1 time: 0.150333 May 28 05:44:40.750239 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3800/7485] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:40 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:41.769135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a68cf69a-8240-4aab-9d29-4278879c894a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:41.769776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a68cf69a-8240-4aab-9d29-4278879c894a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:41.776922 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a68cf69a-8240-4aab-9d29-4278879c894a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:41.777394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a68cf69a-8240-4aab-9d29-4278879c894a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:41.778182 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a68cf69a-8240-4aab-9d29-4278879c894a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:41.778643 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a68cf69a-8240-4aab-9d29-4278879c894a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:41.914012 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a68cf69a-8240-4aab-9d29-4278879c894a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:41.922239 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a68cf69a-8240-4aab-9d29-4278879c894a tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1725 microversion: 2.1 time: 0.157605 May 28 05:44:41.922826 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3686/7486] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:41 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:42.939732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a26fad4a-6a78-404e-920e-7b71d5709afb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:42.940323 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a26fad4a-6a78-404e-920e-7b71d5709afb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:42.947408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a26fad4a-6a78-404e-920e-7b71d5709afb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:42.947901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a26fad4a-6a78-404e-920e-7b71d5709afb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:42.948677 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a26fad4a-6a78-404e-920e-7b71d5709afb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:42.949123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a26fad4a-6a78-404e-920e-7b71d5709afb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:43.077914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a26fad4a-6a78-404e-920e-7b71d5709afb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:43.086405 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a26fad4a-6a78-404e-920e-7b71d5709afb tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1725 microversion: 2.1 time: 0.150658 May 28 05:44:43.087022 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3801/7487] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:42 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:44.103747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b2ad6d9f-8d38-4cc6-9b9a-2a05264d931d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:44.104389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b2ad6d9f-8d38-4cc6-9b9a-2a05264d931d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:44.111339 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b2ad6d9f-8d38-4cc6-9b9a-2a05264d931d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:44.111817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b2ad6d9f-8d38-4cc6-9b9a-2a05264d931d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:44.113142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b2ad6d9f-8d38-4cc6-9b9a-2a05264d931d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:44.113598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b2ad6d9f-8d38-4cc6-9b9a-2a05264d931d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:44.242354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b2ad6d9f-8d38-4cc6-9b9a-2a05264d931d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:44.250475 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b2ad6d9f-8d38-4cc6-9b9a-2a05264d931d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1725 microversion: 2.1 time: 0.150700 May 28 05:44:44.251143 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3687/7488] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:44 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:45.267566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6a1903e3-3b36-4186-a814-d217e9e12947 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:45.268188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6a1903e3-3b36-4186-a814-d217e9e12947 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:45.275809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a1903e3-3b36-4186-a814-d217e9e12947 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:45.276257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a1903e3-3b36-4186-a814-d217e9e12947 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:45.277029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a1903e3-3b36-4186-a814-d217e9e12947 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:45.277476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a1903e3-3b36-4186-a814-d217e9e12947 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:45.408555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6a1903e3-3b36-4186-a814-d217e9e12947 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:45.416541 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6a1903e3-3b36-4186-a814-d217e9e12947 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1725 microversion: 2.1 time: 0.152949 May 28 05:44:45.417120 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3802/7489] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:45 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:46.435177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aaace475-ea60-4bad-a286-6184f6f7a620 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:46.435777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-aaace475-ea60-4bad-a286-6184f6f7a620 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:46.443569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aaace475-ea60-4bad-a286-6184f6f7a620 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:46.444044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aaace475-ea60-4bad-a286-6184f6f7a620 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:46.444943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aaace475-ea60-4bad-a286-6184f6f7a620 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:46.445403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aaace475-ea60-4bad-a286-6184f6f7a620 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:46.575409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-aaace475-ea60-4bad-a286-6184f6f7a620 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:46.584372 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aaace475-ea60-4bad-a286-6184f6f7a620 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1725 microversion: 2.1 time: 0.153441 May 28 05:44:46.584956 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3688/7490] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:46 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:47.602701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-245788b2-37e6-47bc-846e-d173be8137ff tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:47.603361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-245788b2-37e6-47bc-846e-d173be8137ff tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:47.610361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-245788b2-37e6-47bc-846e-d173be8137ff tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:47.610822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-245788b2-37e6-47bc-846e-d173be8137ff tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:47.611621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-245788b2-37e6-47bc-846e-d173be8137ff tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:47.612069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-245788b2-37e6-47bc-846e-d173be8137ff tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:47.743380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-245788b2-37e6-47bc-846e-d173be8137ff tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:47.751406 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-245788b2-37e6-47bc-846e-d173be8137ff tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1725 microversion: 2.1 time: 0.152948 May 28 05:44:47.751985 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3803/7491] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:47 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:44:48.769064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fabfb8c3-3379-425f-b63f-f48a81a07c4d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:48.769699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fabfb8c3-3379-425f-b63f-f48a81a07c4d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:48.776826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fabfb8c3-3379-425f-b63f-f48a81a07c4d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:48.777294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fabfb8c3-3379-425f-b63f-f48a81a07c4d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:48.778075 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fabfb8c3-3379-425f-b63f-f48a81a07c4d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:48.778528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fabfb8c3-3379-425f-b63f-f48a81a07c4d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:48.909810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fabfb8c3-3379-425f-b63f-f48a81a07c4d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:48.918399 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fabfb8c3-3379-425f-b63f-f48a81a07c4d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1725 microversion: 2.1 time: 0.153244 May 28 05:44:48.919375 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3689/7492] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:48 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:49.936333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-884380a9-87d8-4009-bd0a-48942dc89140 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:49.937054 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-884380a9-87d8-4009-bd0a-48942dc89140 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:49.944985 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-884380a9-87d8-4009-bd0a-48942dc89140 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:49.945445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-884380a9-87d8-4009-bd0a-48942dc89140 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:49.946337 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-884380a9-87d8-4009-bd0a-48942dc89140 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:49.946831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-884380a9-87d8-4009-bd0a-48942dc89140 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:50.088026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-884380a9-87d8-4009-bd0a-48942dc89140 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:50.096696 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-884380a9-87d8-4009-bd0a-48942dc89140 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1725 microversion: 2.1 time: 0.164123 May 28 05:44:50.097499 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3804/7493] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:49 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:51.115114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d5095eeb-ee03-416b-9541-03adece6f175 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:51.115761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d5095eeb-ee03-416b-9541-03adece6f175 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:51.122112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5095eeb-ee03-416b-9541-03adece6f175 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:51.122615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5095eeb-ee03-416b-9541-03adece6f175 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:51.123436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5095eeb-ee03-416b-9541-03adece6f175 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:51.123897 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5095eeb-ee03-416b-9541-03adece6f175 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:51.259023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d5095eeb-ee03-416b-9541-03adece6f175 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:51.267323 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d5095eeb-ee03-416b-9541-03adece6f175 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1722 microversion: 2.1 time: 0.156370 May 28 05:44:51.267906 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3690/7494] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:51 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:51.284748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d8ab4856-7a13-45f5-b56a-4af40683499f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:44:51.285295 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d8ab4856-7a13-45f5-b56a-4af40683499f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:51.292157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8ab4856-7a13-45f5-b56a-4af40683499f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:51.292615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8ab4856-7a13-45f5-b56a-4af40683499f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:51.293384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8ab4856-7a13-45f5-b56a-4af40683499f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:51.293831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8ab4856-7a13-45f5-b56a-4af40683499f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:51.330707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8ab4856-7a13-45f5-b56a-4af40683499f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:51.331217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8ab4856-7a13-45f5-b56a-4af40683499f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:51.332026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8ab4856-7a13-45f5-b56a-4af40683499f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:51.332470 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d8ab4856-7a13-45f5-b56a-4af40683499f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:51.352401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-d8ab4856-7a13-45f5-b56a-4af40683499f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Getting quotas for project a59090a2c3eb4898a218d26e86807a86. Resources: {'cores', 'ram'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:44:51.357565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-d8ab4856-7a13-45f5-b56a-4af40683499f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Getting quotas for user 1ffd8cb46a064f39a7b4468292d57b42 and project a59090a2c3eb4898a218d26e86807a86. Resources: {'cores', 'ram'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:44:51.669109 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d8ab4856-7a13-45f5-b56a-4af40683499f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "POST /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0/action" status: 202 len: 0 microversion: 2.1 time: 0.388029 May 28 05:44:51.669837 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3805/7495] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:44:51 2022] POST /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:44:51.678581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1dfbf6bc-b77d-48d8-a7e5-ce7119b295f1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:51.679459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1dfbf6bc-b77d-48d8-a7e5-ce7119b295f1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:51.685968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1dfbf6bc-b77d-48d8-a7e5-ce7119b295f1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:51.686539 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1dfbf6bc-b77d-48d8-a7e5-ce7119b295f1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:51.687334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1dfbf6bc-b77d-48d8-a7e5-ce7119b295f1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:51.687768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1dfbf6bc-b77d-48d8-a7e5-ce7119b295f1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:51.873398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1dfbf6bc-b77d-48d8-a7e5-ce7119b295f1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:51.881388 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1dfbf6bc-b77d-48d8-a7e5-ce7119b295f1 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.207243 May 28 05:44:51.881964 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3691/7496] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:51 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:52.900815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-669f31ea-199f-4dd9-9536-fabfc5f42662 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:52.901521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-669f31ea-199f-4dd9-9536-fabfc5f42662 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:52.908531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-669f31ea-199f-4dd9-9536-fabfc5f42662 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:52.908990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-669f31ea-199f-4dd9-9536-fabfc5f42662 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:52.909767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-669f31ea-199f-4dd9-9536-fabfc5f42662 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:52.910204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-669f31ea-199f-4dd9-9536-fabfc5f42662 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:53.043098 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-669f31ea-199f-4dd9-9536-fabfc5f42662 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:53.051611 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-669f31ea-199f-4dd9-9536-fabfc5f42662 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.156012 May 28 05:44:53.052187 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3806/7497] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:52 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:54.002007 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-6fee4c79-a194-4979-8cfa-32387919b67a req-985ecb7a-15e4-413e-93d3-1c28e925b955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbb3c86-82f6-41bf-ae76-0e34ca7894f0", "name": "network-vif-plugged", "status": "completed", "tag": "5364bc03-00c4-4482-8f2e-fad0620855fa"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:44:54.012152 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-6fee4c79-a194-4979-8cfa-32387919b67a req-985ecb7a-15e4-413e-93d3-1c28e925b955 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:54.012619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-6fee4c79-a194-4979-8cfa-32387919b67a req-985ecb7a-15e4-413e-93d3-1c28e925b955 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:54.025209 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-6fee4c79-a194-4979-8cfa-32387919b67a req-985ecb7a-15e4-413e-93d3-1c28e925b955 service nova] Creating event network-vif-plugged:5364bc03-00c4-4482-8f2e-fad0620855fa for instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 on n-h2-843700-1 May 28 05:44:54.030931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-6fee4c79-a194-4979-8cfa-32387919b67a req-985ecb7a-15e4-413e-93d3-1c28e925b955 service nova] Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:44:54.041900 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-6fee4c79-a194-4979-8cfa-32387919b67a req-985ecb7a-15e4-413e-93d3-1c28e925b955 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044461 May 28 05:44:54.042530 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3692/7498] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:44:54.069747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-02852cb2-ec1e-4427-bd78-d75958a054ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:54.070370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-02852cb2-ec1e-4427-bd78-d75958a054ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:54.077675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02852cb2-ec1e-4427-bd78-d75958a054ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:54.078143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02852cb2-ec1e-4427-bd78-d75958a054ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:54.078940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02852cb2-ec1e-4427-bd78-d75958a054ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:54.079448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02852cb2-ec1e-4427-bd78-d75958a054ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:54.213330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-02852cb2-ec1e-4427-bd78-d75958a054ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:54.221544 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-02852cb2-ec1e-4427-bd78-d75958a054ea tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.156229 May 28 05:44:54.222088 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3807/7499] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:54 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:55.240821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b0d7c4a6-b741-4120-a096-10168cadbdd3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:55.241578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b0d7c4a6-b741-4120-a096-10168cadbdd3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:55.248499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0d7c4a6-b741-4120-a096-10168cadbdd3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:55.248977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0d7c4a6-b741-4120-a096-10168cadbdd3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:55.249770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0d7c4a6-b741-4120-a096-10168cadbdd3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:55.250229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b0d7c4a6-b741-4120-a096-10168cadbdd3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:55.382082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b0d7c4a6-b741-4120-a096-10168cadbdd3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:55.391279 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b0d7c4a6-b741-4120-a096-10168cadbdd3 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.156023 May 28 05:44:55.391885 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3693/7500] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:55 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:56.409722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2479d25b-280e-4f4c-a30b-07968ecf7ac4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:56.410293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2479d25b-280e-4f4c-a30b-07968ecf7ac4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:56.412485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:44:56.417465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2479d25b-280e-4f4c-a30b-07968ecf7ac4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:56.417928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2479d25b-280e-4f4c-a30b-07968ecf7ac4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:56.418747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2479d25b-280e-4f4c-a30b-07968ecf7ac4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:56.419232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2479d25b-280e-4f4c-a30b-07968ecf7ac4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:56.421854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:44:56.559648 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2479d25b-280e-4f4c-a30b-07968ecf7ac4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:56.567635 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2479d25b-280e-4f4c-a30b-07968ecf7ac4 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.162663 May 28 05:44:56.568210 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3808/7501] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:56 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:57.587384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d513e2a9-0ab6-48e9-abb8-df622acf503e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:57.588069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d513e2a9-0ab6-48e9-abb8-df622acf503e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:57.591564 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=30 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:44:57.596507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d513e2a9-0ab6-48e9-abb8-df622acf503e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:57.596977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d513e2a9-0ab6-48e9-abb8-df622acf503e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:57.597901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d513e2a9-0ab6-48e9-abb8-df622acf503e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:57.598434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d513e2a9-0ab6-48e9-abb8-df622acf503e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:57.601207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=86 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:44:57.740839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d513e2a9-0ab6-48e9-abb8-df622acf503e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:57.750016 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d513e2a9-0ab6-48e9-abb8-df622acf503e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.167964 May 28 05:44:57.750896 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3694/7502] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:57 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:57.772895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-bb7c53a6-11db-44e5-a6fd-39e88ac76eaf req-d1ac1256-b49b-458f-bf2b-dd236ee464bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbb3c86-82f6-41bf-ae76-0e34ca7894f0", "name": "network-vif-unplugged", "status": "completed", "tag": "5364bc03-00c4-4482-8f2e-fad0620855fa"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:44:57.783310 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-bb7c53a6-11db-44e5-a6fd-39e88ac76eaf req-d1ac1256-b49b-458f-bf2b-dd236ee464bc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:57.784496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-bb7c53a6-11db-44e5-a6fd-39e88ac76eaf req-d1ac1256-b49b-458f-bf2b-dd236ee464bc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:57.796242 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-bb7c53a6-11db-44e5-a6fd-39e88ac76eaf req-d1ac1256-b49b-458f-bf2b-dd236ee464bc service nova] Creating event network-vif-unplugged:5364bc03-00c4-4482-8f2e-fad0620855fa for instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 on n-h2-843700-1 May 28 05:44:57.802344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [req-bb7c53a6-11db-44e5-a6fd-39e88ac76eaf req-d1ac1256-b49b-458f-bf2b-dd236ee464bc service nova] Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:44:57.813358 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-bb7c53a6-11db-44e5-a6fd-39e88ac76eaf req-d1ac1256-b49b-458f-bf2b-dd236ee464bc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044946 May 28 05:44:57.813973 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3809/7503] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:44:58.768968 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-60ba6c29-86fd-4dcc-892e-aa509511473c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:58.769763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-60ba6c29-86fd-4dcc-892e-aa509511473c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:58.777077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60ba6c29-86fd-4dcc-892e-aa509511473c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:58.780538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60ba6c29-86fd-4dcc-892e-aa509511473c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:58.780538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60ba6c29-86fd-4dcc-892e-aa509511473c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:58.780538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-60ba6c29-86fd-4dcc-892e-aa509511473c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:58.916791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-60ba6c29-86fd-4dcc-892e-aa509511473c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:44:58.925984 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-60ba6c29-86fd-4dcc-892e-aa509511473c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.161492 May 28 05:44:58.926504 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3695/7504] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:58 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:44:59.944954 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-beb6b94b-8f36-402d-bac5-1a5037e49e07 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:44:59.946442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-beb6b94b-8f36-402d-bac5-1a5037e49e07 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:44:59.954553 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-beb6b94b-8f36-402d-bac5-1a5037e49e07 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:59.955413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-beb6b94b-8f36-402d-bac5-1a5037e49e07 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:44:59.957048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-beb6b94b-8f36-402d-bac5-1a5037e49e07 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:44:59.958190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-beb6b94b-8f36-402d-bac5-1a5037e49e07 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:00.180874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-beb6b94b-8f36-402d-bac5-1a5037e49e07 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:00.190431 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-beb6b94b-8f36-402d-bac5-1a5037e49e07 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.250564 May 28 05:45:00.191040 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3810/7505] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:44:59 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:00.403802 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-31d4af8f-445c-4786-8a83-0dd21d0d2517 req-489bc110-98a3-4ad1-bf8f-fa3c06ce1182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bbb3c86-82f6-41bf-ae76-0e34ca7894f0", "tag": "5364bc03-00c4-4482-8f2e-fad0620855fa"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:45:00.414005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-31d4af8f-445c-4786-8a83-0dd21d0d2517 req-489bc110-98a3-4ad1-bf8f-fa3c06ce1182 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:00.414472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-31d4af8f-445c-4786-8a83-0dd21d0d2517 req-489bc110-98a3-4ad1-bf8f-fa3c06ce1182 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:00.428144 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-31d4af8f-445c-4786-8a83-0dd21d0d2517 req-489bc110-98a3-4ad1-bf8f-fa3c06ce1182 service nova] Creating event network-changed:5364bc03-00c4-4482-8f2e-fad0620855fa for instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 on n-h1-843700-1 May 28 05:45:00.434408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-31d4af8f-445c-4786-8a83-0dd21d0d2517 req-489bc110-98a3-4ad1-bf8f-fa3c06ce1182 service nova] Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:45:00.446794 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-31d4af8f-445c-4786-8a83-0dd21d0d2517 req-489bc110-98a3-4ad1-bf8f-fa3c06ce1182 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144359 May 28 05:45:00.448386 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3696/7506] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:45:01.208403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8e0f5dbd-7cdc-483a-8681-3176bc61a304 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:01.208963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8e0f5dbd-7cdc-483a-8681-3176bc61a304 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:01.230179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8e0f5dbd-7cdc-483a-8681-3176bc61a304 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:01.230919 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8e0f5dbd-7cdc-483a-8681-3176bc61a304 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:01.231449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8e0f5dbd-7cdc-483a-8681-3176bc61a304 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:01.231893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8e0f5dbd-7cdc-483a-8681-3176bc61a304 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:01.341518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:45:01.460479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8e0f5dbd-7cdc-483a-8681-3176bc61a304 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:01.469002 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8e0f5dbd-7cdc-483a-8681-3176bc61a304 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.265111 May 28 05:45:01.469592 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3811/7507] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:01 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:02.488383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fe7d4400-da31-4903-8ad0-5c77dbd1612c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:02.489203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fe7d4400-da31-4903-8ad0-5c77dbd1612c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:02.495677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe7d4400-da31-4903-8ad0-5c77dbd1612c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:02.496156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe7d4400-da31-4903-8ad0-5c77dbd1612c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:02.497003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe7d4400-da31-4903-8ad0-5c77dbd1612c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:02.497465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fe7d4400-da31-4903-8ad0-5c77dbd1612c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:02.631889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fe7d4400-da31-4903-8ad0-5c77dbd1612c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:02.640307 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fe7d4400-da31-4903-8ad0-5c77dbd1612c tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.158307 May 28 05:45:02.640886 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3697/7508] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:02 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:03.657840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5f9d0471-6734-4288-8d36-a7fc331891aa tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:03.658460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5f9d0471-6734-4288-8d36-a7fc331891aa tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:03.666040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f9d0471-6734-4288-8d36-a7fc331891aa tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:03.666495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f9d0471-6734-4288-8d36-a7fc331891aa tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:03.667291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f9d0471-6734-4288-8d36-a7fc331891aa tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:03.667735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5f9d0471-6734-4288-8d36-a7fc331891aa tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:03.797183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5f9d0471-6734-4288-8d36-a7fc331891aa tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:03.805953 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5f9d0471-6734-4288-8d36-a7fc331891aa tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.152090 May 28 05:45:03.806534 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3812/7509] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:03 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:04.823702 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-349972bb-29bb-4e15-9563-8fac6592d1ab tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:04.824502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-349972bb-29bb-4e15-9563-8fac6592d1ab tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:04.831770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-349972bb-29bb-4e15-9563-8fac6592d1ab tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:04.832229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-349972bb-29bb-4e15-9563-8fac6592d1ab tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:04.833016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-349972bb-29bb-4e15-9563-8fac6592d1ab tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:04.833463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-349972bb-29bb-4e15-9563-8fac6592d1ab tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:04.970745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-349972bb-29bb-4e15-9563-8fac6592d1ab tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:04.978983 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-349972bb-29bb-4e15-9563-8fac6592d1ab tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.159376 May 28 05:45:04.979592 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3698/7510] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:04 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:05.996908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cb5b6e1b-65c8-4d9b-8aea-f032bf407f28 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:05.997466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cb5b6e1b-65c8-4d9b-8aea-f032bf407f28 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:06.004818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb5b6e1b-65c8-4d9b-8aea-f032bf407f28 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:06.005270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb5b6e1b-65c8-4d9b-8aea-f032bf407f28 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:06.006026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb5b6e1b-65c8-4d9b-8aea-f032bf407f28 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:06.006468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cb5b6e1b-65c8-4d9b-8aea-f032bf407f28 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:06.138497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cb5b6e1b-65c8-4d9b-8aea-f032bf407f28 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:06.147361 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cb5b6e1b-65c8-4d9b-8aea-f032bf407f28 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.154409 May 28 05:45:06.147959 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3813/7511] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:05 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:07.166224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2f15c6d4-e2ad-42ef-b71d-26ca54749a7e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:07.166894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2f15c6d4-e2ad-42ef-b71d-26ca54749a7e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:07.174491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f15c6d4-e2ad-42ef-b71d-26ca54749a7e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:07.174964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f15c6d4-e2ad-42ef-b71d-26ca54749a7e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:07.175824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f15c6d4-e2ad-42ef-b71d-26ca54749a7e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:07.176281 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f15c6d4-e2ad-42ef-b71d-26ca54749a7e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:07.310841 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2f15c6d4-e2ad-42ef-b71d-26ca54749a7e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:07.318975 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2f15c6d4-e2ad-42ef-b71d-26ca54749a7e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.157186 May 28 05:45:07.319574 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3699/7512] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:07 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:08.336406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-445c06dc-4833-45cd-8c24-8c5f42f7524d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:08.337054 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-445c06dc-4833-45cd-8c24-8c5f42f7524d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:08.344124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-445c06dc-4833-45cd-8c24-8c5f42f7524d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:08.344580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-445c06dc-4833-45cd-8c24-8c5f42f7524d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:08.345342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-445c06dc-4833-45cd-8c24-8c5f42f7524d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:08.345782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-445c06dc-4833-45cd-8c24-8c5f42f7524d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:08.476770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-445c06dc-4833-45cd-8c24-8c5f42f7524d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:08.484972 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-445c06dc-4833-45cd-8c24-8c5f42f7524d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.152558 May 28 05:45:08.485756 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3814/7513] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:08 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:09.503016 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-49a5dacf-e1d8-4c46-b3e3-44b344a59f04 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:09.503643 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-49a5dacf-e1d8-4c46-b3e3-44b344a59f04 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:09.510925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49a5dacf-e1d8-4c46-b3e3-44b344a59f04 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:09.511432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49a5dacf-e1d8-4c46-b3e3-44b344a59f04 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:09.512212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49a5dacf-e1d8-4c46-b3e3-44b344a59f04 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:09.512666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49a5dacf-e1d8-4c46-b3e3-44b344a59f04 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:09.645607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-49a5dacf-e1d8-4c46-b3e3-44b344a59f04 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:09.653779 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-49a5dacf-e1d8-4c46-b3e3-44b344a59f04 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.155446 May 28 05:45:09.654352 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3700/7514] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:09 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:10.671703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-89b584bd-afa8-4fb7-8985-52cf6bd702dd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:10.672352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-89b584bd-afa8-4fb7-8985-52cf6bd702dd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:10.679788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89b584bd-afa8-4fb7-8985-52cf6bd702dd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:10.680239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89b584bd-afa8-4fb7-8985-52cf6bd702dd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:10.681000 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89b584bd-afa8-4fb7-8985-52cf6bd702dd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:10.681437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-89b584bd-afa8-4fb7-8985-52cf6bd702dd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:10.816647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-89b584bd-afa8-4fb7-8985-52cf6bd702dd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:10.824726 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-89b584bd-afa8-4fb7-8985-52cf6bd702dd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.157038 May 28 05:45:10.825299 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3815/7515] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:10 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:11.841727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-788bcc91-5148-45e0-b8a4-95f4d18bf852 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:11.842354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-788bcc91-5148-45e0-b8a4-95f4d18bf852 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:11.849847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-788bcc91-5148-45e0-b8a4-95f4d18bf852 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:11.850312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-788bcc91-5148-45e0-b8a4-95f4d18bf852 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:11.851116 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-788bcc91-5148-45e0-b8a4-95f4d18bf852 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:11.851569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-788bcc91-5148-45e0-b8a4-95f4d18bf852 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:11.979381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-788bcc91-5148-45e0-b8a4-95f4d18bf852 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:11.987438 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-788bcc91-5148-45e0-b8a4-95f4d18bf852 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.149600 May 28 05:45:11.991136 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3701/7516] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:11 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:13.005397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-75cf3c82-561e-4f2c-9419-7ff5e3af36c5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:13.005954 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-75cf3c82-561e-4f2c-9419-7ff5e3af36c5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:13.013276 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75cf3c82-561e-4f2c-9419-7ff5e3af36c5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:13.013737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75cf3c82-561e-4f2c-9419-7ff5e3af36c5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:13.014513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75cf3c82-561e-4f2c-9419-7ff5e3af36c5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:13.014960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-75cf3c82-561e-4f2c-9419-7ff5e3af36c5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:13.146454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-75cf3c82-561e-4f2c-9419-7ff5e3af36c5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:13.154453 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-75cf3c82-561e-4f2c-9419-7ff5e3af36c5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.153082 May 28 05:45:13.155048 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3816/7517] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:13 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:14.172268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3bf1f324-567a-4bec-9b06-02d5f751e475 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:14.172926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3bf1f324-567a-4bec-9b06-02d5f751e475 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:14.180708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3bf1f324-567a-4bec-9b06-02d5f751e475 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:14.181176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3bf1f324-567a-4bec-9b06-02d5f751e475 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:14.182219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3bf1f324-567a-4bec-9b06-02d5f751e475 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:14.182668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3bf1f324-567a-4bec-9b06-02d5f751e475 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:14.309607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3bf1f324-567a-4bec-9b06-02d5f751e475 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:14.317813 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3bf1f324-567a-4bec-9b06-02d5f751e475 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.149461 May 28 05:45:14.318431 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3702/7518] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:14 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:15.335260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5ede94f1-dc09-4e4e-afd7-f90b7e6091c6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:15.335894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5ede94f1-dc09-4e4e-afd7-f90b7e6091c6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:15.342894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ede94f1-dc09-4e4e-afd7-f90b7e6091c6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:15.343387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ede94f1-dc09-4e4e-afd7-f90b7e6091c6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:15.344179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ede94f1-dc09-4e4e-afd7-f90b7e6091c6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:15.344606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5ede94f1-dc09-4e4e-afd7-f90b7e6091c6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:15.475528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5ede94f1-dc09-4e4e-afd7-f90b7e6091c6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:15.483539 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5ede94f1-dc09-4e4e-afd7-f90b7e6091c6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.152277 May 28 05:45:15.484126 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3817/7519] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:15 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:16.501824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-98eaccf0-5056-436d-9eef-2d9f7be70af8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:16.502967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-98eaccf0-5056-436d-9eef-2d9f7be70af8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:16.510245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98eaccf0-5056-436d-9eef-2d9f7be70af8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:16.510719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98eaccf0-5056-436d-9eef-2d9f7be70af8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:16.511545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98eaccf0-5056-436d-9eef-2d9f7be70af8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:16.512003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98eaccf0-5056-436d-9eef-2d9f7be70af8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:16.642004 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-98eaccf0-5056-436d-9eef-2d9f7be70af8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:16.650880 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-98eaccf0-5056-436d-9eef-2d9f7be70af8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.152997 May 28 05:45:16.651484 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3703/7520] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:16 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:17.668170 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c04b8e97-7feb-4fad-ae82-74194fc2da6d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:17.668794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c04b8e97-7feb-4fad-ae82-74194fc2da6d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:17.675691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c04b8e97-7feb-4fad-ae82-74194fc2da6d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:17.676152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c04b8e97-7feb-4fad-ae82-74194fc2da6d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:17.676911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c04b8e97-7feb-4fad-ae82-74194fc2da6d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:17.677352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c04b8e97-7feb-4fad-ae82-74194fc2da6d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:17.803803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c04b8e97-7feb-4fad-ae82-74194fc2da6d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:17.811843 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c04b8e97-7feb-4fad-ae82-74194fc2da6d tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1721 microversion: 2.1 time: 0.147553 May 28 05:45:17.812429 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3818/7521] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:17 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:18.829158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-59df5340-d8d2-439c-a94c-0b395ff097ba tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:18.829798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-59df5340-d8d2-439c-a94c-0b395ff097ba tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:18.837519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59df5340-d8d2-439c-a94c-0b395ff097ba tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:18.837994 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59df5340-d8d2-439c-a94c-0b395ff097ba tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:18.838853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59df5340-d8d2-439c-a94c-0b395ff097ba tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:18.839479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-59df5340-d8d2-439c-a94c-0b395ff097ba tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:18.977414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-59df5340-d8d2-439c-a94c-0b395ff097ba tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:18.985692 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-59df5340-d8d2-439c-a94c-0b395ff097ba tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1714 microversion: 2.1 time: 0.160526 May 28 05:45:18.986371 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3704/7522] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:18 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1714 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:19.003299 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a39da07d-d686-43e4-8e8c-88031b20d067 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:19.004051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a39da07d-d686-43e4-8e8c-88031b20d067 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:19.011550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a39da07d-d686-43e4-8e8c-88031b20d067 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:19.013420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a39da07d-d686-43e4-8e8c-88031b20d067 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:19.013420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a39da07d-d686-43e4-8e8c-88031b20d067 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:19.013420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a39da07d-d686-43e4-8e8c-88031b20d067 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:19.146608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a39da07d-d686-43e4-8e8c-88031b20d067 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:19.154663 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a39da07d-d686-43e4-8e8c-88031b20d067 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1714 microversion: 2.1 time: 0.156069 May 28 05:45:19.156739 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3819/7523] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:18 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:19.170903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9ded483f-ccc7-45f7-8c22-fd320a7f8b79 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:19.171594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9ded483f-ccc7-45f7-8c22-fd320a7f8b79 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:19.178477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ded483f-ccc7-45f7-8c22-fd320a7f8b79 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:19.179015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ded483f-ccc7-45f7-8c22-fd320a7f8b79 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:19.183969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ded483f-ccc7-45f7-8c22-fd320a7f8b79 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:19.183969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ded483f-ccc7-45f7-8c22-fd320a7f8b79 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:19.312132 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9ded483f-ccc7-45f7-8c22-fd320a7f8b79 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:19.320796 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9ded483f-ccc7-45f7-8c22-fd320a7f8b79 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1714 microversion: 2.1 time: 0.153761 May 28 05:45:19.321376 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3705/7524] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:19 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:19.336955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0dc5531a-cadc-406c-baba-a8b23cbba08f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:19.337484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0dc5531a-cadc-406c-baba-a8b23cbba08f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:19.343618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0dc5531a-cadc-406c-baba-a8b23cbba08f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:19.344076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0dc5531a-cadc-406c-baba-a8b23cbba08f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:19.344846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0dc5531a-cadc-406c-baba-a8b23cbba08f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:19.345290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0dc5531a-cadc-406c-baba-a8b23cbba08f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:19.369870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0dc5531a-cadc-406c-baba-a8b23cbba08f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:45:19.658930 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0dc5531a-cadc-406c-baba-a8b23cbba08f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 204 len: 0 microversion: 2.1 time: 0.325036 May 28 05:45:19.659619 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3820/7525] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:45:19 2022] DELETE /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:45:19.667963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-269e5fb2-4696-4fdc-80ff-ddf4dc7bffb8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:19.670829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-269e5fb2-4696-4fdc-80ff-ddf4dc7bffb8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:19.675397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-269e5fb2-4696-4fdc-80ff-ddf4dc7bffb8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:19.675873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-269e5fb2-4696-4fdc-80ff-ddf4dc7bffb8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:19.676655 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-269e5fb2-4696-4fdc-80ff-ddf4dc7bffb8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:19.677113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-269e5fb2-4696-4fdc-80ff-ddf4dc7bffb8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:19.803552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-269e5fb2-4696-4fdc-80ff-ddf4dc7bffb8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:19.811650 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-269e5fb2-4696-4fdc-80ff-ddf4dc7bffb8 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1720 microversion: 2.1 time: 0.147732 May 28 05:45:19.815841 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3706/7526] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:19 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:20.830283 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-63be8fee-9008-4c31-bb52-69122a499f4e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:20.831069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-63be8fee-9008-4c31-bb52-69122a499f4e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:20.837953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-63be8fee-9008-4c31-bb52-69122a499f4e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:20.838410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-63be8fee-9008-4c31-bb52-69122a499f4e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:20.839257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-63be8fee-9008-4c31-bb52-69122a499f4e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:20.839704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-63be8fee-9008-4c31-bb52-69122a499f4e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:20.975033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-63be8fee-9008-4c31-bb52-69122a499f4e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:20.983242 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-63be8fee-9008-4c31-bb52-69122a499f4e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1720 microversion: 2.1 time: 0.157294 May 28 05:45:20.983826 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3821/7527] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:20 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:21.125914 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-e3803c1e-4b3f-4886-9437-3ca95f28a17f req-28c2c086-a73d-4f7b-9fd9-f9217ec3044f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbb3c86-82f6-41bf-ae76-0e34ca7894f0", "name": "network-vif-plugged", "status": "completed", "tag": "5364bc03-00c4-4482-8f2e-fad0620855fa"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:45:21.135184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-e3803c1e-4b3f-4886-9437-3ca95f28a17f req-28c2c086-a73d-4f7b-9fd9-f9217ec3044f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:21.135763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-e3803c1e-4b3f-4886-9437-3ca95f28a17f req-28c2c086-a73d-4f7b-9fd9-f9217ec3044f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:21.147386 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-e3803c1e-4b3f-4886-9437-3ca95f28a17f req-28c2c086-a73d-4f7b-9fd9-f9217ec3044f service nova] Creating event network-vif-plugged:5364bc03-00c4-4482-8f2e-fad0620855fa for instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 on n-h1-843700-1 May 28 05:45:21.152269 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-e3803c1e-4b3f-4886-9437-3ca95f28a17f req-28c2c086-a73d-4f7b-9fd9-f9217ec3044f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030549 May 28 05:45:21.152870 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3707/7528] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:45:22.002311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6faffb6d-0178-48ab-b726-dd8711bf57dd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:22.002952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6faffb6d-0178-48ab-b726-dd8711bf57dd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:22.011082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6faffb6d-0178-48ab-b726-dd8711bf57dd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:22.011548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6faffb6d-0178-48ab-b726-dd8711bf57dd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:22.012343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6faffb6d-0178-48ab-b726-dd8711bf57dd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:22.012789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6faffb6d-0178-48ab-b726-dd8711bf57dd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:22.104532 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6faffb6d-0178-48ab-b726-dd8711bf57dd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:22.113208 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6faffb6d-0178-48ab-b726-dd8711bf57dd tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1652 microversion: 2.1 time: 0.115829 May 28 05:45:22.114132 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3822/7529] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:21 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1652 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:22.182613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-28800116-ba94-4f37-a54c-f80e00d3c3a9 req-fdd6a291-9ddd-4c0d-8c21-109c3308071f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbb3c86-82f6-41bf-ae76-0e34ca7894f0", "name": "network-vif-deleted", "tag": "5364bc03-00c4-4482-8f2e-fad0620855fa"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:45:22.192067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-28800116-ba94-4f37-a54c-f80e00d3c3a9 req-fdd6a291-9ddd-4c0d-8c21-109c3308071f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:22.192578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-28800116-ba94-4f37-a54c-f80e00d3c3a9 req-fdd6a291-9ddd-4c0d-8c21-109c3308071f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:22.204906 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-28800116-ba94-4f37-a54c-f80e00d3c3a9 req-fdd6a291-9ddd-4c0d-8c21-109c3308071f service nova] Creating event network-vif-deleted:5364bc03-00c4-4482-8f2e-fad0620855fa for instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 on n-h1-843700-1 May 28 05:45:22.209753 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-28800116-ba94-4f37-a54c-f80e00d3c3a9 req-fdd6a291-9ddd-4c0d-8c21-109c3308071f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032592 May 28 05:45:22.210353 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3708/7530] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:45:23.131645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8f4663c2-e43e-4e09-811d-25a0f90f5b75 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:23.133054 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8f4663c2-e43e-4e09-811d-25a0f90f5b75 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:23.141584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f4663c2-e43e-4e09-811d-25a0f90f5b75 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:23.142045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f4663c2-e43e-4e09-811d-25a0f90f5b75 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:23.143616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f4663c2-e43e-4e09-811d-25a0f90f5b75 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:23.144225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f4663c2-e43e-4e09-811d-25a0f90f5b75 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:23.161490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:45:23.218915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8f4663c2-e43e-4e09-811d-25a0f90f5b75 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:23.228219 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8f4663c2-e43e-4e09-811d-25a0f90f5b75 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1369 microversion: 2.1 time: 0.101331 May 28 05:45:23.231026 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3823/7531] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:23 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:24.247061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-95c916e3-6e7c-4189-a5cb-df8ca1c1839f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:24.247782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-95c916e3-6e7c-4189-a5cb-df8ca1c1839f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:24.254092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-95c916e3-6e7c-4189-a5cb-df8ca1c1839f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:24.254559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-95c916e3-6e7c-4189-a5cb-df8ca1c1839f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:24.255370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-95c916e3-6e7c-4189-a5cb-df8ca1c1839f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:24.255833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-95c916e3-6e7c-4189-a5cb-df8ca1c1839f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:24.318458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-95c916e3-6e7c-4189-a5cb-df8ca1c1839f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:24.326554 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-95c916e3-6e7c-4189-a5cb-df8ca1c1839f tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1369 microversion: 2.1 time: 0.084761 May 28 05:45:24.327147 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3709/7532] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:24 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:25.345100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7d967b48-3035-4eb3-9404-a4c9c7352f22 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:25.345842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7d967b48-3035-4eb3-9404-a4c9c7352f22 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:25.352551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d967b48-3035-4eb3-9404-a4c9c7352f22 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:25.353009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d967b48-3035-4eb3-9404-a4c9c7352f22 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:25.353773 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d967b48-3035-4eb3-9404-a4c9c7352f22 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:25.354213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7d967b48-3035-4eb3-9404-a4c9c7352f22 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:25.415531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7d967b48-3035-4eb3-9404-a4c9c7352f22 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:25.424395 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7d967b48-3035-4eb3-9404-a4c9c7352f22 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1369 microversion: 2.1 time: 0.083211 May 28 05:45:25.424961 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3824/7533] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:25 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:26.442219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3a0c97ac-e177-4f63-8511-ea1c07b08f57 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:26.442783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3a0c97ac-e177-4f63-8511-ea1c07b08f57 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:26.449735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a0c97ac-e177-4f63-8511-ea1c07b08f57 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:26.450338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a0c97ac-e177-4f63-8511-ea1c07b08f57 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:26.451152 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a0c97ac-e177-4f63-8511-ea1c07b08f57 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:26.451598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a0c97ac-e177-4f63-8511-ea1c07b08f57 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:26.513293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3a0c97ac-e177-4f63-8511-ea1c07b08f57 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:26.522066 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3a0c97ac-e177-4f63-8511-ea1c07b08f57 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1369 microversion: 2.1 time: 0.084560 May 28 05:45:26.522632 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3710/7534] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:26 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:27.539887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a3cc9f8a-74ef-43dd-820f-3bcd1957b030 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:27.540562 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a3cc9f8a-74ef-43dd-820f-3bcd1957b030 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:27.543392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:45:27.548455 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3cc9f8a-74ef-43dd-820f-3bcd1957b030 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:27.548936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3cc9f8a-74ef-43dd-820f-3bcd1957b030 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:27.549722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3cc9f8a-74ef-43dd-820f-3bcd1957b030 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:27.550315 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3cc9f8a-74ef-43dd-820f-3bcd1957b030 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:27.621808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a3cc9f8a-74ef-43dd-820f-3bcd1957b030 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:27.630117 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a3cc9f8a-74ef-43dd-820f-3bcd1957b030 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1369 microversion: 2.1 time: 0.094273 May 28 05:45:27.630705 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3825/7535] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:27 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:28.647642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-40e70b6c-d80d-4eb5-b14b-2cd18e5d4b3b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:28.648274 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-40e70b6c-d80d-4eb5-b14b-2cd18e5d4b3b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:28.651147 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=34 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:45:28.655986 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40e70b6c-d80d-4eb5-b14b-2cd18e5d4b3b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:28.656477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40e70b6c-d80d-4eb5-b14b-2cd18e5d4b3b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:28.657263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40e70b6c-d80d-4eb5-b14b-2cd18e5d4b3b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:28.657717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40e70b6c-d80d-4eb5-b14b-2cd18e5d4b3b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:28.660853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=92 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:45:28.719932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-40e70b6c-d80d-4eb5-b14b-2cd18e5d4b3b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:28.728429 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-40e70b6c-d80d-4eb5-b14b-2cd18e5d4b3b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1369 microversion: 2.1 time: 0.084719 May 28 05:45:28.729007 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3711/7536] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:28 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:29.746272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-49603f11-42c7-486b-89bb-114c6f3bbc4b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:29.746886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-49603f11-42c7-486b-89bb-114c6f3bbc4b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:29.754733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49603f11-42c7-486b-89bb-114c6f3bbc4b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:29.755273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49603f11-42c7-486b-89bb-114c6f3bbc4b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:29.756038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49603f11-42c7-486b-89bb-114c6f3bbc4b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:29.756472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-49603f11-42c7-486b-89bb-114c6f3bbc4b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:29.820598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-49603f11-42c7-486b-89bb-114c6f3bbc4b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:29.828929 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-49603f11-42c7-486b-89bb-114c6f3bbc4b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1369 microversion: 2.1 time: 0.086792 May 28 05:45:29.829513 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3826/7537] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:29 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:30.845821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8188af51-7133-4a8b-bdf5-1a76565a9626 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:30.846735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8188af51-7133-4a8b-bdf5-1a76565a9626 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:30.853948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8188af51-7133-4a8b-bdf5-1a76565a9626 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:30.854413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8188af51-7133-4a8b-bdf5-1a76565a9626 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:30.855240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8188af51-7133-4a8b-bdf5-1a76565a9626 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:30.855696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8188af51-7133-4a8b-bdf5-1a76565a9626 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:30.923395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8188af51-7133-4a8b-bdf5-1a76565a9626 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffd8cb46a064f39a7b4468292d57b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59090a2c3eb4898a218d26e86807a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:30.932083 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8188af51-7133-4a8b-bdf5-1a76565a9626 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 200 len: 1369 microversion: 2.1 time: 0.090099 May 28 05:45:30.932694 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3712/7538] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:30 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:31.949974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2f19d5a5-940d-42a0-9b77-e386a10e0697 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:31.950561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2f19d5a5-940d-42a0-9b77-e386a10e0697 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:31.958274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f19d5a5-940d-42a0-9b77-e386a10e0697 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:31.958727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f19d5a5-940d-42a0-9b77-e386a10e0697 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:31.959528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f19d5a5-940d-42a0-9b77-e386a10e0697 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:31.959973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f19d5a5-940d-42a0-9b77-e386a10e0697 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:31.974534 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-2f19d5a5-940d-42a0-9b77-e386a10e0697 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] HTTP exception thrown: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2f19d5a5-940d-42a0-9b77-e386a10e0697 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Request method failure captured: May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 HTTP/1.1 May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbV8EVqnsXJ4v8PKLpKbSN-UMKIcSy3KmkP6QXvwdRFm704ALR4cl_gP9SPkmpV3xU_0jRk0mImnS7YmIQnzqGR8Czb30Vc2tEyE75b992FPEefKyODL7t_FCesR9j2FYAAhL0AvtL4GoBrh1ex3V5-HI_FVJL-8Aq7U-X9LX1Ide1Y May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerActionsTestJSON-1722172964-project May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 1ffd8cb46a064f39a7b4468292d57b42 May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerActionsTestJSON-1722172964-project May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '0bbb3c86-82f6-41bf-ae76-0e34ca7894f0'} May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:45:31.976314 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:31.981838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:31.981838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:45:31.981838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:45:31.981838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:45:31.981838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:45:31.981838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. May 28 05:45:31.981838 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:31.981838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2f19d5a5-940d-42a0-9b77-e386a10e0697 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Returning 404 to user: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:45:31.981838 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2f19d5a5-940d-42a0-9b77-e386a10e0697 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 404 len: 111 microversion: 2.1 time: 0.031890 May 28 05:45:31.981838 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3827/7539] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:31 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 05:45:32.040060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-55e05b1b-35dc-4a5b-b1ba-1b077c2c9547 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:32.041055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-55e05b1b-35dc-4a5b-b1ba-1b077c2c9547 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:32.047976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-55e05b1b-35dc-4a5b-b1ba-1b077c2c9547 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:32.048450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-55e05b1b-35dc-4a5b-b1ba-1b077c2c9547 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:32.049239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-55e05b1b-35dc-4a5b-b1ba-1b077c2c9547 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:32.049700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-55e05b1b-35dc-4a5b-b1ba-1b077c2c9547 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:32.062144 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-55e05b1b-35dc-4a5b-b1ba-1b077c2c9547 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] HTTP exception thrown: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-55e05b1b-35dc-4a5b-b1ba-1b077c2c9547 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Request method failure captured: May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0/os-volume_attachments HTTP/1.1 May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbV8EVqnsXJ4v8PKLpKbSN-UMKIcSy3KmkP6QXvwdRFm704ALR4cl_gP9SPkmpV3xU_0jRk0mImnS7YmIQnzqGR8Czb30Vc2tEyE75b992FPEefKyODL7t_FCesR9j2FYAAhL0AvtL4GoBrh1ex3V5-HI_FVJL-8Aq7U-X9LX1Ide1Y May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerActionsTestJSON-1722172964-project May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 1ffd8cb46a064f39a7b4468292d57b42 May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerActionsTestJSON-1722172964-project May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'server_id': '0bbb3c86-82f6-41bf-ae76-0e34ca7894f0'} May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:45:32.063853 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:45:32.069196 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. May 28 05:45:32.069196 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:32.069196 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:45:32.069196 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:32.069196 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:32.069196 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:45:32.069196 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:45:32.069196 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:45:32.069196 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:45:32.069196 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. May 28 05:45:32.069196 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:32.069196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-55e05b1b-35dc-4a5b-b1ba-1b077c2c9547 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Returning 404 to user: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:45:32.069196 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-55e05b1b-35dc-4a5b-b1ba-1b077c2c9547 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029192 May 28 05:45:32.069196 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3713/7540] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:45:32 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 05:45:38.672734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-154ca585-bf75-43e0-a177-da843597989b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:38.673752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-154ca585-bf75-43e0-a177-da843597989b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:38.681123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-154ca585-bf75-43e0-a177-da843597989b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:38.681586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-154ca585-bf75-43e0-a177-da843597989b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:38.682360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-154ca585-bf75-43e0-a177-da843597989b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:38.682804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-154ca585-bf75-43e0-a177-da843597989b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:38.697052 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-154ca585-bf75-43e0-a177-da843597989b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] HTTP exception thrown: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-154ca585-bf75-43e0-a177-da843597989b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Request method failure captured: May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 HTTP/1.1 May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbV8EVqnsXJ4v8PKLpKbSN-UMKIcSy3KmkP6QXvwdRFm704ALR4cl_gP9SPkmpV3xU_0jRk0mImnS7YmIQnzqGR8Czb30Vc2tEyE75b992FPEefKyODL7t_FCesR9j2FYAAhL0AvtL4GoBrh1ex3V5-HI_FVJL-8Aq7U-X9LX1Ide1Y May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerActionsTestJSON-1722172964-project May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 1ffd8cb46a064f39a7b4468292d57b42 May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerActionsTestJSON-1722172964-project May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '0bbb3c86-82f6-41bf-ae76-0e34ca7894f0'} May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:45:38.698598 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:45:38.703387 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. May 28 05:45:38.703387 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:38.703387 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:45:38.703387 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:38.703387 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.703387 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:45:38.703387 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:45:38.703387 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:45:38.703387 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:45:38.703387 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. May 28 05:45:38.703387 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:38.703387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-154ca585-bf75-43e0-a177-da843597989b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Returning 404 to user: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:45:38.703387 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-154ca585-bf75-43e0-a177-da843597989b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 404 len: 111 microversion: 2.1 time: 0.031292 May 28 05:45:38.703387 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3828/7541] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:45:38 2022] DELETE /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:45:38.708472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8096fec3-b7e9-43b6-be03-3e79f622c592 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:38.709107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8096fec3-b7e9-43b6-be03-3e79f622c592 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:38.716628 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8096fec3-b7e9-43b6-be03-3e79f622c592 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:38.717101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8096fec3-b7e9-43b6-be03-3e79f622c592 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:38.717891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8096fec3-b7e9-43b6-be03-3e79f622c592 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:38.718350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8096fec3-b7e9-43b6-be03-3e79f622c592 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:38.731939 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-8096fec3-b7e9-43b6-be03-3e79f622c592 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] HTTP exception thrown: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8096fec3-b7e9-43b6-be03-3e79f622c592 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Request method failure captured: May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 HTTP/1.1 May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbV8EVqnsXJ4v8PKLpKbSN-UMKIcSy3KmkP6QXvwdRFm704ALR4cl_gP9SPkmpV3xU_0jRk0mImnS7YmIQnzqGR8Czb30Vc2tEyE75b992FPEefKyODL7t_FCesR9j2FYAAhL0AvtL4GoBrh1ex3V5-HI_FVJL-8Aq7U-X9LX1Ide1Y May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerActionsTestJSON-1722172964-project May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 1ffd8cb46a064f39a7b4468292d57b42 May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerActionsTestJSON-1722172964-project May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '0bbb3c86-82f6-41bf-ae76-0e34ca7894f0'} May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:45:38.733501 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:38.739367 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.739367 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:45:38.739367 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:45:38.739367 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:45:38.739367 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:45:38.739367 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. May 28 05:45:38.739367 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:38.739367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8096fec3-b7e9-43b6-be03-3e79f622c592 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Returning 404 to user: Instance 0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:45:38.739367 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8096fec3-b7e9-43b6-be03-3e79f622c592 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0" status: 404 len: 111 microversion: 2.1 time: 0.030404 May 28 05:45:38.739367 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3714/7542] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:38 2022] GET /compute/v2.1/servers/0bbb3c86-82f6-41bf-ae76-0e34ca7894f0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 05:45:38.744030 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d0d03f2f-dc69-4486-a824-55b2c42ecda5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:38.744566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d0d03f2f-dc69-4486-a824-55b2c42ecda5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:38.751082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d0d03f2f-dc69-4486-a824-55b2c42ecda5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:38.752106 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d0d03f2f-dc69-4486-a824-55b2c42ecda5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:38.752897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d0d03f2f-dc69-4486-a824-55b2c42ecda5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:38.753339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d0d03f2f-dc69-4486-a824-55b2c42ecda5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:38.773007 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-d0d03f2f-dc69-4486-a824-55b2c42ecda5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] HTTP exception thrown: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d0d03f2f-dc69-4486-a824-55b2c42ecda5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Request method failure captured: May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 HTTP/1.1 May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbV8EVqnsXJ4v8PKLpKbSN-UMKIcSy3KmkP6QXvwdRFm704ALR4cl_gP9SPkmpV3xU_0jRk0mImnS7YmIQnzqGR8Czb30Vc2tEyE75b992FPEefKyODL7t_FCesR9j2FYAAhL0AvtL4GoBrh1ex3V5-HI_FVJL-8Aq7U-X9LX1Ide1Y May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerActionsTestJSON-1722172964-project May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 1ffd8cb46a064f39a7b4468292d57b42 May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerActionsTestJSON-1722172964-project May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '65a40d51-0250-4b0b-9277-f9dfc97e1720'} May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:45:38.774629 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:45:38.779472 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. May 28 05:45:38.779472 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:38.779472 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:45:38.779472 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:38.779472 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.779472 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:45:38.779472 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:45:38.779472 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:45:38.779472 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:45:38.779472 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. May 28 05:45:38.779472 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:38.779472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d0d03f2f-dc69-4486-a824-55b2c42ecda5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Returning 404 to user: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:45:38.779472 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d0d03f2f-dc69-4486-a824-55b2c42ecda5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "DELETE /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 404 len: 111 microversion: 2.1 time: 0.036138 May 28 05:45:38.779472 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3829/7543] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:45:38 2022] DELETE /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 05:45:38.784853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-35754c8a-a120-48e5-82aa-2860826a1df5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:38.785498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-35754c8a-a120-48e5-82aa-2860826a1df5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 65a40d51-0250-4b0b-9277-f9dfc97e1720] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:38.792082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-35754c8a-a120-48e5-82aa-2860826a1df5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:38.792813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-35754c8a-a120-48e5-82aa-2860826a1df5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:38.793617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-35754c8a-a120-48e5-82aa-2860826a1df5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:38.794077 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-35754c8a-a120-48e5-82aa-2860826a1df5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:38.809214 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-35754c8a-a120-48e5-82aa-2860826a1df5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] HTTP exception thrown: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-35754c8a-a120-48e5-82aa-2860826a1df5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Request method failure captured: May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 HTTP/1.1 May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbV8EVqnsXJ4v8PKLpKbSN-UMKIcSy3KmkP6QXvwdRFm704ALR4cl_gP9SPkmpV3xU_0jRk0mImnS7YmIQnzqGR8Czb30Vc2tEyE75b992FPEefKyODL7t_FCesR9j2FYAAhL0AvtL4GoBrh1ex3V5-HI_FVJL-8Aq7U-X9LX1Ide1Y May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerActionsTestJSON-1722172964-project May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 1ffd8cb46a064f39a7b4468292d57b42 May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerActionsTestJSON-1722172964-project May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '65a40d51-0250-4b0b-9277-f9dfc97e1720'} May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:45:38.810803 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:38.816689 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.816689 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:45:38.816689 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:45:38.816689 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:45:38.816689 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:45:38.816689 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. May 28 05:45:38.816689 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:38.816689 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-35754c8a-a120-48e5-82aa-2860826a1df5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Returning 404 to user: Instance 65a40d51-0250-4b0b-9277-f9dfc97e1720 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:45:38.816689 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-35754c8a-a120-48e5-82aa-2860826a1df5 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720" status: 404 len: 111 microversion: 2.1 time: 0.031422 May 28 05:45:38.816689 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3715/7544] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:38 2022] GET /compute/v2.1/servers/65a40d51-0250-4b0b-9277-f9dfc97e1720 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:45:38.826310 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8767dc35-ee11-4a66-b978-7973c80a94e6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:38.826818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8767dc35-ee11-4a66-b978-7973c80a94e6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:38.833531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8767dc35-ee11-4a66-b978-7973c80a94e6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:38.834000 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8767dc35-ee11-4a66-b978-7973c80a94e6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:38.834795 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8767dc35-ee11-4a66-b978-7973c80a94e6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:38.835266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8767dc35-ee11-4a66-b978-7973c80a94e6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:38.849738 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-8767dc35-ee11-4a66-b978-7973c80a94e6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] HTTP exception thrown: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8767dc35-ee11-4a66-b978-7973c80a94e6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Request method failure captured: May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac HTTP/1.1 May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbV8EVqnsXJ4v8PKLpKbSN-UMKIcSy3KmkP6QXvwdRFm704ALR4cl_gP9SPkmpV3xU_0jRk0mImnS7YmIQnzqGR8Czb30Vc2tEyE75b992FPEefKyODL7t_FCesR9j2FYAAhL0AvtL4GoBrh1ex3V5-HI_FVJL-8Aq7U-X9LX1Ide1Y May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerActionsTestJSON-1722172964-project May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 1ffd8cb46a064f39a7b4468292d57b42 May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerActionsTestJSON-1722172964-project May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '6076a6fa-ff7e-44a6-8924-889f991aeaac'} May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:45:38.851335 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:45:38.855677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. May 28 05:45:38.855677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:38.855677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:45:38.855677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:38.855677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.855677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:45:38.855677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:45:38.855677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:45:38.855677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:45:38.855677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. May 28 05:45:38.855677 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:38.855677 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8767dc35-ee11-4a66-b978-7973c80a94e6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Returning 404 to user: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:45:38.855677 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8767dc35-ee11-4a66-b978-7973c80a94e6 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 404 len: 111 microversion: 2.1 time: 0.030473 May 28 05:45:38.855677 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3830/7545] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:45:38 2022] DELETE /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:45:38.862001 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-600936c5-a268-4459-8d85-4e7a877a643b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:38.862636 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-600936c5-a268-4459-8d85-4e7a877a643b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: 6076a6fa-ff7e-44a6-8924-889f991aeaac] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:38.868946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-600936c5-a268-4459-8d85-4e7a877a643b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:38.874687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-600936c5-a268-4459-8d85-4e7a877a643b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:38.874687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-600936c5-a268-4459-8d85-4e7a877a643b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:38.874687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-600936c5-a268-4459-8d85-4e7a877a643b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:38.885623 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-600936c5-a268-4459-8d85-4e7a877a643b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] HTTP exception thrown: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-600936c5-a268-4459-8d85-4e7a877a643b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Request method failure captured: May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac HTTP/1.1 May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbV8EVqnsXJ4v8PKLpKbSN-UMKIcSy3KmkP6QXvwdRFm704ALR4cl_gP9SPkmpV3xU_0jRk0mImnS7YmIQnzqGR8Czb30Vc2tEyE75b992FPEefKyODL7t_FCesR9j2FYAAhL0AvtL4GoBrh1ex3V5-HI_FVJL-8Aq7U-X9LX1Ide1Y May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerActionsTestJSON-1722172964-project May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 1ffd8cb46a064f39a7b4468292d57b42 May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerActionsTestJSON-1722172964-project May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '6076a6fa-ff7e-44a6-8924-889f991aeaac'} May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:45:38.887212 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:38.892494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.892494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:45:38.892494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:45:38.892494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:45:38.892494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:45:38.892494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. May 28 05:45:38.892494 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:38.892494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-600936c5-a268-4459-8d85-4e7a877a643b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Returning 404 to user: Instance 6076a6fa-ff7e-44a6-8924-889f991aeaac could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:45:38.892494 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-600936c5-a268-4459-8d85-4e7a877a643b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac" status: 404 len: 111 microversion: 2.1 time: 0.031210 May 28 05:45:38.892494 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3716/7546] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:38 2022] GET /compute/v2.1/servers/6076a6fa-ff7e-44a6-8924-889f991aeaac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 05:45:38.899587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-03e3d496-0da2-4500-801c-5693b76bd17b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:38.900032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-03e3d496-0da2-4500-801c-5693b76bd17b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:38.906256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03e3d496-0da2-4500-801c-5693b76bd17b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:38.906704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03e3d496-0da2-4500-801c-5693b76bd17b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:38.908122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03e3d496-0da2-4500-801c-5693b76bd17b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:38.908615 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03e3d496-0da2-4500-801c-5693b76bd17b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:38.922939 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-03e3d496-0da2-4500-801c-5693b76bd17b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] HTTP exception thrown: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-03e3d496-0da2-4500-801c-5693b76bd17b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Request method failure captured: May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c HTTP/1.1 May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbV8EVqnsXJ4v8PKLpKbSN-UMKIcSy3KmkP6QXvwdRFm704ALR4cl_gP9SPkmpV3xU_0jRk0mImnS7YmIQnzqGR8Czb30Vc2tEyE75b992FPEefKyODL7t_FCesR9j2FYAAhL0AvtL4GoBrh1ex3V5-HI_FVJL-8Aq7U-X9LX1Ide1Y May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServerActionsTestJSON-1722172964-project May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 1ffd8cb46a064f39a7b4468292d57b42 May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServerActionsTestJSON-1722172964-project May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c'} May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:45:38.925237 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:45:38.930586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. May 28 05:45:38.930586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:38.930586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:45:38.930586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:38.930586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.930586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:45:38.930586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:45:38.930586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:45:38.930586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:45:38.930586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. May 28 05:45:38.930586 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:45:38.930586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-03e3d496-0da2-4500-801c-5693b76bd17b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Returning 404 to user: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:45:38.930586 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-03e3d496-0da2-4500-801c-5693b76bd17b tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "DELETE /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 404 len: 111 microversion: 2.1 time: 0.032749 May 28 05:45:38.930586 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3831/7547] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:45:38 2022] DELETE /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:45:38.936610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4e4b338b-771f-4bbc-8049-133850ff1a7e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:38.937246 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4e4b338b-771f-4bbc-8049-133850ff1a7e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] [instance: caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:38.943617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e4b338b-771f-4bbc-8049-133850ff1a7e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:38.944087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e4b338b-771f-4bbc-8049-133850ff1a7e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:38.944964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e4b338b-771f-4bbc-8049-133850ff1a7e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:38.945532 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e4b338b-771f-4bbc-8049-133850ff1a7e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:38.959606 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-4e4b338b-771f-4bbc-8049-133850ff1a7e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] HTTP exception thrown: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4e4b338b-771f-4bbc-8049-133850ff1a7e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Request method failure captured: May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c HTTP/1.1 May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbV8EVqnsXJ4v8PKLpKbSN-UMKIcSy3KmkP6QXvwdRFm704ALR4cl_gP9SPkmpV3xU_0jRk0mImnS7YmIQnzqGR8Czb30Vc2tEyE75b992FPEefKyODL7t_FCesR9j2FYAAhL0AvtL4GoBrh1ex3V5-HI_FVJL-8Aq7U-X9LX1Ide1Y May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59090a2c3eb4898a218d26e86807a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: a59090a2c3eb4898a218d26e86807a86 May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1722172964 May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServerActionsTestJSON-1722172964-project May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 1ffd8cb46a064f39a7b4468292d57b42 May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServerActionsTestJSON-1722172964-project May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c'} May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:45:38.962240 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:38.967310 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:45:38.967310 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:45:38.967310 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:45:38.967310 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:45:38.967310 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:45:38.967310 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. May 28 05:45:38.967310 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:45:38.967310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4e4b338b-771f-4bbc-8049-133850ff1a7e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Returning 404 to user: Instance caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:45:38.967310 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4e4b338b-771f-4bbc-8049-133850ff1a7e tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c" status: 404 len: 111 microversion: 2.1 time: 0.030313 May 28 05:45:38.967310 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3717/7548] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:38 2022] GET /compute/v2.1/servers/caf1d2a5-ee5f-4a85-bd4d-0d52db1fe89c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:45:38.973288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2eca6ca2-294f-40a2-bc38-6cab90c35223 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] Calling method '.version_select at 0x7f7701d298b0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:39.058532 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2eca6ca2-294f-40a2-bc38-6cab90c35223 tempest-ServerActionsTestJSON-1722172964 tempest-ServerActionsTestJSON-1722172964-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-121898998" status: 202 len: 0 microversion: 2.1 time: 0.089584 May 28 05:45:39.059333 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3832/7549] 10.222.0.58 () {58 vars in 1217 bytes} [Sat May 28 05:45:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-121898998 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:45:46.846547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-451da014-439f-46c9-bed1-b29e3ddddbd9 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-43493893", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "7c590e63-9795-49ca-95d4-95c6a6ee9739"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:45:46.898258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-451da014-439f-46c9-bed1-b29e3ddddbd9 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] validate_networks() for [('7c590e63-9795-49ca-95d4-95c6a6ee9739', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:45:47.249350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-451da014-439f-46c9-bed1-b29e3ddddbd9 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:45:47.249794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-451da014-439f-46c9-bed1-b29e3ddddbd9 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:45:47.250289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-451da014-439f-46c9-bed1-b29e3ddddbd9 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:45:47.250718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-451da014-439f-46c9-bed1-b29e3ddddbd9 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:45:47.251679 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-451da014-439f-46c9-bed1-b29e3ddddbd9 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:45:47.261091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-451da014-439f-46c9-bed1-b29e3ddddbd9 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:47.261583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-451da014-439f-46c9-bed1-b29e3ddddbd9 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:47.262392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-451da014-439f-46c9-bed1-b29e3ddddbd9 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:47.262856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-451da014-439f-46c9-bed1-b29e3ddddbd9 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:47.280202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-451da014-439f-46c9-bed1-b29e3ddddbd9 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Getting quotas for project 74c5dfbb0ff443c6bb874baa5846e21b. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:45:47.285535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-451da014-439f-46c9-bed1-b29e3ddddbd9 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Getting quotas for user be30fc72573742a88113ec1c9fad8edf and project 74c5dfbb0ff443c6bb874baa5846e21b. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:45:47.298192 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-451da014-439f-46c9-bed1-b29e3ddddbd9 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:45:47.300489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-451da014-439f-46c9-bed1-b29e3ddddbd9 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:45:47.412563 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-451da014-439f-46c9-bed1-b29e3ddddbd9 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679896 May 28 05:45:47.413151 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3718/7550] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:45:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:45:47.423813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-16d8ca08-607b-472f-92d6-1438bf4fa23e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:47.424527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-16d8ca08-607b-472f-92d6-1438bf4fa23e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:47.481843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-16d8ca08-607b-472f-92d6-1438bf4fa23e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:47.488717 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-16d8ca08-607b-472f-92d6-1438bf4fa23e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 200 len: 1215 microversion: 2.1 time: 0.068810 May 28 05:45:47.489288 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3833/7551] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:47 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:45:48.506979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-258e4850-0f9e-4d2e-847d-599072c44d7e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:48.507623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-258e4850-0f9e-4d2e-847d-599072c44d7e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:48.514883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-258e4850-0f9e-4d2e-847d-599072c44d7e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:48.515386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-258e4850-0f9e-4d2e-847d-599072c44d7e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:48.516227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-258e4850-0f9e-4d2e-847d-599072c44d7e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:48.517207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-258e4850-0f9e-4d2e-847d-599072c44d7e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:48.578760 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-258e4850-0f9e-4d2e-847d-599072c44d7e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:48.588290 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-258e4850-0f9e-4d2e-847d-599072c44d7e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 200 len: 1219 microversion: 2.1 time: 0.086433 May 28 05:45:48.598251 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3719/7552] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:48 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:49.605968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-87cc69a3-a29f-4195-8018-69e743d21bff tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:49.607406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-87cc69a3-a29f-4195-8018-69e743d21bff tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:49.614583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=31 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:45:49.616960 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87cc69a3-a29f-4195-8018-69e743d21bff tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:49.617758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87cc69a3-a29f-4195-8018-69e743d21bff tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:49.618823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87cc69a3-a29f-4195-8018-69e743d21bff tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:49.619379 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87cc69a3-a29f-4195-8018-69e743d21bff tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:49.688589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-87cc69a3-a29f-4195-8018-69e743d21bff tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:49.699763 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-87cc69a3-a29f-4195-8018-69e743d21bff tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 200 len: 1275 microversion: 2.1 time: 0.097739 May 28 05:45:49.701249 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3834/7553] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:49 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 1275 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:50.717407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8575d96d-bd94-45b4-817b-828b7b9f7555 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:50.718043 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8575d96d-bd94-45b4-817b-828b7b9f7555 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:50.725395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8575d96d-bd94-45b4-817b-828b7b9f7555 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:50.725870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8575d96d-bd94-45b4-817b-828b7b9f7555 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:50.726663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8575d96d-bd94-45b4-817b-828b7b9f7555 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:50.727160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8575d96d-bd94-45b4-817b-828b7b9f7555 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:50.942083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8575d96d-bd94-45b4-817b-828b7b9f7555 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:50.949843 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8575d96d-bd94-45b4-817b-828b7b9f7555 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 200 len: 1315 microversion: 2.1 time: 0.236386 May 28 05:45:50.950429 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3720/7554] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:50 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:51.165205 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-2555b295-1fc4-46f8-91ec-7ae93b95cb5d req-e613bb3b-f7f9-4c6e-beba-91eaeaf3533f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1a14317-5e9a-4c3b-aa93-70e6c58deab2", "tag": "d5b6ea26-7076-43a6-9fb5-e58633a6a2f0"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:45:51.174980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2555b295-1fc4-46f8-91ec-7ae93b95cb5d req-e613bb3b-f7f9-4c6e-beba-91eaeaf3533f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:51.175730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2555b295-1fc4-46f8-91ec-7ae93b95cb5d req-e613bb3b-f7f9-4c6e-beba-91eaeaf3533f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:51.186879 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-2555b295-1fc4-46f8-91ec-7ae93b95cb5d req-e613bb3b-f7f9-4c6e-beba-91eaeaf3533f service nova] Creating event network-changed:d5b6ea26-7076-43a6-9fb5-e58633a6a2f0 for instance f1a14317-5e9a-4c3b-aa93-70e6c58deab2 on n-h1-843700-1 May 28 05:45:51.192126 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-2555b295-1fc4-46f8-91ec-7ae93b95cb5d req-e613bb3b-f7f9-4c6e-beba-91eaeaf3533f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030877 May 28 05:45:51.192309 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3835/7555] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:45:51.967457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-09baa33c-3eea-4d75-ad6b-10c506bc410d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:51.968097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-09baa33c-3eea-4d75-ad6b-10c506bc410d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:51.974199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09baa33c-3eea-4d75-ad6b-10c506bc410d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:51.974943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09baa33c-3eea-4d75-ad6b-10c506bc410d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:51.975761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09baa33c-3eea-4d75-ad6b-10c506bc410d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:51.976284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-09baa33c-3eea-4d75-ad6b-10c506bc410d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:52.107836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-09baa33c-3eea-4d75-ad6b-10c506bc410d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:52.116159 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-09baa33c-3eea-4d75-ad6b-10c506bc410d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 200 len: 1315 microversion: 2.1 time: 0.153069 May 28 05:45:52.116779 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3721/7556] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:51 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:53.134855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dedac671-91ab-4d7d-876e-ba3a5cfb964b tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:53.135624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dedac671-91ab-4d7d-876e-ba3a5cfb964b tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:53.141950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dedac671-91ab-4d7d-876e-ba3a5cfb964b tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:53.142405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dedac671-91ab-4d7d-876e-ba3a5cfb964b tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:53.143215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dedac671-91ab-4d7d-876e-ba3a5cfb964b tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:53.143711 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dedac671-91ab-4d7d-876e-ba3a5cfb964b tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:53.272110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dedac671-91ab-4d7d-876e-ba3a5cfb964b tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:53.279624 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dedac671-91ab-4d7d-876e-ba3a5cfb964b tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 200 len: 1315 microversion: 2.1 time: 0.150127 May 28 05:45:53.280214 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3836/7557] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:53 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:54.296851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0dcb6fed-e4ad-485e-943c-492cd4e109d0 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:54.298307 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0dcb6fed-e4ad-485e-943c-492cd4e109d0 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:54.305307 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0dcb6fed-e4ad-485e-943c-492cd4e109d0 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:54.305773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0dcb6fed-e4ad-485e-943c-492cd4e109d0 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:54.306546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0dcb6fed-e4ad-485e-943c-492cd4e109d0 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:54.307011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0dcb6fed-e4ad-485e-943c-492cd4e109d0 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:54.434124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0dcb6fed-e4ad-485e-943c-492cd4e109d0 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:54.442290 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0dcb6fed-e4ad-485e-943c-492cd4e109d0 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 200 len: 1315 microversion: 2.1 time: 0.149662 May 28 05:45:54.442874 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3722/7558] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:54 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:55.460164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1b375917-92c0-4435-938f-f2958422428e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:55.460789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1b375917-92c0-4435-938f-f2958422428e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:55.467049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b375917-92c0-4435-938f-f2958422428e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:55.467512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b375917-92c0-4435-938f-f2958422428e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:55.468291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b375917-92c0-4435-938f-f2958422428e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:55.468742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b375917-92c0-4435-938f-f2958422428e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:55.602011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1b375917-92c0-4435-938f-f2958422428e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:55.609535 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1b375917-92c0-4435-938f-f2958422428e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 200 len: 1315 microversion: 2.1 time: 0.153626 May 28 05:45:55.610125 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3837/7559] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:55 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:56.625731 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f46c5144-806e-48b7-927a-7d4715944dfc tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:56.626403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f46c5144-806e-48b7-927a-7d4715944dfc tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:56.634514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f46c5144-806e-48b7-927a-7d4715944dfc tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:56.635015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f46c5144-806e-48b7-927a-7d4715944dfc tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:56.635806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f46c5144-806e-48b7-927a-7d4715944dfc tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:56.636266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f46c5144-806e-48b7-927a-7d4715944dfc tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:56.761763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f46c5144-806e-48b7-927a-7d4715944dfc tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:56.769745 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f46c5144-806e-48b7-927a-7d4715944dfc tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 200 len: 1315 microversion: 2.1 time: 0.147972 May 28 05:45:56.770328 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3723/7560] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:56 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:57.311825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e5782c6f-8ba5-4d59-aae2-efb1c291da96 req-76f84a46-3a9e-4476-a48e-8e124726fb52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a14317-5e9a-4c3b-aa93-70e6c58deab2", "name": "network-vif-plugged", "status": "completed", "tag": "d5b6ea26-7076-43a6-9fb5-e58633a6a2f0"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:45:57.321296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e5782c6f-8ba5-4d59-aae2-efb1c291da96 req-76f84a46-3a9e-4476-a48e-8e124726fb52 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:57.321745 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e5782c6f-8ba5-4d59-aae2-efb1c291da96 req-76f84a46-3a9e-4476-a48e-8e124726fb52 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:57.333179 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e5782c6f-8ba5-4d59-aae2-efb1c291da96 req-76f84a46-3a9e-4476-a48e-8e124726fb52 service nova] Creating event network-vif-plugged:d5b6ea26-7076-43a6-9fb5-e58633a6a2f0 for instance f1a14317-5e9a-4c3b-aa93-70e6c58deab2 on n-h1-843700-1 May 28 05:45:57.338295 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e5782c6f-8ba5-4d59-aae2-efb1c291da96 req-76f84a46-3a9e-4476-a48e-8e124726fb52 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030240 May 28 05:45:57.338919 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3838/7561] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:45:57.786165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b8de6d37-c118-4306-8ded-dada16ab28ed tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:57.786832 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b8de6d37-c118-4306-8ded-dada16ab28ed tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:57.788747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:45:57.789449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:45:57.795055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8de6d37-c118-4306-8ded-dada16ab28ed tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:57.795522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8de6d37-c118-4306-8ded-dada16ab28ed tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:57.796297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8de6d37-c118-4306-8ded-dada16ab28ed tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:57.796743 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b8de6d37-c118-4306-8ded-dada16ab28ed tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:57.924849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b8de6d37-c118-4306-8ded-dada16ab28ed tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:57.932519 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b8de6d37-c118-4306-8ded-dada16ab28ed tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 200 len: 1315 microversion: 2.1 time: 0.150809 May 28 05:45:57.933103 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3724/7562] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:57 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:58.949683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b55f92d3-e52f-4e09-b086-3176acd3ac0a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:58.950381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b55f92d3-e52f-4e09-b086-3176acd3ac0a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:58.952404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:45:58.953900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:45:58.958854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b55f92d3-e52f-4e09-b086-3176acd3ac0a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:58.959350 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b55f92d3-e52f-4e09-b086-3176acd3ac0a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:58.964446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b55f92d3-e52f-4e09-b086-3176acd3ac0a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:58.964446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b55f92d3-e52f-4e09-b086-3176acd3ac0a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:59.088380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b55f92d3-e52f-4e09-b086-3176acd3ac0a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:59.096051 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b55f92d3-e52f-4e09-b086-3176acd3ac0a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 200 len: 1504 microversion: 2.1 time: 0.150610 May 28 05:45:59.096628 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3839/7563] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:58 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:45:59.150150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-10571375-a780-4104-a617-6863d789a230 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-428213097", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "7c590e63-9795-49ca-95d4-95c6a6ee9739"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:45:59.158252 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:45:59.201476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-10571375-a780-4104-a617-6863d789a230 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] validate_networks() for [('7c590e63-9795-49ca-95d4-95c6a6ee9739', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:45:59.553821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-10571375-a780-4104-a617-6863d789a230 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:45:59.554264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-10571375-a780-4104-a617-6863d789a230 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:45:59.554785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-10571375-a780-4104-a617-6863d789a230 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:45:59.555241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-10571375-a780-4104-a617-6863d789a230 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:45:59.555673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-10571375-a780-4104-a617-6863d789a230 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:45:59.564570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10571375-a780-4104-a617-6863d789a230 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:59.565036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10571375-a780-4104-a617-6863d789a230 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:59.565853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10571375-a780-4104-a617-6863d789a230 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:45:59.566306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-10571375-a780-4104-a617-6863d789a230 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:45:59.573009 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=60 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:45:59.583785 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-10571375-a780-4104-a617-6863d789a230 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Getting quotas for project 74c5dfbb0ff443c6bb874baa5846e21b. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:45:59.588834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-10571375-a780-4104-a617-6863d789a230 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Getting quotas for user be30fc72573742a88113ec1c9fad8edf and project 74c5dfbb0ff443c6bb874baa5846e21b. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:45:59.602045 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-10571375-a780-4104-a617-6863d789a230 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:45:59.604194 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-10571375-a780-4104-a617-6863d789a230 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: 4200029e-ebfe-4f5a-9911-96972638f1ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:45:59.720916 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-10571375-a780-4104-a617-6863d789a230 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574520 May 28 05:45:59.721509 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3725/7564] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:45:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:45:59.731621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c2d23e50-b4bc-4f42-a94a-8337392e6117 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:45:59.732364 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c2d23e50-b4bc-4f42-a94a-8337392e6117 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: 4200029e-ebfe-4f5a-9911-96972638f1ab] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:45:59.791442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c2d23e50-b4bc-4f42-a94a-8337392e6117 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:45:59.798232 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c2d23e50-b4bc-4f42-a94a-8337392e6117 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab" status: 200 len: 1216 microversion: 2.1 time: 0.070562 May 28 05:45:59.799241 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3840/7565] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:45:59 2022] GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab => generated 1216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:46:00.817025 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fc5f304f-d268-4132-9fa4-ca4bab1a878a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:00.817649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fc5f304f-d268-4132-9fa4-ca4bab1a878a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: 4200029e-ebfe-4f5a-9911-96972638f1ab] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:00.824522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc5f304f-d268-4132-9fa4-ca4bab1a878a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:00.824995 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc5f304f-d268-4132-9fa4-ca4bab1a878a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:00.825772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc5f304f-d268-4132-9fa4-ca4bab1a878a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:00.826221 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc5f304f-d268-4132-9fa4-ca4bab1a878a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:00.889244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fc5f304f-d268-4132-9fa4-ca4bab1a878a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:00.897008 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fc5f304f-d268-4132-9fa4-ca4bab1a878a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab" status: 200 len: 1220 microversion: 2.1 time: 0.084751 May 28 05:46:00.897583 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3726/7566] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:00 2022] GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:46:01.914161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2715eaab-35d6-4e9b-bc99-62764a4944b3 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:01.914828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2715eaab-35d6-4e9b-bc99-62764a4944b3 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: 4200029e-ebfe-4f5a-9911-96972638f1ab] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:01.923598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2715eaab-35d6-4e9b-bc99-62764a4944b3 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:01.924072 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2715eaab-35d6-4e9b-bc99-62764a4944b3 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:01.924963 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2715eaab-35d6-4e9b-bc99-62764a4944b3 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:01.925403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2715eaab-35d6-4e9b-bc99-62764a4944b3 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:01.999406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2715eaab-35d6-4e9b-bc99-62764a4944b3 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:02.007851 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2715eaab-35d6-4e9b-bc99-62764a4944b3 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab" status: 200 len: 1286 microversion: 2.1 time: 0.097610 May 28 05:46:02.008451 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3841/7567] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:01 2022] GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab => generated 1286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:46:03.025023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-54bff3aa-7ea3-4f1e-a9b9-8e2b2bc54332 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:03.025656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-54bff3aa-7ea3-4f1e-a9b9-8e2b2bc54332 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: 4200029e-ebfe-4f5a-9911-96972638f1ab] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:03.032635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54bff3aa-7ea3-4f1e-a9b9-8e2b2bc54332 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:03.033110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54bff3aa-7ea3-4f1e-a9b9-8e2b2bc54332 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:03.033901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54bff3aa-7ea3-4f1e-a9b9-8e2b2bc54332 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:03.034359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54bff3aa-7ea3-4f1e-a9b9-8e2b2bc54332 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:03.215474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-54bff3aa-7ea3-4f1e-a9b9-8e2b2bc54332 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:03.223354 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-54bff3aa-7ea3-4f1e-a9b9-8e2b2bc54332 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab" status: 200 len: 1316 microversion: 2.1 time: 0.202185 May 28 05:46:03.226011 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3727/7568] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:03 2022] GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab => generated 1316 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:46:03.295595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-f35b30e3-9307-4f9c-b50e-7a5c4be38038 req-f7138c99-c0ee-453f-a35d-7e7ee42f2b55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4200029e-ebfe-4f5a-9911-96972638f1ab", "tag": "fa5efc26-d74f-45f2-901b-5af97e575425"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:46:03.305094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f35b30e3-9307-4f9c-b50e-7a5c4be38038 req-f7138c99-c0ee-453f-a35d-7e7ee42f2b55 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:03.305621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f35b30e3-9307-4f9c-b50e-7a5c4be38038 req-f7138c99-c0ee-453f-a35d-7e7ee42f2b55 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:03.317338 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-f35b30e3-9307-4f9c-b50e-7a5c4be38038 req-f7138c99-c0ee-453f-a35d-7e7ee42f2b55 service nova] Creating event network-changed:fa5efc26-d74f-45f2-901b-5af97e575425 for instance 4200029e-ebfe-4f5a-9911-96972638f1ab on n-h2-843700-1 May 28 05:46:03.322307 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-f35b30e3-9307-4f9c-b50e-7a5c4be38038 req-f7138c99-c0ee-453f-a35d-7e7ee42f2b55 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030646 May 28 05:46:03.322917 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3842/7569] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:46:04.240602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8878e848-c572-474c-9616-8c80b5ecb879 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:04.241174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8878e848-c572-474c-9616-8c80b5ecb879 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: 4200029e-ebfe-4f5a-9911-96972638f1ab] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:04.248131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8878e848-c572-474c-9616-8c80b5ecb879 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:04.248633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8878e848-c572-474c-9616-8c80b5ecb879 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:04.249518 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8878e848-c572-474c-9616-8c80b5ecb879 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:04.249984 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8878e848-c572-474c-9616-8c80b5ecb879 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:04.381367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8878e848-c572-474c-9616-8c80b5ecb879 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:04.389146 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8878e848-c572-474c-9616-8c80b5ecb879 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab" status: 200 len: 1316 microversion: 2.1 time: 0.152565 May 28 05:46:04.389792 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3728/7570] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:04 2022] GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:46:05.408551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-084c01bd-e600-4a6f-8a3a-6aaffd4a8872 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:05.409180 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-084c01bd-e600-4a6f-8a3a-6aaffd4a8872 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: 4200029e-ebfe-4f5a-9911-96972638f1ab] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:05.415504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-084c01bd-e600-4a6f-8a3a-6aaffd4a8872 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:05.415959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-084c01bd-e600-4a6f-8a3a-6aaffd4a8872 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:05.416725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-084c01bd-e600-4a6f-8a3a-6aaffd4a8872 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:05.417171 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-084c01bd-e600-4a6f-8a3a-6aaffd4a8872 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:05.876246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-084c01bd-e600-4a6f-8a3a-6aaffd4a8872 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:05.884031 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-084c01bd-e600-4a6f-8a3a-6aaffd4a8872 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab" status: 200 len: 1316 microversion: 2.1 time: 0.481261 May 28 05:46:05.884618 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3843/7571] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:05 2022] GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab => generated 1316 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:46:06.901711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-96381467-458a-43ea-ae53-e6c9f004c326 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:06.902347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-96381467-458a-43ea-ae53-e6c9f004c326 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: 4200029e-ebfe-4f5a-9911-96972638f1ab] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:06.910046 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-96381467-458a-43ea-ae53-e6c9f004c326 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:06.910522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-96381467-458a-43ea-ae53-e6c9f004c326 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:06.911375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-96381467-458a-43ea-ae53-e6c9f004c326 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:06.911833 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-96381467-458a-43ea-ae53-e6c9f004c326 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:07.041431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-96381467-458a-43ea-ae53-e6c9f004c326 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:07.047304 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-96381467-458a-43ea-ae53-e6c9f004c326 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab" status: 200 len: 1316 microversion: 2.1 time: 0.149613 May 28 05:46:07.047930 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3729/7572] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:06 2022] GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:46:08.064234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-de73d3d8-8777-4b80-8cfc-0b3a0ae2d99d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:08.064855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-de73d3d8-8777-4b80-8cfc-0b3a0ae2d99d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: 4200029e-ebfe-4f5a-9911-96972638f1ab] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:08.071786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de73d3d8-8777-4b80-8cfc-0b3a0ae2d99d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:08.072237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de73d3d8-8777-4b80-8cfc-0b3a0ae2d99d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:08.073001 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de73d3d8-8777-4b80-8cfc-0b3a0ae2d99d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:08.073436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de73d3d8-8777-4b80-8cfc-0b3a0ae2d99d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:08.204206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-de73d3d8-8777-4b80-8cfc-0b3a0ae2d99d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:08.211929 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-de73d3d8-8777-4b80-8cfc-0b3a0ae2d99d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab" status: 200 len: 1316 microversion: 2.1 time: 0.152232 May 28 05:46:08.212521 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3844/7573] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:08 2022] GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:46:08.252423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-4120b4ba-d276-4d4d-b5f3-b0b5579ccc95 req-393a7e82-5cdf-4840-8762-1325a974455f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4200029e-ebfe-4f5a-9911-96972638f1ab", "name": "network-vif-plugged", "status": "completed", "tag": "fa5efc26-d74f-45f2-901b-5af97e575425"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:46:08.261738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4120b4ba-d276-4d4d-b5f3-b0b5579ccc95 req-393a7e82-5cdf-4840-8762-1325a974455f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:08.262205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4120b4ba-d276-4d4d-b5f3-b0b5579ccc95 req-393a7e82-5cdf-4840-8762-1325a974455f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:08.272992 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-4120b4ba-d276-4d4d-b5f3-b0b5579ccc95 req-393a7e82-5cdf-4840-8762-1325a974455f service nova] Creating event network-vif-plugged:fa5efc26-d74f-45f2-901b-5af97e575425 for instance 4200029e-ebfe-4f5a-9911-96972638f1ab on n-h2-843700-1 May 28 05:46:08.278003 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-4120b4ba-d276-4d4d-b5f3-b0b5579ccc95 req-393a7e82-5cdf-4840-8762-1325a974455f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029361 May 28 05:46:08.280445 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3730/7574] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:46:09.229449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aced8da3-e99e-4085-875c-6338161c5c6f tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:09.230005 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aced8da3-e99e-4085-875c-6338161c5c6f tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: 4200029e-ebfe-4f5a-9911-96972638f1ab] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:09.236985 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aced8da3-e99e-4085-875c-6338161c5c6f tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:09.237439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aced8da3-e99e-4085-875c-6338161c5c6f tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:09.238234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aced8da3-e99e-4085-875c-6338161c5c6f tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:09.238675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aced8da3-e99e-4085-875c-6338161c5c6f tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:09.371366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aced8da3-e99e-4085-875c-6338161c5c6f tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:09.379556 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aced8da3-e99e-4085-875c-6338161c5c6f tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab" status: 200 len: 1316 microversion: 2.1 time: 0.154034 May 28 05:46:09.380170 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3845/7575] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:09 2022] GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:46:10.395613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:46:10.396328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:46:10.400483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-87f02a5c-73ce-4361-97a4-b3b0c821aa35 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:10.401207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-87f02a5c-73ce-4361-97a4-b3b0c821aa35 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: 4200029e-ebfe-4f5a-9911-96972638f1ab] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:10.408342 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87f02a5c-73ce-4361-97a4-b3b0c821aa35 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:10.408817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87f02a5c-73ce-4361-97a4-b3b0c821aa35 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:10.409651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87f02a5c-73ce-4361-97a4-b3b0c821aa35 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:10.410117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-87f02a5c-73ce-4361-97a4-b3b0c821aa35 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:10.540223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-87f02a5c-73ce-4361-97a4-b3b0c821aa35 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:10.547894 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-87f02a5c-73ce-4361-97a4-b3b0c821aa35 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab" status: 200 len: 1505 microversion: 2.1 time: 0.154175 May 28 05:46:10.548517 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3731/7576] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:10 2022] GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:46:10.564328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-69207cc8-9a1e-4abb-8778-f2fb47996f7b tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:10.564836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-69207cc8-9a1e-4abb-8778-f2fb47996f7b tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: 4200029e-ebfe-4f5a-9911-96972638f1ab] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:10.566849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:46:10.572506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-69207cc8-9a1e-4abb-8778-f2fb47996f7b tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:10.572957 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-69207cc8-9a1e-4abb-8778-f2fb47996f7b tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:10.573717 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-69207cc8-9a1e-4abb-8778-f2fb47996f7b tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:10.574151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-69207cc8-9a1e-4abb-8778-f2fb47996f7b tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:10.600286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-69207cc8-9a1e-4abb-8778-f2fb47996f7b tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: 4200029e-ebfe-4f5a-9911-96972638f1ab] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:46:10.873511 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-69207cc8-9a1e-4abb-8778-f2fb47996f7b tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab" status: 204 len: 0 microversion: 2.1 time: 0.313184 May 28 05:46:10.874115 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3846/7577] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:46:10 2022] DELETE /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:46:10.882973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d50671d4-6adc-47e2-b5d7-b69f980b4807 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:10.883628 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d50671d4-6adc-47e2-b5d7-b69f980b4807 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: 4200029e-ebfe-4f5a-9911-96972638f1ab] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:10.889832 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d50671d4-6adc-47e2-b5d7-b69f980b4807 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:10.890301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d50671d4-6adc-47e2-b5d7-b69f980b4807 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:10.891138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d50671d4-6adc-47e2-b5d7-b69f980b4807 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:10.891591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d50671d4-6adc-47e2-b5d7-b69f980b4807 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:11.024015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d50671d4-6adc-47e2-b5d7-b69f980b4807 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:11.031631 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d50671d4-6adc-47e2-b5d7-b69f980b4807 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab" status: 200 len: 1511 microversion: 2.1 time: 0.152840 May 28 05:46:11.032216 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3732/7578] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:10 2022] GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:46:12.049374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b97c8e00-14e4-4684-9771-674a1248a594 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:12.050116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b97c8e00-14e4-4684-9771-674a1248a594 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: 4200029e-ebfe-4f5a-9911-96972638f1ab] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:12.057180 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b97c8e00-14e4-4684-9771-674a1248a594 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:12.057641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b97c8e00-14e4-4684-9771-674a1248a594 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:12.058410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b97c8e00-14e4-4684-9771-674a1248a594 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:12.058851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b97c8e00-14e4-4684-9771-674a1248a594 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:12.257735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b97c8e00-14e4-4684-9771-674a1248a594 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:12.265405 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b97c8e00-14e4-4684-9771-674a1248a594 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab" status: 200 len: 1511 microversion: 2.1 time: 0.220393 May 28 05:46:12.266587 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3847/7579] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:12 2022] GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:46:12.707435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-335d6357-7bc3-4a1e-8575-6b2ad71a9a3f req-7c20eb34-9c18-4d1e-8ca4-13d364c488f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4200029e-ebfe-4f5a-9911-96972638f1ab", "name": "network-vif-deleted", "tag": "fa5efc26-d74f-45f2-901b-5af97e575425"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:46:12.718371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-335d6357-7bc3-4a1e-8575-6b2ad71a9a3f req-7c20eb34-9c18-4d1e-8ca4-13d364c488f0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:12.718892 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-335d6357-7bc3-4a1e-8575-6b2ad71a9a3f req-7c20eb34-9c18-4d1e-8ca4-13d364c488f0 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:12.730966 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-335d6357-7bc3-4a1e-8575-6b2ad71a9a3f req-7c20eb34-9c18-4d1e-8ca4-13d364c488f0 service nova] Creating event network-vif-deleted:fa5efc26-d74f-45f2-901b-5af97e575425 for instance 4200029e-ebfe-4f5a-9911-96972638f1ab on n-h2-843700-1 May 28 05:46:12.736890 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-335d6357-7bc3-4a1e-8575-6b2ad71a9a3f req-7c20eb34-9c18-4d1e-8ca4-13d364c488f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033743 May 28 05:46:12.739063 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3733/7580] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:46:13.283858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f66787f1-2db2-45c3-a7ab-812146aff950 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:13.284475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f66787f1-2db2-45c3-a7ab-812146aff950 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: 4200029e-ebfe-4f5a-9911-96972638f1ab] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:13.292436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f66787f1-2db2-45c3-a7ab-812146aff950 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:13.292885 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f66787f1-2db2-45c3-a7ab-812146aff950 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:13.293809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f66787f1-2db2-45c3-a7ab-812146aff950 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:13.294333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f66787f1-2db2-45c3-a7ab-812146aff950 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:13.326300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f66787f1-2db2-45c3-a7ab-812146aff950 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:13.326761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f66787f1-2db2-45c3-a7ab-812146aff950 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:13.327252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-f66787f1-2db2-45c3-a7ab-812146aff950 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lazy-loading 'fault' on Instance uuid 4200029e-ebfe-4f5a-9911-96972638f1ab {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:46:13.369671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f66787f1-2db2-45c3-a7ab-812146aff950 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:13.377117 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f66787f1-2db2-45c3-a7ab-812146aff950 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab" status: 200 len: 1306 microversion: 2.1 time: 0.097857 May 28 05:46:13.377693 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3848/7581] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:13 2022] GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab => generated 1306 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:46:14.395509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9d115a82-1142-453b-9aa5-63a3b7aa8926 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:14.396156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9d115a82-1142-453b-9aa5-63a3b7aa8926 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: 4200029e-ebfe-4f5a-9911-96972638f1ab] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:14.402601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d115a82-1142-453b-9aa5-63a3b7aa8926 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:14.403102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d115a82-1142-453b-9aa5-63a3b7aa8926 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:14.403891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d115a82-1142-453b-9aa5-63a3b7aa8926 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:14.404381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d115a82-1142-453b-9aa5-63a3b7aa8926 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:14.417992 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-9d115a82-1142-453b-9aa5-63a3b7aa8926 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] HTTP exception thrown: Instance 4200029e-ebfe-4f5a-9911-96972638f1ab could not be found. May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9d115a82-1142-453b-9aa5-63a3b7aa8926 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Request method failure captured: May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab HTTP/1.1 May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbcKqBtRTc80JWVCftdFSCLAtSeWKC3JY_TWBd_zygGGPqfWUAS-D5MOZaqacE_7VI_BF9WhuHj3qJE1uCG8cTF5J_CfwH5U2SzZ5paIK7_ldh2YWJ_Rlqsz1nwfMtmGFJFgbgCUV_twBUdKvPyxx16Lah16rmg_Rx2jo2QsOYv_xiE May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 74c5dfbb0ff443c6bb874baa5846e21b May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 74c5dfbb0ff443c6bb874baa5846e21b May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-496514231-project May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: be30fc72573742a88113ec1c9fad8edf May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-496514231-project May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 4200029e-ebfe-4f5a-9911-96972638f1ab could not be found. May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '4200029e-ebfe-4f5a-9911-96972638f1ab'} May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4200029e-ebfe-4f5a-9911-96972638f1ab could not be found. May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4200029e-ebfe-4f5a-9911-96972638f1ab could not be found. May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:46:14.419661 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:14.425993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:14.425993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:46:14.425993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:46:14.425993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:46:14.425993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:46:14.425993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4200029e-ebfe-4f5a-9911-96972638f1ab could not be found. May 28 05:46:14.425993 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:14.425993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9d115a82-1142-453b-9aa5-63a3b7aa8926 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Returning 404 to user: Instance 4200029e-ebfe-4f5a-9911-96972638f1ab could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:46:14.425993 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9d115a82-1142-453b-9aa5-63a3b7aa8926 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab" status: 404 len: 111 microversion: 2.1 time: 0.030901 May 28 05:46:14.425993 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3734/7582] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:14 2022] GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:46:14.430752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f155ae70-4b52-41b7-9469-b0602d1b9f41 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:14.431401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f155ae70-4b52-41b7-9469-b0602d1b9f41 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:14.438402 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f155ae70-4b52-41b7-9469-b0602d1b9f41 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:14.438854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f155ae70-4b52-41b7-9469-b0602d1b9f41 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:14.439671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f155ae70-4b52-41b7-9469-b0602d1b9f41 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:14.440111 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f155ae70-4b52-41b7-9469-b0602d1b9f41 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:14.565887 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f155ae70-4b52-41b7-9469-b0602d1b9f41 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:14.573462 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f155ae70-4b52-41b7-9469-b0602d1b9f41 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 200 len: 1504 microversion: 2.1 time: 0.146627 May 28 05:46:14.574039 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3849/7583] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:14 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:46:14.590814 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c2949c36-831f-492e-b82f-4d1271218f51 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:46:14.591839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c2949c36-831f-492e-b82f-4d1271218f51 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: 1d4b1ca9-2047-43fe-8371-6bf58bd63cd0] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:14.597902 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-c2949c36-831f-492e-b82f-4d1271218f51 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] HTTP exception thrown: Instance 1d4b1ca9-2047-43fe-8371-6bf58bd63cd0 could not be found. May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c2949c36-831f-492e-b82f-4d1271218f51 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Request method failure captured: May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/1d4b1ca9-2047-43fe-8371-6bf58bd63cd0/action HTTP/1.1 May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 32 May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbcKqBtRTc80JWVCftdFSCLAtSeWKC3JY_TWBd_zygGGPqfWUAS-D5MOZaqacE_7VI_BF9WhuHj3qJE1uCG8cTF5J_CfwH5U2SzZ5paIK7_ldh2YWJ_Rlqsz1nwfMtmGFJFgbgCUV_twBUdKvPyxx16Lah16rmg_Rx2jo2QsOYv_xiE May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 74c5dfbb0ff443c6bb874baa5846e21b May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 74c5dfbb0ff443c6bb874baa5846e21b May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-496514231-project May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: be30fc72573742a88113ec1c9fad8edf May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-496514231-project May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: {"resize": {"flavorRef": "452"}} May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 1d4b1ca9-2047-43fe-8371-6bf58bd63cd0 could not be found. May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '1d4b1ca9-2047-43fe-8371-6bf58bd63cd0', 'body': {'resize': {'flavorRef': '452'}}} May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d4b1ca9-2047-43fe-8371-6bf58bd63cd0 could not be found. May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:46:14.599463 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:46:14.605478 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d4b1ca9-2047-43fe-8371-6bf58bd63cd0 could not be found. May 28 05:46:14.605478 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:14.605478 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:46:14.605478 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:14.605478 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:14.605478 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:46:14.605478 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:46:14.605478 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:46:14.605478 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:46:14.605478 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d4b1ca9-2047-43fe-8371-6bf58bd63cd0 could not be found. May 28 05:46:14.605478 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:14.605478 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c2949c36-831f-492e-b82f-4d1271218f51 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Returning 404 to user: Instance 1d4b1ca9-2047-43fe-8371-6bf58bd63cd0 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:46:14.605478 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c2949c36-831f-492e-b82f-4d1271218f51 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "POST /compute/v2.1/servers/1d4b1ca9-2047-43fe-8371-6bf58bd63cd0/action" status: 404 len: 111 microversion: 2.1 time: 0.014016 May 28 05:46:14.605478 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3735/7584] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:46:14 2022] POST /compute/v2.1/servers/1d4b1ca9-2047-43fe-8371-6bf58bd63cd0/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:46:14.608921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6716834b-c753-4061-b289-e45e398e62c5 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:14.609571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6716834b-c753-4061-b289-e45e398e62c5 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:14.615593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6716834b-c753-4061-b289-e45e398e62c5 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:14.616049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6716834b-c753-4061-b289-e45e398e62c5 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:14.616819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6716834b-c753-4061-b289-e45e398e62c5 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:14.617258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6716834b-c753-4061-b289-e45e398e62c5 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:14.749472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6716834b-c753-4061-b289-e45e398e62c5 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:14.756980 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6716834b-c753-4061-b289-e45e398e62c5 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 200 len: 1504 microversion: 2.1 time: 0.151797 May 28 05:46:14.757819 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3850/7585] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:14 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:46:14.774732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-837f19fd-5c68-40a5-b958-53d6503c8905 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:14.775395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-837f19fd-5c68-40a5-b958-53d6503c8905 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:14.783920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-837f19fd-5c68-40a5-b958-53d6503c8905 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:14.784386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-837f19fd-5c68-40a5-b958-53d6503c8905 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:14.785169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-837f19fd-5c68-40a5-b958-53d6503c8905 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:14.785623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-837f19fd-5c68-40a5-b958-53d6503c8905 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:14.916511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-837f19fd-5c68-40a5-b958-53d6503c8905 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:14.924122 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-837f19fd-5c68-40a5-b958-53d6503c8905 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 200 len: 1504 microversion: 2.1 time: 0.153283 May 28 05:46:14.924691 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3736/7586] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:14 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:46:14.941015 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-25625acc-170a-44b0-be33-ba2008dcec71 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "aeb870cd-8090-4e78-aa88-dd0578e762d3"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:46:14.941981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-25625acc-170a-44b0-be33-ba2008dcec71 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:14.948342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25625acc-170a-44b0-be33-ba2008dcec71 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:14.948729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25625acc-170a-44b0-be33-ba2008dcec71 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:14.949483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25625acc-170a-44b0-be33-ba2008dcec71 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:14.949915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-25625acc-170a-44b0-be33-ba2008dcec71 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:14.969620 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:46:14.989400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-25625acc-170a-44b0-be33-ba2008dcec71 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:14.994972 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-25625acc-170a-44b0-be33-ba2008dcec71 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] HTTP exception thrown: Flavor aeb870cd-8090-4e78-aa88-dd0578e762d3 could not be found. May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-25625acc-170a-44b0-be33-ba2008dcec71 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Request method failure captured: May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: request: POST /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2/action HTTP/1.1 May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 65 May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbcKqBtRTc80JWVCftdFSCLAtSeWKC3JY_TWBd_zygGGPqfWUAS-D5MOZaqacE_7VI_BF9WhuHj3qJE1uCG8cTF5J_CfwH5U2SzZ5paIK7_ldh2YWJ_Rlqsz1nwfMtmGFJFgbgCUV_twBUdKvPyxx16Lah16rmg_Rx2jo2QsOYv_xiE May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 74c5dfbb0ff443c6bb874baa5846e21b May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 74c5dfbb0ff443c6bb874baa5846e21b May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-496514231-project May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: be30fc72573742a88113ec1c9fad8edf May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-496514231-project May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: {"resize": {"flavorRef": "aeb870cd-8090-4e78-aa88-dd0578e762d3"}} May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: exception: Flavor aeb870cd-8090-4e78-aa88-dd0578e762d3 could not be found. May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'f1a14317-5e9a-4c3b-aa93-70e6c58deab2', 'body': {'resize': {'flavorRef': 'aeb870cd-8090-4e78-aa88-dd0578e762d3'}}} May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 05:46:14.997018 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor aeb870cd-8090-4e78-aa88-dd0578e762d3 could not be found. May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor aeb870cd-8090-4e78-aa88-dd0578e762d3 could not be found. May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor aeb870cd-8090-4e78-aa88-dd0578e762d3 could not be found. May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-25625acc-170a-44b0-be33-ba2008dcec71 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Returning 400 to user: Flavor aeb870cd-8090-4e78-aa88-dd0578e762d3 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-25625acc-170a-44b0-be33-ba2008dcec71 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "POST /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2/action" status: 400 len: 107 microversion: 2.1 time: 0.061874 May 28 05:46:15.002503 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3851/7587] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:46:14 2022] POST /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2/action => generated 107 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 05:46:15.007950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d6ba9138-2112-4e36-8d4f-65e3701490a6 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:15.013711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d6ba9138-2112-4e36-8d4f-65e3701490a6 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:15.014667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6ba9138-2112-4e36-8d4f-65e3701490a6 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:15.015796 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6ba9138-2112-4e36-8d4f-65e3701490a6 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:15.017186 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6ba9138-2112-4e36-8d4f-65e3701490a6 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:15.017670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d6ba9138-2112-4e36-8d4f-65e3701490a6 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:15.150295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d6ba9138-2112-4e36-8d4f-65e3701490a6 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:15.158150 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d6ba9138-2112-4e36-8d4f-65e3701490a6 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 200 len: 1504 microversion: 2.1 time: 0.154322 May 28 05:46:15.160781 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3737/7588] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:15 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:46:15.175806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e191bec8-5d5b-42bf-a7b9-92b98b2b256d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:15.176424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e191bec8-5d5b-42bf-a7b9-92b98b2b256d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:15.182931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e191bec8-5d5b-42bf-a7b9-92b98b2b256d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:15.188921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e191bec8-5d5b-42bf-a7b9-92b98b2b256d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:15.188921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e191bec8-5d5b-42bf-a7b9-92b98b2b256d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:15.188921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e191bec8-5d5b-42bf-a7b9-92b98b2b256d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:15.317185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e191bec8-5d5b-42bf-a7b9-92b98b2b256d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:15.324668 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e191bec8-5d5b-42bf-a7b9-92b98b2b256d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 200 len: 1504 microversion: 2.1 time: 0.153249 May 28 05:46:15.325245 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3852/7589] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:15 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:46:15.340921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c59c5bbc-3f6d-4472-b921-0c0ec7e55b31 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c59c5bbc-3f6d-4472-b921-0c0ec7e55b31 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Request method failure captured: May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: request: POST /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2/action HTTP/1.1 May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 29 May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbcKqBtRTc80JWVCftdFSCLAtSeWKC3JY_TWBd_zygGGPqfWUAS-D5MOZaqacE_7VI_BF9WhuHj3qJE1uCG8cTF5J_CfwH5U2SzZ5paIK7_ldh2YWJ_Rlqsz1nwfMtmGFJFgbgCUV_twBUdKvPyxx16Lah16rmg_Rx2jo2QsOYv_xiE May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 74c5dfbb0ff443c6bb874baa5846e21b May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 74c5dfbb0ff443c6bb874baa5846e21b May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-496514231-project May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: be30fc72573742a88113ec1c9fad8edf May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-496514231-project May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: {"resize": {"flavorRef": ""}} May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'f1a14317-5e9a-4c3b-aa93-70e6c58deab2', 'body': {'resize': {'flavorRef': ''}}} May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise error May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi On instance['resize']: May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi '' May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:46:15.350064 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:15.356683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:15.356683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:46:15.356683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:46:15.356683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 05:46:15.356683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 05:46:15.356683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short May 28 05:46:15.356683 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:15.356683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c59c5bbc-3f6d-4472-b921-0c0ec7e55b31 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:46:15.356683 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c59c5bbc-3f6d-4472-b921-0c0ec7e55b31 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "POST /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2/action" status: 400 len: 113 microversion: 2.1 time: 0.014633 May 28 05:46:15.356683 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3738/7590] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:46:15 2022] POST /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2/action => generated 113 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 05:46:15.359580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-319b3d06-a020-4d4a-8d07-244e1447c15a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:15.360721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-319b3d06-a020-4d4a-8d07-244e1447c15a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:15.366678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-319b3d06-a020-4d4a-8d07-244e1447c15a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:15.367159 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-319b3d06-a020-4d4a-8d07-244e1447c15a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:15.367918 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-319b3d06-a020-4d4a-8d07-244e1447c15a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:15.368352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-319b3d06-a020-4d4a-8d07-244e1447c15a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:15.493461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-319b3d06-a020-4d4a-8d07-244e1447c15a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:15.501777 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-319b3d06-a020-4d4a-8d07-244e1447c15a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 200 len: 1504 microversion: 2.1 time: 0.145308 May 28 05:46:15.502356 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3853/7591] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:15 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 1504 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:46:15.523329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a4a1eb61-9efa-4d41-9299-df1055acd4ee tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:15.523853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a4a1eb61-9efa-4d41-9299-df1055acd4ee tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: 4200029e-ebfe-4f5a-9911-96972638f1ab] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:15.530913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4a1eb61-9efa-4d41-9299-df1055acd4ee tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:15.531416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4a1eb61-9efa-4d41-9299-df1055acd4ee tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:15.532208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4a1eb61-9efa-4d41-9299-df1055acd4ee tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:15.532670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4a1eb61-9efa-4d41-9299-df1055acd4ee tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:15.545825 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-a4a1eb61-9efa-4d41-9299-df1055acd4ee tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] HTTP exception thrown: Instance 4200029e-ebfe-4f5a-9911-96972638f1ab could not be found. May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a4a1eb61-9efa-4d41-9299-df1055acd4ee tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Request method failure captured: May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab HTTP/1.1 May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbcKqBtRTc80JWVCftdFSCLAtSeWKC3JY_TWBd_zygGGPqfWUAS-D5MOZaqacE_7VI_BF9WhuHj3qJE1uCG8cTF5J_CfwH5U2SzZ5paIK7_ldh2YWJ_Rlqsz1nwfMtmGFJFgbgCUV_twBUdKvPyxx16Lah16rmg_Rx2jo2QsOYv_xiE May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 74c5dfbb0ff443c6bb874baa5846e21b May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 74c5dfbb0ff443c6bb874baa5846e21b May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-ServersNegativeTestJSON-496514231-project May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: be30fc72573742a88113ec1c9fad8edf May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-ServersNegativeTestJSON-496514231-project May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 4200029e-ebfe-4f5a-9911-96972638f1ab could not be found. May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '4200029e-ebfe-4f5a-9911-96972638f1ab'} May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4200029e-ebfe-4f5a-9911-96972638f1ab could not be found. May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:46:15.547408 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:46:15.553465 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4200029e-ebfe-4f5a-9911-96972638f1ab could not be found. May 28 05:46:15.553465 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:15.553465 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:46:15.553465 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:15.553465 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:15.553465 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:46:15.553465 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:46:15.553465 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:46:15.553465 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:46:15.553465 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4200029e-ebfe-4f5a-9911-96972638f1ab could not be found. May 28 05:46:15.553465 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:46:15.553465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a4a1eb61-9efa-4d41-9299-df1055acd4ee tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Returning 404 to user: Instance 4200029e-ebfe-4f5a-9911-96972638f1ab could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:46:15.553465 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a4a1eb61-9efa-4d41-9299-df1055acd4ee tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab" status: 404 len: 111 microversion: 2.1 time: 0.030869 May 28 05:46:15.553465 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3739/7592] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:46:15 2022] DELETE /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:46:15.557657 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ba19a0e2-8756-4dfb-a73a-a7fc02920bab tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:15.558282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ba19a0e2-8756-4dfb-a73a-a7fc02920bab tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: 4200029e-ebfe-4f5a-9911-96972638f1ab] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:15.565027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba19a0e2-8756-4dfb-a73a-a7fc02920bab tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:15.565488 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba19a0e2-8756-4dfb-a73a-a7fc02920bab tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:15.566258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba19a0e2-8756-4dfb-a73a-a7fc02920bab tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:15.566699 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba19a0e2-8756-4dfb-a73a-a7fc02920bab tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:15.580261 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-ba19a0e2-8756-4dfb-a73a-a7fc02920bab tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] HTTP exception thrown: Instance 4200029e-ebfe-4f5a-9911-96972638f1ab could not be found. May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ba19a0e2-8756-4dfb-a73a-a7fc02920bab tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Request method failure captured: May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab HTTP/1.1 May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbcKqBtRTc80JWVCftdFSCLAtSeWKC3JY_TWBd_zygGGPqfWUAS-D5MOZaqacE_7VI_BF9WhuHj3qJE1uCG8cTF5J_CfwH5U2SzZ5paIK7_ldh2YWJ_Rlqsz1nwfMtmGFJFgbgCUV_twBUdKvPyxx16Lah16rmg_Rx2jo2QsOYv_xiE May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 74c5dfbb0ff443c6bb874baa5846e21b May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 74c5dfbb0ff443c6bb874baa5846e21b May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-496514231-project May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: be30fc72573742a88113ec1c9fad8edf May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-496514231-project May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 4200029e-ebfe-4f5a-9911-96972638f1ab could not be found. May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '4200029e-ebfe-4f5a-9911-96972638f1ab'} May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4200029e-ebfe-4f5a-9911-96972638f1ab could not be found. May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4200029e-ebfe-4f5a-9911-96972638f1ab could not be found. May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:46:15.581774 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:46:15.587367 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:15.587367 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:46:15.587367 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:46:15.587367 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:46:15.587367 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:46:15.587367 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4200029e-ebfe-4f5a-9911-96972638f1ab could not be found. May 28 05:46:15.587367 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:46:15.587367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ba19a0e2-8756-4dfb-a73a-a7fc02920bab tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Returning 404 to user: Instance 4200029e-ebfe-4f5a-9911-96972638f1ab could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:46:15.587367 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ba19a0e2-8756-4dfb-a73a-a7fc02920bab tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab" status: 404 len: 111 microversion: 2.1 time: 0.029344 May 28 05:46:15.587367 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3854/7593] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:15 2022] GET /compute/v2.1/servers/4200029e-ebfe-4f5a-9911-96972638f1ab => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:46:15.591411 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-910cefcc-4adb-4849-8c25-ab8563cd2e5d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:15.591930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-910cefcc-4adb-4849-8c25-ab8563cd2e5d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:15.598107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-910cefcc-4adb-4849-8c25-ab8563cd2e5d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:15.598584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-910cefcc-4adb-4849-8c25-ab8563cd2e5d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:15.599428 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-910cefcc-4adb-4849-8c25-ab8563cd2e5d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:15.599889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-910cefcc-4adb-4849-8c25-ab8563cd2e5d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:15.625067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-910cefcc-4adb-4849-8c25-ab8563cd2e5d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:46:15.892317 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-910cefcc-4adb-4849-8c25-ab8563cd2e5d tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 204 len: 0 microversion: 2.1 time: 0.304306 May 28 05:46:15.892947 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3740/7594] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:46:15 2022] DELETE /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:46:15.901119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-abdaa23b-2c04-4934-b115-0a870ce2e8f4 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:15.901848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-abdaa23b-2c04-4934-b115-0a870ce2e8f4 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:15.908634 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abdaa23b-2c04-4934-b115-0a870ce2e8f4 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:15.909095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abdaa23b-2c04-4934-b115-0a870ce2e8f4 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:15.909864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abdaa23b-2c04-4934-b115-0a870ce2e8f4 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:15.910313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abdaa23b-2c04-4934-b115-0a870ce2e8f4 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:16.044098 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-abdaa23b-2c04-4934-b115-0a870ce2e8f4 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:16.051619 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-abdaa23b-2c04-4934-b115-0a870ce2e8f4 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 200 len: 1510 microversion: 2.1 time: 0.154590 May 28 05:46:16.052201 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3855/7595] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:15 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:46:17.069979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ec0cefa0-8ef2-4425-a91b-532ae8381f7e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:17.070710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ec0cefa0-8ef2-4425-a91b-532ae8381f7e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:17.077709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec0cefa0-8ef2-4425-a91b-532ae8381f7e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:17.078183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec0cefa0-8ef2-4425-a91b-532ae8381f7e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:17.079071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec0cefa0-8ef2-4425-a91b-532ae8381f7e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:17.079484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec0cefa0-8ef2-4425-a91b-532ae8381f7e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:17.222925 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ec0cefa0-8ef2-4425-a91b-532ae8381f7e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:17.230564 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ec0cefa0-8ef2-4425-a91b-532ae8381f7e tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 200 len: 1510 microversion: 2.1 time: 0.164832 May 28 05:46:17.231163 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3741/7596] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:17 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:46:17.732728 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-37aff5eb-df44-4bc8-8f63-cebcff831546 req-70398835-d71a-44dd-9194-7656e9c5e40f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a14317-5e9a-4c3b-aa93-70e6c58deab2", "name": "network-vif-deleted", "tag": "d5b6ea26-7076-43a6-9fb5-e58633a6a2f0"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:46:17.741950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-37aff5eb-df44-4bc8-8f63-cebcff831546 req-70398835-d71a-44dd-9194-7656e9c5e40f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:17.742892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-37aff5eb-df44-4bc8-8f63-cebcff831546 req-70398835-d71a-44dd-9194-7656e9c5e40f service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:17.753603 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-37aff5eb-df44-4bc8-8f63-cebcff831546 req-70398835-d71a-44dd-9194-7656e9c5e40f service nova] Creating event network-vif-deleted:d5b6ea26-7076-43a6-9fb5-e58633a6a2f0 for instance f1a14317-5e9a-4c3b-aa93-70e6c58deab2 on n-h1-843700-1 May 28 05:46:17.758835 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-37aff5eb-df44-4bc8-8f63-cebcff831546 req-70398835-d71a-44dd-9194-7656e9c5e40f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032878 May 28 05:46:17.759452 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3856/7597] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:46:18.248604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-01e66694-24f8-4ab5-be27-09b31927757a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:18.249194 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-01e66694-24f8-4ab5-be27-09b31927757a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:18.256857 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-01e66694-24f8-4ab5-be27-09b31927757a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:18.257327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-01e66694-24f8-4ab5-be27-09b31927757a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:18.258380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-01e66694-24f8-4ab5-be27-09b31927757a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:18.258840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-01e66694-24f8-4ab5-be27-09b31927757a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:18.289987 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-01e66694-24f8-4ab5-be27-09b31927757a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:18.290929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-01e66694-24f8-4ab5-be27-09b31927757a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:18.291435 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-01e66694-24f8-4ab5-be27-09b31927757a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lazy-loading 'fault' on Instance uuid f1a14317-5e9a-4c3b-aa93-70e6c58deab2 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:46:18.333419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-01e66694-24f8-4ab5-be27-09b31927757a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be30fc72573742a88113ec1c9fad8edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5dfbb0ff443c6bb874baa5846e21b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:46:18.340960 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-01e66694-24f8-4ab5-be27-09b31927757a tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 200 len: 1305 microversion: 2.1 time: 0.096369 May 28 05:46:18.341696 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3742/7598] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:18 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:46:19.358961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-87e1b8bb-b95a-4731-9547-2c1795628b78 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:46:19.359688 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-87e1b8bb-b95a-4731-9547-2c1795628b78 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] [instance: f1a14317-5e9a-4c3b-aa93-70e6c58deab2] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:46:19.366223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87e1b8bb-b95a-4731-9547-2c1795628b78 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:19.366706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87e1b8bb-b95a-4731-9547-2c1795628b78 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:19.367507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87e1b8bb-b95a-4731-9547-2c1795628b78 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:46:19.367953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87e1b8bb-b95a-4731-9547-2c1795628b78 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:46:19.381649 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-87e1b8bb-b95a-4731-9547-2c1795628b78 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] HTTP exception thrown: Instance f1a14317-5e9a-4c3b-aa93-70e6c58deab2 could not be found. May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-87e1b8bb-b95a-4731-9547-2c1795628b78 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Request method failure captured: May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 HTTP/1.1 May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbcKqBtRTc80JWVCftdFSCLAtSeWKC3JY_TWBd_zygGGPqfWUAS-D5MOZaqacE_7VI_BF9WhuHj3qJE1uCG8cTF5J_CfwH5U2SzZ5paIK7_ldh2YWJ_Rlqsz1nwfMtmGFJFgbgCUV_twBUdKvPyxx16Lah16rmg_Rx2jo2QsOYv_xiE May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 74c5dfbb0ff443c6bb874baa5846e21b May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/74c5dfbb0ff443c6bb874baa5846e21b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 74c5dfbb0ff443c6bb874baa5846e21b May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-496514231 May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-ServersNegativeTestJSON-496514231-project May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: be30fc72573742a88113ec1c9fad8edf May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-ServersNegativeTestJSON-496514231-project May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance f1a14317-5e9a-4c3b-aa93-70e6c58deab2 could not be found. May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': 'f1a14317-5e9a-4c3b-aa93-70e6c58deab2'} May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1a14317-5e9a-4c3b-aa93-70e6c58deab2 could not be found. May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1a14317-5e9a-4c3b-aa93-70e6c58deab2 could not be found. May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:46:19.383479 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:46:19.389368 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:46:19.389368 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:46:19.389368 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:46:19.389368 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:46:19.389368 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:46:19.389368 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1a14317-5e9a-4c3b-aa93-70e6c58deab2 could not be found. May 28 05:46:19.389368 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:46:19.389368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-87e1b8bb-b95a-4731-9547-2c1795628b78 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] Returning 404 to user: Instance f1a14317-5e9a-4c3b-aa93-70e6c58deab2 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:46:19.389368 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-87e1b8bb-b95a-4731-9547-2c1795628b78 tempest-ServersNegativeTestJSON-496514231 tempest-ServersNegativeTestJSON-496514231-project] 10.222.0.58 "GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2" status: 404 len: 111 microversion: 2.1 time: 0.031044 May 28 05:46:19.389368 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3857/7599] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:46:19 2022] GET /compute/v2.1/servers/f1a14317-5e9a-4c3b-aa93-70e6c58deab2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 05:47:00.042977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:47:00.043708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:47:00.217508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f7d002d4-b341-4cf0-afc1-ef8c0ec06e81 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Action: 'create', calling method: .version_select at 0x7f77000d54c0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-949980045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcAeaTWQJ1/cjD93FvHjh7dcIFdTkPNN93DQJeoFWN/R6XxYE8Axmvu9FtFLtCcAtj4JRN4kwH5BgbVnB6z87EQYW4gaf9ZYV+85GzIcZ9qYWMfwFvj3UX5bLgBXcDvqA=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:47:00.232704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-f7d002d4-b341-4cf0-afc1-ef8c0ec06e81 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Getting quotas for project 1776666c25b74b01a3dde1feedb6b29d. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:47:00.239008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-f7d002d4-b341-4cf0-afc1-ef8c0ec06e81 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Getting quotas for user 14ce217e6d6a4c39aaf41c6637be7945 and project 1776666c25b74b01a3dde1feedb6b29d. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:47:00.359488 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f7d002d4-b341-4cf0-afc1-ef8c0ec06e81 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.321761 May 28 05:47:00.364604 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3743/7600] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 05:47:00 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:47:00.428725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a4d86c27-62eb-40c1-b531-b85fb1ff6766 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-430268828", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-949980045", "networks": [{"uuid": "0aee6d44-a684-4091-8cb8-2e287992e636"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:47:00.436136 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:47:00.437000 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=24 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:47:00.486656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-a4d86c27-62eb-40c1-b531-b85fb1ff6766 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] validate_networks() for [('0aee6d44-a684-4091-8cb8-2e287992e636', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:47:00.898802 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a4d86c27-62eb-40c1-b531-b85fb1ff6766 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:47:00.899510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a4d86c27-62eb-40c1-b531-b85fb1ff6766 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:47:00.900022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a4d86c27-62eb-40c1-b531-b85fb1ff6766 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:47:00.900436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a4d86c27-62eb-40c1-b531-b85fb1ff6766 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:47:00.901100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a4d86c27-62eb-40c1-b531-b85fb1ff6766 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:47:00.911367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4d86c27-62eb-40c1-b531-b85fb1ff6766 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:00.911825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4d86c27-62eb-40c1-b531-b85fb1ff6766 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:00.912708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4d86c27-62eb-40c1-b531-b85fb1ff6766 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:00.913156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a4d86c27-62eb-40c1-b531-b85fb1ff6766 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:00.933031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-a4d86c27-62eb-40c1-b531-b85fb1ff6766 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Getting quotas for project 1776666c25b74b01a3dde1feedb6b29d. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:47:00.939556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-a4d86c27-62eb-40c1-b531-b85fb1ff6766 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Getting quotas for user 14ce217e6d6a4c39aaf41c6637be7945 and project 1776666c25b74b01a3dde1feedb6b29d. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:47:00.954589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a4d86c27-62eb-40c1-b531-b85fb1ff6766 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:47:00.957367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a4d86c27-62eb-40c1-b531-b85fb1ff6766 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:47:01.084630 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a4d86c27-62eb-40c1-b531-b85fb1ff6766 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.659724 May 28 05:47:01.085270 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3858/7601] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:47:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:47:01.095095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-73252fd8-6342-4588-8c87-9e31e4361e95 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:01.095812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-73252fd8-6342-4588-8c87-9e31e4361e95 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:01.176329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-73252fd8-6342-4588-8c87-9e31e4361e95 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:47:01.183388 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-73252fd8-6342-4588-8c87-9e31e4361e95 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c" status: 200 len: 1261 microversion: 2.1 time: 0.092156 May 28 05:47:01.184135 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3744/7602] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:01 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c => generated 1261 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:47:02.201110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-00d4f5ed-0b74-455f-9394-3f6f73f9d468 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:02.201703 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-00d4f5ed-0b74-455f-9394-3f6f73f9d468 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:02.211817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00d4f5ed-0b74-455f-9394-3f6f73f9d468 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:02.212274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00d4f5ed-0b74-455f-9394-3f6f73f9d468 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:02.213044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00d4f5ed-0b74-455f-9394-3f6f73f9d468 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:02.213481 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-00d4f5ed-0b74-455f-9394-3f6f73f9d468 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:02.275860 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-00d4f5ed-0b74-455f-9394-3f6f73f9d468 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:47:02.285024 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-00d4f5ed-0b74-455f-9394-3f6f73f9d468 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c" status: 200 len: 1265 microversion: 2.1 time: 0.087833 May 28 05:47:02.285763 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3859/7603] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:02 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:47:03.302091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-45e55014-3943-453c-9c5f-e57f14b00c3c tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:03.303086 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-45e55014-3943-453c-9c5f-e57f14b00c3c tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:03.322483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45e55014-3943-453c-9c5f-e57f14b00c3c tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:03.322959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45e55014-3943-453c-9c5f-e57f14b00c3c tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:03.324120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45e55014-3943-453c-9c5f-e57f14b00c3c tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:03.336839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45e55014-3943-453c-9c5f-e57f14b00c3c tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:03.449213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-45e55014-3943-453c-9c5f-e57f14b00c3c tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:47:03.457577 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-45e55014-3943-453c-9c5f-e57f14b00c3c tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c" status: 200 len: 1321 microversion: 2.1 time: 0.159431 May 28 05:47:03.466619 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3745/7604] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:03 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:47:04.475405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f13222e4-c22a-4e43-9bc1-bb9244b68230 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:04.476038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f13222e4-c22a-4e43-9bc1-bb9244b68230 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:04.483065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f13222e4-c22a-4e43-9bc1-bb9244b68230 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:04.483518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f13222e4-c22a-4e43-9bc1-bb9244b68230 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:04.484289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f13222e4-c22a-4e43-9bc1-bb9244b68230 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:04.485291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f13222e4-c22a-4e43-9bc1-bb9244b68230 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:04.704593 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f13222e4-c22a-4e43-9bc1-bb9244b68230 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:47:04.712295 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f13222e4-c22a-4e43-9bc1-bb9244b68230 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c" status: 200 len: 1361 microversion: 2.1 time: 0.240777 May 28 05:47:04.712883 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3860/7605] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:04 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:47:05.172298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b6c2c4e9-add3-4478-abe1-03c7b4aab22c req-1a5f42f7-20f9-42ee-9276-d329a5f1da3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baa05435-e5d2-443f-97b3-2b044ec4643c", "tag": "f55dd7e5-74ef-4e56-a57e-021f0d5ff345"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:47:05.182220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b6c2c4e9-add3-4478-abe1-03c7b4aab22c req-1a5f42f7-20f9-42ee-9276-d329a5f1da3b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:05.182683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b6c2c4e9-add3-4478-abe1-03c7b4aab22c req-1a5f42f7-20f9-42ee-9276-d329a5f1da3b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:05.200948 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b6c2c4e9-add3-4478-abe1-03c7b4aab22c req-1a5f42f7-20f9-42ee-9276-d329a5f1da3b service nova] Creating event network-changed:f55dd7e5-74ef-4e56-a57e-021f0d5ff345 for instance baa05435-e5d2-443f-97b3-2b044ec4643c on n-h1-843700-1 May 28 05:47:05.207935 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b6c2c4e9-add3-4478-abe1-03c7b4aab22c req-1a5f42f7-20f9-42ee-9276-d329a5f1da3b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039214 May 28 05:47:05.208737 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3746/7606] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:47:05.729622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1460ae3d-647f-4c31-8ce1-6b978dbe340d tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:05.730217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1460ae3d-647f-4c31-8ce1-6b978dbe340d tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:05.737579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1460ae3d-647f-4c31-8ce1-6b978dbe340d tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:05.738032 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1460ae3d-647f-4c31-8ce1-6b978dbe340d tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:05.738791 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1460ae3d-647f-4c31-8ce1-6b978dbe340d tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:05.739259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1460ae3d-647f-4c31-8ce1-6b978dbe340d tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:05.943048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1460ae3d-647f-4c31-8ce1-6b978dbe340d tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:47:05.951029 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1460ae3d-647f-4c31-8ce1-6b978dbe340d tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c" status: 200 len: 1361 microversion: 2.1 time: 0.225276 May 28 05:47:05.951839 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3861/7607] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:05 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:47:06.969165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3ead9212-d341-457c-803c-b90665cc4a80 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:06.970050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3ead9212-d341-457c-803c-b90665cc4a80 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:06.976517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ead9212-d341-457c-803c-b90665cc4a80 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:06.976993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ead9212-d341-457c-803c-b90665cc4a80 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:06.977782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ead9212-d341-457c-803c-b90665cc4a80 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:06.978358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3ead9212-d341-457c-803c-b90665cc4a80 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:07.109829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3ead9212-d341-457c-803c-b90665cc4a80 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:47:07.117757 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3ead9212-d341-457c-803c-b90665cc4a80 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c" status: 200 len: 1361 microversion: 2.1 time: 0.153752 May 28 05:47:07.118702 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3747/7608] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:06 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:47:08.135858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-82f4cd1c-0a72-4e8f-8226-61684608f69b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:08.136486 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-82f4cd1c-0a72-4e8f-8226-61684608f69b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:08.144244 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82f4cd1c-0a72-4e8f-8226-61684608f69b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:08.144709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82f4cd1c-0a72-4e8f-8226-61684608f69b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:08.145490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82f4cd1c-0a72-4e8f-8226-61684608f69b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:08.145943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82f4cd1c-0a72-4e8f-8226-61684608f69b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:08.271555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-82f4cd1c-0a72-4e8f-8226-61684608f69b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:47:08.278880 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-82f4cd1c-0a72-4e8f-8226-61684608f69b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c" status: 200 len: 1361 microversion: 2.1 time: 0.147237 May 28 05:47:08.279496 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3862/7609] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:08 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:47:09.295795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1cae4c77-8436-4cf3-bae7-ae46f9fb37e9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:09.296434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1cae4c77-8436-4cf3-bae7-ae46f9fb37e9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:09.303550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cae4c77-8436-4cf3-bae7-ae46f9fb37e9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:09.304027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cae4c77-8436-4cf3-bae7-ae46f9fb37e9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:09.304835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cae4c77-8436-4cf3-bae7-ae46f9fb37e9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:09.305293 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cae4c77-8436-4cf3-bae7-ae46f9fb37e9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:09.435345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1cae4c77-8436-4cf3-bae7-ae46f9fb37e9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:47:09.442772 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1cae4c77-8436-4cf3-bae7-ae46f9fb37e9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c" status: 200 len: 1361 microversion: 2.1 time: 0.150864 May 28 05:47:09.443409 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3748/7610] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:09 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:47:10.459684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a71e2988-3af7-414d-a31a-750db9b3d58b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:10.460312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a71e2988-3af7-414d-a31a-750db9b3d58b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:10.467362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a71e2988-3af7-414d-a31a-750db9b3d58b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:10.467829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a71e2988-3af7-414d-a31a-750db9b3d58b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:10.469112 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a71e2988-3af7-414d-a31a-750db9b3d58b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:10.469590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a71e2988-3af7-414d-a31a-750db9b3d58b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:10.597527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a71e2988-3af7-414d-a31a-750db9b3d58b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:47:10.605027 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a71e2988-3af7-414d-a31a-750db9b3d58b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c" status: 200 len: 1361 microversion: 2.1 time: 0.149275 May 28 05:47:10.605634 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3863/7611] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:10 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:47:11.622044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b55520b9-b7f6-4e19-b087-7d0d00c29d4c tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:11.622867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b55520b9-b7f6-4e19-b087-7d0d00c29d4c tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:11.626401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:47:11.631381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b55520b9-b7f6-4e19-b087-7d0d00c29d4c tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:11.632132 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b55520b9-b7f6-4e19-b087-7d0d00c29d4c tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:11.632929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b55520b9-b7f6-4e19-b087-7d0d00c29d4c tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:11.633385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b55520b9-b7f6-4e19-b087-7d0d00c29d4c tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:11.653710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:47:11.654473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:47:11.715660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-0738ec5b-a53f-4f81-96ad-92af077f995c req-b166d37f-5449-4e5f-98cf-947e355607bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa05435-e5d2-443f-97b3-2b044ec4643c", "name": "network-vif-plugged", "status": "completed", "tag": "f55dd7e5-74ef-4e56-a57e-021f0d5ff345"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:47:11.725081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-0738ec5b-a53f-4f81-96ad-92af077f995c req-b166d37f-5449-4e5f-98cf-947e355607bc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:11.725545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-0738ec5b-a53f-4f81-96ad-92af077f995c req-b166d37f-5449-4e5f-98cf-947e355607bc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:11.737987 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-0738ec5b-a53f-4f81-96ad-92af077f995c req-b166d37f-5449-4e5f-98cf-947e355607bc service nova] Creating event network-vif-plugged:f55dd7e5-74ef-4e56-a57e-021f0d5ff345 for instance baa05435-e5d2-443f-97b3-2b044ec4643c on n-h1-843700-1 May 28 05:47:11.743443 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-0738ec5b-a53f-4f81-96ad-92af077f995c req-b166d37f-5449-4e5f-98cf-947e355607bc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094533 May 28 05:47:11.744986 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3864/7612] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:47:11.784193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b55520b9-b7f6-4e19-b087-7d0d00c29d4c tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:47:11.792075 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b55520b9-b7f6-4e19-b087-7d0d00c29d4c tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c" status: 200 len: 1361 microversion: 2.1 time: 0.173862 May 28 05:47:11.794097 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3749/7613] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:11 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:47:12.811683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d93b0602-3a1f-44fc-9afa-36e8416c1c2a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:12.812746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d93b0602-3a1f-44fc-9afa-36e8416c1c2a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:12.820128 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d93b0602-3a1f-44fc-9afa-36e8416c1c2a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:12.820726 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d93b0602-3a1f-44fc-9afa-36e8416c1c2a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:12.821525 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d93b0602-3a1f-44fc-9afa-36e8416c1c2a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:12.821972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d93b0602-3a1f-44fc-9afa-36e8416c1c2a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:12.961129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d93b0602-3a1f-44fc-9afa-36e8416c1c2a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:47:12.968883 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d93b0602-3a1f-44fc-9afa-36e8416c1c2a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c" status: 200 len: 1361 microversion: 2.1 time: 0.162551 May 28 05:47:12.969460 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3865/7614] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:12 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:47:13.986472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fa81275b-6590-4cda-8e54-28b9e41ce909 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:13.987140 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fa81275b-6590-4cda-8e54-28b9e41ce909 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:13.994084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa81275b-6590-4cda-8e54-28b9e41ce909 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:13.994558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa81275b-6590-4cda-8e54-28b9e41ce909 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:13.995367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa81275b-6590-4cda-8e54-28b9e41ce909 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:13.995823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa81275b-6590-4cda-8e54-28b9e41ce909 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:14.124034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fa81275b-6590-4cda-8e54-28b9e41ce909 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:47:14.132626 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fa81275b-6590-4cda-8e54-28b9e41ce909 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c" status: 200 len: 1553 microversion: 2.1 time: 0.150023 May 28 05:47:14.133201 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3750/7615] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:13 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:47:14.149366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-249bc7f6-5490-4357-999d-4048607b40e5 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:14.149989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-249bc7f6-5490-4357-999d-4048607b40e5 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:14.157042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-249bc7f6-5490-4357-999d-4048607b40e5 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:14.157502 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-249bc7f6-5490-4357-999d-4048607b40e5 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:14.158274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-249bc7f6-5490-4357-999d-4048607b40e5 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:14.158719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-249bc7f6-5490-4357-999d-4048607b40e5 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:14.285477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-249bc7f6-5490-4357-999d-4048607b40e5 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:47:14.293018 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-249bc7f6-5490-4357-999d-4048607b40e5 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c" status: 200 len: 1553 microversion: 2.1 time: 0.147495 May 28 05:47:14.293584 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3866/7616] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:14 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:47:17.367256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6b1e3fef-886a-4f9e-ac92-799d5d1709e9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4633fb3b-1958-413d-b3ee-0e4541c8ca5f"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:47:17.368379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6b1e3fef-886a-4f9e-ac92-799d5d1709e9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:17.375950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b1e3fef-886a-4f9e-ac92-799d5d1709e9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:17.376419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b1e3fef-886a-4f9e-ac92-799d5d1709e9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:17.377208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b1e3fef-886a-4f9e-ac92-799d5d1709e9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:17.377666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b1e3fef-886a-4f9e-ac92-799d5d1709e9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:18.065279 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6b1e3fef-886a-4f9e-ac92-799d5d1709e9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "POST /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.701746 May 28 05:47:18.065936 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3751/7617] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 05:47:17 2022] POST /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments => generated 194 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:47:35.047747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8a3153fa-5915-4ebe-bae1-6be3c6955494 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:35.048287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8a3153fa-5915-4ebe-bae1-6be3c6955494 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:35.050637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:47:35.051453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=46 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:47:35.056135 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a3153fa-5915-4ebe-bae1-6be3c6955494 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:35.056597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a3153fa-5915-4ebe-bae1-6be3c6955494 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:35.057370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a3153fa-5915-4ebe-bae1-6be3c6955494 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:35.057819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8a3153fa-5915-4ebe-bae1-6be3c6955494 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:35.139150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-8a3153fa-5915-4ebe-bae1-6be3c6955494 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lazy-loading 'services' on Instance uuid baa05435-e5d2-443f-97b3-2b044ec4643c {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:47:35.344960 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8a3153fa-5915-4ebe-bae1-6be3c6955494 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "DELETE /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments/4633fb3b-1958-413d-b3ee-0e4541c8ca5f" status: 202 len: 0 microversion: 2.1 time: 0.301193 May 28 05:47:35.345600 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3867/7618] 10.222.0.58 () {58 vars in 1415 bytes} [Sat May 28 05:47:35 2022] DELETE /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments/4633fb3b-1958-413d-b3ee-0e4541c8ca5f => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:47:35.354560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0fbb3991-5436-4141-9dff-bf76f36b9bb6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:35.355888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0fbb3991-5436-4141-9dff-bf76f36b9bb6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:35.358601 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:47:35.359663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:47:35.365149 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0fbb3991-5436-4141-9dff-bf76f36b9bb6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:35.370072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0fbb3991-5436-4141-9dff-bf76f36b9bb6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:35.370072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0fbb3991-5436-4141-9dff-bf76f36b9bb6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:35.370072 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0fbb3991-5436-4141-9dff-bf76f36b9bb6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:35.400205 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0fbb3991-5436-4141-9dff-bf76f36b9bb6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050048 May 28 05:47:35.404468 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3752/7619] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:47:35 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:47:36.413868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-efd37115-0f8c-47d8-9da0-7a6a52fdab4e tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:36.414860 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-efd37115-0f8c-47d8-9da0-7a6a52fdab4e tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:36.421255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efd37115-0f8c-47d8-9da0-7a6a52fdab4e tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:36.421719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efd37115-0f8c-47d8-9da0-7a6a52fdab4e tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:36.422494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efd37115-0f8c-47d8-9da0-7a6a52fdab4e tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:36.422973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efd37115-0f8c-47d8-9da0-7a6a52fdab4e tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:36.453806 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-efd37115-0f8c-47d8-9da0-7a6a52fdab4e tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045329 May 28 05:47:36.454383 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3868/7620] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:47:36 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:47:37.465051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ee6c365f-5a2c-4774-9541-a91c9cc026dc tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:37.466056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ee6c365f-5a2c-4774-9541-a91c9cc026dc tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:37.474944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ee6c365f-5a2c-4774-9541-a91c9cc026dc tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:37.475454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ee6c365f-5a2c-4774-9541-a91c9cc026dc tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:37.476260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ee6c365f-5a2c-4774-9541-a91c9cc026dc tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:37.476718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ee6c365f-5a2c-4774-9541-a91c9cc026dc tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:37.511460 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ee6c365f-5a2c-4774-9541-a91c9cc026dc tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050596 May 28 05:47:37.517705 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3753/7621] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:47:37 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:47:38.523762 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4a7db64b-2ff8-48a4-af98-fe8bc7069991 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:38.524730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4a7db64b-2ff8-48a4-af98-fe8bc7069991 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:38.531815 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a7db64b-2ff8-48a4-af98-fe8bc7069991 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:38.532273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a7db64b-2ff8-48a4-af98-fe8bc7069991 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:38.533076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a7db64b-2ff8-48a4-af98-fe8bc7069991 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:38.533519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4a7db64b-2ff8-48a4-af98-fe8bc7069991 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:38.564452 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4a7db64b-2ff8-48a4-af98-fe8bc7069991 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045709 May 28 05:47:38.565297 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3869/7622] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:47:38 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:47:39.576020 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9192ed8a-dc34-410a-b221-87af84a6e125 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:39.576954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9192ed8a-dc34-410a-b221-87af84a6e125 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:39.584928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9192ed8a-dc34-410a-b221-87af84a6e125 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:39.585419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9192ed8a-dc34-410a-b221-87af84a6e125 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:39.586145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9192ed8a-dc34-410a-b221-87af84a6e125 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:39.586592 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9192ed8a-dc34-410a-b221-87af84a6e125 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:39.616464 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9192ed8a-dc34-410a-b221-87af84a6e125 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044797 May 28 05:47:39.617247 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3754/7623] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:47:39 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:47:40.628060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3386e1bb-55b3-4ed6-acb9-a8d583a7ca25 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:40.629047 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3386e1bb-55b3-4ed6-acb9-a8d583a7ca25 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:40.636534 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3386e1bb-55b3-4ed6-acb9-a8d583a7ca25 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:40.636991 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3386e1bb-55b3-4ed6-acb9-a8d583a7ca25 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:40.637758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3386e1bb-55b3-4ed6-acb9-a8d583a7ca25 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:40.638200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3386e1bb-55b3-4ed6-acb9-a8d583a7ca25 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:40.668146 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3386e1bb-55b3-4ed6-acb9-a8d583a7ca25 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044133 May 28 05:47:40.668935 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3870/7624] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:47:40 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:47:41.679815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e1177e25-1024-4cc9-ab27-8b81d685fc50 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:41.680768 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e1177e25-1024-4cc9-ab27-8b81d685fc50 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:41.687954 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e1177e25-1024-4cc9-ab27-8b81d685fc50 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:41.688426 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e1177e25-1024-4cc9-ab27-8b81d685fc50 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:41.689218 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e1177e25-1024-4cc9-ab27-8b81d685fc50 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:41.689677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e1177e25-1024-4cc9-ab27-8b81d685fc50 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:41.719451 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e1177e25-1024-4cc9-ab27-8b81d685fc50 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044160 May 28 05:47:41.720060 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3755/7625] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:47:41 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:47:42.734330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-683e01c1-3ec0-4100-9326-3d4f4165d939 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:42.736039 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-683e01c1-3ec0-4100-9326-3d4f4165d939 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:42.747560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-683e01c1-3ec0-4100-9326-3d4f4165d939 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:42.748265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-683e01c1-3ec0-4100-9326-3d4f4165d939 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:42.749484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-683e01c1-3ec0-4100-9326-3d4f4165d939 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:42.750184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-683e01c1-3ec0-4100-9326-3d4f4165d939 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:42.807560 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-683e01c1-3ec0-4100-9326-3d4f4165d939 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079387 May 28 05:47:42.808571 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3871/7626] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:47:42 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:47:43.822115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ee396560-313c-48c7-9002-f7e50932daaa tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:43.823103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ee396560-313c-48c7-9002-f7e50932daaa tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:43.830051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ee396560-313c-48c7-9002-f7e50932daaa tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:43.830523 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ee396560-313c-48c7-9002-f7e50932daaa tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:43.831385 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ee396560-313c-48c7-9002-f7e50932daaa tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:43.831842 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ee396560-313c-48c7-9002-f7e50932daaa tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:43.860865 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ee396560-313c-48c7-9002-f7e50932daaa tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042771 May 28 05:47:43.861669 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3756/7627] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:47:43 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:47:44.873033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-318718ba-a8cf-4579-a59d-987503df474a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:44.873876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-318718ba-a8cf-4579-a59d-987503df474a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:44.881950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-318718ba-a8cf-4579-a59d-987503df474a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:44.882393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-318718ba-a8cf-4579-a59d-987503df474a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:44.883208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-318718ba-a8cf-4579-a59d-987503df474a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:44.883655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-318718ba-a8cf-4579-a59d-987503df474a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:44.912894 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-318718ba-a8cf-4579-a59d-987503df474a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044031 May 28 05:47:44.913464 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3872/7628] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:47:44 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 05:47:44.923615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d1cb323d-5bff-4a35-b008-61b9c48deb17 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:44.924161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d1cb323d-5bff-4a35-b008-61b9c48deb17 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:44.931106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d1cb323d-5bff-4a35-b008-61b9c48deb17 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:44.931576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d1cb323d-5bff-4a35-b008-61b9c48deb17 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:44.932354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d1cb323d-5bff-4a35-b008-61b9c48deb17 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:44.932827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d1cb323d-5bff-4a35-b008-61b9c48deb17 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:45.056053 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-d1cb323d-5bff-4a35-b008-61b9c48deb17 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] HTTP exception thrown: Instance baa05435-e5d2-443f-97b3-2b044ec4643c is not attached to volume 4633fb3b-1958-413d-b3ee-0e4541c8ca5f May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d1cb323d-5bff-4a35-b008-61b9c48deb17 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Request method failure captured: May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments/4633fb3b-1958-413d-b3ee-0e4541c8ca5f HTTP/1.1 May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbdNTySfVVFqZM85g3hn-XBKhpF70oC8rWjK7A5Z034PBUChgkqFDWv2mtGCVvxkjRYSyF9l1B-O1Aa8I9FU4WfH_qfB8yf8o-7o0eAMbZ8zj0LJuSHe_JYG9OuKpGAaK5iwXP7hGU_rjgS749NxHZIy0Gg16fb2Eg8aSpwlEqRm3a4 May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 1776666c25b74b01a3dde1feedb6b29d May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1615336809 May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1776666c25b74b01a3dde1feedb6b29d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1776666c25b74b01a3dde1feedb6b29d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1776666c25b74b01a3dde1feedb6b29d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1776666c25b74b01a3dde1feedb6b29d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestEncryptedCinderVolumes-1615336809 May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 1776666c25b74b01a3dde1feedb6b29d May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1615336809 May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestEncryptedCinderVolumes-1615336809-project May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 14ce217e6d6a4c39aaf41c6637be7945 May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestEncryptedCinderVolumes-1615336809-project May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance baa05435-e5d2-443f-97b3-2b044ec4643c is not attached to volume 4633fb3b-1958-413d-b3ee-0e4541c8ca5f May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'server_id': 'baa05435-e5d2-443f-97b3-2b044ec4643c', 'id': '4633fb3b-1958-413d-b3ee-0e4541c8ca5f'} May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4633fb3b-1958-413d-b3ee-0e4541c8ca5f. May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baa05435-e5d2-443f-97b3-2b044ec4643c is not attached to volume 4633fb3b-1958-413d-b3ee-0e4541c8ca5f May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:47:45.073816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:47:45.079348 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:47:45.079348 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:47:45.079348 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baa05435-e5d2-443f-97b3-2b044ec4643c is not attached to volume 4633fb3b-1958-413d-b3ee-0e4541c8ca5f May 28 05:47:45.079348 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:47:45.079348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d1cb323d-5bff-4a35-b008-61b9c48deb17 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Returning 404 to user: Instance baa05435-e5d2-443f-97b3-2b044ec4643c is not attached to volume 4633fb3b-1958-413d-b3ee-0e4541c8ca5f {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:47:45.079348 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d1cb323d-5bff-4a35-b008-61b9c48deb17 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "DELETE /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments/4633fb3b-1958-413d-b3ee-0e4541c8ca5f" status: 404 len: 154 microversion: 2.1 time: 0.155840 May 28 05:47:45.079348 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3757/7629] 10.222.0.58 () {58 vars in 1415 bytes} [Sat May 28 05:47:44 2022] DELETE /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c/os-volume_attachments/4633fb3b-1958-413d-b3ee-0e4541c8ca5f => generated 154 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:47:51.745616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-77f56fba-2c1b-4fe6-93e1-5e1688d98861 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:51.746269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-77f56fba-2c1b-4fe6-93e1-5e1688d98861 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:51.754519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77f56fba-2c1b-4fe6-93e1-5e1688d98861 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:51.755214 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77f56fba-2c1b-4fe6-93e1-5e1688d98861 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:51.756266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77f56fba-2c1b-4fe6-93e1-5e1688d98861 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:51.756722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77f56fba-2c1b-4fe6-93e1-5e1688d98861 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:51.784833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-77f56fba-2c1b-4fe6-93e1-5e1688d98861 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:47:52.091580 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-77f56fba-2c1b-4fe6-93e1-5e1688d98861 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "DELETE /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c" status: 204 len: 0 microversion: 2.1 time: 0.349560 May 28 05:47:52.092102 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3873/7630] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:47:51 2022] DELETE /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:47:52.100728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b7c0e61e-3514-44b5-9fe7-e6731cf17b11 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:52.106047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b7c0e61e-3514-44b5-9fe7-e6731cf17b11 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:52.109498 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7c0e61e-3514-44b5-9fe7-e6731cf17b11 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:52.109972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7c0e61e-3514-44b5-9fe7-e6731cf17b11 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:52.110758 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7c0e61e-3514-44b5-9fe7-e6731cf17b11 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:52.111249 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b7c0e61e-3514-44b5-9fe7-e6731cf17b11 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:52.251635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b7c0e61e-3514-44b5-9fe7-e6731cf17b11 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:47:52.260163 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b7c0e61e-3514-44b5-9fe7-e6731cf17b11 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c" status: 200 len: 1559 microversion: 2.1 time: 0.163672 May 28 05:47:52.260746 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3758/7631] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:52 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:47:53.278453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ac92c3ae-2647-423a-ac7e-18e9d5191349 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:53.279216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ac92c3ae-2647-423a-ac7e-18e9d5191349 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:53.286118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac92c3ae-2647-423a-ac7e-18e9d5191349 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:53.286560 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac92c3ae-2647-423a-ac7e-18e9d5191349 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:53.287360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac92c3ae-2647-423a-ac7e-18e9d5191349 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:53.287801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac92c3ae-2647-423a-ac7e-18e9d5191349 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:53.515590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ac92c3ae-2647-423a-ac7e-18e9d5191349 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:47:53.523398 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ac92c3ae-2647-423a-ac7e-18e9d5191349 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c" status: 200 len: 1559 microversion: 2.1 time: 0.249306 May 28 05:47:53.524342 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3874/7632] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:53 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c => generated 1559 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:47:54.055219 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b33cde0e-f25f-4296-ab39-6f9d568de68d req-b5f4306d-23f4-42e5-bf7c-2f57920dcd4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa05435-e5d2-443f-97b3-2b044ec4643c", "name": "network-vif-deleted", "tag": "f55dd7e5-74ef-4e56-a57e-021f0d5ff345"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:47:54.064125 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b33cde0e-f25f-4296-ab39-6f9d568de68d req-b5f4306d-23f4-42e5-bf7c-2f57920dcd4b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:54.066442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b33cde0e-f25f-4296-ab39-6f9d568de68d req-b5f4306d-23f4-42e5-bf7c-2f57920dcd4b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:54.075659 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b33cde0e-f25f-4296-ab39-6f9d568de68d req-b5f4306d-23f4-42e5-bf7c-2f57920dcd4b service nova] Creating event network-vif-deleted:f55dd7e5-74ef-4e56-a57e-021f0d5ff345 for instance baa05435-e5d2-443f-97b3-2b044ec4643c on n-h1-843700-1 May 28 05:47:54.080797 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b33cde0e-f25f-4296-ab39-6f9d568de68d req-b5f4306d-23f4-42e5-bf7c-2f57920dcd4b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029299 May 28 05:47:54.081397 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3759/7633] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:47:54.541457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-27a27145-e539-4bb8-b0ea-b301e23fc547 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:54.542082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-27a27145-e539-4bb8-b0ea-b301e23fc547 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:54.548311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27a27145-e539-4bb8-b0ea-b301e23fc547 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:54.548766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27a27145-e539-4bb8-b0ea-b301e23fc547 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:54.549536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27a27145-e539-4bb8-b0ea-b301e23fc547 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:54.549981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27a27145-e539-4bb8-b0ea-b301e23fc547 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:54.580469 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27a27145-e539-4bb8-b0ea-b301e23fc547 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:54.581401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-27a27145-e539-4bb8-b0ea-b301e23fc547 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:54.581857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-27a27145-e539-4bb8-b0ea-b301e23fc547 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lazy-loading 'fault' on Instance uuid baa05435-e5d2-443f-97b3-2b044ec4643c {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:47:54.622212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-27a27145-e539-4bb8-b0ea-b301e23fc547 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:47:54.630418 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-27a27145-e539-4bb8-b0ea-b301e23fc547 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c" status: 200 len: 1351 microversion: 2.1 time: 0.093155 May 28 05:47:54.631269 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3875/7634] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:54 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c => generated 1351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:47:55.649835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-49a87765-dc84-4684-bdbb-2523ead79259 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:55.650546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-49a87765-dc84-4684-bdbb-2523ead79259 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: baa05435-e5d2-443f-97b3-2b044ec4643c] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:55.656944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49a87765-dc84-4684-bdbb-2523ead79259 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:55.657406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49a87765-dc84-4684-bdbb-2523ead79259 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:55.658176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49a87765-dc84-4684-bdbb-2523ead79259 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:55.658625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-49a87765-dc84-4684-bdbb-2523ead79259 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:55.672433 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-49a87765-dc84-4684-bdbb-2523ead79259 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] HTTP exception thrown: Instance baa05435-e5d2-443f-97b3-2b044ec4643c could not be found. May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-49a87765-dc84-4684-bdbb-2523ead79259 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Request method failure captured: May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c HTTP/1.1 May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbdNTySfVVFqZM85g3hn-XBKhpF70oC8rWjK7A5Z034PBUChgkqFDWv2mtGCVvxkjRYSyF9l1B-O1Aa8I9FU4WfH_qfB8yf8o-7o0eAMbZ8zj0LJuSHe_JYG9OuKpGAaK5iwXP7hGU_rjgS749NxHZIy0Gg16fb2Eg8aSpwlEqRm3a4 May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 1776666c25b74b01a3dde1feedb6b29d May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1615336809 May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1776666c25b74b01a3dde1feedb6b29d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1776666c25b74b01a3dde1feedb6b29d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1776666c25b74b01a3dde1feedb6b29d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1776666c25b74b01a3dde1feedb6b29d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestEncryptedCinderVolumes-1615336809 May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 1776666c25b74b01a3dde1feedb6b29d May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1615336809 May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestEncryptedCinderVolumes-1615336809-project May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 14ce217e6d6a4c39aaf41c6637be7945 May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestEncryptedCinderVolumes-1615336809-project May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance baa05435-e5d2-443f-97b3-2b044ec4643c could not be found. May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'baa05435-e5d2-443f-97b3-2b044ec4643c'} May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baa05435-e5d2-443f-97b3-2b044ec4643c could not be found. May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baa05435-e5d2-443f-97b3-2b044ec4643c could not be found. May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:47:55.674017 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:47:55.679882 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:47:55.679882 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:47:55.679882 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:47:55.679882 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:47:55.679882 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:47:55.679882 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baa05435-e5d2-443f-97b3-2b044ec4643c could not be found. May 28 05:47:55.679882 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:47:55.679882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-49a87765-dc84-4684-bdbb-2523ead79259 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Returning 404 to user: Instance baa05435-e5d2-443f-97b3-2b044ec4643c could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:47:55.679882 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-49a87765-dc84-4684-bdbb-2523ead79259 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c" status: 404 len: 111 microversion: 2.1 time: 0.030670 May 28 05:47:55.679882 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3760/7635] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:55 2022] GET /compute/v2.1/servers/baa05435-e5d2-443f-97b3-2b044ec4643c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:47:55.684018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-022f4117-b03d-465b-ba1c-5c247e5d4b90 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '.version_select at 0x7f7700c34c10>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:55.764034 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-022f4117-b03d-465b-ba1c-5c247e5d4b90 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-949980045" status: 202 len: 0 microversion: 2.1 time: 0.083795 May 28 05:47:55.764623 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3876/7636] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 05:47:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-949980045 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:47:55.785170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5fa3069b-f618-4d5d-857d-4c46ae7f2f5c tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Action: 'create', calling method: .version_select at 0x7f770007e820>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-148207483", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi2pWh3XHUmqET43JazzWq4NxFrfn7xw3narviaMjTTMg2X4DhSkP4lApLdncXYJiSFcfiQOvlvwPRA2TqjqSx8hbyrORy+OLzIZmlcK3vbTbBuFiSn7NlhEdbbCg4Aqw=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:47:55.799223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-5fa3069b-f618-4d5d-857d-4c46ae7f2f5c tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Getting quotas for project 1776666c25b74b01a3dde1feedb6b29d. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:47:55.805041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-5fa3069b-f618-4d5d-857d-4c46ae7f2f5c tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Getting quotas for user 14ce217e6d6a4c39aaf41c6637be7945 and project 1776666c25b74b01a3dde1feedb6b29d. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:47:55.884639 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5fa3069b-f618-4d5d-857d-4c46ae7f2f5c tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.104107 May 28 05:47:55.885245 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3761/7637] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 05:47:55 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:47:55.934109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c4a23e06-9023-4d8e-8b29-c53ac61c7b6a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-897134425", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-148207483", "networks": [{"uuid": "0aee6d44-a684-4091-8cb8-2e287992e636"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:47:55.985719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-c4a23e06-9023-4d8e-8b29-c53ac61c7b6a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] validate_networks() for [('0aee6d44-a684-4091-8cb8-2e287992e636', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:47:56.392920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c4a23e06-9023-4d8e-8b29-c53ac61c7b6a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:47:56.393912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c4a23e06-9023-4d8e-8b29-c53ac61c7b6a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:47:56.394415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c4a23e06-9023-4d8e-8b29-c53ac61c7b6a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:47:56.394857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c4a23e06-9023-4d8e-8b29-c53ac61c7b6a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:47:56.395309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-c4a23e06-9023-4d8e-8b29-c53ac61c7b6a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:47:56.404208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4a23e06-9023-4d8e-8b29-c53ac61c7b6a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:56.404764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4a23e06-9023-4d8e-8b29-c53ac61c7b6a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:56.405569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4a23e06-9023-4d8e-8b29-c53ac61c7b6a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:56.406009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c4a23e06-9023-4d8e-8b29-c53ac61c7b6a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:56.422572 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-c4a23e06-9023-4d8e-8b29-c53ac61c7b6a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Getting quotas for project 1776666c25b74b01a3dde1feedb6b29d. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:47:56.428455 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-c4a23e06-9023-4d8e-8b29-c53ac61c7b6a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Getting quotas for user 14ce217e6d6a4c39aaf41c6637be7945 and project 1776666c25b74b01a3dde1feedb6b29d. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:47:56.441523 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c4a23e06-9023-4d8e-8b29-c53ac61c7b6a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:47:56.443811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c4a23e06-9023-4d8e-8b29-c53ac61c7b6a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:47:56.550416 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c4a23e06-9023-4d8e-8b29-c53ac61c7b6a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620183 May 28 05:47:56.551104 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3877/7638] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:47:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:47:56.561123 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0c2b536f-88ea-447a-9f3b-1255ac581cc0 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:56.561745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0c2b536f-88ea-447a-9f3b-1255ac581cc0 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:56.617050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0c2b536f-88ea-447a-9f3b-1255ac581cc0 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:47:56.623917 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0c2b536f-88ea-447a-9f3b-1255ac581cc0 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a" status: 200 len: 1261 microversion: 2.1 time: 0.066754 May 28 05:47:56.624495 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3762/7639] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:56 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a => generated 1261 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:47:57.642376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6a4dd05b-19bd-43dc-bc8d-4769f70d2899 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:57.643009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6a4dd05b-19bd-43dc-bc8d-4769f70d2899 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:57.650104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a4dd05b-19bd-43dc-bc8d-4769f70d2899 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:57.650564 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a4dd05b-19bd-43dc-bc8d-4769f70d2899 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:57.651377 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a4dd05b-19bd-43dc-bc8d-4769f70d2899 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:57.651825 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a4dd05b-19bd-43dc-bc8d-4769f70d2899 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:57.722229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6a4dd05b-19bd-43dc-bc8d-4769f70d2899 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:47:57.730024 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6a4dd05b-19bd-43dc-bc8d-4769f70d2899 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a" status: 200 len: 1265 microversion: 2.1 time: 0.092472 May 28 05:47:57.730614 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3878/7640] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:57 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:47:58.747788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3a2af8c5-1caf-458f-b881-06180509b95b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:58.748349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3a2af8c5-1caf-458f-b881-06180509b95b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:58.755650 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a2af8c5-1caf-458f-b881-06180509b95b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:58.756364 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a2af8c5-1caf-458f-b881-06180509b95b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:58.757189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a2af8c5-1caf-458f-b881-06180509b95b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:58.757641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3a2af8c5-1caf-458f-b881-06180509b95b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:58.838351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3a2af8c5-1caf-458f-b881-06180509b95b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:47:58.845995 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3a2af8c5-1caf-458f-b881-06180509b95b tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a" status: 200 len: 1319 microversion: 2.1 time: 0.102274 May 28 05:47:58.846640 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3763/7641] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:58 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a => generated 1319 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:47:59.865446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b355f151-7b3f-4c15-b994-af42ed15e66a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:47:59.866341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b355f151-7b3f-4c15-b994-af42ed15e66a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:47:59.873206 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b355f151-7b3f-4c15-b994-af42ed15e66a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:59.873670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b355f151-7b3f-4c15-b994-af42ed15e66a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:47:59.874440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b355f151-7b3f-4c15-b994-af42ed15e66a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:47:59.874878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b355f151-7b3f-4c15-b994-af42ed15e66a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:00.007348 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-6441ca3e-9486-4c6b-862c-2f4936cc5944 req-468db2cb-c7e4-4c1d-bcd4-2d164cf3394c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99aad656-5afa-4a1e-a01d-aa566dbbde0a", "tag": "0ac01aae-20f4-4e3f-b854-f4ce1a496c09"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:48:00.018181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-6441ca3e-9486-4c6b-862c-2f4936cc5944 req-468db2cb-c7e4-4c1d-bcd4-2d164cf3394c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:00.018651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-6441ca3e-9486-4c6b-862c-2f4936cc5944 req-468db2cb-c7e4-4c1d-bcd4-2d164cf3394c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:00.030601 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-6441ca3e-9486-4c6b-862c-2f4936cc5944 req-468db2cb-c7e4-4c1d-bcd4-2d164cf3394c service nova] Creating event network-changed:0ac01aae-20f4-4e3f-b854-f4ce1a496c09 for instance 99aad656-5afa-4a1e-a01d-aa566dbbde0a on n-h2-843700-1 May 28 05:48:00.038012 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-6441ca3e-9486-4c6b-862c-2f4936cc5944 req-468db2cb-c7e4-4c1d-bcd4-2d164cf3394c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034579 May 28 05:48:00.038824 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3764/7642] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:48:00.081511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b355f151-7b3f-4c15-b994-af42ed15e66a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:48:00.090326 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b355f151-7b3f-4c15-b994-af42ed15e66a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a" status: 200 len: 1361 microversion: 2.1 time: 0.229309 May 28 05:48:00.091526 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3879/7643] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:47:59 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:48:01.109864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e83f5e5f-17c6-492f-bf5d-a782d5c2dff4 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:01.110615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e83f5e5f-17c6-492f-bf5d-a782d5c2dff4 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:01.117680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e83f5e5f-17c6-492f-bf5d-a782d5c2dff4 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:01.118160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e83f5e5f-17c6-492f-bf5d-a782d5c2dff4 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:01.118955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e83f5e5f-17c6-492f-bf5d-a782d5c2dff4 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:01.119436 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e83f5e5f-17c6-492f-bf5d-a782d5c2dff4 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:01.248095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e83f5e5f-17c6-492f-bf5d-a782d5c2dff4 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:48:01.256369 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e83f5e5f-17c6-492f-bf5d-a782d5c2dff4 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a" status: 200 len: 1361 microversion: 2.1 time: 0.151112 May 28 05:48:01.257030 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3765/7644] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:48:01 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:48:02.276616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-84914c2e-8d50-4e2f-8d93-7681329f16a4 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:02.277233 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-84914c2e-8d50-4e2f-8d93-7681329f16a4 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:02.284260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84914c2e-8d50-4e2f-8d93-7681329f16a4 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:02.284740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84914c2e-8d50-4e2f-8d93-7681329f16a4 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:02.286006 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84914c2e-8d50-4e2f-8d93-7681329f16a4 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:02.286449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-84914c2e-8d50-4e2f-8d93-7681329f16a4 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:02.417629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-84914c2e-8d50-4e2f-8d93-7681329f16a4 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:48:02.425162 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-84914c2e-8d50-4e2f-8d93-7681329f16a4 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a" status: 200 len: 1361 microversion: 2.1 time: 0.152520 May 28 05:48:02.425747 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3880/7645] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:48:02 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:48:03.442486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c0aeba07-f43c-489f-89e5-fb2f140f8ac1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:03.443121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c0aeba07-f43c-489f-89e5-fb2f140f8ac1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:03.450160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c0aeba07-f43c-489f-89e5-fb2f140f8ac1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:03.450617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c0aeba07-f43c-489f-89e5-fb2f140f8ac1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:03.451427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c0aeba07-f43c-489f-89e5-fb2f140f8ac1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:03.451873 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c0aeba07-f43c-489f-89e5-fb2f140f8ac1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:03.579173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c0aeba07-f43c-489f-89e5-fb2f140f8ac1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:48:03.586711 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c0aeba07-f43c-489f-89e5-fb2f140f8ac1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a" status: 200 len: 1361 microversion: 2.1 time: 0.148750 May 28 05:48:03.587312 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3766/7646] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:48:03 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:48:04.603701 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e2f32a3e-f7f9-431a-9f8a-07469ed7240a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:04.604314 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e2f32a3e-f7f9-431a-9f8a-07469ed7240a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:04.611301 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2f32a3e-f7f9-431a-9f8a-07469ed7240a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:04.611752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2f32a3e-f7f9-431a-9f8a-07469ed7240a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:04.612542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2f32a3e-f7f9-431a-9f8a-07469ed7240a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:04.612982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e2f32a3e-f7f9-431a-9f8a-07469ed7240a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:04.740492 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-d5d47bd9-24eb-48db-a7e4-359efd793602 req-193ec7ff-3ae9-48bf-aaea-195775188807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99aad656-5afa-4a1e-a01d-aa566dbbde0a", "name": "network-vif-plugged", "status": "completed", "tag": "0ac01aae-20f4-4e3f-b854-f4ce1a496c09"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:48:04.745745 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e2f32a3e-f7f9-431a-9f8a-07469ed7240a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:48:04.750084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d5d47bd9-24eb-48db-a7e4-359efd793602 req-193ec7ff-3ae9-48bf-aaea-195775188807 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:04.750563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d5d47bd9-24eb-48db-a7e4-359efd793602 req-193ec7ff-3ae9-48bf-aaea-195775188807 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:04.752881 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e2f32a3e-f7f9-431a-9f8a-07469ed7240a tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a" status: 200 len: 1361 microversion: 2.1 time: 0.153143 May 28 05:48:04.753468 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3881/7647] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:48:04 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:48:04.763807 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-d5d47bd9-24eb-48db-a7e4-359efd793602 req-193ec7ff-3ae9-48bf-aaea-195775188807 service nova] Creating event network-vif-plugged:0ac01aae-20f4-4e3f-b854-f4ce1a496c09 for instance 99aad656-5afa-4a1e-a01d-aa566dbbde0a on n-h2-843700-1 May 28 05:48:04.768969 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-d5d47bd9-24eb-48db-a7e4-359efd793602 req-193ec7ff-3ae9-48bf-aaea-195775188807 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032844 May 28 05:48:04.769609 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3767/7648] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:48:05.770537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fd2e1c73-de62-4efc-a389-8cf5bcf6de61 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:05.771189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fd2e1c73-de62-4efc-a389-8cf5bcf6de61 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:05.774391 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:48:05.779459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd2e1c73-de62-4efc-a389-8cf5bcf6de61 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:05.779912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd2e1c73-de62-4efc-a389-8cf5bcf6de61 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:05.780678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd2e1c73-de62-4efc-a389-8cf5bcf6de61 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:05.781123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fd2e1c73-de62-4efc-a389-8cf5bcf6de61 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:05.785581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:48:05.913186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fd2e1c73-de62-4efc-a389-8cf5bcf6de61 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:48:05.921370 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fd2e1c73-de62-4efc-a389-8cf5bcf6de61 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a" status: 200 len: 1361 microversion: 2.1 time: 0.154731 May 28 05:48:05.921949 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3882/7649] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:48:05 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:48:06.942810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:48:06.947103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-532ddde4-5fde-4cdc-9e6c-88f39b9b07a8 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:06.947815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-532ddde4-5fde-4cdc-9e6c-88f39b9b07a8 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:06.954232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-532ddde4-5fde-4cdc-9e6c-88f39b9b07a8 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:06.954699 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-532ddde4-5fde-4cdc-9e6c-88f39b9b07a8 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:06.955501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-532ddde4-5fde-4cdc-9e6c-88f39b9b07a8 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:06.955950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-532ddde4-5fde-4cdc-9e6c-88f39b9b07a8 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:07.094224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-532ddde4-5fde-4cdc-9e6c-88f39b9b07a8 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:48:07.102556 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-532ddde4-5fde-4cdc-9e6c-88f39b9b07a8 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a" status: 200 len: 1553 microversion: 2.1 time: 0.162286 May 28 05:48:07.103202 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3768/7650] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:48:06 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:48:07.120330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8f17b8b7-3e2e-4819-9e87-fa851822e2a9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:07.120882 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8f17b8b7-3e2e-4819-9e87-fa851822e2a9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:07.127021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:48:07.127021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:48:07.131569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f17b8b7-3e2e-4819-9e87-fa851822e2a9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:07.132146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f17b8b7-3e2e-4819-9e87-fa851822e2a9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:07.132925 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f17b8b7-3e2e-4819-9e87-fa851822e2a9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:07.133373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f17b8b7-3e2e-4819-9e87-fa851822e2a9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:07.262893 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8f17b8b7-3e2e-4819-9e87-fa851822e2a9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:48:07.271085 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8f17b8b7-3e2e-4819-9e87-fa851822e2a9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a" status: 200 len: 1553 microversion: 2.1 time: 0.155391 May 28 05:48:07.271667 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3883/7651] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:48:07 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:48:10.304181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1283d29a-3152-447d-bd09-4f2d0976b224 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bd00c59-86a2-47a3-b18c-08c09b0f2458"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:48:10.305260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1283d29a-3152-447d-bd09-4f2d0976b224 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:10.308054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:48:10.312808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1283d29a-3152-447d-bd09-4f2d0976b224 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:10.313247 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1283d29a-3152-447d-bd09-4f2d0976b224 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:10.314014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1283d29a-3152-447d-bd09-4f2d0976b224 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:10.314461 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1283d29a-3152-447d-bd09-4f2d0976b224 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:10.318587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=75 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:48:11.086951 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1283d29a-3152-447d-bd09-4f2d0976b224 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "POST /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.786579 May 28 05:48:11.087610 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3769/7652] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 05:48:10 2022] POST /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments => generated 194 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:48:28.072725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5c14f449-e803-408d-ac98-344849500204 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:28.073759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5c14f449-e803-408d-ac98-344849500204 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:28.080747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c14f449-e803-408d-ac98-344849500204 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:28.081347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c14f449-e803-408d-ac98-344849500204 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:28.082373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c14f449-e803-408d-ac98-344849500204 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:28.082824 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c14f449-e803-408d-ac98-344849500204 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:28.167252 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-5c14f449-e803-408d-ac98-344849500204 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lazy-loading 'services' on Instance uuid 99aad656-5afa-4a1e-a01d-aa566dbbde0a {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:48:28.357917 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5c14f449-e803-408d-ac98-344849500204 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "DELETE /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments/7bd00c59-86a2-47a3-b18c-08c09b0f2458" status: 202 len: 0 microversion: 2.1 time: 0.289982 May 28 05:48:28.358554 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3884/7653] 10.222.0.58 () {58 vars in 1415 bytes} [Sat May 28 05:48:28 2022] DELETE /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments/7bd00c59-86a2-47a3-b18c-08c09b0f2458 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:48:28.368329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e4f0536f-9b2e-4a90-a165-9c19bd4d0d70 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:28.369458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e4f0536f-9b2e-4a90-a165-9c19bd4d0d70 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:28.372176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:48:28.372872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:48:28.377878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4f0536f-9b2e-4a90-a165-9c19bd4d0d70 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:28.379297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4f0536f-9b2e-4a90-a165-9c19bd4d0d70 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:28.380107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4f0536f-9b2e-4a90-a165-9c19bd4d0d70 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:28.380809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4f0536f-9b2e-4a90-a165-9c19bd4d0d70 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:28.411204 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e4f0536f-9b2e-4a90-a165-9c19bd4d0d70 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047483 May 28 05:48:28.411762 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3770/7654] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:48:28 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:48:29.424594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-01e25ddb-05c7-4ee6-8382-369e76d56a3f tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:29.427587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-01e25ddb-05c7-4ee6-8382-369e76d56a3f tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:29.433998 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01e25ddb-05c7-4ee6-8382-369e76d56a3f tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:29.434453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01e25ddb-05c7-4ee6-8382-369e76d56a3f tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:29.435265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01e25ddb-05c7-4ee6-8382-369e76d56a3f tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:29.435704 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-01e25ddb-05c7-4ee6-8382-369e76d56a3f tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:29.466131 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-01e25ddb-05c7-4ee6-8382-369e76d56a3f tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046841 May 28 05:48:29.467098 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3885/7655] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:48:29 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:48:30.478885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-11ac87de-b68f-4be4-9017-59b93e7d3274 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:30.479898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-11ac87de-b68f-4be4-9017-59b93e7d3274 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:30.487883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11ac87de-b68f-4be4-9017-59b93e7d3274 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:30.488350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11ac87de-b68f-4be4-9017-59b93e7d3274 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:30.489165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11ac87de-b68f-4be4-9017-59b93e7d3274 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:30.489616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11ac87de-b68f-4be4-9017-59b93e7d3274 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:30.522011 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-11ac87de-b68f-4be4-9017-59b93e7d3274 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047333 May 28 05:48:30.522824 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3771/7656] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:48:30 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:48:31.533932 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2c384873-6bbb-4b35-b51c-fbc23d767dd6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:31.535302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2c384873-6bbb-4b35-b51c-fbc23d767dd6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:31.542395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c384873-6bbb-4b35-b51c-fbc23d767dd6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:31.542857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c384873-6bbb-4b35-b51c-fbc23d767dd6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:31.543675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c384873-6bbb-4b35-b51c-fbc23d767dd6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:31.544121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2c384873-6bbb-4b35-b51c-fbc23d767dd6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:31.573972 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2c384873-6bbb-4b35-b51c-fbc23d767dd6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044196 May 28 05:48:31.574555 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3886/7657] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:48:31 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:48:32.586727 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b922b3a0-ee8a-4679-9c2c-21bc72f305a6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:32.587849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b922b3a0-ee8a-4679-9c2c-21bc72f305a6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:32.597043 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b922b3a0-ee8a-4679-9c2c-21bc72f305a6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:32.603024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b922b3a0-ee8a-4679-9c2c-21bc72f305a6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:32.603024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b922b3a0-ee8a-4679-9c2c-21bc72f305a6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:32.603024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b922b3a0-ee8a-4679-9c2c-21bc72f305a6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:32.629869 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b922b3a0-ee8a-4679-9c2c-21bc72f305a6 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048182 May 28 05:48:32.630711 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3772/7658] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:48:32 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:48:33.641808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3f07714b-4972-4a4a-b71a-3e07e9df8665 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:33.642763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3f07714b-4972-4a4a-b71a-3e07e9df8665 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:33.649700 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f07714b-4972-4a4a-b71a-3e07e9df8665 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:33.650150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f07714b-4972-4a4a-b71a-3e07e9df8665 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:33.650908 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f07714b-4972-4a4a-b71a-3e07e9df8665 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:33.651368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f07714b-4972-4a4a-b71a-3e07e9df8665 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:33.680612 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3f07714b-4972-4a4a-b71a-3e07e9df8665 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042897 May 28 05:48:33.681170 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3887/7659] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:48:33 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:48:34.693403 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f2930013-3761-4bf4-8308-2d7bf56cf6a9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:34.694392 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f2930013-3761-4bf4-8308-2d7bf56cf6a9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:34.701912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2930013-3761-4bf4-8308-2d7bf56cf6a9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:34.702379 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2930013-3761-4bf4-8308-2d7bf56cf6a9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:34.703205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2930013-3761-4bf4-8308-2d7bf56cf6a9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:34.703666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f2930013-3761-4bf4-8308-2d7bf56cf6a9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:34.733130 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f2930013-3761-4bf4-8308-2d7bf56cf6a9 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044856 May 28 05:48:34.733704 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3773/7660] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:48:34 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:48:35.745223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2bb122a0-5b3a-42f7-aa0d-d268220b1c16 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:35.746172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2bb122a0-5b3a-42f7-aa0d-d268220b1c16 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:35.753964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bb122a0-5b3a-42f7-aa0d-d268220b1c16 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:35.754482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bb122a0-5b3a-42f7-aa0d-d268220b1c16 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:35.755568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bb122a0-5b3a-42f7-aa0d-d268220b1c16 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:35.756013 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2bb122a0-5b3a-42f7-aa0d-d268220b1c16 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:35.788020 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2bb122a0-5b3a-42f7-aa0d-d268220b1c16 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046962 May 28 05:48:35.788633 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3888/7661] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:48:35 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:48:36.800295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-aa36905d-d181-4fa2-831a-ba3eb2f9b3f1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:36.801253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-aa36905d-d181-4fa2-831a-ba3eb2f9b3f1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:36.808209 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa36905d-d181-4fa2-831a-ba3eb2f9b3f1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:36.808686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa36905d-d181-4fa2-831a-ba3eb2f9b3f1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:36.809477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa36905d-d181-4fa2-831a-ba3eb2f9b3f1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:36.809935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-aa36905d-d181-4fa2-831a-ba3eb2f9b3f1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:36.839064 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-aa36905d-d181-4fa2-831a-ba3eb2f9b3f1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043331 May 28 05:48:36.839640 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3774/7662] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:48:36 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:48:37.849948 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-14954ddc-19f2-45de-b898-1b243f6665e1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:37.850906 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-14954ddc-19f2-45de-b898-1b243f6665e1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:37.857740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14954ddc-19f2-45de-b898-1b243f6665e1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:37.858190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14954ddc-19f2-45de-b898-1b243f6665e1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:37.858955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14954ddc-19f2-45de-b898-1b243f6665e1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:37.859420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-14954ddc-19f2-45de-b898-1b243f6665e1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:37.889424 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-14954ddc-19f2-45de-b898-1b243f6665e1 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043625 May 28 05:48:37.889990 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3889/7663] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:48:37 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 05:48:37.899905 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-252e2726-acc5-44e8-bfe1-1ecccc227e02 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:37.900452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-252e2726-acc5-44e8-bfe1-1ecccc227e02 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:37.907410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-252e2726-acc5-44e8-bfe1-1ecccc227e02 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:37.907884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-252e2726-acc5-44e8-bfe1-1ecccc227e02 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:37.908670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-252e2726-acc5-44e8-bfe1-1ecccc227e02 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:37.909127 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-252e2726-acc5-44e8-bfe1-1ecccc227e02 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:37.985200 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-252e2726-acc5-44e8-bfe1-1ecccc227e02 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] HTTP exception thrown: Instance 99aad656-5afa-4a1e-a01d-aa566dbbde0a is not attached to volume 7bd00c59-86a2-47a3-b18c-08c09b0f2458 May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-252e2726-acc5-44e8-bfe1-1ecccc227e02 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Request method failure captured: May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: request: DELETE /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments/7bd00c59-86a2-47a3-b18c-08c09b0f2458 HTTP/1.1 May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbdNTySfVVFqZM85g3hn-XBKhpF70oC8rWjK7A5Z034PBUChgkqFDWv2mtGCVvxkjRYSyF9l1B-O1Aa8I9FU4WfH_qfB8yf8o-7o0eAMbZ8zj0LJuSHe_JYG9OuKpGAaK5iwXP7hGU_rjgS749NxHZIy0Gg16fb2Eg8aSpwlEqRm3a4 May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 1776666c25b74b01a3dde1feedb6b29d May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1615336809 May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1776666c25b74b01a3dde1feedb6b29d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1776666c25b74b01a3dde1feedb6b29d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1776666c25b74b01a3dde1feedb6b29d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1776666c25b74b01a3dde1feedb6b29d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestEncryptedCinderVolumes-1615336809 May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 1776666c25b74b01a3dde1feedb6b29d May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1615336809 May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestEncryptedCinderVolumes-1615336809-project May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 14ce217e6d6a4c39aaf41c6637be7945 May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestEncryptedCinderVolumes-1615336809-project May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 99aad656-5afa-4a1e-a01d-aa566dbbde0a is not attached to volume 7bd00c59-86a2-47a3-b18c-08c09b0f2458 May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'server_id': '99aad656-5afa-4a1e-a01d-aa566dbbde0a', 'id': '7bd00c59-86a2-47a3-b18c-08c09b0f2458'} May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7bd00c59-86a2-47a3-b18c-08c09b0f2458. May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99aad656-5afa-4a1e-a01d-aa566dbbde0a is not attached to volume 7bd00c59-86a2-47a3-b18c-08c09b0f2458 May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:48:37.986872 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:48:37.992935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:48:37.992935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:48:37.992935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99aad656-5afa-4a1e-a01d-aa566dbbde0a is not attached to volume 7bd00c59-86a2-47a3-b18c-08c09b0f2458 May 28 05:48:37.992935 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:48:37.992935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-252e2726-acc5-44e8-bfe1-1ecccc227e02 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Returning 404 to user: Instance 99aad656-5afa-4a1e-a01d-aa566dbbde0a is not attached to volume 7bd00c59-86a2-47a3-b18c-08c09b0f2458 {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:48:37.992935 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-252e2726-acc5-44e8-bfe1-1ecccc227e02 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "DELETE /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments/7bd00c59-86a2-47a3-b18c-08c09b0f2458" status: 404 len: 154 microversion: 2.1 time: 0.093117 May 28 05:48:37.992935 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3775/7664] 10.222.0.58 () {58 vars in 1415 bytes} [Sat May 28 05:48:37 2022] DELETE /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a/os-volume_attachments/7bd00c59-86a2-47a3-b18c-08c09b0f2458 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:48:44.628547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9984fed7-9dc6-400d-bd5e-92f84b01fd93 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:44.638952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9984fed7-9dc6-400d-bd5e-92f84b01fd93 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:44.638952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9984fed7-9dc6-400d-bd5e-92f84b01fd93 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:44.638952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9984fed7-9dc6-400d-bd5e-92f84b01fd93 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:44.638952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9984fed7-9dc6-400d-bd5e-92f84b01fd93 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:44.638952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9984fed7-9dc6-400d-bd5e-92f84b01fd93 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:44.665842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9984fed7-9dc6-400d-bd5e-92f84b01fd93 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:48:44.945859 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9984fed7-9dc6-400d-bd5e-92f84b01fd93 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "DELETE /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a" status: 204 len: 0 microversion: 2.1 time: 0.321751 May 28 05:48:44.946464 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3890/7665] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:48:44 2022] DELETE /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 05:48:44.955895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4ef3ec13-dfe8-4062-a37f-b1a3e388b372 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:44.955895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4ef3ec13-dfe8-4062-a37f-b1a3e388b372 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:44.965394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4ef3ec13-dfe8-4062-a37f-b1a3e388b372 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:44.965866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4ef3ec13-dfe8-4062-a37f-b1a3e388b372 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:44.966658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4ef3ec13-dfe8-4062-a37f-b1a3e388b372 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:44.967148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4ef3ec13-dfe8-4062-a37f-b1a3e388b372 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:45.102531 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4ef3ec13-dfe8-4062-a37f-b1a3e388b372 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:48:45.110487 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4ef3ec13-dfe8-4062-a37f-b1a3e388b372 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a" status: 200 len: 1559 microversion: 2.1 time: 0.159698 May 28 05:48:45.111080 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3776/7666] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:48:44 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:48:46.130009 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-70d92a19-3d9f-4db3-93d8-5ea1321944a3 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:46.130981 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-70d92a19-3d9f-4db3-93d8-5ea1321944a3 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:46.137771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70d92a19-3d9f-4db3-93d8-5ea1321944a3 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:46.138218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70d92a19-3d9f-4db3-93d8-5ea1321944a3 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:46.138980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70d92a19-3d9f-4db3-93d8-5ea1321944a3 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:46.139462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70d92a19-3d9f-4db3-93d8-5ea1321944a3 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:46.266506 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-70d92a19-3d9f-4db3-93d8-5ea1321944a3 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:48:46.273972 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-70d92a19-3d9f-4db3-93d8-5ea1321944a3 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a" status: 200 len: 1559 microversion: 2.1 time: 0.148888 May 28 05:48:46.274548 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3891/7667] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:48:46 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:48:46.899854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-56539095-e755-4fa3-924a-ddd483de1799 req-23d00f10-a09e-4974-b89d-b816e5b9927e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99aad656-5afa-4a1e-a01d-aa566dbbde0a", "name": "network-vif-deleted", "tag": "0ac01aae-20f4-4e3f-b854-f4ce1a496c09"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:48:46.909467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-56539095-e755-4fa3-924a-ddd483de1799 req-23d00f10-a09e-4974-b89d-b816e5b9927e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:46.909929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-56539095-e755-4fa3-924a-ddd483de1799 req-23d00f10-a09e-4974-b89d-b816e5b9927e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:46.920910 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-56539095-e755-4fa3-924a-ddd483de1799 req-23d00f10-a09e-4974-b89d-b816e5b9927e service nova] Creating event network-vif-deleted:0ac01aae-20f4-4e3f-b854-f4ce1a496c09 for instance 99aad656-5afa-4a1e-a01d-aa566dbbde0a on n-h2-843700-1 May 28 05:48:46.926450 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-56539095-e755-4fa3-924a-ddd483de1799 req-23d00f10-a09e-4974-b89d-b816e5b9927e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030374 May 28 05:48:46.927056 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3777/7668] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:48:47.292209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6f8573c7-8c70-459b-a746-424a7ccf27ae tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:47.292915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6f8573c7-8c70-459b-a746-424a7ccf27ae tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:47.300599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f8573c7-8c70-459b-a746-424a7ccf27ae tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:47.301050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f8573c7-8c70-459b-a746-424a7ccf27ae tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:47.301877 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f8573c7-8c70-459b-a746-424a7ccf27ae tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:47.302320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f8573c7-8c70-459b-a746-424a7ccf27ae tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:47.338142 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f8573c7-8c70-459b-a746-424a7ccf27ae tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:47.338598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f8573c7-8c70-459b-a746-424a7ccf27ae tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:47.339074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-6f8573c7-8c70-459b-a746-424a7ccf27ae tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lazy-loading 'fault' on Instance uuid 99aad656-5afa-4a1e-a01d-aa566dbbde0a {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:48:47.380368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6f8573c7-8c70-459b-a746-424a7ccf27ae tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce217e6d6a4c39aaf41c6637be7945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776666c25b74b01a3dde1feedb6b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:48:47.388418 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6f8573c7-8c70-459b-a746-424a7ccf27ae tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a" status: 200 len: 1351 microversion: 2.1 time: 0.100203 May 28 05:48:47.389013 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3892/7669] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:48:47 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:48:48.406377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c3bf7744-019f-4f0d-b03f-17ef216cf4ba tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:48.407115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c3bf7744-019f-4f0d-b03f-17ef216cf4ba tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] [instance: 99aad656-5afa-4a1e-a01d-aa566dbbde0a] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:48:48.415032 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3bf7744-019f-4f0d-b03f-17ef216cf4ba tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:48.415503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3bf7744-019f-4f0d-b03f-17ef216cf4ba tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:48.416277 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3bf7744-019f-4f0d-b03f-17ef216cf4ba tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:48:48.416725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3bf7744-019f-4f0d-b03f-17ef216cf4ba tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:48:48.429916 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-c3bf7744-019f-4f0d-b03f-17ef216cf4ba tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] HTTP exception thrown: Instance 99aad656-5afa-4a1e-a01d-aa566dbbde0a could not be found. May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c3bf7744-019f-4f0d-b03f-17ef216cf4ba tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Request method failure captured: May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a HTTP/1.1 May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbdNTySfVVFqZM85g3hn-XBKhpF70oC8rWjK7A5Z034PBUChgkqFDWv2mtGCVvxkjRYSyF9l1B-O1Aa8I9FU4WfH_qfB8yf8o-7o0eAMbZ8zj0LJuSHe_JYG9OuKpGAaK5iwXP7hGU_rjgS749NxHZIy0Gg16fb2Eg8aSpwlEqRm3a4 May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 1776666c25b74b01a3dde1feedb6b29d May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1615336809 May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1776666c25b74b01a3dde1feedb6b29d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1776666c25b74b01a3dde1feedb6b29d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1776666c25b74b01a3dde1feedb6b29d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1776666c25b74b01a3dde1feedb6b29d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestEncryptedCinderVolumes-1615336809 May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 1776666c25b74b01a3dde1feedb6b29d May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1615336809 May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestEncryptedCinderVolumes-1615336809-project May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 14ce217e6d6a4c39aaf41c6637be7945 May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestEncryptedCinderVolumes-1615336809-project May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 99aad656-5afa-4a1e-a01d-aa566dbbde0a could not be found. May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '99aad656-5afa-4a1e-a01d-aa566dbbde0a'} May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99aad656-5afa-4a1e-a01d-aa566dbbde0a could not be found. May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99aad656-5afa-4a1e-a01d-aa566dbbde0a could not be found. May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:48:48.431622 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:48:48.436725 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:48:48.436725 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:48:48.436725 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:48:48.436725 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:48:48.436725 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:48:48.436725 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99aad656-5afa-4a1e-a01d-aa566dbbde0a could not be found. May 28 05:48:48.436725 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:48:48.436725 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c3bf7744-019f-4f0d-b03f-17ef216cf4ba tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Returning 404 to user: Instance 99aad656-5afa-4a1e-a01d-aa566dbbde0a could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:48:48.436725 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c3bf7744-019f-4f0d-b03f-17ef216cf4ba tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a" status: 404 len: 111 microversion: 2.1 time: 0.030976 May 28 05:48:48.436725 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3778/7670] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:48:48 2022] GET /compute/v2.1/servers/99aad656-5afa-4a1e-a01d-aa566dbbde0a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:48:48.442665 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0e601a7f-a06d-4da5-afd2-910d6f56bbe2 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] Calling method '.version_select at 0x7f77006a8280>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:48:48.524944 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0e601a7f-a06d-4da5-afd2-910d6f56bbe2 tempest-TestEncryptedCinderVolumes-1615336809 tempest-TestEncryptedCinderVolumes-1615336809-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-148207483" status: 202 len: 0 microversion: 2.1 time: 0.085850 May 28 05:48:48.526288 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3893/7671] 10.222.0.58 () {58 vars in 1274 bytes} [Sat May 28 05:48:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-148207483 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:49:21.233879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f1522381-f410-4232-a9c1-b9f205468cc0 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Action: 'create', calling method: .version_select at 0x7f770005caf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-95862361", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcbj/J+FYwLGsB+jDPCx9lpYOd02f+hxxUr4RQtN1xExSc20pe8qTr68GbwcLAZy7MNYscifEkFUdk2hYvFcyW5YJyY+mr40dmd/+EUhV6xYX4Pcfk2hKrTKeOX69TMdw=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:49:21.238777 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=18 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:49:21.239533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=46 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:49:21.250367 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-f1522381-f410-4232-a9c1-b9f205468cc0 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Getting quotas for project 40dae26039054295a42b99499d295422. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:49:21.258691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-f1522381-f410-4232-a9c1-b9f205468cc0 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Getting quotas for user da57a2356ffa4f008b3745da3835a344 and project 40dae26039054295a42b99499d295422. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:49:21.337279 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f1522381-f410-4232-a9c1-b9f205468cc0 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.107435 May 28 05:49:21.337926 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3779/7672] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 05:49:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:49:21.383241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:49:21.383974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:49:21.387850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b0ac87a0-9d26-45b7-8317-02a58c80f540 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1019230534", "imageRef": "3c8be41a-72ed-416a-a10c-1b4eecbe3d4a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-95862361", "networks": [{"uuid": "d53a471a-7ce3-408f-ba2e-2df9fecbbd02"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:49:21.439266 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-b0ac87a0-9d26-45b7-8317-02a58c80f540 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] validate_networks() for [('d53a471a-7ce3-408f-ba2e-2df9fecbbd02', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:49:21.802103 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-b0ac87a0-9d26-45b7-8317-02a58c80f540 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:49:21.802535 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-b0ac87a0-9d26-45b7-8317-02a58c80f540 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:49:21.803045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-b0ac87a0-9d26-45b7-8317-02a58c80f540 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:49:21.803465 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-b0ac87a0-9d26-45b7-8317-02a58c80f540 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:49:21.803884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-b0ac87a0-9d26-45b7-8317-02a58c80f540 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:49:21.813174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0ac87a0-9d26-45b7-8317-02a58c80f540 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:21.813637 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0ac87a0-9d26-45b7-8317-02a58c80f540 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:21.814454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0ac87a0-9d26-45b7-8317-02a58c80f540 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:21.814934 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b0ac87a0-9d26-45b7-8317-02a58c80f540 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:21.832365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-b0ac87a0-9d26-45b7-8317-02a58c80f540 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Getting quotas for project 40dae26039054295a42b99499d295422. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:49:21.837772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-b0ac87a0-9d26-45b7-8317-02a58c80f540 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Getting quotas for user da57a2356ffa4f008b3745da3835a344 and project 40dae26039054295a42b99499d295422. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:49:21.850033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b0ac87a0-9d26-45b7-8317-02a58c80f540 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:49:21.852258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b0ac87a0-9d26-45b7-8317-02a58c80f540 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c8be41a-72ed-416a-a10c-1b4eecbe3d4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:49:21.980191 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b0ac87a0-9d26-45b7-8317-02a58c80f540 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599022 May 28 05:49:21.980929 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3894/7673] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:49:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:49:21.992483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9469d075-9371-4fa4-9ef2-0ca200c6280b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:21.993114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9469d075-9371-4fa4-9ef2-0ca200c6280b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:22.046283 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9469d075-9371-4fa4-9ef2-0ca200c6280b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:22.053663 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9469d075-9371-4fa4-9ef2-0ca200c6280b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1257 microversion: 2.1 time: 0.066674 May 28 05:49:22.054186 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3780/7674] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:49:21 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:49:23.071511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0dcc2af2-bdbe-409f-b2e8-46e9f5bf3ffd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:23.072138 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0dcc2af2-bdbe-409f-b2e8-46e9f5bf3ffd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:23.124583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0dcc2af2-bdbe-409f-b2e8-46e9f5bf3ffd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:23.132625 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0dcc2af2-bdbe-409f-b2e8-46e9f5bf3ffd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1257 microversion: 2.1 time: 0.066714 May 28 05:49:23.133201 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3895/7675] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:49:23 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:49:24.150109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-67f1464c-3b1f-46d7-966e-67e690af80b0 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:24.150763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-67f1464c-3b1f-46d7-966e-67e690af80b0 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:24.208155 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-67f1464c-3b1f-46d7-966e-67e690af80b0 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:24.215626 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-67f1464c-3b1f-46d7-966e-67e690af80b0 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1257 microversion: 2.1 time: 0.069392 May 28 05:49:24.216187 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3781/7676] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:49:24 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1257 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:49:25.233323 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6a3404cf-a7d9-497a-a3f3-a71971745a97 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:25.234050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6a3404cf-a7d9-497a-a3f3-a71971745a97 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:25.241134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a3404cf-a7d9-497a-a3f3-a71971745a97 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:25.241596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a3404cf-a7d9-497a-a3f3-a71971745a97 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:25.242374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a3404cf-a7d9-497a-a3f3-a71971745a97 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:25.242832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6a3404cf-a7d9-497a-a3f3-a71971745a97 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:25.304397 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6a3404cf-a7d9-497a-a3f3-a71971745a97 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:25.312054 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6a3404cf-a7d9-497a-a3f3-a71971745a97 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1261 microversion: 2.1 time: 0.082901 May 28 05:49:25.312631 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3896/7677] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:49:25 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:49:26.329343 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-33b9a390-84c9-4c30-973d-077eb5979af8 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:26.329906 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-33b9a390-84c9-4c30-973d-077eb5979af8 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:26.337820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33b9a390-84c9-4c30-973d-077eb5979af8 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:26.338297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33b9a390-84c9-4c30-973d-077eb5979af8 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:26.339129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33b9a390-84c9-4c30-973d-077eb5979af8 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:26.339624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-33b9a390-84c9-4c30-973d-077eb5979af8 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:26.429017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-33b9a390-84c9-4c30-973d-077eb5979af8 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:26.436649 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-33b9a390-84c9-4c30-973d-077eb5979af8 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1315 microversion: 2.1 time: 0.111501 May 28 05:49:26.439345 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3782/7678] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:49:26 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1315 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:49:27.456162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e6b3a2e5-31f4-48e7-a2ea-d0848ccecf0b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:27.458343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e6b3a2e5-31f4-48e7-a2ea-d0848ccecf0b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:27.466830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e6b3a2e5-31f4-48e7-a2ea-d0848ccecf0b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:27.467329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e6b3a2e5-31f4-48e7-a2ea-d0848ccecf0b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:27.468110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e6b3a2e5-31f4-48e7-a2ea-d0848ccecf0b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:27.468550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e6b3a2e5-31f4-48e7-a2ea-d0848ccecf0b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:27.609051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e6b3a2e5-31f4-48e7-a2ea-d0848ccecf0b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:27.617836 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e6b3a2e5-31f4-48e7-a2ea-d0848ccecf0b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1357 microversion: 2.1 time: 0.166713 May 28 05:49:27.624165 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3897/7679] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:49:27 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:49:28.636381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bb1becf7-c50e-4249-a13b-5b2349f7201e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:28.637130 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bb1becf7-c50e-4249-a13b-5b2349f7201e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:28.656008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb1becf7-c50e-4249-a13b-5b2349f7201e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:28.656664 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb1becf7-c50e-4249-a13b-5b2349f7201e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:28.657580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb1becf7-c50e-4249-a13b-5b2349f7201e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:28.658113 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb1becf7-c50e-4249-a13b-5b2349f7201e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:28.808653 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bb1becf7-c50e-4249-a13b-5b2349f7201e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:28.816181 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bb1becf7-c50e-4249-a13b-5b2349f7201e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1357 microversion: 2.1 time: 0.183813 May 28 05:49:28.816757 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3783/7680] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:49:28 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:49:29.833633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c0d928eb-12d5-47be-9d50-d2bcbbf5a375 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:29.835223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c0d928eb-12d5-47be-9d50-d2bcbbf5a375 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:29.843107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0d928eb-12d5-47be-9d50-d2bcbbf5a375 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:29.844921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0d928eb-12d5-47be-9d50-d2bcbbf5a375 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:29.845939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0d928eb-12d5-47be-9d50-d2bcbbf5a375 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:29.846734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c0d928eb-12d5-47be-9d50-d2bcbbf5a375 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:29.992414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c0d928eb-12d5-47be-9d50-d2bcbbf5a375 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:30.001244 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c0d928eb-12d5-47be-9d50-d2bcbbf5a375 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1357 microversion: 2.1 time: 0.171772 May 28 05:49:30.002051 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3898/7681] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:49:29 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:49:31.019969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e2625a01-0f15-4233-8a9e-9e953e9c3745 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:31.021508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e2625a01-0f15-4233-8a9e-9e953e9c3745 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:31.029381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2625a01-0f15-4233-8a9e-9e953e9c3745 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:31.029928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2625a01-0f15-4233-8a9e-9e953e9c3745 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:31.031137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2625a01-0f15-4233-8a9e-9e953e9c3745 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:31.031486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2625a01-0f15-4233-8a9e-9e953e9c3745 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:31.179574 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e2625a01-0f15-4233-8a9e-9e953e9c3745 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:31.187269 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e2625a01-0f15-4233-8a9e-9e953e9c3745 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1357 microversion: 2.1 time: 0.171546 May 28 05:49:31.187851 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3784/7682] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:49:31 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:49:32.205076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8621cac9-1556-44b7-b098-11e61733ff5e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:32.205766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8621cac9-1556-44b7-b098-11e61733ff5e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:32.209062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:49:32.214186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8621cac9-1556-44b7-b098-11e61733ff5e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:32.214649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8621cac9-1556-44b7-b098-11e61733ff5e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:32.215537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8621cac9-1556-44b7-b098-11e61733ff5e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:32.215986 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8621cac9-1556-44b7-b098-11e61733ff5e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:32.350644 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8621cac9-1556-44b7-b098-11e61733ff5e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:32.358959 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8621cac9-1556-44b7-b098-11e61733ff5e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1357 microversion: 2.1 time: 0.157732 May 28 05:49:32.360280 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3899/7683] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:49:32 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:49:33.377039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ff7f4b3f-a79e-420e-8310-192700b2bce7 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:33.377600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ff7f4b3f-a79e-420e-8310-192700b2bce7 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:33.384923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff7f4b3f-a79e-420e-8310-192700b2bce7 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:33.385390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff7f4b3f-a79e-420e-8310-192700b2bce7 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:33.386171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff7f4b3f-a79e-420e-8310-192700b2bce7 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:33.386654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ff7f4b3f-a79e-420e-8310-192700b2bce7 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:33.543874 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ff7f4b3f-a79e-420e-8310-192700b2bce7 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:33.552439 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ff7f4b3f-a79e-420e-8310-192700b2bce7 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1357 microversion: 2.1 time: 0.179317 May 28 05:49:33.553269 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3785/7684] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:49:33 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:49:34.572075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cf4c4103-432d-4b9e-a212-8a1c4c6c7b46 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:34.572902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cf4c4103-432d-4b9e-a212-8a1c4c6c7b46 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:34.576086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=8 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:49:34.581158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf4c4103-432d-4b9e-a212-8a1c4c6c7b46 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:34.582242 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf4c4103-432d-4b9e-a212-8a1c4c6c7b46 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:34.582970 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf4c4103-432d-4b9e-a212-8a1c4c6c7b46 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:34.583440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf4c4103-432d-4b9e-a212-8a1c4c6c7b46 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:34.750078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cf4c4103-432d-4b9e-a212-8a1c4c6c7b46 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:34.758045 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cf4c4103-432d-4b9e-a212-8a1c4c6c7b46 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1357 microversion: 2.1 time: 0.190441 May 28 05:49:34.758918 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3900/7685] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:49:34 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:49:34.834946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-aa388d8a-1a7b-4cc9-b85f-07cf9f2563a5 req-6532a41d-9b1b-4801-ac5e-fd28068e11a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e5a5165-7cd4-4efc-804d-a5b154916c41", "tag": "2c829991-04d1-45d7-acce-5fd2dd21988f"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:49:34.839923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=8 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:49:34.845879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-aa388d8a-1a7b-4cc9-b85f-07cf9f2563a5 req-6532a41d-9b1b-4801-ac5e-fd28068e11a3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:34.848330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-aa388d8a-1a7b-4cc9-b85f-07cf9f2563a5 req-6532a41d-9b1b-4801-ac5e-fd28068e11a3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:34.858404 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-aa388d8a-1a7b-4cc9-b85f-07cf9f2563a5 req-6532a41d-9b1b-4801-ac5e-fd28068e11a3 service nova] Creating event network-changed:2c829991-04d1-45d7-acce-5fd2dd21988f for instance 3e5a5165-7cd4-4efc-804d-a5b154916c41 on n-h1-843700-1 May 28 05:49:34.863543 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-aa388d8a-1a7b-4cc9-b85f-07cf9f2563a5 req-6532a41d-9b1b-4801-ac5e-fd28068e11a3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033710 May 28 05:49:34.864163 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3786/7686] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:49:35.775121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-da2d8d2d-7715-4521-82ee-8dd609afe53b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:35.775659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-da2d8d2d-7715-4521-82ee-8dd609afe53b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:35.782497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da2d8d2d-7715-4521-82ee-8dd609afe53b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:35.782954 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da2d8d2d-7715-4521-82ee-8dd609afe53b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:35.783736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da2d8d2d-7715-4521-82ee-8dd609afe53b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:35.784168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da2d8d2d-7715-4521-82ee-8dd609afe53b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:35.911422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-da2d8d2d-7715-4521-82ee-8dd609afe53b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:35.918926 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-da2d8d2d-7715-4521-82ee-8dd609afe53b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1357 microversion: 2.1 time: 0.147770 May 28 05:49:35.919539 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3901/7687] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:49:35 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:49:36.938489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6b55219f-b6e7-4364-8abb-73d45feee7b1 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:36.939280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6b55219f-b6e7-4364-8abb-73d45feee7b1 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:36.946322 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b55219f-b6e7-4364-8abb-73d45feee7b1 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:36.946792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b55219f-b6e7-4364-8abb-73d45feee7b1 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:36.947589 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b55219f-b6e7-4364-8abb-73d45feee7b1 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:36.948039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6b55219f-b6e7-4364-8abb-73d45feee7b1 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:37.077333 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6b55219f-b6e7-4364-8abb-73d45feee7b1 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:37.084837 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6b55219f-b6e7-4364-8abb-73d45feee7b1 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1357 microversion: 2.1 time: 0.151893 May 28 05:49:37.085412 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3787/7688] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:49:36 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:49:38.102137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1b1acf48-9106-4ae1-9c2f-badf07991616 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:38.102749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1b1acf48-9106-4ae1-9c2f-badf07991616 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:38.109725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b1acf48-9106-4ae1-9c2f-badf07991616 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:38.110174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b1acf48-9106-4ae1-9c2f-badf07991616 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:38.110935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b1acf48-9106-4ae1-9c2f-badf07991616 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:38.111406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b1acf48-9106-4ae1-9c2f-badf07991616 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:38.242122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1b1acf48-9106-4ae1-9c2f-badf07991616 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:38.249588 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1b1acf48-9106-4ae1-9c2f-badf07991616 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1357 microversion: 2.1 time: 0.151348 May 28 05:49:38.250168 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3902/7689] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:49:38 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:49:39.267477 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0f22f8bf-b39d-4a57-8490-b419ef6589bd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:39.268108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0f22f8bf-b39d-4a57-8490-b419ef6589bd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:39.275111 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f22f8bf-b39d-4a57-8490-b419ef6589bd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:39.275584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f22f8bf-b39d-4a57-8490-b419ef6589bd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:39.276368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f22f8bf-b39d-4a57-8490-b419ef6589bd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:39.276824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0f22f8bf-b39d-4a57-8490-b419ef6589bd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:39.683898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0f22f8bf-b39d-4a57-8490-b419ef6589bd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:39.691409 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0f22f8bf-b39d-4a57-8490-b419ef6589bd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1357 microversion: 2.1 time: 0.427874 May 28 05:49:39.691999 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3788/7690] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:49:39 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1357 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:49:40.435493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-cbfcada9-3c1c-429e-86fd-b52c77e73cf1 req-06874843-b8c0-4d00-b6d9-8f4e0503f519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e5a5165-7cd4-4efc-804d-a5b154916c41", "name": "network-vif-plugged", "status": "completed", "tag": "2c829991-04d1-45d7-acce-5fd2dd21988f"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:49:40.445088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-cbfcada9-3c1c-429e-86fd-b52c77e73cf1 req-06874843-b8c0-4d00-b6d9-8f4e0503f519 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:40.445543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-cbfcada9-3c1c-429e-86fd-b52c77e73cf1 req-06874843-b8c0-4d00-b6d9-8f4e0503f519 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:40.456578 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-cbfcada9-3c1c-429e-86fd-b52c77e73cf1 req-06874843-b8c0-4d00-b6d9-8f4e0503f519 service nova] Creating event network-vif-plugged:2c829991-04d1-45d7-acce-5fd2dd21988f for instance 3e5a5165-7cd4-4efc-804d-a5b154916c41 on n-h1-843700-1 May 28 05:49:40.462027 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-cbfcada9-3c1c-429e-86fd-b52c77e73cf1 req-06874843-b8c0-4d00-b6d9-8f4e0503f519 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030362 May 28 05:49:40.465261 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3903/7691] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:49:40.708470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-16ba585d-9c95-4a71-88d6-2ff15555c73a tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:40.709029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-16ba585d-9c95-4a71-88d6-2ff15555c73a tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:40.716020 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16ba585d-9c95-4a71-88d6-2ff15555c73a tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:40.716496 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16ba585d-9c95-4a71-88d6-2ff15555c73a tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:40.717287 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16ba585d-9c95-4a71-88d6-2ff15555c73a tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:40.717742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-16ba585d-9c95-4a71-88d6-2ff15555c73a tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:40.845359 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-16ba585d-9c95-4a71-88d6-2ff15555c73a tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:40.853193 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-16ba585d-9c95-4a71-88d6-2ff15555c73a tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1357 microversion: 2.1 time: 0.148788 May 28 05:49:40.853767 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3789/7692] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:49:40 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:49:41.871063 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ab0021a1-27b7-412e-b7fd-d7f0f17cd2d3 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:41.871776 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ab0021a1-27b7-412e-b7fd-d7f0f17cd2d3 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:41.878077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab0021a1-27b7-412e-b7fd-d7f0f17cd2d3 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:41.878527 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab0021a1-27b7-412e-b7fd-d7f0f17cd2d3 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:41.879577 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab0021a1-27b7-412e-b7fd-d7f0f17cd2d3 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:41.880018 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ab0021a1-27b7-412e-b7fd-d7f0f17cd2d3 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:42.011872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ab0021a1-27b7-412e-b7fd-d7f0f17cd2d3 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:42.019424 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ab0021a1-27b7-412e-b7fd-d7f0f17cd2d3 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1547 microversion: 2.1 time: 0.153450 May 28 05:49:42.019999 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3904/7693] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:49:41 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:49:42.035423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-eb9b0f24-cf8b-4642-9e99-b3f643c09ea5 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:42.036065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-eb9b0f24-cf8b-4642-9e99-b3f643c09ea5 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:42.043120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb9b0f24-cf8b-4642-9e99-b3f643c09ea5 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:42.043598 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb9b0f24-cf8b-4642-9e99-b3f643c09ea5 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:42.044388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb9b0f24-cf8b-4642-9e99-b3f643c09ea5 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:42.044849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-eb9b0f24-cf8b-4642-9e99-b3f643c09ea5 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:42.171495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-eb9b0f24-cf8b-4642-9e99-b3f643c09ea5 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:42.179235 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-eb9b0f24-cf8b-4642-9e99-b3f643c09ea5 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1547 microversion: 2.1 time: 0.147690 May 28 05:49:42.179808 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3790/7694] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:49:42 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:49:42.194857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a3ecdc37-29ed-4d81-b722-e662972db236 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:42.198237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a3ecdc37-29ed-4d81-b722-e662972db236 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:42.199026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a3ecdc37-29ed-4d81-b722-e662972db236 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Searching by: {'deleted': False, 'project_id': '40dae26039054295a42b99499d295422'} {{(pid=126044) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 05:49:42.204413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3ecdc37-29ed-4d81-b722-e662972db236 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:42.204872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3ecdc37-29ed-4d81-b722-e662972db236 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:42.205715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3ecdc37-29ed-4d81-b722-e662972db236 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:42.206163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3ecdc37-29ed-4d81-b722-e662972db236 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:42.230650 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.multi_cell_list [None req-a3ecdc37-29ed-4d81-b722-e662972db236 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 05:49:42.256972 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a3ecdc37-29ed-4d81-b722-e662972db236 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.066023 May 28 05:49:42.257559 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3905/7695] 10.222.0.58 () {58 vars in 1124 bytes} [Sat May 28 05:49:42 2022] GET /compute/v2.1/servers => generated 343 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:49:42.267924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-17747a13-a328-4db6-80c0-ec65ea6147c3 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:49:42.268563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-17747a13-a328-4db6-80c0-ec65ea6147c3 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:42.275215 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17747a13-a328-4db6-80c0-ec65ea6147c3 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:42.275723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17747a13-a328-4db6-80c0-ec65ea6147c3 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:42.276516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17747a13-a328-4db6-80c0-ec65ea6147c3 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:42.276978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-17747a13-a328-4db6-80c0-ec65ea6147c3 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:42.403303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-17747a13-a328-4db6-80c0-ec65ea6147c3 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:49:42.410812 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-17747a13-a328-4db6-80c0-ec65ea6147c3 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1547 microversion: 2.1 time: 0.146786 May 28 05:49:42.411407 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3791/7696] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:49:42 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:49:45.289356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9041d698-aa1b-4edf-9f90-0344a8200a30 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8903063a-1c08-4b97-983c-392360a6c726"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:49:45.290418 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9041d698-aa1b-4edf-9f90-0344a8200a30 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:49:45.297325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9041d698-aa1b-4edf-9f90-0344a8200a30 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:45.297769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9041d698-aa1b-4edf-9f90-0344a8200a30 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:45.298545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9041d698-aa1b-4edf-9f90-0344a8200a30 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:49:45.298962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9041d698-aa1b-4edf-9f90-0344a8200a30 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:49:45.991042 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9041d698-aa1b-4edf-9f90-0344a8200a30 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "POST /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.706037 May 28 05:49:45.991683 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3906/7697] 10.222.0.58 () {60 vars in 1322 bytes} [Sat May 28 05:49:45 2022] POST /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments => generated 194 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:50:03.013490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-536c886b-73a9-4fb0-8c81-03f52fd592fa tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:50:03.014114 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-536c886b-73a9-4fb0-8c81-03f52fd592fa tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:50:03.016508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:50:03.017170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=56 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:50:03.021898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-536c886b-73a9-4fb0-8c81-03f52fd592fa tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:03.022365 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-536c886b-73a9-4fb0-8c81-03f52fd592fa tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:03.023228 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-536c886b-73a9-4fb0-8c81-03f52fd592fa tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:03.023680 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-536c886b-73a9-4fb0-8c81-03f52fd592fa tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:03.163809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-536c886b-73a9-4fb0-8c81-03f52fd592fa tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:50:03.171811 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-536c886b-73a9-4fb0-8c81-03f52fd592fa tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1593 microversion: 2.1 time: 0.162410 May 28 05:50:03.172382 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3792/7698] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:50:03 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1593 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:50:05.155403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:50:05.156943 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:50:05.157928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:50:05.312909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-5cec81c4-1105-474f-a0ed-cfea44118b27 req-ada9b884-ee40-467b-857e-c39a05e017ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e5a5165-7cd4-4efc-804d-a5b154916c41", "tag": "2c829991-04d1-45d7-acce-5fd2dd21988f"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:50:05.321862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5cec81c4-1105-474f-a0ed-cfea44118b27 req-ada9b884-ee40-467b-857e-c39a05e017ff service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:05.328919 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-5cec81c4-1105-474f-a0ed-cfea44118b27 req-ada9b884-ee40-467b-857e-c39a05e017ff service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:05.334692 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-5cec81c4-1105-474f-a0ed-cfea44118b27 req-ada9b884-ee40-467b-857e-c39a05e017ff service nova] Creating event network-changed:2c829991-04d1-45d7-acce-5fd2dd21988f for instance 3e5a5165-7cd4-4efc-804d-a5b154916c41 on n-h1-843700-1 May 28 05:50:05.341202 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-5cec81c4-1105-474f-a0ed-cfea44118b27 req-ada9b884-ee40-467b-857e-c39a05e017ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192077 May 28 05:50:05.342026 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3907/7699] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:50:07.523619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fbfbfb36-fed4-43e9-b0a6-2b3326dbbbfc tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1205842659"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:50:07.524184 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fbfbfb36-fed4-43e9-b0a6-2b3326dbbbfc tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:50:07.531759 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbfbfb36-fed4-43e9-b0a6-2b3326dbbbfc tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:07.532291 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbfbfb36-fed4-43e9-b0a6-2b3326dbbbfc tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:07.533084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbfbfb36-fed4-43e9-b0a6-2b3326dbbbfc tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:07.533549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fbfbfb36-fed4-43e9-b0a6-2b3326dbbbfc tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:07.668339 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.network.security_group_api [None req-fbfbfb36-fed4-43e9-b0a6-2b3326dbbbfc tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Adding security group bd82004e-0d65-4384-93e2-a45aa088391c to port 2c829991-04d1-45d7-acce-5fd2dd21988f May 28 05:50:08.129251 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fbfbfb36-fed4-43e9-b0a6-2b3326dbbbfc tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "POST /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/action" status: 202 len: 0 microversion: 2.1 time: 0.607487 May 28 05:50:08.133055 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3793/7700] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:50:07 2022] POST /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:50:08.144352 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-4bee98d3-3837-46a0-94d2-61afc11657f7 req-5f1521d6-00e2-4313-8f2d-23ddd67542ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e5a5165-7cd4-4efc-804d-a5b154916c41", "tag": "2c829991-04d1-45d7-acce-5fd2dd21988f"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:50:08.149684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-22175331-76ba-4d16-826b-9e74dbc2af4c tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:50:08.157844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-22175331-76ba-4d16-826b-9e74dbc2af4c tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:50:08.170626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22175331-76ba-4d16-826b-9e74dbc2af4c tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:08.171085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22175331-76ba-4d16-826b-9e74dbc2af4c tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:08.171881 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22175331-76ba-4d16-826b-9e74dbc2af4c tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:08.172327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22175331-76ba-4d16-826b-9e74dbc2af4c tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:08.175154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4bee98d3-3837-46a0-94d2-61afc11657f7 req-5f1521d6-00e2-4313-8f2d-23ddd67542ac service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:08.175770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4bee98d3-3837-46a0-94d2-61afc11657f7 req-5f1521d6-00e2-4313-8f2d-23ddd67542ac service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:08.192289 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-4bee98d3-3837-46a0-94d2-61afc11657f7 req-5f1521d6-00e2-4313-8f2d-23ddd67542ac service nova] Creating event network-changed:2c829991-04d1-45d7-acce-5fd2dd21988f for instance 3e5a5165-7cd4-4efc-804d-a5b154916c41 on n-h1-843700-1 May 28 05:50:08.199394 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-4bee98d3-3837-46a0-94d2-61afc11657f7 req-5f1521d6-00e2-4313-8f2d-23ddd67542ac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058663 May 28 05:50:08.200368 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3794/7701] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:50:08.452439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-22175331-76ba-4d16-826b-9e74dbc2af4c tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:50:08.461582 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-22175331-76ba-4d16-826b-9e74dbc2af4c tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1759 microversion: 2.1 time: 0.327112 May 28 05:50:08.462345 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3908/7702] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:50:08 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1759 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:50:15.988657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e344b389-50f7-4754-b329-1c8e059e5961 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:50:15.989723 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e344b389-50f7-4754-b329-1c8e059e5961 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:50:15.998320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e344b389-50f7-4754-b329-1c8e059e5961 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:15.998794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e344b389-50f7-4754-b329-1c8e059e5961 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:15.999617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e344b389-50f7-4754-b329-1c8e059e5961 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:16.000080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e344b389-50f7-4754-b329-1c8e059e5961 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:16.233493 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e344b389-50f7-4754-b329-1c8e059e5961 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "POST /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/action" status: 202 len: 0 microversion: 2.1 time: 0.248914 May 28 05:50:16.234149 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3795/7703] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:50:15 2022] POST /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:50:16.243742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e755eef2-f749-47ea-9a8f-f86715706139 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:50:16.243742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e755eef2-f749-47ea-9a8f-f86715706139 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:50:16.251054 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e755eef2-f749-47ea-9a8f-f86715706139 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:16.251518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e755eef2-f749-47ea-9a8f-f86715706139 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:16.252682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e755eef2-f749-47ea-9a8f-f86715706139 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:16.252757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e755eef2-f749-47ea-9a8f-f86715706139 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:16.454304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e755eef2-f749-47ea-9a8f-f86715706139 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:50:16.462877 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e755eef2-f749-47ea-9a8f-f86715706139 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1751 microversion: 2.1 time: 0.224428 May 28 05:50:16.463494 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3909/7704] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:50:16 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1751 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:50:17.481912 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-388c6162-32af-4b8e-af7d-16e96e5048aa tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:50:17.482671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-388c6162-32af-4b8e-af7d-16e96e5048aa tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:50:17.489812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-388c6162-32af-4b8e-af7d-16e96e5048aa tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:17.490282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-388c6162-32af-4b8e-af7d-16e96e5048aa tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:17.491588 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-388c6162-32af-4b8e-af7d-16e96e5048aa tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:17.492049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-388c6162-32af-4b8e-af7d-16e96e5048aa tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:17.641151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-388c6162-32af-4b8e-af7d-16e96e5048aa tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:50:17.649263 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-388c6162-32af-4b8e-af7d-16e96e5048aa tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1756 microversion: 2.1 time: 0.172549 May 28 05:50:17.649843 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3796/7705] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:50:17 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:50:18.667767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dc8febd0-45e2-476d-885a-c1aad34ea700 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:50:18.668401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dc8febd0-45e2-476d-885a-c1aad34ea700 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:50:18.675507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc8febd0-45e2-476d-885a-c1aad34ea700 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:18.675965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc8febd0-45e2-476d-885a-c1aad34ea700 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:18.676741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc8febd0-45e2-476d-885a-c1aad34ea700 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:18.677184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dc8febd0-45e2-476d-885a-c1aad34ea700 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:18.817471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dc8febd0-45e2-476d-885a-c1aad34ea700 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:50:18.826180 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dc8febd0-45e2-476d-885a-c1aad34ea700 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1756 microversion: 2.1 time: 0.163104 May 28 05:50:18.826766 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3910/7706] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:50:18 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:50:19.843591 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-750b578a-976f-42ca-a28f-eb80dc6419dd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:50:19.844217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-750b578a-976f-42ca-a28f-eb80dc6419dd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:50:19.851690 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-750b578a-976f-42ca-a28f-eb80dc6419dd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:19.852177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-750b578a-976f-42ca-a28f-eb80dc6419dd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:19.852948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-750b578a-976f-42ca-a28f-eb80dc6419dd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:19.853396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-750b578a-976f-42ca-a28f-eb80dc6419dd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:19.993561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-750b578a-976f-42ca-a28f-eb80dc6419dd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:50:20.001670 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-750b578a-976f-42ca-a28f-eb80dc6419dd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1756 microversion: 2.1 time: 0.161958 May 28 05:50:20.002251 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3797/7707] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:50:19 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:50:21.021019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b66f67f5-55c2-4fc7-9c07-b2674a976fba tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:50:21.021683 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b66f67f5-55c2-4fc7-9c07-b2674a976fba tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:50:21.028568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b66f67f5-55c2-4fc7-9c07-b2674a976fba tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:21.029025 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b66f67f5-55c2-4fc7-9c07-b2674a976fba tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:21.029792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b66f67f5-55c2-4fc7-9c07-b2674a976fba tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:21.030235 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b66f67f5-55c2-4fc7-9c07-b2674a976fba tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:21.175489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b66f67f5-55c2-4fc7-9c07-b2674a976fba tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:50:21.184014 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b66f67f5-55c2-4fc7-9c07-b2674a976fba tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1756 microversion: 2.1 time: 0.166951 May 28 05:50:21.184595 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3911/7708] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:50:21 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:50:22.201690 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-966bed3d-de5e-4440-bdbe-3d04348459b9 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:50:22.202330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-966bed3d-de5e-4440-bdbe-3d04348459b9 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:50:22.208667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-966bed3d-de5e-4440-bdbe-3d04348459b9 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:22.209134 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-966bed3d-de5e-4440-bdbe-3d04348459b9 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:22.210530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-966bed3d-de5e-4440-bdbe-3d04348459b9 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:22.210978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-966bed3d-de5e-4440-bdbe-3d04348459b9 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:22.349979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-966bed3d-de5e-4440-bdbe-3d04348459b9 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:50:22.357991 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-966bed3d-de5e-4440-bdbe-3d04348459b9 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1756 microversion: 2.1 time: 0.160579 May 28 05:50:22.358568 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3798/7709] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:50:22 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:50:23.375293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4e38553c-ecda-4aa8-8dbd-c0ab26c0a0ed tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:50:23.375848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4e38553c-ecda-4aa8-8dbd-c0ab26c0a0ed tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:50:23.383123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e38553c-ecda-4aa8-8dbd-c0ab26c0a0ed tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:23.383582 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e38553c-ecda-4aa8-8dbd-c0ab26c0a0ed tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:23.384347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e38553c-ecda-4aa8-8dbd-c0ab26c0a0ed tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:23.384785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4e38553c-ecda-4aa8-8dbd-c0ab26c0a0ed tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:23.528518 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4e38553c-ecda-4aa8-8dbd-c0ab26c0a0ed tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:50:23.536168 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4e38553c-ecda-4aa8-8dbd-c0ab26c0a0ed tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1756 microversion: 2.1 time: 0.164922 May 28 05:50:23.536746 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3912/7710] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:50:23 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:50:24.554320 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9d07f5a1-748c-4fef-8632-eff4c76d1b24 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:50:24.554957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9d07f5a1-748c-4fef-8632-eff4c76d1b24 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:50:24.562549 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d07f5a1-748c-4fef-8632-eff4c76d1b24 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:24.563047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d07f5a1-748c-4fef-8632-eff4c76d1b24 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:24.563842 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d07f5a1-748c-4fef-8632-eff4c76d1b24 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:24.564303 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9d07f5a1-748c-4fef-8632-eff4c76d1b24 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:24.705631 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9d07f5a1-748c-4fef-8632-eff4c76d1b24 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:50:24.714878 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9d07f5a1-748c-4fef-8632-eff4c76d1b24 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1756 microversion: 2.1 time: 0.165125 May 28 05:50:24.715498 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3799/7711] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:50:24 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:50:25.732259 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d757fc4b-c946-4d78-be56-b0b55fb6ba3b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:50:25.732896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d757fc4b-c946-4d78-be56-b0b55fb6ba3b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:50:25.739151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d757fc4b-c946-4d78-be56-b0b55fb6ba3b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:25.739605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d757fc4b-c946-4d78-be56-b0b55fb6ba3b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:25.740370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d757fc4b-c946-4d78-be56-b0b55fb6ba3b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:25.741304 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d757fc4b-c946-4d78-be56-b0b55fb6ba3b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:25.886974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d757fc4b-c946-4d78-be56-b0b55fb6ba3b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:50:25.895059 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d757fc4b-c946-4d78-be56-b0b55fb6ba3b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1756 microversion: 2.1 time: 0.166856 May 28 05:50:25.895651 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3913/7712] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:50:25 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:50:26.912369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-68de2fdb-e5a0-45dc-bb67-9425fa10f55d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:50:26.913098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-68de2fdb-e5a0-45dc-bb67-9425fa10f55d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:50:26.921642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68de2fdb-e5a0-45dc-bb67-9425fa10f55d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:26.922138 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68de2fdb-e5a0-45dc-bb67-9425fa10f55d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:26.922928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68de2fdb-e5a0-45dc-bb67-9425fa10f55d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:26.923409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-68de2fdb-e5a0-45dc-bb67-9425fa10f55d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:27.077488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-68de2fdb-e5a0-45dc-bb67-9425fa10f55d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:50:27.085765 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-68de2fdb-e5a0-45dc-bb67-9425fa10f55d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1756 microversion: 2.1 time: 0.177343 May 28 05:50:27.086358 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3800/7713] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:50:26 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:50:28.103303 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b027382b-af2e-41d7-a9bb-34a201591a1e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:50:28.103944 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b027382b-af2e-41d7-a9bb-34a201591a1e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:50:28.110904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b027382b-af2e-41d7-a9bb-34a201591a1e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:28.111394 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b027382b-af2e-41d7-a9bb-34a201591a1e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:28.112153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b027382b-af2e-41d7-a9bb-34a201591a1e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:28.112587 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b027382b-af2e-41d7-a9bb-34a201591a1e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:28.252629 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b027382b-af2e-41d7-a9bb-34a201591a1e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:50:28.261432 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b027382b-af2e-41d7-a9bb-34a201591a1e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1756 microversion: 2.1 time: 0.162059 May 28 05:50:28.262010 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3914/7714] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:50:28 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:50:29.279015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d587a5fd-e212-4b7b-b224-d8d6231c4b9e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:50:29.279656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d587a5fd-e212-4b7b-b224-d8d6231c4b9e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:50:29.286594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d587a5fd-e212-4b7b-b224-d8d6231c4b9e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:29.287096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d587a5fd-e212-4b7b-b224-d8d6231c4b9e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:29.287883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d587a5fd-e212-4b7b-b224-d8d6231c4b9e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:29.288337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d587a5fd-e212-4b7b-b224-d8d6231c4b9e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:29.431628 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d587a5fd-e212-4b7b-b224-d8d6231c4b9e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:50:29.439989 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d587a5fd-e212-4b7b-b224-d8d6231c4b9e tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1756 microversion: 2.1 time: 0.164969 May 28 05:50:29.440577 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3801/7715] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:50:29 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:50:30.457494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-346b55c5-0dc5-420f-ab3d-715e92d4f96f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:50:30.458123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-346b55c5-0dc5-420f-ab3d-715e92d4f96f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:50:30.465247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-346b55c5-0dc5-420f-ab3d-715e92d4f96f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:30.465708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-346b55c5-0dc5-420f-ab3d-715e92d4f96f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:30.466483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-346b55c5-0dc5-420f-ab3d-715e92d4f96f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:30.466927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-346b55c5-0dc5-420f-ab3d-715e92d4f96f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:30.609862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-346b55c5-0dc5-420f-ab3d-715e92d4f96f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:50:30.618544 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-346b55c5-0dc5-420f-ab3d-715e92d4f96f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1756 microversion: 2.1 time: 0.165054 May 28 05:50:30.619161 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3915/7716] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:50:30 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:50:31.636443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-703e394b-d44d-4f2b-8cbd-fede2460b2dd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:50:31.637067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-703e394b-d44d-4f2b-8cbd-fede2460b2dd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:50:31.644117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-703e394b-d44d-4f2b-8cbd-fede2460b2dd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:31.644585 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-703e394b-d44d-4f2b-8cbd-fede2460b2dd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:31.645366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-703e394b-d44d-4f2b-8cbd-fede2460b2dd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:31.645817 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-703e394b-d44d-4f2b-8cbd-fede2460b2dd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:31.786762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-703e394b-d44d-4f2b-8cbd-fede2460b2dd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:50:31.794802 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-703e394b-d44d-4f2b-8cbd-fede2460b2dd tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1756 microversion: 2.1 time: 0.162279 May 28 05:50:31.795415 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3802/7717] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:50:31 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:50:32.812316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-435759d7-e53d-49de-ac9c-67475dc9e771 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:50:32.812974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-435759d7-e53d-49de-ac9c-67475dc9e771 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:50:32.820385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-435759d7-e53d-49de-ac9c-67475dc9e771 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:32.820840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-435759d7-e53d-49de-ac9c-67475dc9e771 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:32.821599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-435759d7-e53d-49de-ac9c-67475dc9e771 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:32.822040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-435759d7-e53d-49de-ac9c-67475dc9e771 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:32.967107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-435759d7-e53d-49de-ac9c-67475dc9e771 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:50:32.975083 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-435759d7-e53d-49de-ac9c-67475dc9e771 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1756 microversion: 2.1 time: 0.166816 May 28 05:50:32.975656 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3916/7718] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:50:32 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:50:33.992316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-45063321-f648-4b91-8ffe-a8cf0b087a28 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:50:33.992899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-45063321-f648-4b91-8ffe-a8cf0b087a28 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:50:33.995770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=23 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:50:34.000552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45063321-f648-4b91-8ffe-a8cf0b087a28 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:34.001011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45063321-f648-4b91-8ffe-a8cf0b087a28 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:34.001784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45063321-f648-4b91-8ffe-a8cf0b087a28 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:50:34.002232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-45063321-f648-4b91-8ffe-a8cf0b087a28 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:50:34.005095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:50:34.144316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-45063321-f648-4b91-8ffe-a8cf0b087a28 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:50:34.153244 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-45063321-f648-4b91-8ffe-a8cf0b087a28 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1759 microversion: 2.1 time: 0.164925 May 28 05:50:34.153825 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3803/7719] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:50:33 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:51:06.107758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-64705bbe-ba24-40b7-a762-46d5cbb1a62c tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1205842659"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:51:06.108505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-64705bbe-ba24-40b7-a762-46d5cbb1a62c tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:06.110746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=20 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:51:06.111435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=56 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:51:06.116858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64705bbe-ba24-40b7-a762-46d5cbb1a62c tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:06.121727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64705bbe-ba24-40b7-a762-46d5cbb1a62c tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:06.121727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64705bbe-ba24-40b7-a762-46d5cbb1a62c tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:06.121727 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-64705bbe-ba24-40b7-a762-46d5cbb1a62c tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:06.248741 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.network.security_group_api [None req-64705bbe-ba24-40b7-a762-46d5cbb1a62c tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Removing security group bd82004e-0d65-4384-93e2-a45aa088391c from port 2c829991-04d1-45d7-acce-5fd2dd21988f May 28 05:51:06.667469 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-64705bbe-ba24-40b7-a762-46d5cbb1a62c tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "POST /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/action" status: 202 len: 0 microversion: 2.1 time: 0.563684 May 28 05:51:06.675685 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3917/7720] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:51:06 2022] POST /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:51:06.678054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-13218db5-8fda-4911-a8b9-5e415bd79011 req-790ad16e-0a63-42f1-9933-41d57db61ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e5a5165-7cd4-4efc-804d-a5b154916c41", "tag": "2c829991-04d1-45d7-acce-5fd2dd21988f"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:51:06.685119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:51:06.689819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-13218db5-8fda-4911-a8b9-5e415bd79011 req-790ad16e-0a63-42f1-9933-41d57db61ce9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:06.693714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-13218db5-8fda-4911-a8b9-5e415bd79011 req-790ad16e-0a63-42f1-9933-41d57db61ce9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:06.707320 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-13218db5-8fda-4911-a8b9-5e415bd79011 req-790ad16e-0a63-42f1-9933-41d57db61ce9 service nova] Creating event network-changed:2c829991-04d1-45d7-acce-5fd2dd21988f for instance 3e5a5165-7cd4-4efc-804d-a5b154916c41 on n-h1-843700-1 May 28 05:51:06.715593 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-13218db5-8fda-4911-a8b9-5e415bd79011 req-790ad16e-0a63-42f1-9933-41d57db61ce9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042523 May 28 05:51:06.716890 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3804/7721] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:51:08.086081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-efaa5392-9c11-4bdf-9145-56c4598679b7 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:08.086581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-efaa5392-9c11-4bdf-9145-56c4598679b7 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:08.092678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efaa5392-9c11-4bdf-9145-56c4598679b7 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:08.093130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efaa5392-9c11-4bdf-9145-56c4598679b7 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:08.093892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efaa5392-9c11-4bdf-9145-56c4598679b7 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:08.094330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-efaa5392-9c11-4bdf-9145-56c4598679b7 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:08.177964 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-efaa5392-9c11-4bdf-9145-56c4598679b7 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lazy-loading 'services' on Instance uuid 3e5a5165-7cd4-4efc-804d-a5b154916c41 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:51:08.368406 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-efaa5392-9c11-4bdf-9145-56c4598679b7 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments/8903063a-1c08-4b97-983c-392360a6c726" status: 202 len: 0 microversion: 2.1 time: 0.287603 May 28 05:51:08.369062 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3918/7722] 10.222.0.58 () {58 vars in 1415 bytes} [Sat May 28 05:51:08 2022] DELETE /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments/8903063a-1c08-4b97-983c-392360a6c726 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:51:08.380178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fc9fc2d6-5b94-4306-832d-b72bf12dd80d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:08.381226 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fc9fc2d6-5b94-4306-832d-b72bf12dd80d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:08.388350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc9fc2d6-5b94-4306-832d-b72bf12dd80d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:08.388670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc9fc2d6-5b94-4306-832d-b72bf12dd80d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:08.389465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc9fc2d6-5b94-4306-832d-b72bf12dd80d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:08.390027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc9fc2d6-5b94-4306-832d-b72bf12dd80d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:08.420290 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fc9fc2d6-5b94-4306-832d-b72bf12dd80d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046335 May 28 05:51:08.420873 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3805/7723] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:51:08 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:51:08.732783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-2e464020-0c68-4705-a81b-8cbd243dbb60 req-07d28e86-9cee-46a8-8421-f130762ac308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e5a5165-7cd4-4efc-804d-a5b154916c41", "tag": "2c829991-04d1-45d7-acce-5fd2dd21988f"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:51:08.741872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2e464020-0c68-4705-a81b-8cbd243dbb60 req-07d28e86-9cee-46a8-8421-f130762ac308 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:08.742326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2e464020-0c68-4705-a81b-8cbd243dbb60 req-07d28e86-9cee-46a8-8421-f130762ac308 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:08.753582 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-2e464020-0c68-4705-a81b-8cbd243dbb60 req-07d28e86-9cee-46a8-8421-f130762ac308 service nova] Creating event network-changed:2c829991-04d1-45d7-acce-5fd2dd21988f for instance 3e5a5165-7cd4-4efc-804d-a5b154916c41 on n-h1-843700-1 May 28 05:51:08.758848 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-2e464020-0c68-4705-a81b-8cbd243dbb60 req-07d28e86-9cee-46a8-8421-f130762ac308 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030248 May 28 05:51:08.762299 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3919/7724] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:51:09.432734 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-04c71abf-9aec-4f2f-8f94-04e61049f248 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:09.433876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-04c71abf-9aec-4f2f-8f94-04e61049f248 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:09.441546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-04c71abf-9aec-4f2f-8f94-04e61049f248 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:09.442168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-04c71abf-9aec-4f2f-8f94-04e61049f248 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:09.443611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-04c71abf-9aec-4f2f-8f94-04e61049f248 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:09.444193 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-04c71abf-9aec-4f2f-8f94-04e61049f248 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:09.476870 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-04c71abf-9aec-4f2f-8f94-04e61049f248 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048569 May 28 05:51:09.481008 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3806/7725] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:51:09 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:51:09.730202 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:51:09.730413 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 05:51:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:51:10.490371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4b107513-004d-4175-b10b-31f2241f594d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:10.491336 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4b107513-004d-4175-b10b-31f2241f594d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:10.497656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4b107513-004d-4175-b10b-31f2241f594d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:10.498105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4b107513-004d-4175-b10b-31f2241f594d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:10.498861 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4b107513-004d-4175-b10b-31f2241f594d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:10.499324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4b107513-004d-4175-b10b-31f2241f594d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:10.532631 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4b107513-004d-4175-b10b-31f2241f594d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047453 May 28 05:51:10.533216 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3920/7726] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:51:10 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:51:11.545213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e0a58367-8a1e-4c48-be52-78e0ea1ae733 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:11.546153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e0a58367-8a1e-4c48-be52-78e0ea1ae733 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:11.554676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0a58367-8a1e-4c48-be52-78e0ea1ae733 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:11.555176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0a58367-8a1e-4c48-be52-78e0ea1ae733 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:11.555955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0a58367-8a1e-4c48-be52-78e0ea1ae733 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:11.556405 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0a58367-8a1e-4c48-be52-78e0ea1ae733 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:11.588066 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e0a58367-8a1e-4c48-be52-78e0ea1ae733 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046877 May 28 05:51:11.588653 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3807/7727] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:51:11 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:51:12.599602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-af9a0b98-7bba-4501-adf4-8a691a9f5cb1 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:12.600545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-af9a0b98-7bba-4501-adf4-8a691a9f5cb1 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:12.607764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-af9a0b98-7bba-4501-adf4-8a691a9f5cb1 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:12.608231 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-af9a0b98-7bba-4501-adf4-8a691a9f5cb1 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:12.609011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-af9a0b98-7bba-4501-adf4-8a691a9f5cb1 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:12.609472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-af9a0b98-7bba-4501-adf4-8a691a9f5cb1 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:12.639208 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-af9a0b98-7bba-4501-adf4-8a691a9f5cb1 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043757 May 28 05:51:12.640109 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3921/7728] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:51:12 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:51:13.651377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-22e71956-60cc-4255-ad1b-c5df837dda7a tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:13.652329 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-22e71956-60cc-4255-ad1b-c5df837dda7a tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:13.659616 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22e71956-60cc-4255-ad1b-c5df837dda7a tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:13.660104 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22e71956-60cc-4255-ad1b-c5df837dda7a tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:13.660908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22e71956-60cc-4255-ad1b-c5df837dda7a tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:13.661469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-22e71956-60cc-4255-ad1b-c5df837dda7a tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:13.689857 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-22e71956-60cc-4255-ad1b-c5df837dda7a tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042669 May 28 05:51:13.690605 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3808/7729] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:51:13 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:51:14.701881 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-02d1428f-032b-4554-b2ca-b473944ae80f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:14.702920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-02d1428f-032b-4554-b2ca-b473944ae80f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:14.709865 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02d1428f-032b-4554-b2ca-b473944ae80f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:14.710327 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02d1428f-032b-4554-b2ca-b473944ae80f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:14.711122 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02d1428f-032b-4554-b2ca-b473944ae80f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:14.711561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-02d1428f-032b-4554-b2ca-b473944ae80f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:14.741571 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-02d1428f-032b-4554-b2ca-b473944ae80f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043682 May 28 05:51:14.742147 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3922/7730] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:51:14 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:51:15.753839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f1f7b854-fdd0-41a5-8cb7-ac507595ab56 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:15.755511 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f1f7b854-fdd0-41a5-8cb7-ac507595ab56 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:15.762781 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1f7b854-fdd0-41a5-8cb7-ac507595ab56 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:15.763332 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1f7b854-fdd0-41a5-8cb7-ac507595ab56 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:15.764162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1f7b854-fdd0-41a5-8cb7-ac507595ab56 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:15.764623 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f1f7b854-fdd0-41a5-8cb7-ac507595ab56 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:15.796027 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f1f7b854-fdd0-41a5-8cb7-ac507595ab56 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046563 May 28 05:51:15.796614 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3809/7731] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:51:15 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:51:16.807808 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a1b0c398-291c-4530-8365-7485633ffe7b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:16.808738 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a1b0c398-291c-4530-8365-7485633ffe7b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:16.816121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1b0c398-291c-4530-8365-7485633ffe7b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:16.816589 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1b0c398-291c-4530-8365-7485633ffe7b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:16.818075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1b0c398-291c-4530-8365-7485633ffe7b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:16.818526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1b0c398-291c-4530-8365-7485633ffe7b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:16.850865 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a1b0c398-291c-4530-8365-7485633ffe7b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046905 May 28 05:51:16.851474 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3923/7732] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:51:16 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:51:17.866024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-182d308c-f7b3-4dce-b56c-976fb2e0ca9f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:17.867756 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-182d308c-f7b3-4dce-b56c-976fb2e0ca9f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:17.881372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-182d308c-f7b3-4dce-b56c-976fb2e0ca9f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:17.881831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-182d308c-f7b3-4dce-b56c-976fb2e0ca9f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:17.882761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-182d308c-f7b3-4dce-b56c-976fb2e0ca9f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:17.883326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-182d308c-f7b3-4dce-b56c-976fb2e0ca9f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:17.914519 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-182d308c-f7b3-4dce-b56c-976fb2e0ca9f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055723 May 28 05:51:17.915121 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3810/7733] 10.222.0.58 () {58 vars in 1301 bytes} [Sat May 28 05:51:17 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 05:51:17.932856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-60bee134-19ea-4f28-af06-0ae584b3866b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:17.933772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-60bee134-19ea-4f28-af06-0ae584b3866b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:17.944764 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60bee134-19ea-4f28-af06-0ae584b3866b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:17.945229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60bee134-19ea-4f28-af06-0ae584b3866b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:17.946020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60bee134-19ea-4f28-af06-0ae584b3866b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:17.946472 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-60bee134-19ea-4f28-af06-0ae584b3866b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:18.022099 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-60bee134-19ea-4f28-af06-0ae584b3866b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] HTTP exception thrown: Instance 3e5a5165-7cd4-4efc-804d-a5b154916c41 is not attached to volume 8903063a-1c08-4b97-983c-392360a6c726 May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-60bee134-19ea-4f28-af06-0ae584b3866b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Request method failure captured: May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: request: DELETE /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments/8903063a-1c08-4b97-983c-392360a6c726 HTTP/1.1 May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbfPFDgnzl0DAOElOwXTPncrNtJHd1sgoRTcGeta4Vpf78d1VrrOGGhT9ro8k0_f2V7UtOUwm-4UnSUqxhGvf07aK4aDaQ9dLSfN8zTTMKNqU7g4xdw427nRRXHwh8xPpcJU-jFwhRaOB9ZFu8WAMhXzZgi4_7EAvrRUuiBzp5Et3Ek May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 40dae26039054295a42b99499d295422 May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TestMinimumBasicScenario-159738606 May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_40dae26039054295a42b99499d295422"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/40dae26039054295a42b99499d295422"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/40dae26039054295a42b99499d295422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/40dae26039054295a42b99499d295422"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TestMinimumBasicScenario-159738606 May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 40dae26039054295a42b99499d295422 May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TestMinimumBasicScenario-159738606 May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TestMinimumBasicScenario-159738606-project May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: da57a2356ffa4f008b3745da3835a344 May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TestMinimumBasicScenario-159738606-project May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 3e5a5165-7cd4-4efc-804d-a5b154916c41 is not attached to volume 8903063a-1c08-4b97-983c-392360a6c726 May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'server_id': '3e5a5165-7cd4-4efc-804d-a5b154916c41', 'id': '8903063a-1c08-4b97-983c-392360a6c726'} May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8903063a-1c08-4b97-983c-392360a6c726. May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e5a5165-7cd4-4efc-804d-a5b154916c41 is not attached to volume 8903063a-1c08-4b97-983c-392360a6c726 May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:51:18.024174 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:51:18.030432 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:51:18.030432 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:51:18.030432 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e5a5165-7cd4-4efc-804d-a5b154916c41 is not attached to volume 8903063a-1c08-4b97-983c-392360a6c726 May 28 05:51:18.030432 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:51:18.030432 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-60bee134-19ea-4f28-af06-0ae584b3866b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Returning 404 to user: Instance 3e5a5165-7cd4-4efc-804d-a5b154916c41 is not attached to volume 8903063a-1c08-4b97-983c-392360a6c726 {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:51:18.030432 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-60bee134-19ea-4f28-af06-0ae584b3866b tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments/8903063a-1c08-4b97-983c-392360a6c726" status: 404 len: 154 microversion: 2.1 time: 0.101327 May 28 05:51:18.030432 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3924/7734] 10.222.0.58 () {58 vars in 1415 bytes} [Sat May 28 05:51:17 2022] DELETE /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41/os-volume_attachments/8903063a-1c08-4b97-983c-392360a6c726 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:51:24.529612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-94ce3409-c83a-4909-8401-8feac49bbd00 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:24.530144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-94ce3409-c83a-4909-8401-8feac49bbd00 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:24.536769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-94ce3409-c83a-4909-8401-8feac49bbd00 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:24.537244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-94ce3409-c83a-4909-8401-8feac49bbd00 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:24.538041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-94ce3409-c83a-4909-8401-8feac49bbd00 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:24.538506 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-94ce3409-c83a-4909-8401-8feac49bbd00 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:24.562754 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-94ce3409-c83a-4909-8401-8feac49bbd00 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:51:24.815438 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-94ce3409-c83a-4909-8401-8feac49bbd00 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 204 len: 0 microversion: 2.1 time: 0.289346 May 28 05:51:24.816079 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3811/7735] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:51:24 2022] DELETE /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:51:24.826110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5a73e624-a4ba-4ce9-a4e4-d8658abd37ac tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:24.826734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5a73e624-a4ba-4ce9-a4e4-d8658abd37ac tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:24.833468 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a73e624-a4ba-4ce9-a4e4-d8658abd37ac tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:24.833979 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a73e624-a4ba-4ce9-a4e4-d8658abd37ac tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:24.834753 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a73e624-a4ba-4ce9-a4e4-d8658abd37ac tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:24.835220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5a73e624-a4ba-4ce9-a4e4-d8658abd37ac tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:24.966083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5a73e624-a4ba-4ce9-a4e4-d8658abd37ac tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:51:24.973647 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5a73e624-a4ba-4ce9-a4e4-d8658abd37ac tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1553 microversion: 2.1 time: 0.152772 May 28 05:51:24.974224 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3925/7736] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:51:24 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:51:25.992877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0db5085e-d50c-436a-8c3d-048856da9f02 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:25.993602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0db5085e-d50c-436a-8c3d-048856da9f02 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:26.000550 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0db5085e-d50c-436a-8c3d-048856da9f02 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:26.001022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0db5085e-d50c-436a-8c3d-048856da9f02 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:26.001821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0db5085e-d50c-436a-8c3d-048856da9f02 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:26.002282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0db5085e-d50c-436a-8c3d-048856da9f02 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:26.133378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0db5085e-d50c-436a-8c3d-048856da9f02 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:51:26.140970 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0db5085e-d50c-436a-8c3d-048856da9f02 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1553 microversion: 2.1 time: 0.153184 May 28 05:51:26.141553 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3812/7737] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:51:25 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:51:26.928952 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e5741fe5-cbb7-4031-887c-6ae2988f46a1 req-a41743ef-12ce-448a-bbd2-5a06629cc569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e5a5165-7cd4-4efc-804d-a5b154916c41", "name": "network-vif-deleted", "tag": "2c829991-04d1-45d7-acce-5fd2dd21988f"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:51:26.937958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e5741fe5-cbb7-4031-887c-6ae2988f46a1 req-a41743ef-12ce-448a-bbd2-5a06629cc569 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:26.939811 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e5741fe5-cbb7-4031-887c-6ae2988f46a1 req-a41743ef-12ce-448a-bbd2-5a06629cc569 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:26.949919 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e5741fe5-cbb7-4031-887c-6ae2988f46a1 req-a41743ef-12ce-448a-bbd2-5a06629cc569 service nova] Creating event network-vif-deleted:2c829991-04d1-45d7-acce-5fd2dd21988f for instance 3e5a5165-7cd4-4efc-804d-a5b154916c41 on n-h1-843700-1 May 28 05:51:26.955064 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e5741fe5-cbb7-4031-887c-6ae2988f46a1 req-a41743ef-12ce-448a-bbd2-5a06629cc569 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030447 May 28 05:51:26.955662 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3926/7738] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:51:27.158316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6000ca35-f85a-4bf9-8b98-40265d669b4f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:27.158931 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6000ca35-f85a-4bf9-8b98-40265d669b4f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:27.166010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6000ca35-f85a-4bf9-8b98-40265d669b4f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:27.166487 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6000ca35-f85a-4bf9-8b98-40265d669b4f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:27.167331 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6000ca35-f85a-4bf9-8b98-40265d669b4f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:27.167810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6000ca35-f85a-4bf9-8b98-40265d669b4f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:27.237442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6000ca35-f85a-4bf9-8b98-40265d669b4f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da57a2356ffa4f008b3745da3835a344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40dae26039054295a42b99499d295422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:51:27.245376 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6000ca35-f85a-4bf9-8b98-40265d669b4f tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 200 len: 1342 microversion: 2.1 time: 0.091031 May 28 05:51:27.245966 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3813/7739] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:51:27 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 1342 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:51:28.264262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-150d1b1a-c659-4356-8cb5-957b8de0a964 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:28.264962 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-150d1b1a-c659-4356-8cb5-957b8de0a964 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] [instance: 3e5a5165-7cd4-4efc-804d-a5b154916c41] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:28.271263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-150d1b1a-c659-4356-8cb5-957b8de0a964 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:28.271718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-150d1b1a-c659-4356-8cb5-957b8de0a964 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:28.272476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-150d1b1a-c659-4356-8cb5-957b8de0a964 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:28.272913 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-150d1b1a-c659-4356-8cb5-957b8de0a964 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:28.286495 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-150d1b1a-c659-4356-8cb5-957b8de0a964 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] HTTP exception thrown: Instance 3e5a5165-7cd4-4efc-804d-a5b154916c41 could not be found. May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-150d1b1a-c659-4356-8cb5-957b8de0a964 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Request method failure captured: May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 HTTP/1.1 May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbfPFDgnzl0DAOElOwXTPncrNtJHd1sgoRTcGeta4Vpf78d1VrrOGGhT9ro8k0_f2V7UtOUwm-4UnSUqxhGvf07aK4aDaQ9dLSfN8zTTMKNqU7g4xdw427nRRXHwh8xPpcJU-jFwhRaOB9ZFu8WAMhXzZgi4_7EAvrRUuiBzp5Et3Ek May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 40dae26039054295a42b99499d295422 May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TestMinimumBasicScenario-159738606 May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_40dae26039054295a42b99499d295422"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/40dae26039054295a42b99499d295422"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/40dae26039054295a42b99499d295422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/40dae26039054295a42b99499d295422"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TestMinimumBasicScenario-159738606 May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 40dae26039054295a42b99499d295422 May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TestMinimumBasicScenario-159738606 May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TestMinimumBasicScenario-159738606-project May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: da57a2356ffa4f008b3745da3835a344 May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TestMinimumBasicScenario-159738606-project May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 3e5a5165-7cd4-4efc-804d-a5b154916c41 could not be found. May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '3e5a5165-7cd4-4efc-804d-a5b154916c41'} May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e5a5165-7cd4-4efc-804d-a5b154916c41 could not be found. May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e5a5165-7cd4-4efc-804d-a5b154916c41 could not be found. May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:51:28.288105 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:51:28.292126 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:51:28.292126 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:51:28.292126 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:51:28.292126 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:51:28.292126 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:51:28.292126 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e5a5165-7cd4-4efc-804d-a5b154916c41 could not be found. May 28 05:51:28.292126 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:51:28.292126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-150d1b1a-c659-4356-8cb5-957b8de0a964 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Returning 404 to user: Instance 3e5a5165-7cd4-4efc-804d-a5b154916c41 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:51:28.292126 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-150d1b1a-c659-4356-8cb5-957b8de0a964 tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41" status: 404 len: 111 microversion: 2.1 time: 0.030579 May 28 05:51:28.292126 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3927/7740] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:51:28 2022] GET /compute/v2.1/servers/3e5a5165-7cd4-4efc-804d-a5b154916c41 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:51:28.298172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-677e646e-b44c-4a5a-8aa2-630544b4881d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] Calling method '.version_select at 0x7f77002f5af0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:28.399053 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-677e646e-b44c-4a5a-8aa2-630544b4881d tempest-TestMinimumBasicScenario-159738606 tempest-TestMinimumBasicScenario-159738606-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-95862361" status: 202 len: 0 microversion: 2.1 time: 0.104597 May 28 05:51:28.399586 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3814/7741] 10.222.0.58 () {58 vars in 1265 bytes} [Sat May 28 05:51:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-95862361 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:51:39.687204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=22 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:51:39.688068 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:51:39.846528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3557f4e6-3f60-4f64-ae09-844c5996297e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'create', calling method: .version_select at 0x7f7700617c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1313315923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxQy9s6Y4R359TPE2cleLOKP8GA8RTfXp/JZkcPRc97lZpznvxDQYfAPkdBmbTbKXa+tg/yASwjdgOiOBlsItNRXX4iG298Am+k+/+9k/gmOYQF2J6CkwHdi/hUZ+uk5w=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:51:39.861729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-3557f4e6-3f60-4f64-ae09-844c5996297e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Getting quotas for project 8df3b01779bd4e198777ddc16182cda3. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:51:39.866826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-3557f4e6-3f60-4f64-ae09-844c5996297e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Getting quotas for user 1bcabf3cdb7c4f02a50aeb508775222a and project 8df3b01779bd4e198777ddc16182cda3. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:51:39.959365 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3557f4e6-3f60-4f64-ae09-844c5996297e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.277982 May 28 05:51:39.959971 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3928/7742] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 05:51:39 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:51:48.268172 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:51:48.269390 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:51:48.275337 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e2677b37-f6fe-42b1-95a8-500621ae5ab0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1844695115", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "e7dc9c55-ef81-4019-96ae-28c036fbfce9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1313315923", "security_groups": [{"name": "tempest-secgroup-smoke-316550426"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:51:48.412351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-e2677b37-f6fe-42b1-95a8-500621ae5ab0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] validate_networks() for [('e7dc9c55-ef81-4019-96ae-28c036fbfce9', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:51:49.076738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-e2677b37-f6fe-42b1-95a8-500621ae5ab0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:51:49.077245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-e2677b37-f6fe-42b1-95a8-500621ae5ab0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:51:49.077744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-e2677b37-f6fe-42b1-95a8-500621ae5ab0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:51:49.078371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-e2677b37-f6fe-42b1-95a8-500621ae5ab0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:51:49.078806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-e2677b37-f6fe-42b1-95a8-500621ae5ab0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:51:49.093133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2677b37-f6fe-42b1-95a8-500621ae5ab0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:49.097414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2677b37-f6fe-42b1-95a8-500621ae5ab0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:49.098566 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2677b37-f6fe-42b1-95a8-500621ae5ab0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:49.099936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e2677b37-f6fe-42b1-95a8-500621ae5ab0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:49.152214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-e2677b37-f6fe-42b1-95a8-500621ae5ab0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Getting quotas for project 8df3b01779bd4e198777ddc16182cda3. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:51:49.159850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-e2677b37-f6fe-42b1-95a8-500621ae5ab0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Getting quotas for user 1bcabf3cdb7c4f02a50aeb508775222a and project 8df3b01779bd4e198777ddc16182cda3. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:51:49.183558 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e2677b37-f6fe-42b1-95a8-500621ae5ab0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:51:49.185946 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e2677b37-f6fe-42b1-95a8-500621ae5ab0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:51:49.339087 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e2677b37-f6fe-42b1-95a8-500621ae5ab0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.070197 May 28 05:51:49.341524 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3815/7743] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:51:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:51:49.351873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-550cb6b6-1999-42fa-aec3-fb57798392c8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:49.352497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-550cb6b6-1999-42fa-aec3-fb57798392c8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:49.459676 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-550cb6b6-1999-42fa-aec3-fb57798392c8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:51:49.468233 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-550cb6b6-1999-42fa-aec3-fb57798392c8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1267 microversion: 2.1 time: 0.121624 May 28 05:51:49.480024 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3929/7744] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:51:49 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1267 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:51:50.497728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a674229e-b541-4683-971e-924cf62af37c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:50.499142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a674229e-b541-4683-971e-924cf62af37c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:50.558586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a674229e-b541-4683-971e-924cf62af37c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:51:50.565969 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a674229e-b541-4683-971e-924cf62af37c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1267 microversion: 2.1 time: 0.073041 May 28 05:51:50.566805 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3816/7745] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:51:50 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1267 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:51:51.583716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3cb57ba2-a814-4f78-adac-428f39c835a8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:51.584331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3cb57ba2-a814-4f78-adac-428f39c835a8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:51.639900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3cb57ba2-a814-4f78-adac-428f39c835a8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:51:51.647350 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3cb57ba2-a814-4f78-adac-428f39c835a8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1267 microversion: 2.1 time: 0.067564 May 28 05:51:51.647973 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3930/7746] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:51:51 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1267 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:51:52.664065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8ccff9fb-f61a-48ab-ab13-531014fdeed8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:52.664701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8ccff9fb-f61a-48ab-ab13-531014fdeed8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:52.722351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8ccff9fb-f61a-48ab-ab13-531014fdeed8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:51:52.729327 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8ccff9fb-f61a-48ab-ab13-531014fdeed8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1267 microversion: 2.1 time: 0.069434 May 28 05:51:52.729932 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3817/7747] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:51:52 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1267 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:51:53.746351 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0bf530c7-3660-4d44-b417-f868ff7b6268 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:53.746896 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0bf530c7-3660-4d44-b417-f868ff7b6268 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:53.754105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0bf530c7-3660-4d44-b417-f868ff7b6268 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:53.754566 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0bf530c7-3660-4d44-b417-f868ff7b6268 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:53.755372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0bf530c7-3660-4d44-b417-f868ff7b6268 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:53.756366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0bf530c7-3660-4d44-b417-f868ff7b6268 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:54.156647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0bf530c7-3660-4d44-b417-f868ff7b6268 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:51:54.164371 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0bf530c7-3660-4d44-b417-f868ff7b6268 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1271 microversion: 2.1 time: 0.422129 May 28 05:51:54.164956 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3931/7748] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:51:53 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1271 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:51:55.181474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-18607419-90d7-4c8a-af52-0d40dbb73165 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:55.182103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-18607419-90d7-4c8a-af52-0d40dbb73165 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:55.189374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-18607419-90d7-4c8a-af52-0d40dbb73165 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:55.189838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-18607419-90d7-4c8a-af52-0d40dbb73165 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:55.190665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-18607419-90d7-4c8a-af52-0d40dbb73165 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:55.191256 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-18607419-90d7-4c8a-af52-0d40dbb73165 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:55.257701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-18607419-90d7-4c8a-af52-0d40dbb73165 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:51:55.265366 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-18607419-90d7-4c8a-af52-0d40dbb73165 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1319 microversion: 2.1 time: 0.087929 May 28 05:51:55.265967 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3818/7749] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:51:55 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1319 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:51:56.284043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7c71ec8b-4285-4adc-b4da-4c07686c182e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:56.284748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7c71ec8b-4285-4adc-b4da-4c07686c182e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:56.292108 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7c71ec8b-4285-4adc-b4da-4c07686c182e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:56.292576 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7c71ec8b-4285-4adc-b4da-4c07686c182e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:56.293567 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7c71ec8b-4285-4adc-b4da-4c07686c182e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:56.293875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7c71ec8b-4285-4adc-b4da-4c07686c182e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:56.513779 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7c71ec8b-4285-4adc-b4da-4c07686c182e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:51:56.521383 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7c71ec8b-4285-4adc-b4da-4c07686c182e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1392 microversion: 2.1 time: 0.241422 May 28 05:51:56.521972 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3932/7750] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:51:56 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1392 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:51:57.190109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b6708793-8f4b-48d7-b393-a3046b4a7f30 req-e5a10258-f61d-44a8-b5dc-413bb2c1d0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3285838e-82d4-4884-ba55-6db7320afaf5", "tag": "b7a737de-e278-415f-90c6-3866dd6f72e9"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:51:57.201865 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b6708793-8f4b-48d7-b393-a3046b4a7f30 req-e5a10258-f61d-44a8-b5dc-413bb2c1d0d8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:57.202630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b6708793-8f4b-48d7-b393-a3046b4a7f30 req-e5a10258-f61d-44a8-b5dc-413bb2c1d0d8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:57.216341 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b6708793-8f4b-48d7-b393-a3046b4a7f30 req-e5a10258-f61d-44a8-b5dc-413bb2c1d0d8 service nova] Creating event network-changed:b7a737de-e278-415f-90c6-3866dd6f72e9 for instance 3285838e-82d4-4884-ba55-6db7320afaf5 on n-h2-843700-1 May 28 05:51:57.221731 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b6708793-8f4b-48d7-b393-a3046b4a7f30 req-e5a10258-f61d-44a8-b5dc-413bb2c1d0d8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036121 May 28 05:51:57.222432 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3819/7751] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:51:57.538721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c8d6e3af-1047-4aec-aaa5-08d2cd53a35c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:57.539278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c8d6e3af-1047-4aec-aaa5-08d2cd53a35c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:57.546349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8d6e3af-1047-4aec-aaa5-08d2cd53a35c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:57.546812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8d6e3af-1047-4aec-aaa5-08d2cd53a35c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:57.547633 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8d6e3af-1047-4aec-aaa5-08d2cd53a35c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:57.548081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c8d6e3af-1047-4aec-aaa5-08d2cd53a35c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:57.779338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c8d6e3af-1047-4aec-aaa5-08d2cd53a35c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:51:57.787896 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c8d6e3af-1047-4aec-aaa5-08d2cd53a35c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1392 microversion: 2.1 time: 0.253230 May 28 05:51:57.788929 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3933/7752] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:51:57 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1392 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:51:58.806547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8ad6cf4f-d98e-4d59-8200-a54deaf190a7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:58.807297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8ad6cf4f-d98e-4d59-8200-a54deaf190a7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:58.814489 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ad6cf4f-d98e-4d59-8200-a54deaf190a7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:58.817715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ad6cf4f-d98e-4d59-8200-a54deaf190a7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:58.817715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ad6cf4f-d98e-4d59-8200-a54deaf190a7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:58.817715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8ad6cf4f-d98e-4d59-8200-a54deaf190a7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:58.946326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8ad6cf4f-d98e-4d59-8200-a54deaf190a7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:51:58.953942 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8ad6cf4f-d98e-4d59-8200-a54deaf190a7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1392 microversion: 2.1 time: 0.152457 May 28 05:51:58.954529 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3820/7753] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:51:58 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:51:59.970772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e11abae1-0fe4-488e-935a-a71fb9db141b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:51:59.971441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e11abae1-0fe4-488e-935a-a71fb9db141b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:51:59.978387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e11abae1-0fe4-488e-935a-a71fb9db141b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:59.978846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e11abae1-0fe4-488e-935a-a71fb9db141b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:51:59.979653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e11abae1-0fe4-488e-935a-a71fb9db141b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:51:59.980101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e11abae1-0fe4-488e-935a-a71fb9db141b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:00.110758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e11abae1-0fe4-488e-935a-a71fb9db141b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:52:00.119632 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e11abae1-0fe4-488e-935a-a71fb9db141b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1392 microversion: 2.1 time: 0.152678 May 28 05:52:00.120236 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3934/7754] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:51:59 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:52:01.137223 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-91acf065-9869-4b2a-b968-6580e9391601 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:52:01.137898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-91acf065-9869-4b2a-b968-6580e9391601 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:01.139972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:52:01.145783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91acf065-9869-4b2a-b968-6580e9391601 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:01.148263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91acf065-9869-4b2a-b968-6580e9391601 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:01.148263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91acf065-9869-4b2a-b968-6580e9391601 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:01.148263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91acf065-9869-4b2a-b968-6580e9391601 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:01.283406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-91acf065-9869-4b2a-b968-6580e9391601 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:52:01.291510 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-91acf065-9869-4b2a-b968-6580e9391601 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1392 microversion: 2.1 time: 0.158242 May 28 05:52:01.292093 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3821/7755] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:52:01 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:52:01.795840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-49a8afeb-dfce-4706-87aa-84ff8364767f req-f0c2cf35-7211-4d2e-b8b6-e4a84026301d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3285838e-82d4-4884-ba55-6db7320afaf5", "name": "network-vif-plugged", "status": "completed", "tag": "b7a737de-e278-415f-90c6-3866dd6f72e9"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:52:01.800400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=8 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:52:01.805786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-49a8afeb-dfce-4706-87aa-84ff8364767f req-f0c2cf35-7211-4d2e-b8b6-e4a84026301d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:01.806267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-49a8afeb-dfce-4706-87aa-84ff8364767f req-f0c2cf35-7211-4d2e-b8b6-e4a84026301d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:01.817076 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-49a8afeb-dfce-4706-87aa-84ff8364767f req-f0c2cf35-7211-4d2e-b8b6-e4a84026301d service nova] Creating event network-vif-plugged:b7a737de-e278-415f-90c6-3866dd6f72e9 for instance 3285838e-82d4-4884-ba55-6db7320afaf5 on n-h2-843700-1 May 28 05:52:01.822795 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-49a8afeb-dfce-4706-87aa-84ff8364767f req-f0c2cf35-7211-4d2e-b8b6-e4a84026301d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030650 May 28 05:52:01.823448 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3935/7756] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:52:02.309110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a69ab5b4-fbf8-473a-a056-1b3a9b1cd0bc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:52:02.309735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a69ab5b4-fbf8-473a-a056-1b3a9b1cd0bc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:02.316686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a69ab5b4-fbf8-473a-a056-1b3a9b1cd0bc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:02.317159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a69ab5b4-fbf8-473a-a056-1b3a9b1cd0bc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:02.318486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a69ab5b4-fbf8-473a-a056-1b3a9b1cd0bc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:02.318939 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a69ab5b4-fbf8-473a-a056-1b3a9b1cd0bc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:02.451520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a69ab5b4-fbf8-473a-a056-1b3a9b1cd0bc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:52:02.459011 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a69ab5b4-fbf8-473a-a056-1b3a9b1cd0bc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1392 microversion: 2.1 time: 0.153849 May 28 05:52:02.459608 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3822/7757] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:52:02 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:52:03.477739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-26c42bda-6a29-4fa3-8d68-8347484c2eeb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:52:03.478444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-26c42bda-6a29-4fa3-8d68-8347484c2eeb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:03.485087 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26c42bda-6a29-4fa3-8d68-8347484c2eeb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:03.485596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26c42bda-6a29-4fa3-8d68-8347484c2eeb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:03.486367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26c42bda-6a29-4fa3-8d68-8347484c2eeb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:03.486812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26c42bda-6a29-4fa3-8d68-8347484c2eeb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:03.617583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-26c42bda-6a29-4fa3-8d68-8347484c2eeb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:52:03.625531 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-26c42bda-6a29-4fa3-8d68-8347484c2eeb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1564 microversion: 2.1 time: 0.153542 May 28 05:52:03.625812 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3936/7758] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:52:03 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:52:03.642497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8e30e9f9-ffa3-4af8-9eab-3cad8a5882dc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:52:03.643171 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8e30e9f9-ffa3-4af8-9eab-3cad8a5882dc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:03.645057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=10 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:52:03.651529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e30e9f9-ffa3-4af8-9eab-3cad8a5882dc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:03.651999 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e30e9f9-ffa3-4af8-9eab-3cad8a5882dc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:03.656846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e30e9f9-ffa3-4af8-9eab-3cad8a5882dc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:03.656846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8e30e9f9-ffa3-4af8-9eab-3cad8a5882dc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:03.788420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8e30e9f9-ffa3-4af8-9eab-3cad8a5882dc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:52:03.796147 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8e30e9f9-ffa3-4af8-9eab-3cad8a5882dc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1564 microversion: 2.1 time: 0.157575 May 28 05:52:03.796730 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3823/7759] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:52:03 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:52:05.701708 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-715c4bab-a0c1-47d7-88fc-b6f1bd8c70bc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:52:05.702387 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-715c4bab-a0c1-47d7-88fc-b6f1bd8c70bc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:05.703597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-d37a6743-45b7-42c0-9717-baf50c268aa6 req-41024e5a-04bf-4fcd-b2a2-2c4ad3fdeb37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3285838e-82d4-4884-ba55-6db7320afaf5", "tag": "b7a737de-e278-415f-90c6-3866dd6f72e9"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:52:05.709568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-715c4bab-a0c1-47d7-88fc-b6f1bd8c70bc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:05.710212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-715c4bab-a0c1-47d7-88fc-b6f1bd8c70bc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:05.711005 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-715c4bab-a0c1-47d7-88fc-b6f1bd8c70bc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:05.711447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-715c4bab-a0c1-47d7-88fc-b6f1bd8c70bc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:05.713711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d37a6743-45b7-42c0-9717-baf50c268aa6 req-41024e5a-04bf-4fcd-b2a2-2c4ad3fdeb37 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:05.714185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d37a6743-45b7-42c0-9717-baf50c268aa6 req-41024e5a-04bf-4fcd-b2a2-2c4ad3fdeb37 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:05.729225 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-d37a6743-45b7-42c0-9717-baf50c268aa6 req-41024e5a-04bf-4fcd-b2a2-2c4ad3fdeb37 service nova] Creating event network-changed:b7a737de-e278-415f-90c6-3866dd6f72e9 for instance 3285838e-82d4-4884-ba55-6db7320afaf5 on n-h2-843700-1 May 28 05:52:05.734721 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-d37a6743-45b7-42c0-9717-baf50c268aa6 req-41024e5a-04bf-4fcd-b2a2-2c4ad3fdeb37 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035122 May 28 05:52:05.735894 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3824/7760] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:52:05.948436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-715c4bab-a0c1-47d7-88fc-b6f1bd8c70bc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:52:05.956949 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-715c4bab-a0c1-47d7-88fc-b6f1bd8c70bc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1564 microversion: 2.1 time: 0.259596 May 28 05:52:05.957657 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3937/7761] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:52:05 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1564 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:52:27.270443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c303734a-25ea-4ef0-93c5-bc7fb15d97cf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:52:27.272109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c303734a-25ea-4ef0-93c5-bc7fb15d97cf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:27.274593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:52:27.275326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=36 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:52:27.280275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c303734a-25ea-4ef0-93c5-bc7fb15d97cf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:27.280750 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c303734a-25ea-4ef0-93c5-bc7fb15d97cf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:27.281532 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c303734a-25ea-4ef0-93c5-bc7fb15d97cf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:27.282035 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c303734a-25ea-4ef0-93c5-bc7fb15d97cf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:27.335427 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c303734a-25ea-4ef0-93c5-bc7fb15d97cf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5/action" status: 200 len: 24578 microversion: 2.1 time: 0.069163 May 28 05:52:27.336118 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3825/7762] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:52:27 2022] POST /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5/action => generated 24578 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:52:33.720483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5820026a-431d-4bde-bc78-f2221b2e28e2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:52:33.721052 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5820026a-431d-4bde-bc78-f2221b2e28e2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:33.723203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:52:33.724504 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=38 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:52:33.729328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5820026a-431d-4bde-bc78-f2221b2e28e2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:33.729785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5820026a-431d-4bde-bc78-f2221b2e28e2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:33.730551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5820026a-431d-4bde-bc78-f2221b2e28e2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:33.731012 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5820026a-431d-4bde-bc78-f2221b2e28e2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:33.973235 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5820026a-431d-4bde-bc78-f2221b2e28e2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5/action" status: 202 len: 0 microversion: 2.1 time: 0.256784 May 28 05:52:33.974555 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3938/7763] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:52:33 2022] POST /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 05:52:33.984491 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cb728a52-558e-4a52-8301-495d2ddd15b3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:52:33.985033 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cb728a52-558e-4a52-8301-495d2ddd15b3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:33.993570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb728a52-558e-4a52-8301-495d2ddd15b3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:33.994036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb728a52-558e-4a52-8301-495d2ddd15b3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:33.994815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb728a52-558e-4a52-8301-495d2ddd15b3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:33.995292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cb728a52-558e-4a52-8301-495d2ddd15b3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:34.136821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cb728a52-558e-4a52-8301-495d2ddd15b3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:52:34.144453 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cb728a52-558e-4a52-8301-495d2ddd15b3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1688 microversion: 2.1 time: 0.165096 May 28 05:52:34.145025 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3826/7764] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:52:33 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:52:35.164114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-675bba0a-091d-40cb-927b-cbcf85844038 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:52:35.164821 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-675bba0a-091d-40cb-927b-cbcf85844038 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:35.171172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-675bba0a-091d-40cb-927b-cbcf85844038 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:35.171631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-675bba0a-091d-40cb-927b-cbcf85844038 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:35.172404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-675bba0a-091d-40cb-927b-cbcf85844038 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:35.172914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-675bba0a-091d-40cb-927b-cbcf85844038 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:35.304729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-675bba0a-091d-40cb-927b-cbcf85844038 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:52:35.312372 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-675bba0a-091d-40cb-927b-cbcf85844038 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1668 microversion: 2.1 time: 0.154284 May 28 05:52:35.312951 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3939/7765] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:52:35 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:52:36.402201 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1b5a42aa-9132-48de-b41c-03fad6b24180 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:52:36.403117 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1b5a42aa-9132-48de-b41c-03fad6b24180 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:36.411017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b5a42aa-9132-48de-b41c-03fad6b24180 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:36.411513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b5a42aa-9132-48de-b41c-03fad6b24180 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:36.412308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b5a42aa-9132-48de-b41c-03fad6b24180 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:36.412770 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1b5a42aa-9132-48de-b41c-03fad6b24180 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:36.461049 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1b5a42aa-9132-48de-b41c-03fad6b24180 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5/action" status: 200 len: 32646 microversion: 2.1 time: 0.062687 May 28 05:52:36.461710 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3827/7766] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:52:36 2022] POST /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5/action => generated 32646 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:52:36.473326 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-42931ad5-5156-4532-99ec-9f6f26a625b4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:52:36.473879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-42931ad5-5156-4532-99ec-9f6f26a625b4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:36.481070 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42931ad5-5156-4532-99ec-9f6f26a625b4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:36.481563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42931ad5-5156-4532-99ec-9f6f26a625b4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:36.482345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42931ad5-5156-4532-99ec-9f6f26a625b4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:36.482797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-42931ad5-5156-4532-99ec-9f6f26a625b4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:36.665465 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-42931ad5-5156-4532-99ec-9f6f26a625b4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5/action" status: 202 len: 0 microversion: 2.1 time: 0.196214 May 28 05:52:36.666052 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3940/7767] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:52:36 2022] POST /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:52:36.674941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-08872f5c-6c90-4ab5-b35e-affdaa4df78c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:52:36.675696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-08872f5c-6c90-4ab5-b35e-affdaa4df78c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:36.683742 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-08872f5c-6c90-4ab5-b35e-affdaa4df78c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:36.684224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-08872f5c-6c90-4ab5-b35e-affdaa4df78c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:36.685023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-08872f5c-6c90-4ab5-b35e-affdaa4df78c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:36.685484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-08872f5c-6c90-4ab5-b35e-affdaa4df78c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:36.818068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-08872f5c-6c90-4ab5-b35e-affdaa4df78c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:52:36.826261 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-08872f5c-6c90-4ab5-b35e-affdaa4df78c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1675 microversion: 2.1 time: 0.155585 May 28 05:52:36.826835 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3828/7768] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:52:36 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:52:37.844552 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-93358079-8745-4aa4-930c-a7d1fe7c9c16 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:52:37.845291 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-93358079-8745-4aa4-930c-a7d1fe7c9c16 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:37.851618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93358079-8745-4aa4-930c-a7d1fe7c9c16 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:37.852079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93358079-8745-4aa4-930c-a7d1fe7c9c16 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:37.852844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93358079-8745-4aa4-930c-a7d1fe7c9c16 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:37.853284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-93358079-8745-4aa4-930c-a7d1fe7c9c16 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:37.981719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-93358079-8745-4aa4-930c-a7d1fe7c9c16 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:52:37.989262 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-93358079-8745-4aa4-930c-a7d1fe7c9c16 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1683 microversion: 2.1 time: 0.149853 May 28 05:52:37.989837 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3941/7769] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:52:37 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:52:38.085268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cabe8b05-83e5-402c-897c-65005fb4b6e4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:52:38.086214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cabe8b05-83e5-402c-897c-65005fb4b6e4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:38.093928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cabe8b05-83e5-402c-897c-65005fb4b6e4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:38.094393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cabe8b05-83e5-402c-897c-65005fb4b6e4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:38.095275 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cabe8b05-83e5-402c-897c-65005fb4b6e4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:38.095658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cabe8b05-83e5-402c-897c-65005fb4b6e4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:38.144235 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cabe8b05-83e5-402c-897c-65005fb4b6e4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5/action" status: 200 len: 35486 microversion: 2.1 time: 0.063325 May 28 05:52:38.144914 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3829/7770] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:52:38 2022] POST /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5/action => generated 35486 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:52:39.221328 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c00acfc1-99ac-4afa-95ce-ad215067f17b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:52:39.221879 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c00acfc1-99ac-4afa-95ce-ad215067f17b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:39.225709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-243f9d13-2bb0-4739-b028-7447932f5610 req-196a947a-41f4-4144-ac82-20a842b39241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3285838e-82d4-4884-ba55-6db7320afaf5", "tag": "b7a737de-e278-415f-90c6-3866dd6f72e9"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:52:39.229492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c00acfc1-99ac-4afa-95ce-ad215067f17b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:39.229996 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c00acfc1-99ac-4afa-95ce-ad215067f17b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:39.230769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c00acfc1-99ac-4afa-95ce-ad215067f17b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:39.231232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c00acfc1-99ac-4afa-95ce-ad215067f17b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:39.236570 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-243f9d13-2bb0-4739-b028-7447932f5610 req-196a947a-41f4-4144-ac82-20a842b39241 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:39.237236 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-243f9d13-2bb0-4739-b028-7447932f5610 req-196a947a-41f4-4144-ac82-20a842b39241 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:39.249713 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-243f9d13-2bb0-4739-b028-7447932f5610 req-196a947a-41f4-4144-ac82-20a842b39241 service nova] Creating event network-changed:b7a737de-e278-415f-90c6-3866dd6f72e9 for instance 3285838e-82d4-4884-ba55-6db7320afaf5 on n-h2-843700-1 May 28 05:52:39.255694 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-243f9d13-2bb0-4739-b028-7447932f5610 req-196a947a-41f4-4144-ac82-20a842b39241 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034823 May 28 05:52:39.256845 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3830/7771] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:52:39.258809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c00acfc1-99ac-4afa-95ce-ad215067f17b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:52:39.576445 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c00acfc1-99ac-4afa-95ce-ad215067f17b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 204 len: 0 microversion: 2.1 time: 0.358958 May 28 05:52:39.577520 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3942/7772] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:52:39 2022] DELETE /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:52:39.586949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6f71184c-1378-4726-9931-34d84d703dd4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:52:39.588200 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6f71184c-1378-4726-9931-34d84d703dd4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:39.596070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f71184c-1378-4726-9931-34d84d703dd4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:39.596893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f71184c-1378-4726-9931-34d84d703dd4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:39.598086 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f71184c-1378-4726-9931-34d84d703dd4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:39.599183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6f71184c-1378-4726-9931-34d84d703dd4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:39.764162 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6f71184c-1378-4726-9931-34d84d703dd4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:52:39.772563 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6f71184c-1378-4726-9931-34d84d703dd4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1689 microversion: 2.1 time: 0.190741 May 28 05:52:39.773144 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3831/7773] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:52:39 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:52:40.790775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-37b5d879-82e1-4e08-acc8-34247232f8ab tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:52:40.792782 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-37b5d879-82e1-4e08-acc8-34247232f8ab tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:40.798583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-37b5d879-82e1-4e08-acc8-34247232f8ab tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:40.799073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-37b5d879-82e1-4e08-acc8-34247232f8ab tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:40.799844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-37b5d879-82e1-4e08-acc8-34247232f8ab tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:40.800288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-37b5d879-82e1-4e08-acc8-34247232f8ab tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:41.009422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-37b5d879-82e1-4e08-acc8-34247232f8ab tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:52:41.017164 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-37b5d879-82e1-4e08-acc8-34247232f8ab tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1689 microversion: 2.1 time: 0.230693 May 28 05:52:41.017750 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3943/7774] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:52:40 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1689 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:52:41.661894 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-d814d5a5-86b9-4b4b-8d6f-d516a00c6faa req-6a309a30-5dc9-468e-bb4d-aafe5c722e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3285838e-82d4-4884-ba55-6db7320afaf5", "name": "network-vif-deleted", "tag": "b7a737de-e278-415f-90c6-3866dd6f72e9"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:52:41.671466 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d814d5a5-86b9-4b4b-8d6f-d516a00c6faa req-6a309a30-5dc9-468e-bb4d-aafe5c722e64 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:41.676103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d814d5a5-86b9-4b4b-8d6f-d516a00c6faa req-6a309a30-5dc9-468e-bb4d-aafe5c722e64 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:41.683892 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-d814d5a5-86b9-4b4b-8d6f-d516a00c6faa req-6a309a30-5dc9-468e-bb4d-aafe5c722e64 service nova] Creating event network-vif-deleted:b7a737de-e278-415f-90c6-3866dd6f72e9 for instance 3285838e-82d4-4884-ba55-6db7320afaf5 on n-h2-843700-1 May 28 05:52:41.688939 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-d814d5a5-86b9-4b4b-8d6f-d516a00c6faa req-6a309a30-5dc9-468e-bb4d-aafe5c722e64 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031457 May 28 05:52:41.689528 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3832/7775] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:52:42.035491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bb6d4843-07e0-40e6-991f-03a3da3adf23 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:52:42.036273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bb6d4843-07e0-40e6-991f-03a3da3adf23 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:42.044053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb6d4843-07e0-40e6-991f-03a3da3adf23 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:42.044513 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb6d4843-07e0-40e6-991f-03a3da3adf23 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:42.045320 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb6d4843-07e0-40e6-991f-03a3da3adf23 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:42.045754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb6d4843-07e0-40e6-991f-03a3da3adf23 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:42.078319 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb6d4843-07e0-40e6-991f-03a3da3adf23 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:42.078771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bb6d4843-07e0-40e6-991f-03a3da3adf23 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:42.079239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-bb6d4843-07e0-40e6-991f-03a3da3adf23 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lazy-loading 'fault' on Instance uuid 3285838e-82d4-4884-ba55-6db7320afaf5 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:52:42.123954 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bb6d4843-07e0-40e6-991f-03a3da3adf23 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:52:42.131812 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bb6d4843-07e0-40e6-991f-03a3da3adf23 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 200 len: 1357 microversion: 2.1 time: 0.100209 May 28 05:52:42.132384 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3944/7776] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:52:42 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 1357 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:52:43.149909 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f7d4afee-50b9-46ef-834f-a00d02a3c384 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:52:43.150622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f7d4afee-50b9-46ef-834f-a00d02a3c384 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 3285838e-82d4-4884-ba55-6db7320afaf5] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:43.156911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7d4afee-50b9-46ef-834f-a00d02a3c384 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:43.157409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7d4afee-50b9-46ef-834f-a00d02a3c384 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:43.158177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7d4afee-50b9-46ef-834f-a00d02a3c384 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:43.158627 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7d4afee-50b9-46ef-834f-a00d02a3c384 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:43.172208 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-f7d4afee-50b9-46ef-834f-a00d02a3c384 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] HTTP exception thrown: Instance 3285838e-82d4-4884-ba55-6db7320afaf5 could not be found. May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f7d4afee-50b9-46ef-834f-a00d02a3c384 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Request method failure captured: May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 HTTP/1.1 May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbhqOgVkVYlgtcjZ8mDe_IQDNUqxx11YvunBU1SK3vtlWX-R-IzWraGt8vkjovszbapQtf3pdd97wuZwcsk_aAT7NxFm4DWf5-O7ZGW38a5Y5ysvAizQD5f24_6jK5aEpE_iFnq4qzGXIoYl5ta8zTN4fYRXo_WPUfWUhgxulf_h-tU May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 8df3b01779bd4e198777ddc16182cda3 May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1455991122 May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8df3b01779bd4e198777ddc16182cda3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8df3b01779bd4e198777ddc16182cda3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8df3b01779bd4e198777ddc16182cda3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8df3b01779bd4e198777ddc16182cda3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1455991122 May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 8df3b01779bd4e198777ddc16182cda3 May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1455991122 May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestNetworkAdvancedServerOps-1455991122-project May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 1bcabf3cdb7c4f02a50aeb508775222a May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1455991122-project May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 3285838e-82d4-4884-ba55-6db7320afaf5 could not be found. May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '3285838e-82d4-4884-ba55-6db7320afaf5'} May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3285838e-82d4-4884-ba55-6db7320afaf5 could not be found. May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3285838e-82d4-4884-ba55-6db7320afaf5 could not be found. May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:52:43.173816 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:52:43.178688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:52:43.178688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:52:43.178688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:52:43.178688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:52:43.178688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:52:43.178688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:52:43.178688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3285838e-82d4-4884-ba55-6db7320afaf5 could not be found. May 28 05:52:43.178688 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:52:43.178688 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f7d4afee-50b9-46ef-834f-a00d02a3c384 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Returning 404 to user: Instance 3285838e-82d4-4884-ba55-6db7320afaf5 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:52:43.178688 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f7d4afee-50b9-46ef-834f-a00d02a3c384 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5" status: 404 len: 111 microversion: 2.1 time: 0.030405 May 28 05:52:43.178688 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3833/7777] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:52:43 2022] GET /compute/v2.1/servers/3285838e-82d4-4884-ba55-6db7320afaf5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:52:46.929725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b2a34b4f-c4f5-4d53-9d14-b19b238c9fca tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '.version_select at 0x7f77006161f0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:52:47.010502 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b2a34b4f-c4f5-4d53-9d14-b19b238c9fca tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1313315923" status: 202 len: 0 microversion: 2.1 time: 0.085394 May 28 05:52:47.011136 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3945/7778] 10.222.0.58 () {58 vars in 1283 bytes} [Sat May 28 05:52:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1313315923 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:52:47.038895 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e2371a0a-9dce-47e3-9e85-68fa81f8f7f7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'create', calling method: .version_select at 0x7f77021cf280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-17101592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAinqS0Kz8dIdebeSomQq9/5AoqiM5H9lELJ0FintqMzIZplIunjRTXHYuRMY4PJm89oMundpaPxV9zh4CLexU/M5g7d22SxXX7JoPkYeA/l6RuIkw1REwLxZ2bQQvLGUQ=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:52:47.054691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-e2371a0a-9dce-47e3-9e85-68fa81f8f7f7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Getting quotas for project 8df3b01779bd4e198777ddc16182cda3. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:52:47.060837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-e2371a0a-9dce-47e3-9e85-68fa81f8f7f7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Getting quotas for user 1bcabf3cdb7c4f02a50aeb508775222a and project 8df3b01779bd4e198777ddc16182cda3. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:52:47.143133 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e2371a0a-9dce-47e3-9e85-68fa81f8f7f7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.109881 May 28 05:52:47.144041 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3834/7779] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 05:52:47 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:52:54.933349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:52:54.938253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-41ab0eb4-739a-4ad7-bb73-b77306ca3b72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-97328142", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "ab4a101e-c7b4-410a-a8aa-f16972997b1d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-17101592", "security_groups": [{"name": "tempest-secgroup-smoke-457942481"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:52:55.203978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-41ab0eb4-739a-4ad7-bb73-b77306ca3b72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] validate_networks() for [('ab4a101e-c7b4-410a-a8aa-f16972997b1d', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:52:55.628852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-41ab0eb4-739a-4ad7-bb73-b77306ca3b72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:52:55.629281 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-41ab0eb4-739a-4ad7-bb73-b77306ca3b72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:52:55.629818 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-41ab0eb4-739a-4ad7-bb73-b77306ca3b72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:52:55.630936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-41ab0eb4-739a-4ad7-bb73-b77306ca3b72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:52:55.631392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-41ab0eb4-739a-4ad7-bb73-b77306ca3b72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:52:55.640585 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41ab0eb4-739a-4ad7-bb73-b77306ca3b72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:55.641046 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41ab0eb4-739a-4ad7-bb73-b77306ca3b72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:55.641854 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41ab0eb4-739a-4ad7-bb73-b77306ca3b72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:55.642298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41ab0eb4-739a-4ad7-bb73-b77306ca3b72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:55.659597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-41ab0eb4-739a-4ad7-bb73-b77306ca3b72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Getting quotas for project 8df3b01779bd4e198777ddc16182cda3. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:52:55.665168 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-41ab0eb4-739a-4ad7-bb73-b77306ca3b72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Getting quotas for user 1bcabf3cdb7c4f02a50aeb508775222a and project 8df3b01779bd4e198777ddc16182cda3. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:52:55.677959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-41ab0eb4-739a-4ad7-bb73-b77306ca3b72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:52:55.680298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-41ab0eb4-739a-4ad7-bb73-b77306ca3b72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:52:55.807077 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-41ab0eb4-739a-4ad7-bb73-b77306ca3b72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.875208 May 28 05:52:55.807782 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3946/7780] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:52:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 05:52:55.819031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e6105586-c432-4fce-8f30-1d0a2789d5f5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:52:55.819738 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e6105586-c432-4fce-8f30-1d0a2789d5f5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:55.824901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=36 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:52:55.939633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e6105586-c432-4fce-8f30-1d0a2789d5f5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:52:55.946887 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e6105586-c432-4fce-8f30-1d0a2789d5f5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1263 microversion: 2.1 time: 0.132493 May 28 05:52:55.947774 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3835/7781] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:52:55 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1263 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:52:56.965185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4d9f40a0-715e-47d8-8c9a-eea946a2b9c6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:52:56.965917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4d9f40a0-715e-47d8-8c9a-eea946a2b9c6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:56.979262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d9f40a0-715e-47d8-8c9a-eea946a2b9c6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:56.979731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d9f40a0-715e-47d8-8c9a-eea946a2b9c6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:56.980531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d9f40a0-715e-47d8-8c9a-eea946a2b9c6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:56.980990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d9f40a0-715e-47d8-8c9a-eea946a2b9c6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:57.051389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4d9f40a0-715e-47d8-8c9a-eea946a2b9c6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:52:57.060484 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4d9f40a0-715e-47d8-8c9a-eea946a2b9c6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1267 microversion: 2.1 time: 0.099527 May 28 05:52:57.062492 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3947/7782] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:52:56 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1267 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:52:58.079479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2d5556df-68fa-4a5b-bde2-6895c2214ae0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:52:58.080703 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2d5556df-68fa-4a5b-bde2-6895c2214ae0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:58.089107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d5556df-68fa-4a5b-bde2-6895c2214ae0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:58.089839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d5556df-68fa-4a5b-bde2-6895c2214ae0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:58.090632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d5556df-68fa-4a5b-bde2-6895c2214ae0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:58.091323 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d5556df-68fa-4a5b-bde2-6895c2214ae0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:58.163029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2d5556df-68fa-4a5b-bde2-6895c2214ae0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:52:58.170569 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2d5556df-68fa-4a5b-bde2-6895c2214ae0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1321 microversion: 2.1 time: 0.095041 May 28 05:52:58.171179 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3836/7783] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:52:58 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1321 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:52:59.192515 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cfd4b334-aa97-4340-a869-3f37df1848c2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:52:59.193158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cfd4b334-aa97-4340-a869-3f37df1848c2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:52:59.200227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfd4b334-aa97-4340-a869-3f37df1848c2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:59.200692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfd4b334-aa97-4340-a869-3f37df1848c2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:59.201471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfd4b334-aa97-4340-a869-3f37df1848c2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:59.201918 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cfd4b334-aa97-4340-a869-3f37df1848c2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:59.432840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cfd4b334-aa97-4340-a869-3f37df1848c2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:52:59.441017 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cfd4b334-aa97-4340-a869-3f37df1848c2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1388 microversion: 2.1 time: 0.252502 May 28 05:52:59.441851 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3948/7784] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:52:59 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1388 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:52:59.622859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-10ab7285-254f-4c94-9fcb-316743f9dead req-10ac9745-c21f-4294-a93d-242ece3beec9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87dc3ec0-4588-46b2-a9c5-373ac352ca25", "tag": "38a9d2ec-1ccd-4ebf-8b82-5161ef06a4f3"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:52:59.635126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-10ab7285-254f-4c94-9fcb-316743f9dead req-10ac9745-c21f-4294-a93d-242ece3beec9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:52:59.635611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-10ab7285-254f-4c94-9fcb-316743f9dead req-10ac9745-c21f-4294-a93d-242ece3beec9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:52:59.657057 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-10ab7285-254f-4c94-9fcb-316743f9dead req-10ac9745-c21f-4294-a93d-242ece3beec9 service nova] Creating event network-changed:38a9d2ec-1ccd-4ebf-8b82-5161ef06a4f3 for instance 87dc3ec0-4588-46b2-a9c5-373ac352ca25 on n-h1-843700-1 May 28 05:52:59.662484 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-10ab7285-254f-4c94-9fcb-316743f9dead req-10ac9745-c21f-4294-a93d-242ece3beec9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043899 May 28 05:52:59.663133 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3837/7785] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:53:00.458216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2f5aaca8-5b16-4f91-9f04-20c3f32c89d1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:00.458836 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2f5aaca8-5b16-4f91-9f04-20c3f32c89d1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:00.465597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f5aaca8-5b16-4f91-9f04-20c3f32c89d1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:00.466058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f5aaca8-5b16-4f91-9f04-20c3f32c89d1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:00.466838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f5aaca8-5b16-4f91-9f04-20c3f32c89d1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:00.467306 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2f5aaca8-5b16-4f91-9f04-20c3f32c89d1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:00.602430 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2f5aaca8-5b16-4f91-9f04-20c3f32c89d1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:00.610005 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2f5aaca8-5b16-4f91-9f04-20c3f32c89d1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1388 microversion: 2.1 time: 0.155806 May 28 05:53:00.610584 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3949/7786] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:00 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1388 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:01.627955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c96210dc-773b-4382-b667-7079a1560b37 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:01.628701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c96210dc-773b-4382-b667-7079a1560b37 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:01.636457 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c96210dc-773b-4382-b667-7079a1560b37 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:01.636933 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c96210dc-773b-4382-b667-7079a1560b37 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:01.637717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c96210dc-773b-4382-b667-7079a1560b37 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:01.638173 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c96210dc-773b-4382-b667-7079a1560b37 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:01.766571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c96210dc-773b-4382-b667-7079a1560b37 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:01.774370 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c96210dc-773b-4382-b667-7079a1560b37 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1388 microversion: 2.1 time: 0.151018 May 28 05:53:01.774948 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3838/7787] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:01 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1388 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:02.791257 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d19c24a0-0c30-47cc-9fba-4be8670de653 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:02.791839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d19c24a0-0c30-47cc-9fba-4be8670de653 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:02.798813 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d19c24a0-0c30-47cc-9fba-4be8670de653 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:02.799316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d19c24a0-0c30-47cc-9fba-4be8670de653 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:02.800095 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d19c24a0-0c30-47cc-9fba-4be8670de653 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:02.800541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d19c24a0-0c30-47cc-9fba-4be8670de653 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:02.930543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d19c24a0-0c30-47cc-9fba-4be8670de653 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:02.938081 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d19c24a0-0c30-47cc-9fba-4be8670de653 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1388 microversion: 2.1 time: 0.150890 May 28 05:53:02.938646 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3950/7788] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:02 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1388 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:03.956455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f259eebc-52e5-4544-9dc3-fbb76bc49dcb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:03.957088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f259eebc-52e5-4544-9dc3-fbb76bc49dcb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:03.964641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f259eebc-52e5-4544-9dc3-fbb76bc49dcb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:03.965112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f259eebc-52e5-4544-9dc3-fbb76bc49dcb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:03.965901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f259eebc-52e5-4544-9dc3-fbb76bc49dcb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:03.966356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f259eebc-52e5-4544-9dc3-fbb76bc49dcb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:04.097245 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f259eebc-52e5-4544-9dc3-fbb76bc49dcb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:04.105466 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f259eebc-52e5-4544-9dc3-fbb76bc49dcb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1388 microversion: 2.1 time: 0.153056 May 28 05:53:04.106048 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3839/7789] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:03 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1388 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:05.123110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a1c91ba3-475a-42b1-aef3-3972298f003b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:05.123758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a1c91ba3-475a-42b1-aef3-3972298f003b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:05.126876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:53:05.133019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1c91ba3-475a-42b1-aef3-3972298f003b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:05.133491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1c91ba3-475a-42b1-aef3-3972298f003b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:05.134282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1c91ba3-475a-42b1-aef3-3972298f003b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:05.134729 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a1c91ba3-475a-42b1-aef3-3972298f003b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:05.270232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a1c91ba3-475a-42b1-aef3-3972298f003b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:05.278474 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a1c91ba3-475a-42b1-aef3-3972298f003b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1388 microversion: 2.1 time: 0.159328 May 28 05:53:05.279085 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3951/7790] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:05 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1388 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:05.399831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-9dcf690e-66a0-46f3-bfc7-baf70228f1d7 req-de1633a6-acdf-4778-9c26-725a3bf56ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87dc3ec0-4588-46b2-a9c5-373ac352ca25", "name": "network-vif-plugged", "status": "completed", "tag": "38a9d2ec-1ccd-4ebf-8b82-5161ef06a4f3"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:53:05.403674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:53:05.409119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9dcf690e-66a0-46f3-bfc7-baf70228f1d7 req-de1633a6-acdf-4778-9c26-725a3bf56ffc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:05.409592 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9dcf690e-66a0-46f3-bfc7-baf70228f1d7 req-de1633a6-acdf-4778-9c26-725a3bf56ffc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:05.420472 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-9dcf690e-66a0-46f3-bfc7-baf70228f1d7 req-de1633a6-acdf-4778-9c26-725a3bf56ffc service nova] Creating event network-vif-plugged:38a9d2ec-1ccd-4ebf-8b82-5161ef06a4f3 for instance 87dc3ec0-4588-46b2-a9c5-373ac352ca25 on n-h1-843700-1 May 28 05:53:05.425919 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-9dcf690e-66a0-46f3-bfc7-baf70228f1d7 req-de1633a6-acdf-4778-9c26-725a3bf56ffc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087337 May 28 05:53:05.427254 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3840/7791] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:53:06.296256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3c70c74a-1cb2-4799-82b2-3ac7ef7744e7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:06.296878 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3c70c74a-1cb2-4799-82b2-3ac7ef7744e7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:06.298664 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:53:06.299347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:53:06.305164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c70c74a-1cb2-4799-82b2-3ac7ef7744e7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:06.305626 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c70c74a-1cb2-4799-82b2-3ac7ef7744e7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:06.306401 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c70c74a-1cb2-4799-82b2-3ac7ef7744e7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:06.306846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c70c74a-1cb2-4799-82b2-3ac7ef7744e7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:06.437147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3c70c74a-1cb2-4799-82b2-3ac7ef7744e7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:06.445240 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3c70c74a-1cb2-4799-82b2-3ac7ef7744e7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1388 microversion: 2.1 time: 0.153684 May 28 05:53:06.445950 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3952/7792] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:06 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1388 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:07.460086 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:53:07.465059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-04f3dc52-6709-4b76-b3f3-3e8bf32b5d9e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:07.465782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-04f3dc52-6709-4b76-b3f3-3e8bf32b5d9e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:07.472476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-04f3dc52-6709-4b76-b3f3-3e8bf32b5d9e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:07.472955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-04f3dc52-6709-4b76-b3f3-3e8bf32b5d9e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:07.473751 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-04f3dc52-6709-4b76-b3f3-3e8bf32b5d9e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:07.474211 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-04f3dc52-6709-4b76-b3f3-3e8bf32b5d9e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:07.606977 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-04f3dc52-6709-4b76-b3f3-3e8bf32b5d9e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:07.614623 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-04f3dc52-6709-4b76-b3f3-3e8bf32b5d9e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1560 microversion: 2.1 time: 0.156159 May 28 05:53:07.615252 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3841/7793] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:07 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:07.631373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-de85267a-3f3c-4a27-975b-f3aa317c9ab2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:07.631990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-de85267a-3f3c-4a27-975b-f3aa317c9ab2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:07.639086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de85267a-3f3c-4a27-975b-f3aa317c9ab2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:07.639578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de85267a-3f3c-4a27-975b-f3aa317c9ab2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:07.640339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de85267a-3f3c-4a27-975b-f3aa317c9ab2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:07.640777 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-de85267a-3f3c-4a27-975b-f3aa317c9ab2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:07.771076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-de85267a-3f3c-4a27-975b-f3aa317c9ab2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:07.779439 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-de85267a-3f3c-4a27-975b-f3aa317c9ab2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1560 microversion: 2.1 time: 0.152287 May 28 05:53:07.780029 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3953/7794] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:07 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:10.142120 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1347cabf-edb0-440f-b783-8ed9b4dff7b0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:10.143461 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1347cabf-edb0-440f-b783-8ed9b4dff7b0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:10.145201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-f4a6085c-8143-4eaa-86e4-44a43ac2af94 req-fe1ea645-39df-49d2-a77c-7abee7c6e90a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87dc3ec0-4588-46b2-a9c5-373ac352ca25", "tag": "38a9d2ec-1ccd-4ebf-8b82-5161ef06a4f3"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:53:10.151036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1347cabf-edb0-440f-b783-8ed9b4dff7b0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:10.151728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1347cabf-edb0-440f-b783-8ed9b4dff7b0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:10.152538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1347cabf-edb0-440f-b783-8ed9b4dff7b0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:10.153002 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1347cabf-edb0-440f-b783-8ed9b4dff7b0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:10.155129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f4a6085c-8143-4eaa-86e4-44a43ac2af94 req-fe1ea645-39df-49d2-a77c-7abee7c6e90a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:10.155655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f4a6085c-8143-4eaa-86e4-44a43ac2af94 req-fe1ea645-39df-49d2-a77c-7abee7c6e90a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:10.168049 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-f4a6085c-8143-4eaa-86e4-44a43ac2af94 req-fe1ea645-39df-49d2-a77c-7abee7c6e90a service nova] Creating event network-changed:38a9d2ec-1ccd-4ebf-8b82-5161ef06a4f3 for instance 87dc3ec0-4588-46b2-a9c5-373ac352ca25 on n-h1-843700-1 May 28 05:53:10.173093 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-f4a6085c-8143-4eaa-86e4-44a43ac2af94 req-fe1ea645-39df-49d2-a77c-7abee7c6e90a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032694 May 28 05:53:10.174095 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3954/7795] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:53:10.376677 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1347cabf-edb0-440f-b783-8ed9b4dff7b0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:10.384776 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1347cabf-edb0-440f-b783-8ed9b4dff7b0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1560 microversion: 2.1 time: 0.246585 May 28 05:53:10.385486 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3842/7796] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:10 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1560 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:31.613217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=7 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:53:31.614008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=46 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:53:31.618186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-033bf3f3-25de-487b-8969-649d48c472d6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:53:31.619289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-033bf3f3-25de-487b-8969-649d48c472d6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:31.625373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-033bf3f3-25de-487b-8969-649d48c472d6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:31.626462 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-033bf3f3-25de-487b-8969-649d48c472d6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:31.627109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-033bf3f3-25de-487b-8969-649d48c472d6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:31.627555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-033bf3f3-25de-487b-8969-649d48c472d6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:31.682869 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-033bf3f3-25de-487b-8969-649d48c472d6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25/action" status: 200 len: 24569 microversion: 2.1 time: 0.071469 May 28 05:53:31.683535 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3955/7797] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:53:31 2022] POST /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25/action => generated 24569 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:53:42.774763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a98fd316-87bf-4df7-8b74-9ea5302313c4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:53:42.775763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a98fd316-87bf-4df7-8b74-9ea5302313c4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:42.778139 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=5 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:53:42.778843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=34 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:53:42.783683 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a98fd316-87bf-4df7-8b74-9ea5302313c4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:42.784169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a98fd316-87bf-4df7-8b74-9ea5302313c4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:42.784941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a98fd316-87bf-4df7-8b74-9ea5302313c4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:42.785398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a98fd316-87bf-4df7-8b74-9ea5302313c4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:43.041692 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a98fd316-87bf-4df7-8b74-9ea5302313c4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25/action" status: 202 len: 0 microversion: 2.1 time: 0.271238 May 28 05:53:43.042408 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3843/7798] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:53:42 2022] POST /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:53:43.051273 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6e1be198-a480-4e2d-8238-d5c9b916ecd1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:43.051990 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6e1be198-a480-4e2d-8238-d5c9b916ecd1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:43.055508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:53:43.056163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:53:43.061478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e1be198-a480-4e2d-8238-d5c9b916ecd1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:43.061961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e1be198-a480-4e2d-8238-d5c9b916ecd1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:43.062744 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e1be198-a480-4e2d-8238-d5c9b916ecd1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:43.064110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6e1be198-a480-4e2d-8238-d5c9b916ecd1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:43.199405 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6e1be198-a480-4e2d-8238-d5c9b916ecd1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:43.207577 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6e1be198-a480-4e2d-8238-d5c9b916ecd1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1670 microversion: 2.1 time: 0.160619 May 28 05:53:43.208166 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3956/7799] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:43 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:44.229358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0b75cc20-e3f3-4cc7-b61a-50e899f7953c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:44.230097 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0b75cc20-e3f3-4cc7-b61a-50e899f7953c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:44.236621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b75cc20-e3f3-4cc7-b61a-50e899f7953c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:44.239280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b75cc20-e3f3-4cc7-b61a-50e899f7953c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:44.239280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b75cc20-e3f3-4cc7-b61a-50e899f7953c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:44.239280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0b75cc20-e3f3-4cc7-b61a-50e899f7953c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:44.373893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0b75cc20-e3f3-4cc7-b61a-50e899f7953c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:44.382011 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0b75cc20-e3f3-4cc7-b61a-50e899f7953c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1675 microversion: 2.1 time: 0.160084 May 28 05:53:44.382592 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3844/7800] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:44 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:45.400400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-babd81c6-07c6-44ac-90ce-c835acfc3ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:45.401022 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-babd81c6-07c6-44ac-90ce-c835acfc3ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:45.407992 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-babd81c6-07c6-44ac-90ce-c835acfc3ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:45.408450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-babd81c6-07c6-44ac-90ce-c835acfc3ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:45.409212 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-babd81c6-07c6-44ac-90ce-c835acfc3ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:45.409655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-babd81c6-07c6-44ac-90ce-c835acfc3ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:45.541982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-babd81c6-07c6-44ac-90ce-c835acfc3ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:45.549616 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-babd81c6-07c6-44ac-90ce-c835acfc3ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1675 microversion: 2.1 time: 0.153694 May 28 05:53:45.550215 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3957/7801] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:45 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:46.566883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7f193e80-b806-411d-aae5-0a13014b3fbf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:46.567548 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7f193e80-b806-411d-aae5-0a13014b3fbf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:46.575569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f193e80-b806-411d-aae5-0a13014b3fbf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:46.576038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f193e80-b806-411d-aae5-0a13014b3fbf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:46.576829 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f193e80-b806-411d-aae5-0a13014b3fbf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:46.577282 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f193e80-b806-411d-aae5-0a13014b3fbf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:46.707278 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7f193e80-b806-411d-aae5-0a13014b3fbf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:46.714888 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7f193e80-b806-411d-aae5-0a13014b3fbf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1675 microversion: 2.1 time: 0.151962 May 28 05:53:46.715495 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3845/7802] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:46 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:47.731453 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7bd13ee6-20a8-4639-9269-ca4b49098619 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:47.732075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7bd13ee6-20a8-4639-9269-ca4b49098619 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:47.739049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7bd13ee6-20a8-4639-9269-ca4b49098619 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:47.739464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7bd13ee6-20a8-4639-9269-ca4b49098619 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:47.740234 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7bd13ee6-20a8-4639-9269-ca4b49098619 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:47.740682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7bd13ee6-20a8-4639-9269-ca4b49098619 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:47.872772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7bd13ee6-20a8-4639-9269-ca4b49098619 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:47.880672 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7bd13ee6-20a8-4639-9269-ca4b49098619 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1675 microversion: 2.1 time: 0.153116 May 28 05:53:47.881920 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3958/7803] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:47 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:48.899311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-be1b04ba-f842-44ce-b1af-dc6457584ff8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:48.900076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-be1b04ba-f842-44ce-b1af-dc6457584ff8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:48.907273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-be1b04ba-f842-44ce-b1af-dc6457584ff8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:48.907749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-be1b04ba-f842-44ce-b1af-dc6457584ff8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:48.908544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-be1b04ba-f842-44ce-b1af-dc6457584ff8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:48.909006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-be1b04ba-f842-44ce-b1af-dc6457584ff8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:49.048460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-be1b04ba-f842-44ce-b1af-dc6457584ff8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:49.056414 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-be1b04ba-f842-44ce-b1af-dc6457584ff8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1675 microversion: 2.1 time: 0.161772 May 28 05:53:49.056989 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3846/7804] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:48 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:50.074367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-57277a1a-3382-47a9-9f8c-c042457f90ec tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:50.074982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-57277a1a-3382-47a9-9f8c-c042457f90ec tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:50.082027 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57277a1a-3382-47a9-9f8c-c042457f90ec tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:50.082477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57277a1a-3382-47a9-9f8c-c042457f90ec tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:50.083311 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57277a1a-3382-47a9-9f8c-c042457f90ec tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:50.083747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57277a1a-3382-47a9-9f8c-c042457f90ec tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:50.219202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-57277a1a-3382-47a9-9f8c-c042457f90ec tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:50.227547 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-57277a1a-3382-47a9-9f8c-c042457f90ec tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1675 microversion: 2.1 time: 0.157812 May 28 05:53:50.228140 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3959/7805] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:50 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:51.245959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ec41ed21-c9d0-405d-866a-aba88b71bdfc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:51.246590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ec41ed21-c9d0-405d-866a-aba88b71bdfc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:51.252953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec41ed21-c9d0-405d-866a-aba88b71bdfc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:51.253438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec41ed21-c9d0-405d-866a-aba88b71bdfc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:51.254206 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec41ed21-c9d0-405d-866a-aba88b71bdfc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:51.254659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ec41ed21-c9d0-405d-866a-aba88b71bdfc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:51.382476 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ec41ed21-c9d0-405d-866a-aba88b71bdfc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:51.390038 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ec41ed21-c9d0-405d-866a-aba88b71bdfc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1675 microversion: 2.1 time: 0.148378 May 28 05:53:51.390615 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3847/7806] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:51 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:52.407989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6abe8587-cd76-4eab-a0da-bb2a1e2eff17 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:52.408783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6abe8587-cd76-4eab-a0da-bb2a1e2eff17 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:52.415707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6abe8587-cd76-4eab-a0da-bb2a1e2eff17 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:52.416165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6abe8587-cd76-4eab-a0da-bb2a1e2eff17 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:52.416921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6abe8587-cd76-4eab-a0da-bb2a1e2eff17 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:52.417359 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6abe8587-cd76-4eab-a0da-bb2a1e2eff17 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:52.551596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6abe8587-cd76-4eab-a0da-bb2a1e2eff17 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:52.559687 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6abe8587-cd76-4eab-a0da-bb2a1e2eff17 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1675 microversion: 2.1 time: 0.156108 May 28 05:53:52.560267 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3960/7807] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:52 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:53.577706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1fdbebee-c98d-41c7-8ced-43fba1fbc635 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:53.578328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1fdbebee-c98d-41c7-8ced-43fba1fbc635 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:53.586224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1fdbebee-c98d-41c7-8ced-43fba1fbc635 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:53.586691 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1fdbebee-c98d-41c7-8ced-43fba1fbc635 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:53.587502 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1fdbebee-c98d-41c7-8ced-43fba1fbc635 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:53.587958 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1fdbebee-c98d-41c7-8ced-43fba1fbc635 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:53.715825 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1fdbebee-c98d-41c7-8ced-43fba1fbc635 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:53.723368 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1fdbebee-c98d-41c7-8ced-43fba1fbc635 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1675 microversion: 2.1 time: 0.149598 May 28 05:53:53.723943 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3848/7808] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:53 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:53:54.739817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a579a803-f8bc-490f-802e-24434599dec3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:54.740458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a579a803-f8bc-490f-802e-24434599dec3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:54.747313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a579a803-f8bc-490f-802e-24434599dec3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:54.747769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a579a803-f8bc-490f-802e-24434599dec3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:54.748521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a579a803-f8bc-490f-802e-24434599dec3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:54.748959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a579a803-f8bc-490f-802e-24434599dec3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:54.876422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a579a803-f8bc-490f-802e-24434599dec3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:54.883836 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a579a803-f8bc-490f-802e-24434599dec3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1675 microversion: 2.1 time: 0.147970 May 28 05:53:54.884411 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3961/7809] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:54 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:55.901159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bb4fb26c-7ab0-4b13-b20c-a1637e42c78d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:55.901824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bb4fb26c-7ab0-4b13-b20c-a1637e42c78d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:55.908924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb4fb26c-7ab0-4b13-b20c-a1637e42c78d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:55.909396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb4fb26c-7ab0-4b13-b20c-a1637e42c78d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:55.910181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb4fb26c-7ab0-4b13-b20c-a1637e42c78d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:55.910641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb4fb26c-7ab0-4b13-b20c-a1637e42c78d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:56.044169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bb4fb26c-7ab0-4b13-b20c-a1637e42c78d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:56.051774 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bb4fb26c-7ab0-4b13-b20c-a1637e42c78d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1675 microversion: 2.1 time: 0.154880 May 28 05:53:56.052357 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3849/7810] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:55 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:57.069559 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-85547768-5ffb-4e01-9d9d-e6959ec2db08 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:57.070169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-85547768-5ffb-4e01-9d9d-e6959ec2db08 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:57.077150 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-85547768-5ffb-4e01-9d9d-e6959ec2db08 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:57.077605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-85547768-5ffb-4e01-9d9d-e6959ec2db08 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:57.078361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-85547768-5ffb-4e01-9d9d-e6959ec2db08 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:57.078797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-85547768-5ffb-4e01-9d9d-e6959ec2db08 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:57.209316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-85547768-5ffb-4e01-9d9d-e6959ec2db08 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:57.216834 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-85547768-5ffb-4e01-9d9d-e6959ec2db08 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1675 microversion: 2.1 time: 0.151741 May 28 05:53:57.217368 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3962/7811] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:57 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:53:58.234628 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fa612e05-3d0e-4c1f-9e40-a87a19a8950f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:58.235305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fa612e05-3d0e-4c1f-9e40-a87a19a8950f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:58.242418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa612e05-3d0e-4c1f-9e40-a87a19a8950f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:58.242896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa612e05-3d0e-4c1f-9e40-a87a19a8950f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:58.243714 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa612e05-3d0e-4c1f-9e40-a87a19a8950f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:58.244179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fa612e05-3d0e-4c1f-9e40-a87a19a8950f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:58.379586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fa612e05-3d0e-4c1f-9e40-a87a19a8950f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:58.387742 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fa612e05-3d0e-4c1f-9e40-a87a19a8950f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1675 microversion: 2.1 time: 0.157089 May 28 05:53:58.388348 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3850/7812] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:58 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:53:59.404967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6281f6ee-a05f-406f-927f-849168cca587 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:53:59.405584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6281f6ee-a05f-406f-927f-849168cca587 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:53:59.413121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6281f6ee-a05f-406f-927f-849168cca587 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:59.413571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6281f6ee-a05f-406f-927f-849168cca587 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:59.414329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6281f6ee-a05f-406f-927f-849168cca587 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:53:59.414766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6281f6ee-a05f-406f-927f-849168cca587 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:53:59.548378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6281f6ee-a05f-406f-927f-849168cca587 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:53:59.556850 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6281f6ee-a05f-406f-927f-849168cca587 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1675 microversion: 2.1 time: 0.155795 May 28 05:53:59.557437 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3963/7813] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:53:59 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:54:00.574557 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1cdcae0e-5dd9-4265-b36c-830ea87e035e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:54:00.575225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1cdcae0e-5dd9-4265-b36c-830ea87e035e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:54:00.582351 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cdcae0e-5dd9-4265-b36c-830ea87e035e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:00.582883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cdcae0e-5dd9-4265-b36c-830ea87e035e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:00.583707 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cdcae0e-5dd9-4265-b36c-830ea87e035e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:00.584174 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1cdcae0e-5dd9-4265-b36c-830ea87e035e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:00.711470 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1cdcae0e-5dd9-4265-b36c-830ea87e035e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:54:00.719101 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1cdcae0e-5dd9-4265-b36c-830ea87e035e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1678 microversion: 2.1 time: 0.148483 May 28 05:54:00.719790 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3851/7814] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:54:00 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:54:24.902380 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-58007c60-77fa-454f-9dc2-3ea69cff03ed tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:54:24.903354 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-58007c60-77fa-454f-9dc2-3ea69cff03ed tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:54:24.905398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=16 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:54:24.906074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=48 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:54:24.911414 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58007c60-77fa-454f-9dc2-3ea69cff03ed tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:24.911886 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58007c60-77fa-454f-9dc2-3ea69cff03ed tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:24.912660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58007c60-77fa-454f-9dc2-3ea69cff03ed tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:24.913109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-58007c60-77fa-454f-9dc2-3ea69cff03ed tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:24.966017 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-58007c60-77fa-454f-9dc2-3ea69cff03ed tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25/action" status: 200 len: 69353 microversion: 2.1 time: 0.067716 May 28 05:54:24.966692 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3964/7815] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:54:24 2022] POST /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25/action => generated 69353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:54:29.738761 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:54:29.739265 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 05:54:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:54:32.436051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f3b8625f-3ee9-4a5d-9999-f34254f00d1e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:54:32.436892 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f3b8625f-3ee9-4a5d-9999-f34254f00d1e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:54:32.438153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-afcace61-5af6-4832-b50f-855ffdb8cf44 req-b92a4421-8ff2-4629-ac3c-5d073e78340e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87dc3ec0-4588-46b2-a9c5-373ac352ca25", "tag": "38a9d2ec-1ccd-4ebf-8b82-5161ef06a4f3"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:54:32.440729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=18 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:54:32.441503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:54:32.446112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3b8625f-3ee9-4a5d-9999-f34254f00d1e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:32.446811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3b8625f-3ee9-4a5d-9999-f34254f00d1e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:32.447917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3b8625f-3ee9-4a5d-9999-f34254f00d1e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:32.448259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f3b8625f-3ee9-4a5d-9999-f34254f00d1e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:32.449384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-afcace61-5af6-4832-b50f-855ffdb8cf44 req-b92a4421-8ff2-4629-ac3c-5d073e78340e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:32.449844 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-afcace61-5af6-4832-b50f-855ffdb8cf44 req-b92a4421-8ff2-4629-ac3c-5d073e78340e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:32.462330 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-afcace61-5af6-4832-b50f-855ffdb8cf44 req-b92a4421-8ff2-4629-ac3c-5d073e78340e service nova] Creating event network-changed:38a9d2ec-1ccd-4ebf-8b82-5161ef06a4f3 for instance 87dc3ec0-4588-46b2-a9c5-373ac352ca25 on n-h1-843700-1 May 28 05:54:32.467712 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-afcace61-5af6-4832-b50f-855ffdb8cf44 req-b92a4421-8ff2-4629-ac3c-5d073e78340e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033560 May 28 05:54:32.468664 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3965/7816] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:54:32.479488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f3b8625f-3ee9-4a5d-9999-f34254f00d1e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:54:32.756609 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f3b8625f-3ee9-4a5d-9999-f34254f00d1e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "DELETE /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 204 len: 0 microversion: 2.1 time: 0.324332 May 28 05:54:32.757443 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3852/7817] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:54:32 2022] DELETE /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:54:32.767201 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a7f857d3-6c68-45e2-a000-b40df9a497f1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:54:32.767914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a7f857d3-6c68-45e2-a000-b40df9a497f1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:54:32.774959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7f857d3-6c68-45e2-a000-b40df9a497f1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:32.775473 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7f857d3-6c68-45e2-a000-b40df9a497f1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:32.776254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7f857d3-6c68-45e2-a000-b40df9a497f1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:32.776702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a7f857d3-6c68-45e2-a000-b40df9a497f1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:32.910755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a7f857d3-6c68-45e2-a000-b40df9a497f1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:54:32.918843 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a7f857d3-6c68-45e2-a000-b40df9a497f1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1684 microversion: 2.1 time: 0.156966 May 28 05:54:32.919742 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3966/7818] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:54:32 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:54:33.937773 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9ea07f63-7dd5-415f-8f35-301f8af0ec46 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:54:33.938503 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9ea07f63-7dd5-415f-8f35-301f8af0ec46 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:54:33.946232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ea07f63-7dd5-415f-8f35-301f8af0ec46 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:33.946658 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ea07f63-7dd5-415f-8f35-301f8af0ec46 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:33.947488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ea07f63-7dd5-415f-8f35-301f8af0ec46 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:33.947948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ea07f63-7dd5-415f-8f35-301f8af0ec46 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:34.153111 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9ea07f63-7dd5-415f-8f35-301f8af0ec46 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:54:34.160815 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9ea07f63-7dd5-415f-8f35-301f8af0ec46 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1684 microversion: 2.1 time: 0.227316 May 28 05:54:34.161332 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3853/7819] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:54:33 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1684 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:54:34.767927 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-0b494360-27a4-4b74-9c66-2b91b1c70b36 req-b0a71442-23a3-4577-aa07-13f4f5732d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87dc3ec0-4588-46b2-a9c5-373ac352ca25", "name": "network-vif-deleted", "tag": "38a9d2ec-1ccd-4ebf-8b82-5161ef06a4f3"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:54:34.775994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-0b494360-27a4-4b74-9c66-2b91b1c70b36 req-b0a71442-23a3-4577-aa07-13f4f5732d9b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:34.776449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-0b494360-27a4-4b74-9c66-2b91b1c70b36 req-b0a71442-23a3-4577-aa07-13f4f5732d9b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:34.788043 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-0b494360-27a4-4b74-9c66-2b91b1c70b36 req-b0a71442-23a3-4577-aa07-13f4f5732d9b service nova] Creating event network-vif-deleted:38a9d2ec-1ccd-4ebf-8b82-5161ef06a4f3 for instance 87dc3ec0-4588-46b2-a9c5-373ac352ca25 on n-h1-843700-1 May 28 05:54:34.793073 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-0b494360-27a4-4b74-9c66-2b91b1c70b36 req-b0a71442-23a3-4577-aa07-13f4f5732d9b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090001 May 28 05:54:34.793719 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3967/7820] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:54:35.178950 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f6410839-4df2-4807-8955-434a799714e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:54:35.179622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f6410839-4df2-4807-8955-434a799714e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:54:35.186843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6410839-4df2-4807-8955-434a799714e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:35.187358 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6410839-4df2-4807-8955-434a799714e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:35.188160 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6410839-4df2-4807-8955-434a799714e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:35.188617 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6410839-4df2-4807-8955-434a799714e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:35.225156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6410839-4df2-4807-8955-434a799714e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:35.225156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6410839-4df2-4807-8955-434a799714e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:35.225156 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-f6410839-4df2-4807-8955-434a799714e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lazy-loading 'fault' on Instance uuid 87dc3ec0-4588-46b2-a9c5-373ac352ca25 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:54:35.262074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f6410839-4df2-4807-8955-434a799714e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:54:35.269856 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f6410839-4df2-4807-8955-434a799714e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 200 len: 1353 microversion: 2.1 time: 0.094892 May 28 05:54:35.270961 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3854/7821] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:54:35 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 1353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:54:36.289755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-931169dd-c801-496c-aa42-a9697a42674e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:54:36.290485 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-931169dd-c801-496c-aa42-a9697a42674e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 87dc3ec0-4588-46b2-a9c5-373ac352ca25] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:54:36.296691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-931169dd-c801-496c-aa42-a9697a42674e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:36.297149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-931169dd-c801-496c-aa42-a9697a42674e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:36.297905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-931169dd-c801-496c-aa42-a9697a42674e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:36.298344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-931169dd-c801-496c-aa42-a9697a42674e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:36.312307 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-931169dd-c801-496c-aa42-a9697a42674e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] HTTP exception thrown: Instance 87dc3ec0-4588-46b2-a9c5-373ac352ca25 could not be found. May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-931169dd-c801-496c-aa42-a9697a42674e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Request method failure captured: May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 HTTP/1.1 May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbhqOgVkVYlgtcjZ8mDe_IQDNUqxx11YvunBU1SK3vtlWX-R-IzWraGt8vkjovszbapQtf3pdd97wuZwcsk_aAT7NxFm4DWf5-O7ZGW38a5Y5ysvAizQD5f24_6jK5aEpE_iFnq4qzGXIoYl5ta8zTN4fYRXo_WPUfWUhgxulf_h-tU May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 8df3b01779bd4e198777ddc16182cda3 May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1455991122 May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8df3b01779bd4e198777ddc16182cda3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8df3b01779bd4e198777ddc16182cda3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8df3b01779bd4e198777ddc16182cda3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8df3b01779bd4e198777ddc16182cda3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1455991122 May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 8df3b01779bd4e198777ddc16182cda3 May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1455991122 May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TestNetworkAdvancedServerOps-1455991122-project May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 1bcabf3cdb7c4f02a50aeb508775222a May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1455991122-project May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 87dc3ec0-4588-46b2-a9c5-373ac352ca25 could not be found. May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '87dc3ec0-4588-46b2-a9c5-373ac352ca25'} May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87dc3ec0-4588-46b2-a9c5-373ac352ca25 could not be found. May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87dc3ec0-4588-46b2-a9c5-373ac352ca25 could not be found. May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:54:36.313909 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:54:36.318000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:54:36.318000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:54:36.318000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:54:36.318000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:54:36.318000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:54:36.318000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:54:36.318000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87dc3ec0-4588-46b2-a9c5-373ac352ca25 could not be found. May 28 05:54:36.318000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:54:36.318000 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-931169dd-c801-496c-aa42-a9697a42674e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Returning 404 to user: Instance 87dc3ec0-4588-46b2-a9c5-373ac352ca25 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:54:36.318000 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-931169dd-c801-496c-aa42-a9697a42674e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25" status: 404 len: 111 microversion: 2.1 time: 0.031254 May 28 05:54:36.318000 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3968/7822] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:54:36 2022] GET /compute/v2.1/servers/87dc3ec0-4588-46b2-a9c5-373ac352ca25 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:54:39.915665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ab9694ce-e497-4c0c-a702-d66d421440dc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '.version_select at 0x7f77003071f0>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:54:40.003346 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ab9694ce-e497-4c0c-a702-d66d421440dc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-17101592" status: 202 len: 0 microversion: 2.1 time: 0.091496 May 28 05:54:40.003993 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3855/7823] 10.222.0.58 () {58 vars in 1277 bytes} [Sat May 28 05:54:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-17101592 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:54:40.034284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7b673a8f-a8ce-495f-b430-5d5f11e8b6bb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'create', calling method: .version_select at 0x7f77005d4430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1024834647", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5LFTGF1WxrOpKoe2aLd14iZyWMQflUc8AleGEpN3R4c9IewczYyi4kE6hB0wfQc+GI/6xnUjTb5s9lf29hiH7kW1h3vbOBRnN0BOkJ0zAiPhac47h1NX4a+zo3bpx6BA=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:54:40.049712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-7b673a8f-a8ce-495f-b430-5d5f11e8b6bb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Getting quotas for project 8df3b01779bd4e198777ddc16182cda3. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:54:40.054761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-7b673a8f-a8ce-495f-b430-5d5f11e8b6bb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Getting quotas for user 1bcabf3cdb7c4f02a50aeb508775222a and project 8df3b01779bd4e198777ddc16182cda3. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:54:40.145481 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7b673a8f-a8ce-495f-b430-5d5f11e8b6bb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.115074 May 28 05:54:40.146664 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3969/7824] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 05:54:40 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:54:48.276529 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:54:48.281133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-61455e12-7563-470d-bb1d-8f4bf1dfc084 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-683953070", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "0168df89-fbe4-4a47-837f-6e2cad1de352"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1024834647", "security_groups": [{"name": "tempest-secgroup-smoke-1848357781"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:54:48.425810 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-61455e12-7563-470d-bb1d-8f4bf1dfc084 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] validate_networks() for [('0168df89-fbe4-4a47-837f-6e2cad1de352', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:54:48.896784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-61455e12-7563-470d-bb1d-8f4bf1dfc084 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:54:48.897239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-61455e12-7563-470d-bb1d-8f4bf1dfc084 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:54:48.897864 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-61455e12-7563-470d-bb1d-8f4bf1dfc084 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:54:48.898214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-61455e12-7563-470d-bb1d-8f4bf1dfc084 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:54:48.898594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-61455e12-7563-470d-bb1d-8f4bf1dfc084 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:54:48.908900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-61455e12-7563-470d-bb1d-8f4bf1dfc084 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:48.909694 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-61455e12-7563-470d-bb1d-8f4bf1dfc084 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:48.911674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-61455e12-7563-470d-bb1d-8f4bf1dfc084 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:48.912515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-61455e12-7563-470d-bb1d-8f4bf1dfc084 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:48.934131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-61455e12-7563-470d-bb1d-8f4bf1dfc084 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Getting quotas for project 8df3b01779bd4e198777ddc16182cda3. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:54:48.939839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-61455e12-7563-470d-bb1d-8f4bf1dfc084 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Getting quotas for user 1bcabf3cdb7c4f02a50aeb508775222a and project 8df3b01779bd4e198777ddc16182cda3. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:54:48.953746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-61455e12-7563-470d-bb1d-8f4bf1dfc084 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:54:48.956229 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-61455e12-7563-470d-bb1d-8f4bf1dfc084 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:54:49.099128 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-61455e12-7563-470d-bb1d-8f4bf1dfc084 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.824057 May 28 05:54:49.100505 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3856/7825] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:54:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:54:49.108416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=16 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:54:49.113346 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4504d7fd-c43b-42e9-866b-2f3c789da5b2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:54:49.114806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4504d7fd-c43b-42e9-866b-2f3c789da5b2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:54:49.200771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4504d7fd-c43b-42e9-866b-2f3c789da5b2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:54:49.209608 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4504d7fd-c43b-42e9-866b-2f3c789da5b2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1266 microversion: 2.1 time: 0.102765 May 28 05:54:49.221009 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3970/7826] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:54:49 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:54:50.227887 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-29edacb6-afcb-4d6b-82e0-a668d6931887 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:54:50.228528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-29edacb6-afcb-4d6b-82e0-a668d6931887 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:54:50.257076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29edacb6-afcb-4d6b-82e0-a668d6931887 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:50.259234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29edacb6-afcb-4d6b-82e0-a668d6931887 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:50.260485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29edacb6-afcb-4d6b-82e0-a668d6931887 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:50.262325 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-29edacb6-afcb-4d6b-82e0-a668d6931887 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:50.337820 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-29edacb6-afcb-4d6b-82e0-a668d6931887 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:54:50.346097 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-29edacb6-afcb-4d6b-82e0-a668d6931887 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1270 microversion: 2.1 time: 0.122832 May 28 05:54:50.347433 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3857/7827] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:54:50 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1270 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:54:51.364832 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-68c8cd18-9df9-4cb9-bb1d-9fbf6782276c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:54:51.366096 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-68c8cd18-9df9-4cb9-bb1d-9fbf6782276c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:54:51.375316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68c8cd18-9df9-4cb9-bb1d-9fbf6782276c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:51.375778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68c8cd18-9df9-4cb9-bb1d-9fbf6782276c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:51.376610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68c8cd18-9df9-4cb9-bb1d-9fbf6782276c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:51.377055 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-68c8cd18-9df9-4cb9-bb1d-9fbf6782276c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:51.439743 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-68c8cd18-9df9-4cb9-bb1d-9fbf6782276c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:54:51.447388 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-68c8cd18-9df9-4cb9-bb1d-9fbf6782276c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1324 microversion: 2.1 time: 0.087495 May 28 05:54:51.447973 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3971/7828] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:54:51 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1324 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:54:52.465747 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ae77d3ba-c999-4369-8406-c13fc1c4b41c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:54:52.466383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ae77d3ba-c999-4369-8406-c13fc1c4b41c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:54:52.473460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae77d3ba-c999-4369-8406-c13fc1c4b41c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:52.474306 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae77d3ba-c999-4369-8406-c13fc1c4b41c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:52.480831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae77d3ba-c999-4369-8406-c13fc1c4b41c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:52.480831 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ae77d3ba-c999-4369-8406-c13fc1c4b41c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:52.691279 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-ae77d3ba-c999-4369-8406-c13fc1c4b41c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:54:52.693878 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ae77d3ba-c999-4369-8406-c13fc1c4b41c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1392 microversion: 2.1 time: 0.232192 May 28 05:54:52.694472 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3858/7829] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:54:52 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1392 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:54:52.853838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-7a8dce31-ea5f-4600-94c7-d5236d08362c req-b0d04fd1-9061-4844-9e34-f1552edbdd40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25f557e-63fc-4a2a-9593-9616bbe4319f", "tag": "914c5993-ca7e-400c-94d2-b956677c0c43"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:54:52.864694 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-7a8dce31-ea5f-4600-94c7-d5236d08362c req-b0d04fd1-9061-4844-9e34-f1552edbdd40 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:52.865153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-7a8dce31-ea5f-4600-94c7-d5236d08362c req-b0d04fd1-9061-4844-9e34-f1552edbdd40 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:52.878419 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-7a8dce31-ea5f-4600-94c7-d5236d08362c req-b0d04fd1-9061-4844-9e34-f1552edbdd40 service nova] Creating event network-changed:914c5993-ca7e-400c-94d2-b956677c0c43 for instance d25f557e-63fc-4a2a-9593-9616bbe4319f on n-h2-843700-1 May 28 05:54:52.884127 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-7a8dce31-ea5f-4600-94c7-d5236d08362c req-b0d04fd1-9061-4844-9e34-f1552edbdd40 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034462 May 28 05:54:52.884818 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3972/7830] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:54:53.711450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3c3985ae-83c0-44da-936c-4ef321323654 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:54:53.712078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3c3985ae-83c0-44da-936c-4ef321323654 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:54:53.718923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c3985ae-83c0-44da-936c-4ef321323654 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:53.719420 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c3985ae-83c0-44da-936c-4ef321323654 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:53.720205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c3985ae-83c0-44da-936c-4ef321323654 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:53.720660 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c3985ae-83c0-44da-936c-4ef321323654 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:53.849803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3c3985ae-83c0-44da-936c-4ef321323654 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:54:53.857339 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3c3985ae-83c0-44da-936c-4ef321323654 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1392 microversion: 2.1 time: 0.150409 May 28 05:54:53.857913 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3859/7831] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:54:53 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:54:54.876043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a74c1c93-2c0c-4509-ba9f-15e03d79c29b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:54:54.876753 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a74c1c93-2c0c-4509-ba9f-15e03d79c29b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:54:54.883595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a74c1c93-2c0c-4509-ba9f-15e03d79c29b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:54.884051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a74c1c93-2c0c-4509-ba9f-15e03d79c29b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:54.884822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a74c1c93-2c0c-4509-ba9f-15e03d79c29b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:54.885265 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a74c1c93-2c0c-4509-ba9f-15e03d79c29b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:55.021746 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a74c1c93-2c0c-4509-ba9f-15e03d79c29b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:54:55.029209 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a74c1c93-2c0c-4509-ba9f-15e03d79c29b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1392 microversion: 2.1 time: 0.158604 May 28 05:54:55.029798 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3973/7832] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:54:54 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:54:56.045992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f6b1a879-716f-4d28-a13e-cce3bf60d1ac tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:54:56.046622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f6b1a879-716f-4d28-a13e-cce3bf60d1ac tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:54:56.053693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6b1a879-716f-4d28-a13e-cce3bf60d1ac tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:56.054158 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6b1a879-716f-4d28-a13e-cce3bf60d1ac tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:56.054943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6b1a879-716f-4d28-a13e-cce3bf60d1ac tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:56.055424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6b1a879-716f-4d28-a13e-cce3bf60d1ac tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:56.187399 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f6b1a879-716f-4d28-a13e-cce3bf60d1ac tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:54:56.195239 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f6b1a879-716f-4d28-a13e-cce3bf60d1ac tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1392 microversion: 2.1 time: 0.153188 May 28 05:54:56.195853 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3860/7833] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:54:56 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:54:57.212797 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-bdd0b57a-1ae7-40f4-b065-7c7ffe89ac0a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:54:57.213445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-bdd0b57a-1ae7-40f4-b065-7c7ffe89ac0a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:54:57.216400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:54:57.221192 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdd0b57a-1ae7-40f4-b065-7c7ffe89ac0a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:57.221926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdd0b57a-1ae7-40f4-b065-7c7ffe89ac0a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:57.222951 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdd0b57a-1ae7-40f4-b065-7c7ffe89ac0a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:57.224094 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-bdd0b57a-1ae7-40f4-b065-7c7ffe89ac0a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:57.354955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-bdd0b57a-1ae7-40f4-b065-7c7ffe89ac0a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:54:57.362463 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-bdd0b57a-1ae7-40f4-b065-7c7ffe89ac0a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1392 microversion: 2.1 time: 0.153644 May 28 05:54:57.363051 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3974/7834] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:54:57 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:54:58.380594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cca7fcc9-96ad-4373-a6ca-8c31b11ec638 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:54:58.381207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cca7fcc9-96ad-4373-a6ca-8c31b11ec638 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:54:58.388613 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cca7fcc9-96ad-4373-a6ca-8c31b11ec638 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:58.389085 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cca7fcc9-96ad-4373-a6ca-8c31b11ec638 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:58.389876 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cca7fcc9-96ad-4373-a6ca-8c31b11ec638 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:58.390336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cca7fcc9-96ad-4373-a6ca-8c31b11ec638 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:58.523900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cca7fcc9-96ad-4373-a6ca-8c31b11ec638 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:54:58.531437 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cca7fcc9-96ad-4373-a6ca-8c31b11ec638 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1392 microversion: 2.1 time: 0.154997 May 28 05:54:58.532023 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3861/7835] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:54:58 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:54:58.801520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-3a8f6d01-5b98-4f67-a7d2-76c850684321 req-ffb0a623-452a-4ad6-8e51-8f0a322adfea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25f557e-63fc-4a2a-9593-9616bbe4319f", "name": "network-vif-plugged", "status": "completed", "tag": "914c5993-ca7e-400c-94d2-b956677c0c43"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:54:58.811166 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-3a8f6d01-5b98-4f67-a7d2-76c850684321 req-ffb0a623-452a-4ad6-8e51-8f0a322adfea service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:58.811622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-3a8f6d01-5b98-4f67-a7d2-76c850684321 req-ffb0a623-452a-4ad6-8e51-8f0a322adfea service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:58.822942 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-3a8f6d01-5b98-4f67-a7d2-76c850684321 req-ffb0a623-452a-4ad6-8e51-8f0a322adfea service nova] Creating event network-vif-plugged:914c5993-ca7e-400c-94d2-b956677c0c43 for instance d25f557e-63fc-4a2a-9593-9616bbe4319f on n-h2-843700-1 May 28 05:54:58.828029 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-3a8f6d01-5b98-4f67-a7d2-76c850684321 req-ffb0a623-452a-4ad6-8e51-8f0a322adfea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030241 May 28 05:54:58.833836 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3975/7836] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:54:59.549048 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8843b316-91ed-48ca-8002-b6c74c9d24e3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:54:59.549673 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8843b316-91ed-48ca-8002-b6c74c9d24e3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:54:59.552175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:54:59.552845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:54:59.558642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8843b316-91ed-48ca-8002-b6c74c9d24e3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:59.559133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8843b316-91ed-48ca-8002-b6c74c9d24e3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:59.560036 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8843b316-91ed-48ca-8002-b6c74c9d24e3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:54:59.560492 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8843b316-91ed-48ca-8002-b6c74c9d24e3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:54:59.693535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8843b316-91ed-48ca-8002-b6c74c9d24e3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:54:59.701167 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8843b316-91ed-48ca-8002-b6c74c9d24e3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1392 microversion: 2.1 time: 0.156148 May 28 05:54:59.701746 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3862/7837] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:54:59 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:00.715695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:55:00.720655 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-662e9305-26ff-4964-a22b-ea6887368ff9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:00.721361 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-662e9305-26ff-4964-a22b-ea6887368ff9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:00.727592 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-662e9305-26ff-4964-a22b-ea6887368ff9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:00.728053 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-662e9305-26ff-4964-a22b-ea6887368ff9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:00.728817 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-662e9305-26ff-4964-a22b-ea6887368ff9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:00.729261 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-662e9305-26ff-4964-a22b-ea6887368ff9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:00.861564 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-662e9305-26ff-4964-a22b-ea6887368ff9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:00.869780 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-662e9305-26ff-4964-a22b-ea6887368ff9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1564 microversion: 2.1 time: 0.155220 May 28 05:55:00.870391 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3976/7838] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:00 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:00.887273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-44e64364-e06e-4294-ab2c-2bb0d50f12e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:00.887903 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-44e64364-e06e-4294-ab2c-2bb0d50f12e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:00.895354 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44e64364-e06e-4294-ab2c-2bb0d50f12e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:00.895818 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44e64364-e06e-4294-ab2c-2bb0d50f12e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:00.896717 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44e64364-e06e-4294-ab2c-2bb0d50f12e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:00.897165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44e64364-e06e-4294-ab2c-2bb0d50f12e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:01.028207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-44e64364-e06e-4294-ab2c-2bb0d50f12e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:01.036235 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-44e64364-e06e-4294-ab2c-2bb0d50f12e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1564 microversion: 2.1 time: 0.152664 May 28 05:55:01.036815 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3863/7839] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:00 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:03.003137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef7d47b2-b4cc-4fc4-9858-7e6d2cccbd81 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:03.003720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ef7d47b2-b4cc-4fc4-9858-7e6d2cccbd81 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:03.007248 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-c9d40ada-f33e-4b62-9f02-b1bd72fba3d3 req-50cece90-7e56-4b43-9782-378fd260eab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25f557e-63fc-4a2a-9593-9616bbe4319f", "tag": "914c5993-ca7e-400c-94d2-b956677c0c43"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:55:03.012447 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef7d47b2-b4cc-4fc4-9858-7e6d2cccbd81 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:03.012974 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef7d47b2-b4cc-4fc4-9858-7e6d2cccbd81 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:03.013179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:55:03.013970 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef7d47b2-b4cc-4fc4-9858-7e6d2cccbd81 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:03.014416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef7d47b2-b4cc-4fc4-9858-7e6d2cccbd81 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:03.017308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c9d40ada-f33e-4b62-9f02-b1bd72fba3d3 req-50cece90-7e56-4b43-9782-378fd260eab8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:03.017803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-c9d40ada-f33e-4b62-9f02-b1bd72fba3d3 req-50cece90-7e56-4b43-9782-378fd260eab8 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:03.029610 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-c9d40ada-f33e-4b62-9f02-b1bd72fba3d3 req-50cece90-7e56-4b43-9782-378fd260eab8 service nova] Creating event network-changed:914c5993-ca7e-400c-94d2-b956677c0c43 for instance d25f557e-63fc-4a2a-9593-9616bbe4319f on n-h2-843700-1 May 28 05:55:03.035048 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-c9d40ada-f33e-4b62-9f02-b1bd72fba3d3 req-50cece90-7e56-4b43-9782-378fd260eab8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032546 May 28 05:55:03.036220 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3864/7840] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:55:03.601826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef7d47b2-b4cc-4fc4-9858-7e6d2cccbd81 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:03.609305 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ef7d47b2-b4cc-4fc4-9858-7e6d2cccbd81 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1564 microversion: 2.1 time: 0.610310 May 28 05:55:03.609958 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3977/7841] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:02 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1564 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:24.843346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=46 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:55:24.848043 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-174e9a72-113d-4f8a-9b71-63fea0d3693b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:55:24.849102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-174e9a72-113d-4f8a-9b71-63fea0d3693b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:24.856490 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-174e9a72-113d-4f8a-9b71-63fea0d3693b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:24.856962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-174e9a72-113d-4f8a-9b71-63fea0d3693b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:24.857741 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-174e9a72-113d-4f8a-9b71-63fea0d3693b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:24.858199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-174e9a72-113d-4f8a-9b71-63fea0d3693b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:24.907009 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-174e9a72-113d-4f8a-9b71-63fea0d3693b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f/action" status: 200 len: 24571 microversion: 2.1 time: 0.065554 May 28 05:55:24.908284 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3865/7842] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:55:24 2022] POST /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f/action => generated 24571 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:55:31.299143 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-56f9caa4-ae03-4f6e-9d89-c0a22f6a4ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:55:31.300125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-56f9caa4-ae03-4f6e-9d89-c0a22f6a4ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:31.302195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=7 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:55:31.302870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=34 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:55:31.307769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56f9caa4-ae03-4f6e-9d89-c0a22f6a4ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:31.309140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56f9caa4-ae03-4f6e-9d89-c0a22f6a4ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:31.309140 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56f9caa4-ae03-4f6e-9d89-c0a22f6a4ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:31.309597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-56f9caa4-ae03-4f6e-9d89-c0a22f6a4ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:31.337403 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-56f9caa4-ae03-4f6e-9d89-c0a22f6a4ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:31.343433 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-56f9caa4-ae03-4f6e-9d89-c0a22f6a4ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Old instance type m1.heat2, new instance type m1.heat {{(pid=126044) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 05:55:31.349399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-56f9caa4-ae03-4f6e-9d89-c0a22f6a4ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:55:31.350418 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-56f9caa4-ae03-4f6e-9d89-c0a22f6a4ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:55:31.350902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-56f9caa4-ae03-4f6e-9d89-c0a22f6a4ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:55:31.351343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-56f9caa4-ae03-4f6e-9d89-c0a22f6a4ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:55:31.351763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-56f9caa4-ae03-4f6e-9d89-c0a22f6a4ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:55:31.508032 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-56f9caa4-ae03-4f6e-9d89-c0a22f6a4ecc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f/action" status: 202 len: 0 microversion: 2.1 time: 0.213127 May 28 05:55:31.508634 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3978/7843] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:55:31 2022] POST /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:55:31.518071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-24d0f2a2-f3aa-4abe-80d3-2c535796c9bd tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:31.518888 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-24d0f2a2-f3aa-4abe-80d3-2c535796c9bd tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:31.527378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24d0f2a2-f3aa-4abe-80d3-2c535796c9bd tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:31.527856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24d0f2a2-f3aa-4abe-80d3-2c535796c9bd tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:31.528654 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24d0f2a2-f3aa-4abe-80d3-2c535796c9bd tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:31.529107 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24d0f2a2-f3aa-4abe-80d3-2c535796c9bd tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:31.670238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-24d0f2a2-f3aa-4abe-80d3-2c535796c9bd tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:31.678071 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-24d0f2a2-f3aa-4abe-80d3-2c535796c9bd tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1692 microversion: 2.1 time: 0.164660 May 28 05:55:31.678753 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3866/7844] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:31 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:32.697155 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-dafb03ef-0494-46ee-a301-01a4d30037b2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:32.698355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-dafb03ef-0494-46ee-a301-01a4d30037b2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:32.704575 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dafb03ef-0494-46ee-a301-01a4d30037b2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:32.705033 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dafb03ef-0494-46ee-a301-01a4d30037b2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:32.705803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dafb03ef-0494-46ee-a301-01a4d30037b2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:32.706249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-dafb03ef-0494-46ee-a301-01a4d30037b2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:32.845936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-dafb03ef-0494-46ee-a301-01a4d30037b2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:32.854189 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-dafb03ef-0494-46ee-a301-01a4d30037b2 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1692 microversion: 2.1 time: 0.161958 May 28 05:55:32.854763 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3979/7845] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:32 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:33.872443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2dc52f75-d10f-48e0-bb32-9ff9a6806db7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:33.873037 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2dc52f75-d10f-48e0-bb32-9ff9a6806db7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:33.880268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2dc52f75-d10f-48e0-bb32-9ff9a6806db7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:33.880745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2dc52f75-d10f-48e0-bb32-9ff9a6806db7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:33.881535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2dc52f75-d10f-48e0-bb32-9ff9a6806db7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:33.881993 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2dc52f75-d10f-48e0-bb32-9ff9a6806db7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:34.076828 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2dc52f75-d10f-48e0-bb32-9ff9a6806db7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:34.084709 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2dc52f75-d10f-48e0-bb32-9ff9a6806db7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1692 microversion: 2.1 time: 0.216295 May 28 05:55:34.085313 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3867/7846] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:33 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1692 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:35.101869 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1513402b-dd47-44ce-afe2-6fa66d57f477 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:35.102489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1513402b-dd47-44ce-afe2-6fa66d57f477 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:35.109378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1513402b-dd47-44ce-afe2-6fa66d57f477 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:35.109833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1513402b-dd47-44ce-afe2-6fa66d57f477 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:35.110599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1513402b-dd47-44ce-afe2-6fa66d57f477 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:35.111073 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1513402b-dd47-44ce-afe2-6fa66d57f477 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:35.242208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1513402b-dd47-44ce-afe2-6fa66d57f477 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:35.250030 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1513402b-dd47-44ce-afe2-6fa66d57f477 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1697 microversion: 2.1 time: 0.152159 May 28 05:55:35.250601 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3980/7847] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:35 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:36.268840 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-fc79fc86-43c3-4c0a-b7e6-d38e9573e2fa tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:36.269474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-fc79fc86-43c3-4c0a-b7e6-d38e9573e2fa tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:36.277213 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc79fc86-43c3-4c0a-b7e6-d38e9573e2fa tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:36.277681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc79fc86-43c3-4c0a-b7e6-d38e9573e2fa tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:36.278462 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc79fc86-43c3-4c0a-b7e6-d38e9573e2fa tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:36.278919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-fc79fc86-43c3-4c0a-b7e6-d38e9573e2fa tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:36.413803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-fc79fc86-43c3-4c0a-b7e6-d38e9573e2fa tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:36.421240 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-fc79fc86-43c3-4c0a-b7e6-d38e9573e2fa tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1697 microversion: 2.1 time: 0.156449 May 28 05:55:36.421814 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3868/7848] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:36 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:37.439093 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-966966e6-97ce-4e17-b85b-d306e1c5cc9a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:37.439755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-966966e6-97ce-4e17-b85b-d306e1c5cc9a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:37.446654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-966966e6-97ce-4e17-b85b-d306e1c5cc9a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:37.447157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-966966e6-97ce-4e17-b85b-d306e1c5cc9a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:37.447937 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-966966e6-97ce-4e17-b85b-d306e1c5cc9a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:37.448381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-966966e6-97ce-4e17-b85b-d306e1c5cc9a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:37.579500 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-966966e6-97ce-4e17-b85b-d306e1c5cc9a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:37.587811 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-966966e6-97ce-4e17-b85b-d306e1c5cc9a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1697 microversion: 2.1 time: 0.152658 May 28 05:55:37.588392 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3981/7849] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:37 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:38.605757 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7d61a7da-0466-4660-85db-b1c3db7618e5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:38.606391 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7d61a7da-0466-4660-85db-b1c3db7618e5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:38.613431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d61a7da-0466-4660-85db-b1c3db7618e5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:38.613901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d61a7da-0466-4660-85db-b1c3db7618e5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:38.614719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d61a7da-0466-4660-85db-b1c3db7618e5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:38.615884 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7d61a7da-0466-4660-85db-b1c3db7618e5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:38.745560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7d61a7da-0466-4660-85db-b1c3db7618e5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:38.753377 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7d61a7da-0466-4660-85db-b1c3db7618e5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1697 microversion: 2.1 time: 0.151650 May 28 05:55:38.753954 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3869/7850] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:38 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:39.770568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e7c60b7f-e08e-4eb3-9d94-3b0eae004354 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:39.771238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e7c60b7f-e08e-4eb3-9d94-3b0eae004354 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:39.778044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e7c60b7f-e08e-4eb3-9d94-3b0eae004354 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:39.780709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e7c60b7f-e08e-4eb3-9d94-3b0eae004354 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:39.780709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e7c60b7f-e08e-4eb3-9d94-3b0eae004354 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:39.780709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e7c60b7f-e08e-4eb3-9d94-3b0eae004354 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:39.913833 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e7c60b7f-e08e-4eb3-9d94-3b0eae004354 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:39.921438 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e7c60b7f-e08e-4eb3-9d94-3b0eae004354 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1697 microversion: 2.1 time: 0.154858 May 28 05:55:39.922013 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3982/7851] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:39 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:40.939460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-735dff3a-ba17-4234-9147-7f6d7f5da70f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:40.940122 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-735dff3a-ba17-4234-9147-7f6d7f5da70f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:40.947700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-735dff3a-ba17-4234-9147-7f6d7f5da70f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:40.948166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-735dff3a-ba17-4234-9147-7f6d7f5da70f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:40.948962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-735dff3a-ba17-4234-9147-7f6d7f5da70f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:40.949399 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-735dff3a-ba17-4234-9147-7f6d7f5da70f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:41.079397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-735dff3a-ba17-4234-9147-7f6d7f5da70f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:41.086976 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-735dff3a-ba17-4234-9147-7f6d7f5da70f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1697 microversion: 2.1 time: 0.151454 May 28 05:55:41.087587 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3870/7852] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:40 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:42.104478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-784877b8-ebd6-4b8d-b866-03c352754331 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:42.105107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-784877b8-ebd6-4b8d-b866-03c352754331 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:42.116372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-784877b8-ebd6-4b8d-b866-03c352754331 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:42.116372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-784877b8-ebd6-4b8d-b866-03c352754331 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:42.116372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-784877b8-ebd6-4b8d-b866-03c352754331 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:42.116372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-784877b8-ebd6-4b8d-b866-03c352754331 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:42.247533 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-784877b8-ebd6-4b8d-b866-03c352754331 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:42.255248 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-784877b8-ebd6-4b8d-b866-03c352754331 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1697 microversion: 2.1 time: 0.154762 May 28 05:55:42.256324 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3983/7853] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:42 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:43.273515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-40200c85-18e6-42a6-aba9-b6af972c8004 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:43.274110 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-40200c85-18e6-42a6-aba9-b6af972c8004 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:43.281179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40200c85-18e6-42a6-aba9-b6af972c8004 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:43.281652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40200c85-18e6-42a6-aba9-b6af972c8004 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:43.282441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40200c85-18e6-42a6-aba9-b6af972c8004 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:43.282900 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-40200c85-18e6-42a6-aba9-b6af972c8004 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:43.413678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-40200c85-18e6-42a6-aba9-b6af972c8004 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:43.421310 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-40200c85-18e6-42a6-aba9-b6af972c8004 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1697 microversion: 2.1 time: 0.152370 May 28 05:55:43.421902 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3871/7854] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:43 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:44.438758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4f3af61a-6154-4e8d-8102-6400647fecf4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:44.439342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4f3af61a-6154-4e8d-8102-6400647fecf4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:44.446450 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f3af61a-6154-4e8d-8102-6400647fecf4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:44.446909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f3af61a-6154-4e8d-8102-6400647fecf4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:44.447712 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f3af61a-6154-4e8d-8102-6400647fecf4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:44.448167 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4f3af61a-6154-4e8d-8102-6400647fecf4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:44.580178 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4f3af61a-6154-4e8d-8102-6400647fecf4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:44.587800 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4f3af61a-6154-4e8d-8102-6400647fecf4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1697 microversion: 2.1 time: 0.153213 May 28 05:55:44.588384 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3984/7855] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:44 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:45.605054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0ff19838-9fda-4fd0-8dd2-c99591c18c28 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:45.605682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0ff19838-9fda-4fd0-8dd2-c99591c18c28 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:45.612718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ff19838-9fda-4fd0-8dd2-c99591c18c28 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:45.613181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ff19838-9fda-4fd0-8dd2-c99591c18c28 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:45.613955 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ff19838-9fda-4fd0-8dd2-c99591c18c28 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:45.614404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ff19838-9fda-4fd0-8dd2-c99591c18c28 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:45.747233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0ff19838-9fda-4fd0-8dd2-c99591c18c28 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:45.755071 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0ff19838-9fda-4fd0-8dd2-c99591c18c28 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1697 microversion: 2.1 time: 0.153942 May 28 05:55:45.756351 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3872/7856] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:45 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:46.773666 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d892b7a6-f865-46a6-80ab-413b5cda956f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:46.774286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d892b7a6-f865-46a6-80ab-413b5cda956f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:46.781208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d892b7a6-f865-46a6-80ab-413b5cda956f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:46.781663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d892b7a6-f865-46a6-80ab-413b5cda956f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:46.782437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d892b7a6-f865-46a6-80ab-413b5cda956f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:46.782880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d892b7a6-f865-46a6-80ab-413b5cda956f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:46.922378 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d892b7a6-f865-46a6-80ab-413b5cda956f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:46.930830 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d892b7a6-f865-46a6-80ab-413b5cda956f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1696 microversion: 2.1 time: 0.161730 May 28 05:55:46.931448 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3985/7857] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:46 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:47.110141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-d7d70925-3225-47d4-ac99-c767dd752689 req-01c627a7-d296-4657-80e9-88c02d7cb169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25f557e-63fc-4a2a-9593-9616bbe4319f", "name": "network-vif-unplugged", "status": "completed", "tag": "914c5993-ca7e-400c-94d2-b956677c0c43"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:55:47.119834 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d7d70925-3225-47d4-ac99-c767dd752689 req-01c627a7-d296-4657-80e9-88c02d7cb169 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:47.120295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-d7d70925-3225-47d4-ac99-c767dd752689 req-01c627a7-d296-4657-80e9-88c02d7cb169 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:47.137382 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-d7d70925-3225-47d4-ac99-c767dd752689 req-01c627a7-d296-4657-80e9-88c02d7cb169 service nova] Creating event network-vif-unplugged:914c5993-ca7e-400c-94d2-b956677c0c43 for instance d25f557e-63fc-4a2a-9593-9616bbe4319f on n-h1-843700-1 May 28 05:55:47.142927 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-d7d70925-3225-47d4-ac99-c767dd752689 req-01c627a7-d296-4657-80e9-88c02d7cb169 service nova] Instance d25f557e-63fc-4a2a-9593-9616bbe4319f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:55:47.153630 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-d7d70925-3225-47d4-ac99-c767dd752689 req-01c627a7-d296-4657-80e9-88c02d7cb169 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047373 May 28 05:55:47.154252 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3873/7858] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:55:47.950075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4eb92e59-279f-4c88-b5bc-050d8ffe1298 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:47.950713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4eb92e59-279f-4c88-b5bc-050d8ffe1298 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:47.957982 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4eb92e59-279f-4c88-b5bc-050d8ffe1298 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:47.958438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4eb92e59-279f-4c88-b5bc-050d8ffe1298 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:47.959841 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4eb92e59-279f-4c88-b5bc-050d8ffe1298 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:47.960292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4eb92e59-279f-4c88-b5bc-050d8ffe1298 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:48.358021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4eb92e59-279f-4c88-b5bc-050d8ffe1298 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:48.365905 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4eb92e59-279f-4c88-b5bc-050d8ffe1298 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1696 microversion: 2.1 time: 0.420130 May 28 05:55:48.366625 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3986/7859] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:47 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1696 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:49.169793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-acfc8411-5fe9-46ad-aa4b-2b1a078cc5cd req-af0a4986-c12e-4a62-98e8-8fd6fc412ece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25f557e-63fc-4a2a-9593-9616bbe4319f", "tag": "914c5993-ca7e-400c-94d2-b956677c0c43"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:55:49.178975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-acfc8411-5fe9-46ad-aa4b-2b1a078cc5cd req-af0a4986-c12e-4a62-98e8-8fd6fc412ece service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:49.179452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-acfc8411-5fe9-46ad-aa4b-2b1a078cc5cd req-af0a4986-c12e-4a62-98e8-8fd6fc412ece service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:49.191465 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-acfc8411-5fe9-46ad-aa4b-2b1a078cc5cd req-af0a4986-c12e-4a62-98e8-8fd6fc412ece service nova] Creating event network-changed:914c5993-ca7e-400c-94d2-b956677c0c43 for instance d25f557e-63fc-4a2a-9593-9616bbe4319f on n-h1-843700-1 May 28 05:55:49.196835 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-acfc8411-5fe9-46ad-aa4b-2b1a078cc5cd req-af0a4986-c12e-4a62-98e8-8fd6fc412ece service nova] Instance d25f557e-63fc-4a2a-9593-9616bbe4319f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:55:49.207416 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-acfc8411-5fe9-46ad-aa4b-2b1a078cc5cd req-af0a4986-c12e-4a62-98e8-8fd6fc412ece service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042498 May 28 05:55:49.208196 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3874/7860] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:55:49.384084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-83bfe379-71d5-401b-9e45-5bb7378e5bff tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:49.385340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-83bfe379-71d5-401b-9e45-5bb7378e5bff tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:49.392406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83bfe379-71d5-401b-9e45-5bb7378e5bff tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:49.392863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83bfe379-71d5-401b-9e45-5bb7378e5bff tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:49.394217 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83bfe379-71d5-401b-9e45-5bb7378e5bff tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:49.394330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-83bfe379-71d5-401b-9e45-5bb7378e5bff tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:49.608029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-83bfe379-71d5-401b-9e45-5bb7378e5bff tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:49.616065 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-83bfe379-71d5-401b-9e45-5bb7378e5bff tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1694 microversion: 2.1 time: 0.236126 May 28 05:55:49.626509 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3987/7861] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:49 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1694 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:50.635127 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7f538d74-96dc-4d65-a857-131e361ac9d6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:50.635883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7f538d74-96dc-4d65-a857-131e361ac9d6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:50.642231 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f538d74-96dc-4d65-a857-131e361ac9d6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:50.642728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f538d74-96dc-4d65-a857-131e361ac9d6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:50.643526 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f538d74-96dc-4d65-a857-131e361ac9d6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:50.643979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7f538d74-96dc-4d65-a857-131e361ac9d6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:50.780808 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7f538d74-96dc-4d65-a857-131e361ac9d6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:50.789043 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7f538d74-96dc-4d65-a857-131e361ac9d6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1691 microversion: 2.1 time: 0.159129 May 28 05:55:50.789574 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3875/7862] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:50 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:50.805398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-df352683-027a-4c3e-bce3-c8423f45148f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:55:50.805939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-df352683-027a-4c3e-bce3-c8423f45148f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:50.812822 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df352683-027a-4c3e-bce3-c8423f45148f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:50.813277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df352683-027a-4c3e-bce3-c8423f45148f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:50.814045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df352683-027a-4c3e-bce3-c8423f45148f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:50.814492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-df352683-027a-4c3e-bce3-c8423f45148f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:51.029065 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-df352683-027a-4c3e-bce3-c8423f45148f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f/action" status: 204 len: 0 microversion: 2.1 time: 0.227216 May 28 05:55:51.029664 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3988/7863] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:55:50 2022] POST /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f/action => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:55:51.038480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-618feebc-f8f4-4bea-899b-3eb2fa8fec1e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:51.039159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-618feebc-f8f4-4bea-899b-3eb2fa8fec1e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:51.045582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-618feebc-f8f4-4bea-899b-3eb2fa8fec1e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:51.046056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-618feebc-f8f4-4bea-899b-3eb2fa8fec1e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:51.046845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-618feebc-f8f4-4bea-899b-3eb2fa8fec1e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:51.047338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-618feebc-f8f4-4bea-899b-3eb2fa8fec1e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:51.215224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-618feebc-f8f4-4bea-899b-3eb2fa8fec1e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:51.224876 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-618feebc-f8f4-4bea-899b-3eb2fa8fec1e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1691 microversion: 2.1 time: 0.190451 May 28 05:55:51.229159 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3876/7864] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:51 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1691 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:55:51.243020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0f2103e2-1858-4809-a3fd-5699f0c500e1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:51.243852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0f2103e2-1858-4809-a3fd-5699f0c500e1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:51.253505 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f2103e2-1858-4809-a3fd-5699f0c500e1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:51.255945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f2103e2-1858-4809-a3fd-5699f0c500e1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:51.256769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f2103e2-1858-4809-a3fd-5699f0c500e1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:51.257219 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f2103e2-1858-4809-a3fd-5699f0c500e1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:51.440698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0f2103e2-1858-4809-a3fd-5699f0c500e1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:51.449090 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0f2103e2-1858-4809-a3fd-5699f0c500e1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1691 microversion: 2.1 time: 0.210597 May 28 05:55:51.449776 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3989/7865] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:51 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1691 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:52.130254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-def42d6f-88a9-4fa1-9924-25db57bae802 req-503e83c9-08d9-41d8-904a-1398c9ed9f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25f557e-63fc-4a2a-9593-9616bbe4319f", "name": "network-vif-plugged", "status": "completed", "tag": "914c5993-ca7e-400c-94d2-b956677c0c43"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:55:52.139622 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-def42d6f-88a9-4fa1-9924-25db57bae802 req-503e83c9-08d9-41d8-904a-1398c9ed9f7b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:52.140084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-def42d6f-88a9-4fa1-9924-25db57bae802 req-503e83c9-08d9-41d8-904a-1398c9ed9f7b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:52.151842 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-def42d6f-88a9-4fa1-9924-25db57bae802 req-503e83c9-08d9-41d8-904a-1398c9ed9f7b service nova] Creating event network-vif-plugged:914c5993-ca7e-400c-94d2-b956677c0c43 for instance d25f557e-63fc-4a2a-9593-9616bbe4319f on n-h1-843700-1 May 28 05:55:52.157164 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [req-def42d6f-88a9-4fa1-9924-25db57bae802 req-503e83c9-08d9-41d8-904a-1398c9ed9f7b service nova] Instance d25f557e-63fc-4a2a-9593-9616bbe4319f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843700-1', 'n-h2-843700-1'} {{(pid=126043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 05:55:52.168266 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-def42d6f-88a9-4fa1-9924-25db57bae802 req-503e83c9-08d9-41d8-904a-1398c9ed9f7b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042391 May 28 05:55:52.168854 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3877/7866] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:55:52.466069 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e9beffbe-3019-4e1f-85aa-a213b542a92e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:52.466605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e9beffbe-3019-4e1f-85aa-a213b542a92e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:52.473834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9beffbe-3019-4e1f-85aa-a213b542a92e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:52.474868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9beffbe-3019-4e1f-85aa-a213b542a92e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:52.475684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9beffbe-3019-4e1f-85aa-a213b542a92e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:52.476130 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e9beffbe-3019-4e1f-85aa-a213b542a92e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:52.614709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e9beffbe-3019-4e1f-85aa-a213b542a92e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:52.622513 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e9beffbe-3019-4e1f-85aa-a213b542a92e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1691 microversion: 2.1 time: 0.160465 May 28 05:55:52.623370 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3990/7867] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:52 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:55:53.641824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5bba8c69-fec8-4147-8ccc-c0cc598f24c1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:55:53.642538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5bba8c69-fec8-4147-8ccc-c0cc598f24c1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:55:53.648951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5bba8c69-fec8-4147-8ccc-c0cc598f24c1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:53.649423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5bba8c69-fec8-4147-8ccc-c0cc598f24c1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:53.650196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5bba8c69-fec8-4147-8ccc-c0cc598f24c1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:55:53.650647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5bba8c69-fec8-4147-8ccc-c0cc598f24c1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:55:53.781407 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5bba8c69-fec8-4147-8ccc-c0cc598f24c1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:55:53.789682 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5bba8c69-fec8-4147-8ccc-c0cc598f24c1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1683 microversion: 2.1 time: 0.152996 May 28 05:55:53.790261 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3878/7868] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:55:53 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:56:13.956131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-949a8da9-1645-41e0-8e47-8d4c339381ea tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:56:13.957066 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-949a8da9-1645-41e0-8e47-8d4c339381ea tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:56:13.959604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=30 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:56:13.960268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:56:13.965519 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-949a8da9-1645-41e0-8e47-8d4c339381ea tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:13.970694 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-949a8da9-1645-41e0-8e47-8d4c339381ea tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:13.970694 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-949a8da9-1645-41e0-8e47-8d4c339381ea tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:13.970694 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-949a8da9-1645-41e0-8e47-8d4c339381ea tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:14.015358 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-949a8da9-1645-41e0-8e47-8d4c339381ea tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f/action" status: 200 len: 24581 microversion: 2.1 time: 0.062972 May 28 05:56:14.015986 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3991/7869] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:56:13 2022] POST /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f/action => generated 24581 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:56:21.041029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-89d48c15-7957-4706-a5b6-2ce740e92e2b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:56:21.041559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-89d48c15-7957-4706-a5b6-2ce740e92e2b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:56:21.043894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-f031d374-329a-4b68-a535-49b01bc81f21 req-06ce9bef-c2be-4583-b6df-95c60df15a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25f557e-63fc-4a2a-9593-9616bbe4319f", "tag": "914c5993-ca7e-400c-94d2-b956677c0c43"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:56:21.046885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=29 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:56:21.053546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=76 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:56:21.054702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f031d374-329a-4b68-a535-49b01bc81f21 req-06ce9bef-c2be-4583-b6df-95c60df15a40 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:21.055263 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f031d374-329a-4b68-a535-49b01bc81f21 req-06ce9bef-c2be-4583-b6df-95c60df15a40 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:21.055659 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-89d48c15-7957-4706-a5b6-2ce740e92e2b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:21.056276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-89d48c15-7957-4706-a5b6-2ce740e92e2b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:21.057237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-89d48c15-7957-4706-a5b6-2ce740e92e2b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:21.057700 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-89d48c15-7957-4706-a5b6-2ce740e92e2b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:21.070473 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-f031d374-329a-4b68-a535-49b01bc81f21 req-06ce9bef-c2be-4583-b6df-95c60df15a40 service nova] Creating event network-changed:914c5993-ca7e-400c-94d2-b956677c0c43 for instance d25f557e-63fc-4a2a-9593-9616bbe4319f on n-h1-843700-1 May 28 05:56:21.077010 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-f031d374-329a-4b68-a535-49b01bc81f21 req-06ce9bef-c2be-4583-b6df-95c60df15a40 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037247 May 28 05:56:21.080696 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3992/7870] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:56:21.088798 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-89d48c15-7957-4706-a5b6-2ce740e92e2b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:56:21.417577 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-89d48c15-7957-4706-a5b6-2ce740e92e2b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 204 len: 0 microversion: 2.1 time: 0.380572 May 28 05:56:21.418448 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3879/7871] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:56:21 2022] DELETE /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:56:21.427796 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b56052a6-551f-45ef-9c9e-07d9dbf0c02a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:56:21.431834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b56052a6-551f-45ef-9c9e-07d9dbf0c02a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:56:21.436500 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b56052a6-551f-45ef-9c9e-07d9dbf0c02a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:21.437663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b56052a6-551f-45ef-9c9e-07d9dbf0c02a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:21.438691 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b56052a6-551f-45ef-9c9e-07d9dbf0c02a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:21.439237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b56052a6-551f-45ef-9c9e-07d9dbf0c02a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:21.579809 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b56052a6-551f-45ef-9c9e-07d9dbf0c02a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:56:21.587566 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b56052a6-551f-45ef-9c9e-07d9dbf0c02a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1689 microversion: 2.1 time: 0.164814 May 28 05:56:21.588144 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3993/7872] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:56:21 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:56:22.606682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b80c13a9-1f87-440b-a89f-f07ad90763af tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:56:22.607471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b80c13a9-1f87-440b-a89f-f07ad90763af tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:56:22.615168 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b80c13a9-1f87-440b-a89f-f07ad90763af tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:22.615638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b80c13a9-1f87-440b-a89f-f07ad90763af tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:22.616445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b80c13a9-1f87-440b-a89f-f07ad90763af tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:22.616904 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b80c13a9-1f87-440b-a89f-f07ad90763af tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:22.828519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-b80c13a9-1f87-440b-a89f-f07ad90763af tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:56:22.837886 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b80c13a9-1f87-440b-a89f-f07ad90763af tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 200 len: 1689 microversion: 2.1 time: 0.235429 May 28 05:56:22.838716 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3880/7873] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:56:22 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 1689 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:56:23.319555 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-d7330be1-86ad-4e88-9060-8a27f848e475 req-1447663d-610e-47bb-ae78-2da8cbad92fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25f557e-63fc-4a2a-9593-9616bbe4319f", "name": "network-vif-deleted", "tag": "914c5993-ca7e-400c-94d2-b956677c0c43"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:56:23.327852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d7330be1-86ad-4e88-9060-8a27f848e475 req-1447663d-610e-47bb-ae78-2da8cbad92fc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:23.328308 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-d7330be1-86ad-4e88-9060-8a27f848e475 req-1447663d-610e-47bb-ae78-2da8cbad92fc service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:23.339369 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-d7330be1-86ad-4e88-9060-8a27f848e475 req-1447663d-610e-47bb-ae78-2da8cbad92fc service nova] Creating event network-vif-deleted:914c5993-ca7e-400c-94d2-b956677c0c43 for instance d25f557e-63fc-4a2a-9593-9616bbe4319f on n-h1-843700-1 May 28 05:56:23.344505 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-d7330be1-86ad-4e88-9060-8a27f848e475 req-1447663d-610e-47bb-ae78-2da8cbad92fc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094383 May 28 05:56:23.345103 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3994/7874] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:56:23.857438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a4ddfa24-6f99-4314-bf05-9b0727d70ee0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:56:23.858068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a4ddfa24-6f99-4314-bf05-9b0727d70ee0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: d25f557e-63fc-4a2a-9593-9616bbe4319f] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:56:23.865137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4ddfa24-6f99-4314-bf05-9b0727d70ee0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:23.865610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4ddfa24-6f99-4314-bf05-9b0727d70ee0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:23.866402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4ddfa24-6f99-4314-bf05-9b0727d70ee0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:23.866859 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a4ddfa24-6f99-4314-bf05-9b0727d70ee0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:23.880645 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-a4ddfa24-6f99-4314-bf05-9b0727d70ee0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] HTTP exception thrown: Instance d25f557e-63fc-4a2a-9593-9616bbe4319f could not be found. May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a4ddfa24-6f99-4314-bf05-9b0727d70ee0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Request method failure captured: May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f HTTP/1.1 May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbhqOgVkVYlgtcjZ8mDe_IQDNUqxx11YvunBU1SK3vtlWX-R-IzWraGt8vkjovszbapQtf3pdd97wuZwcsk_aAT7NxFm4DWf5-O7ZGW38a5Y5ysvAizQD5f24_6jK5aEpE_iFnq4qzGXIoYl5ta8zTN4fYRXo_WPUfWUhgxulf_h-tU May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 8df3b01779bd4e198777ddc16182cda3 May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1455991122 May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8df3b01779bd4e198777ddc16182cda3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8df3b01779bd4e198777ddc16182cda3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8df3b01779bd4e198777ddc16182cda3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8df3b01779bd4e198777ddc16182cda3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1455991122 May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 8df3b01779bd4e198777ddc16182cda3 May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1455991122 May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestNetworkAdvancedServerOps-1455991122-project May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 1bcabf3cdb7c4f02a50aeb508775222a May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1455991122-project May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance d25f557e-63fc-4a2a-9593-9616bbe4319f could not be found. May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'd25f557e-63fc-4a2a-9593-9616bbe4319f'} May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d25f557e-63fc-4a2a-9593-9616bbe4319f could not be found. May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d25f557e-63fc-4a2a-9593-9616bbe4319f could not be found. May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:56:23.882313 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:56:23.886029 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:56:23.886029 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:56:23.886029 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:56:23.886029 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:56:23.886029 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:56:23.886029 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:56:23.886029 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d25f557e-63fc-4a2a-9593-9616bbe4319f could not be found. May 28 05:56:23.886029 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:56:23.886029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a4ddfa24-6f99-4314-bf05-9b0727d70ee0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Returning 404 to user: Instance d25f557e-63fc-4a2a-9593-9616bbe4319f could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:56:23.886029 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a4ddfa24-6f99-4314-bf05-9b0727d70ee0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f" status: 404 len: 111 microversion: 2.1 time: 0.031095 May 28 05:56:23.886029 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3881/7875] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:56:23 2022] GET /compute/v2.1/servers/d25f557e-63fc-4a2a-9593-9616bbe4319f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:56:27.565737 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-138381ff-631d-4f80-8ad0-c35ee964b2dd tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '.version_select at 0x7f77007533a0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:56:27.641554 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-138381ff-631d-4f80-8ad0-c35ee964b2dd tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1024834647" status: 202 len: 0 microversion: 2.1 time: 0.079992 May 28 05:56:27.642137 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3995/7876] 10.222.0.58 () {58 vars in 1283 bytes} [Sat May 28 05:56:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1024834647 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:56:27.669128 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-248f0d30-2c04-4f61-91a0-ca193aa14260 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'create', calling method: .version_select at 0x7f77003e34c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-848556867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIeYkvM9qC5+KPP0I2qOwxevjsOAOlTeXAcdcHxsfUV4K044diEwTXfTm+xyGj8S1Q5/IkK4XCJLIeEbmDRFngk8OaoDgEYmPONyhLmYywUozjLtG3Wu8nfLp7Ck5HRyg=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:56:27.684951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-248f0d30-2c04-4f61-91a0-ca193aa14260 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Getting quotas for project 8df3b01779bd4e198777ddc16182cda3. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:56:27.691087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-248f0d30-2c04-4f61-91a0-ca193aa14260 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Getting quotas for user 1bcabf3cdb7c4f02a50aeb508775222a and project 8df3b01779bd4e198777ddc16182cda3. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:56:27.772858 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-248f0d30-2c04-4f61-91a0-ca193aa14260 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.107794 May 28 05:56:27.773476 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3882/7877] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 05:56:27 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:56:35.445395 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-46a3974b-5f4b-45c7-952e-07c1e35531a5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1922293965", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "6b76dc04-c4b2-4a9c-80de-9347af35f23a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-848556867", "security_groups": [{"name": "tempest-secgroup-smoke-47496895"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:56:35.454876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=14 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:56:35.552995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-46a3974b-5f4b-45c7-952e-07c1e35531a5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] validate_networks() for [('6b76dc04-c4b2-4a9c-80de-9347af35f23a', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:56:35.935271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-46a3974b-5f4b-45c7-952e-07c1e35531a5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:56:35.935707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-46a3974b-5f4b-45c7-952e-07c1e35531a5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:56:35.936330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-46a3974b-5f4b-45c7-952e-07c1e35531a5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:56:35.936748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-46a3974b-5f4b-45c7-952e-07c1e35531a5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:56:35.937198 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-46a3974b-5f4b-45c7-952e-07c1e35531a5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:56:35.946871 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-46a3974b-5f4b-45c7-952e-07c1e35531a5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:35.947368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-46a3974b-5f4b-45c7-952e-07c1e35531a5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:35.948183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-46a3974b-5f4b-45c7-952e-07c1e35531a5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:35.948631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-46a3974b-5f4b-45c7-952e-07c1e35531a5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:35.965999 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-46a3974b-5f4b-45c7-952e-07c1e35531a5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Getting quotas for project 8df3b01779bd4e198777ddc16182cda3. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:56:35.972204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-46a3974b-5f4b-45c7-952e-07c1e35531a5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Getting quotas for user 1bcabf3cdb7c4f02a50aeb508775222a and project 8df3b01779bd4e198777ddc16182cda3. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:56:35.985195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-46a3974b-5f4b-45c7-952e-07c1e35531a5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:56:35.987590 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-46a3974b-5f4b-45c7-952e-07c1e35531a5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:56:36.106003 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-46a3974b-5f4b-45c7-952e-07c1e35531a5 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.664499 May 28 05:56:36.106856 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3996/7878] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:56:35 2022] POST /compute/v2.1/servers => generated 404 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 05:56:36.114599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:56:36.119312 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e600b748-7a90-4f74-b059-55a5e977ae6e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:56:36.119949 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e600b748-7a90-4f74-b059-55a5e977ae6e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:56:36.181196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e600b748-7a90-4f74-b059-55a5e977ae6e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:56:36.191083 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e600b748-7a90-4f74-b059-55a5e977ae6e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1266 microversion: 2.1 time: 0.078189 May 28 05:56:36.199074 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3883/7879] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:56:36 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:56:37.209784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-cf3c5454-2cb5-4317-b7b2-ca0f8055ab38 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:56:37.210415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-cf3c5454-2cb5-4317-b7b2-ca0f8055ab38 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:56:37.217011 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf3c5454-2cb5-4317-b7b2-ca0f8055ab38 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:37.217474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf3c5454-2cb5-4317-b7b2-ca0f8055ab38 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:37.218250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf3c5454-2cb5-4317-b7b2-ca0f8055ab38 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:37.218851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-cf3c5454-2cb5-4317-b7b2-ca0f8055ab38 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:37.292719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-cf3c5454-2cb5-4317-b7b2-ca0f8055ab38 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:56:37.301205 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-cf3c5454-2cb5-4317-b7b2-ca0f8055ab38 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1262 microversion: 2.1 time: 0.096412 May 28 05:56:37.310175 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3997/7880] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:56:37 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1262 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:56:38.319998 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c499cb44-dd7d-4ad4-97bd-8f73f9709285 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:56:38.321370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c499cb44-dd7d-4ad4-97bd-8f73f9709285 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:56:38.330676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c499cb44-dd7d-4ad4-97bd-8f73f9709285 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:38.331715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c499cb44-dd7d-4ad4-97bd-8f73f9709285 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:38.332815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c499cb44-dd7d-4ad4-97bd-8f73f9709285 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:38.333561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c499cb44-dd7d-4ad4-97bd-8f73f9709285 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:38.412020 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c499cb44-dd7d-4ad4-97bd-8f73f9709285 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:56:38.421070 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c499cb44-dd7d-4ad4-97bd-8f73f9709285 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1324 microversion: 2.1 time: 0.105359 May 28 05:56:38.421876 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3884/7881] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:56:38 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1324 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:56:39.495445 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-568a573e-be12-46a2-acaf-4741586d11f1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:56:39.496163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-568a573e-be12-46a2-acaf-4741586d11f1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:56:39.503966 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-568a573e-be12-46a2-acaf-4741586d11f1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:39.504751 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-568a573e-be12-46a2-acaf-4741586d11f1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:39.505730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-568a573e-be12-46a2-acaf-4741586d11f1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:39.506233 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-568a573e-be12-46a2-acaf-4741586d11f1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:39.663692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-76763437-ada7-4cb2-a6d1-35f7e6345232 req-3bd37db3-9d16-4087-bafe-52428d10f884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26030b31-03b0-4f1f-b2db-5473f44b7417", "tag": "04e5c493-53c8-424b-8dc9-5063a03a3967"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:56:39.674103 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-76763437-ada7-4cb2-a6d1-35f7e6345232 req-3bd37db3-9d16-4087-bafe-52428d10f884 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:39.675889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-76763437-ada7-4cb2-a6d1-35f7e6345232 req-3bd37db3-9d16-4087-bafe-52428d10f884 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:39.688119 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-76763437-ada7-4cb2-a6d1-35f7e6345232 req-3bd37db3-9d16-4087-bafe-52428d10f884 service nova] Creating event network-changed:04e5c493-53c8-424b-8dc9-5063a03a3967 for instance 26030b31-03b0-4f1f-b2db-5473f44b7417 on n-h2-843700-1 May 28 05:56:39.693916 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-76763437-ada7-4cb2-a6d1-35f7e6345232 req-3bd37db3-9d16-4087-bafe-52428d10f884 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033978 May 28 05:56:39.695602 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3885/7882] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:56:39.714891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-568a573e-be12-46a2-acaf-4741586d11f1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:56:39.723283 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-568a573e-be12-46a2-acaf-4741586d11f1 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1390 microversion: 2.1 time: 0.287776 May 28 05:56:39.724076 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3998/7883] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:56:39 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1390 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:56:40.741952 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-971412d8-3c46-4b6e-8b32-604a3530ed0d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:56:40.742676 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-971412d8-3c46-4b6e-8b32-604a3530ed0d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:56:40.750175 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-971412d8-3c46-4b6e-8b32-604a3530ed0d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:40.750652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-971412d8-3c46-4b6e-8b32-604a3530ed0d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:40.751483 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-971412d8-3c46-4b6e-8b32-604a3530ed0d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:40.751945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-971412d8-3c46-4b6e-8b32-604a3530ed0d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:40.885098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-971412d8-3c46-4b6e-8b32-604a3530ed0d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:56:40.892718 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-971412d8-3c46-4b6e-8b32-604a3530ed0d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1390 microversion: 2.1 time: 0.155121 May 28 05:56:40.893304 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3886/7884] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:56:40 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:56:41.909830 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-22c82ea3-d2f6-4c73-82c6-4f9b64fe763e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:56:41.910449 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-22c82ea3-d2f6-4c73-82c6-4f9b64fe763e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:56:41.918081 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22c82ea3-d2f6-4c73-82c6-4f9b64fe763e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:41.918546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22c82ea3-d2f6-4c73-82c6-4f9b64fe763e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:41.919347 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22c82ea3-d2f6-4c73-82c6-4f9b64fe763e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:41.919803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-22c82ea3-d2f6-4c73-82c6-4f9b64fe763e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:42.051709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-22c82ea3-d2f6-4c73-82c6-4f9b64fe763e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:56:42.059182 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-22c82ea3-d2f6-4c73-82c6-4f9b64fe763e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1390 microversion: 2.1 time: 0.153362 May 28 05:56:42.059772 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 3999/7885] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:56:41 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:56:43.075728 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-50883e60-f3f7-4bf7-9960-a37a9ecb8aff tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:56:43.076369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-50883e60-f3f7-4bf7-9960-a37a9ecb8aff tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:56:43.083389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50883e60-f3f7-4bf7-9960-a37a9ecb8aff tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:43.083866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50883e60-f3f7-4bf7-9960-a37a9ecb8aff tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:43.084697 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50883e60-f3f7-4bf7-9960-a37a9ecb8aff tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:43.085153 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-50883e60-f3f7-4bf7-9960-a37a9ecb8aff tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:43.218178 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-50883e60-f3f7-4bf7-9960-a37a9ecb8aff tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:56:43.226292 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-50883e60-f3f7-4bf7-9960-a37a9ecb8aff tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1390 microversion: 2.1 time: 0.154524 May 28 05:56:43.226878 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3887/7886] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:56:43 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:56:44.244718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4d1fc30e-3175-4c31-b6d3-5165bdccc072 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:56:44.245274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4d1fc30e-3175-4c31-b6d3-5165bdccc072 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:56:44.248302 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:56:44.253278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d1fc30e-3175-4c31-b6d3-5165bdccc072 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:44.253740 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d1fc30e-3175-4c31-b6d3-5165bdccc072 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:44.254517 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d1fc30e-3175-4c31-b6d3-5165bdccc072 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:44.254965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4d1fc30e-3175-4c31-b6d3-5165bdccc072 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:44.394731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4d1fc30e-3175-4c31-b6d3-5165bdccc072 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:56:44.402312 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4d1fc30e-3175-4c31-b6d3-5165bdccc072 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1390 microversion: 2.1 time: 0.162276 May 28 05:56:44.402906 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4000/7887] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:56:44 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:56:45.172693 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-24b79e28-d102-46d6-8930-3ae2df8b04d0 req-e77ccd74-e148-4cb0-820d-11a1a505cd86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26030b31-03b0-4f1f-b2db-5473f44b7417", "name": "network-vif-plugged", "status": "completed", "tag": "04e5c493-53c8-424b-8dc9-5063a03a3967"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:56:45.181987 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-24b79e28-d102-46d6-8930-3ae2df8b04d0 req-e77ccd74-e148-4cb0-820d-11a1a505cd86 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:45.182471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-24b79e28-d102-46d6-8930-3ae2df8b04d0 req-e77ccd74-e148-4cb0-820d-11a1a505cd86 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:45.193430 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-24b79e28-d102-46d6-8930-3ae2df8b04d0 req-e77ccd74-e148-4cb0-820d-11a1a505cd86 service nova] Creating event network-vif-plugged:04e5c493-53c8-424b-8dc9-5063a03a3967 for instance 26030b31-03b0-4f1f-b2db-5473f44b7417 on n-h2-843700-1 May 28 05:56:45.198840 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-24b79e28-d102-46d6-8930-3ae2df8b04d0 req-e77ccd74-e148-4cb0-820d-11a1a505cd86 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029917 May 28 05:56:45.199471 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3888/7888] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:56:45.419568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-77c07ff8-5e2f-4996-bb1f-cd2379b968e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:56:45.420194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-77c07ff8-5e2f-4996-bb1f-cd2379b968e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:56:45.427117 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77c07ff8-5e2f-4996-bb1f-cd2379b968e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:45.427583 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77c07ff8-5e2f-4996-bb1f-cd2379b968e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:45.428355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77c07ff8-5e2f-4996-bb1f-cd2379b968e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:45.428803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-77c07ff8-5e2f-4996-bb1f-cd2379b968e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:45.561424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-77c07ff8-5e2f-4996-bb1f-cd2379b968e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:56:45.569080 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-77c07ff8-5e2f-4996-bb1f-cd2379b968e6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1390 microversion: 2.1 time: 0.153452 May 28 05:56:45.569661 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4001/7889] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:56:45 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:56:46.584396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:56:46.589357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-36c3cafa-2417-4363-ad4c-2f686c636d5e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:56:46.590187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-36c3cafa-2417-4363-ad4c-2f686c636d5e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:56:46.596528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-36c3cafa-2417-4363-ad4c-2f686c636d5e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:46.597006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-36c3cafa-2417-4363-ad4c-2f686c636d5e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:46.597945 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-36c3cafa-2417-4363-ad4c-2f686c636d5e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:46.598401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-36c3cafa-2417-4363-ad4c-2f686c636d5e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:46.735940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-36c3cafa-2417-4363-ad4c-2f686c636d5e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:56:46.743588 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-36c3cafa-2417-4363-ad4c-2f686c636d5e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1562 microversion: 2.1 time: 0.161256 May 28 05:56:46.744177 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3889/7890] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:56:46 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:56:46.762724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-07f2d833-b84b-4062-aee9-e25e8fd59f08 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:56:46.763396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-07f2d833-b84b-4062-aee9-e25e8fd59f08 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:56:46.765260 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:56:46.765980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:56:46.771892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07f2d833-b84b-4062-aee9-e25e8fd59f08 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:46.772352 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07f2d833-b84b-4062-aee9-e25e8fd59f08 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:46.773156 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07f2d833-b84b-4062-aee9-e25e8fd59f08 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:46.773599 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-07f2d833-b84b-4062-aee9-e25e8fd59f08 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:46.905569 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-07f2d833-b84b-4062-aee9-e25e8fd59f08 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:56:46.913483 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-07f2d833-b84b-4062-aee9-e25e8fd59f08 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1562 microversion: 2.1 time: 0.155199 May 28 05:56:46.914067 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4002/7891] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:56:46 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:56:48.823953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0209ca5d-3ad6-45f4-b240-c6d99105f5ed tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:56:48.825318 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0209ca5d-3ad6-45f4-b240-c6d99105f5ed tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:56:48.828831 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-bc9d50fc-5b25-4957-92c5-9260fdf2d414 req-4c6c024f-8332-4d05-976d-3263e0c9d505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26030b31-03b0-4f1f-b2db-5473f44b7417", "tag": "04e5c493-53c8-424b-8dc9-5063a03a3967"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:56:48.834237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0209ca5d-3ad6-45f4-b240-c6d99105f5ed tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:48.835059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0209ca5d-3ad6-45f4-b240-c6d99105f5ed tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:48.836102 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0209ca5d-3ad6-45f4-b240-c6d99105f5ed tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:48.836824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0209ca5d-3ad6-45f4-b240-c6d99105f5ed tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:48.837136 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-bc9d50fc-5b25-4957-92c5-9260fdf2d414 req-4c6c024f-8332-4d05-976d-3263e0c9d505 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:56:48.837602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-bc9d50fc-5b25-4957-92c5-9260fdf2d414 req-4c6c024f-8332-4d05-976d-3263e0c9d505 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:56:48.851215 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-bc9d50fc-5b25-4957-92c5-9260fdf2d414 req-4c6c024f-8332-4d05-976d-3263e0c9d505 service nova] Creating event network-changed:04e5c493-53c8-424b-8dc9-5063a03a3967 for instance 26030b31-03b0-4f1f-b2db-5473f44b7417 on n-h2-843700-1 May 28 05:56:48.857227 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-bc9d50fc-5b25-4957-92c5-9260fdf2d414 req-4c6c024f-8332-4d05-976d-3263e0c9d505 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032875 May 28 05:56:48.857861 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4003/7892] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:56:49.091268 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0209ca5d-3ad6-45f4-b240-c6d99105f5ed tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:56:49.104897 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0209ca5d-3ad6-45f4-b240-c6d99105f5ed tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1562 microversion: 2.1 time: 0.284873 May 28 05:56:49.105813 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3890/7893] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:56:48 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1562 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:57:10.353286 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=7 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:57:10.354048 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=40 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:57:10.358232 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3c3f3913-4fba-4eb4-bf12-66a0d26af3c9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:57:10.359323 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3c3f3913-4fba-4eb4-bf12-66a0d26af3c9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:57:10.365437 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c3f3913-4fba-4eb4-bf12-66a0d26af3c9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:10.367313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c3f3913-4fba-4eb4-bf12-66a0d26af3c9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:10.367313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c3f3913-4fba-4eb4-bf12-66a0d26af3c9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:10.367313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3c3f3913-4fba-4eb4-bf12-66a0d26af3c9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:10.419953 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3c3f3913-4fba-4eb4-bf12-66a0d26af3c9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417/action" status: 200 len: 24576 microversion: 2.1 time: 0.068465 May 28 05:57:10.420517 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4004/7894] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:57:10 2022] POST /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417/action => generated 24576 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:57:21.479932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e31dea53-bc4b-4263-9248-800d3d48b94a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:57:21.482344 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:57:21.483021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=34 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:57:21.487847 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e31dea53-bc4b-4263-9248-800d3d48b94a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:21.493704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e31dea53-bc4b-4263-9248-800d3d48b94a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:21.511531 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e31dea53-bc4b-4263-9248-800d3d48b94a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Going to try to stop instance {{(pid=126043) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 05:57:21.670968 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e31dea53-bc4b-4263-9248-800d3d48b94a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417/action" status: 202 len: 0 microversion: 2.1 time: 0.194905 May 28 05:57:21.671609 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3891/7895] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:57:21 2022] POST /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:57:21.680188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-501820ec-7234-4008-868d-f427bdc11d53 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:57:21.681541 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-501820ec-7234-4008-868d-f427bdc11d53 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:57:21.684643 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:57:21.685284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:57:21.690507 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-501820ec-7234-4008-868d-f427bdc11d53 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:21.690959 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-501820ec-7234-4008-868d-f427bdc11d53 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:21.691752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-501820ec-7234-4008-868d-f427bdc11d53 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:21.692190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-501820ec-7234-4008-868d-f427bdc11d53 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:21.828766 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-501820ec-7234-4008-868d-f427bdc11d53 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:57:21.837347 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-501820ec-7234-4008-868d-f427bdc11d53 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1690 microversion: 2.1 time: 0.161350 May 28 05:57:21.837937 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4005/7896] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:57:21 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:57:22.856442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f7bf8976-d612-4f07-b304-1da156271f29 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:57:22.857188 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f7bf8976-d612-4f07-b304-1da156271f29 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:57:22.863919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7bf8976-d612-4f07-b304-1da156271f29 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:22.864393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7bf8976-d612-4f07-b304-1da156271f29 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:22.865180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7bf8976-d612-4f07-b304-1da156271f29 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:22.865644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f7bf8976-d612-4f07-b304-1da156271f29 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:22.994621 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f7bf8976-d612-4f07-b304-1da156271f29 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:57:23.002608 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f7bf8976-d612-4f07-b304-1da156271f29 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1690 microversion: 2.1 time: 0.151378 May 28 05:57:23.003234 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3892/7897] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:57:22 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:57:24.020565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a0d57fa8-a192-4021-bdb0-90bd3a41ebe0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:57:24.021190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a0d57fa8-a192-4021-bdb0-90bd3a41ebe0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:57:24.028816 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0d57fa8-a192-4021-bdb0-90bd3a41ebe0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:24.029276 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0d57fa8-a192-4021-bdb0-90bd3a41ebe0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:24.030054 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0d57fa8-a192-4021-bdb0-90bd3a41ebe0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:24.030499 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a0d57fa8-a192-4021-bdb0-90bd3a41ebe0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:24.162334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a0d57fa8-a192-4021-bdb0-90bd3a41ebe0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:57:24.170049 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a0d57fa8-a192-4021-bdb0-90bd3a41ebe0 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1690 microversion: 2.1 time: 0.153492 May 28 05:57:24.170645 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4006/7898] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:57:24 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:57:25.186686 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5740fb1f-edb8-40a5-ae0e-2cca5cfacac9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:57:25.187368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5740fb1f-edb8-40a5-ae0e-2cca5cfacac9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:57:25.194334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5740fb1f-edb8-40a5-ae0e-2cca5cfacac9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:25.194811 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5740fb1f-edb8-40a5-ae0e-2cca5cfacac9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:25.195630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5740fb1f-edb8-40a5-ae0e-2cca5cfacac9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:25.196096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5740fb1f-edb8-40a5-ae0e-2cca5cfacac9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:25.328507 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5740fb1f-edb8-40a5-ae0e-2cca5cfacac9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:57:25.336401 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5740fb1f-edb8-40a5-ae0e-2cca5cfacac9 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1690 microversion: 2.1 time: 0.153584 May 28 05:57:25.337514 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3893/7899] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:57:25 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:57:26.354220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-486c7348-e4e2-450d-a2e8-f90fabcf4279 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:57:26.354829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-486c7348-e4e2-450d-a2e8-f90fabcf4279 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:57:26.361508 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-486c7348-e4e2-450d-a2e8-f90fabcf4279 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:26.361961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-486c7348-e4e2-450d-a2e8-f90fabcf4279 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:26.362724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-486c7348-e4e2-450d-a2e8-f90fabcf4279 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:26.363195 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-486c7348-e4e2-450d-a2e8-f90fabcf4279 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:26.491279 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-486c7348-e4e2-450d-a2e8-f90fabcf4279 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:57:26.499703 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-486c7348-e4e2-450d-a2e8-f90fabcf4279 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1690 microversion: 2.1 time: 0.149931 May 28 05:57:26.500275 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4007/7900] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:57:26 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:57:27.516655 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6ea13c23-2013-46c1-b416-9a905d7e3106 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:57:27.517204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6ea13c23-2013-46c1-b416-9a905d7e3106 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:57:27.524706 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ea13c23-2013-46c1-b416-9a905d7e3106 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:27.525169 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ea13c23-2013-46c1-b416-9a905d7e3106 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:27.525973 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ea13c23-2013-46c1-b416-9a905d7e3106 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:27.526421 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6ea13c23-2013-46c1-b416-9a905d7e3106 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:27.658605 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6ea13c23-2013-46c1-b416-9a905d7e3106 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:57:27.666155 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6ea13c23-2013-46c1-b416-9a905d7e3106 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1690 microversion: 2.1 time: 0.153615 May 28 05:57:27.666732 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3894/7901] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:57:27 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:57:28.683992 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-09012ede-b9d7-4ee8-a979-2d8f5cdac65e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:57:28.684612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-09012ede-b9d7-4ee8-a979-2d8f5cdac65e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:57:28.691625 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09012ede-b9d7-4ee8-a979-2d8f5cdac65e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:28.692088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09012ede-b9d7-4ee8-a979-2d8f5cdac65e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:28.693129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09012ede-b9d7-4ee8-a979-2d8f5cdac65e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:28.693584 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-09012ede-b9d7-4ee8-a979-2d8f5cdac65e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:28.821370 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-09012ede-b9d7-4ee8-a979-2d8f5cdac65e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:57:28.828862 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-09012ede-b9d7-4ee8-a979-2d8f5cdac65e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1690 microversion: 2.1 time: 0.149439 May 28 05:57:28.829472 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4008/7902] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:57:28 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:57:29.845999 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0ed527fa-f067-46a7-9e24-a90c6abf5ea4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:57:29.846640 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0ed527fa-f067-46a7-9e24-a90c6abf5ea4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:57:29.854417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ed527fa-f067-46a7-9e24-a90c6abf5ea4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:29.854892 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ed527fa-f067-46a7-9e24-a90c6abf5ea4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:29.855708 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ed527fa-f067-46a7-9e24-a90c6abf5ea4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:29.856167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ed527fa-f067-46a7-9e24-a90c6abf5ea4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:29.991080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0ed527fa-f067-46a7-9e24-a90c6abf5ea4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:57:29.999055 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0ed527fa-f067-46a7-9e24-a90c6abf5ea4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1690 microversion: 2.1 time: 0.156993 May 28 05:57:29.999644 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3895/7903] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:57:29 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:57:31.016680 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-aafbe01d-010a-4e28-9267-762b515f8b5c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:57:31.017296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-aafbe01d-010a-4e28-9267-762b515f8b5c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:57:31.026043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aafbe01d-010a-4e28-9267-762b515f8b5c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:31.026322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aafbe01d-010a-4e28-9267-762b515f8b5c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:31.027134 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aafbe01d-010a-4e28-9267-762b515f8b5c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:31.027571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-aafbe01d-010a-4e28-9267-762b515f8b5c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:31.161863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-aafbe01d-010a-4e28-9267-762b515f8b5c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:57:31.170212 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-aafbe01d-010a-4e28-9267-762b515f8b5c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1690 microversion: 2.1 time: 0.157848 May 28 05:57:31.170790 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4009/7904] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:57:31 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:57:32.188177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9870c0cd-5479-41eb-a90b-76fa7d5d298e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:57:32.188800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9870c0cd-5479-41eb-a90b-76fa7d5d298e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:57:32.195845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9870c0cd-5479-41eb-a90b-76fa7d5d298e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:32.196308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9870c0cd-5479-41eb-a90b-76fa7d5d298e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:32.197080 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9870c0cd-5479-41eb-a90b-76fa7d5d298e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:32.197528 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9870c0cd-5479-41eb-a90b-76fa7d5d298e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:32.325126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9870c0cd-5479-41eb-a90b-76fa7d5d298e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:57:32.332597 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9870c0cd-5479-41eb-a90b-76fa7d5d298e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1690 microversion: 2.1 time: 0.148457 May 28 05:57:32.333170 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3896/7905] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:57:32 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1690 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:57:33.349679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1c35c303-da8e-4e0e-afe3-1b6f12c4b781 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:57:33.350284 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1c35c303-da8e-4e0e-afe3-1b6f12c4b781 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:57:33.357456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1c35c303-da8e-4e0e-afe3-1b6f12c4b781 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:33.357940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1c35c303-da8e-4e0e-afe3-1b6f12c4b781 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:33.358696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1c35c303-da8e-4e0e-afe3-1b6f12c4b781 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:33.359184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1c35c303-da8e-4e0e-afe3-1b6f12c4b781 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:33.492968 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1c35c303-da8e-4e0e-afe3-1b6f12c4b781 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:57:33.500870 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1c35c303-da8e-4e0e-afe3-1b6f12c4b781 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1690 microversion: 2.1 time: 0.155174 May 28 05:57:33.506599 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4010/7906] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:57:33 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:57:34.519579 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-11203bd4-7586-4495-afdc-975d9d4a3e0c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:57:34.520131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-11203bd4-7586-4495-afdc-975d9d4a3e0c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:57:34.528070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11203bd4-7586-4495-afdc-975d9d4a3e0c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:34.528545 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11203bd4-7586-4495-afdc-975d9d4a3e0c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:34.529328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11203bd4-7586-4495-afdc-975d9d4a3e0c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:34.529790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-11203bd4-7586-4495-afdc-975d9d4a3e0c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:34.668926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-11203bd4-7586-4495-afdc-975d9d4a3e0c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:57:34.676823 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-11203bd4-7586-4495-afdc-975d9d4a3e0c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1690 microversion: 2.1 time: 0.161271 May 28 05:57:34.678008 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3897/7907] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:57:34 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:57:35.693863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9a9f0b65-89c0-406a-be21-c86706d589d4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:57:35.694484 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9a9f0b65-89c0-406a-be21-c86706d589d4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:57:35.701495 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a9f0b65-89c0-406a-be21-c86706d589d4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:35.701958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a9f0b65-89c0-406a-be21-c86706d589d4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:35.702758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a9f0b65-89c0-406a-be21-c86706d589d4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:35.703231 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9a9f0b65-89c0-406a-be21-c86706d589d4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:35.837812 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9a9f0b65-89c0-406a-be21-c86706d589d4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:57:35.845251 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9a9f0b65-89c0-406a-be21-c86706d589d4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1690 microversion: 2.1 time: 0.155329 May 28 05:57:35.845820 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4011/7908] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:57:35 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:57:36.862889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bce0b08f-0fa9-48a8-a283-31f444ee9216 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:57:36.863571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bce0b08f-0fa9-48a8-a283-31f444ee9216 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:57:36.871418 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bce0b08f-0fa9-48a8-a283-31f444ee9216 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:36.871880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bce0b08f-0fa9-48a8-a283-31f444ee9216 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:36.872651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bce0b08f-0fa9-48a8-a283-31f444ee9216 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:36.873096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bce0b08f-0fa9-48a8-a283-31f444ee9216 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:37.004474 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bce0b08f-0fa9-48a8-a283-31f444ee9216 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:57:37.012868 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bce0b08f-0fa9-48a8-a283-31f444ee9216 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1690 microversion: 2.1 time: 0.153905 May 28 05:57:37.016808 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3898/7909] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:57:36 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:57:38.030054 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3566dc3a-7e75-4998-8154-e5a1ffddd418 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:57:38.030677 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3566dc3a-7e75-4998-8154-e5a1ffddd418 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:57:38.037689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3566dc3a-7e75-4998-8154-e5a1ffddd418 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:38.038147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3566dc3a-7e75-4998-8154-e5a1ffddd418 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:38.038922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3566dc3a-7e75-4998-8154-e5a1ffddd418 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:38.039398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3566dc3a-7e75-4998-8154-e5a1ffddd418 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:38.170749 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3566dc3a-7e75-4998-8154-e5a1ffddd418 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:57:38.178446 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3566dc3a-7e75-4998-8154-e5a1ffddd418 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1667 microversion: 2.1 time: 0.153009 May 28 05:57:38.179047 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4012/7910] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:57:38 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:57:39.269682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4d8c775d-b6d1-4103-8e08-425150f381d8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:57:39.270672 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4d8c775d-b6d1-4103-8e08-425150f381d8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:57:39.278345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d8c775d-b6d1-4103-8e08-425150f381d8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:39.278815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d8c775d-b6d1-4103-8e08-425150f381d8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:39.279633 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d8c775d-b6d1-4103-8e08-425150f381d8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:39.280093 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4d8c775d-b6d1-4103-8e08-425150f381d8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:39.327875 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4d8c775d-b6d1-4103-8e08-425150f381d8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417/action" status: 200 len: 38430 microversion: 2.1 time: 0.061930 May 28 05:57:39.328458 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3899/7911] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:57:39 2022] POST /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417/action => generated 38430 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:57:39.340105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ac248ada-ab4b-4fce-ad44-efb9ad235b49 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:57:39.347026 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac248ada-ab4b-4fce-ad44-efb9ad235b49 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:39.347482 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ac248ada-ab4b-4fce-ad44-efb9ad235b49 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:39.368792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ac248ada-ab4b-4fce-ad44-efb9ad235b49 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Going to try to start instance {{(pid=126044) start /opt/stack/nova/nova/compute/api.py:2730}} May 28 05:57:39.482647 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ac248ada-ab4b-4fce-ad44-efb9ad235b49 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417/action" status: 202 len: 0 microversion: 2.1 time: 0.146872 May 28 05:57:39.484153 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4013/7912] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:57:39 2022] POST /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:57:39.492397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5743185b-f7cb-46f1-b472-0a93b247530a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:57:39.493112 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5743185b-f7cb-46f1-b472-0a93b247530a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:57:39.500685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5743185b-f7cb-46f1-b472-0a93b247530a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:39.501150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5743185b-f7cb-46f1-b472-0a93b247530a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:39.501963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5743185b-f7cb-46f1-b472-0a93b247530a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:39.502414 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5743185b-f7cb-46f1-b472-0a93b247530a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:39.680000 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5743185b-f7cb-46f1-b472-0a93b247530a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:57:39.688345 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5743185b-f7cb-46f1-b472-0a93b247530a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1676 microversion: 2.1 time: 0.200340 May 28 05:57:39.688914 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3900/7913] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:57:39 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1676 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:57:40.706719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0a161656-1e9e-4f96-b12b-101211f0d2cc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:57:40.708152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0a161656-1e9e-4f96-b12b-101211f0d2cc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:57:40.718038 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0a161656-1e9e-4f96-b12b-101211f0d2cc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:40.719890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0a161656-1e9e-4f96-b12b-101211f0d2cc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:40.719890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0a161656-1e9e-4f96-b12b-101211f0d2cc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:57:40.719890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0a161656-1e9e-4f96-b12b-101211f0d2cc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:57:40.855747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0a161656-1e9e-4f96-b12b-101211f0d2cc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:57:40.863293 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0a161656-1e9e-4f96-b12b-101211f0d2cc tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1680 microversion: 2.1 time: 0.161116 May 28 05:57:40.863859 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4014/7914] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:57:40 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:57:49.747442 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 05:57:49.747949 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 05:57:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 05:58:05.053786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-46697c66-9d9d-40a0-8951-c67d80eccf8a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:58:05.054762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-46697c66-9d9d-40a0-8951-c67d80eccf8a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:58:05.058142 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=20 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:58:05.058824 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:58:05.064431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46697c66-9d9d-40a0-8951-c67d80eccf8a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:05.064898 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46697c66-9d9d-40a0-8951-c67d80eccf8a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:05.065674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46697c66-9d9d-40a0-8951-c67d80eccf8a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:05.066124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-46697c66-9d9d-40a0-8951-c67d80eccf8a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:05.122658 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-46697c66-9d9d-40a0-8951-c67d80eccf8a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417/action" status: 200 len: 62998 microversion: 2.1 time: 0.068478 May 28 05:58:05.122658 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3901/7915] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:58:05 2022] POST /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417/action => generated 62998 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:58:12.445293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-31142179-87bd-480f-9883-a25c703f6df7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:58:12.445806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-31142179-87bd-480f-9883-a25c703f6df7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:58:12.447722 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-286d99e2-6403-43ab-b3a9-a65e2dd8bd5c req-85bfa53c-1378-41c9-b341-142a93a72e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26030b31-03b0-4f1f-b2db-5473f44b7417", "tag": "04e5c493-53c8-424b-8dc9-5063a03a3967"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:58:12.448181 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=20 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:58:12.448946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:58:12.454164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31142179-87bd-480f-9883-a25c703f6df7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:12.454396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31142179-87bd-480f-9883-a25c703f6df7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:12.455316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31142179-87bd-480f-9883-a25c703f6df7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:12.455826 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31142179-87bd-480f-9883-a25c703f6df7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:12.461294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-286d99e2-6403-43ab-b3a9-a65e2dd8bd5c req-85bfa53c-1378-41c9-b341-142a93a72e3e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:12.461294 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-286d99e2-6403-43ab-b3a9-a65e2dd8bd5c req-85bfa53c-1378-41c9-b341-142a93a72e3e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:12.478226 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-286d99e2-6403-43ab-b3a9-a65e2dd8bd5c req-85bfa53c-1378-41c9-b341-142a93a72e3e service nova] Creating event network-changed:04e5c493-53c8-424b-8dc9-5063a03a3967 for instance 26030b31-03b0-4f1f-b2db-5473f44b7417 on n-h2-843700-1 May 28 05:58:12.483829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-31142179-87bd-480f-9883-a25c703f6df7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:58:12.486159 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-286d99e2-6403-43ab-b3a9-a65e2dd8bd5c req-85bfa53c-1378-41c9-b341-142a93a72e3e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040209 May 28 05:58:12.486159 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3902/7916] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:58:12.787580 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-31142179-87bd-480f-9883-a25c703f6df7 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "DELETE /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 204 len: 0 microversion: 2.1 time: 0.346687 May 28 05:58:12.788336 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4015/7917] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:58:12 2022] DELETE /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:58:12.798121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-3c21a167-df8a-4560-ad80-682da9258533 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:58:12.798942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-3c21a167-df8a-4560-ad80-682da9258533 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:58:12.807461 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c21a167-df8a-4560-ad80-682da9258533 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:12.808051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c21a167-df8a-4560-ad80-682da9258533 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:12.808919 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c21a167-df8a-4560-ad80-682da9258533 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:12.809465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-3c21a167-df8a-4560-ad80-682da9258533 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:12.996559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-3c21a167-df8a-4560-ad80-682da9258533 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:58:13.004456 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-3c21a167-df8a-4560-ad80-682da9258533 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1686 microversion: 2.1 time: 0.210931 May 28 05:58:13.005034 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3903/7918] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:58:12 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1686 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:58:14.024204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8ada82de-615a-4b55-8865-852a238c0406 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:58:14.025457 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8ada82de-615a-4b55-8865-852a238c0406 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:58:14.033225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ada82de-615a-4b55-8865-852a238c0406 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:14.033682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ada82de-615a-4b55-8865-852a238c0406 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:14.034452 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ada82de-615a-4b55-8865-852a238c0406 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:14.034897 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ada82de-615a-4b55-8865-852a238c0406 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:14.276549 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8ada82de-615a-4b55-8865-852a238c0406 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:58:14.284354 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8ada82de-615a-4b55-8865-852a238c0406 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1686 microversion: 2.1 time: 0.264586 May 28 05:58:14.285197 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4016/7919] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:58:14 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1686 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:58:14.725183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-2b207468-c0d2-43b8-aef1-a64419ab6c53 req-a2ad023d-b7be-4f4a-8997-a2bbd22c6134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26030b31-03b0-4f1f-b2db-5473f44b7417", "name": "network-vif-deleted", "tag": "04e5c493-53c8-424b-8dc9-5063a03a3967"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:58:14.734415 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2b207468-c0d2-43b8-aef1-a64419ab6c53 req-a2ad023d-b7be-4f4a-8997-a2bbd22c6134 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:14.735776 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2b207468-c0d2-43b8-aef1-a64419ab6c53 req-a2ad023d-b7be-4f4a-8997-a2bbd22c6134 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:14.746804 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-2b207468-c0d2-43b8-aef1-a64419ab6c53 req-a2ad023d-b7be-4f4a-8997-a2bbd22c6134 service nova] Creating event network-vif-deleted:04e5c493-53c8-424b-8dc9-5063a03a3967 for instance 26030b31-03b0-4f1f-b2db-5473f44b7417 on n-h2-843700-1 May 28 05:58:14.751708 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-2b207468-c0d2-43b8-aef1-a64419ab6c53 req-a2ad023d-b7be-4f4a-8997-a2bbd22c6134 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030552 May 28 05:58:14.752287 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3904/7920] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:58:15.303303 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-52173baa-0a3a-4eca-8344-486e782e120a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:58:15.303967 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-52173baa-0a3a-4eca-8344-486e782e120a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:58:15.313903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52173baa-0a3a-4eca-8344-486e782e120a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:15.314400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52173baa-0a3a-4eca-8344-486e782e120a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:15.315213 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52173baa-0a3a-4eca-8344-486e782e120a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:15.315661 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52173baa-0a3a-4eca-8344-486e782e120a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:15.346220 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52173baa-0a3a-4eca-8344-486e782e120a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:15.346682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-52173baa-0a3a-4eca-8344-486e782e120a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:15.347188 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-52173baa-0a3a-4eca-8344-486e782e120a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lazy-loading 'fault' on Instance uuid 26030b31-03b0-4f1f-b2db-5473f44b7417 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:58:15.392017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-52173baa-0a3a-4eca-8344-486e782e120a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:58:15.399585 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-52173baa-0a3a-4eca-8344-486e782e120a tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 200 len: 1356 microversion: 2.1 time: 0.100193 May 28 05:58:15.400162 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4017/7921] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:58:15 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 1356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:58:16.417832 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ee501e87-891e-4101-9350-b7764297098b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:58:16.418479 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-ee501e87-891e-4101-9350-b7764297098b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 26030b31-03b0-4f1f-b2db-5473f44b7417] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:58:16.424839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ee501e87-891e-4101-9350-b7764297098b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:16.425308 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ee501e87-891e-4101-9350-b7764297098b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:16.426090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ee501e87-891e-4101-9350-b7764297098b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:16.426547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-ee501e87-891e-4101-9350-b7764297098b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:16.440639 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-ee501e87-891e-4101-9350-b7764297098b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] HTTP exception thrown: Instance 26030b31-03b0-4f1f-b2db-5473f44b7417 could not be found. May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ee501e87-891e-4101-9350-b7764297098b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Request method failure captured: May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 HTTP/1.1 May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbhqOgVkVYlgtcjZ8mDe_IQDNUqxx11YvunBU1SK3vtlWX-R-IzWraGt8vkjovszbapQtf3pdd97wuZwcsk_aAT7NxFm4DWf5-O7ZGW38a5Y5ysvAizQD5f24_6jK5aEpE_iFnq4qzGXIoYl5ta8zTN4fYRXo_WPUfWUhgxulf_h-tU May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 8df3b01779bd4e198777ddc16182cda3 May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1455991122 May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8df3b01779bd4e198777ddc16182cda3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8df3b01779bd4e198777ddc16182cda3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8df3b01779bd4e198777ddc16182cda3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8df3b01779bd4e198777ddc16182cda3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1455991122 May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 8df3b01779bd4e198777ddc16182cda3 May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1455991122 May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestNetworkAdvancedServerOps-1455991122-project May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 1bcabf3cdb7c4f02a50aeb508775222a May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1455991122-project May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 26030b31-03b0-4f1f-b2db-5473f44b7417 could not be found. May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '26030b31-03b0-4f1f-b2db-5473f44b7417'} May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26030b31-03b0-4f1f-b2db-5473f44b7417 could not be found. May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26030b31-03b0-4f1f-b2db-5473f44b7417 could not be found. May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:58:16.442394 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:58:16.446115 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:58:16.446115 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:58:16.446115 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:58:16.446115 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:58:16.446115 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:58:16.446115 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:58:16.446115 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26030b31-03b0-4f1f-b2db-5473f44b7417 could not be found. May 28 05:58:16.446115 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 05:58:16.446115 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-ee501e87-891e-4101-9350-b7764297098b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Returning 404 to user: Instance 26030b31-03b0-4f1f-b2db-5473f44b7417 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:58:16.446115 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-ee501e87-891e-4101-9350-b7764297098b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417" status: 404 len: 111 microversion: 2.1 time: 0.031561 May 28 05:58:16.446115 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3905/7922] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:58:16 2022] GET /compute/v2.1/servers/26030b31-03b0-4f1f-b2db-5473f44b7417 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:58:19.888297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a16fb21a-6317-4095-b1a2-6c667258e091 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '.version_select at 0x7f7700c34dc0>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:58:19.970887 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a16fb21a-6317-4095-b1a2-6c667258e091 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-848556867" status: 202 len: 0 microversion: 2.1 time: 0.086654 May 28 05:58:19.971529 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4018/7923] 10.222.0.58 () {58 vars in 1280 bytes} [Sat May 28 05:58:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-848556867 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:58:20.004938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a57e7c59-5eba-4dd7-8a77-e3ca1167a05f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'create', calling method: .version_select at 0x7f7701a8e550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1392966148", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgDNt0kDZTwt4OSrmFxzMMs7gbQsLNEbRJZ7DhXJbQI1oZqn1pMDBjLkGL2srv9cg3nV9E9NT9EFHSdoJRUpu/htiVXJ/vppzld2FbabAhddzi/zjzr7LxDIeYBStod1g=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:58:20.019899 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-a57e7c59-5eba-4dd7-8a77-e3ca1167a05f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Getting quotas for project 8df3b01779bd4e198777ddc16182cda3. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:58:20.025960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-a57e7c59-5eba-4dd7-8a77-e3ca1167a05f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Getting quotas for user 1bcabf3cdb7c4f02a50aeb508775222a and project 8df3b01779bd4e198777ddc16182cda3. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:58:20.102539 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a57e7c59-5eba-4dd7-8a77-e3ca1167a05f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.101642 May 28 05:58:20.103170 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3906/7924] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 05:58:19 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:58:28.367876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:58:28.373466 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a79bf1b6-e1cf-4d54-bb17-85eecf4a6227 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1357039882", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "networks": [{"uuid": "f2eff0a4-8599-4938-9825-3077fa8c6a36"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1392966148", "security_groups": [{"name": "tempest-secgroup-smoke-1239612223"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:58:28.500804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-a79bf1b6-e1cf-4d54-bb17-85eecf4a6227 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] validate_networks() for [('f2eff0a4-8599-4938-9825-3077fa8c6a36', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:58:28.973565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a79bf1b6-e1cf-4d54-bb17-85eecf4a6227 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:58:28.974121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a79bf1b6-e1cf-4d54-bb17-85eecf4a6227 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:58:28.974610 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a79bf1b6-e1cf-4d54-bb17-85eecf4a6227 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:58:28.975059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a79bf1b6-e1cf-4d54-bb17-85eecf4a6227 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:58:28.975521 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-a79bf1b6-e1cf-4d54-bb17-85eecf4a6227 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:58:28.988907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a79bf1b6-e1cf-4d54-bb17-85eecf4a6227 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:28.989596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a79bf1b6-e1cf-4d54-bb17-85eecf4a6227 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:28.990429 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a79bf1b6-e1cf-4d54-bb17-85eecf4a6227 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:28.991063 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a79bf1b6-e1cf-4d54-bb17-85eecf4a6227 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:29.013684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-a79bf1b6-e1cf-4d54-bb17-85eecf4a6227 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Getting quotas for project 8df3b01779bd4e198777ddc16182cda3. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:58:29.019132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-a79bf1b6-e1cf-4d54-bb17-85eecf4a6227 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Getting quotas for user 1bcabf3cdb7c4f02a50aeb508775222a and project 8df3b01779bd4e198777ddc16182cda3. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:58:29.032282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a79bf1b6-e1cf-4d54-bb17-85eecf4a6227 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:58:29.034735 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a79bf1b6-e1cf-4d54-bb17-85eecf4a6227 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:58:29.161151 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a79bf1b6-e1cf-4d54-bb17-85eecf4a6227 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.795132 May 28 05:58:29.162421 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4019/7925] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:58:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:58:29.172929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=16 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:58:29.178214 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1bc941aa-0fd1-4a54-8854-28a7fe8586e4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:58:29.178821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1bc941aa-0fd1-4a54-8854-28a7fe8586e4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:58:29.252305 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1bc941aa-0fd1-4a54-8854-28a7fe8586e4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:58:29.270004 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1bc941aa-0fd1-4a54-8854-28a7fe8586e4 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1267 microversion: 2.1 time: 0.092198 May 28 05:58:29.270703 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3907/7926] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:58:29 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1267 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:58:30.287594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8ffdc773-1782-47ab-a875-889b157a03bb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:58:30.288652 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8ffdc773-1782-47ab-a875-889b157a03bb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:58:30.295194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ffdc773-1782-47ab-a875-889b157a03bb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:30.295658 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ffdc773-1782-47ab-a875-889b157a03bb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:30.296443 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ffdc773-1782-47ab-a875-889b157a03bb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:30.296888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ffdc773-1782-47ab-a875-889b157a03bb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:30.362325 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8ffdc773-1782-47ab-a875-889b157a03bb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:58:30.370831 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8ffdc773-1782-47ab-a875-889b157a03bb tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1271 microversion: 2.1 time: 0.088000 May 28 05:58:30.371693 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4020/7927] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:58:30 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:58:31.388237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2a44bfb9-5ba4-471c-a524-35baab771c6f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:58:31.390212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2a44bfb9-5ba4-471c-a524-35baab771c6f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:58:31.397969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a44bfb9-5ba4-471c-a524-35baab771c6f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:31.398667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a44bfb9-5ba4-471c-a524-35baab771c6f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:31.399516 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a44bfb9-5ba4-471c-a524-35baab771c6f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:31.399984 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a44bfb9-5ba4-471c-a524-35baab771c6f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:31.471535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2a44bfb9-5ba4-471c-a524-35baab771c6f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:58:31.480106 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2a44bfb9-5ba4-471c-a524-35baab771c6f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1327 microversion: 2.1 time: 0.095982 May 28 05:58:31.480693 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3908/7928] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:58:31 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:58:32.498769 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-688bb9f8-a229-42d8-a74d-baf22b31e78b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:58:32.499458 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-688bb9f8-a229-42d8-a74d-baf22b31e78b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:58:32.506978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-688bb9f8-a229-42d8-a74d-baf22b31e78b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:32.507476 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-688bb9f8-a229-42d8-a74d-baf22b31e78b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:32.508269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-688bb9f8-a229-42d8-a74d-baf22b31e78b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:32.508725 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-688bb9f8-a229-42d8-a74d-baf22b31e78b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:32.648543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-688bb9f8-a229-42d8-a74d-baf22b31e78b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:58:32.656109 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-688bb9f8-a229-42d8-a74d-baf22b31e78b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1393 microversion: 2.1 time: 0.162346 May 28 05:58:32.656684 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4021/7929] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:58:32 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:58:33.047638 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-9f41d83f-6e8f-4cde-9d78-704edfcca0d3 req-465e5ed7-3506-4b33-b843-6ce9fea39f15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d4a4ac6-d66b-434a-8b17-3f932f18f5db", "tag": "172fe507-7900-4996-8bfe-201d36ee996a"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:58:33.062432 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9f41d83f-6e8f-4cde-9d78-704edfcca0d3 req-465e5ed7-3506-4b33-b843-6ce9fea39f15 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:33.062764 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-9f41d83f-6e8f-4cde-9d78-704edfcca0d3 req-465e5ed7-3506-4b33-b843-6ce9fea39f15 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:33.075090 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-9f41d83f-6e8f-4cde-9d78-704edfcca0d3 req-465e5ed7-3506-4b33-b843-6ce9fea39f15 service nova] Creating event network-changed:172fe507-7900-4996-8bfe-201d36ee996a for instance 8d4a4ac6-d66b-434a-8b17-3f932f18f5db on n-h2-843700-1 May 28 05:58:33.080703 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-9f41d83f-6e8f-4cde-9d78-704edfcca0d3 req-465e5ed7-3506-4b33-b843-6ce9fea39f15 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037083 May 28 05:58:33.081331 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3909/7930] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:58:33.672282 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-da4ba572-c786-4bda-9c91-72482f0fa662 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:58:33.672942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-da4ba572-c786-4bda-9c91-72482f0fa662 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:58:33.680356 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da4ba572-c786-4bda-9c91-72482f0fa662 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:33.680828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da4ba572-c786-4bda-9c91-72482f0fa662 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:33.682121 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da4ba572-c786-4bda-9c91-72482f0fa662 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:33.682608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da4ba572-c786-4bda-9c91-72482f0fa662 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:33.818230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-da4ba572-c786-4bda-9c91-72482f0fa662 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:58:33.826481 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-da4ba572-c786-4bda-9c91-72482f0fa662 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1393 microversion: 2.1 time: 0.158112 May 28 05:58:33.827101 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4022/7931] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:58:33 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:58:34.845632 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-98a8664f-e2f2-4050-9c98-6caeeb5e3e2f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:58:34.846369 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-98a8664f-e2f2-4050-9c98-6caeeb5e3e2f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:58:34.852784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98a8664f-e2f2-4050-9c98-6caeeb5e3e2f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:34.853263 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98a8664f-e2f2-4050-9c98-6caeeb5e3e2f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:34.854056 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98a8664f-e2f2-4050-9c98-6caeeb5e3e2f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:34.854520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-98a8664f-e2f2-4050-9c98-6caeeb5e3e2f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:34.983848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-98a8664f-e2f2-4050-9c98-6caeeb5e3e2f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:58:34.991308 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-98a8664f-e2f2-4050-9c98-6caeeb5e3e2f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1393 microversion: 2.1 time: 0.150888 May 28 05:58:34.991888 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3910/7932] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:58:34 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1393 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:58:36.008718 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f5ffa358-9983-4c84-8d5c-636fbdea4ee6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:58:36.009238 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f5ffa358-9983-4c84-8d5c-636fbdea4ee6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:58:36.016456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5ffa358-9983-4c84-8d5c-636fbdea4ee6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:36.016922 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5ffa358-9983-4c84-8d5c-636fbdea4ee6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:36.017698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5ffa358-9983-4c84-8d5c-636fbdea4ee6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:36.018147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f5ffa358-9983-4c84-8d5c-636fbdea4ee6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:36.147720 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f5ffa358-9983-4c84-8d5c-636fbdea4ee6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:58:36.155959 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f5ffa358-9983-4c84-8d5c-636fbdea4ee6 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1393 microversion: 2.1 time: 0.151254 May 28 05:58:36.156547 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4023/7933] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:58:36 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1393 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:58:37.172809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-96af6f09-1b43-4a17-94bf-04875da71eaf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:58:37.173454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-96af6f09-1b43-4a17-94bf-04875da71eaf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:58:37.176374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:58:37.182096 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-96af6f09-1b43-4a17-94bf-04875da71eaf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:37.182571 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-96af6f09-1b43-4a17-94bf-04875da71eaf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:37.183401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-96af6f09-1b43-4a17-94bf-04875da71eaf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:37.183858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-96af6f09-1b43-4a17-94bf-04875da71eaf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:37.321826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-96af6f09-1b43-4a17-94bf-04875da71eaf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:58:37.333493 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-96af6f09-1b43-4a17-94bf-04875da71eaf tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1393 microversion: 2.1 time: 0.160576 May 28 05:58:37.333493 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3911/7934] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:58:37 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:58:38.346197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-884b18b9-5cf9-4c65-91c7-875289bf7c96 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:58:38.346829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-884b18b9-5cf9-4c65-91c7-875289bf7c96 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:58:38.353904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-884b18b9-5cf9-4c65-91c7-875289bf7c96 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:38.354371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-884b18b9-5cf9-4c65-91c7-875289bf7c96 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:38.355174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-884b18b9-5cf9-4c65-91c7-875289bf7c96 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:38.355627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-884b18b9-5cf9-4c65-91c7-875289bf7c96 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:38.484754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-884b18b9-5cf9-4c65-91c7-875289bf7c96 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:58:38.492338 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-884b18b9-5cf9-4c65-91c7-875289bf7c96 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1393 microversion: 2.1 time: 0.150099 May 28 05:58:38.492918 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4024/7935] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:58:38 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1393 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:58:39.510269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-89e0d233-c256-4088-ba83-1cc215e32085 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:58:39.511076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-89e0d233-c256-4088-ba83-1cc215e32085 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:58:39.513911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:58:39.518924 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-89e0d233-c256-4088-ba83-1cc215e32085 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:39.519445 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-89e0d233-c256-4088-ba83-1cc215e32085 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:39.520230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-89e0d233-c256-4088-ba83-1cc215e32085 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:39.520695 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-89e0d233-c256-4088-ba83-1cc215e32085 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:39.659514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-89e0d233-c256-4088-ba83-1cc215e32085 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:58:39.667348 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-89e0d233-c256-4088-ba83-1cc215e32085 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1393 microversion: 2.1 time: 0.161480 May 28 05:58:39.668013 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3912/7936] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:58:39 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:58:39.699498 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:58:39.700480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:58:39.751247 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-c16bba99-02a9-4cf1-ad6f-5aa65e6073c6 req-5b0a1dcf-8bb7-4e08-8ab1-bb8ff65bd87b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d4a4ac6-d66b-434a-8b17-3f932f18f5db", "name": "network-vif-plugged", "status": "completed", "tag": "172fe507-7900-4996-8bfe-201d36ee996a"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:58:39.759946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c16bba99-02a9-4cf1-ad6f-5aa65e6073c6 req-5b0a1dcf-8bb7-4e08-8ab1-bb8ff65bd87b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:39.760463 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c16bba99-02a9-4cf1-ad6f-5aa65e6073c6 req-5b0a1dcf-8bb7-4e08-8ab1-bb8ff65bd87b service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:39.772558 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-c16bba99-02a9-4cf1-ad6f-5aa65e6073c6 req-5b0a1dcf-8bb7-4e08-8ab1-bb8ff65bd87b service nova] Creating event network-vif-plugged:172fe507-7900-4996-8bfe-201d36ee996a for instance 8d4a4ac6-d66b-434a-8b17-3f932f18f5db on n-h2-843700-1 May 28 05:58:39.777608 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-c16bba99-02a9-4cf1-ad6f-5aa65e6073c6 req-5b0a1dcf-8bb7-4e08-8ab1-bb8ff65bd87b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083115 May 28 05:58:39.778222 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4025/7937] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:58:40.684578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-530d0067-163b-45f1-a5c2-8a904858f4c3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:58:40.685215 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-530d0067-163b-45f1-a5c2-8a904858f4c3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:58:40.692233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-530d0067-163b-45f1-a5c2-8a904858f4c3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:40.692710 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-530d0067-163b-45f1-a5c2-8a904858f4c3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:40.693499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-530d0067-163b-45f1-a5c2-8a904858f4c3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:40.693962 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-530d0067-163b-45f1-a5c2-8a904858f4c3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:40.826735 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-530d0067-163b-45f1-a5c2-8a904858f4c3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:58:40.834324 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-530d0067-163b-45f1-a5c2-8a904858f4c3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1393 microversion: 2.1 time: 0.153743 May 28 05:58:40.834894 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3913/7938] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:58:40 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:58:41.853931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1a4569c2-aac0-47f3-8b9e-fdf10cd8bf93 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:58:41.854636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1a4569c2-aac0-47f3-8b9e-fdf10cd8bf93 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:58:41.860912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a4569c2-aac0-47f3-8b9e-fdf10cd8bf93 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:41.861367 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a4569c2-aac0-47f3-8b9e-fdf10cd8bf93 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:41.862126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a4569c2-aac0-47f3-8b9e-fdf10cd8bf93 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:41.862568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1a4569c2-aac0-47f3-8b9e-fdf10cd8bf93 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:41.995911 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1a4569c2-aac0-47f3-8b9e-fdf10cd8bf93 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:58:42.003349 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1a4569c2-aac0-47f3-8b9e-fdf10cd8bf93 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1565 microversion: 2.1 time: 0.155195 May 28 05:58:42.003936 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4026/7939] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:58:41 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:58:42.019455 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-822132f3-75b3-4c59-bf30-c24d986e6646 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:58:42.020119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-822132f3-75b3-4c59-bf30-c24d986e6646 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:58:42.027740 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-822132f3-75b3-4c59-bf30-c24d986e6646 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:42.028212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-822132f3-75b3-4c59-bf30-c24d986e6646 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:42.029003 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-822132f3-75b3-4c59-bf30-c24d986e6646 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:42.029561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-822132f3-75b3-4c59-bf30-c24d986e6646 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:42.165837 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-822132f3-75b3-4c59-bf30-c24d986e6646 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:58:42.173537 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-822132f3-75b3-4c59-bf30-c24d986e6646 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1565 microversion: 2.1 time: 0.158057 May 28 05:58:42.174104 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3914/7940] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:58:42 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:58:44.551997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0bc26d6b-6f87-44ed-bfcc-a25884d8571c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:58:44.552801 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0bc26d6b-6f87-44ed-bfcc-a25884d8571c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:58:44.554878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b004559e-3ade-4c4f-9df7-e96f5a8cdb63 req-f3923277-5020-41a9-a13f-3d5d933136da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d4a4ac6-d66b-434a-8b17-3f932f18f5db", "tag": "172fe507-7900-4996-8bfe-201d36ee996a"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:58:44.555767 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:58:44.561141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0bc26d6b-6f87-44ed-bfcc-a25884d8571c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:44.562105 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0bc26d6b-6f87-44ed-bfcc-a25884d8571c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:44.563278 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0bc26d6b-6f87-44ed-bfcc-a25884d8571c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:44.563930 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0bc26d6b-6f87-44ed-bfcc-a25884d8571c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:44.564893 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b004559e-3ade-4c4f-9df7-e96f5a8cdb63 req-f3923277-5020-41a9-a13f-3d5d933136da service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:58:44.565368 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b004559e-3ade-4c4f-9df7-e96f5a8cdb63 req-f3923277-5020-41a9-a13f-3d5d933136da service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:58:44.578776 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b004559e-3ade-4c4f-9df7-e96f5a8cdb63 req-f3923277-5020-41a9-a13f-3d5d933136da service nova] Creating event network-changed:172fe507-7900-4996-8bfe-201d36ee996a for instance 8d4a4ac6-d66b-434a-8b17-3f932f18f5db on n-h2-843700-1 May 28 05:58:44.585804 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b004559e-3ade-4c4f-9df7-e96f5a8cdb63 req-f3923277-5020-41a9-a13f-3d5d933136da service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034860 May 28 05:58:44.586783 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3915/7941] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:58:44.703546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0bc26d6b-6f87-44ed-bfcc-a25884d8571c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:58:44.711626 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0bc26d6b-6f87-44ed-bfcc-a25884d8571c tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1565 microversion: 2.1 time: 0.163808 May 28 05:58:44.712942 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4027/7942] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:58:44 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:59:05.945019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=9 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:59:05.945872 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=40 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:59:05.950750 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-57da91f7-0f6e-41cc-a3eb-e4abf09df639 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:59:05.951815 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-57da91f7-0f6e-41cc-a3eb-e4abf09df639 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:05.958034 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-57da91f7-0f6e-41cc-a3eb-e4abf09df639 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:05.958510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-57da91f7-0f6e-41cc-a3eb-e4abf09df639 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:05.959326 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-57da91f7-0f6e-41cc-a3eb-e4abf09df639 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:05.959790 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-57da91f7-0f6e-41cc-a3eb-e4abf09df639 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:06.018891 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-57da91f7-0f6e-41cc-a3eb-e4abf09df639 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db/action" status: 200 len: 24573 microversion: 2.1 time: 0.075837 May 28 05:59:06.019576 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3916/7943] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:59:05 2022] POST /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db/action => generated 24573 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:59:12.436146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0b1b2905-a3b9-43e0-8069-a9715e55e9e8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:59:12.436684 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0b1b2905-a3b9-43e0-8069-a9715e55e9e8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:12.438754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=46 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:59:12.443823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b1b2905-a3b9-43e0-8069-a9715e55e9e8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:12.444271 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b1b2905-a3b9-43e0-8069-a9715e55e9e8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:12.445040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b1b2905-a3b9-43e0-8069-a9715e55e9e8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:12.445471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0b1b2905-a3b9-43e0-8069-a9715e55e9e8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:12.468588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-0b1b2905-a3b9-43e0-8069-a9715e55e9e8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lazy-loading 'flavor' on Instance uuid 8d4a4ac6-d66b-434a-8b17-3f932f18f5db {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:59:12.703946 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0b1b2905-a3b9-43e0-8069-a9715e55e9e8 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db/action" status: 202 len: 0 microversion: 2.1 time: 0.272124 May 28 05:59:12.704534 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4028/7944] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:59:12 2022] POST /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:59:12.713349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f74ba3c5-a454-4d9d-9fdb-9126a065fc72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:12.714207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f74ba3c5-a454-4d9d-9fdb-9126a065fc72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:12.721963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f74ba3c5-a454-4d9d-9fdb-9126a065fc72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:12.725397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f74ba3c5-a454-4d9d-9fdb-9126a065fc72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:12.725397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f74ba3c5-a454-4d9d-9fdb-9126a065fc72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:12.725397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f74ba3c5-a454-4d9d-9fdb-9126a065fc72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:12.858595 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f74ba3c5-a454-4d9d-9fdb-9126a065fc72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:59:12.866412 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f74ba3c5-a454-4d9d-9fdb-9126a065fc72 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1691 microversion: 2.1 time: 0.157448 May 28 05:59:12.867006 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3917/7945] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:59:12 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:59:13.886151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e7ce97e0-7de0-47c8-815e-d37ee4015216 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:13.886876 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e7ce97e0-7de0-47c8-815e-d37ee4015216 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:13.894416 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e7ce97e0-7de0-47c8-815e-d37ee4015216 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:13.894884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e7ce97e0-7de0-47c8-815e-d37ee4015216 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:13.895681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e7ce97e0-7de0-47c8-815e-d37ee4015216 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:13.896129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e7ce97e0-7de0-47c8-815e-d37ee4015216 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:14.030531 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e7ce97e0-7de0-47c8-815e-d37ee4015216 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:59:14.038145 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e7ce97e0-7de0-47c8-815e-d37ee4015216 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1674 microversion: 2.1 time: 0.157768 May 28 05:59:14.038719 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4029/7946] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:59:13 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:59:15.128709 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-71e607c0-99ff-4ef4-a2e0-3837d525159e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:59:15.129668 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-71e607c0-99ff-4ef4-a2e0-3837d525159e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:15.140586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71e607c0-99ff-4ef4-a2e0-3837d525159e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:15.141061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71e607c0-99ff-4ef4-a2e0-3837d525159e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:15.141860 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71e607c0-99ff-4ef4-a2e0-3837d525159e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:15.142332 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-71e607c0-99ff-4ef4-a2e0-3837d525159e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:15.192174 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-71e607c0-99ff-4ef4-a2e0-3837d525159e tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db/action" status: 200 len: 35549 microversion: 2.1 time: 0.067301 May 28 05:59:15.192864 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3918/7947] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:59:15 2022] POST /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db/action => generated 35549 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:59:15.204509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9c07d7e5-d121-4123-aa29-bcfca71f6195 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:59:15.205057 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9c07d7e5-d121-4123-aa29-bcfca71f6195 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:15.211995 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9c07d7e5-d121-4123-aa29-bcfca71f6195 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:15.212456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9c07d7e5-d121-4123-aa29-bcfca71f6195 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:15.213227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9c07d7e5-d121-4123-aa29-bcfca71f6195 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:15.213671 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9c07d7e5-d121-4123-aa29-bcfca71f6195 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:15.452221 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9c07d7e5-d121-4123-aa29-bcfca71f6195 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db/action" status: 202 len: 0 microversion: 2.1 time: 0.251356 May 28 05:59:15.452776 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4030/7948] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:59:15 2022] POST /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:59:15.461718 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-f6980a83-1b82-4d28-a172-50ce66f7675f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:15.462517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-f6980a83-1b82-4d28-a172-50ce66f7675f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:15.469701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6980a83-1b82-4d28-a172-50ce66f7675f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:15.470166 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6980a83-1b82-4d28-a172-50ce66f7675f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:15.470944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6980a83-1b82-4d28-a172-50ce66f7675f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:15.471422 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-f6980a83-1b82-4d28-a172-50ce66f7675f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:15.609789 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-f6980a83-1b82-4d28-a172-50ce66f7675f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:59:15.617902 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-f6980a83-1b82-4d28-a172-50ce66f7675f tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1680 microversion: 2.1 time: 0.160554 May 28 05:59:15.618555 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3919/7949] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:59:15 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 05:59:16.638280 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b4081623-081f-4072-a8e1-ba6b63e2234d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:16.639017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b4081623-081f-4072-a8e1-ba6b63e2234d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:16.645297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4081623-081f-4072-a8e1-ba6b63e2234d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:16.645756 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4081623-081f-4072-a8e1-ba6b63e2234d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:16.646526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4081623-081f-4072-a8e1-ba6b63e2234d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:16.646971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4081623-081f-4072-a8e1-ba6b63e2234d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:16.780297 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b4081623-081f-4072-a8e1-ba6b63e2234d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:59:16.787895 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b4081623-081f-4072-a8e1-ba6b63e2234d tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1680 microversion: 2.1 time: 0.155513 May 28 05:59:16.788478 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4031/7950] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:59:16 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:59:17.805042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e07cfee6-5b86-47fc-a4aa-1cb340e15d44 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:17.805670 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e07cfee6-5b86-47fc-a4aa-1cb340e15d44 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:17.812763 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e07cfee6-5b86-47fc-a4aa-1cb340e15d44 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:17.813227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e07cfee6-5b86-47fc-a4aa-1cb340e15d44 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:17.813996 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e07cfee6-5b86-47fc-a4aa-1cb340e15d44 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:17.814442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e07cfee6-5b86-47fc-a4aa-1cb340e15d44 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:17.948563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e07cfee6-5b86-47fc-a4aa-1cb340e15d44 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:59:17.956154 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e07cfee6-5b86-47fc-a4aa-1cb340e15d44 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1683 microversion: 2.1 time: 0.155053 May 28 05:59:17.956729 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3920/7951] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:59:17 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:59:18.052478 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-31d91500-0719-41cd-aa42-24099fcef504 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:59:18.053422 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-31d91500-0719-41cd-aa42-24099fcef504 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:18.061157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31d91500-0719-41cd-aa42-24099fcef504 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:18.061563 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31d91500-0719-41cd-aa42-24099fcef504 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:18.062340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31d91500-0719-41cd-aa42-24099fcef504 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:18.062855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-31d91500-0719-41cd-aa42-24099fcef504 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:18.107860 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-31d91500-0719-41cd-aa42-24099fcef504 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "POST /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db/action" status: 200 len: 35549 microversion: 2.1 time: 0.059251 May 28 05:59:18.108548 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4032/7952] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 05:59:18 2022] POST /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db/action => generated 35549 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 05:59:19.208600 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cc7d6c2a-a65f-4fb6-8103-6e2e7d082491 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:19.214145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cc7d6c2a-a65f-4fb6-8103-6e2e7d082491 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:19.214262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-224642ca-a5b4-49c4-9e6f-05120f730428 req-4b173e38-2875-494d-ab84-76133692b346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d4a4ac6-d66b-434a-8b17-3f932f18f5db", "tag": "172fe507-7900-4996-8bfe-201d36ee996a"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:59:19.217234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc7d6c2a-a65f-4fb6-8103-6e2e7d082491 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:19.217788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc7d6c2a-a65f-4fb6-8103-6e2e7d082491 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:19.218705 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc7d6c2a-a65f-4fb6-8103-6e2e7d082491 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:19.219269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cc7d6c2a-a65f-4fb6-8103-6e2e7d082491 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:19.223632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-224642ca-a5b4-49c4-9e6f-05120f730428 req-4b173e38-2875-494d-ab84-76133692b346 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:19.224270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-224642ca-a5b4-49c4-9e6f-05120f730428 req-4b173e38-2875-494d-ab84-76133692b346 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:19.236149 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-224642ca-a5b4-49c4-9e6f-05120f730428 req-4b173e38-2875-494d-ab84-76133692b346 service nova] Creating event network-changed:172fe507-7900-4996-8bfe-201d36ee996a for instance 8d4a4ac6-d66b-434a-8b17-3f932f18f5db on n-h2-843700-1 May 28 05:59:19.241394 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-224642ca-a5b4-49c4-9e6f-05120f730428 req-4b173e38-2875-494d-ab84-76133692b346 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037990 May 28 05:59:19.242007 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4033/7953] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:59:19.249064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cc7d6c2a-a65f-4fb6-8103-6e2e7d082491 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 05:59:19.500746 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cc7d6c2a-a65f-4fb6-8103-6e2e7d082491 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 204 len: 0 microversion: 2.1 time: 0.301459 May 28 05:59:19.504579 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3921/7954] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 05:59:19 2022] DELETE /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 05:59:19.510790 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b7488edf-64fa-4fa4-8344-ff0e377cc3df tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:19.511645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b7488edf-64fa-4fa4-8344-ff0e377cc3df tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:19.518098 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b7488edf-64fa-4fa4-8344-ff0e377cc3df tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:19.518551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b7488edf-64fa-4fa4-8344-ff0e377cc3df tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:19.519341 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b7488edf-64fa-4fa4-8344-ff0e377cc3df tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:19.519805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b7488edf-64fa-4fa4-8344-ff0e377cc3df tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:19.660202 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b7488edf-64fa-4fa4-8344-ff0e377cc3df tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:59:19.668416 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b7488edf-64fa-4fa4-8344-ff0e377cc3df tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1689 microversion: 2.1 time: 0.162362 May 28 05:59:19.669002 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4034/7955] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:59:19 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:59:20.686863 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-44f45487-e368-4e32-91ca-8512f9dc3b92 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:20.687639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-44f45487-e368-4e32-91ca-8512f9dc3b92 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:20.694561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44f45487-e368-4e32-91ca-8512f9dc3b92 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:20.697911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44f45487-e368-4e32-91ca-8512f9dc3b92 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:20.697911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44f45487-e368-4e32-91ca-8512f9dc3b92 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:20.697911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-44f45487-e368-4e32-91ca-8512f9dc3b92 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:20.828235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-44f45487-e368-4e32-91ca-8512f9dc3b92 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:59:20.835889 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-44f45487-e368-4e32-91ca-8512f9dc3b92 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1689 microversion: 2.1 time: 0.153337 May 28 05:59:20.836474 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3922/7956] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:59:20 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:59:21.600249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-09d4bdb7-f110-4b8f-80c8-b861782be4b6 req-4b7841be-9dd7-4eda-8106-008002684c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d4a4ac6-d66b-434a-8b17-3f932f18f5db", "name": "network-vif-deleted", "tag": "172fe507-7900-4996-8bfe-201d36ee996a"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:59:21.609520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-09d4bdb7-f110-4b8f-80c8-b861782be4b6 req-4b7841be-9dd7-4eda-8106-008002684c18 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:21.610088 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-09d4bdb7-f110-4b8f-80c8-b861782be4b6 req-4b7841be-9dd7-4eda-8106-008002684c18 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:21.621888 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-09d4bdb7-f110-4b8f-80c8-b861782be4b6 req-4b7841be-9dd7-4eda-8106-008002684c18 service nova] Creating event network-vif-deleted:172fe507-7900-4996-8bfe-201d36ee996a for instance 8d4a4ac6-d66b-434a-8b17-3f932f18f5db on n-h2-843700-1 May 28 05:59:21.626694 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-09d4bdb7-f110-4b8f-80c8-b861782be4b6 req-4b7841be-9dd7-4eda-8106-008002684c18 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030268 May 28 05:59:21.627316 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4035/7957] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:59:21.854069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-dc669f88-48d0-4cfc-8b26-782b9c45ebe3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:21.854635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-dc669f88-48d0-4cfc-8b26-782b9c45ebe3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:21.862015 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc669f88-48d0-4cfc-8b26-782b9c45ebe3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:21.862902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc669f88-48d0-4cfc-8b26-782b9c45ebe3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:21.863345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc669f88-48d0-4cfc-8b26-782b9c45ebe3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:21.863907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc669f88-48d0-4cfc-8b26-782b9c45ebe3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:21.906409 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc669f88-48d0-4cfc-8b26-782b9c45ebe3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:21.906882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-dc669f88-48d0-4cfc-8b26-782b9c45ebe3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:21.907383 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-dc669f88-48d0-4cfc-8b26-782b9c45ebe3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lazy-loading 'fault' on Instance uuid 8d4a4ac6-d66b-434a-8b17-3f932f18f5db {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 05:59:21.949778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-dc669f88-48d0-4cfc-8b26-782b9c45ebe3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcabf3cdb7c4f02a50aeb508775222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df3b01779bd4e198777ddc16182cda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:59:21.958297 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-dc669f88-48d0-4cfc-8b26-782b9c45ebe3 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 200 len: 1357 microversion: 2.1 time: 0.108418 May 28 05:59:21.959168 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3923/7958] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:59:21 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 1357 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:59:22.984124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fb05ac37-fc5f-4608-bd67-2a2428e42f92 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:22.984829 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fb05ac37-fc5f-4608-bd67-2a2428e42f92 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] [instance: 8d4a4ac6-d66b-434a-8b17-3f932f18f5db] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:22.991209 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fb05ac37-fc5f-4608-bd67-2a2428e42f92 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:22.991670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fb05ac37-fc5f-4608-bd67-2a2428e42f92 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:22.992436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fb05ac37-fc5f-4608-bd67-2a2428e42f92 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:22.992884 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fb05ac37-fc5f-4608-bd67-2a2428e42f92 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:23.006351 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-fb05ac37-fc5f-4608-bd67-2a2428e42f92 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] HTTP exception thrown: Instance 8d4a4ac6-d66b-434a-8b17-3f932f18f5db could not be found. May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fb05ac37-fc5f-4608-bd67-2a2428e42f92 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Request method failure captured: May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db HTTP/1.1 May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbhqOgVkVYlgtcjZ8mDe_IQDNUqxx11YvunBU1SK3vtlWX-R-IzWraGt8vkjovszbapQtf3pdd97wuZwcsk_aAT7NxFm4DWf5-O7ZGW38a5Y5ysvAizQD5f24_6jK5aEpE_iFnq4qzGXIoYl5ta8zTN4fYRXo_WPUfWUhgxulf_h-tU May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 8df3b01779bd4e198777ddc16182cda3 May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1455991122 May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8df3b01779bd4e198777ddc16182cda3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8df3b01779bd4e198777ddc16182cda3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8df3b01779bd4e198777ddc16182cda3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8df3b01779bd4e198777ddc16182cda3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1455991122 May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 8df3b01779bd4e198777ddc16182cda3 May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1455991122 May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TestNetworkAdvancedServerOps-1455991122-project May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: 1bcabf3cdb7c4f02a50aeb508775222a May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1455991122-project May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 8d4a4ac6-d66b-434a-8b17-3f932f18f5db could not be found. May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '8d4a4ac6-d66b-434a-8b17-3f932f18f5db'} May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d4a4ac6-d66b-434a-8b17-3f932f18f5db could not be found. May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d4a4ac6-d66b-434a-8b17-3f932f18f5db could not be found. May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:59:23.008000 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 05:59:23.012648 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:59:23.012648 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 05:59:23.012648 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 05:59:23.012648 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 05:59:23.012648 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 05:59:23.012648 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 05:59:23.012648 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d4a4ac6-d66b-434a-8b17-3f932f18f5db could not be found. May 28 05:59:23.012648 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 05:59:23.012648 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fb05ac37-fc5f-4608-bd67-2a2428e42f92 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Returning 404 to user: Instance 8d4a4ac6-d66b-434a-8b17-3f932f18f5db could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 05:59:23.012648 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fb05ac37-fc5f-4608-bd67-2a2428e42f92 tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db" status: 404 len: 111 microversion: 2.1 time: 0.031061 May 28 05:59:23.012648 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4036/7959] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:59:22 2022] GET /compute/v2.1/servers/8d4a4ac6-d66b-434a-8b17-3f932f18f5db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 05:59:26.683067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-82fe2843-c993-4310-bda5-9f7a049e359b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] Calling method '.version_select at 0x7f7701dcea60>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:26.743223 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-82fe2843-c993-4310-bda5-9f7a049e359b tempest-TestNetworkAdvancedServerOps-1455991122 tempest-TestNetworkAdvancedServerOps-1455991122-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1392966148" status: 202 len: 0 microversion: 2.1 time: 0.064166 May 28 05:59:26.743832 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3924/7960] 10.222.0.58 () {58 vars in 1283 bytes} [Sat May 28 05:59:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1392966148 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 05:59:41.609734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=19 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:59:41.611101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:59:41.797412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e787d5dd-2ffb-4df8-ac84-9a7128c5782d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Action: 'create', calling method: .version_select at 0x7f7700574b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-2031697842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqK4nIgEsLyWnycd5oPOWmT5YAUoucqwGA9tc2JdmVKUh4Tu0iuk6NMkIzJsEjyV6H/+aCDwnOcGU4OkrwCyidnO1667N1HLTLb4RRFIZJnOu3h0aeuj2WKMkmZqtWymw=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:59:41.812805 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-e787d5dd-2ffb-4df8-ac84-9a7128c5782d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Getting quotas for project 07c9fecdea3943429a65cdb106d0fe8c. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:59:41.818440 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-e787d5dd-2ffb-4df8-ac84-9a7128c5782d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Getting quotas for user c0c0151985ca4aa9ae5d55f8925603fd and project 07c9fecdea3943429a65cdb106d0fe8c. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:59:41.895791 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e787d5dd-2ffb-4df8-ac84-9a7128c5782d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.292529 May 28 05:59:41.896337 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4037/7961] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 05:59:41 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 05:59:44.344270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7b6aa99f-4191-4f75-bb8e-90b22dcb3af8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-504969725", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2031697842", "security_groups": [{"name": "tempest-secgroup-smoke-987265181"}], "networks": [{"uuid": "b15f79cf-de97-4dbb-a777-d17517b0e9aa"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:59:44.361729 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:59:44.362517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:59:44.477561 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-7b6aa99f-4191-4f75-bb8e-90b22dcb3af8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] validate_networks() for [('b15f79cf-de97-4dbb-a777-d17517b0e9aa', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 05:59:44.969964 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7b6aa99f-4191-4f75-bb8e-90b22dcb3af8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 05:59:44.970404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7b6aa99f-4191-4f75-bb8e-90b22dcb3af8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 05:59:44.970892 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7b6aa99f-4191-4f75-bb8e-90b22dcb3af8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 05:59:44.971356 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7b6aa99f-4191-4f75-bb8e-90b22dcb3af8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 05:59:44.971784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-7b6aa99f-4191-4f75-bb8e-90b22dcb3af8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 05:59:44.981296 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b6aa99f-4191-4f75-bb8e-90b22dcb3af8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:44.981755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b6aa99f-4191-4f75-bb8e-90b22dcb3af8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:44.982560 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b6aa99f-4191-4f75-bb8e-90b22dcb3af8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:44.983029 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7b6aa99f-4191-4f75-bb8e-90b22dcb3af8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:44.999611 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-7b6aa99f-4191-4f75-bb8e-90b22dcb3af8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Getting quotas for project 07c9fecdea3943429a65cdb106d0fe8c. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 05:59:45.004792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-7b6aa99f-4191-4f75-bb8e-90b22dcb3af8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Getting quotas for user c0c0151985ca4aa9ae5d55f8925603fd and project 07c9fecdea3943429a65cdb106d0fe8c. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 05:59:45.016868 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7b6aa99f-4191-4f75-bb8e-90b22dcb3af8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 05:59:45.019129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7b6aa99f-4191-4f75-bb8e-90b22dcb3af8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 05:59:45.150015 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7b6aa99f-4191-4f75-bb8e-90b22dcb3af8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.812588 May 28 05:59:45.155814 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3925/7962] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 05:59:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 05:59:45.163660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-feed3237-9d26-4291-8b7d-ee86544b7a15 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:45.164940 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-feed3237-9d26-4291-8b7d-ee86544b7a15 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:45.225574 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-feed3237-9d26-4291-8b7d-ee86544b7a15 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:59:45.238415 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-feed3237-9d26-4291-8b7d-ee86544b7a15 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1246 microversion: 2.1 time: 0.081463 May 28 05:59:45.239340 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4038/7963] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:59:45 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:59:46.259396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-399acc40-75b9-491c-af6f-f60fbea519f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:46.259396 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-399acc40-75b9-491c-af6f-f60fbea519f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:46.266109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-399acc40-75b9-491c-af6f-f60fbea519f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:46.266936 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-399acc40-75b9-491c-af6f-f60fbea519f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:46.267434 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-399acc40-75b9-491c-af6f-f60fbea519f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:46.267896 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-399acc40-75b9-491c-af6f-f60fbea519f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:46.329187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-399acc40-75b9-491c-af6f-f60fbea519f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:59:46.337176 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-399acc40-75b9-491c-af6f-f60fbea519f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1250 microversion: 2.1 time: 0.083888 May 28 05:59:46.337747 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3926/7964] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:59:46 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1250 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:59:47.354892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2a57a33f-6cf8-4138-95bb-450077c6c145 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:47.355903 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2a57a33f-6cf8-4138-95bb-450077c6c145 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:47.363710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2a57a33f-6cf8-4138-95bb-450077c6c145 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:47.364174 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2a57a33f-6cf8-4138-95bb-450077c6c145 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:47.364988 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2a57a33f-6cf8-4138-95bb-450077c6c145 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:47.366200 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-2a57a33f-6cf8-4138-95bb-450077c6c145 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:47.432226 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2a57a33f-6cf8-4138-95bb-450077c6c145 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:59:47.440706 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2a57a33f-6cf8-4138-95bb-450077c6c145 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1316 microversion: 2.1 time: 0.090918 May 28 05:59:47.441307 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4039/7965] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:59:47 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1316 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:59:48.458387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-91410259-ec0b-4792-a8cf-71b0e19f1f8d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:48.458795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-91410259-ec0b-4792-a8cf-71b0e19f1f8d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:48.469021 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91410259-ec0b-4792-a8cf-71b0e19f1f8d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:48.469843 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91410259-ec0b-4792-a8cf-71b0e19f1f8d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:48.470957 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91410259-ec0b-4792-a8cf-71b0e19f1f8d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:48.472311 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-91410259-ec0b-4792-a8cf-71b0e19f1f8d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:49.000315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-91410259-ec0b-4792-a8cf-71b0e19f1f8d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:59:49.013233 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-91410259-ec0b-4792-a8cf-71b0e19f1f8d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1371 microversion: 2.1 time: 0.559130 May 28 05:59:49.014460 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3927/7966] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:59:48 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1371 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:59:49.054856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-f4af5908-85b7-43b6-98f9-d27c114abfe0 req-52d9178f-1f39-456f-8cf2-922c23fd2909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51801af2-7242-4d4b-ba0c-6fa968212728", "tag": "adfd530a-ccd0-4c1c-b0b0-930c7cff02e4"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:59:49.066196 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f4af5908-85b7-43b6-98f9-d27c114abfe0 req-52d9178f-1f39-456f-8cf2-922c23fd2909 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:49.066639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f4af5908-85b7-43b6-98f9-d27c114abfe0 req-52d9178f-1f39-456f-8cf2-922c23fd2909 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:49.081321 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-f4af5908-85b7-43b6-98f9-d27c114abfe0 req-52d9178f-1f39-456f-8cf2-922c23fd2909 service nova] Creating event network-changed:adfd530a-ccd0-4c1c-b0b0-930c7cff02e4 for instance 51801af2-7242-4d4b-ba0c-6fa968212728 on n-h2-843700-1 May 28 05:59:49.086600 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-f4af5908-85b7-43b6-98f9-d27c114abfe0 req-52d9178f-1f39-456f-8cf2-922c23fd2909 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147238 May 28 05:59:49.087607 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4040/7967] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:59:50.033849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4769a58f-6542-4459-bc08-010772c885fb tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:50.034459 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4769a58f-6542-4459-bc08-010772c885fb tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:50.041765 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4769a58f-6542-4459-bc08-010772c885fb tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:50.042230 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4769a58f-6542-4459-bc08-010772c885fb tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:50.043042 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4769a58f-6542-4459-bc08-010772c885fb tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:50.043501 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4769a58f-6542-4459-bc08-010772c885fb tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:50.174433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4769a58f-6542-4459-bc08-010772c885fb tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:59:50.182604 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4769a58f-6542-4459-bc08-010772c885fb tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1371 microversion: 2.1 time: 0.152804 May 28 05:59:50.183210 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3928/7968] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:59:50 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:59:51.200834 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6d27fff9-72cf-4119-b838-ac70548087a9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:51.201546 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6d27fff9-72cf-4119-b838-ac70548087a9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:51.207916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d27fff9-72cf-4119-b838-ac70548087a9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:51.208375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d27fff9-72cf-4119-b838-ac70548087a9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:51.209153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d27fff9-72cf-4119-b838-ac70548087a9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:51.209606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6d27fff9-72cf-4119-b838-ac70548087a9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:51.346730 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6d27fff9-72cf-4119-b838-ac70548087a9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:59:51.354335 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6d27fff9-72cf-4119-b838-ac70548087a9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1371 microversion: 2.1 time: 0.159249 May 28 05:59:51.354915 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4041/7969] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:59:51 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:59:52.372028 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4842dbea-9973-4ea0-99bc-b7ec01d6b066 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:52.372656 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4842dbea-9973-4ea0-99bc-b7ec01d6b066 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:52.378698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4842dbea-9973-4ea0-99bc-b7ec01d6b066 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:52.379207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4842dbea-9973-4ea0-99bc-b7ec01d6b066 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:52.379985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4842dbea-9973-4ea0-99bc-b7ec01d6b066 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:52.380433 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4842dbea-9973-4ea0-99bc-b7ec01d6b066 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:52.508366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-4842dbea-9973-4ea0-99bc-b7ec01d6b066 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:59:52.516186 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4842dbea-9973-4ea0-99bc-b7ec01d6b066 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1371 microversion: 2.1 time: 0.148571 May 28 05:59:52.519910 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3929/7970] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:59:52 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:59:53.533828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5c406384-551b-4f16-9a4f-4c1f2153d80c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:53.534372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5c406384-551b-4f16-9a4f-4c1f2153d80c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:53.542312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c406384-551b-4f16-9a4f-4c1f2153d80c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:53.542771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c406384-551b-4f16-9a4f-4c1f2153d80c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:53.543596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c406384-551b-4f16-9a4f-4c1f2153d80c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:53.544043 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5c406384-551b-4f16-9a4f-4c1f2153d80c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:53.674149 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5c406384-551b-4f16-9a4f-4c1f2153d80c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:59:53.682360 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5c406384-551b-4f16-9a4f-4c1f2153d80c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1371 microversion: 2.1 time: 0.152568 May 28 05:59:53.682964 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4042/7971] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:59:53 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:59:53.957259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-91c43773-f15f-465e-8972-45a591b91443 req-4557c04b-a452-4e0a-82f4-ad06b4e07a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51801af2-7242-4d4b-ba0c-6fa968212728", "name": "network-vif-plugged", "status": "completed", "tag": "adfd530a-ccd0-4c1c-b0b0-930c7cff02e4"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:59:53.968315 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-91c43773-f15f-465e-8972-45a591b91443 req-4557c04b-a452-4e0a-82f4-ad06b4e07a24 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:53.968878 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-91c43773-f15f-465e-8972-45a591b91443 req-4557c04b-a452-4e0a-82f4-ad06b4e07a24 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:53.981541 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-91c43773-f15f-465e-8972-45a591b91443 req-4557c04b-a452-4e0a-82f4-ad06b4e07a24 service nova] Creating event network-vif-plugged:adfd530a-ccd0-4c1c-b0b0-930c7cff02e4 for instance 51801af2-7242-4d4b-ba0c-6fa968212728 on n-h2-843700-1 May 28 05:59:53.993730 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-91c43773-f15f-465e-8972-45a591b91443 req-4557c04b-a452-4e0a-82f4-ad06b4e07a24 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034072 May 28 05:59:53.993730 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3930/7972] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 05:59:54.700292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-45eb2614-376d-4752-9717-b9f6ba7eab9f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:54.700863 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-45eb2614-376d-4752-9717-b9f6ba7eab9f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:54.707040 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45eb2614-376d-4752-9717-b9f6ba7eab9f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:54.707496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45eb2614-376d-4752-9717-b9f6ba7eab9f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:54.708262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45eb2614-376d-4752-9717-b9f6ba7eab9f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:54.708702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45eb2614-376d-4752-9717-b9f6ba7eab9f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:54.840544 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-45eb2614-376d-4752-9717-b9f6ba7eab9f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:59:54.848122 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-45eb2614-376d-4752-9717-b9f6ba7eab9f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1371 microversion: 2.1 time: 0.152750 May 28 05:59:54.848708 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4043/7973] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:59:54 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:59:55.863698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:59:55.864404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:59:55.868848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9796c818-10e6-48e0-96d1-584594c34cf5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:55.873701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9796c818-10e6-48e0-96d1-584594c34cf5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:55.875782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9796c818-10e6-48e0-96d1-584594c34cf5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:55.876243 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9796c818-10e6-48e0-96d1-584594c34cf5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:55.877011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9796c818-10e6-48e0-96d1-584594c34cf5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:55.877456 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9796c818-10e6-48e0-96d1-584594c34cf5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:56.010669 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9796c818-10e6-48e0-96d1-584594c34cf5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:59:56.018254 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9796c818-10e6-48e0-96d1-584594c34cf5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1555 microversion: 2.1 time: 0.156802 May 28 05:59:56.018840 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3931/7974] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:59:55 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:59:56.035017 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a963dfb5-cebc-4745-81ef-432a4e7e6940 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 05:59:56.035638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a963dfb5-cebc-4745-81ef-432a4e7e6940 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 05:59:56.037594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 05:59:56.043417 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a963dfb5-cebc-4745-81ef-432a4e7e6940 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:56.043875 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a963dfb5-cebc-4745-81ef-432a4e7e6940 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:56.044638 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a963dfb5-cebc-4745-81ef-432a4e7e6940 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:56.045082 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a963dfb5-cebc-4745-81ef-432a4e7e6940 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:56.182902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a963dfb5-cebc-4745-81ef-432a4e7e6940 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 05:59:56.190497 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a963dfb5-cebc-4745-81ef-432a4e7e6940 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1555 microversion: 2.1 time: 0.159393 May 28 05:59:56.191090 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4044/7975] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 05:59:56 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 05:59:58.122266 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-55608d95-ac63-496a-aa17-411f5df3f1ba req-9cfade66-ce56-498b-987c-aaac6a2dc31c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51801af2-7242-4d4b-ba0c-6fa968212728", "tag": "adfd530a-ccd0-4c1c-b0b0-930c7cff02e4"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 05:59:58.130733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-55608d95-ac63-496a-aa17-411f5df3f1ba req-9cfade66-ce56-498b-987c-aaac6a2dc31c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 05:59:58.131235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-55608d95-ac63-496a-aa17-411f5df3f1ba req-9cfade66-ce56-498b-987c-aaac6a2dc31c service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 05:59:58.145370 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-55608d95-ac63-496a-aa17-411f5df3f1ba req-9cfade66-ce56-498b-987c-aaac6a2dc31c service nova] Creating event network-changed:adfd530a-ccd0-4c1c-b0b0-930c7cff02e4 for instance 51801af2-7242-4d4b-ba0c-6fa968212728 on n-h2-843700-1 May 28 05:59:58.150418 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-55608d95-ac63-496a-aa17-411f5df3f1ba req-9cfade66-ce56-498b-987c-aaac6a2dc31c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036766 May 28 05:59:58.151070 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3932/7976] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 05:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:01:14.001383 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:01:14.001997 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 06:01:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:01:53.426923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:01:53.427706 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=32 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:01:53.431709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e03ad8f3-088c-4c5d-8a48-97f0607099db tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:01:53.432255 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e03ad8f3-088c-4c5d-8a48-97f0607099db tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:01:53.438114 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e03ad8f3-088c-4c5d-8a48-97f0607099db tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:01:53.454459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e03ad8f3-088c-4c5d-8a48-97f0607099db tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:01:53.454459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e03ad8f3-088c-4c5d-8a48-97f0607099db tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:01:53.454459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e03ad8f3-088c-4c5d-8a48-97f0607099db tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:01:53.462369 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-e03ad8f3-088c-4c5d-8a48-97f0607099db tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lazy-loading 'flavor' on Instance uuid 51801af2-7242-4d4b-ba0c-6fa968212728 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 06:01:54.096824 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e03ad8f3-088c-4c5d-8a48-97f0607099db tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "POST /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728/action" status: 202 len: 0 microversion: 2.1 time: 0.671625 May 28 06:01:54.097744 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4045/7977] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 06:01:53 2022] POST /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728/action => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 06:01:54.104127 n-d-843700-1 devstack@n-api.service[126043]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9cedd376-8074-49f5-962c-429331dc3c26] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 06:01:54.104964 n-d-843700-1 devstack@n-api.service[126043]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7b68896-232d-4c87-8179-08a432c034dc] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 06:01:54.105614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:01:54.106387 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=36 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:01:54.111334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-521b113e-a1f7-4ed2-8078-dc00b16162bf tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:01:54.112069 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-521b113e-a1f7-4ed2-8078-dc00b16162bf tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:01:54.119237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-521b113e-a1f7-4ed2-8078-dc00b16162bf tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:01:54.119237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-521b113e-a1f7-4ed2-8078-dc00b16162bf tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:01:54.119953 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-521b113e-a1f7-4ed2-8078-dc00b16162bf tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:01:54.120376 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-521b113e-a1f7-4ed2-8078-dc00b16162bf tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:01:54.257124 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-521b113e-a1f7-4ed2-8078-dc00b16162bf tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:01:54.264761 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-521b113e-a1f7-4ed2-8078-dc00b16162bf tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1680 microversion: 2.1 time: 0.162598 May 28 06:01:54.265338 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3933/7978] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:01:54 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:01:55.280602 n-d-843700-1 devstack@n-api.service[126044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7fb7b4e8-8c85-4700-986d-4cff401b6421] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 06:01:55.281431 n-d-843700-1 devstack@n-api.service[126044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a1992b24-c6ca-47ed-a310-b37951ac973c] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 06:01:55.285392 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fe3200e5-d375-49cd-a0ec-0793b9d00825 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:01:55.286100 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fe3200e5-d375-49cd-a0ec-0793b9d00825 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:01:55.292632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe3200e5-d375-49cd-a0ec-0793b9d00825 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:01:55.293085 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe3200e5-d375-49cd-a0ec-0793b9d00825 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:01:55.293849 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe3200e5-d375-49cd-a0ec-0793b9d00825 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:01:55.294332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fe3200e5-d375-49cd-a0ec-0793b9d00825 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:01:55.429424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fe3200e5-d375-49cd-a0ec-0793b9d00825 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:01:55.437661 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fe3200e5-d375-49cd-a0ec-0793b9d00825 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1680 microversion: 2.1 time: 0.158648 May 28 06:01:55.438233 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4046/7979] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:01:55 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:01:56.454338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7064ecc6-4c87-4a8f-abe6-f5285de3498a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:01:56.454930 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7064ecc6-4c87-4a8f-abe6-f5285de3498a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:01:56.464578 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7064ecc6-4c87-4a8f-abe6-f5285de3498a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:01:56.465054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7064ecc6-4c87-4a8f-abe6-f5285de3498a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:01:56.465853 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7064ecc6-4c87-4a8f-abe6-f5285de3498a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:01:56.466316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7064ecc6-4c87-4a8f-abe6-f5285de3498a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:01:56.472487 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] [9cedd376-8074-49f5-962c-429331dc3c26] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 34458. May 28 06:01:56.483982 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7b68896-232d-4c87-8179-08a432c034dc] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 34460. May 28 06:01:56.599468 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7064ecc6-4c87-4a8f-abe6-f5285de3498a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:01:56.607087 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7064ecc6-4c87-4a8f-abe6-f5285de3498a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1680 microversion: 2.1 time: 0.156734 May 28 06:01:56.607667 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3934/7980] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:01:56 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:01:57.625287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4ea4cecb-f22e-408d-8b48-6cc44306bbef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:01:57.625916 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4ea4cecb-f22e-408d-8b48-6cc44306bbef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:01:57.635305 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ea4cecb-f22e-408d-8b48-6cc44306bbef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:01:57.635771 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ea4cecb-f22e-408d-8b48-6cc44306bbef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:01:57.636551 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ea4cecb-f22e-408d-8b48-6cc44306bbef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:01:57.637028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ea4cecb-f22e-408d-8b48-6cc44306bbef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:01:57.641819 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] [7fb7b4e8-8c85-4700-986d-4cff401b6421] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 34464. May 28 06:01:57.644292 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] [a1992b24-c6ca-47ed-a310-b37951ac973c] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 34466. May 28 06:01:57.769092 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4ea4cecb-f22e-408d-8b48-6cc44306bbef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:01:57.776577 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4ea4cecb-f22e-408d-8b48-6cc44306bbef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1680 microversion: 2.1 time: 0.155273 May 28 06:01:57.777147 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4047/7981] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:01:57 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:01:58.794424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2d9aa090-a211-4330-9d84-e84756718c5a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:01:58.795075 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2d9aa090-a211-4330-9d84-e84756718c5a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:01:58.802493 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d9aa090-a211-4330-9d84-e84756718c5a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:01:58.802956 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d9aa090-a211-4330-9d84-e84756718c5a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:01:58.803753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d9aa090-a211-4330-9d84-e84756718c5a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:01:58.804203 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d9aa090-a211-4330-9d84-e84756718c5a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:01:58.938624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2d9aa090-a211-4330-9d84-e84756718c5a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:01:58.946280 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2d9aa090-a211-4330-9d84-e84756718c5a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1680 microversion: 2.1 time: 0.155856 May 28 06:01:58.946857 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3935/7982] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:01:58 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:01:59.963702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-67f8e199-6c8c-4054-8b57-da2a748f0578 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:01:59.964342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-67f8e199-6c8c-4054-8b57-da2a748f0578 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:01:59.971509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67f8e199-6c8c-4054-8b57-da2a748f0578 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:01:59.971972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67f8e199-6c8c-4054-8b57-da2a748f0578 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:01:59.972748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67f8e199-6c8c-4054-8b57-da2a748f0578 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:01:59.973193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-67f8e199-6c8c-4054-8b57-da2a748f0578 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:00.104454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-67f8e199-6c8c-4054-8b57-da2a748f0578 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:00.112574 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-67f8e199-6c8c-4054-8b57-da2a748f0578 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1680 microversion: 2.1 time: 0.152828 May 28 06:02:00.113152 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4048/7983] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:01:59 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:01.130495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8253526c-a224-46b6-b042-59a67a494241 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:01.131163 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8253526c-a224-46b6-b042-59a67a494241 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:01.138137 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8253526c-a224-46b6-b042-59a67a494241 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:01.138612 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8253526c-a224-46b6-b042-59a67a494241 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:01.140146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8253526c-a224-46b6-b042-59a67a494241 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:01.140608 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8253526c-a224-46b6-b042-59a67a494241 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:01.275948 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8253526c-a224-46b6-b042-59a67a494241 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:01.283857 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8253526c-a224-46b6-b042-59a67a494241 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1680 microversion: 2.1 time: 0.157328 May 28 06:02:01.284443 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3936/7984] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:01 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:02.302293 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fae62828-c18c-44d3-b280-b489de378dfd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:02.302917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fae62828-c18c-44d3-b280-b489de378dfd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:02.309954 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fae62828-c18c-44d3-b280-b489de378dfd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:02.310415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fae62828-c18c-44d3-b280-b489de378dfd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:02.311872 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fae62828-c18c-44d3-b280-b489de378dfd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:02.312318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fae62828-c18c-44d3-b280-b489de378dfd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:02.439404 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fae62828-c18c-44d3-b280-b489de378dfd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:02.446957 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fae62828-c18c-44d3-b280-b489de378dfd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1680 microversion: 2.1 time: 0.148755 May 28 06:02:02.447557 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4049/7985] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:02 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:03.465450 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-cf743871-fcdd-47fa-83c1-bfe34ac5f4a8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:03.465999 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-cf743871-fcdd-47fa-83c1-bfe34ac5f4a8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:03.473471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf743871-fcdd-47fa-83c1-bfe34ac5f4a8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:03.473959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf743871-fcdd-47fa-83c1-bfe34ac5f4a8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:03.474733 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf743871-fcdd-47fa-83c1-bfe34ac5f4a8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:03.475215 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-cf743871-fcdd-47fa-83c1-bfe34ac5f4a8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:03.608901 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-cf743871-fcdd-47fa-83c1-bfe34ac5f4a8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:03.616863 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-cf743871-fcdd-47fa-83c1-bfe34ac5f4a8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1680 microversion: 2.1 time: 0.155454 May 28 06:02:03.617451 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3937/7986] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:03 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:04.634277 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-45f5b2f7-460e-4e75-8c21-848aa03aa1a2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:04.634905 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-45f5b2f7-460e-4e75-8c21-848aa03aa1a2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:04.642561 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45f5b2f7-460e-4e75-8c21-848aa03aa1a2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:04.643045 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45f5b2f7-460e-4e75-8c21-848aa03aa1a2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:04.643823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45f5b2f7-460e-4e75-8c21-848aa03aa1a2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:04.644270 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-45f5b2f7-460e-4e75-8c21-848aa03aa1a2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:04.775439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-45f5b2f7-460e-4e75-8c21-848aa03aa1a2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:04.783641 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-45f5b2f7-460e-4e75-8c21-848aa03aa1a2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1701 microversion: 2.1 time: 0.153380 May 28 06:02:04.792687 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4050/7987] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:04 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1701 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:05.801355 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8739ef4e-e71c-4263-973c-dd7d59e14a8a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:05.801984 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8739ef4e-e71c-4263-973c-dd7d59e14a8a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:05.809090 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8739ef4e-e71c-4263-973c-dd7d59e14a8a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:05.809556 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8739ef4e-e71c-4263-973c-dd7d59e14a8a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:05.810328 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8739ef4e-e71c-4263-973c-dd7d59e14a8a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:05.810775 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8739ef4e-e71c-4263-973c-dd7d59e14a8a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:05.943488 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8739ef4e-e71c-4263-973c-dd7d59e14a8a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:05.951189 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8739ef4e-e71c-4263-973c-dd7d59e14a8a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1701 microversion: 2.1 time: 0.153774 May 28 06:02:05.951815 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3938/7988] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:05 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1701 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:06.969557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-70b13369-b008-4de0-ad8a-ece1dc932c6c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:06.970186 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-70b13369-b008-4de0-ad8a-ece1dc932c6c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:06.977415 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70b13369-b008-4de0-ad8a-ece1dc932c6c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:06.977917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70b13369-b008-4de0-ad8a-ece1dc932c6c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:06.978770 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70b13369-b008-4de0-ad8a-ece1dc932c6c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:06.979245 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-70b13369-b008-4de0-ad8a-ece1dc932c6c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:07.118724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-70b13369-b008-4de0-ad8a-ece1dc932c6c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:07.127026 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-70b13369-b008-4de0-ad8a-ece1dc932c6c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1696 microversion: 2.1 time: 0.162104 May 28 06:02:07.127553 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4051/7989] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:06 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:08.147652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d1b20599-c3ee-4675-880a-3d6c79d32380 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:08.148908 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d1b20599-c3ee-4675-880a-3d6c79d32380 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:08.156135 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d1b20599-c3ee-4675-880a-3d6c79d32380 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:08.156795 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d1b20599-c3ee-4675-880a-3d6c79d32380 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:08.157589 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d1b20599-c3ee-4675-880a-3d6c79d32380 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:08.158047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d1b20599-c3ee-4675-880a-3d6c79d32380 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:08.303237 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d1b20599-c3ee-4675-880a-3d6c79d32380 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:08.315128 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d1b20599-c3ee-4675-880a-3d6c79d32380 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1696 microversion: 2.1 time: 0.171301 May 28 06:02:08.324887 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3939/7990] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:08 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1696 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:08.578702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-3dcd6067-1b58-47a6-b296-242b31964ca6 req-fa4ab653-cd65-4735-837f-2bde706cbaf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51801af2-7242-4d4b-ba0c-6fa968212728", "name": "network-vif-plugged", "status": "completed", "tag": "adfd530a-ccd0-4c1c-b0b0-930c7cff02e4"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:02:08.591373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-3dcd6067-1b58-47a6-b296-242b31964ca6 req-fa4ab653-cd65-4735-837f-2bde706cbaf2 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:08.608408 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-3dcd6067-1b58-47a6-b296-242b31964ca6 req-fa4ab653-cd65-4735-837f-2bde706cbaf2 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:08.608408 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-3dcd6067-1b58-47a6-b296-242b31964ca6 req-fa4ab653-cd65-4735-837f-2bde706cbaf2 service nova] Creating event network-vif-plugged:adfd530a-ccd0-4c1c-b0b0-930c7cff02e4 for instance 51801af2-7242-4d4b-ba0c-6fa968212728 on n-h2-843700-1 May 28 06:02:08.610260 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-3dcd6067-1b58-47a6-b296-242b31964ca6 req-fa4ab653-cd65-4735-837f-2bde706cbaf2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036025 May 28 06:02:08.611015 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4052/7991] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:02:09.332257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2f2b9b1c-451b-4608-979a-da64abde70fd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:09.332883 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2f2b9b1c-451b-4608-979a-da64abde70fd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:09.340297 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f2b9b1c-451b-4608-979a-da64abde70fd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:09.340766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f2b9b1c-451b-4608-979a-da64abde70fd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:09.341546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f2b9b1c-451b-4608-979a-da64abde70fd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:09.342525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2f2b9b1c-451b-4608-979a-da64abde70fd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:09.497552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2f2b9b1c-451b-4608-979a-da64abde70fd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:09.507721 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2f2b9b1c-451b-4608-979a-da64abde70fd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1696 microversion: 2.1 time: 0.179369 May 28 06:02:09.508624 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3940/7992] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:09 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1696 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:10.527324 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8f17b08c-3f10-4d20-a768-f90af91ab880 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:10.528597 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8f17b08c-3f10-4d20-a768-f90af91ab880 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:10.539945 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f17b08c-3f10-4d20-a768-f90af91ab880 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:10.540864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f17b08c-3f10-4d20-a768-f90af91ab880 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:10.541914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f17b08c-3f10-4d20-a768-f90af91ab880 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:10.542635 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8f17b08c-3f10-4d20-a768-f90af91ab880 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:10.707690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8f17b08c-3f10-4d20-a768-f90af91ab880 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:10.720934 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8f17b08c-3f10-4d20-a768-f90af91ab880 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1696 microversion: 2.1 time: 0.199239 May 28 06:02:10.721533 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4053/7993] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:10 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1696 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:11.739681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7314014f-97d7-40f3-bb02-54973badb69f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:11.741185 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7314014f-97d7-40f3-bb02-54973badb69f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:11.749131 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7314014f-97d7-40f3-bb02-54973badb69f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:11.751935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7314014f-97d7-40f3-bb02-54973badb69f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:11.751935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7314014f-97d7-40f3-bb02-54973badb69f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:11.751935 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7314014f-97d7-40f3-bb02-54973badb69f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:11.897098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7314014f-97d7-40f3-bb02-54973badb69f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:11.908522 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7314014f-97d7-40f3-bb02-54973badb69f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1696 microversion: 2.1 time: 0.172991 May 28 06:02:11.918259 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3941/7994] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:11 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:12.926330 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9831f350-559a-48c4-a8c6-5becf80bf919 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:12.926950 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9831f350-559a-48c4-a8c6-5becf80bf919 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:12.934036 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9831f350-559a-48c4-a8c6-5becf80bf919 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:12.934496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9831f350-559a-48c4-a8c6-5becf80bf919 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:12.935292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9831f350-559a-48c4-a8c6-5becf80bf919 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:12.936411 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9831f350-559a-48c4-a8c6-5becf80bf919 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:13.092345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9831f350-559a-48c4-a8c6-5becf80bf919 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:13.100157 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9831f350-559a-48c4-a8c6-5becf80bf919 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1696 microversion: 2.1 time: 0.177805 May 28 06:02:13.100747 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4054/7995] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:12 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:14.121868 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1ad5c69d-527b-4a95-87a5-d54d12d2a621 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:14.122604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1ad5c69d-527b-4a95-87a5-d54d12d2a621 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:14.131449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ad5c69d-527b-4a95-87a5-d54d12d2a621 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:14.131967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ad5c69d-527b-4a95-87a5-d54d12d2a621 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:14.132985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ad5c69d-527b-4a95-87a5-d54d12d2a621 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:14.133513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ad5c69d-527b-4a95-87a5-d54d12d2a621 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:14.287755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-1ad5c69d-527b-4a95-87a5-d54d12d2a621 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:14.296705 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1ad5c69d-527b-4a95-87a5-d54d12d2a621 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1696 microversion: 2.1 time: 0.182923 May 28 06:02:14.297295 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3942/7996] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:14 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:15.316578 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4ccb5c27-48b7-41f8-8f7a-46578e19ad12 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:15.317165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4ccb5c27-48b7-41f8-8f7a-46578e19ad12 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:15.327360 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ccb5c27-48b7-41f8-8f7a-46578e19ad12 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:15.329565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ccb5c27-48b7-41f8-8f7a-46578e19ad12 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:15.330432 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ccb5c27-48b7-41f8-8f7a-46578e19ad12 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:15.330970 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4ccb5c27-48b7-41f8-8f7a-46578e19ad12 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:15.487163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-4ccb5c27-48b7-41f8-8f7a-46578e19ad12 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:15.495402 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4ccb5c27-48b7-41f8-8f7a-46578e19ad12 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1696 microversion: 2.1 time: 0.182752 May 28 06:02:15.496034 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4055/7997] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:15 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:16.514165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c24bc412-1c17-4233-8e85-b9e56a07ee78 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:16.514801 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c24bc412-1c17-4233-8e85-b9e56a07ee78 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:16.522920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c24bc412-1c17-4233-8e85-b9e56a07ee78 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:16.524092 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c24bc412-1c17-4233-8e85-b9e56a07ee78 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:16.527023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c24bc412-1c17-4233-8e85-b9e56a07ee78 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:16.527023 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c24bc412-1c17-4233-8e85-b9e56a07ee78 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:16.676788 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c24bc412-1c17-4233-8e85-b9e56a07ee78 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:16.685316 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c24bc412-1c17-4233-8e85-b9e56a07ee78 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1696 microversion: 2.1 time: 0.176095 May 28 06:02:16.691391 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3943/7998] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:16 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:17.708104 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a6096e3e-4349-46a3-a811-f7ec09009585 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:17.708724 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a6096e3e-4349-46a3-a811-f7ec09009585 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:17.715733 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6096e3e-4349-46a3-a811-f7ec09009585 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:17.716189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6096e3e-4349-46a3-a811-f7ec09009585 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:17.716958 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6096e3e-4349-46a3-a811-f7ec09009585 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:17.717400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a6096e3e-4349-46a3-a811-f7ec09009585 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:17.848600 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a6096e3e-4349-46a3-a811-f7ec09009585 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:17.856235 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a6096e3e-4349-46a3-a811-f7ec09009585 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1696 microversion: 2.1 time: 0.152019 May 28 06:02:17.856811 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4056/7999] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:17 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:18.874150 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-64e17e04-fd58-456d-988c-a57644779a23 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:18.874769 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-64e17e04-fd58-456d-988c-a57644779a23 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:18.882284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-64e17e04-fd58-456d-988c-a57644779a23 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:18.882744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-64e17e04-fd58-456d-988c-a57644779a23 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:18.883563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-64e17e04-fd58-456d-988c-a57644779a23 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:18.884014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-64e17e04-fd58-456d-988c-a57644779a23 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:19.020141 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-64e17e04-fd58-456d-988c-a57644779a23 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:19.028218 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-64e17e04-fd58-456d-988c-a57644779a23 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1678 microversion: 2.1 time: 0.158632 May 28 06:02:19.028823 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3944/8000] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:18 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:20.045768 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-82e9cd58-ed3b-4f4c-a3dd-2d8fff656e5c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:20.046394 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-82e9cd58-ed3b-4f4c-a3dd-2d8fff656e5c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:20.053393 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82e9cd58-ed3b-4f4c-a3dd-2d8fff656e5c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:20.053856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82e9cd58-ed3b-4f4c-a3dd-2d8fff656e5c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:20.054631 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82e9cd58-ed3b-4f4c-a3dd-2d8fff656e5c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:20.055107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-82e9cd58-ed3b-4f4c-a3dd-2d8fff656e5c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:20.186059 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-82e9cd58-ed3b-4f4c-a3dd-2d8fff656e5c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:20.193679 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-82e9cd58-ed3b-4f4c-a3dd-2d8fff656e5c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1678 microversion: 2.1 time: 0.151863 May 28 06:02:20.194286 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4057/8001] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:20 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:21.211105 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-93952b83-999d-4cc4-8e27-e8a622ffa08c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:21.211746 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-93952b83-999d-4cc4-8e27-e8a622ffa08c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:21.219227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93952b83-999d-4cc4-8e27-e8a622ffa08c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:21.219696 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93952b83-999d-4cc4-8e27-e8a622ffa08c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:21.220482 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93952b83-999d-4cc4-8e27-e8a622ffa08c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:21.220929 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93952b83-999d-4cc4-8e27-e8a622ffa08c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:21.354547 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-93952b83-999d-4cc4-8e27-e8a622ffa08c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:21.362712 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-93952b83-999d-4cc4-8e27-e8a622ffa08c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1621 microversion: 2.1 time: 0.155732 May 28 06:02:21.363324 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3945/8002] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:21 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1621 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:21.379606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8ab9a7d3-5c28-4312-968a-7bbff5759d46 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:02:21.380126 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8ab9a7d3-5c28-4312-968a-7bbff5759d46 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:21.387074 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ab9a7d3-5c28-4312-968a-7bbff5759d46 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:21.387530 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ab9a7d3-5c28-4312-968a-7bbff5759d46 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:21.388300 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ab9a7d3-5c28-4312-968a-7bbff5759d46 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:21.388778 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8ab9a7d3-5c28-4312-968a-7bbff5759d46 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:21.614324 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8ab9a7d3-5c28-4312-968a-7bbff5759d46 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "POST /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728/action" status: 202 len: 0 microversion: 2.1 time: 0.238653 May 28 06:02:21.615176 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4058/8003] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 06:02:21 2022] POST /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 06:02:21.624054 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0d8d3ed7-e724-4863-b4c1-8522d42e17cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:21.624975 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0d8d3ed7-e724-4863-b4c1-8522d42e17cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:21.631269 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d8d3ed7-e724-4863-b4c1-8522d42e17cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:21.631678 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d8d3ed7-e724-4863-b4c1-8522d42e17cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:21.632480 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d8d3ed7-e724-4863-b4c1-8522d42e17cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:21.632978 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0d8d3ed7-e724-4863-b4c1-8522d42e17cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:21.765590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0d8d3ed7-e724-4863-b4c1-8522d42e17cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:21.773024 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0d8d3ed7-e724-4863-b4c1-8522d42e17cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1629 microversion: 2.1 time: 0.153296 May 28 06:02:21.773606 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3946/8004] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:21 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1629 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:22.558747 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-c72beed1-bc44-4fb5-ac49-fd780d712fa3 req-54a74710-26be-4d23-b659-4554d6591039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51801af2-7242-4d4b-ba0c-6fa968212728", "name": "network-vif-unplugged", "status": "completed", "tag": "adfd530a-ccd0-4c1c-b0b0-930c7cff02e4"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:02:22.568381 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c72beed1-bc44-4fb5-ac49-fd780d712fa3 req-54a74710-26be-4d23-b659-4554d6591039 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:22.568828 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-c72beed1-bc44-4fb5-ac49-fd780d712fa3 req-54a74710-26be-4d23-b659-4554d6591039 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:22.573410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:02:22.579975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.compute.server_external_events [req-c72beed1-bc44-4fb5-ac49-fd780d712fa3 req-54a74710-26be-4d23-b659-4554d6591039 service nova] Unable to find a host for instance 51801af2-7242-4d4b-ba0c-6fa968212728. Dropping event network-vif-unplugged {{(pid=126044) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 28 06:02:22.580846 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-c72beed1-bc44-4fb5-ac49-fd780d712fa3 req-54a74710-26be-4d23-b659-4554d6591039 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026072 May 28 06:02:22.581430 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4059/8005] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 28 06:02:22.791289 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c6fefb3c-8b47-41e2-9489-3e68d46bcc4d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:22.791926 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c6fefb3c-8b47-41e2-9489-3e68d46bcc4d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:22.799372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6fefb3c-8b47-41e2-9489-3e68d46bcc4d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:22.812674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6fefb3c-8b47-41e2-9489-3e68d46bcc4d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:22.812674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6fefb3c-8b47-41e2-9489-3e68d46bcc4d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:22.812674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c6fefb3c-8b47-41e2-9489-3e68d46bcc4d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:22.936830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c6fefb3c-8b47-41e2-9489-3e68d46bcc4d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:22.944750 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c6fefb3c-8b47-41e2-9489-3e68d46bcc4d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1629 microversion: 2.1 time: 0.157538 May 28 06:02:22.945972 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3947/8006] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:22 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1629 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:23.962537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e38c1a04-c5f5-4685-a536-f2ae5e18c68a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:23.963101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e38c1a04-c5f5-4685-a536-f2ae5e18c68a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:23.966272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=33 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:02:23.971372 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e38c1a04-c5f5-4685-a536-f2ae5e18c68a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:23.975318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e38c1a04-c5f5-4685-a536-f2ae5e18c68a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:23.975318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e38c1a04-c5f5-4685-a536-f2ae5e18c68a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:23.975318 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e38c1a04-c5f5-4685-a536-f2ae5e18c68a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:24.172417 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e38c1a04-c5f5-4685-a536-f2ae5e18c68a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:24.180194 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e38c1a04-c5f5-4685-a536-f2ae5e18c68a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1687 microversion: 2.1 time: 0.221723 May 28 06:02:24.180782 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4060/8007] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:23 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1687 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:24.791854 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-2a6bb731-55a3-4027-89bf-57f5699e63e0 req-0b17e092-5e38-48f8-a0b1-805f722d5023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51801af2-7242-4d4b-ba0c-6fa968212728", "tag": "adfd530a-ccd0-4c1c-b0b0-930c7cff02e4"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:02:24.798681 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=31 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:02:24.801800 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2a6bb731-55a3-4027-89bf-57f5699e63e0 req-0b17e092-5e38-48f8-a0b1-805f722d5023 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:24.802260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-2a6bb731-55a3-4027-89bf-57f5699e63e0 req-0b17e092-5e38-48f8-a0b1-805f722d5023 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:24.805144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=91 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:02:24.814809 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-2a6bb731-55a3-4027-89bf-57f5699e63e0 req-0b17e092-5e38-48f8-a0b1-805f722d5023 service nova] Creating event network-changed:adfd530a-ccd0-4c1c-b0b0-930c7cff02e4 for instance 51801af2-7242-4d4b-ba0c-6fa968212728 on n-h1-843700-1 May 28 06:02:24.820091 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-2a6bb731-55a3-4027-89bf-57f5699e63e0 req-0b17e092-5e38-48f8-a0b1-805f722d5023 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100818 May 28 06:02:24.820711 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3948/8008] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:02:25.198857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-417fd7a4-2da5-4eee-9c0e-62910c27af51 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:25.199510 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-417fd7a4-2da5-4eee-9c0e-62910c27af51 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:25.207020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-417fd7a4-2da5-4eee-9c0e-62910c27af51 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:25.208061 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-417fd7a4-2da5-4eee-9c0e-62910c27af51 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:25.208254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-417fd7a4-2da5-4eee-9c0e-62910c27af51 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:25.208698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-417fd7a4-2da5-4eee-9c0e-62910c27af51 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:25.344448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-417fd7a4-2da5-4eee-9c0e-62910c27af51 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:25.352471 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-417fd7a4-2da5-4eee-9c0e-62910c27af51 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1687 microversion: 2.1 time: 0.157548 May 28 06:02:25.353054 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4061/8009] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:25 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:26.371551 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e44f5c33-ccd2-441e-a337-27cc3c7e16b4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:26.372187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e44f5c33-ccd2-441e-a337-27cc3c7e16b4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:26.379338 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e44f5c33-ccd2-441e-a337-27cc3c7e16b4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:26.379804 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e44f5c33-ccd2-441e-a337-27cc3c7e16b4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:26.380576 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e44f5c33-ccd2-441e-a337-27cc3c7e16b4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:26.381024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e44f5c33-ccd2-441e-a337-27cc3c7e16b4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:26.521254 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e44f5c33-ccd2-441e-a337-27cc3c7e16b4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:26.529575 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e44f5c33-ccd2-441e-a337-27cc3c7e16b4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1687 microversion: 2.1 time: 0.162632 May 28 06:02:26.530165 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3949/8010] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:26 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:27.548157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-87e7b9fb-1211-40cd-b8cf-40d6af3f35dc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:27.548157 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-87e7b9fb-1211-40cd-b8cf-40d6af3f35dc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:27.567839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87e7b9fb-1211-40cd-b8cf-40d6af3f35dc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:27.568298 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87e7b9fb-1211-40cd-b8cf-40d6af3f35dc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:27.569075 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87e7b9fb-1211-40cd-b8cf-40d6af3f35dc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:27.569509 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-87e7b9fb-1211-40cd-b8cf-40d6af3f35dc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:27.722492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-87e7b9fb-1211-40cd-b8cf-40d6af3f35dc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:27.731478 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-87e7b9fb-1211-40cd-b8cf-40d6af3f35dc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1687 microversion: 2.1 time: 0.188541 May 28 06:02:27.732785 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4062/8011] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:27 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1687 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:28.751902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2daefbaa-298d-41e9-bd32-a18cb0b9374a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:28.753234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2daefbaa-298d-41e9-bd32-a18cb0b9374a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:28.760475 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2daefbaa-298d-41e9-bd32-a18cb0b9374a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:28.760943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2daefbaa-298d-41e9-bd32-a18cb0b9374a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:28.761730 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2daefbaa-298d-41e9-bd32-a18cb0b9374a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:28.762181 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2daefbaa-298d-41e9-bd32-a18cb0b9374a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:28.900771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2daefbaa-298d-41e9-bd32-a18cb0b9374a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:28.909062 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2daefbaa-298d-41e9-bd32-a18cb0b9374a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1687 microversion: 2.1 time: 0.161799 May 28 06:02:28.909652 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3950/8012] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:28 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:29.926651 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c2d61d12-c88f-41a8-8c3f-7aa01a50adaf tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:29.927254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c2d61d12-c88f-41a8-8c3f-7aa01a50adaf tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:29.934137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2d61d12-c88f-41a8-8c3f-7aa01a50adaf tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:29.934603 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2d61d12-c88f-41a8-8c3f-7aa01a50adaf tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:29.936050 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2d61d12-c88f-41a8-8c3f-7aa01a50adaf tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:29.936496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c2d61d12-c88f-41a8-8c3f-7aa01a50adaf tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:30.075396 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c2d61d12-c88f-41a8-8c3f-7aa01a50adaf tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:30.083026 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c2d61d12-c88f-41a8-8c3f-7aa01a50adaf tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1687 microversion: 2.1 time: 0.160376 May 28 06:02:30.083606 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4063/8013] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:29 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:31.101106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a585c80a-1d56-4ab4-81ab-d5614dcafd63 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:31.101838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a585c80a-1d56-4ab4-81ab-d5614dcafd63 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:31.109357 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a585c80a-1d56-4ab4-81ab-d5614dcafd63 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:31.109845 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a585c80a-1d56-4ab4-81ab-d5614dcafd63 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:31.110704 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a585c80a-1d56-4ab4-81ab-d5614dcafd63 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:31.111244 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a585c80a-1d56-4ab4-81ab-d5614dcafd63 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:31.307170 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a585c80a-1d56-4ab4-81ab-d5614dcafd63 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:31.315220 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a585c80a-1d56-4ab4-81ab-d5614dcafd63 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1687 microversion: 2.1 time: 0.218448 May 28 06:02:31.315810 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3951/8014] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:31 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1687 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:32.335084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1aef5886-7cf7-4500-bac3-ca8a64eee326 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:32.335804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1aef5886-7cf7-4500-bac3-ca8a64eee326 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:32.343389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1aef5886-7cf7-4500-bac3-ca8a64eee326 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:32.343856 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1aef5886-7cf7-4500-bac3-ca8a64eee326 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:32.344659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1aef5886-7cf7-4500-bac3-ca8a64eee326 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:32.345107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1aef5886-7cf7-4500-bac3-ca8a64eee326 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:32.491710 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1aef5886-7cf7-4500-bac3-ca8a64eee326 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:32.499712 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1aef5886-7cf7-4500-bac3-ca8a64eee326 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1687 microversion: 2.1 time: 0.171094 May 28 06:02:32.500528 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4064/8015] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:32 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 06:02:33.517423 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-93deed16-0117-43d7-80e4-b5bd24ff9f49 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:33.518772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-93deed16-0117-43d7-80e4-b5bd24ff9f49 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:33.525867 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93deed16-0117-43d7-80e4-b5bd24ff9f49 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:33.526334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93deed16-0117-43d7-80e4-b5bd24ff9f49 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:33.527159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93deed16-0117-43d7-80e4-b5bd24ff9f49 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:33.527609 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-93deed16-0117-43d7-80e4-b5bd24ff9f49 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:33.672649 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-93deed16-0117-43d7-80e4-b5bd24ff9f49 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:33.680283 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-93deed16-0117-43d7-80e4-b5bd24ff9f49 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1687 microversion: 2.1 time: 0.166860 May 28 06:02:33.680888 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3952/8016] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:33 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:34.697605 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e0eb9285-2a64-4c43-8d61-9cb92f344475 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:34.698173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e0eb9285-2a64-4c43-8d61-9cb92f344475 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:34.705163 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0eb9285-2a64-4c43-8d61-9cb92f344475 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:34.705621 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0eb9285-2a64-4c43-8d61-9cb92f344475 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:34.706384 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0eb9285-2a64-4c43-8d61-9cb92f344475 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:34.706827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e0eb9285-2a64-4c43-8d61-9cb92f344475 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:34.867426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e0eb9285-2a64-4c43-8d61-9cb92f344475 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:34.875071 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e0eb9285-2a64-4c43-8d61-9cb92f344475 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1687 microversion: 2.1 time: 0.181470 May 28 06:02:34.880768 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4065/8017] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:34 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:35.892227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-13a36405-c093-4c40-8d91-41d89c0cd830 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:35.892868 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-13a36405-c093-4c40-8d91-41d89c0cd830 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:35.899911 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13a36405-c093-4c40-8d91-41d89c0cd830 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:35.900388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13a36405-c093-4c40-8d91-41d89c0cd830 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:35.901176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13a36405-c093-4c40-8d91-41d89c0cd830 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:35.901641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-13a36405-c093-4c40-8d91-41d89c0cd830 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:36.032028 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-13a36405-c093-4c40-8d91-41d89c0cd830 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:36.039755 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-13a36405-c093-4c40-8d91-41d89c0cd830 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1687 microversion: 2.1 time: 0.152059 May 28 06:02:36.040339 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3953/8018] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:35 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:37.057616 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a3a122c9-9083-4afc-a872-5c83b7826921 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:37.058240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a3a122c9-9083-4afc-a872-5c83b7826921 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:37.065399 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3a122c9-9083-4afc-a872-5c83b7826921 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:37.065851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3a122c9-9083-4afc-a872-5c83b7826921 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:37.066614 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3a122c9-9083-4afc-a872-5c83b7826921 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:37.067083 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a3a122c9-9083-4afc-a872-5c83b7826921 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:37.199292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a3a122c9-9083-4afc-a872-5c83b7826921 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:37.206760 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a3a122c9-9083-4afc-a872-5c83b7826921 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1687 microversion: 2.1 time: 0.153088 May 28 06:02:37.207367 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4066/8019] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:37 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:38.224240 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6274c8f5-03e6-47c8-8008-5831161facf8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:38.224880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6274c8f5-03e6-47c8-8008-5831161facf8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:38.231959 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6274c8f5-03e6-47c8-8008-5831161facf8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:38.233051 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6274c8f5-03e6-47c8-8008-5831161facf8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:38.233941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6274c8f5-03e6-47c8-8008-5831161facf8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:38.234471 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6274c8f5-03e6-47c8-8008-5831161facf8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:38.384619 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6274c8f5-03e6-47c8-8008-5831161facf8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:38.392421 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6274c8f5-03e6-47c8-8008-5831161facf8 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1687 microversion: 2.1 time: 0.172319 May 28 06:02:38.393218 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3954/8020] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:38 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:39.410110 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8142d903-c9d4-472d-9ea0-38323fa9b064 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:39.410662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8142d903-c9d4-472d-9ea0-38323fa9b064 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:39.417702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8142d903-c9d4-472d-9ea0-38323fa9b064 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:39.418162 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8142d903-c9d4-472d-9ea0-38323fa9b064 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:39.418931 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8142d903-c9d4-472d-9ea0-38323fa9b064 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:39.419400 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8142d903-c9d4-472d-9ea0-38323fa9b064 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:39.557079 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8142d903-c9d4-472d-9ea0-38323fa9b064 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:39.564911 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8142d903-c9d4-472d-9ea0-38323fa9b064 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1687 microversion: 2.1 time: 0.158845 May 28 06:02:39.565507 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4067/8021] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:39 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:40.237091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-da14b8d2-5d0f-4ffb-ab5f-f0e6aaaa6215 req-f07f5ef0-9553-4ed8-8478-3036b07daf95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51801af2-7242-4d4b-ba0c-6fa968212728", "name": "network-vif-plugged", "status": "completed", "tag": "adfd530a-ccd0-4c1c-b0b0-930c7cff02e4"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:02:40.246562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-da14b8d2-5d0f-4ffb-ab5f-f0e6aaaa6215 req-f07f5ef0-9553-4ed8-8478-3036b07daf95 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:40.248882 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-da14b8d2-5d0f-4ffb-ab5f-f0e6aaaa6215 req-f07f5ef0-9553-4ed8-8478-3036b07daf95 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:40.258493 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-da14b8d2-5d0f-4ffb-ab5f-f0e6aaaa6215 req-f07f5ef0-9553-4ed8-8478-3036b07daf95 service nova] Creating event network-vif-plugged:adfd530a-ccd0-4c1c-b0b0-930c7cff02e4 for instance 51801af2-7242-4d4b-ba0c-6fa968212728 on n-h1-843700-1 May 28 06:02:40.264331 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-da14b8d2-5d0f-4ffb-ab5f-f0e6aaaa6215 req-f07f5ef0-9553-4ed8-8478-3036b07daf95 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030406 May 28 06:02:40.264977 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3955/8022] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:02:40.582152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fca9cd6f-54a5-420f-8717-68b5924d3aaa tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:40.582763 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fca9cd6f-54a5-420f-8717-68b5924d3aaa tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:40.589612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fca9cd6f-54a5-420f-8717-68b5924d3aaa tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:40.590049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fca9cd6f-54a5-420f-8717-68b5924d3aaa tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:40.590806 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fca9cd6f-54a5-420f-8717-68b5924d3aaa tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:40.591290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fca9cd6f-54a5-420f-8717-68b5924d3aaa tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:40.721353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fca9cd6f-54a5-420f-8717-68b5924d3aaa tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:40.729121 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fca9cd6f-54a5-420f-8717-68b5924d3aaa tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1687 microversion: 2.1 time: 0.150882 May 28 06:02:40.729701 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4068/8023] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:40 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 06:02:41.747671 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6222ac17-cc73-4677-ae6c-95d4113ce9b4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:41.748443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6222ac17-cc73-4677-ae6c-95d4113ce9b4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:41.754830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6222ac17-cc73-4677-ae6c-95d4113ce9b4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:41.755341 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6222ac17-cc73-4677-ae6c-95d4113ce9b4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:41.756127 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6222ac17-cc73-4677-ae6c-95d4113ce9b4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:41.756584 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6222ac17-cc73-4677-ae6c-95d4113ce9b4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:41.890144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6222ac17-cc73-4677-ae6c-95d4113ce9b4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:41.897899 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6222ac17-cc73-4677-ae6c-95d4113ce9b4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1687 microversion: 2.1 time: 0.155422 May 28 06:02:41.898482 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3956/8024] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:41 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:42.915131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d1924397-6302-4905-a837-209440347a7b tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:02:42.915754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d1924397-6302-4905-a837-209440347a7b tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:02:42.922774 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d1924397-6302-4905-a837-209440347a7b tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:42.923272 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d1924397-6302-4905-a837-209440347a7b tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:42.924044 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d1924397-6302-4905-a837-209440347a7b tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:02:42.924490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d1924397-6302-4905-a837-209440347a7b tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:02:43.053976 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d1924397-6302-4905-a837-209440347a7b tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:02:43.062270 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d1924397-6302-4905-a837-209440347a7b tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1674 microversion: 2.1 time: 0.151160 May 28 06:02:43.062856 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4069/8025] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:02:42 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:02:49.759674 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:02:49.760245 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 06:02:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:02:52.656437 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:02:52.657009 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 06:02:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:03:53.569823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=17 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:03:53.570624 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=45 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:03:53.574620 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-58be628e-a73a-491a-8e49-ed750790efea tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:03:53.575159 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-58be628e-a73a-491a-8e49-ed750790efea tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:03:53.579786 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=19 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:03:53.581240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=60 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:03:53.583280 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-58be628e-a73a-491a-8e49-ed750790efea tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:03:53.583766 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-58be628e-a73a-491a-8e49-ed750790efea tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:03:53.584715 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-58be628e-a73a-491a-8e49-ed750790efea tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:03:53.585225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-58be628e-a73a-491a-8e49-ed750790efea tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:03:53.585334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-fbc9ad04-518a-4bcb-80c9-ab87cd67a9dd req-acab04c5-a6a5-49e8-9e92-6aada88b1bcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51801af2-7242-4d4b-ba0c-6fa968212728", "tag": "adfd530a-ccd0-4c1c-b0b0-930c7cff02e4"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:03:53.594602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-fbc9ad04-518a-4bcb-80c9-ab87cd67a9dd req-acab04c5-a6a5-49e8-9e92-6aada88b1bcd service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:03:53.595091 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-fbc9ad04-518a-4bcb-80c9-ab87cd67a9dd req-acab04c5-a6a5-49e8-9e92-6aada88b1bcd service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:03:53.607173 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-fbc9ad04-518a-4bcb-80c9-ab87cd67a9dd req-acab04c5-a6a5-49e8-9e92-6aada88b1bcd service nova] Creating event network-changed:adfd530a-ccd0-4c1c-b0b0-930c7cff02e4 for instance 51801af2-7242-4d4b-ba0c-6fa968212728 on n-h1-843700-1 May 28 06:03:53.613680 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-fbc9ad04-518a-4bcb-80c9-ab87cd67a9dd req-acab04c5-a6a5-49e8-9e92-6aada88b1bcd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035653 May 28 06:03:53.614789 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4070/8026] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:03:53.618225 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-58be628e-a73a-491a-8e49-ed750790efea tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Going to try to terminate instance {{(pid=126043) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 06:03:53.894936 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-58be628e-a73a-491a-8e49-ed750790efea tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "DELETE /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 204 len: 0 microversion: 2.1 time: 0.327030 May 28 06:03:53.895953 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3957/8027] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 06:03:53 2022] DELETE /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 06:03:53.905596 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-446ac7f0-2c3d-42f2-8a27-cb4cb91181d0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:03:53.906312 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-446ac7f0-2c3d-42f2-8a27-cb4cb91181d0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:03:53.914581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-446ac7f0-2c3d-42f2-8a27-cb4cb91181d0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:03:53.915321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-446ac7f0-2c3d-42f2-8a27-cb4cb91181d0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:03:53.916109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-446ac7f0-2c3d-42f2-8a27-cb4cb91181d0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:03:53.916785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-446ac7f0-2c3d-42f2-8a27-cb4cb91181d0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:03:54.106653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-446ac7f0-2c3d-42f2-8a27-cb4cb91181d0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:03:54.115217 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-446ac7f0-2c3d-42f2-8a27-cb4cb91181d0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1680 microversion: 2.1 time: 0.214732 May 28 06:03:54.116054 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4071/8028] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:03:53 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1680 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:03:55.133665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9f004208-3b4d-40e5-96df-7f86b49c28d9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:03:55.134419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9f004208-3b4d-40e5-96df-7f86b49c28d9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:03:55.141655 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f004208-3b4d-40e5-96df-7f86b49c28d9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:03:55.142126 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f004208-3b4d-40e5-96df-7f86b49c28d9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:03:55.142917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f004208-3b4d-40e5-96df-7f86b49c28d9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:03:55.143398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9f004208-3b4d-40e5-96df-7f86b49c28d9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:03:55.452552 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9f004208-3b4d-40e5-96df-7f86b49c28d9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:03:55.457688 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9f004208-3b4d-40e5-96df-7f86b49c28d9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1680 microversion: 2.1 time: 0.328308 May 28 06:03:55.458271 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3958/8029] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:03:55 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1680 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 06:03:55.765164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-2952cbef-f4a8-4f3c-b2bb-d2658b0a123c req-75aa75a1-b0e9-448b-b04d-98c8bf9d3ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51801af2-7242-4d4b-ba0c-6fa968212728", "name": "network-vif-deleted", "tag": "adfd530a-ccd0-4c1c-b0b0-930c7cff02e4"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:03:55.774448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2952cbef-f4a8-4f3c-b2bb-d2658b0a123c req-75aa75a1-b0e9-448b-b04d-98c8bf9d3ac5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:03:55.774904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-2952cbef-f4a8-4f3c-b2bb-d2658b0a123c req-75aa75a1-b0e9-448b-b04d-98c8bf9d3ac5 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:03:55.786604 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-2952cbef-f4a8-4f3c-b2bb-d2658b0a123c req-75aa75a1-b0e9-448b-b04d-98c8bf9d3ac5 service nova] Creating event network-vif-deleted:adfd530a-ccd0-4c1c-b0b0-930c7cff02e4 for instance 51801af2-7242-4d4b-ba0c-6fa968212728 on n-h1-843700-1 May 28 06:03:55.791638 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-2952cbef-f4a8-4f3c-b2bb-d2658b0a123c req-75aa75a1-b0e9-448b-b04d-98c8bf9d3ac5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030344 May 28 06:03:55.792228 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4072/8030] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:03:56.475651 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6c1f0b64-c9d5-4928-95e2-e2f4ac9f217c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:03:56.476313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6c1f0b64-c9d5-4928-95e2-e2f4ac9f217c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:03:56.482607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c1f0b64-c9d5-4928-95e2-e2f4ac9f217c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:03:56.483104 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c1f0b64-c9d5-4928-95e2-e2f4ac9f217c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:03:56.483880 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c1f0b64-c9d5-4928-95e2-e2f4ac9f217c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:03:56.484327 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c1f0b64-c9d5-4928-95e2-e2f4ac9f217c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:03:56.517050 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c1f0b64-c9d5-4928-95e2-e2f4ac9f217c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:03:56.517521 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6c1f0b64-c9d5-4928-95e2-e2f4ac9f217c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:03:56.517989 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-6c1f0b64-c9d5-4928-95e2-e2f4ac9f217c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lazy-loading 'fault' on Instance uuid 51801af2-7242-4d4b-ba0c-6fa968212728 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 06:03:56.562176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6c1f0b64-c9d5-4928-95e2-e2f4ac9f217c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:03:56.569966 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6c1f0b64-c9d5-4928-95e2-e2f4ac9f217c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 200 len: 1336 microversion: 2.1 time: 0.098459 May 28 06:03:56.573988 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3959/8031] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:03:56 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 1336 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:03:57.588512 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0f1742f7-d615-4647-8941-ae68644d792e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:03:57.589218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0f1742f7-d615-4647-8941-ae68644d792e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 51801af2-7242-4d4b-ba0c-6fa968212728] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:03:57.596309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f1742f7-d615-4647-8941-ae68644d792e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:03:57.596765 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f1742f7-d615-4647-8941-ae68644d792e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:03:57.597530 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f1742f7-d615-4647-8941-ae68644d792e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:03:57.597975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0f1742f7-d615-4647-8941-ae68644d792e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:03:57.611334 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.wsgi [None req-0f1742f7-d615-4647-8941-ae68644d792e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] HTTP exception thrown: Instance 51801af2-7242-4d4b-ba0c-6fa968212728 could not be found. May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0f1742f7-d615-4647-8941-ae68644d792e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Request method failure captured: May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: request: GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 HTTP/1.1 May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: Accept: application/json May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: Accept-Encoding: identity May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: Connection: close May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: Content-Length: 0 May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: Content-Type: application/json May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: Host: 10.222.0.58 May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: Openstack-System-Scope: None May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: User-Agent: python-urllib3/1.26.9 May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: X-Auth-Token: gAAAAABikbpH1nOhnKkVWPSuEdJzFx0s-8-40SevUDctyaXw1zRHMjBWKL_lVnt_XaFoYa8cSTC7d621nJCKer8AJqt3r3OXau0L3vpkrGD2wwCytCugKFk5Kf06U85FSlvKgcTHeFz_NxR9RJyqhgg8xsii9-0SBofxhgwa_ZCxzk56-aYiLg8 May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Id: None May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: X-Domain-Name: None May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: X-Identity-Status: Confirmed May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: X-Is-Admin-Project: True May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Id: default May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Domain-Name: Default May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Id: 07c9fecdea3943429a65cdb106d0fe8c May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: X-Project-Name: tempest-TestShelveInstance-1833083254 May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: X-Role: reader,member May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: X-Roles: reader,member May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_07c9fecdea3943429a65cdb106d0fe8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/07c9fecdea3943429a65cdb106d0fe8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/07c9fecdea3943429a65cdb106d0fe8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/07c9fecdea3943429a65cdb106d0fe8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant: tempest-TestShelveInstance-1833083254 May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Id: 07c9fecdea3943429a65cdb106d0fe8c May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: X-Tenant-Name: tempest-TestShelveInstance-1833083254 May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: X-User: tempest-TestShelveInstance-1833083254-project May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Id: default May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: X-User-Domain-Name: Default May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: X-User-Id: c0c0151985ca4aa9ae5d55f8925603fd May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: X-User-Name: tempest-TestShelveInstance-1833083254-project May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: method: > May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: exception: Instance 51801af2-7242-4d4b-ba0c-6fa968212728 could not be found. May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: action_args: {'id': '51801af2-7242-4d4b-ba0c-6fa968212728'} May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51801af2-7242-4d4b-ba0c-6fa968212728 could not be found. May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51801af2-7242-4d4b-ba0c-6fa968212728 could not be found. May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 06:03:57.612994 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 06:03:57.617696 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 06:03:57.617696 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 06:03:57.617696 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 06:03:57.617696 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 06:03:57.617696 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 06:03:57.617696 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51801af2-7242-4d4b-ba0c-6fa968212728 could not be found. May 28 06:03:57.617696 n-d-843700-1 devstack@n-api.service[126044]: ERROR nova.api.openstack.wsgi May 28 06:03:57.617696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0f1742f7-d615-4647-8941-ae68644d792e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Returning 404 to user: Instance 51801af2-7242-4d4b-ba0c-6fa968212728 could not be found. {{(pid=126044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 06:03:57.617696 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0f1742f7-d615-4647-8941-ae68644d792e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728" status: 404 len: 111 microversion: 2.1 time: 0.031353 May 28 06:03:57.617696 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4073/8032] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:03:57 2022] GET /compute/v2.1/servers/51801af2-7242-4d4b-ba0c-6fa968212728 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 06:03:57.833639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5f1d98c6-0b99-4340-8b0f-cb34d29e4c3a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '.version_select at 0x7f770185cc10>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:03:57.836864 n-d-843700-1 devstack@n-api.service[126043]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5f1d98c6-0b99-4340-8b0f-cb34d29e4c3a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [53a08edb-8440-4d2a-9ebb-f50b8f6a6d4c] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 06:03:58.845259 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [None req-5f1d98c6-0b99-4340-8b0f-cb34d29e4c3a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [53a08edb-8440-4d2a-9ebb-f50b8f6a6d4c] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 34748. May 28 06:03:58.954951 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5f1d98c6-0b99-4340-8b0f-cb34d29e4c3a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2031697842" status: 202 len: 0 microversion: 2.1 time: 1.125227 May 28 06:03:58.955615 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3960/8033] 10.222.0.58 () {58 vars in 1253 bytes} [Sat May 28 06:03:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2031697842 => generated 0 bytes in 1127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 06:03:58.979741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-178ed55d-1bd9-46c3-88d8-098c630e5c88 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Action: 'create', calling method: .version_select at 0x7f7700fef790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1527017702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGXI8fVv+VeLL9cm4nAcCBmzUlvVsFGsdP5xM4etnyKmYaZNmBXwk5ixCVKLGNvB93BhzEme7KEM/JfBGuhwVqwxplv4pXO9w+oWHLovpBpCSUeTGsbJp3vqv/P9nAUxw=="}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:03:58.994536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-178ed55d-1bd9-46c3-88d8-098c630e5c88 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Getting quotas for project 07c9fecdea3943429a65cdb106d0fe8c. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 06:03:59.001019 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-178ed55d-1bd9-46c3-88d8-098c630e5c88 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Getting quotas for user c0c0151985ca4aa9ae5d55f8925603fd and project 07c9fecdea3943429a65cdb106d0fe8c. Resources: {'key_pairs'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 06:03:59.075012 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-178ed55d-1bd9-46c3-88d8-098c630e5c88 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.099299 May 28 06:03:59.075639 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4074/8034] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 06:03:58 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:04:30.378129 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:04:30.378917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:04:30.383060 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2d513a9f-9f80-49c7-bd7f-19bb076765cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-517761276", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1527017702", "security_groups": [{"name": "tempest-secgroup-smoke-993171763"}], "networks": [{"uuid": "b15f79cf-de97-4dbb-a777-d17517b0e9aa"}], "block_device_mapping_v2": [{"uuid": "e9acbf71-4a8c-4ea3-916d-0714e662cfc3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:04:30.494891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-2d513a9f-9f80-49c7-bd7f-19bb076765cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] validate_networks() for [('b15f79cf-de97-4dbb-a777-d17517b0e9aa', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 06:04:30.860099 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-2d513a9f-9f80-49c7-bd7f-19bb076765cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 06:04:30.860535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-2d513a9f-9f80-49c7-bd7f-19bb076765cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 06:04:30.861019 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-2d513a9f-9f80-49c7-bd7f-19bb076765cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 06:04:30.861437 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-2d513a9f-9f80-49c7-bd7f-19bb076765cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 06:04:30.861858 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-2d513a9f-9f80-49c7-bd7f-19bb076765cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 06:04:30.871643 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d513a9f-9f80-49c7-bd7f-19bb076765cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:30.871951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d513a9f-9f80-49c7-bd7f-19bb076765cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:30.872806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d513a9f-9f80-49c7-bd7f-19bb076765cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:30.873260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2d513a9f-9f80-49c7-bd7f-19bb076765cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:30.890148 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-2d513a9f-9f80-49c7-bd7f-19bb076765cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Getting quotas for project 07c9fecdea3943429a65cdb106d0fe8c. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 06:04:30.895494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-2d513a9f-9f80-49c7-bd7f-19bb076765cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Getting quotas for user c0c0151985ca4aa9ae5d55f8925603fd and project 07c9fecdea3943429a65cdb106d0fe8c. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 06:04:30.954197 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2d513a9f-9f80-49c7-bd7f-19bb076765cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 06:04:30.956438 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2d513a9f-9f80-49c7-bd7f-19bb076765cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e9acbf71-4a8c-4ea3-916d-0714e662cfc3',volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 06:04:31.334804 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2d513a9f-9f80-49c7-bd7f-19bb076765cd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.958525 May 28 06:04:31.335521 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3961/8035] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 06:04:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 06:04:31.344340 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=12 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:04:31.345116 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=4 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:04:31.345794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:04:31.349663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d4fb8128-57a0-4353-a0c2-72c8beb3c88c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:31.350288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d4fb8128-57a0-4353-a0c2-72c8beb3c88c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:31.405604 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d4fb8128-57a0-4353-a0c2-72c8beb3c88c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:31.413304 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d4fb8128-57a0-4353-a0c2-72c8beb3c88c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1088 microversion: 2.1 time: 0.070795 May 28 06:04:31.414325 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4075/8036] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:31 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1088 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:32.430167 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e892e57c-2c2c-41fa-8de7-ce3ebdab93c3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:32.430832 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e892e57c-2c2c-41fa-8de7-ce3ebdab93c3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:32.438165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e892e57c-2c2c-41fa-8de7-ce3ebdab93c3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:32.438641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e892e57c-2c2c-41fa-8de7-ce3ebdab93c3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:32.439554 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e892e57c-2c2c-41fa-8de7-ce3ebdab93c3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:32.440013 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e892e57c-2c2c-41fa-8de7-ce3ebdab93c3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:32.502909 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e892e57c-2c2c-41fa-8de7-ce3ebdab93c3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:32.510843 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e892e57c-2c2c-41fa-8de7-ce3ebdab93c3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1138 microversion: 2.1 time: 0.084689 May 28 06:04:32.511481 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3962/8037] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:32 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:33.528141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d7b6667d-e7b7-49c2-afe9-1d1d6d8e3b40 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:33.529362 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d7b6667d-e7b7-49c2-afe9-1d1d6d8e3b40 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:33.538501 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7b6667d-e7b7-49c2-afe9-1d1d6d8e3b40 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:33.539000 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7b6667d-e7b7-49c2-afe9-1d1d6d8e3b40 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:33.539843 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7b6667d-e7b7-49c2-afe9-1d1d6d8e3b40 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:33.540784 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d7b6667d-e7b7-49c2-afe9-1d1d6d8e3b40 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:33.615119 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d7b6667d-e7b7-49c2-afe9-1d1d6d8e3b40 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:33.623944 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d7b6667d-e7b7-49c2-afe9-1d1d6d8e3b40 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1204 microversion: 2.1 time: 0.099728 May 28 06:04:33.624472 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4076/8038] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:33 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1204 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:34.641855 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bccc2d8d-2f6a-498b-92bd-ba5f85359019 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:34.642639 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bccc2d8d-2f6a-498b-92bd-ba5f85359019 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:34.650589 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bccc2d8d-2f6a-498b-92bd-ba5f85359019 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:34.651698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bccc2d8d-2f6a-498b-92bd-ba5f85359019 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:34.652249 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bccc2d8d-2f6a-498b-92bd-ba5f85359019 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:34.652767 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bccc2d8d-2f6a-498b-92bd-ba5f85359019 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:34.822134 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bccc2d8d-2f6a-498b-92bd-ba5f85359019 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:34.830676 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bccc2d8d-2f6a-498b-92bd-ba5f85359019 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1271 microversion: 2.1 time: 0.193216 May 28 06:04:34.840213 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3963/8039] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:34 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1271 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:35.022870 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-a7240acb-98ac-4a77-ac3f-f091c67e98ab req-831b4117-c320-4476-a353-13bd7bab13e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "268c1239-8642-4541-98e3-96711396d880", "tag": "2bec215f-c51d-4998-811f-f675463989f8"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:04:35.036353 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a7240acb-98ac-4a77-ac3f-f091c67e98ab req-831b4117-c320-4476-a353-13bd7bab13e9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:35.037062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a7240acb-98ac-4a77-ac3f-f091c67e98ab req-831b4117-c320-4476-a353-13bd7bab13e9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:35.051138 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-a7240acb-98ac-4a77-ac3f-f091c67e98ab req-831b4117-c320-4476-a353-13bd7bab13e9 service nova] Creating event network-changed:2bec215f-c51d-4998-811f-f675463989f8 for instance 268c1239-8642-4541-98e3-96711396d880 on n-h2-843700-1 May 28 06:04:35.060293 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-a7240acb-98ac-4a77-ac3f-f091c67e98ab req-831b4117-c320-4476-a353-13bd7bab13e9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037919 May 28 06:04:35.060293 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4077/8040] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:04:35.848065 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-54cc86b9-8704-4082-ae8b-d54d3429a8c6 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:35.848618 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-54cc86b9-8704-4082-ae8b-d54d3429a8c6 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:35.856085 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54cc86b9-8704-4082-ae8b-d54d3429a8c6 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:35.856589 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54cc86b9-8704-4082-ae8b-d54d3429a8c6 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:35.857393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54cc86b9-8704-4082-ae8b-d54d3429a8c6 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:35.857885 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-54cc86b9-8704-4082-ae8b-d54d3429a8c6 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:35.992786 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-54cc86b9-8704-4082-ae8b-d54d3429a8c6 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:36.001218 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-54cc86b9-8704-4082-ae8b-d54d3429a8c6 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1271 microversion: 2.1 time: 0.157195 May 28 06:04:36.001804 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3964/8041] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:35 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:37.020460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-90cc68d6-957d-4d34-bdd8-cf77d3c2b591 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:37.021086 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-90cc68d6-957d-4d34-bdd8-cf77d3c2b591 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:37.027406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90cc68d6-957d-4d34-bdd8-cf77d3c2b591 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:37.027873 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90cc68d6-957d-4d34-bdd8-cf77d3c2b591 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:37.028647 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90cc68d6-957d-4d34-bdd8-cf77d3c2b591 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:37.029090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-90cc68d6-957d-4d34-bdd8-cf77d3c2b591 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:37.170169 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-90cc68d6-957d-4d34-bdd8-cf77d3c2b591 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:37.177812 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-90cc68d6-957d-4d34-bdd8-cf77d3c2b591 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1271 microversion: 2.1 time: 0.162690 May 28 06:04:37.178389 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4078/8042] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:37 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:38.195891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-47a8f646-fbc0-4a93-b4ea-6f72de979c73 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:38.197095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-47a8f646-fbc0-4a93-b4ea-6f72de979c73 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:38.203941 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47a8f646-fbc0-4a93-b4ea-6f72de979c73 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:38.204416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47a8f646-fbc0-4a93-b4ea-6f72de979c73 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:38.205208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47a8f646-fbc0-4a93-b4ea-6f72de979c73 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:38.205669 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47a8f646-fbc0-4a93-b4ea-6f72de979c73 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:38.336965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-47a8f646-fbc0-4a93-b4ea-6f72de979c73 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:38.344675 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-47a8f646-fbc0-4a93-b4ea-6f72de979c73 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1271 microversion: 2.1 time: 0.152655 May 28 06:04:38.345176 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3965/8043] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:38 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:39.361705 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-05a1915e-2c72-4963-8bf2-4b31d447db18 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:39.362441 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-05a1915e-2c72-4963-8bf2-4b31d447db18 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:39.371029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05a1915e-2c72-4963-8bf2-4b31d447db18 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:39.371029 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05a1915e-2c72-4963-8bf2-4b31d447db18 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:39.371692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05a1915e-2c72-4963-8bf2-4b31d447db18 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:39.372132 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05a1915e-2c72-4963-8bf2-4b31d447db18 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:39.505721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-05a1915e-2c72-4963-8bf2-4b31d447db18 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:39.514043 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-05a1915e-2c72-4963-8bf2-4b31d447db18 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1271 microversion: 2.1 time: 0.156308 May 28 06:04:39.514624 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4079/8044] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:39 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:40.531292 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6cd83746-209c-4762-957b-3616e30373e1 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:40.542424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6cd83746-209c-4762-957b-3616e30373e1 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:40.542424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6cd83746-209c-4762-957b-3616e30373e1 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:40.542424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6cd83746-209c-4762-957b-3616e30373e1 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:40.542424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6cd83746-209c-4762-957b-3616e30373e1 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:40.542424 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6cd83746-209c-4762-957b-3616e30373e1 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:40.685180 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6cd83746-209c-4762-957b-3616e30373e1 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:40.693989 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6cd83746-209c-4762-957b-3616e30373e1 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1271 microversion: 2.1 time: 0.166558 May 28 06:04:40.694790 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3966/8045] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:40 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:41.711789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1119c2f7-3776-4ceb-b39f-814a8dceeebc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:41.712467 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1119c2f7-3776-4ceb-b39f-814a8dceeebc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:41.719543 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1119c2f7-3776-4ceb-b39f-814a8dceeebc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:41.719997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1119c2f7-3776-4ceb-b39f-814a8dceeebc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:41.720755 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1119c2f7-3776-4ceb-b39f-814a8dceeebc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:41.721190 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1119c2f7-3776-4ceb-b39f-814a8dceeebc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:41.852978 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1119c2f7-3776-4ceb-b39f-814a8dceeebc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:41.860669 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1119c2f7-3776-4ceb-b39f-814a8dceeebc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1271 microversion: 2.1 time: 0.152883 May 28 06:04:41.861256 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4080/8046] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:41 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:42.879067 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:04:42.880381 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:04:42.926553 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a65f67c6-a71c-4ddb-a0c5-0864347baf1d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:42.927302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a65f67c6-a71c-4ddb-a0c5-0864347baf1d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:42.934207 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a65f67c6-a71c-4ddb-a0c5-0864347baf1d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:42.934685 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a65f67c6-a71c-4ddb-a0c5-0864347baf1d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:42.935497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a65f67c6-a71c-4ddb-a0c5-0864347baf1d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:42.935984 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a65f67c6-a71c-4ddb-a0c5-0864347baf1d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:43.069590 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a65f67c6-a71c-4ddb-a0c5-0864347baf1d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:43.077740 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a65f67c6-a71c-4ddb-a0c5-0864347baf1d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1271 microversion: 2.1 time: 0.203284 May 28 06:04:43.078327 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3967/8047] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:42 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1271 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:44.095003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-59a9c7ef-3678-4f16-98c2-d4ebdf825b93 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:44.095835 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-59a9c7ef-3678-4f16-98c2-d4ebdf825b93 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:44.098673 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:04:44.104147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-59a9c7ef-3678-4f16-98c2-d4ebdf825b93 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:44.104612 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-59a9c7ef-3678-4f16-98c2-d4ebdf825b93 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:44.105442 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-59a9c7ef-3678-4f16-98c2-d4ebdf825b93 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:44.105888 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-59a9c7ef-3678-4f16-98c2-d4ebdf825b93 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:44.240649 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-59a9c7ef-3678-4f16-98c2-d4ebdf825b93 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:44.249086 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-59a9c7ef-3678-4f16-98c2-d4ebdf825b93 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1271 microversion: 2.1 time: 0.158079 May 28 06:04:44.249673 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4081/8048] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:44 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:45.265809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9eede2a4-762b-42d3-ba4c-c3ebbbd78ca5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:45.269626 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9eede2a4-762b-42d3-ba4c-c3ebbbd78ca5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:45.273515 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9eede2a4-762b-42d3-ba4c-c3ebbbd78ca5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:45.274484 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9eede2a4-762b-42d3-ba4c-c3ebbbd78ca5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:45.275295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9eede2a4-762b-42d3-ba4c-c3ebbbd78ca5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:45.275755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9eede2a4-762b-42d3-ba4c-c3ebbbd78ca5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:45.412934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9eede2a4-762b-42d3-ba4c-c3ebbbd78ca5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:45.420615 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9eede2a4-762b-42d3-ba4c-c3ebbbd78ca5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1259 microversion: 2.1 time: 0.158848 May 28 06:04:45.424817 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3968/8049] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:45 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:46.438109 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c800c54a-0a59-4088-9e1e-d0207e6daf0f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:46.438678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c800c54a-0a59-4088-9e1e-d0207e6daf0f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:46.445761 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c800c54a-0a59-4088-9e1e-d0207e6daf0f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:46.446858 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c800c54a-0a59-4088-9e1e-d0207e6daf0f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:46.447656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c800c54a-0a59-4088-9e1e-d0207e6daf0f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:46.448107 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c800c54a-0a59-4088-9e1e-d0207e6daf0f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:46.580003 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c800c54a-0a59-4088-9e1e-d0207e6daf0f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:46.589141 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c800c54a-0a59-4088-9e1e-d0207e6daf0f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1259 microversion: 2.1 time: 0.155066 May 28 06:04:46.589727 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4082/8050] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:46 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:47.607038 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bd5ed745-8eb7-42a1-919c-0470dfb52009 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:47.607674 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bd5ed745-8eb7-42a1-919c-0470dfb52009 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:47.615974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd5ed745-8eb7-42a1-919c-0470dfb52009 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:47.616443 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd5ed745-8eb7-42a1-919c-0470dfb52009 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:47.617224 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd5ed745-8eb7-42a1-919c-0470dfb52009 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:47.618330 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bd5ed745-8eb7-42a1-919c-0470dfb52009 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:47.749510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bd5ed745-8eb7-42a1-919c-0470dfb52009 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:47.757107 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bd5ed745-8eb7-42a1-919c-0470dfb52009 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1259 microversion: 2.1 time: 0.154072 May 28 06:04:47.757692 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3969/8051] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:47 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:48.773669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3f94278a-5619-4fe7-928f-b4f47f20549e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:48.774785 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3f94278a-5619-4fe7-928f-b4f47f20549e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:48.781864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f94278a-5619-4fe7-928f-b4f47f20549e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:48.782321 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f94278a-5619-4fe7-928f-b4f47f20549e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:48.783125 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f94278a-5619-4fe7-928f-b4f47f20549e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:48.783573 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3f94278a-5619-4fe7-928f-b4f47f20549e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:48.918041 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3f94278a-5619-4fe7-928f-b4f47f20549e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:48.925738 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3f94278a-5619-4fe7-928f-b4f47f20549e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1259 microversion: 2.1 time: 0.156012 May 28 06:04:48.926326 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4083/8052] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:48 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:49.942569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-874b154b-5d99-4f3e-860c-1a0fa84c6eec tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:49.943232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-874b154b-5d99-4f3e-860c-1a0fa84c6eec tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:49.950395 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-874b154b-5d99-4f3e-860c-1a0fa84c6eec tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:49.950869 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-874b154b-5d99-4f3e-860c-1a0fa84c6eec tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:49.951692 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-874b154b-5d99-4f3e-860c-1a0fa84c6eec tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:49.952154 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-874b154b-5d99-4f3e-860c-1a0fa84c6eec tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:50.090008 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-874b154b-5d99-4f3e-860c-1a0fa84c6eec tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:50.097803 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-874b154b-5d99-4f3e-860c-1a0fa84c6eec tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1259 microversion: 2.1 time: 0.159410 May 28 06:04:50.098398 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3970/8053] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:49 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:51.115536 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-106adbca-d7ef-44b1-9e61-37e586fe852c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:51.116153 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-106adbca-d7ef-44b1-9e61-37e586fe852c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:51.123669 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-106adbca-d7ef-44b1-9e61-37e586fe852c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:51.124123 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-106adbca-d7ef-44b1-9e61-37e586fe852c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:51.124892 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-106adbca-d7ef-44b1-9e61-37e586fe852c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:51.125334 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-106adbca-d7ef-44b1-9e61-37e586fe852c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:51.258016 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-106adbca-d7ef-44b1-9e61-37e586fe852c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:51.266649 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-106adbca-d7ef-44b1-9e61-37e586fe852c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1259 microversion: 2.1 time: 0.155335 May 28 06:04:51.267250 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4084/8054] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:51 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:52.283822 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7dcc2c26-94f8-4c2a-b336-e0cf0e520f51 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:52.284465 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7dcc2c26-94f8-4c2a-b336-e0cf0e520f51 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:52.291583 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7dcc2c26-94f8-4c2a-b336-e0cf0e520f51 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:52.292059 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7dcc2c26-94f8-4c2a-b336-e0cf0e520f51 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:52.292849 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7dcc2c26-94f8-4c2a-b336-e0cf0e520f51 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:52.293309 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7dcc2c26-94f8-4c2a-b336-e0cf0e520f51 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:52.423259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7dcc2c26-94f8-4c2a-b336-e0cf0e520f51 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:52.431674 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7dcc2c26-94f8-4c2a-b336-e0cf0e520f51 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1259 microversion: 2.1 time: 0.151823 May 28 06:04:52.432251 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3971/8055] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:52 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:53.448675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ff7cb6f5-2628-410b-bf0c-0108e10c644e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:53.449290 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ff7cb6f5-2628-410b-bf0c-0108e10c644e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:53.456245 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff7cb6f5-2628-410b-bf0c-0108e10c644e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:53.456719 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff7cb6f5-2628-410b-bf0c-0108e10c644e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:53.457480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff7cb6f5-2628-410b-bf0c-0108e10c644e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:53.457915 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ff7cb6f5-2628-410b-bf0c-0108e10c644e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:53.600716 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ff7cb6f5-2628-410b-bf0c-0108e10c644e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:53.608721 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ff7cb6f5-2628-410b-bf0c-0108e10c644e tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1259 microversion: 2.1 time: 0.163925 May 28 06:04:53.609329 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4085/8056] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:53 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:54.626176 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e4b3fbaf-f9e8-4b4b-901a-7a8ecb5af3cc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:54.626812 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e4b3fbaf-f9e8-4b4b-901a-7a8ecb5af3cc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:54.633990 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4b3fbaf-f9e8-4b4b-901a-7a8ecb5af3cc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:54.634467 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4b3fbaf-f9e8-4b4b-901a-7a8ecb5af3cc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:54.635290 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4b3fbaf-f9e8-4b4b-901a-7a8ecb5af3cc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:54.635748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e4b3fbaf-f9e8-4b4b-901a-7a8ecb5af3cc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:54.762745 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e4b3fbaf-f9e8-4b4b-901a-7a8ecb5af3cc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:54.770655 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e4b3fbaf-f9e8-4b4b-901a-7a8ecb5af3cc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1259 microversion: 2.1 time: 0.148432 May 28 06:04:54.771276 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3972/8057] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:54 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:55.498891 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-ae7b4024-28ec-4241-b991-ed0c57c405a9 req-51ebc617-944f-4deb-b0c9-1ed81746c557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "268c1239-8642-4541-98e3-96711396d880", "name": "network-vif-plugged", "status": "completed", "tag": "2bec215f-c51d-4998-811f-f675463989f8"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:04:55.506855 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ae7b4024-28ec-4241-b991-ed0c57c405a9 req-51ebc617-944f-4deb-b0c9-1ed81746c557 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:55.507344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-ae7b4024-28ec-4241-b991-ed0c57c405a9 req-51ebc617-944f-4deb-b0c9-1ed81746c557 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:55.518816 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-ae7b4024-28ec-4241-b991-ed0c57c405a9 req-51ebc617-944f-4deb-b0c9-1ed81746c557 service nova] Creating event network-vif-plugged:2bec215f-c51d-4998-811f-f675463989f8 for instance 268c1239-8642-4541-98e3-96711396d880 on n-h2-843700-1 May 28 06:04:55.523770 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-ae7b4024-28ec-4241-b991-ed0c57c405a9 req-51ebc617-944f-4deb-b0c9-1ed81746c557 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083554 May 28 06:04:55.525639 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4086/8058] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:04:55.788220 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-06201efc-60cc-4e22-97ba-3702fed60cbd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:55.788846 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-06201efc-60cc-4e22-97ba-3702fed60cbd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:55.796340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06201efc-60cc-4e22-97ba-3702fed60cbd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:55.796803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06201efc-60cc-4e22-97ba-3702fed60cbd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:55.797575 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06201efc-60cc-4e22-97ba-3702fed60cbd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:55.798024 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06201efc-60cc-4e22-97ba-3702fed60cbd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:55.927041 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-06201efc-60cc-4e22-97ba-3702fed60cbd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:55.935177 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-06201efc-60cc-4e22-97ba-3702fed60cbd tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1259 microversion: 2.1 time: 0.150827 May 28 06:04:55.935754 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3973/8059] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:55 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:56.953623 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-26a6db98-1a1f-4049-965a-f186f865344a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:56.954365 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-26a6db98-1a1f-4049-965a-f186f865344a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:56.960702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26a6db98-1a1f-4049-965a-f186f865344a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:56.961194 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26a6db98-1a1f-4049-965a-f186f865344a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:56.961969 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26a6db98-1a1f-4049-965a-f186f865344a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:56.962411 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-26a6db98-1a1f-4049-965a-f186f865344a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:57.095127 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-26a6db98-1a1f-4049-965a-f186f865344a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:57.102875 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-26a6db98-1a1f-4049-965a-f186f865344a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1444 microversion: 2.1 time: 0.154313 May 28 06:04:57.103486 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4087/8060] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:56 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 06:04:57.120375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e0b7c23d-4e65-4fbd-a23c-6b9878cbc2d7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:04:57.121005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e0b7c23d-4e65-4fbd-a23c-6b9878cbc2d7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:04:57.127402 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0b7c23d-4e65-4fbd-a23c-6b9878cbc2d7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:57.127870 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0b7c23d-4e65-4fbd-a23c-6b9878cbc2d7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:57.128652 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0b7c23d-4e65-4fbd-a23c-6b9878cbc2d7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:57.129101 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e0b7c23d-4e65-4fbd-a23c-6b9878cbc2d7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:57.256316 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e0b7c23d-4e65-4fbd-a23c-6b9878cbc2d7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:04:57.264425 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e0b7c23d-4e65-4fbd-a23c-6b9878cbc2d7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1444 microversion: 2.1 time: 0.148671 May 28 06:04:57.265009 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3974/8061] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:04:57 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1444 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:04:59.251184 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e9f448f5-840d-4347-a618-85369d7e403a req-9c1ad7e3-6d41-48cc-953e-1ae4cb4831b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "268c1239-8642-4541-98e3-96711396d880", "tag": "2bec215f-c51d-4998-811f-f675463989f8"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:04:59.259548 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e9f448f5-840d-4347-a618-85369d7e403a req-9c1ad7e3-6d41-48cc-953e-1ae4cb4831b9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:04:59.260008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e9f448f5-840d-4347-a618-85369d7e403a req-9c1ad7e3-6d41-48cc-953e-1ae4cb4831b9 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:04:59.271285 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e9f448f5-840d-4347-a618-85369d7e403a req-9c1ad7e3-6d41-48cc-953e-1ae4cb4831b9 service nova] Creating event network-changed:2bec215f-c51d-4998-811f-f675463989f8 for instance 268c1239-8642-4541-98e3-96711396d880 on n-h2-843700-1 May 28 06:04:59.276935 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e9f448f5-840d-4347-a618-85369d7e403a req-9c1ad7e3-6d41-48cc-953e-1ae4cb4831b9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095896 May 28 06:04:59.277756 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4088/8062] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:06:33.787978 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:06:33.788591 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 06:06:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:07:25.100898 n-d-843700-1 devstack@n-api.service[126043]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7b68896-232d-4c87-8179-08a432c034dc] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 06:07:25.101857 n-d-843700-1 devstack@n-api.service[126043]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9cedd376-8074-49f5-962c-429331dc3c26] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 06:07:25.102452 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:07:25.103253 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=80 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:07:25.107257 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-4e19ca61-e069-47f7-939f-26592b9730ef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:07:25.107809 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-4e19ca61-e069-47f7-939f-26592b9730ef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:25.114047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e19ca61-e069-47f7-939f-26592b9730ef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:25.114604 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e19ca61-e069-47f7-939f-26592b9730ef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:25.115334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e19ca61-e069-47f7-939f-26592b9730ef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:25.119384 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-4e19ca61-e069-47f7-939f-26592b9730ef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:25.140273 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.objects.instance [None req-4e19ca61-e069-47f7-939f-26592b9730ef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lazy-loading 'flavor' on Instance uuid 268c1239-8642-4541-98e3-96711396d880 {{(pid=126043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 06:07:25.482322 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-4e19ca61-e069-47f7-939f-26592b9730ef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "POST /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880/action" status: 202 len: 0 microversion: 2.1 time: 0.383075 May 28 06:07:25.482927 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3975/8063] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 06:07:25 2022] POST /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 06:07:25.490084 n-d-843700-1 devstack@n-api.service[126044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a1992b24-c6ca-47ed-a310-b37951ac973c] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 06:07:25.491248 n-d-843700-1 devstack@n-api.service[126044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7fb7b4e8-8c85-4700-986d-4cff401b6421] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 06:07:25.491997 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=30 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:07:25.492754 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=66 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:07:25.496842 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c9c9b858-6f9a-423a-a1da-03e9e6620007 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:25.497556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c9c9b858-6f9a-423a-a1da-03e9e6620007 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:25.504456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9c9b858-6f9a-423a-a1da-03e9e6620007 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:25.509241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9c9b858-6f9a-423a-a1da-03e9e6620007 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:25.509241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9c9b858-6f9a-423a-a1da-03e9e6620007 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:25.509241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c9c9b858-6f9a-423a-a1da-03e9e6620007 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:25.646020 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c9c9b858-6f9a-423a-a1da-03e9e6620007 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:25.654753 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c9c9b858-6f9a-423a-a1da-03e9e6620007 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1569 microversion: 2.1 time: 0.166598 May 28 06:07:25.655520 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4089/8064] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:25 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:26.677314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d77cd94b-b9ac-41cb-852b-f771af2309a3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:26.678039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d77cd94b-b9ac-41cb-852b-f771af2309a3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:26.690644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d77cd94b-b9ac-41cb-852b-f771af2309a3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:26.691143 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d77cd94b-b9ac-41cb-852b-f771af2309a3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:26.691960 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d77cd94b-b9ac-41cb-852b-f771af2309a3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:26.692410 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d77cd94b-b9ac-41cb-852b-f771af2309a3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:26.693126 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7b68896-232d-4c87-8179-08a432c034dc] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 35066. May 28 06:07:26.697775 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] [9cedd376-8074-49f5-962c-429331dc3c26] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 35068. May 28 06:07:26.827581 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d77cd94b-b9ac-41cb-852b-f771af2309a3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:26.835972 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d77cd94b-b9ac-41cb-852b-f771af2309a3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1569 microversion: 2.1 time: 0.165969 May 28 06:07:26.836552 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3976/8065] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:26 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:27.853258 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-05069d81-d767-4f54-bf1c-99ee09b4f3bc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:27.853902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-05069d81-d767-4f54-bf1c-99ee09b4f3bc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:27.862926 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05069d81-d767-4f54-bf1c-99ee09b4f3bc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:27.863469 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05069d81-d767-4f54-bf1c-99ee09b4f3bc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:27.864239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05069d81-d767-4f54-bf1c-99ee09b4f3bc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:27.864674 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-05069d81-d767-4f54-bf1c-99ee09b4f3bc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:27.874441 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] [a1992b24-c6ca-47ed-a310-b37951ac973c] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 35072. May 28 06:07:27.883869 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] [7fb7b4e8-8c85-4700-986d-4cff401b6421] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 35074. May 28 06:07:28.000972 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-05069d81-d767-4f54-bf1c-99ee09b4f3bc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:28.008758 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-05069d81-d767-4f54-bf1c-99ee09b4f3bc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1569 microversion: 2.1 time: 0.159475 May 28 06:07:28.009341 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4090/8066] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:27 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:29.025951 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c014b97e-d613-4929-83d7-c068cd7bfd00 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:29.026586 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c014b97e-d613-4929-83d7-c068cd7bfd00 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:29.034083 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c014b97e-d613-4929-83d7-c068cd7bfd00 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:29.034556 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c014b97e-d613-4929-83d7-c068cd7bfd00 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:29.035375 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c014b97e-d613-4929-83d7-c068cd7bfd00 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:29.035839 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c014b97e-d613-4929-83d7-c068cd7bfd00 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:29.165499 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c014b97e-d613-4929-83d7-c068cd7bfd00 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:29.173774 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c014b97e-d613-4929-83d7-c068cd7bfd00 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1569 microversion: 2.1 time: 0.151904 May 28 06:07:29.174349 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3977/8067] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:29 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:30.191657 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-839d9881-43e5-44e7-b1c8-6bf363fd6a81 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:30.192309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-839d9881-43e5-44e7-b1c8-6bf363fd6a81 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:30.199435 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-839d9881-43e5-44e7-b1c8-6bf363fd6a81 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:30.199921 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-839d9881-43e5-44e7-b1c8-6bf363fd6a81 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:30.200692 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-839d9881-43e5-44e7-b1c8-6bf363fd6a81 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:30.201137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-839d9881-43e5-44e7-b1c8-6bf363fd6a81 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:30.334734 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-839d9881-43e5-44e7-b1c8-6bf363fd6a81 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:30.342398 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-839d9881-43e5-44e7-b1c8-6bf363fd6a81 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1569 microversion: 2.1 time: 0.155435 May 28 06:07:30.342981 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4091/8068] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:30 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 06:07:31.359179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d24d611c-bb60-41f7-93bc-a04eb4587ce4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:31.360081 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d24d611c-bb60-41f7-93bc-a04eb4587ce4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:31.367070 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d24d611c-bb60-41f7-93bc-a04eb4587ce4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:31.367546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d24d611c-bb60-41f7-93bc-a04eb4587ce4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:31.368417 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d24d611c-bb60-41f7-93bc-a04eb4587ce4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:31.368871 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d24d611c-bb60-41f7-93bc-a04eb4587ce4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:31.502572 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d24d611c-bb60-41f7-93bc-a04eb4587ce4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:31.510165 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d24d611c-bb60-41f7-93bc-a04eb4587ce4 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1569 microversion: 2.1 time: 0.155031 May 28 06:07:31.512513 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3978/8069] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:31 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:32.527880 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ba8eeca9-6b2b-437c-958d-28bd8bf7af82 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:32.528412 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ba8eeca9-6b2b-437c-958d-28bd8bf7af82 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:32.536218 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba8eeca9-6b2b-437c-958d-28bd8bf7af82 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:32.536679 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba8eeca9-6b2b-437c-958d-28bd8bf7af82 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:32.537454 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba8eeca9-6b2b-437c-958d-28bd8bf7af82 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:32.537900 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ba8eeca9-6b2b-437c-958d-28bd8bf7af82 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:32.668606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ba8eeca9-6b2b-437c-958d-28bd8bf7af82 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:32.676374 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ba8eeca9-6b2b-437c-958d-28bd8bf7af82 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1569 microversion: 2.1 time: 0.152622 May 28 06:07:32.677030 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4092/8070] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:32 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:33.693701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-2a5aa460-d032-4230-bec3-dd86ff374096 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:33.694238 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-2a5aa460-d032-4230-bec3-dd86ff374096 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:33.701449 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a5aa460-d032-4230-bec3-dd86ff374096 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:33.701920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a5aa460-d032-4230-bec3-dd86ff374096 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:33.702713 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a5aa460-d032-4230-bec3-dd86ff374096 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:33.703217 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-2a5aa460-d032-4230-bec3-dd86ff374096 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:33.835144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-2a5aa460-d032-4230-bec3-dd86ff374096 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:33.842877 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-2a5aa460-d032-4230-bec3-dd86ff374096 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1569 microversion: 2.1 time: 0.153317 May 28 06:07:33.844111 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3979/8071] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:33 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:34.861632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-65db2482-d784-40dc-97d1-b3019176ab4f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:34.862249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-65db2482-d784-40dc-97d1-b3019176ab4f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:34.869274 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-65db2482-d784-40dc-97d1-b3019176ab4f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:34.869731 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-65db2482-d784-40dc-97d1-b3019176ab4f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:34.870496 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-65db2482-d784-40dc-97d1-b3019176ab4f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:34.870939 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-65db2482-d784-40dc-97d1-b3019176ab4f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:35.001722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-65db2482-d784-40dc-97d1-b3019176ab4f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:35.009324 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-65db2482-d784-40dc-97d1-b3019176ab4f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1569 microversion: 2.1 time: 0.152441 May 28 06:07:35.009906 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4093/8072] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:34 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:36.025920 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-76936314-2955-471a-bf5f-891b20613c5f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:36.026565 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-76936314-2955-471a-bf5f-891b20613c5f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:36.033761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76936314-2955-471a-bf5f-891b20613c5f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:36.034235 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76936314-2955-471a-bf5f-891b20613c5f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:36.035061 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76936314-2955-471a-bf5f-891b20613c5f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:36.035522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-76936314-2955-471a-bf5f-891b20613c5f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:36.169794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-76936314-2955-471a-bf5f-891b20613c5f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:36.178070 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-76936314-2955-471a-bf5f-891b20613c5f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1569 microversion: 2.1 time: 0.156227 May 28 06:07:36.178655 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3980/8073] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:36 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:37.196189 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b56db362-bd4b-4def-8861-24671409ad9f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:37.196814 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b56db362-bd4b-4def-8861-24671409ad9f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:37.203923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b56db362-bd4b-4def-8861-24671409ad9f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:37.204383 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b56db362-bd4b-4def-8861-24671409ad9f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:37.205151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b56db362-bd4b-4def-8861-24671409ad9f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:37.205594 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b56db362-bd4b-4def-8861-24671409ad9f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:37.334309 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b56db362-bd4b-4def-8861-24671409ad9f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:37.341973 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b56db362-bd4b-4def-8861-24671409ad9f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1569 microversion: 2.1 time: 0.149872 May 28 06:07:37.342559 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4094/8074] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:37 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:38.360732 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-af7ad1e8-ed29-431b-963f-c94ccdb014f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:38.361371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-af7ad1e8-ed29-431b-963f-c94ccdb014f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:38.368510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af7ad1e8-ed29-431b-963f-c94ccdb014f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:38.368984 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af7ad1e8-ed29-431b-963f-c94ccdb014f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:38.369772 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af7ad1e8-ed29-431b-963f-c94ccdb014f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:38.370234 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-af7ad1e8-ed29-431b-963f-c94ccdb014f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:38.502642 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-af7ad1e8-ed29-431b-963f-c94ccdb014f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:38.510469 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-af7ad1e8-ed29-431b-963f-c94ccdb014f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1569 microversion: 2.1 time: 0.154458 May 28 06:07:38.511089 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3981/8075] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:38 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:39.528151 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-48ee5754-44e1-442f-b6a4-0d7b6d0c45f9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:39.528783 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-48ee5754-44e1-442f-b6a4-0d7b6d0c45f9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:39.536722 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48ee5754-44e1-442f-b6a4-0d7b6d0c45f9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:39.537179 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48ee5754-44e1-442f-b6a4-0d7b6d0c45f9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:39.537983 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48ee5754-44e1-442f-b6a4-0d7b6d0c45f9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:39.538410 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-48ee5754-44e1-442f-b6a4-0d7b6d0c45f9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:39.675713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-48ee5754-44e1-442f-b6a4-0d7b6d0c45f9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:39.683581 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-48ee5754-44e1-442f-b6a4-0d7b6d0c45f9 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1569 microversion: 2.1 time: 0.159524 May 28 06:07:39.684164 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4095/8076] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:39 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:40.700889 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a8dd13ff-d8d1-4fc2-a250-4a1669a487f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:40.701522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a8dd13ff-d8d1-4fc2-a250-4a1669a487f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:40.709047 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a8dd13ff-d8d1-4fc2-a250-4a1669a487f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:40.709519 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a8dd13ff-d8d1-4fc2-a250-4a1669a487f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:40.710302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a8dd13ff-d8d1-4fc2-a250-4a1669a487f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:40.710755 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a8dd13ff-d8d1-4fc2-a250-4a1669a487f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:40.842472 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a8dd13ff-d8d1-4fc2-a250-4a1669a487f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:40.850982 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a8dd13ff-d8d1-4fc2-a250-4a1669a487f5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1569 microversion: 2.1 time: 0.154100 May 28 06:07:40.851614 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3982/8077] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:40 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:41.868852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-f88293b4-7d55-4e80-992e-55ab831e6210 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:41.869477 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-f88293b4-7d55-4e80-992e-55ab831e6210 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:41.876557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f88293b4-7d55-4e80-992e-55ab831e6210 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:41.880152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f88293b4-7d55-4e80-992e-55ab831e6210 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:41.880152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f88293b4-7d55-4e80-992e-55ab831e6210 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:41.880152 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-f88293b4-7d55-4e80-992e-55ab831e6210 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:42.016586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-f88293b4-7d55-4e80-992e-55ab831e6210 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:42.024462 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-f88293b4-7d55-4e80-992e-55ab831e6210 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1570 microversion: 2.1 time: 0.159960 May 28 06:07:42.025059 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4096/8078] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:41 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:42.042388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8b399da2-2276-471d-a032-607a0467c403 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:07:42.043006 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8b399da2-2276-471d-a032-607a0467c403 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:42.050242 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b399da2-2276-471d-a032-607a0467c403 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:42.050721 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b399da2-2276-471d-a032-607a0467c403 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:42.051568 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b399da2-2276-471d-a032-607a0467c403 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:42.052028 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8b399da2-2276-471d-a032-607a0467c403 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:42.100223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-e5ab1990-58a2-48c2-84d8-663e30243152 req-27a7cd56-9899-4629-ad52-953a8c79cb32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "268c1239-8642-4541-98e3-96711396d880", "name": "network-vif-unplugged", "status": "completed", "tag": "2bec215f-c51d-4998-811f-f675463989f8"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:07:42.108292 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e5ab1990-58a2-48c2-84d8-663e30243152 req-27a7cd56-9899-4629-ad52-953a8c79cb32 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:42.108803 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-e5ab1990-58a2-48c2-84d8-663e30243152 req-27a7cd56-9899-4629-ad52-953a8c79cb32 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:42.120643 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-e5ab1990-58a2-48c2-84d8-663e30243152 req-27a7cd56-9899-4629-ad52-953a8c79cb32 service nova] Creating event network-vif-unplugged:2bec215f-c51d-4998-811f-f675463989f8 for instance 268c1239-8642-4541-98e3-96711396d880 on n-h2-843700-1 May 28 06:07:42.124406 n-d-843700-1 devstack@n-api.service[126044]: ERROR oslo.messaging._drivers.impl_rabbit [req-e5ab1990-58a2-48c2-84d8-663e30243152 req-27a7cd56-9899-4629-ad52-953a8c79cb32 service nova] [b4886c98-9a6e-4e0f-b132-3c1ae5f8f3df] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 06:07:42.336131 n-d-843700-1 devstack@n-api.service[126043]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8b399da2-2276-471d-a032-607a0467c403 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [358ed63c-2f6f-46d9-8c83-b40383b23acd] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 06:07:43.134465 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [req-e5ab1990-58a2-48c2-84d8-663e30243152 req-27a7cd56-9899-4629-ad52-953a8c79cb32 service nova] [b4886c98-9a6e-4e0f-b132-3c1ae5f8f3df] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 35116. May 28 06:07:43.138254 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-e5ab1990-58a2-48c2-84d8-663e30243152 req-27a7cd56-9899-4629-ad52-953a8c79cb32 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.042150 May 28 06:07:43.138886 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4097/8079] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 06:07:43.344391 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [None req-8b399da2-2276-471d-a032-607a0467c403 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [358ed63c-2f6f-46d9-8c83-b40383b23acd] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 35118. May 28 06:07:43.347854 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8b399da2-2276-471d-a032-607a0467c403 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "POST /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880/action" status: 202 len: 0 microversion: 2.1 time: 1.309577 May 28 06:07:43.348562 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3983/8080] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 06:07:42 2022] POST /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880/action => generated 0 bytes in 1311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 06:07:43.357345 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-03bf1883-5805-44a6-8609-711f6d687734 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:43.358511 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-03bf1883-5805-44a6-8609-711f6d687734 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:43.365654 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03bf1883-5805-44a6-8609-711f6d687734 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:43.366229 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03bf1883-5805-44a6-8609-711f6d687734 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:43.367010 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03bf1883-5805-44a6-8609-711f6d687734 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:43.367471 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-03bf1883-5805-44a6-8609-711f6d687734 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:43.501049 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-03bf1883-5805-44a6-8609-711f6d687734 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:43.508669 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-03bf1883-5805-44a6-8609-711f6d687734 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1518 microversion: 2.1 time: 0.155660 May 28 06:07:43.509305 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4098/8081] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:43 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:44.527862 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-916eae92-e810-4a78-a8cd-ab29ead97b4c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:44.528398 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-916eae92-e810-4a78-a8cd-ab29ead97b4c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:44.535397 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-916eae92-e810-4a78-a8cd-ab29ead97b4c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:44.535868 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-916eae92-e810-4a78-a8cd-ab29ead97b4c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:44.536647 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-916eae92-e810-4a78-a8cd-ab29ead97b4c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:44.537100 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-916eae92-e810-4a78-a8cd-ab29ead97b4c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:44.673340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-916eae92-e810-4a78-a8cd-ab29ead97b4c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:44.683767 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-916eae92-e810-4a78-a8cd-ab29ead97b4c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1518 microversion: 2.1 time: 0.158446 May 28 06:07:44.683767 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3984/8082] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:44 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:45.697758 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-adbb697b-b066-45e9-b3ce-98f619d5fb83 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:45.698329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-adbb697b-b066-45e9-b3ce-98f619d5fb83 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:45.705975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-adbb697b-b066-45e9-b3ce-98f619d5fb83 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:45.706438 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-adbb697b-b066-45e9-b3ce-98f619d5fb83 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:45.707239 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-adbb697b-b066-45e9-b3ce-98f619d5fb83 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:45.707689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-adbb697b-b066-45e9-b3ce-98f619d5fb83 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:45.854317 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-adbb697b-b066-45e9-b3ce-98f619d5fb83 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:45.862879 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-adbb697b-b066-45e9-b3ce-98f619d5fb83 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1518 microversion: 2.1 time: 0.169241 May 28 06:07:45.863508 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4099/8083] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:45 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:46.880753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5c4102c9-0bdf-40f3-ae36-003634947a22 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:46.881314 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5c4102c9-0bdf-40f3-ae36-003634947a22 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:46.888401 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c4102c9-0bdf-40f3-ae36-003634947a22 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:46.888902 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c4102c9-0bdf-40f3-ae36-003634947a22 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:46.890350 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c4102c9-0bdf-40f3-ae36-003634947a22 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:46.890830 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5c4102c9-0bdf-40f3-ae36-003634947a22 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:47.018559 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5c4102c9-0bdf-40f3-ae36-003634947a22 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:47.026154 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5c4102c9-0bdf-40f3-ae36-003634947a22 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1518 microversion: 2.1 time: 0.149448 May 28 06:07:47.026733 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3985/8084] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:46 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:48.044428 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-314404d5-862d-4115-a926-ba293d9a0f2b tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:48.045054 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-314404d5-862d-4115-a926-ba293d9a0f2b tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:48.052197 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-314404d5-862d-4115-a926-ba293d9a0f2b tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:48.052653 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-314404d5-862d-4115-a926-ba293d9a0f2b tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:48.053420 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-314404d5-862d-4115-a926-ba293d9a0f2b tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:48.053867 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-314404d5-862d-4115-a926-ba293d9a0f2b tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:48.213490 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-314404d5-862d-4115-a926-ba293d9a0f2b tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:48.213490 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-314404d5-862d-4115-a926-ba293d9a0f2b tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1518 microversion: 2.1 time: 0.160284 May 28 06:07:48.213490 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4100/8085] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:48 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:49.217754 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c3cf9c2f-1178-4f95-87fb-8f277e54cbf3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:49.218509 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c3cf9c2f-1178-4f95-87fb-8f277e54cbf3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:49.226076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3cf9c2f-1178-4f95-87fb-8f277e54cbf3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:49.226580 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3cf9c2f-1178-4f95-87fb-8f277e54cbf3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:49.227366 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3cf9c2f-1178-4f95-87fb-8f277e54cbf3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:49.227826 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c3cf9c2f-1178-4f95-87fb-8f277e54cbf3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:49.382535 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c3cf9c2f-1178-4f95-87fb-8f277e54cbf3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:49.393172 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c3cf9c2f-1178-4f95-87fb-8f277e54cbf3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1520 microversion: 2.1 time: 0.179326 May 28 06:07:49.393775 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3986/8086] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:49 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:50.411636 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1e12474b-ad81-4a55-b5bb-8f1e732097e7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:50.412267 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1e12474b-ad81-4a55-b5bb-8f1e732097e7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:50.420601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e12474b-ad81-4a55-b5bb-8f1e732097e7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:50.421062 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e12474b-ad81-4a55-b5bb-8f1e732097e7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:50.421846 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e12474b-ad81-4a55-b5bb-8f1e732097e7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:50.422332 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1e12474b-ad81-4a55-b5bb-8f1e732097e7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:50.559591 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1e12474b-ad81-4a55-b5bb-8f1e732097e7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:50.567564 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1e12474b-ad81-4a55-b5bb-8f1e732097e7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1520 microversion: 2.1 time: 0.159861 May 28 06:07:50.568150 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4101/8087] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:50 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:51.584838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bb7e89f5-5925-45f7-9f22-4ae90e97f99a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:51.585481 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bb7e89f5-5925-45f7-9f22-4ae90e97f99a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:51.592533 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb7e89f5-5925-45f7-9f22-4ae90e97f99a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:51.592999 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb7e89f5-5925-45f7-9f22-4ae90e97f99a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:51.593771 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb7e89f5-5925-45f7-9f22-4ae90e97f99a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:51.594716 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bb7e89f5-5925-45f7-9f22-4ae90e97f99a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:51.725850 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bb7e89f5-5925-45f7-9f22-4ae90e97f99a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:51.733691 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bb7e89f5-5925-45f7-9f22-4ae90e97f99a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1520 microversion: 2.1 time: 0.152812 May 28 06:07:51.734525 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3987/8088] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:51 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:52.751313 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ae93b6f3-a5e4-4453-a774-16fd8ece1584 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:52.751936 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ae93b6f3-a5e4-4453-a774-16fd8ece1584 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:52.758904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae93b6f3-a5e4-4453-a774-16fd8ece1584 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:52.759390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae93b6f3-a5e4-4453-a774-16fd8ece1584 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:52.760165 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae93b6f3-a5e4-4453-a774-16fd8ece1584 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:52.760608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ae93b6f3-a5e4-4453-a774-16fd8ece1584 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:52.894161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ae93b6f3-a5e4-4453-a774-16fd8ece1584 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:52.901943 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ae93b6f3-a5e4-4453-a774-16fd8ece1584 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1520 microversion: 2.1 time: 0.154674 May 28 06:07:52.902806 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4102/8089] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:52 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:53.919074 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-47c725aa-7cba-44db-88fb-a3818936be5f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:53.919856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-47c725aa-7cba-44db-88fb-a3818936be5f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:53.927666 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47c725aa-7cba-44db-88fb-a3818936be5f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:53.928133 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47c725aa-7cba-44db-88fb-a3818936be5f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:53.928940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47c725aa-7cba-44db-88fb-a3818936be5f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:53.929404 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-47c725aa-7cba-44db-88fb-a3818936be5f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:53.951724 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:07:54.013661 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:07:54.014221 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 06:07:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:07:54.068821 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-47c725aa-7cba-44db-88fb-a3818936be5f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:54.076656 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-47c725aa-7cba-44db-88fb-a3818936be5f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1520 microversion: 2.1 time: 0.161655 May 28 06:07:54.077240 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3988/8090] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:53 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:55.094373 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-eec28363-ca5e-4563-ae02-b1cfe20677b0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:55.095028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-eec28363-ca5e-4563-ae02-b1cfe20677b0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:55.103998 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eec28363-ca5e-4563-ae02-b1cfe20677b0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:55.104460 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eec28363-ca5e-4563-ae02-b1cfe20677b0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:55.105236 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eec28363-ca5e-4563-ae02-b1cfe20677b0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:55.105685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-eec28363-ca5e-4563-ae02-b1cfe20677b0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:55.243137 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-eec28363-ca5e-4563-ae02-b1cfe20677b0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:55.250954 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-eec28363-ca5e-4563-ae02-b1cfe20677b0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1520 microversion: 2.1 time: 0.161031 May 28 06:07:55.251546 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4103/8091] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:55 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:56.268761 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d74fa4c5-90a2-4b7c-aedb-2941636f528c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:56.269393 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d74fa4c5-90a2-4b7c-aedb-2941636f528c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:56.272276 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=31 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:07:56.277071 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d74fa4c5-90a2-4b7c-aedb-2941636f528c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:56.277538 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d74fa4c5-90a2-4b7c-aedb-2941636f528c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:56.278324 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d74fa4c5-90a2-4b7c-aedb-2941636f528c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:56.278780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d74fa4c5-90a2-4b7c-aedb-2941636f528c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:56.413546 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d74fa4c5-90a2-4b7c-aedb-2941636f528c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:56.421217 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d74fa4c5-90a2-4b7c-aedb-2941636f528c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1520 microversion: 2.1 time: 0.156964 May 28 06:07:56.421794 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3989/8092] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:56 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:57.438203 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-743ad94e-eac8-4670-b9f7-6b8b5dd3080a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:57.438819 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-743ad94e-eac8-4670-b9f7-6b8b5dd3080a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:57.441530 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=31 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:07:57.446338 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-743ad94e-eac8-4670-b9f7-6b8b5dd3080a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:57.446792 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-743ad94e-eac8-4670-b9f7-6b8b5dd3080a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:57.447645 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-743ad94e-eac8-4670-b9f7-6b8b5dd3080a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:57.448028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-743ad94e-eac8-4670-b9f7-6b8b5dd3080a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:57.450622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=87 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:07:57.581432 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-743ad94e-eac8-4670-b9f7-6b8b5dd3080a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:57.589034 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-743ad94e-eac8-4670-b9f7-6b8b5dd3080a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1520 microversion: 2.1 time: 0.154846 May 28 06:07:57.589616 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4104/8093] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:57 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:58.606933 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d5615351-fef6-4b60-a266-c36d91f38ea7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:58.607582 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d5615351-fef6-4b60-a266-c36d91f38ea7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:58.614227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5615351-fef6-4b60-a266-c36d91f38ea7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:58.614687 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5615351-fef6-4b60-a266-c36d91f38ea7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:58.615487 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5615351-fef6-4b60-a266-c36d91f38ea7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:58.615940 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d5615351-fef6-4b60-a266-c36d91f38ea7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:58.745719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-d5615351-fef6-4b60-a266-c36d91f38ea7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:58.753245 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d5615351-fef6-4b60-a266-c36d91f38ea7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1520 microversion: 2.1 time: 0.150731 May 28 06:07:58.756485 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3990/8094] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:58 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:07:59.771322 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b8812136-cd20-4f06-a6bc-d3dcad3f2fa2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:07:59.771961 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b8812136-cd20-4f06-a6bc-d3dcad3f2fa2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:07:59.778225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8812136-cd20-4f06-a6bc-d3dcad3f2fa2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:59.778672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8812136-cd20-4f06-a6bc-d3dcad3f2fa2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:59.779456 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8812136-cd20-4f06-a6bc-d3dcad3f2fa2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:07:59.779890 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b8812136-cd20-4f06-a6bc-d3dcad3f2fa2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:07:59.914627 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b8812136-cd20-4f06-a6bc-d3dcad3f2fa2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:07:59.922778 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b8812136-cd20-4f06-a6bc-d3dcad3f2fa2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1576 microversion: 2.1 time: 0.155093 May 28 06:07:59.923591 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4105/8095] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:07:59 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:08:00.940406 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5ff36d20-a7ef-4b47-bb78-169f414feb54 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:08:00.941104 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5ff36d20-a7ef-4b47-bb78-169f414feb54 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:08:00.947782 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ff36d20-a7ef-4b47-bb78-169f414feb54 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:00.948259 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ff36d20-a7ef-4b47-bb78-169f414feb54 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:00.949052 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ff36d20-a7ef-4b47-bb78-169f414feb54 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:00.949514 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5ff36d20-a7ef-4b47-bb78-169f414feb54 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:01.081095 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5ff36d20-a7ef-4b47-bb78-169f414feb54 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:08:01.088902 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5ff36d20-a7ef-4b47-bb78-169f414feb54 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1576 microversion: 2.1 time: 0.153097 May 28 06:08:01.089861 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3991/8096] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:08:00 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:08:02.106741 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-7414d512-7a1b-4bc9-bdc8-748f97ac3d1f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:08:02.107385 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-7414d512-7a1b-4bc9-bdc8-748f97ac3d1f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:08:02.114662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7414d512-7a1b-4bc9-bdc8-748f97ac3d1f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:02.115164 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7414d512-7a1b-4bc9-bdc8-748f97ac3d1f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:02.115942 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7414d512-7a1b-4bc9-bdc8-748f97ac3d1f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:02.116390 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-7414d512-7a1b-4bc9-bdc8-748f97ac3d1f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:02.250227 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-7414d512-7a1b-4bc9-bdc8-748f97ac3d1f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:08:02.258551 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-7414d512-7a1b-4bc9-bdc8-748f97ac3d1f tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1576 microversion: 2.1 time: 0.155739 May 28 06:08:02.259188 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4106/8097] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:08:02 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:08:03.276335 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0e6f887b-d06c-47ed-85c5-393239d13978 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:08:03.276965 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0e6f887b-d06c-47ed-85c5-393239d13978 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:08:03.284599 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e6f887b-d06c-47ed-85c5-393239d13978 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:03.285068 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e6f887b-d06c-47ed-85c5-393239d13978 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:03.285848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e6f887b-d06c-47ed-85c5-393239d13978 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:03.286307 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0e6f887b-d06c-47ed-85c5-393239d13978 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:03.414856 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0e6f887b-d06c-47ed-85c5-393239d13978 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:08:03.423315 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0e6f887b-d06c-47ed-85c5-393239d13978 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1576 microversion: 2.1 time: 0.150156 May 28 06:08:03.423315 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3992/8098] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:08:03 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:08:04.439772 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-d080338a-2e94-451f-b8d4-40cb2d14eaa5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:08:04.440344 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-d080338a-2e94-451f-b8d4-40cb2d14eaa5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:08:04.447268 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d080338a-2e94-451f-b8d4-40cb2d14eaa5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:04.447721 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d080338a-2e94-451f-b8d4-40cb2d14eaa5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:04.448480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d080338a-2e94-451f-b8d4-40cb2d14eaa5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:04.448914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-d080338a-2e94-451f-b8d4-40cb2d14eaa5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:04.581580 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-d080338a-2e94-451f-b8d4-40cb2d14eaa5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:08:04.589300 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-d080338a-2e94-451f-b8d4-40cb2d14eaa5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1576 microversion: 2.1 time: 0.153542 May 28 06:08:04.589883 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4107/8099] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:08:04 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:08:05.607044 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-7c443fa0-8fed-42d2-9b73-f7c01b253885 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:08:05.607667 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-7c443fa0-8fed-42d2-9b73-f7c01b253885 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:08:05.615473 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c443fa0-8fed-42d2-9b73-f7c01b253885 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:05.615938 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c443fa0-8fed-42d2-9b73-f7c01b253885 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:05.616711 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c443fa0-8fed-42d2-9b73-f7c01b253885 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:05.617161 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-7c443fa0-8fed-42d2-9b73-f7c01b253885 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:05.746098 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-7c443fa0-8fed-42d2-9b73-f7c01b253885 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:08:05.753802 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-7c443fa0-8fed-42d2-9b73-f7c01b253885 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1576 microversion: 2.1 time: 0.150701 May 28 06:08:05.754377 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3993/8100] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:08:05 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:08:06.770895 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-b4da8aef-32f2-49b9-a4f3-2a67ae51e5d0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:08:06.771557 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-b4da8aef-32f2-49b9-a4f3-2a67ae51e5d0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:08:06.778586 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4da8aef-32f2-49b9-a4f3-2a67ae51e5d0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:06.779084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4da8aef-32f2-49b9-a4f3-2a67ae51e5d0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:06.779857 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4da8aef-32f2-49b9-a4f3-2a67ae51e5d0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:06.780331 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-b4da8aef-32f2-49b9-a4f3-2a67ae51e5d0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:06.906624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-b4da8aef-32f2-49b9-a4f3-2a67ae51e5d0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:08:06.914307 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-b4da8aef-32f2-49b9-a4f3-2a67ae51e5d0 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1576 microversion: 2.1 time: 0.147339 May 28 06:08:06.914886 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4108/8101] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:08:06 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:08:07.932055 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-e52232ef-c179-414a-ad59-146ef72cf60a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:08:07.932701 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-e52232ef-c179-414a-ad59-146ef72cf60a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:08:07.939792 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e52232ef-c179-414a-ad59-146ef72cf60a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:07.940267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e52232ef-c179-414a-ad59-146ef72cf60a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:07.941057 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e52232ef-c179-414a-ad59-146ef72cf60a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:07.941517 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-e52232ef-c179-414a-ad59-146ef72cf60a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:08.411091 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-e52232ef-c179-414a-ad59-146ef72cf60a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:08:08.418801 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-e52232ef-c179-414a-ad59-146ef72cf60a tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1576 microversion: 2.1 time: 0.490687 May 28 06:08:08.419412 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3994/8102] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:08:07 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1576 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:08:09.435602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-abf7861f-a6aa-4bcf-961c-3c765c97f430 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:08:09.436221 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-abf7861f-a6aa-4bcf-961c-3c765c97f430 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:08:09.443702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abf7861f-a6aa-4bcf-961c-3c765c97f430 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:09.444155 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abf7861f-a6aa-4bcf-961c-3c765c97f430 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:09.444912 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abf7861f-a6aa-4bcf-961c-3c765c97f430 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:09.445349 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-abf7861f-a6aa-4bcf-961c-3c765c97f430 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:09.576682 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-abf7861f-a6aa-4bcf-961c-3c765c97f430 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:08:09.585021 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-abf7861f-a6aa-4bcf-961c-3c765c97f430 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1576 microversion: 2.1 time: 0.153378 May 28 06:08:09.585601 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4109/8103] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:08:09 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:08:10.305485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-4cc7daae-3d94-4450-8dc3-08bb33b48859 req-5765e68b-a6b9-4063-9a55-0ea42cd047c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "268c1239-8642-4541-98e3-96711396d880", "name": "network-vif-plugged", "status": "completed", "tag": "2bec215f-c51d-4998-811f-f675463989f8"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:08:10.314753 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4cc7daae-3d94-4450-8dc3-08bb33b48859 req-5765e68b-a6b9-4063-9a55-0ea42cd047c7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:10.315255 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4cc7daae-3d94-4450-8dc3-08bb33b48859 req-5765e68b-a6b9-4063-9a55-0ea42cd047c7 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:10.328823 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-4cc7daae-3d94-4450-8dc3-08bb33b48859 req-5765e68b-a6b9-4063-9a55-0ea42cd047c7 service nova] Creating event network-vif-plugged:2bec215f-c51d-4998-811f-f675463989f8 for instance 268c1239-8642-4541-98e3-96711396d880 on n-h2-843700-1 May 28 06:08:10.334166 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-4cc7daae-3d94-4450-8dc3-08bb33b48859 req-5765e68b-a6b9-4063-9a55-0ea42cd047c7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032476 May 28 06:08:10.334839 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3995/8104] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:08:10.601909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ce2124c9-9102-46bf-abbf-c2c3ad6d1ae5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:08:10.602537 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ce2124c9-9102-46bf-abbf-c2c3ad6d1ae5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:08:10.609909 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce2124c9-9102-46bf-abbf-c2c3ad6d1ae5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:10.610376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce2124c9-9102-46bf-abbf-c2c3ad6d1ae5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:10.611185 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce2124c9-9102-46bf-abbf-c2c3ad6d1ae5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:10.611639 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ce2124c9-9102-46bf-abbf-c2c3ad6d1ae5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:10.740980 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ce2124c9-9102-46bf-abbf-c2c3ad6d1ae5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:08:10.748658 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ce2124c9-9102-46bf-abbf-c2c3ad6d1ae5 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1576 microversion: 2.1 time: 0.150701 May 28 06:08:10.749245 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4110/8105] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:08:10 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:08:11.766736 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-a70b1401-4ff7-48e3-abe0-e99c43103aca tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:08:11.767431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-a70b1401-4ff7-48e3-abe0-e99c43103aca tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:08:11.773866 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a70b1401-4ff7-48e3-abe0-e99c43103aca tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:11.776119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a70b1401-4ff7-48e3-abe0-e99c43103aca tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:11.776119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a70b1401-4ff7-48e3-abe0-e99c43103aca tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:08:11.776119 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-a70b1401-4ff7-48e3-abe0-e99c43103aca tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:08:11.905979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-a70b1401-4ff7-48e3-abe0-e99c43103aca tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:08:11.914463 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-a70b1401-4ff7-48e3-abe0-e99c43103aca tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1563 microversion: 2.1 time: 0.152929 May 28 06:08:11.915316 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3996/8106] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:08:11 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:09:29.659994 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:09:29.660658 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 06:09:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:09:32.669103 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:09:32.669581 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 06:09:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:09:48.858610 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=15 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:09:48.863439 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-230e0277-215a-4ab0-bcdc-7a661fb4b2e3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:09:48.864593 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=46 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:09:48.869372 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-4a7db95a-9464-49c7-8849-ab04e3f252d4 req-89e8abd6-4fb6-46f1-b163-e9ce5013251d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "268c1239-8642-4541-98e3-96711396d880", "tag": "2bec215f-c51d-4998-811f-f675463989f8"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:09:48.875702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-230e0277-215a-4ab0-bcdc-7a661fb4b2e3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:09:48.875702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=13 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:09:48.875702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=41 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:09:48.883287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-230e0277-215a-4ab0-bcdc-7a661fb4b2e3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:48.887270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4a7db95a-9464-49c7-8849-ab04e3f252d4 req-89e8abd6-4fb6-46f1-b163-e9ce5013251d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:48.887744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-4a7db95a-9464-49c7-8849-ab04e3f252d4 req-89e8abd6-4fb6-46f1-b163-e9ce5013251d service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:48.890759 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-230e0277-215a-4ab0-bcdc-7a661fb4b2e3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:48.891618 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-230e0277-215a-4ab0-bcdc-7a661fb4b2e3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:48.892084 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-230e0277-215a-4ab0-bcdc-7a661fb4b2e3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:48.906403 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-4a7db95a-9464-49c7-8849-ab04e3f252d4 req-89e8abd6-4fb6-46f1-b163-e9ce5013251d service nova] Creating event network-changed:2bec215f-c51d-4998-811f-f675463989f8 for instance 268c1239-8642-4541-98e3-96711396d880 on n-h2-843700-1 May 28 06:09:48.913707 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-4a7db95a-9464-49c7-8849-ab04e3f252d4 req-89e8abd6-4fb6-46f1-b163-e9ce5013251d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056973 May 28 06:09:48.915754 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3997/8107] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:09:48.920256 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-230e0277-215a-4ab0-bcdc-7a661fb4b2e3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 06:09:49.161339 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-230e0277-215a-4ab0-bcdc-7a661fb4b2e3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "DELETE /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 204 len: 0 microversion: 2.1 time: 0.307343 May 28 06:09:49.165301 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4111/8108] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 06:09:48 2022] DELETE /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 06:09:49.175983 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9e9fa766-ca72-428e-b1a1-5f68492fb1e7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:09:49.178270 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9e9fa766-ca72-428e-b1a1-5f68492fb1e7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:09:49.189784 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e9fa766-ca72-428e-b1a1-5f68492fb1e7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:49.196371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e9fa766-ca72-428e-b1a1-5f68492fb1e7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:49.196371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e9fa766-ca72-428e-b1a1-5f68492fb1e7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:49.196371 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9e9fa766-ca72-428e-b1a1-5f68492fb1e7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:49.541594 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9e9fa766-ca72-428e-b1a1-5f68492fb1e7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:09:49.550776 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9e9fa766-ca72-428e-b1a1-5f68492fb1e7 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1569 microversion: 2.1 time: 0.382257 May 28 06:09:49.551612 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3998/8109] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:09:49 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1569 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:09:50.568739 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-3724fcdd-75b7-4b6d-b0f2-645a449e6f1c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:09:50.569444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-3724fcdd-75b7-4b6d-b0f2-645a449e6f1c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:09:50.577092 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3724fcdd-75b7-4b6d-b0f2-645a449e6f1c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:50.577547 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3724fcdd-75b7-4b6d-b0f2-645a449e6f1c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:50.578333 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3724fcdd-75b7-4b6d-b0f2-645a449e6f1c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:50.578757 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-3724fcdd-75b7-4b6d-b0f2-645a449e6f1c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:50.759371 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-3724fcdd-75b7-4b6d-b0f2-645a449e6f1c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:09:50.767192 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-3724fcdd-75b7-4b6d-b0f2-645a449e6f1c tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1569 microversion: 2.1 time: 0.203210 May 28 06:09:50.767856 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4112/8110] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:09:50 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:09:51.200921 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-0588a9f3-aa3a-4179-8f93-a68b7553fbab req-249a930b-ac9b-49a1-9d3c-57007eaacbb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "268c1239-8642-4541-98e3-96711396d880", "name": "network-vif-deleted", "tag": "2bec215f-c51d-4998-811f-f675463989f8"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:09:51.210712 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0588a9f3-aa3a-4179-8f93-a68b7553fbab req-249a930b-ac9b-49a1-9d3c-57007eaacbb6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:51.211199 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0588a9f3-aa3a-4179-8f93-a68b7553fbab req-249a930b-ac9b-49a1-9d3c-57007eaacbb6 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:51.222443 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-0588a9f3-aa3a-4179-8f93-a68b7553fbab req-249a930b-ac9b-49a1-9d3c-57007eaacbb6 service nova] Creating event network-vif-deleted:2bec215f-c51d-4998-811f-f675463989f8 for instance 268c1239-8642-4541-98e3-96711396d880 on n-h2-843700-1 May 28 06:09:51.227620 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-0588a9f3-aa3a-4179-8f93-a68b7553fbab req-249a930b-ac9b-49a1-9d3c-57007eaacbb6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030378 May 28 06:09:51.228215 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 3999/8111] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:09:51.785008 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-222bb450-ad45-4304-b8cc-402e5906ae79 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:09:51.785659 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-222bb450-ad45-4304-b8cc-402e5906ae79 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:09:51.793246 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-222bb450-ad45-4304-b8cc-402e5906ae79 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:51.793707 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-222bb450-ad45-4304-b8cc-402e5906ae79 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:51.794480 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-222bb450-ad45-4304-b8cc-402e5906ae79 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:51.794929 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-222bb450-ad45-4304-b8cc-402e5906ae79 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:51.856417 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-222bb450-ad45-4304-b8cc-402e5906ae79 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:09:51.864611 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-222bb450-ad45-4304-b8cc-402e5906ae79 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1219 microversion: 2.1 time: 0.083654 May 28 06:09:51.865238 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4113/8112] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:09:51 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:09:52.883625 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-152442ba-e049-4c25-b2c3-60be2e89ae5d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:09:52.884349 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-152442ba-e049-4c25-b2c3-60be2e89ae5d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:09:52.890730 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-152442ba-e049-4c25-b2c3-60be2e89ae5d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:52.891258 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-152442ba-e049-4c25-b2c3-60be2e89ae5d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:52.892049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-152442ba-e049-4c25-b2c3-60be2e89ae5d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:52.892508 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-152442ba-e049-4c25-b2c3-60be2e89ae5d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:52.960879 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-152442ba-e049-4c25-b2c3-60be2e89ae5d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:09:52.970149 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-152442ba-e049-4c25-b2c3-60be2e89ae5d tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1219 microversion: 2.1 time: 0.092058 May 28 06:09:52.970763 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4000/8113] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:09:52 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:09:53.987953 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-5b9bfcd9-7179-4638-a598-faa765dd2274 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:09:53.988697 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-5b9bfcd9-7179-4638-a598-faa765dd2274 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:09:53.996343 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b9bfcd9-7179-4638-a598-faa765dd2274 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:53.996800 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b9bfcd9-7179-4638-a598-faa765dd2274 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:53.997571 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b9bfcd9-7179-4638-a598-faa765dd2274 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:53.998014 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-5b9bfcd9-7179-4638-a598-faa765dd2274 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:54.063374 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-5b9bfcd9-7179-4638-a598-faa765dd2274 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:09:54.071601 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-5b9bfcd9-7179-4638-a598-faa765dd2274 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1219 microversion: 2.1 time: 0.087573 May 28 06:09:54.072180 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4114/8114] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:09:53 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:09:55.088565 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bffbb5c6-7f66-44b6-92f0-953d226c6bef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:09:55.089196 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bffbb5c6-7f66-44b6-92f0-953d226c6bef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:09:55.096272 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bffbb5c6-7f66-44b6-92f0-953d226c6bef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:55.096739 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bffbb5c6-7f66-44b6-92f0-953d226c6bef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:55.097527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bffbb5c6-7f66-44b6-92f0-953d226c6bef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:55.097985 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bffbb5c6-7f66-44b6-92f0-953d226c6bef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:55.164208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bffbb5c6-7f66-44b6-92f0-953d226c6bef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:09:55.171828 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bffbb5c6-7f66-44b6-92f0-953d226c6bef tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1219 microversion: 2.1 time: 0.087197 May 28 06:09:55.172391 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4001/8115] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:09:55 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:09:56.189698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6f01bf72-d453-4aa7-9d70-f022596e63cc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:09:56.190424 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6f01bf72-d453-4aa7-9d70-f022596e63cc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:09:56.197608 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f01bf72-d453-4aa7-9d70-f022596e63cc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:56.198071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f01bf72-d453-4aa7-9d70-f022596e63cc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:56.198848 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f01bf72-d453-4aa7-9d70-f022596e63cc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:56.199342 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6f01bf72-d453-4aa7-9d70-f022596e63cc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:56.260788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6f01bf72-d453-4aa7-9d70-f022596e63cc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:09:56.268593 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6f01bf72-d453-4aa7-9d70-f022596e63cc tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1219 microversion: 2.1 time: 0.082940 May 28 06:09:56.269181 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4115/8116] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:09:56 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:09:57.286183 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-79817de1-b036-4fe7-a449-15fed9e8c714 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:09:57.287062 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-79817de1-b036-4fe7-a449-15fed9e8c714 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:09:57.293345 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-79817de1-b036-4fe7-a449-15fed9e8c714 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:57.294232 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-79817de1-b036-4fe7-a449-15fed9e8c714 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:57.294641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-79817de1-b036-4fe7-a449-15fed9e8c714 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:57.295145 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-79817de1-b036-4fe7-a449-15fed9e8c714 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:57.360031 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-79817de1-b036-4fe7-a449-15fed9e8c714 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:09:57.367840 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-79817de1-b036-4fe7-a449-15fed9e8c714 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1219 microversion: 2.1 time: 0.086002 May 28 06:09:57.368475 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4002/8117] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:09:57 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:09:58.384914 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-262371f1-6c01-42af-a9ca-c28e74c6a0b2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:09:58.385568 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-262371f1-6c01-42af-a9ca-c28e74c6a0b2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:09:58.392230 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-262371f1-6c01-42af-a9ca-c28e74c6a0b2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:58.392681 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-262371f1-6c01-42af-a9ca-c28e74c6a0b2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:58.393446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-262371f1-6c01-42af-a9ca-c28e74c6a0b2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:58.393883 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-262371f1-6c01-42af-a9ca-c28e74c6a0b2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:58.454641 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-262371f1-6c01-42af-a9ca-c28e74c6a0b2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:09:58.462888 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-262371f1-6c01-42af-a9ca-c28e74c6a0b2 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1219 microversion: 2.1 time: 0.081885 May 28 06:09:58.463503 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4116/8118] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:09:58 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:09:59.480442 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-85083fd9-02c9-4120-bf95-6e8433d40b22 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:09:59.481088 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-85083fd9-02c9-4120-bf95-6e8433d40b22 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:09:59.488485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85083fd9-02c9-4120-bf95-6e8433d40b22 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:59.488963 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85083fd9-02c9-4120-bf95-6e8433d40b22 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:59.490430 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85083fd9-02c9-4120-bf95-6e8433d40b22 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:09:59.491014 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85083fd9-02c9-4120-bf95-6e8433d40b22 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:09:59.555748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-85083fd9-02c9-4120-bf95-6e8433d40b22 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:09:59.563551 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-85083fd9-02c9-4120-bf95-6e8433d40b22 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1219 microversion: 2.1 time: 0.087124 May 28 06:09:59.564133 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4003/8119] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:09:59 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:10:00.580675 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-fa984b0b-0eb3-4a81-ab4a-a46c49b6f364 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:10:00.581426 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-fa984b0b-0eb3-4a81-ab4a-a46c49b6f364 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:10:00.588685 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa984b0b-0eb3-4a81-ab4a-a46c49b6f364 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:00.589147 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa984b0b-0eb3-4a81-ab4a-a46c49b6f364 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:00.589928 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa984b0b-0eb3-4a81-ab4a-a46c49b6f364 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:00.590376 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa984b0b-0eb3-4a81-ab4a-a46c49b6f364 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:00.622550 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa984b0b-0eb3-4a81-ab4a-a46c49b6f364 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:00.623031 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-fa984b0b-0eb3-4a81-ab4a-a46c49b6f364 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:00.623493 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-fa984b0b-0eb3-4a81-ab4a-a46c49b6f364 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lazy-loading 'fault' on Instance uuid 268c1239-8642-4541-98e3-96711396d880 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 06:10:00.664804 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-fa984b0b-0eb3-4a81-ab4a-a46c49b6f364 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c0151985ca4aa9ae5d55f8925603fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c9fecdea3943429a65cdb106d0fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:10:00.672474 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-fa984b0b-0eb3-4a81-ab4a-a46c49b6f364 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 200 len: 1224 microversion: 2.1 time: 0.095824 May 28 06:10:00.673062 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4117/8120] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:10:00 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:10:01.691813 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d38b8846-b76f-4201-a4ba-667a0f828a79 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:10:01.692447 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-d38b8846-b76f-4201-a4ba-667a0f828a79 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] [instance: 268c1239-8642-4541-98e3-96711396d880] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:10:01.699497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d38b8846-b76f-4201-a4ba-667a0f828a79 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:01.699967 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d38b8846-b76f-4201-a4ba-667a0f828a79 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:01.700749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d38b8846-b76f-4201-a4ba-667a0f828a79 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:01.701202 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-d38b8846-b76f-4201-a4ba-667a0f828a79 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:01.714603 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-d38b8846-b76f-4201-a4ba-667a0f828a79 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] HTTP exception thrown: Instance 268c1239-8642-4541-98e3-96711396d880 could not be found. May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d38b8846-b76f-4201-a4ba-667a0f828a79 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Request method failure captured: May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 HTTP/1.1 May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbpH1nOhnKkVWPSuEdJzFx0s-8-40SevUDctyaXw1zRHMjBWKL_lVnt_XaFoYa8cSTC7d621nJCKer8AJqt3r3OXau0L3vpkrGD2wwCytCugKFk5Kf06U85FSlvKgcTHeFz_NxR9RJyqhgg8xsii9-0SBofxhgwa_ZCxzk56-aYiLg8 May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 07c9fecdea3943429a65cdb106d0fe8c May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestShelveInstance-1833083254 May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_07c9fecdea3943429a65cdb106d0fe8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/07c9fecdea3943429a65cdb106d0fe8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/07c9fecdea3943429a65cdb106d0fe8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/07c9fecdea3943429a65cdb106d0fe8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestShelveInstance-1833083254 May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 07c9fecdea3943429a65cdb106d0fe8c May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestShelveInstance-1833083254 May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestShelveInstance-1833083254-project May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: c0c0151985ca4aa9ae5d55f8925603fd May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestShelveInstance-1833083254-project May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 268c1239-8642-4541-98e3-96711396d880 could not be found. May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '268c1239-8642-4541-98e3-96711396d880'} May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 268c1239-8642-4541-98e3-96711396d880 could not be found. May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 268c1239-8642-4541-98e3-96711396d880 could not be found. May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 06:10:01.716336 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 06:10:01.720179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 06:10:01.720179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 06:10:01.720179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 06:10:01.720179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 06:10:01.720179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 06:10:01.720179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 268c1239-8642-4541-98e3-96711396d880 could not be found. May 28 06:10:01.720179 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 06:10:01.720179 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-d38b8846-b76f-4201-a4ba-667a0f828a79 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Returning 404 to user: Instance 268c1239-8642-4541-98e3-96711396d880 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 06:10:01.720179 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-d38b8846-b76f-4201-a4ba-667a0f828a79 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880" status: 404 len: 111 microversion: 2.1 time: 0.029893 May 28 06:10:01.720179 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4004/8121] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:10:01 2022] GET /compute/v2.1/servers/268c1239-8642-4541-98e3-96711396d880 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 06:10:01.937526 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-29a25e07-f8fa-454a-bb42-64491e2ccbf3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] Calling method '.version_select at 0x7f7700b9b160>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:10:02.059693 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-29a25e07-f8fa-454a-bb42-64491e2ccbf3 tempest-TestShelveInstance-1833083254 tempest-TestShelveInstance-1833083254-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1527017702" status: 202 len: 0 microversion: 2.1 time: 0.126279 May 28 06:10:02.060315 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4118/8122] 10.222.0.58 () {58 vars in 1253 bytes} [Sat May 28 06:10:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1527017702 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 06:10:23.548011 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=16 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:10:23.549347 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=36 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:10:23.734799 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-223030d5-cc90-4d2e-a5d3-8f59112da29f tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Action: 'create', calling method: .version_select at 0x7f77017dfdc0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-593310548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCD9+9FaWU3dJB3HXLXKTyCMV5rNm2xapdOHdSPZT6U4nCszU4cDhH2jGQzxUGnNkHlr1gpx4xw8StkRx2agoTQgpNBZPwpTxJrN/PPx3VU+YK24DVrhyHFMnv2il7lgPQ=="}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:10:23.752698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-223030d5-cc90-4d2e-a5d3-8f59112da29f tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Getting quotas for project 9114b2f82ff348689f0503bb3a36253a. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 06:10:23.759976 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-223030d5-cc90-4d2e-a5d3-8f59112da29f tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Getting quotas for user 54c93294fe5f4245bf785037b3e35a07 and project 9114b2f82ff348689f0503bb3a36253a. Resources: {'key_pairs'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 06:10:23.882622 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-223030d5-cc90-4d2e-a5d3-8f59112da29f tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.340223 May 28 06:10:23.883289 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4005/8123] 10.222.0.58 () {60 vars in 1158 bytes} [Sat May 28 06:10:23 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:10:26.041907 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:10:26.042850 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:10:26.047208 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-4beaffb0-7797-41f5-a495-6fa6d7e1a839 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2091763327", "imageRef": "012b12af-263c-4753-8fad-4a4022b439aa", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-593310548", "security_groups": [{"name": "tempest-secgroup-smoke-2045093653"}], "networks": [{"uuid": "fe1ac134-d1ce-4f26-9d91-f73fad7e76f8"}]}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:10:26.161838 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.network.neutron [None req-4beaffb0-7797-41f5-a495-6fa6d7e1a839 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] validate_networks() for [('fe1ac134-d1ce-4f26-9d91-f73fad7e76f8', None, None, None, None, None)] {{(pid=126044) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 06:10:26.671565 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4beaffb0-7797-41f5-a495-6fa6d7e1a839 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Flavor limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 06:10:26.671989 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4beaffb0-7797-41f5-a495-6fa6d7e1a839 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Image limits 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 06:10:26.672464 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4beaffb0-7797-41f5-a495-6fa6d7e1a839 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Flavor pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 06:10:26.672874 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4beaffb0-7797-41f5-a495-6fa6d7e1a839 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Image pref 0:0:0 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 06:10:26.673287 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.virt.hardware [None req-4beaffb0-7797-41f5-a495-6fa6d7e1a839 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 06:10:26.683386 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4beaffb0-7797-41f5-a495-6fa6d7e1a839 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:26.683840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4beaffb0-7797-41f5-a495-6fa6d7e1a839 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:26.684752 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4beaffb0-7797-41f5-a495-6fa6d7e1a839 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:26.685068 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-4beaffb0-7797-41f5-a495-6fa6d7e1a839 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:26.703101 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-4beaffb0-7797-41f5-a495-6fa6d7e1a839 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Getting quotas for project 9114b2f82ff348689f0503bb3a36253a. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 06:10:26.708736 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.quota [None req-4beaffb0-7797-41f5-a495-6fa6d7e1a839 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Getting quotas for user 54c93294fe5f4245bf785037b3e35a07 and project 9114b2f82ff348689f0503bb3a36253a. Resources: {'cores', 'ram', 'instances'} {{(pid=126044) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 06:10:26.721698 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4beaffb0-7797-41f5-a495-6fa6d7e1a839 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Going to run 1 instances... {{(pid=126044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 06:10:26.724538 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-4beaffb0-7797-41f5-a495-6fa6d7e1a839 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: f5690265-cb0f-4be1-b509-ebfb4e34fbf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='012b12af-263c-4753-8fad-4a4022b439aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 06:10:26.865884 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-4beaffb0-7797-41f5-a495-6fa6d7e1a839 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.826785 May 28 06:10:26.866498 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4119/8124] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 06:10:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 06:10:26.877748 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-26577359-ceaf-4540-9d19-44fe79fd2706 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:10:26.878427 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-26577359-ceaf-4540-9d19-44fe79fd2706 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: f5690265-cb0f-4be1-b509-ebfb4e34fbf1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:10:26.937495 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-26577359-ceaf-4540-9d19-44fe79fd2706 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:10:26.947852 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-26577359-ceaf-4540-9d19-44fe79fd2706 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1" status: 200 len: 1248 microversion: 2.1 time: 0.074671 May 28 06:10:26.948456 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4006/8125] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:10:26 2022] GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1 => generated 1248 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:10:27.966860 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8fbc0ebc-5436-4301-a35a-740303941700 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:10:27.967579 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8fbc0ebc-5436-4301-a35a-740303941700 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: f5690265-cb0f-4be1-b509-ebfb4e34fbf1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:10:28.022193 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8fbc0ebc-5436-4301-a35a-740303941700 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:10:28.029649 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8fbc0ebc-5436-4301-a35a-740303941700 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1" status: 200 len: 1248 microversion: 2.1 time: 0.067945 May 28 06:10:28.030223 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4120/8126] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:10:27 2022] GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1 => generated 1248 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:10:29.048370 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8cb26398-4326-4df0-9a22-dc64378b0877 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:10:29.049157 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8cb26398-4326-4df0-9a22-dc64378b0877 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: f5690265-cb0f-4be1-b509-ebfb4e34fbf1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:10:29.057082 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cb26398-4326-4df0-9a22-dc64378b0877 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:29.057563 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cb26398-4326-4df0-9a22-dc64378b0877 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:29.058361 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cb26398-4326-4df0-9a22-dc64378b0877 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:29.058852 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8cb26398-4326-4df0-9a22-dc64378b0877 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:29.133334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8cb26398-4326-4df0-9a22-dc64378b0877 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:10:29.141173 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8cb26398-4326-4df0-9a22-dc64378b0877 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1" status: 200 len: 1308 microversion: 2.1 time: 0.097738 May 28 06:10:29.141955 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4007/8127] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:10:29 2022] GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:10:30.159307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c779f7bf-eabd-4ce8-ab0f-ed410e6e76e2 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:10:30.159823 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c779f7bf-eabd-4ce8-ab0f-ed410e6e76e2 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: f5690265-cb0f-4be1-b509-ebfb4e34fbf1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:10:30.166748 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c779f7bf-eabd-4ce8-ab0f-ed410e6e76e2 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:30.167237 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c779f7bf-eabd-4ce8-ab0f-ed410e6e76e2 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:30.168005 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c779f7bf-eabd-4ce8-ab0f-ed410e6e76e2 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:30.168444 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c779f7bf-eabd-4ce8-ab0f-ed410e6e76e2 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:30.299406 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c779f7bf-eabd-4ce8-ab0f-ed410e6e76e2 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:10:30.307064 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c779f7bf-eabd-4ce8-ab0f-ed410e6e76e2 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1" status: 200 len: 1374 microversion: 2.1 time: 0.151785 May 28 06:10:30.307654 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4121/8128] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:10:30 2022] GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1 => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:10:31.027084 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-048ff425-9c29-4d45-b7dd-a3468d996a4d req-72337e65-7443-4432-bd42-a6983ba62cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5690265-cb0f-4be1-b509-ebfb4e34fbf1", "tag": "8bfc2b31-8b72-4e2e-b0d2-e7d33d407a13"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:10:31.037205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-048ff425-9c29-4d45-b7dd-a3468d996a4d req-72337e65-7443-4432-bd42-a6983ba62cc2 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:31.037205 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-048ff425-9c29-4d45-b7dd-a3468d996a4d req-72337e65-7443-4432-bd42-a6983ba62cc2 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:31.048745 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-048ff425-9c29-4d45-b7dd-a3468d996a4d req-72337e65-7443-4432-bd42-a6983ba62cc2 service nova] Creating event network-changed:8bfc2b31-8b72-4e2e-b0d2-e7d33d407a13 for instance f5690265-cb0f-4be1-b509-ebfb4e34fbf1 on n-h2-843700-1 May 28 06:10:31.054318 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-048ff425-9c29-4d45-b7dd-a3468d996a4d req-72337e65-7443-4432-bd42-a6983ba62cc2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094439 May 28 06:10:31.055132 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4008/8129] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:10:31.324971 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-008d9da2-12f7-4d8b-805c-f5cad0f61b4c tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:10:31.326223 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-008d9da2-12f7-4d8b-805c-f5cad0f61b4c tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: f5690265-cb0f-4be1-b509-ebfb4e34fbf1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:10:31.333695 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-008d9da2-12f7-4d8b-805c-f5cad0f61b4c tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:31.334261 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-008d9da2-12f7-4d8b-805c-f5cad0f61b4c tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:31.335077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-008d9da2-12f7-4d8b-805c-f5cad0f61b4c tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:31.336204 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-008d9da2-12f7-4d8b-805c-f5cad0f61b4c tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:31.472175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-008d9da2-12f7-4d8b-805c-f5cad0f61b4c tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:10:31.481343 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-008d9da2-12f7-4d8b-805c-f5cad0f61b4c tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1" status: 200 len: 1374 microversion: 2.1 time: 0.159995 May 28 06:10:31.482021 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4122/8130] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:10:31 2022] GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:10:32.500189 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-85a1df92-6ad9-44e7-9cdb-07546f37164a tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:10:32.500923 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-85a1df92-6ad9-44e7-9cdb-07546f37164a tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: f5690265-cb0f-4be1-b509-ebfb4e34fbf1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:10:32.507374 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85a1df92-6ad9-44e7-9cdb-07546f37164a tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:32.507851 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85a1df92-6ad9-44e7-9cdb-07546f37164a tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:32.508641 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85a1df92-6ad9-44e7-9cdb-07546f37164a tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:32.509109 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-85a1df92-6ad9-44e7-9cdb-07546f37164a tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:32.645944 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-85a1df92-6ad9-44e7-9cdb-07546f37164a tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:10:32.653914 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-85a1df92-6ad9-44e7-9cdb-07546f37164a tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1" status: 200 len: 1374 microversion: 2.1 time: 0.158906 May 28 06:10:32.654493 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4009/8131] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:10:32 2022] GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:10:33.671862 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-29bb2fef-b8fd-4830-aaca-92e7c8623c60 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:10:33.672489 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-29bb2fef-b8fd-4830-aaca-92e7c8623c60 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: f5690265-cb0f-4be1-b509-ebfb4e34fbf1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:10:33.679601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-29bb2fef-b8fd-4830-aaca-92e7c8623c60 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:33.680065 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-29bb2fef-b8fd-4830-aaca-92e7c8623c60 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:33.680839 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-29bb2fef-b8fd-4830-aaca-92e7c8623c60 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:33.681289 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-29bb2fef-b8fd-4830-aaca-92e7c8623c60 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:33.812366 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-29bb2fef-b8fd-4830-aaca-92e7c8623c60 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:10:33.820437 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-29bb2fef-b8fd-4830-aaca-92e7c8623c60 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1" status: 200 len: 1374 microversion: 2.1 time: 0.152507 May 28 06:10:33.821012 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4123/8132] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:10:33 2022] GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:10:34.837657 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5e07caf7-3b91-413a-9e7c-5ed2795f69a7 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:10:34.838298 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5e07caf7-3b91-413a-9e7c-5ed2795f69a7 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: f5690265-cb0f-4be1-b509-ebfb4e34fbf1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:10:34.845460 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e07caf7-3b91-413a-9e7c-5ed2795f69a7 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:34.845934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e07caf7-3b91-413a-9e7c-5ed2795f69a7 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:34.846726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e07caf7-3b91-413a-9e7c-5ed2795f69a7 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:34.847216 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5e07caf7-3b91-413a-9e7c-5ed2795f69a7 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:34.985043 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5e07caf7-3b91-413a-9e7c-5ed2795f69a7 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:10:34.993729 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5e07caf7-3b91-413a-9e7c-5ed2795f69a7 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1" status: 200 len: 1374 microversion: 2.1 time: 0.160046 May 28 06:10:34.998527 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4010/8133] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:10:34 2022] GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:10:35.153601 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-080f62cb-71de-4645-b881-0d2167c238b0 req-7725ebf5-97e2-472f-9156-27429318344a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5690265-cb0f-4be1-b509-ebfb4e34fbf1", "name": "network-vif-plugged", "status": "completed", "tag": "8bfc2b31-8b72-4e2e-b0d2-e7d33d407a13"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:10:35.162034 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-080f62cb-71de-4645-b881-0d2167c238b0 req-7725ebf5-97e2-472f-9156-27429318344a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:35.162491 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-080f62cb-71de-4645-b881-0d2167c238b0 req-7725ebf5-97e2-472f-9156-27429318344a service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:35.173725 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-080f62cb-71de-4645-b881-0d2167c238b0 req-7725ebf5-97e2-472f-9156-27429318344a service nova] Creating event network-vif-plugged:8bfc2b31-8b72-4e2e-b0d2-e7d33d407a13 for instance f5690265-cb0f-4be1-b509-ebfb4e34fbf1 on n-h2-843700-1 May 28 06:10:35.179422 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-080f62cb-71de-4645-b881-0d2167c238b0 req-7725ebf5-97e2-472f-9156-27429318344a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089581 May 28 06:10:35.180023 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4124/8134] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:10:36.011212 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-06b85386-df06-49de-92bc-585a57c40c24 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:10:36.011848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-06b85386-df06-49de-92bc-585a57c40c24 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: f5690265-cb0f-4be1-b509-ebfb4e34fbf1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:10:36.018791 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06b85386-df06-49de-92bc-585a57c40c24 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:36.019295 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06b85386-df06-49de-92bc-585a57c40c24 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:36.020078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06b85386-df06-49de-92bc-585a57c40c24 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:36.021027 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-06b85386-df06-49de-92bc-585a57c40c24 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:36.153039 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-06b85386-df06-49de-92bc-585a57c40c24 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:10:36.160650 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-06b85386-df06-49de-92bc-585a57c40c24 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1" status: 200 len: 1374 microversion: 2.1 time: 0.153439 May 28 06:10:36.161233 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4011/8135] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:10:36 2022] GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:10:37.176141 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:10:37.180946 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-9ce03909-49d1-4b70-9706-aa374e02d1aa tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:10:37.181672 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-9ce03909-49d1-4b70-9706-aa374e02d1aa tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: f5690265-cb0f-4be1-b509-ebfb4e34fbf1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:10:37.187840 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ce03909-49d1-4b70-9706-aa374e02d1aa tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:37.188296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ce03909-49d1-4b70-9706-aa374e02d1aa tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:37.189058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ce03909-49d1-4b70-9706-aa374e02d1aa tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:37.189494 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-9ce03909-49d1-4b70-9706-aa374e02d1aa tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:37.324118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-9ce03909-49d1-4b70-9706-aa374e02d1aa tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:10:37.331889 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-9ce03909-49d1-4b70-9706-aa374e02d1aa tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1" status: 200 len: 1559 microversion: 2.1 time: 0.157568 May 28 06:10:37.332464 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4125/8136] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:10:37 2022] GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:10:37.350645 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-8a080878-d1c0-4191-a2a0-ac5e8f9f3709 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:10:37.351310 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-8a080878-d1c0-4191-a2a0-ac5e8f9f3709 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: f5690265-cb0f-4be1-b509-ebfb4e34fbf1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:10:37.353378 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=6 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:10:37.359543 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a080878-d1c0-4191-a2a0-ac5e8f9f3709 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:37.360017 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a080878-d1c0-4191-a2a0-ac5e8f9f3709 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:37.360823 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a080878-d1c0-4191-a2a0-ac5e8f9f3709 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:37.361264 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-8a080878-d1c0-4191-a2a0-ac5e8f9f3709 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:37.493416 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-8a080878-d1c0-4191-a2a0-ac5e8f9f3709 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:10:37.501069 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-8a080878-d1c0-4191-a2a0-ac5e8f9f3709 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1" status: 200 len: 1559 microversion: 2.1 time: 0.155050 May 28 06:10:37.501655 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4012/8137] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:10:37 2022] GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:10:39.417243 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-a5a923d3-5ee6-4427-a1b1-810ee9f7170b req-e7ddfd1e-ac84-43f9-b9c6-46ed243d762e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5690265-cb0f-4be1-b509-ebfb4e34fbf1", "tag": "8bfc2b31-8b72-4e2e-b0d2-e7d33d407a13"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:10:39.421035 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=8 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:10:39.427225 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a5a923d3-5ee6-4427-a1b1-810ee9f7170b req-e7ddfd1e-ac84-43f9-b9c6-46ed243d762e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:10:39.427667 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-a5a923d3-5ee6-4427-a1b1-810ee9f7170b req-e7ddfd1e-ac84-43f9-b9c6-46ed243d762e service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:10:39.438751 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-a5a923d3-5ee6-4427-a1b1-810ee9f7170b req-e7ddfd1e-ac84-43f9-b9c6-46ed243d762e service nova] Creating event network-changed:8bfc2b31-8b72-4e2e-b0d2-e7d33d407a13 for instance f5690265-cb0f-4be1-b509-ebfb4e34fbf1 on n-h2-843700-1 May 28 06:10:39.444636 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-a5a923d3-5ee6-4427-a1b1-810ee9f7170b req-e7ddfd1e-ac84-43f9-b9c6-46ed243d762e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031201 May 28 06:10:39.445413 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4126/8138] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:12:34.489846 n-d-843700-1 devstack@n-api.service[126043]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7b68896-232d-4c87-8179-08a432c034dc] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 06:12:34.490710 n-d-843700-1 devstack@n-api.service[126043]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9cedd376-8074-49f5-962c-429331dc3c26] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 06:12:34.491527 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:12:34.492458 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=32 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:12:34.496485 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-b232524f-df36-45a1-b797-b51a3d1d0cfb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1185781698"}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:12:34.497530 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-b232524f-df36-45a1-b797-b51a3d1d0cfb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: f5690265-cb0f-4be1-b509-ebfb4e34fbf1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:12:34.503635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b232524f-df36-45a1-b797-b51a3d1d0cfb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:12:34.504104 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b232524f-df36-45a1-b797-b51a3d1d0cfb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:12:34.504891 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b232524f-df36-45a1-b797-b51a3d1d0cfb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:12:34.505346 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-b232524f-df36-45a1-b797-b51a3d1d0cfb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:12:34.989412 n-d-843700-1 devstack@n-api.service[126043]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b232524f-df36-45a1-b797-b51a3d1d0cfb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [20773a24-39e0-4623-ab12-cee0ec3ebabe] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 06:12:35.502294 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7b68896-232d-4c87-8179-08a432c034dc] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 35506. May 28 06:12:35.503042 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] [9cedd376-8074-49f5-962c-429331dc3c26] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 35508. May 28 06:12:35.996456 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [None req-b232524f-df36-45a1-b797-b51a3d1d0cfb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [20773a24-39e0-4623-ab12-cee0ec3ebabe] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 35510. May 28 06:12:36.002796 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-b232524f-df36-45a1-b797-b51a3d1d0cfb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "POST /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1/action" status: 202 len: 0 microversion: 2.1 time: 1.514980 May 28 06:12:36.003479 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4013/8139] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 06:12:34 2022] POST /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1/action => generated 0 bytes in 1516 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 06:12:39.661760 n-d-843700-1 devstack@n-api.service[126044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a1992b24-c6ca-47ed-a310-b37951ac973c] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 06:12:39.665173 n-d-843700-1 devstack@n-api.service[126044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7fb7b4e8-8c85-4700-986d-4cff401b6421] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 06:12:39.665173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:12:39.665173 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=30 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:12:39.669483 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-f9673350-e897-4eb6-9b90-75d15f2050ef req-bf40e84d-c441-45cb-97d8-8804182e1d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5690265-cb0f-4be1-b509-ebfb4e34fbf1", "name": "network-vif-plugged", "status": "completed", "tag": "8bfc2b31-8b72-4e2e-b0d2-e7d33d407a13"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:12:39.677663 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f9673350-e897-4eb6-9b90-75d15f2050ef req-bf40e84d-c441-45cb-97d8-8804182e1d84 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:12:39.678183 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-f9673350-e897-4eb6-9b90-75d15f2050ef req-bf40e84d-c441-45cb-97d8-8804182e1d84 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:12:39.689127 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-f9673350-e897-4eb6-9b90-75d15f2050ef req-bf40e84d-c441-45cb-97d8-8804182e1d84 service nova] Creating event network-vif-plugged:8bfc2b31-8b72-4e2e-b0d2-e7d33d407a13 for instance f5690265-cb0f-4be1-b509-ebfb4e34fbf1 on n-h2-843700-1 May 28 06:12:39.694247 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-f9673350-e897-4eb6-9b90-75d15f2050ef req-bf40e84d-c441-45cb-97d8-8804182e1d84 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034258 May 28 06:12:39.694900 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4127/8140] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:12:49.668804 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:12:49.669336 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 06:12:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:12:49.776426 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:12:49.776607 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 06:12:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:12:50.654646 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:12:50.656454 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:12:50.661412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6a2ee74f-34b9-4e5e-a0ec-12457128a4dc tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-157075078", "imageRef": "f1c6d6e5-4be4-4539-a990-53fc61d3b3d2", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-593310548", "security_groups": [{"name": "tempest-secgroup-smoke-2045093653"}], "networks": [{"uuid": "fe1ac134-d1ce-4f26-9d91-f73fad7e76f8"}]}} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:12:50.768239 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.network.neutron [None req-6a2ee74f-34b9-4e5e-a0ec-12457128a4dc tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] validate_networks() for [('fe1ac134-d1ce-4f26-9d91-f73fad7e76f8', None, None, None, None, None)] {{(pid=126043) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 06:12:51.196412 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-6a2ee74f-34b9-4e5e-a0ec-12457128a4dc tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Flavor limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 06:12:51.196913 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-6a2ee74f-34b9-4e5e-a0ec-12457128a4dc tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Image limits 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 06:12:51.197386 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-6a2ee74f-34b9-4e5e-a0ec-12457128a4dc tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Flavor pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 06:12:51.197819 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-6a2ee74f-34b9-4e5e-a0ec-12457128a4dc tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Image pref 0:0:0 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 06:12:51.198249 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.virt.hardware [None req-6a2ee74f-34b9-4e5e-a0ec-12457128a4dc tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 06:12:51.207803 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a2ee74f-34b9-4e5e-a0ec-12457128a4dc tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:12:51.208286 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a2ee74f-34b9-4e5e-a0ec-12457128a4dc tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:12:51.209108 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a2ee74f-34b9-4e5e-a0ec-12457128a4dc tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:12:51.209562 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6a2ee74f-34b9-4e5e-a0ec-12457128a4dc tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:12:51.227614 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-6a2ee74f-34b9-4e5e-a0ec-12457128a4dc tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Getting quotas for project 9114b2f82ff348689f0503bb3a36253a. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 06:12:51.233177 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.quota [None req-6a2ee74f-34b9-4e5e-a0ec-12457128a4dc tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Getting quotas for user 54c93294fe5f4245bf785037b3e35a07 and project 9114b2f82ff348689f0503bb3a36253a. Resources: {'cores', 'ram', 'instances'} {{(pid=126043) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 06:12:51.245464 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6a2ee74f-34b9-4e5e-a0ec-12457128a4dc tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Going to run 1 instances... {{(pid=126043) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 06:12:51.247928 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6a2ee74f-34b9-4e5e-a0ec-12457128a4dc tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1c6d6e5-4be4-4539-a990-53fc61d3b3d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 06:12:51.366340 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6a2ee74f-34b9-4e5e-a0ec-12457128a4dc tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.713487 May 28 06:12:51.367080 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4014/8141] 10.222.0.58 () {60 vars in 1146 bytes} [Sat May 28 06:12:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 06:12:51.382542 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2f9b7149-9613-4790-a335-fa3ce44096a9 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:12:51.383670 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-2f9b7149-9613-4790-a335-fa3ce44096a9 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:12:51.398272 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] [7fb7b4e8-8c85-4700-986d-4cff401b6421] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 35662. May 28 06:12:51.400639 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] [a1992b24-c6ca-47ed-a310-b37951ac973c] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 35660. May 28 06:12:51.447161 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-2f9b7149-9613-4790-a335-fa3ce44096a9 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:12:51.455477 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2f9b7149-9613-4790-a335-fa3ce44096a9 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1247 microversion: 2.1 time: 0.079484 May 28 06:12:51.456051 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4128/8142] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:12:51 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1247 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:12:52.472726 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-be5ec128-ccf1-45a2-bd2f-40aaa1775bc4 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:12:52.473360 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-be5ec128-ccf1-45a2-bd2f-40aaa1775bc4 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:12:52.530486 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-be5ec128-ccf1-45a2-bd2f-40aaa1775bc4 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:12:52.537363 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-be5ec128-ccf1-45a2-bd2f-40aaa1775bc4 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1247 microversion: 2.1 time: 0.069474 May 28 06:12:52.537926 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4015/8143] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:12:52 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1247 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:12:52.677224 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:12:52.677775 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 06:12:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:12:53.553714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-908799af-764c-4c2c-b425-9ad08194d145 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:12:53.554339 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-908799af-764c-4c2c-b425-9ad08194d145 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:12:53.607687 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-908799af-764c-4c2c-b425-9ad08194d145 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:12:53.615102 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-908799af-764c-4c2c-b425-9ad08194d145 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1247 microversion: 2.1 time: 0.065207 May 28 06:12:53.615687 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4129/8144] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:12:53 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1247 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:12:53.903783 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-e455f9f1-4282-4b4c-a56b-acacb7604959 req-145fcf06-b7a3-4a72-8551-b36284cb7273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5690265-cb0f-4be1-b509-ebfb4e34fbf1", "name": "network-vif-unplugged", "status": "completed", "tag": "8bfc2b31-8b72-4e2e-b0d2-e7d33d407a13"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:12:53.913892 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-e455f9f1-4282-4b4c-a56b-acacb7604959 req-145fcf06-b7a3-4a72-8551-b36284cb7273 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:12:53.914836 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-e455f9f1-4282-4b4c-a56b-acacb7604959 req-145fcf06-b7a3-4a72-8551-b36284cb7273 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:12:53.925644 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-e455f9f1-4282-4b4c-a56b-acacb7604959 req-145fcf06-b7a3-4a72-8551-b36284cb7273 service nova] Creating event network-vif-unplugged:8bfc2b31-8b72-4e2e-b0d2-e7d33d407a13 for instance f5690265-cb0f-4be1-b509-ebfb4e34fbf1 on n-h2-843700-1 May 28 06:12:53.931508 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-e455f9f1-4282-4b4c-a56b-acacb7604959 req-145fcf06-b7a3-4a72-8551-b36284cb7273 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031453 May 28 06:12:53.932097 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4016/8145] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:12:54.026157 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:12:54.026669 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 06:12:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:12:54.632742 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-65ad2417-ddcb-41e3-8b2f-8d0ffc008f4f tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:12:54.633355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-65ad2417-ddcb-41e3-8b2f-8d0ffc008f4f tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:12:54.686175 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-65ad2417-ddcb-41e3-8b2f-8d0ffc008f4f tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:12:54.693337 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-65ad2417-ddcb-41e3-8b2f-8d0ffc008f4f tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1247 microversion: 2.1 time: 0.064514 May 28 06:12:54.693903 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4130/8146] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:12:54 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1247 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:12:55.710974 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-6d1a06a3-8db7-4820-b189-9a5c834e9cc3 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:12:55.711698 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-6d1a06a3-8db7-4820-b189-9a5c834e9cc3 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:12:55.718806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6d1a06a3-8db7-4820-b189-9a5c834e9cc3 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:12:55.719301 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6d1a06a3-8db7-4820-b189-9a5c834e9cc3 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:12:55.720078 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6d1a06a3-8db7-4820-b189-9a5c834e9cc3 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:12:55.720525 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-6d1a06a3-8db7-4820-b189-9a5c834e9cc3 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:12:55.782222 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-6d1a06a3-8db7-4820-b189-9a5c834e9cc3 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:12:55.790167 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-6d1a06a3-8db7-4820-b189-9a5c834e9cc3 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1251 microversion: 2.1 time: 0.083425 May 28 06:12:55.790861 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4017/8147] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:12:55 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1251 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:12:56.807622 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-6db2f896-c35e-4e32-8b29-26a055bb77ce tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:12:56.808248 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-6db2f896-c35e-4e32-8b29-26a055bb77ce tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:12:56.815558 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6db2f896-c35e-4e32-8b29-26a055bb77ce tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:12:56.816021 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6db2f896-c35e-4e32-8b29-26a055bb77ce tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:12:56.816793 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6db2f896-c35e-4e32-8b29-26a055bb77ce tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:12:56.817262 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-6db2f896-c35e-4e32-8b29-26a055bb77ce tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:12:56.887660 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-6db2f896-c35e-4e32-8b29-26a055bb77ce tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:12:56.895237 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-6db2f896-c35e-4e32-8b29-26a055bb77ce tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1243 microversion: 2.1 time: 0.092107 May 28 06:12:56.895830 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4131/8148] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:12:56 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1243 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:12:57.913793 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-0ae8e69c-12ce-45da-8432-7951550349f2 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:12:57.914444 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-0ae8e69c-12ce-45da-8432-7951550349f2 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:12:57.927934 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ae8e69c-12ce-45da-8432-7951550349f2 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:12:57.928413 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ae8e69c-12ce-45da-8432-7951550349f2 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:12:57.934076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ae8e69c-12ce-45da-8432-7951550349f2 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:12:57.934076 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-0ae8e69c-12ce-45da-8432-7951550349f2 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:12:58.356377 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-0ae8e69c-12ce-45da-8432-7951550349f2 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:12:58.364740 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-0ae8e69c-12ce-45da-8432-7951550349f2 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1305 microversion: 2.1 time: 0.455700 May 28 06:12:58.365579 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4018/8149] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:12:57 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1305 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:12:59.389446 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c1d32f6b-7302-4cb7-99e8-6e4088958976 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:12:59.391071 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c1d32f6b-7302-4cb7-99e8-6e4088958976 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:12:59.402398 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1d32f6b-7302-4cb7-99e8-6e4088958976 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:12:59.404714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1d32f6b-7302-4cb7-99e8-6e4088958976 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:12:59.404714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1d32f6b-7302-4cb7-99e8-6e4088958976 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:12:59.404714 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c1d32f6b-7302-4cb7-99e8-6e4088958976 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:12:59.557077 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c1d32f6b-7302-4cb7-99e8-6e4088958976 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:12:59.566961 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c1d32f6b-7302-4cb7-99e8-6e4088958976 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1373 microversion: 2.1 time: 0.183490 May 28 06:12:59.568198 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4132/8150] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:12:59 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1373 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:13:00.586118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-bbdd5d33-7d75-497e-97e3-2c881028e88e tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:13:00.587587 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-bbdd5d33-7d75-497e-97e3-2c881028e88e tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:13:00.595210 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bbdd5d33-7d75-497e-97e3-2c881028e88e tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:00.595778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bbdd5d33-7d75-497e-97e3-2c881028e88e tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:00.596663 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bbdd5d33-7d75-497e-97e3-2c881028e88e tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:00.597233 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-bbdd5d33-7d75-497e-97e3-2c881028e88e tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:00.738943 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-bbdd5d33-7d75-497e-97e3-2c881028e88e tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:13:00.747303 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-bbdd5d33-7d75-497e-97e3-2c881028e88e tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1373 microversion: 2.1 time: 0.165635 May 28 06:13:00.747886 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4019/8151] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:13:00 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:13:01.764852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-ef53bdd7-8cf9-4861-9bea-35f471322ff1 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:13:01.765564 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-ef53bdd7-8cf9-4861-9bea-35f471322ff1 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:13:01.773249 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef53bdd7-8cf9-4861-9bea-35f471322ff1 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:01.773709 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef53bdd7-8cf9-4861-9bea-35f471322ff1 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:01.774975 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef53bdd7-8cf9-4861-9bea-35f471322ff1 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:01.775448 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-ef53bdd7-8cf9-4861-9bea-35f471322ff1 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:01.920807 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-ef53bdd7-8cf9-4861-9bea-35f471322ff1 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:13:01.929531 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-ef53bdd7-8cf9-4861-9bea-35f471322ff1 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1373 microversion: 2.1 time: 0.168803 May 28 06:13:01.939600 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4133/8152] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:13:01 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:13:02.947981 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-9ed35321-7b67-40eb-80b9-37759d0ad4e4 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:13:02.948597 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-9ed35321-7b67-40eb-80b9-37759d0ad4e4 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:13:02.950524 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=2 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:13:02.952079 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell0:SELECT=8 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:13:02.957134 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ed35321-7b67-40eb-80b9-37759d0ad4e4 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:02.957615 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ed35321-7b67-40eb-80b9-37759d0ad4e4 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:02.958419 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ed35321-7b67-40eb-80b9-37759d0ad4e4 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:02.958877 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-9ed35321-7b67-40eb-80b9-37759d0ad4e4 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:03.114334 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-9ed35321-7b67-40eb-80b9-37759d0ad4e4 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:13:03.122910 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-9ed35321-7b67-40eb-80b9-37759d0ad4e4 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1373 microversion: 2.1 time: 0.179411 May 28 06:13:03.133077 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4020/8153] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:13:02 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:13:04.140917 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-1b589adc-9fa9-43f4-b3c0-7184346f4fd0 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:13:04.143172 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-1b589adc-9fa9-43f4-b3c0-7184346f4fd0 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:13:04.150389 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b589adc-9fa9-43f4-b3c0-7184346f4fd0 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:04.150852 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b589adc-9fa9-43f4-b3c0-7184346f4fd0 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:04.151705 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b589adc-9fa9-43f4-b3c0-7184346f4fd0 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:04.152131 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-1b589adc-9fa9-43f4-b3c0-7184346f4fd0 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:04.298475 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-1b589adc-9fa9-43f4-b3c0-7184346f4fd0 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:13:04.306602 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-1b589adc-9fa9-43f4-b3c0-7184346f4fd0 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1373 microversion: 2.1 time: 0.169839 May 28 06:13:04.307452 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4134/8154] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:13:04 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:13:05.323966 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-42bc6bf2-bf7b-47b2-bf24-9b6d18f2065a tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:13:05.324716 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-42bc6bf2-bf7b-47b2-bf24-9b6d18f2065a tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:13:05.332010 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42bc6bf2-bf7b-47b2-bf24-9b6d18f2065a tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:05.332569 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42bc6bf2-bf7b-47b2-bf24-9b6d18f2065a tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:05.333441 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42bc6bf2-bf7b-47b2-bf24-9b6d18f2065a tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:05.333992 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-42bc6bf2-bf7b-47b2-bf24-9b6d18f2065a tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:05.576340 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-42bc6bf2-bf7b-47b2-bf24-9b6d18f2065a tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:13:05.583917 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-42bc6bf2-bf7b-47b2-bf24-9b6d18f2065a tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1373 microversion: 2.1 time: 0.263992 May 28 06:13:05.586844 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4021/8155] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:13:05 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1373 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:13:06.045307 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell0:SELECT=6 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:13:06.156124 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [req-6c4c4e3d-6ac2-4e4e-9e2b-773c49d4d048 req-6266e2cf-f6f3-4ca5-ac99-e8b64bcc81af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "152bf344-a17f-4ea0-b572-c55f3955db21", "tag": "2f2bda8a-f33f-441d-81af-76e5f50d3d41"}]} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:13:06.165602 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-6c4c4e3d-6ac2-4e4e-9e2b-773c49d4d048 req-6266e2cf-f6f3-4ca5-ac99-e8b64bcc81af service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:06.166058 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [req-6c4c4e3d-6ac2-4e4e-9e2b-773c49d4d048 req-6266e2cf-f6f3-4ca5-ac99-e8b64bcc81af service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:06.178142 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.compute.server_external_events [req-6c4c4e3d-6ac2-4e4e-9e2b-773c49d4d048 req-6266e2cf-f6f3-4ca5-ac99-e8b64bcc81af service nova] Creating event network-changed:2f2bda8a-f33f-441d-81af-76e5f50d3d41 for instance 152bf344-a17f-4ea0-b572-c55f3955db21 on n-h1-843700-1 May 28 06:13:06.183965 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [req-6c4c4e3d-6ac2-4e4e-9e2b-773c49d4d048 req-6266e2cf-f6f3-4ca5-ac99-e8b64bcc81af service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144738 May 28 06:13:06.184888 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4135/8156] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:13:06.601886 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-80c016bc-a265-48f8-a308-75819502caaa tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:13:06.603388 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-80c016bc-a265-48f8-a308-75819502caaa tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:13:06.610431 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80c016bc-a265-48f8-a308-75819502caaa tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:06.610917 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80c016bc-a265-48f8-a308-75819502caaa tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:06.611749 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80c016bc-a265-48f8-a308-75819502caaa tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:06.612208 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-80c016bc-a265-48f8-a308-75819502caaa tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:06.749972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-80c016bc-a265-48f8-a308-75819502caaa tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:13:06.757128 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-80c016bc-a265-48f8-a308-75819502caaa tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1373 microversion: 2.1 time: 0.159329 May 28 06:13:06.757709 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4022/8157] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:13:06 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:13:07.775894 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-8377746c-efc2-4823-9ba3-eea0846c0c88 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:13:07.776595 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-8377746c-efc2-4823-9ba3-eea0846c0c88 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:13:07.784060 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8377746c-efc2-4823-9ba3-eea0846c0c88 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:07.784556 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8377746c-efc2-4823-9ba3-eea0846c0c88 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:07.785451 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8377746c-efc2-4823-9ba3-eea0846c0c88 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:07.785901 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-8377746c-efc2-4823-9ba3-eea0846c0c88 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:07.927216 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-8377746c-efc2-4823-9ba3-eea0846c0c88 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:13:07.934875 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-8377746c-efc2-4823-9ba3-eea0846c0c88 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1373 microversion: 2.1 time: 0.163807 May 28 06:13:07.935485 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4136/8158] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:13:07 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:13:08.952118 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-c42845b7-2446-436b-a270-2a3ad2fc9ad9 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:13:08.952947 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-c42845b7-2446-436b-a270-2a3ad2fc9ad9 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:13:08.960022 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c42845b7-2446-436b-a270-2a3ad2fc9ad9 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:08.960494 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c42845b7-2446-436b-a270-2a3ad2fc9ad9 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:08.961284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c42845b7-2446-436b-a270-2a3ad2fc9ad9 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:08.961838 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-c42845b7-2446-436b-a270-2a3ad2fc9ad9 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:09.095146 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-c42845b7-2446-436b-a270-2a3ad2fc9ad9 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:13:09.103422 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-c42845b7-2446-436b-a270-2a3ad2fc9ad9 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1373 microversion: 2.1 time: 0.155008 May 28 06:13:09.104005 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4023/8159] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:13:08 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:13:10.121068 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-da0513ae-67bc-410e-8387-70db02c2ceeb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:13:10.121787 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-da0513ae-67bc-410e-8387-70db02c2ceeb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:13:10.129254 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da0513ae-67bc-410e-8387-70db02c2ceeb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:10.129715 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da0513ae-67bc-410e-8387-70db02c2ceeb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:10.130492 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da0513ae-67bc-410e-8387-70db02c2ceeb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:10.130935 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-da0513ae-67bc-410e-8387-70db02c2ceeb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:10.264919 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-da0513ae-67bc-410e-8387-70db02c2ceeb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:13:10.272406 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-da0513ae-67bc-410e-8387-70db02c2ceeb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1373 microversion: 2.1 time: 0.155809 May 28 06:13:10.272988 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4137/8160] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:13:10 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:13:10.972635 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-b203875b-fc2e-49cb-a0fe-4efb4f08fa47 req-2917c509-a9db-4c50-8991-e689b8270700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "152bf344-a17f-4ea0-b572-c55f3955db21", "name": "network-vif-plugged", "status": "completed", "tag": "2f2bda8a-f33f-441d-81af-76e5f50d3d41"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:13:10.982744 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b203875b-fc2e-49cb-a0fe-4efb4f08fa47 req-2917c509-a9db-4c50-8991-e689b8270700 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:10.983241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-b203875b-fc2e-49cb-a0fe-4efb4f08fa47 req-2917c509-a9db-4c50-8991-e689b8270700 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:10.997016 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-b203875b-fc2e-49cb-a0fe-4efb4f08fa47 req-2917c509-a9db-4c50-8991-e689b8270700 service nova] Creating event network-vif-plugged:2f2bda8a-f33f-441d-81af-76e5f50d3d41 for instance 152bf344-a17f-4ea0-b572-c55f3955db21 on n-h1-843700-1 May 28 06:13:11.002021 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-b203875b-fc2e-49cb-a0fe-4efb4f08fa47 req-2917c509-a9db-4c50-8991-e689b8270700 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033518 May 28 06:13:11.002619 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4024/8161] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 06:13:11.289732 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-e67739d4-1fc9-4fdc-82be-79870163ab66 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:13:11.290355 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-e67739d4-1fc9-4fdc-82be-79870163ab66 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:13:11.297316 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e67739d4-1fc9-4fdc-82be-79870163ab66 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:11.297788 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e67739d4-1fc9-4fdc-82be-79870163ab66 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:11.298598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e67739d4-1fc9-4fdc-82be-79870163ab66 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:11.299078 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-e67739d4-1fc9-4fdc-82be-79870163ab66 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:11.430129 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-e67739d4-1fc9-4fdc-82be-79870163ab66 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:13:11.437637 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-e67739d4-1fc9-4fdc-82be-79870163ab66 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1373 microversion: 2.1 time: 0.151866 May 28 06:13:11.438226 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4138/8162] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:13:11 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:13:12.456520 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5cf1fc05-562b-4f2e-bb88-8190df71393b tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:13:12.457165 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5cf1fc05-562b-4f2e-bb88-8190df71393b tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:13:12.464030 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5cf1fc05-562b-4f2e-bb88-8190df71393b tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:12.464513 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5cf1fc05-562b-4f2e-bb88-8190df71393b tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:12.465300 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5cf1fc05-562b-4f2e-bb88-8190df71393b tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:12.465762 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5cf1fc05-562b-4f2e-bb88-8190df71393b tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:12.600260 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5cf1fc05-562b-4f2e-bb88-8190df71393b tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:13:12.609222 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5cf1fc05-562b-4f2e-bb88-8190df71393b tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1557 microversion: 2.1 time: 0.158016 May 28 06:13:12.609800 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4025/8163] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:13:12 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:13:12.625965 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-a5bae85a-7de8-44c1-b98b-b9de1da26f37 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:13:12.626598 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-a5bae85a-7de8-44c1-b98b-b9de1da26f37 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:13:12.634198 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5bae85a-7de8-44c1-b98b-b9de1da26f37 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:12.635581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5bae85a-7de8-44c1-b98b-b9de1da26f37 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:12.635581 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5bae85a-7de8-44c1-b98b-b9de1da26f37 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:12.635998 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-a5bae85a-7de8-44c1-b98b-b9de1da26f37 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:12.768118 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-a5bae85a-7de8-44c1-b98b-b9de1da26f37 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:13:12.776411 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-a5bae85a-7de8-44c1-b98b-b9de1da26f37 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1557 microversion: 2.1 time: 0.154752 May 28 06:13:12.778807 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4139/8164] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:13:12 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:13:14.732064 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-33292074-d19a-4a92-a3e1-59b019820d2b req-f6a25237-e173-4766-822f-80178c8e1f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "152bf344-a17f-4ea0-b572-c55f3955db21", "tag": "2f2bda8a-f33f-441d-81af-76e5f50d3d41"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:13:14.741284 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-33292074-d19a-4a92-a3e1-59b019820d2b req-f6a25237-e173-4766-822f-80178c8e1f05 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:13:14.741942 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-33292074-d19a-4a92-a3e1-59b019820d2b req-f6a25237-e173-4766-822f-80178c8e1f05 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:13:14.753243 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-33292074-d19a-4a92-a3e1-59b019820d2b req-f6a25237-e173-4766-822f-80178c8e1f05 service nova] Creating event network-changed:2f2bda8a-f33f-441d-81af-76e5f50d3d41 for instance 152bf344-a17f-4ea0-b572-c55f3955db21 on n-h1-843700-1 May 28 06:13:14.758506 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-33292074-d19a-4a92-a3e1-59b019820d2b req-f6a25237-e173-4766-822f-80178c8e1f05 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031176 May 28 06:13:14.759219 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4026/8165] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:14:41.939973 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=32 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:14:41.940656 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=52 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:14:41.944662 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-57b60db0-0be3-493c-bec1-abab92c1f997 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1547345197"}} {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:14:41.945689 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-57b60db0-0be3-493c-bec1-abab92c1f997 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:14:41.952459 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57b60db0-0be3-493c-bec1-abab92c1f997 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:14:41.955789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57b60db0-0be3-493c-bec1-abab92c1f997 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:14:41.955789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57b60db0-0be3-493c-bec1-abab92c1f997 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:14:41.955789 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-57b60db0-0be3-493c-bec1-abab92c1f997 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:14:42.459145 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-57b60db0-0be3-493c-bec1-abab92c1f997 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "POST /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21/action" status: 202 len: 0 microversion: 2.1 time: 0.521197 May 28 06:14:42.459824 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4140/8166] 10.222.0.58 () {60 vars in 1277 bytes} [Sat May 28 06:14:41 2022] POST /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) May 28 06:14:47.357630 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:14:47.359469 n-d-843700-1 devstack@n-api.service[126043]: DEBUG dbcounter [-] [126043] Writing DB stats nova_cell1:SELECT=56 {{(pid=126043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:14:47.364665 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-127ccbcc-6dd6-4773-9c45-8c9c2605c472 req-c4bab2e3-4a81-4418-b0f4-a0a9f300dcac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "152bf344-a17f-4ea0-b572-c55f3955db21", "name": "network-vif-plugged", "status": "completed", "tag": "2f2bda8a-f33f-441d-81af-76e5f50d3d41"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:14:47.374886 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-127ccbcc-6dd6-4773-9c45-8c9c2605c472 req-c4bab2e3-4a81-4418-b0f4-a0a9f300dcac service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:14:47.375794 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-127ccbcc-6dd6-4773-9c45-8c9c2605c472 req-c4bab2e3-4a81-4418-b0f4-a0a9f300dcac service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:14:47.389063 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-127ccbcc-6dd6-4773-9c45-8c9c2605c472 req-c4bab2e3-4a81-4418-b0f4-a0a9f300dcac service nova] Creating event network-vif-plugged:2f2bda8a-f33f-441d-81af-76e5f50d3d41 for instance 152bf344-a17f-4ea0-b572-c55f3955db21 on n-h1-843700-1 May 28 06:14:47.394591 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-127ccbcc-6dd6-4773-9c45-8c9c2605c472 req-c4bab2e3-4a81-4418-b0f4-a0a9f300dcac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041253 May 28 06:14:47.400815 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4027/8167] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:14:58.771588 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-162fa884-5975-46aa-95a2-ee332ace1915 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:14:58.772296 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-162fa884-5975-46aa-95a2-ee332ace1915 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:14:58.775106 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-0588e976-8b0d-4dd1-880f-e362a86d29ae req-360fac0b-ded7-4acb-b2cb-a1c9120f59e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "152bf344-a17f-4ea0-b572-c55f3955db21", "tag": "2f2bda8a-f33f-441d-81af-76e5f50d3d41"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:14:58.775794 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_api:SELECT=2 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:14:58.776713 n-d-843700-1 devstack@n-api.service[126044]: DEBUG dbcounter [-] [126044] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 06:14:58.782076 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-162fa884-5975-46aa-95a2-ee332ace1915 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:14:58.782632 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-162fa884-5975-46aa-95a2-ee332ace1915 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:14:58.783690 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-162fa884-5975-46aa-95a2-ee332ace1915 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:14:58.784250 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-162fa884-5975-46aa-95a2-ee332ace1915 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:14:58.784806 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0588e976-8b0d-4dd1-880f-e362a86d29ae req-360fac0b-ded7-4acb-b2cb-a1c9120f59e3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:14:58.785267 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-0588e976-8b0d-4dd1-880f-e362a86d29ae req-360fac0b-ded7-4acb-b2cb-a1c9120f59e3 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:14:58.797726 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-0588e976-8b0d-4dd1-880f-e362a86d29ae req-360fac0b-ded7-4acb-b2cb-a1c9120f59e3 service nova] Creating event network-changed:2f2bda8a-f33f-441d-81af-76e5f50d3d41 for instance 152bf344-a17f-4ea0-b572-c55f3955db21 on n-h1-843700-1 May 28 06:14:58.804045 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-0588e976-8b0d-4dd1-880f-e362a86d29ae req-360fac0b-ded7-4acb-b2cb-a1c9120f59e3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034651 May 28 06:14:58.804978 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4028/8168] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:14:58.818678 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-162fa884-5975-46aa-95a2-ee332ace1915 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 06:14:59.078123 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-162fa884-5975-46aa-95a2-ee332ace1915 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "DELETE /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 204 len: 0 microversion: 2.1 time: 0.310811 May 28 06:14:59.079253 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4141/8169] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 06:14:58 2022] DELETE /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 06:14:59.089087 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-830eba46-7b84-4ebd-bd67-d4a3b7f8652d tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:14:59.089827 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-830eba46-7b84-4ebd-bd67-d4a3b7f8652d tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:14:59.096907 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-830eba46-7b84-4ebd-bd67-d4a3b7f8652d tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:14:59.097380 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-830eba46-7b84-4ebd-bd67-d4a3b7f8652d tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:14:59.098313 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-830eba46-7b84-4ebd-bd67-d4a3b7f8652d tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:14:59.098778 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-830eba46-7b84-4ebd-bd67-d4a3b7f8652d tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:14:59.295049 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-830eba46-7b84-4ebd-bd67-d4a3b7f8652d tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:14:59.304259 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-830eba46-7b84-4ebd-bd67-d4a3b7f8652d tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1682 microversion: 2.1 time: 0.218894 May 28 06:14:59.304259 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4029/8170] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:14:59 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:15:00.321528 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-41dfe198-754d-4495-b293-d5491f52b9be tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:15:00.322269 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-41dfe198-754d-4495-b293-d5491f52b9be tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:15:00.329240 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41dfe198-754d-4495-b293-d5491f52b9be tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:00.329702 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41dfe198-754d-4495-b293-d5491f52b9be tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:00.330474 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41dfe198-754d-4495-b293-d5491f52b9be tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:00.330920 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-41dfe198-754d-4495-b293-d5491f52b9be tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:00.534375 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-41dfe198-754d-4495-b293-d5491f52b9be tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:15:00.541991 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-41dfe198-754d-4495-b293-d5491f52b9be tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1682 microversion: 2.1 time: 0.224839 May 28 06:15:00.542573 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4142/8171] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:15:00 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1682 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:15:01.148602 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-be3ee86a-6aa7-432a-ad43-e29cf66b95a2 req-7e541b3c-5b73-4963-8758-705f7ec89cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "152bf344-a17f-4ea0-b572-c55f3955db21", "name": "network-vif-deleted", "tag": "2f2bda8a-f33f-441d-81af-76e5f50d3d41"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:15:01.157682 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-be3ee86a-6aa7-432a-ad43-e29cf66b95a2 req-7e541b3c-5b73-4963-8758-705f7ec89cf4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:01.158151 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-be3ee86a-6aa7-432a-ad43-e29cf66b95a2 req-7e541b3c-5b73-4963-8758-705f7ec89cf4 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:01.169455 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-be3ee86a-6aa7-432a-ad43-e29cf66b95a2 req-7e541b3c-5b73-4963-8758-705f7ec89cf4 service nova] Creating event network-vif-deleted:2f2bda8a-f33f-441d-81af-76e5f50d3d41 for instance 152bf344-a17f-4ea0-b572-c55f3955db21 on n-h1-843700-1 May 28 06:15:01.174610 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-be3ee86a-6aa7-432a-ad43-e29cf66b95a2 req-7e541b3c-5b73-4963-8758-705f7ec89cf4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029944 May 28 06:15:01.175377 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4030/8172] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:15:01.560241 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-72482dc0-9623-4b25-9dc4-5f497b18251c tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:15:01.560955 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-72482dc0-9623-4b25-9dc4-5f497b18251c tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:15:01.568436 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72482dc0-9623-4b25-9dc4-5f497b18251c tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:01.568902 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72482dc0-9623-4b25-9dc4-5f497b18251c tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:01.569696 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72482dc0-9623-4b25-9dc4-5f497b18251c tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:01.570146 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72482dc0-9623-4b25-9dc4-5f497b18251c tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:01.603904 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72482dc0-9623-4b25-9dc4-5f497b18251c tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:01.604368 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-72482dc0-9623-4b25-9dc4-5f497b18251c tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:01.604827 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-72482dc0-9623-4b25-9dc4-5f497b18251c tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lazy-loading 'fault' on Instance uuid 152bf344-a17f-4ea0-b572-c55f3955db21 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 06:15:01.646158 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-72482dc0-9623-4b25-9dc4-5f497b18251c tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:15:01.654222 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-72482dc0-9623-4b25-9dc4-5f497b18251c tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 200 len: 1337 microversion: 2.1 time: 0.098544 May 28 06:15:01.654801 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4143/8173] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:15:01 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 1337 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:15:02.673204 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1ee22614-7840-4b6d-a690-3d8dc13548d6 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:15:02.673932 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-1ee22614-7840-4b6d-a690-3d8dc13548d6 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: 152bf344-a17f-4ea0-b572-c55f3955db21] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:15:02.680241 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ee22614-7840-4b6d-a690-3d8dc13548d6 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:02.680719 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ee22614-7840-4b6d-a690-3d8dc13548d6 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:02.681510 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ee22614-7840-4b6d-a690-3d8dc13548d6 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:02.681969 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-1ee22614-7840-4b6d-a690-3d8dc13548d6 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:02.695534 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-1ee22614-7840-4b6d-a690-3d8dc13548d6 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] HTTP exception thrown: Instance 152bf344-a17f-4ea0-b572-c55f3955db21 could not be found. May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1ee22614-7840-4b6d-a690-3d8dc13548d6 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Request method failure captured: May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 HTTP/1.1 May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbzJwMeSsFY1_7X2k1GgenKDvAJrYx_6NirGus7Gl53AcOYL4RxrU4j-WhsENDRUoyfvifRT3MEyhpzzBLhR0ttip7Kd_lWNMpC01G8uzUMmG1fPUaQQiB7XqA0quEJ6rHx_6AGYKs9HsChVMvtIbmEsrxO14CeOUvu77WOvEesXMK4 May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 9114b2f82ff348689f0503bb3a36253a May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestSnapshotPattern-1510152594 May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9114b2f82ff348689f0503bb3a36253a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9114b2f82ff348689f0503bb3a36253a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9114b2f82ff348689f0503bb3a36253a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9114b2f82ff348689f0503bb3a36253a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestSnapshotPattern-1510152594 May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 9114b2f82ff348689f0503bb3a36253a May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestSnapshotPattern-1510152594 May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestSnapshotPattern-1510152594-project May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 54c93294fe5f4245bf785037b3e35a07 May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestSnapshotPattern-1510152594-project May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance 152bf344-a17f-4ea0-b572-c55f3955db21 could not be found. May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': '152bf344-a17f-4ea0-b572-c55f3955db21'} May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 152bf344-a17f-4ea0-b572-c55f3955db21 could not be found. May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 152bf344-a17f-4ea0-b572-c55f3955db21 could not be found. May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 06:15:02.697194 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 06:15:02.701389 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 06:15:02.701389 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 06:15:02.701389 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 06:15:02.701389 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 06:15:02.701389 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 06:15:02.701389 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 152bf344-a17f-4ea0-b572-c55f3955db21 could not be found. May 28 06:15:02.701389 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 06:15:02.701389 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-1ee22614-7840-4b6d-a690-3d8dc13548d6 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Returning 404 to user: Instance 152bf344-a17f-4ea0-b572-c55f3955db21 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 06:15:02.701389 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-1ee22614-7840-4b6d-a690-3d8dc13548d6 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21" status: 404 len: 111 microversion: 2.1 time: 0.030968 May 28 06:15:02.701389 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4031/8174] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:15:02 2022] GET /compute/v2.1/servers/152bf344-a17f-4ea0-b572-c55f3955db21 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 06:15:04.919016 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-816152fd-4e9b-4d82-b389-ed54fddbe726 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:15:04.919606 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-816152fd-4e9b-4d82-b389-ed54fddbe726 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: f5690265-cb0f-4be1-b509-ebfb4e34fbf1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:15:04.921440 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-73a14c0d-94a0-4b3c-ab98-fea9ce89501a req-a1093d6e-69a2-4435-bca2-4f55e0ca5c78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5690265-cb0f-4be1-b509-ebfb4e34fbf1", "tag": "8bfc2b31-8b72-4e2e-b0d2-e7d33d407a13"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:15:04.927413 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-816152fd-4e9b-4d82-b389-ed54fddbe726 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:04.927864 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-816152fd-4e9b-4d82-b389-ed54fddbe726 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:04.928923 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-816152fd-4e9b-4d82-b389-ed54fddbe726 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:04.929363 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-816152fd-4e9b-4d82-b389-ed54fddbe726 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:04.931121 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-73a14c0d-94a0-4b3c-ab98-fea9ce89501a req-a1093d6e-69a2-4435-bca2-4f55e0ca5c78 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:04.931596 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-73a14c0d-94a0-4b3c-ab98-fea9ce89501a req-a1093d6e-69a2-4435-bca2-4f55e0ca5c78 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:04.942407 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-73a14c0d-94a0-4b3c-ab98-fea9ce89501a req-a1093d6e-69a2-4435-bca2-4f55e0ca5c78 service nova] Creating event network-changed:8bfc2b31-8b72-4e2e-b0d2-e7d33d407a13 for instance f5690265-cb0f-4be1-b509-ebfb4e34fbf1 on n-h2-843700-1 May 28 06:15:04.947810 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-73a14c0d-94a0-4b3c-ab98-fea9ce89501a req-a1093d6e-69a2-4435-bca2-4f55e0ca5c78 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030262 May 28 06:15:04.948723 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4032/8175] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:15:04.958624 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-816152fd-4e9b-4d82-b389-ed54fddbe726 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: f5690265-cb0f-4be1-b509-ebfb4e34fbf1] Going to try to terminate instance {{(pid=126044) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 06:15:05.222490 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-816152fd-4e9b-4d82-b389-ed54fddbe726 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1" status: 204 len: 0 microversion: 2.1 time: 0.305787 May 28 06:15:05.222490 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4144/8176] 10.222.0.58 () {58 vars in 1238 bytes} [Sat May 28 06:15:04 2022] DELETE /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 06:15:05.231497 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-5784a037-5d9d-4e09-8f78-507dc496c6eb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:15:05.232144 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-5784a037-5d9d-4e09-8f78-507dc496c6eb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: f5690265-cb0f-4be1-b509-ebfb4e34fbf1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:15:05.239603 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5784a037-5d9d-4e09-8f78-507dc496c6eb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:05.240302 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5784a037-5d9d-4e09-8f78-507dc496c6eb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:05.241261 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5784a037-5d9d-4e09-8f78-507dc496c6eb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:05.241910 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-5784a037-5d9d-4e09-8f78-507dc496c6eb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:05.393152 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.policy [None req-5784a037-5d9d-4e09-8f78-507dc496c6eb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126043) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:15:05.401503 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-5784a037-5d9d-4e09-8f78-507dc496c6eb tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1" status: 200 len: 1684 microversion: 2.1 time: 0.175030 May 28 06:15:05.402103 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4033/8177] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:15:05 2022] GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1 => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:15:06.421545 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-c3705ac2-4eca-40d2-bf80-56602ca66b14 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:15:06.422868 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-c3705ac2-4eca-40d2-bf80-56602ca66b14 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: f5690265-cb0f-4be1-b509-ebfb4e34fbf1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:15:06.430288 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3705ac2-4eca-40d2-bf80-56602ca66b14 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:06.431253 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3705ac2-4eca-40d2-bf80-56602ca66b14 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:06.432051 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3705ac2-4eca-40d2-bf80-56602ca66b14 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:06.432497 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-c3705ac2-4eca-40d2-bf80-56602ca66b14 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:06.570090 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-c3705ac2-4eca-40d2-bf80-56602ca66b14 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:15:06.578067 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-c3705ac2-4eca-40d2-bf80-56602ca66b14 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1" status: 200 len: 1684 microversion: 2.1 time: 0.161922 May 28 06:15:06.578661 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4145/8178] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:15:06 2022] GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:15:07.283848 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [req-ca5d34bc-ebe3-43e9-a1f7-fb8bab984d99 req-0597afb5-c396-4393-9afa-695d94949a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5690265-cb0f-4be1-b509-ebfb4e34fbf1", "name": "network-vif-deleted", "tag": "8bfc2b31-8b72-4e2e-b0d2-e7d33d407a13"}]} {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 06:15:07.292187 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ca5d34bc-ebe3-43e9-a1f7-fb8bab984d99 req-0597afb5-c396-4393-9afa-695d94949a19 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:07.294522 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [req-ca5d34bc-ebe3-43e9-a1f7-fb8bab984d99 req-0597afb5-c396-4393-9afa-695d94949a19 service nova] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:07.303541 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.compute.server_external_events [req-ca5d34bc-ebe3-43e9-a1f7-fb8bab984d99 req-0597afb5-c396-4393-9afa-695d94949a19 service nova] Creating event network-vif-deleted:8bfc2b31-8b72-4e2e-b0d2-e7d33d407a13 for instance f5690265-cb0f-4be1-b509-ebfb4e34fbf1 on n-h2-843700-1 May 28 06:15:07.308705 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [req-ca5d34bc-ebe3-43e9-a1f7-fb8bab984d99 req-0597afb5-c396-4393-9afa-695d94949a19 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028790 May 28 06:15:07.309293 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4034/8179] 10.222.0.58 () {64 vars in 1317 bytes} [Sat May 28 06:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 06:15:07.596215 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-0ccf122c-283e-470c-b0c8-ae03dab7bb17 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:15:07.596851 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.compute.api [None req-0ccf122c-283e-470c-b0c8-ae03dab7bb17 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: f5690265-cb0f-4be1-b509-ebfb4e34fbf1] Fetching instance by UUID {{(pid=126044) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:15:07.604251 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ccf122c-283e-470c-b0c8-ae03dab7bb17 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:07.605028 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ccf122c-283e-470c-b0c8-ae03dab7bb17 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:07.606329 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ccf122c-283e-470c-b0c8-ae03dab7bb17 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:07.606775 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ccf122c-283e-470c-b0c8-ae03dab7bb17 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:07.642056 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ccf122c-283e-470c-b0c8-ae03dab7bb17 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:07.642520 n-d-843700-1 devstack@n-api.service[126044]: DEBUG oslo_concurrency.lockutils [None req-0ccf122c-283e-470c-b0c8-ae03dab7bb17 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:07.642998 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.objects.instance [None req-0ccf122c-283e-470c-b0c8-ae03dab7bb17 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lazy-loading 'fault' on Instance uuid f5690265-cb0f-4be1-b509-ebfb4e34fbf1 {{(pid=126044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 06:15:07.697461 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.policy [None req-0ccf122c-283e-470c-b0c8-ae03dab7bb17 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c93294fe5f4245bf785037b3e35a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9114b2f82ff348689f0503bb3a36253a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126044) authorize /opt/stack/nova/nova/policy.py:199}} May 28 06:15:07.705546 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-0ccf122c-283e-470c-b0c8-ae03dab7bb17 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1" status: 200 len: 1338 microversion: 2.1 time: 0.113449 May 28 06:15:07.706136 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4146/8180] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:15:07 2022] GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1 => generated 1338 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 06:15:08.724644 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-24b4e1de-6774-4877-8fb6-e8c7c4a58c4d tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '>' {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:15:08.725607 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.compute.api [None req-24b4e1de-6774-4877-8fb6-e8c7c4a58c4d tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] [instance: f5690265-cb0f-4be1-b509-ebfb4e34fbf1] Fetching instance by UUID {{(pid=126043) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 06:15:08.732544 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24b4e1de-6774-4877-8fb6-e8c7c4a58c4d tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:08.733005 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24b4e1de-6774-4877-8fb6-e8c7c4a58c4d tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:08.733780 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24b4e1de-6774-4877-8fb6-e8c7c4a58c4d tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 06:15:08.734227 n-d-843700-1 devstack@n-api.service[126043]: DEBUG oslo_concurrency.lockutils [None req-24b4e1de-6774-4877-8fb6-e8c7c4a58c4d tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Lock "8c12a9b9-d304-4763-b71f-4058d5ce2ded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 06:15:08.747379 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.wsgi [None req-24b4e1de-6774-4877-8fb6-e8c7c4a58c4d tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] HTTP exception thrown: Instance f5690265-cb0f-4be1-b509-ebfb4e34fbf1 could not be found. May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-24b4e1de-6774-4877-8fb6-e8c7c4a58c4d tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Request method failure captured: May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: request: GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1 HTTP/1.1 May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: Accept: application/json May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: Accept-Encoding: identity May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: Connection: close May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: Content-Length: 0 May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: Content-Type: application/json May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: Host: 10.222.0.58 May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: Openstack-System-Scope: None May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: User-Agent: python-urllib3/1.26.9 May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: X-Auth-Token: gAAAAABikbzJwMeSsFY1_7X2k1GgenKDvAJrYx_6NirGus7Gl53AcOYL4RxrU4j-WhsENDRUoyfvifRT3MEyhpzzBLhR0ttip7Kd_lWNMpC01G8uzUMmG1fPUaQQiB7XqA0quEJ6rHx_6AGYKs9HsChVMvtIbmEsrxO14CeOUvu77WOvEesXMK4 May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Id: None May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: X-Domain-Name: None May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: X-Identity-Status: Confirmed May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: X-Is-Admin-Project: True May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Id: default May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Domain-Name: Default May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Id: 9114b2f82ff348689f0503bb3a36253a May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: X-Project-Name: tempest-TestSnapshotPattern-1510152594 May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: X-Role: reader,member May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: X-Roles: reader,member May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9114b2f82ff348689f0503bb3a36253a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9114b2f82ff348689f0503bb3a36253a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9114b2f82ff348689f0503bb3a36253a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9114b2f82ff348689f0503bb3a36253a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}] May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant: tempest-TestSnapshotPattern-1510152594 May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Id: 9114b2f82ff348689f0503bb3a36253a May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: X-Tenant-Name: tempest-TestSnapshotPattern-1510152594 May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: X-User: tempest-TestSnapshotPattern-1510152594-project May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Id: default May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: X-User-Domain-Name: Default May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: X-User-Id: 54c93294fe5f4245bf785037b3e35a07 May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: X-User-Name: tempest-TestSnapshotPattern-1510152594-project May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: method: > May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: exception: Instance f5690265-cb0f-4be1-b509-ebfb4e34fbf1 could not be found. May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: action_args: {'id': 'f5690265-cb0f-4be1-b509-ebfb4e34fbf1'} May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: {{(pid=126043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5690265-cb0f-4be1-b509-ebfb4e34fbf1 could not be found. May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5690265-cb0f-4be1-b509-ebfb4e34fbf1 could not be found. May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 06:15:08.748972 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 06:15:08.752979 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 06:15:08.752979 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 06:15:08.752979 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 06:15:08.752979 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 06:15:08.752979 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 06:15:08.752979 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5690265-cb0f-4be1-b509-ebfb4e34fbf1 could not be found. May 28 06:15:08.752979 n-d-843700-1 devstack@n-api.service[126043]: ERROR nova.api.openstack.wsgi May 28 06:15:08.752979 n-d-843700-1 devstack@n-api.service[126043]: DEBUG nova.api.openstack.wsgi [None req-24b4e1de-6774-4877-8fb6-e8c7c4a58c4d tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Returning 404 to user: Instance f5690265-cb0f-4be1-b509-ebfb4e34fbf1 could not be found. {{(pid=126043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 06:15:08.752979 n-d-843700-1 devstack@n-api.service[126043]: INFO nova.api.openstack.requestlog [None req-24b4e1de-6774-4877-8fb6-e8c7c4a58c4d tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1" status: 404 len: 111 microversion: 2.1 time: 0.031142 May 28 06:15:08.752979 n-d-843700-1 devstack@n-api.service[126043]: [pid: 126043|app: 0|req: 4035/8181] 10.222.0.58 () {58 vars in 1235 bytes} [Sat May 28 06:15:08 2022] GET /compute/v2.1/servers/f5690265-cb0f-4be1-b509-ebfb4e34fbf1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 06:15:08.984042 n-d-843700-1 devstack@n-api.service[126044]: DEBUG nova.api.openstack.wsgi [None req-2eb686bd-3a8b-488f-a01f-e7a955934d57 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] Calling method '.version_select at 0x7f7700efc700>' {{(pid=126044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 06:15:09.060219 n-d-843700-1 devstack@n-api.service[126044]: INFO nova.api.openstack.requestlog [None req-2eb686bd-3a8b-488f-a01f-e7a955934d57 tempest-TestSnapshotPattern-1510152594 tempest-TestSnapshotPattern-1510152594-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-593310548" status: 202 len: 0 microversion: 2.1 time: 0.080111 May 28 06:15:09.060832 n-d-843700-1 devstack@n-api.service[126044]: [pid: 126044|app: 0|req: 4147/8182] 10.222.0.58 () {58 vars in 1253 bytes} [Sat May 28 06:15:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-593310548 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 06:16:09.677303 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:16:09.677773 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 06:16:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:16:09.785128 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:16:09.785286 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 06:16:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:16:14.035824 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:16:14.036489 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 06:16:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:17:52.687017 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:17:52.687739 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 06:17:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:18:13.804132 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:18:13.804719 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 06:18:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:18:17.000252 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:18:17.000781 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 06:18:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:19:29.685231 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:19:29.685856 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 06:19:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:19:29.792987 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:19:29.793120 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 06:19:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:19:34.045214 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:19:34.045766 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 06:19:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:21:12.695568 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:21:12.696339 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 06:21:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:21:33.812770 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:21:33.813265 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 06:21:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:21:37.009633 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:21:37.010102 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 06:21:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:22:49.694156 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:22:49.694721 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 06:22:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:22:49.800583 n-d-843700-1 devstack@n-api.service[126043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:22:49.800732 n-d-843700-1 devstack@n-api.service[126043]: Sat May 28 06:22:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 06:22:54.053667 n-d-843700-1 devstack@n-api.service[126044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 06:22:54.054175 n-d-843700-1 devstack@n-api.service[126044]: Sat May 28 06:22:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!